How to build my first module With SDK and Webhooks
In this article, we will describe how to build your first module for FinanceGPT so you can run your own code against the chat.
As an example, we are going to deploy the most simple app from this repository the demo app: https://github.com/Unique-AG/sdk-deploy-template
Table of Contents:
Ensure a reachable Webhook endpoint (not needed in local dev setup)
To do that we need to create a connection between Unique FinanceGPT and your development environment. For this we use ngrok but you can also use any other way to get a webhook redirected to your development machine. E.g. Azure functions or other mechanisms. It is important that the data can connect from your FinanceGPT environment to your local machine somehow.
Here is an example with ngrok: this forwards the https://cbac-178-197-218-164.ngrok-free.app
to your local 5001 port, where the apps will run.
ngrok http 5001
---
ngrok (Ctrl+C to quit)
K8s Gateway API support available now: https://ngrok.com/r/k8sgb
Session Status online
Account Andreas Hauri (Plan: Free)
Update update available (version 3.9.0, Ctrl-U to update)
Version 3.8.0
Region Europe (eu)
Latency 13ms
Web Interface http://127.0.0.1:4040
Forwarding https://cbac-178-197-218-164.ngrok-free.app -> http://localhost:5001
Connections ttl opn rt1 rt5 p50 p90
543 0 0.00 0.00 2.40 45.26
HTTP Requests
-------------
POST /webhook 200 OK
POST /webhook 200 OK
Ā
Setting up the app
Now login to Unique and go to the app registration. This requires admin rights to do so.
Create a new app
Ā
Activate the app
Add an endpoint
Make sure you know the URL that your machine is exposing, here it is the ngrok URL but it is webhook because the demo application exposes that.In development
was chosen so the webhook does not expire on too many errors
The unique.chat.external-module.chosen
is the event we are expecting.
Ā
Ā
Now you can see that it created a key named using_***
which you can expose. This is used for validating on the demo application side that the request is coming from this unique instance and from nowhere else.
Create an API key
Now you create an API KEY
Dont worry my app will be deleted after writing this so you can ignore it.
Ā
You will only see this once! Copy the key and store it SECURELY. This has the potential to leak a lot of data to the world.
Remember all the variables for the Python App
Now we need all this info (yes this is the .env variable for your app!):
API_KEY=ukey_qXqoh5lGhTa399CPNHHLUqnkIaWXlwRwAWtPJSrubyM
APP_ID=app_ueltalg142m341pskcankxk0
API_BASE=https://gateway.oleole.unique.app/public/chat
ENDPOINT_SECRET=usig_ad4wJ17fETob6uh0CYasNVn_aYtU1MRH4YnMrMiXjNE
API Base must be set correctly
API_BASE
is very important to do it right:
Local dev setup:
Base url:
http://localhost:8092/public
Remote setup:
no trailing / be careful
public/chat (not the other way around)
make sure you use the correct host! you can look it up in any graphql request on the front end like in the picture below (this is the one from the next multi-tenant):
Ā
Defining the module
Create a Module Template in the UI
Use the āAI Module Templatesā section in the Unique solutionās frontend to create a custom module template for your SDK module. Documentation on this can be found here: AI Module Templates | Creating an AI Module Template.
Create a Module Template via API (Deprecated)
Now we need to make sure that you can create the module that will react to the event in a space.
For this, we need a bit of API magic for the moment.
Here is the simplest way. Copy your bearer Token from the browser illustrated in the picture below:
Run the GraphQL via Postman
Now you will need to execute a graphql request like this one for example in Postman:
Make sure you have set the correct URL:
Local dev setup, use
http://localhost:8092/graphql
For remote setup, see the graphql request from the browser like above
The name here is very important. Your app will receive a payload that contains this name should it be called upon.
the descriptions are also very important. Here you see that this function will only be called if asked for a demo. This is up to you to provide and also test how well it reacts to its intent.
And make sure you have set the correct Bearer token like in the example below, which is the token copied from above.
There is no Bearer in front and no carriage return at the end!
Here is the mutation as text:
mutation CreateModuleTemplate {
createModuleTemplate(
input: {
configuration: { languageModel: "AZURE_GPT_35_TURBO_16K" }
isExternal: true
name: "DemoApp"
templateName: "Demo App Template Name"
toolDefinition: {
type: "function"
function: {
name: "DemoApp"
parameters: {
type: "object"
properties: {
instruction: {
type: "string"
description: "The instruction given by the employee e.g., 'Demo my App please' or 'Tell me about the demo'."
}
}
}
description: "This function is specifically designed for demos"
}
}
weight: 5500
}
) {
templateName
companyId
}
}
Use the Module in a space
Now if you go into the spaces you can choose this as a module so:
Select the Email Writer module first:
Go ahead and publish it. Dont worry, only you can see this space for now.
Select the created Module Template
See the last entry and select this (Demo App Template Name
) and also for example the email writer module.
Publish again.
Running your Python app
Ā
Now you are all set to run your app locally so it can react to chat messages:
In the location where you cloned the template repo https://github.com/Unique-AG/sdk-deploy-template
The .env file
Go into the directory of the assistant_demo app and add the .env file with your settings:
All of these are different for you! Make sure they are correct biggest source of mistakes usually!
Look at the prefixes of the key app using
Remember how a correct API_BASE is defined
Ā
Now go to the terminal and execute the following in that folder:
Modify the App to act as a Module
We can now edit the app and make some modifications:
This is the app.py of the example we need to modify it in a few places:
Check now to make sure that the app does:
Not react to
unique.chat.user-message.created
but to aunique.chat.external-module.chosen
event.React only if it is the defined
DemoApp
Ensure that the
assistant_id
is taken from the event and not from the env variablesThe text is now on the user message object
event["payload"]["userMessage"]["text"]
We also echo the message back to the user
Here the last part changes from lines 72 to 89:
Save and the flask app should automatically restart.
Now chat within the created Demo space
What you see in the console of flask:
Ā
The frontend of Unique:
Ā
Author | @Andreas Hauri |
---|
Ā© 2024 Unique AG. All rights reserved. Privacy Policy ā Terms of Service