{"type":"doc","content":[{"type":"paragraph","content":[{"text":"There are rare cases where you want to talk directly to the Large Language Models that are attached to your Unique AI instance. The following page describes how to do so and which terms & conditions apply.","type":"text"}]},{"type":"extension","attrs":{"layout":"default","extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{"minLevel":{"value":"1"},"maxLevel":{"value":"6"},"outline":{"value":"false"},"style":{"value":"default"},"type":{"value":"list"},"printable":{"value":"true"}},"macroMetadata":{"macroId":{"value":"464d9d52-f018-40e0-b24d-628936ae6a48"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}},"localId":"7302836a-8ffb-4e34-9bdd-02b5fecc76f5"}},{"type":"paragraph","content":[{"text":"This page describes how to use an internal API of Unique, which comes with certain implications:","type":"text"}]},{"type":"paragraph","content":[{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.macro.core","extensionKey":"excerpt-include","parameters":{"macroParams":{"":{"value":"APIs & Integrations"},"name":{"value":"internal-api-warning"},"nopanel":{"value":"true"}},"macroMetadata":{"macroId":{"value":"717a26e8-a454-46ae-9c9e-3230538ba884"},"schemaVersion":{"value":"1"},"title":"Insert excerpt"}},"localId":"c9908d8d-2338-4a20-861b-8767080a6435"}}]},{"type":"paragraph","content":[{"text":"By using the internal API as outlined, you automatically agree to the ","type":"text"},{"text":"#Terms-and-Conditions","type":"text","marks":[{"type":"link","attrs":{"href":"#"}}]},{"text":" described below.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Disclaimer","type":"text"}]},{"type":"panel","attrs":{"panelType":"success"},"content":[{"type":"paragraph","content":[{"text":"The recommended way to use the inbuilt LXM is to use the ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/445251891"}},{"text":" with the Public API as outlined in ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/579239944"}},{"text":".","type":"text"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Terms and Conditions","type":"text"}]},{"type":"paragraph","content":[{"text":"By using this API (especially but not only on a Unique ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/445808926"}},{"text":") you automatically accept the following terms:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"You agree to cover all costs resulting from any usage of the internal API, especially when used programmatically. The cost is charged in the same means as if you would use the Chat User Interface.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"You are aware that all models are differently priced.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"You release UNIQUE from any Unique Credits Claims resulting from improper API usage, such as impacting the Client's own Unique tenant with improper use, especially but not exclusively, for Chat and Ingestion functionalities.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"You accept that Incidents related to using this API improperly are not covered under any signed SLA.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Support in regards to this endpoint is best-effort based and is not covered under any signed SLA.","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"Design considerations","type":"text"}]},{"type":"panel","attrs":{"panelType":"warning"},"content":[{"type":"paragraph","content":[{"text":"As said in the disclaimer, it is strongly discouraged and not supported to build automations or integrations against this internal API. If you decide to use the API programmatically, stick to the following bullets to keep the impact low.","type":"text"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do space the requests out over time","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do limit the amount of parallel requests","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do not 'Denial Of Service' the endpoint.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do select the model to use carefully (remember the cost impact and that you agreed to cover it by using the API)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do avoid unlimited retries and back them off exponentially if needed","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"These bullets are guidelines and do not render Uniques liability in case of improper usage.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"Authenticating towards the API","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"},{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.macro.core","extensionKey":"excerpt-include","parameters":{"macroParams":{"":{"value":"Multitenant Region URLs"},"nopanel":{"value":"true"}},"macroMetadata":{"macroId":{"value":"e7d63700-44dd-4df6-9c6e-b3ed41cbac26"},"schemaVersion":{"value":"1"},"title":"Insert excerpt"}},"localId":"d8fcdb1d-e69c-4ff9-8564-6813b1559e82"}}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Prerequisites","type":"text"}]},{"type":"paragraph","content":[{"text":"Whether user or service user, the entity used must have the Unique Role (","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/513704008"}},{"text":") ","type":"text"},{"text":"chat.admin.all","type":"text","marks":[{"type":"code"}]},{"text":" assigned.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"As user","type":"text"}]},{"type":"paragraph","content":[{"text":"You can learn how to get a valid token for your personal user using ","type":"text"},{"text":"this guide","type":"text","marks":[{"type":"link","attrs":{"href":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/577929672"}}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"As service user","type":"text"}]},{"type":"paragraph","content":[{"text":"Prerequisite","type":"text","marks":[{"type":"strong"}]},{"text":": Having ","type":"text"},{"text":"cliendId","type":"text","marks":[{"type":"code"}]},{"text":" and ","type":"text"},{"text":"clientSecret","type":"text","marks":[{"type":"code"}]},{"text":" of a Service User (","type":"text"},{"text":"Learn here how","type":"text","marks":[{"type":"link","attrs":{"href":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/588546089/Service+User+configuration#Getting-a-JWT-access-token"}}]},{"text":").","type":"text"}]},{"type":"paragraph","content":[{"text":"This cURL will issue token that can be used to interact with the internal API.","type":"text"}]},{"type":"codeBlock","content":[{"text":"curl --location 'https://id..unique.app/oauth/v2/token' \\\n--header 'Content-Type: application/x-www-form-urlencoded' \\\n--header 'Authorization: Basic ' \\\n--data-urlencode 'grant_type=client_credentials' \\\n--data-urlencode 'scope=openid profile email urn:zitadel:iam:user:resourceowner urn:zitadel:iam:org:projects:roles urn:zitadel:iam:org:project:id::aud'","type":"text"}]},{"type":"table","attrs":{"layout":"default","width":760.0,"localId":"05b7ccc5-8268-461a-abe6-fbb1673ef3f7"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Where <> is","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Example","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"The tenants sub-domain.","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"oleole","type":"text","marks":[{"type":"code"}]},{"text":" (part of ","type":"text"},{"text":"id.oleole.unique.app","type":"text","marks":[{"type":"code"}]},{"text":")","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"clientId:clientSecret","type":"text","marks":[{"type":"code"}]},{"text":" but base64 encoded.","type":"text"}]},{"type":"codeBlock","content":[{"text":"echo \"cliendId:clientSecret\" | base64","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Y2xpZW5kSWQ6Y2............xpZW50U2VjcmV0Cg==","type":"text","marks":[{"type":"code"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"The Project ID of your Zitadel instance where the Authorizations for ","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/513704008"}},{"text":" are granted on.","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"225334283118523771","type":"text","marks":[{"type":"code"}]}]}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"Using the API","type":"text"}]},{"type":"codeBlock","content":[{"text":"curl --location 'https://gateway..unique.app/chat/openai?timeout=&languageModel=' \\\n--header 'Content-Type: application/json' \\\n--header 'Authorization: Bearer ' \\\n--data '[\n {\n \"role\": \"user\",\n \"content\": \"What is my ?\"\n }\n]'","type":"text"}]},{"type":"table","attrs":{"layout":"default","width":760.0,"localId":"9099023d-8f60-4bf1-a57d-7fdad5aea49a"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"Where <> is","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"Example","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"The tenants sub-domain.","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"oleole","type":"text","marks":[{"type":"code"}]},{"text":" (part of ","type":"text"},{"text":"gateway.oleole.unique.app","type":"text","marks":[{"type":"code"}]},{"text":")","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"Timeout in ","type":"text"},{"text":"Milliseconds","type":"text","marks":[{"type":"strong"}]},{"text":"!","type":"text"}]},{"type":"paragraph","content":[{"text":"The default is 8 seconds, the maximum is 10 minutes.","type":"text"}]},{"type":"panel","attrs":{"panelIconId":"23f0","panelIcon":":alarm_clock:","panelIconText":"⏰","panelColor":"#FFFAE6","panelType":"custom"},"content":[{"type":"paragraph","content":[{"text":"Note that depending on the model you chose, the answer can take time to generate!","type":"text"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"15000","type":"text","marks":[{"type":"code"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"One of the supported models (","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/445775966/Assistant+module+settings#Available-GPT-models"}},{"text":" ) or actually your own (","type":"text"},{"type":"inlineCard","attrs":{"url":"https://unique-ch.atlassian.net/wiki/spaces/PUB/pages/639205455"}},{"text":"). ","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"AZURE_GPT_4o_2024_0513","type":"text","marks":[{"type":"code"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"The token you got in the ","type":"text"},{"text":"Authenticating","type":"text","marks":[{"type":"link","attrs":{"href":"#Authenticating-towards-the-API"}}]},{"text":" step.","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"eyJhb………KtOi0Vw","type":"text","marks":[{"type":"code"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[404.0]},"content":[{"type":"paragraph","content":[{"text":"The prompt for the model!","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[209.0]},"content":[{"type":"paragraph","content":[{"text":"What is the contrast color of red?","type":"text","marks":[{"type":"code"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[145.0]},"content":[{"type":"paragraph","content":[{"text":"role: user","type":"text","marks":[{"type":"em"}]}]}]},{"type":"tableCell","attrs":{"colspan":2,"rowspan":1,"colwidth":[404.0,209.0]},"content":[{"type":"paragraph","content":[{"text":"Learn from OpenAI what the roles mean…","type":"text","marks":[{"type":"link","attrs":{"href":"https://platform.openai.com/docs/guides/chat-completions"}}]}]}]}]}]},{"type":"codeBlock","attrs":{"language":"yaml"},"content":[{"text":"{\n ...\n \"model\": \"gpt-4o-2024-05-13\",\n \"usage\": {\n \"promptTokens\": 15,\n \"completionTokens\": 58,\n \"totalTokens\": 73\n },\n ...\n \"choices\": [\n {\n \"index\": 0,\n \"finishReason\": \"stop\",\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"The contrast color of red, often referred to as its complementary color, is green. This is based on the color wheel, where complementary colors are positioned directly opposite each other. When placed next to each other, complementary colors create a strong visual contrast and can make each other appear more vibrant.\",\n \"toolCalls\": []\n }\n }\n ]\n}","type":"text"}]},{"type":"paragraph"},{"type":"rule"},{"type":"table","attrs":{"layout":"default","width":633.0,"localId":"6323a696-9107-4db3-837d-a4bb801dea5b"},"marks":[{"type":"fragment","attrs":{"name":"Table 5","localId":"24efb372-9919-45c4-a805-ed04f4ab88a9"}}],"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"background":"var(--ds-background-accent-gray-subtlest, #F4F5F7)","rowspan":1,"colwidth":[110.0]},"content":[{"type":"paragraph","content":[{"text":"Author","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[523.0]},"content":[{"type":"paragraph","content":[{"type":"mention","attrs":{"id":"624ebe8d45ece00069ce737e","localId":"a489331e-6a4b-4ec5-9605-748dde5a190a","text":"@Dominik Meyer"}},{"text":" ","type":"text"}]}]}]}]},{"type":"paragraph","content":[{"text":" ","type":"text"}]}],"version":1}

Browser not supported