Excerpt | ||
---|---|---|
| ||
Overview of Unique AI architecture and basic concepts. |
...
A tokenizer is a crucial component that processes input text to be understood by the model. It segments text into tokens, which can be words, subwords, or characters. Each token is then matched with a unique integer from a pre-established vocabulary on which the model was trained. For words not in the vocabulary, the tokenizer uses special strategies, such as breaking them down into known subwords or using a placeholder for unknown tokens. Additionally, tokenizers may encode extra information like text format and token positions to aid the FinanceGPTUnique AI's comprehension. Once tokenized, the sequence of integers is ready for the model to process. After FinanceGPT Unique AI generates its output, a reverse process, known as detokenization, is used to convert the token IDs back into readable text.
...
This is a streamlined processes integrated within FinacneGPTs Unique AI’s architecture that facilitate the seamless transformation of raw data into actionable insights. These pipelines are carefully designed to preprocess input text, manage data flow through the model's layers, and post-process the output to generate coherent and contextually appropriate responses. The pipelines handle tasks such as tokenization, embedding, attention mechanism management, etc.
...
Note |
---|
This feature is currently only available for the On Premise Tenant deployment model. |
FinanceGPT Unique AI allows for further training on a specific dataset to adapt its knowledge and improve its performance on tasks relevant to that dataset. By fine-tuning FinanceGPT Unique AI on a dataset that includes bilingual or multilingual financial texts, the model learns to translate domain-specific vocabulary more accurately. Furthermore, financial language is often nuanced and context-dependent. Fine-tuning helps the model grasp these subtleties in different languages, improving the quality of translation. Lastly, financial terms can have different meanings in different contexts. Fine-tuning on context-rich examples helps the model disambiguate terms more effectively during translation.
...
Unique can provide a dedicated API that allows developers from our clients to customize FinanceGPT Unique AI for their specific tasks or datasets.
...
Unique offers an SDK specifically designed for FinanceGPT Unique AI via an public API.
Info |
---|
Please read here more: Software Development Kit (SDK) |
...