| Excerpt | ||
|---|---|---|
| ||
Overview of Unique FinanceGPT architecture and basic concepts. |
...
The ingestion service is responsible for taking in files from various sources, such as web pages, SharePoint, or Atlassian products, and bringing them into the system. It handles different file types, including PDFs, Word documents, Excel files, PowerPoint presentations, text files, CSV files, and Markdown files. The service converts these files into Markdown format, preserving the structure and extracting important information like titles, subtitles, and tables. It then creates chunks out of these documents and saves them into a vector database and a Postgres database. The ingestion service also handles scalability and performance, as it needs to be able to handle large volumes of documents being ingested into the system.
More details: https://unique-ch.atlassian.net/wiki/pages/createpage.action?spaceKey=PUB&title=Ingestion&linkCreation=true&fromPageId=445743377
Ingestion Workers
The ingestion workers are responsible for processing different types of files that are ingested into the system. They take in files such as PDFs, Word documents, Excel files, PowerPoint presentations, text files, CSV files, and Markdown files. Each type of file needs to be processed in a different way to extract the necessary information. For example, in the case of PDFs, the ingestion workers need to extract titles, subtitles, tables, and other relevant information. The workers convert the files into Markdown format, which helps preserve the structure of the document and allows the models to better understand and generate results based on the content. The ingestion workers also create chunks out of the documents, which are then saved into a vector database and a Postgres database. This process allows for efficient storage and retrieval of the ingested documents.
...
The theme service is responsible for allowing users to customize the appearance of the Unique financeGPT platform according to their branding preferences. It enables users to set their own colors, logos, and other visual elements to create a personalized and branded experience within the platform.
More details: https://unique-ch.atlassian.net/wiki/pages/createpage.action?spaceKey=PUB&title=Theming&linkCreation=true&fromPageId=445743377
Anonymization Service
Ensures data privacy by anonymizing sensitive information in user prompts and de-anonymizing model responses.
...
The benchmarking enables the client to test prompts on a large scale to ensure a high quality (accuracy) of the output (answers) by automatically comparing answers to the ground truth and creating a score using LLMs and vector distance as well as detections of hallucinations to make sure data and model drift is detected early on.
More details: https://unique-ch.atlassian.net/wiki/pages/createpage.action?spaceKey=PUB&title=Benchmarking&linkCreation=true&fromPageId=445743377
Analytics
Analytics reports (e.g., user engagement) are available via API or also via Unique UI.
More details:https://unique-ch.atlassian.net/wiki/pages/createpage.action?spaceKey=PUB&title=Analytics&linkCreation=true&fromPageId=445743377
Video Explainer
...