Excerpt | ||
---|---|---|
| ||
Overview of Unique FinanceGPT architecture and basic concepts. |
...
The benchmarking enables the client to test prompts on a large scale to ensure a high quality (accuracy) of the output (answers) by automatically comparing answers to the ground truth and creating a score using LLMs and vector distance as well as detections of hallucinations to make sure data and model drift is detected early on.
More details: https://unique-ch.atlassian.net/wiki/x/AQDJIw Benchmarking
Analytics
Analytics reports (e.g., user engagement) are available via API or also via Unique UI.
...