Overview

The Evaluation Service allows users to evaluate responses generated by Large Language Models (LLMs) according to different metrics. Currently, it is integrated within the search in the vector database module, but it will eventually become a dedicated service. The primary metrics implemented are Hallucination and Context Relevancy. Each metric's configuration can be customized, especially within the search in the vector database module.