| Excerpt | ||
|---|---|---|
| ||
Analytics reports (e.g., user engagement) are available via API or also via Unique UI. The article explains which reports are available out of the box and how to get them. Unique continuously enriches the service with additional reports. |
...
| Table of Contents |
|---|
...
Definitions
Active Users: A user with a minimum of one interaction (question & answer) over a defined period of time
...
Chat Interactions
Active Users
Document Reference Statistics
Data Leakage Post-Processing
Main article: Data Leakage Prevention (DLP)
The user-chat-export subsection of the analytics API exposes an interface to post-process prompts and thus works as a form of DLP.
...
Work with Reports
...
How to download Reports
...
A user with the required role is able to request an analytics export.
...
A user can filter the data request:
By date
with for a specific Assistant by spec
When a user requests for a report, the system will create an order entry in the Analytics order table. After the
...
request is completed, a report is available for the user
...
to download
...
.
A user can delete the report after it has been processed
...
or downloaded. You can also filter down report for a specific Assistant before exporting.
...
Interpret reports
Chat Interactions
With this analytics you can evaluate the following:
Which assistant is the most used assistant?
How many Number of interactions per assistant?
Who is the most Most active user?
...
Email: The email of the user, who interacted with the assistant
Date: The date of the interaction
Assistant: The assistant used for the interaction
Count: Number of interactions (question & answer) the user had on the indicated date with the selected assistant
...
This report gives you a detailed export of the chat interactions. The report contains mainly every message of the user and answer of Unique FinanceGPT AI in the specified time frame. The user is as default anonymised. But on special request by a customer Unique can change this to contain the users data. (Not available on multi tenant instance)
This exported data can help identify frequently asked questions/prompts and also missing knowledge when Unique FinanceGPT AI is not able to provide an answer.
...
Username: The name of the user or anonymised: Unknown
Timestamp: The date and time the user sent the message
Space: Which space the user has used for this message
Chat ID: Identifying which messages belongs together (the same chat)
Message: The message that was sent
Answer: The answer of Unique FinanceGPTAI
Device Category: Which device the user used (mobile, desktop, tablet)
Work with Chat Exports
Log Fields Configuration
Each entry logged by the Unique API will contain the following mandatory fields:
timestamp: The date and time of the query, formatted asDD-MM-YYYY; HH:MM:SS GMT+X.username: The identifier of the user who initiated the query.prompt: The user's query to Unique, excluding any sensitive prompt engineering sections.
Example Log Entry
| Code Block |
|---|
{
"timestamp": "01-01-2024; 14:23:05 GMT+1",
"username": "mheppler",
"prompt": "Give me the list of all employees within Unique."
} |
DLP Policy Configuration
To ensure compliance with privacy laws and regulations, the following considerations must be taken into account when configuring DLP policies:
Privacy Compliance: Ensure that monitoring practices are compliant with GDPR, CCPA, and other applicable regulations.
Encryption Handling: Configure SSL interception to inspect encrypted traffic while managing trust certificates responsibly.
Policy Definition: Clearly define what constitutes sensitive data and the conditions under which it is monitored and blocked.
Ethical Transparency: Maintain transparent communication with users regarding the extent and purpose of monitoring.
Scan/Extract Frequency
...
)
...
Review by Clients Compliance teams
Output / findings of DLP scans should be regularly reviewed (regular sample checks) by the respective client’s compliance and/or data protection team. It is not the responsibility of Unique to check output (not allowed by contractual terms and also not part of the Unique service offering). Clients should make sure that the output/ findings are handled according to internal guidelines, policies and regulations.
Reporting issues
...
...
...