Audit trail and toxicity review
Key Takeaway
Turn on "Einstein Generative AI and Feedback Data Collection and Storage" first, because audit data, including toxicity scores, can't be stored or accessed without it. Then use the Einstein Trust Layer dashboard to see whether toxic responses are rising and which features they come from.
Generative AI audit data, also called the audit trail, records how generative AI is used in your Salesforce org. The audit trail shows how the Einstein Trust Layer protects sensitive data from exposure to external large language models (LLMs), such as which data it masked. The audit trail also shows how the Einstein Trust Layer checks the safety and accuracy of LLM responses, such as how toxic or safe each response scored. You use this record to confirm that AI use follows your security, privacy, regulatory, and AI governance policies, and to watch for harmful responses over time.
How to turn on audit data collection
The audit trail is available in Enterprise, Performance, and Unlimited Editions with one of these add-ons:
- Einstein for Sales
- Einstein for Platform
- Einstein for Service
- Einstein 1 Service
- Einstein GPT Service
To store and access audit data, including the toxicity scores for LLM responses, you must first turn on "Einstein Generative AI and Feedback Data Collection and Storage". Follow these steps:
- Turn on "Einstein Generative AI and Feedback Data Collection and Storage".
- Wait for the pre-built reports and dashboards to appear, which can take a few minutes after you first turn on data collection.
- If the pre-built reports and dashboards still don't appear, turn the setting off and then back on.
After you turn on the setting, the audit data is stored with user feedback data in the default data space of your Data 360 instance. You reach the data through Data 360 reporting and other standard platform capabilities. Users need Data 360 user permissions to view the pre-built reports and dashboards.
Audit data is not live. Data 360 refreshes the data streams once every hour, so recent requests can be missing from reports for a while.