n. / Safety and operations
Definition
Data retention is how long you keep stored data, such as traces and prompts, before it is deleted. It balances debugging needs, cost and privacy obligations.
In more detail
Longer retention helps you investigate old incidents and build datasets, but it also stores more sensitive text for longer. Decide a period per kind of data, and make sure you can delete a specific user's data when asked. Where the data is stored, and in which region, also matters for compliance.
Example
Raw traces are kept for 30 days and then deleted, while reviewed examples in the golden dataset are kept until removed.
