Use case / Internal copilots
Know what your team's assistant touched.
Internal assistants reach into documents, tickets and databases. Trace which tool each request used and what access it had, so a problem is a step you can read.
- Tools
- Per request
- Access
- Checked
- Teams
- Compared
Instrument it
Record what the assistant reached for.
Wrap the tool choice and each access check, and a refused read is a step with a reason.
$ npm install tracify-sdk
import { span, traceAgent } from "tracify-sdk";
export const assist = traceAgent(async (userId: string, question: string) => {
const tools = await span("choose-tools", () => pickTools(question), { type: "llm", input: question });
const docs = await span("read-docs", () => readAllowed(userId, tools), { type: "tool" });
return span("answer", () => callModel(question, docs), { type: "llm" });
}, { environment: "production" });What Tracify watches.
Tools used
Recorded on every run, so it can be searched, compared and alerted on.
Access checks
Recorded on every run, so it can be searched, compared and alerted on.
Arguments
Recorded on every run, so it can be searched, compared and alerted on.
Requests per team
Recorded on every run, so it can be searched, compared and alerted on.
Access record
What the assistant touched.
Each request is a trace, linked to the team that made it.
Tool choices are visible before any call happens.
Access checks are recorded with their result.
A refused read is flagged, with the reason.
The reply shows what the assistant could and could not use.
- 01ok
Question asked
“Summarise the Q3 hiring plan.”
- 02ok
Tools chosen
Search documents, read page.
- 03ok
Access checked
The user is not in the people team.
- 04blocked
Document blocked
Read refused, reason recorded.
- 05ok
Answer sent
The reply says what it could not read.
The failure to catch
An assistant that read a document the employee should never have seen.
Trace which company tools an internal assistant used for each request, with the arguments and the result, so access problems are easy to spot.
