Notes on building useful AI.
Practical notes on models, tools, experiments, and engineering. We share project lessons and technical reading for people who build and buy AI systems.
All notes
A voice agent’s rules can’t live in its prompt
Use source tools, server-side action checks, and session limits to control voice agents. Prompts alone cannot enforce permissions or spending.
Evals start with real tasks
Build AI evaluations from real tasks, define expected outcomes, and test critical failures. Use the results to guide release and ongoing review.
A grounded answer shows its source
Build knowledge agents with traceable sources, version details, access controls, and clear responses when information is missing or conflicts.
Self-improving agents need evidence loops
Turn expert corrections into reviewed evidence, targeted evaluations, and software changes. A practical approach to improving AI agents after launch.
Sandboxing agents requires real enforcement
How to assess a coding-agent sandbox: file access, network rules, child processes, and the actions that still need approval.
Voice AI latency depends on more than the model
How network routing, session setup, and interruption handling affect voice AI. Engineering lessons from OpenAI’s real-time media infrastructure.
Get new notes
Tell us what needs to work.
Describe the work you want to improve.