Product Evals: A Travel Planner Taste Test
A product note on evaluating an AI travel planner: itinerary quality, OOD scenes, long-context consistency, recommendation taste, and user loops.
Product
Evals As Instruments: What Demos Hide
A note on evaluation as an instrument: failure cases, metrics, benchmark design, product loops, and the discipline of measuring agents.
Agent Design: Loops, Tools, and Memory
A field note on designing agents as observable loops, with tools, memory, failure recovery, and product boundaries.