Product Evals: Travel Planner, Long Context, and The Weight Of Taste
A product note on evaluating an AI travel planner: itinerary quality, OOD scenes, long-context consistency, recommendation taste, and user loops.
Product
Evals As Instruments: Measuring What The Demo Hides
A note on evaluation as an instrument: failure cases, metrics, benchmark design, product loops, and the discipline of measuring agents.
Agent Design: Loops, Tools, and the Shape of Memory
A field note on designing agents as observable loops, with tools, memory, failure recovery, and product boundaries.