Email from Substack
 
Substack

Aakash Gupta and Austin Miller posted new notes

How people think you ship an AI feature Pick a model → Write the prompt → Build the demo → Eng wires it up → Launch → Read the dashboard → Wait for the next model to fix it How shipping an AI feature actually works Build the demo → The CEO loves it → Sales has already sold it → Real users type like humans: typos, wrong dates → Output reads generic, because it only saw the last message → Add the thread and the CRM → It says "I'll check on that." It never does → Security asks what it can see → Legal is suddenly in the thread → Ship it read-only → It invents a refund policy that doesn't exist → "Looks fine to me" → Label 100 real cases → The judge says 95% good and catches zero failures → Check the judge against your labels → Read 100 traces → The fix was more context → Ship to 5% → Evals go up, usage stays flat → Back to the traces → One power user eats the margin → Finance wants the cheaper model → New model drops. Re-run every eval → It calls tools differently → The rules file keeps…
Read More
1242
Apparently, I’m #66 on the “Rising in Technology” Substack leaderboards. A nice little thing if you’re into that, I suppose. Check out _secpro and cyber_ai today!
22
A year ago these were engineering words. Now they're how AI products get built. ---- Hooks = rules enforced by code Tools = what the agent can reach Skills = playbooks it loads on demand Memory = what it still knows tomorrow Harness = everything around the model Sandbox = a walled-off place to run code Permissions = what it can do without asking Context Library = the folder it reads first Rules = standing instructions saved as files Checks = what catches mistakes before you do Instructions File = what it reads on every task Subagents = helpers with their own fresh context Agent Loop = plan, act, check, decide if it's done Human-in-the-Loop = where it stops and waits for you Feature Harness = the harness inside your AI feature ---- Here are the top resources to learn these: • Harness engineering: https://www.news.aakashg.com/p/harness-engineering?utm_source=sn-hterms • Instructions: https://www.news.aakashg.com/p/how-to-use-claude-code-like-a-pro?utm_source=sn-hterms • Context…
Read More
8 1