How to Audit an AI Agent Before Your Customers Do
We audited six companies’ AI support agents. The costly mistakes weren’t the viral ones. Here’s how to test yours against your own policies, regularly like pen testing.
About
Founder
Michael Taylor
Data-driven, technical marketer turned AI practitioner. $50m managed across paid and organic channels, 8,000+ experiments, co-founder of Ladder.io, instructor at LinkedIn Learning, and co-author of O’Reilly’s Prompt Engineering for Generative AI. These days: evals, prompt optimization and synthetic research.
Posts by Michael
61 posts
Escape the Permanent Underclass
AI spending ranges from $0 to $20,000/month — and the gap is growing. Explore the "permanent underclass theory," why Silicon Valley fears being priced out of AI, and what economics says about whether human labor really becomes worthless.
The Pairwise Gold Triad: Hill Climbing with Subjective Evals
The Pairwise Gold Triad is an eval pattern for subjective AI tasks. Compare challenger outputs against an incumbent using gold references and a fixed LLM judge—then hill climb with autoresearch.
Lessons Learned Generating 5,000 AI Personas
Discover hard-won lessons from scaling AI persona research to 5,000 simulated consumers. Learn practical tips for managing costs, ensuring statistical accuracy, and avoiding common pitfalls when using LLMs for market research.
Bridging the NCO Gap: The Human Backbone of the Post-AGI Economy
AI excels at strategy and execution but fails at creative problem-solving. Explore why humans will remain essential as "NCOs" in the post-AGI economy, bridging the gap between AI planning and AI action through adaptive intelligence and real-world judgment.
Prompt Engineering: From Words to Art and Copy
AI art is here, and prompt engineering is the job of the future. Take my prompt template and learn how to find all the art styles, quality boosters and magic words to get the generative art you need.