How to Audit an AI Agent Before Your Customers Do
We audited six companies’ AI support agents. The costly mistakes weren’t the viral ones. Here’s how to test yours against your own policies, regularly like pen testing.
Blog
Blog
Everything I've learned about AI evals, prompt engineering and growth — in the order I learned it.
7 min read
Escape the Permanent Underclass
AI spending ranges from $0 to $20,000/month — and the gap is growing. Explore the "permanent underclass theory," why Silicon Valley fears being priced out of AI, and what economics says about whether human labor really becomes worthless.
Read more
9 min read
The Pairwise Gold Triad: Hill Climbing with Subjective Evals
The Pairwise Gold Triad is an eval pattern for subjective AI tasks. Compare challenger outputs against an incumbent using gold references and a fixed LLM judge—then hill climb with autoresearch.
Read more
10 min read
Lessons Learned Generating 5,000 AI Personas
Discover hard-won lessons from scaling AI persona research to 5,000 simulated consumers. Learn practical tips for managing costs, ensuring statistical accuracy, and avoiding common pitfalls when using LLMs for market research.
Read more
11 min read
Bridging the NCO Gap: The Human Backbone of the Post-AGI Economy
AI excels at strategy and execution but fails at creative problem-solving. Explore why humans will remain essential as "NCOs" in the post-AGI economy, bridging the gap between AI planning and AI action through adaptive intelligence and real-world judgment.
Read more
26 min read
Prompt Engineering: From Words to Art and Copy
AI art is here, and prompt engineering is the job of the future. Take my prompt template and learn how to find all the art styles, quality boosters and magic words to get the generative art you need.
Read more
11 min read
Hide Your Shoggoth
Learn how ambitious generalists can succeed in a specialist's world through the 'Shoggoth Strategy' - a proven approach to presenting your diverse skills strategically while maintaining your broad interests. Includes real-world examples and practical career advice.
Read more
9 min read
Bait Hook Reward Payload
How to (actually) write engaging LinkedIn posts with ChatGPTOne of the things people get super excited about with ChatGPT is it’s ability to write content for you.
Read more
13 min read
Guaranteeing the Success of our Udemy Course with Memetic Analysis
Learn how two developers used data-driven memetic analysis to launch a successful Udemy course on prompt engineering, generating full-time income while working just one day per month. Includes actionable insights on course naming, pricing, and optimization.
Read more
15 min read
Forcing AI to watch 100s of hours of video and tell you what you missed
Ever wished you could watch hundreds of hours of video in minutes? We did it with AI. Dive into our journey of analyzing countless gaming streams, the hiccups we hit, and what this means for how we'll learn from videos in the future. Get ready for a world where no visual content goes unseen.
Read more
5 min read
How to write a book on AI when everything is changing
Prompt engineering is a fast moving topic, so to write a book on it, we had to zoom out and find transferable and timeless principles that worked with GPT-3, still work with GPT-4, and will work in the future with GPT-5.
Read more
9 min read
Vision Prompting Guide
Vision models are underrated, and in may ways are the future of LLMs. Learning how to prompt them now will pay off dividends in the future.
Read more
10 min read
You're the secret sauce: writing original content with AI
Most people using ChatGPT or AI writing tools for content marketing have it exactly backwards. You have to provide the secret sauce, and use AI as your ghostwriter.
Read more
8 min read
Prompt Optimization
It's one thing to discover a prompt that works through trial and error, but prompt engineering is a whole other discipline with a lot more scale and robustness required. You need to be A/B testing your prompt by running them 20+ times in order to really understand what affects performance.
Read more
5 min read
Winning the “AI wrapper” game
How do you win the AI wrapper game and level up as an AI-powered company? There's a standard path to get there that you can follow, which will increase quality and (eventually) decrease cost.
Read more
5 min read
ChatGPT in GSheets
If you've ever wanted to use the power of ChatGPT in Google Sheets, now you have a template which gives you access in a simple Custom Function.
Read more
11 min read
Can ChatGPT Make You Laugh?
ChatGPT can tell jokes if you know how to ask. I use prompt engineering to make ChatGPT funny again.
Read more
4 min read
ChatGPT doesn't respect word count
ChatGPT can't count words, so stop trying to ask it. This is why prompt testing is important, because without it you wouldn't know what part of your prompts are performing.
Read more
10 min read
Running Robyn in R
Facebook is getting into Marketing Mix Modeling to solve the iOS14 problem, but how do you run Robyn, their open-source project in R-Studio? Step by step instructions including setting up your environment.
Read more
6 min read
AI Writing Style - Prompt Experiment
How do you get the AI to write like you? Here are my results of A/B testing multiple approaches, with the winning prompt that performed 20% better!
Read more
4 min read
GPT3() Function in GSheets
GPT-3 is revolutionary but relatively inaccessible if you don't know how to code! Using GPT3 function in GSheets will make it easier to integrate into your workflow.
Read more
6 min read
The Dangers of Value Based Pricing in Agencies
Value-based pricing in agencies is alluring, but comes with serious risks that must be mitigated, as I found out with my 50 person agency.
Read more
11 min read
AIO: Artificial Intelligence Optimization
AIs are growing exponentially and as a result consumer behavior is changing. There's an opportunity for forward-thinking marketers to invest in AIO or Artificial Intelligence Optimization and ride the wave as brands scramble to get into the AI training set.
Read more
6 min read
Building your own AI assistant like Iron Man
Everybody wants an AI assistant like Iron Man. For the first time it's becoming possible to actually build that, with completely open-source components.
Read more
10 min read
Practical Tips for Defeating the Woke Mind Virus
Elon Musk is fighting against the woke mind virus, but what are the tools memetic engineering gives us in this type of information warfare?
Read more
5 min read
Data Anonymization for Realistic Tutorials, Training & Courses
Anonymize sensitive data for public use in online courses, blog posts, or product demos, without losing any patterns in the data.
Read more
4 min read
Content Repurposing for Social Promotion
Content Repurposing, for example taking the videos you produce and turning them into other formats for promotion on social media, is the key to making the economics of content production work.
Read more
3 min read
Why the winner takes all in Content Marketing
SEO has several dynamics that make content marketing a winner-takes-all market. This is why you should focus.
Read more
9 min read
How to write blog content at scale
What process do you need to follow to write content at scale for SEO? It looks very different from a normal writer's workflow - you have to be strategic.
Read more
3 min read
What everyone gets wrong about Content Strategy
Busting three months about SEO that everyone believes. Best practices don't exist and you shouldn't just write evergreen content for your target customer.
Read more
4 min read
Building Your Keyword Universe
How do you do effective keyword research? What types of keywords should you try and rank for? In what priority?
Read more
15 min read
Link building for authority
If you don't have enough links you won't rank on the first page of Google, but how do you get them? What are the link building tactics and strategies that work?
Read more
4 min read
Recruiting good Freelance Writers
How do you hire good freelance writers to produce your blog content? How does that compare cost-wise to hiring an agency?
Read more
3 min read
Growth engineering for SEO
How do you engineer growth via SEO? It takes engineering resource, but what do the developers actually work on?
Read more
3 min read
Minimum Viable Technical SEO Audit
What's the minimum work you could do to make sure your site is healthy and ready to receive SEO traffic?
Read more
12 min read
Econometrics in GSheets
You need to choose where to allocate your marketing budget, but don't know if you can trust the reports you're getting from Facebook and Google... and how do you even measure TV? Econometrics is the key to answering these strategic questions and making data-driven marketing decisions.
Read more
5 min read
Measuring the Incrementality of Marketing with Causal Inference
"Purchased and has clicked" is the not the same thing as "purchased because they clicked": learn how to determine the true impact of marketing with the causal inference toolbox.
Read more
5 min read
Geo Level Models
How do you know if you have enough data for an MMM? What do you do if you don't? Geo-level models are a great way to increase the certainty in your model, by introducing variance so you get to the truth of channels actually drove performance.
Read more
4 min read
Simulator-Based Courses
Simulator-based courses are the future of online learning. Imagine being able to simulate what it's like to do the job in real-world scenarios, and apply in practice along with learning the theory.
Read more
12 min read
Agency Economics
Where does all the money go when you hire an agency? I reveal the economics of how an agency makes money, and what it spends it on. You'll see why agency employees are always underpaid and overworked, and why agency owners always look fraught.
Read more
6 min read
Bayesian Econometrics in Python
What are Bayesian methods and why are they being adopted by modern MMM practitioners? We share actual code that shows a side-by-side comparison so you can see one of the many benefits of these techniques.
Read more
3 min read
Converting Data From Monthly or Weekly to Daily with Interpolation
If all you have is weekly or monthly data, how do you convert it to build a model with daily data? The answer: Interpolation. (includes open-source code)
Read more
7 min read
How much lost data does Server-Side Tracking actually help you recover?
Everyone is looking to Server-Side Tracking as the potential saviour of marketers
Read more
13 min read
Privacy Backlash
People hate being tracked across the web, and they're starting to fight back. With a third of people using adblocker, Apple's changes to ITP and IDFA and the GDPR and CCPA legislation, the ability to track users has been severely degraded.
Read more
9 min read
Zero-Party Data: What Marketing Without Cookies Could Look Like (30 Day Playbook)
What would you do in marketing without data? How would you survive a post-data apocalypse? Here's a playbook for how to do marketing with zero-party data.
Read more3 min read
What data do I need for a Marketing Mix Model?
What data do you need before starting a marketing mix modeling project? Do you even have enough data? Use my data request checklist to find out.
Read more
5 min read
Marketing Mix Modeling: What’s the difference between a $500, $5,000 and a $50,000+ Project?
How much does Marketing Mix Modeling cost? We explore what $500, $5,000 and $50,000 buys you, and what kind of output you should expect, from Excel to Python code.
Read more
4 min read
What to tell your boss/client about iOS 14.5
iOS 14.5 is the biggest change to to $350b digital marketing industry to happen in decades. It's great for user privacy and
Read more
4 min read
Diminishing Returns
Have you ever doubled your budget and not seen conversions increase by as much? You've encountered diminishing returns, a phenomenon you can build into your Econometric models to predict future performance at different spend levels, and make strategic decisions.
Read more
10 min read
Server-Side Tracking
Server Side Tracking is the latest tech released in the fight for digital attribution. It has the power to solve problems like Apple ITP or ad blockers, but with great power comes great responsibility (and a lot of complications!).
Read more
7 min read
Econometrics in Python
If you're familiar with Econometrics, you've probably wondered how to do the analysis in Python. The benefits over using Excel or GSheets are reusability, scalability and the ability to productize the results.
Read more
8 min read
When Econometrics Works
What can Econometrics do for your business? What questions can it answer? And what is it not good at answering for you?
Read more
10 min read
Measuring the Halo Effect of Ads
Have you ever noticed your Facebook ads performance doesn't line up with Google Analytics? Using econometrics you can measure the 'halo effect' of advertising on organic channels and see if there really is an impact, independently of what Facebook is telling you.
Read more
8 min read
4 min read
Intro to Growth Engineering
What is Growth Engineering and when does it make sense for your business? We discuss the Growth Hacking movement that made the role of Growth Engineer, and discuss what inflection point indicates you need to hire a Growth Engineer.
Read more
5 min read
K-Factor Benchmarks
What is a good level of viral growth? What K-factor should you expect? We look at all the public mentions of famous companies that grew virally to find out.
Read more
5 min read
Modeling Viral Growth
It's hard to really understand the power of viral growth without modeling out it's potential — let's see how to do that.
Read more
7 min read
No More Microtargeting
Micro-targeting has been called a threat to our democracy and has built trillions of dollars of value for some of the World's biggest companies... but does it actually work? Will we miss it when it's gone?
Read more
6 min read
Becoming a Growth Engineer
If you are in love with the idea of Growth Engineering and working hard to become one, you can learn how I built a career in Growth Engineering. We also discuss some tips on what to learn if you're a marketer learning to code, or a developer learning how to do growth.
Read more
6 min read
Growth Engineering Case Studies
13 Growth Engineering case studies to show what's possible to achieve when inviting a developer into your marketing team. In each case we explain the problem we were solving, the strategy we used to solve it and what technology stack made the solution possible.
Read more
6 min read
Growth Engineering Services
Not everyone knows what a Growth Engineer is or what they can do for your marketing organization. This is a comprehensive list of the types of activities that come up again and again for Growth Engineers.
Read more
4 min read
Viral Growth Loops
Viral growth can be tough to optimize for if you haven't mapped out your growth loop.
Read more