Topic

The Quality Gate Pattern: embedding self-evaluation rubrics at every pipeline handoff so bad work doesn’t propagate — each stage must hit 9/10 before passing to the next, with up to 3 revision cycles.

Target Reader

Knowledge entrepreneurs and coaches who have built or are building multi-stage AI workflows (writing pipelines, research + synthesis + drafting sequences, analysis pipelines) and are frustrated that the final output doesn’t match the quality they expect given the sophistication of their setup.

The Fear / Frustration / Want / Aspiration

Frustration: “The output looks polished but it’s not actually good.” A 5-stage pipeline that produces a professional-looking result built on a mediocre first draft. The final stage can’t fix what the first stage got wrong — it can only make a weak foundation look presentable.

Want: AI pipelines where the quality of the output reflects the sophistication of the architecture, not just the final stage’s cleanup work.

Before State

The reader has built multi-stage AI workflows. They’re sophisticated enough to think about separating research from writing, writing from editing. But their pipelines still produce mediocre outputs on complex topics because weak early-stage work compounds into weak final outputs. They’ve been iterating on prompts for the wrong stage.

After State

Quality gates at every handoff. The researcher can’t pass weak sources to the outliner. The outliner can’t pass a structurally weak skeleton to the drafter. Each stage self-evaluates against criteria appropriate to its function, revises up to 3 times, and only passes clean work to the next stage. The final output reflects the quality of every upstream stage.

Narrative Arc

The reader knows multi-stage pipelines are supposed to be better. They’ve built one. The outputs aren’t better in proportion to the setup investment. Tension: why? Turn: because each stage is handing off its first draft. Without a quality gate, the pipeline is just sequential text generation — the stages aren’t holding each other accountable. Resolution: one architectural change — a self-evaluation rubric before every handoff — and the pipeline starts working the way it was supposed to.

Core Argument

A multi-stage AI pipeline with no quality gates is just sequential text generation. Quality gates are what make the pipeline structure actually matter.

Key Evidence / Examples

  • Live demonstration in session: Lou added quality gates to the Brand Writing Team skill mid-demo. The transcript recorded: “Strategist scored a 9. Outliner scored 9. Skeptic scored 9.” Each stage self-evaluated, met threshold, and passed clean work to the next.
  • The resulting article incorporated psychological research, cited sources, and an unusual angle that would not have survived a poor-quality outlining stage.
  • The threshold is deliberately high: 9/10. Each stage compounding at 7/10 produces a meaningfully weaker final output than each stage compounding at 9/10.
  • The 3-attempt ceiling surfaces structural problems rather than masking them with iterative cleanup.
  • Related: Insight - The Quality Gate Pattern — Embed 9-10 Self-Evaluation at Every Pipeline Handoff

Proposed Structure (5–7 beats)

  1. The pipeline paradox — You built a sophisticated multi-stage workflow. The outputs aren’t proportionally better. Something’s wrong.
  2. Where pipelines fail — Stage 1 produces its first draft. Stage 2 inherits it. Stage 3 polishes it. The final stage can’t fix what stage 1 got wrong.
  3. What a quality gate is — Self-generated rubric, score against it, revise up to 3 times, pass only at 9/10. Built into the skill file at every handoff.
  4. Why 9/10 and why self-generated — The threshold is high because stages compound. The rubric is self-generated because each stage knows what quality means for its specific function.
  5. The 3-attempt ceiling — Why iteration doesn’t mean infinite. When a stage can’t hit 9/10 in 3 attempts, that’s a signal for human input, not another revision.
  6. What this looks like working — The live demo: Strategist scored 9. Outliner scored 9. Skeptic scored 9. The article that came out.
  7. How to add gates to your existing pipeline — The template, where to place them, the 5-minute implementation.

Editorial Notes

Tone: diagnostic and practical. The reader should feel recognized in the “why isn’t my pipeline working?” frustration before the solution is offered. The article should feel like a conversation with someone who has already built and fixed this problem — not a theoretical framework.

Avoid: making this sound purely technical. The principle is architectural but the payoff is creative: better writing, better research, better coaching tools. Keep the focus on output quality, not system design.

Next Step

  • Approved for drafting
  • Needs revision
  • Deprioritised