Internal AI Literacy: A 12-Week Curriculum You Can Steal

By Pixel of Software Team · · 13 min read

We built a 12-week AI literacy curriculum for our coaching engagements. We’re publishing the structure here because most SMBs don’t need to buy training — they need a curriculum and a willing internal champion.

The full structure below is the same one we run in our AI & Leadership Training cohorts. The key insight is that structure beats content quality — a mediocre curriculum run with cohort discipline produces better outcomes than a brilliant curriculum delivered as videos.

Who This Is For#

This curriculum is designed to be run by an SMB with:

If you don’t have all four, run a smaller version (e.g., 4 participants, 6 weeks) or hire an external program. Half-implementing the curriculum is worse than not running it.

The 12-Week Structure#

Weeks 1-2 — Production Prompt Engineering#

Learning goal: Move from “I can write a prompt that works” to “I can write a prompt that works reliably.”

Topics:

Weekly exercise: Pick one task you do manually that involves text. Write a prompt that automates it. Build a 10-input eval set. Iterate the prompt until it passes 90%+ of the eval cases.

Anti-pattern to flag: Prompt-engineering as art. The whole point of moving past “I can write a prompt that works” is to make prompts reproducible and testable.

Weeks 3-4 — Retrieval Architecture (RAG)#

Learning goal: Understand what retrieval-augmented generation actually does, why naive implementations fail, and how to evaluate retrieval quality independently of generation quality.

Topics:

Weekly exercise: Set up a basic RAG over your team’s internal docs. Build a 30-question eval set. Measure retrieval quality independently of answer quality.

Weeks 5-7 — Agentic Workflows#

Learning goal: Know when agents are the right pattern and when they aren’t. Design tool-use that doesn’t spiral.

Topics:

Weekly exercise: Convert one of your week 1-2 workflows into an agentic version with 2-3 tools. Identify three failure modes. Implement fallbacks.

Required reading: Two case studies from our coaching alumni — one workflow that worked (with metrics) and one we killed (with the kill criteria that triggered).

Weeks 8-9 — Evaluation Harnesses#

Learning goal: Build an eval harness that scales beyond the demo and runs in CI.

Topics:

Weekly exercise: Take the workflow from week 5-7 and instrument an eval harness in CI. Demonstrate that a deliberate prompt regression triggers a CI failure.

Weeks 10-11 — Governance and Compliance#

Learning goal: Build production AI workflows that survive a SOC 2 / ISO 27001 / EU AI Act audit.

Topics:

Weekly exercise: Run a tabletop audit on the workflow from week 5-7. Identify what would fail an EU AI Act limited-risk classification check. Fix it.

Week 12 — Capstone#

Learning goal: Ship one production-grade workflow with measurable outcomes.

Each participant presents to leadership:

Capstone presentations should be attended by the executive sponsor of the program. This produces visible commitment that is the single biggest factor in whether the workflows survive the next 6 months.

What to Skip From This Curriculum#

If 12 weeks is too long, here’s the priority order for cuts:

Common Failure Modes#

In our coaching engagements we see four recurring patterns:

  1. The capstone gets cancelled. Schedule pressure mounts; the capstone gets postponed; participants don’t ship; the program quietly fails. Pre-commit the capstone date to leadership at week 1.
  2. Pair-work doesn’t happen. The async exercise pairing is essential — solo learning compounds slower. Track participation; reach out at week 3 if pair sessions aren’t happening.
  3. Senior managers exempt themselves. “I’ll let my team go through the program; I’ll skim the materials.” This kills the program’s authority signal. If senior people don’t participate, junior participants learn the program isn’t real.
  4. No measurement plan beyond capstone. Without a 90-day post-program measurement, you have no idea whether the workflows survived contact with reality. Run a 90-day check-in mandatorily.

Materials and Templates#

We maintain a repository of materials we use in our coached cohorts:

Request the materials →