Agile InsightsBriefing

Agile Insights · topic

#oversight

Human review, checking and assurance. 20 episodes across every series, newest first.

A black and white workbench with a recipe card box, a tagged file folder and a clipboard checklist, labelled in yellow Recipe, Owner and Test, beside a studio microphone.
Episode 37 · PrimerWhat is an AI skill (and why you should care)About 6 minutes#agents#oversight
A black and white workbench with a pressure gauge, a sealed exam envelope and a small empty birdcage, labelled in yellow Measure, Held-out exam and Canary, beside a studio microphone.
Episode 36 · Primer and discussionChecking agents in production, even when you can’t read their workAbout 15 minutes in two parts#agents#oversight
A black and white workbench with a magnifying glass on a printed log, an emergency stop button, a rubber stamp on a signed form, and a studio microphone, labelled in yellow Detect, Stop, Approve and Episode 35.
Episode 35 · DiscussionWho watches the agents? Detect, stop, and let a person approve the rulesAbout 10 minutes#security#oversight
Reference 13 cover: a closed reference volume with headphones, titled AI RULEBOOK.
Reference 13 · PrimerThe Commonwealth AI rulebook: the Policy, the technical standard and the APS AI PlanAbout 5 minutes#rules#oversight
A closed reference volume, a partly unrolled blueprint held flat by a steel weight and a pair of headphones on a dark desk, labelled DTA AIRA, Reference Series and Reference 12. A yellow bar along the bottom reads Reference series, number 12.
Reference 12 · PrimerThe DTA AI Reference Architecture: one blueprint for government AIAbout 6 minutes#rules#oversight
Black-and-white workbench with a vintage film camera labelled Video pipeline, a clipboard of figures labelled Number check, a signed form labelled Consent and a studio microphone labelled Episode 32, above the headline Agentic video: what to try, and what to check.
Episode 32 · Primer and discussionAgentic video is real: what to try, and what to checkAbout 13 minutes#oversight#people
A black and white workbench with a rolled house plan, a rubber stamp on a blank sheet, a magnifying glass on a stack of papers, and a studio microphone, labelled in yellow Draft, Sign-off, Check and Episode 31.
Episode 31 · Primer and discussionSpeeding up planning decisions with AI: who checks the checker?About 15 minutes#oversight#people
A black and white workbench with a box of handwritten index cards, a magnifying glass on a blank card, a pencil with eraser crumbs, and a studio microphone, labelled in yellow Notes, Check, Forget and Episode 30.
Episode 30 · PrimerThe prompt that shows what your AI actually knows about you (and it’s less than you might think)About 7 minutes#data#oversight
A black and white workbench with a stack of papers under a glass paperweight, an open card-catalogue drawer and a magnifying glass on an index card, labelled in yellow Raw Sources, The Wiki and Lint, beside a studio microphone.
Episode 28 · Primer and discussionWhen an AI keeps the wiki, checking has to keep pace with writing.About 15 minutes in two parts#data#oversight
A black and white workbench with a mixing dial, a balance scale holding two identical cards and a box of index cards, labelled in yellow Prompt, Same cases and Test set, beside a studio microphone.
Episode 27 · Primer and discussionCan you trust an AI judge?About 15 minutes#oversight
A black and white workbench with an alarm clock and in-tray, a rubber stamp beside a tall stack of slips, and an industrial switch turned off, labelled in yellow Priorities, Approvals and Off switch, beside a studio microphone.
Episode 26 · Primer and discussionThe agent that speaks first: what to decide before proactive agents reach work accounts.About 14 minutes#agents#oversight
A black and white workbench with a mechanical tally counter, a stack of blank comment cards with a suggestion box and a blank name tag, labelled in yellow Usage, Feedback and Owner, beside a studio microphone labelled Episode 20.
Episode 20 · Primer and discussionUsage is not quality: who reads the feedback?About 14 minutes in two parts#microsoft#oversight
A black and white factory conveyor carrying machined metal parts, with one pair of hands checking a part, ringed in yellow and labelled Human in the Loop.
Episode 16 · Primer and discussionWhen making something gets cheap, checking it becomes the real work.About 13 minutes in two parts#oversight#leadership
A black and white patch panel of cable sockets, four plugged cables ringed in yellow and labelled Approved Connectors, and two loose cable ends crossed out in yellow.
Episode 15 · Primer and discussionMicrosoft governs the access. You still have to govern the answer.About 14 minutes in two parts#microsoft#oversight
A single typed page with two short lists and a fountain pen, a rubber stamp, a pair of reading glasses and a studio microphone with headphones on a dark workbench, labelled Contract, Source, Test and Episode 14.
Episode 14 · Primer and discussionWrite down what the agent must never do, and what it must still do.About 16 minutes in two parts#agents#oversight
Two identical blank résumés side by side on a dark workbench, a brass balance scale tipped slightly by a single folded note, and a studio microphone with headphones, labelled Swap, Pressure, Define fair and Episode 13.
Episode 13 · Primer and discussionFairness under pressure: a fair AI decision has to hold when someone leans on itAbout 14 minutes in two parts#people#oversight
A tall stack of printed pages with a single page pulled out under a magnifying glass, a rubber approval stamp lying unused, a large undo key and a studio microphone with headphones on a dark workbench, labelled Risk tier, Owner, Undo and Episode 12.
Episode 12 · Primer and discussionWho reads the code when the AI writes it?About 15 minutes in two parts#oversight
Black and white photograph of a dark workbench: an upright hardback with a yellow ribbon and reading glasses, a ring binder with a rubber stamp labelled The rule book, and a service bell labelled Nobody to ask. Title: The Unaccountability Machine.
Making You Think 6 · Primer and discussionThe Unaccountability Machine, by Dan DaviesAbout 15 minutes#leadership#oversight
Two wooden card-index drawers of blank cards side by side, a closed ring binder, a blank luggage tag with string, and a studio microphone with headphones on a dark workbench, labelled Synced copy, Skills, Provenance and Episode 9.
Episode 9 · PrimerYour company brain is a copy. Govern it like one.About 8 minutes#data#oversight
A three-legged stool on a dark workbench, its legs labelled Ecosystem, Governance and Leadership, between a book and a thesis labelled The Book and The Thesis, and a studio microphone labelled Episode 1.
Episode 1 · DiscussionStaying in charge of decisions in the age of AIAbout 9 minutes#leadership#oversight

Everything from Agile Insights: briefings, Making You Think and the reference series