Automation & Agents
AI Output Acceptance Checklist: What to Check Yourself After an AI Says 'Done'
An AI reporting completion means it believes it is finished. When it checks its own work, it often reuses the same assumptions it used to produce the result, so it cannot see the gap. Find an objective number to compare against.
The one idea that matters
When an AI reports “done”, it means “the AI believes it is finished”, not “this was done correctly”.
An AI’s tone is usually confident, and a message like “done” or “verification passed” makes people relax without noticing. The catch: when an AI checks its own work, it often uses the same assumptions it used to produce the result. If those assumptions have a hole, the AI cannot find it (the circle calls this “the verifier shares the generator’s blind spots”).
The only reliable acceptance is this: look at the final product itself, turn it into an objective, measurable number, and compare it with what you originally wanted.
Steps
Step 1: Ask what the final product physically is
Not the AI’s report message but the real file. For code, the program actually running; for a video, the exported video file; for a report, the Excel or PDF. Always go back to the thing itself, not the text the AI wrote about it.
Step 2: Find an objective, measurable indicator
This is the most important step in the whole note:
- File duration (video, audio): measure the actual seconds and see whether they match what you expect.
- Timestamps (subtitles, animation, schedules): pick one key moment, such as “when does the first subtitle appear”. That number reveals which stage the file really came from.
- File size and resolution: two files with different content almost never match on both.
- The count of passed tests, not whether they passed: is it “10 tests all passed” or “10 tests, 3 skipped”.
- Record counts: do input and output counts match, or are a few rows missing for no reason.
If you do not know which indicator fits, paste this to the AI:
I asked you to finish a task and you reported it as done. Before I believe it, I want an objective, measurable number or check that proves the result is really right, not just “I checked and it looks fine”. List 3 concrete indicators I can use to verify this result, and tell me the actual measured value of each.
Step 3: Compare the number with what you originally wanted
For example, if the video should include a 3-second intro, the main content should start near 3 seconds, and the first subtitle should land after the intro ends, not at 0 seconds. If they do not match, the AI gave you a different file than the one you wanted: a wrong version, or a skipped step.
Step 4: Look at a few key points with your own eyes
Matching numbers do not guarantee the content is right. For images or video, check by eye at least the intro, the start of the main part, the end of the main part and the outro, confirming text does not cover important content and there are no visible errors. For code, run by hand the one operation a real user would do, instead of trusting green automated tests alone.
Step 5: When the AI says “fixed”, run Steps 1 to 4 again
The most skipped step. Look again at “the final file that is actually used”, not the intermediate file it edited. Often the fix landed in the right place but never reached the one file that gets output.
Traps you will hit
- Checking for errors but not for correctness. No error only means the run did not break. Many mistakes happen quietly: the program does not crash but the logic is wrong, the video renders but one clip is in the wrong place. Always add a human check of the final output.
- Assuming the “backed-up” file is the one actually in use. Systems often hold a draft, an intermediate and a final version, and it is easy to back up the wrong layer. Before backing up, compare with the Step 2 indicator. Only matching numbers mean you backed up the right one.
- The AI says “fixed” but the pipeline still references the old file. It may really have edited something, but the edited file never reached the final flow, so the action happened and the result did not change. After a fix, rerun the whole routine instead of skipping the check because it said it was fixed.
Takeaway
When an AI says “done”, treat it as a prompt to “please confirm yourself”, not a guarantee that “it is handled”. Compare one objective number and look with your own eyes at the key spots, and you will catch the problem before it becomes a public one.
Universal rescue: how to ask an AI when you are stuck
I am working on “[your task, for example: checking that the video the AI edited is the right version]”. I want to verify the result with an objective, measurable method, but I am not sure what to measure or how. The current situation is: [paste what you see, an error message, or a short description]. Please: 1. suggest 2 to 3 objective indicators that suit this task; 2. tell me exactly how to measure them (which tool, which command); 3. teach me step by step, without skipping steps.
This is part of an ongoing series of field notes and AI tool tests. To get the full SOPs and future posts, subscribe to the newsletter.
Support this work:Support on Ko-fi