Epic Errands V1 Quick Eval: Text-First Agent Traces
Community Article
Published
June 14, 2026
Epic Errands turns ordinary child goals into themed goal cards with images and
audio. This quick eval checks whether the asset pipeline stays coupled: the
text model creates the canonical card first, and image/audio prompts use that
generated card text instead of drifting into unrelated prompts.
What Ran
The eval used three plain goals across three themes:
| Plain goal | Themes |
|---|---|
| Clean up my room before dinner | Questbook, Classroom, Comic |
| Finish my class project outline | Questbook, Classroom, Comic |
| Read for 20 minutes | Questbook, Classroom, Comic |
The pipeline was:
plain_goal + theme
-> MiniCPM4.1-8B and Nemotron 3 Nano 4B text attempts
-> card_text
-> FLUX image prompt using card_text
-> VoxCPM2 audio prompt and spoken_text using card_text
-> Nemotron Speech ASR, when run
Result Snapshot
| Surface | Result |
|---|---|
| Text prompts | 9/9 rows sent to MiniCPM4.1-8B and Nemotron 3 Nano 4B |
| Card text used | 9/9 rows used schema-valid Nemotron 3 Nano 4B JSON |
| MiniCPM4.1-8B | Ran for all 9 rows, but returned schema-invalid output |
| FLUX | 9/9 generated images |
| VoxCPM2 | 9/9 generated audio clips |
| Nemotron Speech | 9/9 transcripts over the generated audio clips |
The first VoxCPM2 read-goal batch overran, so the runner retried those rows one at a time through the direct Modal function path. All three read-goal audio files then persisted, and Nemotron Speech transcribed the completed read batch.
Evidence
- Space:
https://build-small-hackathon-epic-errands.hf.space/ - Dataset:
https://huggingface.co/datasets/build-small-hackathon/epic-errands-v1-agent-traces - Dataset commit:
https://huggingface.co/datasets/build-small-hackathon/epic-errands-v1-agent-traces/commit/085afdffb7a94d6f068104bcb4e27604582fbe76 - Dataset package source:
product/5-idea-epic-errands/5-v1-epic-errands-app/evidence/demo-full-assets/ - Human table:
goal-theme-live-asset-table.md - Live trace rows:
agent_traces/codex/2026-06-14/live_agent_traces.jsonl - Model access preflight:
model_access_preflight.json
What This Proves
This proves the text-first trace contract and live model execution for the 3x3 quick eval:
- the trace rows store
text_prompt,card_text,resolved_image_prompt,resolved_audio_prompt, andspoken_text; - FLUX image prompts are resolved from generated card text;
- VoxCPM2 audio prompts are resolved from generated card text;
- generated assets and ASR transcripts are linked per goal/theme row.
What This Does Not Prove
This does not claim judge-ready quality or public release readiness. It also does not promote MiniCPM4.1-8B as the default text generator because its outputs failed the current strict JSON schema check.