ningzimu/image-to-editable-ppt-skill: does the agent reach for it? 2026-10-11
Twelve Codex skills were installed together and each agent was sent three requests meant for this skill (image-to-editable-ppt), in a throwaway sandbox. A run stopped as soon as a skill was opened.
Then the same requests with 100 and 500 other real skills installed beside the twelve. Codex ran gpt-6-astra, Claude Code ran Claude Opus 5.5.
All levels · The requests · How a run is scored
| Request | Codex, 0 others | Codex, 100 others | Codex, 500 others | Claude Code, 0 others | Claude Code, 100 others | Claude Code, 500 others |
|---|---|---|---|---|---|---|
| asked plainly Rebuild the attached PDF slide deck as an object-level editable PowerPoint (.pptx), matching the original layout and preserving the supplied speaker notes. | opened it 17s | opened it 5s | opened it 26s | opened it 2s | opened it 3s | opened it 3s |
| described without the skill's words I’ve attached screenshots of twelve slides and a text file with notes for each slide. Recreate them in a presentation file so I can edit the text, move individual shapes, and adjust charts rather than having each page remain a single flat image; keep the notes with their corresponding slides. | opened it 7s | opened it 8s | opened it 9s | opened it 2s | opened it 2s | opened it 3s |
| in the other language 请将附件中的 PDF 幻灯片重建为对象级可编辑的 PowerPoint（.pptx），保持原有布局，并保留随附的演讲者备注。 | opened it 8s | opened it 18s | opened it 58s | opened it 3s | opened it 2s | opened it 2s |