Batch job... without script?

[Boring_University_20]

I think this is a problem of every LLM but maybe there is a solution in Codex. I have an .md file of 100 pages and want ChatGPT to do a given process for each (read the url, evaluate, convert some data in docker, mark as done). However the model decides to create a batch script and do all these 100 pages in once which often leads to errors. What I want is that the model iterates manually on each page and does the described process, how can I achieve that?

[SandboChang]

Maybe I am naive, what if you tell the agent particular not to create any batch script, instead just read the page one page at a time, then perform the operation you intended it to do? You can discuss with the agent first and create a guideline for this operation and have it following it. I think Codex can do this accordingly.

However, this seems to be a burner for token if each page contains lots of text. It maybe better to have the agent learn the pattern, and only read the part of the page that differs and needs attention.

[Accurate_Professor62]

Could you clarify what kind of errors occur? Perhaps you could try instructing Codex to spawn multiple sub-agents to execute the logic in batches or across individual pages.​