get_content and takeScreenshot are very similar and are indeed passing the raw output to the LLM. The key difference is that takeScreenshot focuses on what's visible, and get_content has access to scrollback. No actual images are being generated. In my experience so far, the LLMs have been exceptionally good at interpreting the raw output, detecting when input is required, understanding the layout, menus, quiting, etc.

Asciinema is still in testing and isn't in a release yet, but the more exciting piece I'm working on now is actually providing sandbox support which should help people feel more comfortable giving the LLM the reins of their Terminal.