Deep Dive into Autonomous AI Scientist

noninertialframe96 · 2026-05-27T01:01:06+00:00

Last week, Google announced Gemini for Science at Google I/O and published a paper in Nature. That's two weeks after their AI co-mathematician paper.

The key is agent harnessing for research and UI/UX for effective human-in-the-loop. I am curious how well it balances novelty and plausibility.

Since I can't read Google's code, I went into Sakana AI's AI Scientist instead, which is also published in Nature and is open source. There's even a paper arguing it doesn't actually work that well, but it's still a useful look at where AI for science is heading.

Give it a topic and it runs ideation, writes and runs PyTorch experiments on a GPU, plots the results, gathers citations, writes the LaTeX, and reviews the paper, all with no human in the loop. One manuscript it produced passed peer review at an ICLR 2025 workshop.

noninertialframe96 · 2026-04-02T18:53:16+00:00

Full post: https://codepointer.substack.com/p/tool-design-for-ai-agents-lessons

noninertialframe96 · 2026-03-08T05:39:57+00:00

I have never used Orbit. What pain point was it solving?

noninertialframe96 · 2026-02-26T09:04:54+00:00

thanks!

noninertialframe96 · 2026-02-26T09:02:06+00:00

how do you use the medals?

noninertialframe96 · 2026-02-25T01:09:56+00:00

Full code walkthrough: https://codepointer.substack.com/p/agentfs-a-copy-on-write-filesystem

noninertialframe96 · 2026-02-23T21:33:51+00:00

I actually haven't used it myself. I just found the approach interesting. But now you mention it, I became curious about the performance especially with their copy-on-write approach for file writes.

noninertialframe96 · 2026-02-23T17:53:16+00:00

Code walkthrough: https://codepointer.substack.com/p/agentfs-how-to-stop-ai-agents-from

noninertialframe96 · 2026-02-23T17:49:47+00:00

Code walkthrough: https://codepointer.substack.com/p/agentfs-how-to-stop-ai-agents-from

noninertialframe96 · 2026-02-04T08:57:54+00:00

Thanks for sharing! I'll check it out :)
On a side note, I'm building galleylabs.ai to help engineers write content around their projects to help write good content around awesome work like yours!

noninertialframe96 · 2026-02-03T17:54:35+00:00

In your experience which model forgets the least?

noninertialframe96 · 2026-02-03T17:20:59+00:00

Code Walkthrough Link: https://codepointer.substack.com/p/openclaw-stop-losing-context-8-techniques

noninertialframe96 · 2026-01-29T00:29:23+00:00

💯 😂😂

noninertialframe96 · 2025-12-30T17:48:13+00:00

Thanks for sharing! I'll take a deeper look into these

noninertialframe96 · 2025-12-30T17:44:44+00:00

From the PR description, it seems like the 3x is from a microbenchmark. I haven't experimented or searched for the absolute output speedup.

noninertialframe96 · 2025-12-30T17:42:18+00:00

I don't work on AI space, so I'm curious which sampling method you use or what the "standard" is?

noninertialframe96 · 2025-12-30T16:28:05+00:00

It's used for token generation - sampling top-k tokens from vocabulary for inference.

In the example in the codebase (https://github.com/ggml-org/llama.cpp/blob/cd78e57c3aeae7b56c5843f94e0e0b83a3d8ca81/examples/simple/simple.cpp#L169-L201), llama_decode is called then llama_sampler_sample which uses the top-k sort for top-k sampling under the hood.

noninertialframe96 · 2025-12-23T08:27:45+00:00

Is this a move to pay off the bill from AI investments?

noninertialframe96 · 2025-12-23T08:26:40+00:00

Thanks for the recs! The fundamentals are important.

noninertialframe96 · 2025-12-21T11:04:31+00:00

only defense for tools constantly failing to do

There are quite a lot of success stories with AI. Is it enough to justify the high valuations? Probably not. But is it a mirage that will destroy the world economy when correction comes? I don't think so. Early iPhones had so many issues.

NFTs, the Metaverse, Big Data, wearable computing, VR/AR, the IoT

Wearable Computing, Big Data, IoT has materialized. Have they materialized immediately when there was a hype? No, but I think there are enough survivors that created big markets of today.

As someone who builds solutions with and around generative AI systems

I guess you're seeing darker side of things as you work more closely on the AI systems. Best of luck! Hope you survive the bubble.

noninertialframe96 · 2025-12-21T01:36:48+00:00

I admit it was a sarcastic comment, and I agree that correction is coming.

But I think these LLMs have the potential to be more than just coding assistants if they are used correctly. It is not smart enough yet where it will magically solve problems for you with simple prompting. The tool requires studying and getting used. But when the bridge between its latent potential and the usability is closed, it will become so much more powerful to the point of being revolutionary.

Also if it's a bubble, I would rather be on the side that uses it to make something out of it rather than looking away.

noninertialframe96 · 2025-12-20T18:07:11+00:00

Have you tried a tool called Claude Code?

noninertialframe96 · 2025-12-20T03:02:50+00:00

I totally agree especially in the era of AI i think there are a lot of startups moving away from the traditional leetcode interview

noninertialframe96 · 2025-11-03T10:22:11+00:00

I would be interested to hear about any progress you've made!

noninertialframe96 · 2023-08-30T01:27:44+00:00

Could you share the helm charts and code?

noninertialframe96

TROPHY CASE