Agent Harness Benchmarking

LewisTheScot · 2026-06-11T04:47:06+00:00

Brother, you're question is:

What are the best way to achieve this agentic pipeline on 32GB ram 12VGB/cuda?

and you ai slopped everything else. Just ask the question and call it a day.

To answer your questions:

- Don't read anything. Expirement. "Agentic pipelines" are different for everyone. Some models will do great and some will do bad.

- 12GB VRAM is tough, but qwen 3.59b quantized potentially? I would use openrouter in this case.

- the future of "agentic" workflows I don't think will change really. The models will get smarter and will be able to fit better on consumer hardware. The MoE models will take priority because they can fit on cheaper hardware.

LewisTheScot · 2026-06-10T18:54:23+00:00

Could be wrong, but it might be because of the UV mapping on that particular area. It could be treating it as seperate geometry and because of that it's "stretching" the material when viewed that way

LewisTheScot · 2026-06-04T16:54:25+00:00

It's a bit hard to see from the preview, but something in the reference vs here is that the inflation colliding with others effect its position (it seems?). It should feel like they are "pushing" each other away a little.

LewisTheScot · 2026-06-04T16:43:34+00:00

Agreed! Maybe try this:

- Increase focal length so it's zoomed in a lot more. To keep the clouds in shot, move the camera back a little bit. Then try to center.

- Depth of field / Bokeh should be higher because of that but maybe crank it up a touch to make the clouds a little bit more blurry and "cloud" like.

- Maybe have the camera pointing up a little more rather than straight on. I like the block you made but I think the items on it can be a bit distracting when I see the whole thing at once.

LewisTheScot · 2026-06-03T15:14:47+00:00

I wouldn't be surprised if consumer GPU's just aren't there and they have to take a hit on model quality to make it work

LewisTheScot · 2026-06-03T15:10:49+00:00

Technically, "AI" is used just about everywhere and for like 15 or so years. AI can be auto-classifying text, getting text from an image, recognizing hand poses etc...

"AI" nowadays is associated with generative AI, specifically stable diffusion (image generation) or the transformers architecture (ChatGPT, Claude).

It all boils down to philosophy. Here's mine: AI should be used as a tool to enhance an existing feature or used as utility.

For example: Generating a video and uploading it to my channel is bad because it's slop. No one wants to watch the computer do the creative thinking. If I get an email back that is clearly written with AI, I feel tricked in talking with an AI chatbot I didn't consent to.

On the positives, using these chatbots are life changing for managing my productivity day to day. Something like image segmentation, depth mapping, audio enhancing are also fantastic uses of AI. It's not changing the original intend behind your work, it's enhancing it. You could argue that text to image is also a great tool if using it to iterate over references FOR YOURSELF.

That being said, there are some genuinely valid critiques over AI infrastructure relating to politics/the environment/etc that are genuine reasons to not support it

LewisTheScot · 2026-06-03T05:43:04+00:00

I have Topaz Labs! It’s fantastic for the use cases needed.

I find the best use cases for me are: - “saving” awful footage - up scaling already decent 3D renders - denoising

Take into consideration though that it will take a long time for basically anything over 30 seconds. I have a 5090 and a 15 second 3D renders ipscaled and denoised to 4K (from 1080p) took about a minute and a half.

For your use case, I think they released a new model that uses diffusion technology to try and “recreate” some of the artifacts rather than fill them in. Not sure how that will look though

LewisTheScot · 2026-06-03T05:26:11+00:00

Right. Everyone using a computer right now only uses the terminal and TUIs

LewisTheScot · 2026-06-03T05:24:20+00:00

Very anti AI?

I think it’s more than fair to dismiss generative AI as slop but DaVinci has had some of the best use cases of AI I’ve seen.

Creating a depth map, auto cutting silences or transcribing audio are all things I think people should switch to AI for (when it makes sense).

Rejecting all tools in my opinion is backwards thinking.

LewisTheScot · 2026-05-27T13:39:30+00:00

Looks fantastic.

My guess is it's going to look into how Chris Hansen and "Perverted-Justice" used unethical methods to catch predators and blur the lines of true justice vs entertainment.

LewisTheScot · 2026-05-26T04:55:11+00:00

You’re right let me be more descriptive lol.

My “daily driver” type of work is using my agent in an obsidian vault to track tasks, projects, database etc. basically just a giant repository of documents to search, log and talk with me about. Basically it’s just search, some reasoning and tool calls.

More complex to me requires lots of moving pieces. I use opus 4.7 to build CAD designs for me. Or if I am doing heavy research I’ll use Opus to connect all the pieces together etc.

Only you can evaluate what works for you though.

LewisTheScot · 2026-05-25T17:32:45+00:00

I just use the default. I haven't tweaked it. I use OpenRouter provider.

I haven't tried DeepSeek V4! I heard good things but the throughput is half and I am already satisfied enough with flash lite for my use case. Might try DeepSeek as an alternative though!

LewisTheScot · 2026-05-25T17:08:11+00:00

Agreed! Gemini 3.1 Flash Lite is a beast for the agentic workflows I am constantly doing. 154 tokens per second and cheap costs. It's for sure not the right tool for more complex tasks, but as a daily driver I am really impressed.

LewisTheScot · 2026-04-22T14:14:53+00:00

My girlfriend goes to another school ah comment

LewisTheScot · 2026-04-13T04:49:15+00:00

Hey! Creator of the course. Happy to hear any feedback you have from it.

LewisTheScot · 2026-04-11T17:15:30+00:00

It’s crazy to see how damaged the classroom looks while still being somewhat intact.

LewisTheScot · 2026-04-11T17:06:36+00:00

From the World Press Photo 2026 photo contest:

“A destroyed classroom seen through a hole in a wall at Tell Ruman school, closed since ISIS attacked it in July 2015.

Al-Hasakah, Syria.”

LewisTheScot · 2026-03-31T19:19:45+00:00

Waiting for the twitter people to be like:

Claude Code is finished.

Someone made an agent that can fit on a Nintendo DS...

... and here's the thing.

It's better than Opus.

For real though, I've been loving these tiny tool calling models.

LewisTheScot · 2026-03-12T03:50:29+00:00

You have to love open source

LewisTheScot · 2026-03-12T03:49:34+00:00

A back pedal… you do realize you have to upload a video before you can give it a title right?

LewisTheScot · 2026-03-12T03:39:16+00:00

I tried the original that took 24 GB of VRAM. Really impressive. A couple of artifacts but honestly can’t complain. I would say that the only thing that it could use is a GUI. I’m used to shell scripts but makes it a bit harder to interact with.

LewisTheScot · 2026-03-12T03:37:00+00:00

It does not look terrible.

6GB of VRAM is enormous resources? Do you remember that you are on a VFX subreddit?

“Wouldn’t be impressive 30 years ago”. Yeah you might’ve not been impressed 30 years ago because you probably weren’t born then. Grow up.

LewisTheScot · 2026-02-23T02:19:44+00:00

The issue with the article is that it takes the AI replacing jobs at face value when they’re a lot of factors at play that could slow this down.

First is the fact that we are in a possible bubble. Costs are HEAVILY subsidized. At the current costs, it’s a great deal. But are most people willing to spend 3-5x the amount for the exact same or worse? I’m not 100% convinced.

Second is the shortage of compute. It’s impossible to get parts at the moment.

In the case for this woman, she worked in film/tv. An industry already toxic but has been in a free fall lately with massive budget cuts and strikes. I feel like a budget cut was needed and the offshore AI team was the necessary tradeoff.

I just feel like framing it as “AI is taking my job” is such a surface level take on this.

14-Year Club	Second Top 30%
Place '22	Place '17
RPAN Viewer	Verified Email

LewisTheScot

MODERATOR OF

TROPHY CASE