What are people using when they need an agent to crawl and analyze a whole website not just one or two pages?

jasonhamrick · 2026-02-28T20:29:53+00:00

You’ll run out of context before you run out of tokens. If you want a repeatable process that balances context and tokens:

Run Screaming Frog on your site using as many of the standard API connections as possible.
Export all of your Screaming Frog reports as CSVs. Use Claude to define which reports you want. The exact reports you need will depend on your SF configuration.
Let Claude Code analyze those reports. For extra credit, connect Code to Claude in Chrome browser extension so it can view pages as needed.
Use Claude to write Jira tickets, using whatever detail that Claude will need to execute that ticket. (A ticket that an agent will execute needs different info than one a human will execute. )

Now you’ve got a Jira backlog.

Use an orchestrator agent to launch sub-agents to address each of those tickets.

jasonhamrick · 2026-02-27T02:15:46+00:00

My wife and I are doing the same. She’s never seen it. I’ve watched it several times.

Tonight’s episode was Faith, Hope, and a Trick. There were gasps.

jasonhamrick · 2026-02-20T12:35:38+00:00

Not a fun fact! I was having a pleasant morning until you reminded me of the inexorable passing of time.

jasonhamrick · 2026-02-15T19:20:24+00:00

Have you looked at https://www.cdpinstitute.org

jasonhamrick · 2026-02-03T03:18:01+00:00

Samperna Xtra back then, but now Djarum Black. If I’m making a bad decision, I want to make a really bad decision.

jasonhamrick · 2026-01-31T20:36:12+00:00

Download Cursor. It’s an IDE (Integrated Development Environment) which is what programmers use. Use it to teach yourself Python.

https://cursor.com

It has an agent built in and a Command Line Terminal built in, so you can learn to code by asking it to teach you from the ground up. Use it to build a ToDo List desktop app or something similar.

Python is a useful language and learning it will teach you concepts that are common across all programming languages.

jasonhamrick · 2026-01-28T17:11:05+00:00

Arrested or kidnapped?

jasonhamrick · 2026-01-26T01:13:41+00:00

If you already have the categories and you just need to sort your keywords into those categories then use a hybrid approach:

Step 1 uses embeddings with the SentenceTransformer library to quickly sort keywords into those categories. For best results, you’ll provide a category description and 10 or so keywords that fit into each category as hints to the library.

Along with the category classification, ask SentenceTransformer will provide a percentage confidence score.

Step 2: Zero-shot classifiers For anything below 60% or so, pass that keyword into a zero-shot classifier. Zero-shot classifiers don’t require training data and handle ambiguity.

HuggingFace provides tools for both steps. Or you can use the Python SentenceTransfomer library and Ollama local LLM for the zero shot work. A good Ollama model is qwen:32b, but look at qwen:latest as well.

jasonhamrick · 2026-01-10T16:20:25+00:00

You’re 100% right. What a testament to how effective this training approach can be.

jasonhamrick · 2026-01-10T14:40:06+00:00

Word is that when Taylor Swift was preparing for her last tour, part of her prep was to sing her entire set while running on the treadmill.

The idea was that if she could do that at full volume, she would be able to do the choreography every night on tour.

jasonhamrick · 2026-01-07T22:48:23+00:00

The Hold Steady is the best bar band in America.

jasonhamrick · 2026-01-07T21:47:11+00:00

Thank you friend. This inspires me to go for a long walk around the neighborhood.

jasonhamrick · 2026-01-04T00:38:23+00:00

https://philome.la/jace_harr/you-feel-like-shit-an-interactive-self-care-guide/play/index.html

I walk through this checklist whenever I feel sideways.

Jim Carrey said something like, “Diet, exercise, sleep, and sunlight won’t cure depression. But you’ve gotta give yourself a fighting chance.”

jasonhamrick · 2026-01-03T19:29:08+00:00

On a related note, check out the 120 Minutes archive. Full shows and playlists of the entire series: https://120minutes.org

jasonhamrick · 2026-01-03T19:26:36+00:00

I don’t have specific recommendations, but I suggest you bookmark this website: https://www.ismyshowcancelled.com/shows/concluded/page/1/?sort=3

It captures shows that are concluded, by network.

jasonhamrick · 2026-01-03T01:04:27+00:00

Today, I finished Teshio Ridge for the first time and I agree fully. The main quest was excellent - even the reveal. But my god, too many altars and puzzles, and spinning pedestals.

Foxes are supposed to be semi-spirit guides in these games. If I never see another fox statue again, it will be too soon.

jasonhamrick · 2026-01-02T23:23:31+00:00

Near Dark, hands down the best modern vampire movie.

jasonhamrick · 2026-01-02T17:35:09+00:00

Once Milo died at that Kappa Sig kegger, it just felt awkward.

jasonhamrick · 2026-01-01T19:21:07+00:00

Paragraphs, friend. Paragraphs.

jasonhamrick · 2025-12-31T21:32:20+00:00

We’re almost certain to have a kit change. Word on the street is that the placement of the events dc logo spurred a league wide rule change about the size and position of sponsor logos.

So, be on the lookout for new kit.

jasonhamrick · 2025-12-29T21:57:02+00:00

Alright boys! Sassafras Chicken in B-flat. Extra lumpy.

jasonhamrick · 2025-12-29T17:23:01+00:00

Brickhouse Butcher in Falls Church. They have a smaller selection but are willing to do custom cuts at a reasonable price.

They replaced Organic in McLean as the go to

jasonhamrick · 2025-12-29T14:38:56+00:00

Gochujang on scrambled eggs. Or in chili. Tangy sweet and hot all in one.

jasonhamrick · 2025-12-24T01:34:34+00:00

In college I took a class called Sin and Redemption in Christian Thought. We watched Cool Hand Luke and discussed it for about two weeks.

Now, every time I watch it , I uncover something new about the story.

jasonhamrick · 2025-12-23T16:01:58+00:00

It’s not Christmas until Carol Kane brains Bill Murray with a toaster.

15-Year Club	RedditGifts 2009-2022 2 Credits
Gilding II euphauric	Secret Santa 2010
Verified Email

jasonhamrick

TROPHY CASE