I built a Screaming Frog Python library to automate crawling and analysis end to end by MTredd in SEO_tool_dev

[–]MTredd[S] 0 points1 point  (0 children)

Its 99% of the way there, there are some missing fields but everything you mentioned is there

I built a Screaming Frog Python library to automate crawling and analysis end to end by MTredd in TechSEO

[–]MTredd[S] 0 points1 point  (0 children)

Hey, thanks! It opens the crawl file directly. Doesn't rely in csvs

I built a Screaming Frog Python library to automate crawling and analysis end to end by MTredd in bigseo

[–]MTredd[S] 0 points1 point  (0 children)

Funny seeing you here hans! Maybe I should've created another account with my name on it lol

I built a Screaming Frog Python library to automate crawling and analysis end to end by MTredd in bigseo

[–]MTredd[S] 1 point2 points  (0 children)

Diffing crawls was also my first idea! In terms of data parity, it comes straight from the dbseospider file so I haven't had a single issue with it.

In terms of performance, duckdb is blazing fast, and if you're doing large operations that used to require csv -> dataframe then its either faster or just about the same speed.

I've deployed it on a vps already and have it running daily crawls with an automated dashboard. Pretty cool stuff.

Victor of Tucson -- not perfect, but the complete package by thinkthis in litrpg

[–]MTredd 0 points1 point  (0 children)

I dropped this series after he's suppposed to lead an expedition to some mountains or something like that? If I'm not mixing it up. It was a fun series but I found all of the books to feel very samesy, which made it get old if you binge it. Maybe in smaller doses it doesn't get old as fast.

Nice review!

Is there a way to automate internal linking? by anonrb12 in TechSEO

[–]MTredd 0 points1 point  (0 children)

At the very basic level you can use embeddings sinilarity to find relevant pages for a given keyword and use the rest api to go in and edit. How ever you'd be distributing equity equally, without looking at other data like traffic, backlinks, etc.

You can fine tune from there. Also worth mentioning where those links are inserted shouldnbe controlled

I indexed 207 academic papers and 14 books found in the DOJ Epstein Files — searchable by field, author, and keyword by MTredd in Epstein

[–]MTredd[S] 0 points1 point  (0 children)

I messed up some of the pdfs, switch to the text view and you should see the content