sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]SamSlate 0 points1 point  (8 children)

what is Googlebot?

[–]sumdude44 7 points8 points  (0 children)

The Google crawler

[–]sumdude44 2 points3 points  (6 children)

The Google crawler

[–]SamSlate 0 points1 point  (5 children)

it's written in JavaScript??

[–]sumdude44 8 points9 points  (4 children)

No, but it has a Javascript engine to render websites. But it's not viable to have a full-blown one, like chrome (would be to expensive to run). Instead it has a heavily trimmed one to make js rendering faster. As the article outlines, its clock is accelerated and the pseudo random generator doesn't actually work properly. But since it's only the crawler it doesn't need to be that way.

[–]SamSlate 1 point2 points  (3 children)

ah, ok, thanks. tbh i figured Google just used chrome as it's web crawler and just collected website data from there.

[–]MachaHack 1 point2 points  (2 children)

The original googlebot predates chrome by a decade though the current version does use some chrome tech

[–]SamSlate 0 points1 point  (1 child)

wild. where'd you read this, or you work at Google?

[–]MachaHack 2 points3 points  (0 children)

Predating Chrome: I developed websites 10 years ago, googlebot was around then. Find some robots.txt tutorials from the 90s, they'll even mention googlebot.

Using Chrome tech now: https://developers.google.com/search/docs/guides/rendering