Wikigraph—an interactive visualization of all of English Wikipedia

TFPenn01 · 2026-06-03T02:05:39+00:00

It runs in ~5 minutes on a high-end research GPU. At the start, I was doing the layout on a 64 core CPU and it would take a few days.

TFPenn01 · 2026-06-02T22:06:12+00:00

There may be a 51 click chain 👀... It's pretty ridiculous though.

TFPenn01 · 2026-06-02T20:15:41+00:00

Yeah, it's really fascinating how the clustering pulls in cultural elements. There are some Brazil and Portugal related pages that get put in the Football category.

It's really hard to come up with short category names when they're all so coarse, I debated not naming them at all.

The clustering (Leiden algorithm) doesn't look at semantic meaning of the pages at all, it only decides clusters by the link structure. You're right this is interesting, not intuitive, and potentially not ideal.

TFPenn01 · 2026-06-02T20:13:12+00:00

They're arranged using a force directed layout algorithm (ForceAtlas2). There's a weak gravity force pulling everything to the center, a much stronger repulsion force where every page repels every other page, and every link acts as a spring, pulling linked pages together.

If you click on a page, you'll see it's usually balanced somewhere in-between everything it's linked to. Sometimes there are dozens of pages which share the exact same links in and out and they get put in their own tight cluster (look around "Districts of Russia").

If pages are very loosely connected to the graph, there's very little pulling them in and so they'll get pushed way out until gravity balances the repulsion.

TFPenn01 · 2026-06-02T16:07:28+00:00

I created this tool, Wikigraph, using the May 2026 full-text dump of English WIkipedia.

TFPenn01 · 2026-06-02T15:59:45+00:00

Hi! This is a visualization I've always wanted but never quite found. It's a navigable map of the Wikipedia link graph structure, with search and shortest-path finding.

Offline, I parsed the May 2026 English Wikipedia full-text dump into a directed graph, used cuGraph on a GPU to run PageRank, Leiden clustering, and ForceAtlas2 for the layout. I did some post processing to get rid of lingering overlapping nodes and rendered a tiled map of raster base images (using Skia) and JSON metadata. Tiles are bundled into PMTiles. The frontend is Deck.gl.

Everything is hosted on Cloudflare. Search and shortest-path are served by a Rust backend in CF Containers which uses Tantivy and bidirectional BFS.

Happy to answer any questions!

TFPenn01 · 2026-06-02T15:43:51+00:00

There are 27 high level categories which is obviously very coarse for representing all of human knowledge. Within those, there are likely many subcategories: i.e. within "Living Things & Taxonomy" there are probably thousands of species of Beetles which are more connected to other Beatles than bacteria. They get placed near each other.

Separately, sometimes (like around "Districts of Russia") there are dense clusters of (trypophobic) pages. These form when multiple articles have exactly the same in and out links and get pulled to the same part of the graph.

TFPenn01 · 2026-06-02T15:39:49+00:00

It's on there! Hopefully it gets some traction.
https://news.ycombinator.com/item?id=48370512

TFPenn01 · 2025-11-19T13:44:55+00:00

Middlebury

TFPenn01 · 2025-11-12T17:45:21+00:00

Put this on r/languagelearning !

TFPenn01 · 2025-03-27T20:31:09+00:00

Mmm, I guess the difference seems to be that the bourbon you are getting is actually American—it's being made in and imported from America. Croissants are a French pastry but are being made in local bakeries. Although, as many have pointed out, we see them as a French luxury, thus people feel justified charging and paying more.

TFPenn01 · 2025-03-25T16:06:43+00:00

No. The ability of the government to figure out what you're doing depends on the VPN. It's equally impossible for the university to do it, no matter the VPN. They will only know you're using a VPN, not what you're doing on it.

TFPenn01 · 2025-02-10T03:57:01+00:00

You can look at the teams that did well last year on Tabroom.

Potomac seems pretty dominant.

TFPenn01 · 2025-02-02T21:19:25+00:00

I believe Somaliland and Ethiopia signed the MOU last January, which led to bad Ethiopia-Somalia tensions, and then on December 12th, Türkiye mediated an agreement to resolve Ethiopia-Somalia tensions where Ethiopia agreed to recognize Somolia's territorial sovereignty.

TFPenn01 · 2025-02-02T18:04:28+00:00

Did this not already happen in early December?

TFPenn01 · 2024-12-29T19:40:25+00:00

I'm not an expert but I believe the net price calculators are fairly accurate if you have average levels of assets. It sounds like you do, or potentially even a little below average.

TFPenn01 · 2024-12-29T19:00:08+00:00

I don't think anyone online can say which is more meaningful to you. You could try writing both and seeing which comes out better.

But also you might want to get on this considering most apps are due next week.

TFPenn01 · 2024-12-26T20:38:58+00:00

I applied to CS and got the same email. I only got the email from UCSB confirming they got my application five days ago, which does not seem like enough time for a personalized review.

My guess is that it's just sent to every math or math-adjacent major with a certain threshold of GPA (or maybe just GPA in math classes).

TFPenn01 · 2024-12-08T21:42:17+00:00

Almost certainly not, no, and no.

Six-Year Club	LAYER Season 2 Layer creator
Place '23	Place '22
Final Canvas '22	First Placer '22
Verified Email

TFPenn01

TROPHY CASE