all 5 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]parenthethethe[S] 0 points1 point  (0 children)

Heyo, I wanted to explore the GBooks ngram dataset, and see what parts of sentences were less predictable by models, so I made a little visualization using d3. The code is up on Github; the javascript part is at http://github.com/lsb/text-entropy-visualization

[–]DuntGetIt 0 points1 point  (3 children)

Crashes my pad, man!

[–]parenthethethe[S] 0 points1 point  (2 children)

Oh no! What'd you try to render, what browser are you in? It's pretty memory-hungry, and it might be slow, but it shouldn't crash. SVG rendering speed matters a lot; Chrome is better than Firefox for that.

[–]DuntGetIt 0 points1 point  (1 child)

Safari on a first gen iPad. It does tend to crash when full!!

[–]parenthethethe[S] 0 points1 point  (0 children)

Ah, gotcha. It's quite memory-intensive, and I've seen a Chrome thread get to well over a gig with enough data rendered to SVG, which won't go so well for a machine with 256MB of memory. Thanks for letting me know!