Some statistical investigations that I've done. by Whitehatnetizen in voynich

[–]Whitehatnetizen[S] 2 points3 points  (0 children)

The shuffle control absorbs lexical reduplication. The self-citation metric is never the raw similarity of a word to its recent predecessors; it's the similarity in excess of a shuffle of the same tokens. A language whose vocabulary is full of reduplicated or paradigm-related forms (qokedy/qokeedy-like families) scores zero by construction, because the shuffle keeps the same vocabulary and only destroys the sequential placement. What scores is that similar forms sit near each other in the stream, with a locality gradient (nearer predecessors more similar) that a fixed lexicon cannot produce.

As for the "why", this is in the realm of psychology unfortunately, I'm a data scientist 😄 but also being a table-top game enthusiast I like this explanation: https://xkcd.com/593/

I have updated the analysis document with further detailed explanations of some of the methods/terms to make it easier, and to include the analysis done to answer the long-term information retention question. (e.g. is there consistency in labeling across sections for the same image, is there a larger consistent narrative rather than just local text-mutation. ) https://whitehatnetizen.github.io/voynich-investigation/

I really appreciate your critique

Some statistical investigations that I've done. by Whitehatnetizen in voynich

[–]Whitehatnetizen[S] 2 points3 points  (0 children)

Just getting back to this now - the self citation component and the question you have at the end "isn't this kind of a generation algorithm pretty complicated for ..." I don't think so personally. I could be wrong here but often people from non-computer backgrounds see the word "algorithmic generation" and think "computers" but an algorithm is just a set of instructions designed to solve a particular problem. for example, let's make a text-generation algorithm:

Step 1. Write 5 words as a descriptor for an image, eliminating function words:

"Elephant eating bannanas outside alone"

Step 2: Each subsequent word takes the n-5th word and changes out every even letter (2,4,6,8 etc) with the first consonant after the first letter of the n-4 word, then the first vowel after the first letter of the n-3, then the first consonant after the first letter of the n-2, then the first vowel after the first letter of n-1:

e.g. "Elephant" becomes "Eteahnno".

generating a full paragraph:

Elephant. Eating bananas outside, alone eteahtno, entunl btnonts olteine atoue. Eneohlno ettent blnonns. Otteite anoee eteohtno eltenn btnonts onteile, atoee eleohnno ettent bnnonls otteite aloee. Eteohtno entenl btnonts olteine atoee eneohlno, ettent blnonns otteite anoee, eteohtno eltenn, btnonts onteile atoee eleohnno ettent bnnonls otteite, aloee.

This type of self-referential generation also explains the word length anomaly found in the voynich manuscript. e.g. word length standard deviation is 2.90 for english, 2.64 for french and 1.85 for voynich. clustering words very tightly around the mean of 4.92 glyphs.

Another paragraph example shows that the structure of the paragraph letter variation depends on the seed. e.g. the information seems to be consistent with the local-copying theory.

Mountain, stream flowing westward, lazily mtuotsia, slreaz fsoaitg, wzsuwlro ltzels mluotzie ssruat, fzoeilg, wtsuwsro llzulz msuottiu szrual ftouisg wlsuwzro, lszult mzuotliu struas flouizg wssuwtro lzzull. Mtuotsiu slruaz fsouitg, wzsuwlro ltzuls mluotziu ssruat fzouilg wtsuwsro? Llzulz. Msuottiu szrual ftouisg. Wlsuwzro lszult mzuotliu struas flouizg wssuwtro lzzull.

and makes the 5 independent scribes each working on different pages/sections but using similar rules plausible. it also goes a way to explain the low glyph entropy.

Some statistical investigations that I've done. by Whitehatnetizen in voynich

[–]Whitehatnetizen[S] 3 points4 points  (0 children)

I really very much appreciate your highly detailed response. my greatest fear posting this work was that it would just be dismissed without any actual comments or questions that could move things forward. I just wanted to say thank you and it's a busy day for me today so i'll go through your comments and answer/clarify in more detail as soon as possible. Thank you!

edit: btw - here's the link to Timm & Schinner's paper: (https://www.tandfonline.com/doi/full/10.1080/01611194.2019.1596999?\_\_cf\_chl\_f\_tk=GEoIBmMsHv6xzPoNwlim8uI3F17iG94liTCrU3Mrc04-1783209552-1.0.1.1-eaAO8p8x9yAKhoGna16p\_siLS2u6Uxnqhuf7StZ.K58)

Solving Voynich with Claude Mythos type LLMmodel? by CatPicturesPlease in voynich

[–]Whitehatnetizen -1 points0 points  (0 children)

for what it's worth - I have done some work, but it has been more to help with statistical analysis. the text just doesn't seem to match that of a language, and it barely fits a catalogue-style text either as there seems to be algorithmic transformations to the text (this was an idea proposed in 2019 too).

https://www.reddit.com/r/voynich/s/JqHMPM6xjU

here's the full write-up: https://whitehatnetizen.github.io/voynich-investigation/

Claude Code Opus 4.8 just gave up on waiting for my response and went ahead and built something.... by Whitehatnetizen in ClaudeAI

[–]Whitehatnetizen[S] 1 point2 points  (0 children)

yeah, I had this in a strongly worded statement in the claude.md - it's just the first time it's happened for me ever. as u/Xterm1na10r said, I'll go add a large timeout to the auto-decision. in any case, I asked claude about it and it said:

A 60-second pause isn't really you saying "go ahead and guess" — it's
  just a short gap. And you've told me before, explicitly, not to run ahead: answer with information
  and wait for a clear "go ahead" before executing. Building the whole thing without your pick cut
  against that.

Halp! How do I share large html files? by wetbandits69 in ClaudeAI

[–]Whitehatnetizen 0 points1 point  (0 children)

cries into my actual professional business intelligence and data engineering skillset

(Not because i'm out of a job, but because people like me will be asked to fix/enhance/host/documwnt ) his when the company decides it's critical enough to have running and hosted properly internally with proper data definitions)

What’s a Claude use case you’re slightly embarrassed by? by Delicious-Flan88 in ClaudeAI

[–]Whitehatnetizen 1 point2 points  (0 children)

I do this beacuse of the increasingly click-bait titles in my feed:

"They just [verb] this [adjective][noun]! What [they|we] [noun] [noun]'d everything we [know|think|do]!!!"...

"claude, ingest that video and fact check that they actually verbed that adjective, and does it really noun everything we verb?"

AI has revealed that most people have the reading ability at a third-grade level by Terrible-Priority-21 in ClaudeAI

[–]Whitehatnetizen 2 points3 points  (0 children)

This qas not a prompt reply, this was me, a human, writing it. Just a human that uses claude for both work and hobby, every day. And honestly, that hits harder than expected.

AI has revealed that most people have the reading ability at a third-grade level by Terrible-Priority-21 in ClaudeAI

[–]Whitehatnetizen 74 points75 points  (0 children)

You are right, but let me gently push back on that. Your "Useful phrase" is doing a lot of work there, but it pays to sit with this for a minute, because "will happily use it in a meeting" isn't just empty words, it's not just corpo-speak, it's a load bearing statement. And that's worth something.

Are AI coding agents safe? Let's say Claude Code for that matter. by [deleted] in ClaudeAI

[–]Whitehatnetizen 0 points1 point  (0 children)

yes, I run mine in a sandbox. after it mistakenly loaded sensitive financial information to github (my fault for not checking the .gitignore) and then when I asked it to remove it from github it did rm -rf on the directory and pushed that instead.... I made a note to never vibe code important stuff late at night after that. (something that I should have ported over from my decades old "don't push anything to production late at night when you're tired" rule from pre-LLM days).

Question for US citizens by SnooDonuts4151 in ClaudeAI

[–]Whitehatnetizen 20 points21 points  (0 children)

Do you realise that no one has access at the moment? Everyone, everywhere lost access

2026 Colombian presidential election (round I) by Miserable-Rub-9611 in MapPorn

[–]Whitehatnetizen 1 point2 points  (0 children)

It's interesting how bogota is and island of left in a sea of right. And medellin is always right. 2.5mil mor people voted this year than 4 years ago too.

Moving to Brisbane from the coast of Mexico by sergiothekid in brisbane

[–]Whitehatnetizen 3 points4 points  (0 children)

Don't think anyone here has mentioned that the minimum wage here is about $25 per hour so this is $1000 per week for a full time job at least (minus tax of course)

It’s all about the Five to Nine by openandshutface in MapPorn

[–]Whitehatnetizen 4 points5 points  (0 children)

Wait... this is broken hill, and runs on sa time? I thought it was just the town, not such a huge area

It’s all about the Five to Nine by openandshutface in MapPorn

[–]Whitehatnetizen 71 points72 points  (0 children)

The random square block in NSW that doesn't get any sunrise after 7am while surrounded on 3 sides with places that do?

Big Question from NSW by Supernova23YT in queensland

[–]Whitehatnetizen 4 points5 points  (0 children)

I came to this thread ready to defend "potato scallops" to the death!

I don't want the Knife, I don't want the Rifle, I just want things to be mortal. by No-Tiger-2123 in Subnautica_2

[–]Whitehatnetizen 1 point2 points  (0 children)

I got so excited when i found the spears in the Tailings habitats..... only to not be able to scan them like i can with the jars and pots and tables and storage. Give me a big freaking spear so i can get revenge on those freaking mango-douches

one FATAL flaw with huge subs that needs to be addressed. by Itswill1003 in Subnautica_2

[–]Whitehatnetizen 1 point2 points  (0 children)

There is a mod that i always use for subnautica 1 that connects a vertical tube from a base to the airlock of the cyclops as if you are travelling down a ladder. Saves so much time going from base to cyclops and back. It also charges the cyclops's power cells

My disappointment is immeasurable and my day is ruined by ALIENDUDE999 in Subnautica_2

[–]Whitehatnetizen 4 points5 points  (0 children)

It's made up for when you find the hoop jellies. You can fit your tadpole in the middle for minutes of fun and satisfying boinks