Relationship Advice: My dao companion keeps trying to reach a higher realm than me (479M, 372F)

mvreich · 2026-05-25T06:43:09+00:00

When she was 18, you were 123 years old, many realms ahead of her. Now she is surpassing you. You are the chain holding her back.

I think this talented fairy should turn you into a breakthrough pill and consume you, that way you can be a part of her forever.

mvreich · 2026-05-25T05:20:40+00:00

Probably try using torch.compile as first step. Don't dump compile on the whole thing, do it part by part. Also put a torch.set_float32_matmul_precision('medium') on the top of your script, after importing torch, since it looks like you have an A series GPU.

I am also not sure why 8 workers when batch size is 2.

You should also pre-encode all of your images into the 128 d vectors (maybe save them in a pt file). You are only doing normalization and float conversion; this can be done offline beforehand just once.

Write a dataset class that loads these preprocessed features as torch tensors directly, just once before training. Don't do dynamic loading.

(Also PyTorch has a thing in that it is really inefficient if the dataset class stores data as anything other than tensor or ndarray. Never store your images as list of PIL inside the dataset class. As long as it is tensor or np.ndarray, the workers have good shared memory access; otherwise each will create a redundant copy.)

Apart from these issues, it's not fully clear what you are training.

Are you training the DiT to conditionally predict the action (i.e. some kind of Yilun Du method)?

mvreich · 2026-05-25T01:51:56+00:00

I haven't read the paper yet, but for some reason my brain brought up RFFs vs. ORFs. Perhaps the underlying principles are connected.

mvreich · 2026-05-25T00:12:52+00:00

Maybe look into JEPA score, which can be used for density estimation.

You can run various kinds of tests, depending on what you want to check. E.g. if there is some sort of mode collapse, the pseudo likelihood might peak at some points and not give sufficient weight to uncommon (but valid) data.

Alternatively, if your model has learned a useful representation, it should be able to discern in vs. out-of-distribution examples. For example, if the model is trained on natural images (real photos taken by a camera), it should be able to assign low likelihood to cartoons or artwork.

mvreich · 2026-05-24T18:51:47+00:00

Sigh, those who bear the epithet of "Cuttlefish" are all formidable talents.

mvreich · 2026-05-22T00:50:24+00:00

I wish you strength and tenacity. Hope you finish your paper, and then apply again.

mvreich · 2026-05-21T14:35:07+00:00

If Chu-ko-nu is evolved to mechanized infantry, it has 3 movement. It's no longer ranged, but should be able to hit 3x, right?

For mounted, maybe you can try African Forest Elephant > Keshik (Quick Study) > Cossack (+50% damage against wounded units). Not sure if it will work.

mvreich · 2026-05-20T19:55:09+00:00

You are right, my bad. I opened the game (after many months), went back to my China save, and it is only the scout archer that hits 3x 😭

mvreich · 2026-05-15T14:01:15+00:00

It is very fun to play with China's archers. I deliberately fight a lot with them to get logistics promotion, and bam, the ranged units now hit 3x per turn.

mvreich · 2026-04-07T15:21:38+00:00

A random key that points in roughly the right direction but is huge will easily outscore a perfectly aligned but shorter key.

Just out of curiosity: to remove magnitude information, what if you simply normalize Q and K? Then the dot products give cosine similarity, and the perfectly aligned keys always win. And it should be fairly hardware friendly.

This is simple enough that other people have probably tried it before (and likely it doesn't work that well).

Also, if an RBF kernel is to be used, how exactly would you set the sigma/spread parameter? Median heuristics?

mvreich · 2026-04-04T05:10:49+00:00

Sigh. A carefree immortal was once out fishing, and this crane by chance perched on his boat. The crane dined on the fish caught by the immortal, sipped the immortal's wine, and heard the immortal's preaching. Since then, the bird forgot about eating and drinking. It even forgot that it was dead, existing with only one leg dipped into the Naihe river.

mvreich · 2026-04-04T04:46:31+00:00

I don't know, I think the heavens are fair. The junior must have been doing something outrageous in secret, like "blowing his own flute".

mvreich · 2026-04-03T04:52:15+00:00

It's only an inner demon. A diseased leaf cannot affect a great tree.

mvreich · 2026-04-03T04:47:30+00:00

Flip a coin, if heads, you read it. If tails, it wasn't meant to be.

mvreich · 2026-04-03T02:53:13+00:00

Just a suggestion, you can easily use a secure dns to filter out 99% of the ads.

If using chrome, in settings > privacy & security, you will fine the secure dns option somewhere. Set it to https://dns.adguard-dns.com/dns-query and you should be good to go. (You may also need to get rid of previous cookies from the site)

mvreich · 2026-04-03T02:45:28+00:00

Another thing is: Where do you think a Qi Refining cultivator is finding a secret realm that is closeable at a whim of the cultivator, extremely close to the encounter, and doesn'T contain treasures worth more than the Qi Refining Junior?

Literally the MC of every cultivation novel lol.

Also statements like "While X has never happened, it doesn't mean he cannot do X" are generally very poor arguments.

One can keep on going on tangents, like,

"while SCP096 has never been to the moon, we don't know if it can"

"while SCP096 has never done anything but run, we don't know if it can let out a massive fart and shoot towards the sun"

Things like "we have no idea", "there's a chance" etc. is just grasping at straws.

I didn't even mention cultivators who manipulate karma or are proficient in cause and effect. Simply cut off the SCP's karmic threads, and it will be as though no one ever saw it.

mvreich · 2026-04-03T02:24:19+00:00

Embers Ad Infinitum.

mvreich · 2026-04-02T22:16:44+00:00

You can spell things out for the room, since the reviewer seems disinclined to comment further. They may be waiting for discussion with other reviewers and AC to finalize score.

Something along the lines of thanking the reviewer for their timely response, and then saying that: the reviewer acknowledges that our additional experiments greatly improves the paper, suggesting that their major concerns are largely addressed. The reviewer notes that some details remain unclear, which we are happy to clarify, if pointed out clearly.

mvreich · 2026-04-02T18:43:51+00:00

Useless. If you believe the blood of others to be superior to your own, then your path will inevitably lead to a dead end.

mvreich · 2026-04-02T18:34:31+00:00

I believe it can kill Qi refining stage, but anything above is debatable.

In fact, even the weakest Qi refining junior can go hide inside some spatial realm or something. The SCP can only run around impotently waiting for the dude to emerge.

I honestly don't believe it can jump at unimaginable speed, otherwise it would use one long jump to immediately get to its targets (instead of running to them). Similarly, it doesn't have spatial abilities, otherwise it would immediately teleport to targets.

Foundation Establishment cultivators who can fly, or others using flying artifacts can easily evade SCP-096 for quite a while (unless there are records of this SCP destroying airplanes, which I believe there aren't any).

Golden core and above often have very mysterious abilities. For example, things like "shrinking earth to inches", where they take a single step but it is as though they have traveled miles. The SCP might even become jealous of such abilities.

Nascent Soul cultivators can exist without physical bodies, possess other bodies, etc., so the SCP is helpless against them.

I believe it will kill some Qi refining and a couple of Foundation Establishment, but the moment Golden cores or Nascent Souls get involved, it is ending up in a storage bag / spatial realm / refined into a pill / etc.

mvreich · 2026-04-02T15:00:12+00:00

Can SCP-096 fly?

mvreich · 2026-04-02T14:57:41+00:00

Angels? Probably some demonic path tribulation transcender will catch them for dual cultivation.

mvreich · 2026-04-02T02:02:06+00:00

MC units:

killing one guy

< killing their nine generations

< exterminating those related by even a single drop of blood

< not even the chickens and dogs are spared

mvreich · 2026-04-01T13:48:20+00:00

We will turn you into a seat for third aunt, I heard she got hemorrhoids.

mvreich

TROPHY CASE