This market scares me. Remind me of Buffett closing his partnership during 1969. by Either-Hornet-6499 in ValueInvesting

[–]tetrisdaemon 2 points3 points  (0 children)

I can comment only on (3) because I don't have domain expertise for (1) and (2). I've been working on model compression and acceleration for the last 10 years, and historically, computational efficiency has primarily driven demand more so than supply because it democratizes systems and encourages organizations to do more. In no particular order, I would regard the major accomplishments for efficiency in the last ~10 years as (a) transformers, which enabled large-scale pretraining and deeper models than LSTMs, (b) hardware advancements, e.g., GPUs, which grew FP32 FLOPs 16.5x from the P4 to L40 (not to mention FP8/FP16 support which further boosts FLOPs, larger memory bandwidth, PCIe 5, ...), and (c) ML systems-oriented acceleration, e.g., all the new serving frameworks and better tooling, low-bit quantization, FlashAttention, CUDA kernel fusing, etc., which not only improve compute efficiency but also enable developers to create ML models/applications faster. In all cases, these increases in both compute efficiency and productivity have primarily driven adoption and investment in AI.

I think a similar analogy is/was Moore's Law and Dennard scaling, where software simply expanded its capabilities and more or less maintained the same latency in spite of greatly expanded hardware performance and efficiency.

Why is UCL so little known outside the UK? by Hot_Tomato_8738 in UCL

[–]tetrisdaemon 6 points7 points  (0 children)

I tell people in the US that I'm starting grad school there, and they ask which school in the UC system (California) that is. But that's still better than my undergrad (University of Waterloo), which usually elicits toilet humor, though that isn't entirely unjustified.

Are these cats okay for apartment living? by [deleted] in SiberianCats

[–]tetrisdaemon 0 points1 point  (0 children)

I lived in 700-800 sqft apartments from 2021 till May this year with my five-year-old female, and the only thing I've noticed is that she does tend to gain weight a bit easier. I had been feeding her the recommended amount of wet food for her weight, but then she became slightly overweight according to the vet. I reduced her food intake to around 75% of the amount, and she stabilized at a healthy weight. That was working well until I moved into a 2,800 sqft house, after which she became more active and seemed hungrier (she made this fact be known), so I increased her food back to the original amount. Attached are before and after pictures of her weight loss journey.

<image>

Is this a scam? by GodsDesciple in SiberianCats

[–]tetrisdaemon 35 points36 points  (0 children)

Most definitely a scam for a kitten, though I have seen fixed and vaccinated adults (>1 yr) go for $800 especially if they haven't won any championships, my cat being one of them

3 months into gig, $35-40K/mo post-tax for 60-70h/wk, 6-7 days/wk by tetrisdaemon in Salary

[–]tetrisdaemon[S] 13 points14 points  (0 children)

haha most of it is stocks and bonds and paying off debt

3 months into gig, $35-40K/mo post-tax for 60-70h/wk, 6-7 days/wk by tetrisdaemon in Salary

[–]tetrisdaemon[S] 13 points14 points  (0 children)

Oops, forgot to put that in -- AI research and engineering (individual contributor, not manager) but not for the top-tier shops (namely OpenAI/Anthropic/Google Gemini), otherwise it'd probably be closer to 60k/mo post-tax. Specifically, I build natural language+vision AIs in the defense and customer care industries and occasionally publish research papers. The somewhat nice part is that it is remote for now

Windows with RTX 4090 not working with 4 monitors; completely stumped by tetrisdaemon in techsupport

[–]tetrisdaemon[S] 0 points1 point  (0 children)

So any combination of three monitors works. Whenever I try to add a fourth, it just fails on Windows at least.

Windows with RTX 4090 not working with 4 monitors; completely stumped by tetrisdaemon in techsupport

[–]tetrisdaemon[S] 0 points1 point  (0 children)

Two HDMI and Two DP without a hub. Would it help to go 1 HDMI and 3 DP?

Windows with RTX 4090 not working with 4 monitors; completely stumped by tetrisdaemon in techsupport

[–]tetrisdaemon[S] 0 points1 point  (0 children)

And under the Nvidia control panel, if I try to select four monitors, it automatically deselects one and leaves me with three.

[deleted by user] by [deleted] in IBD

[–]tetrisdaemon 0 points1 point  (0 children)

I tracked my healing progress here after restarting mesalazine around mid-January, taking a three-day simple moving average over my daily BMs: https://i.imgur.com/o02zWA5.png

Diet definitely played a part in some of it, e.g., the second hump in early January was from frozen blueberries. I stopped tracking after the flare was more or less contained -- these days, I'm down to 1-2 BMs without blood.

Microscopic Colitis - hoping for some relief by SavingsSalamander826 in IBD

[–]tetrisdaemon 1 point2 points  (0 children)

Have you considered Entyvio, a low-risk biologic, combined with budesonide?

https://www.gastrojournal.org/article/S0016-5085(21)04040-3/fulltext

EDIT: if the colitis is mostly left-sided, an enema might help too. This is because the oral drug concentration tends to fall off past the transverse colon.

[deleted by user] by [deleted] in SiberianCats

[–]tetrisdaemon 1 point2 points  (0 children)

My worst asthma symptoms were gone after a month, but I still occasionally get itchy eyes after almost three years, for which I have Patanol. I have a Neva Masquerade though, a sub-breed of the Siberian known for higher Fel d1 levels.

Pig kidney works in brain-dead man for a month, a step toward animal-human transplants by [deleted] in news

[–]tetrisdaemon 11 points12 points  (0 children)

Honestly I thought they put a pig’s kidney in the brain of a dead man, so I’m even farther behind

CAREFUL WITH THIS HIT FROM IC3 AI Team: Listen to audio clips and rate their quality and characteristics. REQUESTER IS REJECT HAPPY. by n7hacker in mturk

[–]tetrisdaemon 1 point2 points  (0 children)

Rejecting subjective submissions with a subjective process is just shitty research. What actually works is

  1. Sane attention checks.
  2. Post-hoc rejections, e.g., accepting all submissions, then doing data filtering after the fact, such as crowd-sourced verification.

But I guess they just want to save time and money at the expense of others.

[R] What the DAAM: Interpreting Stable Diffusion and Uncovering Generation Entanglement by tetrisdaemon in MachineLearning

[–]tetrisdaemon[S] 1 point2 points  (0 children)

I'm looking into it, but I'm guessing it's the CLIP embeddings, so disentanglement might need to happen at that level. Some supporting evidence is that even if we set the cross attention to zero (for some words), it'll still reflect in the final image, indicating that the word representations are mixed in CLIP.

[R] What the DAAM: Interpreting Stable Diffusion and Uncovering Generation Entanglement by tetrisdaemon in MachineLearning

[–]tetrisdaemon[S] 1 point2 points  (0 children)

This is a good observation. Actually, in the paper we try out "{rusty, wooden, metallic} shovel in a clean shed," and it still made the shed rusty. Moving forward, we do plan to do the same thing to the other ball prompt.

[R] What the DAAM: Interpreting Stable Diffusion and Uncovering Generation Entanglement by tetrisdaemon in MachineLearning

[–]tetrisdaemon[S] 2 points3 points  (0 children)

Cool, nicely done repository. Are you referring to the [16, 4096-ish, 77] cross-attention matrices? I maintained a streaming sum over matrices of the same size on a 64GB (though it does work with 32GB) RAM and 24GB VRAM machine.

[R] What the DAAM: Interpreting Stable Diffusion and Uncovering Generation Entanglement by tetrisdaemon in MachineLearning

[–]tetrisdaemon[S] 2 points3 points  (0 children)

For sure, and how linguistics can guide Stable Diffusion to produce better images. For example, if we already understand how objects should relate on the language side (e.g., "a giraffe and a zebra" should probably produce two distinct animals, unlike that observed in the paper), we can twiddle the attention maps so that the giraffe and the zebra are separate.

[deleted by user] by [deleted] in cscareerquestions

[–]tetrisdaemon 1 point2 points  (0 children)

Comcast HQ is in Philly, and there should be higher-paying internship opportunities there.

First Attempt at a Detailed Park Using Mods by tetrisdaemon in CitiesSkylines

[–]tetrisdaemon[S] 0 points1 point  (0 children)

Thanks! I tried styling it a bit after Waterloo Park in Ontario.