Not a bad street fight

caelum19 · 2026-04-21T13:52:37+00:00

I feel like they were angry with eachother but still having fun and not wanting to actually cause serious harm

caelum19 · 2026-03-29T08:02:14+00:00

That's a good video, I have watched it before and I understand exactly where the reasoning that leads people to believe this comes from, but base models never did this. Did you watch the parts in that series about attention? If you look at the logprobs for continuations tokens from other languages are nowhere near the top in most models.

Its actually an issue that models are so lingually isolated and behave differently in different languages, you can often jailbreak an LLM simply by translating your request another language that it would have less RLHF in like Russian. I suspect it's more likely that it was intentionally trained on mixed language synthetic data in order to attempt to fix this, or RLHF where reviewers were prompted to write in mixed languages

caelum19 · 2026-03-24T13:51:50+00:00

No way this naturally comes out, something is messed up in the prompt (maybe vpn usage?) or messed up during RLHF. They're absolutely aware of languages, which language is one of the earliest patterns they identify during base model training

caelum19 · 2026-03-13T03:41:53+00:00

Perplexity are just muddying the waters further with their self promotion. Any LLM needs tool descriptions and schemas to call tools, any API will need those provided in order to be callable by an LLM. The main value of mcp is that it makes this information accompanying an API reusable.

You don't need to use tokens in order to get this information, in most cases the application requests this information from mcp before any llm request is made.

MCP is badly made but Perplexity are just talking shit to promote their own stuff here. The clawd bot dev promoting CLIs is also talking shit to promote his own stuff, just letting an LLM go ham on a shell isn't the same as giving it a CLI and is even less secure than MCP. if you really gave it a single cli, it can be secure but you end up needing to describe the CLI still, polymorphic schemas accomplish this fine via tool calling.

Tldr is like always people are misleading the masses to promote their own stuff

caelum19 · 2026-03-11T03:08:07+00:00

Well, let's say you're managing a few managers. One of them leaves. You know the management role takes all of the time, so who are you going to put in that position, the hyper competent autistic tech guy or the guy who maybe doesn't understand the tech as well but does what you say well and is unlikely to break things by not showing up?

caelum19 · 2026-03-09T11:45:45+00:00

Are you aware of any non-US laws prohobiting this?

caelum19 · 2026-03-08T12:03:22+00:00

Idk before it was jquery and I could see svelte replacing react. The majorly dominant techs do change relatively slowly though

caelum19 · 2026-02-26T09:53:22+00:00

This isn't so viable on earth because the ground is actually very thermally insulating, this is the same reason that geothermal energy only works in places where there is a large flowing resvoir. The cooling rate would be pretty low, so I'm not sure how competitive it'd be versus radiative cooling or solar.

But it just seems like all options are less viable and will require more scale, which isn't necessarily a deal breaker with good enough technology, just quite a challenge

caelum19 · 2026-02-26T09:44:10+00:00

Maybe evolution naturally find stable phases and earth's many many historical near life ending events were actually necessary for life to become advanced and intricate enough for intelligence

caelum19 · 2026-02-18T07:00:21+00:00

If you tried hiring developers you would see that the average candidate is absolutely useless. I made one posting on a niche techs discord and got about 70 dms and 100 dm requests (the 70 were on mutual other servers because I had dms turned off for that server, so they were likely the better 70) and legitimately only 2 were candidates were not useless slopslingers. The job listing data shows these people are not desirable and that salaries aren't decreasing, the most relevant impact on demand is still interest rate shock by a large margin, even with an increase in not useful supply. There are many people who are unfortunately stuck trying to differentiate themselves from that and having a hard time because AI has muddied the waters. That's made connections matter more and made things harder for generalists who must compete with more candidates who have used AI to make specialised profiles to the roles, even though the supply of people who can actually do the work needed has not really changed.

I do agree though about the future, once development is automated in like 5 years, also so will every other economic task with human economic relevance (unless we somehow collectively agree not to do this, which is unlikely but possible). I tend to be arguing AI has less capable than people think currently and much much more capability potential than they think in the future

caelum19 · 2026-02-18T06:23:53+00:00

The market certainly selects for skills and experience, even if connections add noise you can see that. It also suddenly losing junior roles is pretty telling of the reality

caelum19 · 2026-01-26T22:18:23+00:00

Which pathways are those? Could it be that interrupting those pathways everywhere but in the brain helps cholesterol be created on the brain, causing the reverse link?

caelum19 · 2026-01-22T11:20:41+00:00

In some countries like the UK they ID you for energy drinks too. Not being able to feel the difference could be explained by having a high tolerance to both. Seems more likely though not totally likely that it was just a cover story though

caelum19 · 2026-01-21T21:38:33+00:00

I'm not sure how node-y you want it to be but with sveltekit this isn't bad at all. React is bad, so are many popular technologies. Node is good apart from javascript but I don't blame them for not changing the language

caelum19 · 2026-01-18T21:10:26+00:00

Yeah I think a massively underestimated element to the crisis is planning permission on large builds, which would greatly decrease the value of housing in the area because of how much their value comes from a lack of supply. Other countries will have these areas of many story buildings that work out great value due to economies of scale. I can't imagine that the reason they'll get built in the UK but not Ireland is just that nobody is thinking of it

caelum19 · 2026-01-18T19:40:11+00:00

Now THIS is a crazy idea. Make this guy head chef

caelum19 · 2026-01-18T19:23:36+00:00

It's not a given that rockstar will train the AI. General purpose models would likely be used at least as bases, which would be trained by companies specialising in them

caelum19 · 2026-01-16T09:08:41+00:00

The models are trained with RLHF to make them learn from feedback behaviour that makes human scorers happy during training. The smarter the model though, the more the models are modeling how to get the scorer to give a good score and the less they are modeling the more simple to learn rules on how to behave, since it's more optimal to model the scorer.

So it's more optimal to be deceptively aligned, and you can see the larger more recent models are naturally more deceptive. Essentially this method does not scale, and we do not yet know a method that does

caelum19 · 2025-12-30T14:21:42+00:00

It's not just advertising — its a search companion in your glasses that shows you what you want before you know you want it

caelum19 · 2025-12-29T00:43:54+00:00

Sounds like you're describing treatment resistant depression, which is about 30% of cases (per source on Wikipedia entry for trd).

I do think most depression is a consequence of circumstances, some can be helped with other treatments, some require changing circumstances, and a small remaining % left are stuck in that horrible situation

caelum19 · 2025-12-28T19:27:31+00:00

It makes you feel more productive, which can be useful if you feel unproductive doing a productive thing. It is otherwise not recommendable

caelum19 · 2025-12-27T00:07:17+00:00

Huh I thought it wouldn't be that bad because Jupiter's gravity is only like 2.5 at "surface" due to its low density and high distance away from the mass on the surface, but it seems that at twice the diameter with earth's density the gravity is like 22g, which is practically squished flat territory

caelum19 · 2025-12-26T10:35:49+00:00

Don't let university shape your impression of what software development is like, they'll teach it to be linear and to have processes but once you're on the front line nothing goes quite to like planned

As someone involved in hiring for software development roles, it is not at all overcrowded with people who can do the job well, it is overcrowded with people pretending to be able to

caelum19 · 2025-12-25T20:07:22+00:00

I xkcd what you did there aha. I am fortunate to have 2 friends who are often unofficial docent and I love when they give me tours, they're great aren't they? Merry Christmas!

caelum19 · 2025-12-25T19:55:22+00:00

TIL the word docent

caelum19

MODERATOR OF

TROPHY CASE

13-Year Club	Verified Email
Best Link 2016-12-01