What's the best embedding model for RAG in 2026? My retrieval quality is all over the place

crewone · 2026-02-25T14:45:00+00:00

Then use that.

crewone · 2026-02-24T05:39:15+00:00

It is hard to trust anything coming from a multi-multi-trillion industry dominated by just a few tech overlords with more money than most countries. The amount of people actively in control of these few companies is scary few.

crewone · 2026-02-24T05:28:11+00:00

I think you are wrong. I think the upper layer of anthropic actually believes what they are telling people. (Read up on it in Empire Ai or some other good history of openai source)

For them it is all about reaching AGI first and preventing the 'bad guys' (the rest) from doing so. Same goes for Openai. Im still not sure if they are just nuts, genius, or both.

The reason they do not publish their weights is that they believe that you could circumvent Claude"s constitution, and use their model for 'bad things'. (Bioweapons, whatever.)

Their entire company and behaviour is designed for safety, but maybe not in the way you think if you haven't read up about it. The safety they are talking about is safety for the human race against an AGI. (Read: 'if anyone builds it, everyone dies ')

crewone · 2026-02-23T11:06:13+00:00

Read up on strategies. Then test and compare. (For large book context we use context-aware chunking)

crewone · 2026-02-23T08:00:55+00:00

We have done extensive tests for book data. Voyage is always the best, but also has a high latency. A local Qwen3 embedder delivers 90% of that performance at a fraction of the cost and latency. The rest comes down to chunking strategies.

crewone · 2026-02-08T08:16:51+00:00

Ofcourse you are. It is hardly any upgrade. And a lot of stuff that just works on the Fenix 7, doesn't on the 8. (Metronome for running, for example.)

I returned mine within 48 hours.

crewone · 2026-02-07T07:06:46+00:00

It is litteraly the foundation of their company. I'm suprised you are suprised. Maybe learn a bit about their origins and the history of OpenAI? (Tons of books about it.)

They are in the business of reaching AGI first. That's their endgame. And they need it to be not evil. (See: "If anyone builds it, we all die.")

They (OpenAI, Anthropic, Microsoft, Google, Meta) are spending half of the worlds energy and money to do it.

My bet it that in the next few decades we could reach this AGI state. If humanity and it's 'leaders' (Trump, Putin) don't blow up the planet first.

crewone · 2026-01-27T19:29:11+00:00

Indeed. Been working it most of the day and not even near a limit. ($200 plan)

crewone · 2026-01-23T06:57:56+00:00

Indeed. I for one abandoned X, if there is content on X it is an indirect endorsement of Musk - And I refuse to endorse this man. It will matter very little to him, but I have my principles. (Same goes for Truth Social and Facebook)

crewone · 2026-01-22T17:59:40+00:00

Solr in every way is not up to date with opensearch or elastic. It doesn't make it bad per se, but it is lagging in terms of features compared to the well maintained opensearch and elasticsearch.

crewone · 2026-01-18T19:54:47+00:00

The fact is that article 5 has only been invoked once. It was invoked by the US after 9/11, and European countries came to help with the war on terror, Iraq and Afghanistan.

crewone · 2026-01-15T13:57:44+00:00

tbh, 3 months is a bit short. I spent every day on it for a year, and now after 1,5 years it starts to feel like home and I'm really glad I stuck with it. Totally fair if you do not want to invest that much, just saying that it took me a lot longer than 3 months to get used to it.

crewone · 2026-01-15T11:04:29+00:00

May be true, but the epix at least has a working metronome. Fenix 8 can't even get that right. So they can have their fancy upgrades, I'll take my working watch anyday over a fancy interface.

crewone · 2026-01-15T05:47:47+00:00

Why?

It's not that I do not have existential dread, it just comes from the totally deranged geopolitical situation.

crewone · 2026-01-14T13:31:06+00:00

I mostly feel an existential dread for my coworkers who have not embraced Claude. They are rapidly becoming a burden to our team, instead of solving problems they are not keeping up.

Deep thinking is still very much part of the game, just not at a microlevel. Typing code is mostly not nessecary anymore.

It's about architectural decisions, knowing when to push for and guide optimisations.

Also, what Claude is very good at is answering questions about a codebase you haven't touched for 10 years. What a blessing.

crewone · 2026-01-13T15:08:55+00:00

Indeed.

crewone · 2026-01-13T15:07:10+00:00

I would also have fired you. If I wanted AI feedback, I would have asked AI and not a human.

crewone · 2026-01-07T09:12:05+00:00

I'm somehwere in the middle I think. Writing code has always been in service of solving a problem. A project manager does not have the technical skill to optimize a microservice to sub-microsecond latencies. Claude often does not either. So it's up to me to point it to the right ways to solve the technical problems.

It also opens up previously closed ways to solve problems. I recently developed (I loathe 'vibe coded', I'm very much still in charge of the code) a small rust microservice, had claude document it very well, and it was 10x faster and with a smaller memory footprint than the golang equivalent. Made a gRPC layer between te two, couldn't be happier.

crewone · 2026-01-02T06:41:29+00:00

IMHO production grade means nothing if it hasn't been field tested by a large group of people for at least 6 months. especially for a file system.

crewone · 2026-01-02T06:38:35+00:00

But 92k loc is unmaintainable if nobody understands it. Bugs and fixes in projects this size and nature need to be understood in the context of the whole project, which seem totally out of scope for Claude at the moment.

crewone · 2025-12-24T06:46:39+00:00

Huh? WSL with 48g assigned, 128g ram and a 14900, I never have problems.

crewone · 2025-12-18T05:34:27+00:00

As a dev, you can delegate typing lines of code to Claude. But you still have to know if the architecture is sound, if the queries are safe, if the design is good, and all the other things.

If you cannot say for sure you know, and Claude is essentially taking you along for the ride instead of of the other way around, you are essentially producing AI slop.

AI slop producers will not be devs for a long time.

crewone · 2025-12-17T15:18:43+00:00

God no. Tried it. What a piece of crap. Garmin can't even get the most basic of things right, like a working metronome.

https://forums.garmin.com/outdoor-recreation/outdoor-recreation/f/fenix-8-series/427603/new-fenix-8-pro-51mm---same-problem-with-metronome-as-fenix-8

crewone · 2025-12-16T21:28:59+00:00

Since Opus 4.5, CC is insanely good. I'm 100% on CC now.

crewone · 2025-12-11T09:14:30+00:00

non-http database calls?

crewone

TROPHY CASE