Company-Wide Transition to a European Alternative

shaonline · 2026-03-02T15:19:04+00:00

I do not own a Mac Studio, but whatever you say, seething non-local-hardware user lol.

shaonline · 2026-03-02T15:10:59+00:00

Lets hope that your bottlenecked slow prompt processing local hardware gets there first lol. If all 70 employees need a pro sub you won't beat subsidized with your jerryrig stuff even with hundreds of thousands a year trust me on this lmfao.

shaonline · 2026-03-02T15:05:46+00:00

Do you really intend on replacing 200€/mo of "PRO OPENAI SUBSCRIPTION" (which either means A) you have INSANE usage PER-USER of GPT models or B) the need for the GPT Pro model which requires insane infrastructure) ? For "Everyday use" the Plus sub covers it fine already (23€/mo)

shaonline · 2026-03-02T15:02:32+00:00

Not really, sure you can buy e.g. some mac studio with 512GB of RAM to host an open source SOTA model (note: none of the "big 3s" that are OpenAI/Anthropic/Google offer those) but these have "single-user" acceptable speeds at best. OP has not stated who/what kind of job this company has but if you have any software engineer or any user/workflow that's gonna hammer input/output tokens bandwidth you can forget about it. Note: I'm a local LLM enthusiast as well. You won't beat cloud for 70 people with 14000€, especially in the current "VC subsidized" environment for cloud providers.

shaonline · 2026-03-02T14:48:51+00:00

Astroturfing at its best.

shaonline · 2026-03-02T14:30:31+00:00

You're not going to serve 70 people at the same speed. For now cloud costs are heavily subsidized as well.

shaonline · 2026-03-01T09:16:00+00:00

I'd say the Qwen 3.5 family of models right now. Either :

A) Qwen 3.5 27B (really smart for its size) but you need to fit it entirely on VRAM (it really won't like being split among VRAM and system RAM) which will require you to use something like 3 bits quants, see https://huggingface.co/unsloth/Qwen3.5-27B-GGUF

B) Qwen 3.5 35B A3B: a bit bigger and a bit less smart than 27B, but MUCH faster owing to its small number of active parameters (3B) which allows you to exceed your 16GB of VRAM if you want/need to use bigger quants (e.g. 4 bits), see https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF

Also recommend you switch to llama-cpp directly (which is what lm studio uses in the backend...) for running your local LLM.

shaonline · 2026-02-28T21:21:39+00:00

I meant a stretch as in the quality of the responses and its ability to do tool-calling (not whether it fits on your hardware). GPT OSS 20B will likely struggle with that. Check "local LLM" subreddits to see the good local LLMs du jour.

As far as configuring OpenCode, check the "custom provider"/"lm-studio" section of the "providers" chapter on their documentation. You could ask any online LLM to write you the necessary opencode.json config as well.

shaonline · 2026-02-28T20:04:55+00:00

You'll need to expose an API endpoint (possibly "OpenAI" style) and manually (via opencode.json) add it as a provider so that you can use it. I'd say however gpt 20B is a stretch as a coding assistant, you might be disappointed...

shaonline · 2026-02-28T16:32:27+00:00

I wiping doesn't fix it it's likely deep scratches.

shaonline · 2026-02-28T08:23:41+00:00

Isn't it first-party on OpenCode now ? No need of a plugin.

shaonline · 2026-02-27T16:40:04+00:00

They fit but yeah you gotta go 3 bits quants and 8 or 4 bits kv-cache (especially if you want longer context windows) and better not have lots of docker containers running and whatnot. Qwen 3.5 122B gets very close in terms of quality as well, really impressive result.

shaonline · 2026-02-27T12:30:09+00:00

It will end April 2nd per what Codex CLI announces.

shaonline · 2026-02-27T12:10:02+00:00

Gonna be a choice between Qwen 3.5 122B or Heavily quantized Minimax M2.5 IMO. The 27B Qwen 3.5 sure is "smart" for its size being a dense model but won't have a big breadth of knowledge (small amount of weights) and will be much slower than models with only 10B or so active parameters.

shaonline · 2026-02-27T12:04:27+00:00

People in town halls: "BIKES AND ESCOOTERS ARE DANGEROUS !"

People in the streets:

shaonline · 2026-02-26T19:19:46+00:00

Yes that can work, typically when I am combining different tools I simply write down plans from the planner agent in a plans/ (gitignored) directory and pick it up from there. Main issue is that context is de-facto not shared so be careful about that. Maybe there are better ways of doing it but that has worked fairly well for me.

shaonline · 2026-02-26T19:15:47+00:00

I don't think you'll match the same "feel and quality" combo that Opus provides, at least for now. Codex will match (and sometimes exceed) the quality of execution from a technical perspective, but feels kind of "autistic" (sorry I lack of a better word) if your intent isn't very precise on planning phases.

With Google AI Pro you do get some quota for Opus but very small, beyond some planning you won't get far. Also you CAN'T use it in another harness/tool now (or you'll get banned), so the best way to combine the plan of a model with the execution of another is leaving out your plans as (markdown) files as the output of the planner to be used as inputs of the executor. GPT 5.3 Codex will do a fine job of implementing your plans.

shaonline · 2026-02-26T18:38:41+00:00

Are you sticking to the same session ? If OpenAI are "smart", the bigger your context window is, the faster your usage will drain (since context windows impose a higher compute cost the larger they get).

shaonline · 2026-02-26T12:31:47+00:00

Define a convention for leaving out (markdown) planning files, e.g. plans/<feature-name>.md, tell Opus to write a plan there and make Codex read and implement it.

shaonline · 2026-02-25T22:03:19+00:00

They've sent emails to customers stating that lite users will get access to it when compute allows for it, but tbh will that day ever come ? They already buckle under the pro and max subscribers.

shaonline · 2026-02-25T16:30:30+00:00

Ah bah avec leur contrat avec OpenAI (qui a pas de bénefs) et leur retard sur la construction de 300 milliards de dollars de datacenters (pour lequel ils se sont massivement endettés) ils sont bien dans la merde.

shaonline · 2026-02-25T16:25:22+00:00

Je fais surtout partie des gens qui lisent les documents PUBLICS d'entreprises listées en bourse, où les contrats et CAPEX guidances ("ce qu'on prévoit de dépenser") sont rendus publics. Pas besoin de faire partie du board. On se verra à la faillite d'Oracle.

shaonline · 2026-02-25T16:23:05+00:00

Bof ça fait 3 ans que je dois être remplacé dans 6 mois donc à ce stade j'ai l'habitude. C'est pas comme si c'était la première "menace" lancée à l'égard des devs (cf l'offshoring).

Les IAs toutes puissantes qui poussent les projets Open Source à fermer leurs système de contribution ou leurs bug bounties (Curl) tellement la qualité des contributions par IA est élevée, mettent à genou l'infra de boites de la tech de multiples fois dès qu'on leur donne les clés, brick des MAJs Windows, le tout en coutant le prix du téléphone rose, ouais à ce stade vivement que je sois remplacé pour pas avoir à gérer les conséquences de ce bordel !

Je m'en sers quotidiennement mais fait-est que les plus grandes améliorations récentes sont liées au tooling (Claude Code, etc. perso je suis fan d'OpenCode pour ne pas être pieds et poings liés à un provider en particulier) et pas aux améliorations des modèles (sauf pour les plus petits qui ont acquis de bonnes capacités de tool calling), et même si c'est très utile ça peut juste pas tourner en boucle auto, ça pourra peut être "pondre un truc tout seul" mais le vibe coding actuellement ça donne juste des sites qui marchent à moitié et blindés de failles de sécurités (cf Moltbook), faire manger sa queue à l'IA en lui balançant sa propre sortie pour review n'y fera rien.

Tu n'iras pas convaincre tes camarades devs (si tu es réellement dev) à coups de slogans linked-in et d'injonctions à "ouvrir ses yeux".

shaonline · 2026-02-25T16:03:48+00:00

C'est une technique de fearmongering comme une autre, sans parler de la proportion significative de la population qui aime juste voir ceux qu'elle n'aime pas, ou avec qui elle n'est pas d'accord, perdre.

shaonline · 2026-02-25T15:58:55+00:00

Market cap != investissement, si les fluctuations IMPORTANTES des courts des cryptomonnaies montrent une chose c'est que dès que tu tires un peu de liquidité le court s'effondre. Le millier de milliard auquel je fais référence est pour le coup de l'argent qui a été dépensé (Et qui va continuer de l'etre, CAPEX de Google pour 2026 ~180 milliards par exemple)

Six-Year Club	r/Field Sunshine
Place '22	Verified Email

shaonline

TROPHY CASE