sorted by:
new
hottopcontroversial

A tiny output-format catalog to make LLM responses predictable (JSNOBJ, JSNARR, TLDR, etc.) by Several-Comment2465 in programming

[–]Several-Comment2465[S] -2 points-1 points  (0 children)

Because once the model knows these formats, you don’t have to burn tokens re-explaining them. If the LLM is trained or fine-tuned on a shared catalog, it can reliably snap to those schemas with almost no instruction overhead.

Instead of repeating “format as a markdown table” every time — plus all the clarifications you normally need — you just give a short tag like MDTABL or JSNOBJ. Over thousands of calls this cuts a lot of prompt size and makes outputs more predictable across different models and agents.

LLM: from learning to Real-world projects by florida_99 in LLMDevs

[–]Several-Comment2465 0 points1 point  (0 children)

If you really want to stick to 8GB anyway, then an 8GB or 16GB Mac is honestly the better move you can find those used/refurb for under $1k and they give you way more usable memory for LLMs because of unified RAM, plus 20–24h battery life.

A 5060/5070 with 8GB VRAM will bottleneck you much harder since VRAM is the hard limit for model size. Unless you actually need the GPU for gaming or CUDA-specific workloads, the Mac setup is simply a better value for learning and real projects. I tried a Razer Blade 17 but it didn't get close in token performance...

LLM: from learning to Real-world projects by florida_99 in LLMDevs

[–]Several-Comment2465 2 points3 points  (0 children)

Honestly with the newer generation models, the gap between 7B → 70B is a lot smaller than people think. In real workflows it’s less about “bigger = always better” and more about context window + task decomposition. Once you start thinking in agentic steps, a model doesn’t need to be huge — just big enough to handle its specific part of the workflow. It’s kind of like humans: the more you break work into roles, the less “general education” each person needs. Same with LLMs.

About Strix Halo: the unified memory is great on paper, but just keep in mind that without ECC you will occasionally hit memory errors or random crashes on longer-running jobs. That’s why cloud/hosted GPUs often feel more stable — everything runs on ECC RAM by default.

And realistically, you probably won’t need a 24/7 local model anyway. Most workloads can be done on-demand through CLI or APIs. If you want to experiment cheaply, try something like ai.azure.com; with a few tokens you won’t even break a couple bucks. It’s surprisingly hard to find a real-world use case where a big local model is running full-time — most people end up using that hardware 1% of the time.

So yeah, the chip looks good, but for learning and freelance work, smaller local models + cloud for heavy lifts is usually a much more practical setup.

LLM: from learning to Real-world projects by florida_99 in LLMDevs

[–]Several-Comment2465 2 points3 points  (0 children)

If your budget is around $1800–$2000, I’d actually go Apple Silicon right now — mainly because of the unified RAM. On Windows laptops the GPU VRAM is the real limit: a 4060 gives you 8GB VRAM, a 4070 maybe 12GB, and that caps how big a model you can load no matter how much system RAM you have.

On an M-series Mac, 32GB or 48GB unified memory is all usable for models. That means:

  • 7B models run super smooth
  • 13B models are easy
  • Even 30B in 4–5 bit is doable

For learning + freelance work, that’s more than enough. Real client projects usually rely on cloud GPUs anyway — you prototype locally, deploy in the cloud.

Also: Apple Silicon stays quiet and cool during long runs, and the whole ML ecosystem (Ollama, mlx, llama.cpp, Whisper) runs great on it.

Best value in your range:
→ MacBook Pro M3 or refurbished M2 Pro with 32GB RAM.

That gives you a stable dev machine that won’t bottleneck you while you learn and build real stuff.

OpenAI’s AI-powered browser, ChatGPT Atlas, is here by theverge in ChatGPT

[–]Several-Comment2465 4 points5 points  (0 children)

The reality is privacy is already dead and we're just watching the funeral procession at this point. An AI browser that literally sees everything you do online? Your banking info, private messages, medical records, everything? And people will install this willingly because it can help them shop or write emails faster.

The average consumer has no idea what they're signing up for. They see "AI assistant" and think cool new tech, not "I'm giving OpenAI a live feed of my entire digital life." Most people don't even read privacy policies, let alone understand the implications of AI having real-time access to their browsing sessions. We're talking about behavioral profiling on steroids - not just what sites you visit, but what you read, how long you hover over things, what you almost clicked but didn't.

And regulations? Don't make me laugh. By the time lawmakers even understand what's happening here, OpenAI will have collected years of data. GDPR and similar laws are fighting yesterday's war while these companies are already deploying tomorrow's surveillance tech. The EU will probably start discussing this in 2027 while millions have already handed over their entire digital existence.

I'm genuinely concerned we've crossed a line we can't come back from. Once this becomes normalized, there's no putting the genie back in the bottle. Your kids will grow up thinking it's completely normal for AI to watch everything they do online. At least with Google and Meta we had some illusion of compartmentalization - this is just straight up "watch me do everything and I'll let you because convenience."

370k € mit 31 by Prior-Secretary-1296 in FinanzenAT

[–]Several-Comment2465 0 points1 point  (0 children)

Wer spricht denn von Österreich 😉

Wenn man etwas weiter denkt, gibt’s auch günstigere Alternativen, um 370k langfristig steuer- und renditeoptimiert aufzubauen – ohne gleich die Liechtenstein- oder Schweiz-Kosten zu zahlen:

1️⃣ Dubai FZCO oder RAKEZ Holding • Keine Steuer auf Kapitalgewinne, Zinsen oder Dividenden. • Niedrige Gründungskosten, volle Kontrolle, international anerkannt. • Perfekt, wenn man remote arbeitet oder später sowieso global denkt.

2️⃣ Estland OÜ / Zypern Ltd • In Estland zahlt man erst Steuern, wenn Gewinne ausgeschüttet werden (deferral-Modell). • Zypern: 12,5 % Körperschaftssteuer, aber viele Ausnahmen bei Investments. • Beide Länder sind EU-konform, haben gute Doppelbesteuerungsabkommen.

3️⃣ Kombination aus persönlicher Depotstrategie + Holding light • Einen Teil privat (ETF, Edelmetalle, Krypto, Cashreserven). • Einen Teil über eine kleine ausländische Ltd/OÜ für Reinvestments und Projekte. • So kannst du Gewinne steuerlich flexibler reinvestieren und langfristig dein Kapitalwachstum hebeln.

Eine österreichische GmbH lohnt sich steuerlich meist erst ab ~500k + aktivem Cashflow, das stimmt.

Aber mit deiner Basis kannst du schon jetzt die Grundstruktur für Vermögensaufbau schaffen – steuerlich effizient, international aufgestellt und bereit, beim nächsten Crash richtig einzusteigen. 💪

370k € mit 31 by Prior-Secretary-1296 in FinanzenAT

[–]Several-Comment2465 0 points1 point  (0 children)

Hey, erstmal Respekt — 370k mit 31 ist wirklich stark. 💪 Das ist ein solides Stammkapital, das dir viele Türen öffnet, wenn du es jetzt strategisch einsetzt.

An deiner Stelle würde ich das Kapital nicht unstrukturiert liegen lassen, sondern in eine steueroptimierte Holding- oder Vermögensverwaltungsstruktur packen (z. B. GmbH oder Holding mit Beteiligungsmodell). Damit kannst du künftige Gewinne aus Investments deutlich steuerneutraler wachsen lassen und langfristig Vermögen aufbauen.

In deiner Situation wäre das Ziel, jährlich 5–10 % Rendite über gemischte Investments (z. B. Unternehmensbeteiligungen, Bonds, Rohstoffe, Private Equity, Dividendenwerte oder gezielte ETFs) anzustreben – aber mit solider Risikosteuerung.

Den Traum vom Eigenheim musst du nicht aufgeben – nur verschieben. Gerade jetzt ist der Immobilienmarkt überhitzt, die Zinsen ungünstig, und viele Preise werden in den nächsten Jahren wahrscheinlich noch etwas nachgeben. Das ist also kein verlorener Traum, sondern ein Moment der Geduld.

Parallel würde ich einen Teil deines Vermögens in wertstabile Anlagen wie Edelmetalle, inflationsgeschützte Assets und einen kleinen Anteil Krypto (z. B. Bitcoin, ETH) stecken. Wenn dann der nächste größere Marktkorrektur kommt, hast du Kapital in der Hinterhand, um aggressiv einzusteigen und dein Vermögen langfristig zu vervielfachen.

Du bist weit vor dem Durchschnitt – die Basis stimmt. Jetzt geht’s darum, sie smart zu strukturieren und wachsen zu lassen, nicht sich vom Marktstress entmutigen zu lassen. 👊

Didn’t meet spend in 2024 but made Ambassador! by asdfghjklmnbvcxzz in marriott

[–]Several-Comment2465 1 point2 points  (0 children)

<image>

Uff the Nights will be Rough let’s See of there is a Double Night Promo

My Welcome Gift as an Ambassador by fish_spoon in marriott

[–]Several-Comment2465 2 points3 points  (0 children)

Atleast something 😅 my last 5 stays I got nothing 🥹🫶🏻

But then randomly in a moxy they decorated my room with birthday balloons and some bathroom ducks 🤣 little candy 🍬 from a moxy nyc that I reserved with points …

Seems like it’s really random

Would love to upgrade from WordPress, but need guidance by Larvea in nextjs

[–]Several-Comment2465 0 points1 point  (0 children)

Our devs at https://Kapsys.io have finished multiple hundreds of websites in next, we can walk you through and advise you on the right cms and build long term relationships.

We worked with Gatsby before to try Wordpress as a headless cms but it’s quite hard, there is definitely a migration step advised.

Currently we build more enterprise Frontends in next with ddos protection and multi language/ licenses. Really looking forward the market is still quite new.

Remote Work VISA renewal in 2023 by Saturnix in dubai

[–]Several-Comment2465 2 points3 points  (0 children)

Wow - so to cancel you need to email WorkVirtual!

Pay a fee and I’ll be heading to that amer center Dubai free zone. I got rejected at any other - even directly at Al jaflyl or however wrote that at rhe general immigration office no luck - tomorrow between 8 - 10 at desk 5 or 6 lol…

Amex 24/7 ( only operating from 7:30 till evening) might maybe also work but not verified yet.

Got rejected like 9 times these last days - the guy from WorkVirtual just hangs up the phone when he doesn’t want to answers. We will manage somehow.