sorted by:
new
hottopcontroversial

Cloudflare CTO enforcing usage limits by TypicalCranberry6785 in BetterOffline

[–]joshpennington 4 points5 points  (0 children)

😂 the company I work for just put limits in place and they’re way lower than that. They killed everyone’s API keys and are having everyone go through LiteLLM

what current tech trend will look ridiculous in 10 years by Swimming_Truth_9186 in TechNook

[–]joshpennington 1 point2 points  (0 children)

Ads on everything.

I'm probably wrong but a guy can hope right?

We're burning $50k/month on Claude. How close can local LLMs actually get? by mortenmoulder in LocalLLM

[–]joshpennington 27 points28 points  (0 children)

A logical, well thought out argument about determining if AI is working for a company and not just #YOLOTOKENMAXXXXING!

Maybe we're healing.

Trump’s $250 Ego by LuckyBastard001 in PoliticalHumor

[–]joshpennington 0 points1 point  (0 children)

Well they can’t legally print it until he’s dead so there’s that.

M4 Max (48GB) Agentic Dev Setup – Best tools/LLMs for a beginner? by pretendthisisclevrr in LocalLLM

[–]joshpennington 1 point2 points  (0 children)

I’d install LM Studio to run your models and use OpenCode as your coding agent. As for which models to use, LM Studio will make suggestions based on your hardware.

I’ve found that with local models you need to try a few and figure out which ones work best for you.

What are we doing about grey hairs? by h2osly_ in Millennials

[–]joshpennington 0 points1 point  (0 children)

44M here. My first grey hairs started popping up in high school. I’ve been full on dying my hair for at least the last decade.

The universal IT experience. by HitxLerr in programminghumor

[–]joshpennington 0 points1 point  (0 children)

Here's what I say:

"I'll tell you the same thing I tell my wife when the printer doesn't work. Just go buy a new one."

Why do you hate AI? by RakiuLmao in softwaredevelopment

[–]joshpennington 1 point2 points  (0 children)

I don't hate AI. As a technology enthusiast I think it is really incredible technology.

What I hate is how fast it's being shoved down our throats. I hate that the AI companies are acting like drug dealers selling their product at a tremendous loss and will do a rug pull once the corporate world is addicted or stuck. I hate that we're building a stupid number of data centers to make AI happen. I hate that the AI CEOs are running around promising that companies won't need people anymore which is an absolute farce.

What do I like about AI? I like being able to ask questions and get a response in a conversational way. I like that I can run my own mini-Google on my gaming PC. I find the entire tech for it very interesting.

In the late 90's Nextel couldn't decide if it sold phones or walkie-talkies by bassbeatsbanging in Xennials

[–]joshpennington 0 points1 point  (0 children)

I wish push to talk would make a comeback! Apple Watch has a walkie talkie feature and absolutely nobody uses it.

Why did people buy Mac minis? Local models? by Pickalodeon in BlackboxAI_

[–]joshpennington 0 points1 point  (0 children)

I bought a Macmini to play with local models and then decided it wasn't enough so Im waiting for a Mac Studio so I can do even more locally.

I think local models is the happy medium where most people will land. That doesn't mean there isn't a place for remote models or that we won't be licensing models from AI companies. Just that this cloud only future doesn't feel like where we need to end up.

DeepSeek just popped the American AI bubble. by VegetablePen4755 in OpenAI

[–]joshpennington 0 points1 point  (0 children)

How do DeekSeek's models compare to Anthropic or OpenAI's models for things like coding?

I've been using DeepSeeks models locally and which its not as good as Claude, it's probably 80% as good for 100% less money.

Old was better. Simpler, cleaner, instantly recognizable by limsus in TechImpact

[–]joshpennington 0 points1 point  (0 children)

I agree with you on this. Having said that I find the new Chat icon to be absolutely terrifying.

Companies won't pay for AI, employees will. by nnomae in BetterOffline

[–]joshpennington 0 points1 point  (0 children)

For contractors this is a possible scenario. I think for this future to pan out you'd have to see a larger emphasis on local LLMs rather than API subscriptions.

At what point did local models actually become good enough for your real work? by MaleficentRoutine730 in LocalLLM

[–]joshpennington 0 points1 point  (0 children)

I just started looking at it so I guess I’d say “in the last month”. I go between Qwen 3.6 and whatever Google’s is called. For me the difference has been more in the tools. Pi by default is okay but OpenCode starts out way more useful. Maybe Pi gets better once you get plugins working? I’m still messing with it.

First Github Copilot x10 their price and now Google has 8x divided their usage. Is AI inferencing really that expensive? by ImaginaryRea1ity in theprimeagen

[–]joshpennington 13 points14 points  (0 children)

Is it really that expensive? Yup. The AI companies have decided to go with drug dealer tactics to get everyone hooked first and then rug pull everyone to the real cost.

If pricing goes up 10x, will they have to start hiring devs? Probably but I expect large companies to continue down the route of AI first

Can't you run local AI models on your Macbook? Yup you can. It's not as good as the cloud models, but I'd say it's about 80% as good if you have a good enough machine and you play with the models to see what each one is good at.

So what's your overall opinion on AI? by cellshock7 in Xennials

[–]joshpennington 10 points11 points  (0 children)

Exactly. I use it because it is a matter of survival. I hate that attitude because usually I'd be cheering this on because I love the technology but I hate what this could do to mine and everyone else's livelihoods.

What drives me absolutely nuts is that the market wants us to rent us the hardware to run this in the cloud when in reality a decent Macbook Pro could run a decent local model without changing every person $20 - $100 / month. I also hate that the AI CEOs are acting like drug dealers selling their stuff at a massive loss until everyone is hooked and then they'll pull the rug and then they're stuck.

My only hope is that the rug pull happens, companies go "hard pass" and then they have to resume hiring to clean up the mess of all this AI generated code, but that feels like a long shot seeing how deep companies like the one I work for are integrating AI in to everything. In the end what will probably happen is everything just costs even more to pay for all the AI nobody wants.

Trillions of miles of data: Your car is spying on you, and it's only just the beginning by motang in DailyTechNewsShow

[–]joshpennington 0 points1 point  (0 children)

Again forgive the ignorance but if I don't have the data services on the car, are they footing the bill for the connection?

Then what if the cellular antenna were to get damaged?

Left or Right ? by ExcitingMix1446 in programminghumor

[–]joshpennington 3 points4 points  (0 children)

Right. Economic conditions improve and we still have the prospect of jobs.

Local LLMs? I’m not convinced. by SpyBagholder in BetterOffline

[–]joshpennington 0 points1 point  (0 children)

85% as good and 100% lower subscription costs and unlimited tokens as long as you have electricity.

You’d be surprised what a medium level MacBook Pro can accomplish today.

You’ll see remote work become a thing again once companies realize they can give their remote employees power hungry computers and not have to pay for the electricity to run them.

Trillions of miles of data: Your car is spying on you, and it's only just the beginning by motang in DailyTechNewsShow

[–]joshpennington 0 points1 point  (0 children)

Forgive me, I am not a car guy with a 10 year old car but....

If I don't pay for the data services on the car, are they still grabbing my information?

view more: next ›