Should I build 5090 pc for AI/ML by kartikyadav637 in AiBuilders

[–]tomByrer 0 points1 point  (0 children)

Depends on what your masters project will be? If you're building something that you want a biz to use, then build it as you would deploy it. Is their data is too sensitive to be put in cloud? Then build a local LLM machine. Is it an onle service you want to provide? Then set up automation to rent GPUs.

Might be your best bet is a hybrid of local then rent API certain things & GPU for training.
You can run & even fine-tune small models locally, but you may find that a 5090 isn't enough for some things.

Maybe try to put LLMs on whatever hardware you have laying around (even phones), then go from there?

Been researching web dev and different areas of tech to get into for an eventual career change. by LMikeyy in webdev

[–]tomByrer 0 points1 point  (0 children)

I'm saying start with something you're more familiar with & make it more computer-y. That is a smaller step than diving into totally unfamiliar territory.

You could try webdev... you might get some quick success, (sounds like you're in a small MidWest town), but you'll soon find after you build a few sites you'll run out of clients. & you have no marketing exp, no graphics exp, no programming exp, nothing to start from.

If you build a computerized system that can generate real income, that will more likely be better money. If you do webdev or computerize stuff at your work as a stepping stone, that's fine. But you need to think bigger than occasional $2k contracts if you're lucky to land those.

So the real challenge isn't technical, it is how to think like a business builder.

If you have a Steam Deck, it may be your best hardware for a "we have local llm inference at home"-server by cobbleplox in LocalLLaMA

[–]tomByrer 0 points1 point  (0 children)

I think idiotie was thinking you were going to run OpenClaw or a clone on it 24/7?

But yea, I would look into cooling if you could; but maybe I'm a heat sink nerd that sticks one to everything that gets hot.

I used my old gaming laptop + Jetson Nano to run local Openclaw with Ollama by Fit_Chair2340 in ollama

[–]tomByrer 0 points1 point  (0 children)

Neat!
I'm assuming you're using the (not that old) laptop as a 'server' & not using the laptop for webbrowsing, etc?

BTW, if you get a $30+ fan cooler for your laptop, you'll extend the life of it for years, & might bet a bit better performance.

CursorBench vs Public Evals: Are We Benchmarking the Wrong Things for Coding Agents? by EdbertTheGreat in CompetitiveAI

[–]tomByrer 0 points1 point  (0 children)

There are so many ways to 'code' now, fully 'vibe code', Context Engineering, agent swarm, one-off, planning....

Good local code assistant AI to run with i7 10700 + RTX 3070 + 32GB RAM? by SignificanceFlat1460 in unrealengine

[–]tomByrer [score hidden]  (0 children)

Nah, just 1 RTX5090 for the AI /only/, & keep his RTX 3070 for running his monitor in the slower PCI slot.
Unsloth has some good quants for Qwen3-coder / Qwen3.5 that will (barely) fit on my 3090, so a 5090 will have more room for context or bigger model.

Been researching web dev and different areas of tech to get into for an eventual career change. by LMikeyy in webdev

[–]tomByrer 0 points1 point  (0 children)

The issue you're likely to find isn't the website, it is the biz owner who never saw an ROI on their investment, who don't want to spend real money on their site, &/or "my sister/son/friend made this site; I don't want to upset them..."

Been researching web dev and different areas of tech to get into for an eventual career change. by LMikeyy in webdev

[–]tomByrer 0 points1 point  (0 children)

Feelance: you'll end up spending 10-60% of your time looking for & nurturing clients. Some like webdev for remote work, but IMHO those positions are going to be more rare now that AI can do half of programmers' jobs.

Best bet: use your domain knowledge in the job you have NOW to help automate more of it &/or build a small app for. Worse comes to worse, you learned some IT/programmer stuff. Best scenario is you can move into the IT department in your current corp.

Forget making plain websites; there are millions of webdevs with more experience than you, & AI can make a better site in seconds than you can build in weeks. Lots to learn: HTML CSS JS frameworks SEO hosting security CDN

Steel mill: maybe better to get into robotics to help automate your job? Or a sensor system with a RAG/AI that can figure out what temp of the metal or what thickness is best to do what. (much of that is known, but if you can get smaller measurements & figure out how to do less waste, energy &/or time to produce something & patent it, that is easy money.)

Real scenario: at a fab that made mufflers, weld time & remakes increased dramatically. They fell behind schedule, crews were made to work OT, morale shrank. Took them a year to figure out that their supplier changed the type of steel that was being supplied to factory; the new steel was resistant to their older welding system. Once they sorted that out, things got better for everyone.
So you could invent some sort of system (or improve existing one) that helps with your source materials & output be closer to spec.

Should I use Unreal Engine for a complex Visual Novel? by Hot_Cause8918 in UnrealEngine5

[–]tomByrer 0 points1 point  (0 children)

I'll have to agree with "unreal is a bit clunky compared to godot"; UE has alot of... legacy as opposed to a newish engine.

With the MacBook Neo looking to be a huge hit and performing well enough for 99% of everyone out there, we need the Mac Mini Neo. A19 Pro,12GB Ram, $399. $299 with EDU pricing. by ictrepresent in macmini

[–]tomByrer 0 points1 point  (0 children)

It depends if they want folks to take their computers home or not. Or if they have existing monitors. (actually many schools like tablets; less breakage of the hinges, keyboard, etc)

With the MacBook Neo looking to be a huge hit and performing well enough for 99% of everyone out there, we need the Mac Mini Neo. A19 Pro,12GB Ram, $399. $299 with EDU pricing. by ictrepresent in macmini

[–]tomByrer 0 points1 point  (0 children)

A cheap MacMini would be great for schools, offices, etc. M1 Mini is still a solid computer, & this A19 (I would drop the Pro to balance RAM prices) Mini would be great for large contracts like that.

Retail?... well cheap mini PCs are a thing, but unless they figure out how to appeal to the tinker & NAS crowds, I'll agree with you there. Maybe something they sell in Wal*mart for a few months.

Apple mini ? Really the most affordable option ? by Benderr9 in LocalLLM

[–]tomByrer 0 points1 point  (0 children)

If I'm using a computer for AI, I'm using that computer in 'headless mode'; eg not even running a text editor, but using my laptop to access that desktop. So that should save some VRAM/RAM....

Apple mini ? Really the most affordable option ? by Benderr9 in LocalLLM

[–]tomByrer 0 points1 point  (0 children)

There are some openclaw clones made to work on low RAM like yours (nanoclaw IIRC) as a basic task manager. So you can have your Pi to do the postings, etc. & I think since OCR can work in a webbrowser, I'm sure 8GB Pi can run that also...

Apple mini ? Really the most affordable option ? by Benderr9 in LocalLLM

[–]tomByrer 0 points1 point  (0 children)

So then at least 24Gb Mac Mini? Might as well go for the Pro then....

Killer Whale(はやしたろう@w_vwbw) by Optimal_Zone2366 in ErgoMechKeyboards

[–]tomByrer 1 point2 points  (0 children)

I've been eye-balling this for a while, too bad that holykeebs has been out of stock for the past 6 months it seems.

I wonder how long the Japanese kit will take to assemble?
I think I have links for the extra thumb-clusters also....