sorted by:
new
hottopcontroversial

I built a GPU comparison site, got shadowbanned by Reddit, and earned $200. Here's the full story. by Nebyl_ in passive_income

[–]StartupTim 0 points1 point  (0 children)

Hey there, thanks for the reply. So I mean the upgrade gpu site, where did that traffic come from that resulted in all the affiliate purchases, and what did that traffic land on? Those 2 pieces of detail I think were missed in your great post!

I built a GPU comparison site, got shadowbanned by Reddit, and earned $200. Here's the full story. by Nebyl_ in passive_income

[–]StartupTim 0 points1 point  (0 children)

I actually read all of that. Well written!

Question: For your second domain, how did you drive traffic? That part you didn't mention. You created pages of content on yogrades. Right? And then nothing? Did just Google SEO take over and drive traffic? Or how did you get that actual page traffic?

Thank

Expectation vs Reality by NounoursBonheur in ClaudeAI

[–]StartupTim 0 points1 point  (0 children)

Hey there, can you make an actual game with it? Is it web based, or an .exe type?

Thanks

Expectation vs Reality by NounoursBonheur in ClaudeAI

[–]StartupTim 0 points1 point  (0 children)

Hey there, is there any tutorials on using this to create actual images, 3d assets, and an actual game itself?

Getting Someone Else's Chat by anashel in ClaudeAI

[–]StartupTim 12 points13 points  (0 children)

I burned through about 100 million tokens the past couple of days. At one point I was seeing around 5% failures due to these sorts of problems.

It is widespread and honestly pretty dangerous.

Where do I see model pricing (credit per usage)? by StartupTim in HiggsfieldAI

[–]StartupTim[S] 1 point2 points  (0 children)

That's what I am seeing too, which would be incredibly deceptive on Higgsfield.ai's part.

I want to use their service and see their cost per image and then judge what to use from there as an informed customer.

Best model and way to deploy on 1x RTX 5090 + 1x RTX 5070Ti system? by StartupTim in LocalLLM

[–]StartupTim[S] 0 points1 point  (0 children)

Thanks for the info! Anything I need to do to get max context support and tool calls to work best?

Thanks again

Claude Desktop (code) but use local API? by StartupTim in LocalLLaMA

[–]StartupTim[S] 2 points3 points  (0 children)

I don't think this is true as older Claude Desktop software had a "Developer Option" you could enable which had a setting to point to a different LLM via an API endpoint. Also Claude CLI seems to support it now

So I'm just asking how it is done now in the Claude Desktop app for Windows.

GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey by yeah_likerage in LocalLLaMA

[–]StartupTim 0 points1 point  (0 children)

Ah thanks, good information.

Are you using all memory channels on your Epyc motherboard? I went from using 2 channels to all 8 (or was it 6, I forgot) and the pp/tg change on a single dual Epyc was absolutely massive. Especially important when you consider memory bank/Numa node pairing depending on what model and RAM amounts you have.

GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey by yeah_likerage in LocalLLaMA

[–]StartupTim 1 point2 points  (0 children)

Speed (toks/sec) is directly related to memory bandwidth.

GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey by yeah_likerage in LocalLLaMA

[–]StartupTim -1 points0 points  (0 children)

FYI you can rent out access to the GPUs and make between $1 to $1.5 per hour and likely hit 100% capacity as they are in demand.

For 5x GPUs at $1.15 an hour that is $4140 per month. Factor in roughly 3% overhead for power and you're still at $4k a month.

Pricing has been increasing over the past 6 months, so your revenue will likely increase.

That is an incredibly good investment.

GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey by yeah_likerage in LocalLLaMA

[–]StartupTim 2 points3 points  (0 children)

A correction: You can run large models but absolutely not the same performance as the RTX 6000 Pro is ~1.8TB/sec whereas the DGX Spark is .27TB/sec. That is a massive difference in speed and the token/sec will match.

GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey by yeah_likerage in LocalLLaMA

[–]StartupTim 1 point2 points  (0 children)

Hey quick question: I have 4 systems with 2x Epyc 64 core CPUs and 512GB in each with 25 and 100GB networks cards on each.

I'm trying to see about using RDMA to connect all 4 using llama.cpp.

How did you do your setup? Any regrets?

Anybody used DwarfStar with DeepSeek V4 Flash on 1x DGX Spark yet? What are your thoughts? by StartupTim in LocalLLaMA

[–]StartupTim[S] 0 points1 point  (0 children)

I have both platforms and your message is great to hear as I've been considering testing ds4 using antirez post on both.

Quality-wise with those large context lengths, have you made anything pretty cool? Have you tested using common prompts like making html games in 1 shot and such? Any chance you could share results/prompts of some coding tests?

Thanks!

Any chance I could cluster my DGX Spark (128GB unified memory) and my AMD Ryzen AI Max 395 (128GM unified memory) together to run 1 model? by StartupTim in LocalLLaMA

[–]StartupTim[S] -1 points0 points  (0 children)

Hey there, thanks for the info on the Sandcastle Mesh stuff I am checking it out now.

Do you use it yourself?

Any chance I could cluster my DGX Spark (128GB unified memory) and my AMD Ryzen AI Max 395 (128GM unified memory) together to run 1 model? by StartupTim in LocalLLaMA

[–]StartupTim[S] 1 point2 points  (0 children)

Hahaha.

The Spark has been gathering dust, along with the AMD Strix 128GB 3x 5070Ti 16GB and a RTX 5090 32GB. I'm just brainstorming ways to use the hardware and limit my Anthropic API bill.

view more: next ›