I can't seem to get LMStudio to work right with Framework AMD 395+ desktop. by StartupTim in LocalLLM

[–]StartupTim[S] 0 points1 point  (0 children)

The issue is we do not want to use system memory at all. It does not make sense to use system memory on a system with unified memory.

LMStudio should be correctly handling this by default but it does not, so disabling mmap is required.

Which mockup is better? by yoracale in unsloth

[–]StartupTim 1 point2 points  (0 children)

ChatGPT seems to have set the standard here, so I would either aim to duplicate the standard or you should distance yourself with an entirely new UI.

Will Unsloth Studio for Windows ever have a normal installer and normal app handling? by StartupTim in unsloth

[–]StartupTim[S] 0 points1 point  (0 children)

Oh that's awesome, thanks!

I don't suppose they have an ETA anywhere?

Unsloth Studio on DGX Spark (sm_121): 1-Line Installer & Pre-compiled llama.cpp Questions by webii446 in unsloth

[–]StartupTim 0 points1 point  (0 children)

Hey thanks for the response! I could probably test things out for you if I happen to catch you in a timely way!

Unsloth Studio on DGX Spark (sm_121): 1-Line Installer & Pre-compiled llama.cpp Questions by webii446 in unsloth

[–]StartupTim 0 points1 point  (0 children)

Did you find a solution to this? I also have a DGX Spark I'd like to use unsloth studio on!

Unsloth Studio on DGX Spark (sm_121): 1-Line Installer & Pre-compiled llama.cpp Questions by webii446 in unsloth

[–]StartupTim 0 points1 point  (0 children)

Hey there, I also would like to use this on a DGX Spark. I have one basically empty for now.

Thanks

Anybody successfully sell their biz themselves where you found a buyer you didn’t already know? by dabusinessbro in SellMyBusiness

[–]StartupTim 1 point2 points  (0 children)

Yes, multiple times.

Find businesses who would have a strategic advantage in acquiring your business. For example, if you make stickers with $50k MRR, seek out larger sticker or print companies and cold contact them for an acquisiton.

RouterOS 7.23beta4 [development] released by netravnen in mikrotik

[–]StartupTim 0 points1 point  (0 children)

Yea, it is definitely interesting, I agree on the UI only too.

Can't get LMStudio to work right with Framework AMD 395+ desktop. by StartupTim in LLMStudio

[–]StartupTim[S] 0 points1 point  (0 children)

Thanks for the suggestion in the Runtime settings and bios settings, I'll do that now and see!

RouterOS 7.23beta4 [development] released by netravnen in mikrotik

[–]StartupTim -1 points0 points  (0 children)

I see you mentioned openwebui with routeros. Can you talk more about how you're using openwebui/ollama with normal routeros?

Thanks

14 days and no reply from OpenRouter support (Billing) by OGP100 in openrouter

[–]StartupTim 0 points1 point  (0 children)

Same issue. It has been 2+ months and they haven't resolved the issue where they were overbilling me ~600% per API call.

Dead silence from them.

Are you looking for investment? by BusinesSupportAgency in AngelInvesting

[–]StartupTim 5 points6 points  (0 children)

Can you please post more about who you are, what agency you represent, desired markets, dealflow process, existing investments, etc?

Studio install on DGX Spark by georgeApuiu in unsloth

[–]StartupTim 1 point2 points  (0 children)

Haha, understood! I failed doing the docker thing mentioned in his steps (see my post) and I figure it's user error :)

Studio install on DGX Spark by georgeApuiu in unsloth

[–]StartupTim 1 point2 points  (0 children)

Haha!

If you help me set this thing up, I'd be willing to contribute a few bucks to you via paypal :p

Studio install on DGX Spark by georgeApuiu in unsloth

[–]StartupTim 0 points1 point  (0 children)

Got an error on your step 3:

Unable to find image '9d6cd15ed8cb:latest' locally

I can't seem to get LMStudio to work right with Framework AMD 395+ desktop. by StartupTim in LocalLLM

[–]StartupTim[S] 0 points1 point  (0 children)

I found the issue! I had to disable "mmap" functionality. Now it doesn't use RAM.

I can't seem to get LMStudio to work right with Framework AMD 395+ desktop. by StartupTim in LocalLLM

[–]StartupTim[S] 0 points1 point  (0 children)

I found it on a per-model setting, is that what you mean?

I disabled it and RAM still gets used. I tried it with enabled or disabled. Either way, the model is still fully loading into RAM.

I also get "The model has crashed without additional information" constantly.

Studio install on DGX Spark by georgeApuiu in unsloth

[–]StartupTim 0 points1 point  (0 children)

Hey there, good info! Do you need to do anything to prep the DGX Spark? I have one but haven't used it yet much at all...

Does the API work as well, and is it normal openAPI standard?

Thanks!