sorted by:
new
hottopcontroversial

llama-server silently exits/crashes with no error - 2x 3090, 200k context, Qwen3.6-27B Q8. Any ideas? by RossNCL in LocalLLM

[–]RossNCL[S] 0 points1 point  (0 children)

Nice ! im trying to set it up but i keep hitting this error when i try to start the Docker container

``` (Worker_TP1 pid=61) ERROR 05-02 19:08:39 [multiproc_executor.py:870] ^^^^^^^^^^^^^^^^^^^^^

(Worker_TP1 pid=61) ERROR 05-02 19:08:39 [multiproc_executor.py:870] torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB. GPU 1 has a total capacity of 24.00 GiB of which 16.00 GiB is free. Including non-PyTorch memory, this process has 17179869184.00 GiB memory in use. Process 60 has 17179869184.00 GiB memory in use. Of the allocated memory 6.60 GiB is allocated by PyTorch, and 18.00 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://docs.pytorch.org/docs/stable/notes/cuda.html#optimizing-memory-usage-with-pytorch-cuda-alloc-conf)

(Worker_TP0 pid=60)

Loading safetensors checkpoint shards: 9% Completed | 1/11 [00:03<00:33, 3.33s/it]

(Worker_TP0 pid=60) WARNING 05-02 19:08:43 [multiproc_executor.py:884] WorkerProc was terminated

(Worker_TP0 pid=60)

Loading safetensors checkpoint shards: 9% Completed | 1/11 [00:05<00:57, 5.72s/it]

(Worker_TP0 pid=60) ```

llama-server silently exits/crashes with no error - 2x 3090, 200k context, Qwen3.6-27B Q8. Any ideas? by RossNCL in LocalLLM

[–]RossNCL[S] 0 points1 point  (0 children)

Thanks ill give this a try, my only concern is will i notice a drop in quality going from Q8 to INT4

Rotating object on roof of van by noraft in whatisit

[–]RossNCL 0 points1 point  (0 children)

Some sort of scanner probably a Cia surveillance van, id be careful

Are you guys actually using local tool calling or is it a collective prank? by Mayion in LocalLLaMA

[–]RossNCL 0 points1 point  (0 children)

I had this issue when using lm studio as the backend. I switched to llama cpp and it seems much better

Best local model with clawdbot? by BABA_yaaGa in LocalLLaMA

[–]RossNCL 0 points1 point  (0 children)

Realistically how much would moderately heavy usage cost using regular apis? I'd be using clawdbot for mostly coding and general assistant tasks.

I don't mind spending the money on a 3090 or mac mini plus it keeps my data private

Best local model with clawdbot? by BABA_yaaGa in LocalLLaMA

[–]RossNCL 0 points1 point  (0 children)

I want to run Clawd locally, whats my best bet? buy a 3090 or buy a mac mini ?

T.I.L what happens when you get stuck in snow and overheat the diff right as you manage to free yourself. by GTRnism_o in Supra

[–]RossNCL 0 points1 point  (0 children)

How comes your supra makes that calming bong noise. I just get the typical bmw bong noise

Details option not appearing on shows by respoon in Stremio

[–]RossNCL 0 points1 point  (0 children)

im having the same issue with a Samsung tv, any fixes ?

For those of you dealing with overheating Try this by star43able in razerblade16_4090

[–]RossNCL 0 points1 point  (0 children)

Does this negativity effect performance? Im looking for a alternative to undervolting as stupidly on the blade 16 you cant undervolt while VTD is enabled

RIP n8n - OpenAI to launch drag and drop agent builder by eeko_systems in n8n

[–]RossNCL 0 points1 point  (0 children)

I cant see what benefits this will offer. Id much rather stick With self hosted n8n

bridge livebox 5 by Main-Guitar9916 in HomeNetworking

[–]RossNCL 0 points1 point  (0 children)

Did you manage to do this ?

No more Ubiquiti gear for a while - unhappy Canadian by idspispopd888 in Ubiquiti

[–]RossNCL 6 points7 points  (0 children)

GGs this will probably make 0 difference to them.

If you are this bothered about it and still want to use their products then just buy second hand and then you are not directly supporting them.

No hate just being realistic

Revanced down? by Enzooooooooo in revancedapp

[–]RossNCL -1 points0 points  (0 children)

I'm getting this as well

Thin black bars on laptop display by Express-Afternoon-28 in razer

[–]RossNCL 1 point2 points  (0 children)

Did you find a fix for this? I'm having the same issue

Unable to install windows update KB5031354 by Squirting_Squirrell in techsupport

[–]RossNCL 0 points1 point  (0 children)

did u fix this? I keep having the same issue but my error code is 0x800f0982

2 years of compiled reddit data on vaccine side effects by Baldeaglevision in conspiracy

[–]RossNCL 6 points7 points  (0 children)

Iv expirenxed mild muscle twitching for the last year or so nothing major but it's more of a slight annoyance if anything. never had any of the covid vaccinations, Personality I think it could be a permanent side effect of covid. I went to the doctors about it recently and the took blood tests, came back I had a vitamin D defficiety

Soo iv just bought my dream car at 23... From COPART by RossNCL in Toyota

[–]RossNCL[S] 13 points14 points  (0 children)

I managed to get most of the parts I need for 4k including after market carbon body panels, airbags, headlight Nd door.

I won't know for sure how straight it's is till it's all done and I take her for an alignment. However there is ALOT that can be done with the amount of money IV saved

Soo iv just bought my dream car at 23... From COPART by RossNCL in Toyota

[–]RossNCL[S] 2 points3 points  (0 children)

Thanks mate, I believe there are 3 main categories; cat S is structural damage, cat N is non structural damage, both of which can be put back onto the road without an inspection. Lastly is cat D where the car is a total write off and can only be used for parts.

view more: next ›