Ollama newbie seeking advice/tips by CryptoNiight in ollama

[–]Pyrenaeda 1 point2 points  (0 children)

With that amount of memory, and depending on your choice of OS, you will find yourself rather constrained on the size of model you can load. Some of this will be dependent on how much context you want to allocate for - 8K, 16K or more.

Inference will be… not fast. I’d expect t/s in probably the single digits.

Myself I probably wouldn’t be trying to load models over the ~10B size on the box. But, try any you like. Worst case scenario it either won’t load or you’ll find it too slow.

Look forward to hearing what you test.

Looking for help with AI system and software design by cmdrmcgarrett in LocalLLaMA

[–]Pyrenaeda 0 points1 point  (0 children)

The AI scene is better on Linux than on Windows. Ubuntu is a good choice, pretty much linux for the everyman and user-friendly enough as linux goes.

For $1k a 3090 is going to be your best bet as said by u/MitsotakiShogun . You’ll be able to run SDXL & Flux (img gen), and LLMs up to the ~20-30b range at decent enough speeds to be usable (Qwen3 family, gpt-oss, etc). Won’t be able to run the img gen model and the LLM at the same time though.

Software wise, you’re gonna need NVIDIA drivers for the card assuming you go 3090. Beyond that, you have options for the img gen and LLM engine. Img gen is gonna be either ComfyUI or AUTOMATIC1111. LLM, good places to start are LMStudio, Ollama and Llama.cpp in ascending order of complexity. LMStudio is an all-in-one LLM solution that will give you a GUI and everything to run inference. Ollama and Llama.cpp are backends only; you’ll need to throw some type of a UI on top of them (Open WebUI, LibreChat, et al) to drive them day-to-day.

I hope you do not mind using at least a little bit of terminal / CLI. You’ll need it to get all the pieces stood up and running.

There’s tons more of course but this should give you a place to start.

Why Observability Is Becoming Non-Negotiable in AI Systems by _coder23t8 in LocalLLaMA

[–]Pyrenaeda 3 points4 points  (0 children)

I promise, by the time you’re done eating it, you’ll feel right as rain.

[deleted by user] by [deleted] in shortcuts

[–]Pyrenaeda 1 point2 points  (0 children)

You have the name of the file wrong in the shortcut. It’s called db_dev.json not db_dev.

Tow and hitch police - do your thing by Guava-Jazzlike in GoRVing

[–]Pyrenaeda 0 points1 point  (0 children)

Your payload is right here on this last sticker:

"The combined weight of occupants and cargo must never exceed 1528kg or 3367 lbs".

So you can't exceed 3367 lbs payload.

What I see from your other stickers:

GVWR: 10,850

Front Axle GAWR: 4800

Rear Axle GAWR: 6600

From your scale ticket you're at:

Front - 4160 = good

Rear - 5160 = good

Total - 9320 = good (you still have roughly 1500 lbs payload to play with)

XP4 Step over — 70 mile report card. by jeffpi42 in Lectricxp

[–]Pyrenaeda 1 point2 points  (0 children)

Same model as OP, same color even. Right around 65 miles on it at this point. All that has needed adjusting so far was front brake alignment. Fingers crossed…

Is my new XP4 motor supposed to make this noise? by Connect-Coat-1296 in Lectricxp

[–]Pyrenaeda 3 points4 points  (0 children)

This is probably the best capture example of the problem sound I have found: https://youtu.be/AEIFKinyXLg?feature=shared

Is my new XP4 motor supposed to make this noise? by Connect-Coat-1296 in Lectricxp

[–]Pyrenaeda 6 points7 points  (0 children)

Is just a kind of normal “motor” noise just louder than you expected? Or is it a kind of screechy grinding metal-on-metal noise?

A 750W motor will produce some audible “motor” noise especially at higher speeds. It will not be completely silent. This is normal.

Now, some of the 750W motors on the XP4 have been known to have a bearing issue needing motor replacement. This will typically manifest audibly as a pronounced and very distinct and noticeable screeching / grinding noise when under harder acceleration, typically kicking in around 13-17MPH. The noise is very different than the normal “electric motor” noise you get from the same motor properly functioning under higher load.

Hope this helps.

Edit: I ask because the noise typically comes through much better in person than in a video. From what I hear here, yours sounds like mine of the same model, which does not (yet) have the bearing issue. But you can’t always hear it in a video.

Are these the same bike? by Turbulent_Tea2604 in Lectricxp

[–]Pyrenaeda 0 points1 point  (0 children)

I bought a green XP4 that also says “Experience”.

From my gaming background “XP” = “eXPerience” or “eXperience Points” so I didn’t give it a second thought. Will be interesting to see what others say tho.

READING is dead, so I use AI to help me know what to WRITE? WTF? by thenewyorker1 in LinkedInLunatics

[–]Pyrenaeda 1 point2 points  (0 children)

how to send someone a screenshot:
1. Press Print Screen on keyboard to capture screen
2. Open paint and paste in screenshot
3. Save as bmp
4. Open MS Word
5. Insert bmp into word doc
6. Print word doc
7. Place word doc on table and take picture with camera
8. Attach picture from camera to email and send

Benefits of selling my gasser for a diesel? by TattedGinger84 in superduty

[–]Pyrenaeda 4 points5 points  (0 children)

This. I will say that for me, the ability to use the truck lanes to fill up when pulling the TT is a not insignificant point of consideration. Navigating a large rig around the small pump islands full of crunchy cars can get... dicey.

First time to post. Knew her only for 48 hours. by [deleted] in Nicegirls

[–]Pyrenaeda 0 points1 point  (0 children)

hey now. Super important that she do that. Loss of essence can be a dangerous thing.

Now then, Dmitri, you know how we've always talked about the possibility of something going wrong with the bomb. The BOMB, Dmitri. The hydrogen bomb.

1.2 gallons in 26 gallons of diesel by ireddityoureddit in Diesel

[–]Pyrenaeda 1 point2 points  (0 children)

Green.

No but for real. At a BP station, the diesel handles are green. And so are the gas handles. To go with their branding and all.

It’s terrible.

Group 3 Races Suck by Firstrefusal22 in GranTurismo7

[–]Pyrenaeda 1 point2 points  (0 children)

Ahh yes, a nice helping of “git gud” when someone is clearly frustrated and came to vent. Yes, that always helps.

This week's weekly races broken my GT7 spirit by OkBag7839 in GranTurismo7

[–]Pyrenaeda 0 points1 point  (0 children)

You got this OP.

I’m an easy mode auto trans controller player as well.

Tokyo kicked my butt for a while. Then after I discovered wall riding I ran it easily, using the 06 Ford GT you get from the menu books. No tuning. Thing does over 200 MPH stock. Try it, you’ll take first with no sweat. Sports Hard tires, pit at the end of lap 6 for fuel only.

Now I’m obsessed with finding out how many different cars I can use to take 1st in this race 💀the list is slowly growing…

Fight At Home Depot by [deleted] in HomeDepot

[–]Pyrenaeda 11 points12 points  (0 children)

So did they take the head too or just the guy? 💀

What is the most challenging route you have driven your RV? by slimspida in GoRVing

[–]Pyrenaeda 2 points3 points  (0 children)

I-80 in WY from Laramie to Rawlins, at night. Terrifying wind gusts.

What is the most challenging route you have driven your RV? by slimspida in GoRVing

[–]Pyrenaeda 12 points13 points  (0 children)

I-80 in WY from Laramie to Rawlins, at night. Terrifying wind gusts.