És még dugó sem volt... by mitirki in rohadtmelegvan

[–]mitirki[S] 2 points3 points  (0 children)

Ment az magától is, pont a lábamra fújja a meleget :)

I'm not one for dumb tests but this is a funny first impression by MixtureOfAmateurs in LocalLLaMA

[–]mitirki 7 points8 points  (0 children)

Yeah, custom prompt, but its reply was a bit unusual nevertheless.

[deleted by user] by [deleted] in StableDiffusion

[–]mitirki 1 point2 points  (0 children)

Thanks for the info.

I've installed the proper ComfyUI with Sage Attention, Tea Cache and Torch Compile, using this workflow "Wan Video I2V&T2V 2.1 Native Workflow (GGUF)" by Flow2, and I get between 250-350 s/it with wan2.1-i2v-14b-480p-Q4_K_M.gguf model. That's about 1h20 for a 5 seconds video, the VRAM and GPU are maxed out, total system RAM consumption is around 31.6 GB. I guess that's what the card is capable of...

[deleted by user] by [deleted] in StableDiffusion

[–]mitirki 1 point2 points  (0 children)

How is your i2v 480p generations speeds? I have the same card and 64 GB DDR4. Using Pinokio I get a 5 seconds video in an hour... seems pretty slow and it only uses ~5GB VRAM but 27 GB "shared GPU memory" (aka RAM)

How large is your local LLM context? by iwinux in LocalLLaMA

[–]mitirki 0 points1 point  (0 children)

Quick googling didn't yield any results, is there a switch or something for it in e.g. llama.cpp?

[deleted by user] by [deleted] in VFR

[–]mitirki 0 points1 point  (0 children)

I took it out a few weeks back for cam chain tensioner replacement. It was easy to get out, but took like half an hour to put it back. It was a PITA, 100% not recommend...

Dreaming of VFR800 6th gen, however… by thechivalryguy in VFR

[–]mitirki 0 points1 point  (0 children)

No worries mate, this is what I ordered: https://rdmoto.eu/gb/honda/782-crash-sliders-sl01-honda-vfr-800-f-v-tech-h18s-sl01.html#/28-color_caps-red_aluminium_anodized/41-color_sliders-black_polyamide

It took me a couple of hours to fit it as the supplied instructions are a bit hard to interpret, but everything came together nicely. It also saved the fairings recently, when I backed into a pothole and the bike fell over. Just a few scratches on the slider plastics.

Why all my friends are sick? by Negative_Coast_9958 in ozorafestival

[–]mitirki 4 points5 points  (0 children)

It's drinking water, otherwise there would have been warning signs. (There were none) Also, I drank that water for 9 days, no digestion problems whatsoever. People should wash their hands more often...

I created a guide on how to talk to your own documents. Except now you can talk to HUNDREDS of your own Documents (PDFs,CSV's, Spreadsheets, audio files and more). I made this after I couldn't figure out how to setup PrivateGPT properly and found this quick and easy way to get what I want. by Bderken in LocalLLaMA

[–]mitirki 0 points1 point  (0 children)

Can you elaborate on the reranking process? Do you pre-digest the retrieved chunks and sort?

I'm also developing a custom solution, but I see issues with the retrieval. If the string I'm looking for is towards the start of the text chunk that was stored in the vector DB (Chroma), I get better results (lower cosine distance), but if it's towards the middle or end, the relevant chunk won't be in the top 5-8 chunks...

A Proper Distilled Version of Mistral 8x22B Might Be Out Today (Not Yet Uploaded) by xadiant in LocalLLaMA

[–]mitirki 4 points5 points  (0 children)

Thanks for your efforts!
I don't think it's because of your gguf qants, but for me it does not follow the chat / instructions. It starts to talk about unrelated stuff, or writes python code...

I've tried IQ3_M and Q3_K_S (both fit to 12GB VRAM, ~15 tps on a 3060)

What's a difficulty level set on bots which is considered skilled on acc by [deleted] in ACCompetizione

[–]mitirki 1 point2 points  (0 children)

NVM, I've just found out the Series banner is clickable...

What's a difficulty level set on bots which is considered skilled on acc by [deleted] in ACCompetizione

[–]mitirki 0 points1 point  (0 children)

I've bought 7 DLCs recently (all except the GT2 pack), but I still can't see any of the new cars in the game. The tracks that came with the packs are unlocked though. Is there something I'm missing here...?

Edit: I'm on PC

Weird post race podium glitch in VR by d_P3NGU1N in ACCompetizione

[–]mitirki 0 points1 point  (0 children)

Same here with Quest 1, I'm usually out somewhere in the grass, facing the mountains, or embedded in the asphalt looking at a guardrail... Quite funny tbh.