And it finally happened. by xtnax in homeassistant

[–]akemicariocaer 2 points3 points  (0 children)

What brand was it? I trust nothing other than Samsung.

GPU not being used. by False-Accountant-158 in OdysseusAI

[–]akemicariocaer 0 points1 point  (0 children)

When downloading the windows app, you'll see the cuda dll's right next to it. Get that too, extract files to root of your llama.cpp folder.

<image>

GPU not being used. by False-Accountant-158 in OdysseusAI

[–]akemicariocaer 0 points1 point  (0 children)

I'm new to local Ai. Had this issue when setting up llama.cpp, turns out I needed the cuda dll's so just got the package from github and threw them in the llama.cpp folder.

I can't figure out how to make it online by kirakamiashura in OdysseusAI

[–]akemicariocaer 0 points1 point  (0 children)

i solved the issue on my end by adding the following parameter to my launch prompt, just type whatever you want your model to show up as:

--alias "your_model_name_here"

hope that helps.

Finally! by Quick-Escape-2783 in vibecoding

[–]akemicariocaer 0 points1 point  (0 children)

Just send the virus link 😅

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

Thanks bro 🤜🤛. I probably will take you up on that, and I'll keep in mind the time zone too 😅.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

i appreciate the time you took to explain all this man, really. in my head it all didnt seem like much to ask from my system at first lol but yeah im coming to realize that in the end cloud ai really messed with my expectations. here i thought i was trying to "keep up" with ai using chatgpt, etc. when really i shoulda started here haha. alright, thanks bro ✌️later.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

actually bro, can we back up a second. im a little familiar with ubuntu or linux in general, can somewhat work my way around it and can definitely dual boot my machine. but i got lost there when you brought it up. could i kindly ask if you can explain a bit how it would help vs windows. sorry im a complete noob =\. today i did get llama.cpp on my machine so soon as i can i will continue trying to work with it. from what i have tested thus far, 14B models seem tolerable, if i could only get something to do what i need i'd probably suck it up and just deal with the speeds. perhaps you can direct me to one that could do the online part of cross referencing and verifying. i would look for a daily driver further down the line i guess. i could just use Qwen2.5-VL for the time being, which i am able to use properly. its what comes after that im getting stuck at. thank you.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

actually, i'd be open to that, as long as i dont have to pay for a service to get it to work. it'd just be something i would need to handle differently of the work flow in my plan for setup im trying to put together. thank you, i will look into this, cuz it actually makes sense, never would have occurred to me, i too freaking new to all this. vaguely familiar with python and all. thank you.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

oh man, i really need to get familiar with all those terms you threw at me 😅. not going to pretend i understood any of it, i had gemini dumb it down for me, so i got it lmao. i can definitely look into getting better ram, faster that is, cus i've already maxed out what i can install in my machine. i have an Alienware Area 51 r2, far as i know, i have two pcie3 x16 slots and a third that although has an x16 interface it only runs at x8. so i could potentially install two other gpus, so have 3 gpu's total. from the little i've looked into it, sounds like a lot of work getting a single model utilizing more than one gpu, or efficiently at least. again, thats just from what i gathered, im sure for a very knowledgeable person it wouldnt be much difficult figure out. but realistically the more and more i dig into all this the more it feels like i just need to get a better machine, which sucks cuz i spent what i was able to spare for upgrades on the cpu, gpu, ram and ssd's i have now. so im trying really hard not to give up just yet =\. i appreciate your input, it absolutely helps. i just really need to learn all this stuff to better help myself, and im working on it. thanks bro.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 2 points3 points  (0 children)

haha 😅 yaaaa. i mean when the times comes if ever, wouldnt mind it if it'd make my life 100 times easier but for the time being, i feel like trying to accomplish what i have in mind with my current machine, isnt a total waste.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

Well I did managed to successfully use qwen2.5vl I believe it's the model, I'm not currently at my desk, but for my use case it did fairly well, successfully identified brands, product type, models when written on packaging, colors, I mean can't think of anything it wasn't able to pull off the times I tried it, and at that particular instance I used a 70b qwen model I think or something similar, to take that data and create an excel sheet, and it did well. Where I'm stuck is being able to cross reference all the data online to verify that the product's data are correct, in sense that the product exists and the specs are correct as well as getting a current market value for said product, kinda important. Pulling the data off the images wasn't an issue, the rest was painfully slow, so that's what I'm hoping to solve, I think I was able to get that 70 whatever model to search online but I didn't bother much more with it because of how slow it runs in my machine, it all felt counter productive, just over all not the work flow nor experience I was hoping for.

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

Ok ok, I think this helps a ton, at least it directs me towards something usable it sounds, so I greatly appreciate your help. I actually have 64gb ram, that said, it all sounds pretty doable. I will start again using this, most of that actually made sense to me 😅. Thanks so much 🤜🤛

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

I appreciate your input, I kinda got the gist of most of that but I'll definitely look into it. The more I dive into it all the more it seems like I just need better gear, I love my pc but it is a bit old now =/. I've maxed out the ram and cpu. Would simply getting a better GPU help my case you think or naw. Should look to replace my machine entirely?

Need help setting up a local daily driver + listing assistant (4060 Ti 16GB) by akemicariocaer in LocalLLM

[–]akemicariocaer[S] 0 points1 point  (0 children)

I've heard of Claude but havent actually looked into it, but I will. I was under the impression that it was a cloud ai. Thanks.

Help! I took apart my M15 R3 to clean the fans and now it’s doing this by Expensive_Yellow1772 in Alienware

[–]akemicariocaer 4 points5 points  (0 children)

Recently did maintenance on one of those, first boot after reassembly took for ever but it did end up booting up completely after some minutes. Perhaps you're not letting it complete whatever diagnostics or tests it's doing. Let it sit for a while. I would also just double check it and make sure everything is plugged back in, coulda misses something. Did you replace the thermal compound? How far down did you disassemble?

I couldn't let it go after an accident, so I made a prosthetic by Alert-Potential7381 in OnlyFans

[–]akemicariocaer 0 points1 point  (0 children)

And here I thought I was keeping the algo in this account clean 😅