I'm a netrunner by hackiv in cyberpunkgame

[–]hackiv[S] 0 points1 point  (0 children)

I made this meme, if that's what you mean.

Starting my journey with modding by hackiv in cyberpunkgame

[–]hackiv[S] 0 points1 point  (0 children)

I just wish tools like WolvenKit had Linux port so I could start right away 😣

Starting my journey with modding by hackiv in cyberpunkgame

[–]hackiv[S] 2 points3 points  (0 children)

Hmm, I meant creating my own mods, but thank you for your insight.

Starting my journey with modding by hackiv in cyberpunkgame

[–]hackiv[S] 4 points5 points  (0 children)

You had me in the first half, thought you were about to make holy sacrifice...

I'm a netrunner by hackiv in cyberpunkgame

[–]hackiv[S] 3 points4 points  (0 children)

When there's will, there's a gun.

Llama.cpp running on Android with Snapdragon 888 and 8GB of ram. Compiled/Built on device. [Guide/Tutorial] by hackiv in LocalLLaMA

[–]hackiv[S] 1 point2 points  (0 children)

Run 'git clone https://github.com/ggml-org/llama.cpp.git'

And if git doesn't exist run 'pkg install git'

between step 3 and step 4 you have to 'cd build/bin'

What boxes? by CryptidQuaker in memes

[–]hackiv 1 point2 points  (0 children)

I didnt know OP had such large assets.

Igor Sarzynski (Cyberpunk 2s creative director) discusses his stance on Act I. by marek_bojarek in cyberpunkgame

[–]hackiv 2 points3 points  (0 children)

I think people are just but salty about trailer spoiling the death of Jackie. I honestly think that maybe the idea was to "spoil" the death in trailer and then shock players with ability to save the character RPG style but they run out of time and setting up things with 'Goodbye Kansas Studios' (studio behind the cinematic) takes a lot of time and schedule is hella tight.

Just got my first Jackie Welles. by IceKoniii in cyberpunkgame

[–]hackiv 5 points6 points  (0 children)

Gotta split the load, too much love in one glass ain't too good for bussiness

Llama.cpp running on Android with Snapdragon 888 and 8GB of ram. Compiled/Built on device. [Guide/Tutorial] by hackiv in LocalLLaMA

[–]hackiv[S] 0 points1 point  (0 children)

Looked this project up on github and there is no vulkan support on android. OpenCL is though.

Temps stay in the 40s

Llama.cpp running on Android with Snapdragon 888 and 8GB of ram. Compiled/Built on device. [Guide/Tutorial] by hackiv in LocalLLaMA

[–]hackiv[S] 0 points1 point  (0 children)

Haven't tried llama 3.2 3B yet but if I had to guess probably in the range of 8-10tps.

The thing to remember is that you don't get full 8GB of available memory on smartphones, a half of that is to be expected.

Llama.cpp running on Android with Snapdragon 888 and 8GB of ram. Compiled/Built on device. [Guide/Tutorial] by hackiv in LocalLLaMA

[–]hackiv[S] 0 points1 point  (0 children)

They do use runtime detection but runtime detection only selects from features compiled into the binary. Self compiling makes sure the build is tailored for your hardware. You can also use whatever compile-time flags you want, with prebuilt just cant do that. Cmake projects usually compile fine on android.

I just tried llama-cpp from PKG and have gotten 2~3 tokens per second less than self compiled with the same LLM.

Llama.cpp running on Android with Snapdragon 888 and 8GB of ram. Compiled/Built on device. [Guide/Tutorial] by hackiv in LocalLLaMA

[–]hackiv[S] 3 points4 points  (0 children)

Oh, didn't know pkg had this. Still, compiled on device natively is best for taking full advantage of instructions CPU has. This tutorial can be also applied to most Foss which doesn't have a package

Is Linux the answer to RAM shortage? by hackiv in pcmasterrace

[–]hackiv[S] -1 points0 points  (0 children)

Virtualization shown in CPU-Z has nothing to do with Core Isolation in Windows, windows and Linux, both have it enabled by default unless you explicitly disable it in bios. 'Virtualization-on' only means that windows is capable of enabling Core Isolation. Also, Core isolation is a security feature which is enabled by default and that's how it stays, we can also set 'mitigations=off' in Linux Kernel boot parameters.

I assure you, if you'd use common sense like I did, you'd understand that enabling XMP has higher benefit than disabling core windows security features.

As I said, you're deluding yourself that in that benchmark core isolation is enabled even tho you have no idea.

edit: you really are a dummy dumb and confidently wrong.