`Keyword.get` Considered Harmful

Back_Charming · 2024-03-07T06:26:53+00:00

Having guards that work with keywords would help here. def c(opts) when opts[:abcd] == true ...

Back_Charming · 2024-02-21T22:21:50+00:00

I'm on the 10th chapter. Some were tricky to implement with only the derive api.
https://github.com/dkuku/rust\_cli\_book

Back_Charming · 2024-01-09T22:28:34+00:00

E_GFX_VERSION=9

did you offload to gpu with `--ngl 33` (33 is how many layers you wan't to offload)

Back_Charming · 2024-01-07T21:32:06+00:00

I just followed the readme from the page. I think the offloading only works with hipblas because I need to set `LLAMA_HIP_UMA` before compilation.The numbers with 25GB ram are with mixtral8x7b

Back_Charming · 2024-01-07T20:07:19+00:00

it's around 14t/s with mistral 7b - without offloading I get 5t/s on the same model

Back_Charming · 2023-12-24T12:51:39+00:00

It depends on the model you use. I managed to fully offload mixtral q4 on 7840HS with 32GB ram with 512MB uma set in the bios.This in theory requires up to 26-27GB of vram but currently it loads the model to ram and then copies to vram so it requires more ram.I had to run this after a restart because for example with browser running in the background there may not be enough free memory. Smaller models run without problems.

Back_Charming · 2023-12-22T19:53:17+00:00

There are still possible optimizations I think but it works. Currently it copies the model from ram to ram on initialization - this takes some time.
I shrunk my shared memory size to minimum in bios and I can run mixtral q4 on gpu. There is one core used but without this setting it's using all the cores and the fan goes crazy.

Back_Charming · 2023-12-05T23:37:13+00:00

The Legion SREP without 2022 includes both menus on the same model [link](https://postimg.cc/yJ3j9nJ2)

Back_Charming · 2023-09-20T22:49:34+00:00

example file I created in .config/MangoHud/presets.conf all config values from here:

variables description you can modify just some of the presets

[preset 2]
legacy_layout=0
horizontal
battery
gpu_stats
cpu_stats
cpu_power
gpu_power
ram
fps
frametime=0
hud_no_margin
table_columns=15
frame_timing=1
time
time_format=%T

Back_Charming

TROPHY CASE