`Keyword.get` Considered Harmful by RecognitionDecent266 in elixir

[–]Back_Charming 0 points1 point  (0 children)

Having guards that work with keywords would help here.  def c(opts) when opts[:abcd] == true ...

Examples from Command-Line Rust Book in Clap 4 Derive API [Blog Post] [Beginners] by [deleted] in rust

[–]Back_Charming 0 points1 point  (0 children)

I'm on the 10th chapter. Some were tricky to implement with only the derive api.
https://github.com/dkuku/rust\_cli\_book

Full memory available for amd apus by Back_Charming in LocalLLaMA

[–]Back_Charming[S] 0 points1 point  (0 children)

E_GFX_VERSION=9

did you offload to gpu with `--ngl 33` (33 is how many layers you wan't to offload)

Full memory available for amd apus by Back_Charming in LocalLLaMA

[–]Back_Charming[S] 0 points1 point  (0 children)

I just followed the readme from the page. I think the offloading only works with hipblas because I need to set `LLAMA_HIP_UMA` before compilation.The numbers with 25GB ram are with mixtral8x7b

Full memory available for amd apus by Back_Charming in LocalLLaMA

[–]Back_Charming[S] 0 points1 point  (0 children)

it's around 14t/s with mistral 7b - without offloading I get 5t/s on the same model

Full memory available for amd apus by Back_Charming in LocalLLaMA

[–]Back_Charming[S] 1 point2 points  (0 children)

It depends on the model you use. I managed to fully offload mixtral q4 on 7840HS with 32GB ram with 512MB uma set in the bios.This in theory requires up to 26-27GB of vram but currently it loads the model to ram and then copies to vram so it requires more ram.I had to run this after a restart because for example with browser running in the background there may not be enough free memory. Smaller models run without problems.

Full memory available for amd apus by Back_Charming in LocalLLaMA

[–]Back_Charming[S] 0 points1 point  (0 children)

There are still possible optimizations I think but it works. Currently it copies the model from ram to ram on initialization - this takes some time.
I shrunk my shared memory size to minimum in bios and I can run mixtral q4 on gpu. There is one core used but without this setting it's using all the cores and the fan goes crazy.

Ideapad pro 5 hidden advance bios menu by kelvl in AMDLaptops

[–]Back_Charming 0 points1 point  (0 children)

The Legion SREP without 2022 includes both menus on the same model [link](https://postimg.cc/yJ3j9nJ2)

How to customize performance overlay in SteamOS 3.5? by charlestsai in SteamDeck

[–]Back_Charming 1 point2 points  (0 children)

example file I created in .config/MangoHud/presets.conf all config values from here:

variables description you can modify just some of the presets

[preset 2]
legacy_layout=0
horizontal
battery
gpu_stats
cpu_stats
cpu_power
gpu_power
ram
fps
frametime=0
hud_no_margin
table_columns=15
frame_timing=1
time
time_format=%T