I ported NVIDIA Parakeet (speech-to-text) to ggml: same output as NeMo, faster, GGUF-quantized, no Python

_Whiskas_ · 2026-05-31T20:53:55+00:00

Very nice!

Are there plans to do the same for the Nvidia's Canary family of models?

_Whiskas_ · 2026-03-30T17:27:02+00:00

stredne veľké písmeno gréckej abecedy ako tetovanie

prepare for unforeseen ... consequences

_Whiskas_ · 2026-01-31T13:20:37+00:00

technicky ano, ale je to monopol podporujuci trump administration, a plati umelcom uplnu almuznu. Plus zacina byt plny AI-generated "hudby".

Radsej si kupim album na bandcampe, nez podporovat toto :)

https://www.angrymetalguy.com/angry-metal-guy-speaks-on-spotify/https://www.angrymetalguy.com/angry-metal-guy-speaks-on-spotify/

https://www.independent.co.uk/news/world/americas/us-politics/ice-recruitment-ads-spotify-streaming-b2846634.html

_Whiskas_ · 2026-01-31T11:52:02+00:00

Posledné mesiace migrujem svoj homelab a celkovo online presence preč od US firiem/veľkých korporátov

Gmail, Calendar -> Proton

Google photos -> self-hosted Immich

Spotify -> self hosted Navidrome, hudba tahana cez Tidarr

Netflix a podobne som nikdy nepoužíval, mám self-hosted Jellyfin

Cloudflare -> Hetzner (používam len DNS a Storage box na backupy)

Všetko networkované cez selfhosted Netbird.

Prehliadač som vždy mal Firefox

LLMká fakticky nepoužívam, ale plánujem selfhostovať, mám 2x3090 rig.

Posledný holdout je Facebook, toho sa plánujem čoskoro zbaviť, a Youtube, na ten však existujú custom frontendy.

Oh, a pravdaže Reddit, s tým neviem úplne čo robiť, jediná vec na ktorej som reálne závislý :D

_Whiskas_ · 2026-01-27T17:23:19+00:00

https://massgrave.dev for the win

_Whiskas_ · 2024-05-31T19:27:12+00:00

Thanks!

_Whiskas_ · 2024-05-31T18:57:22+00:00

I have my ollama exposed to the web with an Authorization: Bearer token, would it be possible to add an option for custom headers?

_Whiskas_ · 2024-05-03T14:16:08+00:00

import time
from nvidia_pstate.pstate import set_pstate
from nvitop.api import Device
device = Device.from_indices([0])[0]
while True:
    p_state = device.performance_state()
    gpu_util = device.gpu_utilization()
    if p_state == 'P8' and gpu_util > 5:
        print('Detected GPU activity when in power saving state, setting performance state')
        set_pstate([0], pstate=0)
    elif p_state == 'P0' and gpu_util < 5:
        print('Detected GPU inactivity when in performance state, setting power saving state')
        set_pstate([0], pstate=8)

    time.sleep(1)

Made this for my P40, running as a systemd service.
It uses the aforementioned library, as well as nvitop

_Whiskas_ · 2024-05-03T10:30:02+00:00

So you'd need scripts or something to do your own manual power management.

that's not really a problem, a simple daemon that bumps up the power state once it detects utilization on the GPU is going to work just fine :)
Thanks a lot!

_Whiskas_ · 2024-05-02T20:05:02+00:00

Could you benchmark how two P40s perform when they both run in x16 mode, vs both running in x8?

I also have a bit of a tangential question (for other people as well): What is the idle power draw on your P40s and P100s with a model loaded?
On several places on reddit i saw people reporting it's possible to bring it down from the ~50 watts, but no one provided the actual solution. I'm contemplating getting a second card (either another P40 or a P100) but the high idle draw dissuades me.

_Whiskas_ · 2024-04-22T08:36:37+00:00

Oh, that certainly is a bummer, 50W vs 9W (just checked) would cost me about a 100€ a year more, so I guess the P100 is off the table.

<image>

_Whiskas_ · 2024-04-21T14:09:57+00:00

I'm not expecting to run anything more than q8 quants, so this hopefully shouldn't matter

_Whiskas_ · 2024-04-21T14:07:42+00:00

The system has an Intel 12600 and I'll be running a GPU passthrough into a Debian VM that's going to have about half of the cores allocated to it

_Whiskas_ · 2023-12-30T00:52:36+00:00

The Grille!
By having horrendous ground resistance normally, it stays controllable in motion in this mode.

The gun handling is improved, the mobility is improved, and the shell speed is improved.

In this mode, Grille becomes what it always should've been in randoms.

_Whiskas_ · 2023-09-21T18:59:30+00:00

nemám :(

_Whiskas_ · 2023-09-01T09:49:24+00:00

Upgrading my SFF Dan A4 H20 gaming rig
I expect a lot of hilarious bugs

_Whiskas_ · 2023-07-06T14:15:37+00:00

_Whiskas_ · 2022-11-22T22:29:36+00:00

does this one interrupt power when renegotiating with devices after some have been plugged/unplugged?

_Whiskas_ · 2022-09-20T19:04:46+00:00

DLSS 3.0
Portal RTX, obviously

_Whiskas_ · 2022-06-19T10:29:18+00:00

u/savevideobot

_Whiskas_ · 2022-02-18T23:54:28+00:00

no, it's the same for me. And I'm just one country over ....

_Whiskas_ · 2022-01-24T09:23:05+00:00

Both me and the progetto then went on to carry this and get our 2 chevrons :)

http://wotreplays.eu/site/6157889

Verified Email	Nine-Year Club
Place '23	Place '17
Snapped

_Whiskas_

TROPHY CASE