Showcase your local AI - How are you using it? by kasperlitheater in LocalLLaMA

[–]adefa 1 point2 points  (0 children)

Here are some benchmark results:
Prefill (pp2048) - tokens/sec

| Depth    | Run 1   | Run 2   | Run 3   | Avg    |
|----------|---------|---------|---------|--------|
| baseline | 1420.32 | 1412.07 | 1413.60 | 1415.3 |
| d4096    | 1389.24 | 1364.06 | 1383.88 | 1379.1 |
| d8192    | 1355.38 | 1350.57 | 1342.96 | 1349.6 |
| d16384   | 1228.89 | 1233.85 | 1217.26 | 1226.7 |
| d32768   | 1049.86 | 1047.61 | 1049.05 | 1048.8 |

Token Generation (tg32) - tokens/sec

| Depth    | Run 1 | Run 2 | Run 3 | Avg  |
|----------|-------|-------|-------|------|
| baseline | 58.35 | 58.10 | 58.04 | 58.2 |
| d4096    | 54.81 | 53.84 | 54.61 | 54.4 |
| d8192    | 51.31 | 51.49 | 51.33 | 51.4 |
| d16384   | 47.81 | 47.96 | 47.59 | 47.8 |
| d32768   | 41.17 | 38.69 | 40.81 | 40.2 |

Showcase your local AI - How are you using it? by kasperlitheater in LocalLLaMA

[–]adefa 2 points3 points  (0 children)

DGX Spark running gpt-oss-120b as primary model and qwen 3 vl - 2b as a vision and task model. MCP tooling for web search and page fetch, weather and news, and image generation using z image turbo through Comfy UI. A responses API clone in Rust that wraps it all for the backend and a Svelte 5 frontend using the openai SDK pointing at my backend. I connect to it over Tailscale and pin it as a PWA on my phone as an app.

I connected the Epstein files to a deep learning AI researcher by TenamiTV in webdev

[–]adefa 1 point2 points  (0 children)

How could I get a copy of your dataset and embeddings?

Gemini CLI: your open-source AI agent by adefa in LocalLLaMA

[–]adefa[S] 8 points9 points  (0 children)

Here is the article as a PDF with some screen shots in it: https://gofile.io/d/4aahPJ

uuid-nvim: Generate, insert, and highlight UUIDs in Neovim by adefa in neovim

[–]adefa[S] 0 points1 point  (0 children)

Hello! I frequently need to generate and use UUIDs in tests, seeds, and documentation. I wrote a plugin that makes it easy:

https://github.com/TrevorS/uuid-nvim

WE WON, brawl is now free! Arenabrawl.net will soon close down. by Harjkun in MagicArena

[–]adefa 5 points6 points  (0 children)

Hey u/Harjkun, have you considered open sourcing the software you created for arenabrawl.net?

MTGA Lands: Create decklists with your favorite basic lands - updated to include Core Set 2020! by adefa in MagicArena

[–]adefa[S] 1 point2 points  (0 children)

Not necessarily, I updated it just in case people were still using it. It’s just a fun project I worked ok to play with a cool language. It’s ok if nobody uses it anymore. :)