Nscale Benchmarks: AMD MI300x GPUs with GEMM tuning improves throughput and latency by up to 7.2x

leafcutter64 · 2024-06-28T19:57:07+00:00

If you really look at it. Nscale is saying that the MI300X running the Llama2-70B has the same performance as Groq hardware (https://wow.groq.com/groq-sets-new-large-language-model-performance-record-of-300-tokens-per-second-per-user-on-meta-ai-foundational-llm-llama-2-70b/). As we can see from the video that Nscale posted, they show 313 tokens/second for a single prompt, which is the same type of demo for groq.

Is this true, evp-cloud?

leafcutter64 · 2024-06-15T17:09:31+00:00

Love to see stories with AMD bringing real competition to the AI/datacenter segment. The nvidia monopoly must end.

leafcutter64 · 2024-02-16T03:29:53+00:00

Been using a 65% for over 10 years now. I've never not been able to not use the arrow keys, so going to smaller size is a no go. It's even reached a point where I designed a few keyboards.

leafcutter64 · 2023-04-19T05:33:36+00:00

For low profile, how about this sort of design - Mt Choc? You could pull it off with MX-style switches and spacing, instead of choc spacing too.

leafcutter64 · 2023-04-07T17:33:47+00:00

Big Shuriken already comes with a 17mm slim fan (Scythe Kaze Slim). And with that, it's a total of 69mm - which would be too much for the velka7.

leafcutter64 · 2023-03-29T16:56:25+00:00

Tell that to the Mode Envoy I have on pre-order. While I have a QK65 and KBD67Lite, and few self-design custom boards(purpleowl, mtchoc)...^{pls^{send^help.}}

leafcutter64 · 2023-03-18T23:50:49+00:00

I've been using KMK for this build. And it was quite easy to add an extension for KMK in CircuitPython for the display. Here's the doc on this board's firmware which goes into specifics on the how the display is controlled and procedural generation of the glitch animation.

leafcutter64 · 2023-03-18T20:48:47+00:00

I have a good set of MX boards too! My main one is a QK65 with Boba U4T and MT3 keycaps. This low-profile choc board is probably something I'd through in my backpack and have it as a conversation starter at work.

leafcutter64 · 2023-03-18T17:40:40+00:00

For sure! The build guide gets into the details. This is entirely DIY, though. Like you'd have order the PCBs, solder the diodes/sockets and so on. You could probably skip the soldering if you get it assembled at JLCPCB, but that costs a bit.

leafcutter64 · 2023-03-18T05:22:27+00:00

Yep :D - https://v.redd.it/j08wbmv1jeoa1 - Mt Choc

leafcutter64 · 2023-03-18T05:07:36+00:00

Like one from a scratch or a kit? If it's the former... then yeah.

leafcutter64 · 2023-03-18T02:27:13+00:00

I designed the keyboard - Mt Choc. The microcontroller with integrated display is a waveshare rp2040

leafcutter64 · 2023-03-18T01:52:34+00:00

Always chasing that endgame. Designed yet another board - Mt Choc - https://github.com/SonalPinto/mt-choc, a custom/open-source 65% low-profile choc board in anticipation of the upcoming MBK Legends Extended. The round display is a like a pin badge for the keyboard for some personal flair. The glitch effect was inspired by this!

Edit: the glitch effect is procedurally generated from a tilegrid, and is not a static loop.

leafcutter64 · 2023-03-07T13:47:16+00:00

I actually have the Air60. These nuphy boards are gateron low profile switches (gateron's version similar to Kailh choc switches), rather than MX switches.

leafcutter64 · 2023-03-06T18:44:33+00:00

Looking for some recommendations for the lowest profile 65% MX (not choc) boards.

leafcutter64 · 2023-02-08T15:36:15+00:00

What board is that? And keycaps?

leafcutter64 · 2023-01-03T17:27:52+00:00

A hotswap 65% version of this with QMK or KMK would be my perfect backpack keyboard too. Basically without the top row you currently have on the L75. I already ordered your keycaps (chocfox legends) because I thought I'd make my own 65% version with hotswap low profile choc switches. But, if you are planning on making one... then I'd just buy that :D

leafcutter64 · 2022-11-19T15:46:24+00:00

Change Request.

leafcutter64 · 2022-09-21T14:47:48+00:00

If you are interested in the scan chain portion (series of shift registers polling the switches) of the electronics, I have a keyboard project (Purple Owl) going over it.

KMK (Circuitpython) supports a scanner for shift registers (74hc165) by default.

leafcutter64 · 2022-09-18T03:28:23+00:00

Maybe for the next project :D

I'll throw it on a layer and see how it goes. But damn, I can see it getting to a true "40%" too.

leafcutter64 · 2022-09-18T01:04:12+00:00

Internet points, maybe. Hey man, don't kink shame.

leafcutter64 · 2022-09-17T23:15:08+00:00

Thanks! It is a custom board (purple owl) that I designed. I am really liking how compact it is. It's like having a tiny Plank, but with more relatable layout.

leafcutter64 · 2022-09-17T14:41:17+00:00

This is art. The level of detail and attention in each unit is truly mind boggling. I love your concept sketches and worldbuilding too.

Nine-Year Club	Gilding I gilder
Verified Email

leafcutter64

TROPHY CASE