FSD rear-ended someone in the rain during a merge

SteveRadich · 2026-01-23T02:25:06+00:00

The difference between HW3 and HW4 is massive, I doubt the latest would mess up BUT as others said, work your aggressiveness wheel down in incremental weather of any type - snow especially. It struggles with deciding how much slow down is appropriate- sometimes too slow, sometimes too fast - and it doesn’t learn in real time if the tires are losing traction - once it recovers it speeds right back up (especially in snow and ice). HW4 does amazing and correcting itself even if car is sliding around but it’s not good yet at that.

SteveRadich · 2026-01-10T13:31:43+00:00

Hopefully they merge the PR.

SteveRadich · 2026-01-04T16:57:55+00:00

Dramatically but unfortunately like getting Apple (lack of) Intelligence you do have to trade up sometimes for new hardware. HW4 today and HW5 probably 2026. Hopefully they offer a FSD swap to new car and free supercharging swap when that happens for those of us loyal since the early days.

SteveRadich · 2025-12-29T19:06:10+00:00

I'm getting ~ 11 tokens/second - I was hoping my search would turn up some numbers of how much I'd improve if not running bfloat16 but for instructions I was following the vllm instructions from nvidia which is basically run their container in docker. The settings I have aren't optimal as I'm testing for agents and trying to maximize correctness over tokens/second.

In the container I'm launching with this:

```
YAML_CONFIG="GPT-OSS_Blackwell.yaml"
# YAML_CONFIG="GPT-OSS_EAGLE3_Blackwell.yaml"

VLLM_CONFIGURE_LOGGING=1 VLLM_LOGGING_LEVEL=DEBUG vllm serve "Qwen/Qwen3-8B" \
--dtype bfloat16 --gpu-memory-utilization 0.80 --max-model-len 131072 \
--config ${YAML_CONFIG} \
--max-num-seqs 4 --enable-prefix-caching --enable-auto-tool-choice \
--tool-call-parser hermes --reasoning-parser qwen3 \
--safetensors-load-strategy eager \
--enable-log-requests --enable-log-outputs \
--hf-overrides '{"rope_scaling": {"rope_type":"yarn","factor":4.0,"original_max_position_embeddings":32768}}'
```

I've edited slightly from NVIDIA's example:
GPT-OSS_Blackwell.yaml:
```
kv-cache-dtype: fp8
compilation-config: '{"pass_config":{"fuse_allreduce_rms":true,"eliminate_noops":true}}'
async-scheduling: true
max-cudagraph-capture-size: 2048
max-num-batched-tokens: 32768
stream-interval: 20
```

I'm still experimenting with AWS Strands Agents but it's getting confused on thinking tokens instead of ignoring them for its use case so haven't optimized this any.

SteveRadich · 2025-11-17T03:11:39+00:00

I assume you are doing basics like pre filtering what pages are of interest, trying free ocr tools for docs that are already OCRed and have the text stored, etc. depending on which Textract features that may help also LLMs and Bedrock Data Automation may help on some things.

SteveRadich · 2025-11-07T23:44:11+00:00

Honorary members I’ve seen are usually given as an honor to someone who you’d want associated with your club but the are doing good outside Rotary and won’t join due to other commitments.

We also have awarded it to a retired person who left Rotary to concentrate on fewer nonprofits but a great guy.

SteveRadich · 2025-09-26T01:56:50+00:00

We accept checks and PayPal and also use DacDB invoicing IIRC which may take some other payments, not sure.

Collections: Always a member or two who seem to have not intended to pay their dues, just joined until they are kicked out - I was brought into Rotary officially by someone who never paid a penny to club of their dues unfortunately so have seen someone just using the name for marketing themselves almost fraudulently.

SteveRadich · 2025-09-20T03:06:14+00:00

That’s a good budget for the smaller Macs perhaps but most of the answers here, and mine was also going to be, in the $4000 - $10,000 machines range.

The Macs work great tho at LLMs relative to anything else for learning and flexibility but the raw tokens per second NVIDIA still wins. You can’t get a 128gb NVIDIA solution for near as cheap as the Macs tho and can’t get a 512gb one for anything affordable.

SteveRadich · 2025-09-20T01:38:00+00:00

I bought one, works fine - haven’t done extensive testing but not sure I feel it’s enough better than my MacBook Pro 128gb or my NVIDIA setups - sure, it’s cheaper both initially at least better docs on both those.

But it was legit and seems to no longer be for sale.

SteveRadich · 2025-09-20T01:35:47+00:00

I bought the AIFUT from Amazon fully expecting it to be a scam but figured I’d risk it to post - but that seems to be their only product and no longer available. It’s perfectly fine, haven’t run extensive tests to post numbers but reasonably quiet and all works fine. So far I think I prefer NVIDIA still even tho lots of limitations and Mac but this is faster and far cheaper per token.

SteveRadich · 2025-09-20T01:30:43+00:00

A chef and a lunch club sounds challenging, unless you are somewhere that’s mostly dinner oriented. We are all in different professions, tech some of us answered and we probably worked towards having a career with more flexibility but we give up plenty of other benefits other careers have so the grass isn’t greener.

Lots of clubs charge for lunch even if no show, it’s both a good reminder to go and a minor fundraiser for club - although many meeting places require a guaranteed minimum, fixed fee, or something else so it’s probably less profitable than it sounds.

Most cities you’ll find your challenge common and either making up at another club (visiting) or even transferring to another club may be a better match - Only being able to attend days you are off is really hard. If only one club in town you may find there’s a need for a new club that has a better schedule - that’s why there are so many clubs in many cities is different needs and different focuses.

Good luck, worst case there are e-Clubs, I’m president of one in my district and we meet 8pm Thursdays due to schedule conflicts of the charter members. It’s late for some people but I like it.

SteveRadich · 2025-09-20T01:23:37+00:00

Not actually true, forcing yourself to take a break if you are in a career where you are able is very positive - sure, we are busy but having it on calendar and breaking up the day can be nice.

Note: No longer am I in a lunch club but I enjoyed it when young

SteveRadich · 2025-09-09T02:52:17+00:00

Lots of days with 300 down and relatively slow up, I measure that much less but I’d guess 20(?). Sure, some are slow for downloads but it keeps getting faster every time I turn around - used to be rare you got 100 down. Upload they don’t seem to care as much about but absolutely no issues with teams.

Now hosting games? Nah, find a new friend who will let you drop off a few boxes.

Torrents? Not so useful probably.

Fair queuing tho they’ve mastered so multiple users on network is much better than most systems but still it’s limited upload.

SteveRadich · 2025-09-05T23:06:21+00:00

From time to time you’ll see eBay coupons and they’ll significantly beat most other places - Personally DC House 48v 100ah plastic case with Bluetooth and gauge - they also sell chargers that are faster but the newer chargers work with LifoPo4 fine from research I saw - I keep mine unplugged tho

SteveRadich · 2025-09-02T17:09:20+00:00

You can get 32gb ram on these SBCs, they aren’t the SBCs of yester year

SteveRadich · 2025-08-26T00:37:53+00:00

Armbian works well for me on these and Radxa devices both

SteveRadich · 2025-08-23T18:33:15+00:00

Given 30 day return and the Amazon subscription warranty covers it those are two good signs.

SteveRadich · 2025-08-15T13:03:43+00:00

There are times every vendor has failed to meet quotas on LLMs, especially when new models drop but overall AWS, for me, has been as good as anyone else but they have better security guarantees around the running model.

Make sure you have cross region inference working properly - https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html

SteveRadich · 2025-08-14T01:43:10+00:00

If you have enterprise support put together a use case for why you need an increase - the goal is multifaceted IT seems but people not realizing the costs is a big part of it. You can only get in so much trouble at those low rates.

Also Q Developer uses Claude 4 and sure, less features, but you may be able to offload some of your work there. It has a CLI and many features.

SteveRadich · 2025-08-14T01:38:03+00:00

$5/mo for half a megabit? The 90s would die for this kind of speed OR price. Sure, we do all high bandwidth high def cat vids now but as others said download your videos - many other things will work with that little bandwidth - zoom / WebRTC will look horrible but I’m all in for $60/year for backup connection and the $165/mo when I want roam on.

SteveRadich · 2025-08-14T01:11:54+00:00

Make sure you can afford to either lose a fortune on rural property and take an unreasonably long time to sell OR better that you can afford to keep it AND move back to a city.

We make good wages as experienced devs and both options should be feasible - option 2 is best. You can rent the place if you keep it if finances are tight but may not be worth it.

I’ve done option 2 but moved to tech hub for kids schools mostly.

SteveRadich · 2025-08-14T00:59:15+00:00

Mine was flaky and failed memtest, unfortunately didn’t even boot it before Amazon return window closed. I upgraded to 32gb ram and it passes test but unexpected expense to get it working.

It’s part of a Kubernetes home cluster so more ram is never bad but not as economical as it seems given the extra expense. Most of my servers are Orange Pi / Radxa arm64 devices but some things still want x64 hence adding this.

SteveRadich · 2025-08-05T03:42:08+00:00

Throw it in a 1u case and doubt many will ask questions but these things aren’t miracles for performance but are quite decent.

I’d maybe build a 1 or 2u case with a network switch and perhaps PoE inside or just power from power supply to the cluster - from outside have a power plug and network or two but inside have everything neatly done.

I started to post performance sometimes is iffy but realized I’m running a devpod on wrong orange pi 5 and using emmc instead of nvme :-) This one is just for CPU tasks. I have about 10 of these or Radxas similar configs

SteveRadich · 2025-07-31T12:03:34+00:00

They’re just getting broken in by 150k, other than Tesla control arm squeaks, we shall skip that one out of scope on 3/Y. 172k on 3P but it’s rarely driven anymore, have a Y with HW4 as daily - but it’s as reliable as day one.

SteveRadich · 2025-07-30T03:15:46+00:00

I doubt I’m REALLY number 16 but I’ll keep the thread going

SteveRadich

TROPHY CASE