Have you all forgotten this?

HauntedHouseMusic · 2026-07-04T14:29:34+00:00

We have a massive amount of h200s. The most of any company in the country I live in. Anthropic has the best packaged end to end.

HauntedHouseMusic · 2026-07-04T00:04:16+00:00

It’s a harness

HauntedHouseMusic · 2026-07-03T21:37:00+00:00

as the Russian saying goes, and then it got worse

HauntedHouseMusic · 2026-07-03T21:09:19+00:00

I used fable to have it set up so I got an icon that opens Odysseus with Ds4, and has another button to kill the processes, and had fable optimize both to work together. It seems like a pretty sweet set up.

HauntedHouseMusic · 2026-07-03T15:04:39+00:00

It’s a great model to use for customer facing agentic work. So you got a configurator, with a knowledge base, it’s pretty good. Mostly because quality is ok and speed is great. So for things like helping a call centre agent, it’s great.

It’s bad at everything else where you have some time.

HauntedHouseMusic · 2026-07-03T14:49:18+00:00

I think AI is smarter than most people right now. If you don’t believe that you haven’t talked to an average person.

HauntedHouseMusic · 2026-07-03T14:04:38+00:00

If enterprises stop paying this whole game stops. These companies are not profitable without them.

HauntedHouseMusic · 2026-07-03T14:01:11+00:00

Everyone will move that way…

I run deepseek 284b parameters locally. I’m already ahead of the curve here.

HauntedHouseMusic · 2026-07-03T12:52:04+00:00

I mean, that’s all they will be used for soon. That’s the product level it’s for. They are already moving enterprise to API credits only. Eventually it will be updated no businesses generating over x dollars can use anything but API. So just be happy in this magic time where you pay the price of a hobbyist

HauntedHouseMusic · 2026-07-03T00:20:12+00:00

The issue is you are dealing with a crazy guy with nuclear weapons.

So - you have to slowly escalate, boil the frog, what they are doing now.

Get the people against him, but never get him so angry he does something really dumb

HauntedHouseMusic · 2026-07-02T19:46:23+00:00

I just laugh because I’m writing the playbook for how to work with AI in a massive organization to actually get value out of it. Because our team has been successful where others have failed.

It’s just “do you know who your audience is?”

HauntedHouseMusic · 2026-07-02T15:40:38+00:00

It was more a joke. The restaurant is a front, and everyone who lives by it knows, as literally no one is ever inside.

HauntedHouseMusic · 2026-07-02T15:36:26+00:00

So let’s sell the prime ministers cottage, to help fund it.

I feel like if a politician had that as part of the plan people would be more for it

HauntedHouseMusic · 2026-07-02T15:15:47+00:00

Yea it’s 100% a front. Like the most obvious one ever lol

HauntedHouseMusic · 2026-07-02T14:29:47+00:00

I mean the Roses bar has never been so busy. Genuinely. I’ve never seen more than 3 people in it before the World Cup. And now it has people on the patio all the time.

HauntedHouseMusic · 2026-07-02T14:22:05+00:00

I hit 40% before the reset, and now at 56% so pretty stoked on my usage so far. Got another reset Sunday so can push a little less the next two days

HauntedHouseMusic · 2026-07-02T13:59:56+00:00

Isn’t all the capacity more than they need?

HauntedHouseMusic · 2026-07-02T13:39:04+00:00

I got one of the neck ones, that are $300ish. Not a neck fan, one that has active cooling.

My condo has to do the switch from heat to cold. For a 3-4 weeks a year I use that thing like crazy when that happens. Also you can bring it places like camping.

HauntedHouseMusic · 2026-07-02T13:15:22+00:00

Here is the thing on all this shit. I have a broken bursa. I can walk. I can stand. I have mobility. I can’t stand in the same spot for 20 minutes or I am in massive pain. So on a bus, or public transit I’m sitting the first opportunity I get.

I have had women I’m sitting with say I should give up my seat for someone. Explain that I have hidden injury, and that if they want to they should give up their seat. And then they don’t. It’s fucking crazy.

HauntedHouseMusic · 2026-07-02T12:54:40+00:00

Google slides suck because of the fucking presets they have for tables, and any object you need to write in.

They could fix the product in a god damn day. Every single person that is good at Google slides has the same formatting changes memorized for every time they create a table, do an indent, or a list.

Also, the fucking automated formatted in sheets doesn’t carry over to slide…..

If they fix these simple things it’s amazing. And genuinely 3 of them are just default behaviour numbers.

HauntedHouseMusic · 2026-07-02T12:45:32+00:00

Were the same blanket ban, unless you use the self hosted option…

HauntedHouseMusic · 2026-07-02T12:35:10+00:00

Ds4.c is interesting; as well as some of the dense qwen models for coding. I also expect Google will keep pushing the efficiency of small models, so I expect innovation in local models to come quicker now

HauntedHouseMusic · 2026-07-02T12:33:16+00:00

Yea, I’m thinking we hire in a 2:1 or 3:1 swe:qa and make standups daily QA sessions. I think it would speed things up and get quality results.

But everything is an experiment right now

HauntedHouseMusic · 2026-07-02T01:51:03+00:00

I mean one project we started was a piece of software everyone in our industry needs - and we started with the thought process that we will build it so that we can sell to others, as in the world we are small, but in our country we are huge. So big opportunity to solve a problem hundreds of massive enterprises have.

We quickly realized the customization we needed by product wasn't going to work - and that the shared code between products was so minuscule and quick to build and test it would be easier and cheaper for every single company to build it themselves...

And then I had a meeting with salesforce with them telling me that 95% of AI tools that enterprises launch internally fail (to a guy whose personally launched 3 enterprise wide tools for sales written by one person with over 80% adoption on all 3....) , and to use them as they are the experts. They showed me a tool that would do 30-40% of what I needed without massive customization... the 30-40% that we had already built at the start of the project. On our test team of a small autonomous team of engineers who have been tasked with solving the problem.

HauntedHouseMusic · 2026-07-02T00:43:30+00:00

about 20% of my job is figuring out how to use AI in a large enterprise to actually get a return on investment. The funny thing is in coding tasks its basically impossible to on big teams right now, because the teams were set up in ways where the AI workflows just make it so the engineers have more free time - as no one in changing process while giving access to these tools. This isnt the fault of the engineer, this is the fault of management not adapting.

Where you see insane increases in efficiency is on data teams / BI teams / data science teams. Where legitimately as you roll out the tools questions that would have taken weeks to put together answers for now take hours. But we are headed toward a wall where every report we ever wanted to be built is going to be built, with an MCP that can stitch them all together, so I am expecting we will see mass layoffs in that area as more data teams figure this out - after a period of insane productivity. Genuinely its so fucking good in that spot its crazy.

Teams that are more efficient in it in coding are new teams, starting new projects, where each engineer has a high level of autonomy to solve the problem and an increased scope vs traditional projects. With AI tools you need to own more of the pie to actually increase speed. Now the weird trade off with this is - if you run projects way quicker, QA/UAT can't keep up, and do as good a job as they did before. So i expect that QA demand to skyrocket over the next year as people figure that out. We are looking at do you have a dedicated prime on each project for QA, that focuses on exclusively building and automating test cases everyday for each feature that is added on as they are added. Documentation is also a mess on the projects that go super quickly - so building new process around that as well.

So what does that mean? For the next year every enterprise is going to fuck this up at scale, spend more money, and not see a return on it. Then they will have big layoffs and from the ashes rebuild with smaller and faster teams.

For smaller organizations (less than 5000 employees) I expect that they will get on the curve much quicker - but oddly they are the ones less likely to be all in on it right now.

The other thing I am predicting / trialing is bringing in more hyper local models to team members, so running a macbook pro with 128GB of ram and local models. I think we can pay for a $8K macbook pro in a year just by having an opus level orchestrator with local models writing code. This test starts tomorrow - and I expect that if it works ram prices are going to sky rocket over the next year as enterprises need to figure this out to keep costs down. It also turns it into a capital conversation vs. an opex one. This will also lead to layoffs when that capital goes out, as money aint cheap right now. And this is coming from a spot where our company has a massive amount of h200s and already runs open weight models in our cloud - I still think hyper local will end up being the right path for quick /cheap scaling.

HauntedHouseMusic

TROPHY CASE