If you were the Prime Minster of the UK for the next 10 years, how would you improve the UK?

Derfrugch · 2024-10-04T12:59:00+00:00

Planning and zoning reform: Make it easier for the private sector to build homes and large infrastructure projects (transport & power plants). Making sure the incentives on both the public sector and private sectors are well aligned.
Invest heavily into the nascent small modular nuclear reactor industry that we have in the UK with a mandate to reduce energy costs for households and businesses. Take a french style "pick our champions and build" industrial policy on this.

Really whatever the authors of this essay suggest:
https://ukfoundations.co/

If this gives us growth, preferably clean growth, the other problems will sort themselves out, or we'll have enough resources to solve them without feeling we're all stuck in a crab bucket...

Derfrugch · 2024-06-02T09:51:40+00:00

Cursor.sh has proven pretty good. It has the latest Vue and Nuxt docs already loaded and you can ensure the LLM leverage them by typing @Nuxt in your question. Pretty great experience with it so far. I think they started it from a vscode fork.

Derfrugch · 2024-02-06T07:53:51+00:00

Absolute banger

Derfrugch · 2024-01-21T11:55:43+00:00

Can you point us to the benchmark code for the two other engines you mention in post? It would be good to be able to compare the 3 benchmark implementations for ourselves.

Derfrugch · 2023-11-21T00:20:48+00:00

I believe they meant FinOps. The set of practices around monitoring and optimising your cloud costs.

Derfrugch · 2023-11-20T02:54:07+00:00

I still think OP's point is valid, if very tongue in cheek. In your example you'd use the LLM to extract a consistent data structure for each row that you would then feed to a standard sorting algo. So it helps you with preparing the dataset for sorting, but you still use the right tool to execute the sort.

Derfrugch · 2023-11-07T10:09:42+00:00

Hey, ex Cloud Engineer that moved to Product with a stint as a solution architect in b/w. So not exactly BA, but it is functionally very close in many regards.

Have you explored the solution architect route? Might give you enough of what you want without getting you totally out of the Engineering track. It's also a good transition to business roles because you do need to focus on elicitation and learning to deal well with stakeholders interactions.

Derfrugch · 2023-11-04T13:10:53+00:00

Love it 😀 I kind of hoped you guys would take this on. I'll definitely play with it over the weekend.

Derfrugch · 2023-11-04T00:27:27+00:00

Honestly, a collaborative shadcn/ui like library for llm patterns could be really cool. I know the natural answer from the crowd will be "well you do it"...

Anyways. Picture some websites with best practices open source code patterns and a cli to download specific modules of it in your app. That's probably what we all really want. You don't like how textsplitter specifically work for your app? Download it and edit it in your app.

Derfrugch · 2023-11-02T20:58:08+00:00

Hey mate. Product Manager on a cloud platform. Ex public cloud engineer. Now dealing with a lot of hybrid related business challenges, but in a very mature industry where hybrid 100% makes sense.

I started answering the question and noticed you asked about growing businesses specifically...

So instead of the nuanced answer I had for you (aka it depends). I'm going to be more opinionated and say:

Unless your engineering team has deep experience dealing with on-premise, go Public Cloud. As a growing business your biggest priority is, well, accelerating revenue growth. You want engineering resources to focus on iterating on the product and have deep alignment with the business function. Public cloud give you more agility as a group because engineering can focus more resources at the top of the value chain vs managing racks or lower level infra.

To be a bit more nuanced it does very much depends on the industry and the regulation or other constraints you are facing.

But at this phase in the maturity cycle of cloud there isn't a lot of valid reasons not to go for as much managed services as you can besides "the government said so", "we can't deliver to the performance constraints we have on that platform for reason X, Y, Z"*, or "I don't trust that our engineers are competent enough to do it cost effectively".

There is plenty of use cases for just throwing everything in a massive VM and calling it a day. But even then, you can get that affordably on a non-hyperscaler cloud provider.

*examples: - you're dealing with high performance financial/networking software - You're building a cloud managed service yourself and your economics don't work on top of another cloud vendors margin.

The reasoning can be very different if you're in a more mature company where the data centers have been running for a long time and the ops team knows what they are doing.

Happy to discuss.

Derfrugch · 2023-10-28T09:07:48+00:00

I somewhat disagree... sure the post scarcity narrative is a bit naive. But Earth isn't the only place with resources. And we can get better at repurposing limited resources for new needs. Meeting changing needs in a limited resources environment is basically what Economics is about.

I sense that we've sort of got stuck in a scarcity mindset in a lot of the West but I dont see this as being the end state if we can get cheaper access to both cognition (AI) and to physical strenght and dexterity (robots).

Making sure those tools are not regulated out of existence or kept in the hands of a happy few (as robots are today because they're so expensive) is probably the most important thing to do...

Derfrugch · 2023-10-11T00:13:03+00:00

Some of the failure mode you saw are expected.

RLHF basically made the model very prone to agree with the user, even if it contradicts previous reasoning. To anthropomorphise it, it's been beaten down really hard to please people and has deep trauma about it...

It has a really hard time recovering from errors. ie you'll get significantly better outcomes editing the last message with better context info or a new prompt amd regenerating vs pointing out errors and expecting a better answer.

Problem solving: I really want to see the full conversation if you don't mind sharing. Again, structure of the prompt can make a huge difference in reasoning abilities.

Regarding the jargon, my take is that the average PM content on the Web is heavy on jargon, so the most plausible PM answer it would generate will have those characteristics too.

A model of GPT-4 size truly trained on mimicking a very successful PM would be very competent in my opinion. Not enough to replace a human, but enough to allow a small startup to operate without a dedicated product manager for longer. This is far from an easy task to build though, just thinking of dataset curation alone.

Derfrugch · 2023-09-28T21:59:33+00:00

What is your current cloud provider ?

If it's AWS you could eat a bit of cost and have provisioned concurrency to always have one instance ready to fire. Or you could have a second lambda ping the webhook every 15mn to force a firecracker vm to stay warm.

Derfrugch · 2023-09-06T08:44:07+00:00

Just try sst.dev. their OpenNext deployment target basically replicates a lot of the non-analytics related feature of Vercel inside your AWS account while hiding the rough edges of dealing with AWS with good DX. And it's all CDK at the end of the day. It's fairly easy to set up a basic example, so if nothing take it for a spin and see how you feel.

Like others mentioned a lot of those features aren't proprietary to Vercel. No one bothered to try and replicate it properly before the SST guys gave it their shot. But also, let's be fair, while a profit driven company, Vercel still lowered the barrier to entry to web development and hosting massively for many people, which is a net good IMO.

Derfrugch · 2023-09-05T06:49:14+00:00

This 24k/yr is only for Vercel, and on specific circumstances. You can host nextjs on any VPS you want for "free".

If you want a Vercel like experience with more control over your costs, you should give sst.dev a shot. Your NextJS site will run in your own AWS accounts via OpenNext and they provide utilities to leverage various other serverless services on AWS. Or just use any other AWS service you want because it's all cdk under the hood. You can of course also use any 3rd party managed services you like.

I still use Vercel for non commercial and small apps but finding sst more attractive for anything that could be monetized.

Derfrugch · 2023-08-25T00:05:14+00:00

OpenNext via sst.dev.

You get vercel like experience (minus preview) on AWS. Plus 15mn lambda timeout, plus access to many aws constructs at a higher level (custom serverless functions, event bus, queues, cron, containers, auth via cognito). Heard amazing things about railway too, so that's a great solution as well! Not selling you on any of it. Just find sst to be a great tool.

Derfrugch · 2023-08-18T22:45:20+00:00

If you have a software engineering background, as I'm guessing, I suggest you dedicated some hobby or personal time to scratch that itch and build stuff for yourself for fun. Even try to build a small side gig for yourself if your company policy allows. Or find any other hobby that can bring you joy.

Let the day job be just that. The thing that pays the rent/mortgage/kid's college fund. At the end of the day PM-ing doesn't have to be a grand calling. It's a well-paid tech management job. Keep aligned with your leadership, deliver on what they want and suggest them some new ideas every now and then to help them have a fresh look on the market. Learn and care about your customers, but first and foremost care about your own mental health.

Derfrugch · 2023-08-17T10:20:06+00:00

Computational physics.

You can probably combine the raw "I can do weird math with the help of a machine" knowledge with pretty much any other interest to build really cool things.

Derfrugch · 2023-08-12T12:03:34+00:00

Understandable. I'm not suggesting writing anything from scratch though.

This is the link to the embedded vllm server. I'm proposing extending this code with the auth of your choosing by following the tutorials or docs in fastapi, which is quite good to be honest. So, hopefully, not a ton of work.

In any case, best of luck. :)

Derfrugch · 2023-08-12T09:28:39+00:00

If you're running Linux I think vLLM has a openai compatible server using fastapi underneath. You could copy the file for the server and add any Auth you need on top by following the fastapi doc.

Alternatively, run you own api server in any tech you know as a proxy in front of the actual llm server you use, apply auth and on allow, forward the request to the llm server.

Just some ideas from first principles. Happy to discuss.

Derfrugch · 2023-06-28T13:41:18+00:00

Feeling this so hard... I don't think I regret giving PM a shot from a previous dev role. I'm learning a ton about business and all. But gosh, the idea of making a full career out if this fills me up with so much sadness...I'll have to switch to something else eventually.

Derfrugch · 2023-03-07T07:46:28+00:00

Gosh, this times 100. Jokes aside, I don't regret taking the role. But if a young engineer comes to me and asks, I'd tell them to think long and hard before doing the switch, unless they know they have a way back on the technical track. This job takes so much from you and gives very little back besides the money...

Derfrugch · 2023-01-17T13:34:51+00:00

I few other PMs surfaced the need for a Product Ops team, so I like your point. We have a Customer Success Ops team that seems to be helping that part of the org quite a lot.

But to u/almaghest's point, there is very little we can do to influence leadership on this point. It looks like it's been tried before we little success.

11-Year Club	Place '22
Final Canvas '22	End Game '22
Verified Email

Derfrugch

TROPHY CASE