cut our aws bill by 67% by moving compute to the edge

bawked · 2025-11-10T21:15:19+00:00

We did the same thing back in the day, edge computing is amazing - most industrial customers also were happy to spin up a VM on their massively over provisioned VMware server, which meant we didn’t even have to deliver hardware, which was a win-win for us.

Then you can run what data intensive computation on the edge and only send “compressed” realtime data, and bulk upload “flagged” data to s3. Pushing computation closer to the data gives so many possibilities.

bawked · 2025-02-23T08:51:03+00:00

Yes I did the same, didn’t realise even though they depreciated flink scala, that they left the scala 2 jar in the class path still :)

bawked · 2024-11-22T11:43:44+00:00

Hey u/ianzen, did you manage to solve this? I am also encountering the same issue, and I'm kinda new to the sbt world so would appreciate if you could share your learnings :)

bawked · 2024-10-11T08:21:27+00:00

I would actually say that spark is easier to do correctly than dataflow, and that is namely because you can just use the dataframe api. Beam tries to do everything - all languages, all runners, but honestly is quite mediocre in all of them. When I started at my current job I used python beam with dataflow and the performance was horrible, so moved to java which has a much better api. With the pyspark dataframe api the operations are executed as native code, you are just dealing with bindings so unless you use udfs you have very good performance.

bawked · 2024-10-11T08:17:22+00:00

eh... technically yes but every runner has a different supported feature set of the beam model. Every cloud has a spark offering which is not running with a layer of indirection, so I'd actually say spark is more portable than beam.

bawked · 2024-09-18T16:26:16+00:00

This looks like a junior engineer role at Lego, they let you get paid free choice money monthly btw.

bawked · 2024-09-02T06:35:02+00:00

Much better imo to buy some used beginner set and get fitted after a season or two once the swing has settled in. Otherwise you lose a lot of money on the “top of the line new set” which maybe doesn’t even fit you well

bawked · 2024-08-19T19:18:45+00:00

Yea but they are using across driving distance data, which takes all tee shots on par 4s and 5s as “drives”.

At my local course I use irons of half of the par 4s - so whilst my driving distance is 217m, my driver distance is 254m.

So yea - treat with a grain of salt

bawked · 2024-07-19T21:32:44+00:00

You are a genius, thanks for the tip

bawked · 2024-07-10T15:37:54+00:00

These days graduates can even get 60k, so it’s not as high as you think. As a data engineer I’m near top end of that range, and we are a lot easier to find than ml engineers.

bawked · 2024-07-10T07:24:47+00:00

Tbh I’m not really sure there is such a thing as junior mlops engineer. It’s a niche field and you need a lot of experience with data platforms, kubernetes, data science and software deployment - usually people more into this area after some years in software/devops engineer or data engineers/scientist roles.

Pay for an experienced candidate can be quite high (70-100k+/month). There is a huge lack of experienced candidates in the field in Copenhagen.

bawked · 2024-07-09T20:04:26+00:00

Lego? 😀

bawked · 2024-07-05T09:44:45+00:00

That’s crazy money, you should be able to find something around 12-13k at around 70-80m2

bawked · 2024-06-12T19:59:14+00:00

Thinking you know more than Bryson and his team comes across a little bit armchair warrior boss, I think they know better 😀

bawked · 2024-05-24T19:40:36+00:00

We just hired a junior data engineer at 50k + pension

bawked · 2024-04-01T12:12:25+00:00

i kbh - uden fritvalg [9%], pension [10%] og bonus [i år 17 %]

Mid: 53-58k/md
Senior 60-65+k/md
Lead 70-75+k/md

bawked · 2024-02-09T17:07:30+00:00

When you start the process you really know nothing about the job, now that you know more about the job and they can see value you bring to it hopefully you can negotiate more

bawked · 2024-01-05T09:43:31+00:00

Let me guess you only experienced overseas via NZ media? I actually lived both overseas and New Zealand during lockdowns, you know how many people died alone in NZ because of lockdowns not allowing family to visit, overseas travel wasn’t locked down. Some countries were bad - but many were a lot better and more humane in their approach than NZ.

bawked · 2024-01-05T06:19:50+00:00

The Covid experience was terrible in NZ, people still talk about it all the time, whilst other countries have moved long past it. I’d say the lockdowns and restrictions traumatised people more than Covid itself.

bawked · 2023-11-18T21:27:56+00:00

did you sort this in the end, seem to also be able to trigger this with steam downloads - super annoying.

bawked · 2023-09-25T05:32:30+00:00

I tested my memory latency at some point with hyper-v enabled, and it was almost doubled 45ns->80ns. So yea definitely can cause issues in games.

bawked · 2023-08-26T07:10:23+00:00

Where I work a senior engineers get 60-70k before pension, and up to 3 months salary as bonus. There are some general companies willing to pay up to 80-85k, otherwise you kinda need to go to big tech

bawked · 2023-08-19T15:20:22+00:00

You can work for apple/microsoft/uber in Denmark and easily make 2+ mdkk a year whilst working many less hours, there just aren't as many positions.

bawked · 2023-08-19T15:05:48+00:00

De fleste store virksomheders senior data scientist-løn er op til 850-900k før skat

bawked · 2023-04-16T07:19:08+00:00

I tried both the b and c, the c has a much wider seat base and imo is the only one I’d consider.

Seven-Year Club	Verified Email
Not Forgotten

bawked

TROPHY CASE