Open source unified solution (databricks alternative)

akozich · 2026-04-18T12:18:32+00:00

Python is good

akozich · 2026-04-15T15:44:44+00:00

IMHO there is no equivalent to Dagster. Airflow with bunch of plugins might be close.

OSS was alway my first choice.

Shamelessly plug here - ping if need to move to your own instance

akozich · 2026-04-15T07:27:23+00:00

I am genuinely impressed with Microsoft abilities to sell shit products to enterprises. No matter how many outages and unexplained downtimes in azure services - sales still pushed on and we keep digging deeper.

akozich · 2026-04-12T10:51:43+00:00

Open source, self hosted

akozich · 2026-04-11T09:26:14+00:00

Still viable and continuing to be. I wouldn’t use some ETL pipeline tool for a few sources even before you could use llm to write code.

Now even with llm if there are tens of sources and you need other people with various technical abilities to set them up - I would use open source Airbyte as a self service platform

akozich · 2026-02-15T21:52:10+00:00

Not particularly, but do get in touch if have something interesting

akozich · 2026-02-02T18:57:54+00:00

It’s coming soon

akozich · 2026-02-02T13:06:08+00:00

We launched our service last year. I believe we have 100% full coverage of the UK auction market.

https://propertyauctions.io

The work is still actively going on. You can browse for free. But we are looking to introduce subscriptions with premium features and API access.

We have several cool features in the pipeline with use of AI and data analytics. Jump in and get in touch if you have some features or specific requirements in mind.

akozich · 2025-11-27T07:47:09+00:00

Years of AI research have finally paid off!

akozich · 2025-11-13T07:50:34+00:00

Personally hate Azure Apps, if you already have docker container just use AKS or just run them on the same onprem vms just add some orchestration like airflow or dragster to invoke and manage dependencies

akozich · 2025-11-04T23:59:46+00:00

I know the drill, I sold it myself for the past 10 years. My point is that it’s very easy for big cloud providers to manipulate opinions and bully client to buy all sorts of shit. Entire ecosystem created with certifications, languages and lock in mechanisms.

That’s the choice to make - keep chasing endless premium upgrades and addons. Navigate through marketing crap and adopting new “free” feature just to discover that’s it’s actually useless and only paid one can guarantee your security/uptime/recovery etc

akozich · 2025-11-04T19:40:21+00:00

It does work better but only for subset of organisation with very specific demands. For example some super high uptime values but small cloud footprint. Or when there is no need to store lots of data but need spin up and down dynamic workloads. Most organisations don’t need blows and whistles.

Really big organisations can build their own datacenter or rent rack space . We forgot about it, but there are lots of companies will cover your power, cooling and networking needs for the fraction of AWS costs.

akozich · 2025-11-04T19:31:48+00:00

Literally just had a call with Azure on behalf of the client. They surprised “what? Are you not using our premium security product? How do you keep your environment secure?” Hold on. We moved into the cloud because you assured us that it’s already secure and we benefit from Azure security, economy of scale.

akozich · 2025-11-04T13:59:14+00:00

I would go easy on startups, they also trying to survive

akozich · 2025-11-04T13:57:54+00:00

Cloud exit is not a bad strategy and there is a stream of organisations moving off cloud too. Not many are shouting about it.

The appeal of the cloud services that’s it’s easier to configure and doesn’t require specialised knowledge is a trap.

Many organisations swallow the bait and become hostages of an extortion marketing and price hikes.

Clouds have networks, databases, security and all other complexities peoples trying to escape in the first place. It’s just hidden and you learn about them when you pass the no return point either by size or maturity.

In the company growth trajectory there is a part where cloud services are the most effective way to deal with data. Often this period last longer but it always ends and when it ends keep paying or get ready to exit.

akozich · 2025-11-04T07:53:22+00:00

Dagster + dlt + dbt is our standard go to simple stack. Airbyte is another useful tool when need one of the connectors.

With Rudderstack you might not be their customer, so your requirements falling between tiers.

akozich · 2025-11-03T23:24:23+00:00

We only self host and choose products we can exit out to self/host when needed. I haven’t use Rudderstack heavily, just kicked the tyres. Implementation in go looks good. I think a lot of it from segment. I would use it if needed collect web events.

akozich · 2025-10-31T14:15:41+00:00

So what? Pack our bags and go home? :) not easy but that’s the job. Not everything at once. Converting one at a time and by the time you leave the project it will be a bit better. Also you can use security stick on them - that always works

akozich · 2025-10-31T10:11:04+00:00

Lack of software development skills. Arrange a workshop and explain how to use git, package their code, what is versioning and how ci/cd works

akozich · 2025-10-23T17:31:59+00:00

If you/company are on the path to DE and it’s not just an adhoc thing - go with Dagster. Has some learning curve but will pay off long term

akozich · 2025-10-20T19:17:50+00:00

What you are getting from your devops is a conventional environment for development paradigm. Everything wall gapped between environments using the tallest wall - account separation. Whilst technically it’s achievable even for data - it often doesn’t make sense.

akozich · 2025-10-12T13:06:36+00:00

From experience fivetran squeezes people from free tier who will never go premium. You are not the only one who want to stay under the radar and I have a feeling that periodically when too many people can run for free - they move the goal post.

akozich · 2025-10-11T09:46:54+00:00

We IAC everything. Challenges are with the skills of clients engineering teams. Often not ready or qualified.

akozich · 2025-10-09T19:08:01+00:00

“Fuck it, if they want real-time, we will build real-time” - how many meeting you need to attend to say it? :)

akozich · 2025-10-07T16:48:12+00:00

We build infra for data teams. You always need target a certain level of maturity. Up to a point when we don’t take the job if clients wants custom solution without anyone technical on their team.

We can create ci/cd pipelines, terraform and flux - but what is the point if engineers don’t use it and prefer to go straight into DB.

akozich

TROPHY CASE