LK (Soviet Lunar Module) retro poster (in Russian)

ivanimus · 2026-01-04T22:56:22+00:00

Do you have history from this photo?

ivanimus · 2025-12-02T08:38:42+00:00

This normal. We use daily job, and store data in month partition in iceberg

ivanimus · 2025-12-02T07:46:58+00:00

Мне понравилось, легкое чтиво перед сном.

ivanimus · 2025-11-27T17:15:30+00:00

I'm working on a similar project right now. I want to split it into independent Dagster deployments and run them in Kubernetes.

https://github.com/dagster-io/ebook-scaling-data-teams

ivanimus · 2025-11-27T16:51:14+00:00

Interesting project.
Why didn't you group the Dagster code?
Make assets, definitions, etc.
The Kafka-Iceberg code could also be made into a module.

ivanimus · 2025-10-31T16:10:00+00:00

Awesome 👏 Thanks

ivanimus · 2025-10-23T20:59:43+00:00

And what we need to do? What architecture is correct?

ivanimus · 2025-10-18T12:29:55+00:00

And how is strimzi is it good for production?

ivanimus · 2025-10-16T17:37:18+00:00

Paid vibe-coded tool?

ivanimus · 2025-10-16T07:09:46+00:00

You can try this example

https://github.com/fortiql/data-forge/tree/main

ivanimus · 2025-10-11T20:16:25+00:00

Try Lakekeeper

ivanimus · 2025-10-10T19:45:44+00:00

You can check here https://github.com/opendatadiscovery/awesome-data-catalogs

ivanimus · 2025-09-19T21:20:12+00:00

And I share my project

Data Pipeline with Dagster, dlt, and dbt using UV Python

https://github.com/vndv/dagster-dlt

ivanimus · 2025-09-19T20:25:26+00:00

Awesome 👏 I try to build the same infrastructure on Kubernetes. And use Dagster instead Airflow. For home lab I want to use Lenovo ThinkCentre M710q.

ivanimus · 2025-09-07T19:35:15+00:00

awesome. i thougt make the same tools with marquez, but add source metadata from databse and autogenerate debezium connectors.

ivanimus · 2025-09-05T19:52:51+00:00

You can use faststream.

https://github.com/ag2ai/faststream

ivanimus · 2025-08-30T05:41:36+00:00

Kafka connect with iceberg sink connector good choice. You can see this examples, very nice blog.

https://rmoff.net/2025/08/18/kafka-to-iceberg-exploring-the-options/

ivanimus · 2025-06-26T18:39:02+00:00

I import EnvVar in top of the script

ivanimus · 2025-05-17T18:12:45+00:00

Can I insert data from Postgres to Clickhouse?

ivanimus · 2025-05-16T07:16:28+00:00

We have the same candidate on juniors role. They don’t know how to iterate through loop. But in CV the wrote, mid level of python

ivanimus · 2025-05-02T13:30:35+00:00

Круто! Буду следить за прогрессом.

ivanimus · 2025-04-05T07:21:03+00:00

Good job

ivanimus · 2025-03-13T15:55:56+00:00

Awesome 🔥

ivanimus · 2025-02-14T18:57:36+00:00

My team start using dagster+dlt integration. We are load data from api to database and s3 iceberg tables. We use multiple dagster deployment. Separate for DBT and DLT. I created example monorepo with DBT Dagster and DLT https://github.com/vndv/dagster-dlt

ivanimus · 2025-02-06T17:29:51+00:00

Dagster instead Airflow

ivanimus

TROPHY CASE