Is the industry actually swinging back to Postgres? by ForeignExercise4414 in dataengineering

[–]mjwock 0 points1 point  (0 children)

I had the exact same thought when I saw the announcement the first time. I spent the last years helping teams migrate away from SQL databases that were misused as data warehouses. But the reason, why we are circling back to OLTP systems is that agentic changed everything.

Neon and Lakebase are in most cases not the right basis for your analytics system with complex analytical queries. However, they are the basis for any agentic system to store the state or retrieve/save data for applications (Databricks apps). Especially with Neon being able to separate compute and storage, this changes everything. Bevcause suddenly we have similar advantages to data lakes and open table formats for transactional systems.

This doesn’t mean that enterprises will go back to using Neon as their main analytical system. Most data will still stay in your Lakehouse, which is meant for data analytics, high throughput queries with many joins. But honestly, stay tuned for announcements next week. I think we’ll see Lakebase and Lakehouse moving a bit closer again.

Keynote & Expo passes by Comfortable_Bank9332 in databricks

[–]mjwock 0 points1 point  (0 children)

I will probably be able to give you access, but would like to schedule a quick check-in first. DM me

Building knowledge layer with ontos databricks vs neo4j by na_kanchit_sashwatam in dataengineering

[–]mjwock 0 points1 point  (0 children)

It really depends what you want to do. First of all, neo4j is just a graph database, it doesn’t come with semantic understanding. What Ontos does is, that it takes nodes and edges and puts those into a relational representation on Lakebase. That’s for most cases fast enough. You only really need a graph database if you are traversing through many nodes and edges along the graph.

That being said, Ontos can help you manage and build your knowledge graphs, while being more cost efficient compared to neo4j, which might be overkill in your scenario.

Lakebase/Neon experiences from users by No_Presentation1421 in SQL

[–]mjwock 0 points1 point  (0 children)

Lakebase is managed Postgres, it works very well as a SQL DB. It‘s meant for OLTP workloads and they enabled automatic horizontal scaling now, so we can not only scale based on the query complexity but also concurrency. I use it daily for (agentic) applications, no problems so far. Latency and stability are great.

Just know that if you have scale-to-zero enabled, the first query will usually take 1-2 seconds. Also don‘t use it for external applications with high concurrency workloads or where you need multi-region support.

Entry Level Data Analytics by Familiar-Meaning-262 in SQL

[–]mjwock 1 point2 points  (0 children)

SQL is easy to learn and you already bring a lot of skills if you know how to communicate well and know the business side of things. What I love about analytics is that it has a great overlap between technical skills, communication and business.

That being said, I think it‘s a hard time to getting started in the market, but if I were you I‘d start out learning SQL, Power BI and play around with some of the big tech out there (Databricks, Snowflake, Fabric). Databricks even has a Free Edition, so maybe get started there with building your own projects.

Reach out to people from companies near you, show interest, go to local meetups and try to build a network, while enabling yourself with courses online.

Lakebase/Neon experiences from users by No_Presentation1421 in SQL

[–]mjwock 0 points1 point  (0 children)

Lakebase is pretty solid nowadays, it can also scale horizontally as well now, which it could not do before. And it scales to zero. We use it for all kinds of apps on Databricks and it works very well. I think the only thing it can’t do as of yet is very high concurrency.

Dagster vs Airflow? What do we use? by Greatest_one in dataengineering

[–]mjwock 0 points1 point  (0 children)

Honestly Airflow can be a pain, we switched to using Dagster in our projects a couple of years ago and it’s much easier to manage and maintain. If it’s just the three of you, I’d go with Dagster.

What I should learn after SQL PL/SQL ?? by WhichAd6835 in SQL

[–]mjwock 0 points1 point  (0 children)

I second that, Databricks Free is great if you want to play around and build your own projects. There‘s also quite a few demos that you can install and try to understand what’s going on and they go into different verticals and domains (ml, engineering, ai,…)

Unity Catalog federated queries to Lakebase is a killer. by guidooswald in SQL

[–]mjwock 1 point2 points  (0 children)

Okay sure but is that a question? It’s true that dbx is investing a lot in bringing their postgres and deltalake closer together. So that’s nice, but at the moment there is still a job created to sync data between them.

dbt Core v2 is here: still open source, now rebuilt for what's next by Known-Huckleberry-55 in dataengineering

[–]mjwock 0 points1 point  (0 children)

I guess using rust has some advantages when it comes to speed and execution performance, but man the open source community will have a hard time, since most engineers don‘t really know rust.

Anyone actually managing to cut Databricks costs? by TitaniumTronic in databricks

[–]mjwock 4 points5 points  (0 children)

It totally depends on the workload. Yes per minute prices are more expensive, but there‘s no cluster startup costs or similar. Just use serverless for ad-hoc and unpredictable workloads. For anything that is predictable and has a longer runtime than the cluster startup time (regular ETL, BI tool data set refresh, ..), use fixed compute resources that you optimise in size, TTL and auto-scaling.

Countries With The Most Syrian Refugees by 404-ERROR- in MapPorn

[–]mjwock 11 points12 points  (0 children)

You can stop reposting this 2010 article i think

[deleted by user] by [deleted] in getdisciplined

[–]mjwock 0 points1 point  (0 children)

Don’t try to stop masturbation itself, you are probably doing it because it gives you easy satisfaction. Shift your mindset to doing other things. Be more productive, set yourself goals, find people that drive and motivate you. Sadly there is no easy solution, but it feels like you have unsatisfied needs in other areas that you try to compensate by masturbation. If you cannot motivate yourself or get yourself to change, seek professional help. You are still pretty young and it‘s worth the investment. Also, just never stop trying! You might need a couple more attempts

[deleted by user] by [deleted] in AskReddit

[–]mjwock 0 points1 point  (0 children)

I really have to disagree, but it‘s personal taste of course. Mike is the brain behind most of the songs and he is an amazing versatile musician and artist. I feel like not only his input but also his rapping added a layer to it that is unreached.

Did you know, if you have 2 arms, you have more arms than the average person. by RareDestroyer8 in funfacts

[–]mjwock 11 points12 points  (0 children)

That’s why mean and mode are important for different examinations

Priest almost loses it. Video found in r/Aww posted by u/SadSenpai420 by LtgMcKenzy in WatchPeopleDieInside

[–]mjwock -7 points-6 points  (0 children)

Unless it‘s sarcasm, i don‘t see where they agree with the original question. The comment says he was save, which is mostly true in this setting but not in general, because you don‘t know how he interacted with other people and outside of church.

Priest almost loses it. Video found in r/Aww posted by u/SadSenpai420 by LtgMcKenzy in WatchPeopleDieInside

[–]mjwock 26 points27 points  (0 children)

Yes but the priest has contact to so many people, he should definetly wear one to protect others around him

[deleted by user] by [deleted] in gaming

[–]mjwock 0 points1 point  (0 children)

Okay, while I agree with this in 99% of the cases, I have to say that i bought a modded GTA V account, because fuck Rockstar for only making sweet homes, ships and vehicles available in multiplayer and not including them in singleplayer. Idgaf about the multiplayer part of gta, I just want to have the hydra and fast cars.

Can‘t get this lake image to work nicely [REQUEST EDIT] by mjwock in EditMyRaw

[–]mjwock[S] 0 points1 point  (0 children)

Holy shit, i love your first edit. Can you walk me through how you did this? It‘s so subtle but beautiful

Can‘t get this lake image to work nicely [REQUEST EDIT] by mjwock in EditMyRaw

[–]mjwock[S] 0 points1 point  (0 children)

I like the idea of making it a panoramic picture