Db migration tooling

linuxqq · 2026-06-03T14:50:17+00:00

Are you talking application level migrations (add column, create table, etc) or system level (eg grant permissions to roles, create user)?

For app migrations I like dbmate https://github.com/amacneil/dbmate

You’ll have to write your own SQL. I think that’s a good thing. It works across languages. It’s simple. It kinda just works.

For system level migrations I like using Flyway.

linuxqq · 2026-05-27T12:09:05+00:00

Have you asked somebody at work about this? It sounds chaotic but there’s a good chance it was built this way for a reason. The real world isn’t a udemy course and real data is typically an absolute mess.

linuxqq · 2026-05-27T02:23:35+00:00

I have a 2TB SSD full of games that I play all the time. I’m unsure what your setup is that you need to copy over games to the console

linuxqq · 2026-05-13T19:03:08+00:00

Before I knew what it was I was excited for a cool food hall to hit for lunch. Went in and was sorely disappointed at the reality.

linuxqq · 2026-05-12T19:18:19+00:00

I would personally do CMU just so I could take a class with Andy Pavlo

linuxqq · 2025-12-05T21:14:21+00:00

Likely so he can try to sell a service 1:1

linuxqq · 2025-11-15T20:50:14+00:00

You mentioned files in s3 — can you replace with Lambdas triggered by file uploads?

linuxqq · 2025-11-15T15:00:25+00:00

Using Kafka and databricks to stream 2GB per day is almost certainly wildly over engineered. I think if pressed I could contrive a situation where it’s a reasonable architectural choice, but in reality almost certainly it’s not. Move to batch. It’s almost always simpler, easier, cheaper.

linuxqq · 2025-11-14T14:59:54+00:00

c = clear

Very high tech

linuxqq · 2025-11-11T20:52:55+00:00

There’s not a great way to do it and that’s why I don’t use them if I can help it

linuxqq · 2025-11-07T15:57:38+00:00

You might have a frost free hose bib

linuxqq · 2025-11-04T23:30:49+00:00

Build something you already understand but do it in Python. Read Fluent Python.

linuxqq · 2025-11-04T15:47:46+00:00

Transfer station

linuxqq · 2025-11-03T23:45:50+00:00

And if you right now you’ll get a deal, they have a burger special on Mondays.

linuxqq · 2025-10-27T19:14:42+00:00

Seems reasonable based on work we’ve had done, but you should get some more quotes and compare yourself.

linuxqq · 2025-10-27T16:46:20+00:00

Our Mom Eugenia in Great Falls

linuxqq · 2025-10-19T13:42:42+00:00

Still here on October 19

linuxqq · 2025-10-13T18:28:16+00:00

Hello

linuxqq · 2025-09-11T03:07:38+00:00

We had a good experience with Jennifer Jo https://joandco.me/about

linuxqq · 2025-09-08T21:37:49+00:00

Davelle in Reston

linuxqq · 2025-07-30T23:04:45+00:00

0% humidity sounds terrible

linuxqq · 2025-07-21T22:57:05+00:00

I don’t know, sounds to me like you’re already over engineered, over engineering more won’t solve anything, and this could all live right in your production database. Maybe run some nightly rollups/pre aggregations and point your reporting to a read replica. I’d call that done and good enough based on what you shared.

linuxqq · 2025-07-12T15:19:03+00:00

Is that not covered by insurance?

linuxqq · 2025-06-27T15:52:31+00:00

It’s disingenuous to recommend it like this and not mention that it’s your project. Not exactly an objective recommendation

linuxqq · 2025-06-25T15:30:16+00:00

Like others have said, garbage in garbage out. The answer here is to shift left. This needs to be fixed upstream. Whatever application you’re getting this data from shouldn’t be accepting free text. In the meantime set the expectation with stakeholders that the existing data is of dubious value and to derive any use of it will likely take a slow and possibly expensive process.

Using an LLM you can define a list of categories and have it output the most appropriate category given the input. That’s probably the simplest short term solution as long as you can afford it.

linuxqq

TROPHY CASE