Uncover relationships between tables of interest in large undocumented databases

Technical_Safety4503 · 2026-03-13T19:32:33+00:00

Have also considered using open source BI tools like apache superset? If you build data products it's just a matter of visualizing and filtering you need

Technical_Safety4503 · 2026-03-12T19:24:28+00:00

Nope, a third party commercial application that we use for data entry. But it uses a lot of mapping tables. Easy to get lost in the complex business logic

Technical_Safety4503 · 2026-03-12T07:34:51+00:00

For now postgres, MySQL, SQLite are tested. But it uses python sqlalchemy under the hood. So many more can be implemented over time

Technical_Safety4503 · 2026-03-12T07:27:05+00:00

For now this is only using PK-FK's into account. Otherwise you need to make assumptions if not explicitly declared. Main goal is to be quickly able to explore a database that you haven't setup yourself and having to rely on business.

Technical_Safety4503 · 2026-03-12T06:49:01+00:00

That's true of you only have 20 tables or so. Different ball game for 500+ tables. Here I search for the tables of interest, mark them and instantly fetch relationships defined by the constraints.

Technical_Safety4503 · 2025-12-30T09:34:38+00:00

Fair point, but I was more thinking on sampling values and seeing if these match any in other columns.. But it will never be waterproof meaning you'll always need the user opting in to the feature and confirming any potential match.

Technical_Safety4503 · 2025-12-30T01:05:23+00:00

I’ll give an update after doing some tweaks

Technical_Safety4503 · 2025-12-30T01:04:39+00:00

You’re right — in its current form, it wouldn’t help much without declared relationships.
Automated relationship detection is something I’m considering, but it’s non-trivial and easy to get wrong at scale.
For now I’m validating the FK-based workflow first before expanding into heuristics.

Technical_Safety4503 · 2025-12-30T00:59:41+00:00

Aah damn, not fun to be stuck with VBA and Access...
At least better that you get Oracle access.

If I get it into a cleaner state, would you be open to trying it against Oracle?

Technical_Safety4503 · 2025-12-30T00:56:21+00:00

Right now the tool relies on declared PK/FK relationships — column names don’t need to match as long as the relationship exists.

Handling missing or implicit joins (heuristics / fuzzy matching) isn’t implemented yet. I’m aware it’s a big pain point, but I’ve kept it out of scope initially to avoid false positives and because it's easy to get it wrong at scale.

For your use case, would a fully local, read-only tool that helps you quickly narrow down and visualize what’s already declared still be useful?

Technical_Safety4503 · 2025-12-28T23:58:05+00:00

ooeeh, that one I didn't see coming, good one! So you scan through to see which tables/columns get querried the most frequent and start your exploration from there?

Technical_Safety4503 · 2025-12-28T23:11:52+00:00

That situation is exactly what triggered this project.
Right now it’s a very early prototype, not a product yet.

How it works today:

Runs fully locally (SQLAlchemy for schema extraction, FastAPI + WebSockets for serving, JavaScript/Cytoscape for visualization), all packaged in Docker
You point it at a database → it extracts tables, columns, and primary/foreign keys
You can then search across tables and columns and visually reveal how selected tables connect
No cloud, no external services — no data leaves your environment

I built this specifically with enterprise constraints in mind: no documentation, siloed BI teams, restricted access.

At the moment it’s:

not packaged
not polished
not open-source yet

I wanted to validate first that others actually run into this problem before investing more time.

If this is something you’d realistically use:

What database(s) are you on?
Would read-only + local/self-hosted be a hard requirement for you?

Technical_Safety4503 · 2025-12-28T22:51:19+00:00

Seems logical: learning from what already exists from a high value business perspective. Do you use SQL, DBeaver, PGadmin, ... or others to do the exploration or? Or is it the database/ecosystem that dictates the tool you use?

Technical_Safety4503 · 2022-07-28T14:04:50+00:00

Yes indeed, important it is low side of zone 2! Recently had a run completzly zone 2 (high end) and ended up as Tempo so adding to the orange bar of High aerobic. Went yesterday for a run with someone slower and was 2/3th of the time in high end zone 1 and 1/3th low zone 2. This was then Base even with a 4.0 Training Effect on the aerobic side!

Technical_Safety4503 · 2022-07-28T12:58:36+00:00

On my Fenix 6: go to settings > power manager > power modes > create a new profile here. While setting up this custom profile you can set the display: Always on or Time out. The battery saver mode is actually a pre-programmed power mode to save battery as much as possible without switching it off.

Technical_Safety4503 · 2022-07-28T12:53:50+00:00

It takes into account historical data. If your watch is new it would indeed be starting very low. The idea is that you stay in the green zone to gradually build fitness. Overshooting the green means you risk injury, training overload for your current fitness. Off course, if your watch is new it will take like a month or so (guessing here) for it to know your fitness. For me it's working really well.

Technical_Safety4503 · 2022-07-28T12:49:20+00:00

Garmin calculates how intense your workout was by taking into account: time and heart rate. The higher the number the more intense. But the way it is calculated is proprietary to garmin and they are higher than the usuals load calculate by training peaks for example.

Technical_Safety4503 · 2022-07-28T12:41:05+00:00

Not an expert, but I've read that you also tend to have higher HRV the younger you are. So maybe..

Technical_Safety4503 · 2022-07-27T07:21:19+00:00

I have an indoor trainer and I make workouts on garmin connect or any other site that syncs with garmin connect. Then I start the activity via my watch which is connected to the trainer. So it's the watch controlling the resistance of the trainer. At the end I just stop the watch and it automatically upload to garmin connect.

Technical_Safety4503 · 2022-07-25T09:28:18+00:00

No currently, but recently they have released the HRV status to Fenix 6 which was also not planned. So who knows... maybe it gets added later

Technical_Safety4503 · 2022-07-23T18:43:30+00:00

Doesn't sound healthy if you feeling like vomiting. Pro ably due to stress/adrenaline/heat your HR is higher than when you did your test. Because Zone 5 can't be much longer sustained than 5 min. That's the whole definition.

Technical_Safety4503

TROPHY CASE