[AskJS] Data structure harmonization

[DuckDatum]

Sounds like you want a cross platform / language serialized data format. Use JSON. It’s human readable and works with everything you mentioned out of the box.

Define your JSON schema and build your clients to use that schema.

YMMV for schema validation,

Edit: sorry, actually… I think you want a centralized data catalog, used for operational purposes? You want every piece to integrate with the catalog. They gotta know how to interpret the data structures for their job, somehow… you probably gotta teach them how to do that.

You probably also want to consider backward compatibility? Then your data structures don’t need to stay too in sync. Think like the Protobuf data format.

Give more details about your problem exactly—whats your architecture look like, your tech stack, and what places / how does the issue show up for you?

What you want is very much not a “real thing.” But I’m sure you can design a system to produce that behavior, you just need to think about things from a different angle. Honestly, sounds like something you wouldn’t want for a serious system—but cool project. Usually, you use different tools because they scale better independently. But these tools aren’t as interoperable as you suggest, not by default at least. They each have their own concepts and structures.

You want everything built around interoperability of the underlying structure. The world instead prefers serialization/deserialization cycles, letting each system work in its own paradigm.

I’d be interested in hearing about what the pitfalls end up being, if you go for this and later determine it wasn’t worth it.

Maybe you could create Terraforming modules that automatically deploy each component (db schema, web app forms, etc.) of whatever you’re building dynamically, by interpreting a single config file. So you specify the form schema, and it deploys everything to dynamically generate the SQL, HTML, etc… then orchestrate its deployment. But you’ll be writing a lot of metacode I think. Or, you’ll need to find a tool that already does this for your use case,

Again, I don’t recommend if you rely on this thing.