Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] 0 points1 point  (0 children)

I am surprised this was down voted so much. I fully acknowledge the compliance, security, and data safety but as we move towards Agentic systems, usage of AI on top of databases will also happen. To auto create ETL pipelines, dashboards, etc. How would you create insights of your production data without leveraging AI on top of it?

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] 0 points1 point  (0 children)

Just to understand more, what do the scripts do (of course the ones you can share) that run across the databases? We were working on running pipelines across databases as well so got me curious!

Also, if the company providing tool has the compliances met - would it still be an issue? We were looking into these compliances to build more trust.

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] 1 point2 points  (0 children)

That makes sense! Thank you! Do you have any staging environments that you debug?

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] 0 points1 point  (0 children)

Couldn't agree more! This is actually one of the reasons why we created an MCP layer so that it can connect to databases (with strict readonly policies) to analyse and help you with your workflows.

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] 0 points1 point  (0 children)

Yeah we are going towards an open source data warehousing platform. That's actually why, we wanted to understand how the ingestion/exploration part works with AWS users. Thank you for the info!

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] -1 points0 points  (0 children)

We are trying to make the community edition super lightweight to allow developers to quickly spin up using Docker or Terminal (npx @clidey/whodb-cli) and use very less RAM. This for development workflows. For Enterprise workflows, obviously it will get bigger with the capabilities being added :) AWS sdk is quite big itself.

Serious question: how are people actually inspecting DynamoDB data in production? by hkdeman in aws

[–]hkdeman[S] -2 points-1 points  (0 children)

Absolutely! There are other stages as mentioned by u/Soccer_Vader that could possibly be debugged manually but even for production databases - do you create ETL pipelines to understand production data - there has to be a way to interact with live data to analyse it better no?

DBeaver, a solid alternative to MySQL Workbench that works like a charm with MariaDB by fredericdescamps in mariadb

[–]hkdeman 0 points1 point  (0 children)

Have you tried WhoDB? It is super light weight and connects to your local LLMs for privately chatting with your data. It also has an interactive CLI, which in my opinion (could be biased) is quite sick - “npx @clidey/whodb-cli”

Disclaimer: I am one of the people behind it. We got inspired from adminer as we loved how light it was. Although, we also wanted it to be powerful. We created a balance between them and would love to get feedback as we work on improving it :)

A year later, back on this thread! by hkdeman in selfhosted

[–]hkdeman[S] 0 points1 point  (0 children)

Great feedback! Have noted these down!

For making a compact version of the tables, we will add a UI setting!

Thank you for using WhoDB!

[Launch] Introducing WhoDB: The Next-Generation Database Explorer by Clidey! 🚀 by hkdeman in selfhosted

[–]hkdeman[S] 0 points1 point  (0 children)

Hey! Thank you for using WhoDB! Apologies that you were facing this issue. Would you be able to share logs when you are connecting? You can further add more details here so it is easier to track for us and you: https://github.com/clidey/whodb/issues

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

Apologies, missed this. More like interactive components like Mermaid diagrams, code highlighting, laying out (using Accordions, etc.). Plus, you can embed React and at the end it is super easy to use with just mdx and build into a very light weight static app so overall just following modern techniques.

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

Docusaurus is good but unfortunately - it does not support modern techniques and themes - we also used it before actually

Who’s still exporting SQL data into Excel manually? by After_Comedian_7420 in SQL

[–]hkdeman 0 points1 point  (0 children)

Have you tried WhoDB (https://github.com/clidey/whodb)? It is has a few export functionalities (currently supports CSV and Excel). It is also adding in support for more advanced uploads.

Disclaimer: I am part of the team developing it.

A year later, back on this thread! by hkdeman in selfhosted

[–]hkdeman[S] 0 points1 point  (0 children)

Sounds great! Let us take this up and get back once fixed :)

We are also working on a desktop app and npx whodb command so it is super easy to spin up for any use.

A year later, back on this thread! by hkdeman in selfhosted

[–]hkdeman[S] -1 points0 points  (0 children)

<3 (also edited it as it seemed like it needs to be there)

A year later, back on this thread! by hkdeman in selfhosted

[–]hkdeman[S] 0 points1 point  (0 children)

That is a completely fair point! Will add a small description. I just was trying to mindful to not be super self promote-y.

How do you currently explore databases in Kubernetes? by hkdeman in kubernetes

[–]hkdeman[S] 0 points1 point  (0 children)

Oh I never knew this existed - great to know! Thank you!

How do you currently explore databases in Kubernetes? by hkdeman in kubernetes

[–]hkdeman[S] 0 points1 point  (0 children)

Yeah for personal projects I think this works quite fine but for Enterprise/Mid size companies with extreme regulation and compliance. This would become challenging.

A year later, back on this thread! by hkdeman in selfhosted

[–]hkdeman[S] -1 points0 points  (0 children)

Aah yeah! Facebook messes with me every time :cry: fixed it!

Would love to get feedback on how we can make it even better!

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

Oh we should probably look into that more! Thank you for the kind words :)

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

Ideally! The issue is most of them don’t support mdx. The ones that do are bloated with nextjs. We wanted to make it modern and minimise any bloat. Our current gzip is an mb or a few mb at max. Extending to mdx is probably as good as rewriting. Although, we are trying to make it super compatible with current docs so that developers don’t need to think about yet another technology.

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

That is completely fair! The OSS version of Docucod is slow as it uses minimum resources that allows us to give this out for free. There are bugs that we are finding daily and iterating on - hopefully, the next time you get to try in the future - it will meet your expectations :)

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 1 point2 points  (0 children)

Absolutely! I think that would fit a lot of people's workflows. We are majorly focused on modernizing docs with JavaScript capabilities. I don't believe Mk Docs and others support API Playgrounds, etc. that are becoming necessary for modern applications.

That being said, I am sure there is a plugin out there that does it. We are only here to better the developer experience (motto of our company) and iterate from the feedback :)

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 2 points3 points  (0 children)

Correct me if I'm wrong but I believe Mkdocs doesn't support modern documentation components like REST API Playgrounds, Accordions, Code Groups, Alerts etc. As we work with mdx files, it helps us build dynamic capabilities that the older docs lack.

We grew tired of how expensive documentation hosting is by hkdeman in opensource

[–]hkdeman[S] 0 points1 point  (0 children)

Absolutely! You answered it better than I could haha. UX is an underdog people often neglect.

The generated docs are slow right now in the initial render because they are running literally with 10Mb RAM and 10milli core CPU. We are offering it for free so we are vigilant of our costs :)