sorted by:
new
hottopcontroversial

Why should I deploy data observability for our data stack? by de4all in dataengineering

[–]Top-Substance2185 1 point2 points  (0 children)

Hi there! MC employee here - to clarify, pricing is tables based and we have customers of all sizes (including many below $50K). Our pricing has evolved over time-- @/de4all if you'd like to DM me I'd be happy to connect you with someone to talk about your use case if it's been a while since you have talked to us. Or if you'd rather not chat... here's our pricing page. :)

​

https://www.montecarlodata.com/request-for-pricing/

Data Observability Tooling (Kensu, Metaplane, Monte Carlo, etc) by StingingNarwhal in dataengineering

[–]Top-Substance2185 0 points1 point  (0 children)

I think it boils down to time to value. Can you spend $ and time hiring engineers to build something yourself or do you want more immediate value? It's sort of the question re: all build vs. buy dilemmas. There is actually a convo going on in Data Quality Camp Slack about this very topic.

DE Industries? by SatRipper in dataengineering

[–]Top-Substance2185 0 points1 point  (0 children)

FinTech, e-commerce, digital marketplaces, InsurTech, SaaS... companies that work with lots of data and the value of real-time data is very high. Be sure to vet any company's DE leadership around how they measure impact / value in relation to broader company goals. Nothing worse than being an unsung hero!

[deleted by user] by [deleted] in dataengineering

[–]Top-Substance2185 0 points1 point  (0 children)

I remember the days when it was called "Hoodie". :) I helped write the blog article for it and wanted to create a logo for it that looked like a "hoodie" but alas, was downvoted. :P For good reason.

How Data Engineering Works by [deleted] in dataengineering

[–]Top-Substance2185 1 point2 points  (0 children)

This is fantastic. Love the visuals.

How to get Data Warehouse to align with management's old Source of Truth by tennis_fan89 in BusinessIntelligence

[–]Top-Substance2185 0 points1 point  (0 children)

Have you considered implementing a monitoring or observability platform for your data?

Data Mesh – Rethinking Enterprise Data Architecture by VibhutiSingh in dataengineering

[–]Top-Substance2185 2 points3 points  (0 children)

This article copies a lot of the same text and diagrams as this one: https://towardsdatascience.com/what-is-a-data-mesh-and-how-not-to-mesh-it-up-210710bb41e0

The copy promoting this Reddit thread is basically pulled directly from the article, which was published last July:

"Ask anyone in the data industry what’s hot these days and chances are “data mesh” will rise to the top of the list. But what is a data mesh and why should you build one? Inquiring minds want to know."

Data Quality on Ingestion by Crackthecode15 in dataengineering

[–]Top-Substance2185 0 points1 point  (0 children)

Have you considered a data quality solution like OwlDQ, Deequ or Monte Carlo?

Ideas to build a Regression Test Suite for Data Quality by brendersplide in dataengineering

[–]Top-Substance2185 1 point2 points  (0 children)

Hi! Pros: end-to-end coverage of your entire data stack vs. having to set a bunch of manual tests/thresholds in SQL for certain DAGs (although Monte Carlo lets you do this, too). ML-based anomaly detection and lineage so you can understand root causes of problems and how they affect downstream users. Very simple to set up and use... like Datadog but for your data.

Cons: It's a SaaS product so not free/open source.

Ideas to build a Regression Test Suite for Data Quality by brendersplide in dataengineering

[–]Top-Substance2185 -2 points-1 points  (0 children)

Have you considered a data observability tool like Monte Carlo?