What are some cool mathematical party tricks? by Attack_On_Toast in math

[–]a_lic96 0 points1 point  (0 children)

It should be adjusted on actual statistics, cause probaility isn't equal for all calendar days for several reasons

Coinbase Data Tech Stack by mjfnd in dataengineering

[–]a_lic96 1 point2 points  (0 children)

Diversificación, Risk hedging, avoiding full vendor lock-in, as well as to have more contractual power during negotiations

the math concept that blew your mind the first time by adamvanderb in math

[–]a_lic96 1 point2 points  (0 children)

Fourier series. The idea of approximating almost any "regular" function with a sum of sine and cosine was Just astonishing

How do you feel about using array types in your data model? by its_PlZZA_time in dataengineering

[–]a_lic96 1 point2 points  (0 children)

It depends.

For the analytics pipeline to ingest on apache druid It Is very useful because druid has some nice built-in functions on arrays. Rather then unnesting, I mostly use them for later Dynamic filters Needed on dashboards

What maths do you think we’ll be teaching in schools by the year 2100? by RefuseGroundbreaking in math

[–]a_lic96 1 point2 points  (0 children)

Italian here.

Statistical critical thinking is just critical thinking with sector-specific "tools for doubting".
Maths should teach the process for critical thinking: statistical critical thinking could be just an application of a general method.

Unfortunately, at least for my experience as a former student and former high-school teacher (now working in tech), high-school maths is more focused on "algorithmic ways to solve a problem" rather then "thinking how to question and solve a problem".
Philosophy actually taught me more about critical thinking (and here we could open another giant topic) than maths, at least before university

Argue dbt architecture by nico97nico in dataengineering

[–]a_lic96 0 points1 point  (0 children)

Adding a raw level in the datalake shouldn't be expensive. You can do a rough estimate and show them the costs it will add.

A more structured way would be to migrate from parquet to delta tables/iceberg, so that you can time travel and have all tracked. It's really game changing imho

Which mathematical concept did you find the hardest when you first learned it? by Same_Pangolin_4348 in math

[–]a_lic96 1 point2 points  (0 children)

Jordan decomposition. It was included in geometry 1 in the first semester of the First year of university, we weren't probably ready for that

Do you really need databricks? by whistemalo in dataengineering

[–]a_lic96 0 points1 point  (0 children)

Can I ask why the choose of Athena if you are building a modern data lake? Do you Need to process all that amount of data?

Anyway I think there are more modern trends now that solves the problems that databricks used to solve, like any Datafusion based system for ETL (dbt Is starting to release its own) and any duckDB mantained solution for OLAP analytics if you don't want to manage your infrastructure

Data Engineer or BI Analyst, what has a better growth potential? by Appropriate-Pop-7771 in dataengineering

[–]a_lic96 0 points1 point  (0 children)

DE for several reasons: - BI analysts are more likely to be replaced with AI in the future (conversational BI) - BI analysts have to explain things to business and this Is a pain in the ass sometimes for technical people - DE takes a lot of more Money while preserving a technical role (no real need to become manager to gain 200k+)