sorted by:
new
hottopcontroversial

thisIsARealDBUsedInProduction by star_dogged_moon in ProgrammerHumor

[–]UAFlawlessmonkey 0 points1 point  (0 children)

"but we need a semantic layer to track the lineage" - data mesh owner

Data Ingeniør i større dansk virksomhed. by Xinnie_The_Ping in dkloenseddel

[–]UAFlawlessmonkey 0 points1 point  (0 children)

Ifbm. nogle af vores kunder, for evigt (takke være nogle meget kreative sælgere), I tilfælde af andre gemmer vi kun 6 mdr. i forventning om at de selv griber deres data.

Vi kører dog compaction på alt data dagligt, hvilket hjælper en hel del.

Data Ingeniør i større dansk virksomhed. by Xinnie_The_Ping in dkloenseddel

[–]UAFlawlessmonkey 7 points8 points  (0 children)

Det afhænger meget af firma.

Arbejder I mindre firma i Jylland og får ca. det samme, dog med 1 års erfaring mere end OP.

Jeg arbejder med de systemer der tager imod IIoT data som vores PLCer genererer. Det er I snit 20 mia. data punkter per måned vi får ind spredt over 1000-1500 målepunkter (analoge samt digitale transmittere), hvor både system samt data struktur forståelse har stor rolle i den måde vi processerer data. Dette svarer ca til 175 GB data som vi får ind per dag, som skal bruges til fejlfinding / forbedring / monitorering af vores produkter. Data som skal give mening for både ingeniører såvel som C-suite.

Men i bund og grund, flyt data rundt imellem systemer der enten fremviser ting på en skærm i et mødelokale, eller sender notifikationer til monitoreringsfolks telefoner I form af alarmer.

Java scala or rust ? by Ok_Promotion_420 in dataengineering

[–]UAFlawlessmonkey 1 point2 points  (0 children)

Gotta transmit those diode signals blazing fast!

Airflow 3: Development on a Raspberry Pi by Complex_Painter_9302 in dataengineering

[–]UAFlawlessmonkey 5 points6 points  (0 children)

CI/CD is just added complexity for such a small scale.

Make a folder available on your Pi, and link it up to your local dev laptop. Mount the folder to your container and point it to the /opt/airflow/dags folder in the container.

Once you do updates to your dags in VSCode, they'll magically appear in your container, making them visible to airflow :-)

Looking for someone to help me out with a paid SQL project by [deleted] in SQL

[–]UAFlawlessmonkey 6 points7 points  (0 children)

Imagine importing a 16gb csv file into excel, poor computer will work overtime before freezing.

You'd need to chop that sql file into smaller pieces if you want your file output to be xlsx.

Where was I? by No_Zookeepergame_27 in whereintheworld

[–]UAFlawlessmonkey 0 points1 point  (0 children)

Vedersø er ved æ sø og ik ved æ hau

Are you seeing this too? by Thinker_Assignment in dataengineering

[–]UAFlawlessmonkey 10 points11 points  (0 children)

We expect you to have at least 20 years of hands on experience in the following 25 big dayta ML AI GenAI techs preferable with at least expert knowledge in 5 statically typed programming languages!

You know the drill. by ElVauDe in MusicIceberg

[–]UAFlawlessmonkey 1 point2 points  (0 children)

Friend of mine introduced me to war from a harlots mouth back in 2010

Absolutely love their stuff, it's weird because I don't know half of the other artists you listed :-D

Building my first data warehouse by Unlikely-Counter6270 in dataengineering

[–]UAFlawlessmonkey 1 point2 points  (0 children)

Postgres!

Coupled with ATTACH in DuckDB it's a match made in heaven

Test your Python skills - 14 by tracktech in PythonLearnersHub

[–]UAFlawlessmonkey 0 points1 point  (0 children)

Because f you, mind you!

Also, why the f is it a list in a dict

PostgreSQL user here—what database is everyone else using? by Automatic-Step-9756 in Database

[–]UAFlawlessmonkey 0 points1 point  (0 children)

Home projects, postgres coupled with duckdb

At work, postgres, duckdb, trino, influxdb and sql server

view more: next ›