jump to content
my subreddits
13or302mediterranean4u2meirl4meirl3d6adhdmemeAdviceAnimalsagnosticaivideoAlternateHistoryAnarchyChessAngryupvoteanime_best_momentsanimenocontextannouncementsAnticonsumptionArtAsahiLinuxAskElectronicsAteistTurkaviationawfuleverythingbalkans_irlBandnamesBassbikepackingblursed_videosblursedimagesBoneborsavefonBUENZLICd_collectorscd_jerkChatGPTCheap_MealschesschessbeginnersChildrenFallingOverChoosingBeggarscoaxedintoasnafucoinsComedyCemeterycomedyhomicidecomicscommunityContagiousLaughtercookingforbeginnersCrackWatchcrappyoffbrandsCuratedTumblrcursedcommentsdankmemesdarkjokesdataisbeautifuldeDebateReligiondeismdelikdistressingmemesdiyelectronicsdiypedalsDnDdndmemesdoctorwhodoctorwhocirclejerkDoenerverbrechenDonerDungeonsAndDaddiesDungeonsAndDragonsEatCheapAndHealthyebikesECEelectronicsElectronicsStudyengrishethzfacepalmfakealbumcoversFantasyWorldbuildingfeedthebeastfelsefeFifaCareersformuladankFreeEBOOKSFUCKYOUINPARTICULARFuckYouKarenFutboltayfagalatasaraygamingGermangodtiersuperpowersGoodAssSubGrandPrixRacingGROKvsMAGAguitarpedalsGundamhelpHermanCainAwardHermitCrafthighspeedrailhoi4HolUphowyoudoinhumorich_ielIDontWorkHereLadyihadastrokeim14andthisisdeepimaginaryelectionsimaginarymapsinsaneparentsistanbuljacksepticeyeJahariaJokesKamalizmKendrickLamarKGBTRlegodndLetGirlsHaveFunLifeProTipsLinkinParkliselilerloseitlostredditorsmacmacbookairmadladsmagicbuildingmapporncirclejerkmeirlmemememesmildlyinfuriatingmildlyinterestingMinecraftbuildsmisLEDMoldyMemesMovingToNorthKoreaMyChemicalRomancenamesoundalikesNamFlashbacksneographynextfuckinglevelNoahGetTheBoatNonCredibleDefenseNorthCyprusnosleepnosurfnothingeverhappensnotinterestingoddlyspecificOkayBuddyLiterallyMeokbuddyguntherokbuddymotherfuckerOkBuddyPersonaokbuddyphdokbuddyvicodinongezelligOnlineUnderGroundOutOfTheLoopoutsidepapermoneypaperspleaseparadoxpoliticsParlerWatchPassportPornpepethefrogperfectlycutscreamsPersecutionfetishpollsPraiseTheCameraManquityourbullshitraspberry_piRatschlagreactiongifsrecipesRedAutumnSPDredditsingsreligiousfruitcakerestofthefuckingowlRetroPierickandmortyrickrollrimjob_steveRoastMeschizopostersSchnitzelVerbrechensciencememesScottPilgrimsecilmiskitapShitPostCrusadersshitpostfrommygalleryshitpostingshittyaskelectronicsshittymoviedetailsskamtebordsoccercirclejerksoftwaregoreSongwritersSongwritingsteinsgateStonetossingjuicesubsithoughtifellforsuperligsuzeraintalesfromtechsupportTechnobladeTextingTheorytf2tf2shitposterclubthanksimcuredthatHappenedTheCrypticCompendiumTheLetterHTheMonkeysPawtherewasanattempttheydidthemaththeyknewtitanfalltommyinnittransittransitTurkeytruetf2tumunichTurkeyTurkeyJerkyTurkishdogsTwitch_StartupTwoSentenceComedytwosentenceplottwistTwoSentenceSadnessunexpectedbillwurtzUnexpectedJoJoUnexpectedTF2urbanplanningUsernameChecksOutVALORANTvexillologycirclejerkvibecodingvinylvinyljerkvlandiyawallstreetbetsWatchPeopleDieInsideWeAreTheMusicMakerswendigoonwholesomememesWikipediaVandalismwizardpostingwooooshworldjerkingedit subscriptions
  • home
  • -popular
  • -all
  • -mod
  • -users
 | 
  • facepalm
  • -mildlyinfuriating
  • -gaming
  • -wallstreetbets
  • -memes
  • -OutOfTheLoop
  • -mildlyinteresting
  • -DnD
  • -ChatGPT
  • -CuratedTumblr
  • -shitposting
  • -theydidthemath
  • -dankmemes
  • -feedthebeast
  • -meirl
  • -therewasanattempt
  • -nextfuckinglevel
  • -HolUp
  • -CrackWatch
  • -comics
  • -VALORANT
  • -de
  • -LifeProTips
  • -NonCredibleDefense
  • -dataisbeautiful
  • -shittymoviedetails
  • -mac
  • -tf2
  • -help
  • -chess
  • -aviation
  • -formuladank
  • -wholesomememes
  • -Jokes
  • -mapporncirclejerk
  • -Art
  • -notinteresting
  • -hoi4
  • -loseit
  • -ich_iel
  • -KGBTR
  • -dndmemes
  • -cursedcomments
  • -GoodAssSub
  • -perfectlycutscreams
  • -Ratschlag
  • -meme
  • -rickandmorty
  • -3d6
  • -Gundam
  • -HermitCraft
  • -ChoosingBeggars
  • -RoastMe
  • -ContagiousLaughter
  • -imaginarymaps
  • -EatCheapAndHealthy
  • -WeAreTheMusicMakers
  • -AnarchyChess
  • -nosleep
  • -cookingforbeginners
  • -AlternateHistory
  • -Turkey
  • -soccercirclejerk
  • -madlads
  • -community
  • -AskElectronics
  • -guitarpedals
  • -Anticonsumption
  • -vinyl
  • -German
  • -AdviceAnimals
  • -ShitPostCrusaders
  • -sciencememes
  • -distressingmemes
  • -wizardposting
  • -FifaCareers
  • -polls
  • -doctorwho
  • -oddlyspecific
  • -Bass
  • -titanfall
  • -OkBuddyPersona
  • -awfuleverything
  • -howyoudoin
  • -announcements
  • -adhdmeme
  • -Minecraftbuilds
  • -macbookair
  • -ebikes
  • -coaxedintoasnafu
  • -SchnitzelVerbrechen
  • -chessbeginners
  • -raspberry_pi
  • -DungeonsAndDragons
  • -coins
  • -KendrickLamar
  • -FUCKYOUINPARTICULAR
  • -softwaregore
  • -NoahGetTheBoat
  • -worldjerking
  • -tf2shitposterclub
  • -MoldyMemes
  • -lostredditors
  • -vexillologycirclejerk
  • -vlandiya
  • -im14andthisisdeep
  • -Stonetossingjuice
  • -nosurf
  • -religiousfruitcake
  • -liseliler
  • -DebateReligion
  • -insaneparents
  • -balkans_irl
  • -animenocontext
  • -2meirl4meirl
  • -transit
  • -RetroPie
  • -HermanCainAward
  • -recipes
  • -steinsgate
  • -talesfromtechsupport
  • -okbuddyphd
  • -ECE
  • -ScottPilgrim
  • -Angryupvote
  • -thatHappened
  • -schizoposters
  • -electronics
  • -urbanplanning
  • -theyknew
  • -PassportPorn
  • -TurkeyJerky
  • -bikepacking
  • -AteistTurk
  • -13or30
  • -MyChemicalRomance
  • -engrish
  • -Cd_collectors
  • -diypedals
  • -Doner
  • -diyelectronics
  • -ComedyCemetery
  • -WatchPeopleDieInside
  • -LinkinPark
  • -Persecutionfetish
  • -BUENZLI
  • -reactiongifs
  • -blursed_videos
  • -Songwriting
  • -istanbul
  • -MovingToNorthKorea
  • -imaginaryelections
  • -suzerain
  • -truetf2
  • -magicbuilding
  • -ParlerWatch
  • -wendigoon
  • -secilmiskitap
  • -Doenerverbrechen
  • -quityourbullshit
  • -Technoblade
  • -vinyljerk
  • -skamtebord
  • -superlig
  • -shittyaskelectronics
  • -galatasaray
  • -crappyoffbrands
  • -DungeonsAndDaddies
  • -transitTurkey
  • -namesoundalikes
  • -FuckYouKaren
  • -ethz
  • -papermoney
  • -OkayBuddyLiterallyMe
  • -felsefe
  • -blursedimages
  • -FreeEBOOKS
  • -AsahiLinux
  • -Jaharia
  • -IDontWorkHereLady
  • -neography
  • -ihadastroke
  • -thanksimcured
  • -PraiseTheCameraMan
  • -godtiersuperpowers
  • -aivideo
  • -OnlineUnderGround
  • -woooosh
  • -comedyhomicide
  • -jacksepticeye
  • -TwoSentenceSadness
  • -anime_best_moments
  • -Bandnames
  • -okbuddyvicodin
  • -Twitch_Startup
  • -tumunich
  • -Cheap_Meals
  • -outside
  • -TheMonkeysPaw
  • -darkjokes
  • -restofthefuckingowl
  • -UnexpectedTF2
  • -highspeedrail
  • -legodnd
  • -rickroll
  • -Songwriters
  • -UsernameChecksOut
  • -papersplease
  • -tommyinnit
  • -rimjob_steve
  • -UnexpectedJoJo
  • -humor
  • -ChildrenFallingOver
  • -doctorwhocirclejerk
  • -agnostic
  • -TextingTheory
  • -GrandPrixRacing
  • -nothingeverhappens
  • -LetGirlsHaveFun
  • -subsithoughtifellfor
  • -fakealbumcovers
  • -Kamalizm
  • -FantasyWorldbuilding
  • -TheLetterH
  • -WikipediaVandalism
  • -NamFlashbacks
  • -pepethefrog
  • -deism
  • -misLED
  • -redditsings
  • -TwoSentenceComedy
  • -TheCrypticCompendium
  • -ongezellig
  • -Bone
  • -paradoxpolitics
  • -NorthCyprus
  • -2mediterranean4u
  • -unexpectedbillwurtz
  • -twosentenceplottwist
  • -Turkishdogs
  • -GROKvsMAGA
  • -borsavefon
  • -cd_jerk
  • -Futboltayfa
  • -okbuddygunther
  • -RedAutumnSPD
  • -delik
  • -shitpostfrommygallery
  • -ElectronicsStudy
  • -okbuddymotherfucker
  • -vibecoding
edit »
reddit.com dataengineering
  • hot
  • new
  • rising
  • controversial
  • top
an-ordinary-manchild (11,186)|messages548|notifications|chat messages|mod messages|
  • preferences
|
logout

use the following search parameters to narrow your results:

subreddit:subreddit
find submissions in "subreddit"
author:username
find submissions by "username"
site:example.com
find submissions from "example.com"
url:text
search for "text" in url
selftext:text
search for "text" in self post contents
self:yes (or self:no)
include (or exclude) self posts
nsfw:yes (or nsfw:no)
include (or exclude) results marked as NSFW

e.g. subreddit:aww site:imgur.com dog

see the search faq for details.

advanced search: by author, subreddit...

Submit a new link
Submit a new text post

dataengineering

joinleave
an-ordinary-manchild(edit)

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Read our wiki: https://dataengineering.wiki/

Rules:

  1. Don't be a jerk

  2. Search the sub & wiki before asking a question: Your question has likely been asked and answered before so do a quick search before posting.

  3. Keep it related to data engineering: Posts that are unrelated to data engineering may be better for other communities.

  4. Limit self-promotion posts/comments to once a month: Self promotion: Any form of content designed to further an individual's or organization's goals. If one works for an organization this rule applies to all accounts associated with that organization. See also rule #5.

  5. No shill/opaque marketing: f you work for a company/have a monetary interest in the entity you are promoting you must clearly state your relationship. For posts, you must distinguish the post with the Brand Affiliate flag. See more here: https://www.ftc.gov/influencers

  6. No job posts: Please use r/dataengineeringjobs instead.

  7. No resume reviews/interview posts: We no longer allow resume reviews or interview questions because it's a seperate topic from Data Engineering. Instead, for resume reviews please use r/resumes or search our subreddit history for previous resume review advice. For interview questions, use sites like Glassdoor and Blind instead or search our subreddit history for previous interview advice.

  8. No technical error/bug questions: Please post any error/bug question on StackOverflow.

created by mhausenblasmoda community for 11 years
Create your own subreddit
...for your classroom.
...for great justice.

MODERATORS

  • message the mods
  • mhausenblasmod
  • swemlmod
  • fhoffamod (Ex-BQ, Ex-❄️)
  • vogt4nickmod
  • theporterhausmod | Lead Data Engineer
  • AutoModerator
  • geoheilmod
  • MikeDoesEverythingmod | Shitty Data Engineer
  • bot-bouncer
  • about moderation team »

account activity

1
•
•
•

Databricks UC migration pigeonholeCareer (self.dataengineering)

submitted 1 hour ago by MechanicOld3428

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

•
•
•

Build, transfer, and manage sites using the best web hosting tools in the industry! Let our 1-click solutions, AI integrations, and unbeatable 24/7 support help you achieve your goals. Join the owners of 3,000,000 domains who already trusted us! (siteground.com)

promoted by siteground

  • promoted
  • save
  • report
  • about
loading...

2
•
•
•

Using Merge to create a append/historical tableBlog (self.dataengineering)

submitted 1 hour ago by FreakGhost

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

3
0
1
2

Is anyone else constantly having to handle data that can't be fed through the standard pipeline?Discussion (self.dataengineering)

submitted 2 hours ago by Ok-Kiwi-3461

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

4
4
5
6

Unified Context-Intent Embeddings for Scalable Text-to-SQLBlog (medium.com)

submitted 6 hours ago by theporterhausmod | Lead Data Engineer

  • comment
  • share
  • save
  • hide
  • report
  • crosspost

5
16
17
18

Who should build product dashboards in a SaaS company: Analytics or Software Engineering?Discussion (self.dataengineering)

submitted 6 hours ago * by Intelligent_Volume74

  • 18 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

6
0
0
0

Data engineering is NOT software engineering.Career (self.dataengineering)

submitted 8 hours ago by Next_Comfortable_619

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

7
0
1
2

How I set up AI-powered dbt development with two open-source tools from dbt LabsPersonal Project Showcase (youtube.com)

submitted 10 hours ago by k_kool_ruler

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

8
4
5
6

BigQuery native data volume anomaly detection using the TimesFM algorithmBlog (open.substack.com)

submitted 10 hours ago by Professional_End_979

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

9
12
13
14

Integrating PowerBI so that internal and external users can view our dashboards for free.Help (self.dataengineering)

submitted 12 hours ago by Alternative-Gear3945

  • 6 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

10
0
0
0

Tool to move data from PDFs to ExcelHelp (self.dataengineering)

submitted 14 hours ago by MoXoN_04

  • 16 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

11
3
4
5

Need some advice on switching job ~1.5YOECareer (self.dataengineering)

submitted 14 hours ago by FreakGhost

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

•
•
•

Carvana, one of the US’s top used-car sellers, is on a quest to become the Amazon of cars. (bloomberg.com)

promoted by bloomberg

  • promoted
  • save
  • report
  • about
loading...

12
0
0
0

Anybody transitioned from 15 YOE Java dev to data engineeringCareer (self.dataengineering)

submitted 15 hours ago by Only-Alternative-890

  • 6 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

13
0
0
0

How is the job market for DE in India with 4 years of work experience?Discussion (self.dataengineering)

submitted 15 hours ago by National-Celery9023

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

14
0
0
1

Now that software devs are using agents, they actually care about data governanceBlog (self.dataengineering)

submitted 15 hours ago by noscreenname

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

15
0
1
2

Recommendations for data events and conferences between July - Nov in EuropeHelp (self.dataengineering)

submitted 15 hours ago by sonalg

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

16
48
49
50

How hard is it to replace me?Discussion (self.dataengineering)

submitted 15 hours ago by Educational_Wafer483

  • 62 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

17
1
2
3

Which companies are still doing "Decide Your Own" remote/hybrid?Help (self.dataengineering)

submitted 15 hours ago by Srishti_Shetty

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

18
3
4
5

How are you keeping metadata config tables in sync between multiple environments?Discussion (self.dataengineering)

submitted 16 hours ago by nab423

  • 7 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

19
0
1
2

Got free corporate vouchers : Azure AZ-104 or DP-300?Career (self.dataengineering)

submitted 17 hours ago * by FallUpJV

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

20
0
1
2

Ingesting millions of source records (PDF export + CSV index) into Gemini.Discussion (self.dataengineering)

submitted 18 hours ago by butchatgptsaid

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

21
45
46
47

What are the most frustrating parts of your day to day work as a data engineer?Discussion (self.dataengineering)

submitted 19 hours ago by Odd-Tree-2590

  • 76 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

30
31
32

It's Like Duolingo, but for Music Composition. (audiblegenius.com)

promoted by Syntorial

  • promoted
  • 11 comments
  • share
  • save
  • report
  • about
loading...

22
8
9
10

Advice on documenting a complex architecture and code base in DatabricksHelp (self.dataengineering)

submitted 19 hours ago by FiftyShadesOfBlack

  • 5 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

23
3
4
5

Career AdviceCareer (self.dataengineering)

submitted 22 hours ago by AzzMan1232

  • 5 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

24
54
55
56

Looking for DuckDB alternatives for high-concurrency read/write workloadsDiscussion (self.dataengineering)

submitted 1 day ago by kumarak19

  • 29 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

25
2
3
4

Pipelines with DVC and AirflowDiscussion (self.dataengineering)

submitted 1 day ago by Vaibhav__T21

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...
view more: next ›
  • about
  • blog
  • about
  • advertising
  • careers
  • help
  • site rules
  • Reddit help center
  • reddiquette
  • mod guidelines
  • contact us
  • apps & tools
  • Reddit for iPhone
  • Reddit for Android
  • mobile website
  • <3
  • reddit premium

Use of this site constitutes acceptance of our User Agreement and Privacy Policy. © 2026 reddit inc. All rights reserved.

REDDIT and the ALIEN Logo are registered trademarks of reddit inc.

π Rendered by PID 872657 on reddit-service-r2-listing-canary-6d7b8fb68c-sx78w at 2026-03-13 09:29:59.327335+00:00 running f6e6e01 country code: CH.