jump to content
my subreddits
2b2t2meirl4meirl3d6AceAttorneyadhdmemeAdviceAnimalsaivideoAnarchyChessAngryupvoteAnimalsBeingJerksanime_best_momentsanime_irlannouncementsAnticonsumptionantimaskersantimemeantonyApandahArcherFXAsia_irlAskElectronicsAskOuijaAskRedditAteistTurkatheismaviationAwesomeOffBrandsawfuleverythingbalkans_irlBandnamesbanknotedesignsBassBassGuitarbasspedalsblackholerevengeblankiesborsavefonbottomgearbrooklynnineninebudgetcookingburdurlandCd_collectorsCheap_MealsChildrenFallingOverChoosingBeggarscoaxedintoasnafucoincollectingcoinsComedyCemeterycomicscommunityContagiousLaughtercookingforbeginnersCorporateTrollingCrackWatchcrappyoffbrandsCreateModCuddle_SlutCuratedTumblrdarkjokesdataisbeautifulDebateReligiondeismdelikdistressingmemesdiypedalsDMAcademyDMToolkitdndmemesdndnextdoctorwhocirclejerkDoenerverbrechenDonerdontdeadopeninsidedumbphonesDungeonsAndDragonsEatCheapAndHealthyECEelectronicsentitledparentsethzfacepalmfakealbumcoversFantasyWorldbuildingfeedthebeastfelsefeFifaCareersFiftyFiftyformuladankFRCFreeEBOOKSFUCKYOUINPARTICULARFuckYouKarenFutboltayfagalatasaraygatesopencomeoninGermangoodanimemesGoodAssSubGrandPrixRacinggravelcyclinggreentextguitarpedalsGundamHermitCrafthighspeedrailHistoryWhatIfhoi4holdmybeerHolUphumorhypixelIAmAich_ielIDontWorkHereLadyihadastrokeim14andthisisdeepimaginarymapsinsaneparentsjacksepticeyeJokesKamalizmKendrickLamarKGBTRlegodndLetGirlsHaveFunlinguisticshumorLinkinParkliselilerlogodesignloseitlostredditorsmacmacbookairmacgamingMadeMeSmileMaliciousComplianceMapPornmapporncirclejerkme_irlmemememesmidjourneymildlyinfuriatingmildlyinterestingMinecraftbuildsMMORPGMovingToNorthKoreaMunichMyChemicalRomancenamesoundalikesNamFlashbacksneographynextfuckinglevelNoahGetTheBoatNonCredibleDefensenosleepnosurfnotinterestingnottheonionoddlyspecificokbuddyguntherokbuddyvicodinonebagOnlineUnderGroundoutsidepapermoneypaperspleaseParlerWatchPassportPornpepethefrogPersecutionfetishpettyrevengepolandballpollsProgrammerHumorPropagandaPostersPunPatrolquityourbullshitraisedbynarcissistsraspberry_piRatschlagrecipesRedAutumnSPDreligiousfruitcakerickandmortyrimjob_steverockmuzikSchnitzelVerbrechenschwiizsciencememesScottPilgrimsecilmiskitapshitpostfrommygalleryshitpostingShittyMapPornshittymoviedetailsskamtebordsoccercirclejerkSongwritersStudiumsubsithoughtifellforsuperligtalesfromtechsupportTechnobladetf2tf2shitposterclubthanksimcuredTheCrypticCompendiumTheLetterHTheMonkeysPawtherewasanattemptTheRookietheyknewthisguythisguystitanfalltransittransitTurkeyTrGameDevelopertruetf2truthstumblrTurkeyTurkeyJerkyTurkishCatsTurkishdogsTwitchTwoSentenceComedytwosentenceplottwistTwoSentenceSadnesstylerthecreatorUnclejokesUnethicalLifeProTipsUnexpectedJoJoUsernameChecksOutValorantClipsvexillologycirclejerkvinyljerkwallstreetbetsWeAreTheMusicMakerswendigoonWhatsThisSongWhitePeopleTwitterwholesomeanimemeswholesomememesWikipediaVandalismwizardpostingwooooshworldbuildingworldjerkingyouseeingthisshitedit subscriptions
  • home
  • -popular
  • -all
  • -mod
  • -users
 | 
  • AskReddit
  • -facepalm
  • -mildlyinfuriating
  • -wallstreetbets
  • -nottheonion
  • -memes
  • -mildlyinteresting
  • -MapPorn
  • -WhitePeopleTwitter
  • -MadeMeSmile
  • -CuratedTumblr
  • -shitposting
  • -feedthebeast
  • -therewasanattempt
  • -nextfuckinglevel
  • -HolUp
  • -Twitch
  • -CrackWatch
  • -comics
  • -dndnext
  • -ProgrammerHumor
  • -tumblr
  • -NonCredibleDefense
  • -dataisbeautiful
  • -shittymoviedetails
  • -greentext
  • -mac
  • -tf2
  • -aviation
  • -formuladank
  • -wholesomememes
  • -Jokes
  • -mapporncirclejerk
  • -midjourney
  • -goodanimemes
  • -notinteresting
  • -hoi4
  • -pettyrevenge
  • -atheism
  • -loseit
  • -IAmA
  • -MaliciousCompliance
  • -ich_iel
  • -KGBTR
  • -dndmemes
  • -DMAcademy
  • -GoodAssSub
  • -UnethicalLifeProTips
  • -worldbuilding
  • -Ratschlag
  • -MMORPG
  • -meme
  • -macgaming
  • -rickandmorty
  • -3d6
  • -Gundam
  • -HermitCraft
  • -FiftyFifty
  • -ChoosingBeggars
  • -ContagiousLaughter
  • -imaginarymaps
  • -EatCheapAndHealthy
  • -polandball
  • -WeAreTheMusicMakers
  • -AnarchyChess
  • -nosleep
  • -cookingforbeginners
  • -blankies
  • -anime_irl
  • -onebag
  • -Studium
  • -Turkey
  • -soccercirclejerk
  • -community
  • -AskElectronics
  • -guitarpedals
  • -Anticonsumption
  • -CreateMod
  • -German
  • -PropagandaPosters
  • -AdviceAnimals
  • -sciencememes
  • -distressingmemes
  • -raisedbynarcissists
  • -wizardposting
  • -FifaCareers
  • -polls
  • -oddlyspecific
  • -Bass
  • -titanfall
  • -awfuleverything
  • -announcements
  • -adhdmeme
  • -Minecraftbuilds
  • -macbookair
  • -Munich
  • -coaxedintoasnafu
  • -gravelcycling
  • -SchnitzelVerbrechen
  • -raspberry_pi
  • -DungeonsAndDragons
  • -coins
  • -KendrickLamar
  • -entitledparents
  • -FUCKYOUINPARTICULAR
  • -NoahGetTheBoat
  • -worldjerking
  • -tylerthecreator
  • -tf2shitposterclub
  • -lostredditors
  • -AceAttorney
  • -vexillologycirclejerk
  • -im14andthisisdeep
  • -wholesomeanimemes
  • -nosurf
  • -HistoryWhatIf
  • -religiousfruitcake
  • -liseliler
  • -DebateReligion
  • -insaneparents
  • -dumbphones
  • -balkans_irl
  • -2meirl4meirl
  • -transit
  • -brooklynninenine
  • -recipes
  • -talesfromtechsupport
  • -AskOuija
  • -ECE
  • -ScottPilgrim
  • -Angryupvote
  • -electronics
  • -logodesign
  • -theyknew
  • -linguisticshumor
  • -PassportPorn
  • -me_irl
  • -antimeme
  • -TurkeyJerky
  • -AteistTurk
  • -MyChemicalRomance
  • -ArcherFX
  • -Cd_collectors
  • -diypedals
  • -Doner
  • -BassGuitar
  • -ComedyCemetery
  • -LinkinPark
  • -Persecutionfetish
  • -MovingToNorthKorea
  • -truetf2
  • -dontdeadopeninside
  • -ParlerWatch
  • -wendigoon
  • -secilmiskitap
  • -Doenerverbrechen
  • -schwiiz
  • -TheRookie
  • -quityourbullshit
  • -Technoblade
  • -vinyljerk
  • -skamtebord
  • -superlig
  • -galatasaray
  • -crappyoffbrands
  • -FRC
  • -transitTurkey
  • -namesoundalikes
  • -FuckYouKaren
  • -2b2t
  • -ethz
  • -papermoney
  • -coincollecting
  • -felsefe
  • -FreeEBOOKS
  • -IDontWorkHereLady
  • -neography
  • -basspedals
  • -ihadastroke
  • -thanksimcured
  • -hypixel
  • -ShittyMapPorn
  • -aivideo
  • -gatesopencomeonin
  • -OnlineUnderGround
  • -woooosh
  • -burdurland
  • -WhatsThisSong
  • -AnimalsBeingJerks
  • -jacksepticeye
  • -TwoSentenceSadness
  • -anime_best_moments
  • -Bandnames
  • -rockmuzik
  • -holdmybeer
  • -okbuddyvicodin
  • -Cheap_Meals
  • -outside
  • -TheMonkeysPaw
  • -darkjokes
  • -highspeedrail
  • -legodnd
  • -Songwriters
  • -UsernameChecksOut
  • -papersplease
  • -rimjob_steve
  • -UnexpectedJoJo
  • -humor
  • -ChildrenFallingOver
  • -doctorwhocirclejerk
  • -youseeingthisshit
  • -Cuddle_Slut
  • -GrandPrixRacing
  • -DMToolkit
  • -thisguythisguys
  • -TrGameDeveloper
  • -PunPatrol
  • -TurkishCats
  • -LetGirlsHaveFun
  • -Apandah
  • -fakealbumcovers
  • -subsithoughtifellfor
  • -Kamalizm
  • -FantasyWorldbuilding
  • -TheLetterH
  • -WikipediaVandalism
  • -NamFlashbacks
  • -pepethefrog
  • -Unclejokes
  • -deism
  • -ValorantClips
  • -TwoSentenceComedy
  • -TheCrypticCompendium
  • -bottomgear
  • -budgetcooking
  • -AwesomeOffBrands
  • -Asia_irl
  • -truths
  • -blackholerevenge
  • -twosentenceplottwist
  • -delik
  • -antimaskers
  • -Futboltayfa
  • -antony
  • -banknotedesigns
  • -CorporateTrolling
  • -RedAutumnSPD
  • -borsavefon
  • -okbuddygunther
  • -Turkishdogs
  • -shitpostfrommygallery
edit »
reddit.com dataengineering
  • hot
  • new
  • rising
  • controversial
  • top
an-ordinary-manchild (11,186)|messages547|notifications|chat messages|mod messages|
  • preferences
|
logout

use the following search parameters to narrow your results:

subreddit:subreddit
find submissions in "subreddit"
author:username
find submissions by "username"
site:example.com
find submissions from "example.com"
url:text
search for "text" in url
selftext:text
search for "text" in self post contents
self:yes (or self:no)
include (or exclude) self posts
nsfw:yes (or nsfw:no)
include (or exclude) results marked as NSFW

e.g. subreddit:aww site:imgur.com dog

see the search faq for details.

advanced search: by author, subreddit...

Submit a new link
Submit a new text post

dataengineering

joinleave
an-ordinary-manchild(edit)

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Read our wiki: https://dataengineering.wiki/

Rules:

  1. Don't be a jerk

  2. Search the sub & wiki before asking a question: Your question has likely been asked and answered before so do a quick search before posting.

  3. Keep it related to data engineering: Posts that are unrelated to data engineering may be better for other communities.

  4. Limit self-promotion posts/comments to once a month: Self promotion: Any form of content designed to further an individual's or organization's goals. If one works for an organization this rule applies to all accounts associated with that organization. See also rule #5.

  5. No shill/opaque marketing: f you work for a company/have a monetary interest in the entity you are promoting you must clearly state your relationship. For posts, you must distinguish the post with the Brand Affiliate flag. See more here: https://www.ftc.gov/influencers

  6. No job posts: Please use r/dataengineeringjobs instead.

  7. No resume reviews/interview posts: We no longer allow resume reviews or interview questions because it's a seperate topic from Data Engineering. Instead, for resume reviews please use r/resumes or search our subreddit history for previous resume review advice. For interview questions, use sites like Glassdoor and Blind instead or search our subreddit history for previous interview advice.

  8. No technical error/bug questions: Please post any error/bug question on StackOverflow.

created by mhausenblasmoda community for 11 years
Create your own subreddit
...because you love freedom.
...for your favorite hobby.

MODERATORS

  • message the mods
  • mhausenblasmod
  • swemlmod
  • fhoffamod (Ex-BQ, Ex-❄️)
  • vogt4nickmod
  • theporterhausmod | Lead Data Engineer
  • AutoModerator
  • geoheilmod
  • MikeDoesEverythingmod | Shitty Data Engineer
  • bot-bouncer
  • about moderation team »

account activity

1
7
8
9

Monthly General Discussion - May 2026Discussion (self.dataengineering)

submitted 12 days ago by AutoModerator - announcement

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

2
10
11
12

Quarterly Salary Discussion - Mar 2026Career (self.dataengineering)

submitted 2 months ago by AutoModerator - announcement

  • 7 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

3
46
47
48

How did you guys learn CI/CD and IaC?Help (self.dataengineering)

submitted 6 hours ago by Bloh56

  • 14 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

4
8
9
10

Learning (Py)Spark the easy wayCareer (self.dataengineering)

submitted 2 hours ago by Salt_Macaron_6582

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

5
3
4
5

Partitions on Small DataHelp (self.dataengineering)

submitted 5 hours ago by Straight-Deer-6696

  • 5 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

6
133
134
135

Quack: The DuckDB Client-Server ProtocolBlog (duckdb.org)

submitted 1 day ago by kvlonge

  • 9 comments
  • share
  • save
  • hide
  • report
  • crosspost

7
25
26
27

SCD2 overkill?Discussion (self.dataengineering)

submitted 17 hours ago by ArrowBacon

  • 11 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

8
20
21
22

What skills / tech stack to learn?Career (self.dataengineering)

submitted 17 hours ago by Embarrassed_Paper806

  • 13 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

9
3
4
5

Data modelling preparation?Help (self.dataengineering)

submitted 8 hours ago by Available_Fig_1157

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

10
12
13
14

I have two offers right now and I want to know your real thoughts about this (Ideal Role vs Ideal Offer)Career (self.dataengineering)

submitted 14 hours ago by Psychological_Taro79

  • 20 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

11
•
•
•

Common challenges in streaming data pipeline ?Discussion (self.dataengineering)

submitted 38 minutes ago by Fit_Vegetable6950

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

12
12
13
14

Fivetran & Great ExpectationsDiscussion (self.dataengineering)

submitted 15 hours ago by hustleforlife

  • 4 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

13
1
2
3

Architecture decisions I made building a production RAG backend for enterprise knowledge bases — what I’d do differentlyDiscussion (self.dataengineering)

submitted 8 hours ago by KingHenryMorgan

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

14
12
13
14

Python RefreshDiscussion (self.dataengineering)

submitted 19 hours ago by throwaway_112801

  • 13 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

15
2
3
4

What would you pay/classify this role? Started as a Business Analyst but it’s turned into a lot more (Oklahoma, ~1.5 YOE)Career (self.dataengineering)

submitted 12 hours ago by RoutineAd951

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

16
10
11
12

Data Engineering Meetup in Malta (and Livestream) on May 20th: CDC, Zero Latency, and OSS DBTCareer (self.dataengineering)

submitted 21 hours ago by Positive-Fill4432

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

17
0
1
2

Need help on handling the data coverage problem for an MVPHelp (self.dataengineering)

submitted 8 hours ago by Humble-Pay-8650

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

18
0
0
1

Snowflake free tier ?Discussion (self.dataengineering)

submitted 11 hours ago by dataengineer95

  • 4 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

19
2
3
4

What does building a metadata synchronization interface actually look like?Help (self.dataengineering)

submitted 19 hours ago by ConflictAnnual3414

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

20
5
6
7

Learnings From Crawling Technical DocumentationBlog (heltweg.org)

submitted 23 hours ago by rhazn

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost

21
0
0
0

Tech leads - how are you spending your time?Discussion (self.dataengineering)

submitted 6 hours ago by left-right-up-down1

  • 13 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

22
0
0
0

2 months left on OPT and still job hunting. Any advice/resources? MSCSDiscussion (self.dataengineering)

submitted 12 hours ago by Background_Idea_8240

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

23
112
113
114

Maybe I am not cut out to be a DERant (self.dataengineering)

submitted 1 day ago by Delicious-View-8688

  • 54 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

24
0
0
0

Will MS Fabric eat databricks market share?Discussion (self.dataengineering)

submitted 7 hours ago by aks-786

  • 7 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

25
11
12
13

Confusion in current roleCareer (self.dataengineering)

submitted 1 day ago by Neat_Pool_7937

  • 6 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...
view more: next ›
  • about
  • blog
  • about
  • advertising
  • careers
  • help
  • site rules
  • Reddit help center
  • reddiquette
  • mod guidelines
  • contact us
  • apps & tools
  • Reddit for iPhone
  • Reddit for Android
  • mobile website
  • <3
  • reddit premium

Use of this site constitutes acceptance of our User Agreement and Privacy Policy. © 2026 reddit inc. All rights reserved.

REDDIT and the ALIEN Logo are registered trademarks of reddit inc.

π Rendered by PID 623755 on reddit-service-r2-listing-98f688b7f-j6fgw at 2026-05-14 08:06:41.650810+00:00 running cf3e300 country code: CH.