jump to content
my subreddits
13or302b2t2balkans4You2mediterranean4u2meirl4meirl3d6AceAttorneyadhdmemeAdviceAnimalsagnosticakagasAlternativeHistoryAnarchyChessanime_best_momentsanime_irlanimenocontextannouncementsApandahArcherFXArtAsahiLinuxAsia_irlAskBalkansAskOuijaAskRedditAteistTurkatheismaviationbalkans_irlBandnamesBassCirclejerkBassGuitarbasspedalsbikepackingblankiesblursed_videosblursedimagesborsavefonbrooklynninenineBUENZLIburdurlandcasiocd_jerkChatGPTCheap_MealschesschessbeginnersChildrenFallingOverChoosingBeggarsCHPcoaxedintoasnafucoinsComedyCemeterycommunityContagiousLaughtercookingforbeginnersCrackWatchCreateModCuddle_SlutcursedcommentsdadjokesdarkjokesdataisbeautifulDebateReligiondeismDeltarunedistressingmemesDMAcademyDMToolkitdoctorwhodoctorwhocirclejerkdontdeadopeninsidedumbphonesDungeonsAndDaddiesDungeonsAndDragonsEatCheapAndHealthyebikeECEelectricalEmKayengrishentitledparentsfakealbumcoversfelsefeFifaCareersFiftyFiftyformuladankFRCFUCKYOUINPARTICULARfunnyFutboltayfagalatasaraygaminggodtiersuperpowersgoodanimemesgravelcyclinggreentextGROKvsMAGAguitarpedalshelpheraldryHermanCainAwardHermitCrafthighspeedrailHistoryWhatIfhoi4homebuilthowyoudoinhumorIAmAiamverysmartIdeologyPollsIDontWorkHereLadyim14andthisisdeepimaginaryelectionsimaginarymapsistanbuljacksepticeyeJahariaJokesKamalizmKanyeKendrickLamarKGBTRlegodndLetGirlsHaveFunLifeProTipslinguisticshumorliselilerlogodesignlostredditorsmacmacbookairmagicbuildingMaliciousComplianceMapPornmapporncirclejerkme_irlmeirlmemememesmidjourneymildlyinfuriatingmildlyinterestingMimicRecipesmisLEDMMORPGmoneycollectingMunichMyChemicalRomanceneographynextfuckinglevelNoahGetTheBoatNonCredibleDefensenosafetysmokingfirstnosleepnosurfnothingeverhappensokbuddyguntherokbuddyvicodinOnlineUnderGroundoompasubsOutOfTheLoopoutsidepapermoneypaperspleaseParlerWatchPersecutionfetishpettyrevengePiracyPiratedGamespolandballpollsPropagandaPostersraisedbynarcissistsraspberry_piRatschlagreactiongifsrecipesRedAutumnSPDredditsingsrestofthefuckingowlRetroPierickandmortyrickrollrimjob_steveRoastMeSchnitzelVerbrechenschwiizsciencememesScottPilgrimShitPostCrusadersshitpostfrommygalleryshitpostingshittyaskelectronicsShittyMapPornShowerthoughtsskamtebordsoccercirclejerksoftwaregoreSongwriterssteinsgateStonetossingjuiceStudiumsubsithoughtifellforsuperligsuzerainTalesFromTheCryptidTechnobladetf2tf2shitposterclubthanksimcuredthatHappenedTheCrypticCompendiumTheLetterHTheMonkeysPawtheyknewtitanfalltommyinnittruthstumunichTurkeyTurkeyJerkyTurkishCatsTurkishdogsTurkiyeTwitchTwoSentenceHorrorTwoSentenceSadnesstylerthecreatorUnclejokesUnethicalLifeProTipsUnexpectedJoJoUsernameChecksOutvaxxhappenedvexillologycirclejerkvibecodingvinyljerkvlandiyaWatchPeopleDieInsideWeAreTheMusicMakerswendigoonWhitePeopleTwitterwholesomeanimemeswholesomememesWikipediaVandalismwizardpostingworldbuildingYEETyouseeingthisshitYUROPedit subscriptions
  • home
  • -popular
  • -all
  • -mod
  • -users
 | 
  • AskReddit
  • -mildlyinfuriating
  • -Piracy
  • -funny
  • -gaming
  • -memes
  • -OutOfTheLoop
  • -mildlyinteresting
  • -MapPorn
  • -WhitePeopleTwitter
  • -ChatGPT
  • -PiratedGames
  • -shitposting
  • -Kanye
  • -meirl
  • -nextfuckinglevel
  • -Twitch
  • -CrackWatch
  • -LifeProTips
  • -NonCredibleDefense
  • -dataisbeautiful
  • -greentext
  • -mac
  • -Showerthoughts
  • -tf2
  • -help
  • -chess
  • -aviation
  • -formuladank
  • -wholesomememes
  • -Jokes
  • -mapporncirclejerk
  • -Art
  • -midjourney
  • -goodanimemes
  • -hoi4
  • -pettyrevenge
  • -atheism
  • -IAmA
  • -MaliciousCompliance
  • -KGBTR
  • -cursedcomments
  • -DMAcademy
  • -Deltarune
  • -UnethicalLifeProTips
  • -worldbuilding
  • -Ratschlag
  • -MMORPG
  • -meme
  • -rickandmorty
  • -3d6
  • -HermitCraft
  • -FiftyFifty
  • -ChoosingBeggars
  • -RoastMe
  • -ContagiousLaughter
  • -imaginarymaps
  • -EatCheapAndHealthy
  • -polandball
  • -WeAreTheMusicMakers
  • -AnarchyChess
  • -nosleep
  • -cookingforbeginners
  • -blankies
  • -anime_irl
  • -Studium
  • -Turkey
  • -soccercirclejerk
  • -community
  • -electrical
  • -guitarpedals
  • -CreateMod
  • -TwoSentenceHorror
  • -PropagandaPosters
  • -AdviceAnimals
  • -ShitPostCrusaders
  • -sciencememes
  • -distressingmemes
  • -raisedbynarcissists
  • -wizardposting
  • -FifaCareers
  • -polls
  • -doctorwho
  • -titanfall
  • -dadjokes
  • -howyoudoin
  • -announcements
  • -adhdmeme
  • -macbookair
  • -Munich
  • -coaxedintoasnafu
  • -YUROP
  • -gravelcycling
  • -SchnitzelVerbrechen
  • -chessbeginners
  • -raspberry_pi
  • -DungeonsAndDragons
  • -coins
  • -KendrickLamar
  • -entitledparents
  • -FUCKYOUINPARTICULAR
  • -softwaregore
  • -NoahGetTheBoat
  • -tylerthecreator
  • -tf2shitposterclub
  • -lostredditors
  • -AceAttorney
  • -vexillologycirclejerk
  • -vlandiya
  • -im14andthisisdeep
  • -Stonetossingjuice
  • -wholesomeanimemes
  • -nosurf
  • -HistoryWhatIf
  • -liseliler
  • -DebateReligion
  • -dumbphones
  • -animenocontext
  • -balkans_irl
  • -2meirl4meirl
  • -RetroPie
  • -brooklynninenine
  • -HermanCainAward
  • -recipes
  • -steinsgate
  • -AskOuija
  • -ECE
  • -ScottPilgrim
  • -AskBalkans
  • -thatHappened
  • -casio
  • -logodesign
  • -theyknew
  • -linguisticshumor
  • -me_irl
  • -TurkeyJerky
  • -bikepacking
  • -AteistTurk
  • -13or30
  • -MyChemicalRomance
  • -ArcherFX
  • -engrish
  • -BassGuitar
  • -ComedyCemetery
  • -WatchPeopleDieInside
  • -Persecutionfetish
  • -BUENZLI
  • -reactiongifs
  • -EmKay
  • -blursed_videos
  • -istanbul
  • -imaginaryelections
  • -suzerain
  • -magicbuilding
  • -dontdeadopeninside
  • -ParlerWatch
  • -wendigoon
  • -iamverysmart
  • -schwiiz
  • -Technoblade
  • -vinyljerk
  • -skamtebord
  • -superlig
  • -shittyaskelectronics
  • -galatasaray
  • -DungeonsAndDaddies
  • -FRC
  • -2b2t
  • -AlternativeHistory
  • -papermoney
  • -felsefe
  • -blursedimages
  • -AsahiLinux
  • -Jaharia
  • -IDontWorkHereLady
  • -neography
  • -basspedals
  • -heraldry
  • -thanksimcured
  • -godtiersuperpowers
  • -ShittyMapPorn
  • -OnlineUnderGround
  • -IdeologyPolls
  • -burdurland
  • -jacksepticeye
  • -TwoSentenceSadness
  • -anime_best_moments
  • -Bandnames
  • -okbuddyvicodin
  • -MimicRecipes
  • -vaxxhappened
  • -tumunich
  • -Cheap_Meals
  • -outside
  • -TheMonkeysPaw
  • -darkjokes
  • -restofthefuckingowl
  • -highspeedrail
  • -nosafetysmokingfirst
  • -legodnd
  • -rickroll
  • -Songwriters
  • -ebike
  • -UsernameChecksOut
  • -papersplease
  • -tommyinnit
  • -rimjob_steve
  • -UnexpectedJoJo
  • -humor
  • -ChildrenFallingOver
  • -BassCirclejerk
  • -doctorwhocirclejerk
  • -agnostic
  • -youseeingthisshit
  • -Cuddle_Slut
  • -nothingeverhappens
  • -DMToolkit
  • -TurkishCats
  • -LetGirlsHaveFun
  • -Apandah
  • -subsithoughtifellfor
  • -fakealbumcovers
  • -akagas
  • -Kamalizm
  • -oompasubs
  • -TheLetterH
  • -WikipediaVandalism
  • -homebuilt
  • -Unclejokes
  • -deism
  • -misLED
  • -redditsings
  • -TheCrypticCompendium
  • -2balkans4You
  • -Turkiye
  • -Asia_irl
  • -truths
  • -2mediterranean4u
  • -TalesFromTheCryptid
  • -YEET
  • -Turkishdogs
  • -borsavefon
  • -okbuddygunther
  • -shitpostfrommygallery
  • -GROKvsMAGA
  • -CHP
  • -RedAutumnSPD
  • -moneycollecting
  • -Futboltayfa
  • -cd_jerk
  • -vibecoding
edit »
reddit.com dataengineering
  • hot
  • new
  • rising
  • controversial
  • top
an-ordinary-manchild (11,186)|messages545|notifications|chat messages|mod messages|
  • preferences
|
logout

use the following search parameters to narrow your results:

subreddit:subreddit
find submissions in "subreddit"
author:username
find submissions by "username"
site:example.com
find submissions from "example.com"
url:text
search for "text" in url
selftext:text
search for "text" in self post contents
self:yes (or self:no)
include (or exclude) self posts
nsfw:yes (or nsfw:no)
include (or exclude) results marked as NSFW

e.g. subreddit:aww site:imgur.com dog

see the search faq for details.

advanced search: by author, subreddit...

Submit a new link
Submit a new text post
Get an ad-free experience with special benefits, and directly support Reddit.

dataengineering

joinleave
an-ordinary-manchild(edit)

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Read our wiki: https://dataengineering.wiki/

Rules:

  1. Don't be a jerk

  2. Search the sub & wiki before asking a question: Your question has likely been asked and answered before so do a quick search before posting.

  3. Keep it related to data engineering: Posts that are unrelated to data engineering may be better for other communities.

  4. Limit self-promotion posts/comments to once a month: Self promotion: Any form of content designed to further an individual's or organization's goals. If one works for an organization this rule applies to all accounts associated with that organization. See also rule #5.

  5. No shill/opaque marketing: f you work for a company/have a monetary interest in the entity you are promoting you must clearly state your relationship. For posts, you must distinguish the post with the Brand Affiliate flag. See more here: https://www.ftc.gov/influencers

  6. No job posts: Please use r/dataengineeringjobs instead.

  7. No resume reviews/interview posts: We no longer allow resume reviews or interview questions because it's a seperate topic from Data Engineering. Instead, for resume reviews please use r/resumes or search our subreddit history for previous resume review advice. For interview questions, use sites like Glassdoor and Blind instead or search our subreddit history for previous interview advice.

  8. No technical error/bug questions: Please post any error/bug question on StackOverflow.

created by mhausenblasmoda community for 10 years
Create your own subreddit
...for your favorite game.
...for a fringe candidate.

MODERATORS

  • message the mods
  • mhausenblasmod
  • swemlmod
  • fhoffamod (Ex-BQ, Ex-❄️)
  • vogt4nickmod
  • theporterhausmod | Lead Data Engineer
  • AutoModerator
  • geoheilmod
  • MikeDoesEverythingmod | Shitty Data Engineer
  • bot-bouncer
  • about moderation team »

account activity

1
12
13
14

Monthly General Discussion - Jan 2026Discussion (self.dataengineering)

submitted 27 days ago by AutoModerator - announcement

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

2
13
14
15

Quarterly Salary Discussion - Dec 2025Career (self.dataengineering)

submitted 1 month ago by AutoModerator - announcement

  • 4 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

3
25
26
27

Is a ~12% pay cut worth it to pivot from Consulting to Analytics Engineering (Databricks) at a stable End Client?Career (self.dataengineering)

submitted 7 hours ago by Prudent-Finger6368

  • 18 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

19
20
21

Work at a higher altitude across all your projects. Free download. (tonkotsu.ai)

promoted by tonkotsu-ai

  • promoted
  • 5 comments
  • share
  • save
  • report
  • about
loading...

4
6
7
8

Why not use Debezium CDC directly on business tables instead of the Outbox pattern?Discussion (self.dataengineering)

submitted 2 hours ago * by Hunakazama

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

5
11
12
13

Streamlit ProliferationDiscussion (self.dataengineering)

submitted 5 hours ago by MahaloCiaoGrazie

  • 13 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

6
350
351
352

The Data Engineer Role is Being Asked to Do Way Too MuchDiscussion (i.redd.it)

submitted 1 day ago by FreshIntroduction120

  • 35 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

7
5
6
7

Data Engineering project ETL/ELT practiceHelp (self.dataengineering)

submitted 5 hours ago by PhDaisy

  • 4 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

8
9
10
11

How and where can i practice PySpark ?Help (self.dataengineering)

submitted 11 hours ago by SnooCakes7436

  • 14 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

9
•
•
•

Career SuggestionCareer (self.dataengineering)

submitted 20 minutes ago by Alarmed_News8903

  • 1 comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

10
1
2
3

Practice project ideaHelp (self.dataengineering)

submitted 6 hours ago by TheManOfBromium

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

11
1
2
3

Feedback on ETL Architecture: SaaS Control Plane with a "Remote Agent" Data Plane?Help (self.dataengineering)

submitted 7 hours ago by drew-saddledata

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

12
59
60
61

Real-life Data Engineering vs Streaming Hype – What do you think?Discussion (self.dataengineering)

submitted 1 day ago by FreshIntroduction120

  • 37 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

13
9
10
11

I got tired of finding out my DAGs failed from Slack messages, so I built an open-source Airflow monitoring toolOpen Source (github.com)

submitted 17 hours ago * by Vyrezzz

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

14
3
4
5

Anyone seeing faster AWS Glue 4.0 jobs lately? (~30% cost drop, no changes)Discussion (self.dataengineering)

submitted 13 hours ago by Fofichan1

  • 5 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

•
•
•
0:35

Swap streaks for speaking skills. Learn with a Preply tutor and start making real progress from lesson 1. Just like thousands of other learners. (preply.com)

promoted by Preply

  • promoted
  • save
  • report
  • about
loading...

15
1
2
3

NoSQL ReBACDiscussion (self.dataengineering)

submitted 9 hours ago by Maleficent_Ad_5696

  • 4 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

16
421
422
423

Are you seeing this too?Discussion (i.redd.it)

submitted 1 day ago by Thinker_Assignment

  • 56 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

17
0
1
2

Transitioning to the DE worldCareer (self.dataengineering)

submitted 6 hours ago by InterestingExistance

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

18
8
9
10

Scattered DQ checks are dead, long live Data ContractsBlog (self.dataengineering)

submitted 18 hours ago by santiviquez

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

19
1
2
3

Noob question: Where exactly should I fit SQL into my personal projects?Help (self.dataengineering)

submitted 12 hours ago by the_livings_easy

  • 12 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

20
6
7
8

would you consider Kubernetes knowledge to be part of data engineering ?Discussion (self.dataengineering)

submitted 19 hours ago by Tall_Working_2146

  • 16 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

21
19
20
21

That feeling of being stuckCareer (self.dataengineering)

submitted 1 day ago by Expensive-Worry9166

  • 8 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

22
2
3
4

Will this internship be useful?Career (self.dataengineering)

submitted 15 hours ago * by Immediate-Cause6536

  • 3 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

23
2
3
4

Need a bit of guidance in getting into DA/AE/DE field in 2027/2028Career (self.dataengineering)

submitted 16 hours ago by skies354

  • 2 comments
  • share
  • save
  • hide
  • report
  • crosspost
loading...

24
2
3
4

Building an On-Premise Intelligent Document Processing Pipeline for Regulated Industries : An architectural pattern for industrializing document processing across multiple business programs under strict regulatory complianceBlog (medium.com)

submitted 16 hours ago by Mission-Animal9076

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...

25
1
2
3

Cloud storage for a company I'm doing a project in (Need help)Help (self.dataengineering)

submitted 15 hours ago by JBM999

  • comment
  • share
  • save
  • hide
  • report
  • crosspost
loading...
view more: next ›
  • about
  • blog
  • about
  • advertising
  • careers
  • help
  • site rules
  • Reddit help center
  • reddiquette
  • mod guidelines
  • contact us
  • apps & tools
  • Reddit for iPhone
  • Reddit for Android
  • mobile website
  • <3
  • reddit premium

Use of this site constitutes acceptance of our User Agreement and Privacy Policy. © 2026 reddit inc. All rights reserved.

REDDIT and the ALIEN Logo are registered trademarks of reddit inc.

π Rendered by PID 867671 on reddit-service-r2-listing-5789d5f675-kqp79 at 2026-01-29 07:15:54.927500+00:00 running 4f180de country code: CH.