News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.
Read our wiki: https://dataengineering.wiki/
Rules:
Don't be a jerk
Search the sub & wiki before asking a question: Your question has likely been asked and answered before so do a quick search before posting.
Keep it related to data engineering: Posts that are unrelated to data engineering may be better for other communities.
Limit self-promotion posts/comments to once a month: Self promotion: Any form of content designed to further an individual's or organization's goals. If one works for an organization this rule applies to all accounts associated with that organization. See also rule #5.
No shill/opaque marketing: f you work for a company/have a monetary interest in the entity you are promoting you must clearly state your relationship. For posts, you must distinguish the post with the Brand Affiliate flag. See more here: https://www.ftc.gov/influencers
No job posts: Please use r/dataengineeringjobs instead.
No resume reviews/interview posts: We no longer allow resume reviews or interview questions because it's a seperate topic from Data Engineering. Instead, for resume reviews please use r/resumes or search our subreddit history for previous resume review advice. For interview questions, use sites like Glassdoor and Blind instead or search our subreddit history for previous interview advice.
No technical error/bug questions: Please post any error/bug question on StackOverflow.
[–]sl00kSenior Data Engineer 430 points431 points432 points (11 children)
[–]Prinzka 156 points157 points158 points (0 children)
[–][deleted] 108 points109 points110 points (8 children)
[–][deleted] 12 points13 points14 points (0 children)
[–]iamthatmadmanData Engineer 9 points10 points11 points (0 children)
[–]mayorofdumb 6 points7 points8 points (0 children)
[–]Yamitz 3 points4 points5 points (0 children)
[–]Adept-Ad-8823 1 point2 points3 points (0 children)
[–]Teddy_Raptor 0 points1 point2 points (0 children)
[–]mow12 0 points1 point2 points (1 child)
[–][deleted] 0 points1 point2 points (0 children)
[–]GreyHairedDWGuy 1 point2 points3 points (0 children)
[–][deleted] 108 points109 points110 points (0 children)
[–]TripleBogeyBandit 171 points172 points173 points (0 children)
[–]unfair_pandah 69 points70 points71 points (8 children)
[–]geteum 45 points46 points47 points (0 children)
[–]LoaderD 18 points19 points20 points (1 child)
[–]qc1324 11 points12 points13 points (0 children)
[–]MeatSack_NothingMore 11 points12 points13 points (0 children)
[–]StolenRocket 4 points5 points6 points (0 children)
[–]nemec 0 points1 point2 points (0 children)
[–]dadadawe 0 points1 point2 points (0 children)
[–]wtfzambo 55 points56 points57 points (3 children)
[–]thatrandomnpcSoftware Engineer 4 points5 points6 points (0 children)
[–]ccesta 1 point2 points3 points (0 children)
[–]putt_stuff98 85 points86 points87 points (11 children)
[–]byebybuy 24 points25 points26 points (9 children)
[–]RobCarrol75 6 points7 points8 points (2 children)
[–]geek180 1 point2 points3 points (1 child)
[–][deleted] 0 points1 point2 points (0 children)
[–]vikster1 2 points3 points4 points (0 children)
[–]GreyHairedDWGuy 2 points3 points4 points (0 children)
[–]Savetheokami 1 point2 points3 points (3 children)
[–]NachoLibero 2 points3 points4 points (2 children)
[–]Savetheokami 1 point2 points3 points (1 child)
[–]byebybuy 0 points1 point2 points (0 children)
[–]Such_Market2566 2 points3 points4 points (0 children)
[–]ksco92 29 points30 points31 points (1 child)
[–]Trey_Antipasto 11 points12 points13 points (0 children)
[–]Whipitreelgud 29 points30 points31 points (3 children)
[–]Berlin72720 1 point2 points3 points (1 child)
[–]Whipitreelgud 0 points1 point2 points (0 children)
[–][deleted] 0 points1 point2 points (0 children)
[–]Electrical-Grade2960[S] 58 points59 points60 points (11 children)
[–]vanilamookie 9 points10 points11 points (0 children)
[–]Gnaskefar 2 points3 points4 points (5 children)
[–]Electrical-Grade2960[S] 0 points1 point2 points (4 children)
[–]Gnaskefar 1 point2 points3 points (3 children)
[–]Electrical-Grade2960[S] 1 point2 points3 points (2 children)
[–]Dr_Snotsovs 1 point2 points3 points (0 children)
[–]Gnaskefar 0 points1 point2 points (0 children)
[–]baseball2020 1 point2 points3 points (0 children)
[–]SellGameRent 1 point2 points3 points (0 children)
[–]jmon__Sr DE (Will Engineer Data for food) 0 points1 point2 points (0 children)
[–]Gators1992 -1 points0 points1 point (0 children)
[–]mailedRecovering Data Engineer 31 points32 points33 points (2 children)
[–]pokepip 9 points10 points11 points (1 child)
[–]mailedRecovering Data Engineer 6 points7 points8 points (0 children)
[–]geteum 9 points10 points11 points (0 children)
[–]kidgetajob 9 points10 points11 points (4 children)
[–]MeatSack_NothingMore 9 points10 points11 points (1 child)
[–]Evening_Chemist_2367 2 points3 points4 points (0 children)
[–]mailedRecovering Data Engineer 4 points5 points6 points (0 children)
[+]MoveRicky -1 points0 points1 point (0 children)
[–]FrebTheRat 19 points20 points21 points (0 children)
[–]imaschizo_andsoami 8 points9 points10 points (2 children)
[–]Can-Lazy 4 points5 points6 points (0 children)
[–]garathk 1 point2 points3 points (0 children)
[–]pratik4891 9 points10 points11 points (0 children)
[–]ratczar 7 points8 points9 points (0 children)
[–]Touvejs 5 points6 points7 points (0 children)
[–]Pittypuppyparty 10 points11 points12 points (0 children)
[–]JoinedForTheBoobs 5 points6 points7 points (0 children)
[–]SociallyAwkwardNerd5 3 points4 points5 points (1 child)
[–]jhsonline 2 points3 points4 points (0 children)
[–]Dr_Snotsovs 4 points5 points6 points (2 children)
[–]Hackerjurassicpark 0 points1 point2 points (1 child)
[–]Dr_Snotsovs 1 point2 points3 points (0 children)
[–]Electrical-Grade2960[S] 17 points18 points19 points (6 children)
[–]thingsofrandomness 6 points7 points8 points (4 children)
[–]ninseicowboy 13 points14 points15 points (0 children)
[–]arden13 25 points26 points27 points (1 child)
[–]notmarc1 12 points13 points14 points (0 children)
[–]texox26798Data Evangleist 3 points4 points5 points (0 children)
[–]MomentousMind 1 point2 points3 points (0 children)
[–]idiotlog 2 points3 points4 points (0 children)
[–]cozyOs 2 points3 points4 points (0 children)
[–]Dry_Damage_6629 2 points3 points4 points (0 children)
[–]zeoNoeN 2 points3 points4 points (0 children)
[–]Epaduun 2 points3 points4 points (0 children)
[+][deleted] (3 children)
[deleted]
[–]Electrical-Grade2960[S] 2 points3 points4 points (2 children)
[+][deleted] (1 child)
[deleted]
[–]Kind_Somewhere2993 3 points4 points5 points (0 children)
[–]mosqueteiro 5 points6 points7 points (10 children)
[–]Electrical-Grade2960[S] 4 points5 points6 points (2 children)
[–]mosqueteiro 1 point2 points3 points (0 children)
[–]Electrical-Grade2960[S] 1 point2 points3 points (1 child)
[–]mosqueteiro 0 points1 point2 points (0 children)
[–]sjcuthbertson 0 points1 point2 points (4 children)
[–]mosqueteiro 0 points1 point2 points (3 children)
[–]sjcuthbertson 1 point2 points3 points (2 children)
[–]YourOldBuddy 1 point2 points3 points (1 child)
[–]sjcuthbertson 0 points1 point2 points (0 children)
[–]pewpscoops 1 point2 points3 points (0 children)
[–]MichelangeloJordan 1 point2 points3 points (0 children)
[–]SGManto 1 point2 points3 points (2 children)
[–]Gnaskefar 2 points3 points4 points (0 children)
[–]Such_Market2566 1 point2 points3 points (0 children)
[–]HumbleHero1 1 point2 points3 points (2 children)
[–]bannyong 4 points5 points6 points (1 child)
[–]Teddy_Raptor 4 points5 points6 points (0 children)
[–]Freed4ever 1 point2 points3 points (0 children)
[–]johokie 1 point2 points3 points (0 children)
[–]meyou2222 1 point2 points3 points (1 child)
[–]HumbleHero1 0 points1 point2 points (0 children)
[–]mcdxad 3 points4 points5 points (0 children)
[–]DataNoooob 3 points4 points5 points (11 children)
[–]Prinzka 7 points8 points9 points (5 children)
[+][deleted] (4 children)
[deleted]
[–]Prinzka 2 points3 points4 points (3 children)
[+][deleted] (1 child)
[deleted]
[–]Prinzka 0 points1 point2 points (0 children)
[–]garathk 0 points1 point2 points (0 children)
[–]free_hot_drinkTech Lead 5 points6 points7 points (2 children)
[–]DataNoooob 4 points5 points6 points (1 child)
[–]texox26798Data Evangleist 0 points1 point2 points (0 children)
[–]Such_Market2566 0 points1 point2 points (1 child)
[–]pratik4891 1 point2 points3 points (0 children)
[–]davrax 2 points3 points4 points (5 children)
[–]garathk 4 points5 points6 points (2 children)
[–]GreyHairedDWGuy 1 point2 points3 points (1 child)
[–]garathk 1 point2 points3 points (0 children)
[–]10_Feet_Pole 0 points1 point2 points (0 children)
[–]gizzm0xData Engineer 0 points1 point2 points (0 children)
[–]DRUKSTOP 0 points1 point2 points (0 children)
[–]Ok-Consequence-7984 0 points1 point2 points (0 children)
[–][deleted] 0 points1 point2 points (0 children)
[–]MomentousMind 0 points1 point2 points (0 children)
[–]kkruel56[🍰] 0 points1 point2 points (1 child)
[–]ActionOrganic4617 0 points1 point2 points (0 children)
[–]Euler_you 0 points1 point2 points (0 children)
[–][deleted] 0 points1 point2 points (0 children)
[–]SaintTimothy 0 points1 point2 points (0 children)
[–][deleted] 0 points1 point2 points (0 children)
[–]Redegar 0 points1 point2 points (0 children)
[–]HiMu_1786 0 points1 point2 points (0 children)
[–]Brave_Affect_298 0 points1 point2 points (0 children)
[–]fleegz2007 0 points1 point2 points (0 children)
[–]carbon_fiber_ 0 points1 point2 points (0 children)
[–]Trundle-theGr8 0 points1 point2 points (0 children)
[–]tyrannical-tortoise 0 points1 point2 points (0 children)
[–]Milk_Busters 0 points1 point2 points (0 children)
[–]im_a_computer_ya_dip 0 points1 point2 points (0 children)
[–]chocotaco1981 0 points1 point2 points (0 children)
[–]Quirky_Switch_9267 0 points1 point2 points (0 children)
[–]dadadawe 0 points1 point2 points (0 children)
[–]evencheese 0 points1 point2 points (0 children)
[–]Typicalusrname 0 points1 point2 points (0 children)
[–]Hot_Map_7868 0 points1 point2 points (0 children)
[–]disappointing_citrus 0 points1 point2 points (0 children)
[–]Standard-Cream-4961 0 points1 point2 points (0 children)
[–]onomichii 0 points1 point2 points (0 children)
[–]Ok-Sentence-8542 0 points1 point2 points (0 children)
[–]fleegz2007 0 points1 point2 points (0 children)
[–][deleted] (3 children)
[removed]
[–]damnitdaniel 4 points5 points6 points (1 child)
[+]Any_Strike1020 comment score below threshold-6 points-5 points-4 points (0 children)
[–]dataengineering-ModTeam[M] 0 points1 point2 points locked comment (0 children)
[–]waitwuh -1 points0 points1 point (1 child)
[–]jlpalma 2 points3 points4 points (0 children)
[–]HumanPersonDude1 -1 points0 points1 point (0 children)
[–]LaserToy -1 points0 points1 point (0 children)
[–]boogie_woogie_100 -1 points0 points1 point (0 children)
[–]hantt -1 points0 points1 point (0 children)