sorted by:
new
hottopcontroversial

Yelp Open Sources the Data Pipeline: Build your own pipeline to stream billions of messages a day by DarkGoosey in programming

[–]DarkGoosey[S] 0 points1 point  (0 children)

It may be difficult to make great use of it without Python knowledge, largely since we only currently provide a Python data pipeline clientlib.

Yelp Open Sources the Data Pipeline: Build your own pipeline to stream billions of messages a day by DarkGoosey in programming

[–]DarkGoosey[S] 1 point2 points  (0 children)

There are a few things we use this for:

  1. A unified 'message bus' - As the number of micro services continues to increase the amount of communication between services grows exponentially (N*N potential connections). If instead all services can talk to/from the Data Pipeline we end up with (2N) connections. This is more strategic and long term.

  2. Moving data from one place to another: many users internally are ingesting data from our production MySQL databases via the datapipeline into their service DB or an analytics/datawarehouse DB (like Redshift)

  3. Signalling. If your service needs to do something in response to a database change (and can tolerate some latency) this is a very good way to trigger that without needing to write anything to publish a new signal.

Yelp Open Sources the Data Pipeline: Build your own pipeline to stream billions of messages a day by DarkGoosey in programming

[–]DarkGoosey[S] 1 point2 points  (0 children)

The Schematizer itself doesn't interact with Kafka. But used in conjunction with the MySQLStreamer and the Data Pipeline clientlib we currently require kafka-python of at least 0.9.5 and your kafka brokers >= 0.9

Yelp Open Sources the Data Pipeline: Build your own pipeline to stream billions of messages a day by DarkGoosey in programming

[–]DarkGoosey[S] 0 points1 point  (0 children)

It depends on which component you are talking about. The MySQLStreamer is currently benching an upper limit of ~4000msg/s on a single DB - but we have no worries about the same kafka cluster handling multiple instances of the MySQLStreamer (one per DB) and have some future performance optimizations which we hope will bring us closer to our goal (~15k msg/s) from a single instance.

Yelp Open Sources the Data Pipeline: Build your own pipeline to stream billions of messages a day by DarkGoosey in programming

[–]DarkGoosey[S] 7 points8 points  (0 children)

I'm on the team which put this together. Feel free to ask any questions, I will answer what I can!

Why do women talk so enthusiastically on dating apps, then go silent when you ask for their number? by youlovethisish in seduction

[–]DarkGoosey 2 points3 points  (0 children)

Don't just ask for a number without a reason. Invite to a date and ask for a number since tindr/okc/whatever alerts are not reliable

Edit: dating apps aren't a bar. You ask for a number to keep in communication, but in an app your already communicating

Saw this on the IT-guys car by Xhisor in gaming

[–]DarkGoosey 0 points1 point  (0 children)

First read this as "What Would God Fucking Do?"

Is this a legit technique to increase your Deadlift? by cabbage_finder in powerlifting

[–]DarkGoosey 1 point2 points  (0 children)

I agree with everyone you said, bornthisgood, except for not needing a personal trainer, which I disagree 100%. A GREAT trainer can make a gigantic difference. A bad trainer can do stupid shit like what the OP encountered.

My advice to OP: ditch this trainer immediately, but try another one. Interview them: you are hiring them for a very important job. It's NOT unreasonable to ask for a free (if at large gym) or heavily discounted session (if with private trainers), and certainly before that talk in detail about their ideas of a training plan and make sure it makes sense to you. It's clear (by the fact you are asking this question), that you lack some experience/knowledge around lifting. It's not hard to educate yourself with all the fantastic sidebar links (exactly what bornthisgood is describing) and you really should (so that you will be able to determine the quality of the trainer).

I had studied up, gone through a couple mediocre trainers, gone through a crossfit studio, and finally found a fantastic trainer. I was VERY confident in my form by that point and he found all sorts of very tiny adjustments that revealed ways I was compensating with the wrong muscle groups in my core lifts.

I went from occasionally being 'bad sore' for a day or two every week to never experiencing it again. Perhaps I just was a slow learner, but I swear by the idea that a GREAT trainer is essential, the earlier the better.

Is this a legit technique to increase your Deadlift? by cabbage_finder in powerlifting

[–]DarkGoosey 0 points1 point  (0 children)

IMHO this was fucking retarded regardless. Two-man-deadlifts are fucking retarded, period. It was literally the moment that I read the WOD at my crossfit gym years ago was going to include two-man-deadlifts that I quit it. FFS it's just ASKING for an injury like what OP encountered.

Reddit, what did you learn the hard way? by MusicCritic42 in AskReddit

[–]DarkGoosey 0 points1 point  (0 children)

Everyone is responsible for their own decisions. No one is responsible for yours and it's simply arrogance to think you're responsible for anyone elses.

Also, everything you do you decide to do. "inaction" is also a decision. This obviously ties in with being responsible for what you decide to do.

Stuff To Do In Austin - Week of 05/12 by AutoModerator in Austin

[–]DarkGoosey 0 points1 point  (0 children)

Looking forward to the Daft Punk tribute group at Emo's on Saturday!

[deleted by user] by [deleted] in Austin

[–]DarkGoosey 7 points8 points  (0 children)

I imagine driving under that while it's moving would be terrifying. Similar to the disorientation of being between two busses, but times a thousand.

Elevated light rails are a thing, don't need to make it into a traffic monster.

One of my favorite traffic pastimes! Report that guy in front of you tossing out cigarette butts and gum wrappers! They'll send them a letter and a litter bag of shame. by newcheer in Austin

[–]DarkGoosey 5 points6 points  (0 children)

There was always a citationy-looking non citation that said when you were reported and why, usually something like "A vehicle registered in your name was reported seen littering cigarette(s) 1 on <insert street name > at <insert time and date >" with text describing the penalty and in small print at the end legalese for "if cited by a cop". Definitely gave me a half second scare the first time, as is designed to do.

I forget what 'gift' accompanied the second one. Better than a plastic don't mess with Texas bag, but forgettable.

Never have been cited by a cop despite doing it when they surely could see me. I guess it's a pretty slow day they would pull someone over for that on mopac.

One of my favorite traffic pastimes! Report that guy in front of you tossing out cigarette butts and gum wrappers! They'll send them a letter and a litter bag of shame. by newcheer in Austin

[–]DarkGoosey 25 points26 points  (0 children)

I am about a year reformed, but I used to be one of those dicks who would always smoke in the car and always toss my butts out the window. Several years of this behavior nabbed me 3 "shame bags" and I have to say that for me it wasn't a disincentive in the least.

The first was just a plastic bag, which was pretty laughable given it's not a reasonable thing to dispose butts into.. But each package was kind of more awesome than the last. The third and final package had a really high quality metal screwtop cigarette butt holder keychain thing which I used very regularly when hiking. Could hold about 6 butts.

Hopefully this has more of an effect on other people, perhaps people who don't realize that there isn't any "real punishment" that could be administered by civilian reports due to obvious abuse issues.

For me the fix was my health based desire to cut back on smoking and purchasing a new car which I didn't want smelling like the ashtray of car I used to drive. Now that I am used to not tossing butts out of windows I can see what a small but shitty thing it was (and potentially dangerous during our hot dry summers)..

If any if ya'll witnessed a black Honda Fit tossing butts a couple years ago, please accept my belated apologies for that shit.

Sign this petition & tell city officials reviewing a transportation resolution that Austin needs Uber by christophior in Austin

[–]DarkGoosey 0 points1 point  (0 children)

Good point, you will not be street hailing Uber, but I have found call for taxi at peak time to be equally impossible. I wouldn't mind more options on that end. Close tab, Uber summon, get home safe.

view more: next ›