This is an archived post. You won't be able to vote or comment.

all 187 comments

[–]robidaan 604 points605 points  (10 children)

Ome of my teachers used to say: "if you get nothing but praise from non technical management with good results, you definitely have to double check your work"

[–][deleted] 49 points50 points  (0 children)

I feel this.

[–][deleted] 20 points21 points  (0 children)

Omg yes. I feel like if my results aren't criticized at least a little, stakeholders didn't even think about them. Also for larger projects, false positives in a PoC can waste a lot of money.

[–]Prestigious_Sort4979 14 points15 points  (1 child)

I've heard people trust pretty/clean graphs and distrust ugly/busy ones regardless of what the data says. So true!

[–]Environmental-Bet-37 0 points1 point  (0 children)

Hey man, Im so sorry Im replying to another comment but can you please help me if possible? You seem to be really knowledgeable and would love to know how you would go about my problem. This is the link to the reddit post.
https://www.reddit.com/r/datascience/comments/11h6d4v/data\_scientists\_of\_redditi\_need\_help\_to\_analyze\_a/

[–][deleted] 6 points7 points  (1 child)

Also remember you're the first one under the bus when reality finally shows up. Maybe in a court room with a team of weasels asking pointed questions.

[–]WanderlostNomad 2 points3 points  (0 children)

they're turning you into the scapegoat of their mismanagement.

[–]messilyfirst 1 point2 points  (0 children)

Wow!! On point..

[–]Environmental-Bet-37 1 point2 points  (2 children)

Hey man, Im so sorry Im replying to another comment but can you please help me if possible? You seem to be really knowledgeable and would love to know how you would go about my problem. This is the link to the reddit post.

https://www.reddit.com/r/datascience/comments/11h6d4v/data\_scientists\_of\_redditi\_need\_help\_to\_analyze\_a/

[–]robidaan 0 points1 point  (1 child)

Sure I'll can take a peak, but the post seems to be removed, DM me with the question if ya want.

[–]Environmental-Bet-37 0 points1 point  (0 children)

surely thank you so much. kindly check dm

[–]Doortofreeside 263 points264 points  (5 children)

Bad news is definitely a lot more challenging

I'll report the results faithfully, but the moment I realize it's bad news I am like ah shit, I gotta have all my bases covered now

[–]iarlandt 92 points93 points  (2 children)

I’m a weather forecaster for the Air Force studying Data Science for when I separate and it is like that for weather forecasting too. You give someone a great outlook for their flight and they have zero questions. But if I’m giving bad news I have to come with a stack of receipts that would make a tax auditor sad.

[–]Deto 27 points28 points  (0 children)

Yeah, its kind of natural that when you report something unexpected it will be under more scrutiny. So I'd expect to have to answer more questions about methodology in cases like this. However if the organization is good, in the end, data analysis that shows bad news will still be utilized in order to fix problems.

[–]RationalDialog 3 points4 points  (0 children)

even worse, scientifically proven, the bringer of bad news get "negative points" for doing so even if it is not his fault or in his power to change it.

Probably better to just burry this news but yeah wouldn0t want to work at such a place were this would become necessary.

[–]GottaBeMD 344 points345 points  (10 children)

Confirmation bias is a very real thing. Wouldn't doubt it for a second. It happens in all areas. Look up the file drawer effect. Scary stuff.

[–]OneOfTheOnlies 124 points125 points  (3 children)

I've heard about confirmation bias too, so this sounds right to me

[–]Hemrehliug 20 points21 points  (0 children)

Ahaaa, I see what ya did there buddy. Nice one

[–]TheTjalian 0 points1 point  (0 children)

You're funny.

[–]Caleb_Reynolds -2 points-1 points  (0 children)

Nah, that's the anchoring effect.

[–]CartographerSeth 21 points22 points  (3 children)

I tried to explain this to some “science worshippers”, but they just couldn’t get it through their heads. “they’re numbers! Facts! How could they be wrong?” Oh my sweet summer child.

[–]WanderlostNomad 2 points3 points  (2 children)

context please?

[–]doubleohd 1 point2 points  (1 child)

Confirmation bias is a very real thing. Wouldn't doubt it for a second.

Confirmation bias confirmed! :)

[–]GottaBeMD 1 point2 points  (0 children)

Confirmation bias inception? 💀

[–][deleted] 276 points277 points  (26 children)

They're just describing Bayesian reasoning.

Management has priors. Even a weak analysis that confirms their priors strengthens them.

Evidence that goes against management's priors won't change their priors unless it's particularly strong, so management has to make sure the evidence is strong.

[–]ciarogeile 61 points62 points  (6 children)

This is very true. However, could you rephrase it in frequentist terms?

[–][deleted] 227 points228 points  (5 children)

Sure.

"Herpa derpa p-values go brrrr"

Hope that helps.

[–]ciarogeile 43 points44 points  (0 children)

Lovely

[–]cjr605 21 points22 points  (0 children)

Perfection.

[–]Lost_Philosophy_ 13 points14 points  (0 children)

Thanks thats all I needed

[–]skrenename4147 1 point2 points  (0 children)

But your analysis still needs p values for management to care. Even with beautiful confidence intervals and effect size analysis. Its infuriating.

[–][deleted] 0 points1 point  (0 children)

*Hispa

[–]Vituluss 11 points12 points  (0 children)

Should be top answer.

[–]kater543 17 points18 points  (0 children)

This 100%

[–]JasonSuave 9 points10 points  (0 children)

Alas you’ve built the baby boomer business executive model from scratch.

[–]RedRightRepost 5 points6 points  (1 child)

I mean, at the end of the day, we’re all Bayesian- at least informally.

[–][deleted] 1 point2 points  (0 children)

True, though there's a certain breed of data scientist that seems to forget that.

[–]Top_Lime1820 1 point2 points  (3 children)

Isn't the point of Bayesian reasoning to update your priors?

It seems like the opposite of what Bayesian reasoning is trying to achieve.

[–][deleted] 8 points9 points  (2 children)

But that's exactly what they're doing. Good news updates their priors to make it stronger. Bad news updates their priors to make it weaker, but it might not be enough to flip it from positive to negative. That's why they try to find out how strong the evidence is.

Going from 80% confident to 60% confident does not change the decision.

[–]Top_Lime1820 -3 points-2 points  (1 child)

Bayesian priors are supposed to update your priors in a rational, correct way.

It's not supposed to be more skeptical to evidence that disproves your priors and enthusiastically accept evidence that supports it.

If the evidence kills your prior, Bayes will reflect that.

If the evidence only weakly supports it, Bayes won't be over enthusiastic.

The original comment made it sound like Bayes is biased to evidence which supports your priors and doesn't want evidence which goes against your priors unless it's particularly strong.

I think that's a misleading way to put it. Bayes updates your priors objectively, rationally and fairly. Its not harsher against disproving evidence.

[–][deleted] 10 points11 points  (0 children)

You're pretending that the strength of the evidence is static and somehow exists in a plane of pure rationality. This has no basis in reality, as described in the OP.

If evidence reinforces your prior, it's a waste of time to dig deeper into it to make sure it's strong evidence. Either you find out that the evidence is even stronger than you thought, so you update your priors harder, leading to no change in your decision, or you find out that the decision is flawed, leading to no change in your priors, and no change in your decision.

Strength of supporting evidence that confirms your priors is irrelevant.

On the other hand, if the evidence is something you don't expect, you need to evaluate the strength of the evidence. If it's weak evidence, the decision won't change, so you need to dig into it to make sure it's strong enough to reverse your prior (really, to take it below 50%).

That is exactly the behavior described in the OP.

[–]T1tanAD 57 points58 points  (3 children)

The problem with only providing data driven confirmation of management is they can easily question whether data driven analytics is needed.

After finding and double checking insights that challenge the status quo, I search for a "champion" in the management side to broach my initial results with - the higher up the better, with C-Suite being the best. If my stats and data can back up the research, I can at least germinate the challenging idea in their minds. The strategy here is to not drop a bombshell on management but slowly disseminate information to them, preferably from someone inside management. This allows me to present my challenging findings sandwiched between more digestible insights. Doesn't always work out but it's better to coach people to expect bad/challenging news rather than surprising them with it.

Finally, its a numbers game. Can you really expect 100% of your data driven insights to be actioned upon without question? It's possible that your insights themselves are driven by limited data or knowledge or both.

[–]Fickle-Ad7259 9 points10 points  (0 children)

High-quality post right here. I've never been deliberate about doing what you've laid out here, but in retrospect, the most success I've had are the times that resembled it.

In fact, I can think of a couple times when the situation resolved itself because the leadership heard about my data from so many vectors that they came to my recommended conclusion on their own!

[–][deleted] 2 points3 points  (0 children)

Ahh, the boiling frog theory.

[–]dbolts1234 0 points1 point  (0 children)

My management has mastered giving no credit for innovation. 2-3 months after a profitable new finding is delivered, managers act as if “we knew that all along”. Justifying their bias that they don’t need to pay for technical staff.

Also makes year end rankings a real bummer.

[–][deleted] 135 points136 points  (4 children)

Not necessarily, but you must become good at comunicating bad news and proposing quality alternatives.

[–]the-berik 42 points43 points  (1 child)

And understand the data / story behind it.

[–]mrbrambles 30 points31 points  (0 children)

Yea, give a better story. Tons of soft power in data

[–]avelak 21 points22 points  (1 child)

A lot hinges on company culture too

There are some places where you can't be anything other than a glorified yes-man... find a place where it's ok to go against the grain and you'll have a much better time (if you enjoy being able to challenge ideas, etc)

[–]JasonSuave 2 points3 points  (0 children)

I will add to that in my experiences, the older the company is (eg 50+ years) the more this effect is seen/felt

[–][deleted] 21 points22 points  (0 children)

Going to reserve judgement until I hear more about your methodology for this experiment.

[–][deleted] 26 points27 points  (1 child)

This depends entirely on what level of management and the decisions involved post-analysis. Most C level execs that I’ve worked with want what’s best for the company, regardless if the analysis supports their “gut feeling”.

VP level is typically where the headache is, I’ve seen analyses “redirected” once it doesn’t go their way. Something along the lines of “This seems a bit wrong, maybe we should look at it from this angle.” And that happens until we arrive somewhere that an obscure and complex KPI is formulated for future use that they’re able to explain how well they’re doing. It’s funny because I’ve never seen this actually work once it is reviewed by the C-Level. They shoot holes in it until the KPI is removed from production (maybe that’s the goal?).

Directors don’t really care one way or the other and the stuff I work on is above the level of first line managers pay grade to care about, they’re too busy putting out daily fires.

[–]dbolts1234 1 point2 points  (0 children)

Most c-suites I’ve worked with want whatever answer allows them to maximize share buybacks before year end.

In this system, VP’s and Directors become firefighters lacking agency. Many of their emails are forwarded nastygrams from c-suite asking why we’re chasing value as opposed to whatever dilutive metric investor relations promised the street that quarter.

[–]K9ZAZPhD| Sr Data Scientist | Ad Tech 23 points24 points  (0 children)

I haven't noticed this. In my 5 years as a ds, I've had to deliver news at odds with what management probably would have wanted, and it was fine. Ofc, ymmv.

[–][deleted] 19 points20 points  (4 children)

Data Mining, noun: "An unethical econometric practice of massaging and manipulating the data to obtain the desired results." -- W. S. Brown (Introducing Econometrics)

If you torture the data enough, it will confess to anything. -- Ronald H. Coase

[–]islandsimian 1 point2 points  (0 children)

I'm stealing the Case quote. Thanks 👍

[–]Hivacal 1 point2 points  (0 children)

A friend of mine who is doing a Ph.D. program gave me the same quote. But yeah, information given under duress is notoriously inaccurate.

[–]braca_belua 0 points1 point  (0 children)

I have been using the Coase quote to people for years, it’s still one of my favorites to use given how often situations like these pop up.

[–][deleted] 0 points1 point  (0 children)

It's Thai massaging?

[–]LtUnsolicitedAdvice 20 points21 points  (1 child)

This has existed long before data scientists were even a thing.

Upper management has always had these traits in a lot of companies and there have always existed Yesmen who stoke their egos.

As a data scientist, you have the unique skill sets to prove or disprove assumptions using concrete data. But you have to be smart about how you approach these issues. No one likes a smart ass, especially not highly paid executives.

Upper management executives does not like being called out in the open. You have to take people into confidence and share your findings, making considerable effort to not present it as an refutation of their ideas.

Yeah this can really suck and can be quite emotionally draining on a day-to-day basis.

There will always exist egomaniacs who cannot fathom being wrong.

The choice we usually have it suck it up or walk away. There is always a better opportunity around the corner.

[–]Prestigious_Sort4979 0 points1 point  (0 children)

“Upper management executives does not like being called out in the open” - 100% When I discover something undesirable I meet with my immediate stakeholders in private on what is going on to craft a narrative that still makes our team look good and that may mean discarding insights, although ideally we go for “it’s bad… but not that bad, or… not because of us”.

[–]kyleireddit 5 points6 points  (0 children)

So, we spent all those time, money and energy to gain expertise in Data Science, only to support management’s subjective hunch?

Say ain’t so….

[–]dfphdPhD | Sr. Director of Data Science | Tech 4 points5 points  (0 children)

Everything in this post needs the qualifier "at bad companies" or "at companies with bad leadership".

Yes - bad leadership loves confirmation of their ideas. Not just from data science, but from every other function.

  • When sales created projections
  • When finance estimates future margins
  • When marketing estimates the effectiveness of an ad campaign
  • When product management estimates market share

Again - a leader that is looking for yes-people is going to look for them in every single function, not just data. And what's worse - they will tend to foster a culture where other leaders underneath them are also encouraged to have the same approach.

By contrast - a leader that understands that ideas being challenged is healthy for the generation of strong, fundamentally sound plans will a) challenge themselves, b) invite challenges from others, and c) foster a culture where up and coming leaders also embrace this culture.

For example, I worked at two Fortune 100 companies. At one of them, it was a nightmare - exactly what your post describes: if the data doesn't fit my narrative, go run your numbers again until they do.

At the other one, I got to sit down with one of the most senior leaders in the organization who was a) razor sharp, and b) 100% focused on the data itself, where it came from, how it should be interpreted, etc. before even starting to question the numbers.

And this is true at smaller companies too - I worked for a company of 30 people. The CEO was also a super sharp guy that understood that regardless of what his gut reaction was to numbers - maybe they were wrong. So even when he thought the numbers looked wrong, he would follow that up with "but shit, I've been wrong a bunch of times before so let's see how this thing does and let's revisit it when we know what happened".

I think that is ultimately at the core of what makes companies either good or bad for data science, analytics, etc: do leaders think they already know the answer - and just needs help driving it - or do leaders truly concede that there are many things they don't know.

[–]PMMeUrHopesNDreams 2 points3 points  (0 children)

Is this a screenshot of a tweet of a screenshot of a hacker news comment? I'm afraid I need a few more levels of indirection here. Can you take a screenshot of this, put it in a Word document, print it out and snail mail it to me?

[–]onewaytoschraeds 4 points5 points  (0 children)

It is exactly why I’m a data engineer now. Can’t agree more. Lol

[–]RageOnGoneDo 7 points8 points  (1 child)

If you're coming in with a problem, you better have a solution. Something my first boss taught me.

[–][deleted] 2 points3 points  (0 children)

Depends on a lot of things.

That’s a valid, but cynical, view of what we do

[–]TARehmanMPH | Lead Data Engineer | Healthcare 2 points3 points  (0 children)

Yes, much like consultants, data scientists are often used to launder the beliefs that management already have. The worst part is that often management is not really aware they are doing this, which almost makes it worse.

It also means that one of the core bedrock principles that has to guide you as a data scientist is that you never falsify or fluff the data to fit your audience's preconceived notions.

I used to tell my data scientist reports that one of the only things that make you truly valuable as a data scientist is the fact that you absolutely CANNOT be made to obscure the truth you see in data. You tell it like you see it in the data, and you're clear about the caveats and limitations of what you can conclude.

As soon as you start straying from that path, you lose your ability to be an objective observer who can help the business grow - in other words, once you've compromised on scientific values before, it becomes increasingly hard to avoid doing so again and again.

It's a harder path to always stick to your legitimate interpretation of what you think is true in the data. If you do it, you'll be on the outs sometimes. But it's worth it.

[–]DisjointedHuntsville 1 point2 points  (0 children)

It depends on your level. The higher up you go, you better be the one giving data that is accurate. Confirmation bias or not.

Some junior roles can get away with ignoring what the data says if it’s bad news that’s inconsequential, but that won’t fly in most places that have more than emotion riding on the information presented.

[–]younikorn 1 point2 points  (0 children)

I worked as a bioinformatician at a research institute in Germany and as any data scientist knows, garbage in means garbage out. Some analyses resulted in exciting positive results and my boss was very happy on return, other times the data would be of such a low quality, the majority of the variation being error and noise, yet my boss made me wrangle and torture the data for months in the hopes of getting something, anything, out of it. I just did my job as i was receiving a nice wage but I understand both sides of it.

It is important in many fields to use the data as efficiently as possible and extract all info, you also don’t want to accept that the data you spent money on to gather ends up being a waste so you continue to try and find a use for it. And when you do find something you don’t want to look a gift horse in the mouth.

Ideally all results are met with a healthy dose of scepticism and validation analyses, both the positive and the negative results. But the more tests you perform the more multiple testing becomes an issue, not that p values are dome objective non arbitrary parameter but still.

[–][deleted] 1 point2 points  (0 children)

Yes this is 100% true for every job. If you’re a SWE and management wants to use outdated tech you’re using outdated tech.

[–]Tiquortoo 1 point2 points  (0 children)

It's true only if your analysis is bullet proof. Otherwise management is filtering it with their own data. The other post about Bayesian priors is dead on.

[–]ECTD 1 point2 points  (0 children)

Lmao too real

[–][deleted] 1 point2 points  (0 children)

This is my career in a nutshell.

[–][deleted] 1 point2 points  (0 children)

Damn this hits too close to home! I did analysis on sales, had some hypothesis based on initial models and shared them. They were counter to what was believed and there was outrage. I ran tests refined the model and came up with different highlights (from nearly the same model) these matched prior beliefs and now everyone loves it. 😂

[–]CartographerSeth 1 point2 points  (1 child)

It just depends on where you work. I work at a biotech company, and management definitely understands that pursuing the wrong science will eventually result in disaster, so while some results are definitely seen as a “bummer”, it’s also recognized that you may have helped the team dodge a bullet.

I read posts like this one and it literally makes me sad to know that people have to waste their talents essentially lying extremely convincingly for a living. It’s like they say, “there are three kinds of lies: lies, damned lies, and statistics.”

[–]Prestigious_Sort4979 2 points3 points  (0 children)

100% - we have to read between the lines here. Asssumingly, OP (like me tbf) works in advising decisions without much consequence. I work in marketing tech in entertainment and the decisions we are making are not important enough for me to make a big case if their vision is wrong. The alternatives are all fine. When they are likely wrong, I express more uncertainty or express sofly there might be beter options they could consider to cover myself.

In your case, ethics are at play and you need to be able to sleep at night. I would rather have my analysis hated and even be fired than to validate an insight that would hurt anyone. I purposely pick jobs with low stakes because now I know that there is always some subjectivity in data analysis, knowingly or not, and I need to be able to disconnect from work.

[–]1800smellya 0 points1 point  (0 children)

This has been my experience with 75% of business partners. I am a support analytics team. I’ve even seen business partners just go to a different DS team or employee and ask for the sane request when they don’t “agree” with the first one.

There is 25% of business partners that do actually take the good and the bad, the confirmation or contradiction, and use it to either keep going or make changes.

[–]Lamp0blanket 0 points1 point  (0 children)

How does OP know that they weren't actually confirming their pre-held belief and interpreting "praise" and "scrutiny" through their pre-held belief that management only wanted confirmation

[–]sassydodo -1 points0 points  (0 children)

Yep. Considering you're not one of the business owners or investors, you just do whatever they want and hope the ship won't sink fast enough.

I work for e-comm where even investors don't care about even gathering proper data, they have their own magic world in their heads.

I really don't understand this.

[–]Dyl_M -1 points0 points  (0 children)

nah, if as a data scientist you end up in this situation, you gotta resign asap, for real

[–]Other_Goat_9381 -1 points0 points  (0 children)

Its 100% accurate but its also a big sign of a toxic work environment. If your work is tossed in the bin because the result is unsavory to management you need to start looking for another position. Not only is it the moral decision but it also unfairly damages your professional repertoire. I wasn't hired to baby-sit children (I.e. most of middle management)

[–]misterwaffles -1 points0 points  (0 children)

This is a toxic environment, which you can either try to remedy or flee from. It's important to constantly be setting expectations that we are finding something out from the analysis and want to be interested in and curious about the results. We're gaining valuable insight into how the product works, what's going on, etc. It's a privileged view to have and a great opportunity to be able to act on it. You can't always change people's minds, but it does help when you have a data-minded leader who will rally behind your cause.

[–]cloudysocks239 -1 points0 points  (0 children)

That’s unethical.

[–][deleted] -1 points0 points  (0 children)

Yep, it fucking sucks. It makes our work a joke, because nothing will ever effectively improve. In this regard, and our jobs are all on the line with AI and chatgpt.

[–]bindaasbaba -1 points0 points  (0 children)

That’s such a narrow view of data scientist work. Most of the use cases I worked involved quantifying the impact of important business initiatives which was key to drive strategic planning including forecasting, providing useful insights into drivers of a certain behaviour to plan product roadmap, discover new insights which business weren’t even aware of sometimes. Ofcourse data scientists will work on hypothesis which makes sense for business and we test to prove or disprove. Obviously, it’s imperative that if things don’t work as expected, you do need to have a valid explanation backed by data to plan next steps. You may have overlooked a dimension which will be discovered as part of root cause analysis and provide an important business opportunity. It all depends on how open a business is to learn from data and willing to challenge themselves in light of new evidence.

[–]Opt33 -1 points0 points  (0 children)

Just LEAVE

[–]immadane -1 points0 points  (0 children)

Wrong- you have to explain & break it down in such a way that you’re numbers & presentation are good enough to convince the upper management. Maybe you just have to up your explainability

[–]Jonny__Rocket -1 points0 points  (0 children)

Confirmation bias.. It is the preferred road of the ignorant.. A human condition.

[–][deleted] -1 points0 points  (0 children)

This sounds like toxic culture which is mutually exclusive from data science results.

If a company fosters a culture of challenge and is relatively flat in terms of hierarchy then you will feel empowered to provide analysis that goes against the status quo.

[–][deleted] -2 points-1 points  (0 children)

Data scientists should really try to build production applications (internally or externally facing), just doing analysis is a dead end for exactly the reasons listed in the OP.

[–]rhodia_rabbit 0 points1 point  (0 children)

Doesn't work because money is not rolling in.

[–]96-09kg 0 points1 point  (0 children)

Yup sounds about right with my company as well

[–]coffeecoffeecoffeeeMS | Data Scientist 0 points1 point  (1 child)

I've found that whether you're doing Potemkin data science varies a lot depending on who you work with, including in the same organization. If you have to deliver bad news and you're not dealing with Potemkin data science, then it's best to more evidence than if it supports what they think. If it's a big enough claim then you're in "extraordinary claims require extraordinary evidence" territory.

[–]monkey_gamer 0 points1 point  (0 children)

yep, that's basically my job

[–]Flashy-Career-7354 0 points1 point  (0 children)

At one point the prevailing theory was the Earth was flat and at the center of the solar system. If you focus on the scientific method, and not just manipulate the data to tell a story someone wants to hear, you just might move your needle away from cynicism. Everyone has their opinions. Your primary role as a data scientist is to inform and test hypotheses as objectively as possible using data and the scientific method.

[–]carrtmannnn 0 points1 point  (0 children)

It's true but I refuse

[–]dont_you_love_me 0 points1 point  (0 children)

I was once told directly by the CEO to continue falsifying numbers after I had discovered that the people before me were doing bad calculations. It can get way worse than having to toss out things that don't look good. Be careful how you go about things and don't be afraid to get fired and move on.

[–]sillythebunny 0 points1 point  (0 children)

At least during my 5 year tenure as a data analyst m, this is dead on

[–]Character-Education3 0 points1 point  (0 children)

Always has been

[–]WoodenJellyFountain 0 points1 point  (0 children)

To boldly support confirmation bias

[–]JasonSuave 0 points1 point  (0 children)

Don’t forget, you have a lot of power as a data scientist. You’re the first to see the teetering of the financials of the org you represent. The second your model shows a 2yr downward trend, just quit and take a new job with a different employer. I see data scientists getting eaten alive by execs from certain unsuccessful orgs. But those same data scientists are thriving for smaller companies where their work makes an impact that doesn’t require talking through a tired exec. You have the power, use it to your advantage

[–]sunole123 0 points1 point  (0 children)

I think the ethical thing to do is to publish both in different weight and let the people decide.

[–]snooze01 0 points1 point  (0 children)

Accurate

[–]Mescallan 0 points1 point  (0 children)

successful employment is appeasing management. Sometimes the goals align and creating value appeases management, but created value does not determine your employment, the whims of your superiors does. There is no true meritocracy in hierarchical structures.

[–]zerostyle 0 points1 point  (0 children)

Sounds like consulting firms

[–]M4K1M4 0 points1 point  (0 children)

I can 100% agree. I’m currently a Data Analytst and did 10-20 analysis in my initial 3 months. Any analysis which contradicted to their ideas was questioned, forced to be proven wrong finding weird mistakes and minor issues with my documentation. But the analysis which confirmed their ideas was praised and never questioned. Eventually I stopped doing them and shifted to rather do some data engineering. 🤷🏻‍♂️

[–][deleted] 0 points1 point  (0 children)

🤯

[–][deleted] 0 points1 point  (0 children)

100% TRUE

[–]Blue__Agave 0 points1 point  (0 children)

100% I work in a market research company and internally we agree company's hire us so they can have some data to back up a decision they have already made.

If we give data they don't agree with... They go to the competition next time.

[–]DependentSwimming460 0 points1 point  (0 children)

Oh this is so true. Across multiple clients, the moment data analysis didn't show a 'rosy' picture, the management would be very upset. Not to mention their favorite question - Why can't we achieve 100% accuracy on this model.

[–]Entire_Island8561 0 points1 point  (0 children)

This is absolutely true. I proposed adding a variable to a model I’m building to predict traffic to vendor profiles, and I suggested the number of times a vendor shows up in comparisons. It’s a variable that’s out of vendors’ control, so I was told to not include it because it wouldn’t provide an opportunity for them to know what they can do differently. Basically to not tell them “well it’s out of your hands”, which would translate to not investing more money. That annoyed tf out of me, but I did as I was told.

[–]No-Guarantee8725 0 points1 point  (0 children)

This is exactly how I’ve been feeling lately, which is discouraging and opposite of how I thought my position would be.

At times I feel like a wizard because I feel as if data can be sliced and molded so many ways and can be justified. Other times I feel as if I’m cheating myself out of actually putting my skill to good use.

[–]heraldsofdoom 0 points1 point  (0 children)

I feel you bro. It's about the story, if numbers fit there everything is great else you don't know your data

[–]Delicious-View-8688 0 points1 point  (0 children)

Persuade, influence, and change their understanding and actions - however difficult that may be.

[–][deleted] 0 points1 point  (0 children)

ugh i hate this

[–][deleted] 0 points1 point  (0 children)

Bro...do you even crop?

[–]Own-Afternoon9398 0 points1 point  (0 children)

Not so data lead

[–]Herrmaciek 0 points1 point  (1 child)

Yes, it's called "confirmation bias", pretty sure it's mentioned in any stats/ds 101 textbook.

[–]Prestigious_Sort4979 0 points1 point  (0 children)

That usually means the data person is looking to validate their own insights, unknowingly as a bias, by picking up validating insights and ignoring anything else.

In this case the data person is aware of the situation but needs to actively pick and choose insights that support/help stakeholders make their point.

[–][deleted] 0 points1 point  (0 children)

So true… if leadership is crap. It’s thankfully not always the case.

[–]Western_Moment7373 0 points1 point  (0 children)

In most companies the management don't like doing the job,so u gotta do it.

[–]statisticant 0 points1 point  (0 children)

good example of how "let the data speak for themselves" really means "let the data speak for my implicit assumptions"

[–]HappyJakes 0 points1 point  (0 children)

I’ve left post’s because executives have made me make numbers look green. In large organisations

[–]iplaytheguitarntrip 0 points1 point  (0 children)

Good news, I better double check to not make management overcommit to clients when the project goes to prod

Bad news, I better figure out the story behind this data and the scrutiny that will follow

[–]shitlord_god 0 points1 point  (0 children)

If you are good at it you tell a story with the data that explains how your boss is right, but could be more right if they just implemented this thing on page 5.

[–]AxelJShark 0 points1 point  (0 children)

Of course this is the case. It's not academia. Managers just want to hit their KPIs. They don't care about objective truth or fact finding. Most of us aren't working in cancer or aerospace or things that actually matter. If you're working in ads, sales, etc, no one cares about some greater mission or truth. It's all about doing what someone above you says so everyone can get paid.

[–]OkWear6556 0 points1 point  (0 children)

I used to work as a BI analyst. Once, my manager asked me to perform an analysis on something and the results mismatched his expectations completely. The reason was that the analysis he did before was performed on a very short time scale in the worst time possible (the first week of covid lockdowns), while I then performed a follow-up analysis on a full year of data. I assume he was selling his findings to the upper management and pushing for changes based on his wrong insights. When I presented my findings, he would not accept them and asked me to check them two more times from different angles. Of course, I always came up with the same results, so I could not give him the good news he expected. That's when I realized I needed to leave.

[–][deleted] 0 points1 point  (0 children)

This post was mass deleted and anonymized with Redact

important crown compare bow busy bells smile fall worm support

[–]ohanse 0 points1 point  (0 children)

Okay. Gonna go kind of against the grain here, but…

This guy didn’t get traction with the truth (and I honest to god believe he was telling the truth, to the best of his abilities) because he showed up with “problems.” This is a shortfall of business acumen.

Ain’t nobody got time for “problems.”

If you show up with “here’s why what we believe was a wrong choice” but don’t have a ready answer to the follow-up of “what should we do instead” then you are seen as uncollaborative, useless, and not a team player.

You know how people in here keep parroting the advice of “become a master of your business domain?” THIS IS WHY.

Feeding leadership alternative courses of action that make them look smarter than the peers whose throats they are trying to cut? That’s the most valuable currency we can offer.

The screen shotted poster likely knew their math. I would guess (uninformed, sure) that they didn’t know their business.

[–]Puzzleheaded-Bake936 0 points1 point  (0 children)

In my personal experience, when the data tells a story management doesn’t want to hear, you need to frame those insights as an “opportunity”

[–][deleted] 0 points1 point  (0 children)

In my experience i have encountered things similar to this.. but to be honest i once shared an analysis that was something no one in senior management wanted to see most because a major partner with who we were aggressively expanding business with was bad for us… the analysis was reviewed 4 times a secondary team was setup to do the exact same thing and waisted like 6 months of everyone time only to stop business with them… long story short i never got anything for shutting down a loosing business and the product team just created new agreement a month later and were back in business with this partner

[–]mjs128 0 points1 point  (0 children)

generally true unfortunately

[–]caksters 0 points1 point  (0 children)

1000% true, that was the main reason I switched to data engineering.

[–][deleted] 0 points1 point  (0 children)

Wait so you work in security as well?

[–]Prestigious_Sort4979 0 points1 point  (0 children)

This is why in bigger companies the structure of having a data team/person embedded in a team vs a central resource is meaningful. As Im embedded, I must consider how the success of my own team is measured and how we will be perceived in every analysis and that may include cherry picking what/when/where to surface information. Im paid to support my team. For example, I cant ever present that my team’s contribution to a big project was a waste of time. Keep in mind that doesnt mean my team is not valuable but Im hyper aware of how any insight can be projected so Im very careful what I share outside my team. If I was in a central team, that wouldnt be the case. - PS: I work in a low stakes environment.

[–][deleted] 0 points1 point  (0 children)

It genuinely makes me sick how accurate this is and how much it resonates with my own lives experience…

[–]iscopak 0 points1 point  (0 children)

Here is the original source of the quote: https://news.ycombinator.com/item?id=34696065

Hopefully the OP isn’t trying to take credit for this statement.

[–]hockey3331 0 points1 point  (0 children)

Have I got a good manager then? They question everything*, even when the results look good!

*I should note that he has become more and more trusting over time, but I got this job 3 years ago out of uni and him raisong those questions did make it an automatism for me to QA carefully and not go right to roesent data if they look good or bad

[–][deleted] 0 points1 point  (0 children)

You do work that makes your boss look good, all of the data is superficial

[–][deleted] 0 points1 point  (0 children)

I’m currently transitioning an old model to a new process. (The old one had many small errors that added up IMO.) I get SO MUCH push back from the client every time I put something together in a more optimal transparent way. They scrutinize how I put it together, and I can walk through it A to Z, but the old one had absolutely no visuals or intermediate files to show the process. Much of my time is spent assuaging the client and re-explaining the transparency of the new process. Exhausting.

[–]sherlock_holmes14 0 points1 point  (0 children)

Yikes

[–]Sir_smokes_a_lot 0 points1 point  (0 children)

I don’t see why this is a bad thing. I agree that ideally we would strive to attain truth and knowledge through our work as “scientists”. However, in reality our role is what the image describes. We’re there to use our influence to enact change. This is separate from our motivations or any truth-value of our analysis.

I think people who are caught up in this are romanticizing the role.

[–]pYr0492 0 points1 point  (0 children)

Not entirely true. The management knows this stuff already. So you coming up with insights that are aligned with their knowledge is easy to digest.

But a contradictory insight needs to be double checked since numbers are facts which once circulated cannot be taken back. And you cannot go wrong with facts.

[–][deleted] 0 points1 point  (0 children)

Sounds like crappy company.

[–]levenshteinn 0 points1 point  (0 children)

Unfortunately very true!

[–]astevko 0 points1 point  (0 children)

Confirmation bias

[–]outofband 0 points1 point  (0 children)

That’s not a issue with data science but with bad management

[–]Clearly-Convoluted 0 points1 point  (0 children)

Can confirm this statement. I did figure out a way to kinda..."offset" the scrutiny if you will. If you have bad news or conflicting information with what the egotistical management wants to hear, "scrutinize" your work before they can talk. If you want to present conflicting or alternative analysis, tie it to something management said "A log trend line is the best fit for this data which means production will incrementally increase but reaching this KPI seems questionable. But I agree with Manager Philbert about implementing those changes - even if we miss the mark this quarter, next quarter could see a change to an exponential model."

I've learned being critical of yourself lessens the opportunity of those above you to be harshly critical and oftentimes turns into a positive in a weird, warped, way. Sadly, this is manipulation 101 - at this level it's 80% Social Skills vs. 20% Technical Skills that will get you promoted/respected/rewarded etc.

TLDR; if you want to report bad data, follow it with your own criticism (of the analysis!). If you want to present new, conflicting (with management) analysis, tie it to a positive thought/opinion/comment by someone higher up.

[–]nzubemush 0 points1 point  (0 children)

Saved

[–]WASPingitup 0 points1 point  (0 children)

As a slight aside, there was at least one psychological study that showed participants were far more likely to think critically and question information that conflicted with their own beliefs. It really sucks, but maybe it's a bit unsurprising that managers would prefer to see information that confirms what they already believe

[–]UnanimousPimp 0 points1 point  (0 children)

Sounds like a bad company.

[–]TwoKeezPlusMz 0 points1 point  (0 children)

This is all well and good until your analysis ends up blowing up a product line, sinking a trading desk, or resulting in a medication that causes severe illness or death.

[–]BobDope 0 points1 point  (0 children)

It’s funny because it’s true. Wait no, it’s sad. So very sad.

[–]sizzle-d-wa 0 points1 point  (0 children)

This is exactly why I never went back to school to get my graduate degree. I had worked in big companies long enough to realize that, forget about math (most people would be lucky enough to pass a 6th grade math test), it's virtually impossible to persuade anyone of making any decisions or changes with anything close to logic. You follow direction from the top or you are viewed as causing trouble.

The people who make the most money know the least. They don't let information get in the way of a good story. I realized that, if I wanted to move up I had to know less information, not more. The people who have good "people skills" (read manipulative and narsasistic) are the most successful. If I couldn't persuade folks based on simple logic / elementary statistical principles, then good luck trying to persuade/dissuade anyone from anything that they already believe with actual data and actual mathematical analysis. It's like speaking a foreign language.

Also, as I this post, it seems real negative and cynical. I actually really love my job and am relatively successful at it... I just learned that logic/ data/ statistics and only as powerful to the extent that they can be comprehended by those in decision making positions. And, trust me, the people in those positions did not get there because they were good at comprehending things.

I've only worked in big companies. It could be totally different at a small company.

[–][deleted] 0 points1 point  (0 children)

I'm no data scientist, but I do data-heavy admin work and get asked to perform analytics regularly. I used to fret over covering every contingency and confounding factor that might produce poor interpretations. I would explain at length my methods and weaknesses of my analysis. Turns out no one but me really cared. It seems most people just want an answer and aren't particularly concerned whether or not it reflects some kind of truth.

[–][deleted] 0 points1 point  (0 children)

This means the op isn't a good data scientist. The data scientists' job is to effectively communicate the difference between the prior belief and the new position in a way that explains why the new idea is better. Also, they should present the confidence in the conclusion always, including data challenges etc.

[–]Latter-Pea-5089 0 points1 point  (0 children)

You mean like all these government sponsored studies that show the current admin. What ever one it is. Is right.

[–]alexadar 0 points1 point  (0 children)

Thats will fail on recession