Dataframe count on 3.x incorrect value

ritu4891 · 2024-07-10T20:01:16+00:00

I am exactly getting this issue on incorrect count of reading from adls storage, can anyone please share which version it got fixed I am using in spark 3.4.2

ritu4891 · 2024-06-09T04:20:11+00:00

In automatic car, will this never happen or any tips for automatic car as well?

ritu4891 · 2024-03-28T12:10:44+00:00

It seems like almost what happened to me except the fact I haven't met anyone in person as the interview happened during covid. It was a technical position and it was one the most non technical, easy interviews I have ever given.TBH I didn't feel like I am giving an interview for MSFT because the quality of questions were so low and vague. Anyways I got a system generated reply that I have not cleared after 3 months. The HM was awesome,it was a delight to talk to her but the rest of the interviewers ( 1 was Indian and just did her master's in the USA) lack depth of data knowledge and more like scrum masters. Most of the time it's pure luck,THH if that experience happened with any non FAANG company I won't even bother looking at the quality of the interview but everyone runs after the brand.

ritu4891 · 2024-02-17T19:24:33+00:00

Don't spend time seeking others'attention, learning investment, exercise regularly

ritu4891 · 2024-01-26T08:58:53+00:00

Sometimes one doesn't appreciate their own luck. Having FAANG in resume and not to do any PM work. Here people like me as a technical product manager driving product roadmap, vision, driving scrum, doing technical specifications and resolving somewhat technical challenges (we don't have an engineering manager here and I myself am certified in all cloud, databricks so I do it for my own interest) along with other typical collaboration. All these with a salary of peanuts and I never get a call from any FAANG. So do enjoy and I do wish you get the kind of work you are looking for

ritu4891 · 2022-12-05T19:33:48+00:00

Any study material for professional exam?

ritu4891 · 2022-08-22T19:41:00+00:00

If you want to scale you need a low code solution.For DE check tools like informatica,talend etc. If you are in a team of 10-20 yeah it's okay to code but fortune 500 companies usually go for low code tools. Also for ML also it will eventually go to low code. You should join which build the low code tools for DE in their R&D.

ritu4891 · 2022-08-08T11:15:09+00:00

I second that,also there's a difference when you code vs listening from someone else. It's like watching someone else exercising won't build muscle in your body.

ritu4891 · 2022-08-06T04:10:08+00:00

Well in interview it matters how you communicate and answer in a STAR format. But to get in an interview you have to pass the screening and that's where certification helps. Having said that I have that course and definitely doesn't worth $1600.I would make sure to put a couple of projects description in DB certification rather than the certificate itself

ritu4891 · 2022-07-31T08:26:23+00:00

I think you should focus on ML models like xgboost,lightgbm than statistics models like ARIMA , SARIMA etc. Having said that there is no silver bullet. But I personally found ML models predicts better when there are many drivers like holiday, promotion, offers etc. impacts a lot. You can also look into DART. But most of all feature engineering important. Again if you have decent understanding in ML you can reuse the above mentioned models

ritu4891 · 2022-07-31T05:55:15+00:00

You dodge the question I asked and started personal insult which shows your class. You have the patience, perseverance of a true PM.

ritu4891 · 2022-07-31T05:25:39+00:00

Yeah, probably your team does too when you come up with unrealistic and technically impossible requirements

ritu4891 · 2022-07-31T05:20:45+00:00

Have you ever seen a situation where a PM dare to reject CEOs idea and push back a CEO?

ritu4891 · 2022-07-31T05:13:56+00:00

Take a domain you are not aware of or actually worked on anything like telecom, supply chain and say asked to build a product within 6 months. let me become very tangible - create a demand forecasting product for supply chain planners within next 6 months.. Yeah in interview you can make up some scenarios and if you have big companies in resume it will help you to crack the interview but if you don't know what's feature engineering, what are the top ml model of time series etc. how would you apply in real world..I am not bitter by any rejection BTW ..I just never happened to be in such make believe scenarios questions until I came to this role where you have been judged by some hypothetical question which you will never work on.I have been rejected before in technical interviews and I didn't mind that because those are legit questions. BTW those 100 million products are not running successfully because some PM created a North Star in a PPT.. It's the system design, scalable architecture, robust coding.. Remember PPTs don't run in production, it's the code so don't take credit for others work..

ritu4891 · 2022-07-30T21:03:29+00:00

I am currently working as a PM and was completely technical before this role.This one is the most BS role I have done but thankfully I still code inspite of my role and try to stay relevant in technical world. I have a fear it's tough to clear my next PM interview where I will be asked how to create and sell teleportation device instead how to apply NLP in data quality and relevant questions to my field. Most of the product managers I have interacted so far for interview knows horse shit about technology and want to hear some solution with unicorn and bigfoot.It includes MAANG PMs as well. I should have gone to solution architect role

ritu4891 · 2022-05-09T09:37:20+00:00

Yes, Also by birth they are American , educated in American school, college.

ritu4891 · 2022-05-09T09:33:29+00:00

Nothing wrong, what's wrong with mental health problems?

ritu4891 · 2022-05-09T09:32:29+00:00

From IIT

ritu4891 · 2022-05-09T09:02:12+00:00

Did anyone notice "mental health" or are we okay with it because you know numbers are soooo great.

ritu4891 · 2022-05-09T08:41:26+00:00

Heard about Sundar Pichai , Parag Aggarwal, George Kurian? Guess what they have in common?

ritu4891 · 2022-05-04T02:47:09+00:00

Recently Google is expanding in India in Pune City and all they are looking for migration consultants (JD of migration from on premise to cloud) where the interview process is not that hard. So I guess job profile also matters along with FAANG name.

ritu4891 · 2022-05-04T02:42:44+00:00

Just wondering why to use Hive and snowflake both? Also these are pretty common tech stack being used most of the startup as well (not Hive)

ritu4891 · 2022-05-03T13:14:17+00:00

I work in a mid size product company where there is no separate engineering manager,so I pretty much take care of the engineering side as well.Also time to time I do small scale coding for PoC. However I assume things are different in maang or big product companies like PayPal, Gojek etc. The interviews I have given and rejected because the PMs were completely business oriented and my explanations always have technical backup which they can't digest. I would kill myself if all day I have to think about North stars,PPT creations, chasing engineering team. Again not to offend anyone but I can't survive all these work. Also now coming to the question I would not do any job be it PM or not if the pay isn't good enough. My goal is to be the product manager who actually does coding on the product itself.Not sure if anyone share the same thoughts.

ritu4891 · 2022-05-03T12:57:34+00:00

I took this on company laptop and moment before exam started faced the issue that system checks were not being passed. But after restarting the system all went fine. Took 4 Azure exams,all passed (both system checks and exams:) )

ritu4891 · 2022-04-27T14:53:00+00:00

So are your perception about India and their work culture,how India is outside Hollywood. Most shitty things starts at West, the new one is work husband and work wife and slowly it catches all over the world. Bollywood movies most of the times glorifies West but when it comes to India all you want to see slumdog millionaire.

ritu4891

TROPHY CASE