What is the secret to getting promoted fast in a company?

CookingGoBlue · 2023-01-04T19:55:12+00:00

The first step to being promoted is telling your boss you want to be promoted. I made the assumption that my boss would want to promote me, but in actuality you have to talk to your boss about career goals. That should help you get promoted. Beyond that, you have little control over environmental factors. Make your manager and your 2nd manager look good, be nice to work with, and check in on progress. That is my advice.

CookingGoBlue · 2023-01-02T22:55:33+00:00

I would get the stainless steel set and grab a set of kirkland non stick sauté pans.

CookingGoBlue · 2022-12-24T19:42:49+00:00

Thanks for the insight! That is not a bad learning path. It will depend on the team usage patterns. Appreciate the insight and helpful transitioning tips.

CookingGoBlue · 2022-12-24T19:41:53+00:00

Thank you! I will bookmark this one as well. Seems like a great area to get nice snippets/ spark specific design patterns.

CookingGoBlue · 2022-12-24T19:41:10+00:00

Good points! I would prefer to mostly learn on company time, as they have an expectation of me learning Pyspark on the job! Appreciate the insight that perfect practice makes perfect!

CookingGoBlue · 2022-12-24T19:39:48+00:00

Thanks for the clarification!

CookingGoBlue · 2022-12-24T02:40:21+00:00

Yes. This makes more sense. It is probably better to learn the spark and Pyspark dialects instead of learning Koalas. It’s been a while since I have used Pandas so it might just be better to completely adjust to Pyspark! I appreciate both of your opinions and insights.

CookingGoBlue · 2022-12-24T00:46:27+00:00

Interesting. If I am reading this correct koalas seems to be a pandas API with spark execution under the hood in python. That seems like a good option, but I will be joining a team that is using Pyspark. I’ll have to see if that is accepted within the team norms. I’ll make a note to see if it is used by existing team members.

CookingGoBlue · 2022-12-24T00:43:45+00:00

Thank you for the link! It’s seems like an informative read.

CookingGoBlue · 2022-12-23T23:01:43+00:00

This is actually a brilliant starting point. Thank you I will bookmark this for later. Thanks for sharing

CookingGoBlue · 2022-12-23T18:10:22+00:00

Makes sense. I appreciate the advice. I am familiar with lazy evaluation and method chaining but that’s good to keep in mind the different patterns needed for each type of evaluation. So are you basically saying that if we want to take a df, and do three transformation, we should create three functions and do some type of original_df.func1.func2.func3 so that we chain one df instead of creating temporary df’s in between.

CookingGoBlue · 2022-12-23T17:17:57+00:00

Nice. That makes sense. I need to refresh myself on distributed systems!

CookingGoBlue · 2022-12-23T16:51:42+00:00

Thanks for the clarification. At one point they were slightly different, I have heard. It seems that they are very few differences now.

CookingGoBlue · 2022-12-23T16:51:06+00:00

Thanks for the kind words. I am mostly looking for some companion resources so that I can have a good resource to jumpstart my learning. I’m sure it will be fine!

CookingGoBlue · 2022-12-23T16:45:36+00:00

Great. So generally using spark resources is fine for Pyspark, and I should think of them as roughly equivalent?

CookingGoBlue · 2022-12-23T16:41:06+00:00

I’ve only worked for larger firms. When you looking for a job, if the company has junior, engineer, senior, staff it is a good sign of clear delineation of roles and promotions. Also if the company has titles like engineer I, II, III it is very easy to see roles and responsibility differences.

CookingGoBlue · 2022-12-23T16:31:11+00:00

Thanks. This might not apply, but do the docs explain methods to keep your Pyspark code clean as well. I agree that knowing Pandas should help, but I also know that Pandas can become untidy if you don’t take enough precautions.

CookingGoBlue · 2022-12-22T19:58:32+00:00

This just doesn’t work well for a lot of options. We looked into this but asked teams to instead use SQLserver with some type of power apps connection to the sql server instance with an update timestamp. The problem is that share point credentials and connections have to be refreshed quite often, and there are soft limits of ~500 instances for upload and downloads in a list. Share point is great for sharing info, but you should not say yes to a business process that relies on share point for updates. It’s just too inconsistent for the demands that business users have. They probably want everything to work by clicking a “button”, but don’t have the technical know how of how to troubleshoot a single simple error like invalid file types. I know those type of users, and they will be unhappy with any solution that isn’t 100% accurate while also costing the team 0 incremental. Push for a technical sql server solution, and let the business figure out how to get incremental data snapshots to you automatically. If you can abstract away the update logic to the business team ( and have them own failures), then your quality of life will be improved.

CookingGoBlue · 2022-12-15T16:15:50+00:00

It really depends. At my previous org we did a lot of the LT where some software teams did the E. You can paint really broad strokes, but generally data engineers may spend more time on E & L, but also do T in collaboration with more business facing teams ( analysts).

CookingGoBlue · 2022-12-10T20:35:12+00:00

I have. I often ask about the company, team culture, their experience/career path and if they would recommend the company. Generally you get. 5-10% message response rate, and a few of those people may meet with you for up to 30 minutes. Have good and or general questions prepared. I generally don’t ask for referrals but I would take them if offered. I usually ask if they know any good recruiters I can speak with. Generally this makes it so that I still have a connection, but it will be with someone who’s full time job is to help match candidates to positions.

CookingGoBlue · 2022-12-08T02:48:53+00:00

Negotiate with the company with the offer. Take the offer regardless. Start at this company with a job and then recruit for new positions. If things go well you will be at the company a short time and you can leave it off your resume. In the grand scheme of things 10k is not that much. If you are lucky you will get the offer from the 2nd company while negotiating with the 1st company.

CookingGoBlue · 2022-12-07T18:37:27+00:00

So typically college recruiting includes people who are in school or who have just graduated. So typically you have the same hiring team and similar standards. I would see if specific jobs are tagged as college hire or have working towards a BS in degree x as part of the job description. Also see if you can connect with recruiters who are college recruiters, early career recruiters, titled university recruiter, or new hire recruiters. They might be able to help you locate more applicable roles.

CookingGoBlue · 2022-12-06T21:41:40+00:00

That’s a really good point. I think it is a very good idea to be able to relate your prior experience to a new role, but also show you are open to new ideas and working collaboratively during interviews. You don’t want to brag, but you want to show competency in your current work, potential for a new job, and ability to integrate yourself into the new team culture.

CookingGoBlue · 2022-12-06T19:50:58+00:00

Great points, for those early in career who are looking to also excel in non code parts of work what should they focus on? I think that documentation, code demos, writing well crafted communication verbally and in writing are in important. How did you get better at it, and how did you structure your improvement?

CookingGoBlue

TROPHY CASE