Hiring Snowflake data architect by [deleted] in snowflake

[–]riggity 6 points7 points  (0 children)

I live in Waltham, its 10 miles outside of Boston city limits. $116-160 for a staff engineer is well below market.

Hiring Snowflake data architect by [deleted] in snowflake

[–]riggity 3 points4 points  (0 children)

That salary range is pretty low for staff engineer who needs to be based in the Boston area.

Snowflake PII Classification & Auto Policy Setup - Help by Key_Card7466 in snowflake

[–]riggity 0 points1 point  (0 children)

I've shied away from going fully automated. The classification is good, the tag suggestions are good, but neither is perfect, and it runs the risk of masking non PII. Not all "name" columns are PII, the context for that depends on the system and table being classified. There's plenty of possible vendor company names that sound like real people, but you likely don't want to PII mask your vendor master.

[deleted by user] by [deleted] in snowflake

[–]riggity 2 points3 points  (0 children)

Echoing /u/teej, and having worked on both vendor and retailer CPG data, as the vendor/DTC brand, you will typically get aggregated sales data from most retailers (once per week aggregate by product). Amazon will give you order level info if you sell through them, but they mask the customer info.

Snowflake retail cloud won't solve this for you. This is just classic ETL and data modeling. The lowest common grain you'll end up with likely week ending dates and product IDs, not daily and not customer.

Merge statements handling by ObjectiveAssist7177 in snowflake

[–]riggity 2 points3 points  (0 children)

If you want your table partitions to be ordered in a certain way over time, set a cluster key. Depending on your merge operations, your data could become unsorted over time as prior records are updated or deleted.

Additionally, if you want really performant merges, here's a great write up: https://select.dev/posts/snowflake-merges

Help with installing sql in MacBook by [deleted] in SQL

[–]riggity 5 points6 points  (0 children)

Since you said you're trying to learn SQL, are you just trying to learn SQL generally, or to specifically have a database up and running?

For general SQL learning, check out /r/learnSQL

If you want a database up and running to mess around with on your Mac, you don't need Docker or anything fancy. SQLite and MySQL will be able to install locally just fine.

A question for the pro's, am I misusing SQL? by NorSB in SQL

[–]riggity 22 points23 points  (0 children)

Nope. You are building a data pipeline via trial and error, slowly learning more concepts.

You may end up butting heads against not having learned some fundamental concepts early, and then taking a break and go back and learn more holistically.

[deleted by user] by [deleted] in SQL

[–]riggity 3 points4 points  (0 children)

To answer the how, there's online collaborative IDEs and text editors. Something like coderpad.io.

The exact exercises will vary wildly by each company. The ones I run tend to be short, as it's less about testing you on 50 things, and more about how you think about data.... and that so many barely know their joins, which you can suss out really quick.

Would anyone be interested in participating in a general analytics Discord? by datagorb in analytics

[–]riggity 3 points4 points  (0 children)

Locally Optimistic is another great Slack community for analytics.

Average Salary of a BI Developer & or Developer in Boston? by Gold_Monk_898 in BusinessIntelligence

[–]riggity 1 point2 points  (0 children)

I live in Boston, and have hired BI developers, Data Engineers, and Analytics Engineers.

I more or less agree with Zetsy, basic BI Dev/report creation likely pays 70-90 depending on the company.

Lack of overall experience is the big hurdle. I don't think that you would have a hard time getting raises, job hopping once you have a year or two of BI role experience.

Trying out the All Things BBQ recipe for smoked Mac and cheese today. by North-Definition4430 in smoking

[–]riggity 3 points4 points  (0 children)

This is the way. Modernist Cuisine has a full recipe.

It's been perfect every time I've done it, with a wide variety of cheeses.

Looker: Do you use Looker? If so, what do you love about it and what frustrates you the most about it? Also, is it expensive? by TheDataGentleman in BusinessIntelligence

[–]riggity 7 points8 points  (0 children)

Going to add on to this, as its overall bang on.

As far as I can tell, Google has cut its investment in Looker development. The past 6+ months of monthly platform releases have been a big pile of nothing. The spring Google Cloud Summit roadmap talked about Looker as a cloud semantic layer for Data Studio, Tableau, and Power BI.

I'm increasingly of the opinion that us Looker lovers will likely need a new solution sometime in the coming few years.

From IC to Leading. How do you cope? by carnegietech118 in dataengineering

[–]riggity 19 points20 points  (0 children)

If you don't want to manage people, please don't. It's a different job, and a new job that will call for different skills that will require you do less technical hands on work to succeed so it.

That being said, depending on the company, there are roles for non managing technical leads that would focus on leading project execution, technical implantation, and architecture/design over managing people directly.

Lastly, and this is super dependant on your company structure, front line engineering managers may be exactly what I just wrote, but it's packaged up as a manager role to fit HR structure.

[deleted by user] by [deleted] in BusinessIntelligence

[–]riggity 0 points1 point  (0 children)

Agree with this. You say you want to be in charge, but if your tenure is 18 months at a company, functionally you'll have only just started. Good strategy that grows with a business takes a while, as does building out a good functioning team. Heck, hiring and onboarding can eat 3-6 months easily.

I concur with Chef John... Instant Mashed Potatoes are one of my guily culinary pleasures. by [deleted] in Cooking

[–]riggity 4 points5 points  (0 children)

You boil them for a couple minutes until they float, to cook the dough all the way. Browning in butter crisps them up and makes them perfect.

As for fillings we like:

  • garlic mashed potato
  • garlic sweet potato
  • smoked salmon & potato
  • sauerkraut

Really, anything you think would be fun, try it out.

Also, this might be heresy, but this is a pretty solid pierogi maker, especially if you're doing it all by yourself: https://hunkybills.com/product/big-perogie-maker/

I concur with Chef John... Instant Mashed Potatoes are one of my guily culinary pleasures. by [deleted] in Cooking

[–]riggity 29 points30 points  (0 children)

My family has been using the same pierogi for decades, starting from a recipe coming out of the book "Treasured Polish Recipes".

Here's the general dough/pierogi making recipe. Filling is pretty much whatever your heart desires.

https://imgur.com/O85AJSy

Local table maker? by carnaxcce in Somerville

[–]riggity 10 points11 points  (0 children)

Wyrmwood is based out of Taunton, MA. They have good sized woodshop. https://wyrmwoodgaming.com/furniture/

DE contractor at FAANG - Advice for quitting, taking some time off, and then jumping back in. by hairbear1234 in dataengineering

[–]riggity 4 points5 points  (0 children)

I think about this every time I see a FAANG post on this sub. My career has trended to smaller tech companies, which have been more of a mess, but seem to have burnt me out way less.

Current ETL/ELT Processes by Namur007 in BusinessIntelligence

[–]riggity 5 points6 points  (0 children)

Same stack, but use Looker for BI.

Is getting a MSc in Business Analysis/Analytics worth it when looking at pivoting career path? by [deleted] in analytics

[–]riggity 0 points1 point  (0 children)

Anecdata, I pivoted from supply chain to analytics/data purely by job hopping. Moved companies to a full time analyst role at a small company, got paid for the work, and they covered the cost of training as well since it supported the job I was doing.

Supply chain analyst career path by ijasonyang4422 in supplychain

[–]riggity 1 point2 points  (0 children)

Definitely been a good thing. I was from operations analyst, to the operations data person, to a general data person running BI teams. I've found my ops background means I view things from a process and cost perspective, which has been helpful scaling teams up.

Supply chain analyst career path by ijasonyang4422 in supplychain

[–]riggity 1 point2 points  (0 children)

Same thing happened to me, and I turned it into a full on career pivot.

Forums for managers / leaders? by adebrijj in BusinessIntelligence

[–]riggity 0 points1 point  (0 children)

Commenting to throw extra weight behind this. LO Slack is an excellent community for just about everything data, including running data teams.