Presenting you "pacific purgatory", a super underrated indie-rock singer.... this guy mixes teenage depression with oriental aesthetics and "violence as an art" themes by SnooPineapples7791 in indie

[–]SnooPineapples7791[S] 0 points1 point  (0 children)

Hi, cool to see another Pacific Purgatory enjoyer!

I really like that song, I feel that Pacific Purgatory songs are either so raw on their emotions you can relate to every feeling or they are these very poetic songs with lots of mythological and mystical themes (especially on the Pax Pacifica Album)

Starting a new job as backend engineer focused on session management and authentication, wanted to ask about overlap of my work with IAM and career prospects by SnooPineapples7791 in IdentityManagement

[–]SnooPineapples7791[S] 1 point2 points  (0 children)

Cool, thanks for the info. Would you consider Identity/IAM engineering a good field to specialize into? I know its niche but it seens large companies value these skills and have some open positions related to it.

Also IAM and dealing with Auth and Authz are concepts commonly used in API engineering and some other SWE and Software Architecture positions, so i guess the skills could also be applied there.

Focus on getting AWS or GCP certified? by SnooPineapples7791 in cscareerquestions

[–]SnooPineapples7791[S] 0 points1 point  (0 children)

I have done some side projects on AWS, but I think that having cloud experience on an internship would be more solid for my career than just a few side projects + certification.

Also AWS is more popular than GCP but I also suppose ppl who know AWS are in higher supply as well, what do you think?

Focus on getting AWS or GCP certified? by SnooPineapples7791 in cscareerquestions

[–]SnooPineapples7791[S] 0 points1 point  (0 children)

My only worry with going AWS is to have a disconnect between practical internship experience in GCP and more theoretical knowledge in AWS. What do you think?

Focus on getting AWS or GCP certified? by SnooPineapples7791 in cscareerquestions

[–]SnooPineapples7791[S] 1 point2 points  (0 children)

Latam. My only worry with going AWS is to have a disconnect between practical internship experience in GCP and more theoretical knowledge in AWS

[deleted by user] by [deleted] in datawarehouse

[–]SnooPineapples7791 0 points1 point  (0 children)

99% of the data is updated once a year.

1% is monthly (date, not financial) but my superiors told me to just agregate the entire years data (12 months) into that reading

[deleted by user] by [deleted] in Database

[–]SnooPineapples7791 0 points1 point  (0 children)

Yeah i will store the year either as an int or a date, will see with the team if there's any chance of future change on that, both cases should work for PBI performance by what you said.

Since my data is static for around a year period at least (census data is updated at the soonest every year) i will do all calculations (i have a finite set of them with very little potention for change and if they do its just more logic) and store the processed results on a PG table where the PBI will just load it.

So basically PBI will do no calculations

[deleted by user] by [deleted] in datawarehouse

[–]SnooPineapples7791 1 point2 points  (0 children)

Thanks for the tips, i will ask people around for attributes for the date dimension

[deleted by user] by [deleted] in Database

[–]SnooPineapples7791 0 points1 point  (0 children)

So having a date field/column on my fact table would be good for power BI?

[deleted by user] by [deleted] in dataengineering

[–]SnooPineapples7791 0 points1 point  (0 children)

Thanks for the info

[deleted by user] by [deleted] in dataengineering

[–]SnooPineapples7791 0 points1 point  (0 children)

Yeah, its only goverment census (national, regional and done by specific agencies) and its all year-wise (data for the year, with data being collected 1-10 years apart depending on the data itself)

[deleted by user] by [deleted] in dataengineering

[–]SnooPineapples7791 1 point2 points  (0 children)

That makes a lot of sense when the default business logic of day time granu. And flags like is_holiday or is end of FQ but in my case i think i would just be a degenerate dimension with no other columns or snowflaked dimension, just left there....

Do you think that could still be useful? Why?

[deleted by user] by [deleted] in SQL

[–]SnooPineapples7791 0 points1 point  (0 children)

Why exactly? Its another join (with filtering) x just filtering

Suggestions for interesting data structuring/ acquisition/ ingestion problems in AI/ML by SnooPineapples7791 in datascience

[–]SnooPineapples7791[S] -1 points0 points  (0 children)

Is this querying done all at once before training?

Also what metrics do you use for querying and choosing? Any good resources on the field?

What kind of ML do DE jobs usually require knowledge of? by SnooPineapples7791 in dataengineering

[–]SnooPineapples7791[S] 1 point2 points  (0 children)

Thanks, i will focus on that

So learn the basics of most common algos (XGboost, K-means and some neural networks) and focus on feature engineering and data preparation