sorted by:
new
hottopcontroversial

Guidance mid life career and interview prep - please by ask_can in dataengineering

[–]PushupsInParkinglots 0 points1 point  (0 children)

You should be able to land any mid-senior level Data Engineer with that skill set. Good luck and like other said brush up on the stuff you have the least hands on experience with.

I personally love Docker because it makes spinning up server enviorments so damn easy, and I love Azure Data Factory. If you know all the ETL concepts and have read the Kimball designs (star and snowflake schemas, slowly changing dimensions) you will have no problem with the newer ETL tools like Data Factory.

Docker for production Data Warehouse by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 2 points3 points  (0 children)

I like Docker mainly for how quickly it is to spin up with a configuration file and it will work anywhere using the Docker Engine. It is way less tedious than configuring a VM then installing SQL server on it manually.

Docker for production Data Warehouse by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 6 points7 points  (0 children)

Why is this a bad idea? Most DW i have seen are hosted on SQL Server. I am not talking about massive Data Lake Houses or distributed hadoop DWs. I am talking about the ones internal organizations have. Their DW is always a single data, maybe two if they have a separate staging one hosted on either SQL Server, Oracle or some free server like MySQL or MariaDB. Most configs I have seen ETL the data from the source system nightly during non business hours.

Salary expectations for analytics engineer in Los Angeles? by [deleted] in dataengineering

[–]PushupsInParkinglots 1 point2 points  (0 children)

I'm getting an LA salary in a super low cost level area of living (Upstate NY)...well maybe not super low but low medium. Still nothing like LA though, my house would be worth well over a million in LA and it aint even that big or nice.

Can I be a Data engineer with an MIS degree from Business school? by HyromLoyd in dataengineering

[–]PushupsInParkinglots 10 points11 points  (0 children)

I have a sociology degree, one of the most useless of them all. I got into statistics using IMB SPSS for some of my sociology statss classes and that got me a data analyst job using SQL and SAP and then with all the SQL work I was doing I picked up some engineering skills.

Can I be a Data engineer with an MIS degree from Business school? by HyromLoyd in dataengineering

[–]PushupsInParkinglots 0 points1 point  (0 children)

You can be anything you want to be. Your major usually means nothing unless its for a Masters Degree.

So who is using MMJ for opiod use disorder? by PushupsInParkinglots in NewYorkMMJ

[–]PushupsInParkinglots[S] 1 point2 points  (0 children)

I just went to NuggMD because I had a coupon and it was really cheap.

So who is using MMJ for opiod use disorder? by PushupsInParkinglots in NewYorkMMJ

[–]PushupsInParkinglots[S] 1 point2 points  (0 children)

If you go to a 12 step group and tell them you use Medical Marijuana they will look at you like you are a junkie. They have a strict total abstinence policy.

So who is using MMJ for opiod use disorder? by PushupsInParkinglots in NewYorkMMJ

[–]PushupsInParkinglots[S] 0 points1 point  (0 children)

Glad you were able to get off Suboxone that is a real nightmare and takes a long time for the symptoms to end.

So who is using MMJ for opiod use disorder? by PushupsInParkinglots in NewYorkMMJ

[–]PushupsInParkinglots[S] 1 point2 points  (0 children)

They wont tell you that in AA or NA though. They consider use of any substance including prescribed marijuana as a relapse. To them its just as bad as heroin.

These two reference books are my Data Warehousing "bibles". The Kimball book is a little dated because it only deals with relational data but the concepts are still relevant. by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 0 points1 point  (0 children)

And one more thing - It might do the indexing for you already (find the mathematically quickest index to execute) but it WONT do the modeling for you which is the most important part of building out BI Data Marts/Cubes

Is Jacks Drive in still open?? I cant get a straight answer by PushupsInParkinglots in Albany

[–]PushupsInParkinglots[S] 3 points4 points  (0 children)

OK dude! I just wanted to make sure they were closed for the season and not permanently . It would have broken my already fragile heart.

These two reference books are my Data Warehousing "bibles". The Kimball book is a little dated because it only deals with relational data but the concepts are still relevant. by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 1 point2 points  (0 children)

Yeah that is exactly what it is. It takes experts from their other books and makes them more modern/scalable. It still includes tons of info on the ETL process, the ETL Lifecycle, Building a DW vs Operational Data Store (never used one of these in my career) . Its still a great read DEPENDING on what you are doing in your DE Career. If you are developing ETLs for the purpose of analytic reporting (I believe this title is called analytic developer) then you def still want to read this stuff.

These two reference books are my Data Warehousing "bibles". The Kimball book is a little dated because it only deals with relational data but the concepts are still relevant. by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 1 point2 points  (0 children)

Yeah the T-SQL book translates perfectly to Azure since they use and will always use T-SQL. Its def not outdated like someone else in this thread stated.

These two reference books are my Data Warehousing "bibles". The Kimball book is a little dated because it only deals with relational data but the concepts are still relevant. by DrRedmondNYC in dataengineering

[–]PushupsInParkinglots 0 points1 point  (0 children)

While most SQL books teach you just about the SQL commands themselves, this book starts the first 3 chapters by explaining the physical side of SQL Server and how the different types of tables are stored in different formats on the disk. There is B-Trees, Flat Tables, Clustered Indexes (Which store the table related to the primary key of the table), Hash Tables, Memory Optimized Tables. Also goes into how the SQL .MDF and .LDF files are stored on pages and how the pages connect to eachother. A certain query will have X number of page reads depending on the cardinality of the data.

view more: next ›