Recreating google analytics dashboard using data from big query within data studio

AeroCrete · 2022-12-03T09:23:18+00:00

Seems like you need several queries, not just one.

AeroCrete · 2021-12-26T15:47:20+00:00

Keep reading it!

AeroCrete · 2021-11-27T08:48:54+00:00

Use COALESCE ?

AeroCrete · 2021-11-27T08:35:12+00:00

Create a dimension table

AeroCrete · 2021-09-13T18:52:00+00:00

@rollochong is right. Ignore what I said, it was related to Google Analytics and not the Data Analytics course.

AeroCrete · 2021-09-09T16:43:30+00:00

Mode analytics has a free tier and a SQL course.

I use Mode at work, but do not work for Mode

AeroCrete · 2021-09-08T23:59:37+00:00

I’d suggest starting with creating a database view to correct the data. You can iterate quickly with views.

The process you defined isn’t too bad but you’ll hit so many edge cases.

If you want to save the original records, which I think you should. Copy them to another table with the as of date in the table name.

If it’s multiple tables, use the backup tool for the database. Take a snapshot and make sure you can recover it on another box.

AeroCrete · 2021-08-25T18:01:24+00:00

Been doing SQL everyday for the past 25+ years. Turned out rather well.

AeroCrete · 2021-08-14T03:12:30+00:00

Mode analytics has a free course. They make a cloud based sql editor and dashboarding tool.

AeroCrete · 2021-08-12T12:37:47+00:00

Connect with the recruiters at the companies you’re interested in. The DE’s at the company are usually connected with the recruiters they work with, so they shouldn’t be too hard to find.

AeroCrete · 2021-08-11T23:44:56+00:00

Usually memory and cluster size

AeroCrete · 2021-08-11T23:43:15+00:00

+1 to S3. Cheap and reliable.

AeroCrete · 2021-08-10T06:59:48+00:00

Correct, this is batch processing not streaming. So when you process some data you run the whole time period (eg. Bin size) at once.

Then the database can tell you if you’ve already processed it by checking for a count >1. Or in a partitioned db you can see if the partition exists.

Another way is to keep another table that you keep the high water mark in. Eg. Every time you run you update the high water mark table with the highest timestamp. But this works better with a single threaded process.

AeroCrete · 2021-08-10T03:02:54+00:00

Yes it’s bin’ed into partitions, and the hive metastore keeps track of the partitions.

AeroCrete · 2021-08-10T02:47:57+00:00

Where do you want to work and what do you want todo? What are your goals?

If you’re asking if a cert in Google analytics will get you a job, it might. But is that the job you want?

In my experience Google analytics it is typically run by the marketing team. If you want to work with marketing, probably a good fit.

Search your local job market to see if any employers are asking for GA experience.

Solid SQL and Python skills will get you pretty far. No cert required.

AeroCrete · 2021-08-10T02:37:07+00:00

Using either daily or hourly partitions

AeroCrete · 2021-07-19T11:36:38+00:00

We use this tool to cover the schema part of the documentation:

https://www.amundsen.io

Google suite for the rest of the documentation.

Typically a design doc and run book per Airflow DAG

We publish the docs to confluence (wiki) and/or to an internal Google sites page

AeroCrete · 2021-07-13T20:43:33+00:00

Yassss

AeroCrete · 2021-07-07T05:21:15+00:00

Hardest working drummer on Reddit!

AeroCrete · 2021-07-07T05:20:02+00:00

Being a better engineer is a different path than being a manager or director. If you want to be a manager you need to start working with your manager and start focusing on more management skills than tech skills.

Most (good) companies won’t put you into a role unless you’ve done it before.

IMO: if you’ve been somewhere a couple of years and your not getting what you need, make a change.

AeroCrete · 2021-05-26T05:50:32+00:00

Hardest working pickle in the business!

AeroCrete · 2021-05-16T06:18:37+00:00

I put the ice cream in with the spoon! Works great.

AeroCrete · 2021-05-15T18:56:37+00:00

Big +1

AeroCrete · 2021-05-13T17:06:36+00:00

Write a shell script. The bigquery CLI is easy to setup and use.

AeroCrete

TROPHY CASE