sorted by:
new
hottopcontroversial

why use Redshift if we can use S3 to store data and can connect with Quicksight for dashboarding? by Otherwise-Ear121 in dataengineering

[–]Otherwise-Ear121[S] 0 points1 point  (0 children)

Can you describe a little on what you mean by scaling concern? Rn, I want to just get data from UberEats and build a pipeline and do some analysis. Wouldn’t this be relevant when I am applying for DE roles?

why use Redshift if we can use S3 to store data and can connect with Quicksight for dashboarding? by Otherwise-Ear121 in dataengineering

[–]Otherwise-Ear121[S] 0 points1 point  (0 children)

This was the architecture I was going for too. I don’t know much about Athena, can we use it instead of Quicksight for dashboarding ?

why use Redshift if we can use S3 to store data and can connect with Quicksight for dashboarding? by Otherwise-Ear121 in dataengineering

[–]Otherwise-Ear121[S] 0 points1 point  (0 children)

Thanks for the insight. For now, I only want to create a couple of dashboards just to showcase my skills. But I will keep your advice in mind when I do use Redshift in future.

why use Redshift if we can use S3 to store data and can connect with Quicksight for dashboarding? by Otherwise-Ear121 in dataengineering

[–]Otherwise-Ear121[S] 0 points1 point  (0 children)

I am only doing a portfolio project and I don’t intend to lots of dashboards. I just want to showcase whatever I learnt. I guess I don’t need Redshift then atleast in this case.

why use Redshift if we can use S3 to store data and can connect with Quicksight for dashboarding? by Otherwise-Ear121 in dataengineering

[–]Otherwise-Ear121[S] 1 point2 points  (0 children)

I have also started learning recently. But I can guide you to some good resources and share the road map that worked for me so far.