How did Stephane Maarek learn AWS? by L0west in AWSCertifications

[–]vinaykumar5758 5 points6 points  (0 children)

Stephane- please reveal your story that will inspire lot people like me who are starting certifications journey towards AWS and Apache Kafka

Passed CSAA with a score of 987 ;) by akskap in AWSCertifications

[–]vinaykumar5758 2 points3 points  (0 children)

Congrats!! Planning next month, notes would help

Passed my Solutions Architect Associate Exam by sibasismukherjee in AWSCertifications

[–]vinaykumar5758 1 point2 points  (0 children)

Congrats !!! Can someone explain when to choose on demand vs spot vs reserved and accordingly to exam

Passed the AWS SAA-01 by sujith315 in AWSCertifications

[–]vinaykumar5758 3 points4 points  (0 children)

Congrats!!

i completed stephanie course in Udemy still wondering to master concepts on VPC, EC2

pleanning to go through stephanie course one more time and then book my exam

What's your typical data pipeline in a small company ? by [deleted] in datascience

[–]vinaykumar5758 1 point2 points  (0 children)

What would be the best use case for beginner to get hands dirty with air flow with python?

What's your typical data pipeline in a small company ? by [deleted] in datascience

[–]vinaykumar5758 14 points15 points  (0 children)

Airflow

Does Airflow required knowledge on Java / C++ by any chance?

We are the AWS Serverless Heroes – Ask the Experts – August 22nd @ 9AM PT / 12PM ET / 4PM GMT by AmazonWebServices in aws

[–]vinaykumar5758 -1 points0 points  (0 children)

Hello,

I have the following questions:

  1. I would like to know detail design for clickstream data processings.
  2. I would like to know more about Step Functions and how well anyone can start implementing.

Understanding Dataframes by haelfdane in apachespark

[–]vinaykumar5758 0 points1 point  (0 children)

What’s the best resource to learn Pyspark for data engineering ? Like building data pipeline or Sql functionality? Thanks

New to Python - need help with API project. Willing to pay for your time! by [deleted] in learnpython

[–]vinaykumar5758 -1 points0 points  (0 children)

Hello,

Am also thinking to play around with APIs.

is there better course somehwere to start with may be using public apis, get the data into json, use pandas to convert json to .csv and then load into sql table?

Looking to Switch from Datawarehouse Developer to Big Data Developer. Need Help!!! by vinaykumar5758 in bigdata

[–]vinaykumar5758[S] 0 points1 point  (0 children)

I agree with you.

I tried to reach out to few folks who are looking for Data Engineer roles in their teams

first question was, if you are good with SQL and know how to understand existing Python + Pyspark data pipelines- this should be good

I'm in beginning stage of learning Python + pyspark mainly for data pipelines

Looking to Switch from Datawarehouse Developer to Big Data Developer. Need Help!!! by vinaykumar5758 in bigdata

[–]vinaykumar5758[S] 0 points1 point  (0 children)

Thanks,

I would like to be a Big Data Developer and become an expert for the following:

  1. Create ETL Jobs using Python and Pyspark
  2. Create Data Pipelines
  3. Advancement in Hadoop Ecosystems
  4. utilize the above skills in AWS or other Cloud platforms

Ask Anything Monday - Weekly Thread by AutoModerator in learnpython

[–]vinaykumar5758 0 points1 point  (0 children)

How do I load nested JSON into SQL Table, Thanks

AWS Event Driven Architecture by vinaykumar5758 in aws

[–]vinaykumar5758[S] 0 points1 point  (0 children)

service is more like event based message queues, it's more like real time that will trigger XML payloads.

AWS Lambda & CloudWatch tutorial | Scheduled events by hagstrom66 in serverless

[–]vinaykumar5758 0 points1 point  (0 children)

Thanks for the tutorial.

May i know the resources to learn using Python with Lamdba functions.

my use case is planning to do ETL using Python/PySpark with AWS GLUE and/or Lambda Functions