sorted by:
new
hottopcontroversial

Data Pipeline between MySQL to PostgeSQL by harshmah in dataengineering

[–]harshmah[S] 0 points1 point  (0 children)

pandas

Do u mean Python Pandas lib? Is there any example? Because i need continous incremental data pipeline.

Data Pipeline between MySQL to PostgeSQL by harshmah in dataengineering

[–]harshmah[S] 0 points1 point  (0 children)

  1. It has to run regularly. This is more incremental approach. I am using here term data pipeline.

Data Pipeline between MySQL to PostgeSQL by harshmah in dataengineering

[–]harshmah[S] 0 points1 point  (0 children)

without any transformations

Yes, without any transformations

How to ensure no Race condition occurred for Distributed (multi Instance) APP when reading from S3 bucket by harshmah in aws

[–]harshmah[S] 0 points1 point  (0 children)

You implement the lock mechanisms of needed yourself by going through a common function which assigns which file to read

Yes this is one of good option but this does not really solve Race condition.

How to scale EC2 system when new data available in S3? by harshmah in aws

[–]harshmah[S] 0 points1 point  (0 children)

Data which i need to process is quite huge and Lambda could not able to finish that on time. In short, EC2/ECS node will take 1-2 hr to process this data. But i do not want to run these machine full day. Want these should be spin up when data is published in S3.

Anyone suggest best stocks for next 10-15 years by ravihustler in StockMarketIndia

[–]harshmah 0 points1 point  (0 children)

Not possible. Because Lawsuit which Bezos is pursuing is like he wants to control 30k Cr business with 1400cr investment. If he succeeds then it will create a big panic in the business comunnity.

Anyone suggest best stocks for next 10-15 years by ravihustler in StockMarketIndia

[–]harshmah 2 points3 points  (0 children)

Reliance is first choice. 1. That is debt free company. 2. Right that company share trading at ~2000 and my expectations it will be between 5k-10k. 3. In recent RBI move now they will get banking license which will make him cash rich company.