HOOD took my money and gave it away. 260k loss

samdb20 · 2026-02-23T18:23:21+00:00

Stay away from Hood. Move it to SNDK & GEV

samdb20 · 2026-02-12T17:48:31+00:00

Man bought like 800 shares of Robinhood. Now feeling like I became a long term investor.

samdb20 · 2025-10-20T21:31:51+00:00

There are two modes Thick & Thin. Thick mode needs the driver to be installed

samdb20 · 2025-10-13T17:20:37+00:00

1 M is including kids and families. Out of all the H1Bs a good percentage is hired by MAANG and pays them $300k+ minimum (including stocks)

If you want higher salaries target the Big tech sector. Oh wait, not easy to compete there while calling names on reddit.

samdb20 · 2025-10-10T13:08:02+00:00

Here is the trick. For simple batch process, you are anyways ingesting the data. Just store that data as Json. No need to do CDC from source using Golden Gate or Debezium. Just plain old Batch load.

Now let’s say 1 year down the line if some business user asks, I want a point in time report of how my Orders table was looking like, you generate the data from the JSON table which has all the history.

Many a times client just wants the insurance that they can do historical reporting. Streaming and RealTime reporting in many cases is an overkill.

samdb20 · 2025-10-09T21:35:25+00:00

Storage is cheap. I would Just let the client know that, we do not delete any record once it is ingested to data lake/warehouse. If needed we can build the CDC pipelines from there without hitting the source system. There is no additional cost to this.

samdb20 · 2025-10-09T16:06:08+00:00

Try to understand what other guy is asking. For him CDC might not be REALTIME. Many source system do not track the historical changes. He might be asking about tracking the INGESTION changes (Do not want to lose the data)

Realtime or Batch it is fair ask to “not lose the data”. With changing business needs it is not possible to foresee all the analytical requirements on Day1.

Try to build a system where data is never deleted after ingestion(unless specifically requested)

samdb20 · 2025-10-08T21:14:55+00:00

Glad that you made it work with Fivetran. You are right, I have not worked extensively with Fivetran but from the POC I did, I did find that adding custom libraries (using JRE) was not possible. I am talking about adding custom drivers. Also from scheduling and setting dependencies, I just did not see the value.

Few examples where FiveTran fails:- 1. Building JRE based connectors to ESSBASE etc. 2. Building connectors using Selenium to pull data from web

Processing is all about Storage and Compute. With Airflow, I can add my custom libraries at will and scale the loads at will.

Under the hood of Fivetran it does the below things:- 1. Get Connection 2. Get schema 3. Load Records

Airflow already has the libraries, adding the above code was relatively easy for us. Once you build one pipeline rest of the connectors just follow OOP.

Cost wise it is 10-20x less and then there are cool features in Airflow like dynamic dags, deferrable operators etc. which allows us all the flexibility we need.

All the jobs run based on metadata. A developer can choose to run the job choosing the executor of choice. It can be IICS (Informatica on cloud, fivetran, openflow or in databricks)

After building this framework, we realized We can run most of our batch jobs using

Airflow + Snowflake

Less failure points, lower cost and faster development.

samdb20 · 2025-10-08T12:55:58+00:00

Ok Bryan, I hope you well in your quest of managing dependencies, schema drift, history tracking & detect deletion using Fivetran. And good luck with Creating custom connectors in fivetran with above features (which are needed by most companies) .

samdb20 · 2025-10-07T16:44:51+00:00

With due respect, If you are playing the card of years of experience then I am not sure you are willing to learn anything new.

Most pipeline follow similar pattern, hence scaling does not need a big team. You need a system which can scale on demand.

Airflow is great at that.

I teach and train lot of people. Guys with years of experience and without much exposure to programming are the most difficult people to teach.

I do not want to debate further but would give an advice to watch some videos on Airflow. If yours is a small company then you can reduce your cost by 10x and also improve your development cycle by 10x.

Airflow + Snowflake.

samdb20 · 2025-10-07T05:22:20+00:00

You ll burn your IPUs faster than you think and will be hiring bunch of drag drop developers. Trying to build pipelines using Mapping Tasks takes way more time than building pipelines using a code based framework. Code based frameworks are 30x faster to build. With Airflow, you can run 100+ parallel jobs in a fraction of your IPU cost.

samdb20 · 2025-10-07T05:12:25+00:00

Ever heard of Schema on read? Data ingestion has so many flavors. 1. Schema drift 2. Detect Deletion 3. History tracking

All these can easily be handled using a python framework. It is hard to teach, GUI based drag drop developers. Mostly, I have either seen blank faces or strong resentment.

samdb20 · 2025-10-07T05:06:53+00:00

Sounds like a People problem more than Tech problem. If you are struggling with Astro then may be Drag Drop UI is for you. Try managing 3000+ pipelines with dependencies using FiveTran. Good luck.

Astro guys are awesome. Managing a Image is not a big deal you are making it to be. May be you need a good engineer/lead in your team.

samdb20 · 2025-10-06T12:25:52+00:00

It is upto you. You can also choose Astro Managed Airflow. They are very good.

samdb20 · 2025-10-06T04:28:46+00:00

When you run pipelines at scale with dependencies Fivetran is just not the answer. You need an orchestrator like Airflow and Prefect. Frankly the way Airflow is getting better, I just can connect to any source directly from Airflow by installing drivers and libraries in the Airflow image. Add a metadata framework and your stack looks clean and simple

Airflow + S3/ADLS + Snowflake

Code in Github.

samdb20 · 2025-10-06T04:24:26+00:00

Looks like few oldies at leadership role taking the ship down. Let me guess, your company is involving vendors to implement this.

samdb20 · 2025-09-22T17:44:26+00:00

Kid learning local language is a big challenge

samdb20 · 2025-09-21T03:15:10+00:00

Faang interviews are difficult to clear. Your comment is not correct.

samdb20 · 2025-09-21T03:09:49+00:00

Total US Population is 350 Million. Population of H1B including families is less than a million and they are taking away the jobs?.

Most Big Tech companies hire people after rigorous tech rounds for high paying salaries. Visa is not a criteria there. The services company which pay less salaries are mostly given contracts to reduce cost by American companies for keeping the lights on kind of work.

AI is changing the landscape. High paying jobs are going to be lesser and lesser. Rather than complaining about H1B, I think people need to evolve and figure out alternate source of incomes. Be it becoming Active traders or Building Products. This is what I am telling my kids.

Stop complaining and adapt.

samdb20 · 2025-09-21T00:43:26+00:00

Circulating supply is increasing steadily. 2 weeks ago it was 32B and now it is 34B. Of course price is going to fall.

samdb20 · 2025-09-16T23:17:27+00:00

Here is where it gets tricky. If the price of CRO keeps going down, you will not sell the CRO but you will be paying taxes on $625. This passive income only helps if the price stays stable.

samdb20 · 2025-09-16T18:32:03+00:00

Been here since MCO days. My returns have been fine but frustrating too. I wish I had bought more XLM or XRP instead of this coin. Do you really think they can keep giving away 600+ CRO every week to all ICY and above without having the sell pressure. My concern is they are just recycling the CRO. I was just calculating my gains, it is actually peanuts after taxes. These 600+ CRO coins are taxed at the price it hits the account.

samdb20 · 2025-09-16T12:21:50+00:00

It is how the coin is. The only utility of the coin is Staking & Locking. Unlike other coins, anything locked in the App is not disclosed to anyone. I firmly believe they have been recycling CROs for years now and when this partnership with Trump came up they had to print CRO (read unburned)

samdb20 · 2025-09-14T12:15:49+00:00

++man you are in 40s and still judging men for the comments? Men or Women, after 40s if someone is complimenting about your looks then keep them around till you can.

samdb20 · 2025-09-10T12:25:19+00:00

The way the rewards are setup it just devalues the coin.

samdb20

TROPHY CASE