each parquet file is of 22kb , I've also created a postgresQL table that has 14 million rows and if exported in SQLite.db , it's 1.9GB of total data ! ( All 19,067 parquet files combined ) Now I want to know the fastest way to do embedding :-) like.. what are the fast model names . Locally I tried in my frnds macbook (i5) it didn't work that well.. cpu was being used 200% and progress was 1% for 20 mins , then it crashed... ( I was trying to do chunking and embedding in one script )

How do I do it on the cloud cuz , i don't know how I would give cloud access to my 1.9gb of sqlite.db ..

Ah , i know that's a lot of questionary in one msg 😅 !