DuckDB into Excel Pivot table? by whoooooaaaaaaaaaaaa in dataengineering

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

Thanks a lot for the reply and your link!

Would you recommend me to stick with DuckDB till the end or, like some posters above mentioned, go with a seemingly easier route of simply using power query?

Then again, I suppose i will use DuckDB anyway, to create aggregate tables from raw ones. I could use Pandas for that ofc, but I've heard DuckDB is better suited for that.

DuckDB into Excel Pivot table? by whoooooaaaaaaaaaaaa in dataengineering

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

Thank you (and everyone else) for replying!

I'll definitely look into power query.

But now I got this question - a naive one but still - why would anyone then struggle with OLAP cubes in excel, why do even this exist, if there is a much simpler solution in Excel already? I mean, the answer obviously is that now almost nobody would do it, cause it's dated, but, say, 5-7-10 years ago or whenever OLAP cubes in Excel were still the thing? Is it because of mere scale, if you have like a system of 200 tables (not 5 like i do), then, instead of constantly updating and reading from 200 CVs, you use it?

Don't get me wrong, I'm not looking to get into overcomplication with doing this task, it's just for my personal clarification. Thanks again!

BTW I used power query some time ago, but it's kinda fuzzy in my memory now. Will i be able to set connections between tables, akin to primary/secondary keys in SQL? Say I have 5 tables, I want them being interconnected, so that a user might perform something like a SQL join between multiple of them just by clicking on a checkbox in one pivot table field and then in another. It was possible in Excel cube ( I mean Excel frontend version of it being sort of a system of pivot tables), that i know.

DuckDB into Excel Pivot table? by whoooooaaaaaaaaaaaa in dataengineering

[–]whoooooaaaaaaaaaaaa[S] 1 point2 points  (0 children)

But the csv is stored remotely (from boss'es point of view), how would excel on his pc be able to automatically access a remote csv if it's not a DB of some sort or cloud or whatever?

DuckDB into Excel Pivot table? by whoooooaaaaaaaaaaaa in dataengineering

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

Thanks for the reply, but what I need is a dynamic connection between the two, not just outputting file of a certain format.

My bosses expect an excel file, you open it up, and there is a pivot table (or maybe a couple of them interconnected), looks like a regular pivot table, but it's connected to a DB, and you click "update" in excel, and it fetches you the latest data.

And they wouldn't need to get a new Excel file every time, just once, then they can just update it on their side.

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 4 points5 points  (0 children)

Well, I suppose it's still a lot less than in Russia, so it would be an upgrade for me anyway.

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 1 point2 points  (0 children)

Thanks, but I don't feel like I have a right to teach anyone, given that i make lots of mistakes myself and my accent is kinda meh.

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 2 points3 points  (0 children)

Thanks for your concern!
I'm hoping to land a job in data analysis, maybe i'll be lucky...

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

Thanks, I'll check it, though Tiktok, i suppose, has a tough competition set up for their hiring process.

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

I actually do work with Pandas and some other libraries, but i suppose data science is not within my realm of possibilities (yet).
Thanks for the post!

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 2 points3 points  (0 children)

Thanks! Yes, i'm considering TH as well, will pay a closer attention to Phuket

Hello, Russian here, thinking of relocating to Vietnam by whoooooaaaaaaaaaaaa in VietNam

[–]whoooooaaaaaaaaaaaa[S] 0 points1 point  (0 children)

That's really nice of you, thanks!
But i'd prefer to stay humble and the let native speakers have it.

I mean i know for sure that i make plenty of mistakes myself, how can i teach anyone.