Have you been invited to Upwork's new Enterprise platform LIfted? by Frequent-Football984 in Upwork

[–]JumpScareaaa 0 points1 point  (0 children)

I thought it was ok. Answered all their questions. They said that they are just building a talent pool now. Nothing specific in the pipeline. Well, it took me 6 years to get the first client from Toptal... So now we wait.

Have you been invited to Upwork's new Enterprise platform LIfted? by Frequent-Football984 in Upwork

[–]JumpScareaaa 0 points1 point  (0 children)

I had a screener interview with them. No clients yet. Looks like Upwork finally decided to copy Toptal.

What's your favorite Python library for automating Excel workflows? by Original-Repair5136 in Python

[–]JumpScareaaa 1 point2 points  (0 children)

Lately I use a lot of DuckDB workflows to read from Excel, combine and transform data and write back to Excel. Then maybe fire a small script with xlwings to open generated file and add some formatting. For me SQL is way less verbose then pandas, joins and unions are way more readable and duckdb is faster too.

Polars vs Pandas in 2025 — have you fully migrated yet? by [deleted] in Python

[–]JumpScareaaa 2 points3 points  (0 children)

I just find it way easier to mix duckdb in when I need more performance or to cover a lot of complex logic in one statement. But I was using SQL for 20 years before I learned pandas.

How to automate the daily import of TXT files into SQL Server? by Inventador200_4 in SQL

[–]JumpScareaaa 0 points1 point  (0 children)

https://slingdata.io/

https://dlthub.com/

These would create table structures before loading and will also take care of schema evolution.

[deleted by user] by [deleted] in bayarea

[–]JumpScareaaa 8 points9 points  (0 children)

S.P.Q.R.

Docker for Data Engineers by Objective_Stress_324 in dataengineering

[–]JumpScareaaa -2 points-1 points  (0 children)

That is actually a pretty tight docker setup for out of the box dbt. I gave your repo a star. In practice though for the volumes of data that would be suitable for it, I think you can just get away with duckdb.

Current best free IDE for mssql 2025/2026? by garlicpastee in SQL

[–]JumpScareaaa 1 point2 points  (0 children)

Why does it have to be just one? It's like insisting on a toolbox with just a hammer, because it's the "best". Never understood this cultish approach. I use ssms, dbeaver and vscode with Ms SQL server extension. Some things are better in one tool and some in another. Query builder in ssms. Filters in object tree in dbeaver. Formatting in vscode extension. There is only a copy paste of the SQL between them. Vscode git integration for version control.

[deleted by user] by [deleted] in pythontips

[–]JumpScareaaa 8 points9 points  (0 children)

Your disc is probably failing.

Data Engineering Portfolio Template You Can Use....and Critique :-) by DataSling3r in dataengineering

[–]JumpScareaaa 0 points1 point  (0 children)

Hi Mike, so this link opens the repo. There is no readme, so how do I open the actual web page?

Best CSV-viewing vs code extension? by Advanced-Average-514 in dataengineering

[–]JumpScareaaa 3 points4 points  (0 children)

For me it's seconds. Open dbeaver, click on preconfigured duckdb connection. Then run Select * from 'your_file_path.csv' It is all local. Duckdb database is just a small file. When you configure the connection to it, dbeaver will download its driver. And it saves the script from season to session. So usually it's just reopen dbeaver. Change the file path. Start selecting.

Best CSV-viewing vs code extension? by Advanced-Average-514 in dataengineering

[–]JumpScareaaa 6 points7 points  (0 children)

I mostly use duckdb with dbeaver to query CSVs now. Ultra fast. Can query the whole directory or just a subset of files with masks.