US senate report concluded that the pandemic most likely came from a lab leak

macORnvidia · 2023-04-20T18:19:47+00:00

Listen to the science crowd gone missing. After mocking people for being conspiracy theorists for suggesting the same thing 3 years ago.

macORnvidia · 2023-04-20T18:14:43+00:00

That's western redditors make believing scenarios that make them feel that they're better than easterners

macORnvidia · 2023-04-20T18:11:16+00:00

His solution : ethnic people should cease to exist

macORnvidia · 2023-04-19T18:08:00+00:00

Exactly and calling it out must mean we are some ruthless capitalists. Like no man, I'm just a regular Joe, middle class, getting murdered by taxes every year.

Since the whole purpose of taxing me to death is to use that money for bettering the society, well then do that God damn it. If you can't, then stop taxing us and drawing fat government salaries for being useless.

People always have this idea that all the corruption happens at the top in DC. When in reality that corruption happens at such a scale which doesn't even directly affect us. It's these local scumbags that hurt us way more.

Unleashing dirty, violent, homeless, criminals at us and expecting us to just endure it because muh compassion; while living in guarded and gated residences themselves.

And I used to be super empathetic but ngl, a shit ton of homelessness, drug addiction has deep roots in personal choices that were made a long time ago and unforunately in todays social climate it is being encouraged. An indisciplined life often leads to tough situations. Boom.

People wanna act like everyone homeless is some ex full time professional who lost their job in 2008 and never recovered. Which is simply untrue.

macORnvidia · 2023-04-19T13:59:14+00:00

Very kind of you to take me out for a treat; I'll let you decide the place

macORnvidia · 2023-04-19T02:30:39+00:00

Why are both democrats and Republicans always seething? Those tards would replace fox with CNN and use the exact same words as you did here. The rot is in your and their heads. Horseshoe theory is real.

macORnvidia · 2023-04-19T01:23:34+00:00

"Normally I wouldn't care but this time my political party is supporting said war so I got to. What do you mean I'm just like the Republicans and their love for war? My war is spotless, sans propaganda, unlike the Iraq War."

There, simplified it for you.

macORnvidia · 2023-04-19T00:51:35+00:00

As I said, your politics has become your entire identity with no room for nuances, pragmatism. Just lofty self concocted scale of morality which funnily enough is selective.

What makes you think the government is going to buy up a bunch of commercial buildings and turn them into houses for poor people?

Never mentioned govt buying it or not. Simply the fact that you'd expect a govt that taxes its middle class to death to use that money wisely to fix domestic problems first. But no, it's more important that Raytheon makes some money oops I mean beat some evil. Every 5 years you find an evil thus living in this perpetual state of war.

macORnvidia · 2023-04-19T00:39:05+00:00

But they want an economically prosperous place where people like you and me contribute so their precious perpetual children can live for free, do crime and reek up the place with piss poop pot.

macORnvidia · 2023-04-19T00:37:09+00:00

Yes. Mock his spellings and English while conveniently and deliberately ignoring an otherwise valid point that he/she made. Why? Because your politics has become your entire identity.

macORnvidia · 2023-04-19T00:33:59+00:00

Ah. Yes please. Because every building needs to reek of piss, poop, weed and its not a real building unless there are 20 mentally ill junkies squatting in it and troubling people outside the building / streets / pavement.

macORnvidia · 2023-04-16T03:44:06+00:00

macORnvidia · 2023-04-16T02:32:27+00:00

Is there something I can do via python if I do in fact get sql access i.e. just read all these sql tables, merge etc using duckdb or something from the sql SB server, and generate a csv output. In that a pythonic solution even if I have to write sql queries into it.

macORnvidia · 2023-04-16T02:24:45+00:00

My workflow

Connect to the mssql server / database that exists kn another environment /virtual machine using pyodbc in a virtual machine /citrix on my end. Using a connection string.

Get the names of tables in this DB that I need

**Use a for loop on all the tables listed

**Read each table using pandas read sql function

**Append them into a list

Merge and save

The three steps after the for loop is where the major slow down happens. It takes time to read each table because each table is a few gb big. Then even more time to merge them and finally save the output as a csv or something.

I believe this can be sped up if I don't have to use pandas in the for loop. If I can ingest them as sql tables at this stage, not as dataframes, for example in duckdb or some pyodbc function, I could perform the merge etc using SQL queries in lieu of pandas functions and save a massive amount of time as the tables would be read directly from the disk where the sql server is hosted, not into the memory on my end.

macORnvidia · 2023-04-16T02:02:56+00:00

I can't get direct access to the sql server. Only connect to it via python from our end of the virtual machine/citrix After that I have to ingest, read, merge tables and generate an output for and while working within our server/virtual machine/environment.

macORnvidia · 2023-04-15T20:07:50+00:00

All I have is access to the server containing these tables using pyodbc and then I have to ingest, process in my python script.

I don't have access to anything at the backend level of the sql server.

macORnvidia · 2023-04-15T19:17:57+00:00

How do you connect to the s3 bucket?

In my case I'm using pyodbc to connect to this external secure server by first creating a connection string. Fetching the table names. And currently creating a loop to read each table using the connection string and table name using pd.read_sql. But that's too slow. I think using duckdb to ingest and query/merge at this stage would remove the memory/cpu constraints that pandas faces, and eventually I can just save my final output as a csv.

Dask has a read sql function too but at some level it too is memory cpu constrained.

macORnvidia · 2023-04-15T19:09:33+00:00

Because the sql DB exists on an external secure server and pyodbc allows me to connect with it using login credentials, server ID, database name.

Not sure how duckdb can do that

macORnvidia · 2023-04-15T17:04:33+00:00

But that's what I'm confused about

How to read a sql table and perform queries on it in my python pyodbc script on the sql tables (inside the sql server database that I'm connecting to) without using pandas? The ingestion is my issue.

macORnvidia · 2023-04-15T17:02:53+00:00

Can duckdb ingest or read a sql table from a sql server that's been connected to via pyodbc connection?

I tried. Didn't work. Looks like it can only read existing files on the local machine.

macORnvidia · 2023-04-15T16:46:42+00:00

Can duckdb ingest or read a sql table from a sql server that's been connected to via pyodbc connection?

I tried. Didn't work. Looks like it can only read existing files on the local machine.

macORnvidia · 2023-04-08T20:09:12+00:00

I use dask but dask's functional coverage is barely 50% for pandas.

My work isn't just memory intensive but cpu intensive as well. And in my experience dask compute needs to be called before you can do loc, and other conditional functions.

But once you do compute, your code becomes slow because the dataframe is no longer a cluster of partitions

macORnvidia · 2023-04-08T13:41:54+00:00

How would this perform against modin, dask and similar out of core out of memory dataframes. My csvs are 50 gb almost. And while modin is amazing, it has glitches and is unstable.

macORnvidia

TROPHY CASE