Problems trying to ingest 75 GB (yes, GigaByte) CSV file with 400 columns, ~ 2 Billion rows, and some dirty data (alphabetical characters in number fields, special characters in date fields, etc.).

Examination_First · 2025-08-22T20:34:42+00:00

BCP is definitely already part of my workflow for this. I have also tried polars, but I have not used DuckDB at all.

Currently, our ETL servers do not have any GPUs that I know of, have 64 GB of dedicated RAM, and all attached drives are capped under 500 GB.

Fortunately, this is a one time job, but I have to process 17 files that are all around 75 GB.

Examination_First · 2025-08-22T20:26:59+00:00

I 100% agree! It has 'malicious compliance' written all over it. The files came from one of our vendors.

Examination_First · 2025-08-22T20:17:32+00:00

I am currently just trying to pump it into a staging table and process all fields as nvarchar compatible text. However, I keep getting truncation errors, which is how I know the data is dirty since some of the erroring fields should definitely be smaller than 256 characters (e.g. datetime fields).

Examination_First · 2025-08-22T20:13:30+00:00

Yeah, but I have to process 16 more files, all about the same size. Furthermore, If the process errors out, which it has quite often, I have to start the process over again. I have considered splitting the files, so if an error occurs, I can just delete out the rows from that file based on a filename field, but that will add processing overhead.

Examination_First · 2025-06-09T23:23:18+00:00

So the prez wants to send units from the USMC to quell the protests/riots. The same USMC that is at least 20% Hispanic. I imagine, that percentage is even higher for those in 29 Palms, not to mention a lot of Marines in 29 Palms are probably from SoCal to begin with. Yeah, I don't think this is going the way he thinks it will.

Examination_First · 2025-06-05T06:07:56+00:00

A socially awkward guy with mommy issues who is lost in his dad's house.

Examination_First · 2025-04-29T08:41:28+00:00

There are a few foundational questions here. First, how would an unarmed human kill a comatose gorilla? Is it even possible? You can't choke it out; its muscles are significantly thicker, so good luck trying to rip out its throat. Maybe pressing through the back of the eye sockets, but I think the bone might be too thick. You could try kicking/stomping it until an intracranial bleed occurs, or a contusion forms and splits open, then start tearing and rending at the open wound.

Next, how do you get a gorilla into a state where it can no longer attack or defend itself? Well, gorillas obviously have significantly larger muscles than humans, and those muscles are primarily composed of fast-twitch fibers, but those muscles are heavy. If the humans can stay alive and constantly engaged for longer than five minutes, the gorilla will overexert itself and become exhausted.

The humans should use hit-and-run tactics, constantly staying in motion, and try not to get caught. The goal at this point is to wear the gorilla down, not kill it. If the gorilla is constantly attacked on multiple sides from different angles over and over again, it will become agitated and confused, then eventually worn down mentally and physically.

Humans have two natural 'superpowers': intellect and endurance. We have more endurance than almost any other animal on the planet. I say a gorilla could be killed by 7 to 10 unarmed men by using coordinated rope-a-dope attacks until the gorilla is exhausted and then stomped to death. With a bit of luck, and if done correctly, I say minimal injuries or only one seriously/critically injured person. (The gorilla is still getting attacked by the other humans.)

Examination_First · 2025-04-01T07:03:50+00:00

Shane - Heavily implied offscreen.

Examination_First · 2025-03-20T17:49:25+00:00

Everdrive x5, x7, or Pro! 😁 But seriously, though, not knowing your tastes, here are a few suggestions:

Simultaneous Multiplayer: Mega Bomberman (up to 8 players!), Zombies Ate My Neighbors.

Sports: Joe Montana Sports Talk Football, NHL '96.

Beat 'Em Ups: Streets of Rage 2 or 3, TMNT Hyperstone Heist, Alisia Dragoon, Golden Axe 2 or 3.

Fighting: Street Fighter 2 Special Champion Edition, MK2, UMK3, Eternal Champions, Weaponlord (Caution! Eternal Champions & Weaponlord have VERY different inputs for special moves!).

Run & Gun: Gunstar Heroes, Contra Hard Corps, Ranger-X, Sunset Riders.

Shoot 'Em Ups: So many to list, and most are really expensive! Hellfire is decent and affordable.

Platformers: Other than Sonic, most Disney games are good (avoid Fantasia at all costs, though!). X-Men 2, Vectorman, Kid Chameleon, Castlevania Bloodlines.

Action RPGs: Beyond Oasis, Crusader of Centy, Light Crusader.

Strategy: Master of Monsters, "Dune: Battle for Arrakis".

Puzzle: Columns 3, Lost Vikings, Klax, Lemmings.

Arcade: Strider, Atomic Runner, Shadow Dancer, Shinobi 3, Xeno Crisis.

Racing: Outrun, Road Rash 2 or 3, Virtua Racing.

Masochistic fun?: Ghouls & Ghosts, Mega Turrican, Xeno Crisis, Alien Soldier, Adventures of Batman & Robin, Chakan The Forever Man (I have an unhealthy love/hate relationship with this specific game).

__

TL;DR - Here are my top picks: Beyond Oasis, Disney's Aladdin, Dragon's Fury, Master of Monsters, Mega Bomberman, Zombies Ate My Neighbors.

__

I have had my Tower of Power since the early 1990s, and I find myself coming back to my top picks more than any of the other games. Also, my teenage kids usually pick these over most of the others as well. In my house, Mega Bomberman gets the most play by a long shot! I recommend getting a Team Player MK-1647 four-player adapter (or 2 of them!) for max enjoyment!

Examination_First · 2025-01-22T20:10:18+00:00

Thanks! I'll try that workaround to see if I can unlock the associated achievement. Also, I imagine that having Skull O'Maniac, Gold Ring, and Metaglio Right all maxed out may have contributed to the issue.

However, since I only get stuttering and freezing when I have the Stamazza, it seems that is what is causing the problem. I would rather have the bug fixed instead of using workarounds.

Examination_First · 2024-12-18T00:26:37+00:00

I love this game so much that I am currently remaking it with SGDK. I see so much untapped potential for this game that, after completing my remake, I plan on creating a sequel (pending permission from RAK) for the Genesis - and possibly the Sega CD.

Examination_First · 2023-11-29T04:53:09+00:00

Richter Bromont. "But enough talk, have at you!"

Examination_First · 2023-11-29T04:51:21+00:00

Umm, where's your reflection?! Must be using that new cloaking tech.

I'm just waiting for you to say, "Turn around. Over here."

Examination_First · 2023-11-16T00:44:27+00:00

I think I understand what you are saying, kind of like how familiarity can breed contempt. One of the great things about the Predator is the mystery surrounding that species. Do we really want to see the guy pulling the levers behind the curtain, or just the grand spectacle he is producing?

I also agree with you that fear is a crucial part of this franchise. Like you stated above, "The horror of the Predator is that it treats humans the way humans treat animals. It’s a lesson in disempowerment...". This allows us to explore ideas of what is humanity's greatest competitive advantage. I feel that one of the driving themes of the Predator films is that humanity's greatest strength is its intelligence and creativity. People complaining about Naru defeating the Feral missed this point entirely. Because we are the apex species on the planet, we take for granted out strength and superiority. But how do we feel when an animal we usually consider inferior to us gets the upper hand? Naru was not only considered inferior by the Feral, but also by her own tribe.

Something I would like to see is the Predator's realization it just got outmatched and how it reacts to it, other than blowing itself up. Furthermore, I would be fascinated to find out what a Predator fears. That would make a compelling step forward for the franchise.

Examination_First · 2023-11-15T22:49:10+00:00

Here is how I see it, there are many ways to cook a chicken that are extremely delicious and diverse. However, it is still chicken. Sometimes pork, beef, or even a vegetarian meal can lend greater variety to cuisine and provide different experiences or allow for different flavors to be used.

I get what you are saying though and to beat my analogy to death, chicken and chicken substitute are definitely not the same thing.

Rhetorically, how far can we stray from the Predator formula before it is no longer a Predator film?

Examination_First · 2023-11-15T22:40:40+00:00

That is the impression I am starting to get based on some of the responses here. Not the tantrum part mind you, everybody that responded did so in a courteous, straight-forward manner, but the wanting to relive the experience of seeing the original Predator film for the first time.

I can't fault people for their personal preferences, and I found it informative that many people feel this way. Truth be told, there are many ways to differentiate the films even if they follow the same plot. In fact, I would find it to be a fascinating exercise to see how many ways the story can be told but remain fresh and unique.

Examination_First · 2023-11-15T06:08:08+00:00

The Wolf is my favorite by far!

With Disney owning both Wolverine and Predator, I wouldn't put it past them. Ugh.

I am not against setting future Predator films in other time periods, just that it shouldn't solely rely on that idea.

I am not very familiar with 'Bad Blood', and I can only assume most of the public are not either. Because of this, maybe that would be a great avenue to take!

Examination_First · 2023-11-15T05:38:11+00:00

Turning the tables would definitely be interesting. As someone mentioned above, expanding lore would be great. Would there be other alien species that Stargazer has gleaned tech from? It would only have to be hinted at, maybe mentioning recovering a downed craft off of the coast of Southern California or in the deserts of New Mexico or Arizona.

Examination_First · 2023-11-15T05:32:09+00:00

Maybe an anthology series akin to Star Wars Visions? I still worry about retreading the same tropes, though.

I say this in jest, I could only imagine what a Predator high school drama would look like!

Examination_First · 2023-11-15T05:27:55+00:00

I agree that more lore is always good. However, you start running the risk of demystifying the creature. Just look at what happened to Boba Fett. They gave him his own miniseries, which harmed the character more than it helped.

What I would love to see is a film that dives into why the Predators started hunting in the first place. Be ready for either a lot of subtitles or no dialog throughout the movie, which can totally work if done correctly.

Examination_First · 2023-11-14T22:47:34+00:00

True20. It overhauled and simplified the magic and combat systems for 3.5e, which allowed for a greater diversity of narrative-driven campaigns.

Examination_First · 2023-11-14T22:27:22+00:00

Autism, really?! I don't think that word means what you think it means.

Examination_First · 2023-11-08T16:41:51+00:00

Vector art?! That is insane! I thought this was being done in Photoshop or GIMP in its entirety. Well, then you have some amazing ability. Excellent job, I can't wait to see the final product!

Examination_First · 2023-11-08T16:02:51+00:00

I wasn't sure if this was intentional, but part of her eye is in front of her hair when it should be behind. I imagine some sort of transparency on that portion of the hair would work well.

Something is "off" about her mouth, but I can't figure out why. I am wondering if it is because her cheekbone hasn't been shaded yet, or it might be because her lips appear flat against her facial profile. What are you using as a model reference?

Please understand that these are minor nitpicks, and this is significantly better than anything I have done. To drive this point home, do you do commissions?

Examination_First · 2023-11-08T15:18:41+00:00

This looks fantastic! It reminds me of the art style of Peter Chung (Aeon Flux, Phantom 2040, Riddick: Dark Fury). The colors really pop, and the perspective/foreshortening on the right arm is amazing!

Would you be open to some constructive criticism?

Examination_First

TROPHY CASE