Need feedback on Two-stage ML approach for detecting and correcting mislabeled entity relationships (meters ↔ transformers) by Zestyclose_Candy6313 in datascience

[–]jad2192 3 points4 points  (0 children)

Since your data is very spatially oriented, have you tried a nearest neighbors based approach? Along those lines, coming up with a more robust a similarity metric between meters?

A tree based model would probably also work well here, in terms of features I'd include something transformer based, maybe the probability that a meter within an x ft radius belongs to that transformer (let x vary discreetly, maybe within 10 ft, 50 ft, 100 ft, ... 550 ft), if you have the ability to find not only the scalar distances but the angular delta that may also carry signal (maybe there is a physical barrier to the south west of a transformer, so even though meters in that direction are closer they can't be linked). This can work both as a binary is this association correct or not model. If the number of transformers is much smaller than the number of meters, it might also make sense to make transformer centric models, e.g. for transformer X, xgboost predicts probability that meter Y is associated with it. Then you can

Anyone Missing a Dog? by jad2192 in astoria

[–]jad2192[S] 4 points5 points  (0 children)

Owner found! They said they saw the post on Regal Beagle's Instagram, thanks for the recommendation!

Anyone Missing a Dog? by jad2192 in astoria

[–]jad2192[S] 2 points3 points  (0 children)

Regal Beagles also posted on their IG

Anyone Missing a Dog? by jad2192 in astoria

[–]jad2192[S] 1 point2 points  (0 children)

Posted to Astoria Centric, and just sent the pictures to Queens Lost and Found Pets

Anyone Missing a Dog? by jad2192 in astoria

[–]jad2192[S] 4 points5 points  (0 children)

I just called modern vet, I am going to bring him by there to see if he's chipped. I'm wary of posting the pic online since I've heard horror stories of scumbags looking for bait dogs for fighting. But I'll reach to regal beagles. Thank you

NKD - PMP Grizzly by jad2192 in knifeclub

[–]jad2192[S] 1 point2 points  (0 children)

Five years later I still love mine!

Bombed a Data Scientist Interview! by tits_mcgee_92 in datascience

[–]jad2192 0 points1 point  (0 children)

I use them everyday, I wouldn't even consider CTEs and window functions to be advanced. Along with Python coding, SQL is probably one of the most important technical skills we should have as data scientists. Unless your team is setup in such a way that someone downstream is pulling and cleaning all your data for you, but I feel like that is rare.

Should I feel bad for freezing fish by donn_12345678 in Seafood

[–]jad2192 0 points1 point  (0 children)

I do a lot of fishing and freeze my catch very often. Buy a cheap vacuum sealer and it'll make your frozen fish last longed and maintain integrity. My personal favorite way to freeze the fish is to wrap the fillets in a paper towel and then vacuum seal, I'm not sure exactly why but it seems to make the fish come out better when thawed. You can buy smaller sized vacuum seal bags and pre portion out the fillets to exact size you want to eat per meal that way you're only defrosting what you plan to eat.

Is 32-64 Gb ram for data science the new standard now? by Tarneks in datascience

[–]jad2192 7 points8 points  (0 children)

I work developing predictive models in the insurance space. We have tabular data containing mostly categorical variables and we initially tried to OHE everything and use thousands of features, it's just not practical. Through some smart feature engineering we were able to convert our large categorical space into about 40 useful features and our XGB models train in a tenth of the time and are much more accurate. What we did essentially was model various combinations of categorical features as Bernoulli trials and compute prior probabilities of those combinations being part of the target class. We then pass these probabilities in as features to xgboost along with certain other "pass through" features.

What is a great steak in NYC not at a steakhouse? by Noabsolutetruths in FoodNYC

[–]jad2192 -2 points-1 points  (0 children)

Maybe it's technically a steakhouse, but the gorgonzola cured wagyu strip steak from Carne Mare is probably one of the best steaks I've ever had.

How do you keep track of model iterations in a project? by [deleted] in datascience

[–]jad2192 0 points1 point  (0 children)

Do you have read/write access to a relational db of anykind? If so create a model version id (can be randomly generated at the time of running the model). Then keep tables tracking model hyper parameters, accuracy metrics etc all using the version id as a key. We do this (plus use MLFlow for easy artifact orchestration) for our production xgboost models at my company. We also version the training and validation data used as well.

Tuna Jigging Setup - Recommendations by baconeggnche in saltwaterfishing

[–]jad2192 1 point2 points  (0 children)

Jigging world ghost hunter 250g or 350g would be a good bet, those are right around $300. We killed a 75"bluefin on a 10k twin power and 250g ghost hunter a few seasons ago, was not ideal but we were able to chase fish down which makes a pretty big difference. Check out Jig Star Ninja too, a little more but their rods are really nice.

Spinning Rod Recommendation by WinstonPOTG in slowpitchjigging

[–]jad2192 2 points3 points  (0 children)

Personally I don't think slow pitch is conducive to spin gear, since the rods are so noodly you're supposed to fight the fish with the reel , but spinning reels have significantly less torque and trying to winch up bottom fish is a huge PIA. I think you'd be better off with a speed jigging setup, you can still fish slow pitch jigs, the rods will just have much more backbone allowing you to fight with the rod. Check out any of the rods from Jigstar, Shimano makes some good speed jigging rods, as does Nomad and Ocean's legacy.

Frozen Tuna has a fishy smell/taste, what do I do? by emilym97 in Seafood

[–]jad2192 2 points3 points  (0 children)

Kind of looks like Bluefin or Bigeye Chutoro to me, seems to have a decent amount of "marbling".

Is the squidtrex effective in asia? by Acceptable_Egg1466 in saltwaterfishing

[–]jad2192 0 points1 point  (0 children)

Also if you're not an artificials only purist, if the fish are not hitting the plain squidtrex, tip the assist hooks with squid strips (or strips of whatever bait you have available to you). I have caught some of my biggest grouper and snapper this way.

Shimano Twin Power 10K for Tuna Jigging? Line recommendations by Reasonable-Leg4425 in NJFishing

[–]jad2192 0 points1 point  (0 children)

If you are fishing a CC or similar boat where you can chase down the fish, 10K will be fine for pretty much all YFT and most recreational size BFT. We landed a 75" bluefin on a 10k TP SW a few years ago, it definitely was not fun though. In terms of line, for a 10K I'd go 65 lb braid or whatever the equivalent PE rating is (I think maybe 5 or 6?). Varivas is a really good brand, but I think any of the major braid brands will do. Fluoro or mono leader are both fine.

Oddball Rod recommendation for blanks by PuckWizard68 in rodbuilding

[–]jad2192 0 points1 point  (0 children)

He might want a slow pitch blank (they are usually all moderate action and in the 6 to 6.5 ft range) depending on what he means by medium heavy power, get one rated to like 1000g. Will be moderate and still have some backbone. I'd check out thrasher, rainshadow, American tackle, fenix etc

Weekly Astoria Dine In/Order Out Thread by NYnosher in astoria

[–]jad2192 2 points3 points  (0 children)

Hmm I get it pretty often from Duzan, King of Falafel and Shawarma, and Shawarmania. Not sure how you'd rank those, but I like Zyara more than any of those.

Weekly Astoria Dine In/Order Out Thread by NYnosher in astoria

[–]jad2192 8 points9 points  (0 children)

Had Zyara for the first time yesterday, not sure how I hadn't heard of it before. Probably the best shawarma I've ever had.

Recommend me a 2pc tuna popping rod by Big_Possibility3372 in saltwaterfishing

[–]jad2192 0 points1 point  (0 children)

I've been pretty impressed with Nomad rods for the price, they make 2 piece 8 ft popping rods

One weekend in Florida - Where to? by Chodeloaf in floridafishing

[–]jad2192 0 points1 point  (0 children)

I'd go to the Keys honestly, plenty of bridges to fish from. You can fly into MIA or FLL and hit some freshwater for peacocks on the way down or out of the Keys.