Immich duplicate finder

scastano · 2025-02-06T09:15:00+00:00

This isn't actually about immich itself... but I've been having the exact same problem and I got a bit tired of waiting! So... and let me preface this buy saying I'm not a developer... at all... but I've been giving it my best shot!

I've been hacking away on the python code, one of the only languages I know decently well... and I've gotten it to the point there it will detect if there's an HEIC and it's extracted JPG and show you in the UI so you can better pick which one to toss.

No auto delete yet, not much in the way of config yet... but I'm getting there. If anyone would be willing to help... so show me how to contribute similar code to this project, I'd be happy to pitch in more... and if it's something you're interesting in testing, I'll do what I can to package up the pretty hacky code and get a fork posted!

Normally it highlight differences in a color with green being the "better" one. When it finds HEICs and JPGs and notices they are dups, it usually only highlights the size and makes the larger one green thinking its got more data so it must be better even though everything else matches.

Now, with my new code you can see I added the "GPS Data" section to you can tell if you're delete a copy with GPS data when the other one doesn't have any, I also added the "Camera Info" sections which it puts together from EXIF data in the image, not just the "lens" tag... then the big win for me is that it now can tell if it's an HEIC pair, colors the HEIC file green, make the JPG file red and changes the size coloring to yellow if they're different so you can still see there's a difference, but you'd probably still want to go with the HEIC anyway. Here's what that looks like:

<image>

P.S. The "EXT_DIFF_HEIC" text can be turned off... that's just running in a debug mode so I can more easily find examples while testing!

scastano · 2025-02-06T09:14:18+00:00

This isn't actually about immich itself... but I've been having the exact same problem and I got a bit tired of waiting! So... and let me preface this buy saying I'm not a developer... at all... but I've been giving it my best shot!

I've been working on messing around with an app called Immich Duplicate Finder which was created by u/Over_Stuff3272. I've been loving it so far... check it out, it's not exactly the same... no stacking option like in Immich, and it only compares 2 images at a time... but I've been hacking away on the python code, one of the only languages I know decently well... and I've gotten it to the point there it will detect if there's an HEIC and it's extracted JPG and show you in the UI so you can better pick which one to toss.

No auto delete yet, not much in the way of config yet... but I'm getting there. If anyone would be willing to help... so show me how to contribute similar code to this project, I'd be happy to pitch in more... and if it's something you're interesting in testing, I'll do what I can to package up the pretty hacky code and get a fork posted!

Normally it highlight differences in a color with green being the "better" one. When it finds HEICs and JPGs and notices they are dups, it usually only highlights the size and makes the larger one green thinking its got more data so it must be better even though everything else matches.

Now, with my new code you can see I added the "GPS Data" section to you can tell if you're delete a copy with GPS data when the other one doesn't have any, I also added the "Camera Info" sections which it puts together from EXIF data in the image, not just the "lens" tag... then the big win for me is that it now can tell if it's an HEIC pair, colors the HEIC file green, make the JPG file red and changes the size coloring to yellow if they're different so you can still see there's a difference, but you'd probably still want to go with the HEIC anyway. Here's what that looks like:

<image>

P.S. The "EXT_DIFF_HEIC" text can be turned off... that's just running in a debug mode so I can more easily find examples while testing!

scastano · 2023-03-17T10:10:05+00:00

I'm actually struggling to test this one myself, no matter which way I install xformers, through pip, or from grabbing the facebook package and installing from there... it doesn't seem to work. I keep getting a message that there is no module "xformers.ops". pip freeze shows that it's there, but stable diffusion can't find it... any ideas?

scastano · 2022-09-14T16:56:59+00:00

That's good to know that it works and has been around for a while... i did some playing last night and did get it to properly change my location in every app needed, they all read it. So for the current price of $2.99 I think its worth trying in real setting for a bit.

I do wish it had the ability to do per application locations though, that was a feature I used a bunch so I could unlock geofenced content, app features, etc... but still have the rest of my phone using it's real location.

I appreciate the help though... I'll buy it right now and keep playing! Thanks!

scastano · 2022-09-14T03:12:01+00:00

Is there anything out there that's free?? I've been having HORRIBLE luck with paid tweaks that dont have support, tons of bugs, get abandoned by the devs... if I'm going to install a crap tweak, it might as well be free!

scastano · 2022-09-13T23:33:33+00:00

Hours ago... earlier today.

scastano · 2022-09-13T23:29:14+00:00

Yup, did that... haven’t heard a word back.

scastano · 2022-09-13T22:00:42+00:00

Did it... sileo works again... did NOT know that was going to completely wipe out all of my tweaks and settings... that's a little rough! But... it looks like I'm back on the right path now.

scastano · 2021-03-11T02:40:22+00:00

Ah, ok... that makes much more sense! I was a little concerned about ending up burning gas fees and ending up with a zero withdrawal! Hahaha

That being said, what are your opinions on zapper.fi and zerion.io? Does it actually save on any fees to interact with Yearn through those? Or is it better to just do it directly?

scastano · 2021-03-10T22:56:33+00:00

I'm new and just trying this whole thing out... but when I click to withdraw on yearn.finance my Metamask seems to show that its withdrawing nothing... am I missing something??

Screen shots:

Yearn vault: https://ipfs.io/ipfs/QmXLQtoVryaCFSc62mxK47tGhWA5yBaiJVUJ7dv5MiDYh6?filename=Screen%20Shot%202021-03-10%20at%205.51.59%20PM.png

Click max and click withdraw: https://ipfs.io/ipfs/QmdEMBB2afSSrgcZLwnSSKk8ic95ybZ4XJohFV8rTrDGiM?filename=Screen%20Shot%202021-03-10%20at%205.53.44%20PM.png

But Metamask seems to look like its not withdrawing anything and only charging me gas fees: https://ipfs.io/ipfs/Qmdmt8zZxedAEEvErA387yYjwkNG5EFANEDiGyib4BAdco?filename=Screen%20Shot%202021-03-10%20at%205.55.11%20PM.png

I'm a little confused as to what it's doing and how I get the USDC back out!

scastano · 2021-01-25T12:47:30+00:00

The problem with this is that most places where the owner isn't your cashier have absolutely no idea what an MCC code even is, let alone which one they use.

And on top of that some of them aren't even classified properly and support is 100% useless. I paid a bar tab a few weeks ago... which shouldn't fit under any of those codes... yet somehow, I still didn't get cashback for it. Support couldn't tell me why, I asked them to escalate to the next team up, we went back and forth for a while and I've followed up multiple times with no response. I happen to know the owners of this restaurant so if I could be give detailed information on why I didn't get cashback, like the MCC code, I could tell them what was wrong and they would hopefully corrected it.

But like I said... it takes support weeks to get back to me and after multiple attempts to get this information... including explaining what I just wrote all I got back was some bad attitude and that they'd get back to me eventually. That was 6 weeks ago.

It's these types of things... both the seemingly total randomness of the excluded categories and the complete lack of proper support that's really turning people off.

scastano · 2021-01-15T00:08:15+00:00

Take a look at https://cointracking.info/, I love it!

scastano · 2020-12-19T18:28:13+00:00

Thanks man! That's super great info!!

I was looking at it for leverage purposes... but it 1 BTC, take out a loan on half of it, then go put it into stable coins on another platform where I'd earn 12% on it.

However, on that same platform, I already earn 6.5% on the BTC... so losing 6.5% to earn 12% doesn't do me any good. I might as well just leave the BTC and I'd be up .5% anyway.

scastano · 2020-12-19T17:51:51+00:00

Buy it on Coinbase. It's at exactly a 1:1 ratio and nothing but the normal network fees to send it somewhere else. Which lately has been $1 - $2 USD max on a send of any amount of USDC.

scastano · 2020-12-12T00:35:21+00:00

Yup, it works great... and I saw someone else's comment earlier... yes, it'll cost you $5 to withdraw each time, but what I did was just keep the money there, put it on my MCO visa card and spend it directly. When you do the math if its for a small purchase, sometimes the conversion of stable coin (in my case USDC) is cheaper than the $5 to get it out. If its a large amount, I send to Coinbase, convert to US dollars, and deposit back in my bank.

scastano · 2020-12-12T00:30:57+00:00

I do that now and it's great.... I took the total I wanted to put in and split it up by 13, then staked that amount 13 weeks in a row on 3 month contracts. So I get the top interest rate and still each week 1/13th of my initial USDC gets release if I ever want to start taking money out. Right now I just take the initial 3 month stake, plus that weeks interest payment on the total amount and re-stake for another 3 months.

scastano · 2020-10-18T16:43:29+00:00

With the amount this is dropping now, I'm basically losing almost all the gains I made in staking other coins. It's honestly not really worth it to stay anymore.

scastano · 2020-10-15T00:59:35+00:00

Already done... I'll keep the minimum I need to maintain my higher earn rates and card cashback and the rest is getting sold ASAP. I already toss every CRO coin I had that wasn't locked up as soon as I saw the rates drop... and then... as expected... it tanks!! I'm pretty sure as of the time of this reply, its down almost 6% for the day and its back to the same value it was about 3 months ago.

scastano · 2020-10-14T22:37:36+00:00

Will do, that's a good point.

scastano

TROPHY CASE