Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS General Gear Talk Data Storage, Memory Cards & Backup 
Thread started 26 Nov 2017 (Sunday) 11:04
Search threadPrev/next
sponsored links (only for non-logged)

Help! Swimming in Duplicate image files

 
buddy4344
OM System Ambassador
Avatar
1,693 posts
Gallery: 412 photos
Best ofs: 14
Likes: 2174
Joined Nov 2006
Location: Allentown, PA
     
Nov 26, 2017 11:04 |  #1

I will start with the bottom line: I suspect I have several duplicate copies of images on my NAS device and want a great software to help me locate duplicates and remove them.

Over the last few years, I haven't been consistent at how I create back-ups for storage. Now, more than 10 years into digital, I have a mess on my hands. I shoot a lot and, early on, didn't delete enough, so I have right at 8 TB of RAW and Edits on my Synology NAS. Annually, I have just blindly copied the files onto an external drive and stored it at another location. In the early days, that was easy as files were smaller and I shot less. I still plan to regularly make a back-up to an external, but copying 8 TB takes forever and, of course, I'm wasting space.

On line there are a million software solutions offered, many free. I'm not sure I trust them. I'm okay with paying for the right software but which one? BTW, the many options I found on-line after just a 5 min search include:


  • Awesome Duplicate Photo Finder

  • Duplicate Photos Fixer Pro

  • Duplicate Photo Cleaner

  • Duplicate Photo Finder

  • Duplicate Images Finder

  • Duplicate Sweeper

  • Duplicate File Finder

  • Auslogics Duplicate

  • Digital Volcano Duplicate Cleaner

  • VisiPics

  • Free Duplicate Photo Finder

  • Anti-Twin

  • Similar Image Search


Help! Please!

Buddy4344

OM System Ambassador, Gear: Olympus OM-1 and EM1X, Olympus/Zuiko Lenses: 150-400mm f/4.5, 40-150mm f/2.8, 12-40 f/2.8, Oly 2x and 1.4x TCon, Kiboko 30L and 22L+

  
  LOG IN TO REPLY
ShotByTom
Goldmember
Avatar
3,050 posts
Gallery: 23 photos
Likes: 136
Joined Aug 2005
Location: Indianapolis
     
Nov 28, 2017 16:59 |  #2

I paid $5 for Duplicate Detective (Mac) and it worked well for me. I was able to clean up my hard drive in a few hours, but it was only 1.5TB, so it will surely take you longer.


Gear
Website (external link)

  
  LOG IN TO REPLY
Archibald
You must be quackers!
Avatar
15,505 posts
Gallery: 789 photos
Best ofs: 4
Likes: 51009
Joined May 2008
Location: Ottawa
Post edited over 5 years ago by Archibald.
     
Nov 28, 2017 17:17 |  #3

I use dupeGuru and it seems to work well. Depending on the situation, you might also want to look at Beyond Compare, a trusted and versatile comparison program. The latter is not free but there is a free trial. Both are for Windows.


Canon R5 and R7, assorted Canon lenses, Sony RX100, Pentax Spotmatic F
I'm Ed. Migrating to cameraderie.org and Talk Photography where I'm Archibald.

I'm probably listening to Davide of MIMIC (external link)

  
  LOG IN TO REPLY
John ­ from ­ PA
Cream of the Crop
11,258 posts
Likes: 1527
Joined May 2003
Location: Southeast Pennsylvania
     
Nov 28, 2017 19:13 |  #4

I think you found what I use, Auslogics Duplicate File Finder, which is free and can be downloaded at https://www.auslogics.​com …re/duplicate-file-finder/ (external link). You mention "Duplicate File Finder" and Auslogics "Duplicate" so it could just be a naming issue. Anyway, I find it works well and it goes beyond just file name, date and size and looks "within" at binary content. Something like that is pretty much necessary when you have three different cameras.




  
  LOG IN TO REPLY
buddy4344
THREAD ­ STARTER
OM System Ambassador
Avatar
1,693 posts
Gallery: 412 photos
Best ofs: 14
Likes: 2174
Joined Nov 2006
Location: Allentown, PA
Post edited over 5 years ago by buddy4344.
     
Nov 29, 2017 20:15 as a reply to  @ ShotByTom's post |  #5

@ShotBytom Thanks, I will look into this and see if they have a pc version.


Buddy4344

OM System Ambassador, Gear: Olympus OM-1 and EM1X, Olympus/Zuiko Lenses: 150-400mm f/4.5, 40-150mm f/2.8, 12-40 f/2.8, Oly 2x and 1.4x TCon, Kiboko 30L and 22L+

  
  LOG IN TO REPLY
buddy4344
THREAD ­ STARTER
OM System Ambassador
Avatar
1,693 posts
Gallery: 412 photos
Best ofs: 14
Likes: 2174
Joined Nov 2006
Location: Allentown, PA
Post edited over 5 years ago by buddy4344.
     
Nov 29, 2017 20:16 as a reply to  @ Archibald's post |  #6

@Archibald, Thanks for this input in my analysis of options.


Buddy4344

OM System Ambassador, Gear: Olympus OM-1 and EM1X, Olympus/Zuiko Lenses: 150-400mm f/4.5, 40-150mm f/2.8, 12-40 f/2.8, Oly 2x and 1.4x TCon, Kiboko 30L and 22L+

  
  LOG IN TO REPLY
buddy4344
THREAD ­ STARTER
OM System Ambassador
Avatar
1,693 posts
Gallery: 412 photos
Best ofs: 14
Likes: 2174
Joined Nov 2006
Location: Allentown, PA
     
Nov 29, 2017 20:17 |  #7

John from PA wrote in post #18506287 (external link)
I think you found what I use, Auslogics Duplicate File Finder, which is free and can be downloaded at https://www.auslogics.​com …re/duplicate-file-finder/ (external link). You mention "Duplicate File Finder" and Auslogics "Duplicate" so it could just be a naming issue. Anyway, I find it works well and it goes beyond just file name, date and size and looks "within" at binary content. Something like that is pretty much necessary when you have three different cameras.

Thanks for input. I like that it looks deeper.


Buddy4344

OM System Ambassador, Gear: Olympus OM-1 and EM1X, Olympus/Zuiko Lenses: 150-400mm f/4.5, 40-150mm f/2.8, 12-40 f/2.8, Oly 2x and 1.4x TCon, Kiboko 30L and 22L+

  
  LOG IN TO REPLY
buddy4344
THREAD ­ STARTER
OM System Ambassador
Avatar
1,693 posts
Gallery: 412 photos
Best ofs: 14
Likes: 2174
Joined Nov 2006
Location: Allentown, PA
     
Dec 06, 2017 19:57 |  #8

End the end, I used Auslogics. I had no trouble using the software to illuminate duplicates on the main drives or on the external drive the plan is for back up. The software did not seem to want to see or read my in the NAS.


Buddy4344

OM System Ambassador, Gear: Olympus OM-1 and EM1X, Olympus/Zuiko Lenses: 150-400mm f/4.5, 40-150mm f/2.8, 12-40 f/2.8, Oly 2x and 1.4x TCon, Kiboko 30L and 22L+

  
  LOG IN TO REPLY
sponsored links (only for non-logged)

2,625 views & 0 likes for this thread, 4 members have posted to it.
Help! Swimming in Duplicate image files
FORUMS General Gear Talk Data Storage, Memory Cards & Backup 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is semonsters
1077 guests, 114 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.