Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS General Gear Talk Computers 
Thread started 10 Aug 2014 (Sunday) 07:41
Search threadPrev/next
sponsored links (only for non-logged)

Archiving RAW files

 
alan_potter
wireless groping system
Avatar
2,408 posts
Gallery: 164 photos
Best ofs: 1
Likes: 658
Joined May 2005
Location: Falkirk, Scotland
     
Aug 10, 2014 07:41 |  #1

Looking for ways to archive RAW files. And by Archiving I'm meaning put them somewhere so I can get them back if I need to, but I don't expect to need access very often and when I do, it's okay for it to take a little while.

Now, I could put them onto USB disks, and store them somewhere. But USB disks do fail, and how would I know if they were on the path to failure? I would need to do that by myself.

Or, I could put them onto a "cloud" (i.e. internet) server. That way the host takes care of backing them up, etc. Prices that I have found so far include:

Google - US$10 per month
Microsoft - GBP8 per month, with up to 5 licences for Office 365 included
Dropbox - doesn't have a decent plan
Amazon - £320 per year

(I'd probably also keep a copy or two on USB disk, TBH).

Things like Carbonite don't work because I want to clear space off my local drives; they only backup things that are ON the drive! (I do use Carbonite to back up the JPGs that come from the RAWs, but that's a different requirement...)

So... any other suggestions that I have missed for archival of RAW files that I don't expect to want to use often, but don't want to lose either?


Falkirk, Scotland.
Project 365 Blog (external link) | flickr (external link)

  
  LOG IN TO REPLY
CincyTriGuy
Senior Member
Avatar
567 posts
Likes: 122
Joined Nov 2011
Location: Cincinnati, OH
     
Aug 10, 2014 09:56 |  #2

I use Microsoft Azure cloud storage, and I use a program called CloudBerry Backup that does daily backups to Azure for me. CloudBerry Backup may not work for you since you indicated you want to delete the files locally, but you could use a program like CloudBerry Explorer to copy and/or move the files from your local disks to Azure.

Azure storage currently costs $0.02 per GB, you only pay for what you use. I say "currently" because I started doing this a couple years ago and the cost then was $0.12 per GB; there have been many price reductions over the years.


Jason
Canon 1DX Mark II | 16-35 f/2.8L | 24-105 f/4L | 50 f/1.4 | 85 f/1.8 | 70-200 f/2.8L

  
  LOG IN TO REPLY
NullMember
Goldmember
3,019 posts
Likes: 1130
Joined Nov 2009
     
Aug 10, 2014 10:05 |  #3
bannedPermanently

What's wrong with an external HD?




  
  LOG IN TO REPLY
Kolor-Pikker
Goldmember
2,790 posts
Likes: 59
Joined Aug 2009
Location: Moscow
     
Aug 10, 2014 10:06 |  #4

alan_potter wrote in post #17087137 (external link)
Now, I could put them onto USB disks, and store them somewhere. But USB disks do fail, and how would I know if they were on the path to failure? I would need to do that by myself.

Flash memory typically degrades over time, I did have some USB sticks fail on me over time, but they had a huge amount of data go through them over years of use. I have one 2GB stick that must be 6 years old and it still works, if sluggishly, however I don't know how flash memory performs in terms of cold storage...

Or, I could put them onto a "cloud" (i.e. internet) server. That way the host takes care of backing them up, etc. Prices that I have found so far include:

It depends on location/provider, cloud storage would be far too slow for me, and I wouldn't be able to use software like Bridge to browse images.

So... any other suggestions that I have missed for archival of RAW files that I don't expect to want to use often, but don't want to lose either?

Currently, I simply have my photos duplicated over 3 hard drives, but if I were to start from scratch, I'd get a RAID array with at least 4 drives and put them in mode 5 or 6.


5DmkII | 24-70 f/2.8L II | Pentax 645Z | 55/2.8 SDM | 120/4 Macro | 150/2.8 IF
I acquired an expensive camera so I can hang out in forums, annoy wedding photographers during formals and look down on P&S users... all the while telling people it's the photographer, not the camera.

  
  LOG IN TO REPLY
Archibald
You must be quackers!
Avatar
15,505 posts
Gallery: 789 photos
Best ofs: 4
Likes: 51009
Joined May 2008
Location: Ottawa
     
Aug 10, 2014 10:28 |  #5

My photo files (and other files too) go on two external hard drives that are updated every few months. One of the HDs alternately is stored off-site.

I also do daily backups of new files on a second internal drive.

I don't zip or compress my files.

Works for me.


Canon R5 and R7, assorted Canon lenses, Sony RX100, Pentax Spotmatic F
I'm Ed. Migrating to cameraderie.org and Talk Photography where I'm Archibald.

I'm probably listening to Davide of MIMIC (external link)

  
  LOG IN TO REPLY
Kolor-Pikker
Goldmember
2,790 posts
Likes: 59
Joined Aug 2009
Location: Moscow
     
Aug 10, 2014 10:44 |  #6

Archibald wrote in post #17087366 (external link)
My photo files (and other files too) go on two external hard drives that are updated every few months. One of the HDs alternately is stored off-site.

I also do daily backups of new files on a second internal drive.

I don't zip or compress my files.

Works for me.

Are you me? :D


5DmkII | 24-70 f/2.8L II | Pentax 645Z | 55/2.8 SDM | 120/4 Macro | 150/2.8 IF
I acquired an expensive camera so I can hang out in forums, annoy wedding photographers during formals and look down on P&S users... all the while telling people it's the photographer, not the camera.

  
  LOG IN TO REPLY
alan_potter
THREAD ­ STARTER
wireless groping system
Avatar
2,408 posts
Gallery: 164 photos
Best ofs: 1
Likes: 658
Joined May 2005
Location: Falkirk, Scotland
     
Aug 10, 2014 16:18 |  #7

Thank you for the suggestions. CincyTriGuy, I shall have a look at Azure (incidentally, I am hoping to do my first-ever tri in September!)

I'm not looking to do backup; I have that pretty well covered. This is archiving; it's making a one-off backup so that I can delete the files from the local hard drive and know that I can get them if I need them - but they are not frequently-accessed files. Most haven't been looked at in two years or more!


Falkirk, Scotland.
Project 365 Blog (external link) | flickr (external link)

  
  LOG IN TO REPLY
mike_d
Cream of the Crop
Avatar
5,690 posts
Gallery: 8 photos
Likes: 1074
Joined Aug 2009
     
Aug 10, 2014 17:07 |  #8

One copy = no copy, regardless of how safe you think it is.




  
  LOG IN TO REPLY
tim
Light Bringer
Avatar
51,010 posts
Likes: 375
Joined Nov 2004
Location: Wellington, New Zealand
     
Aug 10, 2014 21:17 |  #9

For me:
- One copy onsite in RAW, with a jpeg, on a hard disk in a drawer
- One copy offsite in DNG, with a jpeg, on a hard disk
- Another DNG offsite in a different location, on a hard disk

I just released a tool to validate the integrity of DNG files. If one location has a file that fails validation you can restore from original raw or another location. I had 100 odd files fail validation, out of 75,000 I had on the disk.

See also the backups section of my workflow.


Professional wedding photographer, solution architect and general technical guy with multiple Amazon Web Services certifications.
Read all my FAQs (wedding, printing, lighting, books, etc)

  
  LOG IN TO REPLY
alan_potter
THREAD ­ STARTER
wireless groping system
Avatar
2,408 posts
Gallery: 164 photos
Best ofs: 1
Likes: 658
Joined May 2005
Location: Falkirk, Scotland
     
Aug 11, 2014 04:01 |  #10

@mike_d: totally agree - an online service would be in addition to HDDs
@tim: I'll have a look, thanks :-)


Falkirk, Scotland.
Project 365 Blog (external link) | flickr (external link)

  
  LOG IN TO REPLY
gotaudi
Senior Member
720 posts
Likes: 2
Joined Jan 2010
Location: Southern California
     
Aug 19, 2014 16:28 |  #11

I keep a set of my photos on my desktop, I central server to back up all those files, I have a couple external hard drive that backups the critical data on the server (this includes Image backup of OS and all data on server) that I store at home and another couple external hard drives that I store at my parents house. Ive been thinking of building a NAS I can store at my parents house and setting it up to connect through a VPN tunnel and backup that way over night keeps me from needing to go and physically get the hard drive every couple weeks.




  
  LOG IN TO REPLY
phantelope
Goldmember
Avatar
1,889 posts
Gallery: 5 photos
Best ofs: 1
Likes: 40
Joined Sep 2008
Location: NorCal
     
Aug 19, 2014 16:41 |  #12

2 external HDs at home, one occasionally updated at my wife's work and everything online with crashplan. If all that fails I probably won't care, as I probably didn't survive that meteor strike either ;-)a


40D, 5D3, a bunch of lenses and other things :cool:

  
  LOG IN TO REPLY
Ursyn
Goldmember
Avatar
1,426 posts
Gallery: 63 photos
Best ofs: 1
Likes: 1520
Joined Oct 2009
     
Aug 27, 2014 04:01 |  #13

Maybe several disks connected with RAID 1 (mirror) would be a good solution? I'm using it and I'm satisfied so far. I had one disk crash but an array has been automatically rebuilt.

If can look at http://www.wdc.com …cts/products.as​px?id=1260 (external link)


Adrian | flickr (external link) & Instagram (external link)

  
  LOG IN TO REPLY
Eddie
xpfloyd lookalike
Avatar
14,834 posts
Gallery: 719 photos
Best ofs: 8
Likes: 10955
Joined Feb 2011
Location: Glasgow, Scotland
     
Aug 27, 2014 04:45 |  #14

I have 2 internal hard drives that are linked and mirrored. I then have another 2 harddrives under my floor which I back up onto weekly using acronis true image. My logic is that the internal 2 that are mirrored mean I dont lose a file during the week if one drive fails (I still lose the file if I occidentally delete it though). Then my weekly backup to the 2 drives under my floor mean that my PC can be stolen/go on fire/whatever and I would still have the files on these drives (unless my whole house burns down but I figure if that happened my harddrives would be the least of my worries).

If you are using lightroom you can move the files from within lightroom to a removeable drive and they will still show up in your lightroom library but you just wont be able to access them until the drive is reattached. I have been meaning to do this instead of doing a complete backup on a weekly basis I would only be backing up recent stuff


Leica M11 | Leica Q2 | Sony α7RV
Voigtlander 28 f/2 Ulton II | Leica 50 Summilux ASPH
16-35GM | 24GM | 35GM | 85GM | Tamron 35-150 | Sigma 105 Macro Art

  
  LOG IN TO REPLY
tim
Light Bringer
Avatar
51,010 posts
Likes: 375
Joined Nov 2004
Location: Wellington, New Zealand
     
Aug 27, 2014 15:15 |  #15

Drives under your floor are an unusual solution. I figure in a house fire what's most important is your memories and data like family photos, over possessions but below people of course. Suggest you get yourself an offsite backup soon. If those backup drives are always connected a virus/user error could wipe them out too.

I have one layer of backups in a nearby building, which is easy but reasonably protected.


Professional wedding photographer, solution architect and general technical guy with multiple Amazon Web Services certifications.
Read all my FAQs (wedding, printing, lighting, books, etc)

  
  LOG IN TO REPLY
sponsored links (only for non-logged)

2,463 views & 0 likes for this thread, 11 members have posted to it.
Archiving RAW files
FORUMS General Gear Talk Computers 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is semonsters
1519 guests, 131 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.