Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS Cameras, Lenses & Accessories Canon Accessories 
Thread started 22 Apr 2010 (Thursday) 22:22
Search threadPrev/next
sponsored links (only for non-logged)

Lost 10+years of work, Need advice on next back up plan

 
ed ­ rader
"I am not the final word"
Avatar
23,395 posts
Gallery: 4 photos
Likes: 578
Joined May 2005
Location: silicon valley
     
Apr 23, 2010 13:40 |  #31

sapearl wrote in post #10051574 (external link)
Hi Ed - yeah, I know a lot of folks do that and are quite happy with it..... for some reason though I never adopted that strategy.

Although I suppose that with all the free space I have with my hosting service, I could simpy ftp the full rez images to a buried directory for safe keeping.

all i do is upload full resolution jpegs (print ready) to my zenfolio gallery. it takes a bit longer but these are the pictures i really don't want to lose....no matter what :D.

ed rader


http://instagram.com/e​draderphotography/ (external link)
5D4 x2, 16-35L F4 IS, 24-70L II, 70-200L F4 IS II, 100-400L II, 14L II, sigma 15 FE, sigma 28 f1.4 art, tc 1.4 III, 430exII, gitzo 3542L + markins Q20, gitzo GT 1545T + markins Q3T, gitzo GM4562

  
  LOG IN TO REPLY
robscomputer
Senior Member
Avatar
429 posts
Joined Dec 2009
Location: Union City, CA
     
Apr 23, 2010 14:16 as a reply to  @ ed rader's post |  #32

Sorry to hear about the data loss.

I lost my first set of digital photos back in 2002, after that started a much better backup procedure. From my experience backing up is a balance between fault tolerance and price. It's like the old saying, "data recovery, speed, cheap, pick two".

Based upon the idea that you have two systems which need to be backed up I would recommend the following.

1) Set up a folder for all of your images and make sure that nothing else you want backed up is placed in another directory. I'm not familiar with Mac, but you could create a folder structure like /home/user/images where this would be all of your images.

2) Create a cron job to backup the /home/user/images folder to another local directory or drive. Another drive would be best but on the same drive would be ok for now. The idea here is to guard against any accidental deletion of the entire directory.

3) Create another cron job or script to copy the /home/user/images folder to a USB device. Also when you copy the files, use a utility that verifies that all of the images have been copied over. I think you can use the command diff to compare two directories, in Windows there is a tool called Robocopy that is great for this, scans GB of data and shows the different files in seconds, assume there's a tool in Mac.

4) Install a cloud backup agent. You can use Mozy or any other vendor like Jungle Disk, but stick with a larger company. Now this is not a 100% backup since it's going to the cloud, but it's just another layer of backups, also it's cheap, I think I pay $10 for two systems on Mozy.

5) Hard copy backups, once a month (or quarter) export your latest files to DVD for archival backups. This is going to be a huge pain the first time but after should be much easier. I know people will say "DVD's are too small 4.7GB is less than one card" but my reason is it's the most readable format possible. Do not use a backup software to create these disks unless you are certain that 10~20 years from now the software company will still be in business. These archival backups should be kept off site, like an in-laws house, bank deposit box, local storage locker, etc. Do not keep the archival files at home, next to your computer.

6) Test your backup procedure monthly. Make sure that you're backup procedure is tested and working. Login to the cloud backup software, retrive a file or directory. Try calling back some of the DVD's you made, can you pull data from it using a Mac or PC?

I like to build simple solutions over complex, I also follow this same path at work managing data backups for a small data center. This reason, I do not recommend a RAID SAN or NAS in place for a home environment unless you calculate the extra time and effort required to monitor the device. Each added solution to backup is like adding another link to the chain, it's another possible fault and another piece you need to check. I like to keep the chain as short as possible, this way you don't become lazy and forgot while you assume that the device is doing it's work.

Now, if you really have the time and effect, throwing a NAS in RAID 5 with a few TB of data would be nice to add after step 5. I haven't used home based NAS or SAN devices but I think they might offer some reporting tools, if a drive has failed send you a e-mail, or maybe even a phone home reporting so you'll get a call from the vendor with a replacement drive.

Basically, you want multiple levels of backup. Don't trust one method 100% as it may fail, and you never know when the worst will happen.

Good luck!


Amateur photographer

  
  LOG IN TO REPLY
ocabj
Goldmember
Avatar
1,120 posts
Likes: 3
Joined Jan 2008
Location: Riverside, CA (USA)
     
Apr 23, 2010 16:01 |  #33

harcosparky wrote in post #10052078 (external link)
I do the same thing, though I have the one that holds two drives.

Have you had any issues with that one? Mine will randomly eject a disk ( just started doing that this week )

Nope. I have this particular one constantly plugged into my office desktop at work for Time Machine (OS X backups).

I'm actually looking to get the one made/sold by OWC (macsales.com) because it has a FW800 interface.


Jonathan Ocab - https://www.ocabj.net (external link) - http://jocabphoto.com (external link)

  
  LOG IN TO REPLY
hairy_moth
Goldmember
Avatar
3,739 posts
Gallery: 1 photo
Likes: 19
Joined Apr 2009
Location: NJ
     
Apr 23, 2010 16:10 |  #34

ocabj wrote in post #10051618 (external link)
<< Picture of external disk deleted for space >>

I like to use a SATA to USB docking station and then buy SATA hard drives to use as backup 'cassettes'.

1TB drives can be had for cheap. They don't need to be fast either for writing to and then tossing into a drawer.

I do something similar, but with this western digital network drive (external link) that comes with automated backup software. If I was more serious, I would use 2 or more of the disks pictured above, but always keep at least one offsite.
As it is now, I periodically make DVD copies of my most important pictures and put them in the safe deposit box.


7D | 300D | G1X | Tokina 11-16mm f/2.8 | EF-S 17-55mm f/2.8 | EF-S 60mm f/2.8 Macro | EF 85mm f/1.8 | 70-200 f/2.8L MkII -- flickr (external link)

  
  LOG IN TO REPLY
Mystwalker
Senior Member
608 posts
Joined Feb 2008
     
Apr 23, 2010 16:18 |  #35

OUCH! Sorry to hear about your loss.
Not sure what I would do if that happened to me - probably have to change name and run for life. My wife will want to kill me :(

I have one copy (RAW & JPEG) on machine that I use to convert - this is work machine.
I back up to server - seperate machine.
And I also back up to external USB drives (one Seagate and now one WD)
Would like to also upload to web somewhere in case house burns down or California falls into ocean.

In past, I also copy to DVD, but then found out DVDs do not have "infinite" life span :(




  
  LOG IN TO REPLY
hairy_moth
Goldmember
Avatar
3,739 posts
Gallery: 1 photo
Likes: 19
Joined Apr 2009
Location: NJ
     
Apr 23, 2010 16:26 |  #36

Mystwalker wrote in post #10053037 (external link)
In past, I also copy to DVD, but then found out DVDs do not have "infinite" life span :(

Your results will also vary based on the DVD format. I had used some DVD+RW disks: complete junk; those disks, that are made to be rewritten only lasted about 2 years. I now use archive quality DVD-R. I don't really know if the gold colored disks are any better, but none of mine have failed yet.

http://www.jiscdigital​media.ac.uk …for-digital-preservation/ (external link)


7D | 300D | G1X | Tokina 11-16mm f/2.8 | EF-S 17-55mm f/2.8 | EF-S 60mm f/2.8 Macro | EF 85mm f/1.8 | 70-200 f/2.8L MkII -- flickr (external link)

  
  LOG IN TO REPLY
themadman
Cream of the Crop
Avatar
18,871 posts
Likes: 14
Joined Nov 2009
Location: Northern California
     
Apr 23, 2010 16:34 |  #37

OP > Have you considered hard drive recovery? I lost a hard drive myself recently and I am working with a recovery company based in Canada. I'll update you on how it goes.


Will | WilliamLiuPhotography.​com (external link) | Gear List and Feedback | CPS Member | Have you Pre-Ordered Your 3Dx Yet? | HorusBennu Discussion | In honor of Uncle Steve, thanks for everything! 10-5-2011

  
  LOG IN TO REPLY
sandro9mm
Goldmember
Avatar
1,718 posts
Joined Oct 2005
Location: Italy, Milan
     
Apr 23, 2010 16:52 |  #38

hm, western digital has 2TB mirror backup unit. I think that would be enough, doesn't cost more than 100$, connect it through wifi router, upload ur staff and forget.


Photography Tips (external link) - Learn photography now!
Famous photographers (external link) - Video Interviews, photos, biography
My gear (external link)

  
  LOG IN TO REPLY
MDJAK
Cream of the Crop
Avatar
24,745 posts
Gallery: 7 photos
Likes: 204
Joined Nov 2004
Location: New York
     
Apr 23, 2010 17:10 |  #39

Eh, my pictures suck so much, it wouldn't be such a loss. I'd just start all over again.

So, the question is: Why do I have like 10 external Hard Drives of varying shapes, sizes and capacities?

me




  
  LOG IN TO REPLY
RichSoansPhotos
Cream of the Crop
5,981 posts
Likes: 44
Joined Aug 2007
Location: London, UK
     
Apr 23, 2010 17:29 |  #40
bannedPermanent ban

nvert wrote in post #10048595 (external link)
Now, after much research, it's time for feedback about backup systmes from others with more experience. I have a concept diagram that I created and can be found here of what I currently am thinkin - this is a WIP diagram: http://gallery.me.com …ckupdiagram&bgc​olor=black (external link)

After loosing 10+ years of photo, art, and other work from an external hdd crash + a pc hd crash both within 10day period, I now have a new iMac and shopping for the best backup solution PLUS a syncing solution between my travel Macbook Pro, iPhone and home workstation iMac. At the moment, I'm just trying to regather, I have not been able to shoot in over a month. I don't think I'll ever be the same because of this loss.

Any help/advice is appreciated.
Brad (aka nvert)


You can get recovery companies to retrieve the data, but they are not cheap though.....




  
  LOG IN TO REPLY
Jon
Cream of the Crop
Avatar
69,628 posts
Likes: 227
Joined Jun 2004
Location: Bethesda, MD USA
     
Apr 23, 2010 17:30 |  #41

MDJAK wrote in post #10053304 (external link)
Eh, my pictures suck so much, it wouldn't be such a loss. I'd just start all over again.

So, the question is: Why do I have like 10 external Hard Drives of varying shapes, sizes and capacities?

me

Maybe to ensure you can never find the photo you think you want to print next? :{)#


Jon
----------
Cocker Spaniels
Maryland and Virginia activities
Image Posting Rules and Image Posting FAQ
Report SPAM, Don't Answer It! (link)
PERSONAL MESSAGING REGARDING SELLING OR BUYING ITEMS WITH MEMBERS WHO HAVE NO POSTS IN FORUMS AND/OR WHO YOU DO NOT KNOW FROM FORUMS IS HEREBY DECLARED STRICTLY STUPID AND YOU WILL GET BURNED.
PAYPAL GIFT NO LONGER ALLOWED HERE

  
  LOG IN TO REPLY
Wilt
Reader's Digest Condensed version of War and Peace [POTN Vol 1]
Avatar
46,487 posts
Gallery: 1 photo
Likes: 4580
Joined Aug 2005
Location: Belmont, CA
     
Apr 23, 2010 18:03 |  #42

ed rader wrote in post #10050917 (external link)
another way is to "store" full resolution files of your best stuff on a paid service like smug mug or zenfolio.

ed rader

Some on line storage companies have been known to go bankrupt, close operations, provide no notice to their clients, and simply close their doors without transferring data to some other on line storage solution, I am reluctant to recommend or use such storage solutions.


You need to give me OK to edit your image and repost! Keep POTN alive and well with member support https://photography-on-the.net/forum/donate.p​hp
Canon dSLR system, Olympus OM 35mm system, Bronica ETRSi 645 system, Horseman LS 4x5 system, Metz flashes, Dynalite studio lighting, and too many accessories to mention

  
  LOG IN TO REPLY
Franko515
"doped up on pills"
Avatar
2,478 posts
Joined May 2006
Location: Crete, Illinois
     
Apr 23, 2010 18:20 as a reply to  @ Wilt's post |  #43

I may be over doing it a little but it helps me sleep


Internal Drives

C Drive is only for OS and Apps

D Drive - Current projects

E Drive - Photo Storage (not mirrored, I manually copy the photos to this drive)

External Drives

F Drive - Photo Backup

G Drive - Photo Backup (kept off site)

DVD Backups

I put every completed job on a DVD, which I store off site. I make new copies of these every year.


Light, composition, shooting technique matter to the end quality most. -Pekka
My Flickr Gallery (external link)
My Gear List

  
  LOG IN TO REPLY
theslip
Member
101 posts
Joined Dec 2009
     
Apr 23, 2010 19:00 |  #44

Just like my story
my backupdrive broke while i was fixing my main drive
so lost all my life's files in a sec

geez talk about backupping your backup drive 'sigh'


60D|Kit Lens|Sigma 30|50mm1.8|NissinDi866​|YN460II|PT04NE|Apex 140 AW| Retro10 | 055xprob+498rc2

  
  LOG IN TO REPLY
nvert
THREAD ­ STARTER
Hatchling
2 posts
Joined Jul 2008
Location: Blacksburg, VA
     
Apr 23, 2010 21:08 |  #45

All of you guys ROCK!! I would never have anticipated this much response to my questions - in less than 24hrs. I don't even know how to respond to everyone except one BIG Thank you. I'll try to get back to most of you with more specific questions over the next day or two..

By the way, more info for everyone regarding my attempts to recover data:

"The Accident": One evening I knocked my external HDD off the PC tower which sits under my desk on carpet. The drive fell less than 18" - all cords attached - and I'm sure that slowed the fall a bit. Either way, the drive was powered on 24/7 and most likely spinning at the time of the fall. Once I put everything back in place, the ext HDD began clicking. Immediately I shut it down and went to the forums as well as tech help from my university. The click was truly the "click of death". Because my university has a contract with DriveSavers, I sent it to them hoping for the best. After 2 levels of analysis by DS, nothing on the 320GB drive recoverable. What few items they were able to pull off the drive, even they were not able to decipher if those files were jpgs or txt files.
nd my job was willing to foot part of the bill since we already have an account with DriveSavers. I was ready to pay 2K for data recovery and work was willing to meet me part way. The sick irony of it all is that I was looking at another backup level 2 months before this happened - I just couldn't decide on what and now I have lost all originals. I have lots of work on the web but as you all know that format is limiting.

I lost great work, family pics, travel pics, SCUBA pics, published work, work to be published, writing, course+teaching materials, financial data...EVERYTHING YOU HAVE! So....

...For all of you thinking about upgrading...follow your gut and do it now before something like this happens to you. Not to be pessimistic...it will happen eventually. I'm just thankful the house didn't burn etc but loosing all that work is a bit debilitating. At least my Canon is right beside me at this moment...been the first time in over 5 weeks and usually it's always "the appendage" my friends tease me about.

Again, thanks to everyone for responding so fast to my post. I promise to take time and read and respond over the next few days.

Best to all,
Brad Whitney
www.bradleywhitney.com (external link)
www.flickr.com/bradley​whitney (external link)
http://gallery.me.com/​nvert (external link)

Best,
Brad




  
  LOG IN TO REPLY
sponsored links (only for non-logged)

15,281 views & 0 likes for this thread, 65 members have posted to it.
Lost 10+years of work, Need advice on next back up plan
FORUMS Cameras, Lenses & Accessories Canon Accessories 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member was a spammer, and banned as such!
2788 guests, 132 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.