Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS Cameras, Lenses & Accessories Canon Accessories 
Thread started 05 Mar 2014 (Wednesday) 09:17
Search threadPrev/next
sponsored links (only for non-logged)

Raspberry Pi backup strategy

 
Stevegg
Member
38 posts
Likes: 1
Joined Sep 2013
     
Mar 05, 2014 09:17 |  #1

I have posted a step-by-step guide to use a Raspberry Pi £30 mini computer as a portable photo backup solution for travelling.

The system means I can use a standard lightweight portable hard drive as a backup for a fraction of the price of a dedicated photo backup device like the Hyperdrive.

I hope you find it useful. The guide can be found at www.sggimages.blogspot​.com (external link)


6d, 7d, 50 f1.4, 100 f 2.8 L, 17-40, 24-105, 70-200 f4, 400 f5.6
Flickr (external link)

  
  LOG IN TO REPLY
Eddie
xpfloyd lookalike
Avatar
14,829 posts
Gallery: 719 photos
Best ofs: 8
Likes: 10940
Joined Feb 2011
Location: Glasgow, Scotland
     
Mar 05, 2014 09:25 |  #2

Excellent, I have been searching for this very thing but didnt find a solution. I will have to read it a few more times though to take it all in


Leica M11 | Leica Q2 | Sony α7RV
Voigtlander 28 f/2 Ulton II | Leica 50 Summilux ASPH
16-35GM | 24GM | 35GM | 85GM | Tamron 35-150 | Sigma 105 Macro Art

  
  LOG IN TO REPLY
jmikolich
Senior Member
Avatar
388 posts
Likes: 7
Joined Feb 2013
Location: Ohio
     
Mar 05, 2014 11:33 |  #3

Hi Steve, Great to see it posted. I can't wait to check it out.

Couple questions now that I've briefly glanced through it.

This is meant as a means to Take the SD Card (or CF if you had the correct USB adapter) out of the camera and insert it into the Pi Hub then basically use the iPad as a GUI to cut and paste the files OFF the SD Card to the HDD, is my understanding Correct?

Have you looked @ using the Pi Wireless and tethering to the 6D? or are you convinced there are already enough examples of people doing this?

Also, is there a file size/HDD limit with the Pi/distro that you've found, for instance I have several 1tB and greater HDD, are these compatible?


-Jim
Canon 5D3,5D3,5D2,6D,24 f2.8 IS,35L,45 TS-E,50L,85 f1.8,70-200 f2.8L II,100L
Rokinon 14mm f2.8

  
  LOG IN TO REPLY
Stevegg
THREAD ­ STARTER
Member
38 posts
Likes: 1
Joined Sep 2013
     
Mar 05, 2014 12:17 |  #4

jmikolich wrote in post #16736376 (external link)
Hi Steve, Great to see it posted. I can't wait to check it out.

Couple questions now that I've briefly glanced through it.

This is meant as a means to Take the SD Card (or CF if you had the correct USB adapter) out of the camera and insert it into the Pi Hub then basically use the iPad as a GUI to cut and paste the files OFF the SD Card to the HDD, is my understanding Correct?

Have you looked @ using the Pi Wireless and tethering to the 6D? or are you convinced there are already enough examples of people doing this?

Also, is there a file size/HDD limit with the Pi/distro that you've found, for instance I have several 1tB and greater HDD, are these compatible?

Hi Jim

Q1 Yes it allows transfer of the files from the cameras card SD or CF to an external HD. The Ipad accesses the Ad-Hoc Network created by the Pi and effectively acts as a wireless screen, keyboard and mouse replacement.

Q2 I have played with Eye Fi and wireless on the 6D but at present Gphoto2 which is the Linux software which connects with cameras doesn't (as far as know) allow wireless connection. It is possible to connect the camera direct to the Pi but this needs Gphoto which is quite complicated to install, if you want the latest version. I found using the card out of the camera quicker and more reliable. In addition controlling the Pi with the Ipad requires an Ad-Hoc network and you can't run two Ad-hoc networks simultaneously.

Q3 I use a 500mb Seagate Ultra Slim Drive with no problem but I'm sure a 1Tb drive is not a problem.

Best Wishes

Steve


6d, 7d, 50 f1.4, 100 f 2.8 L, 17-40, 24-105, 70-200 f4, 400 f5.6
Flickr (external link)

  
  LOG IN TO REPLY
joeseph
"smells like turd"
Avatar
11,836 posts
Gallery: 263 photos
Likes: 6003
Joined Jan 2004
Location: Auckland, New Zealand
     
Mar 08, 2014 01:15 |  #5

looks very interesting - thanks for sharing!


some fairly old canon camera stuff, canon lenses, Manfrotto "thingy", and an M5, also an M6 that has had a 720nm filter bolted onto the sensor:
TF posting: here :-)

  
  LOG IN TO REPLY
TeamSpeed
01010100 01010011
Avatar
40,862 posts
Gallery: 116 photos
Best ofs: 2
Likes: 8923
Joined May 2002
Location: Midwest
     
Mar 08, 2014 06:26 |  #6

That looks cool, I always thought about playing with the PI.

However if I wanted to just have a small device to back up cards, is the PI route better overall than something like the following? I had an epson Pxxxx unit years ago, and it was very handy too, but much more expensive.

http://www.bhphotovide​o.com …ST_251_Photo_Sa​fe_II.html (external link)


Past Equipment | My Personal Gallery (external link) My Business Gallery (external link)
"Man only has 5 senses, and sometimes not even that, so if they define the world, the universe, the dimensions of existence, and spirituality with just these limited senses, their view of what-is and what-can-be is very myopic indeed and they are doomed, now and forever."

  
  LOG IN TO REPLY
Stevegg
THREAD ­ STARTER
Member
38 posts
Likes: 1
Joined Sep 2013
     
Mar 08, 2014 08:53 |  #7

Hi Teamspeed

I'm not sure the Pi route is better but it is substantially cheaper, particularly if you already have a suitable portable hard drive. The Photosafe doesn't get very good reviews and the Hyperdrive, which does get better reviews, is $500.

We always take an iPad when we travel which doubles as a DVD player, Photo viewer and now as a controller for the raspberry Pi.

It is possible to get a small screen with buttons that works with the Pi and would make a stand alone backup. My programming isn't that advanced yet but I'm working on it.

Best Wishes

Steve


6d, 7d, 50 f1.4, 100 f 2.8 L, 17-40, 24-105, 70-200 f4, 400 f5.6
Flickr (external link)

  
  LOG IN TO REPLY
TeamSpeed
01010100 01010011
Avatar
40,862 posts
Gallery: 116 photos
Best ofs: 2
Likes: 8923
Joined May 2002
Location: Midwest
     
Mar 08, 2014 08:59 |  #8

Stevegg wrote in post #16743146 (external link)
Hi Teamspeed

I'm not sure the Pi route is better but it is substantially cheaper, particularly if you already have a suitable portable hard drive. The Photosafe doesn't get very good reviews and the Hyperdrive, which does get better reviews, is $500.

We always take an iPad when we travel which doubles as a DVD player, Photo viewer and now as a controller for the raspberry Pi.

It is possible to get a small screen with buttons that works with the Pi and would make a stand alone backup. My programming isn't that advanced yet but I'm working on it.

Best Wishes

Steve

Is there a way to obtain a slightly larger case where you could incorporate everything into one box? Hub, card slots, and Pi... That would make for a nice compact kit so you didn't have all the components. I am more concerned about having all the pieces rattling around in a bag, etc. and one box, even it is a bit on the larger side would be nice. I am not familiar with all the PI configurations and cases though.


Past Equipment | My Personal Gallery (external link) My Business Gallery (external link)
"Man only has 5 senses, and sometimes not even that, so if they define the world, the universe, the dimensions of existence, and spirituality with just these limited senses, their view of what-is and what-can-be is very myopic indeed and they are doomed, now and forever."

  
  LOG IN TO REPLY
Stevegg
THREAD ­ STARTER
Member
38 posts
Likes: 1
Joined Sep 2013
     
Mar 08, 2014 09:56 |  #9

I don't think there's a commercial case available but it wouldn't be too difficult to adapt an electrical enclosure box and deconstruct a powered USB hub to fit in the modified box. It would be an interesting project.

I actually prefer the component parts because they then fit into small spaces when I'm packing light.

BW

Steve


6d, 7d, 50 f1.4, 100 f 2.8 L, 17-40, 24-105, 70-200 f4, 400 f5.6
Flickr (external link)

  
  LOG IN TO REPLY
jonneymendoza
Goldmember
3,794 posts
Likes: 391
Joined Apr 2008
     
Mar 09, 2014 19:33 |  #10

very interesting. thanks for that


Canon 5dmkIII | Canon 85L 1.2 | Sigma 35mm ART 1.4|Canon 16-35mm L 2.8 |Canon 24-70mm L f2.8 | Canon 70-200mm F2.8L MK2 | Canon 430EX MK2 Flickr (external link)

  
  LOG IN TO REPLY
pwm2
"Sorry for being a noob"
Avatar
8,626 posts
Likes: 3
Joined May 2007
Location: Sweden
     
Mar 09, 2014 20:04 |  #11

Note that the RP is a general computer and can be programmed to perform the transfers automatically when both a memory card and HDD is connected - all without the use of any tablet or similar.

It's possible to just connect a couple of LED to inform
- waiting for card/hdd
- busy copying
- copy done
- hdd full
- low battery
...

Or teaching the RP to use two HDD - when HDD 1 is connected then just copy the images. When HDD 2 gets connected perform a copy + remove. So you always gets two copies of the images before the memory card images gets erased.

The main limitation of the RP is the speed of the USB interface. Except for that, almost anything is possible.


5DMk2 + BG-E6 | 40D + BG-E2N | 350D + BG-E3 + RC-1 | Elan 7E | Minolta Dimage 7U | (Gear thread)
10-22 | 16-35/2.8 L II | 20-35 | 24-105 L IS | 28-135 IS | 40/2.8 | 50/1.8 II | 70-200/2.8 L IS | 100/2.8 L IS | 100-400 L IS | Sigma 18-200DC
Speedlite 420EZ | Speedlite 580EX | EF 1.4x II | EF 2x II

  
  LOG IN TO REPLY
Stevegg
THREAD ­ STARTER
Member
38 posts
Likes: 1
Joined Sep 2013
     
Mar 10, 2014 03:51 as a reply to  @ pwm2's post |  #12

Thanks pwm2

I am working on a solution which avoids using the Ipad but still allows the hard drive contents to be viewed. It also needs to be cheap.
The problem with the LED indication is the doubt that the files have been backed up correctly.

I published this solution because it's easy to achieve even if you are a complete Pi nooby, and AFAIK the steps have not been collected into one easy to follow document.

Best Wishes

Steve


6d, 7d, 50 f1.4, 100 f 2.8 L, 17-40, 24-105, 70-200 f4, 400 f5.6
Flickr (external link)

  
  LOG IN TO REPLY
pwm2
"Sorry for being a noob"
Avatar
8,626 posts
Likes: 3
Joined May 2007
Location: Sweden
     
Mar 10, 2014 04:44 |  #13

I just have the advantage of writing embedded software every day :p

I personally like to use the md5sum to verify correct transfers.

So the md5 is computed of the images on the memory card.

And the md5 is computed on the files after copied to a HDD.

An important issue here is that if copying a limited number of files, then the RP will cache the file data so md5sum will not perform any new reads - so a very careful guy has to tell the Linux OS to clear the disk cache before reading back the copies and check for perfect copies.

The good thing is still that it doesn't take much programming skills to manage - each step is quite simple.


5DMk2 + BG-E6 | 40D + BG-E2N | 350D + BG-E3 + RC-1 | Elan 7E | Minolta Dimage 7U | (Gear thread)
10-22 | 16-35/2.8 L II | 20-35 | 24-105 L IS | 28-135 IS | 40/2.8 | 50/1.8 II | 70-200/2.8 L IS | 100/2.8 L IS | 100-400 L IS | Sigma 18-200DC
Speedlite 420EZ | Speedlite 580EX | EF 1.4x II | EF 2x II

  
  LOG IN TO REPLY
jonneymendoza
Goldmember
3,794 posts
Likes: 391
Joined Apr 2008
     
Mar 10, 2014 06:10 |  #14

pwm2 wrote in post #16747307 (external link)
I just have the advantage of writing embedded software every day :p

I personally like to use the md5sum to verify correct transfers.

So the md5 is computed of the images on the memory card.

And the md5 is computed on the files after copied to a HDD.

An important issue here is that if copying a limited number of files, then the RP will cache the file data so md5sum will not perform any new reads - so a very careful guy has to tell the Linux OS to clear the disk cache before reading back the copies and check for perfect copies.

The good thing is still that it doesn't take much programming skills to manage - each step is quite simple.

i write software too everyday and imagine most photographer hobbies do!

you would be surprised how many photographers also write software or work within the IT field


Canon 5dmkIII | Canon 85L 1.2 | Sigma 35mm ART 1.4|Canon 16-35mm L 2.8 |Canon 24-70mm L f2.8 | Canon 70-200mm F2.8L MK2 | Canon 430EX MK2 Flickr (external link)

  
  LOG IN TO REPLY
jmikolich
Senior Member
Avatar
388 posts
Likes: 7
Joined Feb 2013
Location: Ohio
     
Mar 10, 2014 10:46 |  #15

pwm2 wrote in post #16747307 (external link)
I just have the advantage of writing embedded software every day :p

I just had a feeling you were in to software at a low level based off your username.

I work with hardware and all the RPi software stuff brings back bad memories to my undergrad degree

I have all the stuff to try this out, just haven't had the time to play with it yet


-Jim
Canon 5D3,5D3,5D2,6D,24 f2.8 IS,35L,45 TS-E,50L,85 f1.8,70-200 f2.8L II,100L
Rokinon 14mm f2.8

  
  LOG IN TO REPLY
sponsored links (only for non-logged)

5,104 views & 0 likes for this thread, 7 members have posted to it.
Raspberry Pi backup strategy
FORUMS Cameras, Lenses & Accessories Canon Accessories 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is johntmyers418
1173 guests, 188 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.