Is your computer ready for 21-24 MB files?

[RichNY]

This isn't just a 5D question but applies to the 1Ds III, Sony, future Nikon, etc.

If I purchased a new high mpix camera I would need to upgrade my computer (2yo 2.16GHz Intel 2 Duo processor) if I wanted acceptable performance.

Just wondering how many others would be faced to do the same.

[syntrix]

Well, I have the storage space, but this would double+ my processing time if I ripped raw files in batch for final output.

I'd take less MP for a better quality file. Seems like there's a MP war going on.

[wytwolf]

The cpu should be fine, but make sure you have a lot of ram, opening up and editing numerous pictures will eat alot of ram.

[syntrix]

The cpu should be fine, but make sure you have a lot of ram, opening up and editing numerous pictures will eat alot of ram.

My batch only does one at a time, just make sure if you PS batch you have it close the working file.

4G of ECC ram is what I have and process on, but that's probably outdated now.

Ugh, actually now that I think about it, I've had to zip up raw files and send them out...... hmmmm, I need a faster connection now.

[Stealthy Ninja]

Macpro with x2 Xeon 2.66Ghz CPU and 6GB of RAM should handle it OK still. ;)

[René Damkot]

If I had a 5D2, I'd probably use it on 10Mp 90% of the time. (sRaw).

[Stealthy Ninja]

If I had a 5D2, I'd probably use it on 10Mp 90% of the time. (sRaw).

Same here. It matches my 40D better and I don't need 21MP for family stuff too. :D

[elbirth]

I have an 8-core 3GHz Mac Pro with 5GB of RAM (still planning on upgrading to maybe 8GB or so), so I think I'll be fine.

All totaled I probably have close to 3TB of storage, but it's across multiple locations (actually in the Mac Pro, a file server and external hard drives)... I have 1TB worth in a mirrored RAID already, but I'd love to get a Drobo or something else with a solid RAID setup and throw some 1TB drives in solely for photo storage.


As much as I hate to "waste" the 21MP of the 5D Mark II, I think I'll probably also shoot in sRAW for most random shooting, only bumping to 21MP for more special occasions.. but that also depends on how big those 21MP RAW files end up being, too...

[Tom W]

I'm ready - I upgraded last November in anticipation of the February release of the 5D replacement. Perhaps I was a bit premature....

[weka2000]

I upgraded 2 weeks ago :)

Core 2 quad 8 gig ram vista 64bit.

[ed rader]

Well, I have the storage space, but this would double+ my processing time if I ripped raw files in batch for final output.

I'd take less MP for a better quality file. Seems like there's a MP war going on.

that's a major reason i love the 1d mark III.

ed rader

[form]

I use a 533 mhz Mac G4 for my 12-14mb 40D raw files. Very slow. To me, anything is better; a core 2 duo would be like going from night to day for me.

I can't believe you think your computer wouldn't be fast enough.

[cicopo]

Since I just bought a 1Dsmkll and right away shot an event that took just over 1000 RAW + JPG's (yes I shoot both at max file size) I want to warn everyone that it took over 6 hours to download all the cards. Now that by itself wasn't the worst part, the hard drive failed with about 40 files left to download, so I had to do it all over again. Big files take a long time to download, and a lot of disk space. There will be a lot of USB hard drives being sold to those buying the new bodies, and that's another story.

[syntrix]

that's a major reason i love the 1d mark III.

ed rader

Zing !!! where the thumbup icon, hmmmm.

[silvex]

I am ready. I just upgraded my SATA disk from 300GB to 500GB, but I might have to move to a 2TB network attached NetGear disk.

[Tsmith]

I might pick up a new 500 GB OEM WD SATA II (storage) from newegg for around $69. The Core2 Duo 2.66 Ghz with 4 gigs of RAM\Raptor drives does pretty darn well with big TIFF's.

[cicopo]

2 Tb might be good but what do we do when a drive that large dies? I was really lucky with mine because it was a back up to a back up. More importantly it wasn't very old (out of warranty though) and was a very respected brand to the best of my research (Seagate).

[Jim G]

I just upgraded to a quad core... so it had better be ready for whatever comes in the next few years 'cos I'm not upgrading again anytime soon!

[Zazoh]

I guess all those poster printers out there really needed those extra MP.

Man, I have the 5D and if you can't take a decent picture with 12.8, 21 aint gonna do you no good.

[elbirth]

2 Tb might be good but what do we do when a drive that large dies? I was really lucky with mine because it was a back up to a back up. More importantly it wasn't very old (out of warranty though) and was a very respected brand to the best of my research (Seagate).

yeah, this is why I want to find a solid RAID solution.
My Mac Pro has a software RAID built-in which I like a lot for the 1TB mirrored array I already have, but my computer also only has 4 internal slots.
This is where I think I may explore using external drives and setting them up in a RAID (assuming it even lets you use USB drives)

and for those who may not know what RAID is... to put it simply, it makes multiple drives work in tandem with one another to provide redundancy, so if 1 drive dies, the others all still have that data so you can replace the drive without losing data like you would if you just had a single drive.

[Stealthy Ninja]

yeah, this is why I want to find a solid RAID solution.
My Mac Pro has a software RAID built-in which I like a lot for the 1TB mirrored array I already have, but my computer also only has 4 internal slots.
This is where I think I may explore using external drives and setting them up in a RAID (assuming it even lets you use USB drives)

and for those who may not know what RAID is... to put it simply, it makes multiple drives work in tandem with one another to provide redundancy, so if 1 drive dies, the others all still have that data so you can replace the drive without losing data like you would if you just had a single drive.

There are different types of RAID arrays.

RAID 0 (striped disks) distributes data across several disks in a way which gives improved speed and full capacity, but all data on all disks will be lost if any one disk fails.

RAID 1 (mirrored disks) uses two (possibly more) disks which each store the same data, so that data is not lost as long as one disk survives. Total capacity of the array is just the capacity of a single disk. The failure of one drive, in the event of a hardware or software malfunction, does not increase the chance of a failure nor decrease the reliability of the remaining drives (second, third, etc).

RAID 5 (striped disks with parity) combines three or more disks in a way that protects data against loss of any one disk; the storage capacity of the array is reduced by one disk.

RAID 6 (less common) can recover from the loss of two disks.

So basically, you can have RAID 0 for combining 2 disks into one big disk. Or the other methods for keeping your data safe (but you lose capacity).

Personally I am considering getting a 1TB backup disk, then 2 500GB disks in RAID 0 configeration for storage. Backing up regularly on the 1TB disk (I wonder if timemachine can be set up just to mirror the "files" drive).

[weka2000]

In testing a RAID 5 at work on my PC 3x1TB disks, if happy will do the same at home but have 3 x 500 and 1TB external.

[Swaffs]

I've got a new mobo, and Quad core + 6 Gb RAM waiting to be installed, just need some down time to swap it all out.

Rich

[René Damkot]

Since I just bought a 1Dsmkll and right away shot an event that took just over 1000 RAW + JPG's (yes I shoot both at max file size) I want to warn everyone that it took over 6 hours to download all the cards.

Real slow card reader I assume?

That would be what? 20Gb, maybe 30Gb in files?

Should be able to transfer that in under an hour max...

[Dermit]

Mac Pro dual quad core w/10GB RAM and two internal 1TB drives, one for images, one for backup, a Raptor drive for apps and OS and a 320GB drive for scratch. I should be good for, oh a year or two or three.

[ArcticShooter]

Just wait until you starts doing TIFFs :)

[HoRnYTuRbO]

memory is so cheap now, i picked up two 1 tera byte external HD for $150 each

[Bobster]

Since I just bought a 1Dsmkll and right away shot an event that took just over 1000 RAW + JPG's (yes I shoot both at max file size) I want to warn everyone that it took over 6 hours to download all the cards.

Real slow card reader I assume?

That would be what? 20Gb, maybe 30Gb in files?

Should be able to transfer that in under an hour max...
yeah 4GB takes about 8 minutes via USB2 on a laptop

as far as your 2.1Ghz CPU is concerned.. you can pick up a QuadCore2 6600 for very little these days, if you've got enough storage and RAM and you find that your machine is a little on the sluggish side, pick up a Q6600 and replace the CPU :)

[In2Photos]

I think my PC would drop dead if I tried to use RAW files from a 5d2 or 1Ds3. Hell I have trouble with the RAW files from my old 40D. :lol: The PC needs upgrading and I am hoping that x-mas is a good one. ;)

[tim]

memory is so cheap now, i picked up two 1 tera byte external HD for $150 each

Memory and storage are different.

I have a dual core PC, i'm sure it'll be fine, but i'll be upgrading to at least quad core in the next 6 months, maybe 8 core, depending on price.

[elbirth]

Personally I am considering getting a 1TB backup disk, then 2 500GB disks in RAID 0 configeration for storage. Backing up regularly on the 1TB disk (I wonder if timemachine can be set up just to mirror the "files" drive).

Just curious why you would do 2 500GB drives in a striped array versus 2 1TB drives in a mirror. With a striped array, if 1 drive dies, you lose all the data, although you do have the other single 1TB drive you mentioned as a backup.

This is why I like my current mirrored array with 2 1TB drives. I only get 1TB of usable space, but when 1 drive dies, I don't lose anything.


As for Time Machine... it's not designed to really do a mirror of drives, but just incremental backups that keep all of your data (old and new) intact. You can have it back up your "files" drive and it'll do an incremental backup every hour and get any new data. If that "files" drive dies, you should be able to replace it with a new drive of the same name, then invoke Time Machine and have it restore all the files to it.
I haven't used it in that manner before though so I'm not 100% sure, but I know you can use Time Machine to restore your system from a crashed boot drive, so I don't see why not.

[Palladium]

take a look at these new multiple compact flash card readers 0 one with software and one without.

http://www.bhphotovideo.com/c/product/550540-REG/Delkin_Devices_DDREADER_40_US_ImageRouter_Card_Rea der_Writer_.html

http://www.bhphotovideo.com/c/product/550543-REG/Delkin_Devices_DDREADER_40_KIT_US_ImageRouter_Card _Reader_Writer_.html

[smdevo]

You could always shoot in sRAW 10MP files. That's gonna be a 5D II option right?

As for me, I'll be ok with my 8-core mac pro for a while.

[elbirth]

You could always shoot in sRAW 10MP files. That's gonna be a 5D II option right?

As for me, I'll be ok with my 8-core mac pro for a while.

yeah you'll be able to do 10MP and I think 5MP sRAW files with the 5DMkII
of course, using anything less than full resolution is blasphemy :p

[40Driggs]

Well, loading up my 40D raw images on my POS computer definitely takes some time. I'm running on 1.7 Ghz (single core) with 1 GB of Ram. Can't justify buying a new computer though when I have all this camera stuff that I want!

[tim]

Going from single core to dual core more than doubled my performance, as each core was faster than the original single core. See if you can do that 40Driggs, it only cost me $150 or so.

[Stealthy Ninja]

Just curious why you would do 2 500GB drives in a striped array versus 2 1TB drives in a mirror. With a striped array, if 1 drive dies, you lose all the data, although you do have the other single 1TB drive you mentioned as a backup.

This is why I like my current mirrored array with 2 1TB drives. I only get 1TB of usable space, but when 1 drive dies, I don't lose anything.


As for Time Machine... it's not designed to really do a mirror of drives, but just incremental backups that keep all of your data (old and new) intact. You can have it back up your "files" drive and it'll do an incremental backup every hour and get any new data. If that "files" drive dies, you should be able to replace it with a new drive of the same name, then invoke Time Machine and have it restore all the files to it.
I haven't used it in that manner before though so I'm not 100% sure, but I know you can use Time Machine to restore your system from a crashed boot drive, so I don't see why not.


Because on my computer I want to have as much storage space as possible (2x 500GB not 1x500GB on 2x500GB drives). I then back up regularly enough that it doesn't bother me if I notice a drive starting to fail (usually they don't die suddenly these days - unless you something violent to them.

The way I do it, I can use 1 TB on my computer and have another 1 TB on the side with regular backups.

I'll have to check the time machine thing. I think (if it works) it'll be simular (though not totally the same as) using a mirrored raid (but with more storage overall).

Of course, my way costs a bit more to set up. ;) Though HDDs are getting pretty cheap these days.


Basically though, we're doing the same thing. Mine takes a little more risk, but that's OK. :D

Time for another backup soon I suspect. Feeling nervous.

I might even look into getting 2x1TB drives put in a RAID 0 configuration. I use a lot of HDD space for videos (some projects are up to 500GB each!!!). So 2 TB is looking good for me.

Then I'll probably use my old 320GB drives as finished video backup (just keep the finished work). Get another 1TB external drive as photo backup (more space needed for that ;) ). When that gets too small I can probably afford a 2TB drive. Then I'll back up that 1TB external with the new 2TB external, giving me an extra 1TB to fill up. When that fills up, I can probably get a 3TB drive... and so on.

That way I keep backing myself up (and keeping the old drives as backups of the older files).

Phew. Complicated... but totally cool. I love getting a new HDD. Makes me feel like a big man (cheaper than a big car too).

[Bobster]

Going from single core to dual core more than doubled my performance, as each core was faster than the original single core. See if you can do that 40Driggs, it only cost me $150 or so.
You'll actually see less than a double increase in speed when going from a single CPU of the same speed to a dual CPU of the same speed - ie. 2.1GHz single to 2.1GHz dual..

[elysium]

My PC barely copes as it is. 15mb RAW files would be hell. Need to upgrade sometime soon on that front also.

[Stealthy Ninja]

My goodness we're all geeks. ;)

Here's a test:

1f U C4N r34d 7h15 ur 3Y3Z r teh 1337. TTYL

I n33d5 50m3 21mp fil3s 70 m4k3 my 1337 h4xor sk1ll5 w0rk h4rdr

Here is a harder test:
!|# `/0|_| (4|\| |234|) +|-|!5 +3%+ `/0|_|'|23 4 633|( . ! +0+411`/ |\|33|) 50|\/|3 21|\/||> |#!135 +0 |\/|4|( 3 |\/|`/ (0|\/||>|_|+3|2 |-|4\/3 4 8!+ 0|# 4 (|-|4113|\|63. !+'5 +00 |#45+ 4+ +|-|3 |\/|0|\/|3|\|+.

[elysium]

My goodness we're all geeks. ;)

Here's a test:

1f U C4N r34d 7h15 ur 3Y3Z r teh 1337. TTYL
If you can read this, your eyes are the elite(great). Talk to you/y'all later.

heh

[KarlosDaJackal]

I don't use PhotoShop, I could easily handle a 200MB file (conservative estimate, probably a lot more than that).

[Bobster]

If you can read this, your eyes are the elite(great). Talk to you/y'all later.

heh
no just my monitor ;)
I don't use PhotoShop, I could easily handle a 200MB file (conservative estimate, probably a lot more than that).
the way photoshop currently works (i think they may have optimised stuff in CS4 (EX)) is you take your image so 21Mpix = 60MB TIFF (8bit) and you multiply it by 5 so you end up needing 300MB of physical RAM free to work on the image.. start adding layers etc and the size will increase, and so needing more RAM..

start working in 16bit and you're doubling file sizes and the need for a decent amount of RAM in the machine

[Tandem]

My computer is okay but I needed to seriously upgrade my CF storage. I now have 6 16MB cards and a 500GB card reader.

[slimninj4]

On a raid 1 if one dies, it is just plug and play for a new drive and the computer will know to copy (duplicate) the files on to the new drive?

I ask because a coworker lost all his data when he replaced one drive the computer took this as a time to delete and make both HD with all files wiped.

[KarlosDaJackal]

On a raid 1 if one dies, it is just plug and play for a new drive and the computer will know to copy (duplicate) the files on to the new drive?

I ask because a coworker lost all his data when he replaced one drive the computer took this as a time to delete and make both HD with all files wiped.

Way to hijack a thread :p

Depends on the RAID controller and level. Assuming he had a raid 1 (mirror), the idea is that the drive flagged as failed should be replace and the RAID system should recognize this and copy the good drive to the replaced drive. With hardware RAID it seems to work quite well, software and motherboard RAID (without its own processor and ram chip) seems hit and miss.

Regardless, RAID is not a backup solution, its only intended to keep the machine running for long enough for you to replace the failed drive.

[elbirth]

My computer is okay but I needed to seriously upgrade my CF storage. I now have 6 16MB cards and a 500GB card reader.

Good point. Though, uh... if you're using 16MB cards, you're going back to some old school stuff of changing media after every shot ;)


I have a couple 4GB cards that have been generally fine when I'm shooting with my 20D, but I want to look into getting some 8 or 16GB ones (probably 16 of course)
I was really hoping the 5D Mark II would at least allow both CF and SD like the 1 series, so I could use the CF cards I have and buy some SD cards from here on out since those are much cheaper than CF cards at the same capacity.

If anyone has a good source for really cheap CF cards (but good quality), feel free to speak up :)

[Stealthy Ninja]

no just my monitor ;)



I think you missed the point there.

[Faolan]

Useful solutions:

Netgear ReadyNAS: comes with a unique RAID mode called X-Raid, you can find out about it on their site. Several versions available but the ReadyNAS Duo is a great starter NAS. Just make sure you upgrade your LAN to 1Gbe...

Antec Veris MX-1: cheap as chips external e-SATA case with cooling/silencing tech. Chuck in a SATA drive and connect to a port on your PC and you have full Sata 3Gb/s speeds (if your mother supports it). It also has a USB 2 interface.

Firewire card reader: Sandisk is about the only one that does one, but if you're starting to do more than 4Gb data then the time saved is worth it. Firewire's throughput is faster than any USB solution. Also make sure you buy the fastest CF cards you can afford, not so much for the camera but for the transfer rates they allow.

RAM lots of it for Photoshop and fast scratch disks, this will mean transitioning to a 64bit aware OS. Mac OS X is partially 64bit and Vista 64 is full 64Bit, both will allow you to see more than 4Gb without switches.

[Zepher]

I did a decent upgrade. P4 3.4ghz 2GB to a C2D 3.0ghz 4GB.

[Steve Beck]

My computer has been handling the 25-30mb raw files from my 1dsmkIII cameras fine for the last 6 months. I even processed a few 9 bracketed shots from my dsmkIII on my laptop they ended up being 300mbs when they were finished with no problems at all.