Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS General Gear Talk Computers 
Thread started 31 May 2019 (Friday) 03:54
Search threadPrev/next
sponsored links (only for non-logged)

Storage config / options

 
urbanfreestyle
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
Post edited over 4 years ago by urbanfreestyle.
     
May 31, 2019 03:54 |  #1

TLDR: I have too many HDD, which should i use?

Hi family,
So i'm hoping that someone can help me out with my dilemma.
I have just acquired a nice PC that i intend to use as my workhorse, I have hidden the specs below:

Motherboard: Asus Z97-K
Processor: Intel Core i7 4790K
CPU Cooler: Noctua NH-U14S
RAM: 32gb 2133 Corsair Vengeance Pro DDR3
Graphics: EVGA GTX 960 SCC
PSU: Corsair CS550M 500w
Case: Carbide 330R Titanium
Fans: 2x Front 140 Corsair (OEM) 1x Rear 120 Corsair (OEM)

Now the issue i have is storage... In a way i think i have too much choice as i have collected a lot over the last year.
Below is my list of drives:

3x 3tb Seagate Constelation es.3 HDD
6x 2tb Seagate Baracuda HDD
2x 256gb Samsung M.2 NVME
2x 256gb Samsung 840 Evo SSD

I guess what i am trying to work out is what can / do i use in this build?
I know that it's not a simple answer as there are so many combinations i could use.
As i said it is going to be my workhorse so by this i mean that i will be using it for the following:

3d CAD using Fusion 360
Photo editing using Lightroom and Photoshop
Video editing using Sony Vegas
VM testing (i work in an infrastructure team to want to be able to try / break things before going into a live environment with it)
Normal shiz like iTunes, web browsing, blah blah blah
NO GAMING

My current thoughts are:

Boot drive: 256gb m.2
Scratch: 256gb SSD
Photo & Video storage: 3x 3tb Seagate drives in RAID 0
Backup (i also own an empty 4 bay NAS): 4x 2tb Seagate RAID 6

Final passing thought. Could i RAID 0 2 of the SSDs for scratch storage / current projects?


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
John ­ from ­ PA
Cream of the Crop
11,258 posts
Likes: 1527
Joined May 2003
Location: Southeast Pennsylvania
     
May 31, 2019 04:27 |  #2

Your configuration only seems to use (1) of the Samsung M.2 NVME drives. Why not use the 2nd one as your scratch drive as opposed to the Samsung 840 Evo? Having said that, the exact details on the drives are not provided, but you can do a comparison given the details at https://ssd.userbenchm​ark.com …-256GB-vs-Group-/2385vs10 (external link).

On your question concerning the RAID array...read the relatively recent content (March 2019) at https://www.enterprise​storageforum.com …ge-hardware/ssd-raid.html (external link). Good article on RAID various pros and cons.




  
  LOG IN TO REPLY
urbanfreestyle
THREAD ­ STARTER
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
     
May 31, 2019 04:28 as a reply to  @ John from PA's post |  #3

Thanks for the reply. I only list using one as i only have the one m.2 slot on my motherboard.
Will have a read of that article :-)


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
Moppie
Moderator
Avatar
15,102 posts
Gallery: 24 photos
Best ofs: 1
Likes: 451
Joined Sep 2004
Location: Akarana, Aotearoa. (Kiwiland)
     
May 31, 2019 17:26 |  #4

What model is your NAS and do you have a 1Gb network at home?


flickr (external link)

Have you Calibrated your Monkey lately?

Now more than ever we need to be a community, working together and for each other, as photographers, as lovers of photography and as members of POTN.

  
  LOG IN TO REPLY
CyberDyneSystems
Admin (type T-2000)
Avatar
52,922 posts
Gallery: 193 photos
Likes: 10114
Joined Apr 2003
Location: Rhode Island USA
Post edited over 4 years ago by CyberDyneSystems. (2 edits in all)
     
May 31, 2019 18:35 |  #5

I wouldn't bother with RAID 0 for the SSD,. Personally Id be scared to have all my data on a 3 part striped drive as well,. back up or no, when a drive goes down you have to stop working. I hate that.

It makes perfect sens to populate an external with all those (or most) of the 2TB drives,. and have a cold spare on hand.

Here's what I do,.
2X256 SSD raid 1 mirror for boot/OS

2x 2TB Raid 1 for all "other" Data. (mY docs, music etc.)
2X 5tb Raid 1 for video and 3D stuff..

4X 4TB in Raid 10, (or 0+1, can't recall which is safer this evening) double speed, 8TB of storage,. for photos and other important stuff. I have a "luke warm spare" (cold but already installed and ready to go in a hot swap-able drive rack)

---------------

All of the above is active storage, on when the computer is on. In addition I have externals on site and off site for back up.


GEAR LIST
CDS' HOT LINKS
Jake Hegnauer Photography (external link)

  
  LOG IN TO REPLY
Moppie
Moderator
Avatar
15,102 posts
Gallery: 24 photos
Best ofs: 1
Likes: 451
Joined Sep 2004
Location: Akarana, Aotearoa. (Kiwiland)
     
May 31, 2019 18:41 |  #6

Most important question, how much storage do you need?
It's no good suggesting a 3TB set up if you need 5TB of storage.


flickr (external link)

Have you Calibrated your Monkey lately?

Now more than ever we need to be a community, working together and for each other, as photographers, as lovers of photography and as members of POTN.

  
  LOG IN TO REPLY
urbanfreestyle
THREAD ­ STARTER
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
     
Jun 02, 2019 08:00 |  #7

Moppie wrote in post #18870521 (external link)
What model is your NAS and do you have a 1Gb network at home?

Hi there, network is all 1gb+ and it is a Buffalo Terrastation NAS


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
urbanfreestyle
THREAD ­ STARTER
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
     
Jun 02, 2019 08:00 |  #8

CyberDyneSystems wrote in post #18870548 (external link)
I wouldn't bother with RAID 0 for the SSD,. Personally Id be scared to have all my data on a 3 part striped drive as well,. back up or no, when a drive goes down you have to stop working. I hate that.

It makes perfect sens to populate an external with all those (or most) of the 2TB drives,. and have a cold spare on hand.

Here's what I do,.
2X256 SSD raid 1 mirror for boot/OS

2x 2TB Raid 1 for all "other" Data. (mY docs, music etc.)
2X 5tb Raid 1 for video and 3D stuff..

4X 4TB in Raid 10, (or 0+1, can't recall which is safer this evening) double speed, 8TB of storage,. for photos and other important stuff. I have a "luke warm spare" (cold but already installed and ready to go in a hot swap-able drive rack)

---------------

All of the above is active storage, on when the computer is on. In addition I have externals on site and off site for back up.

Not planning on buying any more disks to be honest.


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
urbanfreestyle
THREAD ­ STARTER
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
     
Jun 02, 2019 08:01 |  #9

Moppie wrote in post #18870552 (external link)
Most important question, how much storage do you need?
It's no good suggesting a 3TB set up if you need 5TB of storage.

Currently about 1.4tb of photos and around 2.5tb of ‘other’


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
Moppie
Moderator
Avatar
15,102 posts
Gallery: 24 photos
Best ofs: 1
Likes: 451
Joined Sep 2004
Location: Akarana, Aotearoa. (Kiwiland)
     
Jun 03, 2019 00:41 |  #10

urbanfreestyle wrote in post #18871374 (external link)
Currently about 1.4tb of photos and around 2.5tb of ‘other’

Cool, that is not an unmanageable amount, but with those drives you're still going to have to make some compromises.


I would forget about doing RAID in your computer, it will use the CPU and RAM to manage it which takes up resources. If you want to do 3D work, make heavy use of LR, or run a VM then you need all the performance your CPU has.
You also won't get any advantage out of doing RAID 0 with the SSD's. Your CPU given it's age will be the bottle neck in the system, not the speed of a single SSD.

Don't assume every hard drive you have is good, or will be usable in the NAS. If it's a collection of discs you've gathered over time, and many of them have been used, then they may have errors.
You need to check each disc with a program like Crystal Disc Info, it's a SMART reader and will give you a general health report for each disc. Ideally you need to check them in the NAS, I've had discs pass Crystal Disc yet not be considered healthy enough for my Synology NAS as it's rejected them for errors.

I read some reviews on the NAS you have, it doesn't rate well, especially for usability in terms of set up and management of discs, but assuming you've set it up before, or are tech savy enough to make it work, then it makes good sense to make that the center of your storage system, with the SSD's used for OS, programs, scratch/cache and the VM and any remaining discs being used for back up.


I suggest the following:

In the computer:
M.2 SSD for operating system and programs
SATA SSD for Scratch disc and cache for LR, PS, Vegas etc
SATA SSD for VM installation
M.2 SSD in a PCI adapter card (these are $10-20) for LR catalog and previews as well as extra storage, iTunes etc.

This separates different kinds of data and programs, and as long as your LR catalog is backed up, also means if any drive fails you don't lose data. OS and programs are easy to reinstall, and loosing a cache or scratch, or VM isn't really a big deal (but the VM can be backed up anyway).
The data separation also helps with performance.

In the NAS:
4 x 2TB drives in RAID 5
RAID 5 does only allow for a single disc failure, but it gives you 6TB of total storage which is an extra 50% more than your current needs.
If you run it as RAID 6 you'll get protection from 2 discs failing, but only have 4TB of storage.
Note, if you got a 4th 3TB drive then in RAID 5 you would have 9TB of storage or 6TB in RAID 6

You'd need to make sure the LR catalog get's back up to the NAS

With the NAS connected over a 1GB LAN connection you'll have better performance for file access than a single spinning disc in the box, and if you get a managed switch and a PCI Intel LAN card with 2 inputs for the computer you could run a teamed 2gb/s connection from the NAS to the computer for even better performance.

Back Up:
2 x 3TB drives to put into external enclosures to use as off site back ups.

If you also back up the NAS with a service like Crashplan for Backblaze then have a pretty solid and reliable storage system with onsite redundancy and 2 forms of off site back up.

This would mean your CPU and RAM are free to do work load tasks, not manage a RAID.
It means all your fast storage is in the computer and tasks are separated across them, and it means the NAS which is designed to run and manage a RAID is doing just that.
It also gives you a physical back up on the 3TB discs to keep off site.


You do of course have enough discs to try different variations:
Put all 3 3TB discs in the NAS with a 2TB to make up the RAID. Then when you need more space replace the 2TB with a 3TB.
That would still let you use the 2TB discs for external back ups.

Or if you find doing video is taking up more space than you thought, but the 2TB discs in the NAS for photography, and use the extra 3TB discs in the computer for video storage only. Then you still have enough discs for a remote back up, but it's spread over more 2TB discs as well.

But, I suspect, based on my own experience not all of those discs will be actually be healthy enough to trust with your data.


And, a quick tip for getting some more performance from the CPU, since you have a really good motherboard and cooler you can sync all the cores to run at the same boost clock.
It makes a noticeable difference with out getting into overclocking and with out compromising stability.
This videos shows how from about the 2min mark: https://youtu.be/w-oAf2tVDcg?t=120 (external link)


flickr (external link)

Have you Calibrated your Monkey lately?

Now more than ever we need to be a community, working together and for each other, as photographers, as lovers of photography and as members of POTN.

  
  LOG IN TO REPLY
urbanfreestyle
THREAD ­ STARTER
I am a squirrel who loves rubbing bottles and I have Nuts in my drawers, too!
Avatar
2,060 posts
Gallery: 9 photos
Likes: 228
Joined Dec 2013
Location: Exeter, Devon
     
Jun 03, 2019 06:02 as a reply to  @ Moppie's post |  #11

Thanks for the lengthy reply :-)
I appreciate you taking the time to reply.
The 2tb drives actually came from the NAS and are all matched date / use wise but i might just run a check on each one before i put them back into the enclosure and make sure that is solid. You are right in that the configuration isn't the easiest however something i can manage :-)


Facebook (external link)
Canon 1D Mk IV | Canon 50mm 1.8 Mk1 | Sigma 'Bigma' 50-500 | Fuji XE1 | Helios 44/m | 50mm 1.4 | Manfrotto 055CX PRO3 | 3LT Mohawk ballhead | Lubitel 2 med format camera |

  
  LOG IN TO REPLY
-dave-m-
Senior Member
493 posts
Gallery: 6 photos
Likes: 49
Joined Sep 2011
Location: Edmonton, Alberta, Canada
     
Jun 03, 2019 07:54 |  #12

Having played around with RAID 0 in consumer level PC's for about 10 years I came to the conclusion that outside of a few niche situations it's not worth the hassle/risk/extended boot time for the majority of people. Unless you go full RAID with redundancy on a dedicated card it's not worth the effort.


5D MkII Gripped | 7D MkII Gripped | 200 f/2.8L | 17-40 f/4L | Σ 24-105 OS f/4 Art | Σ 50 f/1.4 Art | Σ 150-600 OS f/5-6.3 C | 430EX II

  
  LOG IN TO REPLY
John ­ from ­ PA
Cream of the Crop
11,258 posts
Likes: 1527
Joined May 2003
Location: Southeast Pennsylvania
     
Jun 06, 2019 16:53 |  #13

Is this, https://www.pcgamer.co​m …ly-fast-storage-solution/ (external link), anything worth looking into?




  
  LOG IN TO REPLY
sponsored links (only for non-logged)

1,539 views & 2 likes for this thread, 5 members have posted to it and it is followed by 2 members.
Storage config / options
FORUMS General Gear Talk Computers 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is semonsters
1509 guests, 131 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.