Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS General Gear Talk Computers 
Thread started 13 Jun 2016 (Monday) 23:02
Search threadPrev/next
sponsored links (only for non-logged)

What's bottle-necking my editing speed?

 
xarik
THREAD ­ STARTER
Goldmember
Avatar
1,787 posts
Gallery: 5 photos
Likes: 43
Joined Sep 2013
Location: Arizona
     
Jun 14, 2016 00:00 as a reply to  @ post 18038750 |  #16

Would yah look at that! Yup, it's a Type B :P. Any ideas on how to make the Esata connection work out of the back of my RAID? A PCI card or something I can buy to get things to work properly. That would greatly speed up the drives at the very least for now.

Looking at M.2 and it looks like my MOBO can handle the fastest type on the market, so I'm going to look into this just as a small project to get a bit more speed out of it for now


Bodies: Canon 5D3 - Canon 1D4
Lenses: Sigma 120-300mm F2.8 DG OS HSM SPORTS - Canon 100mm F2.8 L - Canon 70-200mm F2.8 L - - Canon 85mm F1.2 L V2 - Canon 40mm F2.8 Pancake
Extras: 2 Neewer TT520 Speedlites - Manfrotto 3021BPRO and ballhead

Check out my Flickr (external link)!

  
  LOG IN TO REPLY
mike_d
Cream of the Crop
Avatar
5,689 posts
Gallery: 8 photos
Likes: 1073
Joined Aug 2009
     
Jun 14, 2016 00:01 |  #17

CyberDyneSystems wrote in post #18038741 (external link)
Agree on the M2, the problem is he won't be putting a massive archive of RAW files on it (not likely)
Unless he can replace his approx 12TB array with an M2! :)

One option is to import to the fastest SSD available, do all the edits there, then move them to the RAID array when the set/event/project is done. I do this but substitute NAS for local RAID. They are still editable off the NAS/RAID, but things will be as snappy as possible while doing the majority of the work.




  
  LOG IN TO REPLY
110yd
Senior Member
790 posts
Likes: 35
Joined Jan 2005
     
Jun 14, 2016 00:06 as a reply to  @ mike_d's post |  #18

From the specs on the Asus Z170 A motherboard
With x4 PCI Express 3.0/2.0 bandwidth, M.2 supports up to 32Gbit/s data-transfer speeds.

The RAID configuration may very well be the root of the problem, but the SATA interface to the SSD
is no match for the PCIE x4 M.2 interface.




  
  LOG IN TO REPLY
mike_d
Cream of the Crop
Avatar
5,689 posts
Gallery: 8 photos
Likes: 1073
Joined Aug 2009
     
Jun 14, 2016 00:13 |  #19

110yd wrote in post #18038755 (external link)
From the specs on the Asus Z170 A motherboard
With x4 PCI Express 3.0/2.0 bandwidth, M.2 supports up to 32Gbit/s data-transfer speeds.

The RAID configuration may very well be the root of the problem, but the SATA interface to the SSD
is no match for the PCIE x4 M.2 interface.

Which only applies if he gets an NVMe SSD. The more common M.2 boards are no faster than his current SSD.




  
  LOG IN TO REPLY
xarik
THREAD ­ STARTER
Goldmember
Avatar
1,787 posts
Gallery: 5 photos
Likes: 43
Joined Sep 2013
Location: Arizona
     
Jun 14, 2016 00:14 as a reply to  @ mike_d's post |  #20

I'm too lazy to double check if I mentioned it, but I carried everything onto my SSD for a test run and it was still a bit laggy and behind when pixel peeping and editing. I'd rather not wait at all when adjusting sliders and such :/


Bodies: Canon 5D3 - Canon 1D4
Lenses: Sigma 120-300mm F2.8 DG OS HSM SPORTS - Canon 100mm F2.8 L - Canon 70-200mm F2.8 L - - Canon 85mm F1.2 L V2 - Canon 40mm F2.8 Pancake
Extras: 2 Neewer TT520 Speedlites - Manfrotto 3021BPRO and ballhead

Check out my Flickr (external link)!

  
  LOG IN TO REPLY
xarik
THREAD ­ STARTER
Goldmember
Avatar
1,787 posts
Gallery: 5 photos
Likes: 43
Joined Sep 2013
Location: Arizona
     
Jun 14, 2016 00:28 |  #21

The M.2 drives in my price range are no faster than the SSD I already have, simply smaller and more convenient but not really worth it. I'm not looking to spend $400 on a larger PCIe SSD that's blazing fast, I could put that money towards a lens or towards a 4tb internal and such.


Bodies: Canon 5D3 - Canon 1D4
Lenses: Sigma 120-300mm F2.8 DG OS HSM SPORTS - Canon 100mm F2.8 L - Canon 70-200mm F2.8 L - - Canon 85mm F1.2 L V2 - Canon 40mm F2.8 Pancake
Extras: 2 Neewer TT520 Speedlites - Manfrotto 3021BPRO and ballhead

Check out my Flickr (external link)!

  
  LOG IN TO REPLY
mike_d
Cream of the Crop
Avatar
5,689 posts
Gallery: 8 photos
Likes: 1073
Joined Aug 2009
     
Jun 14, 2016 00:32 |  #22

xarik wrote in post #18038766 (external link)
The M.2 drives in my price range are no faster than the SSD I already have, simply smaller and more convenient but not really worth it. I'm not looking to spend $400 on a larger PCIe SSD that's blazing fast, I could put that money towards a lens or towards a 4tb internal and such.

True. The good news is that SSDs are constantly dropping in price. Just keep as much of your "hot" data as possible on the SSD you have.




  
  LOG IN TO REPLY
kenwood33
Goldmember
2,616 posts
Likes: 26
Joined Jul 2005
     
Jun 14, 2016 07:03 |  #23

Before going out and buying new hardware, I suggest doing a google on what you can do from the software side.

Think about companies that you can outsource editing to. All you provide is your lightroom catalog. And how big is the catalog? Not big at all. You should be able to edit using just he catalog (without the RAW files behind the scene). This should significantly speed up any zoom in/preview/apply edit operations.


Gearlist

  
  LOG IN TO REPLY
ryanforster
Hatchling
Avatar
7 posts
Joined Jun 2016
Location: Sydney, Australia
     
Jun 14, 2016 07:19 |  #24

One way to speed it up is to use smart previews. Have the lightroom catalog on your computer harddrive, keep the raw files on an external drive. When importing photos, render smart previews and select 1:1. Then disconnect external drive and you can edit away at lightning speed. All changes will be applied to the raw files when you reconnect the drive.

Drawback is you cannot stitch panoramas or select "edit in photoshop" with the smart previews


Ryan Forster (external link)
Sony user.. haters gonna hate.

  
  LOG IN TO REPLY
Bleufire
Goldmember
Avatar
1,203 posts
Likes: 53
Joined Mar 2008
Location: California
Post edited over 7 years ago by Bleufire.
     
Jun 14, 2016 08:24 |  #25

mike_d wrote in post #18038751 (external link)
Sadly, this is all too true. It seem like no matter how much horsepower you throw at it, the UI remains laggy. LR6 will use the GPU (or is that nVidia only?) to accelerate certain functions.


I am no speed animal but I really want to know how much difference a GPU (Green or Red) will make on LR/PS applications AND what different tiers have with greater impact (970 vs 980 vs 980 Ti vs 1080 vs 1070)


5D*Sigma 50/1.4*EF 17-40/4
New to Photography? ----> ENJOY! Canon DSLR! (external link)

  
  LOG IN TO REPLY
EverydayGetaway
Cream of the Crop
Avatar
11,007 posts
Gallery: 11 photos
Likes: 5395
Joined Oct 2012
Location: GA Mountains
     
Jun 15, 2016 11:29 |  #26

Turn off GPU acceleration if you haven't yet. I've had 2 AMD cards (including an r9 280) and neither worked right with that feature.

Beyond that, idk, I think your issue is definitely software related though.


Fuji X-T3 // Fuji X-Pro2 (Full Spectrum) // Fuji X-H1 // Fuji X-T1
flickr (external link) // Instagram (external link)www.LucasGPhoto.com (external link)

  
  LOG IN TO REPLY
Larry ­ Johnson
Goldmember
Avatar
1,397 posts
Gallery: 1 photo
Likes: 487
Joined Sep 2011
Location: Virginia
     
Jun 15, 2016 15:54 |  #27

You might find some useful info here: https://www.youtube.co​m …tKAmJ_9c&featur​e=youtu.be (external link)

I'm using a 2008 macbook pro. To help move things along, I do minimal edits the first go-round when selecting keepers. Using the Sync command to make global edits, etc. After keepers have been selected, I make Smart Previews which are much smaller files. Then move the original file to an external drive to keep my hard drive as empty as possible. Final edits are done with Smart Previews which appear to be much faster than with the original file. Originals are automatically updated when external drive is connected.


_______________
Ain't Nature Grand!
Shooting 7D2 with Canon 400mm, f/5.6.
60D, canon 18-135 EFS, and 1.4 extender in the bag.
flickr (external link)

  
  LOG IN TO REPLY
BigAl007
Cream of the Crop
Avatar
8,118 posts
Gallery: 556 photos
Best ofs: 1
Likes: 1681
Joined Dec 2010
Location: Repps cum Bastwick, Gt Yarmouth, Norfolk, UK.
     
Jun 17, 2016 12:43 |  #28

Simply moving the catalogue/previews from the RAID to an internal (preferably SSD) should give you a significant speed boost. With LR it writes to the catalogue file every time you move a slider. Once you have imported your images, and LR has created your previews, LR only accesses the RAW files when you need to export the image. So having the image files themselves on the RAID system should not slow you down. So you really only need to move the .lrcat file, although I would also move the associated folder structure with all the previews as well. If you don't LR will happily rebuild the previews, but either you will have to tell LR to do the whole lot, and it could take a while, or take the hit and let LR build them as you go.

Alan


alanevans.co.uk (external link)

  
  LOG IN TO REPLY
John_T
Goldmember
Avatar
3,098 posts
Gallery: 127 photos
Best ofs: 2
Likes: 449
Joined Jun 2003
Location: Switzerland
     
Jun 18, 2016 18:42 |  #29

I agree with Jake. There are a number of things a good machine will speed up in LR, but LR doesn't appear to be coded to take advantage of it all, such as cores and threads. Processor speed and up to four cores will help some editing functioins, though some not at all. My rebuilt system is pretty snappy at everything, however some LR editing functions haven't sped up in the slightest. My 51 MPx RAW files are handled zippity-zip, but most editing functions are no quicker than any other file, that is ...Loading... in circles.

Tweaking your BIOS, such as enabling memory XMP, making sure your M.2 drive is running at gen3, etc. makes a difference generally and enhances your overall use of your machine, however it's going to be Adobe getting down to writing fast code that takes advantage of all aspects of our hardware that is going to heal our wounds.

My recent build:

- Intel i7 6700K CPU @ 4Ghz
- Noctua NH-U12S HSF
- 64GB Corsair Vengeance 3000 RAM
- Samsung 950 M.2 NVME 512GB boot drive
- Gigabyte Z170X 7 EU MB
- Nvidia Quatro K2200 GPU
- Samsung 850 Pro SSD 512GB
- Samsung 850 Pro SSD 2TB
- Samsung 850 Pro SSD 1TB
- Antec 850W PSU
- SilverStone TJ07 case
- 8TB Synology NAS


Canon : EOS R : 5DIV : 5DS R : 5DIII : 7DII : 40 2.8 : 50 1.4 : 35L : 85L : 100L IS Macro : 135L : 16-35L II : RF-24-105L IS : 70-200L II : 100-400L IS II : 1.4x & 2x TC III : 600EX-RT : 580EX : 430EX : G1XII : Markins Q10 & Q3T : Jobu Gimbal : Manfrotto Underware : etc...

  
  LOG IN TO REPLY
Submariner
Goldmember
Avatar
3,028 posts
Likes: 47
Joined May 2012
Location: London
Post edited over 7 years ago by Submariner. (2 edits in all)
     
Jun 18, 2016 20:59 |  #30

110yd wrote in post #18038717 (external link)
I believe the Asus Z170A has a M.2 port. Use that instead of the SSD that you are using and
you will see a speed bump.

Regards,

110yd

Some M.2 sockets are not the fast ones, not sure what it is technically that makes the difference ( sorry not technical enough maybe it goes via a SATA Bus rather than PCIe ??) but it really matters , so do your research well before buying.
If yours is the slow type you can buy an ASUS PCIe card to M.2 Adapter I hear thats the only one that delivers full speed. i have one , well built and works with Windows 10 perfectly.

The M.2 you want is the Samsung 950 Pro M.2 NVMe. 512 GB.

I do all my edits for the 2 latests shoots on the Intel 750 PCIe NVMe, and then back them off to a pair of Samsung 850 500GB, no fancy raid , just copies until I achivr them to 2 HGST 4TBs.
There is a cery significant difference editing with Photoshop elements 13, on the Intel 750 ( rough equivalent of the proposed 950 Pro M.2 ) as opposed to editing on the 850s.
Nb buy a fan to cool the M.2 socket or it will hit 100C in 6 seconds! Right by the connection to the MB!

I also run my OS , PSE13, Portraiture, and the NIK pluggins, DPP4, and Office 365 off the 400 GB Intel, plus the latest 2 shoots circa 120GB max. 400GB is the min size for this leaving some free space on the OS drive.


Canon EOS 5DS R, Canon EF 70-200 F2.8 L Mk II IS USM, Canon EF 70-300 F4-5.6 L IS USM, EF 40mm F2.8 STM , RC6 Remote. Canon STE-3 Radio Flash Controller, Canon 600 EX RT x4 , YN 560 MkII x2 ; Bowens GM500PRO x4 , Bowens Remote Control. Bowens Pulsar TX, RX Radio Transmitter and Reciever Cards. Bowens Constant 530 Streamlights 600w x 4 Sold EOS 5D Mk III, 7D, EF 50mm F1.8, 430 EX Mk II, Bowens GM500Rs x4

  
  LOG IN TO REPLY
sponsored links (only for non-logged)

7,245 views & 2 likes for this thread, 12 members have posted to it and it is followed by 7 members.
What's bottle-necking my editing speed?
FORUMS General Gear Talk Computers 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is zachary24
1391 guests, 114 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.