Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS General Gear Talk Data Storage, Memory Cards & Backup 
Thread started 22 Dec 2018 (Saturday) 18:44
Search threadPrev/next
sponsored links (only for non-logged)

How do you store your photos & separate processed / viewable from unprocessed

 
Amamba
Goldmember
Avatar
3,685 posts
Gallery: 8 photos
Likes: 65
Joined Nov 2007
Location: SE MI
     
Dec 22, 2018 18:44 |  #1

So, for years, I have been using my harddrive(s) as the main dump for all photos and videos, and Flickr as my gallery to browse with. I organize photos in folders by year / month (2018/ 01, 02, etc) and use the same album names in Flickr. On Flickr, I only keep the photos that I consider good enough to display / browse (i.e. my albums),while on computer, I may have multiple versions of the same photo, raw originals, photos that are not processed and don't look too great but I don't want to delete them, etc. The biggest advantage of having my albums on Flickr was the ability to browse through them from anywhere and share albums with my family members.

Now with Flickr terms changing, I am going to do something different. I am really turned off by them deleting photos that users had uploaded over the years. Grandfathering existing photos while requiring a subscription to upload additional files would hardly cost them anything, and would show lots of goodwill towards users. I don't mind paying $50 a year to support a service I use and respect, but with this kind of cutthroat attitude, there's many other ways I can spend that money, store my photos, and get better overall value.

So, the question... how do you (other amateur photogs) store, access, and browse through *your* photos, and separate processed / ready to view ones from the rest ? I am looking for a simple process with least amount of upkeep required.


Ex-Canon shooter. Now Sony Nex.
Life Lessons: KISS. RTFM. Don't sweat the small stuff.
My Gear List (external link)

  
  LOG IN TO REPLY
MichSt
Goldmember
Avatar
1,127 posts
Gallery: 135 photos
Likes: 423
Joined Oct 2006
Location: Lansing, MI
     
Dec 22, 2018 19:49 |  #2

I've been using a combo of lightroom and smugmug since 2008 or so. Lightroom is excellent tool for organization and editing. I flag and tag my photos for quickly sorting out the keepers. I also have it linked to my smugmug account so I can create galleries and folders and upload photos straight from lightroom. From smugmug I can share the files with my family and post images here and other platforms. It's pretty simple and easy for me.


Mario.Q

Canon EOS R

  
  LOG IN TO REPLY
Bcaps
I was a little buzzed when I took this
Avatar
1,019 posts
Gallery: 90 photos
Best ofs: 16
Likes: 2605
Joined Jun 2003
Location: Bay Area, CA
Post edited over 4 years ago by Bcaps.
     
Dec 28, 2018 13:57 |  #3

I use Lightroom, it is built for this purpose.

Inside of LR I use "collections" to organize my images into logical groups. For example for my Patagonia trip I created a top level "Patagonia" collection set and then inside of that I have separate collection sets, one for each image I will process.

IMAGE: https://photography-on-the.net/forum/images/hostedphotos_lq/2018/12/4/LQ_952529.jpg
Image hosted by forum (952529) © Bcaps [SHARE LINK]
THIS IS A LOW QUALITY PREVIEW. Please log in to see the good quality stuff.

For example, for my photo "Call of the Horns" I then use collections and collection sets to further organize the photos as they go through my workflow process.


IMAGE: https://photography-on-the.net/forum/images/hostedphotos_lq/2018/12/4/LQ_952528.jpg
Image hosted by forum (952528) © Bcaps [SHARE LINK]
THIS IS A LOW QUALITY PREVIEW. Please log in to see the good quality stuff.

For that particular location I took eight shots. Those eight RAW shots are in the collection 1. Call of the Horns All. I then go through those and choose which ones I will blend (if needed) when I process the shot. In this case I didn't need to blend separate shots and I only used one raw which is located in 2. To Blend. As I process the shot in Photoshop I save the Tiff in LR and add it to the 3. Working collection. In this case I have five different TIFFS as I was trying out different looks for the shot. I usually only have one or two files in the "Working" collection, but for some shots I really go in a different direction on some edits and I like to be able to revisit those various edits down the road. Finally, when the image is "done", I save that as my "Master" file and add it to the 4. Master collection.

The master file is finished but not output sharpened. I then create a 1600 pixel TIFF sharpened for the web and add that to the Web/ 1. Layered TIFF collection set. I used to save both a layered TIFF and then also a flattened version, although I usually don't save the flattened version as it's redundant. From that TIFF I generate a jpg and save that file and add it to the 3. Flattened JPG collection.

If I ever print the image, from the master image I create a file that is resized and sharpened for that particular print size, saving both the layered and flattened files and add them to the Print collection set.

It all sounds like a lot of work but in practice it isn't. The integration between PS and LR makes this super easy. When you save an image in PS it automatically is added back to LR and then you just drag that image to the collection(s) you want it in. I generate the whole collection set tree using a plugin called "Collection Agent". I created a template Collection set as shown in the above and then for each shot I want to process I just create a copy of the template and it's all setup and ready to go. I can easily find any image at any stage of my workflow in seconds. It all works for me :)

- Dave | flickr (external link)
Nikon D810
14-24mm f/2.8 | 16-35mm F/4 | 24-70mm f/2.8 | 70-200mm f/4 | Sigma 150-600mm

  
  LOG IN TO REPLY
kf095
Out buying Wheaties
Avatar
7,484 posts
Gallery: 64 photos
Likes: 1087
Joined Dec 2009
Location: Canada, Ontario, Milton
     
Dec 28, 2018 14:38 |  #4

My photography done in a way to minimize PP.
I only use LR and if for some reason I want original - virtual copy - revert to original.

I do film and digital 50/50.
I have negatives as originals :)
I wish I could make copies of my lith prints...
But I rather send them to private collections.
Some of my prints went as far as Australia.
Some of them are on paper which is not available anymore.


M-E and ME blog (external link). Flickr (external link). my DigitaL and AnaLog Gear.

  
  LOG IN TO REPLY
ChrisHeathcote
Member
Avatar
190 posts
Gallery: 15 photos
Likes: 260
Joined Oct 2013
Location: Derbyshire
     
Dec 29, 2018 16:34 |  #5

I use a combination of Lightroom and Apple Photos. All of my images are stored in LR with finished images put into Collections, these are then exported into Photos, this way I have multiple copies around the place. My hard-drive is backed up with Backblaze and on a separate hard-drive. Finished images are also in Photos and therefore backed up in iCloud. This gives me 1 physical and 2 off-site cloud back ups of finished images and 1 physical and 1 off-site back-up of the raw images.




  
  LOG IN TO REPLY
Dan ­ Marchant
Do people actually believe in the Title Fairy?
Avatar
5,635 posts
Gallery: 19 photos
Likes: 2058
Joined Oct 2011
Location: Where I'm from is unimportant, it's where I'm going that counts.
     
Dec 30, 2018 22:28 |  #6

Lightroom.

I was using Flickr as well and Lightroom has publish collections which allow you to automatically publish image to Flickr. However I was mostly using it to share images to forums and won't be continuing. Instead I now post to my own webserver and link from there.

I also share via Instagram.


Dan Marchant
Website/blog: danmarchant.com (external link)
Instagram: @dan_marchant (external link)
Gear Canon 5DIII + Fuji X-T2 + lenses + a plastic widget I found in the camera box.

  
  LOG IN TO REPLY
Moonshiner
Senior Member
Avatar
795 posts
Likes: 1131
Joined Jul 2013
Location: Mil-yucky, Whiskonsin
     
Jan 01, 2019 22:37 |  #7

I too use Lightroom.. I use Jeffrey Friedl's “Export to Flickr” Plugin as it is more feature rich then the built in feature. I don't use collections that much yet. I am using them to sift through my images that I have published to Flickr. I have 65K+ images in Lightroom and 11.5K on Flickr. I originally started by publishing the Uploadr tool. The aforementioned plugin allows you to link images in your catalog to what's on Flickr automatically (by name and time stamp) or manually by setting the URL. I use starring to determine which photos I will process (4), publish (5), pictures I have processed but chosen to not publish (3). Anything less could be culled when space becomes an issue. Since I have re-upped by pro subscription, I will continue to use these...




  
  LOG IN TO REPLY
raksphoto
Senior Member
527 posts
Gallery: 21 photos
Likes: 111
Joined Jun 2010
Location: California
Post edited over 4 years ago by raksphoto. (7 edits in all)
     
Jan 03, 2019 07:06 |  #8

For archival storage and instant project access, I use Darktable under Linux, presently with redundant high-capacity (8TB) external drives. Some specific or special shoots or projects may be further exported from here into Cloud storage. Otherwise for a creative editing project, Darktable is used to select and copy data in various ways (select raws, or other fotos intended for edit); or, just one of the 8TB archival drives is used with a my editing machine (described next) to obtain a whole shoot, or select fotos, depending in the project. Projects are imported by Darktable by type, then by date, along with supplememtary keywords, and sometimes EXIF adjusts -- like fixing having forgotten to update the camera's clock when first in Europe, etc. In this manner, I've finally been able to facilitate centralized access for work across 15 years of time, for some 450+ foto shoots. Think of this as the darkroom, and the main negatives storage cabinet.

Then for creative editing, per the above, data is moved to a literal light table: my Google Pixelbook, which is a combined tablet and laptop computer. Touching the image literally for me is much more like working with film. For this processing, I often use the Linux container on ChromeOS as a secondary and transient negatives storage area, where I'll run Raw Therapee to perform detailed camera raw edits and conversions. Then specific creative edit work is done on ChromeOS with Polarr and Snapseed, plus some glamour-specific utilities. Creative product results from here go where they go, online posting, upload to cloud for magazines or print, now and then actual print-making. Then the finished art is often archived back to the "main negatve storage cabinet," but more often Cloud storage, which becomes the "Product Warehouse" storage facility. Finished work is grouped into folders by project and date.

Today, no software from Apple or Adobe ever touches my art work, none whatsoever. All original foto data and project data is ultimately used only transiently, never stored on the edit machine archivially, in case it fails. A broken edit machine is annoying for sure, but replaceable. Lost data is not. The "main negatve storage" is operated under a Triple Modular Redundancy (TMR) policy, to which I'm adding additonal geographically dispersed storage voiumes. I do not believe in RAID for local physical storage, but I do believe in blob storage in the Cloud, which is exponentially more reliable than RAID. Drives are operated only when they are needed, preserving mechanical and magnetic storage life to 《 20000 hours operating time, in order to stay ahead of the MTBF curve. I have found that digital data is nomadic, it must move from time to time, or it will fade away with the sands of time. Approximately every 36 months main storage is upgraded to the next doubling of storage capacity that costs about US $130. This is generallly the knee in the price/capacity curve, and read/write bit rate always improves with new technology. As new work gets added to the collection, improved technology enables keeping full data copy times down to 12-16 hours per volume. I am definitely managing millions of my own fotos, mostly of belly dancers, but enough other work that I accidently discovered that I am also my own stock foto agency. I'm considering adding machine learning adjunct to Darktable, to make finding specific things faster. Otherwise, in terms of the "Product Warehouse," Cloud storage is as reliable as Civilization is. Which does feel a bit more risky these days, and it does take money and faith.


2x 7D Mark II | 70D | 5DSr
EF-S 10-18mm f/3.5-5.6 IS STM | EF-S 17-55mm f/2.8 IS USM |
EF-S 70-300mm f/4-5.6 IS II USM | EF 70-200mm f/4L |
EF 135mm f/2L | EF 100mm f/2 | EF 85mm f/1.8 | EF 50mm f/1.2L | EF 35mm f/1.4L EF 100mm f/2.8L IS USM MACRO

  
  LOG IN TO REPLY
Tom ­ Reichner
"That's what I do."
Avatar
17,636 posts
Gallery: 213 photos
Best ofs: 2
Likes: 8386
Joined Dec 2008
Location: from Pennsylvania, USA, now in Washington state, USA, road trip back and forth a lot
     
Jan 03, 2019 08:31 |  #9

Amamba wrote in post #18776259 (external link)
So, the question... how do you store, access, and browse through your photos, and separate processed / ready to view ones from the rest ?

I am looking for a simple process with least amount of upkeep required.

My 'process' would undoubtedly meet your requirement with respect to simplicity.

I dump all of my RAW files into 'Photos', which is the program that comes already loaded onto every Apple computer (it replaced iPhoro).

The good photos that I want to share / view / edit / share are made into 'favorites' by simply clicking on the little heart-shaped thingy at the bottom of the picture. You can click on 'favorites' any time you want to, and then only the favorites will come up.

Photos is a combination RAW converter, editing tool, photo manager, and slideshow generator, so you just stay in Photos all the time and there's no need to ever jump from one program to another.

All edits are nondestructive so a copy of the RAW image is always there for you automatically. There's no need to make copies of unedited versions because you can just go back to the original file at any time.

I would never use anything internet-based as a way of storing or managing my images. I want full control of my images and their management and storage - why surrender any control to a company like Flickr or Smugmug or PhotoShelter? To me it would be preposterous to count on any third party to store my images.

I back up the contents of my 'favorites' to a couple of removable hard drives a few times each year, so that my best photos will be backed up in the unlikely event that something horrible happens to my computer. I have no need or desire to back up all of my photos - I only care about the good ones that I've made into'favorites'.

.


"Your" and "you're" are different words with completely different meanings - please use the correct one.
"They're", "their", and "there" are different words with completely different meanings - please use the correct one.
"Fare" and "fair" are different words with completely different meanings - please use the correct one. The proper expression is "moot point", NOT "mute point".

  
  LOG IN TO REPLY
jurgensdigitalmedia
Member
Avatar
44 posts
Gallery: 3 photos
Likes: 17
Joined Oct 2012
Location: South Dakota
     
Jan 08, 2019 22:17 |  #10

Bought myself a 6-bay Q-Nap NAS with 6TB HDDs (in RAID5 setup). Best purchase ive made in years! Have 27TB of usable storage now for photos and a bunch of other IT work I do. Can FTP and a bunch of other things. Added a couple of 8TB drive i already had as a redundant backup for files.


Past that I keep my file structure pretty simple. General sport, team, or client name -- year-- then the specific event. Probably not the greatest but it's worked for me the last few years.




  
  LOG IN TO REPLY
tim
Light Bringer
Avatar
51,010 posts
Likes: 375
Joined Nov 2004
Location: Wellington, New Zealand
     
Jan 09, 2019 18:36 |  #11

I have one folder for RAW images, another for processed images to share.


Professional wedding photographer, solution architect and general technical guy with multiple Amazon Web Services certifications.
Read all my FAQs (wedding, printing, lighting, books, etc)

  
  LOG IN TO REPLY
Ltdave
it looks like im post #19,016
Avatar
5,709 posts
Gallery: 24 photos
Likes: 8590
Joined Apr 2012
Location: the farthest point east in michigan
     
Jan 10, 2019 03:44 |  #12

i have a similar set up to Juergen and Tim...

really quite simple.

if its a one off sort of thing, i make a folder on the laptop named "2018 work party" or whatever...
dump all my RAW files into it.
process with LR.
export the keepers into a sub-folder with in "2018 work party" named "edits"

if i have a recurring event, say my daughters band shows/concerts, theres a folder on the laptop named "2018-2019 PHN Band"
inside that file is a sub-folder named "Memorial Day Parade" or "July 4 Parade" or whatever the event is.
all of the RAW files go into it.
process with LR.
export the keepers into another sub-folder (in the same event folder) named "edits"

after a couple of weeks of playing around i copy all of this new(er) work to a 2TB portable hard drive...

it is my intention to get another portable hard drive or 3, to have a back up copy to the back up copy. i dont do anything that is earth shattering or needs much more than family picture type archival storage so i dont use the cloud or any sort of off-site storage even though ive been told that just having multiple copies on separate drives does NOT constitute backing up files...


-im just trying. sometimes i succeed

  
  LOG IN TO REPLY
el_duderino04
Member
40 posts
Likes: 3
Joined Nov 2018
Location: Pasadena, CA
     
Jan 25, 2019 15:21 |  #13

MichSt wrote in post #18776295 (external link)
I've been using a combo of lightroom and smugmug since 2008 or so. Lightroom is excellent tool for organization and editing. I flag and tag my photos for quickly sorting out the keepers. I also have it linked to my smugmug account so I can create galleries and folders and upload photos straight from lightroom. From smugmug I can share the files with my family and post images here and other platforms. It's pretty simple and easy for me.

Personally, I like the fact that Flickr functioned both to back up my photos as well as easily share them (or just certain albums) with others. It seems to me that Flickr is still one of the better choices in this regard if you want full resolution photos. How does smugmug compare in your experience?




  
  LOG IN TO REPLY
el_duderino04
Member
40 posts
Likes: 3
Joined Nov 2018
Location: Pasadena, CA
     
Jan 25, 2019 15:43 |  #14

el_duderino04 wrote in post #18798399 (external link)
Personally, I like the fact that Flickr functioned both to back up my photos as well as easily share them (or just certain albums) with others. It seems to me that Flickr is still one of the better choices in this regard if you want full resolution photos. How does smugmug compare in your experience?

To answer my own question, it looks like one big difference for me is with Smugmug, you have to go to the $70/yr option to share photos with only certain people. It seems the $50/yr option that's comparable to Flickr either lets you share everything with the world, or not share at all. This is just based on a quick reading of the plan comparison on Smugmug's website, so I certainly may be mistaken.




  
  LOG IN TO REPLY
MichSt
Goldmember
Avatar
1,127 posts
Gallery: 135 photos
Likes: 423
Joined Oct 2006
Location: Lansing, MI
     
Jan 25, 2019 16:22 as a reply to  @ el_duderino04's post |  #15

I think you got it right on. I switched over to Smugmug about 10 years ago. Back then Flickr has some limited abilities to customize your site, organization, etc. Smugmug was far ahead in that area. Not sure where Flickr stands now. Also, I think back then on Flickr you could share all your photos or hide all your photos with no in between. On Smugmug I'm able to hide my site from searches. Which controlled access to just friends and family I gave the address out to and kept my stuff out of web search engines. Again, not sure where Flickr stands now with their options.


Mario.Q

Canon EOS R

  
  LOG IN TO REPLY
sponsored links (only for non-logged)

4,542 views & 5 likes for this thread, 16 members have posted to it and it is followed by 11 members.
How do you store your photos & separate processed / viewable from unprocessed
FORUMS General Gear Talk Data Storage, Memory Cards & Backup 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member is semonsters
1048 guests, 104 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.