Approve the Cookies
This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and our Privacy Policy.
OK
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Guest
Forums  •   • New posts  •   • RTAT  •   • 'Best of'  •   • Gallery  •   • Gear
Register to forums    Log in

 
FORUMS Post Processing, Marketing & Presenting Photos The Business of Photography 
Thread started 03 Jan 2011 (Monday) 06:52
Search threadPrev/next
sponsored links (only for non-logged)

Organising and storing 200000 photographs.

 
paulmarkj
Hatchling
1 post
Joined Jan 2011
     
Jan 03, 2011 06:52 |  #1

My organisation has 200,000 photographs and adds 20,000+ each year. The photographs are taken by staff who are not photographers and the staff place the into folders, eg:

W:\2010\area 1\subject 1\
W:\2010\area 1\subject 2\
W:\2010\area 1\subject 3\ etc.

Though a few staff rename their photos to give more information, most do not, so finding photos that are a few years old is difficult unless we know the area and subject. Eg: have we got a photograph of John Smith from 2005? Only if we know the supporting information.

What I am looking for is a photograph database where we can tag and organise our photos. An online solution might be difficult for security reasons.

Can anyone suggest a suitable solution




  
  LOG IN TO REPLY
Gatorboy
Goldmember
Avatar
2,483 posts
Likes: 2
Joined May 2005
Location: Bel Air, MD
     
Jan 03, 2011 07:32 |  #2

Lightroom


Dave Hoffmann

  
  LOG IN TO REPLY
griptape
Goldmember
2,037 posts
Joined Feb 2007
Location: Home
     
Jan 03, 2011 09:10 |  #3

Gatorboy wrote in post #11563188 (external link)
Lightroom

Ditto.




  
  LOG IN TO REPLY
ndelacova
Member
95 posts
Joined Feb 2006
     
Jan 03, 2011 09:46 |  #4

Ditto II




  
  LOG IN TO REPLY
thecackster
Senior Member
Avatar
915 posts
Gallery: 1 photo
Likes: 96
Joined Aug 2007
Location: Seattle, WA
     
Jan 03, 2011 10:08 |  #5

I use Lightroom with tons of collections and sets and keywords. I also use a very intense set of folders on top of it all.




  
  LOG IN TO REPLY
sspellman
Goldmember
Avatar
1,731 posts
Likes: 30
Joined Dec 2006
Location: Detroit, Michigan
     
Jan 03, 2011 10:57 |  #6

Lightroom is a good tool for a single user on one computer. If your organization needs to have media at multiple locations or accesible by multiple users you will need a more advanced Digital Asset Management system like Canto, Extensis, or ImageFolio.

Reguardless, its essential to create policies for standardized file names and ITPC keywords when the images are stored. These are the key to minimizing the herculean task of managing 200000 pics from different sources.

-Scott


ScottSpellmanMedia.com [photography]

  
  LOG IN TO REPLY
TheBrick3
Goldmember
Avatar
2,094 posts
Joined Nov 2009
Location: College Park, Md.
     
Jan 03, 2011 21:56 as a reply to  @ sspellman's post |  #7

We use picasa. It's not the best, but it's simple/open source/works and is used by multiple people.


1D III 5D II 5D | 580 EX II x 2
17-40L | 35L | 100L | 70-200 II | 17-35 f/2.8-f/4
Website (external link)

  
  LOG IN TO REPLY
PixelMagic
Cream of the Crop
5,546 posts
Likes: 6
Joined Nov 2007
Location: Racine, WI
     
Jan 03, 2011 22:18 |  #8

Even though I've been a Lightroom user since its first beta in 2006, I wouldn't suggest it unless you also intend to use it for image editing which from your brief description does not appear to be the case.

Instead take a look at an application like IDimager Pro or IDimager Pro for SQL Server. Lightroom is a single user application while IDimager is much more scaleable, scriptable, and also allows multiple concurrent users accessing its database(s) simultaneously. See here: http://www.idimager.co​m/ (external link)

I'd also suggest you ask over at a forum like The DAM Forum where they have much more knowledge about Digital Asset Management and wouldn't just suggest an application because of its popularity: http://thedambook.com/​smf/index.php (external link)


Gear List

  
  LOG IN TO REPLY
enlightphoto
Junior Member
Avatar
28 posts
Joined Dec 2010
Location: SF Bay Area, CA
     
Jan 04, 2011 01:49 |  #9

Take it from someone who managed an image library of 400,000 transparencies without any kind of database, other than my own gray matter. (Read: Job security) The first lesson I learned when working with a database; the information and search results you will get out will depend totally on the quality of the information going in. Think first about what you want to get out; that will guide you on what to put in. Regardless of the database, keywords and other metadata will be of paramount importance. Good Luck.


Gary Crabbe
Enlightened Images (external link)
PORTFOLIO (external link) / Weblog (external link)
Facebook (external link) / Twitter (external link)

  
  LOG IN TO REPLY
Headspin
Member
85 posts
Joined Dec 2006
Location: Rochdale
     
Jan 04, 2011 02:51 |  #10

Extensis Portfolio works well and the server option allows for multiple users (can be pricey though)

http://www.extensis.co​m …lioserver9-5/features.jsp (external link)


www.nicecatmedia.com (external link)

  
  LOG IN TO REPLY
amfoto1
Cream of the Crop
10,331 posts
Likes: 146
Joined Aug 2007
Location: San Jose, California
     
Jan 04, 2011 12:15 |  #11

Yes, I agree, Lightroom is good.

Unless you have a pretty powerful computer you might want to organize into yearly archives, creating a different catalog for each year. The only problem with this is that you will have to know the year, to find the picture, or may need to open and search several catalogs, to find what you are looking for.

The reason for this, is that LR slows down a lot when you have a lot of images in a catalog. I've been updating my 2008 catalog just recently with LR3 and it's been struggling with 100,000 images from that year (probably half are duplicates such as thumbnails or finished prints from images, I didn't shoot 100K, probably more like 45-50K).

In Lightroom you can do all sorts of things pretty easily. It allows for batch processing, too.... for example you could highlight a number of images and add the same tag to all of them, or rate/sort them with one to five stars, and/or color code them.

You can view them by date & time taken, or sorted in a wide variety of other ways.

You can view the entire year as one giant catalog, or look at just particular folders within the catalog, mirroring your folder structure in your computer.

There are lots of possibilities and some good books that are a big help learning to use Lightroom. There are several modules in addition the cataloging Library, which you may or may not find useful: Develop (non-destructive image adjustments), Slideshow, Print and Web. I use Develop all the time, and Print and Slideshow frequently.


Alan Myers (external link) "Walk softly and carry a big lens."
5DII, 7DII, 7D, M5 & others. 10-22mm, Meike 12/2.8,Tokina 12-24/4, 20/2.8, EF-M 22/2, TS 24/3.5L, 24-70/2.8L, 28/1.8, 28-135 IS (x2), TS 45/2.8, 50/1.4, Sigma 56/1.4, Tamron 60/2.0, 70-200/4L IS, 70-200/2.8 IS, 85/1.8, Tamron 90/2.5, 100/2.8 USM, 100-400L II, 135/2L, 180/3.5L, 300/4L IS, 300/2.8L IS, 500/4L IS, EF 1.4X II, EF 2X II. Flashes, strobes & various access. - FLICKR (external link)

  
  LOG IN TO REPLY
thecackster
Senior Member
Avatar
915 posts
Gallery: 1 photo
Likes: 96
Joined Aug 2007
Location: Seattle, WA
     
Jan 04, 2011 15:53 |  #12

amfoto1 wrote in post #11571770 (external link)
Yes, I agree, Lightroom is good.

Unless you have a pretty powerful computer you might want to organize into yearly archives, creating a different catalog for each year. The only problem with this is that you will have to know the year, to find the picture, or may need to open and search several catalogs, to find what you are looking for.

Great idea, I actually am doing that starting in 2011.




  
  LOG IN TO REPLY
MJPhotos24
Cream of the Crop
Avatar
5,619 posts
Likes: 4
Joined Nov 2005
Location: Attica, NY / Parrish, FL
     
Jan 04, 2011 16:28 |  #13

I just re-did mine a couple years ago for the external drives...

Main categories like...

Editorial
Youth & High School
Travel

Then sub-categories...

Editorial
Baselball 2009
- MLB - NY Mets 2009
- Wright, David (organized by player)
- Glavine, Tom
- MiLB - Batavia Muckdogs 2009
Football 2009
- Bills vs Browns 11.19.09 (organized by game)
- Steelers vs Bears 11.26.09
- etc.

It's at least 4-5 levels deep for most and can find images in seconds flat though. ALSO, have been tagging images ever since re-organizing so everything is tagged with info if there needs to be a search. Most of the keepers from 2003-present is online with PhotoShetler and searchable though have a few years to go and get up there.


Freelance Photographer & Co-founder of Four Seam Images
Mike Janes Photography (external link) - Four Seam Images LLC (external link)
FSI is a baseball oriented photo agency and official licensee of MiLB/MLB.
@FourSeamImages (instagram/twitter)
@MikeJanesPhotography (instagram)
@MikeJanesPhotog (twitter)

  
  LOG IN TO REPLY
sfaust
Goldmember
Avatar
2,306 posts
Likes: 10
Joined Nov 2006
     
Jan 04, 2011 20:52 |  #14

All the information you need is in the (DAM) Digital Asset Management book. Cataloging, software, backup methodology, storage solutions, metadata, hardware, derivative management, file migration, software compatibility and data sharing, etc. Its a very deep subject, and the more you images you have, the more questions that will crop up.

There is nothing worse than finding yourself in a mess later because the storage and cataloging were thrown together without a clear insight into the future. What may seem logical and easy today, could cause a huge headache down the road. Its really best to take a month or two to really explore the asset management requirements, and then set a solution in motion. The DAM book will really get you set in the right direction.

As for Lightroom, perhaps. Its easy for today, but it was never designed as a cataloging product. There are shortcomings and limitations that can be a big set back later on down the road. I love Lightroom and use it extensively on a daily basis, but only for current work. Once projects are completed, they get archived and cataloged with archival software (such as Portfolio Extensis, Media Expressions, etc). Those programs handle more than just images, and will catalog all your media even if you shoot images, video, audio, and so on. They are also so much faster than Lightroom, but also compatible with Lightroom in a partner type scenario.

Definitely take the time to really research this. The 10 hours spent now could save you 100 hours later in file migration, fixing metadata compatibility issues, and so on.


Stephen

Mix of digital still gear, Medium format to M4/3.
Canon EOS Cinema for video.
Commercial Photography (external link)

  
  LOG IN TO REPLY
J ­ Michael
Goldmember
1,015 posts
Gallery: 7 photos
Best ofs: 1
Likes: 63
Joined Feb 2010
Location: Atlanta
     
Jan 04, 2011 21:46 |  #15

Good advice from Stephen and others. This sounds like a project that would benefit from a collaboration between your IT folks and the department in charge of managing the assets. I would look at the long term needs for storage, back-up, search & retrieval, data growth, etc. Long term in my thinking is 10 or more years. The data belongs on the network, not a bunch of portable drives etc.




  
  LOG IN TO REPLY
sponsored links (only for non-logged)

2,709 views & 0 likes for this thread, 16 members have posted to it.
Organising and storing 200000 photographs.
FORUMS Post Processing, Marketing & Presenting Photos The Business of Photography 
AAA
x 1600
y 1600

Jump to forum...   •  Rules   •  Forums   •  New posts   •  RTAT   •  'Best of'   •  Gallery   •  Gear   •  Reviews   •  Member list   •  Polls   •  Image rules   •  Search   •  Password reset   •  Home

Not a member yet?
Register to forums
Registered members may log in to forums and access all the features: full search, image upload, follow forums, own gear list and ratings, likes, more forums, private messaging, thread follow, notifications, own gallery, all settings, view hosted photos, own reviews, see more and do more... and all is free. Don't be a stranger - register now and start posting!


COOKIES DISCLAIMER: This website uses cookies to improve your user experience. By using this site, you agree to our use of cookies and to our privacy policy.
Privacy policy and cookie usage info.


POWERED BY AMASS forum software 2.58forum software
version 2.58 /
code and design
by Pekka Saarinen ©
for photography-on-the.net

Latest registered member was a spammer, and banned as such!
1936 guests, 125 members online
Simultaneous users record so far is 15,144, that happened on Nov 22, 2018

Photography-on-the.net Digital Photography Forums is the website for photographers and all who love great photos, camera and post processing techniques, gear talk, discussion and sharing. Professionals, hobbyists, newbies and those who don't even own a camera -- all are welcome regardless of skill, favourite brand, gear, gender or age. Registering and usage is free.