Reviews

Problems with meta-data entry in Lightroom

I’ve been having problems with meta-data entry in Lightroom, particularly the location meta-data. It’s not my computer that’s to blame. The problems exist on both the PC and Mac versions of Lightroom, although they’re more apparent on the Mac version.

When I first mentioned this on Twitter and Friendfeed (see here, here and here) I promised I’d put together a video if I found a good screencasting application. Ken Verburg pointed me to iShowU, which I used to make a short screencast demonstrating the problems. Thanks Ken!

I uploaded the video to my Vimeo account last night, but don’t try to view it there. The compression is terrible and you won’t be able to see what I’m doing. Instead, go there and scroll down till you see the download link. Click on that and view it locally on your computer (you’ll need Quicktime or iTunes). Another option is to download the video directly from my site. The original video has no loss in quality and you’ll be able to see everything properly.

The video will do a good job of conveying my frustration with the user interface in Lightroom. I really do hope the final version of Lightroom 2 will address these issues, because entering location metadata in Lightroom right now is terribly frustrating.

Standard
Places

Shenandoah Valley panoramas

You are about to see several panoramic photos that have taken me well over 35 hours to create — and I’m not counting travel time, setup time, time it took to take the photos, and the time it took to write this post.

This slideshow requires JavaScript.

A couple of weekends ago, Ligia and I got into our MINI and drove up to Shenandoah National Park, for a single purpose: to take a few panoramic photos of the valley from the tops of the Appalachian Mountains. Fortunately, that simply meant driving on beautiful, scenic Skyline Drive and stopping at various points to set up the tripod and take series of shots that would later be stitched together. Unfortunately, the weather wasn’t exactly collaborating, in spite of the cheery weather report. The day was neither sunny nor cloudy. The light was diffuse and had that washed, in-between quality that doesn’t really make it good for anything. But, I was there, and if that’s what I had to work with, so be it.

As it turned out, driving out there and taking the photos was the easiest part of the whole thing. Like I mentioned in the opening paragraph, putting together the panoramas was by far the longest, most excruciatingly slow stretch of processing work I have ever done. I do not recommend it to anyone, for multiple reasons, which I’ll mention below. If you just want to see the photos, skip ahead.

A few thoughts on the whole thing

I will not do panoramas very often in the future, unless I’m commissioned to do specific ones. If and when I do another panorama for myself (not for a client), it will likely only be a 5 to 10 photo image, simply because it takes an enormous amount of time to stitch and process them on the computer if they’re made up of more images than that.

For one thing, you would need a super fast, quad-core or better computer loaded to the gills with RAM to get any sort of decent speed while processing panoramas. A Mac Pro worth about $7,000 or better should do the trick. Seriously, every single simple operation, like cropping or rotating, took at least 10 minutes or more to execute. Sometimes just assembling a single panorama in Photoshop (through the Photomerge feature) took about 45 minutes. I have the latest MacBook Pro laptop (2.5 GHz Intel Core 2 Duo processor, 512 MB video card, 4 GB RAM), and it still took what seemed like forever to get through each panorama.

The resolution of the photos also matters. My individual photos are 12-megapixels each, at 240 dpi, made by a Canon 5D. Just imagine how much processing power is needed to put together 20 or 30 of these photos into a single image!

People don’t appreciate panoramas. I bet you most people will skim this post, unimpressed, and move on. You can’t really appreciate panoramic photos unless they’re printed out in their full size and spread out on a wall, right in front of you. You can’t appreciate their size on your computer monitor, no matter how large it might be. The largest single monitors nowadays are 30″ and have a maximum resolution of 2560×1600. That’s equivalent to about 6 megapixels at 72 dpi. You can’t possibly appreciate a 12 megapixel photo at 1:1 size on a current-day monitor, much less a panorama made up of 20 of those photos.

As an aside, don’t confuse monitor size with resolution. There are LCD HDTVs on the market that are 42″, 46″ or more in size, but they can only display up to 1920×1080 pixels, which is much less resolution than a 30″ monitor.

I can’t show you the full panoramas on my site, because of photo theft. Not that I think my panoramas (these ones in particular) are spectacular and would fetch amazing prices, but I know for a fact that if I post my panoramas at full resolution, there will be people who will steal them and try to profit from them.

How does the new Lightroom 2 Beta handle panoramas?

After I processed the photos in Photoshop CS3, which worked without crashing for the whole bunch, although it ate an amazing amount of space on my hard drive for its scratch disk, I imported them into the new Lightroom 2 Beta, to see how it would handle them.

Most of the photos were over 1 GB in size, uncompressed. Because I saved most as TIFs, using ZIP compression, their file size on disk was significantly lower. Lightroom did amazingly well to start with. It created small previews very quickly, and also created the 1:1 previews much quicker than Photoshop would have been able to render them. I was able to use the spot heal brush to remove sensor dust spots, and also used the new selective retouching brushes, without any problems. Lightroom 2 was able to do these things without significant delays, and would show the effects instantaneously.

LR2 only started hiccuping when I started to add some meta-data to the photos. As I went through and added meta-data, then opened them at 1:1 size once more, it would hang, literally forever. I had to keep force quitting it, and had to do that regularly, for each and every photo that I wanted to look at. Interestingly enough, when I wanted to export the panoramas to use them here on my site, it did it without any problems, and without crashing. It’s certainly odd behavior, but it is in Beta after all.

On to the photos

While I cannot post the panoramas at full resolution here, I did post them at higher sizes than I would normally post, in order to give you a better idea of what they look like. I also created 1:1 previews of regions of each photo, to help you realize how big they really are.

If you click on each panorama (not its 1:1 detail), it will take you to its photo page, where it will tell you how large it is (in megapixels), and how many photos went into making it. If you click on it again (on that page), it will take you to its larger size. Sorry for the double-clicking, but that’s how things work in WordPress these days.

First, a panoramic of Skyline Drive itself. This road is amazing, and I’m so glad the US government decided to build it back in the 1930s. It literally hugs the tops of the Appalachian mountains and lets average John and Jane drive on top of the world (as high as possible in this area of the world, anyway).

We stopped along Skyline Drive, parked our car, and took a hike through the forest on one of the paths marked out there. In the middle of nowhere (literally), we found this cabin, called Range View.

It was a darling little place built out of stone and off the grid (in spite of the fact that wires ran right above it). The fireplace was outside the cabin, by the front door. While the place was locked up and the windows equipped with thick wire and netting, Ligia and I could spot beds and various pieces of old furniture inside. Don’t know what it’s used for nowadays, but it is used, because there was an open bottle of wine standing in plain sight near one of the windows, and it was of recent vintage.

The rest of the photos, including the 1:1 previews, are found in the gallery below. Click on each to get to the photo page, then click again to see it in a larger size. Enjoy!

Standard
Lists

Condensed knowledge for 2008-03-17

Standard
Reviews

The next stage for Lightroom

Adobe LightroomI am a happy user of Adobe Lightroom. It has helped me get a handle on my growing photo library. While it largely replicates the functionality of Adobe Bridge, it does so with a much better interface, and includes extra functionality that makes its price worthwhile. I do most of my photo processing in Lightroom these days, and don’t go into Photoshop unless I absolutely need it.

There are a few things that need to change in order for Lightroom to become a truly valuable addition to a digital photographer’s tool set. Sure, there are some small features that could be introduced here and there, and there are some bug fixes that need to occur as well. By and large though, what I see as the biggest needed improvement can’t be explained in a few words. It requires a more detailed explanation.

Say someone starts getting into photography in a serious sort of way. They begin editing their photos on their computer, and soon find, as they get into the several hundreds and thousands, that they need something to help them organize and manage their photos. Right? Well, say they get Lightroom. They’re happy campers now. They take more photos, and then even more. They can edit the meta-data, batch process photos, export for web and print, put together photo galleries, etc. It’s great!

Here’s where things start to get tricky though. As that photo library gets bigger, it needs to be moved off the primary computer, be it a laptop or a desktop machine. Its sheer size demands a large external device, and hopefully one that stores the data in redundant fashion, to guard against hardware failures. Well, no problem, they get a huge drive and move their photos onto it. That drive is connected via USB or Firewire, and they continue to work with Lightroom. Things are just peachy.

Guess what: at some point, that photographer will need to shoot on location. They’ll take a trip either out of town, or out of the country. If they don’t have a laptop already, they’ll need to get one, because every digital photographer knows they’ll very likely need to process some photos on location, away from home.

But guess where their photo library is? It’s at home, of course. So what do you think happens when you open Lightroom while you’re away from your photo library? Why, you can’t! It tells you drive X is not available. (I should specify this occurs when the Lightroom library is stored on an external device. You can, of course, store the library locally and the photos externally, but as the library gets bigger, you’ll run into space problems. I did.)

So what can you do? You can create a new photo library, import the photos into it, and work with them that way. But wait a minute? Where’s all that beautiful meta-data that you worked so hard at? Where’s your keyword database, with its hierarchical structure, so you can tag easier without having to remember all the keywords you’d want to use? Where are all your locations? Where are your collections? Nowhere. You have to start fresh, and then when you get home, you have to re-import those photos into your main library, then reconcile keywords, locations, etc. It’s just not pretty, and it’s not practical. And on top of that, you may run into certain import bugs

What Lightroom needs is the ability to have a two-part library: a portable, main library, that travels with the machine where Lightroom is installed, and an archive library that can sit on an external device, or multiple external devices. This is NOT the same as the Vault concept one finds in Aperture. No, it goes far beyond that. The Vault concept is meant for backing up the photo library, but doesn’t address the problem of running out of space in the main library. It simply allows you to back up your work on multiple devices.

Hear me out, because I realize the concept I’m introducing is a bit complicated. The Lightroom user needs to have the ability to have access to all of their meta-data from all of their photos while traveling or while away from their main photo library. It doesn’t matter whether that person uses a laptop or a desktop. If they separate their computer from the external device that hosts their photos, they should still be able to have access to their photo library — everything but the actual photos which are to be found elsewhere.

Huh? Stay with me on this one. This isn’t the same thing as having your photo library on the laptop itself instead of the external drive. In that case, should you have your laptop with you, only the photos stored on the laptop will show up in the library, while the ones to be found on an external drive will not show up when you open Lightroom. But this points out two problems.

One, you’ll run out of space on your laptop very soon if you have a large library, even if you store the bulk of your photos elsewhere, because Lightroom builds either full-size previews, or fairly large ones (you decide this in the Preferences). Those previews are stored with the photo library, and if it resides on the laptop, the drive will fill up pretty soon.

Two, simply making those photos stored externally unavailable when Lightroom is separated from the external device doesn’t help you much. You need to be able to see at least the thumbnails, and have the meta-data available for searching, not crossed out or grayed out.

Let me outline the main points of my proposed functioning for the Lightroom library. Perhaps this will make it easier to understand:

  • A two-part library. A local/portable one, that holds all of the meta-data and thumbnails, plus a portable collection of photos that the photographer would like to have ready for processing and use no matter where they are. And the main/archive library, that holds a backup copy of the library’s meta-data and thumbnails, plus all of the photos that have been moved off the local/portable library.
  • Obviously, the ability to move photos freely from the local/portable library to the main/archive library, as needed. This would allow the photographer to decide which photos to keep local and portable, and move others to the archive in order to save space on the laptop or desktop that they’re taking with them on location.
  • The two-part library syncs the meta-data and thumbnails automatically and perhaps offers choices for conflicting data when the external device that holds the main/archive library is reconnected to the laptop/desktop.
  • Just to make things clear, the local/portable library would hold meta-data, thumbnails for all of the photos in the library, plus whatever group of photos the photographer decides to keep local. This would keep its size small and portable while allowing the user to view thumbnails for all of the photos in the library even when away from the archive library. They would even be able to do searches on the meta-data and update it as needed. The changes would sync when the archive would be re-connected. The photos stored in the archive would be marked by a special border or icon to let the user know they’re not available in their full size while the archive would be disconnected.

This is the sort of functionality I will expect from Lightroom. It would make it a truly powerful and portable piece of software. I know some people say that Bridge does the same things, but I’ve used both, and I like the Lightroom interface a LOT more.

Standard
Reviews

Bugs in Lightroom 1.2

The latest version of Adobe’s Lightroom, 1.2, introduced corrections for several issues such as XMP auto-write performance, Vista grid display errors, and noise reduction for Bayer-patterned sensors (the majority of digital sensors on the market user Bayer patterns in their color pixel distributions). It also introduced support for new cameras such as the Canon EOS 40D and the Olympus EVOLT E-510. The upgrade was a marked improvement upon 1.1 and 1.0, but I’ve noticed a few bugs:

  1. Time-shifted capture times don’t transfer properly on import from catalog to catalog. While on a recent trip in Romania, I took along my laptop but didn’t take my WD My Book Pro Edition II, since I wanted it to stay safely at home. (That’s where I keep my photo library.) I thought, no problem, I’ll just start a new catalog directly on my laptop, work with my photos there, and do a catalog to catalog import when I get home. In theory, that should have worked just fine — in practice, it was somewhat different. You see, I’d forgotten to set my 5D to Romania’s local time, and that meant that all of the photos I’d taken for the first few days lagged behind local time by 7 hours. I corrected those times by selecting those photos in Lightroom and choosing Metadata >> Edit Capture Time >> Shift by set numbers of hours. That fixed those times in the catalog on my laptop, but when I imported those same photos, I found out that very few of those corrected times transferred during the catalog import operation. What’s worse, the capture time for others was somehow shifted by seemingly random values to something else altogether, so I had to fix that as well.
  2. There’s an annoying and somewhat destructive color shift that takes place when I import photos into Lightroom. For a few moments after I open a photo, it’ll look just like it looked on my 5D’s LCD screen, but then Lightroom will shift the colors slightly as it loads and develops the RAW file. It seems to do less of it now than in version 1.0, but it’s still happening, and then it’s really difficult, if not impossible, to get my photos to look like they’re supposed to look. Canon’s own RAW viewer doesn’t do this, and neither does Microsoft’s RAW viewer.
  3. Batch-editing photos selected from the filmstrip (instead of the grid view) does not apply the actions to all of the photos, only to the first photo selected from that bunch. In other words, if I were to select the same group of photos in grid view and apply a set of modifications to all of them (keywords, etc.), these modifications would be applied to all of the photos selected. When the same group of photos is selected in the filmstrip, the modifications are not applied to all of them, only to the first selected photo. By the same token, if I select multiple photos from the filmstrip in develop view and apply a sharpening change to all of them, it doesn’t take. It only gets applied to the first selected photo.
  4. Changes to ITPC meta data are often not written to the files until Lightroom is restarted. For example, if I select a group of photos, and specify location information for them, Lightroom will not write that data to the XMP files right away. Instead, it’ll wait until I exit, then start Lightroom again. Only then will it start to write those changes to each photo’s meta data. I’m not sure why it’s like this, but it’s confusing to the user.

As frustrating as these bugs are — especially #3 — I can’t imagine working on my photographs without Lightroom. It’s made my life a whole lot easier, and it’s streamlined my photographic workflow tremendously. I can locate all of my photos very easily, and I can organize them in ways I could only dream about before. It’s really a wonderful product, and I look forward to future versions with rapt attention. I hope Adobe continues to dedicate proper focus to Lightroom as it goes forward with its market strategy.

More information:

Standard