During the recent NAB Show in Las Vegas, I attended a panel discussion and screening of a series of tests called the Single Chip Camera Evaluation. The SCCE shootout, produced by an independent, ad hoc group named Image Quality Geeks, compared 11 single-chip digital cinema cameras, along with two 35mm film emulsions.
These extensive tests, designed for “apples-to-apples” comparisons, provided a comprehensive look at the following cameras:
- 12-bit Sony F35
- ArriRaw Alexa
- Kodak 35mm Vision3 film stocks: 5213-200T and 5219-500T
- RED One M-X
- Weisscam HS-2 high-speed camera
- Phantom Flex high-speed camera
- Panasonic AF-100
- Sony F3
- Canon 5D Mk II DSLR
- Canon 1D Mk IV DSLR
- Canon 7D DSLR
- Nikon D7000 DSLR
Cinematographer Bob Primes, ASC, directed the tests and chaired the panel, which included Stephen Lighthill, ASC, of the American Film Institute, and a half dozen other postproduction and lab honchos. Over a hundred technicians were involved in shooting and posting the tests over a period of several months before NAB. The screening featured a 25-minute film, which described the tests and showed direct comparisons among cameras, projected brilliantly on a large screen.
Each camera was shot at its highest quality level, rated at an ISO between 800-1250, using the least compression possible and RAW files when available. Cameras were tested for sharpness, sensitivity, exposure latitude, color space, compression, skin tone, and shutter artifacts. In some cases, images were recorded through the cameras’ HD-SDI outputs, for less compressed files than onboard recording.
The IQG group shot high production value scenes with sets, actors, and extensive careful lighting, as well as specially devised technical tests. Some results were shown graphically on screen, some (like skin tone) required more subjective judgment in a split-screen comparison. Offered as a work in the public domain, the presentation provided filmmakers the opportunity to evaluate cameras with meticulous standards. Full results will be posted soon at thescce.org, but these trends were clear from the screening:
- The Arri Alexa and the Sony F35 both looked great in most of the tests, as befitting these cameras which sell in the $80,000-100,000 range. The Alexa had great low light sensitivity and film-quality latitude.
- The F35’s color space was similarly gorgeous, though I thought it looked a bit noisy, especially compared to the Alexa.
- The two film emulsions showed the best resolution and great latitude, especially in the highlights, not surprisingly. Some of the digital cameras actually exhibited better latitude in the shadow areas. And the film shots looked grainy, especially side-by-side with pristine digital images. Film grain has never bothered me before; I’ve always accepted it as a form of analog integrity, but here, for the first time, I found it bothersome.
- The Red One M-X did well in many of the tests, especially resolution and latitude, but looked average in others.
- The Sony PMW-F3, which sells for about $13,000, looked great in nearly all the tests, clearly the best bang for the buck among the less-expensive cameras. The F3 scored especially well in sharpness and latitude.
- The Panasonic AF-100 (which sells for under $5000, the least expensive actual video camera in the tests), looked over-compressed and over-enhanced in this high-end environment, on a large, theatre-sized screen.
- The DSLRs generally scored poorly, especially in resolution, sharpness and shutter artifacts, though they tested well in latitude.
Primes and Lighthill stressed that the aim was not to establish which was the best camera. Any camera could be the right camera for a particular shooting situation, depending on budget, logistics, size, mobility, postproduction workflow, and a host of other factors.
Other panelists included Michael Bravin, Mike Curtis of Pro Video Coalition, William Feightner of EFILM, Bill Hogan of Clarity Image, Jack Holm, Matthew Siegel, and Josh Siegel of IQG. DP Nancy Schreiber, ASC, also participated in the tests but was unable to attend the event.
3 thoughts on “NAB 2011: Digital Cinema Camera Shootout”
Does anyone have contact info for either Bob Primes or the other 40 members of the “Wandering Geeks Squad” who participated in the comparison tests whose PP was shown at NAB? I am authoring a book on Digital Cinematography for SMPTE and, although very much at NAB, missed the presentation. Bob seems to be in a hardened bunker somewhere and I have not been able to find him.
S. O. S.
Or, for that matter any of the other participants (according to your piece) in the NAB panel who seem to include: Stephan Lighthill, Michael Brevin, Mike Curtis, William Feightner, Bill Hogan, Jack Holm, Matthew Siegel, Josh Siegel and Nancy Schreiber.
Object: to actually get to see the PowerPoint that was shown in Vegas.
Doug, Thanks for your replies to my post about the Digital Camera Shootout at NAB. I’ll also respond to you by email, because the participants may not want their contact info posted on my blog. I’m sure you’ve seen this page, which merely teases but does little to elaborate:
Also, FWIW, they didn’t screen a PowerPoint at the NAB screening, but rather a 25-minute film which both documented the process and showed many of the comparisons. My own conclusions and reflections on the results are based on observation and hastily scribbled notes, though they did screen the film twice. My list of panel participants is based on the announced list, as amended by my notes. My photos, as noted, were all shot off the screen during the presentation. I didn’t want readers evaluating the images based on how they appeared in my blog!
Bob Primes did say the results would be posted soon at http://thescce.org/, but probably in the form of high-res stills, not web-resolution video. Many of the flaws and foibles of the various cameras were most noticeable on a large screen at full resolution.