Testing The 5D2 – RAW vs. H264

Earlier, I posted that I had filmed quite a bit of comparison footage that I was not able to process, because of an “LV_REC” error. Thanks to “a.d.” on the Magic Lantern RAW processing forum, I was able to figure out how to use a hex editor to copy the file footer code from a functional RAW file, and paste it onto a malfunctioning file. It didn’t work 100% of the time (and it was incredibly time-consuming), but I did salvage enough footage to post a decent comparison video.

My first impression, once I put the H264 and RAW footage back-to-back, was that the H264 looks very good! Sure, the RAW files have a tremendous amount of detail, but the colors and the overall punch of the ungraded H264 files are often much more appealing to me than the minimally-processed RAW files. The difference, of course, is that the nature of RAW allows one to grade the footage to look however one wants, while maintaining data integrity and clarity, so it’s difficult to make an apples-to-apples comparison.

battery_h264

battery raw

I can authoritatively state, however, that the workflow, as it stands now, for RAW footage is not for the faint of heart (or the short on time). First, I had to copy the RAW files from the card to my Mac’s desktop (which seemed to be the only place the RAW2DNG utility would acknowledge the existence of the files). Then, RAW2DNG would take the single RAW file (except for the ones that didn’t work, because the Magic Lantern module is still a work in progress), make a folder for it, and and create an individual DNG image for each frame of the video. Then, I had to open those DNG files in Photoshop (which pops up the Canon Adobe Raw editing interface), take the horrible-looking RAW file, make it look reasonably decent, and batch process all the DNG files for each clip into TIF files (as opposed to JPG, to maintain quality). Then, I imported all the TIF folders into Premiere, put them – one at a time – on a sequence, and exported each one as a ProRes file.

ea h264

ea raw

Boy, was that time-consuming! Not to mention the fact that, with the RAW file, the DNG folder, the TIF folder, and the ProRes file, I now have FOUR versions of each clip taking up room on my harddrive. And these are not small files.

My initial conclusions are as follows:

1) Don’t fall into the trap of suddenly thinking the Canon’s H264 files are worthless. They still look really good, even compared to RAW.

2) Until some enterprising developers develop a more streamlined solution to the RAW-to-ProRes transcoding process, or until Adobe allows for direct importing of RAW files into Premiere, the workflow is most likely not worth the effort, for most users.

With that said, I went ahead and shot a simple commercial in RAW (more specifically, in RAW and H264, since I didn’t have confidence in the RAW files), which I’ll be editing this week. That process will give me some insight into the advantages and disadvantages of shooting and working with DSLR RAW on an actual project. Stay tuned for that!

Processing Canon RAW Files

Here’s what seems to work the best for me, so far:

- Use RAW2DNG app to convert Camera RAW to DNG files. Here is the app for Mac, and here is the app for Windows.
- Use Adobe Camera Raw (within Photoshop) to open DNG and save as TIF sequence
- Within FCP or Premiere: Settings -> General -> Still Frame Duration: 1 Frame
- Drag and drop TIF sequence folders onto sequence
- Export as preferred flavor of ProRes, then re-import

BEWARE Today’s ML Build

I was pleased to see that, overnight, the Magic Lantern developers had come out with a new build, which allows for starting/stopping RAW recording directly from the Live View screen, instead of having to go in and out of the Magic Lantern menu. So, I installed it on my cards, and spent several hours carefully shooting lovely footage on my Canon 5D2, in both RAW and H264 formats, so that I could post a really nice comparison video.

Now, I have good news and bad news. The good news is that my Lexar Professional 1000x 16GB cards worked flawlessly at recording RAW footage at 1888×720.  The bad news is that, once I tried to convert those RAW files using RAW2DNG, I got this message: “Error: This ain’t a lv_rec RAW file”

That was disappointing, to put it mildly. According to the relevant board on the Magic Lantern forum, this is a known bug that the developers are working on. Some resolutions will work – e.g. 1280×720 – and some won’t.

I’ve posted a question on the forum inquiring whether there’s some way to fix the files, and will report if I hear anything.

In the meantime … DO NOT USE TODAY’S BUILD!

Follow the instructions and the links in yesterday’s post to install an earlier build of the Magic Lantern for 5D2.

RAW Test on Canon 5D Mark II

Hacking a new DSLR to record RAW footage is impressive. Hacking a five year old DSLR to record RAW footage is INCREDIBLE!

I grabbed a few quick shots in RAW format on my 5D2 today, and the results were mixed. The dynamic range is stupefying, and it’s exhilerating to be able to fine-tune white balance and exposure in editing. The resolution dictated by ML – 1888×720 – is a little strange, but it gives the footage an interesting super-widescreen look which could have some nice potential.

However, the 60MB/s write speed of my SanDisk “Extreme” 16GB CF card is clearly insufficient for the firehose stream of data coming at it. As you can see in the moving shots, frames are dropping left and right. I’m going to do some more careful shots, with a faster card, and see how it goes.

How To Shoot RAW Video On Your 5D2

After spending most of the morning sifting through the Magic Lantern forums, I’ve figured out how to install Magic Lantern on my Canon 5D Mark II (note that it is the II, not the III).

1) Make sure you have the final 5D2 official firmware (2.1.2), from here.

2) Copy the official firmware files to an CF card, and use the “Firmware Update” function in the menu to update it.

_MG_9011

3) Download the latest Magic Lantern complete module for 5D2 from here.

4) Unzip the Magic Lantern file. Copy ONLY the “5D2-212.fir” file to the root directory of the CF card. Do NOT put it in the camera yet.

5) Download the latest RAW build from here.

6) Unzip that build file. You’ll see an “autoexec.bin” file and an “ML” folder. Copy BOTH to the root directory of the CF card. The CF card root directory should like like this.

ml folder

7) Now, put the CF card in the camera, and run the “Firmware Update” again. Follow the onscreen instructions. If all goes well, you’ll eventually see a screen with green text saying that you can restart your camera now. Go ahead and turn it off, and then back on.

_MG_9015

_MG_9004

8) Now, press the button on the camera that has the trash can icon on it. This will open up the Magic Lantern interface. Pretty impressive, eh?

9) Scroll all the way to the right to the “M” tab, and click “Load modules now.” You’ll see “raw_rec” pop up at the bottom.

_MG_9005

10) Now scroll back to the video camera tab, and click on “RAW video.”

11) Turn Live View on, to enable the rest of the functions. Set the width and height to 1880×720 (maximum resolution right now).

_MG_9007

12) Click on “Start.” You’re now recording!

13) When you’re ready to stop recording, click the trash can button again to see the menu, and click on “Start.”

That’s it! Now you have a RAW video file on your Canon 5D Mark 2. Turning it into something you can actually use will be the subject of my next post.

First 5D Mark III (+ 60D & Mk II) Raw Video Tests

It’s been about 24 hours since the Magic Lantern’s RAW hack for the Canon 5D Mark III hit the streets, and the test videos are trickling in. I’m going to update this post throughout the day with the best that I find.

By the way, the RAW patch works for the Canon 60D, and the Mark II as well!

The Canon 5D Is Back On Top!

I started this website in 2009, after the Canon 5D Mark II democratized filmmaking by opening mega-sensor production up to microbudget productions.

In the last couple of years, as newer technologies have emerged, I’ve been spending more time on my blog – http://crewofone.com – and left this site to more or less whither on the vine.

But, thanks to Magic Lantern’s RAW firmware hack for the Canon 5D Mark III, the 5D family is big news again. I haven’t seen this kind of excitement since Vincent LaForet’s “Reverie” first showed the world that a DSLR could shoot gorgeous video.

For the past five years, people have been doing amazing work with the 5D’s highly compressed camera files. Now, the RAW patch makes even more incredible work possible.