The Role of Grain
Literally beyond lens effects stands another attribute of images shot with a real camera. Grain is essentially high-frequency noise that can be found in each channel of most footage, to varying degrees. Far from being a mere annoyance or problem, grain can be your friend, given its due. Grain adds texture and life to images and can help to conceal a multitude of small details, enabling compositors to get away with all kinds of stuff (in particular, adding life to a still image source in a moving image composition). Just like depth of field and motion blur, moderate amounts of grain are part of the key to a cinematic look. For compositors, perhaps the most important role of grain is its role in integrating a flat, static layer with moving footage, adding life to an element that otherwise looks oddly suspended out of the time and place of the rest of the scene (see Figure 27).
Figure 27 Solid areas of color without fine detail such as this section of blue screen (zoomed to 800%, blue channel displayed) are the best to sample and evaluate grain. At right of frame is a color-matched solid that evidently fails to blend with the background.
Proper grain isn't simply switched on or off, however; it needs to be adjusted carefully. You can become quite theoretical about all this, but really you need to concern yourself with only two basic factors:
- Size of the grain, per channel
- Amount of grain, or amount of contrast in the grain, per channel
The emphasis here is that these factors typically vary from channel to channel. Blue is almost universally the channel likeliest to have the most noise; happily, the human eye is less sensitive to blue than to red or green, but this can be bad news for blue-screen shoots.
How much grain is enough? The goal is typically to match what's there already. If your shot has a background plate with the proper amount of grain in it, you match your foreground elements to that. In the case of a fully computer-generated scene, you might have to match surrounding shots that have plate reference, which you would match in the same manner.
Grain Management Strategies
After Effects Professional includes a suite of three tools for automated grain sampling, grain reduction, and grain generation: Add Grain you adjust entirely manually, but Match Grain and Remove Grain sample a noise source layer to give you an initial result that you can then adjust.
If you've been reading closely up to this point, you know that I'm not a fan of using the automated solutions. Not so in this case. The Match Grain effect doesn't seem to be appreciably slower due to grain sampling than Add Grain, which doesn't perform any sampling and includes all of the same controls. Therefore, I recommend that you see what Match Grain can come up with as a starting point, and then work from there. In either case, the steps are the same:
- Look for a section of your source footage that contains a solid color area and little or no motion for 10 to 20 frames. Most clips include an area satisfying these criteria, and those that don't may let you get away with less precision.
- Zoom to 200% to 400% on the solid color area, and create a Region of Interest around it. Set the Work Area to the 10 or 20 frames with little or no motion.
- Add a solid that's small enough to occupy part of the Region of Interest. Apply a Ramp effect to the solid, and use the eyedropper tools to select the darkest and lightest pixels in the solid color area of the clip. The lack of grain detail in the foreground gradient should be clearly apparent (see Figure 28).
Figure 28 Insert a small solid and add a Ramp effect; then use the eyedropper tools in Ramp to sample the brightest and darkest areas of the background. This technique offers a clear evaluation of a grain match once Match Grain or Add Grain is applied.
- Apply the Match Grain effect to the foreground solid. Choose the source footage layer in the Noise Source Layer pull-down. As soon as the effect finishes rendering a sample frame, you have a basis from which to begin fine-tuning. You can RAM Preview at this point to see how close a match you have. In most cases, you're not done yet.
- Twirl down the Tweaking controls for Match Grain, and then twirl down Channel Intensities and Channel Size. You can save yourself a lot of time by doing most of your work here, channel by channel.
- Activate the red channel only in the Composition window by pressing Alt-1 (Mac OS: Option-1) and adjust the Red Intensity and Red Size values to match the foreground and background (see Figure 29). Repeat this process for the green and blue channels by pressing Alt-2 (Mac OS: Option-2) and Alt-3 (Mac OS: Option-3), respectively. RAM Preview the result.
Figure 29 As with color matching, grain matching is best performed channel by channel. Match Grain is the best type of automated plug-in because it's really only semi-automated, enabling you to control and improve upon the initial result easily.
- Adjust Intensity, Size, or Softness controls under Tweaking, according to what you see in the RAM Preview. You may also find it necessary to reduce Saturation under Color, particularly if your source is film rather than video. In most cases, these steps yield a workable result. The effect can be copied and pasted to any foreground layers that need grain. If the foreground layer already contains noise or grain, you may need to adjust the Compensate for Existing Noise percentage for that layer.
Obviously, whole categories of controls are untouched with this method (see Figure 30). The Application category, for example, contains controls for how the grain is blended and how it affects shadows, midtones, and highlights individually. Typically these are overkill, as are the Sampling and Animation controls, but how far you go in matching grain before your eye is satisfied is up to you and your team. This is one more case in which slamming the result can help ascertain its effectiveness (see Figure 31).
Figure 30 Highlighted are the essential controls in Match Grain, which contains a lot of properties. It's best to proceed top to bottom through these, adjusting overall Intensity, Size, and Softness, and then refining the individual Channel Intensities and Channel Size (as shown earlier in Figure 28).
Figure 31 Slamming the result—with an adjustment layer containing a Levels effect, in this case with Gamma and Input levels adjusted—reveals the effectiveness of the match (and the full gnarliness of the grain).
Grain Removal
Removing grain, or sharpening an image in general, is an entirely different process from adding grain. On a well-shot production, you'll rarely have a reason to reach for the Remove Grain tool.
If you do, the reason for doing so may be unique to your particular footage. In such cases, you may very well find that Remove Grain at the default settings gives you a satisfactory result. If not, check into the Fine Tuning and Unsharp Mask settings to adjust it.
Remove Grain is often best employed "behind the scenes"—not across the entire frame (see Figure 32), or intermediately in combination with other effects.
Figure 32 It may suit a still figure in a book (applied at the right side of this image), but Remove Grain on an entire shot with the default settings is rarely desirable. In full motion, the grain-reduced shot looks a bit strange and retains a certain soft lumpiness.
When to Employ Grain Strategies
The most obvious candidates for grain addition are computer-generated or still image layers, because they lack any of the moving grain found in film or video footage. As soon as your shot has to match anything that came from a camera, and particularly in a large format such as HD or film, you must manage grain.
Blurred elements may also need grain addition, even if they employ matching source footage. Blurry source shots contain as much grain as focused ones because the grain is an artifact of the medium recording the image, not the subject itself. Elements that have been scaled down in After Effects contain scaled-down grain, which may require restoration. Color keying can also suppress grain in the channel that has been keyed out.
Other compositing operations will instead enhance grain. Sharpening, unless performed via Remove Grain, can strongly emphasize grain contrast in an element, typically in a not-so-desirable manner. Sharpening also brings out any nasty compression artifacts that come with footage that uses JPEG-type compression, such as MiniDV video.
Lack of grain is one of the dead giveaways of a poorly composited shot, however. It's worth the effort to match the correct amount of grain into your shot—even if the result isn't apparent as you preview it on your monitor.