Keying Template Demo with VFX for Filmmakers


I was recently on VFXforFilmmakers channel doing a keying demo using my advanced keying template. Matt has kindly filmed some 4K ACES blackmagic footage for all of you to practice on, and we’ve included this nuke script, original footage, pre-renders and final render in the work files for you to play around and dive into.

It’s a great resource and practical case of how I would use the techniques and templates that I developed in the series. By no means the only way to keep, but hopefully you will find many parts interesting and valuable.

The FREE working files can be downloaded from Matt’s website VFXforFilm.com

https://www.vfxforfilm.com/online-store/Spit-Ballin-Episode-1-Keying-in-Nuke-p300452414

New NukeSurvivalToolkit Release v1.1.0

Published new v1.1.0 Release of NukeSurvivalToolkit


Added some new tools, fixed some bugs.
For all interested what was updated:

If your interested in the new tool additions highlights, check out this bulletin: https://drive.google.com/file/d/1WziZXM8LSmJxibYckvUV9jbvcLgExUuk/view

Full Release Notes v1.1.0 found here: https://drive.google.com/file/d/1nb_DfkYn44yqc30gD34aEEV3zlh_-shP/view?usp=sharing

Link to new release v1.1.0 download page: https://github.com/CreativeLyons/NukeSurvivalToolkit_publicRelease/releases/latest

If you already have the package installed, should be as easy swapping out the old folder with the new one. In the future I plan to do a monthly release update, given there is enough material to add, bug fix, change, etc.

Please let me know if there are any tools you think I missed and would make a good addition in the comments, as well as any bugs or unusual behavior. Thanks

DirectionalBlur

Directional Blur

Select the rotation angle and size of the blur. Choose between blur and defocus. Has a perpendicular blur that blurs in the perpendicular direction to the angle chosen.

Some helpful options for managing your BBox.

Has channels, mask, mix, etc

View the demo here on youtube:
https://www.youtube.com/watch?v=BrioyN9YMA8&feature=youtu.be

Or on vimeo:
https://vimeo.com/348730566

Download the tool on Nukepedia:
http://www.nukepedia.com/gizmos/filter/directionalblur

Download at my github where you can find a repository of all my tools in one place:
https://github.com/CreativeLyons/Lyons_Tools_Public/blob/master/06_Filter/DirectionalBlur.nk

Enjoy!

BinaryAlpha

BinaryAlpha_SplashPage_v01.jpg

Binary Alpha is a very simple, yet super convenient expression that I use all the time, and decided to turn into a quick gizmo.

It analyzes a choice of the RGB, RGBA, or Alpha input and outputs an Alpha Channel (or RGBA result) that is Binary, 0 or 1.  Any Pixels that are not 0 will be turned into 1 (negative numbers also), and 0 will remain 0.  

This is perfect for those “blur, unpremult, set alpha, blur” for tricks extending colors, or if you need a quick matte for finding any rgb color above or below 0, in a CG render passes for example.

The good ol’ blur/unpremult/blur ❤ :

BinaryAlphaExample_v03_copy_2.gif

Basic properties:

binaryAlphaSettings_jpg.jpg

The literal tcl expression is just:

r!=0 || g!=0 || b!=0 || a! = 0 ? 1 : 0

Which in english, translates to something like: 
“if red is not 0, or green is not 0, or blue is not 0, or alpha is not 0, then be 1, or else, be 0”
So it will include negative pixels as an output as 1 as well.

Super simple but hopefully a time saver if you are like me and hate remembering expressions.

Find the tool on nukepedia here:
http://www.nukepedia.com/gizmos/channel/binaryalpha

You can also download this tool at my github, where you’ll find all my public tools in one place:
https://github.com/CreativeLyons/Lyons_Tools_Public/blob/master/04_Channel/BinaryAlpha.nk

Enjoy

BlacksMatch

For those who just want to quickly see what the tool does, I’ll include a time-stamped link to that part of the Demo here:
https://youtu.be/Kw3bcsmkGuk?t=2145

BlacksMatch recreates a Toe operation with merge nodes, meaning you can now plug in an external image are your black color and it will perform the operation taking each pixel’s value into account as the blackpoint.  

You can control the Multiply, which is how far above the blackpoint the blacks match with stop affecting your midtones and highlights.  For example, if you plugged in 0.15 and had the multiply set to 2, then values above 0.3 remain unaffected.  

The “falloff” or Gamma control just controls the falloff of the curve into your blackpoint color.  if it’s really high, it will act more like a screen or plus (still ending at the blackpoint color times your multiply control), and if it’s really low, it will act more like a clamp.  Your blackpoint will not ever fall below your input color while you manipulate the curves.

There is a preview plotscan button that helps you visualize how your curve is behaving with your settings.  Just move the plotscan picker around and it will sample your blackpoint color at that area and give you an overlay of your curve.  (Don’t forget to turn it off when you are done)

I personally think this is a tool every comper should have in their toolkit, as it’s by far the most controlable way to match your blacks properly!

The settings of the BlackMatch Tool and a wipe from the tutorial:

BlacksMatchTutorial_ThumbforNukepedia.jpg

There is a full video Tutorial about the BlacksMatch workflow, along with a Tool Demonstration at the end.  If you want to know how I made it and whats going on under the hood, please watch the whole video. It might give you some ideas of how to re-think your matching blacks workflow.


Here is the Flow Chart for the Blacks Match Workflow:

Our goals are:

1.) Nothing should fall below the blackpoint value

2.) The blackpoint should affect the mids/highs as little as possible.

The Most important thing to remember is to try and not adjust any color corrections after you apply your blackpoint.


Here’s a few examples of the importance matching blacks can be to your image:

Here is a picture with just some beauty rendered statues, color corrected and placed into our scene, no blacks match… stands out quite a bit:

Here is a before picture is we just turn off all the color and detail and just place “pure black” statues into our scene:

If we start sampling the colors around the surrounding areas of the statues and applying theses as our blackpoint, still ignore any midtone/highlight color or detail. We can actually see our statues are fitting in quite nicely. You can think of it like “if there were pure black objects in my scene in that area, what would it look like?” and we are getting pretty decent results:

And here is the image with our matched blacks properly combined with our midtones and highlights. But there is a lot of operations used to combine the blackpoint with the midtones and highlights. So let’s take a look at all of them, and study the best way of combining these:

For the second part of our goal, the blacks should affect our midtones and highlights as little as possible. We have to look at different operations of how to apply our blackpoint:

Here’s some graphs comparing the most common operations of how to match the blackpoint and what they are doing to a 0-1 curve.

Here’s a closer look at the curves next to each other:

Here is just an overlay of all the curves on top of each other to compare them to one another:


Here is a close up of a Clamp operation:

Here’s a close up of the plus operation:

Here’s an example of a Screen operation:

A close up of a Hypot operation:

A close up of a Toe operation:


Let’s now talk about the Good, the Bad, and the Ugly… starting with the bad:

A screen and lift do a sililar operation between 0-1, but the screens influence stops at 1, where as a lift is actually using 1 as a pivot point to lift the blacks and lower the highlights above 1. If you set a lift to 1, it will completely decontrast the image, sandwiching every pixel and turning the entire frame to 1.

No matter if you leave a color correct at default range, or start adjusting the range curves, the color correct produces some very strange results because of the S-curve it generates. Because it is sampling the luminance from the bg image, if you enter a black point number higher than the luma key it is calculating, than the curve will first be your black point color, then dip back down to the midtone color and rise back up to your highlights. This creates a really strange image that you’ll want to avoid.

Avoid Lift on a Grade, and avoid ColorCorrect nodes for adjusting your blackpoint.


The Ugly:

Both Clamp and Plus are at the Extremes of our operations, and have the least appealing qualities. You can acheive much more control and better operations using our remains screen, hypot, and toe operations. Here is the gif of the curves compared to one another again so you can see that clamp and plus are at the extremes:

Screen and Hypot are perfectly fine operations, but offer limited control. and Toe… Well we can’t even input an image, and we don’t even know what exactly it is doing. There’s very little documentation on it. Let’s try to reconstruct it:

With a little bit of fiddling around. We can see the top of the toe operation is exactly double the value of the blackpoint… We need to start by re-creating a screen, which is basically an inverted luminance key, used as a mask, that is plusing out blackpoint. From there we can create a screen operation that instead of end at 0-1, ends at 0 to 2x the balckpoint value, and you can see in the example above we have a mini triangle encompassing our toe operation. There it’s a matter of using a gamma of 0.5 on the luma-key mask and we have our toe.

So to reiterate:

A toe is an inverted luma-key, that instead of 0-1 is 0-‘2x the blackpoint color’ and then is gammed by 0.5 and is used as a mask to plus the blackpoint color over the image.

I know… that’s a mouthfull. But what we take away from making this toe for ourselves is that we have controls over 2 things. The multiply of how far above the black color it is affecting our midtones and highlights. And the gamma curve that is controlling our falloff of the curve towards the blackpoint value.

With this knowledge and math, we can create a tool that uses merges to do our math operations, which mean me can plug in an external image as out blackpoint and expose controls for the mult (above the blackpoint) and gamma (falloff) of the curve. And now we have our BlacksMatch tool.


Download the tool from Nukepedia here:

http://www.nukepedia.com/gizmos/colour/blacksmatch_20

Or download the tool from my github, where you can find a repository with all my tools in one place:

https://github.com/CreativeLyons/Lyons_Tools_Public/blob/master/05_Color/BlacksMatch.nk


I’ve received a few requests for the script and images I’ve used in the tutorial, so I’ve put together a folder on my dropbox for you guys to download and play around with.
This is a preview of the part of the script I am saving for you. It includes the statues over the temple example, a couple of the simple shapes over complex black level images, and the part of the script that I recreated the toe, with the animating graph.

I’m also adding a reference image folder, with some of the cool hazy/foggy complex black point images I found while researching this topic. Maybe they will be good practice for you to bring into nuke and play around.

Finally I am adding in the original statue exr render, with some passes: beauty, depth, position, and normals, in case you want to try and color correct and match the statue render into any of these images or your own backgrounds. Thanks to Ernest Dios for the render.

Here is the dropbox link to the project files:
https://www.dropbox.com/sh/p47aquatmp1cai7/AAAnt_Lr4slT2RmK5znV50L3a?dl=0

GradMagic Tool

GradMagic is an interactive 4 point gradient tool, which can link to cornerpin nodes, and can toggle between live sampling from the plate or baking the color values of the corners.

Can be used for various tasks in prep and DMP,or if you just need a quick 4 point gradient map.

GradMagic_Properties_Screenshot.png

Quick Overview of the properties:

It’s pretty straight forward, heres some basic written steps:
1.) Set your cornerpoints manually or by pressing one of the ‘snap to’ buttons.  Or alternatively you can link or bake your cornerpoints to an existing cornerpin node (or any node with 4 “to” knobs).

2.) If you need to adjust the points once they are baked/linked/ in place, then show the adjust knobs, set the reference frame to snap the adjust points near the main points, and you can then move each cornerpoint while it still retains its animation path.

3.) You can either keep the node live, bake the corner colors on a single frame, or bake the colors over a framerange.  once baked you can adjust the cornerpoints further if you need to cover up more area.  You can adjust the ‘sample size’ at the top if you want to average more colors under each corner point.

4.) Finally you can apply a blur to the edges to help with transition, and you can select the output at the top, whether to show the gradient over the BG input, or just the gradient itself.

Hope you find it useful

A full tutorial video on how to use the tool can be found here on youtube:
https://youtu.be/oge8jMR0LRw

Or here on vimeo:
https://vimeo.com/341514150

Download the tool from nukepedia with this link:
http://www.nukepedia.com/gizmos/draw/gradmagic

You can also download GradMagic from my github link:
https://github.com/CreativeLyons/Lyons_Tools_Public/blob/master/02_Draw/GradMagic.nk

Stay tuned for more tools and tutorials.

Advanced Keying Breakdown: 4.1 – Template

0:00 – Introduction
4:30 – CC and transform after key
6:49 – CC and transform before key
12:03 – Advanced Keying Template flowchart
15:25 – Advanced Keying Template
40:10 – Advanced Keying Template Compressed
40:55 – Advanced Keying walkthrough script
41:59 – outro


Hey guys,

Sorry for the long overdue tutorial wrapping up this keying series. Here is the advanced keying template video, along with a flowchart and download link to the template scripts, which you can save to your toolsets for your own use in your nuke scripts.

advanced_keying_template_flowchart_3

Here is the Template Flow Chart from the video for you to download and review:

Here is the download to the Advanced Keying Template Package:

Advanced Keying Template Package Download

Or download from Nukepedia

Package contains:
Advanced_Keying_Template_v06_.nk
Advanced_Keying_Template_Compressed_v06_.nk
Advanced_Keying_Template_Walkthrough_v01_.nk


Some of you have asked for source materials for keying practice.  I can provide you with a few free downloads so you can practice.

https://www.thefoundry.co.uk/support/user-guides/#nuke  – download the nuke keying assets

http://www.thefoundry.co.uk/products/nuke/learn1/ – scroll down to 2d compositing | Compositing Basics.  Click on the link that says Download Assets for Basic Workflows (535 MB).  Here you will find the girl and desert  BG found in this tutorial.

https://mango.blender.org/ – Tears of steal open source project.  Free 4K footage for people to download and practice.  Highly recommended.  scroll down to the blog post called ALL 4K FRAMES – NOW AVAILABLE ON XIPH.ORG.



Finally, I want to thank everyone for your continued support, views, shares, comments, and emails.  It all means a lot to me and you’ve certainly motivated me to keep going. Thank you.

As always, if there are any questions, just leave a comment or shoot me an email and I will try my best to respond.  Hopefully with this series of tutorials, and now this template, you guys will be fully equipped to handle even the toughest of keys.

Until next time!

Advanced Keying Breakdown: DESPILL 2.1 Initial Concepts

0:00 intro
0:40 what is despill?
3:40 Separating the Despill process from the Alpha process
7:33 Core Despill and Edge Despill

Hey guys,

I’m going over the first section of Despilling.  I talk about what despill is, why you need to remove it,  how it should be separated from the alpha process, and combining core and edge despills.

The 2 main goals of despilling are:

1.) Removing any spill while still maintaining the original colors in the plate
2.) Blending the subjects edges with a BG colors

http://nukestation.com/vkeyer-tutorial/

Here is the link to a great despill tutorial which goes over blending BG colors using the difference matte of a despilled plate –> to the original plate.   If you are new to the concept of blending your despill with the background then you are really going to like this video.  He talks about flame in the beginning of the video and switches to nuke later.

Thanks for watching, next I’ll go over how to achieve and control the despill to get what you need.

– Tony

Advanced Keying Breakdown: ALPHA 1.4 – IBK Stacked Technique

Sorry for not posting in a couple months, I have been traveling and working.  But I am ready to finish off this series.  I think you guys will like this one because I go over some techniques on the IBK workflow.  The first part of the video I show you a comparison between how I usually see IBK being used and the IBK stacked technique.  There are 4 examples (a greenscreen, a bluescreen, a hair problem, and a shadow problem) that I go over and explain the concept of what the IBK is doing, and the importance of the IBK Color, or cleanplate.

Next I give you a step by step breakdown of how to setup this IBK stacked techniques by building these 4 examples from scratch.  If you are already familiar with IBK and want to jump into the step by step process of this stacked technique, you can just to 7:09 (Step by Step process, example 1 greenscreen).

0:00 Intro
0:45 Comparison 1 greenscreen example
3:54 Comparison 2 bluescreen example
4:31 Comparison 3 hair example
5:53 Comparison 4 shadows and markers example

7:09 Step by Step process, example 1 greenscreen
17:12 step by step example 2 bluescreen
22:15 step by step example 3 hair and assisted eroding
27:37 step by step example 4 shadows / cleanplate customization
37:12 Outro

At one point, my cursor disappears in the recording.  Something must have gone wrong during the recording process, but you should still be able to see me clicking and marquee-ing stuff.

I’m glad to be moving onto the despill section, as I think it usually is overlooked.  In reality it’s just as important as the alpha, if not MORE important.

Cheers,

Tony

AE to Nuke: 02 Deinterlace inside of Nuke

You can grab the bridal footage asset from VideoCopilot.net:

http://www.videocopilot.net/tutorials/deinterlace_in_ae/

Below I have included a link to the group I was using in the video, which I have named “Deinterlacer_v02”

DeInterlacer_v02

I chose a group instead of a gizmo because it is easy to just drag and drop into any script without any fuss and will work on multiple machines or networks.  Gizmos will break if it cannot link to the main file properly.  Anyways just drag and drop this guy into the script and voila, deinterlaced video.

Let me know if it works for you, if it has any bugs, or needs any updates.

Best,

Tony Lyons