Virtual Production Tool Set

Overview

About Color Calibrator

"Color Calibrator" is an application that measures and calibrates the color reproduction characteristics of displays and cameras used in a virtual production environment. It accepts X-OCN files shot using the Sony MPC-3610 (VENICE/CineAltaV) and MPC-3626/ MPC-3628 (VENICE 2/CineAltaV 2) Digital Cinema Cameras or SDI output signals from a camera and generates 3D LUT files used for calibration (correction of color characteristics). The calibration operation is performed in conjunction with the "Camera and Display Plugin" Unreal Engine plugin.

Accessing Software to which the LGPL Applies

This product uses Qt software to which the LGPL applies. This informs you that you have a right to have access to, modify, and redistribute source code for software programs under the conditions of the LGPL. For details about obtaining the source code, contact technical support at http://www.sonycreativesoftware.com/support/camerautilities. We would prefer that you do not contact us about the contents of the source code.

Usage Precautions

Software Usage

This manual or the software described herein, in whole or in part, may not be reproduced, translated or reduced to any machine readable form without prior written approval from Sony Corporation. © 2023 Sony Corporation

Security

SONY WILL NOT BE LIABLE FOR DAMAGES OF ANY KIND RESULTING FROM A FAILURE TO IMPLEMENT PROPER SECURITY MEASURES ON TRANSMISSION DEVICES, UNAVOIDABLE DATA LEAKS RESULTING FROM TRANSMISSION SPECIFICATIONS, OR SECURITY PROBLEMS OF ANY KIND.

SONY CORPORATION PROVIDES NO WARRANTY WITH REGARD TO THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN AND HEREBY EXPRESSLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE WITH REGARD TO THIS MANUAL, THE SOFTWARE OR SUCH OTHER INFORMATION. IN NO EVENT SHALL SONY CORPORATION BE LIABLE FOR ANY INCIDENTAL, CONSEQUENTIAL OR SPECIAL DAMAGES, WHETHER BASED ON TORT, CONTRACT, OR OTHERWISE, ARISING OUT OF OR IN CONNECTION WITH THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN OR THE USE THEREOF.

This software may only be used with the specified device.

Sony Corporation reserves the right to make any modification to this manual or the information contained herein at any time without notice.

About This Manual

Trademarks

• Windows is a trademark or registered trademark of Microsoft Corporation in the U.S. and/or other countries.
• Intel, Intel Core, and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries.
• AMD Radeon is a trademark of Advanced Micro Devices, Inc.
• NVIDIA and GeForce GTX are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and/or other countries.
• Unreal Engine is a trademark or registered trademark of Epic Games, Inc. in the United States of America and elsewhere.
• All system names, product names, and company names appearing in this document are registered trademarks or trademarks of their respective owners. Trademarked items are not indicated by ® or ™ symbols in this document.

About the Display Screen

The displayed screen may vary from that shown in this document, depending on the computer and operating environment.

Preparation

Setup

Operating Environment

Recommended operating environment

• OS: Windows 10 (64-bit)
• Processor: Intel Core i7, Intel Xeon, or higher
• Memory: 6 GB RAM or higher
• HDD: 500 MB free space or higher
• GPU: AMD Radeon RX 400 series or later, NVIDIA GeForce GTX 750 series or later
• Monitor: 1920×1080 or higher

Supported devices

Camera

• MPC-3610 (VENICE/CineAltaV)
• MPC-3626 and MPC-3628 (VENICE 2/CineAltaV 2)

SDI capture card

• Decklink 8K Pro
• Decklink 4K Extreme manufactured by Blackmagic Design

[Note] SDI capture cards are required only for input of the output signal from a camera using SDI connection.

Installing Color Calibrator

This section describes how to install Color Calibrator using the "ColorCalibrator_xxxxx.msi" installer. The "xxxxx" part of the file name indicates the version of the application.

1. Run "ColorCalibrator_xxxxx.msi." The setup wizard launches.
2. Click the [Next] button.
3. When the software end user license agreement appears, check the contents.
4. Place a check mark in [I accept the terms in the License Agreement] to proceed, and click the [Next] button.
5. Specify the installation destination folder and click the [Next] button.
6. To create a shortcut on the desktop, place a check mark in [Create a desktop shortcut] and click the [Next] button. Installation of the application begins.
7. When the ready to install screen appears, click the [Install] button.
8. When the installation completed screen appears, click the [Finish] button. The setup wizard closes.

SDI Connection with Camera

You can perform a calibration by inputting the SDI output signal from a camera directly into Color Calibrator. To use the SDI connection, attach a supported SDI capture card to the computer running Color Calibrator. For details about SDI capture cards, see "Supported devices" (page 6).

Supported output signals

The SDI connection supports the following output signals.

Resolution: 1920×1080

Frame rate and signal format: 23.98/24/25/29.97 (PsF or Progressive, YPbPr, 1.5G) | 50/59.94 (Progressive, YPbPr, 3G)

Color space: S-Gamut3/SLog3 | S-Gamut3.Cine/SLog3

Calibration Operations

Overview of Calibration Operations

Color Calibrator performs calibration in conjunction with the "Camera and Display Plugin" Unreal Engine plugin. For details about the plugin, refer to the Camera and Display Plugin manual.

Calibration operation workflow

The basic operations and workflow for calibration are shown below.

Device and software preparation

• Launching Color Calibrator
• Configuring On-set Camera component settings of the Camera and Display Plugin
• Configuring a camera
• Configuring a display

Camera adjustments

• Adjusting the camera exposure
• Adjusting the camera focus (defocusing on display surface)

Workflow Steps:

1. Device and Software Preparation: Launch Color Calibrator, configure On-set Camera component settings, configure camera, and configure display.

2. On-set Camera Component: Display W100 chart on the display.

3. Camera Adjustments: Adjust camera exposure and focus.

4. On-set Camera Component: Display color chart on the display.

5. Camera Operation: Shoot color chart using the camera.

6. Color Calibrator: Input image shot on the camera (color chart) via X-OCN file or SDI connection output.

7. Color Calibrator: Perform calibration and generate a 3D LUT file.

8. On-set Camera Component: Apply 3D LUT to the display.

9. On-set Camera Component: Display Verify chart on the display.

10. Camera Operation: Shoot Verify chart using the camera.

11. Color Calibrator: Input image shot on the camera (Verify chart) via X-OCN file or SDI connection output.

12. Color Calibrator: Check calibration result.

Diagram Description: A workflow diagram shows the sequence from device preparation through calibration and verification, involving the On-set Camera component, Color Calibrator, Camera, and Display. It illustrates data flow via X-OCN file or SDI connection, and the generation/application of a 3D LUT file.

Calibration Types

Color Calibrator performs calibration according to the display mode (HDR or SDR) and the luminance management operating mode (Mode A or Mode B). Four types are supported:

• HDR & Mode A
• HDR & Mode B
• SDR & Mode A
• SDR & Mode B

Display mode of the display

Select calibration type based on display mode (HDR or SDR).

HDR: Calibrate color reproduction characteristics including high luminance.

SDR: Calibrate SDR color reproduction characteristics.

[Note] SDR calibration performance may vary; consider adjusting display settings or switching to HDR.

Luminance management operating mode

Select mode (Mode A or Mode B) from [Sensitivity Simulation] of the Virtual VENICE actor.

Mode A: Includes deviation in optical luminance between actual display and camera in Virtual VENICE actor. Brightness changes with the actual shooting environment. Calibrates real camera output to match Virtual VENICE actor output.

Mode B (Beta): Does not include deviation in optical luminance. Brightness of Virtual VENICE actor output does not change. Calibrates real camera output to match Virtual VENICE actor output. [Note] Mode B is experimental; conduct sufficient testing.

Basic Operation

Calibration uses Color Calibrator and the On-set Camera component. Procedures vary by calibration type.

"HDR & Mode A" Type Calibration Operation

Use for HDR display mode and Mode A luminance management.

1. Set chart to "W100" in On-set Camera component.
2. Check display settings (color space, 100 nits emission).
3. Check camera settings (Input Color Space: S-Gamut3.Cine/SLog3 or S-Gamut3/SLog3, Recording Format: X-OCN, ND Filter: Clear, White Balance: 6500K, Exposure Index, Base ISO).
4. Check camera viewfinder settings (Zebra enabled, Zebra 2 at 61%, Output video: Log).
5. Adjust camera exposure by shooting W100 chart (target 61% IRE for S-Log3).
6. Set chart to "HDR1" in On-set Camera component.
7. Shoot and record HDR1 chart using camera (X-OCN format). Ensure no external lighting or reflections.
8. Shoot and record HDR2, HDR3, HDR4 charts similarly.
9. Access X-OCN files on the computer running Color Calibrator.
10. Sample HDR1-HDR4 charts in Color Calibrator ([Chart] to [HDR], [Calibration Mode] to [ModeA]).
11. Perform calibration using the [Calibrate] button.
12. Check calibration result in the [Monitor] window.
13. Generate a 3D LUT file (*.cube) via [Export].
14. Apply the 3D LUT file in the On-set Camera component.
15. Set chart to "HDR-Verify" in On-set Camera component.
16. Shoot and record Verify chart.
17. Sample Verify chart in Color Calibrator.
18. Check calibration result using [Verify] button in [Monitor] window.

"HDR & Mode B" Type Calibration Operation

Use for HDR display mode and Mode B luminance management.

1. Set chart to "W100" in On-set Camera component.
2. Check display settings.
3. Check camera settings (similar to HDR & Mode A, but includes FPS: "23.98", Shutter: "180", Iris: "T4.0").
4. Set chart to "HDR1" in On-set Camera component.
5. Shoot and record HDR1 chart using camera.
6. Shoot and record HDR2, HDR3, HDR4 charts.
7. Access X-OCN files.
8. Sample HDR1-HDR4 charts in Color Calibrator ([Chart] to [HDR], [Calibration Mode] to [ModeB], configure display/controller settings if SDR & Mode B).
9. Perform calibration.
10. Check calibration result.
11. Generate 3D LUT file.
12. Apply 3D LUT file.
13. Set chart to "HDR-Verify".
14. Shoot and record Verify chart.
15. Sample Verify chart.
16. Check calibration result.

"SDR & Mode A" Type Calibration Operation

Use for SDR display mode and Mode A luminance management.

1. Set chart to "W100" in On-set Camera component.
2. Check display settings.
3. Check camera settings (similar to HDR & Mode A).
4. Check camera viewfinder settings.
5. Adjust exposure by shooting W100 chart.
6. Set chart to "SDR1" in On-set Camera component.
7. Shoot and record SDR1 chart using camera (X-OCN format).
8. Shoot and record SDR2, SDR3 charts.
9. Access X-OCN files.
10. Sample SDR1-SDR3 charts in Color Calibrator ([Chart] to [SDR], [Calibration Mode] to [ModeA]).
11. Perform calibration.
12. Check calibration result.
13. Generate 3D LUT file.
14. Apply 3D LUT file.
15. Set chart to "SDR-Verify".
16. Shoot and record Verify chart.
17. Sample Verify chart.
18. Check calibration result.

"SDR & Mode B" Type Calibration Operation

Use for SDR display mode and Mode B luminance management.

1. Set chart to "W100" in On-set Camera component.
2. Check display settings.
3. Check camera settings (similar to SDR & Mode A, but includes specific FPS, Shutter, Iris values).
4. Set chart to "SDR1" in On-set Camera component.
5. Shoot and record SDR1 chart using camera.
6. Shoot and record SDR2, SDR3 charts.
7. Access X-OCN files.
8. Sample SDR1-SDR3 charts in Color Calibrator ([Chart] to [SDR], [Calibration Mode] to [ModeB], configure display/controller settings).
9. Perform calibration.
10. Check calibration result.
11. Generate 3D LUT file.
12. Apply 3D LUT file.
13. Set chart to "SDR-Verify".
14. Shoot and record Verify chart.
15. Sample Verify chart.
16. Check calibration result.

Color Calibrator Operation

Operations include sampling color charts, performing calibration, generating 3D LUT files, comparing results, and managing data as projects.

Sampling a Color Chart

Capture color charts from camera video and record as measurement images.

1. Create a project in [Color Manager] window.
2. Select color chart images in [Chart] (HDR or SDR).
3. Select luminance management operating mode in [Calibration Mode] (ModeA or ModeB).
4. Select calibration configuration mode in [Calibration Setting] (Color&Linearity or Color Only).
5. If SDR & Mode B, set display/display controller settings.
6. Select a capture image area.
7. Display video in [Image Viewer] window (via SDI or X-OCN).
8. Display captured image of target color chart.
9. Set positions of color measurement guides. Adjust size and zoom as needed.
10. Click (Capture) button to register the image.
11. Sample all color charts. Save the project.
12. Sample the Verify chart.

Performing Calibration

Perform calibration after sampling color charts.

1. Sample color charts.
2. Click [Calibrate] button in [Color Manager] window.
3. Check calibration result in [Monitor] window.

Generating a 3D LUT File

Generate a 3D LUT file (*.cube) after calibration.

1. Click [Export] button in [Color Manager] window.
2. Specify save destination and file name.
3. Select input color space.
4. Select output color space.
5. Click [Save].

On-set Camera Component Operation

Operations include displaying color charts and applying 3D LUTs.

Displaying Color Charts on the Display

Use On-set Camera component to display color charts. Configure display color space in [LED Settings] and charts in [Calibration] > [Calibration Chart].

Selecting a color chart: Choose chart type (W100, HDR1-4, Verify for HDR; W100, SDR1-3, Verify for SDR).

Checking the color chart display: Ensure chart displays correctly on the real display.

Applying a 3D LUT to the Display

Apply generated 3D LUT files to the display.

1. Set 3D LUT file in [LUT Filename] in [Calibration LUT].
2. Place check mark in [Enable] in [Calibration LUT].

[Note] When calibrating with a color chart, disable [Calibration LUT] first.

Crystal LED B-series: Ensure [Calibration LUT] settings match the display controller for proper linearity correction.

Configuring a Display

Set display to appropriate settings for calibration.

When display mode is HDR: Check color space, measure 100 nits for W100 chart, set color temperature to 6500K (or match camera WB).

When display mode is SDR: Check color space, set appropriate luminance for W100 chart, set color temperature to 6500K (or match camera WB).

Display Configuration Method

Configure using Display Control Software (e.g., Sony Crystal LED B-series, ZRCT-300 Display Controller).

HDR Display Settings: Contrast "600", Brightness "500", Gamma (arbitrary), HDR (curve matching environment, SMPTE ST 2084), Color Space (matching environment), Transfer Matrix (device input), Light Output "Step6".

SDR Display Settings: Contrast (arbitrary), Brightness "500", Gamma (curve matching environment), HDR "Off", Color Space (matching environment), Transfer Matrix (device input), Light Output (arbitrary).

Configuring a Camera (Viewfinder)

For Mode A calibration, set zebra function and output video appropriately. Standard white in S-Log3 should be 61 IRE.

Configuring VENICE 2 (CineAltaV 2) / VENICE (CineAltaV)

Configuring the zebra function

Navigate menu: MENU > Monitoring > VF Function. Set Zebra: "On", Zebra Select: "2", Zebra2 Level: "61%".

Configuring the output video

Navigate menu: HOME screen. Select output video setting. Set to [Log].

Color Calibrator Screen

Screen Structure

Color Calibrator has a menu bar and four operation windows: [Color Manager], [Image Viewer], [Waveform], [Monitor]. Windows can be floating or docked.

Menu bar: [File] (Exit), [Project] (New, Load, Save, etc.), [Window] (Show/hide windows), [Help] (About).

Diagram Description: Shows the layout of the Color Calibrator interface with numbered elements corresponding to the menu bar and windows.

[Color Manager] Window

Used to manage projects, register images, perform calibration, and generate 3D LUT files.

Project manager section: Manages projects (save/load calibration data).

Calibration section: Performs calibration tasks (register images, calibrate, generate LUTs).

Verify chart section: Verifies calibration results by registering images with 3D LUT applied.

[Image Viewer] Window

Displays X-OCN file video or SDI input, and captures images.

Elements: [SDI Input] button, Color space display, Message display, Input image area, Color measurement guides, [Read X-OCN] button, Seek bar, playback controls (previous, play/pause, next), (Capture) button, Zoom indicator, [Average] setting.

[Waveform] Window

Displays waveform of image in [Image Viewer]. Shows S-Gamut3/S-Log3 signal waveform.

Controls: [Overlay] button, [RGB] button, [Red], [Green], [Blue], [Luma] buttons for waveform display modes. [nits] button to switch units (nits/IRE). [Intensity] to adjust brightness.

[Monitor] Window

Compares theoretical and measured values using color patches or graphs.

Buttons: [Input] (theoretical vs. measured), [Calibration] (result with simulation), [Verify] (result with 3D LUT applied).

Comparison display area: Shows results in five ways: [Patch], [CIE 1931 Chromaticity], [DE2000 (Summary)], [DE2000], [Linearity].

[Note] [Calibration] and [Verify] buttons enable after respective operations.