What is QC?
Quality Control (QC) is the comprehensive and objective, technical quality and consistency review performed on all Netflix content prior to launch on our service. It is completed by our pool of highly skilled partner QC partners, who thoroughly examine all content for technical errors/inconsistencies and ensure it adheres to the current versions of the Netflix Delivery Specifications. These vendors generate detailed reports and submit them via Asset QC. This ensures the final launch on service will be of the highest quality to provide the best experience for our members.
What is Asset QC?
Asset QC is the platform in which QC Tasks will be completed. Asset QC serves as a one stop platform for file distribution, report issue entry, QC review (for Streaming QC tasks) and fix note entry/communication. It is a living history of the health of an asset, containing all issues that have ever been flagged on an asset. It can also be a place to communicate with Netflix or production personnel via the issue commenting function.
How Do I Access the Asset QC Platform?
The Asset QC Platform can be accessed at http://assetqc.netflix.com/qc.
If you are a Netflix Post team member or an external production team member, you will see all the reports for the shows to which you are currently onboarded.
If you are a QC Operator, you will see available tasks to complete when you login.
If you are a QC Vendor Manager, you will see all the tasks currently assigned to your operators and the tasks your operators have completed.
Search functionalities are the same as Backlot.
All users onboarded to the Asset QC Platform by Netflix personnel. If you need assistance being onboarded, please file a ticket via the Partner Help Center.
What kinds of Asset QC Tasks are completed on delivered content?
There are three kinds of Asset QC Services:.
Download QC
- QC performed on the final deliverable IMF, M&E WAV, Printmaster WAV, or Atmos BWAV or IAB source files
- Sources must be downloaded to the vendor’s local storage
- Playback occurs on the QC vendor’s hardware of choice including but not limited to:
- Rohde & Schwarz Clipster
- Colorfront Transkoder
- GrayMeta Iris
- Standard SLA for report submission is 48hrs from assignment (including download of the assets)
- Rush SLA for report submission is 24hrs from assignment
- Issues entered into the Asset QC Platform
- Files distributed via the Asset QC Platform
Cast QC
- QC performed on the HDR, SDR or Audio streams created from the final deliverable IMF
- Playback is streamed directly from the Asset QC Platform using the following equipment setup
- Google Chromecast Ultra
- Dolby Vision enabled TV
- 5.1 Surround Sound Setup
- Laptop connected to same high speed network as Chromecast to enable tool
- Standard SLA is 48hrs from assignment
- Rush SLA is 24 hours from assignment
- Issues entered into the Asset QC Platform
Browser QC
- QC performed on the SDR or Audio streams created from the final deliverable IMF or audio file
- Playback occurs within the Asset QC Platform in the Google Chrome browser using the following equipment setup
- Google Chrome Browser
- 5.1 or Stereo Headphones
- High quality computer monitor
- Connection to high speed network
- Standard SLA is 48hrs from assignment
- Issues entered into the Asset QC Platform
How does the Self Assignment model work?
- Pull Model - associated with Download and Cast QC
- When an operator logs into the Asset QC Platform, they will see available tasks.
- The operator will assign themselves to one of these tasks, which will send a notification to their data I/O team to download the assets.
- Push Model - associated with Browser QC
- When an operator logs into the Asset QC Platform, they will be assigned a QC task and served the asset automatically.
- They will not be assigned a new task/ asset until the current one is complete.
What is the SLA for QC?
The standard SLA to complete a QC task will continue to be 5 days from successful delivery. This includes QC review and Verification of the QC report. Since Cast and Browser QC tasks require ingest, encoding and deployment of the content, we factor in additional time to ensure these complete successfully.
The SLA applies to all content and includes weekends and holidays.
Where can I find resources related to QC?
Further resources can be found on the Partner Help Center.
How do I onboard new Operators to my facility to complete work in Asset QC?
When you want to add a new operator to the pool, please send us a ticket via the Partner Help Center:
- Subject line - New Operator Onboarding for Asset QC
- Body of the email - First name, Last name, email address of all operators you wish to onboard.
If there are specific considerations you must take into account for legal reasons, please let us know.
What is Verification?
The verification process has external verifiers review the QC reports, making corrections or additions to the issues noted, and making sure our QC operators are performing at their best.
This is how the QC accuracy metrics are derived. If an issue is flagged incorrectly, it will be adjusted by the verifier. We capture these metrics and use them to track the performance of our QC operators.
QC Operators are always responsible for double checking their work for accuracy.
How does Verification work in Asset QC?
Verification assignment and task completion will be very similar to the push/pull models of QC. Verification accounts in Asset QC will be separate from QC Operator accounts. Available tasks will be selected by operators at the Download level and served to operators automatically at the Cast and Browser levels.
When a Verifier is assigned a task, they will review each issue flagged in the report and assess whether or not each issue has been flagged correctly. If timecode, error code or description require adjustments, the verifier may need to delete the original notation and create a new one to accurately flag the issue. This along with any “new” issues that need to be added will affect the QC Operator’s metrics. The verifier may also simply downrate severity on issues that do not require action. This will not negatively affect the QC Operator’s metrics.
Verification is completed by our external preferred partners.
What are Fix Notes?
The fix notes process occurs on Download and Cast QC tasks when a QC report has issues flagged. Once the report is completed.
Understanding Error Severity:
Asset QC uses 3 Severity types
- Blocker - QC flags that are so severe the content is inconsumable or otherwise cannot be launched (Large global audio sync offset, Missing title sequence, missing media)
- Issue - QC flags that require attention. All flagged issues should be addressed during fixes unless they are considered by agreement of internal and external teams to be waived.
- FYI - QC flags that exist within the content, but are non-actionable and do not require attention or fixes.
How do I report issues with the Asset QC Platform?
All bugs can now be reported by submitting a Zendesk support ticket from directly within the Asset QC tool. Clicking on the “?” in the upper right of the QC request, will open up the ticket creation dialog box.
In order to better serve the Engineering team and ensure the correct issue is being addressed, please provide as much information as possible around the bug: the account affected, the version of Chrome you are using and a HAR file from your browser when the issue was occurring.
Who do I contact with questions that are not addressed in this article?
Please file a ticket via the Partner Help Center mainpage or through the Asset QC UI. This will help us to get you the best answer as quickly as possible.
CHANGE LOG
- 12/3/20 - Updated information in the article, made less focused on Branded Content QC, removed mention of new elements as they have been in production for over a year. Updated ticket references for partners to reach out via Partner Help Center. Grammar and formatting updates.