Skip to content

ONNX AI Models in Notch

From Notch 2026.2 you can run ONNX (Open Neural Network Exchange) AI models in Notch through the AI Model Post-FX node, processing video in real time on your Disguise media server’s NVIDIA GPU. This page covers what runs on Disguise hardware and the things to watch for. For the full setup and usage instructions, refer to Notch’s own documentation and follow the videos.

Notch also ships with built-in AI integrations, such as the YOLO, AI Hand Tracker and AI Face Tracker nodes not covered here.

  • New in Notch 2026.2, through the AI Model Post-FX node. This first implementation supports image-to-image models only.
  • On import, Notch compiles the model into a TensorRT engine file (.trt) optimised for the exact GPU, driver and CUDA version of the machine. The .trt file is therefore machine-specific, so moving a project to another media server triggers a recompile.
  • Some models import and run straight away. Others use dynamic tensors and need their dimensions set in the Notch Inspector.
  • A supported NVIDIA GPU. See the Notch v1.0+ Compatibility Table for which servers can run Notch. AMD GPUs do not support CUDA and cannot run AI models in Notch.
  • CUDA, TensorRT and a compatible NVIDIA driver. On launch, Notch 2026.2 requires CUDA 12.9, TensorRT 10.15.1 and NVIDIA driver 576.02 or newer. Check Notch’s documentation for the current versions and installation steps.
  • Sufficient video memory (VRAM) to load, convert and run the model.

Diagram of the Notch AI model workflow: an ONNX model imported into Notch is compiled to a GPU-specific .trt engine, which the AI Model Post-FX node runs on a video source to produce an image-to-image output. The required environment is an NVIDIA GPU with sufficient VRAM, an NVIDIA driver, CUDA and TensorRT.

The Notch 2026.2 AI model workflow and required environment on a Disguise media server.

  • NVIDIA Background Removal may not function correctly when used alongside the Notch ONNX model workflow.
  • Some Disguise media servers have locked NVIDIA driver versions that may not meet the requirement, so check your server can run the driver Notch needs.
  • Sufficient VRAM must be available to load, convert and run AI models.
  • AMD GPUs are not supported.

For the full, current instructions, follow Notch’s official documentation. This covers installing CUDA and TensorRT, setting the TENSORRT_DIR environment variable, importing a model through Import Resource > AI > ONNX Model, managing dynamic tensors in the Inspector, and troubleshooting a model that will not run.