AI Accelerator Interface (AI²)

Accelerated Inference for Deep Learning in HALCON

With the AI² interface (AI Accelerator Interface), MVTec provides a high-performance and flexible solution for running deep learning models on specialized hardware. This significantly accelerates inference (executing trained neural networks), including on edge devices with limited compute resources.

The AI² interface extends HALCON with a unified programming interface that enables the use of different hardware platforms. This allows users to distribute compute load effectively and use hardware resources efficiently – from high-performance GPU systems to energy-efficient embedded systems.

Why AI²?

Deep learning models often require high compute power, especially for real-time inference on large data volumes. The AI² interface enables seamless hardware acceleration without the need to change application code.

Maximum performance through specialized accelerators.

A unified API structure across supported platforms.

Minimal implementation effort when switching devices.

Scalability from desktop systems to embedded and edge devices.

Available Plugins

pluginSupported ArchitectureSSupported ProductsAvailable via
NVIDIA® TensorRT™ SDK
  • x64-win64
  • x64-linux
  • aarch64-linux
  • HALCON
  • MERLIC
  • DLT1
MVTec Software Manager
Intel® Distribution of OpenVINO™ toolkit
  • x64-win64
  • x64-linux
  • HALCON
  • MERLIC
  • DLT1
MVTec Software Manager
HAILO
  • x64-win643
  • x64-linux
  • aarch64-linux2
  • armv7a-linux2
  • HALCON
  • DLT3
HAILO Developer Zone

 

1 starting with DLT 23.04
2 only inference
3 starting with DLT 24.05

For more technical information, please refer to the HALCON Reference Manual, section "AI Acceleration Interfaces (AI²)", or the MERLIC Tool Reference, section "AI² Interfaces for Tools with Deep Learning". Go to our Product Documentation

Example Scripts

descriptionDownload
Deep learning classification example program based on the AI² interface of MVTec HALCON's Intel® OpenVINO™ ToolkitZip-file
Deep learning object detection example program based on the AI² interface of MVTec HALCON's Intel® OpenVINO™ ToolkitZip-file

Model Compatibility

HALCON supports pre-trained HALCON networks as well as integrating third-party networks in ONNX format. ONNX is not an AI² plugin, but an interchange format for importing models.

GETTING STARTED WITH DEEP LEARNING
Workflow

From data acquisition to inference - learn all about the deep learning workflow.

BROAD RANGE OF FEATURES
Deep Learning Methods

With deep learning, our software offers a broad range of powerful methods for a wide variety of machine vision tasks. 

OUR KNOWLEDGE & SERVICES

Benefit From Our Expertise

PRACTICAL INSIGHTS & EXPERT KNOWLEDGE
Discover Our White Papers!

Explore our white papers to gain practical insights and expert knowledge on industrial machine vision. Download them now to understand key technologies, current trends, and real-world applications that support informed technical and strategic decisions.

INDIVIDUALLY TAILORED
Evaluation Of Your Application

Do you want to know if we offer the right solution for your industry? Send us your software application design and our experts will check it.

MVTec Software