As a result, significantly faster deep learning inference times can be achieved on Intel processors including CPUs, GPUs and VPUs for key workloads. By expanding the range of supported hardware, users can now harness the performance of a wide range of Intel devices to accelerate their deep learning applications and are no longer limited to a few specific devices. At the same time, the integration works seamlessly and is not bound to certain hardware specifics. Simply by changing parameters, the inference of an existing deep learning application can now be executed on devices supported by the OpenVINO toolkit.
Generic support for AI accelerator hardware
The OpenVINO toolkit plugin from MVTec is based on the new HALCON AI Accelerator Interface (AI²). This generic interface allows customers to use supported AI accelerator hardware for the inference part of their deep learning applications – quickly and conveniently. Such special devices are widely used especially for applications in the embedded environment, but also exist more and more in the PC environment. By abstracting the deep learning models from specific hardware, the AI Accelerator Interface is particularly future-proof. In addition to plugins provided by MVTec, the integration of customer-specific AI accelerator hardware is also possible. Moreover, it is not only typical deep learning applications that can be accelerated via AI². All "classic" machine vision methods with integrated deep learning functions, such as HALCON's Deep OCR, benefit from this as well.
"Thanks to the seamless integration of the OpenVINO toolkit as an AI² plugin, simply adding supported Intel devices can significantly speed up inference in applications without any further modifications," confirms Thomas Hopfner, Product Manager Licensing & Interfaces at MVTec Software GmbH. "In addition, the use of special accelerator hardware reduces temporal variance and thus leads to deterministic execution times, which is a critical factor especially in the field of manufacturing automation," he adds.
Alex Myakov, Chief Computer Vision Advocate at Intel Corporation adds: "With the release of this plugin, MVTec underlines the increasing market relevance of the OpenVINO toolkit. Through our cooperation, MVTec customers from the industrial machine vision market can now very easily access our wide hardware range of CPUs, GPUs and VPUs and are thus able to implement their deep learning applications even more efficiently."