MVTec Software GmbH

3D Vision

Featured in HALCON
3D Vision
3D reconstruction: the 3D shape of an object is reconstructed from the images of a two camera setup.
3D Vision
3D alignment: using a camera image and various image processing functions, the 3D pose of an object is determined. This data is used to control the robot.

3D Vision
3D object processing: Errors are detected using 3D surface inspection.
3D Vision
3D object processing: A 3D object model is segmented into connected components.

In industrial applications, e.g., within the Industrial Internet of Things, 3D vision is the acquisition, processing, and utilization of image-derived three dimensional data to affect or control a mechanical system or process. This allows to realize applications that could not be solved with 2D approaches. Technologies like HALCON's "3D scene flow" can even be used to predict the motion of objects (try out HALCON for free here).

As "eye of the production" MVTec’s software supports all aspects of 3D vision, such as:

    • 3D reconstruction
      Image acquisition Interfaces are provided for numerous commercially available 3D sensors.
      MVTec software products also offer tools for constructing 3D depth maps or point clouds from image techniques like multi-view stereo or sheet of light imaging. Furthermore the software  enables smoothing, sub-sampling, and triangulation of points for efficient processing and improved visualization.

    • 3D registration
      MVTec software allows customers to generate a complete 360 degree representation of an object by aligning 3D point clouds from multiple 3D images.
    Surface-based 3D matching by MVTec
    Video: 3D vision guided robotic assembly using surface-based 3D matching.

    • 3D-Object Localization Methods:

      • Surface-based 3D matching
        This tool searches for arbitrarily shaped 3D objects in a scene and determines their pose in 3D space. It locates multiple objects in a single scene even if objects are partially occluded or not entirely contained in the scene.
      • Generic Box Finder
        Moreover, the generic box finder is able to locate boxes of different sizes within a predefined range of height, width, and depth, removing the need to train a model. This is a powerful tool for robotic bin picking and automated portioning systems as well as many more 3D machine vision applications.


    • 3D object processing
      Similar to blob analysis in 2D, MVTec’s software
      enables developers to measure and extract various features from 3D point clouds as well as segment point clouds based on those features. Background points can easily be removed via thresholding, and point clouds can be intersected by a plane to create a 2D cross-section profile.

    • 3D surface inspection
      Alignment of an acquired 3D point cloud object with a known object model or point cloud template enables users to check for and locate variations and deviations in the surfaces profile of manufactured parts. Our software also supports deflectometry.This method is used to inspect specular and partially specular surfaces. It uses the reflections on specular objects by observing mirror images of known patterns and their deformations on the surface.

    Read Success Stories about 3D Vision


    Fast automated inspection of seals through 3D vision with HALCON

    Brett Martin is a producer of different plastic solutions like, amongst others, push-fit products in the area of plumbing and drainage. They hired Fis...


    Bin-picking application with MVTec HALCON boosts productivity

    Short cycle times, little scrap, minimal stock-keeping – the factory of the future is networked and highly economical. This requires increasingly...


    Fully automated dispense and labeling system for pharmaceutical products runs with MVTec HALCON

    MVTec’s Certified Integration Partner Crave Technical developed a vision system for an automatic unit-of-use dispense and labeling system for...


    MVTec HALCON controls linear conveyor and robot system for fully automatic assembly of components

    The complexity of the automation technology is constantly growing. On the one hand, this is due to the increasing variety of parts, and on the other...


    The sweet pepper robot SWEEPER detects and picks ripe crops using MVTec HALCON

    The Wageningen University & Research (WUR) in the Netherlands developed a greenhouse harvesting robot, which is able to pick ripe crops. The shape-...

    Automotive & Robotics

    Science Project: Proprioceptive Industrial Robot Gripper – Kinemetrix

    Kinemetrix, based in Lexington, KY, specializes in advanced solutions for robotic automation. This spring, they supported a team of high school...


    3D Vision Guided Robotic Assembly - Kinemetrix

    Using HALCON's surface-based 3D matching technology and 3D point cloud data, the position and orientation of parts on an automated clip assembly cell...

    Automotive & Robotics

    Completely under Control: Bin-Picking-System Allows for Better Efficiency in the Production of Differential Gears - Jtekt Torsen

    This article only exists as German version. To read the article in German, please follow this link.

    Automotive & Robotics

    Vision Helps Spot Failures on the Rail - Network Rail Ltd.

    An automated vision inspection system relieves rail workers from the task of manually inspecting rail infrastructure


    Vision Q.400 – The Universal Inspection Software for Industrial Image Processing

    The software package Vision Q.400 from Q.VITEC was first created 20 years ago in cooperation with MVTec. Since this time, it has been continuously...