MVTec Software GmbH
 

3D Vision

Featured in HALCON
3D Vision
3D reconstruction: the 3D shape of an object is reconstructed from the images of a two camera setup.
3D Vision
3D alignment: using a camera image and various image processing functions, the 3D pose of an object is determined. This data is used to control the robot.

3D Vision
3D object processing: Errors are detected using 3D surface inspection.
3D Vision
3D object processing: A 3D object model is segmented into connected components.

In industrial applications, e.g., within the Industrial Internet of Things, 3D vision is the acquisition, processing, and utilization of image-derived three dimensional data to affect or control a mechanical system or process. This allows to realize applications that could not be solved with 2D approaches. Technologies like HALCON's "3D scene flow" can even be used to predict the motion of objects (try out HALCON for free here).


As "eye of the production" MVTec’s software supports all aspects of 3D vision, such as:

    • 3D reconstruction
      Image acquisition Interfaces are provided for numerous commercially available 3D sensors.
      MVTec software products also offer tools for constructing 3D depth maps or point clouds from image techniques like multi-view stereo or sheet of light imaging. Furthermore the software  enables smoothing, sub-sampling, and triangulation of points for efficient processing and improved visualization.

    • 3D registration
      MVTec software allows customers to generate a complete 360 degree representation of an object by aligning 3D point clouds from multiple 3D images.
    Surface-based 3D matching by MVTec
    Video: 3D vision guided robotic assembly using surface-based 3D matching.

    • 3D-Object Localization Methods:

      • Surface-based 3D matching
        This tool searches for arbitrarily shaped 3D objects in a scene and determines their pose in 3D space. It locates multiple objects in a single scene even if objects are partially occluded or not entirely contained in the scene.
      • Generic Box Finder
        Moreover, the generic box finder is able to locate boxes of different sizes within a predefined range of height, width, and depth, removing the need to train a model. This is a powerful tool for robotic bin picking and automated portioning systems as well as many more 3D machine vision applications.

     

    • 3D object processing
      Similar to blob analysis in 2D, MVTec’s software
      enables developers to measure and extract various features from 3D point clouds as well as segment point clouds based on those features. Background points can easily be removed via thresholding, and point clouds can be intersected by a plane to create a 2D cross-section profile.

    • 3D surface inspection
      Alignment of an acquired 3D point cloud object with a known object model or point cloud template enables users to check for and locate variations and deviations in the surfaces profile of manufactured parts. Our software also supports deflectometry.This method is used to inspect specular and partially specular surfaces. It uses the reflections on specular objects by observing mirror images of known patterns and their deformations on the surface.

    Read Success Stories about 3D Vision

    References

    Vision system sorts tomato seedlings - University of Wageningen

    More than 150 million tons of tomatoes are produced every year around the world. With seedlings costing €0.25, plant growers such as Westland...

    Automotive & Robotics

    Electrode sheet inspection machine - Ayaha Engineering

    For web inspection, a high resolution line scan camera is basically used. To stably process large images in high speed, a fast hardware processing...

    Automotive & Robotics

    Vision-guided robotic 'bartender' serves drinks - University of Brescia

    Researchers led by professor Giovanna Sansoni at the Laboratory of Optoelectronics in the Department of Engineering at the University of Brescia,...

    References

    Machine Vision Inspects Biscuits – Machine Vision Technology Ltd.

    As imaging software becomes more advanced and the latest 3D imaging tools open the doors to techniques that where not possible before, one of Europe's...

    Automotive & Robotics

    Vision-guided Robot Heads for Space – NASA

    To support the work of astronauts on the International Space Station (ISS), NASA (Washington, DC), General Motors (Detroit, MI) and Oceaneering Space...

    Automotive & Robotics

    Novel gripper uses machine vision to automate packing - Helmut-Schmidt-University Hamburg

    Combining a sophisticated gripping mechanism with machine vision allows packing systems to handle disparate objects

    Machinery

    Structured-light-based vision system inspects percussion caps – Tekniker

    The Centro Tecnológico Tekniker has developed a very fast system to inspect percussion caps.

    Percussion caps are a critical component used in...

    References

    Vision System Simplifies Robotic Fruit Picking – ACRO Institute

    Robotic apple picker relies on a camera inside the gripper and off-the-shelf software

     

    Automotive & Robotics

    3D Calibration for Inspection

    Stereo camera system eases highly precise measurement