MVTec Software GmbH
 

3D Vision Technology - 3D Matching

Featured in HALCON
Video about 3D matching with our software
Video: Pick-and-place application with 3D matching

With 3D matching, it is possible to recognize arbitrary 3D objects and to determine their 3D pose even with only one camera or depth sensor.

The 3D matching of MVTec HALCON is particularly used for 3D alignment, i.e., determining the 3D position and orientation of 3D objects from common or distance images, e.g., within automotive and robotics applications, pick-and-place applications (see an example in the video on the right), and bin picking.

The generic box finder facilitates pick-and-place-application.
The generic box finder locates boxes of different sizes without the need of training.

For pick-and-place applications, HALCON provides the generic box finder. It allows users to locate boxes of different sizes within a predefined range of height, width, and depth, removing the need to train a model. This makes many applications much more efficient – especially within the logistics and pharmaceutical industries, where usually boxes in a large variety of different sizes are used.

A further possibility is the measuring of geometric features and locating defects on complex 3D objects after 3D alignment.

3D matching
The object's 3D position and orientation is determined by matching multiple 2D views of a known 3D object.

To determine the 3D pose from common images, shape-based 3D matching is used. It extends the technology of shape-based matching to 3D by using multiple 2D views of the 3D object, represented by its CAD model. To determine the 3D pose from distance images, surface-based 3D matching is used. It combines 3D point cloud data and edge information from distance images. This allows the robust pose determination even for smooth objects without prominent edges, which would not show significant gray value edges in common images. To gain highest accuracy, both methods provide a refinement of the pose in the full 3D space.

3D matching with MVTec
Localizing a known object.
3D matching and alignment
Control of the robot’s grasping process.
3D matching
A reference object is compared with a test object to detect bent parts.
3D object inspection
The 3D surface inspection is done based on surface-based matching and object comparison.

Read Success Stories about 3D Vision

Food & Agriculture

Vision system sorts tomato seedlings - University of Wageningen

More than 150 million tons of tomatoes are produced every year around the world. With seedlings costing €0.25, plant growers such as Westland...

Automotive & Robotics

Electrode sheet inspection machine - Ayaha Engineering

For web inspection, a high resolution line scan camera is basically used. To stably process large images in high speed, a fast hardware processing...

Automotive & Robotics

Vision-guided robotic 'bartender' serves drinks - University of Brescia

Researchers led by professor Giovanna Sansoni at the Laboratory of Optoelectronics in the Department of Engineering at the University of Brescia,...

Packaging, Logistics & Identification

Machine Vision Inspects Biscuits – Machine Vision Technology Ltd.

As imaging software becomes more advanced and the latest 3D imaging tools open the doors to techniques that where not possible before, one of Europe's...

Automotive & Robotics

Vision-guided Robot Heads for Space – NASA

To support the work of astronauts on the International Space Station (ISS), NASA (Washington, DC), General Motors (Detroit, MI) and Oceaneering Space...

Automotive & Robotics

Novel gripper uses machine vision to automate packing - Helmut-Schmidt-University Hamburg

Combining a sophisticated gripping mechanism with machine vision allows packing systems to handle disparate objects

Machinery

Structured-light-based vision system inspects percussion caps – Tekniker

The Centro Tecnológico Tekniker has developed a very fast system to inspect percussion caps.

Percussion caps are a critical component used in...

Automotive & Robotics

Vision System Simplifies Robotic Fruit Picking – ACRO Institute

Robotic apple picker relies on a camera inside the gripper and off-the-shelf software

 

Automotive & Robotics

3D Calibration for Inspection

Stereo camera system eases highly precise measurement