MVTec Software GmbH
 

3D Vision Technology - 3D Matching

Featured in HALCON
Video about 3D matching with our software
Video: Pick-and-place application with 3D matching

With 3D matching, it is possible to recognize arbitrary 3D objects and to determine their 3D pose even with only one camera or depth sensor.

The 3D matching of MVTec HALCON is particularly used for 3D alignment, i.e., determining the 3D position and orientation of 3D objects from common or distance images, e.g., within automotive and robotics applications, pick-and-place applications (see an example in the video on the right), and bin picking.

The generic box finder facilitates pick-and-place-application.
The generic box finder locates boxes of different sizes without the need of training.

For pick-and-place applications, HALCON provides the generic box finder. It allows users to locate boxes of different sizes within a predefined range of height, width, and depth, removing the need to train a model. This makes many applications much more efficient – especially within the logistics and pharmaceutical industries, where usually boxes in a large variety of different sizes are used.

A further possibility is the measuring of geometric features and locating defects on complex 3D objects after 3D alignment.

3D matching
The object's 3D position and orientation is determined by matching multiple 2D views of a known 3D object.

To determine the 3D pose from common images, shape-based 3D matching is used. It extends the technology of shape-based matching to 3D by using multiple 2D views of the 3D object, represented by its CAD model. To determine the 3D pose from distance images, surface-based 3D matching is used. It combines 3D point cloud data and edge information from distance images. This allows the robust pose determination even for smooth objects without prominent edges, which would not show significant gray value edges in common images. To gain highest accuracy, both methods provide a refinement of the pose in the full 3D space.

3D matching with MVTec
Localizing a known object.
3D matching and alignment
Control of the robot’s grasping process.
3D matching
A reference object is compared with a test object to detect bent parts.
3D object inspection
The 3D surface inspection is done based on surface-based matching and object comparison.

Read Success Stories about 3D Vision

References

Fast automated inspection of seals through 3D vision with HALCON

Brett Martin is a producer of different plastic solutions like, amongst others, push-fit products in the area of plumbing and drainage. They hired Fis...

References

Bin-picking application with MVTec HALCON boosts productivity

Short cycle times, little scrap, minimal stock-keeping – the factory of the future is networked and highly economical. This requires increasingly...

References

Fully automated dispense and labeling system for pharmaceutical products runs with MVTec HALCON

MVTec’s Certified Integration Partner Crave Technical developed a vision system for an automatic unit-of-use dispense and labeling system for...

References

MVTec HALCON controls linear conveyor and robot system for fully automatic assembly of components

The complexity of the automation technology is constantly growing. On the one hand, this is due to the increasing variety of parts, and on the other...

References

The sweet pepper robot SWEEPER detects and picks ripe crops using MVTec HALCON

The Wageningen University & Research (WUR) in the Netherlands developed a greenhouse harvesting robot, which is able to pick ripe crops. The shape-...

Automotive & Robotics

Science Project: Proprioceptive Industrial Robot Gripper – Kinemetrix

Kinemetrix, based in Lexington, KY, specializes in advanced solutions for robotic automation. This spring, they supported a team of high school...

References

3D Vision Guided Robotic Assembly - Kinemetrix

Using HALCON's surface-based 3D matching technology and 3D point cloud data, the position and orientation of parts on an automated clip assembly cell...

Automotive & Robotics

Completely under Control: Bin-Picking-System Allows for Better Efficiency in the Production of Differential Gears - Jtekt Torsen

This article only exists as German version. To read the article in German, please follow this link.

Automotive & Robotics

Vision Helps Spot Failures on the Rail - Network Rail Ltd.

An automated vision inspection system relieves rail workers from the task of manually inspecting rail infrastructure

Machinery

Vision Q.400 – The Universal Inspection Software for Industrial Image Processing

The software package Vision Q.400 from Q.VITEC was first created 20 years ago in cooperation with MVTec. Since this time, it has been continuously...