December 30, 2021 | Developers Corner

Deep OCR – Tips and Tricks

Have you already experienced the performance boost by using Deep OCR compared to the classical rule‑based approaches? In this article, we’ll show you practical tips and tricks to further improve your Deep OCR results.

Deep OCR outperforms the classical approaches in many ways. The most obvious point is the better recognition rate. But also, the independence of the font type, the polarity and the orientation of the text are strong arguments for Deep OCR. In this article we will show you some tips and tricks how to further improve your Deep OCR results.

First, you should take your time to think about the mode which is suitable for your application. In Deep OCR two modes are available: ‘detection’ and ‘recognition’. The mode ‘detection’ finds connected characters as words in the image and gives you the bounding box of the word. The mode ‘recognition’ translates cropped images in machine-readable text.

Deep OCR detection example
Detection and Recognition in Deep OCR

In a lot of applications, both modes ‘detection’ and ‘recognition’ are needed. In this case you can use the mode 'auto'. Have in mind that HALCON provides a powerful toolbox to write your own algorithm to detect the text you are interested in. This could be very useful, if you are only interested in specific text lines in an image full of text, or if you would like to decrease your runtime.

In the following we give you some hints how to improve your Deep OCR performance in case of the modes ‘detection’ and ‘recognition’. But before evaluating the results, you should look at your image data and think about preprocessing methods such as enhancing the contrast.

Detection

If you want to improve your ‘detection’ result, you should take a look into the score maps. You can find the score maps in the DeepOcrResult handle. Especially, the character score map and the link score map can give you useful insights about the ‘detection’ results. This information could be used to adapt the important parameters ’detection_min_word_score’ and ‘detection_min_character_score’.

If your text is already horizontally aligned, set the parameter ‘detection_orientation’ = 0 and you will not have any issues with imperfectly aligned rectangles.

In case of large images with small text use the powerful parameter ‘detection_tiling’. Setting this parameter to 'true' splits the images internally into tiles. The tilling is done fully automatically, and you don't have to care about the tiled images, but you can simply enjoy the detected text. However, bear in mind that the runtime will increase, depending on the size of the processed image.

Recognition

If you are surprised by the results you get from the recognition mode, we recommend opening the DeepOcrResult handle and take a look into the preprocessed image which is used for the recognition. In many cases this image gives you already an explanation, why the ‘recognition’ fails. The most common issue is the length of the text line, which can be handled by setting the parameter 'recognition_image_width'. A detailed example can be found in the standard example ‘deep_ocr_workflow.hdev’.

Finally, it is always worth to reconsider whether Deep OCR is the right choice. Even if Deep OCR outperforms the rule-based approaches, there are still use cases (speed restrictions, specific font types, hardware limitations or pixel-precise segmentation) which justify the choice of classical approaches.

Published on: December 30, 2021

Further Success Stories

MVTec HALCON product icon
Warehouse where cheese wheels age during the ripening process
Revolutionizing Cheese Production with AI and Machine Vision
The food industry is experiencing a transformative shift in quality control, due in part to advances in artificial intelligence (AI). When combined with rule-based machine vision, AI is enabling automation of processes that were previously impossible…
Show full Story
HALCON
Food & Beverage
Robotics
Anomaly Detection
Deep Learning
MVTec HALCON product icon
Dynamic OCR inspection with HALCON ensures maximum product quality
In the pharmaceutical industry, strict compliance regulations require medical product packaging to be correctly labeled before delivery. To meet these requirements, the Chinese company Shenzhen Jiangrun Xuneng Technology has developed a powerful mach…
Show full Story
HALCON
Medical Supplies & Pharmaceutical
Bar Code & 2D Code Reading
OCR
MVTec HALCON product icon
Automatisierte Transport- und Inspektionsstation für pharmazeutische Ampullen mit Machine-Vision-System von Aspen.
AI-powered machine vision automates quality inspection in the pharmaceutical industry
The pharmaceutical company Aspen is improving the quality inspection of filled ampoules with the MVTec HALCON machine vision software and the consulting and technical support services provided by MVTec. With deep learning methods, the company has sig…
Show full Story
HALCON
Medical Supplies & Pharmaceutical
Blob Analysis
Deep Learning
Matching
MVTec HALCON product icon
University of Paderborn, Heinz Nixdorf Institute
The Heinz Nixdorf Institute (HNI) joined the MVTec on Campus program in 2022. The University of Paderborn is a renowned research and educational institution specializing in the field of computer science and its applications in the context of digital…
Show full Story
HALCON
Robotics
Education, Research & Science
MVTec HALCON product icon
Intelligent Image Recognition for Automotive Logistics
An intelligent, database-based image recognition system supports order picking in automotive logistics. It shows staff the correct component, uses cameras to verify that packaging is ready for shipment, and enables seamless documentation. The solutio…
Show full Story
HALCON
Automotive
Packaging & Logistics
Object Detection
MVTec HALCON product icon
Line-scan vision system diagram used for inspecting printed materials with defect detection along a conveyor.
Industrial Inspection: Line-scan-based vision system tackles color print inspection - Daheng Image Vision
Daheng Image Vision uses a line-scan vision system with two Teledyne DALSA cameras and MVTec HALCON to inspect color prints on conveyor belts at 300 m/min. The system reliably detects ink spots, embossing errors, and misregistration, enabling compreh…
Show full Story
HALCON
Glass, Metal, Paper, Foil & Printing
Alignment
Classification
Matching
MVTec HALCON product icon
X-ray film dosimeter badges and opened cassettes with different metal filters inspected by a machine vision system.
Vision System Inspects X-ray Dosimeter Badges – Helmholtz-Zentrum
Helmholtz-Zentrum Munich uses HALCON to fully automate the evaluation of approximately 120,000 X-ray dosimeter films per month. Optical density, film type, and dosimeter numbers are precisely captured, and radiation sources are analyzed. The system s…
Show full Story
HALCON
Medical Supplies & Pharmaceutical
Calibration
Filtering
Matching
Measuring
OCR
MVTec HALCON product icon
Plastic rings on a conveyor used for automated machine vision inspection.
Closing the Ring – NP Plastics
NP Plastics in the Netherlands manufactures small plastic rings used in binder closing mechanisms. To increase throughput and improve quality, the company deployed a machine vision system with two AVT FireWire cameras, LED illumination, and HALCON so…
Show full Story
HALCON
Glass, Metal, Paper, Foil & Printing
Blob Analysis
Measuring
MVTec HALCON product icon
Workflow der Produktion zylindrischer Lithium-Ionen-Batterien mit verteilten Sensorsystemen und zentraler Deep-Learning-Auswertung mit MVTec HALCON.
MVTec HALCON’s deep learning helps Panasonic Energy to propel automotive battery production
Panasonic Energy manufactures automotive batteries, for which demand is increasing worldwide, at multiple sites in Japan and North America. The company recently implemented MVTec HALCON’s deep learning technologies on a large scale at its Kansas plan…
Show full Story
HALCON
Battery Production
Automotive
Deep Learning
Inspection
MVTec HALCON product icon
Advancing machine vision education at Reutlingen University
At Reutlingen University, Professor Arnd Buschhaus has been integrating MVTec HALCON into the teaching curriculum since 2018. HALCON is used extensively in courses related to robotics and machine vision, providing students with practical experience i…
Show full Story
Education, Research & Science
3D Vision
Blob Analysis
Classification
MVTec HALCON product icon
Robotic welding cell inspecting car body weld seams using machine vision.
Machine vision optimizes quality inspection in automotive production
Consistently high quality is an absolute must in automotive production. To ensure that welded connections in body shells meet these standards, DGH has developed an application that automatically inspects them and identifies anomalies. The MVTec HALCO…
Show full Story
HALCON
Automotive
Anomaly Detection
Deep Learning
Inspection
MVTec HALCON product icon
High-speed battery inspection using machine vision.
Machine Vision automates and optimizes battery inspection
A variety of defects can occur during battery production. Averna has developed a method for the automated inspection of batteries that reliably detects all conceivable defects. Here, the machine vision software MVTec HALCON plays a key role.
Show full Story
HALCON
Battery Production
Blob Analysis
Inspection
MVTec HALCON product icon
Automated robot cell handling vaccine vials with machine vision.
Machine Vision automates vaccine production
A global company needed to quickly ramp up vaccine production. Goldfuß engineering GmbH and SIMON IBV GmbH developed a robot-based solution for loading and unloading trolleys with the vaccine vials. The machine vision software HALCON ensures the seam…
Show full Story
HALCON
Robotics
Medical Supplies & Pharmaceutical
3D Vision
MVTec HALCON product icon
Micromechanical part measured with machine vision for high-precision inspection.
Machine vision improves the measuring process of precision and micro components
The precise inspection of very small precision components, for example in watchmaking, is a challenge. Petitpierre, the Swiss specialist for high-precision technology, has developed sophisticated applications with which micromechanical components can…
Show full Story
HALCON
Matching
Measuring
MVTec HALCON product icon
Industrial robots performing laser welding on battery cells guided by machine vision.
Machine vision accelerates battery production
High speed, precision, and reliability: These are the determining factors for battery production. To meet the rapidly growing demand for batteries, companies are developing increasingly efficient production processes. Laserax has developed a new syst…
Show full Story
HALCON
Battery Production
3D Calibration
Calibration
Matching
MVTec HALCON product icon
Robotic manufacturing cell assembling satellite panels with optical solar reflectors using machine vision.
Seeing robots process large work area with high precision
The automation specialist AKEOPLUS has developed an innovative robotic cell for the production of satellite panels at the global space manufacturer Thales Alenia Space. The special feature: robots place the components with high absolute accuracy to a…
Show full Story
HALCON
Robotics
3D Vision
Matching
MVTec HALCON product icon
Students and researchers using a robot with machine vision in a university lab to demonstrate the impact of MVTec HALCON on education and research.
Technical University of Applied Sciences Würzburg-Schweinfurt
At Technical University of Applied Sciences Würzburg-Schweinfurt (THWS), Professor Christian Zirkelbach is teaching robotics and machine vision at Faculty of Applied Natural Sciences and Humanities. He has integrated advanced machine vision tools int…
Show full Story
HALCON
Robotics
Education, Research & Science
3D Vision
Deep Learning
MVTec HALCON product icon
Aluminum bottles on a production line identified by OCR using machine vision for automated quality control.
Empty bottle? Not with Deep OCR
To identify products quickly and reliably, even in difficult circumstances, machine vision has proven its worth. The company Visione Artificiale also relies on machine vision for its system to trace aluminum bottles during production. Within this sys…
Show full Story
HALCON
Food & Beverage
OCR
MVTec HALCON product icon
Operating personnel using the PackCheck machine vision solution for quality control in food packaging production.
Machine vision for every taste
The Dutch company PackCheck BV ensures packaging quality in the food industry with a modular solution. Part of the solution is the machine vision software HALCON from MVTec Software GmbH. This enables the company to increase the efficiency of packagi…
Show full Story
HALCON
Food & Beverage
Bar Code & 2D Code Reading
Blob Analysis
Matching
OCR
MVTec HALCON product icon
Hand-eye calibration enabling precise alignment between camera and robot for accurate gripping of accessory bags.
Perfectly positioned plastic bags – with classic machine vision and deep learning
Consistently automated pick-and-place activities require the reliable gripping of differently shaped and translucent objects. TEKVISA has implemented a sophisticated application that enables reliable gripping even with complex surfaces with the help…
Show full Story
HALCON
Robotics
Deep Learning
MVTec Software