December 30, 2021 | Developers Corner

Deep OCR – Tips and Tricks

Have you already experienced the performance boost by using Deep OCR compared to the classical rule‑based approaches? In this article, we’ll show you practical tips and tricks to further improve your Deep OCR results.

Deep OCR outperforms the classical approaches in many ways. The most obvious point is the better recognition rate. But also, the independence of the font type, the polarity and the orientation of the text are strong arguments for Deep OCR. In this article we will show you some tips and tricks how to further improve your Deep OCR results.

First, you should take your time to think about the mode which is suitable for your application. In Deep OCR two modes are available: ‘detection’ and ‘recognition’. The mode ‘detection’ finds connected characters as words in the image and gives you the bounding box of the word. The mode ‘recognition’ translates cropped images in machine-readable text.

Deep OCR detection example
Detection and Recognition in Deep OCR

In a lot of applications, both modes ‘detection’ and ‘recognition’ are needed. In this case you can use the mode 'auto'. Have in mind that HALCON provides a powerful toolbox to write your own algorithm to detect the text you are interested in. This could be very useful, if you are only interested in specific text lines in an image full of text, or if you would like to decrease your runtime.

In the following we give you some hints how to improve your Deep OCR performance in case of the modes ‘detection’ and ‘recognition’. But before evaluating the results, you should look at your image data and think about preprocessing methods such as enhancing the contrast.

Detection

If you want to improve your ‘detection’ result, you should take a look into the score maps. You can find the score maps in the DeepOcrResult handle. Especially, the character score map and the link score map can give you useful insights about the ‘detection’ results. This information could be used to adapt the important parameters ’detection_min_word_score’ and ‘detection_min_character_score’.

If your text is already horizontally aligned, set the parameter ‘detection_orientation’ = 0 and you will not have any issues with imperfectly aligned rectangles.

In case of large images with small text use the powerful parameter ‘detection_tiling’. Setting this parameter to 'true' splits the images internally into tiles. The tilling is done fully automatically, and you don't have to care about the tiled images, but you can simply enjoy the detected text. However, bear in mind that the runtime will increase, depending on the size of the processed image.

Recognition

If you are surprised by the results you get from the recognition mode, we recommend opening the DeepOcrResult handle and take a look into the preprocessed image which is used for the recognition. In many cases this image gives you already an explanation, why the ‘recognition’ fails. The most common issue is the length of the text line, which can be handled by setting the parameter 'recognition_image_width'. A detailed example can be found in the standard example ‘deep_ocr_workflow.hdev’.

Finally, it is always worth to reconsider whether Deep OCR is the right choice. Even if Deep OCR outperforms the rule-based approaches, there are still use cases (speed restrictions, specific font types, hardware limitations or pixel-precise segmentation) which justify the choice of classical approaches.

Published on: December 30, 2021

Further Success Stories

MVTec HALCON product icon
3D vision enables robots to “see” in the carpentry industry
As in many industrial areas, automation is advancing in furniture production as well. One example of this is MAB Möbel AG from Switzerland: with the support of HOMAG Bohrsysteme GmbH and MVTec Software GmbH, this furniture manufacturer automated the…
Show full Story
HALCON
Machinery
Robotics
3D Vision
OCR
MVTec HALCON product icon
Warehouse where cheese wheels age during the ripening process
Revolutionizing Cheese Production with AI and Machine Vision
The food industry is experiencing a transformative shift in quality control, due in part to advances in artificial intelligence (AI). When combined with rule-based machine vision, AI is enabling automation of processes that were previously impossible…
Show full Story
HALCON
Food & Beverage
Robotics
Anomaly Detection
Deep Learning
MVTec HALCON product icon
Dynamic OCR inspection with HALCON ensures maximum product quality
In the pharmaceutical industry, strict compliance regulations require medical product packaging to be correctly labeled before delivery. To meet these requirements, the Chinese company Shenzhen Jiangrun Xuneng Technology has developed a powerful mach…
Show full Story
HALCON
Medical Supplies & Pharmaceutical
Bar Code & 2D Code Reading
OCR
MVTec HALCON product icon
Automatisierte Transport- und Inspektionsstation für pharmazeutische Ampullen mit Machine-Vision-System von Aspen.
AI-powered machine vision automates quality inspection in the pharmaceutical industry
The pharmaceutical company Aspen is improving the quality inspection of filled ampoules with the MVTec HALCON machine vision software and the consulting and technical support services provided by MVTec. With deep learning methods, the company has sig…
Show full Story
HALCON
Medical Supplies & Pharmaceutical
Blob Analysis
Deep Learning
Matching
MVTec HALCON product icon
Workflow der Produktion zylindrischer Lithium-Ionen-Batterien mit verteilten Sensorsystemen und zentraler Deep-Learning-Auswertung mit MVTec HALCON.
MVTec HALCON’s deep learning helps Panasonic Energy to propel automotive battery production
Panasonic Energy manufactures automotive batteries, for which demand is increasing worldwide, at multiple sites in Japan and North America. The company recently implemented MVTec HALCON’s deep learning technologies on a large scale at its Kansas plan…
Show full Story
HALCON
Battery Production
Automotive
Deep Learning
Inspection
MVTec HALCON product icon
Advancing machine vision education at Reutlingen University
At Reutlingen University, Professor Arnd Buschhaus has been integrating MVTec HALCON into the teaching curriculum since 2018. HALCON is used extensively in courses related to robotics and machine vision, providing students with practical experience i…
Show full Story
Education, Research & Science
3D Vision
Blob Analysis
Classification
MVTec HALCON product icon
Robotic welding cell inspecting car body weld seams using machine vision.
Machine vision optimizes quality inspection in automotive production
Consistently high quality is an absolute must in automotive production. To ensure that welded connections in body shells meet these standards, DGH has developed an application that automatically inspects them and identifies anomalies. The MVTec HALCO…
Show full Story
HALCON
Automotive
Anomaly Detection
Deep Learning
Inspection
MVTec HALCON product icon
High-speed battery inspection using machine vision.
Machine Vision automates and optimizes battery inspection
A variety of defects can occur during battery production. Averna has developed a method for the automated inspection of batteries that reliably detects all conceivable defects. Here, the machine vision software MVTec HALCON plays a key role.
Show full Story
HALCON
Battery Production
Blob Analysis
Inspection
MVTec HALCON product icon
Automated robot cell handling vaccine vials with machine vision.
Machine Vision automates vaccine production
A global company needed to quickly ramp up vaccine production. Goldfuß engineering GmbH and SIMON IBV GmbH developed a robot-based solution for loading and unloading trolleys with the vaccine vials. The machine vision software HALCON ensures the seam…
Show full Story
HALCON
Robotics
Medical Supplies & Pharmaceutical
3D Vision
MVTec HALCON product icon
Micromechanical part measured with machine vision for high-precision inspection.
Machine vision improves the measuring process of precision and micro components
The precise inspection of very small precision components, for example in watchmaking, is a challenge. Petitpierre, the Swiss specialist for high-precision technology, has developed sophisticated applications with which micromechanical components can…
Show full Story
HALCON
Matching
Measuring
MVTec HALCON product icon
Industrial robots performing laser welding on battery cells guided by machine vision.
Machine vision accelerates battery production
High speed, precision, and reliability: These are the determining factors for battery production. To meet the rapidly growing demand for batteries, companies are developing increasingly efficient production processes. Laserax has developed a new syst…
Show full Story
HALCON
Battery Production
3D Calibration
Calibration
Matching
MVTec HALCON product icon
Robotic manufacturing cell assembling satellite panels with optical solar reflectors using machine vision.
Seeing robots process large work area with high precision
The automation specialist AKEOPLUS has developed an innovative robotic cell for the production of satellite panels at the global space manufacturer Thales Alenia Space. The special feature: robots place the components with high absolute accuracy to a…
Show full Story
HALCON
Robotics
3D Vision
Matching
MVTec HALCON product icon
Students and researchers using a robot with machine vision in a university lab to demonstrate the impact of MVTec HALCON on education and research.
Technical University of Applied Sciences Würzburg-Schweinfurt
At Technical University of Applied Sciences Würzburg-Schweinfurt (THWS), Professor Christian Zirkelbach is teaching robotics and machine vision at Faculty of Applied Natural Sciences and Humanities. He has integrated advanced machine vision tools int…
Show full Story
HALCON
Robotics
Education, Research & Science
3D Vision
Deep Learning
MVTec HALCON product icon
Aluminum bottles on a production line identified by OCR using machine vision for automated quality control.
Empty bottle? Not with Deep OCR
To identify products quickly and reliably, even in difficult circumstances, machine vision has proven its worth. The company Visione Artificiale also relies on machine vision for its system to trace aluminum bottles during production. Within this sys…
Show full Story
HALCON
Food & Beverage
OCR
MVTec HALCON product icon
Operating personnel using the PackCheck machine vision solution for quality control in food packaging production.
Machine vision for every taste
The Dutch company PackCheck BV ensures packaging quality in the food industry with a modular solution. Part of the solution is the machine vision software HALCON from MVTec Software GmbH. This enables the company to increase the efficiency of packagi…
Show full Story
HALCON
Food & Beverage
Bar Code & 2D Code Reading
Blob Analysis
Matching
OCR
MVTec HALCON product icon
Hand-eye calibration enabling precise alignment between camera and robot for accurate gripping of accessory bags.
Perfectly positioned plastic bags – with classic machine vision and deep learning
Consistently automated pick-and-place activities require the reliable gripping of differently shaped and translucent objects. TEKVISA has implemented a sophisticated application that enables reliable gripping even with complex surfaces with the help…
Show full Story
HALCON
Robotics
Deep Learning
MVTec HALCON product icon
Fully automated packaging inspection system using machine vision for inline quality control in food packaging.
Deep learning detects defects in the food industry
Automation specialist INNDEO has developed a sophisticated automation solution for quality control in the packaging industry. Thanks to machine vision and deep learning technologies, high speeds and defect detection rates are no longer a problem.
Show full Story
HALCON
Food & Beverage
Deep Learning
OCR
MVTec HALCON product icon
Bottle caps inspected by machine vision to verify print quality in beverage production.
Beverage industry: HALCON reliably checks bottle cap imprints
Machine vision offers enormous advantages for quality control applications. High accuracy and speed as well as high flexibility and availability are important for practical use. K&S Anlagenbau GmbH has implemented such an application for the beverage…
Show full Story
HALCON
Food & Beverage
Blob Analysis
Calibration
Matching
MVTec HALCON product icon
Robots and machine vision software interact perfectly
The Spanish robotics specialist Tekniker has developed a solution that allows chaotically lying parts to be automatically gripped and placed in an orderly manner. The integrated machine vision software MVTec HALCON uses 3D vision technologies to ensu…
Show full Story
HALCON
Robotics
Automotive
3D Vision
MVTec MERLIC product icon
Inspection setup for electrical connections using deep learning–based machine vision to detect defects.
An eye on everything with deep learning
Bosch Car Multimédia in Portugal specializes in the development and manufacture of electronic components for vehicle safety and dynamics, driver assistance, automated driving and car multimedia. The company uses the machine vision software MERLIC fro…
Show full Story
MERLIC
Automotive
Electric Components
Deep Learning
MVTec Software