PySceneText.PySceneText Class Reference

Detect and decode English or Chinese text on NPU using TIM-VX. More...

Public Member Functions
	__init__ (self)
	Constructor.
	processGUI (self, inframe, helper)
	Process function with GUI output.

Public Attributes
	modelname
	charset
	tdname
	recognizer
	detector
	timer
	w
	h

Detailed Description

Detect and decode English or Chinese text on NPU using TIM-VX.

This module runs on the JeVois-Pro NPU using a quantized deep neural network. It is derived from https://github.com/opencv/opencv_zoo/tree/master/models/text_recognition_crnn See LICENSE for license information.

By default, English is used, but you can change that to Chinese in the constructor

This module is mainly intended as a tutorial for how to run quantized int8 DNNs on the NPU using OpenCV and TIM-VX, here achieved through only small modifications of code from https://github.com/opencv/opencv_zoo - in particular, the core class for this model, LPD_YuNet, was not modified at all, and only the demo code was edited to use the JeVois GUI Helper for fast OpenGL drawing as opposed to slow drawings into OpenCV images.

Author

Laurent Itti

Display Name:

PySceneText

Videomapping:

JVUI 0 0 30.0 CropScale=RGB24@512x288:YUYV 1920 1080 30.0 JeVois PySceneText

Email:

itti@usc.edu

Address:

University of Southern California, HNB-07A, 3641 Watt Way, Los Angeles, CA 90089-2520, USA

Copyright

Copyright (C) 2022 by Laurent Itti, iLab and the University of Southern California

Main URL:

http://jevois.org

Support URL:

http://jevois.org/doc

Other URL:

http://iLab.usc.edu

License:

GPL v3

Distribution:

Unrestricted

Restrictions:

None

Definition at line 37 of file PySceneText.py.

Constructor & Destructor Documentation

__init__()

PySceneText.PySceneText.__init__

(

self

)

Constructor.

Definition at line 40 of file PySceneText.py.

Member Function Documentation

processGUI()

PySceneText.PySceneText.processGUI	(		self,
			inframe,
			helper
	)

Process function with GUI output.

Definition at line 79 of file PySceneText.py.

References PySceneText.PySceneText.charset, AprilTag.AprilTag.detector, PySceneText.PySceneText.detector, PythonObject6D.PythonObject6D.detector, jevois::CameraCalibration.h, env_dims.h, PyLicensePlate.PyLicensePlate.h, PySceneText.PySceneText.h, PyLicensePlate.PyLicensePlate.modelname, PyLLM.PyLLM.modelname, PySceneText.PySceneText.modelname, PySceneText.PySceneText.recognizer, PySceneText.PySceneText.tdname, AprilTag.AprilTag.timer, FirstPython.FirstPython.timer, PyClassificationDNN.PyClassificationDNN.timer, PyCoralClassify.PyCoralClassify.timer, PyCoralDetect.PyCoralDetect.timer, PyCoralSegment.PyCoralSegment.timer, PyDetectionDNN.PyDetectionDNN.timer, PyDMTX.PyDMTX.timer, PyEmotion.PyEmotion.timer, PyFaceMesh.PyFaceMesh.timer, PyHandDetector.PyHandDetector.timer, PyLicensePlate.PyLicensePlate.timer, PyObjectron.PyObjectron.timer, PyPoseDetector.PyPoseDetector.timer, PySceneText.PySceneText.timer, PySelfie.PySelfie.timer, PythonObject6D.PythonObject6D.timer, PythonOpenCV.PythonOpenCV.timer, PythonParallel.PythonParallel.timer, PythonSandbox.PythonSandbox.timer, PythonTest.PythonTest.timer, jevois::CameraCalibration.w, TinyImGUIdemo.w, env_dims.w, PyLicensePlate.PyLicensePlate.w, and PySceneText.PySceneText.w.

Member Data Documentation

charset

PySceneText.PySceneText.charset

Definition at line 48 of file PySceneText.py.

Referenced by PySceneText.PySceneText.processGUI().

detector

PySceneText.PySceneText.detector

Definition at line 62 of file PySceneText.py.

Referenced by AprilTag.AprilTag.processGUI(), PySceneText.PySceneText.processGUI(), AprilTag.AprilTag.processNoUSB(), and AprilTag.AprilTag.setDic().

h

PySceneText.PySceneText.h

Definition at line 75 of file PySceneText.py.

Referenced by PyLicensePlate.PyLicensePlate.processGUI(), and PySceneText.PySceneText.processGUI().

modelname

PySceneText.PySceneText.modelname

Definition at line 47 of file PySceneText.py.

Referenced by PyLicensePlate.PyLicensePlate.processGUI(), PyLLM.PyLLM.processGUI(), and PySceneText.PySceneText.processGUI().

recognizer

PySceneText.PySceneText.recognizer

Definition at line 59 of file PySceneText.py.

Referenced by PySceneText.PySceneText.processGUI().

tdname

PySceneText.PySceneText.tdname

Definition at line 49 of file PySceneText.py.

Referenced by PySceneText.PySceneText.processGUI().

timer

PySceneText.PySceneText.timer

Definition at line 72 of file PySceneText.py.

Referenced by FirstPython.FirstPython.process(), PyClassificationDNN.PyClassificationDNN.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyDMTX.PyDMTX.process(), PythonObject6D.PythonObject6D.process(), PythonOpenCV.PythonOpenCV.process(), PythonParallel.PythonParallel.process(), PythonSandbox.PythonSandbox.process(), AprilTag.AprilTag.processGUI(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), PyCoralSegment.PyCoralSegment.processGUI(), PyFaceMesh.PyFaceMesh.processGUI(), PyHandDetector.PyHandDetector.processGUI(), PyLicensePlate.PyLicensePlate.processGUI(), PyObjectron.PyObjectron.processGUI(), PyPoseDetector.PyPoseDetector.processGUI(), PySceneText.PySceneText.processGUI(), PySelfie.PySelfie.processGUI(), PythonOpenCV.PythonOpenCV.processGUI(), PythonSandbox.PythonSandbox.processGUI(), PythonTest.PythonTest.processGUI(), FirstPython.FirstPython.processNoUSB(), PythonObject6D.PythonObject6D.processNoUSB(), and PythonSandbox.PythonSandbox.processNoUSB().

w

PySceneText.PySceneText.w

Definition at line 75 of file PySceneText.py.

Referenced by PyLicensePlate.PyLicensePlate.processGUI(), and PySceneText.PySceneText.processGUI().

---

The documentation for this class was generated from the following file:

• src/Modules/PySceneText/PySceneText.py