PyCoralClassify.PyCoralClassify Class Reference

Object recognition using Coral Edge TPU. More...

Public Member Functions
def	__init__ (self)
	Constructor. More...
def	process (self, inframe, outframe)
	JeVois main processing function. More...
def	processGUI (self, inframe, helper)
	Process function with GUI output. More...

Public Attributes
	threshold
	rgb
	model
	labels
	interpreter
	timer

Detailed Description

Object recognition using Coral Edge TPU.

This module runs an object classification deep neural network using the Coral TPU library. It only works on JeVois-Pro platform equipped with an Edge TPU add-on card. Classification (recognition) networks analyze a central portion of the whole scene and produce identity labels and confidence scores about what the object in the field of view might be.

This module supports networks implemented in TensorFlow-Lite and ported to Edge TPU/

Included with the standard JeVois distribution are:

• MobileNetV3
• more to come, please contribute!

See the module's constructor (init) code and select a value for model to switch network.

Object category names for models trained on ImageNet are at https://github.com/jevois/jevoisbase/blob/master/share/opencv-dnn/classification/synset_words.txt

Sometimes it will make mistakes! The performance of SqueezeNet v1.1 is about 56.1% correct (mean average precision, top-1) on the ImageNet test set.

This module is adapted from the sample code: https://github.com/google-coral/pycoral/blob/master/examples/classify_image.py

More pre-trained models are available at https://coral.ai/models/

Author

Laurent Itti

Videomapping:

YUYV 320 264 30.0 YUYV 320 240 30.0 JeVois PyClassificationDNN

Email:

itti@.nosp@m.usc..nosp@m.edu

Address:

880 W 1st St Suite 807, Los Angeles CA 90012, USA

Copyright

Copyright (C) 2020 by Laurent Itti

Main URL:

http://jevois.org

Support URL:

http://jevois.org

Other URL:

http://jevois.org

License:

GPL v3

Distribution:

Unrestricted

Restrictions:

None

Definition at line 53 of file PyCoralClassify.py.

Constructor & Destructor Documentation

__init__()

def PyCoralClassify.PyCoralClassify.__init__

(

self

)

Constructor.

Definition at line 56 of file PyCoralClassify.py.

References jevois.getNumInstalledTPUs().

Member Function Documentation

process()

def PyCoralClassify.PyCoralClassify.process	(		self,
			inframe,
			outframe
	)

JeVois main processing function.

Definition at line 83 of file PyCoralClassify.py.

References PyCoralClassify.PyCoralClassify.interpreter, TensorFlow.interpreter, mobilenet_v1.MobileNetV1.labels, mobilenet_v2.MobileNetV2.labels, PyCoralClassify.PyCoralClassify.labels, TensorFlow.labels, mobilenet_v1.MobileNetV1.model, mobilenet_v2.MobileNetV2.model, mp_palmdet.MPPalmDet.model, lpd_yunet.LPD_YuNet.model, PyNetORT.PyNetORT.model, PyNetURetinex.PyNetURetinex.model, PyNetOpenCV.PyNetOpenCV.model, PyCoralClassify.PyCoralClassify.model, PyClassificationDNN.PyClassificationDNN.model, TensorFlow.model, PyClassificationDNN.PyClassificationDNN.rgb, PyCoralClassify.PyCoralClassify.rgb, PyCoralClassify.PyCoralClassify.threshold, PyModule::__MODULE__.timer, PythonTutorial2::PythonTutorial2.timer, PyCoralClassify.PyCoralClassify.timer, PyClassificationDNN.PyClassificationDNN.timer, and FirstPython.FirstPython.timer.

processGUI()

def PyCoralClassify.PyCoralClassify.processGUI	(		self,
			inframe,
			helper
	)

Process function with GUI output.

Definition at line 126 of file PyCoralClassify.py.

References PyCoralClassify.PyCoralClassify.interpreter, TensorFlow.interpreter, mobilenet_v1.MobileNetV1.labels, mobilenet_v2.MobileNetV2.labels, PyCoralClassify.PyCoralClassify.labels, TensorFlow.labels, mobilenet_v1.MobileNetV1.model, mobilenet_v2.MobileNetV2.model, mp_palmdet.MPPalmDet.model, lpd_yunet.LPD_YuNet.model, PyNetORT.PyNetORT.model, PyNetURetinex.PyNetURetinex.model, PyNetOpenCV.PyNetOpenCV.model, PyCoralClassify.PyCoralClassify.model, PyClassificationDNN.PyClassificationDNN.model, TensorFlow.model, PyClassificationDNN.PyClassificationDNN.rgb, PyCoralClassify.PyCoralClassify.rgb, PyCoralClassify.PyCoralClassify.threshold, PythonTutorial2::PythonTutorial2.timer, PyModule::__MODULE__.timer, PyCoralClassify.PyCoralClassify.timer, PyClassificationDNN.PyClassificationDNN.timer, and FirstPython.FirstPython.timer.

Member Data Documentation

interpreter

PyCoralClassify.PyCoralClassify.interpreter

Definition at line 76 of file PyCoralClassify.py.

Referenced by PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralSegment.PyCoralSegment.process(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), and PyCoralSegment.PyCoralSegment.processGUI().

labels

PyCoralClassify.PyCoralClassify.labels

Definition at line 73 of file PyCoralClassify.py.

Referenced by PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralClassify.PyCoralClassify.processGUI(), and PyCoralDetect.PyCoralDetect.processGUI().

model

PyCoralClassify.PyCoralClassify.model

Definition at line 64 of file PyCoralClassify.py.

Referenced by PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyLicensePlate.PyLicensePlate.processGUI(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), and PyCoralSegment.PyCoralSegment.processGUI().

rgb

PyCoralClassify.PyCoralClassify.rgb

Definition at line 61 of file PyCoralClassify.py.

Referenced by PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), and PyCoralSegment.PyCoralSegment.processGUI().

threshold

PyCoralClassify.PyCoralClassify.threshold

Definition at line 60 of file PyCoralClassify.py.

Referenced by PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralClassify.PyCoralClassify.processGUI(), and PyCoralDetect.PyCoralDetect.processGUI().

timer

PyCoralClassify.PyCoralClassify.timer

Definition at line 79 of file PyCoralClassify.py.

Referenced by PyDMTX.PyDMTX.process(), PythonOpenCV.PythonOpenCV.process(), PythonSandbox.PythonSandbox.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralSegment.PyCoralSegment.process(), PythonParallel.PythonParallel.process(), PyDetectionDNN.PyDetectionDNN.process(), PythonObject6D.PythonObject6D.process(), PyFaceMesh.PyFaceMesh.processGUI(), PyHandDetector.PyHandDetector.processGUI(), PyPoseDetector.PyPoseDetector.processGUI(), PySelfie.PySelfie.processGUI(), PyObjectron.PyObjectron.processGUI(), PyLicensePlate.PyLicensePlate.processGUI(), PySceneText.PySceneText.processGUI(), PythonTest.PythonTest.processGUI(), PythonSandbox.PythonSandbox.processGUI(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), PyCoralSegment.PyCoralSegment.processGUI(), PythonSandbox.PythonSandbox.processNoUSB(), and PythonObject6D.PythonObject6D.processNoUSB().

---

The documentation for this class was generated from the following file:

• src/Modules/PyCoralClassify/PyCoralClassify.py