Salient Regions
Extract the most salient regions and send them out over USB.
By Laurent Ittiitti@usc.eduhttp://jevois.orgGPL v3
 Language: C++Supports mappings with USB output: YesSupports mappings with NO USB output: No 
 Video Mapping:   YUYV 64 192 25.0 YUYV 320 240 25.0 JeVois SalientRegions
 Video Mapping:   YUYV 100 400 10.0 YUYV 640 480 10.0 JeVois SalientRegions

Module Documentation

This module extracts cropped images around the N most salient (i.e., conspicuous, or attention-grabbing) locations in the JeVois camera's field of view. These regions are then streamed over USB, one of top of another. This module thus produces an output mainly intended for machine use: a host computer might grab the regions detected by JeVois, and run, for example, some object recognition algorithm on each region.

See DemoSaliency for more information about visual attention and saliency.

The number of regions extracted (N) is decided by the height of the desired USB output image, while the (square) region size (width and height) is determined by the output image width. Note that region width and height must be a multiple of 4. ALso note that Mac computers may not be able to grab and display video of width that is not a multiple of 16.

The most salient region is on top, the second most salient region is below the first one, etc.

Example use

With video mapping

YUYV 64 192 25.0 YUYV 320 240 25.0 JeVois SalientRegions

in JEVOIS:/config/videomappings.cfg, this module will extract three 64x64 salient regions, and will send them over USB one on top of the other (since USB video width is 64, which determines region size, and USB video height is 3x64 = 192, which determines the number of regions).

ParameterTypeDescriptionDefaultValid Values
(SalientRegions) inhsigmafloatSigma (pixels) used for inhibition of return32.0F-
(Saliency) cweightbyteColor channel weight255-
(Saliency) iweightbyteIntensity channel weight255-
(Saliency) oweightbyteOrientation channel weight255-
(Saliency) fweightbyteFlicker channel weight255-
(Saliency) mweightbyteMotion channel weight255-
(Saliency) centerminsize_tLowest (finest) of the 3 center scales2-
(Saliency) deltaminsize_tLowest (finest) of the 2 center-surround delta scales3-
(Saliency) smscalesize_tScale of the saliency map4-
(Saliency) mthreshbyteMotion threshold0-
(Saliency) fthreshbyteFlicker threshold0-
(Saliency) msflickboolUse multiscale flicker computationfalse-
Detailed docs:SalientRegions
Copyright:Copyright (C) 2016 by Laurent Itti, iLab and the University of Southern California
License:GPL v3
Distribution:Unrestricted
Restrictions:None
Support URL:http://jevois.org/doc
Other URL:http://iLab.usc.edu
Address:University of Southern California, HNB-07A, 3641 Watt Way, Los Angeles, CA 90089-2520, USA