Tracking Sparse Objects and People in Large Scale Environments

Published in United States Patent and Trademark Office, 2021

A modular tracking system is described comprising of the network of independent tracking units optionally accompanied by a LIDAR scanner and/or (one or more) elevated cameras. Tracking units are combining panoramic and zoomed cameras to imitate the working principle of the human eye. Markerless computer vision algorithms are executed directly on the units and provide feedback to motorized mirror placed in front of the zoomed camera to keep tracked objects/people in its field of view. Microphones are used to detect and localize sound events. Inference from different sensor is fused in real time to reconstruct high-level events and full skeleton representation for each participant.

Download application here.