IP Library › Granted Patent US 10,094,903
Granted Patent B2
US 10,094,903 · App. 15/051,312 · Granted Oct 9, 2018

Object tracking and data aggregation in panoramic video

Inventors: Brian C. Lowry (Emlenton, PA); Evan A. Wimer (Pittsburgh, PA); Joseph B. Tomko (Wexford, PA)
Assignee: C360 Technologies, Inc.
G01S3/7865G01S1/047H04N5/23238A63B71/0605A63B2220/806H04N5/2628
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,094,903
App. No.
15/051,312
Granted
Oct 9, 2018
Kind
B2
Abstract

Methods and systems for real-time object tracking and data aggregation in panoramic video are disclosed. An example system provides a panoramic video camera that produces panoramic video data of an area; a plurality of radio frequency tags producing tracking data; and at least one of the radio frequency tags being co-located with the panoramic video camera, producing tracking data for the panoramic video camera; at least another of the radio frequency tags being co-located with at least one object within the area, producing tracking data for the at least one object; a computing device, wherein the computing device receives the panoramic video data and further receives the tracking data from the plurality of radio frequency tags; the computing device generating a video stream by augmenting the panoramic video data with the tracking data; the computing device sending the video stream to at least one remote system. Other methods and systems are disclosed.

Claims (44)

1. A system, comprising:

a panoramic video camera that produces fixed panoramic video data of an area;

a plurality of radio frequency tags producing tracking data; and

at least one of the plurality of radio frequency tags co-located with the panoramic video camera and producing tracking data for the panoramic video camera;

at least another of the plurality of radio frequency tags co-located with at least one object within the area and producing tracking data for the at least one object, wherein the tracking data for the at least one object identifies a location of the at least one object within the area in relation to the location of the panoramic video camera identified based upon the tracking data for the panoramic video camera;

a computing device, wherein the computing device receives the fixed panoramic video data and further receives the tracking data from the plurality of radio frequency tags;

the computing device generating a video stream by augmenting the fixed panoramic video data with the tracking data of the at least one object, wherein the augmented panoramic video allows following of the at least one object within the area using the tracking data, by at least one remote system;

the computing device sending the video stream to the at least one remote system;

the computing device receiving, from the at least one remote system, instructions selecting an object within the video stream section to be followed; and

the computing device adjusting, based upon the received instructions, a view being viewed at the at least one remote system, wherein the adjusting comprises modifying a view within the video stream to follow the selected object, wherein the modifying comprises displaying a portion of the video stream by centering the selected object within the view of the video stream as the object moves through the area using the tracking data associated with the selected object.

2. The system of claim 1 , wherein the tracking data for the panoramic video camera comprises position data for the panoramic video camera.

3. The system of claim 1 , wherein the tracking data for the at least one object comprises a position of the at least object relative to the panoramic video camera.

4. The system of claim 1 , wherein the video stream comprises a displayable portion of the fixed panoramic video data.

5. The system of claim 4 , wherein the computing device receives adjustment information from the at least one remote system, wherein the adjustment information identifies a displayable portion within the panoramic video data to be viewed.

6. The system of claim 5 , wherein the computing device generates an augmented video stream for the at least one remote device, wherein the augmented video stream comprises the identified displayable portion within the fixed panoramic video data.

7. The system of claim 1 , wherein the computing device generates an augmented video stream for the at least one remote system, wherein the augmented video stream comprises a video stream that follows the object within the area.

8. The system of claim 1 , wherein the computing device receives the fixed panoramic video data, receives the tracking data, generates the video stream, and sends the video stream in real-time.

9. The system of claim 1 , wherein the video stream allows a user of the at least one remote system to adjust the video stream to track a particular object within the area based on the tracking data included in the video stream.

10. A device, comprising:

a remote computing device, comprising:

a processor; and

a memory device that stores instructions executable by the processor to:

receive fixed panoramic video data of an area produced by a panoramic video camera;

receive tracking data produced by a plurality of radio frequency tags co-located with objects within the area, wherein the tracking data for each of the objects identifies a location of the object within the area in relation to the location of the panoramic video camera identified based upon tracking data for the panoramic video camera;

generate a video stream by augmenting the fixed panoramic video data with the tracking data;

stream a displayable portion of the video stream to at least one remote system;

receive, from the at least one remote system, selection information, wherein the selection information selects at least one of the objects within the area to follow and wherein the selection information comprises instructions to modify the displayable portion of the video stream based upon the selection information; and

adjust the displayable portion of the video stream viewed at the remote system based upon the selection information, wherein to adjust comprises iteratively adjusting the displayable portion of the video stream to follow the selected at least one of the objects as the selected object moves through the area by centering the selected objected within the displayable portion of the video stream as the object moves through the area using the tracking data associated with the selected object.

11. The device of claim 10 , wherein the video stream allows a user to adjust the displayable portion of the video stream.

12. The device of claim 10 , wherein the selection information comprises information indicating an adjustment to the displayable portion of the video stream, wherein the adjustment indicates a new portion of the video stream to display.

13. The device of claim 10 , wherein the instructions to receive fixed panoramic video data, receive tracking data, generate a video stream, and stream a displayable portion are conducted in real-time.

14. The device of claim 10 , wherein the instructions to adjust the displayable portion is conducted during real-time receipt of the panoramic video data.

15. A system, comprising:

more than one panoramic video camera, each producing fixed panoramic video data of an area;

a plurality of radio frequency tags producing tracking data; and

at least one of the plurality of radio frequency tags co-located with each of the more than one panoramic video camera and producing tracking data for each of more than one the panoramic video camera;

at least another of the plurality of radio frequency tags co-located with at least one object within the area and producing tracking data for the at least one object;

a computing device, wherein the computing device receives the panoramic video data from each of the more than one panoramic video camera and further receives the tracking data from the plurality of radio frequency tags;

the computing device generating a video stream by augmenting the fixed panoramic video data received from at least one of the more than one panoramic video camera with the tracking data, wherein the augmented panoramic video allows following of the at least one object within the area using the tracking data, by at least one remote system;

the computing device sending the video stream to the at least one remote system;

the computing device receiving, from the at least one remote system, instructions selecting an object within the video stream to be followed; and

the computing device adjusting, based upon the received instructions, a view being viewed at the at least one remote system, wherein the adjusting comprises modifying a view within the video stream to follow the selected object, wherein the modifying comprises displaying a portion of the video stream by centering the selected object within the view of the video stream as the object moves through the area using the tracking data associated with the selected object.

16. The system of claim 15 , wherein the panoramic video data that is augmented is selected based upon the location of the object with respect to the more than one panoramic video camera.

17. The system of claim 16 , wherein the panoramic video data that is augmented is the panoramic video data received from the panoramic video camera being closest to the object.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2023
From: C360 TECHNOLOGIES, INC.
To: COSM, INC.
Reel/Frame 065013/0565 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2016
From: INNERMEDIA, INC.
To: C360 TECHNOLOGIES, INC.
Reel/Frame 040199/0460 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2016
From: LOWRY, BRIAN C.; WIMER, EVAN A.; TOMKO, JOSEPH B.
To: INNERMEDIA, INC.
Reel/Frame 037803/0735 →
Continuity (3)
Continuation 13767489 · Feb 14, 2013
Provisional Application 61598734 · Feb 14, 2012
Related Publication 20160173775A1 · Jun 16, 2016