IP Library Patent Application 15892412
Patent Application
App. No. 15/892,412

METHODS AND APPARATUS RELATING TO CAMERA SWITCHING AND/OR MAKING A DECISION TO SWITCH BETWEEN CAMERAS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/892,412
Abstract

In order to reduce or minimize the effect of camera switching performed outside of user control in some embodiments an automated camera switching policy policing system is implemented. The policing system can make camera switch recommendations, automatically implement camera switches and/or take other actions. In some embodiments the automated policing system tracks the location of an area of interest in the environment, e.g., an area corresponding to the location of an object of interest, where images are being captured. Camera switches are recommend when the object of interest remains in the field of view of a current camera supplying content and the field of view of a camera to which a switch is to be made. Recommendations are made against camera switches which will result in a switch which will prevent a user from viewing the same object of interest before and after a camera switch.

Claims (60)

1 . A method of operating a system, the method comprising:

performing a monitoring operation, said monitoring operation including at least one of:

i) determining a location of an object of interest in an environment; or

ii) tracking where at least one viewer is looking in said environment;

generating a camera switch recommendation based on information obtained by said monitoring operation; and

presenting the camera switch recommendation to an operator of said system or automatically implementing the generated camera switch recommendation.

2 . The method of claim 1 , wherein said monitoring operation includes determining the location of the object of interest, the method further comprising:

determining if the object of interest is in a field of view of a second camera in addition to being in a field of view of said first camera; and

wherein generating the camera switch recommendation includes making a decision to recommend a switch to said second camera or a recommendation not to switch to said second camera based on whether the object of interest is determined to be in the field of view of the second camera in addition to being in the field of view of said first camera or is determined not be in the field of view of a second camera in addition to being in said field of view of said first camera.

3 . The method of claim 2 , wherein said monitoring operation further includes:

determining a direction of motion of the object of interest.

4 . The method of claim 3 , wherein generating the camera switch recommendation is further based on the direction of motion of the object of interest.

5 . The method of claim 4 , wherein generating the camera switch recommendation includes:

i) making a decision to recommend a switch to said second camera in response to determining that the object of interest is in the field of view of both said first and second cameras and is moving in a direction of motion out of said field of view of the first camera but which will remain in the field of view of the second camera upon exiting the field of view of the first camera; and

ii) making a decision to recommend not to switch to said second camera in response to determining that the object of interest is in the field of view of both said first and second cameras and is moving in a direction of motion towards a main portion of the field of view of the first camera.

6 . The method of claim 5 , wherein the method further includes:

automatically implementing the generated camera switch recommendation when said decision is a decision to recommend a switch to said second camera and the object of interest is about to move out of said field of view of the first camera but will remain in the field of view of the second camera upon exiting the field of view of the first camera.

7 . The method of claim 5 , wherein the method includes presenting the camera switch recommendation to the operator of said system when said decision is a decision to recommend a switch to said second camera and the object of interest is not about to move out of said field of view of the first camera.

8 . The method of claim 7 , further comprising:

deciding based on the proximity of the object of interest to an edge of the field of view of the first camera whether the object of interest is about to move out of the field of view of the first camera.

9 . The method of claim 1 , further comprising:

receiving a camera switch control signal from an input device indicating a switch from said first camera to said second camera;

in response to said camera switch control signal, checking if the object of interest is in the field of view of the second camera; and

if it is determined that the object of interest is not in the field of view of the second camera, presenting a warning to the user of the system indicating that the object of interest is not in the field of view of the second camera and promoting the user of the system to confirm that the switch to the second camera should be implemented.

10 . The method of claim 9 , further comprising:

if it is determined that the object of interest is in the field of view of the second camera, switching to the second camera without presenting said warning to the user of the system.

11 . The method of claim 1 , wherein said monitoring operation includes tracking where a plurality of viewers are looking in said environment, said at least one viewer being one of said plurality of viewers; and

wherein generating the camera switch recommendation includes making a decision to recommend a switch to said second camera or a decision not to recommend a switch to said second camera based on the direction in which a majority of monitored viewers are turning their head as determined from said tracking of where the viewers are looking in the environment.

12 . The method of claim 11 , further comprising:

determining a number of monitored viewers turning their head in a direction towards a main portion of the second camera field of view or away from the main portion of the second camera field of view.

13 . The method of claim 11 ,

wherein making the camera switch recommendation includes:

i) making a decision to recommend a switch to said second camera in response to determining that the majority of monitored viewers are turning their head toward the main portion of the second camera field of view; and

ii) making a decision not to recommend a switch to said second camera in response to determining that the majority of monitored viewers are turning their head away from the main portion of the second camera field of view.

14 . A system comprising:

a receiver for receiving image content captured by at least first and second cameras in an environment;

a control apparatus including a processor configured to:

perform a monitoring operation, said monitoring operation including at least one of:

i) determining a location of an object of interest in an environment; or

ii) tracking where at least one viewer is looking in said environment; and

generate a camera switch recommendation based on information obtained by said monitoring operation; and

present the camera switch recommendation to an operator of said control apparatus or automatically implement the generated camera switch recommendation.

15 . The system of claim 14 ,

wherein said processor is further configured, as part of said monitoring operation, to determine the location of the object of interest; and

wherein said processor is further configured to determine if the object of interest is in a field of view of a second camera in addition to being in a field of view of said first camera; and

wherein the processor is also further configured, as part of generating the camera switch recommendation, to make a decision to recommend a switch to said second camera or a recommendation not to switch to said second camera based on whether the object of interest is determined to be in the field of view of the second camera in addition to being in the field of view of said first camera or is determined not be in the field of view of a second camera in addition to being in said field of view of said first camera.

16 . The system of claim 15 , wherein said processor is further configured, as part of performing the monitoring operation, to:

determine a direction of motion of the object of interest.

17 . The system of claim 16 , wherein generating the camera switch recommendation is further based on the direction of motion of the object of interest.

18 . The system of claim 17 , wherein the processor is further configured, as part of generating the camera switch recommendation, to:

i) make a decision to recommend a switch to said second camera in response to determining that the object of interest is in the field of view of both said first and second cameras and is moving in a direction of motion out of said field of view of the first camera but which will remain in the field of view of the second camera upon exiting the field of view of the first camera; and

ii) make a decision to recommend not to switch to said second camera in response to determining that the object of interest is in the field of view of both said first and second cameras and is moving in a direction of motion towards a main portion of the field of view of the first camera.

19 . The system of claim 18 , wherein the processor is further configured to:

automatically implement the generated camera switch recommendation when said decision is a decision to recommend a switch to said second camera and the object of interest is about to move out of said field of view of the first camera but will remain in the field of view of the second camera upon exiting the field of view of the first camera.

20 . A non-transitory computer readable medium including computer executable instructions, which when executed by a processor of a system, control the system to perform the steps of:

performing a monitoring operation, said monitoring operation including at least one of:

i) determining a location of an object of interest in an environment; or

ii) tracking where at least one viewer is looking in said environment;

generating a camera switch recommendation based on information obtained by said monitoring operation; and

presenting the camera switch recommendation to an operator of said system or automatically implementing the generated camera switch recommendation.

Assignments (5)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 7, 2020
From: NEXTVR INC.
To: NEVERMIND CAPITAL LLC
Reel/Frame 053139/0942 →
RELEASE OF SECURITY INTEREST Recorded May 13, 2020
From: VCAP VENTURES (BVI) LIMITED
To: NEXTVR, INC.
Reel/Frame 052657/0091 →
CHANGE OF ADDRESS Recorded Apr 9, 2019
From: NEXTVR INC.
To: NEXTVR INC.
Reel/Frame 048836/0085 →
SECURITY INTEREST Recorded Mar 29, 2019
From: NEXTVR INC.
To: VCAP VENTURES (BVI) LIMITED
Reel/Frame 048747/0128 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2018
From: COLE, DAVID; MOSS, ALAN MCKAY
To: NEXTVR INC.
Reel/Frame 045100/0941 →