IP Library Granted Patent US 10,783,701
Granted Patent B2
US 10,783,701 · App. 16/654,803 · Granted Sep 22, 2020

System for active-focus prediction in 360 video

Inventors: Tan Xu (Bridgewater, NJ); Eric Zavesky (Austin, TX); Behzad Shahraray (Holmdel, NJ); David Crawford Gibbon (Lincroft, NJ)
Assignee: AT&T Intellectual Property I, L.P.
G06T15/20G06F3/013H04N21/21805H04N21/23406H04N21/234345
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,783,701
App. No.
16/654,803
Granted
Sep 22, 2020
Kind
B2
Abstract

Aspects of the subject disclosure may include, for example, analyzing video content obtained from a 360 degree camera to discern a point of interest in the video content and obtaining information about a viewer of the video content. A field of view is predicted based on the information about the viewer and the analysis of the video content. Less than 180 degrees of the video content centered on the predicted field of view is sent to equipment of the viewer. A monitored line of sight of the viewer is obtained based upon eye movements of the viewer relative to an orientation of the viewer. The analysis is updated based on the monitored line of sight and the predicted field of view is updated based on the updated analysis. Other embodiments are disclosed.

Claims (40)

1. A method comprising:

analyzing, by a processing system having a processor, media content to discern a point of interest in the media content, wherein the analyzing of the media content results in a scoring of the point of interest in the media content;

obtaining, by the processing system, information about a user having requested to view the media content;

predicting, by the processing system, a field of view of the user to obtain a predicted field of view based on the information about the user and the scoring the point of interest in the media content, a portion of the media content comprising the predicted field of view being sent to equipment of the user;

obtaining, by the processing system, a monitored line of sight of the user viewing the media content; and

updating, by the processing system, the scoring of the point of interest in the media content to obtain an updated scoring based on the monitored line of sight of the user viewing the media content, the predicted field of view of the user being updated according to the updated scoring.

2. The method of claim 1 , wherein the media content includes 360 degree video content.

3. The method of claim 2 , wherein the portion of the media content sent to the equipment of the user consists of only the predicted field of view.

4. The method of claim 3 , wherein the portion of the media content sent to the equipment of the user consists of less than 180 degrees of the media content centered on the predicted field of view.

5. The method of claim 3 , wherein the portion of the media content sent to the equipment of the user consists of less than 90 degrees of the media content centered on the predicted field of view.

6. The method of claim 1 , wherein the portion of the media content sent to the equipment of the user, consists of less than 135 degrees of the media content centered on the monitored line of sight of the user.

7. The method of claim 1 , further comprising:

aligning, by the processing system, a camera with the monitored line of sight of the user; and

obtaining, by the processing system, the media content from the camera.

8. The method of claim 1 , wherein the monitored line of sight of the user is obtained from a tracking a tracking of eye movements of the user relative to an orientation of the user.

9. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:

analyzing video content obtained from a 360 degree camera system to discern a point of interest in the video content, resulting in an analysis of the video content which identifies at least one potential point of interest;

obtaining first information about a first user requesting a viewing of the video content and second information about a second user requesting a viewing of the video content;

identifying a predicted field of view based on the first information, the second information, and the analysis, the predicted field of view being sent to first equipment of the first user and second equipment of the second user;

obtaining a first line of sight of the first user based upon eye movements of the first user and a second line of sight of the second user based upon eye movements of the second user; and

updating the analysis based on the first line of sight and the second line of sight, the predicted field of view being updated based on the first line of sight and the second line of sight.

10. The non-transitory, machine-readable medium of claim 9 , wherein the predicted field of view sent to the first equipment of the first user and the second equipment of the second user consists of only the predicted field of view.

11. The non-transitory, machine-readable medium of claim 10 , wherein the predicted field of view sent to the first equipment of the first user and the second equipment of the second user consists of less than 135 degrees of the video content centered on the predicted field of view.

12. The non-transitory, machine-readable medium of claim 9 , the operations further comprising sending, to the first equipment, less than 135 degrees of the video content centered on the first line of sight.

13. The non-transitory, machine-readable medium of claim 9 , the operations further comprising determining a midpoint between the first line of sight and the second line of sight and aligning the 360 degree camera system with the midpoint.

14. The non-transitory, machine-readable medium of claim 9 , the operations further comprising determining a midpoint between the first line of sight and the predicted field of view, and wherein the predicted field of view sent to first equipment of the first user and the second equipment of the second user comprises less than 180 degrees of the video content centered on the midpoint.

15. The non-transitory, machine-readable medium of claim 14 , the operations further comprising aligning the 360 degree camera system with the midpoint.

16. The non-transitory, machine-readable medium of claim 9 , the operations further comprising determining a midpoint between the first line of sight, the second line of sight, and the predicted field of view, and wherein the predicted field of view sent to first equipment of the first user and the second equipment of the second user comprises less than 180 degrees of the video content centered on the midpoint.

17. The non-transitory, machine-readable medium of claim 16 , the operations further comprising aligning the 360 degree camera system with the midpoint.

18. An apparatus, comprising:

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitates performance of operations, the operations comprising:

analyzing video content obtained from a 360 degree camera system to discern a point of interest in the video content, resulting in an analysis of the video content that identifies at least one potential point of interest;

obtaining information about a viewer of the video content;

predicting a field of view to obtain a predicted field of view based on the information about the viewer and the analysis of the video content, less than 180 degrees of the video content centered on the predicted field of view being sent to equipment of the viewer;

obtaining a monitored line of sight of the viewer based upon eye movements of the viewer relative to an orientation of the viewer;

updating the analysis based on the monitored line of sight to obtain an updated analysis of the video content; and

updating the predicted field of view based on the updated analysis.

19. The apparatus of claim 18 , the operations further comprising determining a midpoint between the monitored line of sight and the predicted field of view, and wherein the predicted field of view sent to the equipment of the viewer comprises less than 135 degrees of the video content centered on the midpoint.

20. The apparatus of claim 19 , the operations further comprising aligning the 360 degree camera system with the midpoint.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTED ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED AT REEL: 050956 FRAME: 0093. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 1, 2021
From: XU, TAN; ZAVESKY, ERIC; SHAHRARAY, BEHZAD; GIBBON, DAVID CRAWFORD
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 056447/0450 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2019
From: XU, TAN; ZAVESKY, ERIC; SHAHRARAY, BEHZAD; GIBBON, DAVID CRAWFORD
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 050956/0093 →
Continuity (2)
Continuation 15985890 · May 22, 2018
Related Publication 20200051321A1 · Feb 13, 2020