IP Library Granted Patent US 11,196,944
Granted Patent B2
US 11,196,944 · App. 16/868,226 · Granted Dec 7, 2021

System for infinite windows with optical disparity and depth resolution

Inventors: Eric Zavesky (Austin, TX); Tan Xu (Bridgewater, NJ); Mohammed Abdel-Wahab (Madison, NJ); Jean-Francois Paiement (Sausalito, CA)
Assignee: AT&T Intellectual Property I, L.P.
H04N5/272G06F3/013G06T5/50H04N5/2253H04N5/247H04N7/181G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,196,944
App. No.
16/868,226
Granted
Dec 7, 2021
Kind
B2
Abstract

Aspects of the subject disclosure may include, for example, a machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, including: receiving measurements indicating a viewpoint and a gaze direction of a user in a room; receiving a plurality of real-time images from the two or more cameras outside of the room; creating a visual presentation comprising two or more of the plurality of real-time images stitched together, wherein the two or more of the plurality of real-time images are used to remove a physical object obstructing a view of one of the two or more cameras; and sending the visual presentation to the display device, wherein the display device presents the visual presentation on the screen. Other embodiments are disclosed.

Claims (40)

1. A device, comprising:

an ocular tracking device;

a display device including a screen;

two or more cameras;

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:

receiving measurements indicating a viewpoint and a gaze direction of a plurality of users from data provided by the ocular tracking device;

receiving a plurality of real-time live images from the two or more cameras;

creating a visual presentation to present to the plurality of users, wherein the visual presentation comprises the plurality of real-time live images from the two or more cameras stitched together, wherein the plurality of real-time live images are used to completely remove a physical object obstructing a view of at least one of the two or more cameras; and

sending the visual presentation to the display device, wherein the display device presents the visual presentation on the screen.

2. The device of claim 1 , wherein the operations further comprise adapting the gaze direction based on a majority of the plurality of users having gaze directions is toward at least a portion of the screen.

3. The device of claim 1 , wherein the operations further comprise adapting the viewpoint based on a selected user of the plurality of users.

4. The device of claim 3 , wherein the operations further comprise adapting the gaze direction based on the selected user.

5. The device of claim 3 , wherein the selected user is chosen based on a proximity of the gaze direction of the selected user to a center of the screen.

6. The device of claim 3 , wherein the selected user is chosen based on an identity of the selected user.

7. The device of claim 3 , wherein the operations further comprise changing a point of view of the visual presentation based on a change of the viewpoint or the gaze direction of the selected user.

8. The device of claim 1 , wherein the two or more cameras communicate with the device via a wireless network.

9. The device of claim 1 , wherein at least one of the two or more cameras is on a drone.

10. The device of claim 1 , wherein the display device comprises a plurality of screens, and wherein each screen of the plurality of screens displays at least one real-time image from at least one camera.

11. The device of claim 1 , wherein the operations further comprise modifying the visual presentation based on texture mapping on one or more physical objects included in the visual presentation.

12. The device of claim 1 , wherein the operations further comprise modifying the visual presentation based on preferred weather conditions.

13. The device of claim 1 , wherein the operations further comprise modifying the visual presentation based on seasonal variations from actual conditions.

14. The device of claim 1 , wherein the operations further comprise modifying the visual presentation using a machine learning model to remove anomalous objects.

15. The device of claim 1 , wherein the operations further comprise modifying the visual presentation to pan or zoom by changing the viewpoint to a virtual viewpoint.

16. The device of claim 1 , wherein the processing system comprises a plurality of processors operating in a distributed computing environment.

17. A method, comprising:

receiving, by a processing system including a processor, a plurality of live, real-time images from two or more cameras outside of a room;

stitching, by the processing system, the plurality of the live, real-time images together to form a visual presentation video, wherein the stitching performs a logical joining of the plurality of the live, real-time images based on pixels and depth of the plurality of the live, real-time images;

checking, by the processing system, resolution and quality of the visual presentation video;

removing, by the processing system, anomalous objects detected using a machine learning model from the visual presentation video using the plurality of live, real-time images, wherein the anomalous objects obstruct a view of at least one of the two or more cameras outside of the room;

receiving measurements, by the processing system, indicating a viewpoint and a gaze direction of a user in the room;

adjusting, by the processing system, the visual presentation video based on the viewpoint and gaze direction of the user; and

sending, by the processing system, the visual presentation video to a display device.

18. The method of claim 17 , comprising: adapting, by the processing system, the visual presentation video based on preferences of the user, wherein the preferences include one or more of weather conditions, diurnal variations and seasonal variations.

19. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:

receiving measurements indicating a viewpoint and a gaze direction of a user in a room;

receiving a plurality of live, real-time images from two or more cameras outside of the room;

creating a visual presentation comprising the plurality of live, real-time images stitched together, wherein the plurality of live, real-time images are used to completely remove a physical object obstructing a view of at least one of the two or more cameras; and

sending the visual presentation to a display device, wherein the display device presents the visual presentation on a screen.

20. The non-transitory, machine-readable medium of claim 19 , wherein the processing system comprises a plurality of processors operating in a distributed computing environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2021
From: ZAVESKY, ERIC; XU, TAN; ABDEL-WAHAB, MOHAMMED; PAIEMENT, JEAN-FRANCIOS
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 055335/0532 →
Continuity (1)
Related Publication 20210352222A1 · Nov 11, 2021
Cited By (1)
US 12,489,859