Granted Patent B2

US 12,656,991 · App. 18/219,108 · Granted Jun 16, 2026

Inventor: Paul Abraham Chintapalli (Plano, TX)

G06F3/1446G06F1/1607G06F1/165G06F3/013G06T7/70H04N23/90G06T2207/30201

Abstract

Claims (51)

1 . An apparatus for managing a gaze of a user engaged in a visual communication session with an audience, the apparatus comprising:

a holder configured to be attached to a body of a device used by the user for engaging in the visual communication session with the audience; and

at least one auxiliary display device configured to be mounted to the body of the device using the holder, wherein the at least one auxiliary display device is configured to be communicatively coupled with the device, wherein the device comprises an image capturing device and a display screen, wherein the display screen displays a second content stream associated with the audience and the image capturing device generates a first content stream comprising the gaze of the user by capturing a plurality of images associated with the user, wherein the user engages in the visual communication session based on the displaying of the second content stream and the generating of the first content stream, wherein the at least one auxiliary display device comprises:

at least one communication interface configured for receiving the second content stream from the device;

a processing device communicatively coupled with the at least one communication interface, wherein the processing device is configured for:

processing the second content stream; and

generating an auxiliary second content stream based on the processing; and

at least one auxiliary display screen communicatively coupled with the processing device, wherein the at least one auxiliary display screen is configured for displaying the auxiliary second content stream to the user based on the generating, wherein the second content stream is projected to the at least one auxiliary display device from the device based on the displaying of the auxiliary second content stream, wherein the projecting shifts the gaze of the user to the image capturing device of the device, wherein the managing of the gaze of the user is based on viewing the auxiliary second content stream by the user.

2 . The apparatus of claim 1 , wherein the at least one auxiliary display screen is placed in at least one location in relation to the image capturing device based on the mounting of the at least one auxiliary display device, wherein the at least one auxiliary display screen is spatially proximal to the image capturing device based on the placing of the at least one auxiliary display screen in the at least one location, wherein the displaying of the auxiliary second content stream comprises displaying the auxiliary second content stream from the at least one location.

3 . The apparatus of claim 1 , wherein the at least one auxiliary display screen comprises a first auxiliary display screen and a second auxiliary display screen, wherein the first auxiliary display screen is placed on a first side of the image capturing device and the second auxiliary display screen is placed on a second side opposing the first side of the image capturing device based on the mounting of the at least one auxiliary display device, wherein the displaying of the auxiliary second content stream comprises displaying the auxiliary second content stream from at least one of the first side and the second side of the image capturing device.

4 . The apparatus of claim 3 , wherein the processing device is further configured for determining at least one display mode for the displaying of the auxiliary second content stream by at least one of the first auxiliary display screen and the second auxiliary display screen, wherein the at least one display mode comprises one of a simultaneous display mode, an independent display mode, and a selective display mode, wherein each of the first auxiliary display screen and the second auxiliary display screen simultaneously displays the auxiliary second content stream in the simultaneous display mode, wherein each of the first auxiliary display screen and the second auxiliary display screen independently display a portion of the auxiliary second content stream in the independent display mode, wherein either one of the first auxiliary display screen and the second auxiliary display screen display the auxiliary second content stream in the selective display mode, wherein the displaying of the auxiliary second content stream from at least one of the first side and the second side of the image capturing device is further based on the at least one display mode.

5 . The apparatus of claim 4 , wherein the processing of the second content stream comprises analyzing the second content stream, wherein the analyzing of the second content stream comprises analyzing the second content stream for determining at least one characteristic of the audience, wherein the at least one characteristic comprises at least one of a number of individuals making up the audience and a position of each of the number of the individuals, wherein the determining of the at least one display mode is further based on the analyzing of the second content stream, wherein the determining of the at least one display mode is further based on the at least one characteristic of the audience.

6 . The apparatus of claim 4 , wherein the at least one auxiliary display device comprises at least one input device communicatively coupled with the processing device, wherein the at least one input device is configured for receiving at least one input from the user, wherein the processing device is further configured for analyzing of the at least one input, wherein the determining of the at least one display mode is further based on the analyzing of the at least one input.

7 . The apparatus of claim 1 , wherein the at least one auxiliary display device further comprises at least one auxiliary image capturing device, wherein the at least one auxiliary image capturing device and the at least one auxiliary display screen are present on a front side of the at least one auxiliary display device, wherein the at least one auxiliary image capturing device is configured for generating an auxiliary first content stream by capturing a plurality of auxiliary images of the user, wherein the user engages in the visual communication session based on the generating of the auxiliary first content stream.

8 . The apparatus of claim 7 , wherein the at least one auxiliary image capturing device is present on a peripheral region of the at least one auxiliary display screen.

9 . The apparatus of claim 7 , wherein the at least one auxiliary image capturing device is present on a central region of the at least one auxiliary display screen, wherein the at least one auxiliary image capturing device is added in the at least one auxiliary display screen.

10 . The apparatus of claim 7 , wherein the at least one communication interface is further configured for receiving the first content stream from the image capturing device, wherein the processing device is further configured for:

analyzing the first content stream, wherein the analyzing of the first content stream comprises analyzing the first content stream for determining a quality of images captured by the image capturing device; and

determining a state of the image capturing device based on the analyzing of the first content stream, wherein the state corresponds to an inadequacy of the image capturing device to capture the plurality of images, wherein the determining of the state is further based on the quality of the images, wherein the generating of the auxiliary first content stream is further based on the state.

11 . The apparatus of claim 7 , wherein the at least one auxiliary display device further comprises at least one input device communicatively coupled with the processing device, wherein the at least one input device is configured for receiving at least one first input from the user, wherein the generating of the auxiliary first content stream is further based on the at least one first input, wherein the at least one first input corresponds to one of a selection of the image capturing device and a selection of the at least one auxiliary image capturing device, wherein the auxiliary first content stream is generated based on the selection of the at least one auxiliary image capturing device, wherein the auxiliary first content stream is not generated based on the selection of the image capturing device.

12 . The apparatus of claim 1 , wherein the processing device is further configured for:

determining a performance of a screen extending operation based on the processing of the second content stream, wherein the generating of the auxiliary second content stream is further based on the determining of the performance of the screen extending operation; and

performing the screen extending operation based on the determining of the performance of the screen extending operation, wherein the display screen ceases to display the second content stream based on the performing of the screen extending operation.

13 . The apparatus of claim 1 , wherein the at least one communication interface is further configured for receiving the first content stream from the image capturing device, wherein the processing device is further configured for:

analyzing the first content stream;

determining an offset in the gaze of the user with respect to a line of view of the image capturing device based on the analyzing of the first content stream; and

generating at least one calibrating signal for allowing calibrating of a location for the mounting of the at least one auxiliary display device on the body of the device based on the determining of the offset, wherein the at least one auxiliary display screen is further configured for displaying the at least one calibrating signal for facilitating the calibrating of the location for the mounting of the at least one auxiliary display device on the body of the device, wherein the at least one calibrating signal is a visual signal, wherein the visual signal is viewed by the user and the at least one auxiliary display device is moved by the user on the body to find an optimal location for the at least one auxiliary display device on the body of the device.

14 . An apparatus for managing a gaze of a user engaged in a visual communication session with an audience, the apparatus comprising:

a holder configured to be attached to a body of a device used by the user for engaging in the visual communication session with the audience; and

at least one auxiliary display device configured to be mounted to the body of the device using the holder, wherein the at least one auxiliary display device is configured to be communicatively coupled with the device, wherein the device comprises an image capturing device and a display screen, wherein the display screen displays a second content stream associated with the audience and the image capturing device generates a first content stream comprising the gaze of the user by capturing a plurality of images associated with the user, wherein the user engages in the visual communication session based on the displaying of the second content stream and the generating of the first content stream, wherein the at least one auxiliary display device comprises:

at least one communication interface configured for receiving the second content stream from the device;

a processing device communicatively coupled with the at least one communication interface, wherein the processing device is configured for:

processing the second content stream;

determining a performance of a screen extending operation based on the processing of the second content stream;

generating an auxiliary second content stream based on the processing of the second content stream and the determining of the performance of the screen extending operation; and

performing the screen extending operation based on the determining of the performance of the screen extending operation, wherein the display screen ceases to display the second content stream based on the performing of the screen extending operation; and

at least one auxiliary display screen communicatively coupled with the processing device, wherein the at least one auxiliary display screen is configured for displaying the auxiliary second content stream to the user based on the generating, wherein the second content stream is projected to the at least one auxiliary display device from the device based on the displaying of the auxiliary second content stream, wherein the projecting shifts the gaze of the user to the image capturing device of the device, wherein the managing of the gaze of the user is based on viewing the auxiliary second content stream by the user.

15 . The apparatus of claim 14 , wherein the at least one auxiliary display screen is placed in at least one location in relation to the image capturing device based on the mounting of the at least one auxiliary display device, wherein the at least one auxiliary display screen is spatially proximal to the image capturing device based on the placing of the at least one auxiliary display screen in the at least one location, wherein the displaying of the auxiliary second content stream comprises displaying the auxiliary second content stream from the at least one location.

16 . The apparatus of claim 14 , wherein the at least one auxiliary display screen comprises a first auxiliary display screen and a second auxiliary display screen, wherein the first auxiliary display screen is placed on a first side of the image capturing device and the second auxiliary display screen is placed on a second side opposing the first side of the image capturing device based on the mounting of the at least one auxiliary display device, wherein the displaying of the auxiliary second content stream comprises displaying the auxiliary second content stream from at least one of the first side and the second side of the image capturing device.

17 . The apparatus of claim 16 , wherein the processing device is further configured for determining at least one display mode for the displaying of the auxiliary second content stream by at least one of the first auxiliary display screen and the second auxiliary display screen, wherein the at least one display mode comprises one of a simultaneous display mode, an independent display mode, and a selective display mode, wherein each of the first auxiliary display screen and the second auxiliary display screen simultaneously displays the auxiliary second content stream in the simultaneous display mode, wherein each of the first auxiliary display screen and the second auxiliary display screen independently display a portion of the auxiliary second content stream in the independent display mode, wherein either one of the first auxiliary display screen and the second auxiliary display screen display the auxiliary second content stream in the selective display mode, wherein the displaying of the auxiliary second content stream from at least one of the first side and the second side of the image capturing device is further based on the at least one display mode.

18 . The apparatus of claim 17 , wherein the processing of the second content stream comprises analyzing the second content stream, wherein the analyzing of the second content stream comprises analyzing the second content stream for determining at least one characteristic of the audience, wherein the at least one characteristic comprises at least one of a number of individuals making up the audience and a position of each of the number of the individuals, wherein the determining of the at least one display mode is further based on the analyzing of the second content stream, wherein the determining of the at least one display mode is further based on the at least one characteristic of the audience.

19 . The apparatus of claim 18 , wherein the at least one auxiliary display device comprises at least one input device communicatively coupled with the processing device, wherein the at least one input device is configured for receiving at least one input from the user, wherein the processing device is further configured for analyzing of the at least one input, wherein the determining of the at least one display mode is further based on the analyzing of the at least one input.

20 . An apparatus for managing a gaze of a user engaged in a visual communication session with an audience, the apparatus comprising:

a holder configured to be attached to a body of a device used by the user for engaging in the visual communication session with the audience; and

at least one auxiliary display device configured to be mounted to the body of the device using the holder, wherein the at least one auxiliary display device is configured to be communicatively coupled with the device, wherein the device comprises an image capturing device and a display screen, wherein the display screen displays a second content stream associated with the audience and the image capturing device generates a first content stream comprising the gaze of the user by capturing a plurality of images associated with the user, wherein the user engages in the visual communication session based on the displaying of the second content stream and the generating of the first content stream, wherein the at least one auxiliary display device comprises:

at least one communication interface configured for receiving the second content stream from the device;

a processing device communicatively coupled with the at least one communication interface, wherein the processing device is configured for:

processing the second content stream; and

generating an auxiliary second content stream based on the processing;

at least one auxiliary display screen communicatively coupled with the processing device, wherein the at least one auxiliary display screen is configured for displaying the auxiliary second content stream to the user based on the generating, wherein the second content stream is projected to the at least one auxiliary display device from the device based on the displaying of the auxiliary second content stream, wherein the projecting shifts the gaze of the user to the image capturing device of the device, wherein the managing of the gaze of the user is based on viewing the auxiliary second content stream by the user; and

at least one auxiliary image capturing device configured for generating an auxiliary first content stream by capturing a plurality of auxiliary images of the user, wherein the at least one auxiliary image capturing device and the at least one auxiliary display screen are present on a front side of the at least one auxiliary display device, wherein the user engages in the visual communication session based on the generating of the auxiliary first content stream.

Continuity (1)

References Cited (13)