IP Library Granted Patent US 12,646,276
Granted Patent B2
US 12,646,276 · App. 18/535,051 · Granted Jun 2, 2026

Transforming image including non-directional object and directional object

Inventors: Jiayang Zhang (Santa Clara, CA); Daniel Edmond Fish (Palo Alto, CA); Eric Baczuk (Palo Alto, CA); Lynn Tsai (Seattle, WA)
Assignee: Google LLC
G06T19/20G06F3/013G06T13/40G06T2219/2016H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,646,276
App. No.
18/535,051
Granted
Jun 2, 2026
Kind
B2
Abstract

A method of facilitating a virtual conference includes determining that a first object is non-directional, the first object being presented within an original image on a first display within the virtual conference; based on determining that the first object is non-directional, reversing an appearance and a location of the first object to generate a reversed first object; determining that a second object is directional, the second object being presented within the original image on the first display within the virtual conference; based on determining that the second object is directional, transferring a location of the second object while maintaining an orientation of the second object to generate a transferred second object; and causing a second display to generate a transformed image, the transformed image including the reversed first object and the transferred second object.

Claims (85)

1 . A method of facilitating a virtual conference, the method comprising:

determining that a first object is non-directional, the first object being presented within an original image on a first display within the virtual conference;

based on determining that the first object is non-directional, reversing an appearance and a location of the first object to generate a reversed first object;

determining that a second object is directional, the second object being presented within the original image on the first display within the virtual conference;

based on determining that the second object is directional, transferring a location of the second object while maintaining an orientation of the second object to generate a transferred second object;

causing a second display to generate a transformed image, the transformed image including the reversed first object and the transferred second object;

determining that a user of the first display is focusing on the first object; and

generating a representation of the user, the representation of the user appearing to focus on the reversed first object, the transformed image including the representation of the user.

2 . The method of claim 1 , wherein the second object includes text.

3 . The method of claim 1 , further comprising:

determining that a third object is three-dimensional, the third object being presented within the original image on the first display within the virtual conference; and

based on determining that the third object is three-dimensional, rotating the third object about an axis and transferring a location of the third object to generate a rotated object,

the transformed image including the reversed first object, the transferred second object, and the rotated third object.

4 . The method of claim 1 , wherein:

determining that the user of the first display is focusing on the first object includes determining that the user of the first display is looking at the first object,

generating the representation of the user includes generating an avatar, the avatar appearing to look toward a location of the reversed first object, and

the representation of the user includes the avatar.

5 . The method of claim 1 , wherein:

determining that the user of the first display is focusing on the first object includes determining that the user of the first display is pointing at the second object,

generating the representation of the user includes generating an avatar, the avatar appearing to point toward a location of the transferred second object, and

the representation of the user includes the avatar.

6 . The method of claim 1 , wherein:

determining that the user of the first display is focusing on the first object includes determining a direction that the user of the first display is looking,

generating the representation of the user includes rotating an avatar based on the direction to generate a rotated avatar, and

the representation of the user includes the rotated avatar.

7 . The method of claim 1 , further comprising:

determining a direction that a user of the second display is looking;

receiving an instruction to move an avatar, the avatar representing the user of the second display; and

in response to receiving the instruction to move the avatar:

moving the avatar within the first display; and

rotating the avatar based on the direction and the instruction.

8 . The method of claim 1 , wherein reversing the appearance and the location of the first object to generate the reversed first object includes subtracting horizontal values of pixels included in the first object from a predetermined value.

9 . The method of claim 1 , wherein transferring the location of the second object while maintaining an appearance of the second object to generate the transferred second object includes:

determining a section of the first display that includes the location of the second object; and

determining a section of the second display to include the location of the transferred second object, the section of the second display being flipped horizontally from the section of the first display.

10 . A non-transitory computer-readable storage medium comprising instructions stored thereon for facilitating a virtual conference, the instructions, when executed by at least one processor, being configured to cause a computing device to:

determine that a first object is non-directional, the first object being presented within an original image on a first display within the virtual conference;

based on determining that the first object is non-directional, reverse an appearance and a location of the first object to generate a reversed first object;

determine that a second object is directional, the second object being presented within the original image on the first display within the virtual conference;

based on determining that the second object is directional, transfer a location of the second object without reversing the second object to generate a transferred second object;

cause a second display to generate a transformed image, the transformed image including the reversed first object and the transferred second object;

determine that a user of the first display is focusing on the first object; and

generate a representation of the user, the representation of the user appearing to focus on the reversed first object, the transformed image including the representation of the user.

11 . The non-transitory computer-readable storage medium of claim 10 , wherein the second object includes text.

12 . The non-transitory computer-readable storage medium of claim 10 , wherein the instructions are further configured to cause the computing device to:

determine that a third object is three-dimensional, the third object being presented within the original image on the first display within the virtual conference; and

based on determining that the third object is three-dimensional, rotate the third object about an axis and transferring a location of the third object to generate a rotated object,

the transformed image including the reversed first object, the transferred second object, and the rotated third object.

13 . The non-transitory computer-readable storage medium of claim 10 , wherein:

determining that the user of the first display is focusing on the first object includes determining that the user of the first display is looking at the first object,

generating the representation of the user includes generating an avatar, the avatar appearing to look toward a location of the reversed first object, and

the representation of the user includes the avatar.

14 . The non-transitory computer-readable storage medium of claim 10 , wherein:

determining that the user of the first display is focusing on the second object includes determining that the user of the first display is pointing at the second object,

generating the representation of the user includes generating an avatar, the avatar appearing to point toward a location of the transferred second object, and

the representation of the user includes the avatar.

15 . The non-transitory computer-readable storage medium of claim 10 , wherein:

determining that the user of the first display is focusing on the first object includes determining a direction that the user of the first display is looking,

generating the representation of the user includes rotating an avatar based on the direction to generate a rotated avatar, and

the representation of the user includes the rotated avatar.

16 . The non-transitory computer-readable storage medium of claim 10 , wherein the instructions are further configured to cause the computing device to:

determine a direction that a user of the second display is looking;

receive an instruction to move an avatar, the avatar representing the user of the second display; and

in response to receiving the instruction to move the avatar:

move the avatar within the first display; and

rotate the avatar based on the direction and the instruction.

17 . The non-transitory computer-readable storage medium of claim 10 , wherein reversing the appearance and the location of the first object to generate the reversed first object includes subtracting horizontal values of pixels included in the first object from a predetermined value.

18 . The non-transitory computer-readable storage medium of claim 10 , wherein transferring the location of the second object without reversing the second object to generate the transferred second object includes:

determining a section of the first display that includes the location of the second object; and

determining a section of the second display to include the location of the transferred second object, the section of the second display being flipped horizontally from the section of the first display.

19 . A computing device comprising:

at least one processor; and

a non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by the at least one processor, are configured to cause the computing device to:

determine that a first object is non-directional, the first object being presented within an original image on a first display;

based on determining that the first object is non-directional, reverse an appearance and a location of the first object to generate a reversed first object;

determine that a second object is directional, the second object being presented within the original image on the first display;

based on determining that the second object is directional, transfer a location of the second object without reversing the second object to generate a transferred second object;

cause a second display to generate a transformed image, the transformed image including the reversed first object and the transferred second object;

determine that a user of the first display is focusing on the first object; and

generate a representation of the user, the representation of the user appearing to focus on the reversed first object, the transformed image including the representation of the user.

20 . The computing device of claim 19 , wherein:

determining that the user of the first display is focusing on the first object includes determining a direction that a user of the second display is looking; and

the instructions are further configured to cause the computing device to respond to an instruction to move an avatar, the avatar representing the user of the second display, by:

moving the avatar within the first display; and

rotating the avatar based on the direction and the instruction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: ZHANG, JIAYANG; FISH, DANIEL EDMOND; BACZUK, ERIC; TSAI, LYNN
To: GOOGLE LLC
Reel/Frame 065950/0969 →
Continuity (4)
Provisional Application 63386804 · Dec 9, 2022
Provisional Application 63386803 · Dec 9, 2022
Provisional Application 63386800 · Dec 9, 2022
Related Publication 20240193895A1 · Jun 13, 2024
References Cited (7)
US 20130010093A1 · Redmann · 2013 [cited by applicant]
US 20150169704A1 · Stekkelpak · 2015 [cited by examiner]
US 20200322575A1 · Valli · 2020 [cited by applicant]
US 20220182581A1 · Oz et al. · 2022 [cited by applicant]
US 20230041678A1 · Swierk · 2023 [cited by examiner]
“Using the Floating Window”, https://help.autodesk.com/view/LUSTRE/2021/ENU/?guid=Lustre_UG_Stereoscopy_Using_the_Floating_Window_html, Sep. 5, 2022, 4 pages. [cited by applicant]
Fuchs, et al., “Immersive 3D Telepresence”, IEEE Computer Society, Jul. 2014, pp. 46-52. [cited by applicant]