IP Library Granted Patent US 10,469,804
Granted Patent B1
US 10,469,804 · App. 16/558,083 · Granted Nov 5, 2019

Display an image during a communication

Inventor: Philip Scott Lyren (Bangkok, TH)
H04N7/157G02B27/017G02B27/0176H04N7/144H04N7/147H04N13/167H04N13/189H04N13/194H04N13/332H04N13/344H04N13/383H04N13/398H04R1/00G02B2027/014G02B2027/0134G02B2027/0178G02B2027/0187H04N2007/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,469,804
App. No.
16/558,083
Granted
Nov 5, 2019
Kind
B1
Abstract

An electronic device displays an image during a communication between two people. The image represents one of the people to the communication. The electronic device determines a location where to place the image and displays the image such that the image appears to exist at the location.

Claims (57)

1. A method executed by one or more electronic devices in an electronic system that includes at least a smartphone in communication with wearable electronic glasses (WEG), the method comprising:

determining, by the one or more electronic devices in the electronic system and before a first user answers an electronic call from a second user, locations on physical objects in an environment of the first user where to place a virtual image that represents the second user during the electronic call between the first user and the second user;

receiving, at the smartphone in communication with the WEG, the electronic call from the second user to the first user;

selecting, by the one or more electronic devices in the electronic system and in response to the first user answering the electronic call from the second user, one of the locations on one of the physical objects in the environment of the first user where to place the virtual image that represents the second user during the electronic call; and

displaying, by the WEG worn by the first user and during the electronic call, the virtual image that represents the second user at the one of the locations on the one of the physical objects.

2. The method of claim 1 further comprising:

building a map that stores available locations where to place the virtual image that represents the second user;

storing the map in memory; and

retrieving the map from memory to select the one of the locations on the one of the physical objects for where to place the virtual image during the electronic call.

3. The method of claim 1 further comprising:

capturing, with the WEG, images of the physical objects in the environment; and

executing software to recognize the physical objects from the images and to identify surfaces of the physical objects that the one or more electronic devices determines to be an available location where to place the virtual image for the electronic call.

4. The method of claim 1 further comprising:

determining whether the physical objects in the environment have a suitable size and a suitable shape to be an available location where to place the virtual image for the electronic call.

5. The method of claim 1 further comprising:

identifying, in the environment, one of the physical objects as a chair; and

determining that the chair is an available location where to place the virtual image for the electronic call.

6. The method of claim 1 further comprising:

identifying, in the environment, one of the physical objects as being unsuitable to be an available location where to place the virtual image for the electronic call; and

displaying, with the WEG, the one of the physical objects so the first user can see the one of the physical objects is unsuitable to be the available location where to place the virtual image for the electronic call.

7. The method of claim 1 further comprising:

determining, in the environment, whether an empty space above a surface of one of the physical objects is large enough to be an available location where to place the virtual image for the electronic call.

8. The method of claim 1 further comprising:

rotating, during the electronic call, a face of the virtual image that represents the second user to follow and to track a location of the first user as the first user moves in the environment.

9. A non-transitory computer readable storage media storing instructions that are executed by one or more electronic devices in an electronic system to execute a method comprising:

determining, in a physical environment of a first user and before the first user answers an electronic call from a second user, different locations where a virtual image that represents the second user can be placed during the electronic call between the first user and a second user;

processing, at a smartphone in communication with wearable electronic glasses (WEG) worn on a head of the first user, the electronic call between the first user and the second user;

answering, by the first user, the electronic call that selects one of the different locations in the physical environment of the first user where to place the virtual image that represents the second user during the electronic call between the first user and the second user; and

displaying, by the WEG worn on the head of the first user and during the electronic call, the virtual image that represents the second user at the one of the different locations.

10. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

rotating a face of the virtual image of the second user to continue to be directed toward the first user and to track the first user as the first user moves to different locations in the physical environment.

11. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

displaying, with the WEG and before the first user accepts the electronic call from the second user, multiple different suitable locations where to place the virtual image of the second user in the physical environment of the first user for the electronic call, wherein the multiple different suitable locations are displayed with color to distinguish from other locations in the physical environment.

12. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

determining a size of a surface area of physical objects in the physical environment to determine whether one of the physical objects has sufficient size to be a suitable location where to place the virtual image of the second user in the physical environment of the first user for the electronic call.

13. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

determining a time of day when the electronic call occurs; and

selecting suitable location where to place the virtual image of the second user in the environment of the first user for the electronic call based on the time of day.

14. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

simultaneously displaying, with the WEG and before the first user accepts the electronic call from the second user, three-dimensional (3D) augmented reality (AR) images in the physical environment that are suitable locations where to place the virtual image of the second user in the environment of the first user for the electronic call.

15. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

displaying, with the WEG and before the first user accepts the electronic call from the second user, a preview of the virtual image that shows the first user where the virtual image of the second user will be placed in the physical environment when the first user accepts the electronic call from the second user.

16. The non-transitory computer readable storage media storing instructions of claim 9 in which the method further comprises:

showing a call history between the first user and the second user by simultaneously displaying, with the WEG, multiple locations where the virtual image of the second user appeared in previous electronic calls between the first user and the second user.

17. A method executed by one or more electronic devices that include at least a smartphone in wireless communication with wearable electronic glasses (WEG) worn on a head of a first user, the method comprising:

determining, by the one or more electronic devices and in a physical environment of the first user before the first user has an electronic communication with a second user, different suitable locations where a virtual image that represents the second user can be placed during the electronic communication between the first user and a second user;

processing, by the smartphone in wireless communication with the WEG worn on the head of the first user, the electronic communication between the first user and the second user;

selecting, by the one or more electronic devices and in response to the first user accepting the electronic communication from the second user, one of the different suitable locations in the physical environment of the first user where to place the virtual image that represents the second user during the electronic communication between the first user and the second user; and

displaying, by the WEG worn on the head of the first user and during the electronic communication, the virtual image that represents the second user at the one of the different suitable locations.

18. The method of claim 17 further comprising:

highlighting, with color on a display of the WEG and before the first user accepts the electronic communication, the different suitable locations in the physical environment that are suitable locations where to place the virtual image of the second user for the electronic communication.

19. The method of claim 17 further comprising:

detecting, with the WEG, when a person moves into the one of the different suitable locations where the virtual image of the second user is being displayed during the electronic communication; and

moving, in response to the detecting the person moved into the one of the different suitable locations where the virtual image of the second user is being displayed, a location of the virtual image in the physical environment so the person and the virtual image are not situated at a same location in the physical environment.

20. The method of claim 17 further comprising:

detecting, with the WEG, when the virtual image is no longer in a field of view of the first user during the electronic communication; and

moving, in response to the detecting that the virtual image is no longer in the field of view of the first user, a location of the virtual image in the physical environment so the virtual image is within the field of view of the first user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2024
From: LYREN, PHILIP SCOTT
To: PELAGIC CONCEPTS LLC
Reel/Frame 066658/0307 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: LYREN, PHILIP SCOTT
To: FOUR MILE BAY LLC
Reel/Frame 059063/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: FOUR MILE BAY LLC
To: LYREN, PHILIP SCOTT
Reel/Frame 059064/0159 →
Continuity (9)
Continuation 16401208 · May 2, 2019
Continuation 16246494 · Jan 12, 2019
Continuation 16161239 · Oct 16, 2018
Continuation 16021045 · Jun 28, 2018
Continuation 15944794 · Apr 4, 2018
Continuation 15825131 · Nov 29, 2017
Continuation 15632300 · Jun 24, 2017
Continuation 14823582 · Aug 11, 2015
Provisional Application 62116642 · Feb 16, 2015
Cited By (13)
US 12,189,422 US 12,192,680 US 12,236,008 US 12,265,655 US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,669,848