IP Library Granted Patent US 10,587,843
Granted Patent B1
US 10,587,843 · App. 16/669,501 · Granted Mar 10, 2020

Display an image during a communication

Inventor: Philip Scott Lyren (Bangkok, TH)
H04N7/157G02B27/017G02B27/0176H04N7/144H04N7/147H04N13/167H04N13/189H04N13/194H04N13/332H04N13/344H04N13/383H04N13/398H04R1/00G02B2027/014G02B2027/0134G02B2027/0178G02B2027/0187H04N2007/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,587,843
App. No.
16/669,501
Granted
Mar 10, 2020
Kind
B1
Abstract

An electronic device displays an image during a communication between two people. The image represents one of the people to the communication. The electronic device determines a location where to place the image and displays the image such that the image appears to exist at the location.

Claims (57)

1. A method executed by one or more electronic devices, the method comprising:

mapping, by the one or more electronic devices, locations of objects where a first user is located;

determining, by the one or more electronic devices and from the mapping of the locations of the objects, available locations where to place an augmented reality (AR) image representing a second user for an electronic communication between the first user and a second user;

selecting, by the one or more electronic devices, one of the available locations where to place the AR image representing the second user for the electronic communication between the first user and the second user;

receiving, at a smartphone in communication with wearable electronic glasses (WEG) worn on a head of the first user, the electronic communication; and

displaying, with the WEG and before the first user answers the electronic communication, a preview of the AR image representing the second user so the first user can see where the WEG will display the AR image representing the second user when the first user answers the electronic communication.

2. The method of claim 1 , wherein the one or more electronic devices includes the WEG.

3. The method of claim 1 further comprising:

determining, by the one or more electronic devices, movement of the first user to a different location with respect to the one of the available locations where the AR image representing the second user is located; and

changing, in response to the movement of the first user to the different location, an orientation of the AR image representing the second user so the AR image representing the second user continues to face the first user while the first user moves to the different location.

4. The method of claim 1 further comprising:

displaying, with the WEG worn on the head of the first user, the AR image representing the second user on top of a table where the first user is located; and

altering an orientation of a face of the AR image representing the second user so the face of the AR image representing the second user is looking at the first user while the first user and the second user talk to each other during the electronic communication and while the first user moves to different locations.

5. The method of claim 1 further comprising:

storing a location where the AR image representing the second user appeared to the first user during the electronic communication between the first user and the second user; and

displaying, with the WEG and after the electronic communication terminates, the AR image representing the second user at the location to show a call history of the electronic communication between the first user and the second user.

6. The method of claim 1 further comprising:

displaying, with the WEG, AR images that highlight available locations where the AR image representing the second user can move during the electronic communication between the first user and the second user.

7. The method of claim 1 further comprising:

determining, with one or more sensors in the WEG, a direction of gaze of the first user; and

automatically moving the AR image representing the second user to a different location when the direction of gaze of the first user is not directed to the one of the available locations where the AR image representing the second user is located.

8. The method of claim 1 , wherein the AR image representing the second user is a three-dimensional (3D) virtual image of a person that represents the second user, and the second user is a software program.

9. A non-transitory computer readable storage media storing instructions that one or more electronic devices execute as a method comprising:

mapping locations of objects where a first user is located;

determining, from the mapping of the locations of the objects, suitable locations where to place an augmented reality (AR) image of a second user;

selecting, by the one or more electronic devices, one of the suitable locations where to place the AR image of the second user for an electronic communication between the first user and the second user;

receiving, at a smartphone in communication with wearable electronic glasses (WEG) worn on a head of the first user, the electronic communication; and

displaying, with the WEG and before the first user answers the electronic communication, a preview of the AR image of the second user so the first user can see where the WEG will display the AR image of the second user when the first user answers the electronic communication.

10. The non-transitory computer readable storage media of claim 9 further comprising:

determining a distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user during the electronic communication between the first user and the second user; and

adjusting, during the electronic communication between the first user and the second user, a size of the AR image of the second user based on the distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user.

11. The non-transitory computer readable storage media of claim 9 further comprising:

determining a distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user during the electronic communication between the first user and the second user; and

decreasing, during the electronic communication between the first user and the second user, a size of the AR image of the second user in response to determining an increase to the distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user.

12. The non-transitory computer readable storage media of claim 9

determining a distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user during the electronic communication between the first user and the second user; and

increasing, during the electronic communication between the first user and the second user, a size of the AR image of the second user in response to determining a decrease to the distance from the WEG to the one of the suitable locations where the WEG displays the AR image of the second user.

13. The non-transitory computer readable storage media of claim 9 further comprising:

adjusting, during the electronic communication between the first user and the second user, a facial orientation of the AR image of the second user so a face of the AR image of the second user continues to look at the first user while the first use moves to different locations.

14. The non-transitory computer readable storage media of claim 9 further comprising:

displaying, with the WEG, an AR image of a suggested location where the first user can move the AR image of the second user during the electronic communication between the first user and the second user.

15. The non-transitory computer readable storage media of claim 9 , wherein the AR image of the second user is a three-dimensional (3D) virtual image of an animal that represents the second user, and the second user is a software program with whom the first user talks.

16. A method comprising:

determining, by one or more electronic devices and from a mapping of locations of objects where a first user is located, suitable locations where to place an augmented reality (AR) image of a second user;

selecting, by the one or more electronic devices and from the mapping, one of the suitable locations where to place the AR image of the second user for an electronic communication between the first user and the second user;

receiving, at a smartphone in communication with wearable electronic glasses (WEG) worn on a head of the first user, the electronic communication; and

displaying, with the WEG and before the first user answers the electronic communication, a preview of the AR image of the second user so the first user can see where the WEG will display the AR image of the second user when the first user answers the electronic communication.

17. The method of claim 16 further comprising:

detecting when the head of the first user moves and causes the AR image of the second user to no longer be in a field of view of the first user during the electronic communication; and

moving, in response to the detecting that the AR image of the second user is no longer in the field of view of the first user, a location of the AR image of the second user in a physical environment of the first user so the AR image of the second user remains in the field of view of the first user.

18. The method of claim 16 further comprising:

capturing, with a camera in the WEG, images of physical objects in an environment of the first user; and

executing software to recognize the physical objects and to identify a surface where to place the AR image of the second user for the electronic communication.

19. The method of claim 16 further comprising:

rotating, during the electronic communication, a face of the AR image of the second user so the face follows and tracks a location of the first user as the first user moves to different physical locations.

20. The method of claim 16 further comprising:

displaying, with the WEG and before the first user accepts the electronic communication, a preview of the AR image of the second user that shows the first user where the AR image of the second user will be placed in a physical environment of the first user when the first user accepts the electronic communication from the second user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: LYREN, PHILIP SCOTT
To: PELAGIC CONCEPTS LLC
Reel/Frame 069221/0938 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: LYREN, PHILIP SCOTT
To: FOUR MILE BAY LLC
Reel/Frame 059063/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: FOUR MILE BAY LLC
To: LYREN, PHILIP SCOTT
Reel/Frame 059064/0159 →
Continuity (10)
Continuation 16558083 · Aug 31, 2019
Continuation 16401218 · May 2, 2019
Continuation 16246494 · Jan 12, 2019
Continuation 16161239 · Oct 16, 2018
Continuation 16021045 · Jun 28, 2018
Continuation 15944794 · Apr 4, 2018
Continuation 15825131 · Nov 29, 2017
Continuation 15632300 · Jun 24, 2017
Continuation 14823582 · Aug 11, 2015
Provisional Application 62116642 · Feb 16, 2015