IP Library Granted Patent US 10,137,374
Granted Patent B2
US 10,137,374 · App. 15/906,448 · Granted Nov 27, 2018

Method for an augmented reality character to maintain and exhibit awareness of an observer

Inventors: Thomas Miller (San Mateo, CA); George Weising (San Mateo, CA)
Assignee: Sony Interactive Entertainment America LLC
A63F13/655A63F13/211A63F13/213A63F13/5255A63F13/92G06T19/006A63F2300/105A63F2300/1093A63F2300/204A63F2300/6607A63F2300/6676A63F2300/69G09G2340/12G09G2340/125G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,137,374
App. No.
15/906,448
Granted
Nov 27, 2018
Kind
B2
Abstract

A method comprising: detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene; generating an augmented reality scene formed by inserting a virtual character into the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device; displaying the augmented reality scene on a display; wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.

Claims (40)

1. A method for causing a virtual character to demonstrate awareness of a portable device's position or activity, the method comprising, detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene, the anchor being tracked during movement of the portable device;

generating an augmented reality scene formed by inserting a virtual character into the real-world scene as captured by the camera, the virtual character being positioned in the augmented reality scene in relation to the identified anchor, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device;

displaying the augmented reality scene on a display;

wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character;

wherein the adjustment of the view direction of the virtual character is in the direction of the position of the portable device and is defined by adjustment from a current view direction to an adjusted view direction towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.

2. The method of claim 1 , wherein the insertion of the virtual character into the real-world scene comprises placement of the virtual character on a surface of the anchor identified within the real-world scene.

3. The method of claim 1 , wherein the anchor is selected from the group consisting of one or more augmented reality tags and one or more features within the real-world scene.

4. The method of claim 1 , wherein the performance of an action indicating awareness occurs automatically, without requiring a command from a user.

5. The method of claim 1 , further comprising,

continuously updating the adjustment of the view direction of the virtual character in the direction of the position of the portable device, as the portable device moves in three-dimensional space.

6. The method of claim 1 , wherein the action indicating awareness further comprises moving the virtual character towards the portable device.

7. The method of claim 1 , wherein the display is included in the portable device.

8. A method for causing a virtual character to demonstrate awareness of a portable device's position or activity, the method comprising,

capturing a real-world scene at a camera of a portable device;

identifying and tracking one or more markers in the real-world scene;

tracking a position of the portable device;

generating a virtual reality scene positioned with reference to the one or more markers in the real-world scene, the virtual reality scene including a virtual character positioned with reference to the one or more markers in the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device;

displaying the virtual reality scene on a display;

wherein the action indicating awareness comprises adjusting a view direction, in the virtual reality scene, of the virtual character, by adjusting a head of the virtual character;

wherein the adjustment of the view direction is in the direction of the position of the portable device, and wherein the adjustment of the view direction changes a relationship of the view direction to the one or more markers; and

continuously updating the adjustment of the view direction as the portable device moves in three-dimensional space.

9. The method of claim 8 , wherein the markers are selected from the group consisting of one or more augmented reality tags and one or more features within the real-world scene.

10. The method of claim 8 , wherein the performance of an action indicating awareness occurs automatically, without requiring a command from a user.

11. The method of claim 8 , wherein the adjustment of the view direction of the virtual character includes adjustment of eyes of the virtual character so as to look in the direction of the portable device.

12. The method of claim 8 , further comprising,

continuously updating the adjustment of the view direction of the virtual character in the direction of the position of the portable device, as the portable device moves in three-dimensional space.

13. The method of claim 8 , wherein the action indicating awareness further comprises moving the virtual character towards the portable device.

14. The method of claim 8 , wherein the display is included in the portable device.

15. A method for causing a plurality of virtual characters to demonstrate awareness of a portable device's position or activity, the method comprising,

detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene, the anchor being tracked during movement of the portable device;

generating an augmented reality scene formed by inserting a plurality of virtual characters into the real-world scene as captured by the camera, the virtual characters being positioned in the augmented reality scene in relation to the identified anchor, each of the virtual characters configured to perform an action indicating awareness of the position or activity of the portable device;

displaying the augmented reality scene on a display;

wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual characters;

wherein the adjustment of the view direction of each of the virtual characters is in the direction of the position of the portable device and is defined by adjustment from a current view direction to an adjusted view direction towards the portable device, and wherein the adjustment of the view direction of each of the virtual characters changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of each of the virtual characters includes adjustment of a head of the virtual character so as to look in the direction of the portable device.

16. The method of claim 15 , wherein the anchor is selected from the group consisting of one or more augmented reality tags and one or more features within the real-world scene.

17. The method of claim 15 , wherein the performance of an action indicating awareness occurs automatically, without requiring a command from a user.

18. The method of claim 15 , further comprising,

continuously updating the adjustment of the view direction of each of the virtual characters in the direction of the position of the portable device, as the portable device moves in three-dimensional space.

19. The method of claim 15 , wherein the action indicating awareness further comprises moving the virtual characters toward the portable device.

20. The method of claim 15 , wherein the display is included in the portable device.

Assignments (1)
MERGER Recorded Mar 30, 2020
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 053323/0567 →
Continuity (3)
Continuation 12963585 · Dec 8, 2010
Provisional Application 61319021 · Mar 30, 2010
Related Publication 20180185757A1 · Jul 5, 2018
Cited By (1)
US 12,518,436