IP Library › Granted Patent US 9,536,352
Granted Patent B2
US 9,536,352 · App. 14/227,752 · Granted Jan 3, 2017

Imitating physical subjects in photos and videos with augmented reality virtual objects

Inventor: Glen J. Anderson (Beaverton, OR)
Assignee: Intel Corporation
G06T19/006G06F3/011G06F3/013G06F3/016G06F17/30873G06K17/0016G09G5/377A63F2300/695A63F2300/8082G09G2340/12G09G2340/125G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,536,352
App. No.
14/227,752
Filed
Mar 27, 2014
Granted
Jan 3, 2017
Kind
B2
Art Unit
2618
USPC
345/633
Abstract

Technologies for rendering augmented reality virtual objects include an augmented reality device to capture an image and recognize subjects within the image. Subjects may include persons or objects, such as accessories. The augmented reality device determines a context associated with the subjects of the image and selects one or more virtual objects based on the context. The identified context may include an activity or theme associated with the subject or accessories included in the image. Virtual objects may include accessories and clothing for virtual characters. The augmented reality device may select virtual objects that are similar to identified subjects and accessories, or that are associated with an identified activity or theme of the subject. The augmented reality device applies the virtual objects to a virtual character and renders an augmented reality scene based on the captured image that includes the virtual character. Other embodiments are described and claimed.

Claims (48)

1. An augmented reality device for rendering augmented reality content, the augmented reality device comprising:

image capture circuitry to capture an image;

subject recognition circuitry to (i) analyze the image to recognize a subject represented in the image and a background item in the image, (ii) access a character profile based on the subject, (iii) determine, based on the character profile, whether the background item is associated with the subject, (iv) determine, based on the character profile and in response to a determination that the background item is associated with the subject, a theme of the image, and (v) determine a context associated with the subject based on the image and the background item, wherein the context is related to the theme, wherein to determine the context comprises to classify a type of an accessory object represented in the image that is related to the subject;

virtual object matching circuitry to select a virtual object based on the context of the subject and the background item, wherein the virtual object comprises an accessory object that is composable with the virtual character and is of the same type as the accessory object represented in the image, and wherein to select the virtual object comprises to select the virtual object based on similarity between the virtual object and a feature of the subject; and

augmented reality rendering circuitry to (i) apply the virtual object to a virtual character and (ii) render an augmented reality scene based on the captured image and including the virtual character with the virtual object applied thereto.

2. The augmented reality device of claim 1 , wherein to select the virtual object comprises to select a virtual object similar to the accessory object.

3. The augmented reality device of claim 2 , wherein:

to determine the context comprises to identify a feature of the accessory object; and

to select the virtual object similar to the accessory object comprises to select a virtual object having a feature matching the feature of the accessory object.

4. The augmented reality device of claim 1 , wherein the context comprises a current activity of the subject.

5. The augmented reality device of claim 4 , wherein to select the virtual object comprises to select a virtual object associated with the current activity of the subject.

6. The augmented reality device of claim 1 , wherein to select the virtual object comprises to select a virtual object associated with the theme associated with the subject.

7. The augmented reality device of claim 1 , wherein to determine the context comprises to receive context data from a mobile computing device associated with the subject.

8. The augmented reality device of claim 7 , wherein the subject recognition circuitry is further to receive an indication from the mobile computing device that the user of the mobile computing device has opted-in to share the context data.

9. The augmented reality device of claim 7 , wherein to receive the context data from the mobile computing device comprises to:

poll the mobile computing device to determine whether the mobile computing device has the context data available;

receive, in response to the poll of the mobile computing device, an indication from the mobile computing device that the context data is available;

request the context data from the mobile computing device in response to the indication that the context data is available; and

receive, in response to the request, the context data from the mobile computing device.

10. The augmented reality device of claim 1 , wherein to select the virtual object comprises to receive the virtual object from a remote virtual object database.

11. A method for rendering augmented reality content, the method comprising:

capturing, by an augmented reality device, an image;

analyzing, by the augmented reality device, the image to recognize a subject represented in the image and a background item in the image;

accessing, by the augmented reality device, a character profile based on the subject;

determining, by the augmented reality device and based on the character profile, whether the background item is associated with the subject;

determine, by the augmented reality device and in response to a determination that the background item is associated with the subject, a theme of the image based on the character profile;

determining, by the augmented reality device, a context associated with the subject based on the image and the background item, wherein the context is related to the theme, wherein determining the context comprises classifying a type of an accessory object represented in the image that is related to the subject;

selecting, by the augmented reality device, a virtual object based on the context of the subject and the background item, wherein the virtual object comprises an accessory object that is composable with the virtual character and is of the same type as the accessory object represented in the image, and wherein selecting the virtual object comprises selecting the virtual object based on similarity between the virtual object and a feature of the subject;

applying, by the augmented reality device, the virtual object to a virtual character; and

rendering, by the augmented reality device, an augmented reality scene based on the captured image and including the virtual character with the virtual object applied thereto.

12. The method of claim 11 , wherein determining the context comprises determining a current activity of the subject.

13. One or more non-transitory computer-readable storage media comprising a plurality of instructions that in response to being executed cause an augmented reality device to:

capture an image;

analyze the image to recognize a subject represented in the image and a background item in the image;

access a character profile based on the subject;

determine, based on the character profile, whether the background item is associated with the subject;

determine, based on the character profile and in response to a determination that the background item is associated with the subject, a theme of the image;

determine a context associated with the subject based on the image and the background item, wherein the context is related to the theme, wherein to determine the context comprises to classify a type of an accessory object represented in the image that is related to the subject;

select a virtual object based on the context of the subject and the background item, wherein the virtual object comprises an accessory object that is composable with the virtual character and is of the same type as the accessory object represented in the image, and wherein to select the virtual object comprises to select the virtual object based on similarity between the virtual object and a feature of the subject;

apply the virtual object to a virtual character; and

render an augmented reality scene based on the captured image and including the virtual character with the virtual object applied thereto.

14. The one or more non-transitory computer-readable storage media of claim 13 , wherein to select the virtual object comprises to select a virtual object similar to the accessory object.

15. The one or more non-transitory computer-readable storage media of claim 14 , wherein:

to determine the context comprises to identify a feature of the accessory object; and

to select the virtual object similar to the accessory object comprises to select a virtual object having a feature matching the feature of the accessory object.

16. The one or more non-transitory computer-readable storage media of claim 13 , wherein to determine the context comprises to determine a current activity of the subject.

17. The one or more non-transitory computer-readable storage media of claim 16 , wherein to select the virtual object comprises to select a virtual object associated with the current activity of the subject.

18. The one or more non-transitory computer-readable storage media of claim 13 , wherein to select the virtual object comprises to select a virtual object associated with the theme associated with the subject.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2014
From: ANDERSON, GLEN J.
To: INTEL CORPORATION
Reel/Frame 032934/0652 →
Continuity (1)
Related Publication 20150279101A1 · Oct 1, 2015