IP Library Granted Patent US 10,169,921
Granted Patent B2
US 10,169,921 · App. 15/275,709 · Granted Jan 1, 2019

Systems and methods for augmented reality aware contents

Inventors: Ragupathy Jayaraj (Bangalore, IN); Mukesh Manjunath Prabhu (Bangalore, IN)
Assignee: Wipro Limited
G06T19/006G06F3/005G06F3/011G06F17/30H04N7/188G06T2200/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,169,921
App. No.
15/275,709
Granted
Jan 1, 2019
Kind
B2
Abstract

Methods and systems for rendering augmented reality aware standard digital content are disclosed. The method includes detecting a context sensitive trigger initiated in response to activation of a trigger condition related to a standard digital content; determining augmented reality content information associated with the context sensitive trigger using augmented reality awareness data; retrieving based on the augmented reality content information, at least one of augmented reality trigger information, augmented reality digital content or mixed content experience configuration; activating at least one reality source based on the context sensitive trigger to capture reality data in response to retrieving; identifying at least one augmented reality trigger in the at least one reality source; and selectively rendering one of the at least one portion of the standard digital content, the augmented reality digital content and the reality data relative to the at least one portion of the standard digital content.

Claims (45)

1. A method of rendering augmented reality aware standard digital content, the method comprising:

detecting, by a user device, a context sensitive trigger initiated in response to activation of a trigger condition related to a standard digital content;

determining augmented reality content information associated with the context sensitive trigger using augmented reality awareness data;

retrieving based on rendering capability of the user device and augmented reality content information, at least one of augmented reality trigger information, augmented reality digital content associated with the augmented reality trigger information or mixed content experience configuration, wherein the mixed content experience configuration is indicative of what kind and combination of the standard digital content, the augmented reality digital content, and reality data has to be rendered;

activating at least one reality source based on the context sensitive trigger to capture reality data in response to retrieving the augmented reality content information, the augmented reality trigger information, and the mixed content experience configuration;

identifying, by the user device, at least one augmented reality trigger in the at least one reality source, when the rendering capability of the user device comprises ability to identify augmented reality triggers in reality sources;

selectively rendering, by the user device, a particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data captured by the at least one reality source relative to the at least one portion of the standard digital content, based on the rendering capability of the user device and the mixed content experience configuration, wherein based on the rendering capability of the user device, determining one or more decision factors comprising a selection of one or more augmented reality engines, selection of one or more augmentation objects, and selection of quality of augmentation; and

automatically determining, by the user device, an extent of rendering the particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data relative to the at least one portion of the standard digital content on the user device based on the determined one or more decision factors.

2. The method of claim 1 , wherein the trigger condition for the context sensitive trigger comprises at least one of user actions, user gestures, user profile, user preferences, ambient environment, device location, device orientation, content-flow actions or device events comprising power saving mode, locked state, and user device sensor values.

3. The method of claim 1 , wherein the standard digital content comprises at least one of e-books, PDF files, Notepad, images, Web pages, Microsoft Word document, audio content, 3D objects, virtual reality, animated content or video content.

4. The method of claim 1 , wherein the context sensitive trigger corresponds to the context in which the trigger condition was activated, the content sensitive trigger indicates enablement or disablement of an augmented reality digital content.

5. The method of claim 1 further comprising rendering the at least one portion of the standard digital content on the user device based on the rendering capability of the user device.

6. The method of claim 1 further comprising rendering the at least one portion of the standard digital content and the augmented reality digital content on the user device based on the rendering capability of the user device, wherein the augmented reality digital content is overlaid on the standard digital content.

7. The method of claim 1 , wherein the at least one reality source comprises a camera, sensor values, and digital content.

8. The method of claim 1 , wherein the augmented reality trigger comprises at least one of a marker, an object, temperature, time lapse, location, sensor values or sound.

9. The method of claim 1 further comprising creating the augmented reality aware standard digital content, creating comprising:

forming associations between context sensitive triggers and augmented reality content information, association between augmented reality trigger information and augmented reality digital content; and

configuring the mixed content experience configuration comprising rules governing the selective rendering of at least one of the at least one portion of the standard digital content, the augmented reality digital content relative to the at least one portion of the standard digital content or the reality data captured by the at least one reality source.

10. The method of claim 1 further comprising deactivating the at least one reality source on expiration of the context sensitive trigger or identification of a deactivating context sensitive trigger.

11. The method of claim 1 , wherein the rendering capability of the user device comprises ability to: detect context sensitive triggers, detect augmented reality triggers, render augmented reality digital content, and activate the at least one reality source in response to retrieving an augmented reality trigger.

12. A system for rendering augmented reality aware standard digital content, the system comprising:

at least one processors; and

a computer-readable medium storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

detect a context sensitive trigger initiated in response to activation of a trigger condition related to a standard digital content;

determine augmented reality content information associated with the context sensitive trigger using augmented reality awareness data;

retrieve based on rendering capability of the user device and augmented reality content information, at least one of augmented reality trigger information, augmented reality digital content associated with the augmented reality trigger information or mixed content experience configuration, wherein the mixed content experience configuration is indicative of what kind and combination of the standard digital content, the augmented reality digital content, and reality data has to be rendered;

activate at least one reality source based on the context sensitive trigger to capture reality data in response to retrieving the augmented reality content information, the augmented reality trigger information, and the mixed content experience configuration;

identify at least one augmented reality trigger in the at least one reality source, when the rendering capability of the user device comprises ability to identify augmented reality triggers in reality sources;

selectively render a particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data captured by the at least one reality source relative to the at least one portion of the standard digital content, based on the rendering capability of the user device and the mixed content experience configuration, wherein based on the rendering capability of the user device, determining one or more decision factors comprising a selection of one or more augmented reality engines, selection of one or more augmentation objects, and selection of quality of augmentation; and

automatically determine an extent of rendering the particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data relative to the at least one portion of the standard digital content on the user device based on the determined one or more decision factors.

13. The system of claim 12 , wherein the trigger condition for the context sensitive trigger comprises at least one of user actions, user gestures, user profile, user preferences, ambient environment, device location, device orientation, content-flow actions or device events comprising power saving mode, locked state, and user device sensor values.

14. The system of claim 12 , wherein the operations further comprise rendering the at least one portion of the standard digital content on the user device based on the rendering capability of the user device.

15. The system of claim 12 , wherein the operations further comprise rendering the at least one portion of the standard digital content and the augmented reality digital content on the user device based on the rendering capability of the user device, wherein the augmented reality digital content is overlaid on the standard digital content.

16. The system of claim 12 , wherein the operations further comprise creating the augmented reality aware standard digital content, creating further comprises operations of:

forming associations between context sensitive triggers and augmented reality content information, association between augmented reality trigger information and augmented reality digital content; and

configuring the mixed content experience configuration comprising rules governing the selective rendering of at least one of the at least one portion of the standard digital content, the augmented reality digital content relative to the at least one portion of the standard digital content or the reality data captured by the at least one reality source.

17. The system of claim 12 , wherein the operations further comprise deactivating the at least one reality source on expiration of the context sensitive trigger or identification of a deactivating context sensitive trigger.

18. A non-transitory computer-readable storage medium for rendering augmented reality aware standard digital content, when executed by a computing device, cause the computing device to:

detect, by a user device, a context sensitive trigger initiated in response to activation of a trigger condition related to a standard digital content;

determine augmented reality content information associated with the context sensitive trigger using augmented reality awareness data;

retrieve based on rendering capability of the user device and augmented reality content information, at least one of augmented reality trigger information, augmented reality digital content associated with the augmented reality trigger information or mixed content experience configuration, wherein the mixed content experience configuration is indicative of what kind and combination of the standard digital content, the augmented reality digital content, and reality data has to be rendered;

activate at least one reality source based on the context sensitive trigger to capture reality data in response to retrieving the augmented reality content information, the augmented reality trigger information, and the mixed content experience configuration;

identify, by the user device, at least one augmented reality trigger in the at least one reality source, when the rendering capability of the user device comprises ability to identify augmented reality triggers in reality sources;

selectively render, by the user device, a particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data captured by the at least one reality source relative to the at least one portion of the standard digital content, based on the rendering capability of the user device and the mixed content experience configuration, wherein based on the rendering capability of the user device, determining one or more decision factors comprising a selection of one or more augmented reality engines, selection of one or more augmentation objects, and selection of quality of augmentation; and

automatically determine, by the user device, an extent of rendering the particular combination of the at least one portion of the standard digital content, the augmented reality digital content and the reality data relative to the at least one portion of the standard digital content on the user device based on the determined one or more decision factors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2016
From: JAYARAJ, RAGUPATHY; PRABHU, MUKESH MANJUNATH
To: WIPRO LIMITED
Reel/Frame 040145/0231 →
Priority Claims (1)
IN 201641026534 · Aug 3, 2016 · national
Continuity (1)
Related Publication 20180040166A1 · Feb 8, 2018
Cited By (1)
US 12,444,132