IP Library Granted Patent US 10,834,454
Granted Patent B2
US 10,834,454 · App. 16/060,930 · Granted Nov 10, 2020

Personalized presentation enhancement using augmented reality

Inventors: Shahab Hamidi-Rad (Sunnyvale, CA); Subrahmanya Sandilya Bhamidipati (Sunnyvale, CA); Brian Charles Eriksson (San Jose, CA); Cong Han Lim (Madison, WI); Hasti Seifi (Vancouver, CA); Urvashi Oswal (Madison, WI); Annamalai Natarajan (Amherst, MA); Paris Syminelakis (Palo Alto, CA)
Assignee: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
H04N21/4126G06T11/60H04N21/431H04N21/435H04N21/44218H04N21/44222H04N21/4532H04N21/4667H04N21/4884H04N21/8133H04N21/84G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,834,454
App. No.
16/060,930
Granted
Nov 10, 2020
Kind
B2
Abstract

A method of presenting personalized additional information along with displayed content includes accessing a content viewing history and a user profile. Detecting an event by extracting metadata related to content provided for display, the content provided for display related to other content not contained within the content viewing history, and accessing additional information related to the detected event. Additional features include overlaying an object onto the content being displayed on the content display device, and displaying background image information the surrounds the content display device in the view of the AR user. Any or all of the features may be present simultaneously.

Claims (27)

1. A method comprising:

comparing a user profile and metadata related to digital multimedia content provided for display on a first display to determine whether an object within the digital multimedia content is to be replaced by a replacement image when the first display is viewed through a wearable user interface, wherein the first display displays the digital multimedia content including the object within the digital multimedia content;

accessing the replacement image of the object displayed on the first display, the replacement image to be viewed using the wearable user interface, the replacement image accessed based on the comparing;

projecting the replacement image on a lens of the wearable user interface, the replacement image seen when the digital multimedia content on the first display is viewed through the wearable user interface;

accessing a background image from the metadata related to the digital multimedia content; and

providing the background image to the wearable user interface for projection at a position surrounding the digital multimedia content display device.

2. The method of claim 1 , further comprising presenting additional information for display as subtitles related to the digital multimedia content provided for display wherein the additional information is not in a user viewing history.

3. The method of claim 1 , further comprising presenting additional information for display to a user interface of an augmented reality system.

4. The method of claim 1 , wherein projecting the replacement image on a lens of the wearable user interface includes:

receiving information regarding a position of a user interface of an augmented reality system relative to the digital multimedia content display device;

determining a position for projection of the replacement image; and

providing data identifying the position for projection of the replacement image to the wearable user interface.

5. A controller device comprising:

a display interface driving a first display of audio/video digital multimedia content;

a network transmitter/receiver for communicating with a network providing the audio/video digital multimedia content including metadata identifying characteristics of the audio/video digital multimedia content;

a storage device for storing a user profile;

a processor using the metadata from the audio/video digital multimedia content and the user profile to determine whether an object within the digital multimedia content is to be replaced with a replacement image when the first display is viewed through a wearable user interface;

the processor operating to request the replacement image for the object based on the determination, wherein the replacement image is provided to a wearable user interface transmitter/receiver, the replacement image projected on a lens of the wearable user interface, the replacement image seen when the audio/video digital multimedia content on the first display is viewed through the wearable user interface; and

wherein the processor accesses a background image from metadata associated with the digital multimedia content and provides the background image to the wearable user interface transmitter/receiver for projection at a position surrounding the digital multimedia content display device.

6. The controller device of claim 5 , further comprising wherein the wearable user interface transmitter/receiver drives additional information as subtitles to overlay on the display, wherein the additional information is not in a user viewing history.

7. The controller device of claim 6 , wherein the wearable user interface transmitter/receiver communicates with a user interface of an augmented reality system.

8. The controller device of claim 5 , wherein the storage device comprises a user profile database for storing the user profile, the user profile including user preference information including language and user presentation preferences.

9. The controller device of claim 5 , wherein the processor is configured to:

receive information regarding a position of the wearable user interface relative to the digital multimedia content display device;

determine a position for projection of the replacement image onto the digital multimedia content for display as viewed from the wearable user interface; and

provide data identifying the position for projection of the replacement image to the wearable user interface transmitter/receiver.

10. The controller device of claim 5 , wherein the processor is a component of a set-top box or router.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2020
From: INTERDIGITAL CE PATENT HOLDINGS, SAS
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 053083/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2019
From: THOMSON LICENSING
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 049850/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2018
From: HAMIDI-RAD, SHAHAB; ERIKSSON, BRIAN; OSWAL, URVASHI; LIM, CONG HAN; NATARAJAN, ANNAMALAI; BHAMIDIPATI, SUBRAHMANYA SANDILYA; SEIFI, HASTI; SYMINELAKIS, PARIS
To: THOMSON LICENSING
Reel/Frame 046260/0361 →