IP Library Granted Patent US 12,229,907
Granted Patent B2
US 12,229,907 · App. 18/372,904 · Granted Feb 18, 2025

Systems and methods for displaying supplemental content for media using augmented reality

Inventors: Lucas Waye (Cambridge, MA); Theresa Tokesky (Boston, MA); Michael A. Montalto (South Hamilton, MA); Kanagasabai Sivanadian (Framingham, MA)
Assignee: ADEIA GUIDES INC.
G06T19/006G06F16/4387G06F16/48G06F16/93G06F16/9554G06K7/10722G06K7/1417H04L67/306H04L67/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,907
App. No.
18/372,904
Granted
Feb 18, 2025
Kind
B2
Abstract

Systems and methods are provided for displaying supplemental content for print media using augmented reality. A user profile for a user of an augmented reality device is determined. Content of the print media is searched to identify a first portion of the print media that matches the user profile and a second portion of the print media that does not match the user profile. Supplemental content is obtained based on content of the first portion of the print media. A display of the supplemental content is positioned over the second portion of the print media.

Claims (65)

1. A method comprising:

identifying weather information in a content item that is viewable through an augmented reality device;

determining that the identified weather information describes weather for a first geographical location that is different than a second geographical location of the augmented reality device by:

computing a distance between the first geographical location and the second geographical location; and

in response to determining that the distance is greater than a threshold distance, determining that the second geographical location is different from the first geographical location;

in response to determining that the identified weather information describes the weather for the first geographical location that is different than the second geographical location of the augmented reality device:

retrieving weather information that describes weather for the second geographical location of the augmented reality device; and

generating for display, using the augmented reality device, the retrieved weather information such that the retrieved weather information overlays the identified weather information in the content item.

2. The method of claim 1 , wherein generating for display the retrieved weather information for the second geographical location such that the retrieved weather information overlays the identified weather information in the content item comprises:

determining a position of the identified weather information in the content item; and

generating for display a virtual image of the retrieved weather information for the second geographical location as an overlay at the position of the identified weather information.

3. The method of claim 1 , further comprising:

accessing a database comprising weather information; and

retrieving the weather information that describes the weather for the second geographical location from the database.

4. The method of claim 1 , further comprising:

detecting a visual focus through the augmented reality device on a portion of the content item; and

in response to detecting the visual focus, retrieving supplemental content associated with the portion of the content item.

5. The method of claim 1 , further comprising:

accessing a user profile;

retrieving supplemental content based on one or more user preferences of the user profile; and

generating for display, using the augmented reality device, the supplemental content.

6. The method of claim 5 , wherein the supplemental content comprises video content.

7. The method of claim 1 , wherein the content item comprises print content.

8. The method of claim 1 , wherein the content item is displayed on another device different from the augmented reality device.

9. A method comprising:

identifying weather information in a content item that is viewable through an augmented reality device;

determining that the identified weather information describes weather for a first geographical location that is different than a second geographical location of the augmented reality device by:

identifying one or more keywords in the content item indicative of the first geographical location;

retrieving global positioning system (GPS) information corresponding to the augmented reality device;

determining, based on the GPS information, the second geographical location for the augmented reality device; and

determining that the second geographical location does not match the one or more keywords indicative of the first geographical location;

in response to determining that the identified weather information describes the weather for the first geographical location that is different than the second geographical location of the augmented reality device:

retrieving weather information that describes weather for the second geographical location of the augmented reality device; and

generating for display, using the augmented reality device, the retrieved weather information such that the retrieved weather information overlays the identified weather information in the content item.

10. A system comprising:

an augmented reality device; and

control circuitry configured to:

identify weather information in a content item that is viewable through the augmented reality device;

determine that the identified weather information describes weather for a first geographical location that is different than a second geographical location of the augmented reality device by:

computing a distance between the first geographical location and the second geographical location; and

in response to determining that the distance is greater than a threshold distance, determining that the second geographical location is different from the first geographical location;

in response to determining that the identified weather information describes the weather for the first geographical location that is different than the second geographical location of the augmented reality device:

retrieve weather information that describes weather for the second geographical location of the augmented reality device; and

generate for display, using the augmented reality device, the retrieved weather information such that the retrieved weather information overlays the identified weather information in the content item.

11. The system of claim 10 , wherein the control circuitry, when generating for display the retrieved weather information for the second geographical location such that the retrieved weather information overlays the identified weather information in the content item, is configured to:

determine a position of the identified weather information in the content item; and

generate for display a virtual image of the retrieved weather information for the second geographical location as an overlay at the position of the identified weather information.

12. The system of claim 10 , wherein the control circuitry, when determining that the identified weather information describes the weather for the first geographical location that is different than the second geographical location of the augmented reality device, is configured to:

identify one or more keywords in the content item indicative of the first geographical location;

retrieve global positioning system (GPS) information corresponding to the augmented reality device;

determine, based on the GPS information, the second geographical location for the augmented reality device; and

determine that the second geographical location does not match the one or more keywords indicative of the first geographical location.

13. The system of claim 10 , wherein the control circuitry is further configured to:

access a database comprising weather information; and

retrieve the weather information that describes the weather for the second geographical location from the database.

14. The system of claim 10 , wherein the control circuitry is further configured to:

detect a visual focus through the augmented reality device on a portion of the content item; and

in response to detecting the visual focus, retrieve supplemental content associated with the portion of the content item.

15. The system of claim 10 , wherein the control circuitry is further configured to:

access a user profile;

retrieve supplemental content based on one or more user preferences of the user profile; and

generate for display, using the augmented reality device, the supplemental content.

16. The system of claim 15 , wherein the supplemental content comprises video content.

17. The system of claim 10 , wherein the content item comprises print content.

18. The system of claim 10 , wherein the content item is displayed on another device different from the augmented reality device.

Assignments (2)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2023
From: WAYE, LUCAS; TOKESKY, THERESA; MONTALTO, MICHAEL A.; SIVANADIAN, KANAGASABAI
To: ROVI GUIDES, INC.
Reel/Frame 065034/0433 →
Continuity (4)
Continuation 17410155 · Aug 24, 2021
Continuation 16749444 · Jan 22, 2020
Continuation 15940198 · Mar 29, 2018
Related Publication 20240020932A1 · Jan 18, 2024
References Cited (25)
US 8576276B2 · Bar-Zeev et al. · 2013 [cited by applicant]
US 10083547B1 · Tomatsu · 2018 [cited by applicant]
US 11127219B2 · Waye et al. · 2021 [cited by applicant]
US 11804017B2 · Waye et al. · 2023 [cited by applicant]
US 20030105826A1 · Mayraz · 2003 [cited by applicant]
US 20060089969A1 · Brown et al. · 2006 [cited by applicant]
US 20060126932A1 · Eschbach · 2006 [cited by applicant]
US 20080134083A1 · Farouki · 2008 [cited by applicant]
US 20090125510A1 · Graham et al. · 2009 [cited by applicant]
US 20130147836A1 · Small · 2013 [cited by examiner]
US 20130325463A1 · Greenspan et al. · 2013 [cited by applicant]
US 20140171039A1 · Bjontegard · 2014 [cited by examiner]
US 20140210857A1 · Liu et al. · 2014 [cited by applicant]
US 20150049113A1 · Rahman et al. · 2015 [cited by applicant]
US 20150310667A1 · Young et al. · 2015 [cited by applicant]
US 20160049013A1 · Tosas Bautista · 2016 [cited by applicant]
US 20160133054A1 · Honjo et al. · 2016 [cited by applicant]
US 20180089335A1 · Huang et al. · 2018 [cited by applicant]
US 20180130376A1 · Meess et al. · 2018 [cited by applicant]
US 20180197336A1 · Rochford et al. · 2018 [cited by applicant]
US 20190155884A1 · Liu et al. · 2019 [cited by applicant]
US 20190289341A1 · Vasco de Oliveira Redol · 2019 [cited by examiner]
US 20200394842A1 · Baillard et al. · 2020 [cited by applicant]
US 20210383614A1 · Waye et al. · 2021 [cited by applicant]
Azuma et al., “Evaluating Label Placement for Augmented Reality View Management,” Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '03) (2003) (10 pages). [cited by applicant]