IP Library Granted Patent US 12,026,812
Granted Patent B2
US 12,026,812 · App. 17/462,010 · Granted Jul 2, 2024

Schemes for retrieving and associating content items with real-world objects using augmented reality and object recognition

Inventor: Glenn Black (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
G06T11/60G06F18/22G06T19/006G06V20/20G06V20/653G06V20/70G06T2219/004G06V20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,812
App. No.
17/462,010
Granted
Jul 2, 2024
Kind
B2
Abstract

A method includes identifying a real-world object in a scene viewed by a camera of a user device, matching the real-world object with a tagged object based at least in part on image recognition and a sharing setting of the tagged object, the tagged object having been tagged with a content item, providing a notification to a user of the user device that the content item is associated with the real-world object, receiving a request from the user for the content item, and providing the content item to the user. A computer readable storage medium stores one or more computer programs, and an apparatus includes a processor-based device.

Claims (42)

1. A method comprising:

identifying a real-world object in an image;

matching the real-world object with a tagged real-world object based at least in part on image recognition, the tagged real-world object having been tagged with a content item by way of a tagging user interface that displays a first option for entering the content item; and

providing a notification to a user that the content item is associated with the real-world object;

wherein the matching is further based on a setting assigned to the tagged real-world object by way of a second option displayed on the tagging user interface that provides for selection from a list of attributes of the tagged real-world object.

2. The method of claim 1 , wherein the attributes are based on an appearance of the tagged real-world object, are determined using image recognition, or/and are based on a location of the tagged real-world object.

3. The method of claim 1 , wherein the matching of the real-world object with the tagged real-world object is further based on a location of the user and/or a social network connection between the user and an author of the content item.

4. The method of claim 1 , wherein the notification comprises one or more of a sound notification, a pop-up notification, a vibration, or an icon in a display of a user device.

5. The method of claim 1 , wherein the content item comprises one or more of a text comment, an image, an audio clip, or a video clip.

6. An apparatus comprising:

a processor-based device; and

a non-transitory storage medium storing a set of computer readable instructions configured to cause the processor-based device to perform steps comprising:

identifying a real-world object in an image;

matching the real-world object with a tagged real-world object based at least in part on image recognition, the tagged real-world object having been tagged with a content item by way of a tagging user interface that displays a first option for entering the content item; and

providing a notification to a user that the content item is associated with the real-world object;

wherein the matching is further based on a setting assigned to the tagged real-world object by way of a second option displayed on the tagging user interface that provides for selection from a list of attributes of the tagged real-world object.

7. The apparatus of claim 6 , wherein the attributes are based on an appearance of the tagged real-world object, are determined using image recognition, or/and are based on a location of the tagged real-world object.

8. The apparatus of claim 6 , wherein the matching of the identified real-world object with the tagged real-world object is further based on a location of the user and/or a social network connection between the user and an author of the content item.

9. The apparatus of claim 6 , wherein the notification comprises one or more of a sound notification, a pop-up notification, a vibration, or an icon in a display of a user device.

10. The apparatus of claim 6 , wherein the content item comprises one or more of a text comment, an image, an audio clip, or a video clip.

11. A method comprising:

receiving a selection of a first real-world object from a first user;

receiving a content item to tag to the first real-world object by way of a tagging user interface that displays a first option for entering the content item;

receiving one or more images of the first real-world object;

receiving a setting by way of a second option displayed on the tagging user interface that provides for selection from a list of attributes of the first real-world object, wherein the setting comprises information relating to how the first real-world object will be matched with other images; and

storing the content item, the one or more images of the first real-world object, and the setting on a server, wherein the content item is configured to be retrieved by a second user viewing a second real-world object matching the first real-world object.

12. The method of claim 11 , wherein the content item comprises one or more of a text comment, an image, an audio clip, or a video clip.

13. The method of claim 11 , wherein the attributes are based on an appearance of the first real-world object, are determined using image recognition, or/and are based on a location of the first real-world object.

14. The method of claim 11 , wherein the setting is entered by the first user selecting from the list of attributes.

15. The method of claim 11 , wherein the list of attributes is generated through object recognition performed on the one or more images of the first real-world object.

16. An apparatus comprising:

a processor-based device; and

a non-transitory storage medium storing a set of computer readable instructions configured to cause the processor-based device to perform steps comprising:

receiving a selection of a first real-world object from a first user;

receiving a content item to tag to the first real-world object by way of a tagging user interface that displays a first option for entering the content item;

receiving one or more images of the first real-world object;

receiving a setting by way of a second option displayed on the tagging user interface that provides for selection from a list of attributes of the first real-world object, wherein the setting comprises information relating to how the first real-world object will be matched with other images; and

storing the content item, the one or more images of the first real-world object, and the setting on a server, wherein the content item is configured to be retrieved by a second user viewing a second real-world object matching the first real-world object.

17. The apparatus of claim 16 , wherein the content item comprises one or more of a text comment, an image, an audio clip, or a video clip.

18. The apparatus of claim 16 , wherein the attributes are based on an appearance of the first real-world object, are determined using image recognition, or/and are based on a location of the first real-world object.

19. The apparatus of claim 16 , wherein the setting is entered by the first user selecting from the list of attributes.

20. The apparatus of claim 16 , wherein the list of attributes is generated through automatic object recognition performed on the one or more images of the first real-world object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2024
From: BLACK, GLENN
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 067452/0625 →
CHANGE OF NAME Recorded May 17, 2024
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 067456/0896 →
Continuity (6)
Continuation 16903240 · Jun 16, 2020
Continuation 16281102 · Feb 21, 2019
Continuation 14565236 · Dec 9, 2014
Provisional Application 62057223 · Sep 29, 2014
Provisional Application 62057219 · Sep 29, 2014
Related Publication 20210397834A1 · Dec 23, 2021