IP Library Granted Patent US 8,606,317
Granted Patent B2
US 8,606,317 · App. 13/664,876 · Granted Dec 10, 2013

User augmented reality for camera-enabled mobile devices

Inventors: Athellina R. Ahmad Athsani (Santa Clara, CA); Chris T. Kalaboukis (San Jose, CA)
Assignee: YAHOO! Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,606,317
App. No.
13/664,876
Granted
Dec 10, 2013
Kind
B2
Abstract

Apparatus and methods are described for providing a user augmented reality (UAR) service for a camera-enabled mobile device, so that a user of such mobile device can use the mobile device to obtain meta data regarding one or more images/video that are captured with such device. The meta data is interactive and allows the user to obtain additional information or specific types of information, such as information that will aid the user in making a decision regarding the identified objects or selectable action options that can be used to initiate actions with respect to the identified objects.

Claims (34)

1. A computer-implemented method for providing information regarding a moving object captured in an image or video by a camera of a mobile device, comprising:

receiving the image or video captured by the camera of the mobile device;

processing the image or video using an image processing technique to identify the moving object;

generating meta data relating to the moving object, the meta data comprising information about the moving object that relates to a social network of a user of the mobile device;

causing a visual representation of the meta data to be overlaid on a visual representation of the image or video in the display of the mobile device; and

causing action information to be displayed in the display of the mobile device, the action information being configured to enable the user to perform a specific action relating to the moving object and the social network.

2. The method of claim 1 wherein the visual representation of the meta data includes one or more of text, an image, video, audio, or a link.

3. The method of claim 1 further comprising causing decision support information to be displayed in the display of the mobile device, the decision support information being configured to help the user of the mobile device make decisions about specific actions relating to the moving object.

4. The method of claim 1 further comprising determining a location associated with the mobile device, wherein identification of the moving object is accomplished with reference to the location.

5. The method of claim 1 wherein generating the meta data comprises conducting a search relating to the moving object, thereby generating one or more search results.

6. The method of claim 1 wherein the moving object is a person, and wherein the meta data include publicly available information about the person.

7. The method of claim 1 further comprising storing the meta data in a database, and responding to a search using at least a portion of the meta data, the search relating to a second image or video determined to be similar to the image or video captured by the camera of the mobile device.

8. The method of claim 1 further comprising storing the meta data in a database, and providing at least a portion of the meta data to the user in response to a request from the user.

9. A mobile device for providing information regarding a moving object captured in an image or video, comprising:

a camera for capturing the image or video;

a display;

at least one a processor and at least one memory, the at least one processor and at least one memory being configured to:

transmit the image or video to a remote device for processing using an image processing technique to identify the moving object;

receive meta data from the remote device relating to the moving object, the meta data comprising information about the moving object that relates to a social network of a user of the mobile device;

overlay a visual representation of the meta data on a visual representation of the image or video in the display of the mobile device; and

display action information in the display of the mobile device, the action information being configured to enable the user to perform a specific action relating to the moving object and the social network.

10. The mobile device of claim 9 wherein the visual representation of the meta data includes one or more of text, an image, video, audio, or a link.

11. The mobile device of claim 9 wherein the at least one processor and at least one memory are further configured to display decision support information in the display of the mobile device, the decision support information being configured to help the user of the mobile device make decisions about specific actions relating to the moving object.

12. The mobile device of claim 9 wherein the at least one processor and at least one memory are further configured to determine a location associated with the mobile device, and transmit the location to the remote device, wherein identification of the moving object by the remote device is accomplished with reference to the location.

13. The mobile device of claim 9 wherein the meta data comprises search results of a search relating to the moving object.

14. The mobile device of claim 9 wherein the moving object is a person, and wherein the meta data include publicly available information about the person.

15. A wearable display device configured to provide information regarding an object in a field of view of a user wearing the device, comprising:

goggles or glasses configured to be worn by the user;

a camera mounted on the goggles or glasses for capturing an image of the field of view;

circuitry configured to transmit the image to a processor for image processing, and to receive meta data from the processor regarding the object in the field of view that relates to a social network of a user of the mobile device; and

a display configured to display the meta data regarding the object and action information in the field of view of the user.

16. The wearable display device of claim 15 wherein the circuitry is a wireless transceiver and the processor is included in a remote device.

17. The wearable display device of claim 15 wherein the wearable display device is also a mobile communication device.

18. The wearable display device of claim 15 wherein the display includes a screen in the field of view of the user.

Assignments (9)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 052853 FRAME: 0153. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 29, 2021
From: R2 SOLUTIONS LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 056832/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 053654 FRAME 0254. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST GRANTED PURSUANT TO THE PATENT SECURITY AGREEMENT PREVIOUSLY RECORDED. Recorded Dec 30, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: R2 SOLUTIONS LLC
Reel/Frame 054981/0377 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jul 8, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
Reel/Frame 053654/0254 →
PATENT SECURITY AGREEMENT Recorded Jun 5, 2020
From: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MERTON ACQUISITION HOLDCO LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 052853/0153 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2018
From: EXCALIBUR IP, LLC.
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 045065/0823 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038950/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2016
From: EXCALIBUR IP, LLC
To: YAHOO! INC.
Reel/Frame 038951/0295 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038383/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2012
From: AHMAD ATHSANI, ATHELLINA R.; KALABOUKIS, CHRIS T.
To: YAHOO! INC.
Reel/Frame 029229/0747 →
Continuity (4)
Continuation 13593282 · Aug 23, 2012
Continuation 13470042 · May 11, 2012
Continuation 11874389 · Oct 18, 2007
Related Publication 20130057585A1 · Mar 7, 2013