IP Library Granted Patent US 8,156,116
Granted Patent B2
US 8,156,116 · App. 12/342,330 · Granted Apr 10, 2012

Dynamic presentation of targeted information in a mixed media reality recognition system

Assignee: Ricoh Co., Ltd
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,156,116
App. No.
12/342,330
Granted
Apr 10, 2012
Kind
B2
Abstract

A context-aware targeted information delivery system comprises a mobile device, an MMR matching unit, a plurality of databases for user profiles, user context and advertising information, a plurality of comparison engines and a plurality of weight adjusters. The mobile device is coupled to deliver an image patch to the MMR matching unit which in turn performs recognition to produce recognize text. The recognized text is provided to a first and second comparison engines to produce relevant topics and relevant ads. The relevant topics and relevant ads are adjusted with information from a user context database including information such as location, date, time, and other information from a user profile. The weight adjusted relevant topics and relevant ads to a third comparison engine. The third comparison engine compares the weighted relevant topics and relevant ads to produce a set of final ads that are most related to the topics of interest for the user and delivered for display on to the mobile device.

Claims (37)

1. A computer-implemented method for retrieving and generating targeted information, the method comprising:

receiving an image;

performing, with a computer, document recognition using the image to produce recognized text;

producing a list of relevant topics using the recognized text and user profile information;

producing a list of relevant information using the recognized text and target information;

adjusting a weight of one of the list of relevant information based on user context information, the adjusting of the weight including determining word relevancy by calculating a distance from a center of the image outward using a distance measure; and

comparing the list of relevant topics to the list of relevant information to produce a final list of information.

2. The method of claim 1 , wherein the relevant information is a relevant advertisement.

3. The method of claim 1 , wherein

the image is captured with a mobile device and further comprising sending an indicator for the final list of information for display on the mobile device.

4. The method of claim 3 , wherein the indicator is a colored rectangle positioned near an outer edge of a screen of the mobile device.

5. The method of claim 3 , further comprising:

receiving user input selecting the indicator; and

sending enhanced content for display on the mobile device.

6. The method of claim 1 , further comprising sending the final list of information for display on a mobile device.

7. The method of claim 1 , further comprising adjusting a weight of one of the relevant topics in the list of relevant topics based on user context information.

8. The method of claim 7 , wherein the user context information includes one from the group of a patch image; a recognized document; a location and a page of the recognized document; recognized text from the patch image; surrounding text for the patch image; image features of the patch image; hotspot information; physical location where the image was captured; time of day when the image was captured; time of year when the image was captured; history of previous matches; other images that were captured before the latest one; and a user context.

9. The method of claim 1 , wherein comparing the list of relevant topics to the list of relevant information to produce the final list of information comprises using the relevant information with a highest weight value as the final list of information when no match between the list of relevant topics and the list of relevant information is found.

10. The method of claim 1 , wherein the user context information includes one from the group of a patch image; a recognized document; a location and a page of the recognized document; recognized text from the patch image; surrounding text for the patch image; image features of the patch image; hotspot information; physical location where the image was captured; time of day when the image was captured; time of year when the image was captured; history of previous matches; other images that were captured before the latest one; and a user context.

11. The method of claim 1 , wherein the user profile information includes user interests.

12. The method of claim 1 , comprising storing the final list of information in a user context database.

13. The method of claim 1 , wherein the user profile information includes at least one of the user's age, gender, residence and citizenship.

14. A computer program product embodied in a non-transitory computer useable medium storing a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

receive an image;

perform document recognition using the image to produce recognized text;

produce a list of relevant topics using the recognized text and user profile information;

produce a list of relevant information using the recognized text and target information;

adjust a weight of one of the list of relevant information based on user context information, adjusting the weight including determining word relevancy by calculating a distance from a center of the image outward using a distance measure; and

compare the list of relevant topics to the list of relevant information to produce a final list of information.

15. The non-transitory computer program product of claim 14 wherein the relevant information is a relevant advertisement.

16. The non-transitory computer program product of claim 14 wherein the image is captured with a mobile device and wherein the computer readable program when executed on a computer further causes the computer to send an indicator for the final list of information for display on the mobile device.

17. The non-transitory computer program product of claim 16 wherein the indicator is a colored rectangle positioned near an outer edge of a screen of the mobile device.

18. The non-transitory computer program product of claim 16 wherein the computer readable program when executed on a computer further causes the computer to:

receive user input selecting the indicator; and

send enhanced content for display on the mobile device.

19. The non-transitory computer program product of claim 14 wherein the computer readable program when executed on a computer further causes the computer to send the final list of information for display on a mobile device.

20. The non-transitory computer program product of claim 14 wherein the computer readable program when executed on a computer further causes the computer to adjust a weight to one of the relevant topics in the list of relevant topics based on user context information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2009
From: GRAHAM, JAMEY; HULL, JONATHAN J.
To: RICOH CO., LTD.
Reel/Frame 022140/0094 →
Continuity (41)
Continuation In Part 11461017 · Jul 31, 2006
Continuation In Part 11461279 · Jul 31, 2006
Continuation In Part 11461286 · Jul 31, 2006
Continuation In Part 11461294 · Jul 31, 2006
Continuation In Part 11461300 · Jul 31, 2006
Continuation In Part 11461126 · Jul 31, 2006
Continuation In Part 11461143 · Jul 31, 2006
Continuation In Part 11461268 · Jul 31, 2006
Continuation In Part 11461272 · Jul 31, 2006
Continuation In Part 11461064 · Jul 31, 2006
Continuation In Part 11461075 · Jul 31, 2006
Continuation In Part 11461090 · Jul 31, 2006
Continuation In Part 11461037 · Jul 31, 2006
Continuation In Part 11461085 · Jul 31, 2006
Continuation In Part 11461091 · Jul 31, 2006
Continuation In Part 11461095 · Jul 31, 2006
Continuation In Part 11466414 · Aug 22, 2006
Continuation In Part 11461147 · Jul 31, 2006
Continuation In Part 11461164 · Jul 31, 2006
Continuation In Part 11461024 · Jul 31, 2006
Continuation In Part 11461032 · Jul 31, 2006
Continuation In Part 11461049 · Jul 31, 2006
Continuation In Part 11461109 · Jul 31, 2006
Continuation In Part 11827530 · Jul 11, 2007
Continuation In Part 12060194 · Mar 31, 2008
Continuation In Part 12059583 · Mar 31, 2008
Continuation In Part 12060198 · Mar 31, 2008
Continuation In Part 12060200 · Mar 31, 2008
Continuation In Part 12060206 · Mar 31, 2008
Continuation In Part 12121275 · May 15, 2008
Continuation In Part 11776510 · Jul 11, 2007
Continuation In Part 11776520 · Jul 11, 2007
Continuation In Part 11776530 · Jul 11, 2007
Continuation In Part 11777142 · Jul 12, 2007
Continuation In Part 11624466 · Jan 18, 2007
Continuation In Part 12210511 · Sep 15, 2008
Continuation In Part 12210519 · Sep 15, 2008
Continuation In Part 12210532 · Sep 15, 2008
Continuation In Part 12210540 · Sep 15, 2008
Continuation In Part 11327087 · Jan 5, 2006
Related Publication 20090125510A1 · May 14, 2009