IP Library Granted Patent US 9,684,902
Granted Patent B2
US 9,684,902 · App. 14/328,015 · Granted Jun 20, 2017

Processing techniques for text capture from a rendered document

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
G06Q30/00G06K9/00442
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,684,902
App. No.
14/328,015
Filed
Jul 10, 2014
Granted
Jun 20, 2017
Kind
B2
Art Unit
3625
USPC
705/26.62
Abstract

A facility for initiating a purchase is described. The facility receives a text sequence captured by a user from a rendered document using a handheld text capture device. The facility identifies in the received text sequence a reference to a distinguished product. In response to identifying the reference, the facility presents to the user an opportunity to place an order for the established product. If the user accepts the presented opportunity to order the distinct product, the facility orders the distinct product on behalf of the user.

Claims (68)

1. A method implemented by data processing apparatus, the method comprising:

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

2. The method of claim 1 , wherein the wireless device includes a display, and wherein the method further comprises:

presenting, on the display, the image of the text to be captured by the camera.

3. The method of claim 2 , further comprising:

presenting, on the display, information about the quality of the image and its suitability for recognition.

4. The method of claim 2 , further comprising:

presenting, on the display, information about one or more segments of text to be captured from the rendered document.

5. The method of claim 1 , further comprising:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.

6. The method of claim 1 , wherein providing the purchase option for purchasing the product includes providing a context menu of actions comprising the purchase option for purchasing the product.

7. The method of claim 1 , further comprising:

receiving, by the system server, from a seller server, availability and price information related to the product; and

providing, by the system server and for presentation on the wireless device, the availability and price information; and

providing, by the system server, to the seller server, the instruction to purchase the product.

8. The method of claim 7 , further comprising:

storing, by the system server, account information corresponding to an account associated with the wireless device;

storing, by the system server, account information corresponding to an account associated with the seller server;

receiving, by the system server, from the wireless device, an identifier of the account associated with the wireless device;

negatively adjusting the account associated with the wireless device; and

positively adjusting the account associated with the seller server.

9. The method of claim 8 , wherein the account information corresponding to the account associated with the wireless device comprises shipping preference information, and wherein the method further comprises providing the shipping preference information from the system server to the seller server.

10. A system comprising:

one or more computing devices; and

a memory storage apparatus in data communication with the one or more computing devices and storing instructions executable by the one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising:

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

11. The system of claim 10 , wherein the wireless device includes a display, and wherein the operations further comprise:

presenting, on the display, the image of the text to be captured by the camera.

12. The system of claim 11 , wherein the operations further comprise:

presenting, on the display, information about the quality of the image and its suitability for recognition.

13. The system of claim 11 , wherein the operations further comprise:

presenting, on the display, information about one or more segments of text to be captured from the rendered document.

14. The system of claim 10 , wherein the operations further comprise:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.

15. The system of claim 10 , wherein providing the purchase option for purchasing the product includes providing a context menu of actions comprising the purchase option for purchasing the product.

16. The system of claim 10 , wherein the operations further comprise:

receiving, by the system server, from a seller server, availability and price information related to the product; and

providing, by the system server and for presentation on the wireless device, the availability and price information; and

providing, by the system server, to the seller server, the instruction to purchase the product.

17. The system of claim 16 , wherein the operations further comprise:

storing, by the system server, account information corresponding to an account associated with the wireless device;

storing, by the system server, account information corresponding to an account associated with the seller server;

receiving, by the system server, from the wireless device, an identifier of the account associated with the wireless device;

negatively adjusting the account associated with the wireless device; and

positively adjusting the account associated with the seller server.

18. The system of claim 17 , wherein the account information corresponding to the account associated with the wireless device comprises shipping preference information, and wherein the operations further comprise providing the shipping preference information from the system server to the seller server.

19. A non-transitory computer readable medium storing instructions executable by one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising:

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

20. The non-transitory computer readable medium of claim 19 , wherein the operations further comprise:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.

Assignments (5)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2014
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 034546/0511 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR/ASSIGNEE PREVIOUSLY RECORDED AT REEL: 034247 FRAME: 0722. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 18, 2014
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 034678/0973 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2014
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: GOOGLE INC.
Reel/Frame 034247/0722 →
Continuity (91)
Continuation 13615517 · Sep 13, 2012
Continuation 12696599 · Jan 29, 2010
Continuation 11131945 · May 17, 2005
Continuation In Part 11004637 · Dec 3, 2004
Continuation In Part 11097961 · Apr 1, 2005
Continuation In Part 11097093 · Apr 1, 2005
Continuation In Part 11098038 · Apr 1, 2005
Continuation In Part 11098014 · Apr 1, 2005
Continuation In Part 11097103 · Apr 1, 2005
Continuation In Part 11098043 · Apr 1, 2005
Continuation In Part 11097981 · Apr 1, 2005
Continuation In Part 11097089 · Apr 1, 2005
Continuation In Part 11097835 · Apr 1, 2005
Continuation In Part 11098016 · Apr 1, 2005
Continuation In Part 11097828 · Apr 1, 2005
Continuation In Part 11097833 · Apr 1, 2005
Continuation In Part 11097836 · Apr 1, 2005
Continuation In Part 11098042 · Apr 1, 2005
Continuation In Part 11096704 · Apr 1, 2005
Continuation In Part 11110353 · Apr 19, 2005
Provisional Application 60571715 · May 17, 2004
Provisional Application 60589203 · Jul 19, 2014
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60657309 · Feb 28, 2005
Related Publication 20150039474A1 · Feb 5, 2015