IP Library › Granted Patent US 12,625,980
Granted Patent B2
US 12,625,980 · App. 18/248,983 · Granted May 12, 2026

Mapping a tangible instance of a document

Inventors: Brett Barros (San Mateo, CA); Alexander James Faaborg (Mountain View, CA)
Assignee: GOOGLE LLC
G06F21/604
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,625,980
App. No.
18/248,983
Granted
May 12, 2026
Kind
B2
Abstract

A computer-implemented method comprises: detecting, by a first computer system, first content of a tangible instance of a first document; generating, by the first computer system, a first hash using the first content, the first hash including first obfuscation content; sending, by the first computer system, the first hash for receipt by a second computer system; and receiving, by the first computer system, a response to the first hash generated by the second computer system, the response including information corresponding to a second document associated with the first content.

Claims (50)

1 . A computer-implemented method comprising:

capturing, by an image sensor of a first computer system, first content of a hardcopy instance or an on-screen presentation instance of a first document;

generating, by the first computer system, a first hash using the first content, the first hash incorporating content not originating from the first document;

sending, by the first computer system, the first hash for a look up against a collection of documents associated with a collaboration program; and

receiving, by the first computer system, a response to the first hash, the response including information corresponding to a second document associated with the first content, the second document being included in the collection of documents.

2 . The computer-implemented method of claim 1 , wherein the first hash is sent to a second computer system and the second computer system controls the collaboration program for the collection of documents.

3 . The computer-implemented method of claim 2 , further comprising sending, by the first computer system and based on the response, the first content for receipt by the second computer system.

4 . The computer-implemented method of claim 3 , wherein the second computer system generates a new document for the collaboration program using the first content.

5 . The computer-implemented method of claim 2 , further comprising sending, by the first computer system and based on the response, a marked-up change of the first document for receipt by the second computer system.

6 . The computer-implemented method of claim 2 , wherein the second computer system generates a second hash using second contents of the second document, the second hash incorporating content not originating from the second document, and wherein the second hash is included in the response.

7 . The computer-implemented method of claim 6 , further comprising verifying, by the first computer system and using the second hash, a correspondence between the first document and the second document.

8 . The computer-implemented method of claim 7 , further comprising receiving, by the first computer system, the second document from the second computer system.

9 . The computer-implemented method of claim 6 , wherein the second computer system performs detection of unauthorized access of the second contents upon receiving the first hash.

10 . The computer-implemented method of claim 2 , further comprising receiving, by the first computer system, a history of access for a user of the first computer system, the history including an entry for accessing the second document based on the second computer system having received the first hash.

11 . The computer-implemented method of claim 10 , wherein the entry for accessing the second document is based on detecting that the user is proximate to at least one of the hardcopy instance of the first document or the on-screen presentation instance of the first document.

12 . The computer-implemented method of claim 10 , wherein the second computer system generates the entry in response to determining that the user has access permission to the second document.

13 . The computer-implemented method of claim 10 , wherein the user does not have access permission to the second document, and wherein the information corresponding to the second document includes a control for the user to request access permission to the second document.

14 . The computer-implemented method of claim 10 , wherein the user does not have access permission to the second document, and wherein the second computer system grants the access permission to the user in response to determining that the user is accessing the first document for at least a predetermined time.

15 . The computer-implemented method of claim 2 , wherein the first computer system identifies a user of the first computer system to the second computer system, and wherein the collection of documents is defined based on the user having access permission to the collection of documents.

16 . The computer-implemented method of claim 2 , further comprising receiving, by the first computer system and from a user, a request for text-to-speech service of the first document, wherein the second document contains structure markup, and providing the text-to-speech service of the first document using the second document.

17 . The computer-implemented method of claim 2 , wherein the first computer system detects the first content based on the first document being presented on a display device.

18 . The computer-implemented method of claim 17 , wherein the display device is controlled by the first computer system and presents a screen sharing application on a desktop, wherein the first document is being screen shared with the first computer system using the screen sharing application.

19 . The computer-implemented method of claim 18 , wherein the first computer system further presents a browser on the desktop, and wherein the browser provides a control for opening the second document on the desktop using the collaboration program.

20 . The computer-implemented method of claim 18 , further comprising facilitating, by the first computer system, dragging of a representation of the first document to trigger opening of the second document using the collaboration program.

21 . The computer-implemented method of claim 20 , wherein the dragging causes the second document to be presented on the desktop of the first computer system.

22 . The computer-implemented method of claim 20 , wherein the dragging causes the second document to be presented on another computer system based on the other computer system being detected by the first computer system.

23 . The computer-implemented method of claim 2 , wherein the first document and the second document are paper documents, and wherein the second computer system detects the second document being associated with the first document using the first hash and a second hash of the second document.

24 . The computer-implemented method of claim 23 , wherein the first hash and the second hash facilitate sharing of virtual annotations regarding the first document and the second document between the first computer system and the second computer system.

25 . The computer-implemented method of claim 1 , wherein the first computer system comprises an augmented-reality (AR) headset, and wherein the first computer system detects the first content based on the first content being within a field of view of the AR headset.

26 . The computer-implemented method of claim 25 , further comprising detecting, by the first computer system, that a user of the AR headset performs a gesture within the field of view, and in response moving a representation of the first document within the field of view according to the gesture.

27 . The computer-implemented method of claim 26 , wherein moving of the representation facilitates opening of the second document on the first computer system using the collaboration program.

28 . The computer-implemented method of claim 26 , wherein moving of the representation facilitates opening of the second document, using a collaboration program, on another computer system detected by the first computer system.

29 . The computer-implemented method of claim 1 , further comprising presenting, by the first computer system and using the information, second contents of the second document.

30 . The computer-implemented method of claim 29 , wherein the first computer system comprises an augmented-reality (AR) headset, wherein the first computer system detects the first content based on the first content being within a field of view of the AR headset, and wherein presenting the second contents comprises applying a first virtual annotation to the first document.

31 . The computer-implemented method of claim 30 , further comprising receiving, by the first computer system, an audio input generated by a user corresponding to making a change in the first document, presenting in the field of view a second virtual annotation to the first document, and sending the change to a second computer system.

32 . The computer-implemented method of claim 1 , wherein the second document is publicly accessible and wherein the response includes the second document.

33 . A computer program product tangibly embodied in a non-transitory storage medium, the computer program product including instructions that when executed by one or more processor(s) cause the one or more processor(s) to perform operations, the operations comprising:

capturing, by an image sensor of a computer system, first content of a hardcopy instance or an on-screen presentation instance of a first document;

generating, by the computer system, a first hash using the first content, the first hash incorporating content not originating from the first document;

sending, by the computer system, the first hash for a look up against a collection of documents associated with a collaboration program; and

receiving, by the computer system, a response to the first hash, the response including information corresponding to a second document associated with the first content, the second document being included in the collection of documents.

34 . The computer program product of claim 33 , wherein the computer system is a first computer system and a second computer system controls the collaboration program for the collection of documents.

35 . A computer system comprising:

at least a processor; and

a memory storing instructions that, when executed by the processor, cause the computer system to perform operations comprising:

capturing, by an image sensor of the first computer system, first content of a hardcopy instance or an on-screen presentation instance of a first document;

generating, by the computer system, a first hash using the first content, the first hash incorporating content not originating from the first document;

sending, by the computer system, the first hash for a look up against a collection of documents associated with a collaboration program; and

receiving, by the computer system, a response to the first hash, the response including information corresponding to a second document associated with the first content, the second document being included in the collection of documents.

36 . The computer system of claim 35 , wherein the computer system is a first computer system and a second computer system controls the collaboration program for the collection of documents.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2023
From: BARROS, BRETT; FAABORG, ALEXANDER JAMES
To: GOOGLE LLC
Reel/Frame 063455/0120 →
Continuity (1)
Related Publication 20230385431A1 · Nov 30, 2023
References Cited (25)
US 6453416B1 · Epstein · 2002 [cited by examiner]
US 9471581B1 · Lee · 2016 [cited by applicant]
US 10599753B1 · Eisner et al. · 2020 [cited by applicant]
US 20030095681A1 · Burg · 2003 [cited by examiner]
US 20060041605A1 · King · 2006 [cited by examiner]
US 20070124590A1 · Vanstone · 2007 [cited by examiner]
US 20130100501A1 · Chen et al. · 2013 [cited by applicant]
US 20140289644A1 · Clarke et al. · 2014 [cited by applicant]
US 20150220506A1 · Parkinson · 2015 [cited by examiner]
US 20150371445A1 · Karrer Walker et al. · 2015 [cited by applicant]
US 20160162734A1 · Ross et al. · 2016 [cited by applicant]
US 20160285838A1 · Ford et al. · 2016 [cited by applicant]
US 20170093870A1 · Meyer · 2017 [cited by applicant]
US 20180276896A1 · Launonen · 2018 [cited by applicant]
US 20190019022A1 · Marda · 2019 [cited by examiner]
US 20190087792A1 · Chow et al. · 2019 [cited by applicant]
US 20210098092A1 · Katuwal et al. · 2021 [cited by applicant]
JP 2009211603A · 2009 [cited by applicant]
JP 2012248940A · 2012 [cited by applicant]
JP 2014093036A · 2014 [cited by applicant]
KR 101351449B1 · 2014 [cited by applicant]
KR 20190072554A · 2019 [cited by applicant]
Office Action for Korean Application No. 10-2023-7016612 (with English translation), mailed Feb. 7, 2025, 20 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2020/070674, mailed on Jun. 17, 2021, 12 pages. [cited by applicant]
Office Action for Japanese Application No. 2023-523624 (with English translation), mailed Jun. 11, 2024, 14 pages. [cited by applicant]