RESTORING FULL ONLINE DOCUMENTS FROM SCANNED PAPER FRAGMENTS
Searching for documents includes retrieving objects from a physical media image using a camera from a smartphone, a user selecting a subset of the objects, forming a search query based on the subset of objects, and applying the search query to a search engine to search for the documents. Retrieving objects from a media image may include waiting for a view of the camera to stabilize. Waiting for the view of the camera to stabilize may include detecting changing content of a video flow provided to the camera and/or using motion sensors of the camera to detect movement. Retrieving objects may include the smartphone identifying possible subsets of objects in the media image. The user selecting a subset of the objects may include the smartphone presenting at least some of the possible subsets to the user and the user selecting one of the possible subsets.
1 . (canceled)
2 . A method comprising:
at a computing device including one or more processors:
obtaining media content;
identifying one or more objects within the media content;
detecting a user selection of a target object of the one or more objects; and
in response to the user selection:
performing a search in a collection of digital documents based on content of the target object; and
displaying one or more search results related to at least a portion of content of the target object.
3 . The method of claim 2 , comprising, while displaying the one or more search results, detecting input to select a respective search result of the one or more search results.
4 . The method of claim 2 , wherein the one or more search results include source documents related to at least the portion of the content of the target object.
5 . The method of claim 2 , wherein:
the target object includes a subset of objects;
the media content includes a video stream of one or more frames;
identifying the one or more objects within the media content further includes:
simultaneously displaying, by a display of the computing device, a plurality of subsets of objects, wherein each subset is distinct and includes at least one object of the one or more objects.
6 . The method of claim 5 , wherein:
displaying the plurality of subsets of objects includes displaying a plurality of pictograms;
a respective pictogram of the plurality of pictograms includes a representation of a subset of objects; and
at least one object of the subset of objects of the target object is emphasized.
7 . The method of claim 2 , wherein the one or more objects are further based on one or more of user preferences and heuristics.
8 . The method of claim 2 , wherein performing the search based on the content of the target object includes:
determining, for the target object, one or more fragments, wherein each fragment of the one or more fragments is a subquery; and
performing the search based on one or more subqueries.
9 . The method of claim 8 , wherein determining, for the target object, one or more fragments includes:
identifying text within the target object; and
removing one or more stopwords from the text within the target object, wherein text between the removed stopwords is a fragment.
10 . The method of claim 2 , further comprising:
in response to the user selection, generating a search query based on the content of the target object, wherein the search is performed based on the search query.
11 . The method of claim 2 , wherein the one or more objects include at least one of a column, a header, a text block, a drawing, a chart, a building, or a person.
12 . The method of claim 2 , wherein identifying the one or more objects within the media content is delayed for a period of time that corresponds to a camera stabilization operation.
13 . The method of claim 12 , wherein performing the camera stabilization operation includes at least one of: detecting changing content of video captured by a camera and using one or more motion sensors of the camera to detect movement.
14 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to:
obtain media content;
identify one or more objects within the media content;
detect a user selection of a target object of the one or more objects; and
in response to the user selection:
perform a search in a collection of digital documents based on content of the target object; and
display one or more search results related to at least a portion of the content of the target object.
15 . The non-transitory computer readable storage medium of claim 14 , wherein detecting the selection of the target object includes detssecting, by the computing device, a user input gesture that corresponds to the target object during presentation thereof.
16 . The non-transitory computer readable storage medium of claim 14 , wherein performing the search produces a plurality of search results that are prioritized based on at least one of: publication time, author credentials, or distribution chain.
17 . The non-transitory computer readable storage medium of claim 14 , wherein the one or more search results include a full online version of one or more source documents restored using the selected target object.
18 . A computing device, comprising:
a display;
a camera;
one or more processors; and
memory storing one or more instructions that, when executed by the one or more processors, cause the one or more processors to:
obtain media content;
identify one or more objects within the media content;
detect a user selection of a target object of the one or more objects; and
in response to the user selection:
perform a search in a collection of digital documents based on content of the target object; and
display one or more search results related to at least a portion of the content of the target object.
19 . The computing device of claim 18 , the memory further comprising instructions for:
in response to the user selection, generating a search query based on the content of the target object, wherein the search is performed based on the search query.
20 . The computing device of claim 18 , wherein the one or more objects include at least one of a column, a header, a text block, a drawing, a chart, a building, or a person.
21 . The computing device of claim 18 , wherein identifying the one or more objects within the media content is delayed for a period of time that corresponds to a camera stabilization operation.