Smart camera user interface
Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder.
1 . A computer-implemented method comprising:
displaying, by a computing device comprising one or more processors, real-time image data captured by an image capture device of the computing device, wherein the real-time image data depicts a scene being captured in real-time by the image capture device of the computing device, and wherein the scene depicts a plurality of entities;
obtaining, by the computing device, entity recognition data that identifies a first entity of the plurality of entities as belonging to a first category of entities;
determining, by the computing device, one or more actions based on at least one of the first entity or the first category of entities;
automatically performing, by the computing device, the one or more actions; and
causing, by the computing device, display of an element indicative of performance of at least one of the one or more actions.
2 . The computer-implemented method of claim 1 , wherein causing display of the element indicative of the performance of at least one of the one or more actions comprises:
displaying, by the computing device, the element indicative of the performance of at least one of the one or more actions.
3 . The computer-implemented method of claim 1 , wherein causing display of the element indicative of the performance of at least one of the one or more actions comprises:
providing, by the computing device, the element indicative of the performance of at least one of the one or more actions for display at a display device of a wearable computing device worn by a user of the computing device.
4 . The computer-implemented method of claim 3 , wherein the wearable computing device comprises the computing device.
5 . The computer-implemented method of claim 1 , wherein automatically performing the one or more actions comprises:
displaying, by the computing device, a web page within a web browser executed by the computing device.
6 . The computer-implemented method of claim 5 , wherein the first entity of the plurality of entities comprises a purchasable item; and
wherein displaying the web page comprises:
displaying, by the computing device, a web page for purchasing the purchasable item within the web browser executed by the computing device.
7 . The computer-implemented method of claim 6 , wherein displaying the web page comprises:
displaying a web page for purchasing the purchasable item or one or more second purchasable items within the web browser executed by the computing device, wherein the one or more purchasable items belong to the first category of entities.
8 . The computer-implemented method of claim 1 , wherein automatically performing the one or more actions comprises:
displaying, by the computing device, an information frame that depicts information associated with the first entity.
9 . The computer-implemented method of claim 8 , wherein the at least one entity comprises content, and wherein the information frame depicts an identity of a creator of the content.
10 . The computer-implemented method of claim 9 , wherein the content comprises a fictional work, and wherein the information frame depicts an identity of a creator of the fictional work.
11 . The computer-implemented method of claim 1 , wherein obtaining the entity recognition data comprises:
processing, by the computing device, the real-time image data with an entity recognition engine to obtain the entity recognition data that identifies the first entity as belonging to the first category.
12 . A computing device, comprising:
one or more processors; and
one or more tangible, non-transitory, computer readable media that collectively store instructions that when executed by the one or more processors cause the computing device to perform operations comprising:
displaying real-time image data captured by an image capture device of the computing device, wherein the real-time image data depicts a scene being captured in real-time by the image capture device of the computing device, and wherein the scene depicts a plurality of entities;
obtaining entity recognition data that identifies a first entity of the plurality of entities as belonging to a first category of entities;
determining one or more actions based on at least one of the first entity or the first category of entities;
automatically performing the one or more actions; and
causing display of an element indicative of performance of at least one of the one or more actions.
13 . The computing device of claim 12 , wherein causing display of the element indicative of the performance of at least one of the one or more actions comprises:
displaying the element indicative of the performance of at least one of the one or more actions.
14 . The computing device of claim 12 , wherein causing display of the element indicative of the performance of at least one of the one or more actions comprises:
providing the element indicative of the performance of at least one of the one or more actions for display at a display device of a wearable computing device worn by a user of the computing device.
15 . The computing device of claim 14 , wherein the wearable computing device comprises the computing device.
16 . The computing device of claim 12 , wherein automatically performing the one or more actions comprises:
displaying a web page within a web browser executed by the computing device.
17 . The computing device of claim 16 , wherein the first entity of the plurality of entities comprises a purchasable item; and
wherein displaying the web page comprises:
displaying a web page for purchasing the purchasable item within the web browser executed by the computing device.
18 . The computing device of claim 17 , wherein displaying the web page comprises:
displaying a web page for purchasing the purchasable item or one or more second purchasable items within the web browser executed by the computing device, wherein the one or more purchasable items belong to the first category of entities.
19 . The computing device of claim 12 , wherein automatically performing the one or more actions comprises:
displaying an information frame that depicts information associated with the first entity.
20 . One or more tangible, non-transitory, computer-readable media that collectively store instructions when executed by one or more processors of a computing system cause the one or more processors to perform operations, the operations comprising:
displaying real-time image data captured by an image capture device of the computing device, wherein the real-time image data depicts a scene being captured in real-time by the image capture device of the computing device, and wherein the scene depicts a plurality of entities;
obtaining entity recognition data that identifies a first entity of the plurality of entities as belonging to a first category of entities;
determining one or more actions based on at least one of the first entity or the first category of entities;
automatically performing the one or more actions; and
causing display of an element indicative of performance of at least one of the one or more actions.