Contextual information for a displayed resource that includes an image

1. A method implemented by one or more processors, the method comprising:

receiving from a user device, by a contextual information server, a request for contextual information relevant to an active resource displayed in an application environment on the user device, the active resource displayed in the application environment on the user device including image content and non-image content;

determining, by the contextual information server, whether the non-image content is sufficient to satisfy the request for the contextual information;

in response to determining that the non-image content is insufficient to satisfy the request for the contextual information:

transmitting to the user device, by the contextual information server, an additional request for the image content;

receiving from the user device, by the contextual information server, and responsive to the additional request, the image content that is included as part of the active resource displayed in the application environment; and

generating, by the contextual information server, and based on both the image content and the non-image content, a contextual information card as the contextual information relevant to the active resource;

in response to determining that the non-image content is sufficient to satisfy the request for the contextual information:

generating, by the contextual information server, and based on only the non-image content, the contextual information card as the contextual information relevant to the active resource;

transmitting to the user device, by the contextual information server, the contextual information card; and

causing, by the contextual information server, the contextual information card to be displayed at the user device.

2. The method of claim 1 , wherein the request for the contextual information relevant to the active resource displayed in the application environment on the user device includes an indication that the active resource includes the image content, but does not include the image content.

3. The method of claim 1 , wherein the request for the contextual information relevant to the active resource displayed in the application environment on the user device does not include one or more query terms entered by the user.

4. The method of claim 1 , wherein determining whether the non-image content is sufficient to satisfy the request for the contextual information comprises:

processing the non-image content include included in the request; and

determining, based on processing the non-image content included in the request, that no search item is included in the non-image content, wherein the search item is an entity.

5. The method of claim 1 , wherein determining whether the non-image content is sufficient to satisfy the request for the contextual information comprises:

processing the non-image content include included in the request; and

identifying, based on processing the non-image content included in the request, a search item included in the non-image content;

submitting the search item as a search query; and

determining that search results, obtained responsive to the search query, are not relevant to the active resource displayed in the application environment on the user device.

6. The method of claim 5 , wherein determining that the search results are not relevant to the active resource displayed in the application environment on the user device comprises:

determining a corresponding relevancy score for each of the search results; and

determining the corresponding relevancy score for each of the search results fails to satisfy a relevancy score threshold.

7. The method of claim 1 , wherein causing the contextual information card to be displayed at the user device comprises causing the contextual information card to overlay the active resource displayed in the application environment on the user device.

8. The method of claim 7 , wherein the contextual information cards includes one or more selectable options that, when selected, cause the user device to perform one or more actions.

9. The method of claim 8 , wherein the one or more actions include one or more of:

performing a search action;

performing a telephone call action;

performing a navigation action; or

performing a restaurant reservation action.

10. The method of claim 1 , wherein causing the contextual information card to be displayed at the user device comprises causing the contextual information card to supplant the active resource displayed in the application environment on the user device.

11. A system comprising:

at least one processor; and

at least one memory storing instructions that, when executed, cause the at least one processor to:

receive, from a user device of a user, a request for contextual information relevant to an active resource displayed in an application environment on the user device, the active resource displayed in the application environment on the user device including image content and non-image content;

determine whether the non-image content is sufficient to satisfy the request for the contextual information;

in response to determining that the non-image content is insufficient to satisfy the request for the contextual information:

transmit, to the user device, an additional request for the image content;

receive, from the user device, and responsive to the additional request, the image content that is included as part of the active resource displayed in the application environment; and

generate, based on both the image content and the non-image content, a contextual information card as the contextual information relevant to the active resource; and

in response to determining that the non-image content is sufficient to satisfy the request for the contextual information:

generate, based on only the non-image content, the contextual information card as the contextual information relevant to the active resource;

transmit, to the user device, the contextual information card; and

cause the contextual information card to be displayed at the user device.

12. The system of claim 11 , wherein the request for the contextual information relevant to the active resource displayed in the application environment on the user device includes an indication that the active resource includes the image content, but does not include the image content.

13. The system of claim 11 , wherein the request for the contextual information relevant to the active resource displayed in the application environment on the user device does not include one or more query terms entered by the user.

14. The system of claim 11 , wherein the instructions to determine whether the non-image content is sufficient to satisfy the request for the contextual information comprise instructions to:

process the non-image content include included in the request; and

determine, based on processing the non-image content included in the request, that no search item is included in the non-image content, wherein the search item is an entity.

15. The system of claim 11 , wherein the instructions to determine whether the non-image content is sufficient to satisfy the request for the contextual information comprise instructions to:

process the non-image content include included in the request; and

identify, based on processing the non-image content included in the request, a search item included in the non-image content;

submit the search item as a search query; and

determine that search results, obtained responsive to the search query, are not relevant to the active resource displayed in the application environment on the user device.

16. The system of claim 15 , wherein the instructions to determine that the search results are not relevant to the active resource displayed in the application environment on the user device comprise instructions to:

determine a corresponding relevancy score for each of the search results; and

determine the corresponding relevancy score for each of the search results fails to satisfy a relevancy score threshold.

17. The system of claim 11 , wherein the instructions to cause the contextual information card to be displayed at the user device comprise instructions to cause the contextual information card to overlay the active resource displayed in the application environment on the user device.

18. The system of claim 17 , wherein the contextual information cards includes one or more selectable options that, when selected, cause the user device to perform one or more actions.

19. The system of claim 11 , wherein the instructions to cause the contextual information card to be displayed at the user device comprises instructions to cause the contextual information card to supplant the active resource displayed in the application environment on the user device.

20. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to execute the instructions, the instructions causing the at least one processor to:

receive from a user device, by a contextual information server, a request for contextual information relevant to an active resource displayed in an application environment on the user device, the active resource displayed in the application environment on the user device including image content and non-image content;

determine, by the contextual information server, whether the non-image content is sufficient to satisfy the request for the contextual information;

in response to determining that the non-image content is insufficient to satisfy the request for the contextual information:

transmit to the user device, by the contextual information server, an additional request for the image content;

receive from the user device, by the contextual information server, and responsive to the additional request, the image content that is included as part of the active resource displayed in the application environment; and

generate, by the contextual information server, and based on both the image content and the non-image content, a contextual information card as the contextual information relevant to the active resource;

in response to determining that the non-image content is sufficient to satisfy the request for the contextual information:

generate, by the contextual information server, and based on only the non-image content, the contextual information card as the contextual information relevant to the active resource;

transmit to the user device, by the contextual information server, the contextual information card; and

cause, by the contextual information server, the contextual information card to be displayed at the user device.