IP Library Granted Patent US 10,701,272
Granted Patent B2
US 10,701,272 · App. 16/569,273 · Granted Jun 30, 2020

Smart camera user interface

Inventors: Teresa Ko (Los Angeles, CA); Hartwig Adam (Marina del Rey, CA); Mikkel Crone Koser (Copenhagen, DK); Alexei Masterov (Mountain View, CA); Andrews-Junior Kimbembe (San Francisco, CA); Matthew J. Bridges (New Providence, NJ); Paul Chang (New York, NY); David Petrou (Brooklyn, NY); Adam Berenzweig (Brooklyn, NY)
Assignee: Google LLC
H04N5/23293G06F3/04817G06F3/04842G06F3/1431G06F3/1438G06K9/00671G06K9/00677G06K9/78G09G5/363H04N5/23216G09G2360/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,272
App. No.
16/569,273
Granted
Jun 30, 2020
Kind
B2
Abstract

Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder.

Claims (38)

1. A computer-implemented method executed using one or more processors, the method comprising:

receiving, by the one or more processors, image data depicting a scene viewed by a camera device;

determining, by the one or more processors, data describing a plurality of persons determined from the scene, the plurality of persons being persons that are depicted in the scene;

determining, by the one or more processors, that at least one of the plurality of persons is a contact in a social network system to which a user of the camera device is a member and in response:

determining, by the one or more processors, one or more actions based on the contact in the social network;

providing, by the one or more processors, instructions to display an action interface comprising one or more action elements, wherein each action element, upon user interaction, causes execution of a respective action, the action interface being displayed in a viewfinder of a camera in which the image data is displayed;

receiving an indication of a user interaction with an action element of the one or more action elements; and

executing the respective action associated with the action element.

2. The computer-implemented method of claim 1 , wherein the image data depicting a scene is viewed by the camera device, wherein the viewfinder is provided in a camera application currently executing on a user device.

3. The computer-implemented method of claim 1 , wherein the actions comprise one or more of a share image action and a add to a photo album action.

4. The computer-implemented method of claim 1 , wherein the image data comprises pre-capture image data.

5. The computer-implemented method of claim 1 , wherein the image data comprises post-capture image data.

6. A system comprising:

one or more processors; and

a non-transitory computer storage medium in data communication with the one or more processors and storing instructions executable by the one or more processors and that upon such execution cause the one or more processors to perform operations comprising:

receiving, by the one or more processors, image data depicting a scene viewed by a camera device;

determining, by the one or more processors, data describing a plurality of persons determined from the scene, the plurality of persons being persons that are depicted in the scene;

determining, by the one or more processors, that at least one of the plurality of persons is a contact in a social network system to which a user of the camera device is a member and in response:

determining, by the one or more processors, one or more actions based on the contact in the social network;

providing, by the one or more processors, instructions to display an action interface comprising one or more action elements, wherein each action element, upon user interaction, causes execution of a respective action, the action interface being displayed in a viewfinder of a camera in which the image data is displayed;

receiving an indication of a user interaction with an action element of the one or more action elements; and

executing the respective action associated with the action element.

7. The system of claim 6 , wherein the image data depicting a scene is viewed by the camera device, wherein the viewfinder is provided in a camera application currently executing on a user device.

8. The system of claim 6 , wherein the actions comprise one or more of a share image action and a add to a photo album action.

9. The system of claim 6 , wherein the image data comprises pre-capture image data.

10. The system of claim 6 , wherein the image data comprises post-capture image data.

11. A non-transitory computer storage medium storing instructions executable by one or more processors and that upon such execution cause the one or more processors to perform operations comprising:

receiving, by the one or more processors, image data depicting a scene viewed by a camera device;

determining, by the one or more processors, data describing a plurality of persons determined from the scene, the plurality of persons being persons that are depicted in the scene;

determining, by the one or more processors, that at least one of the plurality of persons is a contact in a social network system to which a user of the camera device is a member and in response:

determining, by the one or more processors, one or more actions based on the contact in the social network;

providing, by the one or more processors, instructions to display an action interface comprising one or more action elements, wherein each action element, upon user interaction, causes execution of a respective action, the action interface being displayed in a viewfinder of a camera in which the image data is displayed;

receiving an indication of a user interaction with an action element of the one or more action elements; and

executing the respective action associated with the action element.

12. The non-transitory computer storage medium of claim 11 , wherein the image data depicting a scene is viewed by the camera device, wherein the viewfinder is provided in a camera application currently executing on a user device.

13. The non-transitory computer storage medium of claim 11 , wherein the actions comprise one or more of a share image action and a add to a photo album action.

14. The non-transitory computer storage medium of claim 11 , wherein the image data comprises pre-capture image data.

15. The non-transitory computer storage medium of claim 11 , wherein the image data comprises post-capture image data.

Assignments (2)
ENTITY CONVEYANCE Recorded Jan 27, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 051709/0023 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: KO, TERESA; ADAM, HARTWIG; KOSER, MIKKEL CRONE; MASTEROV, ALEXEI; KIMBEMBE, ANDREWS-JUNIOR; BRIDGES, MATTHEW J.; CHANG, PAUL; PETROU, DAVID; BERENZWEIG, ADAM
To: GOOGLE INC.
Reel/Frame 050373/0517 →
Continuity (5)
Continuation 15946342 · Apr 5, 2018
Continuation 15428821 · Feb 9, 2017
Continuation 14618962 · Feb 10, 2015
Provisional Application 61937833 · Feb 10, 2014
Related Publication 20200007774A1 · Jan 2, 2020