IP Library › Granted Patent US 9,529,803
Granted Patent B2
US 9,529,803 · App. 14/331,928 · Granted Dec 27, 2016

Image modification

Inventors: Andrew Vytas Kisielius (San Francisco, CA); Wenfeng Li (Sunnyvale, CA); Michael Paul Rolig (San Francisco, CA); Chunfeng Hao (Santa Clara, CA); Jacqueline Anne Lai (Irvine, CA); Alena Viktorovna Repina (Novosibirskaya Oblast, RU); Bryan M. Klingner (Austin, TX); Robert William Christy (Sunnyvale, CA)
Assignee: Google Inc.
G06F17/30061G06F3/04845G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,529,803
App. No.
14/331,928
Granted
Dec 27, 2016
Kind
B2
Abstract

In one aspect, a request to alter a first image is received. The request includes a portion of the first image that is provided for display with a second image. The second image is associated with three-dimensional (3D) geometry data for an object depicted in both the first and second images and date information identifying when the second image was captured. Input identifying an area of the second image is received. A third image is identified based on the date information of the third image and the second image. The third image is associated with 3D geometry data for the object. An area of the third image is determined based on the 3D geometry data of the second image, the 3D geometry data of the second image, and the area of the second image. Information identifying the area of the third image is provided for display with the third image.

Claims (57)

1. A computer-implemented method comprising:

receiving, by one or more computing devices, a request to blur an object in a first image, the request identifying at least a portion of the first image;

providing for display, by the one or more computing devices, a second image and the portion of the first image, wherein the second image is associated with three dimensional geometry data corresponding to a surface of the object depicted in both the first image and the second image and with date information identifying when the second image was captured;

receiving, by the one or more computing devices, user input identifying an area of the second image;

identifying, by the one or more computing devices, a third image based on date information identifying when the third image was captured and the date information identifying when the second image was captured, the third image being associated with three dimensional geometry data corresponding to a surface of the object depicted in the third image;

providing for display, with the second image and the portion of the first image, an indication that the third image is available;

determining, by the one or more computing devices, an area of the third image based on the three dimensional geometry data associated with the third image, the three dimensional geometry data associated with the second image, and the area of the second image;

providing, by the one or more computing devices, information identifying the area of the third image for display with the third image;

receiving input confirming the area of the third image; and

blurring image pixels corresponding to the area of the third image.

2. The method of claim 1 , further comprising:

providing for display the indication in a first state when the third image has not been viewed by an operator; and

providing for display the indication in a second state, different from the first state, when the third image has been viewed by the operator.

3. The method of claim 1 , further comprising providing for display, with the second image and the first portion of the first image, a map including a first marker indicating a location where an image is available for only one date and a second marker indicating a second location where a set of images is available for different dates.

4. The method of claim 3 , further comprising:

providing for display the second marker in a first state when no images of the set of images have been viewed by an operator; and

providing for display the indication in a second state, different from the first state, when at least one image of the set of images has been viewed by the operator.

5. The method of claim 1 , further comprising

receiving input confirming the area of the second image, and

wherein determining the area of the third image is performed after the input confirming the area of the second image is received.

6. The method of claim 1 , further comprising automatically modifying image pixels corresponding to the area of the third image before providing the third image for display.

7. A system comprising one or more computing devices, wherein the one or more computing devices are configured to:

receive a request to blur an object in a first image, the request identifying at least a portion of the first image;

provide for display a second image and the portion of the first image, wherein the second image is associated with three dimensional geometry data corresponding to a surface of the object depicted in both the first image and the second image and with date information identifying when the second image was captured;

receive user input identifying an area of the second image;

identify a third image based on date information identifying when the third image was captured and the date information identifying when the second image was captured, the third image being associated with three dimensional geometry data corresponding to a surface of the object depicted in the third image;

provide for display, with the second image and the portion of the first image, an indication that the third image is available;

determine an area of the third image based on the three dimensional geometry data associated with the third image, the three dimensional geometry data associated with the second image, and the area of the second image;

provide information identifying the area of the third image for display with the third image;

receive input confirming the area of the third image; and

blur image pixels corresponding to the area of the third image.

8. The system of claim 7 , wherein the one or more computing devices are further configured to provide for display, with the second image and the portion of the first image, an indication that the third image is available.

9. The system of claim 7 , wherein the one or more computing devices are further configured to:

provide for display the indication in a first state when the third image has not been viewed by an operator; and

provide for display the indication in a second state, different from the first state, when the third image has been viewed by the operator.

10. The system of claim 7 , wherein the one or more computing devices are further configured to provide for display, with the second image and the first image portion of the first image, a map including a first marker indicating a location where only one image is available for only one date and a second marker indicating a second location where a set of images is available for different dates.

11. The system of claim 7 , wherein the one or more computing devices are further configured to:

provide for display the second marker in a first state when no images of the set of images have been viewed by an operator; and

provide for display the indication in a second state, different from the first state, when at least one image of the set of images has been viewed by the operator.

12. The system of claim 7 , wherein the one or more computing devices are further configured to:

receive input confirming the area of the second image, and

perform the determining the area of the third image after the input confirming the area of the second image is received.

13. The system of claim 7 , wherein the one or more computing devices are further configured to automatically modify image pixels corresponding to the area of the third image before providing the third image for display.

14. A non-transitory computer-readable storage medium on which computer readable instructions of a program are stored, the instructions, when executed by a processor, cause the processor to perform a method, the method comprising:

receive a request to blur an object in a first image, the request identifying at least a portion of the first image;

provide for display a second image and the portion of the first image, wherein the second image is associated with three dimensional geometry data corresponding to a surface of the object depicted in both the first image and the second image and with date information identifying when the second image was captured;

receive user input identifying an area of the second image;

identify a third image based on date information identifying when the third image was captured and the date information identifying when the second image was captured, the third image being associated with three dimensional geometry data corresponding to a surface of the object depicted in the third image;

provide for display with the second image and the portion of the first image, an indication that the third image is available;

determine an area of the third image based on the three dimensional geometry data associated with the third image, the three dimensional geometry data associated with the second image, and the area of the second image; and

provide information identifying the area of the third image for display with the third image;

receiving input confirming the area of the third image; and

blurring image pixels corresponding to the area of the third image.

15. The medium of claim 14 , wherein the method further comprises providing for display, with the second image and the portion of the first image, a map including a first marker indicating a location where only one image is available for only one date and a second marker indicating a second location where a set of images is available for different dates.

16. The medium of claim 14 , wherein the method further comprises:

receiving input confirming the area of the second image, and

wherein determining the area of the third image is performed after the input confirming the area of the second image is received.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2014
From: KISIELIUS, ANDREW VYTAS; LI, WENFENG; ROLIG, MICHAEL PAUL; HAO, CHUNFENG; LAI, JACQUELINE ANNE; REPINA, ALENA VIKTOROVNA; KLINGNER, BRYAN M.; CHRISTY, ROBERT WILLIAM
To: GOOGLE INC.
Reel/Frame 033320/0241 →
Continuity (1)
Related Publication 20160019223A1 · Jan 21, 2016