IP Library Granted Patent US 11,086,927
Granted Patent B2
US 11,086,927 · App. 16/575,941 · Granted Aug 10, 2021

Displaying objects based on a plurality of models

Inventor: Janne Matias Kontkanen (San Francisco, CA)
Assignee: Google LLC
G06F16/5838G06K9/00677G06T15/00G06T15/04G06T15/20G06T15/205G06T15/503G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,086,927
App. No.
16/575,941
Granted
Aug 10, 2021
Kind
B2
Abstract

A system and method is provided for displaying surfaces of an object from a vantage point different from the vantage point from which imagery of the object was captured. In some aspects, imagery may be generated for display by combining visual characteristics from multiple source images and applying greater weight to the visual characteristics of some of the source images relative to the other source images. The weight may be based on the orientation of the surface relative to the location from which the image was captured and the location from which the object will be displayed.

Claims (46)

1. A method of providing an image for display, the method comprising:

capturing a first image of an object from a first vantage point to generate a first model;

capturing a second image of the object from a second vantage point to generate a second model;

receiving a request for an image of the object from a requested vantage point different from the first vantage point and the second vantage point;

receiving a third image having a third visual characteristic that is based on a first visual characteristic determined from the first model and the requested vantage point, and a second visual characteristic determined from the second model and the requested vantage point; and

providing the third image for display.

2. The method of claim 1 , further comprising determining an orientation associated with the requested vantage point, wherein the first visual characteristic of the first model is based on the orientation, and the second visual characteristic of the second model is based on the orientation.

3. The method of claim 1 , wherein the third visual characteristic of the third image is based on a first orientation associated with the first model and a second orientation associated with the second model.

4. The method of claim 1 , wherein the third visual characteristic of the third image is based on first location information associated with the first model and second location information associated with the second model.

5. The method of claim 1 , wherein the request for an image further comprises a geographic location, and wherein the third visual characteristic is based on the geographic location.

6. The method of claim 1 , wherein:

the first visual characteristic is based on a first ratio of a first texel count to a first pixel count generated by projecting image data captured from the first vantage point onto the first model; and

the second visual characteristic is based on a second ratio of a second texel count to a second pixel count generated by projecting image data captured from the second vantage point onto the second model.

7. The method of claim 1 , wherein:

the first visual characteristic is a first texel generated by projecting image data captured from the first vantage point onto the first model; and

the second visual characteristic is a second texel generated by projecting image data captured from the second vantage point onto the second model.

8. The method of claim 1 , wherein the visual characteristics are associated with colors, and wherein the third visual characteristic of the third image is based on blending a first color associated with the first visual characteristic and blending a second color associated with the second visual characteristic.

9. The method of claim 1 , wherein the object has a surface defining a plane, the method further comprises selecting a point on the plane, and the first visual characteristic and the second visual characteristics is determined based on a respective angle between the plane and a line extending from the first vantage point and the second vantage point to the selected point on the plane.

10. A system comprising:

one or more computing devices; and

memory storing instructions, the instructions being executable by the one or more computing devices;

wherein the instructions comprise:

capturing a first image of an object from a first vantage point to generate a first model;

capturing a second image of the object from a second vantage point to generate a second model;

receiving a request for an image of the object from a requested vantage point different from the first vantage point and the second vantage point;

receiving a third image having a third visual characteristic that is based on a first visual characteristic determined from the first model and the requested vantage point, and a second visual characteristic determined from the second model and the requested vantage point; and

providing the third image for display.

11. The system of claim 10 , further comprising determining an orientation associated with the requested vantage point, wherein the first visual characteristic of the first model is based on the orientation, and the second visual characteristic of the second model is based on the orientation.

12. The system of claim 10 , wherein the third visual characteristic of the third image is based on a first orientation associated with the first model and a second orientation associated with the second model.

13. The system of claim 10 , wherein the third visual characteristic of the third image is based on first location information associated with the first model and second location information associated with the second model.

14. The system of claim 10 , wherein the request for an image further comprises a geographic location, and wherein the third visual characteristic is based on the geographic location.

15. The system of claim 10 , wherein the visual characteristics are associated with colors, and wherein the third visual characteristic of the third image is based on blending a first color associated with the first visual characteristic and blending a second color associated with the second visual characteristic.

16. The system of claim 10 , wherein:

the first visual characteristic is a first texel generated by projecting image data captured from the first vantage point onto the first model; and

the second visual characteristic is a second texel generated by projecting image data captured from the second vantage point onto the second model.

17. A non-transitory computing-device readable storage medium on which computing-device readable instructions of a program are stored, the instructions, when executed by one or more computing devices, causing the one or more computing devices to perform a method, the method comprising:

capturing a first image of an object from a first vantage point to generate a first model;

capturing a second image of the object from a second vantage point to generate a second model;

receiving a request for an image of the object from a requested vantage point different from the first vantage point and the second vantage point;

receiving a third image having a third visual characteristic that is based on a first visual characteristic determined from the first model and the requested vantage point, and a second visual characteristic determined from the second model and the requested vantage point; and

providing the third image for display.

18. The medium of claim 17 , further comprising determining an orientation associated with the requested vantage point, wherein the first visual characteristic of the first model is based on the orientation, and the second visual characteristic of the second model is based on the orientation.

19. The medium of claim 17 , wherein the third visual characteristic of the third image is based on a first orientation associated with the first model and a second orientation associated with the second model.

20. The medium of claim 17 , wherein:

the first visual characteristic is a first texel generated by projecting image data captured from the first vantage point onto the first model; and

the second visual characteristic is a second texel generated by projecting image data captured from the second vantage point onto the second model.

Assignments (2)
CHANGE OF NAME Recorded Dec 13, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 051288/0245 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2019
From: KONTKANEN, JANNE MATIAS
To: GOOGLE INC.
Reel/Frame 051201/0152 →
Continuity (3)
Continuation 15692548 · Aug 31, 2017
Continuation 14877368 · Oct 7, 2015
Related Publication 20200012678A1 · Jan 9, 2020
Cited By (1)
US 12,339,897