IP Library Granted Patent US 9,224,036
Granted Patent B2
US 9,224,036 · App. 13/723,073 · Granted Dec 29, 2015

Generating static scenes

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,224,036
App. No.
13/723,073
Granted
Dec 29, 2015
Kind
B2
Abstract

Implementations generally relate to generating static scenes. In some implementations, a method includes collecting photos associated with objects in at least one location. The method also includes collecting attention information associated with one or more of the objects. The method also includes generating an attention map based on the attention information. The method also includes generating a model of the at least one location based on the photos and the attention map.

Claims (43)

1. A computer-implemented method comprising:

collecting photos associated with objects in at least one location, wherein one or more of the photos are captured using one or more respective devices that are operable to track a gaze of a user;

collecting attention information associated with one or more of the objects, wherein the attention information is based on tracking gazes of one or more users and based on one or more fixation points of one or more objects in the least one location;

generating an attention map based on the attention information;

associating a color with each object in the at least one location, wherein each color corresponds to a size of an attention value; and

generating a model of the at least one location based on the photos and the attention map, wherein the generating of the model comprises combining the photos into a panorama of the at least one location based on the one or more fixation points, and wherein the method further comprises iteratively replacing one or more photos in the panorama with replacement photos based on one or more predetermined replacement criteria.

2. A computer-implemented method comprising:

collecting photos associated with objects in at least one location;

collecting attention information associated with one or more of the objects, wherein the attention information is based on tracking gazes of one or more users and based on one or more fixation points of one or more objects in the least one location;

generating an attention map based on the attention information;

associating a color with each object in the at least one location, wherein each color corresponds to a size of an attention value; and

generating a model of the at least one location based on the photos and the attention map, wherein the generating of the model comprises combining the photos into a panorama of the at least one location based on the one or more fixation points.

3. The method of claim 2 , wherein one or more of the photos are captured using one or more respective devices that are operable to track a gaze of a user.

4. The method of claim 2 , wherein the generating of the model comprises:

identifying the objects in the attention map;

selecting photos for each of the objects based on one or more predetermined selection criteria; and

combining the photos into the panorama of the at least one location.

5. The method of claim 2 , wherein the generating of the model comprises:

identifying the objects in the attention map;

selecting photos for each of the objects based on one or more predetermined selection criteria, wherein the one or more predetermined selection criteria is based on one or more of resolution, quality, field of view, and level of attention; and

combining the photos into the panorama of the at least one location.

6. The method of claim 2 , wherein the method further comprises iteratively replacing one or more photos in the panorama with replacement photos based on one or more predetermined replacement criteria, and wherein the replacement criteria may include one or more of quality and resolution.

7. The method of claim 2 , wherein the method further comprises enabling a user to overlay one or more user-selected photos over one or more portions of the panorama.

8. A system comprising:

one or more processors; and

logic encoded in one or more tangible media for execution by the one or more processors and when executed operable to perform operations comprising:

collecting photos associated with objects in at least one location;

collecting attention information associated with one or more of the objects, wherein the attention information is based on tracking gazes of one or more users and based on one or more fixation points of one or more objects in the least one location;

generating an attention map based on the attention information;

associating a color with each object in the at least one location, wherein each color corresponds to a size of an attention value; and

generating a model of the at least one location based on the photos and the attention map, wherein the generating of the model comprises combining the photos into a panorama of the at least one location based on the one or more fixation points.

9. The system of claim 8 , wherein one or more of the photos are captured using one or more respective devices that are operable to track a gaze of a user.

10. The system of claim 8 , wherein the attention information is based on tracking gazes of one or more users.

11. The system of claim 8 , wherein, to generate the model, the logic when executed is further operable to perform operations comprising:

identifying the objects in the attention map;

selecting photos for each of the objects based on one or more predetermined selection criteria; and

combining the photos into the panorama of the at least one location.

12. The system of claim 8 , wherein, to generate the model, the logic when executed is further operable to perform operations comprising:

identifying the objects in the attention map;

selecting photos for each of the objects based on one or more predetermined selection criteria, wherein the one or more predetermined selection criteria is based on one or more of resolution, quality, field of view, and level of attention; and

combining the photos into the panorama of the at least one location.

13. The system of claim 8 , wherein the logic when executed is further operable to perform operations comprising iteratively replacing one or more photos in the panorama with replacement photos based on one or more predetermined replacement criteria.

14. The system of claim 8 , wherein the logic when executed is further operable to perform operations comprising iteratively replacing one or more photos in the panorama with replacement photos based on one or more predetermined replacement criteria, and wherein the replacement criteria may include one or more of quality and resolution.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044566/0657 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2013
From: HOROWITZ, BRADLEY
To: GOOGLE INC.
Reel/Frame 029573/0209 →