IP Library Patent Application 17313545
Patent Application
App. No. 17/313,545

NAVIGATING THROUGH A SET OF IMAGES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/313,545
Abstract

Information relating to a subset of images within a set of images is received. The information includes metadata of each image. The subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image. Weight information is received. The weight information controls weights to be given to a plurality of different measures of similarities. A plurality of combined measures of similarity for pairs of images in the subset of images are calculated.

Claims (34)

1 - 14 . (canceled)

15 . A method, comprising:

receiving information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image;

receiving weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and

calculating a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information.

16 . The method of claim 15 , further comprising:

selecting a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair.

17 . The method of 16 , further comprising determining a transition class of a transition from the current image to the at least one best ranked transition image, and wherein the method further comprises outputting an indication of one or more transition classes associated with the at least one best ranked transition image.

18 . The method of claim 15 , further comprising determining at least one best ranked transition image among the images within the subset of images based on the plurality of combined measures of similarity.

19 . The method of claim 15 , further comprising generating a graph representation of the images within the subset of images, the graph representation comprising nodes and edges.

20 . The method of claim 15 , wherein the corresponding metadata includes a three-dimensional reconstruction index indicating that the corresponding image is part of a particular sub-model of three-dimensional structure of objects having the three-dimensional reconstruction index.

21 . The method of claim 15 , wherein the bounding area is updated based on navigation through the set of images.

22 . The method of claim 15 , wherein the bounding area is determined based at least in part on a viewing angle associated with of the current image.

23 . The method of claim 15 , further comprising sending a request for information relating to the subset of images, wherein the request comprises an indication of the current image.

24 . A system, comprising:

one or more processors configured to:

receive information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image;

receive weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and

calculate a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information; and

 a memory coupled to at least a portion of the one or more processors and configured to provide instructions.

25 . The system of claim 24 , wherein the one or more processors are further configured to select a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair.

26 . The system of claim 25 , wherein the one or more processors are further configured to determine a transition class of a transition from the current image to the at least one best ranked transition image, and wherein the method further comprises outputting an indication of one or more transition classes associated with the at least one best ranked transition image.

27 . The system of claim 24 , wherein the one or more processors are further configured to determine at least one best ranked transition image among the images within the subset of images based on the plurality of combined measures of similarity.

28 . The system of claim 24 , wherein the one or more processors are further configured to generate a graph representation of the images within the subset of images, the graph representation comprising nodes and edges.

29 . The system of claim 24 , wherein the corresponding metadata includes a three-dimensional reconstruction index indicating that the corresponding image is part of a particular sub-model of three-dimensional structure of objects having the three-dimensional reconstruction index.

30 . The system of claim 24 , wherein the bounding area is updated based on navigation through the set of images.

31 . The system of claim 24 , wherein the bounding area is determined based at least in part on a viewing angle associated with of the current image.

32 . The system of claim 24 , wherein the one or more processors are further configured to send a request for information relating to the subset of images, wherein the request comprises an indication of the current image.

33 . A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:

receiving information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image;

receiving weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and

calculating a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information.

34 . The computer program product of claim 33 , further comprising computer instructions for:

selecting a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair.

Assignments (1)
CHANGE OF NAME Recorded Nov 19, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058214/0351 →