IP Library Granted Patent US 11,622,073
Granted Patent B2
US 11,622,073 · App. 17/384,114 · Granted Apr 4, 2023

Method of generating a panoramic image

Inventors: Dmitry Aleksandrovich Sinev (Domodedovo, RU); Anton Gennadevich Timofeev (Moscow, RU)
Assignee: YANDEX EUROPE AG
H04N5/23238G06T7/136G06T2200/04G06T2207/10016G06T2207/30248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,622,073
App. No.
17/384,114
Granted
Apr 4, 2023
Kind
B2
Abstract

A method and a system for generating a video of a 3D object are provided. The method comprises: generating a visual reference frame; capturing an image of a surrounding area around the 3D object; in response to detecting within the image at least a portion of the 3D object: generating a bounding box encompassing the at least the portion of the 3D object; determining an overlap parameter between the bounding box and the visual reference frame; comparing the overlap parameter to a plurality of thresholds; in response to the overlap parameter being above a given one of the plurality of thresholds, generating a respective one of a plurality of predetermined indications for adjusting a position of the camera to capture the portion of the 3D object within the visual reference frame, thereby generating an adjusted image thereof used for composing the video of the 3D object.

Claims (36)

1. A method for generating a video of a 3D object using a camera, the method being executable by a processor of the camera, the method comprising:

generating, by the processor, a visual reference frame, the visual reference frame being indicative of boundaries, within which the 3D object is to be located;

capturing, by the processor, an image of a surrounding area around the 3D object;

in response to detecting, by the processor, within the image, at least a portion of the 3D object:

generating, by the processor, a bounding box encompassing the at least the portion of the 3D object;

determining, by the processor, an overlap parameter between the bounding box and the visual reference frame,

the overlap parameter being indicative of a ratio between a portion of the bounding box outside the visual reference frame and a total surface area of the bounding box;

comparing, by the processor, the overlap parameter to a plurality of thresholds,

in response to the overlap parameter being above a given one of the plurality of thresholds,

generating, by the processor, a respective one of a plurality of predetermined indications for adjusting a position of the camera to capture the portion of the 3D object within the visual reference frame, thereby generating an adjusted image thereof;

storing, by the processor, the adjusted image for inclusion thereof in a plurality of images composing the video of the 3D object.

2. The method of claim 1 , wherein the plurality of predetermined indications comprises a plurality of escalating indications, the plurality of escalating indications being sequentially more prominent as the overlap parameter increases.

3. The method of claim 2 , wherein a given one of the plurality of predetermined indications associated with a given one of the plurality of thresholds is more pronounced than a previous one of the plurality of predetermined indications associated with a previous one of the plurality of thresholds.

4. The method of claim 1 , wherein each one of the plurality of thresholds is associated with one of: a respective constant absolute value of the overlap parameter and a respective percentage of an associated edge of the visual reference frame covered by the bounding box outside thereof.

5. The method of claim 1 , wherein in response to the overlap parameter being above the given one of the plurality of thresholds at two opposite edges of the visual reference frame, the method further comprises generating a first error indication.

6. The method of claim 1 , wherein the capturing the image is executed in response to the camera being caused to move around the 3D object.

7. The method of claim 6 , wherein the video is a sequence of images making up a panoramic view.

8. The method of claim 1 , wherein in response to the capturing the image of the surrounding area around the 3D object being executed less than a predetermined period after generating a pervious one of the plurality of images composing the video of the 3D object, the method further comprises discarding the image from further processing.

9. The method of claim 1 , wherein the detecting, within the image, the at least the portion of the 3D object, further comprises compressing the image.

10. The method of claim 9 , wherein the compressing further comprises converting the image into a pixel buffer having a 32-bit RGBA format.

11. The method of claim 1 , wherein the method further comprises determining, based on the at least the portion of the 3D object, a type of the 3D object.

12. The method of claim 11 , wherein in response to the 3D object being not of a predetermined type of 3D objects, the method further comprises discarding the image from further processing.

13. The method of claim 12 , wherein in response to not determining the type of the 3D object as being the predetermined type in a predetermined number of consecutively captured images, the method further comprises generating a second error indication.

14. The method of claim 13 , wherein the predetermined type of 3D object comprises a vehicle.

15. The method of claim 1 , wherein in response to the bounding box encompassing the at least the portion of the 3D object having dimensions smaller than respective predetermined thresholds, the method further comprises discarding the image from further processing.

16. The method of claim 1 , wherein in response to the bounding box encompassing the at least the portion of the 3D object being offset at a distance from a center of the visual reference frame greater than a predetermined distance threshold, the method further comprises discarding the image from further processing.

17. The method of claim 1 , wherein in response to detecting, within the image, along with the at least the portion of the 3D object, at least an other portion of an other 3D object, the method further comprises:

generating for the at least the other portion of the other 3D object, a second bounding box;

determining respective dimensions of the bounding box and the second bounding box; and

selecting for further processing one of the bounding box and the second bounding box having smaller dimensions.

18. The method of claim 1 , wherein in response to the bounding box being positioned within the visual reference frame at a distance spaced away from any of edges thereof by less than a first predetermined distance threshold value, the method further comprises generating a third error indication.

19. The method of claim 18 , wherein the third error indication comprises a haptic indication.

20. The method of claim 1 , wherein the method further comprises causing display of the video of the 3D object.

21. The method of claim 20 , wherein the causing display further comprises causing display of indications of each one the plurality of predetermined indications associated with respective timestamps,

a given timestamp associated with a given one of the plurality of predetermined indications being indicative of a time when the given one of the plurality of predetermined indications was generated.

22. The method of claim 21 , wherein the causing display further comprises causing display of an associated triggered one of the plurality of predetermined indications for a given of the plurality of images.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2026
From: Y.E. HUB ARMENIA LLC
To: YANDEX.CLASSIFIEDS TECHNOLOGY LLC
Reel/Frame 073839/0405 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: DIRECT CURSUS TECHNOLOGY L.L.C
To: Y.E. HUB ARMENIA LLC
Reel/Frame 068534/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: YANDEX EUROPE AG
To: DIRECT CURSUS TECHNOLOGY L.L.C
Reel/Frame 065692/0720 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: TIMOFEEV, ANTON GENNADEVICH; SINEV, DMITRY ALEKSANDROVICH
To: YANDEX.CLASSIFIEDS TECHNOLOGY LLC
Reel/Frame 062685/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: YANDEX.CLASSIFIEDS TECHNOLOGY LLC
To: YANDEX.CLASSIFIEDS LLC
Reel/Frame 062686/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: YANDEX.CLASSIFIEDS LLC
To: YANDEX EUROPE AG
Reel/Frame 062747/0280 →