IP Library › Granted Patent US 11,457,145
Granted Patent B2
US 11,457,145 · App. 17/232,731 · Granted Sep 27, 2022

System and method for producing a spatially highly precise, localized panoramic street image

Inventors: Christoph Fretter (Berlin, DE); Detlev Huelsebusch (Berlin, DE); Oleg Selig (Berlin, DE)
Assignee: Parkling GmbH
H04N5/23238H04N5/23229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,457,145
App. No.
17/232,731
Granted
Sep 27, 2022
Kind
B2
Abstract

The invention relates to a method for producing a spatially highly precise, localized panoramic street image of a street from a continuous film with location information recorded by means of a vehicle, wherein the film contains image data at an angle of 90° to the course of the street, which is referred to as zero position, and has a capture angle of at least 20° in the horizontal. Here, for each frame of the film recording positions are ascertained and afterwards, in an analysis step, the physical distance between the recording positions of a first and a subsequent frame is calculated. Following this, image strips are extracted from the first and the subsequent frame, which correlate with the distance. Furthermore, the invention relates to a system for executing the relevant method according to the invention.

Claims (50)

1. A method for producing a localized panoramic street image of a street from a continuous film with location information recorded by means of a vehicle, the method comprising:

using a film which contains image data at an angle of 90° to a course of the street, which is referred to as zero position, and which has a capture angle of at least 20° in the horizontal, wherein at least 5° of the capture angle are present before and after the zero position;

by means of the location information, ascertaining a recording position for each frame of the film;

performing an analysis step including calculating a physical distance e 1 between recording positions of a first frame, obtained at a recording position P 1 , and a subsequent frame obtained at a recording position P 2 , and repeating the calculating of the physical distance for every pair of subsequent adjacent pairs of the recording positions to determine a physical distance separating every said pair of adjacent ones of the recording positions;

producing a panoramic street image by:

creating an image strip of the first frame extending from the zero position in the direction of the recording position (P 2 ) of the subsequent frame, which corresponds with a first part of the distance; and

creating an image strip of the subsequent frame from the zero position in the direction of the recording position of the first frame, which corresponds with a second part of the distance;

wherein the first and the second parts of the distance together correspond to the entire distance separating recording positions P 1 and P 2 ;

wherein at least for one said frame, pixels thereof are ascertained that lie on the zero position of the at least one said frame; and

wherein every subsequent pair of said image frames created is dependent on a distance separating a subsequent associated pair of adjacent ones of said recording positions, and every said subsequent pair of said image frames together correspond to the entire distance separating the two recording positions used to produce the pair of said image frames.

2. The method according to claim 1 , wherein the analysis step is carried out for each frame of the film that shows the street.

3. The method according to claim 1 , wherein in the case of the first and the last frame of the film, only the portions starting from the zero position in the direction of the course of the street are used in each case.

4. The method according to claim 1 , wherein the panoramic street image is assembled from the image strips, wherein the panoramic street image corresponds with the length of the street.

5. The method according to claim 1 , wherein the first part of the distance and the second part of the distance each correspond to half of the distance.

6. The method according to claim 1 , wherein the recording position is ascertained relative to the beginning of the street.

7. The method according to claim 1 , wherein the distance is converted into pixels of a frame.

8. The method according to claim 1 , wherein the film is chosen such that a 10 cm distance corresponds to at least 35 pixels.

9. The method according to claim 1 , wherein in the analysis step a depth in the range between 3.5 m and 4.5 m is used.

10. The method according to claim 1 , wherein the film is chosen such that a 1° capture angle in the horizontal has at least 25 pixels.

11. The method according to claim 1 , wherein the zero position is determined by means of a corner of at least one of a house wall or a calibration means.

12. The method according to claim 1 , wherein the zero position is corrected by means of position and/or orientation data of the vehicle, in addition to using information pertaining to a course of a street being travelled by the vehicle.

13. The method according to claim 1 , wherein the film is chosen such that it has a capture angle in the vertical of at least 100° and in the horizontal of at least 50°.

14. The method according to claim 1 , further comprising a system for producing localized panoramic street image of a street from a continuous film with location information recorded by means of a vehicle with a computing unit, in accordance with the method.

15. The method of claim 1 , further comprising a system for performing the method.

16. A method for producing a localized panoramic street image of a street from a continuous film with location information recorded by means of a vehicle, the method comprising:

using a film which contains image data at a predetermined angle to a course of the street, which is referred to as zero position, and which has a predetermined horizontal capture angle, wherein predetermined subportions of the capture angle are present before and after the zero position;

by means of the location information, ascertaining a recording position for each frame of the film;

performing an analysis step including calculating a physical distance el between recording positions of a first frame and a subsequent frame;

producing a panoramic street image by:

creating an image strip of the first frame from the zero position in the direction of the recording position (P 2 ) of the subsequent frame, which corresponds with a first part of the distance; and

creating an image strip of the subsequent frame from the zero position in the direction of the recording position of the first frame, which corresponds with a second part of the distance;

wherein the first and the second part of the distance together correspond to the entire distance wherein;

wherein at least for one frame, pixels thereof are ascertained that lie on the zero position of the frames;

wherein in the case of the first and the last frame of the film, only the portions starting from the zero position in the direction of the course of the street are used in each case; wherein the panoramic street image is assembled from the image strips, wherein the panoramic street image corresponds with the length of the street; and

wherein every subsequent pair of said image frames created is dependent on a distance separating a subsequent pair of adjacent ones of said recording positions, and every said subsequent pair of said image frames together correspond to the entire distance separating the two recording positions used to produce the pair of said image frames.

17. The method of claim 16 , wherein the predetermined angle comprises an angle of 90°.

18. The method of claim 16 , wherein the predetermined horizontal capture angle is at least 20°.

19. The method of claim 16 , wherein the predetermined subportions of the capture angle present before and after the zero position are at least 5°.

20. A method for producing a localized panoramic street image of a street from a continuous film with location information recorded by means of a vehicle, the method comprising:

using a film which contains image data obtained at a predetermined angle which is non-parallel to a course of the street, which is referred to as zero position, and which has a capture angle of at least 20° in the horizontal, wherein at least 5° of the capture angle are present before and after the zero position;

by means of the location information, ascertaining a recording position for each frame of the film;

performing an analysis step including calculating a physical distance el between recording positions of a first frame and a subsequent frame;

producing a panoramic street image by:

creating an image strip of the first frame from the zero position in the direction of the recording position (P 2 ) of the subsequent frame, which corresponds with a first part of the distance; and

creating an image strip of the subsequent frame from the zero position in the direction of the recording position of the first frame, which corresponds with a second part of the distance;

wherein the first and the second part of the distance together correspond to the entire distance, and wherein the distances separating adjacent pairs of recording positions can vary such that the distances are non-uniform;

wherein at least for one frame, pixels are ascertained that lie on the zero position of the frames;

wherein the zero position is determined by means of a corner of at least one of a house wall or a calibration means;

wherein the zero position is corrected by means of position and/or orientation data of the vehicle, in addition to using information pertaining to a course of a street being travelled by the vehicle; and

wherein every subsequent pair of said image frames created is dependent on a distance separating a subsequent pair of adjacent ones of said recording positions, and every said subsequent pair of said image frames together correspond to the entire distance separating the two recording positions used to produce pair of said image frames.

Assignments (2)
ASSIGNEE'S CHANGE OF ADDRESS Recorded Oct 14, 2025
From: PARKLING GMBH
To: PARKLING GMBH
Reel/Frame 073102/0827 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: FRETTER, CHRISTOPH; HUELSEBUSCH, DETLEV; SELIG, OLEG
To: PARKLING GMBH
Reel/Frame 056332/0034 →
Priority Claims (1)
EP 20174906 · May 15, 2020 · regional
Continuity (1)
Related Publication 20210360156A1 · Nov 18, 2021