IP Library › Granted Patent US 11,166,005
Granted Patent B2
US 11,166,005 · App. 16/759,170 · Granted Nov 2, 2021

Three-dimensional information acquisition system using pitching practice, and method for calculating camera parameters

Inventors: Whol-Yul Kim (Seoul, KR); Joong-Sik Kim (Incheon, KR); Je Yeon Kim (Goyang-si, KR); Hong Jun Lee (Gumi-si, KR)
Assignee: INDUSTRY-UNIVERSITY COOPERATION FOUNDATION HANYANG UNIVERSITY
H04N13/246H04N13/128H04N13/239H04N2013/0081H04N2013/0085
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,166,005
App. No.
16/759,170
Granted
Nov 2, 2021
Kind
B2
Abstract

A three-dimensional information acquisition system using pitching practice, and a method for calculating camera parameters are disclosed. The method by which a server calculates camera parameters in order to obtain three-dimensional information, according to various embodiments of the present invention, can comprise the steps of: receiving, from at least two camera devices, image information of dynamic objects moving at a predetermined speed; confirming location information of each dynamic object, included in the image information, on the basis of the same time in each piece of image information received from each camera device; and calculating camera parameters, which indicate the relationship between the camera devices, by using at least a part of each piece of confirmed location information as a corresponding point.

Claims (36)

1. A method of calculating camera parameters at a server for 3-dimensional information acquisition, the method comprising:

receiving image information of a dynamic object moving at a particular speed from at least two or more camera devices;

checking a respective set of location information of the dynamic object included in the image information received from each camera device at a same time; and

calculating the camera parameters representing a relationship between the camera devices by using at least a portion of the respective set of the checked location information as a corresponding point,

wherein the calculating of the camera parameters comprises:

determining a first camera parameter based on the dynamic object moved during a first pitching practice;

determining a second camera parameter based on the dynamic object moved during a second pitching practice followed by the first pitching practice; and

correcting the first camera parameter based on the second camera parameter.

2. The method of calculating the camera parameters according to claim 1 , wherein the checking of the location information of the dynamic object comprises:

extracting an image corresponding to a same timeframe from the respective image information; and

checking plane coordinate information of a region in which the dynamic object is present in each of the extracted images.

3. The method of calculating the camera parameters according to claim 1 , wherein the image information includes a ball thrown in a pitching practice space as the dynamic object.

4. The method of calculating the camera parameters according to claim 1 , wherein the camera parameters represent distance information between the camera devices.

5. A method of calculating camera parameters at a server for 3-dimensional information acquisition, the method comprising:

receiving image information of a dynamic object moving at a particular speed from at least two or more camera devices;

checking a respective set of location information of the dynamic object included in the image information received from each camera device at a same time; and

calculating the camera parameters representing a relationship between the camera devices by using at least a portion of the respective set of the checked location information as a corresponding point,

detecting consecutive 2-dimensional location information from the image information, the consecutive 2-dimensional location information associated with a movement of the dynamic object;

modeling a trajectory of the dynamic object as a 2 nd order curve based on the 2-dimensional location information;

modifying the 2-dimensional location information such that the 2-dimensional location information of the dynamic object deviating by a particular distance or greater from the 2 nd order curve is positioned on at least two points of the 2 nd order curve; and

calibrating the camera parameters based on the modified 2-dimensional location information.

6. The method of calculating the camera parameters according to claim 5 , further comprising:

rendering 3-dimensional information representing the trajectory of the dynamic object based on the calibrated camera parameters, the rendered 3-dimensional information comprising consecutive 3-dimensional location information of the dynamic object;

modeling the trajectory of the dynamic object as a 3-dimensional plane based on the rendered 3-dimensional information;

modifying the 3-dimensional location information such that the 3-dimensional location information of the dynamic object deviating by a particular distance or greater from the 3-dimensional plane is positioned on at least two points of the 3-dimensional plane; and

calibrating the camera parameters based on the modified 3-dimensional location information.

7. The method of calculating the camera parameters according to claim 6 , further comprising:

calibrating the camera parameters by detecting new 2-dimensional location information based on the modified 3-dimensional location information and modifying the new 2-dimensional location information based on a new 2 nd order curve modeling.

8. A server configured to calculate camera parameters for 3-dimensional information acquisition, the server comprising:

a communication unit;

an image information receiver unit configured to receive image information of a dynamic object moving at a particular speed via the communication unit from at least two or more camera devices;

an image analysis unit configured to check a respective set of location information of the dynamic object included in the image information received from each camera device at a same time; and

a parameter calculation unit configured to calculate the camera parameters representing a relationship between the camera devices by using at least a portion of the respective set of the checked location information as a corresponding point,

wherein the parameter calculation unit determines a first camera parameter based on the dynamic object moved during a first pitching practice, determines a second camera parameter based on the dynamic object moved during a second pitching practice after the first pitching practice, and corrects the first camera parameter based on the second camera parameter.

9. The server of claim 8 , wherein the image analysis unit extracts an image corresponding to a same time from the respective set of the image information and checks plane coordinate information of a region in which the dynamic object is present in each of the extracted images.

10. The server of claim 8 , wherein the camera parameters represent distance information between the camera devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: IUCF-HYU (INDUSTRY-UNIVERSITY COOPERATION FOUNDATION HANYANG UNIVERSITY)
To: LABINNO, INC.
Reel/Frame 067290/0988 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2020
From: KIM, WHOL-YUL; KIM, JOONG-SIK; KIM, JE YEON; LEE, HONG JUN
To: INDUSTRY-UNIVERSITY COOPERATION FOUNDATION HANYANG UNIVERSITY
Reel/Frame 052491/0451 →
Continuity (1)
Related Publication 20200351488A1 · Nov 5, 2020