IP Library Granted Patent US 11,514,678
Granted Patent B2
US 11,514,678 · App. 17/110,718 · Granted Nov 29, 2022

Data processing method and apparatus for capturing and analyzing images of sporting events

Inventors: Mathew Richards (Basingstoke, GB); Edward Hawke (Basingstoke, GB); Luke Dodd (Basingstoke, GB); Hattori Hironori (Tokyo, JP)
Assignees: Sony Europe B.V.; Sony Group Corporation
G06V20/42G01S19/485G06T7/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,514,678
App. No.
17/110,718
Granted
Nov 29, 2022
Kind
B2
Abstract

A data processing method comprising obtaining information identifying a position of an object in a scene at a time during a sporting event; obtaining an image of the scene captured at the time during the sporting event; projecting the position of the object in the scene onto an image plane of the image; and outputting information based on the projection.

Claims (30)

1. A data processing method comprising:

obtaining information identifying a position of an object in a scene at a time during a sporting event;

obtaining an image of the scene captured at the time during the sporting event;

projecting the position of the object in the scene onto an image plane of the image;

outputting information based on the projection;

obtaining information indicating a visual characteristic of the object which distinguishes it from one or more other objects in the scene; and

determining if the object is in the image using the visual characteristic of the object, wherein

the determining if the object is in the image includes:

projecting the position of the object in the scene onto a plurality of candidate image planes of the image,

for each candidate image plane, determining if a portion of the image at the projected position of the object has the visual characteristic of the object, and

determining the object is in the image if, for one candidate image plane, the portion of the image at the projected position of the object has the visual characteristic of the object, and

the one candidate image plane is determined as the image plane of the image.

2. The data processing method according to claim 1 , wherein the output information indicates the image.

3. The data processing method according to claim 1 , wherein the output information indicates one or more camera parameters associated with the one candidate image plane.

4. The data processing method according to claim 1 , wherein the visual characteristic of the object comprises a pose of the object or a visual marking on the object.

5. The data processing method according to claim 1 , wherein the position of the object in the scene is determined using a plurality of images of the object simultaneously captured by a plurality of respective cameras each calibrated with respect to the scene.

6. The data processing method according to claim 1 , wherein the information identifying the position of the object in the scene comprises Global Navigation Satellite System GNSS coordinates of the object.

7. The data processing method according to claim 6 , wherein

the object is in the image, and

the method comprises:

comparing the projected position of the GNSS coordinates of the object on the image plane of the image with the position of the object in the image; and

if there is a discrepancy between the projected position of the GNSS coordinates of the object on the image plane of the image and the position of the object in the image:

adjusting the GNSS coordinates of the object to reduce the discrepancy; and

including the adjusted GNSS coordinates in the output information.

8. The data processing method according to claim 1 , wherein the sporting event is a ball game and the object is a ball game participant or a ball.

9. The data processing method according to claim 8 , wherein the sporting event is a soccer match.

10. The data processing method according to claim 8 , wherein the sporting event is an American football game.

11. The data processing method according to claim 1 , wherein the sporting event is a race and the object is a race participant.

12. The data processing method according to claim 11 , wherein the sporting event is a horse race.

13. A non-transitory storage medium storing a program for controlling a computer to perform the method according to claim 1 .

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2022
From: HAWK-EYE INNOVATIONS LIMITED
To: SONY EUROPE BV; SONY CORPORATION
Reel/Frame 061499/0266 →
CHANGE OF NAME Recorded Oct 21, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 061740/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2022
From: RICHARDS, MATHEW; HAWKE, EDWARD; DODD, LUKE
To: HAWK-EYE INNOVATIONS LIMITED
Reel/Frame 061478/0505 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2022
From: HIRONORI, HATTORI
To: SONY CORPORATION
Reel/Frame 061478/0597 →
Priority Claims (1)
GB 1918370 · Dec 13, 2019 · national
Continuity (1)
Related Publication 20210182560A1 · Jun 17, 2021