IP Library › Granted Patent US 10,834,305
Granted Patent B2
US 10,834,305 · App. 16/092,467 · Granted Nov 10, 2020

System and method for providing virtual pan-tilt-zoom, PTZ, video functionality to a plurality of users over a data network

Inventors: Magnus Linderoth (Lund, SE); Håkan Ardö (Lund, SE); Klas Josephson (Malmö, SE)
Assignee: SPIIDEO AB
H04N5/23206G06T7/80H04N5/04H04N5/232H04N5/23216H04N5/23299H04N5/247H04N5/2628H04N21/21805H04N21/47217H04N21/6587H04N21/816H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,834,305
App. No.
16/092,467
Granted
Nov 10, 2020
Kind
B2
Abstract

A system for providing virtual pan-tilt-zoom, PTZ, video functionality video to a plurality of users over a data network is provided. The system includes one or more network video cameras positioned to make a video recording of a real-world target field, or a respective subarea thereof, and output a respective raw video segment onto the data network, a back-end camera calibration unit which is adapted to obtain a relative position and orientation of the respective network video camera with respect to a three dimensional world space for the target field, and to save the obtained relative position and orientation as metadata for the respective network video camera, a back-end video processing unit, connected to the data network and adapted to receive the respective raw video segment(s) recorded by the network video camera(s), and to store or buffer video contents of the respective raw video segment(s) in a back-end video storage, a back-end video streaming unit adapted to stream the stored or buffered video contents and the saved metadata for the respective network video camera onto the data network, a plurality of client devices for use by the plurality of users.

Claims (34)

1. A system for providing virtual pan-tilt-zoom, PTZ, video functionality to a plurality of users over a data network, the system comprising:

one or more network video cameras positioned to make a video recording of a real-world target field, or a respective subarea thereof, and output a respective raw video segment onto the data network;

a back-end camera calibration unit which is adapted to obtain a relative position and orientation of the respective network video camera with respect to a three dimensional world space for the target field, and to save the obtained relative position and orientation as metadata for the respective network video camera;

a back-end video processing unit, connected to the data network and adapted to receive the respective raw video segment(s) recorded by the network video camera(s), and to store or buffer video contents of the respective raw video segment(s) in a back-end video storage;

a back-end video streaming unit adapted to stream the stored or buffered video contents and the saved metadata for the respective network video camera onto the data network; and

a plurality of client devices for use by the plurality of users, wherein each client device is adapted to:

receive the streamed video contents and the metadata;

determine a chosen virtual pan-tilt-zoom value; and

present, on a display of the client device, the video contents by projecting directions, in the three dimensional world space, onto the display based on the chosen virtual pan-tilt-zoom value and the metadata, wherein the virtual pan-tilt-zoom value defines a projection plane of a virtual camera, and wherein a display screen coordinate of a direction in space is determined by where it intersects the projection plane.

2. The system as defined in claim 1 , wherein the back-end camera calibration unit is further adapted to obtain intrinsic parameters of the respective network video camera with respect to the three dimensional world space for the target field, and to save the obtained intrinsic parameters as metadata for the respective network video camera.

3. The system as defined in claim 1 , wherein the system comprises two or more network video cameras, and wherein the back-end video processing unit is further adapted to analyze the respective raw video frames as recorded by the two or more network video cameras and to synchronize these frames.

4. The system as defined in claim 3 , wherein the back-end video processing unit or the video streaming unit is further configured to generate a stacked video stream from the synchronized frames of the respective raw video segments from the two or more network video cameras.

5. The system as defined in claim 4 , wherein at least one of the synchronized frames of the respective raw video segments from the two or more network video cameras in the stacked video stream are scaled-down and used to show at least one thumbnail of the corresponding video streams.

6. The system as defined in claim 1 , wherein each client device is further adapted to receive a tag inserted by the user in the video contents presented on the display.

7. The system as defined in claim 6 , wherein the tag comprises a spatial parameter which represents a drawing made by the user in the video contents presented on the display.

8. The system as defined in claim 6 , wherein the tag comprises a time parameter and a spatial parameter.

9. The system as defined in claim 6 , wherein the system further comprises a tagging unit adapted to receive the tag and store the tag in the back-end storage.

10. The system as defined in claim 9 , wherein tagging unit allows the tag to be shared with a plurality of client devices.

11. The system as defined in claim 1 , wherein each client device is further adapted to receive a tag inserted by the system in the video contents presented on the display.

12. The system as defined in claim 1 , wherein the chosen virtual pan-tilt-zoom value defines a projection plane of the one or more network video cameras.

13. The system as defined in claim 1 , wherein the system further comprises a tracking unit configured to choose the virtual pan-tilt-zoom value.

14. The system as defined in claim 13 , wherein the tracking unit is configured to choose the virtual pan-tilt-zoom value by detecting an estimated current activity center in the ongoing activity in the target field.

15. The system as defined in claim 1 , wherein the chosen virtual pan-tilt-zoom value is determined by the user.

16. A method for providing virtual pan-tilt-zoom, PTZ, video functionality to a plurality of users over a data network, wherein the method comprises:

providing one or more network video cameras positioned to make a video recording of a real-world target field, or a respective subarea thereof, and output a respective raw video segment onto the data network;

obtaining a relative position and orientation of the respective network video camera with respect to a three dimensional world space for the target field;

saving the obtained relative position and orientation as metadata for the respective network video camera;

receiving over the data network the respective raw video segment(s) recorded by the network video camera(s);

storing or buffering video contents of the respective raw video segment(s) in a cloud-based video storage;

streaming the stored or buffered video contents and the saved metadata for the respective network video camera onto the data network,

wherein, the method further involves, in respective client devices for use by respective one of the plurality of users:

receiving the streamed video contents and the metadata;

determining a chosen virtual pan-tilt-zoom value; and

presenting, on a display the client device, the video contents by projecting directions in the three dimensional world space onto the display based on the chosen virtual pan-tilt-zoom value and the metadata, wherein the virtual pan-tilt-zoom value defines a projection plane of a virtual camera, and wherein a display screen coordinate of a direction in space is determined by where it intersects the projection plane.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2020
From: LINDEROTH, MAGNUS; ARDÖ, HÅKAN; JOSEPHSON, KLAS
To: SPIIDEO AB
Reel/Frame 051869/0796 →
Priority Claims (1)
SE 1650488 · Apr 11, 2016 · national
Continuity (1)
Related Publication 20190109975A1 · Apr 11, 2019
Cited By (6)
US 12,229,905 US 12,244,782 US 12,309,449 US 12,542,946 US 12,586,305 US 12,675,962