IP Library Granted Patent US 9,686,467
Granted Patent B2
US 9,686,467 · App. 14/460,696 · Granted Jun 20, 2017

Panoramic video

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,686,467
App. No.
14/460,696
Granted
Jun 20, 2017
Kind
B2
Abstract

A direction of a sound source located in the surrounding of a detector of a panoramic video is established. A preset view of the panoramic video is determined based on the established direction. Playback of the panoramic video is based on the determined preset view.

Claims (28)

1. A method of processing a panoramic video, comprising:

retrieving video data of a panoramic video, the panoramic video imaging a first part of a surrounding of a detector of the panoramic video;

establishing a direction of a sound source located in the surrounding of the detector;

based on said establishing of the direction of the sound source, determining control data indicating a preset view of the panoramic video, the preset view imaging a second part of the surrounding of the detector, the first part including the second part; and

storing, in computing memory, a portion of the video data containing the preset view of the panoramic video, and absent storing, in the computing memory, a remaining portion of the video data outside the second part of the surrounding of the detector to discard the remaining portion.

2. The method of claim 1 , wherein said establishing of the direction of the sound source comprises:

evaluating at least one of a plurality of audio tracks of the video data, and a plurality of audio tracks received from microphones of the detector.

3. The method of claim 2 , wherein said evaluating takes into account at least one of a level of loudness of the plurality of audio tracks, and a time shift of a sound pattern between the plurality of audio tracks.

4. The method of claim 1 , wherein the preset view includes the established direction of the sound source.

5. The method of claim 1 , wherein the determining of the control data is further based on at least one of the following: an audio level of the sound source; a previously determined preset view; and a predefined panning parameter.

6. The method of claim 1 , wherein the control data specifies at least one of the following parameters of the preset view: a direction of the sound source; a center position; a zoom factor; an aspect ratio; a vertical orientation; a horizontal orientation; an azimuthal angle φ; and a polar angle θ.

7. The method of claim 1 , wherein the control data indicates an audio level of the sound source.

8. The method of claim 1 , wherein the control data is determined with a predefined temporal resolution.

9. The method of claim 1 , wherein the control data indicates a zoom factor of the preset view, wherein the zoom factor depends on the sound level of the sound source.

10. The method of claim 1 , wherein the method is performed during a capturing of the panoramic video.

11. A device, comprising:

a processor operating under computer program instructions control, the processor:

retrieving video data of a panoramic video, the panoramic video imaging a first part of a surrounding of a detector,

establishing a direction of a sound source located in the surrounding of the detector,

determining control data indicating a preset view of the panoramic video based on said establishing of the direction of the sound source, wherein the preset view images a second part of the surrounding of the detector, the first part including the second part, and

storing, in computing memory, a portion of the video data containing the preset view of the panoramic video, and absent storing, in the computing memory, a remaining portion of the video data outside the second part of the surrounding of the detector to discard the remaining portion.

12. The device of claim 11 , wherein the processor: establishing the direction of the sound source by evaluating at least one of a plurality of audio tracks of video data, and a plurality of audio tracks received from microphones of the detector.

13. The device of claim 12 , wherein the processor: evaluating the at least one of the plurality audio tracks of the video data, and the plurality of audio tracks received from the microphones by taking into account at least one of a level of loudness of the plurality of audio tracks, and a time shift of a sound pattern between the plurality of audio tracks.

14. The device of claim 11 , wherein the preset view includes the established direction of the sound source.

15. The device of claim 11 , wherein the processor: determining the control data based on at least one of the following: an audio level of the sound source; a previously determined preset view; and a predefined panning parameter.

16. The device of claim 11 , wherein the control data specifies at least one of the following parameters: an audio level of the sound source; a direction of the sound source; a center position; a zoom factor; an aspect ratio; a vertical orientation; a horizontal orientation; an azimuthal angle φ; and a polar angle θ.

17. The device of claim 11 , wherein the processor: determining the control data with a predefined temporal resolution.

18. The device of claim 11 , wherein the control data indicates a zoom factor of the preset view, wherein the zoom factor depends on the sound level of the sound source.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →