IP Library Granted Patent US 11,082,719
Granted Patent B2
US 11,082,719 · App. 16/626,726 · Granted Aug 3, 2021

Apparatus, a method and a computer program for omnidirectional video

Inventors: Miska Hannuksela (Tampere, FI); Sebastian Schwarz (Unterhaching, DE)
Assignee: Nokia Technologies Oy
H04N19/597H04N13/161H04N19/167H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,082,719
App. No.
16/626,726
Filed
Dec 26, 2019
Granted
Aug 3, 2021
Kind
B2
Art Unit
2482
USPC
348/43
Abstract

There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a bitstream comprising a coded first-view picture and a coded second-view picture is encoded or encapsulated. The coded second-view picture represents a smaller field of view than the coded first-view picture, wherein decoding of the coded first-view picture results in a decoded first-view picture, and decoding of the coded second-view picture results in a decoded second-view picture. An indication is inserted in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture.

Claims (76)

1. An apparatus comprising at least one processor and at least one non-transitory memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least:

encode or encapsulating a bitstream comprising a coded first-view picture and a coded second-view picture, wherein:

the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region;

the coded second-view picture represents a smaller field of view than the coded first-view picture;

decode of the coded first-view picture results in a decoded first-view picture; and

decode of the coded second-view picture results in a decoded second-view picture; and

indicate in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture.

2. The apparatus of claim 1 further comprising:

decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and

indicating in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture.

3. The apparatus of claim 1 , wherein the decoded first-view picture and the reconstructed second-view picture comprise a monoscopic area, the apparatus further comprising:

encoding or encapsulating the monoscopic area into the coded first-view picture and excluding the monoscopic area from the coded second-view picture.

4. The apparatus of claim 3 , wherein a mapping comprises:

a first region of the decoded picture covering the decoded first-view picture mapped to the first-view constituent picture of the frame-packed picture;

a second region of the decoded picture covering a left-side of the monoscopic area of the decoded first-view picture mapped to a second region within the second-view constituent picture of the frame-packed picture;

a third region of the decoded picture covering a right-side of the monoscopic area of the decoded first-view picture mapped to a third region within the second-view constituent picture of the frame-packed picture; and

a fourth region of the decoded picture covering the decoded second-view picture, which excludes the monoscopic area, mapped to a fourth region within the second-view constituent picture of the frame-packed picture.

5. The apparatus claim 1 , further comprising:

indicating, in or along the bitstream, a spherical coverage of the coded first-view picture and the coded second-view picture separately for each view.

6. The apparatus claim 1 , further comprising:

indicating, in or along the bitstream, one-dimensional coordinate indicative of a location of a border between an overlapping area and a non-overlapping area in the coded first-view picture.

7. The apparatus of claim 5 , further comprising:

indicating in or along the bitstream that for the non-overlapping spherical coverage or area, content from the first view is copied for reconstructing the reconstructed second-view picture.

8. The apparatus claim 3 , further comprising:

encoding at least a part of the monoscopic area within the coded first-view picture as one or more motion-constrained tile sets, which do not contain any stereoscopic areas.

9. The apparatus of the claim 1 , further comprising:

encapsulating the coded first-view into a first track; and

encapsulating the coded second-view into a second track.

10. The apparatus of claim 3 , wherein the at least one region of the decoded first-view picture included in the reconstructed second-view picture is the monoscopic area of the decoded first-view picture.

11. An apparatus comprising at least one processor and at least one non-transitory memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least:

receive a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region, and wherein the coded second-view picture represents a smaller field of view than the coded first-view picture;

decode the coded first-view picture, wherein the decoding results into a decoded first-view picture;

decode the coded second-view picture, wherein the decoding results into a decoded second-view picture;

decode from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and

reconstruct the reconstructed second-view picture accordingly.

12. The apparatus of claim 11 , further comprising:

decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and

decoding in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture.

13. The apparatus of claim 11 , wherein the field of view comprises a monoscopic area, the apparatus further comprising:

decoding or decapsulating the monoscopic area from the coded first-view picture.

14. The apparatus of claim 11 , further comprising:

decoding, from or along the bitstream, a separate indication of a spherical coverage of the coded first-view picture and the coded second-view picture for each view.

15. The apparatus of claim 11 , further comprising:

decoding, from or along the bitstream, one-dimensional coordinate indicative of a location of a border between an overlapping area and a non-overlapping area in the coded first-view picture.

16. The apparatus of claim 14 , further comprising:

decoding from or along the bitstream an indication that for non-overlapping spherical coverage or area, content from the first view is copied for reconstructing the reconstructed second-view picture.

17. A method, comprising:

encoding or encapsulating a bitstream comprising a coded first-view picture and a coded second-view picture, wherein

the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region,

the coded second-view picture represents a smaller field of view than the coded first-view picture,

decoding of the coded first-view picture results in a decoded first-view picture,

decoding of the coded second-view picture results in a decoded second-view picture; and

indicating in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture.

18. A method, comprising:

receiving a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region, and wherein the coded second-view picture represents a smaller field of view than the coded first-view picture,

decoding the coded first-view picture, wherein the decoding results into a decoded first-view picture,

decoding the coded second-view picture, wherein the decoding results into a decoded second-view picture,

decoding from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and

reconstructing the reconstructed second-view picture accordingly.

19. The method of claim 18 , further comprising:

decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and

decoding in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture.

20. A computer readable non-transitory storage medium comprising code for use by an apparatus, which when executed by a processor, causes the apparatus to perform at least:

obtain a first coded tile or sub-picture track and a second coded tile or sub-picture track, the first and second coded tile or sub-picture tracks representing a different spatial part of an input video sequence, and the first and second coded tile or sub-picture tracks having the same width and height in pixels;

encode or encapsulate a bitstream comprising a coded first-view picture and a coded second-view picture, wherein

the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region,

the coded second-view picture represents a smaller field of view than the coded first-view picture,

decoding of the coded first-view picture results in a decoded first-view picture,

decoding of the coded second-view picture results in a decoded second-view picture, and

indicate in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture.

21. A computer readable non-transitory storage medium comprising code for use by an apparatus, which when executed by a processor, causes the apparatus to perform at least:

receive a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded first-view picture and the coded second-view picture form a partially stereoscopic content, wherein the partially stereoscopic content comprises a stereoscopic region and a monoscopic region, and wherein the coded second-view picture represents a smaller field of view than the coded first-view picture,

decode the coded first-view picture, wherein the decoding results into a decoded first-view picture,

decode the coded second-view picture, wherein the decoding results into a decoded second-view picture,

decode from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and

reconstruct the reconstructed second-view picture accordingly.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2019
From: HANNUKSELA, MISKA; SCHWARZ, SEBASTIAN
To: NOKIA TECHNOLOGIES OY
Reel/Frame 051370/0355 →
Priority Claims (1)
FI 20175640 · Jul 3, 2017 · national
Continuity (1)
Related Publication 20200288171A1 · Sep 10, 2020
Cited By (1)
US 12,549,732