IP Library Granted Patent US 10,375,371
Granted Patent B2
US 10,375,371 · App. 15/647,630 · Granted Aug 6, 2019

Method and apparatus for filtering 360-degree video boundaries

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,375,371
App. No.
15/647,630
Granted
Aug 6, 2019
Kind
B2
Abstract

A video system for encoding or decoding 360-degree virtual reality (360VR) video is provided. The system performs filtering operations to reduce coding artifacts and discontinuities in a projection image of an omnidirectional image. The video system identifies first and second edges of the projection image. The first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image. The system computes a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge.

Claims (36)

1. A method comprising:

receiving a projection image of an omnidirectional image;

identifying a first edge of the projection image;

identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and

computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,

wherein the omnidirectional image is a platonic solid having a plurality of faces and the projection image comprises a layout of the faces of the platonic solid, and

wherein the first edge is an edge of a first face of the platonic solid, the second edge is an edge of a second face of the platonic solid, the first set of pixels is in the first face of the platonic solid, and the second set of pixels is in the second face of the platonic solid.

2. The method of claim 1 , wherein said filtering is deblock filtering that reduces discontinuity and compression artifacts across the common edge.

3. The method of claim 1 , wherein said filtering comprises rearranging pixels of the second face of the platonic solid according to a geographical relationship between the first face and the second face, the geographical relationship defined by the layout of the faces of the platonic solid in the projection image.

4. The method of claim 3 , wherein rearranging pixels of the second face comprises rotating or flipping pixels of the second face based on the geographical relationship between the first face and the second face.

5. The method of claim 3 , wherein said filtering further comprises storing the rearranged pixels of the second face at a blank area of the projection image adjacent to the first edge.

6. The method of claim 3 , wherein said filtering further comprises storing the rearranged pixels of the second face at a temporary buffer that does not store pixels from a blank area of the projection image.

7. The method of claim 3 , wherein said filtering further comprising computing a set of filtered values for the first and second sets of pixels based on the pixels of the first face and the rearranged pixels of the second face.

8. A method comprising:

receiving a projection image of an omnidirectional image;

identifying a first edge of the projection image;

identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and

computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,

wherein the omnidirectional image is a sphere and the projection image comprises an equirectangular projection of the sphere, and

wherein both the first edge and the second edge extend from a north pole to a south pole of the sphere.

9. An electronic apparatus comprising:

a decoded picture storage capable of receiving and storing a projection image of an omnidirectional image; and

a filtering circuit capable of:

identifying a first edge of the projection image;

identifying a second edge of the projection image, wherein the first and second edges are physically correlated as a common edge in the omnidirectional image but not physically connected in the projection image; and

computing a set of filtered pixels based on a first set of pixels near the first edge and a second set of pixels near the second edge,

wherein the omnidirectional image is a platonic solid having a plurality of faces and the projection image comprises a layout of the faces of the platonic solid, and

wherein the first edge is an edge of a first face of the platonic solid, the second edge is an edge of a second face of the platonic solid, the first set of pixels is in the first face of the platonic solid, and the second set of pixels is in the second face of the platonic solid.

10. The electronic apparatus of claim 9 , wherein said filtering is deblock filtering that reduces discontinuity and compression artifacts across the common edge.

11. The electronic apparatus of claim 9 further comprising a rearranging circuit capable of rearranging pixels of the second face of the platonic solid according to a geographical relationship between the first face and the second face, the geographical relationship defined by the layout of the faces of the platonic solid in the projection image.

12. The electronic apparatus of claim 11 , wherein rearranging pixels of the second face comprises rotating or flipping pixels of the second face based on the geographical relationship between the first face and the second face.

13. The electronic apparatus of claim 11 , wherein said rearranged pixels of the second face are stored at a blank area of the projection image adjacent to the first edge.

14. The electronic apparatus of claim 11 , wherein said rearranged pixels of the second face are stored at a temporary buffer that does not store pixels from a blank area of the projection image.

15. The electronic apparatus of claim 11 , wherein the filtering circuit computes a set of filtered values for the first and second sets of pixels based on the pixels of the first face and the rearranged pixels of the second face.

16. The electronic apparatus of claim 9 , wherein the omnidirectional image is a sphere and the projection image comprises an equirectangular projection of the sphere.

17. The electronic apparatus of claim 15 , wherein both the first edge and the second edge extend from the north pole to the south pole of the sphere.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2023
From: MAYSIDE LICENSING LLC
To: COMMUNICATION ADVANCES LLC
Reel/Frame 064869/0020 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2023
From: MEDIATEK INC.
To: MAYSIDE LICENSING LLC
Reel/Frame 064840/0811 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2017
From: XU, XIAOZHONG; LIU, SHAN
To: MEDIATEK INC.
Reel/Frame 042986/0734 →
Cited By (2)
US 12,375,693 US 12,439,063