IP Library Granted Patent US 12,593,097
Granted Patent B2
US 12,593,097 · App. 18/016,598 · Granted Mar 31, 2026

Method for decoding a data stream, associated device and associated data stream

Inventors: Félix Henry (Saint-Grégoire, FR); Gordon Clare (Pacé, FR)
Assignee: ORANGE
H04N21/435H04N21/44209
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,593,097
App. No.
18/016,598
Granted
Mar 31, 2026
Kind
B2
Abstract

A data stream includes an indicator (IND) and data (Fnn) representative of a video or audio content. A method for decoding this data stream includes: decoding (E 60 ) the indicator (IND) to determine whether an artificial neural network to be used to decode the representative data (Fnn) is encoded into the data stream or forms part of a predetermined set of artificial neural networks, and decoding (D 70 ) the representative data (Fnn) by the artificial neural network. If it is determined, by decoding the indicator (Fnn) that the artificial neural network forms part of the aforementioned predetermined set, the method includes decoding (E 62 ) an identifier (Inn) of the neural network. Associated decoding devices and associated data streams are also described.

Claims (31)

1 . A method for decoding a data stream including an indicator and representative data that is representative of an audio or video content, the method being implemented by a decoding device, the method comprising:

selectively decoding the indicator having one of a first value and a second value different from the first value, the first value indicating that an artificial neural network to be used to decode said representative data is encoded in the data stream, the second value indicating that the artificial neural network to be used to decode the representative data belongs to a predetermined set of artificial neural networks accessible by the decoding device; and

decoding said representative data by the artificial neural network.

2 . The decoding method according to claim 1 , wherein said audio or video content is a first part of a video sequence, said video sequence comprising said first part and a second part,

wherein the decoding said representative data produces said first part, and

wherein the method further comprises decoding other data by another artificial neural network to produce the second part.

3 . The decoding method according to claim 2 , wherein the other artificial neural network has an identical structure to a structure of said artificial neural network.

4 . The decoding method according to claim 3 , wherein the first part and the second part respectively form two groups of images for a format of representation of the content used.

5 . The decoding method according to claim 2 , wherein the first part and the second part respectively form two groups of images for a format of representation of the content used.

6 . The decoding method according to claim 2 , further comprising transmitting a list of artificial neural networks to a controller configured to control data stream transmission.

7 . The decoding method according to claim 1 , further comprising transmitting a list of artificial neural networks to a controller configured to control data stream transmission.

8 . The decoding method according to claim 1 , further comprising, decoding an identifier of the artificial neural network, when it is determined, by decoding the indicator, that the artificial neural network belongs to the predetermined set of artificial neural networks.

9 . The decoding method according to claim 8 , further comprising reading, in a storage, parameters of the artificial neural network identified by the decoded identifier.

10 . The decoding method according to claim 9 , wherein the storage stores a first set of parameters representative of a first artificial neural network forming a random access decoder and a second set of parameters representative of a second artificial neural network forming a low latency decoder.

11 . The decoding method according to claim 8 , further comprising generating an error message in an absence of data related to the artificial neural network identified by the decoded identifier.

12 . The decoding method according to claim 8 , further comprising receiving, from a remote server, parameters of the artificial neural network identified by the decoded identifier.

13 . The decoding method according to claim 1 , further comprising, decoding data encoding the artificial neural network that are included in the data stream in order to obtain parameters of the artificial neural network, when it is determined by decoding the indicator that the artificial neural network is encoded in the data stream.

14 . The decoding method according to claim 1 , wherein the decoding device stores parameters defining the artificial neural networks of the predetermined set of artificial neural networks.

15 . The decoding method according to claim 1 , wherein the decoding device has access to parameters defining the artificial neural networks of the predetermined set of artificial neural networks by connection to remote electronic equipment.

16 . The decoding method according to claim 1 , wherein the indicator allows the decoding device to know the method by which the decoding device will be able to have access to the artificial neural network to be used to decode the representative data.

17 . A decoding device comprising:

a receiver configured to receive a data stream comprising an indicator and representative data that is representative of an audio or video content, the indicator having one of a first value and a second value different from the first value; and

one or more processors configured to decode the indicator, decode the representative data using an artificial neural network encoded in the data stream when the indicator has the first value, and decode the representative data using an artificial neural network belonging to a predetermined set of artificial neural networks accessible by the decoding device when the indicator has the second value.

18 . A method for decoding a data stream including an indicator and representative data that is representative of an audio or video content, the method being implemented by a decoding device and comprising:

decoding the indicator, which has one of a first value and a second value different from the first value, the first value indicating that an artificial neural network to be used to decode said representative data is encoded in the data stream, the second value indicating that the artificial neural network to be used to decode the representative data belongs to a predetermined set of artificial neural networks accessible by the decoding device;

selecting among a first decoding process and a second decoding process based on the decoded indicator,

the second decoding process comprising decoding an identifier of the artificial neural network in order to obtain parameters of the artificial neural network and decoding the representative data using the artificial neural network configured with the parameters obtained according to the second decoding process; and

the first decoding process comprising decoding data encoding the artificial neural network that are included in the data stream in order to obtain parameters of the artificial neural network and decoding the representative data using the artificial neural network configured with the parameters obtained according to the first decoding process; and

based on the selecting,

executing the second decoding process when the decoded indicator has the second value,

else executing the first decoding process when the decoded indicator has the first value.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2024
From: FONDATION B-COM
To: ORANGE
Reel/Frame 069452/0506 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2023
From: HENRY, FÉLIX; CLARE, GORDON
To: FONDATION B-COM
Reel/Frame 065134/0681 →
Priority Claims (1)
FR 2007529 · Jul 17, 2020 · national
Continuity (1)
Related Publication 20230283836A1 · Sep 7, 2023
References Cited (22)
US 20130272385A1 · Yu et al. · 2013 [cited by applicant]
US 20180249158A1 · Huang · 2018 [cited by examiner]
US 20190075301A1 · Chou · 2019 [cited by examiner]
US 20190273948A1 · Yin · 2019 [cited by examiner]
US 20200014603A1 · Kuo et al. · 2020 [cited by applicant]
US 20200304804A1 · Habibian · 2020 [cited by examiner]
US 20230164336A1 · Cricri · 2023 [cited by examiner]
JP 2020010331A · 2020 [cited by applicant]
WO 2017036370 · 2017 [cited by applicant]
WO 2019045883 · 2019 [cited by applicant]
WO 2019205871 · 2019 [cited by applicant]
International Search Report for PCT/EP2021/069519, dated Apr. 8, 2022, 10 pages (with English Translation). [cited by applicant]
Written Opinion of the ISA for PCT/EP2021/069519, dated Apr. 8, 2022, 10 pages. [cited by applicant]
Wiedemann et al., “Compact and computationally Efficient Representation of Deep Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, vol. 31, No. 3, Mar. 2020, pp. 772-785. [cited by applicant]
Wiedemann et al., “DeepCabac: Context-adaptive binary arithmetic coding for deep neural network compression” May 15, 2019, 4 pages. [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 12, 2012, pp. 1649-1668. [cited by applicant]
Osborne “Google's Tensor Processing Unit explained: this is what the future of computing looks like”, techrader.com, Aug. 22, 2016, 3 pages. [cited by applicant]
“Use cases and requirements for compressed representation of neural networks”, International Organization for Standardization Organisation International De Normalisation ISO/IEC JTC1/SC29/WG11 Coding of Moving Pictures … [cited by applicant]
Lu et al., “DVC: An End-to-end Deep Video Compression Framework”, https://github.com/GuoLusjtv/DVS, pp. 11006-11015. [cited by applicant]
English translation of the Written Opinion of the International Searching Authority dated Apr. 8, 2022 for corresponding International Application No. PCT/EP2021/069519, filed Jul. 13, 2021. [cited by applicant]
Japanese Notice of Reasons for Rejection dated Jul. 1, 2025 for corresponding Japanese Application No. 2023-502953. [cited by applicant]
Hujun Yin, et al., “AHG9: Adaptive convolutional neural network loop filter,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakesh, Jan. 2019, JVET-M0566, ITU-T, Jan.… [cited by applicant]