IP Library Granted Patent US 8,750,385
Granted Patent B2
US 8,750,385 · App. 12/448,291 · Granted Jun 10, 2014

Video data loss recovery using low bit rate stream in an IPTV system

Inventors: Jiwang Dai (Princeton Junction, NJ); John Qiang Li (Montgomery, NJ); Alan Jay Stein (Princeton Junction, NJ)
Assignee: Thomson Research Funding
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,750,385
App. No.
12/448,291
Granted
Jun 10, 2014
Kind
B2
Abstract

A system and method for recovering from data loss are described including monitoring a first bit rate video data bit stream to determine if there is frame loss or damage, multiplexing decoding parameters of a second bit rate video data bit stream, the second bit rate video data bit stream and the first bit rate video data bit stream, if there is frame loss or damage, demultiplexing the first bit rate video data bit stream and the second bit rate video data bit stream, decoding the first bit rate video data bit stream, removing damaged frames from the first bit rate video data bit stream, decoding the second bit rate video data bit stream, up-sampling frames from said processed second bit rate video data bit stream if said processed second bit rate video data bit stream has a lower resolution than said processed first bit rate video data bit stream and merging frames from the second bit rate video data bit stream and the first bit rate video data bit stream.

Claims (61)

1. A method for recovering from data loss in a multicast internet protocol television system, said method comprising:

monitoring a first bit rate video data bit stream to determine if there is one of frame loss and damage by a proxy server;

multiplexing decoding parameters of a second bit rate video data bit stream, said second bit rate video data bit stream and said first bit rate video data bit stream, if there is one of frame loss and damage, wherein said second bit rate video data bit stream has a lower bit rate than said first bit rate video data bit stream by said proxy server;

demultiplexing said first bit rate video data bit stream, said second bit rate video data bit stream and said decoding parameters of said second bit rate video data bit stream by a receiving set top box;

decoding said first bit rate video data bit stream to generate a processed first bit rate video data bit stream by said receiving set top box;

removing damaged frames from said processed first bit rate video data bit stream by said receiving set top box;

decoding said second bit rate video data bit stream using said received decoding parameters to generate a processed second bit rate video data stream, wherein said processed second bit rate video data bit stream has a lower bit rate than said processed first bit rate video data bit stream, by said receiving set top box;

up-sampling decoded frames from said processed second bit rate video data bit stream if said processed second bit rate video data bit stream has a lower resolution than said processed first bit rate video data bit stream by said receiving set top box; and

merging the decoded and up-sampled frames from said processed second bit rate video data bit stream and said processed first bit rate video data bit stream by said receiving set top box to one of replace and repair one of said lost and damaged frames of said first bit rate video data bit stream.

2. The method according to claim 1 , wherein said first bit rate video data bit stream and said second bit rate video data bit stream are simulcast to said proxy server.

3. The method according to claim 1 , wherein said first bit rate video data bit stream and said second bit rate video data bit stream are staggercast to said proxy server.

4. The method according to claim 1 , further comprising:

transmitting said first bit rate video data bit stream to a first multicast group; and

transmitting said second bit rate video data bit stream to a second multicast group.

5. The method according to claim 1 , wherein said second bit rate video data bit stream is used to accomplish a fast channel change.

6. The method according to claim 1 , wherein said second bit rate video data bit stream is used for picture-in-picture.

7. The method according to claim 1 , wherein said second bit rate video data bit stream is used for mosaic view.

8. The method according to claim 1 , further comprising:

determining a beginning of a video deterioration event; and

determining an end of said video deterioration event.

9. The method according to claim 8 , further comprising:

searching backwards in a memory storage element and forward in an incoming second bit rate video data bit stream to locate a first I frame before said beginning of said video deterioration event; and

searching in one of said memory storage element and said incoming second bit rate video data bit stream for a first I frame after said end of said video deterioration event.

10. The method according to claim 9 , wherein said multiplexing act selectively multiplexes a group of pictures of said second bit rate video data bit stream corresponding to one of said lost and damaged frames of said first bit rate video data bit stream.

11. The method according to claim 10 , wherein a resolution of said group of pictures of said second bit rate video data bit stream is one of equal to and less than a resolution of said group of pictures of said first bit rate video data bit stream.

12. A method for recovering from data loss at a receiver in a multicast internet protocol television system, said method comprising:

receiving a multiplexed video data bit stream in a multicast group, said multiplexed video data bit stream including a first bit rate video data bit stream, a second bit rate video data bit stream and decoding parameters of said second bit rate video data bit stream;

de-multiplexing said received video data bit stream into a first bit rate video data bit stream and a second bit rate video data bit stream, said second bit rate video data bit stream comprising frames corresponding to one of lost and damaged frames of said first bit rate video data bit stream, wherein said second bit rate video data bit stream has a lower bit rate than said first bit rate video data bit stream;

decoding frames from said second bit rate video data bit stream using said received decoding parameters of said second bit rate video data bit stream to one of replace and repair one of said lost and damaged frames of said first bit rate video data bit stream;

up-sampling the decoded frames from said processed second bit rate video data bit stream to one of replace and repair one of said lost and damaged frames of said first bit rate video data bit stream if said processed second bit rate video data bit stream has a lower resolution than said processed first bit rate video data bit stream by said receiving set top box; and

merging the decoded and up-sampled frames from said processed second bit rate video data bit stream and said processed first bit rate video data bit stream by said receiving set top box to recover one of lost and damaged data in said processed first bit rate video data bit stream.

13. A system for recovering from data loss in a multicast internet protocol television system, comprising:

a proxy server for monitoring a first bit rate video data bit stream to determine if there is one of frame loss and damage;

said proxy server multiplexing decoding parameters of a second bit rate video data bit stream, said second bit rate video data bit stream and said first bit rate video data bit stream, if there is one of frame loss and damage, wherein said second bit rate video data bit stream has a lower bit rate than said first bit rate video data bit stream;

a receiving set top box for demultiplexing said first bit rate video data bit stream and said second bit rate video data bit stream;

said receiving set top box decoding said first bit rate video data bit stream to generate a processed first bit rate video data stream;

said receiving set top box removing damaged frames from said processed first bit rate video data stream;

said receiving set top box up-sampling frames from said processed second bit rate video data bit stream if said processed second bit rate video data bit stream has a lower resolution than said processed first bit rate video data bit stream; and

said receiving set top box merging frames from said processed second bit rate video data stream and said processed first bit rate video data stream to one of replace and repair the removed damaged frames of said first bit rate video data bit stream.

14. The system according to claim 13 , wherein said first bit rate video data bit stream and said second bit rate video data bit stream are simulcast to said proxy server.

15. The system according to claim 13 , wherein said first bit rate video data bit stream and said second bit rate video data bit stream are staggercast to said proxy server.

16. The system according to claim 13 , further comprising:

a multicast switch for transmitting said first bit rate video data bit stream to a first multicast group; and

said multicast switch transmitting said second bit rate video data bit stream to a second multicast group.

17. The system according to claim 13 , wherein said second bit rate video data bit stream is used to accomplish a fast channel change.

18. The system according to claim 13 , wherein said second bit rate video data bit stream is used for picture-in-picture.

19. The system according to claim 13 , wherein said second bit rate video data bit stream is used for mosaic view.

20. The system according to claim 13 , further comprising:

said proxy server determining a beginning of a video deterioration event; and

said proxy server determining an end of said video deterioration event.

21. The system according to claim 20 , further comprising:

said proxy server searching backwards in a memory storage element and forward in an incoming second bit rate video data bit stream to locate a first I frame before said beginning of said video deterioration event; and

said proxy server searching in one of said memory storage element and said incoming second bit rate video data bit stream for a first I frame after said end of said video deterioration event.

22. The system according to claim 21 , wherein said proxy server selectively multiplexes a group of pictures of said second bit rate video data bit stream corresponding to one of said lost and damaged frames of said first bit rate video data bit stream.

23. The system according to claim 22 , wherein a resolution of said group of pictures of said second bit rate video data bit stream is one of less than and equal to a resolution of said group of pictures of said first bit rate video data bit stream.

24. An apparatus for recovering from data loss at a receiver in a multicast internet protocol television system, comprising:

said receiver receiving a multiplexed video data bit stream in a multicast group, said multiplexed video data bit stream including a first bit rate video data bit stream, a second bit rate video data bit stream and decoding parameters of said second bit rate video data bit stream;

said receiver de-multiplexing said received video data bit stream into a first bit rate video data bit stream and a second bit rate video data bit stream, said second bit rate video data bit stream comprising frames corresponding to lost or damaged frames of said first bit rate video data bit stream, wherein said second bit rate video data bit stream has a lower bit rate than said first bit rate video data bit stream;

said receiver decoding frames from said second bit rate video data bit stream using said received decoding parameters of said second bit rate video data bit stream to replace one of said lost and damaged frames of said first bit rate video data bit stream;

up-sampling the decoded frames from said processed second bit rate video data bit stream to one of replace and repair one of said lost and damaged frames of said first bit rate video data bit stream if said processed second bit rate video data bit stream has a lower resolution than said processed first bit rate video data bit stream by said receiving set top box; and

merging the decoded and up-sampled frames from said processed second bit rate video data bit stream and said processed first bit rate video data bit stream by said receiving set top box to recover one of lost and damaged data in said processed first bit rate video data bit stream.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2019
From: THOMSON RESEARCH FUNDING
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 049830/0889 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2009
From: DAI, JIWANG; LI, JOHN QIANG; STEIN, ALAN JAY
To: THOMSON RESEARCH FUNDING
Reel/Frame 022847/0890 →
Continuity (1)
Related Publication 20100046634A1 · Feb 25, 2010