IP Library Granted Patent US 12,374,013
Granted Patent B2
US 12,374,013 · App. 17/735,907 · Granted Jul 29, 2025

Distribution of sign language enhanced content

Inventor: Mark Arana (Agoura Hills, CA)
Assignee: Disney Enterprises, Inc.
G06T13/00G06F3/1423G06F40/20G06F40/58G06T11/00G06V20/40G06V20/41G09B21/009G10L15/22G10L21/055G10L25/57G10L25/63H04N21/242H04N21/488
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,374,013
App. No.
17/735,907
Granted
Jul 29, 2025
Kind
B2
Abstract

A system for distributing sign language enhanced content includes a computing platform having processing hardware and a system memory storing a software code. The processing hardware is configured to execute the software code to receive content including at least one of a sequence of audio frames or a sequence of video frames, perform an analysis of the content, and identify, based on the analysis, a message conveyed by the content. The processing hardware is further configured to execute the software code to generate a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message conveyed by the content.

Claims (35)

1. A system comprising:

a computing platform including a processing hardware and a system memory storing a software code;

the processing hardware configured to execute the software code to:

receive content including at least one of a sequence of audio frames or a sequence of video frames;

perform an analysis of the content;

identify, based on the analysis, a message conveyed by the content;

generate a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message;

broadcast or stream the sign language translation, over a first communication channel, to a remote client system for rendering on a first display of the remote client system; and

concurrently with broadcasting or streaming the sign language translation, broadcast or stream the content, over a second communication channel separate from the first communication channel, to the remote client system for rendering on a second display of the remote client system.

2. The system of claim 1 , wherein the content is rendered on the second display, concurrently with rendering a performance of the sign language translation on the first display.

3. The system of claim 1 , wherein a performance of the sign language translation is rendered using a digital character.

4. The system of claim 1 , wherein a performance of the sign language translation is rendered on the first display such that the sign language translation is visible to at least one, but not all of a plurality of users concurrently viewing the content on the first display.

5. The system of claim 1 , wherein the remote client system comprises an augmented reality (AR) viewer.

6. The system of claim 1 , wherein the content comprises digital representations that populate a virtual reality, augmented reality, or mixed reality environment.

7. The system of claim 1 , wherein the processing hardware is further configured to execute the software code to:

synchronize the sign language translation to one of a timecode of the content, the sequence of audio frames, or the sequence of video frames.

8. The system of claim 1 , wherein the processing hardware is further configured to execute the software code to:

generate the sign language translation dynamically during the broadcasting or the streaming of the content.

9. A method comprising:

receiving content including at least one of a sequence of audio frames or a sequence of video frames;

performing an analysis of the content;

identifying, based on the analysis, a message conveyed by the content;

generating a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message;

broadcasting or streaming the sign language translation, over a first communication channel, to a remote client system for rendering on a first display of the remote client system; and

concurrently with broadcasting or streaming the sign language translation, broadcasting or streaming the content, over a second communication channel separate from the first communication channel, to the remote client system for rendering on a second display of the remote client system.

10. The method of claim 9 , further comprising:

rendering, concurrently with rendering the content on the second display, a performance of the sign language translation on the first display.

11. The method of claim 9 , wherein a performance of the sign language translation is rendered using a digital character.

12. The method of claim 9 , wherein the sign language translation is rendered on the first display such that the sign language translation is visible to at least one, but not all of a plurality of users concurrently viewing the content on the first display.

13. The method of claim 9 , wherein the remote client system comprises an augmented reality (AR) viewer.

14. The method of claim 9 , further comprising:

before rendering a performance of the sign language translation on the first display, synchronizing the sign language translation to one of a timecode of the content, the sequence of audio frames, or the sequence of video frames.

15. The method of claim 9 , wherein the content comprises digital representations that populate a virtual reality, augmented reality, or mixed reality environment.

16. The method of claim 9 , further comprising:

generating the sign language translation dynamically during the broadcasting or the streaming of the content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: ARANA, MARK
To: DISNEY ENTERPRISES, INC.
Reel/Frame 059802/0329 →
Continuity (2)
Provisional Application 63184692 · May 5, 2021
Related Publication 20220358854A1 · Nov 10, 2022
References Cited (66)
US 6327272B1 · Van Steenbrugge · 2001 [cited by applicant]
US 6483532B1 · Girod · 2002 [cited by applicant]
US 6545685B1 · Dorbie · 2003 [cited by applicant]
US 7827547B1 · Sutherland et al. · 2010 [cited by applicant]
US 7827574B1 · Hendricks et al. · 2010 [cited by applicant]
US 8566075B1 · Bruner · 2013 [cited by applicant]
US 9215514B1 · Kline · 2015 [cited by applicant]
US 10375237B1 · Williams et al. · 2019 [cited by applicant]
US 10514766B2 · Gates et al. · 2019 [cited by applicant]
US 10735213B2 · Nakahara · 2020 [cited by examiner]
US 20020104083A1 · Hendricks et al. · 2002 [cited by applicant]
US 20050097593A1 · Raley et al. · 2005 [cited by applicant]
US 20060018254A1 · Sanders · 2006 [cited by applicant]
US 20090141793A1 · Gramelspacher et al. · 2009 [cited by applicant]
US 20090262238A1 · Hope et al. · 2009 [cited by applicant]
US 20100254408A1 · Kuno · 2010 [cited by applicant]
US 20110096232A1 · Dewa et al. · 2011 [cited by applicant]
US 20110157472A1 · Keskinen · 2011 [cited by applicant]
US 20110162021A1 · Lee · 2011 [cited by applicant]
US 20130141551A1 · Kim · 2013 [cited by applicant]
US 20140046661A1 · Bruner · 2014 [cited by applicant]
US 20140242955A1 · Kang · 2014 [cited by examiner]
US 20150163545A1 · Freed et al. · 2015 [cited by applicant]
US 20150317307A1 · Mahkovec et al. · 2015 [cited by applicant]
US 20150350139A1 · Speer et al. · 2015 [cited by applicant]
US 20160098850A1 · Shintani et al. · 2016 [cited by applicant]
US 20160191958A1 · Nauseef et al. · 2016 [cited by applicant]
US 20160198214A1 · Levy · 2016 [cited by examiner]
US 20160294714A1 · Persson et al. · 2016 [cited by applicant]
US 20170006248A1 · An et al. · 2017 [cited by applicant]
US 20170111670A1 · Ducloux et al. · 2017 [cited by applicant]
US 20170132828A1 · Zelenin et al. · 2017 [cited by applicant]
US 20180063325A1 · Wilcox et al. · 2018 [cited by applicant]
US 20180075659A1 · Browy et al. · 2018 [cited by applicant]
US 20190052473A1 · Soni et al. · 2019 [cited by applicant]
US 20190096407A1 · Lambourne · 2019 [cited by examiner]
US 20190213401A1 · Kuang · 2019 [cited by applicant]
US 20190251344A1 · Menefee · 2019 [cited by applicant]
US 20200294525A1 · Santos et al. · 2020 [cited by applicant]
US 20210241309A1 · Wolf, Jr. · 2021 [cited by applicant]
US 20210352380A1 · Duncan et al. · 2021 [cited by applicant]
US 20220141547A1 · Plunkett, Jr. · 2022 [cited by applicant]
US 20220171960A1 · Nelson et al. · 2022 [cited by applicant]
US 20220327309A1 · Carlock et al. · 2022 [cited by applicant]
US 20220335971A1 · Gruszka · 2022 [cited by examiner]
US 20220343576A1 · Marey et al. · 2022 [cited by applicant]
WO 2018052901 · 2018 [cited by applicant]
WO 2019157344 · 2019 [cited by applicant]
Tiago Maritan U. de Araujo, Felipe L.S. Ferreira, Danilo A.N.S. Silva, Leonardo D. Oliveira, Eduardo L. Falcao, Leonardo A. Domingues, Vandhuy F. Martins, Igor A.C. Portela, Yurika S. Nobrega, Hozana R.G. Lima, Guido L.… [cited by applicant]
International Search Report and Written opinion dated Jul. 13, 2022 for International Application PCT/US2022/027716. [cited by applicant]
International Search Report and Written opinion dated Jul. 15, 2022 for International Application PCT/US2022/027717. [cited by applicant]
International Search Report and Written opinion dated Jul. 15, 2022 for International Application PCT/US2022/027719. [cited by applicant]
International Search Report and Written opinion dated Aug. 9, 2022 for International Application PCT/US2022/027713. [cited by applicant]
“Guidelines for Positioning of Sign Language Interpreters in Conferences, Including Web-Streaming: Proper spatial organization enhances communication when SLI is used in meetings. These simple steps will help you realiz… [cited by applicant]
“Guidelines for positioning of sign language interpreters in conferences, including web-streaming” Sign Language Network. Dec. 21, 2016. pp. 1-6. [cited by applicant]
“Sign Language, Video Encoding for Digital Cinema” ISDCF Document 13. Jul. 18, 2018 pp. 1-6. [cited by applicant]
International Search Report and Written Opinion for International Application PCT/US2022/027717 dated Jul. 15, 2022. [cited by applicant]
International Search Report & Written Opinion for International Application PCT/US2022/025123, dated Jul. 4, 2022. [cited by applicant]
File History of U.S. Appl. No. 17/735,926, filed May 3, 2022. [cited by applicant]
ISDCF Doc4-16-Channel Audio Packaging Guide obtained from https://files.isdcf.com/papers/ISDCF-Doc4-Audio-channel-recommendations.pdf (2017). [cited by applicant]
File History of U.S. Appl. No. 17/735,920, filed May 3, 2022. [cited by applicant]
File History of U.S. Appl. No. 17/735,935, filed May 3, 2022. [cited by applicant]
File History of U.S. Appl. No. 17/506,054, filed Oct. 20, 2021. [cited by applicant]
Published Dec. 21, 2016. Last updated: Dec. 12, 2016. 6 pgs. [cited by applicant]
ISDCF: “Sign Language Video Encoding for Digital Cinema” Jul. 18, 2018 pp. 1-6. [cited by applicant]
Daniel Jones “Demystifying Audio Watermarking, Fingerprinting and Modulation.” Published Jan. 19, 2017. 10 pgs. [cited by applicant]