IP Library Granted Patent US 12,022,157
Granted Patent B2
US 12,022,157 · App. 17/466,613 · Granted Jun 25, 2024

System and method for audio visual content creation and publishing within a controlled environment

Inventor: Alex Petty (Mobile, AL)
Assignee: Global Tel*Link Corporation
H04N21/4627G06F40/295G06V20/41G10L15/26G11B27/036H04N5/76H04N9/802H04N9/8715H04N21/2143H04N21/233H04N21/23418H04N21/234336H04N21/2541H04N21/4532H04N21/47205H04N21/6543
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,022,157
App. No.
17/466,613
Granted
Jun 25, 2024
Kind
B2
Abstract

Methods and systems for providing content creation and content publishing in a controlled environment are disclosed herein. A media management device receives an audio track including lyrical content. Further, the media management device performs speech recognition analysis on the audio track to determine lyrical text corresponding to the lyrical content. Additionally, the media management device determines whether the audio track contains prohibited content based on comparing the lyrical text to a blacklist of prohibited information. When the audio track does not include prohibited content, the media management device publishes the audio track to a media library accessible to devices within the controlled environment.

Claims (81)

1. A media publishing device, comprising:

a transceiver configured to receive a work for publication;

a memory configured to store the received work; and

one or more processors comprising:

a composition analysis module configured to review the stored work for restricted lyrics;

a video analysis module configured to review the stored work for restricted images;

an audio analysis module configured to review the stored work for restricted audio including copyrighted audio, an audio analysis including comparing words and rhythmic composition of the stored work to a known rhythmic composition and identifying words and phrases within the stored work that rhyme with prohibited words and phrases within the known rhythmic composition; and

a content generation module configured to generate audio-visual media based on the reviews conducted by the video analysis module and the audio analysis module, and publish the audio-visual media to a catalog of inmate content, the publishing including transmitting the stored work to a publication server for electronic storage and retrieval,

wherein the video analysis module includes a trained first machine-learning model configured to carry out the review of the stored work for the restricted images, and

wherein the audio analysis module includes a second trained machine-learning model configured to carry out the review of the stored work for restricted audio.

2. The media publishing device of claim 1 , wherein the composition analysis module is further configured to convert lyrical content of the received work into lyrical text using a speech recognition analysis.

3. The media publishing device of claim 2 , wherein the composition analysis module is further configured to:

compare words included in the lyrical text to a database of restricted words; and

identify, based on the comparing, words in the lyrical text that are prohibited from publication.

4. The media publishing device of claim 1 , wherein the video analysis module is further configured to:

select a frame of video from the received work; and

identify a visual object included in the frame by performing an image recognition analysis.

5. The media publishing device of claim 4 , wherein the video analysis module is further configured to:

compare the identified visual objects to a list of prohibited objects; and

allow or filter the identified visual object based on the comparing.

6. The media publishing device of claim 1 , wherein the audio analysis module is further configured to:

identify a musical element within the received work, the musical element including a chord, a chord progression, a motif, a melody, or a harmony included within the received work; and

compare the musical element to a list of restricted musical elements.

7. The media publishing device of claim 6 , wherein the audio analysis module is further configured to:

determine whether the musical element is a prohibited musical element in response to the comparing; and

allowing or filtering the musical element based on the determining.

8. A media publishing method, comprising:

receiving a work for publication;

storing the received work in a memory;

performing a composition review of the received work, the composition review including reviewing the received work for restricted lyrics;

performing, by a trained first machine-learning model, a video analysis of the received work, the video analysis including reviewing the received work for restricted images;

performing, by a trained second machine-learning model, an audio analysis of the received work, the audio analysis including reviewing the received work for restricted audio including copyrighted audio, the audio analysis including comparing words and rhythmic composition of the received work to a known rhythmic composition and identifying words and phrases within the received work that rhyme with prohibited words and phrases within the known rhythmic composition;

generating audio-visual media based on the video analysis and the audio analysis; and

publishing the audio-visual media to a catalog of inmate content, the publishing including transmitting the stored work to a publication server that stores the catalog of inmate content for electronic storage and retrieval.

9. The media publishing method of claim 8 , further comprising:

editing the received work based on the composition review, the video analysis, and the audio analysis; and

publishing the edited work.

10. The media publishing method of claim 8 , wherein the composition review includes:

converting lyrical content of the received work into lyrical text using a speech recognition analysis;

comparing words included in the lyrical text to a database of restricted words; and

identifying, based on the comparing, words in the lyrical text that are prohibited from publication.

11. The media publishing method of claim 8 , wherein the video analysis includes:

selecting a frame of video from the received work; and

identifying a visual object included in the frame by performing image recognition analysis.

12. The media publishing method of claim 11 , wherein the video analysis further includes:

comparing the identified visual object to a list of prohibited objects; and

allowing or filtering the identified visual object based on the comparing.

13. The media publishing method of claim 8 , wherein the audio analysis includes:

identifying a musical element within the received work, the musical element including at least one of a chord, a chord progression, a motif, a melody, or a harmony; and

comparing the musical element to a list of restricted musical elements.

14. The media publishing method of claim 13 , wherein the audio analysis further includes:

determining whether the musical element is a prohibited musical element in response to the comparing; and

allowing or filtering the musical element based on the determining.

15. A media publishing system, comprising:

a transceiver configured to receive a work for publication;

a memory that sores the received work;

a restriction database that stores work restrictions; and

one or more processors configured to:

perform a composition review of the received work, the composition review including reviewing the received work for restricted lyrics;

perform, by a trained first machine-learning model, a video analysis of the received work, the video analysis including reviewing the received work for restricted images;

perform, by a trained second machine-learning model, an audio analysis of the received work, the audio analysis including reviewing the received work for restricted audio including copyrighted audio, the audio analysis including comparing words and rhythmic composition of the received work to a known rhythmic composition and identifying words and phrases within the received work that rhyme with prohibited words and phrases within the known rhythmic composition;

generate audio-visual media based on the video analysis and the audio analysis; and

publish the audio-visual media to a catalog of inmate content, the publishing including transmitting the stored work to a publication server that stores the catalog of inmate content for electronic storage and retrieval.

16. The media publishing system of claim 15 , wherein the one or more processors are further configured to:

edit the received work based on the composition review, the video analysis, and the audio analysis; and

publish the edited work.

17. The media publishing system of claim 16 , wherein the composition review includes:

converting lyrical content of the received work into lyrical text using a speech recognition analysis;

comparing words included in the lyrical text to words included in the restriction database; and

identify, based on the comparing, words in the lyrical text that are prohibited from publication.

18. The media publishing system of claim 17 , wherein the video analysis includes:

selecting a frame of video from the received work; and

identifying a visual object included in the frame by performing an image recognition analysis.

19. The media publishing system of claim 18 , wherein the video analysis further includes:

comparing the identified visual object to prohibited objects identified in the restriction database; and

allowing or filtering the identified visual object based on the comparing.

20. The media publishing system of claim 16 , wherein the audio analysis includes:

identifying a musical element within the received work, the musical element including at least one of a chord, a chord progression, a motif, a melody, or a harmony;

comparing the musical element to a list of restricted musical elements stored in the restriction database;

determining whether the musical element is a prohibited musical element in response to the comparing; and

allowing or filtering the musical element based on the determining.

Assignments (2)
PATENT SECURITY AGREEMENT Recorded Aug 7, 2024
From: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC; 3V TECHNOLOGIES INCORPORATED
To: TEXAS CAPITAL BANK, AS COLLATERAL AGENT
Reel/Frame 068510/0764 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2024
From: PETTY, ALEX
To: GLOBAL TEL*LINK CORPORATION
Reel/Frame 067323/0482 →
Continuity (4)
Continuation 16723632 · Dec 20, 2019
Continuation 16025721 · Jul 2, 2018
Continuation 15662092 · Jul 27, 2017
Related Publication 20220053239A1 · Feb 17, 2022
Cited By (1)
US 12,675,557