IP Library Granted Patent US 11,665,381
Granted Patent B2
US 11,665,381 · App. 17/109,197 · Granted May 30, 2023

Content modification based on element contextualization

Inventors: Jorge Andres Moros Ortiz (Melbourne, AU); Sree Harish Maathu (Coonoor, IN); Suman Sedai (Hughesdale, AU); Turgay Tyler Kay (Broadmeadows, AU)
Assignee: KYNDRYL, INC.
H04N21/23439H04N21/233H04N21/23418H04N21/25891
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,665,381
App. No.
17/109,197
Granted
May 30, 2023
Kind
B2
Abstract

Content of entertainment media that is being consumed by a user is analyzed. An element of the content that is of a first character is identified. A preference associated with the user to consume entertainment media that contains elements of a second character is identified. An updated version of the element is generated. The updated version of the element is of the second character, such that the media is consumed by the user with the element in the updated version.

Claims (70)

1. A computer-implemented method comprising:

analyzing content of a video feed of entertainment media being consumed by a user;

identifying an element of the content that is of a first character in a plurality of frames of the video feed of the entertainment media;

identifying a preference associated with the user to consume entertainment media that contains elements of a second character, wherein the first character and the second character are different stylistic choices within the entertainment media;

predicting, based on a plurality of video feeds from a plurality of entertainment media and a machine learning model, where the element of the content that is of the first character will be in a plurality of locations in a plurality of upcoming frames of the entertainment media; and

generating, using the prediction, an updated version of the element at the plurality of locations, wherein the updated version of the element is of the second character such that the media is consumed by the user with the updated version of the element.

2. The computer-implemented method of claim 1 , wherein the first character relates to relatively more graphic content and the second character relates to relatively less graphic content, and the first character and the second character are identified from a corpus of analyzed entertainment media.

3. The computer-implemented method of claim 1 , wherein:

the element of the content that is of a first character is an original version of the entertainment media;

the first character relates to a first stylistic choice of being relatively less graphic content, and

the second character relates to a second stylistic choice of being relatively more graphic content, such that generating the updated version of the element modifies the original version of the entertainment media to be relatively more graphic.

4. The computer-implemented method of claim 1 , wherein generating the updated version of the element includes:

analyzing the entertainment media to learn how to visually identify and isolate the element for independent and individual modification; and

modifying how the element is visually provided to the user in real time by swapping out initial elements of a first character with updated versions of the initial elements that are of a second character in a manner that is functionally undetectable by the user.

5. The computer-implemented method of claim 4 , further comprising graphically tracking the element of the first character as the element of the first character moves within the content,

wherein modifying how the element is visually provided includes graphically generating the updated version of the element over the element of the first character as the element of the first character moves within the content.

6. The computer-implemented method of claim 1 , wherein generating the updated version of the element includes:

analyzing the entertainment media to learn how to audibly identify and isolate one or more sounds of the element for independent and individual modification; and

modifying how the element is audibly provided to the user in real time.

7. The computer-implemented method of claim 6 , further comprising audibly isolating one or more sounds associated with the element of the first character,

wherein modifying how the element is audibly provided includes dubbing updated sounds of the element in the second character over the one or more sounds.

8. The computer-implemented method of claim 1 , further comprising:

analyzing a corpus of entertainment media that includes a first plurality of elements of the first character and a second plurality of elements of the second character;

identifying a first set of rules that govern how the first plurality of elements move and sound, and

identifying a second set of rules that govern relationships between the second plurality of elements and the second character,

wherein generating the updated version of the element includes using the first set of rules to remove traces of the element in the first character and using the second set of rules to provide the updated version of the element in the second character.

9. The computer-implemented method of claim 1 , wherein identifying the element of the content that is of the first character includes identifying metadata of the entertainment media of that is of the first character.

10. The computer-implemented method of claim 1 , wherein identifying the element of the content that is of the first character includes crawling across publicly available data repositories to identify that the element is of the first character.

11. A system comprising:

a processor; and

a memory in communication with the processor, the memory containing instructions that, when executed by the processor, cause the processor to:

analyze content of a video feed of entertainment media being consumed by a user;

identify an element of the content that is of a first character in a plurality of frames of the video feed of the entertainment media;

identify a preference associated with the user to consume entertainment media that contains elements of a second character, wherein the first character and the second character are different stylistic choices within the entertainment media;

predict, based on a plurality of video feeds from a plurality of entertainment media and a machine learning model, where the element of the content that is of the first character will be in a plurality of locations in a plurality of upcoming frames of the entertainment media; and

generate, using the prediction, an updated version of the element at the plurality of locations, wherein the updated version of the element is of the second character such that the media is consumed by the user with the updated version of the element.

12. The system of claim 11 , the memory containing additional instructions that, when executed by the processor, cause the processor to:

graphically track the element of the first character as the element of the first character moves within the content,

wherein generating the updated version of the element includes modifying how the element is visually provided to the user in real time, and

wherein modifying how the element is visually provided includes graphically generating the updated version of the element over the element of the first character as the element of the first character moves within the content in a manner that is functionally undetectable by the user.

13. The system of claim 11 , the memory containing additional instructions that, when executed by the processor, cause the processor to:

audibly isolate one or more sounds associated with the element of the first character,

wherein generating the updated version of the element includes modifying how the element is audibly provided to the user in real time, and

wherein modifying how the element is audibly provided includes dubbing updated sounds of the element in the second character over the one or more sounds in a manner that is functionally undetectable by the user.

14. The system of claim 11 , wherein the first character relates to relatively more graphic content and the second character relates to relatively less graphic content, and the first character and the second character are identified from a corpus of analyzed entertainment media.

15. The system of claim 11 , the memory containing additional instructions that, when executed by the processor, cause the processor to:

analyze a corpus of entertainment media that includes a first plurality of elements of the first character and a second plurality of elements of the second character;

identify a first set of rules that govern how the first plurality of elements move and sound; and

identify a second set of rules that govern relationships between the second plurality of elements and the second character,

wherein generating the updated version of the element includes using the first set of rules to remove traces of the element in the first character and using the second set of rules to provide the updated version of the element in the second character.

16. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:

analyze content of a video feed of entertainment media being consumed by a user;

identify an element of the content that is of a first character in a plurality of frames of the video feed of the entertainment media;

identify a preference associated with the user to consume entertainment media that contains elements of a second character, wherein the first character and the second character are different stylistic choices within the entertainment media;

predict, based on a plurality of video feeds from a plurality of entertainment media and a machine learning model, where the element of the content that is of the first character will be in a plurality of locations in a plurality of upcoming frames of the video feed of the entertainment media; and

generate, using the prediction, an updated version of the element at the plurality of locations, wherein the updated version of the element is of the second character such that the media is consumed by the user with the updated version of the element.

17. The computer program product of claim 16 , the computer readable storage medium having additional program instructions embodied therewith that are executable by the computer to cause the computer to:

graphically track the element of the first character as the element of the first character moves within the content,

wherein generating the updated version of the element includes modifying how the element is visually provided to the user in real time, and

wherein modifying how the element is visually provided includes graphically generating the updated version of the element over the element of the first character as the element of the first character moves within the content in a manner that is functionally undetectable by the user.

18. The computer program product of claim 16 , the computer readable storage medium having additional program instructions embodied therewith that are executable by the computer to cause the computer to:

audibly isolate one or more sounds associated with the element of the first character,

wherein generating the updated version of the element includes modifying how the element is audibly provided to the user in real time, and

wherein modifying how the element is audibly provided includes dubbing updated sounds of the element in the second character over the one or more sounds.

19. The computer program product of claim 16 , wherein the first character relates to relatively more graphic content and the second character relates to relatively less graphic content and the first character and the second character are identified from a corpus of analyzed entertainment media.

20. The computer program product of claim 16 , the computer readable storage medium having additional program instructions embodied therewith that are executable by the computer to cause the computer to:

analyze a corpus of entertainment media that includes a first plurality of elements of the first character and a second plurality of elements of the second character;

identify a first set of rules that govern how the first plurality of elements move and sound; and

identify a second set of rules that govern relationships between the second plurality of elements and the second character,

wherein generating the updated version of the element includes using the first set of rules to remove traces of the element in the first character and using the second set of rules to provide the updated version of the element in the second character.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 058213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2020
From: MOROS ORTIZ, JORGE ANDRES; MAATHU, SREE HARISH; SEDAI, SUMAN; KAY, TURGAY TYLER
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 054511/0500 →
Continuity (1)
Related Publication 20220174339A1 · Jun 2, 2022