IP Library Granted Patent US 11,711,557
Granted Patent B2
US 11,711,557 · App. 17/134,829 · Granted Jul 25, 2023

Systems, methods, and devices supporting scene change-based smart search functionalities

Inventors: Yatish Jayant Naik Raikar (Bengaluru, IN); Soham Sahabhaumik (Bengaluru, IN); Rakesh Ramesh (Bengaluru, IN); Karthik Mahabaleshwar Hegde (Bengaluru, IN)
H04N21/2387G06V20/46H04N21/2393
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,711,557
App. No.
17/134,829
Granted
Jul 25, 2023
Kind
B2
Abstract

Systems, methods, and devices are disclosed enabling smart search functionalities utilizing key scene changes appearing in video content. In various embodiments, the method includes the step or process of, while engaged in playback of the video content, receiving a user command at a playback device to shift a current playback position of the video content to a default search playback position (PP DS ). In response to receipt of the user command, the playback device searches a time window encompassing the default search playback position (PP DS ) for a key scene change in the video content. If locating a key scene change within the time window, the playback device shifts playback of the video content to a playback position corresponding to the key scene change (PP ST ). Otherwise, the playback device shifts playback of the video content to the default search playback position (PP DS ).

Claims (65)

1. A method of playing video content utilizing a playback device, the method comprising:

receiving a user command at the playback device to shift a current playback position of the video content to a default search playback position (PP DS );

defining a temporal window extending before and after the default search playback position (PP DS ) of the user command,

wherein a start time of the temporal window is determined by subtracting a first duration from the default search playback position (PP DS ),

wherein an end time of the temporal window is determined by adding a second duration to the default search playback position (PP DS ), and

wherein the temporal window extending before and after the default search playback position (PP DS ) encompasses a segment of the video content;

searching the segment of the video content encompassed by the temporal window extending before and after the default search playback position (PP DS ) for a scene change; and

in response to locating the scene change in the segment of the video content encompassed by the temporal window, automatically shifting playback of the video content to a new playback position corresponding to a time position of the scene change (PP ST ) between the start time of the temporal window and the end time of the temporal window.

2. The method of claim 1 , further comprising, in response to the scene change near to the temporal window, shifting playback of the video content to the new playback position corresponding to the time position of the scene change (PP ST ) rather than the default search playback position (PP DS ).

3. The method of claim 2 , further comprising, in response to multiple scene changes being located within the temporal window, shifting playback of the video content to the new playback position corresponding to the scene change closest in time to the default search playback position (PP DS ).

4. The method of claim 3 , further comprising:

in response to receipt of the user command, searching a time window encompassing the default search playback position (PP DS ) for the scene change in the video content wherein the time window is a different window than the temporal window.

5. The method of claim 4 , further comprising:

in response to the default search playback position (PP DS ) occurring after the current playback position in the video content, assigning a first predetermined value to the first duration; and

in response to the default search playback position (PP DS ) occurs occurring prior to the current playback position in the video content, assigning a second predetermined value to the first duration.

6. The method of claim 5 , wherein the user command comprises instructions to implement a SEEK function having a trick mode speed; and

wherein the method further comprises determining the first duration and second duration based, at least in part, on the trick mode speed of the SEEK function.

7. The method of claim 3 , further comprising:

place-shifting the video content from the playback device, over a network, and to a second device coupled to a display device;

wherein the user command is entered at the second device and sent as a user command message transmitted from the second device, over the network, and to the playback device.

8. The method of claim 6 , further comprising:

extracting the start time (W S ) of the temporal window and the end time (W E ) of the temporal window from a user command message.

9. The method of claim 1 , further comprising:

parsing the video content to identify scene changes to generate scene change data prior to playback of the video content; and

subsequently utilizing the scene change data to determine whether the scene change is located within the temporal window.

10. The method of claim 9 , further comprising:

generating a slide bar graphic on a display device including a slide bar representative of a duration of the video content; and

further producing, on the display device, markers adjacent to the slide bar graphic denoting locations of scene changes indicated by the scene change data.

11. The method of claim 10 , further comprising:

generating thumbnails for the video content at junctures corresponding to scene changes listed in the scene change data; and

in response to user input, displaying selected ones of the thumbnails alongside the slide bar graphic.

12. The method of claim 9 wherein parsing comprises identifying the scene changes based, at least in part, on user preference data stored in a memory of the playback device.

13. The method of claim 12 wherein the user preference data specifies a sensitivity for generating the scene change data.

14. The method of claim 1 , wherein the second duration between the end time of the temporal window and the default search playback position (PP DS ) is dynamically determined based on a search direction.

15. The method of claim 1 , wherein the second duration between the end time of the temporal window and the default search playback position (PP DS ) is between 1 second and 10 seconds.

16. A playback device, comprising:

a processor; and

a computer-readable storage medium storing computer-readable code that, when executed by the processor, causes the playback device to perform operations comprising:

receiving a user command at the playback device to shift a current playback position of video content to a default search playback position (PP DS );

defining a temporal window extending before and after the default search playback position (PP DS ) of the user command,

wherein a start time of the temporal window is defined by subtracting a first duration from the default search playback position (PP DS ),

wherein an end time of the temporal window is identified by adding a second duration to the default search playback position (PP DS ), and

wherein the temporal window extending before and after the default search playback position (PP DS ) encompasses a segment of the video content;

searching the segment of the video content encompassed by the temporal window for a scene change between the start time and the end time of the temporal window; and

in response to locating the scene change in the segment of video encompassed by the temporal window, automatically shifting playback of the video content to a new playback position corresponding to the scene change (PP ST ).

17. The playback device of claim 16 wherein the operations further comprise:

in response to locating multiple scene changes within the temporal window or near to the temporal window, shifting playback of the video content to the new playback position corresponding to the scene change closest in time location to the default search playback position (PP DS ).

18. The playback device of claim 16 wherein the operations further comprise:

parsing the video content to identify scene changes to generate scene change data prior to playback of the video content; and

using the scene change data to determine whether the scene change is located within the temporal window or to determine whether the scene change is located near the temporal window.

19. A playback device, comprising:

a scene change detector configured to:

detect scene changes in video content in a time window and in a temporal window, wherein the time window is different than the temporal window; and

generate scene change data indicating locations of the scene changes in the video content, wherein the scene change data is provided as a manifest; and

a smart search controller to:

monitor for a user command to shift a current playback position of the video content to a default search playback position (PP DS );

define the temporal window extending before and after the default search playback position (PP DS ) of the user command,

wherein a start time of the temporal window is defined by subtracting a first duration from the default search playback position (PP DS ),

wherein an end time of the temporal window is defined by adding a second duration to the default search playback position (PP DS ), and

wherein the temporal window extending before and after the default search playback position (PP DS ) encompasses a segment of the video content;

utilize the scene change data to determine a scene change occurs in the segment of the video content encompassed by the temporal window; and

in response to determining that the scene change occurs in the segment of video encompassed by the temporal window, automatically shifting playback of the video content to a playback position corresponding to the scene change (PP ST ).

20. The playback device of claim 19 further comprising a thumbnail generator configured to:

receive the scene change data from the scene change detector; and

generate thumbnail images for each time position in the video content at which the scene change data indicates that an occurrence of the scene change (PP ST ) wherein the scene change detector is configured to detect scene changes in the video content utilizing scene change markers embedded in the video content.

Assignments (2)
CHANGE OF NAME Recorded Sep 1, 2022
From: SLING MEDIA PVT. LTD.
To: DISH NETWORK TECHNOLOGIES INDIA PRIVATE LIMITED
Reel/Frame 061365/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2020
From: NAIK RAIKAR, YATISH JAYANT; SAHABHAUMIK, SOHAM; RAMESH, RAKESH; HEGDE, KARTHIK MAHABALESHWAR
To: SLING MEDIA PVT LTD
Reel/Frame 054753/0483 →