IP Library › Granted Patent US 9,589,596
Granted Patent B2
US 9,589,596 · App. 14/620,508 · Granted Mar 7, 2017

Method and device of playing multimedia and medium

Inventors: Bin Wang (Beijing, CN); Zhiguang Zheng (Beijing, CN); Dongfang Ji (Beijing, CN)
Assignee: Xiaomi Inc.
G11B27/102G06F3/04842G06F3/04847G11B19/022G11B27/105G11B27/22G11B27/28G11B27/30H04N7/0885H04N5/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,589,596
App. No.
14/620,508
Granted
Mar 7, 2017
Kind
B2
Abstract

The present disclosure relates to a method and a device for playing multimedia. The method may comprise: obtaining at least one of audio data and subtitle data of a first preset time length before a pause position of a multimedia; determining a starting position of a complete semantic statement according to at least one of the audio data and the subtitle data; and continuing to play the multimedia according to the starting position when an instruction of continuing to play the multimedia is detected or a condition of continuing to play the multimedia is met.

Claims (92)

1. A device, comprising:

a storage medium storing a set of instructions for playing a multimedia data stream; and

a processor in communication with the storage medium, wherein when executing the set of instructions, the processor is directed to:

play the multimedia data stream, wherein the multimedia data stream comprises audio data and subtitle data;

pause the multimedia data stream at a pause position;

tape back the multimedia data stream from the pause position to obtain a target section from the audio data and subtitle data, the target section comprising:

a first audio signal in the audio data and a first subtitle in the subtitle data that corresponds with the first audio signal; and

a second audio signal in the audio data and a second subtitle in the subtitle data that corresponds with the second audio signal,

wherein the first audio signal is adjacent to and precedes the second audio signal, and the first subtitle is adjacent to and precedes the second subtitle;

determine a starting position of a semantic statement occurring within the target section as a target starting position, wherein the processor is directed to:

obtain an end display time of the second subtitle and an initial display time of the first subtitle when a time interval between the first audio signal and the second audio signal is larger than a first preset interval, and

select a position in the time interval as the target starting position when a time interval between the end display time and the initial display time is larger than a second preset interval; and

restart the multimedia data stream from the target starting position when a condition to resume playing the multimedia data stream is met.

2. A device comprising:

a storage medium storing a set of instructions for playing a multimedia data stream; and

a processor in communication with the storage medium, wherein when executing the set of instructions, the processor is directed to:

play the multimedia data stream, wherein the multimedia data stream comprises at least one of audio data and subtitle data;

pause the multimedia data stream at a pause position;

obtain a target section of the multimedia stream that precedes the pause position by a particular duration;

determine a starting position of a semantic statement occurring within the target section as a target starting position, wherein when the target section does not comprise the starting position of the semantic statement, the processor is further directed to:

obtain another target section of the multimedia stream that precedes the pause position by an additional duration;

determine whether the starting position of the semantic statement is in the another target section; and

when the starting position of the semantic statement is in the another target section, determine the starting position of the semantic statement as the target starting position; and

restart the multimedia data stream from the target starting position when a condition to resume playing the multimedia data stream is met.

3. The device of claim 2 , wherein when the multimedia data stream comprises audio data,

the target section comprises a plurality of audio signals, and

to determine the starting position of the semantic statement the processor is further directed to:

find a time interval between two successive audio signals in the audio data; and

when the time interval is larger than a first preset time interval, select a time position in the time interval as the starting position.

4. The device of claim 3 , wherein to determine the starting position the processor is further directed to:

obtain voice audio data by filtering the audio data according to voice frequency;

determine a time interval between two successive voice audio signals in the voice audio data; and

select a time position between the two successive voice audio signals as the starting position when the time interval between the two successive voice audio signals is larger than the first preset interval.

5. The device of claim 2 , wherein when the multimedia data stream comprises the subtitle data,

the target section comprises at least a first subtitle and a second subtitle adjacent to and after the first subtitle; and

to determine the starting position of the semantic statement the processor is further directed to:

obtain an end display time of the first subtitle and an initial display time of the second subtitle; and

when a time interval between the end display time and the initial display time is greater than a second preset time interval, select a position in the time interval as the starting position.

6. The device of claim 2 , wherein when the target section comprises a plurality of semantic statements, to determine the target starting position the processor is directed to:

find a starting position of each of the plurality of semantic statements; and

select the starting position of the semantic statement closest to the pause position as the target starting position.

7. The device of claim 2 , wherein when the target section comprises a plurality of semantic statements, to determine the target starting position the processor is further directed to:

find a starting position of each of the plurality of semantic statements; and

select a target starting position from the plurality of starting positions, wherein the target starting position is an Nth starting position away from the pause position.

8. The device of claim 2 , wherein the processor is directed to:

pause the multimedia data stream at the pause position based on a determination that an amount of data in a multimedia buffer is insufficient for continuing to play the multimedia data stream; and

wherein the condition to resume playing the multimedia data stream is met when an amount of data in a multimedia buffer is sufficient for continuing to play the multimedia data stream.

9. The device of claim 2 , wherein the semantic statement is a sentence or a paragraph, and the starting position of the semantic statement is the starting position of the sentence or paragraph.

10. A method for playing a multimedia data stream, comprising:

playing, by an electronic device, the multimedia data stream, wherein the multimedia data stream comprises audio data and subtitle data;

pausing, by the electronic device, the multimedia data stream at a pause position;

taping back the multimedia data stream, by the electronic device, to obtain a target section from the audio data and subtitle data, the target section comprising:

a first audio signal in the audio data and a first subtitle in the subtitle data that corresponds with the first audio signal; and

a second audio signal in the audio data and a second subtitle in the subtitle data that corresponds with the second audio signal,

wherein the first audio signal is adjacent to and precedes the second audio signal, and the first subtitle is adjacent to and precedes the second subtitle;

determining, by the electronic device, a starting position of a semantic statement occurring within the target section as a target starting position by:

obtaining an end display time of the second subtitle and an initial display time of the first subtitle when a time interval between the first audio signal and the second audio signal is larger than a first preset interval, and

selecting a position in the time interval as the target starting position when a time interval between the end display time and the initial display time is larger than a second preset interval; and

restarting the multimedia, by the electronic device, from the target starting position when a condition to resume playing the multimedia is met.

11. A method for playing a multimedia data stream, comprising:

playing, by an electronic device, the multimedia data stream, wherein the multimedia data stream comprises at least one of audio data and subtitle data;

pausing, by the electronic device, the multimedia data stream at a pause position;

obtaining a target section of the multimedia stream that precedes the pause position by a particular duration;

determining, by the electronic device, a starting position of a semantic statement occurring within the target section as a target starting position, wherein when the target section does not comprise the starting position of the semantic statement, the method further comprises:

obtaining another target section of the multimedia stream that precedes the pause position by an additional duration;

determining whether the starting position of the semantic statement is in the another target section; and

when the starting position of the semantic statement is in the another target section, determining the starting position of the semantic statement as the target starting position; and

restarting the multimedia data stream, by the electronic device, from the target starting position when a condition to resume playing the multimedia data stream is met.

12. The method of claim 11 , wherein when the multimedia data stream comprises audio data,

the target section comprises a plurality of audio signals, and

determining the starting position of the semantic statement comprises:

finding a time interval between two successive audio signals in the audio data; and

when the time interval is larger than a first preset time interval, selecting a time position in the time interval as the starting position.

13. The method of claim 12 , wherein the determining of the starting position further comprises:

obtaining voice audio data by filtering the audio data according to voice frequency;

determining a time interval between two successive voice audio signals in the voice audio data; and

selecting a time position between the two successive voice audio signals as the starting position when the time interval between the two successive voice audio signals is larger than the first preset interval.

14. The method of claim 11 , wherein when the multimedia data stream comprises the subtitle data,

the target section comprises at least a first subtitle and a second subtitle adjacent to and after the first subtitle; and

the determining of the starting position of the semantic statement comprises:

obtaining an end display time of the first subtitle and an initial display time of the second subtitle; and

when a time interval between the end display time and the initial display time is greater than a second preset time interval, selecting a position in the time interval as the starting position.

15. The method of claim 11 , wherein when the target section comprises a plurality of semantic statements, the determining of the target starting position comprises:

finding a starting position of each of the plurality of semantic statements; and

selecting the starting position of the semantic statement closest to the pause position as the target starting position.

16. The method of claim 11 , wherein when the target section comprises a plurality of semantic statements, the determining of the target starting position comprises:

finding a starting position of each of the plurality of semantic statements; and

selecting a target starting position from the plurality of starting positions, wherein the target starting position is an Nth starting position away from the pause position.

17. The method of claim 11 , further comprising:

pausing the multimedia stream at the pause position based on a determination that an amount of data in a multimedia buffer is insufficient for continuing to play the multimedia stream; and

wherein the condition to resume playing the multimedia data stream is met when an amount of data in a multimedia buffer is sufficient for continuing to play the multimedia data stream.

18. The method of claim 11 , wherein the semantic statement is a sentence or a paragraph, and the starting position of the semantic statement is the starting position of the sentence or paragraph.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2016
From: WANG, BIN; ZHENG, ZHIGUANG; JI, DONGFANG
To: XIAOMI INC.
Reel/Frame 040604/0076 →
Priority Claims (1)
CN 2014 1 0250800 · Jun 6, 2014 · national
Continuity (2)
Continuation In Part PCTCN2014091757 · Nov 20, 2014
Related Publication 20150356997A1 · Dec 10, 2015