IP Library Granted Patent US 11,545,185
Granted Patent B1
US 11,545,185 · App. 17/379,910 · Granted Jan 3, 2023

Method and apparatus for frame accurate high resolution video editing in cloud using live video streams

Inventors: Alper Turgut (San Francisco, CA); Oztan Harmanci (Mountain View, CA); Ismail R. Haritaoglu (Palo Alto, CA)
Assignee: Google LLC
G11B27/02G11B27/10H04N21/2181H04N21/2187H04N21/23424H04N21/234363G06F16/4393
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,545,185
App. No.
17/379,910
Granted
Jan 3, 2023
Kind
B1
Abstract

A system and method for frame accurate editing of high resolution live video streams is disclosed. A method includes providing a low resolution video stream displayed in a first viewing portion of an edit user interface, wherein the low resolution video stream corresponds to a high resolution video stream of the live video content, receiving, via the viewing portion of the user interface, user input identifying a first start point and a first end point within the low resolution video stream, and transmitting the first start point and the first end point to a server to obtain a respective intermediate video segment of an intermediate resolution video stream corresponding to the high resolution video stream. The method further includes presenting the respective intermediate video segment in a second viewing portion of the edit user interface, the second viewing portion comprising a frame identifying section to identify frames corresponding to the first start point and the first end point, receiving user input identifying a second start point and a second end point from within the intermediate resolution video stream, and transmitting the second start point and the second end point to the server to obtain a respective high resolution video segment from the high resolution video stream for presentation to the user.

Claims (44)

1. A method for editing live video content, comprising:

presenting a low resolution video stream in a first viewing portion of an edit user interface, wherein the low resolution video stream corresponds to a high resolution video stream of the live video content, wherein the high resolution video stream includes a first plurality of frames and at least a portion of the first plurality of frames from the high resolution video stream are not included in the low resolution video stream;

receiving, via the first viewing portion of the edit user interface, user input identifying a first start point and a first end point within the low resolution video stream;

transmitting the first start point and the first end point to a server to obtain a respective intermediate video segment of an intermediate resolution video stream corresponding to the high resolution video stream, wherein the intermediate resolution video stream includes a second plurality of frames, at least a portion of the second plurality of frames from the intermediate resolution video stream are not included in the low resolution video stream, and at least a portion of the first plurality of frames from the high resolution video stream are not included in the intermediate resolution video stream;

presenting the respective intermediate video segment in a second viewing portion of the edit user interface, the second viewing portion comprising a frame identifying section to identify frames corresponding to the first start point and the first end point;

receiving, in view of the frames identified in the frame identifying section, user input identifying a second start point and a second end point within the intermediate resolution video stream, wherein each of the second start point and the second end point are frame accurate points within the intermediate resolution video stream; and

transmitting the second start point and the second end point to the server to obtain a respective high resolution video segment from the high resolution video stream for presentation to a user.

2. The method of claim 1 wherein the low resolution video stream includes a plurality of thumbnail images and wherein each thumbnail image corresponds to one of the first plurality of frames of the high resolution video stream.

3. The method of claim 2 wherein each of the plurality of thumbnail images is presentative of a scene in the live video content.

4. The method of claim 2 wherein the first viewing portion includes a slider bar to scroll through the plurality of thumbnail images, the slider bar comprising a left marker and a right marker to identify the first start point and the first end point respectively.

5. The method of claim 1 wherein the frame identifying section presents one or more frames immediately preceding or immediately following each of the first start point and the first end point in the high resolution video stream.

6. The method of claim 1 wherein the frame identifying section allows the user to move forward or backward through the respective intermediate video segment in the second viewing portion on a frame-by-frame basis.

7. The method of claim 1 wherein the respective high resolution video segment is presented in a third viewing portion of the edit user interface.

8. The method of claim 1 further comprising:

allowing the user to edit the respective high resolution video segment; and

providing the edited high resolution video segment to a cloud-based storage location specified by the user.

9. A system for editing live video content, comprising:

a memory; and

a processor, coupled to the memory, to perform operations comprising:

presenting a low resolution video stream in a first viewing portion of an edit user interface, wherein the low resolution video stream corresponds to a high resolution video stream of the live video content, wherein the high resolution video stream includes a first plurality of frames and at least a portion of the first plurality of frames from the high resolution video stream are not included in the low resolution video stream;

receiving, via the first viewing portion of the edit user interface, user input identifying a first start point and a first end point within the low resolution video stream;

transmitting the first start point and the first end point to a server to obtain a respective intermediate video segment of an intermediate resolution video stream corresponding to the high resolution video stream, wherein the intermediate resolution video stream includes a second plurality of frames, at least a portion of the second plurality of frames from the intermediate resolution video stream are not included in the low resolution video stream, and at least a portion of the first plurality of frames from the high resolution video stream are not included in the intermediate resolution video stream;

presenting the respective intermediate video segment in a second viewing portion of the edit user interface, the second viewing portion comprising a frame identifying section to identify frames corresponding to the first start point and the first end point;

receiving, in view of the frames identified in the frame identifying section, user input identifying a second start point and a second end point within the intermediate resolution video stream, wherein each of the second start point and the second end point are frame accurate points within the intermediate resolution video stream; and

transmitting the second start point and the second end point to the server to obtain a respective high resolution video segment from the high resolution video stream for presentation to a user.

10. The system of claim 9 wherein the low resolution video stream includes a plurality of thumbnail images and wherein each thumbnail image corresponds to one of the first plurality of frames of the high resolution video stream.

11. The system of claim 10 wherein the first viewing portion includes a slider bar to scroll through the plurality of thumbnail images, the slider bar comprising a left marker and a right marker to identify the first start point and the first end point respectively.

12. The system of claim 9 wherein the frame identifying section presents one or more frames immediately preceding or immediately following each of the first start point and the first end point in the high resolution video stream.

13. The system of claim 9 wherein the frame identifying section allows the user to move forward or backward through the respective intermediate video segment in the second viewing portion on a frame-by-frame basis.

14. The system of claim 9 wherein the respective high resolution video segment is presented in a third viewing portion of the edit user interface.

15. The system of claim 9 wherein the operations further comprise:

allowing the user to edit the respective high resolution video segment; and

providing the edited high resolution video segment to a cloud-based storage location specified by the user.

16. A non-transitory computer readable medium comprising instructions, which when executed by a processor cause the processor to perform operations for editing live video content, the operations comprising:

presenting a low resolution video stream in a first viewing portion of an edit user interface, wherein the low resolution video stream corresponds to a high resolution video stream of the live video content, wherein the high resolution video stream includes a first plurality of frames and at least a portion of the first plurality of frames from the high resolution video stream are not included in the low resolution video stream;

receiving, via the first viewing portion of the edit user interface, user input identifying a first start point and a first end point within the low resolution video stream;

transmitting the first start point and the first end point to a server to obtain a respective intermediate video segment of an intermediate resolution video stream corresponding to the high resolution video stream, wherein the intermediate resolution video stream includes a second plurality of frames, at least a portion of the second plurality of frames from the intermediate resolution video stream are not included in the low resolution video stream, and at least a portion of the first plurality of frames from the high resolution video stream are not included in the intermediate resolution video stream;

presenting the respective intermediate video segment in a second viewing portion of the edit user interface, the second viewing portion comprising a frame identifying section to identify frames corresponding to the first start point and the first end point;

receiving, in view of the frames identified in the frame identifying section, user input identifying a second start point and a second end point within the intermediate resolution video stream, wherein each of the second start point and the second end point are frame accurate points within the intermediate resolution video stream; and

transmitting the second start point and the second end point to the server to obtain a respective high resolution video segment from the high resolution video stream for presentation to a user.

17. The non-transitory computer readable medium of claim 16 wherein the low resolution video stream includes a plurality of thumbnail images and wherein each thumbnail image corresponds to one of the first plurality of frames of the high resolution video stream.

18. The non-transitory computer readable medium of claim 17 wherein the first viewing portion includes a slider bar to scroll through the plurality of thumbnail images, the slider bar comprising a left marker and a right marker to identify the first start point and the first end point respectively.

19. The non-transitory computer readable medium of claim 17 wherein the frame identifying section presents one or more frames immediately preceding or immediately following each of the first start point and the first end point in the high resolution video stream.

20. The non-transitory computer readable medium of claim 17 wherein the frame identifying section allows the user to move forward or backward through the respective intermediate video segment in the second viewing portion on a frame-by-frame basis.

Assignments (2)
CHANGE OF NAME Recorded Jul 29, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 057073/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2021
From: TURGUT, ALPER; HARMANCI, OZTAN; HARITAOGLU, ISMAIL R.
To: GOOGLE INC.
Reel/Frame 056996/0735 →
Continuity (2)
Continuation 15591012 · May 9, 2017
Provisional Application 62334228 · May 10, 2016
Cited By (2)
US 12,236,980 US 12,294,745