IP Library Granted Patent US 10,506,198
Granted Patent B2
US 10,506,198 · App. 15/366,950 · Granted Dec 10, 2019

Video stream encoding system with live crop editing and recording

Inventors: Sergii Maliuk (Brooklyn, NY); Philip Tomasz Worthington (New York, NY); Jimmy S. An (Hillsborough, NJ); Shi Gang Yuan (Brooklyn, NY); Jesse H. Hertzberg (New York, NY); Maxime G. G. Haot (New York, NY)
Assignee: Livestream LLC
H04N5/775G06F3/04842G06F3/04845G06K9/4671G11B27/031H04N5/23293H04N5/2628G06F3/04883G06K2009/4666
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,506,198
App. No.
15/366,950
Granted
Dec 10, 2019
Kind
B2
Abstract

Implementations of the disclosure provide for video stream encoding system with live crop editing and recording. In one implementation, the method comprises receiving, by a camera device, an input video stream depicting an image. A first video stream and a second video stream are generated based on the input video stream. A crop instruction associated with the image is received based on user input. A region of interest in the first stream is determined based on the crop instruction. The first stream depicts a full field of view of the image associated with the input video stream. A cropped view presentation of the full field of view is generated to associate with the second stream in accordance with the region of interest. Thereupon, a portion of the cropped view presentation of the second stream is provided for display at a network device.

Claims (42)

1. A method comprising:

receiving, by a camera device, an input video stream depicting an image;

transmitting, by the camera device, dual output video streams based on the input video stream comprising a first video stream transmitting to a mobile device and a second video stream transmitting to a network device;

receiving, by the camera device, a crop instruction associated with the image based on a touch screen gesture received on the mobile device, wherein the first video stream depicts a full field of view of the image on the mobile device, and wherein the full field of view is maintained on the mobile device while receiving the crop instruction;

determining, by the camera device, a region of interest in the first video stream based on coordinates specified by the crop instruction to generate a cropped view presentation of the full field of view, wherein the second video stream depicts the cropped view presentation;

selecting, by the camera device, a smoothing algorithm to adjust a visual transition from the full field of view in the first video stream to the cropped view presentation in the second video stream, the smoothing algorithm selected based at least in part on a crop instruction type identified on the mobile device; and

providing, by the camera device, the cropped view presentation in the second video stream for display at the network device while continuing to provide the full field of view in the first video stream for display at the mobile device.

2. The method of claim 1 , wherein the crop instruction type comprises at least one of: a pinch to zoom instruction, a tap to cut instruction or a drag to pan instruction.

3. The method of claim 1 , further comprising adjusting an exposure setting of the full field of view associated with the first video stream based on a selection of the region of interest.

4. The method of claim 1 , further comprising selecting one or more frames from the input video stream to transition between the full field of view and the region of interest at the display of the network device.

5. A method of claim 1 , further comprising:

tracking an object within the full field of view associated with the first video stream;

associating the cropped view presentation of the second video stream with the object; and

adjusting the cropped view presentation at the display of the network device as the object moves within the full field of view.

6. The method of claim 5 , wherein the tracking comprises detecting a location of the cropped view presentation based on a facial feature associated with the object within the full field of view.

7. The method of claim 5 , wherein the tracking comprises detecting a location of the cropped view presentation based on a speech activity associated with the object within the full field of view.

8. A system comprising:

a memory to store video streams, and

a processing device of a camera device, operatively coupled to the memory to:

receive an input video stream depicting an image;

transmit dual output video streams based on the input video stream comprising a first video stream to transmit to a mobile device and a second video stream to transmit to a network device;

receive a crop instruction associated with the image based on a touch screen gesture received on the mobile device, wherein the first video stream depicts a full field of view of the image on the mobile device, and wherein the full field of view is maintained on the mobile device while receiving the crop instruction;

determine a region of interest in the first video stream based on coordinates specified by the crop instruction to generate a cropped view presentation of the full field of view, wherein the second video stream depicts the cropped view presentation;

select a smoothing algorithm to adjust a visual transition from the full field of view in the first video stream to the cropped view presentation in the second video stream, the smoothing algorithm selected based at least in part on a crop instruction type identified on the mobile device; and

provide the cropped view presentation in the second video stream for display at the network device while continuing to provide the full field of view in the first video stream for display at the mobile device.

9. The system of claim 8 , wherein the crop instruction type comprises at least one of: a pinch to zoom instruction, a tap to cut instruction or a drag to pan instruction.

10. The system of claim 8 , wherein the processing device is further operatively coupled to the memory to adjust an exposure setting of the full field of view associated with the first video stream based on a selection of the region of interest.

11. The system of claim 8 , wherein the processing device is further operatively coupled to the memory to select one or more frames from the input video stream to transition between the full field of view and the region of interest at the display of the network device.

12. A system of claim 8 , wherein the processing device is further operatively coupled to the memory to:

track an object within the full field of view associated with the first video stream;

associate the cropped view presentation of the second video stream with the object; and

adjust the cropped view presentation at the display of the network device as the object moves within the full field of view.

13. The system of claim 12 , wherein to track, the processing device is further operatively coupled to the memory to detect a location of the cropped view presentation based on a facial feature associated with the object within the full field of view.

14. The system of claim 12 , wherein to track, the processing device is further operatively coupled to the memory to detect a location of the cropped view presentation based on a speech activity associated with the object within the full field of view.

15. A non-transitory computer-readable storage medium comprising executable instructions that when executed, by a processing device of a camera device, cause the processing device to:

receive an input video stream depicting an image;

transmit dual output video streams based on the input video stream comprising a first video stream to transmit to a mobile device and a second video stream to transmit to a network device;

receive a crop instruction associated with the image based on a touch screen gesture received on the mobile device, wherein the first video stream depicts a full field of view of the image on the mobile device, and wherein the full field of view is maintained on the mobile device while receiving the crop instruction;

determine a region of interest in the first video stream based on coordinates specified by the crop instruction to generate a cropped view presentation of the full field of view, wherein the second video stream depicts the cropped view presentation;

select a smoothing algorithm to adjust a visual transition from the full field of view in the first video stream to the cropped view presentation in the second video stream, the smoothing algorithm selected based at least in part on a crop instruction type identified on the mobile device; and

provide the cropped view presentation in the second video stream for display at the network device while continuing to provide the full field of view in the first video stream for display at the mobile device.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the crop instruction type comprises at least one of: a pinch to zoom instruction, a tap to cut instruction or a drag to pan instruction.

Assignments (6)
SECURITY INTEREST Recorded May 4, 2026
From: VIMEO.COM, INC.
To: INTESA SANPAOLO S.P.A., AS SECURITY AGENT
Reel/Frame 074553/0001 →
RELEASE OF PATENT SECURITY INTERESTS FILED FEBRUARY 12, 2021 AT REEL/FRAME 055288/0371 Recorded Jul 3, 2023
From: JPMORGAN CHASE BANK, N.A.
To: VIMEO.COM, INC. (FKA VIMEO, INC.)
Reel/Frame 064193/0449 →
CHANGE OF NAME Recorded Jun 25, 2021
From: VIMEO, INC.
To: VIMEO.COM, INC.
Reel/Frame 056754/0261 →
SECURITY AGREEMENT Recorded Feb 12, 2021
From: VIMEO, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 055288/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2020
From: LIVESTREAM LLC
To: VIMEO, INC.
Reel/Frame 051445/0866 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2017
From: MALIUK, SERGII; WORTHINGTON, PHILIP TOMASZ; AN, JIMMY S.; YUAN, SHI GANG; HERTZBERG, JESSE H.; HAOT, MAXIME G.G.
To: LIVESTREAM LLC
Reel/Frame 040959/0348 →
Continuity (2)
Provisional Application 62263364 · Dec 4, 2015
Related Publication 20170163929A1 · Jun 8, 2017