Multimedia formats for multiple display areas in a display device

Inventors: Dengzhi Zhang (San Jose, CA); Hugo Du Plooy (San Jose, CA)

Assignee: ROKU, INC.

H04N21/440272 H04N21/4316 H04N21/44029

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12677031
App. No.: 17/963,466
Granted: Jul 7, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Disclosed herein are system, apparatus, method and/or computer program product embodiments for a multimedia environment that includes a computing device to display multiple multimedia segments within multiple display areas of a display device. The display device can include a first display area to display a first multimedia segment, and a second display area to display a second multimedia segment, which may be an advertisement related to the first multimedia segment. In some embodiments, to fit into the first display area, the first multimedia segment may be in a first format when received, and converted into a second format to fit into the first display area before being displayed in the first display area.

Claims (35)

1 . A method, comprising:

receiving a first video segment including a plurality of frames in a first video aspect ratio, wherein the first video segment includes automatic content recognition (ACR) content recognized using an ACR server;

determining, by at least one processor, a second video aspect ratio adapted to fit into a first display area of a display device to display each of the plurality of frames of the first video segment within the first display area, wherein the second video aspect ratio is different from the first video aspect ratio and wherein the display device includes the first display area and a second display area at least partially disjoint from the first display area;

converting the first video segment in the first video aspect ratio into the second video aspect ratio;

selecting, from among a plurality of video segments stored on a server, a second video segment related to the first video segment to be substantially concurrently displayed within the second display area of the display device, wherein the selecting the second video segment related to the first video segment comprises selecting the second video segment stored on the server based on the ACR content of the first video segment; and

displaying the plurality of frames of the first video segment within the first display area in the second video aspect ratio to fit into the first display area, and displaying the second video segment related to the first video segment substantially concurrently within the second display area.

2 . The method of claim 1 , wherein the second display area is completely disjoint from the first display area.

3 . The method of claim 2 , wherein the first display area and the second display area are of a rectangular shape of a substantially same height.

4 . The method of claim 3 , wherein the first display area has a first width A, and the second display area has a second width B satisfying a golden ratio condition (A+B)/A=1.618.

5 . The method of claim 1 , wherein the second display area overlays with the first display area and is partially disjoint from the first display area, and the second video segment is an on-screen display (OSD) of the first video segment.

6 . The method of claim 1 , wherein the first video segment includes audio content, and wherein the selecting the second video segment related to the first video segment comprises selecting the second video segment stored on the server based on the audio content of the first video segment.

7 . The method of claim 1 , further comprising identifying an object within a frame of the plurality of frames of the first video segment, the identifying comprising performing image recognition analysis of the frame, wherein the selecting the second video segment related to the first video segment comprises selecting the second video segment stored on the server based on the identified object.

8 . A computing device, comprising:

a display device including a first display area and a second display area at least partially disjoint from the first display area;

one or more memories; and

at least one processor, each coupled to at least one of the memories and the display device and configured to:

receive a first video segment including a plurality of frames in a first video aspect ratio, wherein the first video segment includes automatic content recognition (ACR) content recognized using an ACR server;

determine a second video aspect ratio adapted to fit into the first display area of the display device to display each of the plurality of frames of the first video segment within the first display area, wherein the second video aspect ratio is different from the first video aspect ratio;

convert the first video segment in the first video aspect ratio into the second video aspect ratio;

select, from among a plurality of video segments stored on a server, a second video segment related to the first video segment to be substantially concurrently displayed within the second display area of the display device, wherein to select the second video segment related to the first video segment, the at least one processor is configured to select the second video segment stored on the server based on the ACR content of the first video segment; and

display the plurality of frames of the first video segment within the first display area in the second video aspect ratio to fit into the first display area, and display the second video segment related to the first video segment substantially concurrently within the second display area.

9 . The computing device of claim 8 , wherein the first video segment includes audio content, and wherein the selecting the second video segment related to the first video segment comprises selecting the second video segment stored on the server based on the audio content of the first video segment.

10 . The computing device of claim 8 , wherein the first display area and the second display area are of a rectangular shape of a substantially same height.

11 . The computing device of claim 10 , wherein the first display area has a first width A, and the second display area has a second width B satisfying a golden ratio condition (A+B)/A=1.618.

12 . The computing device of claim 8 , wherein the second display area overlays with the first display area and is partially disjoint from the first display area, and the second video segment is an on-screen display (OSD) of the first video segment.

13 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

converting the first video segment in the first video aspect ratio into the second video aspect ratio;

14 . The non-transitory computer-readable medium of claim 13 , wherein the first video segment includes audio content, and wherein the selecting the second video segment related to the first video segment comprises selecting the second video segment stored on the server based on the audio content of the first video segment.

15 . The non-transitory computer-readable medium of claim 13 , wherein the first display area and the second display area are of a rectangular shape of a substantially same height.

16 . The non-transitory computer-readable medium of claim 15 , wherein the first display area has a first width A, and the second display area has a second width B satisfying a golden ratio condition (A+B)/A=1.618.

17 . The non-transitory computer-readable medium of claim 13 , wherein the second display area overlays with the first display area and is partially disjoint from the first display area, and the second video segment is an on-screen display (OSD) of the first video segment.