IP Library Granted Patent US 11,816,310
Granted Patent B1
US 11,816,310 · App. 17/000,885 · Granted Nov 14, 2023

Multi-view audio and video interactive playback

Inventors: Neil Birkbeck (Sunnyvale, CA); Isasi Inguva (Mountain View, CA); Damien Kelly (Sunnyvale, CA); Andrew Crawford (Mountain View, CA); Hugh Denman (San Francisco, CA); Perry Tobin (Santa Cruz, CA); Steve Benting (San Mateo, CA); Anil Kokaram (Sunnyvale, CA); Jeremy Doig (Los Gatos, CA)
Assignee: Google LLC
G06F3/0484G11B27/10G11B27/34H04N21/2387H04N21/242H04N21/45H04N21/8455H04N21/8456H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,816,310
App. No.
17/000,885
Granted
Nov 14, 2023
Kind
B1
Abstract

An interactive multi-view module identifies a plurality of media items associated with one or more real-world events. Each of the plurality of media items is created by capturing the real-world events from a particular geographic location. The interactive multi-view module determines a geographic position associated with each of the media items and presents the media items in an interactive multi-view player interface based at least on the geographic positions. The interactive multi-view player interface allows a user to switch between of media items, and indicates at least one of a video density indicating a number of media items available at a given point in time or an event highlight indicating a popularity of the media items at a given point in time. The popularity of the respective media items is determined using one or more factors comprising a number of views of the media items at a given point in time.

Claims (63)

1. A method comprising:

identifying, by a processing device, a plurality of media items associated with one or more real-world events, wherein each of the plurality of media items is created by capturing the one or more real-world events from a particular geographic position;

determining a geographic position associated with each of the plurality of media items; and

providing the plurality of media items for presentation in an interactive multi-view player interface based at least on geographic positions,

wherein the interactive multi-view player interface displays the geographic positions on a geographic map associated with the one or more real-world events,

wherein the interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items,

wherein the interactive multi-view player interface indicates a video density indicating a quantity of media items available at one of the geographic positions at a given point in time, and an event highlight indicating a popularity of respective media items corresponding to the displayed geographic map at the given point in time, and

wherein the popularity of the respective media items at the given point in time is determined using one or more factors comprising a number of views of the respective media items at the given point in time by the plurality of users.

2. The method of claim 1 , further comprising:

identifying an audio portion for each media item; and

synchronizing the audio portions of each of the plurality of media items according to a common reference timeline.

3. The method of claim 1 , wherein identifying the plurality of media items comprises determining media items having metadata that identifies the one or more real-world events.

4. The method of claim 1 , wherein determining the geographic position associated with each of the plurality of media items comprises determining positions of separate cameras used to capture each of the plurality of media items.

5. The method of claim 1 , wherein providing the plurality of media items for presentation in the interactive multi-view player interface comprises:

displaying an icon representing each of the plurality of media items, wherein each icon is displayed in a location based on the corresponding geographic position;

receiving a first user selection of a first icon representing a first media item of the plurality of media items and beginning playback of the first media item; and

receiving, at a time during playback of the first media item corresponding to a first point on a common reference timeline, a second user selection of a second icon representing a second media item of the plurality of media items and beginning playback of the second media item at the time in the second media item corresponding to the first point on the common reference timeline.

6. The method of claim 5 , further comprising:

predicting a subsequent media item to be selected by the user; and

buffering the subsequent media item prior to a third user selection of the subsequent media item.

7. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:

identifying, by the processing device, a plurality of media items associated with one or more real-world events, wherein each of the plurality of media items is created by capturing the one or more real-world events from a particular geographic;

determining a geographic position associated with each of the plurality of media items; and

providing the plurality of media items for presentation in an interactive multi-view player interface based at least on multiple geographic positions,

wherein the interactive multi-view player interface displays the geographic positions on a geographic map associated with the one or more real-world events,

wherein the interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items,

wherein the interactive multi-view player interface indicates a video density indicating a quantity of media items available at one of the geographic positions at a given point in time, and an event highlight indicating a popularity of respective media items corresponding to the displayed geographic map at the given point in time, and

wherein the popularity of the respective media items at the given point in time is determined using one or more factors comprising a number of views of the respective media items at the given point in time by the plurality of users.

8. The non-transitory machine-readable storage medium of claim 7 , wherein the operations further comprise:

identifying an audio portion for each media item; and

synchronizing the audio portions of each of the plurality of media items according to a common reference timeline.

9. The non-transitory machine-readable storage medium of claim 7 , wherein identifying the plurality of media items comprises determining media items having metadata that identifies the one or more real-world events.

10. The non-transitory machine-readable storage medium of claim 7 , wherein determining the geographic position associated with each of the plurality of media items comprises determining positions of separate cameras used to capture each of the plurality of media items.

11. The non-transitory machine-readable storage medium of claim 7 , wherein providing the plurality of media items for presentation in the interactive multi-view player interface comprises:

displaying an icon representing each of the plurality of media items, wherein each icon is displayed in a location based on the corresponding geographic position;

receiving a first user selection of a first icon representing a first media item of the plurality of media items and beginning playback of the first media item; and

receiving, at a time during playback of the first media item corresponding to a first point on a common reference timeline, a second user selection of a second icon representing a second media item of the plurality of media items and beginning playback of the second media item at a time in the second media item corresponding to the first point on the common reference timeline.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the operations comprise:

predicting a subsequent media item to be selected by the user; and

buffering the subsequent media item prior to a third user selection of the subsequent media item.

13. A server computer system comprising:

a processing device;

a memory coupled to the processing device; and

an interactive multi-view module, executable by the processing device from the memory, to:

identify a plurality of media items associated with one or more real-world events, wherein each of the plurality of media items is created by capturing the one or more real-world events from a particular geographic;

determine a geographic position associated with each of the plurality of media items; and

provide the plurality of media items for presentation in an interactive multi-view player interface based at least on multiple geographic positions,

wherein the interactive multi-view player interface displays the geographic positions on a geographic map associated with the one or more real-world events,

wherein the interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items,

wherein the interactive multi-view player interface indicates a video density indicating a quantity of media items available at one of the geographic positions at a given point in time, and an event highlight indicating a popularity of respective items corresponding to the displayed geographic map at the given point in time, and

wherein the popularity of the respective media items at the given point in time is determined using one or more factors comprising a number of views of the respective media items at the given point in time by the plurality of users.

14. The server computer system of claim 13 , wherein the interactive multi-view module further to:

identify an audio portion for each media item; and

synchronize the audio portions of each of the plurality of media items according to a common reference timeline.

15. The server computer system of claim 13 , wherein identifying the plurality of media items comprises determining media items having metadata that identifies the one or more real-world events.

16. The server computer system of claim 13 , wherein determining the geographic position associated with each of the plurality of media items comprises determining positions of separate cameras used to capture each of the plurality of media items.

17. The server computer system of claim 13 , wherein to provide the plurality of media items for presentation in the interactive multi-view player interface, the interactive multi-view module to:

display an icon representing each of the plurality of media items, wherein each icon is displayed in a location based on the corresponding relative geographic position;

receive receiving a first user selection of a first icon representing a first media item of the plurality of media items and beginning playback of the first media item; and

receive, at a time during playback of the first media item corresponding to a first point on a common reference timeline, a second user selection of a second icon representing a second media item of the plurality of media items and beginning playback of the second media item at a time in the second media item corresponding to the first point on the common reference timeline.

18. The server computer system of claim 13 , wherein the interactive multi-view module further to:

predict a subsequent media item to be selected by the user; and

buffer the subsequent media item prior to a user selection of the subsequent media item.

Assignments (2)
CHANGE OF NAME Recorded Oct 14, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 054084/0209 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2020
From: BIRKBECK, NEIL; INGUVA, ISASI; KELLY, DAMIEN; CRAWFORD, ANDREW; DENMAN, HUGH; TOBIN, PERRY; BENTING, STEVE; KOKARAM, ANIL; DOIG, JEREMY
To: GOOGLE INC.
Reel/Frame 053594/0561 →
Continuity (2)
Continuation 14323807 · Jul 3, 2014
Provisional Application 61906588 · Nov 20, 2013