IP Library Granted Patent US 10,075,693
Granted Patent B2
US 10,075,693 · App. 15/139,328 · Granted Sep 11, 2018

Embedding calibration metadata into stereoscopic video files

Inventors: Han Jin (Milpitas, CA); Adam Rowell (Palo Alto, CA)
H04N13/0066H04N13/0239H04N13/0246
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,075,693
App. No.
15/139,328
Granted
Sep 11, 2018
Kind
B2
Abstract

A computerized system for displaying stereoscopic three-dimensional (3D) video recorded on a stereoscopic camera device includes a computer store containing data. The data includes a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, wherein the stereoscopic video feed comprises a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device. The computerized system includes a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to obtain the stereoscopic video feed from the computer store, parse the plurality of contemporaneous metadata feeds from the stereoscopic video feed, and calibrate the stereoscopic video feed for display in a display of a user's computing device using the plurality of contemporaneous metadata feeds.

Claims (32)

1. A computerized system for recording stereoscopic three-dimensional (3D) video on a stereoscopic camera device comprising:

(a) a computer store containing data, wherein the data comprises:

a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, and

a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device;

b) a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to:

obtain the stereoscopic video feed from the computer store,

obtain the plurality of contemporaneous metadata feeds from the computer store, and

embedding, in real-time as the stereoscopic video feed is recorded, the stereoscopic video feed with the plurality of contemporaneous metadata feeds, and wherein the plurality of metadata feeds comprises a calibration metadata of the stereoscopic video capture device contemporaneous with the stereoscopic video feed, wherein the stereoscopic video feed embedded with the plurality of contemporaneous metadata feeds is written by the computer processor to a video file in the stereoscopic video capture device, and wherein the plurality of contemporaneous metadata feeds is embedded into the stereoscopic video feed by encoding the contemporaneous metadata feeds into the subtitles or closed captioning metadata fields of the video file format, such that the timing of the subtitle or closed captioning metadata conveys the timing of the metadata feeds.

2. The computerized system of claim 1 , wherein the plurality of metadata feeds comprises an inertial measurement unit (IMU) metadata of the stereoscopic video capture device contemporaneous with the stereoscopic video feed.

3. The computerized system of claim 2 , wherein the plurality of metadata feeds comprises a location metadata that provides the location of the stereoscopic video capture device contemporaneous with the obtaining of the stereoscopic video feed, and wherein the location metadata comprises a set of latitude and longitude coordinates of where the stereoscopic video feed was obtained.

4. The computerized system of claim 1 , wherein the embedding the stereoscopic video feed with the plurality of contemporaneous metadata feeds is performed on a graphics processing unit (GPU) in the stereoscopic video capture device.

5. The computerized system of claim 4 , wherein the computer processor renders the video file into a format for communication to a display device.

6. A computerized system for displaying stereoscopic three-dimensional (3D) video recorded on a stereoscopic camera device comprising:

(a) a computer store containing data, wherein the data comprises:

a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, wherein the stereoscopic video feed comprises a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device;

(b) a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to:

obtain the stereoscopic video feed from the computer store,

parse the plurality of contemporaneous metadata feeds from the stereoscopic video feed,

calibrate the stereoscopic video feed for display in a virtual-reality headset display using the plurality of contemporaneous metadata feeds, and

decode a metadata stored in the subtitles or closed captioning fields of the stored video file format, wherein the metadata is associated with a set of different times within the video based on the timing of the subtitles or closed captioning fields.

7. The computerized system of claim 6 , wherein the computer processor uses the decoded metadata during the rendering of a stereoscopic video sequence for display in the virtual-reality headset.

8. The computerized system of claim 7 , wherein the stereoscopic video capture device comprises two or more fish-eyed lens digital cameras in the stereoscopic video capture device.

9. The computerized system of claim 8 , wherein the computer processor decodes metadata stored for multiple recording devices during the rendering of a stereoscopic video sequence for display, such that the metadata is associated with particular segments of the video sequence.

10. The computerized system of claim 7 , wherein, the computerized system for displaying the stereoscopic 3D content is a mobile phone or tablet device.

11. A computerized system for displaying stereoscopic three-dimensional (3D) video recorded on a stereoscopic camera device comprising:

(a) a computer store containing data, wherein the data comprises:

a stereoscopic video feed of two or more stereoscopic images from a stereoscopic video capture device, wherein the stereoscopic video feed comprises a plurality of contemporaneous metadata feeds, wherein a metadata feed comprises a time sequenced set of metadata obtained from a sensor of the stereoscopic video capture device, and wherein the stereoscopic video capture device comprises two or more fish-eyed lens digital cameras that are used to capture the stereoscopic video feed, wherein the time sequenced set of metadata is encoded into the stereoscopic video in a time-dependent fashion by utilizing a metadata channel in a video file format, and wherein the metadata channel comprises a subtitle metadata field or a closed-caption metadata field;

b) a computer processor in the stereoscopic video capture device, which computer processor is coupled to the computer store and programmed to:

obtain the stereoscopic video feed from the computer store,

parse the plurality of contemporaneous metadata feeds from the stereoscopic video feed, and

calibrate the stereoscopic video feed for display in a display of a user's computing device using the plurality of contemporaneous metadata feeds.

12. The computerized system of claim 11 , wherein the user's computing device comprises a virtual-reality headset, a tablet computer or a smartphone.

Assignments (5)
REAFFIRMATION OF PATENT ASSIGNMENT AGREEMENT Recorded Apr 16, 2026
From: R. HEWEN & CO., LLC
To: ARTIFICIAL INTELLIGENCE INDUSTRY ASSOCIATION, INC.
Reel/Frame 075409/0743 →
CHANGE OF NAME Recorded Apr 2, 2026
From: ARTIFICIAL INTELLIGENCE IMAGING ASSOCIATION, INC.
To: ARTIFICIAL INTELLIGENCE INDUSTRY ASSOCIATION, INC.
Reel/Frame 074260/0967 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: BLUWHALE AI, INC.
To: R. HEWEN & CO., LLC
Reel/Frame 071724/0284 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: R. HEWEN & CO., LLC
To: ARTIFICIAL INTELLIGENCE IMAGING ASSOCIATION, INC.
Reel/Frame 071724/0575 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2023
From: JIN, HAN; ROWELL, ADAM
To: BLUWHALE AI, INC.
Reel/Frame 064201/0636 →
Continuity (3)
Provisional Application 62154703 · Apr 29, 2015
Provisional Application 62328011 · Apr 27, 2016
Related Publication 20160330430A1 · Nov 10, 2016