IP Library Granted Patent US 10,356,316
Granted Patent B2
US 10,356,316 · App. 14/370,268 · Granted Jul 16, 2019

Panoramic camera

Inventor: Jean-Claude Artonne (Montréal, CA)
Assignee: 6115187 Canada
H04N5/23238H04N5/2252H04N5/23293H04N5/2628
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,316
App. No.
14/370,268
Granted
Jul 16, 2019
Kind
B2
Abstract

A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Claims (36)

1. A space orientation-based panoramic camera comprising a device for obtaining an indication of (i) an orientation of an optical axis of the lens of the panoramic camera relative to a horizon line and (ii) a relative position of the panoramic camera about the optical axis when capturing a panoramic image, the captured panoramic image having perspective and/or geometrical distortion, and to generate information in order to produce a processed image to be displayed or printed where the processed image to be displayed or printed has the perspective and/or geometrical distortion at least partially corrected and corresponds to a strip of the panoramic image shot by the camera, the generating information including discriminating between three subcategories of strip type to automatically select a strip type as a function of the determined relative orientation of the optical axis and the relative position of the panoramic camera about the optical axis at the time the panoramic image was captured, the three subcategories of strip type being:

(a) a frontal vision with first priority type having a greater extent in a direction parallel to the horizon line than in a direction perpendicular to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a first relative position about the optical axis,

(b) a frontal vision with second priority type having a greater extent in the direction perpendicular to the horizon line than in the direction parallel to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a second relative position about the optical axis, and

(c) a peripheral/circular vision type having a circular or peripheral strip when the orientation of the optical axis is generally perpendicular to the horizon line.

2. A camera according to claim 1 , wherein the camera is configured to store the panoramic image with orientation data, whereby the image to be displayed or printed using the indication of the orientation can be done externally to the camera.

3. A camera according to claim 1 , wherein the device for obtaining an indication of the orientation comprises an accelerometer.

4. A camera according to claim 1 , wherein the device for obtaining an indication of the orientation comprises a magnetic field sensor for reading the earth's magnetic field.

5. A camera according to claim 1 , wherein said lens is a wide-angle lens capturing a field of view that is essentially at least a hemisphere.

6. A system for displaying an image from a panoramic image comprising:

a panoramic camera according to claim 1 , and further comprising a wireless communications device for communicating to a display device data representing said indication and a panoramic image;

a display device having a wireless communications device for receiving said data, and a processor for generating a display image from said panoramic image selected using said indication.

7. A method for generating a displayable image from a selected portion of a panoramic image from a space orientation-based panoramic camera having an optical system characterised by an optical axis, the panoramic image from the camera having perspective and/or geometrical distortion, the method for generating the displayable image comprising:

producing an indication of a (i) a relative orientation of the optical axis of the optical system with respect to a horizon line and (ii) a relative position of the panoramic camera about the optical ax is during capture of the panoramic image by using a spatial orientation device;

interpreting the indication of the orientation of the optical axis of the optics systems and the relative position of the panoramic camera about the optical axis at the time of capture of the panoramic image by using an interpretation unit;

selecting a portion of the panoramic image captured by the camera, by using the interpretation unit, to discriminate between three subcategories of strip type according to the indication of the orientation of the optical axis of the optics system and the relative position of the panoramic camera about the optical axis at the time the panoramic image was captured, the three subcategories of strip type being:

(a) a frontal vision with first priority type having a greater extent in a direction parallel to the horizon line than in a direction perpendicular to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a first relative position about the optical axis,

(b) a frontal vision with second priority type having a greater extent in the direction perpendicular to the horizon line than in the direction parallel to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a second relative position about the optical axis, and

(c) a peripheral/circular vision type having a circular or peripheral strip when the orientation of the optical axis is generally perpendicular to the horizon line; and

processing the selected portion of the panoramic image shot by the camera to generate the displayable image and at least partially correct the perspective and/or geometrical distortion, generating the displayable.

8. The method according to claim 7 , wherein the circular strip is defined as a 360° peripheral strip.

9. The method according to claim 7 , further comprising associating metadata with the image.

10. The method according to claim 7 , further comprising using processing software for mitigating geometric distortions.

11. The method according to claim 7 , further comprising:

providing the panoramic camera with a display device;

providing the panoramic camera with an accelerometer;

configuring the panoramic camera so that a shake movement in a first direction is interpreted as a forward command and a shake movement in a second direction is interpreted as a backward command;

placing the panoramic camera in a shake-detection mode; and

controlling displaying stored images on the display device by imparting the panoramic camera a shake in the first or second direction;

wherein the forward command causes the next stored image to be displayed and the backward command causes the previous stored image to be displayed.

12. A method for generating a displayable video from a video shot by a space orientation-based panoramic camera having an optical system characterised by an optical axis, the panoramic video from the camera having perspective and/or geometrical distortion, the method for generating the displayable video comprising:

producing an indication of (i) a relative orientation of the optical axis of the optical system with respect to a horizon line and (ii) a relative position of the panoramic camera about the optical axis during the shooting of the video by the panoramic camera by using a spatial orientation device;

interpreting an intent of a user of the panoramic camera based on the indication of the orientation of the optical axis of the optics system and the relative position of the panoramic camera about the optical axis at the time the video was shot by the panoramic camera by using an interpretation unit, the intention of the user being interpreted by discriminating between three modes, the three modes being:

(a) a frontal vision with first priority type having a greater extent in a direction parallel to the horizon line than in a direction perpendicular to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a first relative position about the optical axis,

(b) a frontal vision with second priority type having a greater extent in the direction perpendicular to the horizon line than in the direction parallel to the horizon line when the orientation of the optical axis is generally parallel to the horizon line and the panoramic camera has a second relative position about the optical axis, and

(c) a peripheral/circular vision type having a circular or peripheral strip when the orientation of the optical axis is generally perpendicular to the horizon line; and

dewarping the video shot by the panoramic camera according to the intent of the user as interpreted by the interpretation device in order to generate the displayable video with the perspective and/or geometrical distortion at least partially corrected.

Assignments (5)
CHANGE OF NAME Recorded Jul 10, 2019
From: 6115187 CANADA, INC.
To: IMMERVISION, INC.
Reel/Frame 050878/0639 →
SECURITY INTEREST Recorded Jun 28, 2019
From: IMMERVISION INC.
To: BRIDGING FINANCE INC.
Reel/Frame 049634/0352 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2019
From: TAMAGGO, INC.
To: 6115187 CANADA, D/B/A IMMERVISION
Reel/Frame 048802/0207 →
SECURITY INTEREST Recorded Jul 11, 2016
From: IMMERVISION INC.
To: ACG 360 L.P.
Reel/Frame 039299/0539 →
SECURITY INTEREST Recorded Nov 27, 2015
From: 6115187 CANADA INC.
To: ACG 360 L.P.; ACG 360 GENERAL PARTNER INC.
Reel/Frame 037161/0249 →
Priority Claims (1)
CA 2763649 · Jan 6, 2012 · national
Continuity (1)
Related Publication 20140340473A1 · Nov 20, 2014
Cited By (1)
US 12,333,693