IP Library Patent Application 14576298
Patent Application
App. No. 14/576,298

SYSTEM, METHOD, AND COMPUTER PROGRAM PRODUCT FOR DETERMIING A FRONT FACING VIEW OF AND CENTERING AN OMNIDIRECTIONAL IMAGE

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/576,298
Abstract

The invention is directed to systems, methods and computer program products for determining a front facing view for a camera and centering an omnidirectional image captured by the camera. An exemplary method comprises determining motion of the camera; determining an azimuthal angle and a polar angle for the camera based on the motion; determining the front facing view based on the azimuthal angle and the polar angle; capturing the image based on the front facing view; segmenting the image into at least two sections; calculating an average motion vector for each section; determining two sections with mirrored motion vectors having substantially equal magnitude; and centering the image based on the two sections with mirrored motion vectors.

Claims (48)

1 . A method for determining a front facing view for a camera and centering an omnidirectional image captured by the camera, the method comprising:

determining motion of the camera;

determining an azimuthal angle and a polar angle for the camera based on the motion;

determining the front facing view based on the azimuthal angle and the polar angle;

capturing the image based on the front facing view;

segmenting the image into at least two sections;

calculating an average motion vector for each section;

determining two sections with mirrored motion vectors having substantially equal magnitude; and

centering the image based on the two sections with mirrored motion vectors.

2 . The method of claim 1 , wherein the motion is equal to or greater than a threshold motion.

3 . The method of claim 1 , further comprising determining gyroscope information for a gyroscope in the camera.

4 . The method of claim 3 , wherein the azimuthal angle and the polar angle are determined further based on the gyroscope information.

5 . The method of claim 1 , further comprising determining an adjustment that needs to be made to the azimuthal angle and the polar angle based on an amount of the motion.

6 . The method of claim 1 , further comprising determining compass information for a compass in the camera.

7 . The method of claim 6 , wherein the front facing view is determined further based on the compass information.

8 . The method of claim 1 , further comprising determining a direction of motion of an area associated with the front facing view.

9 . The method of claim 8 , further comprising determining a direction of motion of an area to the left or right of the area associated with the front facing view from the perspective of the camera.

10 . The method of claim 1 , wherein the front facing view is front facing from a perspective of the camera.

11 . The method of claim 1 , wherein the front facing view is determined before or at the time of capturing the image.

12 . The method of claim 1 , further comprising smoothing the image using a smoothing filter in the camera.

13 . The method of claim 1 , wherein the average motion vector is calculated either in the spatial domain or in the Fourier domain.

14 . The method of claim 1 , wherein the camera comprises a six axis gyroscope, wherein three of six axes are for determining a linear motion of the camera and a remaining three of the six axes are for determining a rotational motion of the camera.

15 . The method of claim 1 , wherein the front facing view is determined with an amount of power less than a threshold power when the camera has motion less than a threshold amount of motion, and wherein the front facing view is determined with an amount of power greater than the threshold power when the camera has motion greater than the threshold amount of motion.

16 . The method of claim 1 , wherein the camera comprises at least two cameras.

17 . The method of claim 1 , wherein the camera is comprised in at least one of a mobile computing device, a non-mobile computing device, a mobile phone, a television, a watch, or a tablet computing device.

18 . An apparatus for determining a front facing view for a camera and centering an omnidirectional image captured by the camera, the apparatus comprising:

a memory;

a processor; and

a module stored in the memory, executable by the processor, and configured to:

determine motion of the camera;

determine an azimuthal angle and a polar angle for the camera based on the motion;

determine the front facing view based on the azimuthal angle and the polar angle;

capture the image based on the front facing view;

segment the image into at least two sections;

calculate an average motion vector for each section;

determine two sections with mirrored motion vectors having substantially equal magnitude;

center the image based on the two sections with mirrored motion vectors.

19 . The apparatus of claim 18 , further comprising a gyroscope, a smoothing filter, and a compass.

20 . A computer program product for determining a front facing view for a camera and centering an omnidirectional image captured by the camera, the computer program product comprising:

a non-transitory computer-readable medium comprising a set of codes for causing a computer to:

determine motion of the camera;

determine an azimuthal angle and a polar angle for the camera based on the motion;

determine the front facing view based on the azimuthal angle and the polar angle;

capture the image based on the front facing view;

segment the image into at least two sections;

calculate an average motion vector for each section;

determine two sections with mirrored motion vectors having substantially equal magnitude;

center the image based on the two sections with mirrored motion vectors.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2016
From: SONY CORPORATION
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 038542/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2015
From: STANKOVIC, BORIS
To: SONY CORPORATION
Reel/Frame 034760/0115 →