IP Library Granted Patent US 9,583,133
Granted Patent B2
US 9,583,133 · App. 14/402,633 · Granted Feb 28, 2017

Image generation device and image generation method for multiplexing captured images to generate an image stream

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,583,133
App. No.
14/402,633
Granted
Feb 28, 2017
Kind
B2
Abstract

Frame memories store captured images supplied from a plurality of imaging units, respectively. A motion detection portion detects the motion of a captured image of at least one of the imaging units. A mode determination portion sets, in accordance with at least either the amount of the motion detected by the motion detection portion or a power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently. A control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

Claims (38)

1. An image generation device comprising:

a plurality of frame memories adapted to store captured images from a plurality of imaging units; and

a multiplexing section adapted to read the captured images of the imaging units from the frame memories and multiplex the captured images to generate an image stream,

wherein the multiplexing section includes

a motion detection portion adapted to detect a motion of a captured image of at least one of the imaging units,

a mode determination portion adapted to set, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

a control signal generation portion adapted to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

2. The image generation device of claim 1 further comprising

a shooting control section adapted to control operations of the plurality of imaging units,

wherein the shooting control section supplies, to the plurality of imaging units, a control signal adapted to operate the plurality of imaging units simultaneously or intermittently in accordance with the mode set by the mode determination portion.

3. The image generation device of claim 2 ,

wherein, even when the mode for operating the plurality of imaging units intermittently is set by the mode determination portion, the control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to operate the plurality of frame memories intermittently while operating the plurality of imaging units simultaneously.

4. The image generation device of claim 1 , wherein

the mode determination portion sets the mode for operating the plurality of imaging units simultaneously when the amount of the motion detected by the motion detection portion is equal to or greater than a given threshold, and

the mode determination portion sets the mode for operating the plurality of imaging units intermittently when the amount of the motion detected by the motion detection portion is smaller than the given threshold.

5. The image generation device of claim 4 , wherein,

even when the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, but when the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently, and

when the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, and when the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously.

6. The image generation device of claim 1 , wherein,

when the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and

when the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

7. The image generation device of claim 1 , wherein,

when the image generation device is operating on power from an external power source, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and

when the image generation device is operating on power from a built-in chargeable battery, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

8. An image generation method comprising:

storing captured images from a plurality of imaging units in a plurality of frame memories; and

reading the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,

wherein the reading includes

detecting a motion of a captured image of at least one of the imaging units,

setting, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

supplying, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.

9. A non-transitory, computer-readable recording medium storing a program for a computer, the program comprising:

a module configured to store captured images from a plurality of imaging units in a plurality of frame memories; and

a module configured to read the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,

wherein the module configured to read includes

a module configured to detect a motion of a captured image of at least one of the imaging units,

a module configured to set, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and

a module configured to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
CHANGE OF NAME Recorded Dec 27, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 040773/0200 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2016
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 040773/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2014
From: HIRATA, SHINICHI; OSAWA, HIROSHI; FURUMURA, KYOKO
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 034224/0277 →