IP Library Granted Patent US 10,257,492
Granted Patent B2
US 10,257,492 · App. 15/121,518 · Granted Apr 9, 2019

Image encoding and display

Inventors: Sharwin Winesh Raghoebardajal (London, GB); Ian Henry Bickerstaff (London, GB)
Assignee: Sony Interactive Entertainment Europe Limited
H04N13/161H04N13/10H04N13/122H04N13/156H04N13/189H04N13/194H04N13/332H04N13/366H04N19/132H04N19/167H04N19/17H04N21/440245H04N21/4728H04N21/816H04N13/344H04N19/597H04N2013/0074H04N2213/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,257,492
App. No.
15/121,518
Granted
Apr 9, 2019
Kind
B2
Abstract

An image encoding method includes, for each of left and right images of an image stereo pair, identifying a region of interest (ROI) in an input image, generating multiple representations of that input image such that one representation is a high field of view (FOV) representation including substantially all of the input image and another representation is a low FOV representation having a lower FOV than the high FOV representation and including at least the ROI. The relationship between pixel resolution and image size for the high and low FOV representations is such that, in relation to the ROI, the low FOV representation provides more image detail than the high FOV representation. The method also includes generating one or more multiplexed images by juxtaposing portions of the left and right, high and low FOV representations so as to include all image content thereof in fewer than four multiplexed images.

Claims (24)

1. An image encoding method comprising:

for each of a left and a right image of a stereo pair of images, identifying, in an input image, a region of interest;

generating, by one or more processors, at least two image representations of that input image, such that one of the image representations is a high field of view (FOV) image representation including substantially all of the input image, and another of the image representations is a low FOV image representation having a lower FOV than the high FOV image representation and including at least the region of interest;

in which a relationship between pixel resolution and image size for the high FOV image representation and the low FOV image representation is such that, in relation to the region of interest, the low FOV image representation provides a higher amount of image detail than the high FOV image representation;

generating, by the one or more processors, one or more multiplexed images by juxtaposing at least portions of the left and right, high FOV and low FOV image representations, so as to include all image content of the left and right, high FOV and low FOV image representations in fewer than four multiplexed images; and

performing one or both of transmitting or storing the multiplexed images;

in which generating the one or more multiplexed images comprises generating a first multiplexed image by juxtaposing a whole of a first one of the left and right, high FOV and low FOV image representations next to a whole of a second one of the left and right, high FOV and low FOV image representations, and generating a second multiplexed image by juxtaposing a whole of a third one of the left and right, high FOV and low FOV image representations next to a whole of a fourth one of the left and right, high FOV and low FOV image representations.

2. A method according to claim 1 , in which the performing step comprises one or both of transmitting or storing the multiplexed images at a higher image repetition rate than an image repetition rate of the input images.

3. A method according to claim 1 , in which performing step comprises one or both of transmitting or storing the multiplexed images as respective left and right dummy 3D images.

4. A non-transitory computer readable storage medium storing computer readable instructions thereon, the instructions, when executed by one or more processors, casing the one or more processors to perform an image encoding method, the method comprising:

for each of a left and a right image of a stereo pair of images, identifying, in an input image, a region of interest;

generating at least two image representations of that input image, such that one of the image representations is a high field of view (FOV) image representation including substantially all of the input image, and another of the image representations is a low FOV image representation having a lower FOV than the high FOV image representation and including at least the region of interest;

in which a relationship between pixel resolution and image size for the high FOV image representation and the low FOV image representation is such that, in relation to the region of interest, the low FOV image representation provides a higher amount of image detail than the high FOV image representation;

generating one or more multiplexed images by juxtaposing at least portions of the left and right, high FOV and low FOV image representations, so as to include all image content of the left and right, high FOV and low FOV image representations in fewer than four multiplexed images; and

performing one or both of transmitting or storing the multiplexed images;

in which generating the one or more multiplexed images comprises generating a first multiplexed image by juxtaposing a whole of a first one of the left and right, high FOV and low FOV image representations next to a whole of a second one of the left and right, high FOV and low FOV image representations, and generating a second multiplexed image by juxtaposing a whole of a third one of the left and right, high FOV and low FOV image representations next to a whole of a fourth one of the left and right, high FOV and low FOV image representations.

5. An image encoding apparatus comprising:

a representation generator configured, for each of a left and a right image of a stereo pair of images, to:

identify, in an input image, a region of interest; and

generate at least two image representations of the input image, such that one of the representations is a high field of view (FOV) image representation including substantially all of the input image, and another of the image representations is a low FOV image representation having a lower FOV than the high FOV image representation and including at least the region of interest; in which a relationship between pixel resolution and image size for the high FOV image representation and the low FOV image representation is such that, in relation to the region of interest, the low FOV image representation provides a higher amount of image detail than the high FOV image representation;

a multiplexer operatively coupled to the representation generator and configured to generate one or more multiplexed images by juxtaposing at least portions of the left and right, high FOV and low FOV image representations, so as to include all image content of the left and right, high FOV and low FOV image representations in fewer than four multiplexed images; and

an image output operatively coupled to the multiplexer and configured to output the multiplexed images;

in which the representation generator is configured to generate the one or more multiplexed images by generating a first multiplexed image by juxtaposing a whole of a first one of the left and right, high FOV and low FOV image representations next to a whole of a second one of the left and right, high FOV and low FOV image representations, and by generating a second multiplexed image by juxtaposing a whole of a third one of the left and right, high FOV and low FOV image representations next to a whole of a fourth one of the left and right, high FOV and low FOV image representations.

6. The image encoding apparatus of claim 5 , wherein the image encoding apparatus is a videogame machine.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052167/0398 →
CHANGE OF NAME Recorded Jul 14, 2017
From: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
Reel/Frame 043198/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2016
From: RAGHOEBARDAJAL, SHARWIN WINESH; BICKERSTAFF, IAN HENRY
To: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
Reel/Frame 039621/0458 →
Priority Claims (1)
GB 1403379.9 · Feb 26, 2014 · national
Continuity (1)
Related Publication 20160366392A1 · Dec 15, 2016