Methods and apparatus for receiving and/or using reduced resolution images
Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.
1. A method of operating a content playback device, the method comprising:
storing a plurality of texture maps corresponding to different resolution allocations, different resolution allocations corresponding to different patterns of non-uniform image downsampling;
receiving a first encoded image, said first encoded image representing a first image in encoded form, said first image including at least a first image portion that was downsampled in accordance with a first resolution allocation and a second image portion which, in accordance with said first resolution allocation, was left at full resolution or subject to a lesser amount of resolution reduction than said first image portion;
receiving information indicating which of said plurality of texture maps is to be used with the first image, said information identifying a first texture map corresponding to said first resolution allocation, different texture maps in said plurality of texture maps corresponding to different resolution allocations;
decoding the first encoded image to recover said first image;
using the first texture map corresponding to the first resolution allocation to apply at least the first image portion of said first image to a surface of a first portion of a model of an environment to generate a first rendered image; and
outputting the first rendered image to a display device.
2. The method of claim 1 , further comprising:
receiving a second encoded image, said second encoded image representing a second image in encoded form, said second image including at least a third image portion that was downsampled in accordance with a second resolution allocation and an additional image portion which, in accordance with said second resolution allocation, was left at full resolution or subject to a lesser amount of resolution reduction than said third image portion;
decoding the second encoded image to recover the second image; and
using a second texture map corresponding to a second resolution allocation to apply at least the third image portion of said third image to the surface of the first portion of the model of the environment to generate an additional rendered image; and
outputting the additional rendered image to the display.
3. The method of claim 2 , wherein storing a plurality of texture maps includes:
storing said first texture map and said second texture map in memory in said content playback device prior to receiving said first and second encoded images.
4. The method of claim 2 , further comprising:
receiving, prior to using the second texture map, a second indicator indicating that the second texture map in said plurality of texture maps is to be used with the second image.
5. The method of claim 2 , wherein said different patterns of non-uniform image downsampling correspond to patterns which when used for downsampling control downsampling on different portions of an image by different amounts, said first portion of said first image having been downsampled by a first amount, said third image portion of the second image or said additional image portion of said second image having been downsampled in accordance with said second resolution allocation by a different amount than said first amount.
6. The method of claim 2 , wherein said different patterns of non-uniform image downsampling correspond to patterns which when used for downsampling control downsampling on different portions of an image by different amounts, said first portion of said first image having been downsampled by a first amount, said third image portion of the second image having been downsampled in accordance with said second resolution allocation by a different amount than said first amount.
7. The method of claim 1 , wherein said information indicating which of said plurality of texture maps is to be used with the first image is a first indicator identifying the first texture map.
8. The method of claim 1 , wherein said different patterns of non-uniform image downsampling correspond to patterns which when used for downsampling control downsampling on different portions of an image by different amounts.
9. A content playback device comprising:
a memory storing a plurality of texture maps corresponding to different resolution allocations, different resolution allocations corresponding to different patterns of non-uniform image downsampling;
a receiver;
a decoder;
a processor, said processor configured to control said content playback device to:
i) receive a first encoded image, said first encoded image representing a first image in encoded form, said first image including at least a first image portion that was downsampled in accordance with a first resolution allocation and a second image portion which, in accordance with said first resolution allocation, was left at full resolution or subject to a lesser amount of resolution reduction than said first image portion;
ii) receive information indicating which of said plurality of texture maps is to be used with the first image, said information identifying a first texture map corresponding to said first resolution allocation, different texture maps in said plurality of texture maps corresponding to different resolution allocations;
iii) decode the first encoded image to recover said first image; and
iv) use the first texture map corresponding to the first resolution allocation to apply at least the first image portion of said first image to a surface of a first portion of a model of an environment to generate a first rendered image; and
a display for displaying images rendered by the processor.
10. The content playback device of claim 9 ,
wherein said processor is further configured to control said content playback device to store said first texture map and said second texture map in said memory.
11. The content playback device of claim 10 , wherein said information indicating which of said plurality of texture maps is to be used with the first image is a first indicator identifying the first texture map.
12. The content playback device of claim 11 , wherein the processor is further configured to control the content playback device to:
receive a second encoded image, said second encoded image representing a second image in encoded form, said second image including at least a third image portion that was downsampled in accordance with a second resolution allocation and an additional image portion which, in accordance with said second resolution allocation, was left at full resolution or subject to a lesser amount of resolution reduction than said third image portion;
decode the second encoded image to recover the second image; and
use a second texture map corresponding to the second resolution allocation to apply at least the third image portion of said second image to the surface of the first portion of the model of the environment to generate an additional rendered image.
13. The content playback device of claim 12 , wherein said processor is further configured to control said content playback device to receive a second indicator indicating which of the plurality of texture maps corresponding to different resolution allocations is to be used with the second image, said second indicator identifying the second texture map.
14. A non-transitory computer readable medium comprising processor executable instructions, which when executed by a processor, control a content playback device to:
store a plurality of texture maps corresponding to different resolution allocations, different resolution allocations corresponding to different patterns of non-uniform image downsampling;
receive a first encoded image, said first encoded image representing a first image in encoded form, said first image including at least a first image portion that was downsampled in accordance with a first resolution allocation and a second image portion which, in accordance with said first resolution allocation, was left at full resolution or subject to a lesser amount of resolution reduction than said first image portion;
receive information indicating which of said plurality of texture maps is to be used with the first image, said information identifying a first texture map corresponding to said first resolution allocation, different texture maps in said plurality of texture maps corresponding to different resolution allocations;
decode the first encoded image to recover said first image;
use the first texture map corresponding to the first resolution allocation to apply at least the first image portion of said first image to a surface of a first portion of a model of an environment to generate a first rendered image; and
display the first rendered image on a display.