IP Library Granted Patent US 11,388,384
Granted Patent B2
US 11,388,384 · App. 16/037,273 · Granted Jul 12, 2022

Methods and apparatus for receiving and/or using reduced resolution images

Inventors: David Cole (Aliso Viejo, CA); Alan Moss (Laguna Beach, CA); Hector Medina (Laguna Beach, CA)
Assignee: Nevermind Capital LLC
H04N13/189G06T15/04G06T17/20H04N5/23238H04N13/106H04N13/139H04N13/161H04N13/194H04N13/243H04N13/275H04N13/279H04N19/136H04N19/172H04N19/44H04N19/597H04N21/2387H04N21/234363H04N21/42653H04N21/435H04N21/437H04N21/44016H04N21/472H04N21/816H04N21/8146G06T2215/12H04N2013/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,388,384
App. No.
16/037,273
Granted
Jul 12, 2022
Kind
B2
Abstract

Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

Claims (50)

1. A content playback method comprising:

storing a mesh model of an environment having segments;

storing a plurality of image maps, each of the plurality of image maps mapping a different number of pixels to the same segment of the environment;

receiving an encoded image, captured in the environment, and an indication that the resolution of the encoded image was reduced in accordance with a first resolution allocation corresponding to a first image map of the plurality of image maps;

decoding the encoded image;

mapping the decoded image to the mesh model of the environment in accordance with the first image map to produce a first rendered image; and

displaying the first rendered image on a display device.

2. The method of claim 1 , wherein the first image map maps different numbers of pixels to different segments of the mesh model having the same size.

3. The method of claim 1 , further comprising:

identifying a region of interest in the environment;

determining whether an image captured in the environment includes the region of interest;

selecting the first resolution allocation corresponding to the first image map in response to the determination;

reducing the resolution of the image captured in the environment using the first image map to generate a reduced resolution image; and

encoding the reduced resolution image to generate the encoded image.

4. The method of claim 3 , wherein the region of interest in the environment is identified based on motion in the environment.

5. The method of claim 3 , wherein the region of interest in the environment is identified based on motion detected in one or more video streams of the environment, the one or more video streams including the image captured in the environment.

6. The method of claim 3 , wherein the region of interest in the environment is identified based on a location of an object in the environment.

7. The method of claim 3 , wherein the environment includes spectators and the region of interest in the environment is identified based on a direction that the spectators are looking.

8. The method of claim 3 , wherein the region of interest in the environment is identified based on user input.

9. The method of claim 3 , wherein the resolution of the image captured in the environment is reduced by a content delivery system using the first image map, the method further comprising:

receiving the first image map from the content delivery system.

10. The method of claim 9 , wherein mapping the decoded image in accordance with the first image map comprises:

receiving the first image map, by a content playback device, from the content delivery system; and

mapping the decoded image, by the content playback device, in accordance with the first image map.

11. A content playback device, comprising:

memory that stores a mesh model of an environment having segments and a plurality of image maps each mapping a different number of pixels to the same segment of the environment;

a network interface that receives an encoded image, captured in the environment and an indication that the resolution of the encoded image was reduced in accordance with a first resolution allocation corresponding to a first image map of the plurality of image maps;

a decoder that decodes the encoded image;

a processor that renders the decoded image by mapping the decoded image to the mesh model of the environment in accordance with the first image map to produce a first rendered image; and

a display device that displays the first rendered image.

12. The device of claim 11 , wherein the first image map maps different numbers of pixels to different segments of the mesh model having the same size.

13. The device of claim 11 , wherein:

the environment includes a region of interest; and

the encoded image is generated by reducing the resolution of an image captured in the environment to form a reduced resolution image and encoding the reduced resolution image;

the resolution of the image captured in the environment is reduced using the first map based on a determination that the encoded image includes the region of interest.

14. The device of claim 13 , wherein the region of interest in the environment is identified based on motion in the environment.

15. The device of claim 13 , wherein the region of interest in the environment is identified based on motion detected in one or more video streams of the environment, the one or more video streams including the image captured in the environment.

16. The device of claim 13 , wherein the region of interest in the environment is identified based on a location of an object in the environment.

17. The device of claim 13 , wherein the environment includes spectators and the region of interest in the environment is identified based on a direction that the spectators are looking.

18. The device of claim 13 , wherein the region of interest in the environment is identified based on user input.

19. The device of claim 13 , wherein:

the resolution of the image captured in the environment is reduced by a content delivery system using the first image map; and

the content playback device receives the first image map from the content delivery system.

20. A non-transitory computer readable storage medium storing instructions that, when executed by a content playback device, cause the content playback device to:

store a mesh model of an environment having segments;

store a plurality of image maps, each of the plurality of image maps mapping a different number of pixels to the same segment of the environment;

receive an encoded image, captured in the environment, and an indication that the resolution of the encoded image was reduced in accordance with a first resolution allocation corresponding to a first image map of the plurality of image maps;

decode the encoded image;

map the decoded image to the mesh model of the environment in accordance with the first image map to produce a first rendered image; and

display the first rendered image on a display device.

Assignments (5)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 7, 2020
From: NEXTVR INC.
To: NEVERMIND CAPITAL LLC
Reel/Frame 053139/0942 →
RELEASE OF SECURITY INTEREST Recorded May 13, 2020
From: VCAP VENTURES (BVI) LIMITED
To: NEXTVR, INC.
Reel/Frame 052657/0091 →
CHANGE OF ADDRESS Recorded Apr 9, 2019
From: NEXTVR INC.
To: NEXTVR INC.
Reel/Frame 048836/0085 →
SECURITY INTEREST Recorded Mar 29, 2019
From: NEXTVR INC.
To: VCAP VENTURES (BVI) LIMITED
Reel/Frame 048747/0128 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2018
From: COLE, DAVID; MOSS, ALAN MCKAY; MEDINA, HECTOR M
To: NEXTVR INC.
Reel/Frame 046483/0507 →
Continuity (5)
Continuation 15046331 · Feb 17, 2016
Provisional Application 62296065 · Feb 16, 2016
Provisional Application 62262374 · Dec 2, 2015
Provisional Application 62117427 · Feb 17, 2015
Related Publication 20190082161A1 · Mar 14, 2019