IP Library Granted Patent US 10,805,593
Granted Patent B2
US 10,805,593 · App. 16/708,420 · Granted Oct 13, 2020

Methods and apparatus for receiving and/or using reduced resolution images

Inventors: David Cole (Aliso Viejo, CA); Alan McKay Moss (Laguna Beach, CA); Hector M Medina (Laguna Beach, CA)
Assignee: Nevermind Capital LLC
H04N13/189G06T15/04G06T17/20H04N5/23238H04N13/106H04N13/139H04N13/161H04N13/194H04N13/243H04N13/275H04N13/279H04N19/136H04N19/172H04N19/44H04N19/597H04N21/2387H04N21/234363H04N21/42653H04N21/435H04N21/437H04N21/44016H04N21/472H04N21/816H04N21/8146G06T2215/12H04N2013/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,805,593
App. No.
16/708,420
Granted
Oct 13, 2020
Kind
B2
Abstract

Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

Claims (20)

1. A method of communicating information to be used to represent an environment, the method comprising: operating a content delivery system to communicate to a content playback device, via a network interface, a first image map mapping portions of a first frame to segments of an environmental model, said first image map allocating different size portions of the first frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said environmental model; operating the content delivery system to communicate the first frame, including at least a portion of a first image to be mapped to said environmental model using said first image map, to the content playback device, said first frame corresponding to a first time; operating the content delivery system to communicate to the content playback device, via the network interface, a second image map mapping portions of a second frame to segments of the environmental model, said second image map allocating different size portions of the second frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said environmental model, said second image map allocating a different number of pixels to a first segment of said environmental model than are allocated by said first image map.

2. The method of claim 1 , further comprising:

operating the content delivery system to communicate the second frame, including at least a portion of a second image to be mapped to said environmental model using said second image map, to the content playback device.

3. The method of claim 2 , wherein said first frame and second frame correspond to different times; and

wherein a different portion of an environment to which the first and second frames correspond is important at the different times, said first and second image maps providing different resolution allocations to provide higher resolution to the important portion of the environment for each of said different times.

4. The method of claim 2 , wherein said first and second frames include the same number of pixels.

5. The method of claim 2 , wherein said first and second image maps are communicated in a content stream that includes said first and second frames.

6. The method of claim 2 , further comprising: p 1 operating the content delivery system to select a first resolution reduction operation to be performed on a first captured image to produce said first image; and

operating the content delivery system to select a second resolution reduction operation to be performed on a second captured image to produce said second image, said second resolution operation being different from said first resolution reduction operation.

7. The method of claim 6 , wherein the first and second images correspond to the same portion of the environment.

8. A content delivery system including a network interface and a processor, said processor being configured to control the content delivery system to:

communicate to a content playback device, via a network interface, a first image map mapping portions of a first frame to segments of an environmental model, said first image map allocating different size portions of the first frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said environmental model; communicate the first frame, including at least a portion of a first image to be mapped to said environmental model using said first image map, to the content playback device, said first frame corresponding to a first time; and communicate to the content playback device, via the network interface, a second image map mapping portions of a second frame to segments of the environmental model, said second image map allocating different size portions of the second frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said model, said second image map allocating a different number of pixels to a first segment of said model than are allocated by said first image map.

9. The content delivery system of claim 8 , wherein said processor is further configured to control the content delivery system to:

communicate the second frame including at least a portion of a second image to be mapped to said environmental model using said second image map to the content playback device.

10. The content delivery system of claim 9 , wherein said first frame and second frame correspond to different times; and

wherein a different portion of an environment to which the first and second frames correspond is important at the different times, said first and second image maps providing different resolution allocations to provide higher resolution to the important portion of the environment for each of said different times.

11. The content delivery system of claim 9 , wherein said first and second image maps map different numbers of pixels to an area corresponding to the same portion of an environment thereby providing different resolution allocations for said same portion of the environment based on which of the first and second image maps are used.

12. The content delivery system of claim 9 , wherein the content delivery system includes a server providing a real time content stream while an event is ongoing.

13. A non-transitory computer readable medium comprising processor executable instructions, which when executed by a processor, control a content delivery system to: communicate to a content playback device, via a network interface, a first image map mapping portions of a first frame to segments of an environmental model, said first image map allocating different size portions of the first frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said model; communicate the first frame, including at least a portion of a first image to be mapped to said environmental model using said first image map, to the content playback device, said first frame corresponding to a first time; and communicate to the content playback device, via the network interface, a second image map mapping portions of a second frame to segments of the environmental model, said second image map allocating different size portions of the second frame to different segments of the environmental model thereby allocating different numbers of pixels to different segments of said environmental model, said second image map allocating a different number of pixels to a first segment of said environmental model than are allocated by said first image map.

14. The non-transitory computer readable medium of claim 13 , further including processor executable instructions, which when executed by a processor, control the content delivery system to: communicate the second frame including at least a portion of a second image to be mapped to said environmental model using said second image map to the content playback device.

Assignments (3)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 7, 2020
From: NEXTVR INC.
To: NEVERMIND CAPITAL LLC
Reel/Frame 053139/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2019
From: COLE, DAVID; MOSS, ALAN MCKAY; MEDINA, HECTOR M
To: NEXTVR INC.
Reel/Frame 051266/0965 →
CHANGE OF ADDRESS Recorded Dec 12, 2019
From: NEXTVR INC.
To: NEXTVR INC.
Reel/Frame 051283/0507 →
Continuity (7)
Continuation 16035459 · Jul 13, 2018
Continuation 15672236 · Aug 8, 2017
Division 15046327 · Feb 17, 2016
Provisional Application 62296065 · Feb 16, 2016
Provisional Application 62262374 · Dec 2, 2015
Provisional Application 62117427 · Feb 17, 2015
Related Publication 20200186779A1 · Jun 11, 2020