IP Library Granted Patent US 10,706,621
Granted Patent B2
US 10,706,621 · App. 14/953,615 · Granted Jul 7, 2020

Systems and methods for processing image information

Inventor: Benjamin von Cramon (Marietta, GA)
Assignee: Photopotech LLC
G06T17/20G06K9/4661G06T7/586G06T15/60H04N5/2254H04N5/2256H04N5/232G06T2200/08G06T2207/10016G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,706,621
App. No.
14/953,615
Granted
Jul 7, 2020
Kind
B2
Abstract

Paired images of substantially the same scene are captured with the same freestanding sensor. The paired images include reflected light illuminated with controlled polarization states that are different between the separate images. A first pixel value from one of the first image and the second image is subtracted from a corresponding pixel value from a remaining one of the first image and the second image. When repeated over the raster of corresponding pixels, a modified image includes an isolated representation of substantially pure specular color data. The captured images and the modified image are stored and used to generate a model. Substantially shadow-free diffuse color and specular color data are applied to texture maps of the model to generate a virtual environment where a virtual light source can be introduced and controlled to achieve desired results absent adverse effects introduced from fixed ambient light sources used in conventional source photography.

Claims (33)

1. A method for processing image information, the method comprising:

receiving a sensor orientation, the sensor orientation defining a sensor axis;

receiving a data set responsive to a cross-polarized exposure, wherein subject matter captured in the cross-polarized exposure is illuminated with light provided by an image capture system, the light provided by the image capture system forming an angle of less than about 10 degrees from the sensor axis to provide a diffuse surface texture;

wherein the cross-polarized exposure is captured with an image-capture system fixed to a freestanding chassis;

using the diffuse surface texture in the data set and the sensor orientation to generate a UV map;

receiving a preferred orientation;

rendering a virtual environment using the preferred orientation, the three-dimensional model and color information from the data set;

receiving information characterizing a virtual light source; and

modifying the virtual environment in response to the virtual light source;

wherein information characterizing the virtual light source includes one or more of identifying a location, a luminous flux, and a frequency range.

2. The method of claim 1 , further comprising:

receiving information representative of a surface geometry of the subject matter.

3. The method of claim 1 , wherein the data set includes a set of exposures captured from more than one perspective of a scene.

4. The method of claim 1 , wherein the data set was captured using an image sensor about a meter or greater from subject matter in the cross- polarized exposure.

5. The method of claim 4 , wherein the image sensor is selected from a group responsive to visible light, non-visible light, multi-spectral light, and hyper-spectral light.

6. The method of claim 4 , wherein the freestanding chassis is coupled to a vehicle selected from the group consisting of a land-based vehicle, an underwater vehicle, a buoyant vehicle, a lighter than air vehicle and an airborne vehicle.

7. The method of claim 1 , wherein an image-capture system applies a first illumination power to illuminate the scene in coordination with an exposure that generates the cross-polarized image.

8. The method of claim 7 , wherein the image-capture system applies a second illumination power different from the first illumination power to illuminate the scene in coordination with a second exposure that generates a co-polarized image.

9. The method of claim 8 , wherein an elapsed time between separate exposures that generate the cross-polarized image and the co-polarized image is controlled.

10. A method for processing image information, the method comprising:

receiving a sensor orientation, the sensor orientation defining a sensor axis;

receiving a data set responsive to a cross-polarized exposure, wherein subject matter captured in the cross-polarized exposure is illuminated with light provided by an image capture system, the light provided by the image capture system forming an angle of less than about 10 degrees from the sensor axis to provide a diffuse surface texture;

wherein the cross-polarized exposure is captured with the image-capture system suspended from a flexible elongate member; and

using the diffuse surface texture in the data set and the sensor orientation to generate a UV map;

receiving a preferred orientation;

rendering a virtual environment using the preferred orientation, the three-dimensional model and color information from the data set;

receiving information characterizing a virtual light source; and

modifying the virtual environment in response to the virtual light source;

wherein information characterizing the virtual light source includes one or more of identifying a location, a luminous flux, and a frequency range.

11. The method of claim 10 , wherein receiving a data set is further responsive to a co-polarized exposure.

12. The method of claim 10 , wherein the three-dimensional model is used in a product selected from the group consisting of an exhibit, video game, cinematic production, and a teaching aid.

13. The method of claim 10 , wherein the cross-polarized exposure is captured with a sensor responsive to one or more of light visible to a human observer, light invisible to a human observer, multi-spectral light, and hyper-spectral light.

14. The method of claim 10 , wherein subject matter captured in the co-polarized exposure is illuminated with light provided by the image capture system forming an angle of less than about 10 degrees from the sensor axis with the sensor axis to provide a specular-surface texture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2018
From: VON CRAMON, BENJAMIN
To: PHOTOPOTECH LLC
Reel/Frame 045107/0277 →
Continuity (1)
Related Publication 20170154462A1 · Jun 1, 2017