IP Library Granted Patent US 9,892,514
Granted Patent B2
US 9,892,514 · App. 14/511,579 · Granted Feb 13, 2018

Post-manufacture camera calibration

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,892,514
App. No.
14/511,579
Granted
Feb 13, 2018
Kind
B2
Abstract

Some embodiments include a method of operating a calibration server for a camera module. The method can include: receiving, by the computing server, a first training image taken by the camera module in a mobile device and a corresponding image-context attribute from the mobile device; aggregating, by the computing device, the first training image into a set of contextually similar images based on the image-context attribute; computing a calibration parameter model based on the set of contextually similar images utilizing dimension reduction statistical analysis; and scheduling to update the calibration parameter model to configure an image processor to adjust a raw photograph of the camera module according to the calibration parameter model.

Claims (38)

1. A computer-implemented method comprising:

receiving, at a computer server system from a mobile device, a first training image taken by a camera module of the mobile device and an image-context attribute describing a context associated with the first training image, wherein the image-context attribute is separate from the first training image;

adding, by the computer server system, the first training image into a sub-group of training images in accordance with a similarity based, at least in part, on the image-context attribute;

in response to determining that a training set of images including the sub-group provides a threshold amount of data samples to compute a calibration parameter model, computing, by the computer server system, the calibration parameter model based, at least in part, on the sub-group of training images utilizing dimension reduction statistical analysis, wherein the calibration parameter model configures at least an image adjustment process corresponding to the image-context attribute and wherein the image adjustment process is configured to define how to post-process a raw photograph after being captured by the camera module; and

causing, by the computer server system, an image processor to calibrate the raw photograph of the camera module by providing the calibration parameter model to the image processor.

2. The computer-implemented method of claim 1 , further comprising providing a current version of the calibration parameter model to the image processor for deployment; and wherein the image processor is part of the mobile device; and wherein the image processor is configured to process raw photographs taken by the camera module prior to saving or displaying the raw photographs.

3. The computer-implemented method of claim 1 , wherein the image processor is part of the computer server system that performs said computing of the calibration parameter model; wherein the computing server system is configured as an online storage of raw photographs taken by the camera module of the mobile device; and wherein the image processor is configured to adjust automatically the raw photographs in the online storage and subsequently uploaded photographs according to the calibration parameter model.

4. The computer-implemented method of claim 1 , wherein the image processor is part of an external server separate from the computer server system and the mobile device; and further comprising:

receiving, at the external server, the raw photograph taken by the camera module from the mobile device; and

processing, by the external server, the raw photograph based on the calibration parameter model to present in a network accessible interface.

5. The computer-implemented method of claim 1 , wherein computing the calibration parameter model is in response to receiving the first training image.

6. The computer-implemented method of claim 1 , wherein computing the calibration parameter model is according to a preset schedule.

7. The computer-implemented method of claim 1 , further comprising:

adjusting a test image based on a current version of the calibration parameter model to determine whether the calibration parameter model has improved in accuracy over a previous version of the calibration parameter; and

wherein providing the calibration parameter model for the image processor is in response to determining that the current version has improved in accuracy.

8. The computer-implemented method of claim 1 , wherein the first training image is a low spatial frequency image.

9. A non-transitory computer-readable data storage medium storing computer-executable instructions that, when executed, cause a computer system to perform a computer-implemented method, the computer-executable instructions comprising:

instructions for receiving, at a computer server system from a mobile device, a first training image taken by a camera module of the mobile device and an image-context attribute describing a context associated with the first training image, wherein the image-context attribute is separate from the first training image;

instructions for adding, by a computer server system, the first training image into a sub-group of training images in accordance with a similarity based, at least in part, on the image-context attribute;

instructions for in response to determining that a training set of images including the sub-group provides a threshold amount of data samples to compute a calibration parameter model, computing, by the computer server system, the calibration parameter model based, at least in part, on the subgroup of training images utilizing dimension reduction statistical analysis, wherein the calibration parameter model configures at least an image adjustment process corresponding to the image-context attribute and wherein the image adjustment process is configured to define how to post-process a raw photograph after being captured by the camera module; and

instructions for causing, by a computer server system, an image processor to calibrate the raw photograph of the camera module by providing the calibration parameter model to the image processor.

10. The non-transitory computer-readable data storage medium of claim 9 , wherein the computer-executable instructions further comprises instructions for providing a current version of the calibration parameter model to the image processor for deployment; and wherein the image processor is part of the mobile device; and wherein the image processor is configured to process raw photographs taken by the camera module prior to saving or displaying the raw photographs.

11. The non-transitory computer-readable data storage medium of claim 9 , wherein the image processor is part of the computer server system that performs said computing of the calibration parameter model; wherein the computing server system is configured as an online storage of raw photographs taken by the camera module of the mobile device; and wherein the image processor is configured to adjust automatically the raw photographs in the online storage and subsequently uploaded photographs according to the calibration parameter model.

12. The non-transitory computer-readable data storage medium of claim 9 , wherein the image processor is part of an external server separate from the computer server system and the mobile device; and wherein the computer-executable instructions further comprises:

instructions for receiving, at the external server, the raw photograph taken by the camera module from the mobile device; and

instructions for processing, by the external server, the raw photograph based on the calibration parameter model to present in a network accessible interface.

13. The non-transitory computer-readable data storage medium of claim 9 , wherein computing the calibration parameter model is in response to receiving the first training image.

14. The non-transitory computer-readable data storage medium of claim 9 , wherein computing the calibration parameter model is according to a preset schedule.

15. The non-transitory computer-readable data storage medium of claim 9 , wherein the computer-executable instructions further comprises:

instructions for adjusting a test image based on a current version of the calibration parameter model to determine whether the calibration parameter model has improved in accuracy over a previous version of the calibration parameter; and

wherein providing the calibration parameter model for the image processor is in response to determining that the current version has improved in accuracy.

16. A computer system, comprising:

a non-transitory memory device configured to store executable instructions;

a processor configured by the executable instructions to:

receive, from a mobile device, a first training image taken by a camera module of the mobile device and an image-context attribute describing a context associated with the first training image, wherein the image-context attribute is separate from the first training image;

add the first training image into a sub-group of training images in accordance with a similarity based, at least in part, on the image-context attribute;

in response to determining that a training set of images including the sub-group provides a threshold amount of data samples to compute a calibration parameter model, compute the calibration parameter model based, at least in part, on the sub-group of training images utilizing dimension reduction statistical analysis, wherein the calibration parameter model configures at least an image adjustment process corresponding to the image-context attribute and wherein the image adjustment process is configured to define how to post-process a raw photograph after being captured by the camera module; and

cause an image processor to calibrate the raw photograph of the camera module by providing the calibration parameter model to the image processor.

Assignments (2)
CHANGE OF NAME Recorded Jan 27, 2022
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058871/0336 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2015
From: MAGUIRE, YAEL; SHEN, SHIZHE
To: FACEBOOK, INC.
Reel/Frame 035074/0803 →