IP Library Granted Patent US 10,701,276
Granted Patent B2
US 10,701,276 · App. 15/841,043 · Granted Jun 30, 2020

Techniques for determining settings for a content capture device

Inventors: Brian Keith Smith (Wellington, FL); Ilya Tsunaev (Plantation, FL)
Assignee: Magic Leap, Inc.
H04N5/2352H04N5/2226H04N5/2351H04N5/2353H04N5/2355H04N5/2356H04N5/243H04N5/265H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,276
App. No.
15/841,043
Granted
Jun 30, 2020
Kind
B2
Abstract

Provided are methods, systems, and computer-program products for determining one or more settings of a content capture device. In some examples, to determine the one or more settings, luma values of pixels of an image from the content capture device may be identified. Objects in the image and information associated with the objects may also be identified. The information associated with the objects may be divided into categories of the information. And using the objects and the information, a separate weight array for each category of the information may be computed. The separate weight arrays may be combined to create a total weight array to augment the luma values. The augmented luma values may be aggregated to compute a weighted luma average for the image. Based upon a difference of the weighted luma average and a target, the one or more settings may be adjusted.

Claims (30)

1. A method comprising:

receiving an image captured by a content capture device, wherein the image includes a plurality of pixels;

identifying a target luma value for the image;

identifying an object in the image;

dividing the plurality of pixels of the image into a plurality of pixel groups;

calculating a pixel group luma value for each of the plurality of pixel groups;

defining a first set of pixel groups not associated with the object;

setting weights for each of the pixel groups in the first set of pixel groups;

defining a second set of pixel groups associated with the object;

setting weights for each of the pixel groups in the second set of pixel groups;

calculating an image luma value by summing, for each pixel group of the plurality of pixel groups, the weight of each pixel group multiplied by the pixel group luma value of each pixel group;

computing a difference between the image luma value and the target luma value; and

updating a setting of the content capture device based upon the computed difference.

2. The method of claim 1 , wherein the weights for the pixel groups in the second set of pixel groups are based upon the association between the second set of pixel groups and the object.

3. The method of claim 1 , wherein the setting is related to gain or exposure.

4. The method of claim 1 , further comprising:

identifying a second object in the image;

defining a third set of pixel groups associated with the second object; and

setting weights for each of the pixel groups in the third set of pixel groups.

5. The method of claim 1 , wherein the target luma value is determined based on at least one of an exposure setting or a gain setting of the content capture device.

6. The method of claim 1 , wherein a number of pixels in a first pixel group is equal to a number of pixels in a second pixel group.

7. The method of claim 1 , wherein a first pixel group is different from a second pixel group.

8. The method of claim 1 , further comprising identifying additional information associated with the object.

9. The method of claim 8 , wherein the additional information is a category associated with the object, a size of the object, a distance of the object from the content capture device, or a distance that the object is located from a focus reticle of the content capture device, and wherein the weights for each of the pixel groups in the first set of pixel groups is based upon the additional information.

10. The method of claim 8 , wherein the weights for each of the pixel groups in the first set of pixel groups is at least partially based upon the additional information.

11. The method of claim 1 , further comprising:

identifying a direction a user is looking;

determining a location on the image that corresponds to the direction the user is looking; and

determining a distance that the object is located from the location, wherein the weights for each of the pixel groups in the first set of pixel groups is based upon the distance.

12. The method of claim 1 , wherein the image is not presented to a user.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: SMITH, BRIAN; TSUNAEV, ILYA
To: MAGIC LEAP, INC.
Reel/Frame 044779/0032 →
Continuity (2)
Provisional Application 62438926 · Dec 23, 2016
Related Publication 20180183986A1 · Jun 28, 2018
Cited By (2)
US 12,219,265 US 12,720,207