IP Library Granted Patent US 12,032,792
Granted Patent B1
US 12,032,792 · App. 18/135,687 · Granted Jul 9, 2024

Method and apparatus for creating an adaptive Bayer pattern

Inventors: Tarek El Dokor (Phoenix, AZ); Joshua King (Mesa, AZ); Roger Hauptman (Denver, CO)
Assignee: Golden Edge Holding Corporation
G06F3/0425G06F3/017G06F3/0488G06T3/4015G06T3/4053G06T7/55G06T2207/10052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,032,792
App. No.
18/135,687
Granted
Jul 9, 2024
Kind
B1
Abstract

A method and apparatus for creating an adaptive mosaic pixel-wise virtual Bayer pattern. The method may include receiving a plurality of monochromatic images from an array of imaging elements, creating a reference ordered set at infinity from the plurality of monochromatic images, running a demosaicing process on the reference ordered set, and creating a color image from the demosaiced ordered set. One or more offset artifacts resulting from the demosaicing process may be computed at a distance other than infinity, the ordered set may be modified in accordance with the computed offsets.

Claims (59)

1. A method for enabling gesture recognition of a gesture command, comprising:

receiving a plurality of images of an object to be used for performing a gesture command from an army of imaging elements included within a camera;

aligning the plurality of images;

creating an ordered set at infinity comprising Red, Clear, Blue (R, C, B) pixel elements from the plurality of images;

defining as an infinity image a low-resolution G image generated by subtracting the R, C, B pixel data of the plurality of images;

performing a demosiacing process on the ordered set at infinity:

computing offsets between the images from one or more determined artifacts generated from imaging the object performing the gesture command;

modifying the ordered set to adapt to the computed offsets;

regenerating the demosaiced image and computing an associated depth thereof;

and interpreting the gesture command performed by the object.

2. The method of claim 1 , wherein the gesture recognition is updated by matching row-wise and column wise disparity values.

3. The method of claim 1 , further comprising:

realigning the reference ordered set such that objects that are not at infinity are subtended by a modified Bayer pattern for better image quality;

creating a second pattern based upon the modified Bayer pattern; and

generating a second demosaiced image in accordance with the second pattern.

4. The method of claim 3 , further comprising generating a depth map in accordance with the second pattern.

5. The method of claim 1 , wherein a hand of a user is captured in the image as the object performing the gesture command.

6. The method of claim 5 , wherein the hand of the user is used to control a mobile device.

7. The method of claim 6 , wherein the camera is included within the mobile device.

8. The method of claim 7 , wherein the hand of the user is positioned within a field of view of the camera.

9. The method of claim 7 , wherein the array of imaging elements comprise a backward facing camera and the hand of the user is positioned within a field of view of the backward facing camera.

10. The method of claim 9 , wherein a pinch gesture by the hand of the user positioned within the field of view of the backward facing camera adjusts zoom on the display of one or more images captured by a front facing camera of the mobile device without requiring contact with the display of the camera.

11. The method of claim 9 , wherein a thumbs up gesture by the hand of the user positioned within the field of view of the backward facing camera results in the taking of a picture captured by a front facing camera of the mobile device.

12. The method of claim 9 , wherein movement of the hand of the user positioned within the field of view of the backward facing camera towards and away from the display of the camera adjusts zoom of the front facing camera of the mobile device.

13. The method of claim 6 , wherein the one or more mobile devices comprise one or more electronic devices.

14. The method of claim 13 , wherein the one or more electronic devices are controlled by a gestural interface, each gesture being determined based upon one or more images acquired by the array of imaging elements comprising a camera of the electronic device for acquiring the gesture command.

15. The method of claim 13 , wherein the one or more electronic devices comprises a television.

16. The method of claim 13 , wherein the one or more devices comprises a game console.

17. The method of claim 1 , wherein the step of computing one or more offset artifacts is performed only on pixels in the reference image that have changed from a prior image.

18. The method of claim 1 , further comprising the steps of:

highlighting on a touchscreen, by the user, one or more regions corresponding to one or more objects in the demosaiced image for which a distance to the mobile device from the object is to be determined;

extracting the coordinates of the highlighted region from one or more of the demosaiced image and the received plurality of images;

segmenting the region in the one of the received plurality of images and the demosaiced image from which the coordinates were extracted,

determining a distance to the one or more objects corresponding to the highlighted region on the display;

determining one or more dimensions of the one or more objects corresponding to the highlighted region in accordance with the demosaicing process.

19. A system for enabling gesture recognition of a gesture command, comprising:

an array of imaging elements comprising a camera for acquiring a plurality of images; and

a processor for:

receiving a plurality of images of an object to be used for performing a gesture command from an array of imaging elements included within the camera;

aligning the plurality of images;

creating an ordered set at infinity comprising Red, Clear, Blue (R, C, B) pixel elements from the plurality of images;

defining as an infinity image a low resolution G image generated by subtracting the R, C, B pixel data of the plurality of images;

performing a demosiacing process on the ordered set at infinity;

amplifying a response of blue and red pixel level elements based upon the C pixel data;

computing offsets between the images from one or more determined artifacts generated from imaging the object performing a gesture command;

modifying the ordered set to adapt to the computed offsets;

regenerating the demosaiced image; and

interpreting the gesture command performed by the object.

20. A non-transitory storage medium having a computer program stored thereon, the computer program causing a general purpose computer to perform the steps of:

receiving a plurality of images of an object to be used for performing a gesture command from an array of imaging elements included within a camera;

aligning the plurality of images;

creating an ordered set at infinity comprising Red, Clear, Blue (R, C, B) pixel elements from the plurality of images;

defining as an infinity image a low resolution G image generated by subtracting the R, C, B pixel data of the plurality of images;

performing a demosiacing process on the ordered set at infinity;

amplifying a response of blue and red pixel level elements based upon the C pixel data;

computing offsets between the images from one or more determined artifacts generated from imaging the object performing a gesture command;

modifying the ordered set to adapt to the computed offsets;

regenerating the demosaiced image; and

interpreting the gesture command performed by the object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: EDGE3 TECHNOLOGIES, INC.; EDGE3 TECHNOLOGIES, LLC
To: GOLDEN EDGE HOLDING CORPORATION
Reel/Frame 064415/0683 →
Continuity (7)
Continuation 17676625 · Feb 21, 2022
Continuation 16812348 · Mar 8, 2020
Continuation 16290941 · Mar 3, 2019
Continuation 15588656 · May 7, 2017
Continuation 14925039 · Oct 28, 2015
Continuation 14045774 · Oct 3, 2013
Provisional Application 61711177 · Oct 8, 2012