IP Library Granted Patent US 9,918,013
Granted Patent B2
US 9,918,013 · App. 15/045,519 · Granted Mar 13, 2018

Method and apparatus for switching between cameras in a mobile device to receive a light signal

Inventors: Daniel Ryan (San Francisco, CA); Aaron Ganick (Boxford, MA); Kelby Edward Green (Boston, MA)
Assignee: ABL IP HOLDING LLC
H04N5/23293G01C21/206G01S1/70G06T3/40H04B10/116H04M1/0264H04N5/3532H04W4/04H04M2250/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,918,013
App. No.
15/045,519
Granted
Mar 13, 2018
Kind
B2
Abstract

In one aspect, the present disclosure relates to a method for a method for hiding a camera preview feed of a mobile device application. The method may proceed by the mobile device application enabling an imaging sensor of the mobile device, where the software of the mobile device requires the mobile device application to display the camera preview feed when the imaging sensor is enabled. The method may continue by creating a camera preview surface for displaying the camera preview feed. The method may further continue by modifying the camera preview surface to be hidden from the mobile device user. The method may end by setting the camera preview feed to be displayed on the camera preview surface. In another aspect, the present disclosure further relates to modifying the camera preview surface by resizing the camera preview surface to be one pixel large.

Claims (82)

1. A method comprising:

determining an orientation of a mobile device;

selecting one optical sensor from a plurality of optical sensors of the mobile device as being most likely to receive a modulated light signal, based on the determined orientation; and

demodulating an output signal of the one optical sensor to produce a demodulated signal;

analyzing the demodulated signal of the optical sensor to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present:

selecting another optical sensor of the plurality of optical sensors; and

demodulating an output signal of the other optical sensor to produce a further demodulated signal.

2. The method of claim 1 , wherein the one optical sensor includes an imaging sensor and the method further includes configuring of the one optical sensor by modifying sensor parameters including at least one of exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode of the one optical sensor to improve reception of the modulated light signal before demodulating the output signal of the one optical sensor.

3. The method of claim 1 , wherein the one optical sensor includes a photodiode and the demodulating of the optical sensor includes digitizing the output signal of the photodiode and detecting an on-off key (OOK) modulating signal.

4. The method of claim 1 , wherein the determining the orientation of the mobile device includes analyzing output signals of at least one of a gyroscope, compass, or accelerometer of the mobile device to determine the orientation of the mobile device.

5. A method comprising:

determining an orientation of a mobile device;

selecting one optical sensor from a plurality of optical sensors of the mobile device as being most likely to receive a modulated light signal, based on the determined orientation; and

demodulating an output signal of the one optical sensor to produce a demodulated signal;

wherein the one optical sensor includes an imaging sensor and the demodulating of the output signal of the optical sensor includes processing an image output of the imaging sensor to obtain information corresponding to variations of width of one or more stripes in the image output.

6. The method of claim 5 , wherein processing includes performing digital pulse recognition (DPR) demodulation on pixel values provided by the imaging sensor.

7. The method of claim 6 , wherein:

the DPR demodulation includes generating a confidence score indicating a likelihood that the demodulated signal includes DPR tones; and

the analyzing of the demodulated signal includes analyzing the confidence score to determine whether DPR tones are present.

8. The method of claim 5 , wherein the one optical sensor includes an imaging sensor and the method further includes configuring of the one optical sensor by modifying sensor parameters including at least one of exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode of the one optical sensor to improve reception of the modulated light signal before demodulating the output signal of the one optical sensor.

9. The method of claim 5 , wherein the one optical sensor includes a photodiode and the demodulating of the optical sensor includes digitizing the output signal of the photodiode and detecting an on-off key (OOK) modulating signal.

10. The method of claim 5 , wherein the determining the orientation of the mobile device includes analyzing output signals of at least one of a gyroscope, compass, or accelerometer of the mobile device to determine the orientation of the mobile device.

11. A mobile device comprising:

a first optical sensor mounted in a first location on the mobile device;

a second optical sensor mounted in a second location on the mobile device wherein the second location is different from the first location;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to:

determine an orientation of the mobile device;

based on the determined orientation, select one of the first and second optical sensors as the optical sensor most likely to receive a modulated light signal;

demodulate an output signal of the one optical sensor to produce a demodulated signal; and

analyze the demodulated signal of the one optical sensor to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present:

select another optical sensor of the first and second optical sensors;

configure the other optical sensor to receive the modulated light signal; and

demodulate an output signal of the other optical sensor to produce a further demodulated signal.

12. The mobile device of claim 11 , wherein each of the first and second optical sensors is selected from a group consisting of a complementary metal oxide semiconductor (CMOS) imager, a charge coupled device (CCD) imager and a photodiode.

13. The mobile device of claim 11 , wherein the first optical sensor is a front camera mounted on a front side of the mobile device and the second optical sensor is a back camera mounted on a back side of the mobile device.

14. The mobile device of claim 11 , further including program instructions that cause the processor to configure the one optical sensor by modifying at least one sensor parameter including exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode to improve reception of the modulated light signal before the output signal of the one optical sensor is demodulated.

15. The mobile device of claim 11 , wherein each camera is a rolling shutter camera.

16. The mobile device of claim 11 , wherein:

the one optical sensor includes a photodiode and the mobile device further includes an analog-to-digital converter configured to digitize the output signal of the photodiode; and

the program instructions that cause the processor to demodulate the output signal of the sensor include program instructions that cause the processor to perform on-off key (OOK) demodulation.

17. The mobile device of claim 11 , further comprising:

at least one sensor selected from a group consisting of a gyroscope, compass, and accelerometer; and

the program instructions that cause the processor to determine the orientation of the mobile device cause the processor to determine the orientation based on the output signals of the at least one sensor.

18. A mobile device comprising:

a first optical sensor mounted in a first location on the mobile device;

a second optical sensor mounted in a second location on the mobile device wherein the second location is different from the first location;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to:

determine an orientation of the mobile device;

based on the determined orientation, select one of the first and second optical sensors as the optical sensor most likely to receive a modulated light signal, wherein the one optical sensor includes an imaging sensor; and

demodulate an output signal of the one optical sensor to produce a demodulated signal by processing an image output of the imaging sensor to obtain information corresponding to variations of width of one or more stripes in the image output.

19. The mobile device of claim 18 , wherein the program instructions that cause the processor to demodulate the output signal of the optical sensor include program instructions that cause the processor to perform digital pulse recognition (DPR) demodulation on pixel values provided by the imaging sensor.

20. The mobile device of claim 19 , wherein:

the program instructions that cause the processor to perform the DPR demodulation include program instructions that cause the processor to generate a confidence score indicating a likelihood that the demodulated signal includes DPR tones; and

the program instructions that analyze the demodulated signal include program instructions that analyze the confidence score to determine whether DPR tones are present.

21. The mobile device of claim 18 , wherein each of the first and second optical sensors is selected from a group consisting of a complementary metal oxide semiconductor (CMOS) imager, a charge coupled device (CCD) imager and a photodiode.

22. The mobile device of claim 18 , wherein the first optical sensor is a front camera mounted on a front side of the mobile device and the second optical sensor is a back camera mounted on a back side of the mobile device.

23. The mobile device of claim 18 , further including program instructions that cause the processor to configure the one optical sensor by modifying at least one sensor parameter including exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode to improve reception of the modulated light signal before the output signal of the one optical sensor is demodulated.

24. The mobile device of claim 18 , wherein each camera is a rolling shutter camera.

25. The mobile device of claim 18 , wherein:

the one optical sensor includes a photodiode and the mobile device further includes an analog-to-digital converter configured to digitize the output signal of the photodiode; and

the program instructions that cause the processor to demodulate the output signal of the sensor include program instructions that cause the processor to perform on-off key (OOK) demodulation.

26. The mobile device of claim 18 , further comprising:

at least one sensor selected from a group consisting of a gyroscope, compass, and accelerometer; and

the program instructions that cause the processor to determine the orientation of the mobile device cause the processor to determine the orientation based on the output signals of the at least one sensor.

27. A mobile device comprising:

a first camera mounted on a first side of the mobile device;

a second camera mounted on a second side the mobile device, opposite to the first side;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to:

compare output signals of the first and second cameras;

select one of the first and second cameras providing a greater output signal as the optical sensor most likely to receive a modulated light signal;

configure the one camera to receive the modulated light signal;

demodulate an output signal of the one camera to produce a demodulated signal; and

analyze the demodulated signal of the one camera to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present:

select another camera of the first and second cameras;

configure the other camera to receive the modulated light signal; and

demodulate an output signal of the other camera to produce a further demodulated signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2016
From: BYTELIGHT, INC.
To: ABL IP HOLDING LLC
Reel/Frame 037835/0758 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2016
From: RYAN, DANIEL; GANICK, AARON; GREEN, KELBY
To: BYTELIGHT, LLC
Reel/Frame 037773/0348 →
Continuity (23)
Continuation 14019376 · Sep 5, 2013
Continuation In Part 13718233 · Dec 18, 2012
Continuation 13526656 · Jun 19, 2012
Continuation In Part 13446520 · Apr 13, 2012
Continuation 13445019 · Apr 12, 2012
Continuation 13435448 · Mar 30, 2012
Continuation 13422591 · Mar 16, 2012
Continuation 13422580 · Mar 16, 2012
Continuation 13369147 · Feb 8, 2012
Continuation 13369144 · Feb 8, 2012
Continuation In Part 13446506 · Apr 13, 2012
Continuation 13445019 · Apr 12, 2012
Continuation 13435448 · Mar 30, 2012
Continuation 13422591 · Mar 16, 2012
Continuation 13422580 · Mar 16, 2012
Continuation 13369147 · Feb 8, 2012
Continuation 13369144 · Feb 8, 2012
Provisional Application 61697098 · Sep 5, 2012
Provisional Application 61639428 · Apr 27, 2012
Provisional Application 61635413 · Apr 19, 2012
Provisional Application 61567484 · Dec 6, 2011
Provisional Application 61511589 · Jul 26, 2011
Related Publication 20160165145A1 · Jun 9, 2016