IP Library › Granted Patent US 12,625,573
Granted Patent B2
US 12,625,573 · App. 18/904,033 · Granted May 12, 2026

Systems and apparatus for object detection using optical sensing

Inventors: Yuta Kuboyama (San Mateo, CA); Christopher M. Dodson (Denver, CO); Prashanth Holenarsipur (Los Altos, CA); Serhan O. Isikman (Sunnyvale, CA); Brian R. Land (Woodside, CA); Anant Rai (San Jose, CA)
Assignee: Apple Inc.
G06F3/038G04C3/001G04C3/005G04C3/007G04G21/08G06F1/163G06F3/0304G06F3/03547G06F3/0362G06F2203/04105G06F2203/04108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,625,573
App. No.
18/904,033
Granted
May 12, 2026
Kind
B2
Abstract

An electronic device comprises: a housing; a cover material; a crown; a processor; and an optical proximity sensor comprising: a first light emitter; a second light emitter; and one or more light detectors. The one or more light detectors comprises a first light detector aligned with the first light emitter and the second light emitter in a first direction, the first light detector configured to receive a first amount of light from the first light emitter and configured to receive a second amount of light from the second light emitter. The processor is configured to determine a distance of an object to the optical proximity sensor or to the crown in a second direction, different than the first direction, based on the first amount of light and the second amount of light.

Claims (63)

1 . An electronic device comprising:

a housing;

a cover material coupled to the housing, the cover material comprising a glass cover substrate of the electronic device;

a crown at least partially external to the housing;

a processor; and

an optical proximity sensor positioned within the housing of the electronic device and comprising:

a first light emitter;

a second light emitter; and

one or more light detectors;

wherein:

the optical proximity sensor is configured with a field of view including the crown at least partially external to the housing or an area above the crown;

the one or more light detectors comprises a first light detector aligned with the first light emitter and the second light emitter in a first direction, the first light detector configured to receive a first amount of light from the first light emitter and configured to receive a second amount of light from the second light emitter;

the first light emitter of the optical proximity sensor is configured to emit a first light path beginning within a threshold angle of a first angle and the cover material is configured to refract the first light path to a second angle, different from the first angle;

the second light emitter is configured to emit a second light path beginning within a threshold angle of a third angle and the cover material is configured to refract the second light path to a fourth angle, different from the third angle; and

the processor is configured to determine a distance of an object to the optical proximity sensor or to the crown in a second direction, different than the first direction, based on the first amount of light and the second amount of light.

2 . The electronic device of claim 1 , wherein a distance of the first light emitter to the first light detector is less than a distance of the second light emitter to the first light detector in the first direction, and wherein the distance of the first light emitter to the first light detector is less than a distance of the first light emitter to the second light emitter.

3 . The electronic device of claim 1 , wherein the first amount of light from the first light emitter and the second amount of light from the second light emitter are received sequentially.

4 . The electronic device of claim 1 , wherein:

the first amount of light has a first wavelength and the second amount of light has a second wavelength different from the first wavelength of light or the first amount of light has a first pulsing scheme and the second amount of light has a second pulsing scheme different from the first pulsing scheme; and

the first amount of light and the second amount of light are received simultaneously.

5 . The electronic device of claim 1 , wherein the optical proximity sensor further comprises:

an optical filter disposed in or over one or more apertures for the first light emitter, the second light emitter, or the first light detector, wherein the optical filter is configured to pass light with one or more common wavelengths as one or more wavelengths of light emitted by the first light emitter and the second light emitter and block light with a wavelength different from the one or more wavelengths of light emitted by the first light emitter and the second light emitter.

6 . The electronic device of claim 1 , wherein the one or more light detectors comprises a plurality of light detectors arranged in a one-dimensional array or in a two-dimensional array aligned with the first light emitter in a first direction.

7 . The electronic device of claim 6 , further comprising:

a processor configured to:

determine a centroid location using respective amplitudes detected by one or more of the plurality of light detectors; and

determine a distance of an object to the optical proximity sensor or to the crown in a second direction using the centroid location, wherein the second direction is orthogonal to the one-dimensional array or the two-dimensional array.

8 . The electronic device of claim 7 , wherein the centroid location is determined based on a particular light detector of the plurality of light detectors with a maximum amplitude among the plurality of light detectors or determined by interpolating the respective amplitudes detected by the plurality of light detectors.

9 . The electronic device of claim 1 , wherein the optical proximity sensor further comprises:

an emitter lens; and

a detector lens.

10 . The electronic device of claim 1 , wherein the cover material includes a curved portion and a flat portion, wherein the field of view excludes an area normal to the flat portion of the cover material, wherein the field of view passes through the curved portion, and wherein the optical proximity sensor is mounted normal to the first angle with respect to a plane of the flat portion of the cover material.

11 . The electronic device of claim 1 , wherein a difference between the first angle and the second angle is between 10 degrees and 60 degrees.

12 . The electronic device of claim 1 , further comprising:

an opaque mask having one or more apertures disposed on an inner surface of the cover material; and

an optical filter disposed at least partially in the apertures of the opaque mask;

wherein the field of view of the optical proximity sensor passes through the one or more apertures and wherein the optical filter is configured to pass a first range of wavelengths of light and to block a second range of wavelengths of light different from the first range of wavelengths of light.

13 . The electronic device of claim 1 , wherein the second direction is orthogonal to the first direction.

14 . The electronic device of claim 1 , wherein determining the distance of an object to the optical proximity sensor or to the crown in the second direction is based on a ratio of the first amount of light and the second amount of light.

15 . The electronic device of claim 1 , the processor further configured to:

in accordance with a determination that an object is present within the field of view of the optical proximity sensor, perform a first operation; and

in accordance with a determination that an object is not present within the field of view of the optical proximity sensor, forgo performing the first operation.

16 . The electronic device of claim 15 , wherein the first operation is waking up the electronic device from a sleep state.

17 . The electronic device of claim 1 , the processor further configured to:

in accordance with a determination that the distance of the object to the optical proximity sensor or to the crown in the second direction is less than a first threshold distance and greater than a second threshold distance, perform a first operation; and

in accordance with a determination that the distance of the object to the optical proximity sensor or to the crown in the second direction is less than the first threshold distance and less than the second threshold distance, perform a second operation, different from the first operation.

18 . A wearable device comprising:

a housing;

a cover material coupled to the housing, the cover material comprising a glass cover substrate of the wearable device;

a crown at least partially external to the housing;

an optical proximity sensor positioned within the housing of the wearable device, disposed under the cover material, and configured with a field of view including the crown at least partially external to the housing or an area above the crown, the optical proximity sensor comprising a first light emitter, a second light emitter, and one or more light detectors; and

a processor coupled to the optical proximity sensor;

wherein the one or more light detectors comprises a first light detector aligned with the first light emitter and the second light emitter in a first direction, the first light detector configured to receive a first amount of light from the first light emitter and configured to receive a second amount of light from the second light emitter;

the first light emitter of the optical proximity sensor is configured to emit a first light path beginning within a threshold angle of a first angle and the cover material is configured to refract the first light path to a second angle, different from the first angle;

the second light emitter is configured to emit a second light path beginning within a threshold angle of a third angle and the cover material is configured to refract the second light path to a fourth angle, different from the third angle;

wherein the processor is configured to:

estimate a presence of an object touching or within a threshold distance from the crown; or

estimate a distance between the object touching or within the threshold distance from the crown; and

wherein the processor is further configured to determine a distance of an object to the optical proximity sensor or to the crown in a second direction, different than the first direction, based on the first amount of light and the second amount of light.

19 . The wearable device of claim 18 , wherein determining the distance of an object to the optical proximity sensor or to the crown in the second direction is based on a ratio of the first amount of light and the second amount of light.

20 . The electronic device of claim 1 , wherein:

the first amount of light received by the one or more light detectors comprises a first reflection received via the cover material,

the second amount of light received by the one or more light detectors comprises a second reflection received via the cover material.

Continuity (10)
Continuation 17347000 · Jun 14, 2021
Continuation 15275323 · Sep 23, 2016
Provisional Application 62304135 · Mar 4, 2016
Provisional Application 62304129 · Mar 4, 2016
Provisional Application 62297780 · Feb 19, 2016
Provisional Application 62235254 · Sep 30, 2015
Provisional Application 62235473 · Sep 30, 2015
Provisional Application 62235465 · Sep 30, 2015
Provisional Application 62235426 · Sep 30, 2015
Related Publication 20250028401A1 · Jan 23, 2025
References Cited (157)
US 3673327A · Johnson et al. · 1972 [cited by applicant]
US 4203280A · Grandjean et al. · 1980 [cited by applicant]
US 4468131A · Bui · 1984 [cited by examiner]
US 4506354A · Hansen · 1985 [cited by applicant]
US 4746914A · Adler · 1988 [cited by applicant]
US 4825212A · Adler et al. · 1989 [cited by applicant]
US 5483261A · Yasutake · 1996 [cited by applicant]
US 5488204A · Mead et al. · 1996 [cited by applicant]
US 5591945A · Kent · 1997 [cited by applicant]
US 5766493A · Shin · 1998 [cited by applicant]
US 5816225A · Koch et al. · 1998 [cited by applicant]
US 5825352A · Bisset et al. · 1998 [cited by applicant]
US 5835079A · Shieh · 1998 [cited by applicant]
US 5854450A · Kent · 1998 [cited by applicant]
US 5880411A · Gillespie et al. · 1999 [cited by applicant]
US 6061050A · Allport et al. · 2000 [cited by applicant]
US 6078315A · Huang · 2000 [cited by applicant]
US 6091406A · Kambara et al. · 2000 [cited by applicant]
US 6188391B1 · Seely et al. · 2001 [cited by applicant]
US 6225985B1 · Armstrong et al. · 2001 [cited by applicant]
US 6229529B1 · Yano et al. · 2001 [cited by applicant]
US 6252825B1 · Perotto · 2001 [cited by applicant]
US 6310610B1 · Beaton et al. · 2001 [cited by applicant]
US 6323846B1 · Westerman et al. · 2001 [cited by applicant]
US 6327011B2 · Kim · 2001 [cited by applicant]
US 6636197B1 · Goldenberg et al. · 2003 [cited by applicant]
US 6661438B1 · Shiraishi et al. · 2003 [cited by applicant]
US 6690387B2 · Zimmerman et al. · 2004 [cited by applicant]
US 6856259B1 · Sharp · 2005 [cited by applicant]
US 7015894B2 · Morohoshi · 2006 [cited by applicant]
US 7079118B2 · Benard et al. · 2006 [cited by applicant]
US 7098891B1 · Pryor · 2006 [cited by applicant]
US 7123351B1 · Schaefer · 2006 [cited by examiner]
US 7184064B2 · Zimmerman et al. · 2007 [cited by applicant]
US 7489308B2 · Blake et al. · 2009 [cited by applicant]
US 7499039B2 · Roberts · 2009 [cited by applicant]
US 7573466B1 · Marzen et al. · 2009 [cited by applicant]
US 7663607B2 · Hotelling et al. · 2010 [cited by applicant]
US 7800592B2 · Kerr et al. · 2010 [cited by applicant]
US 7822469B2 · Lo · 2010 [cited by applicant]
US 7907129B2 · Idzik et al. · 2011 [cited by applicant]
US 8169404B1 · Boillot · 2012 [cited by applicant]
US 8294670B2 · Griffin · 2012 [cited by applicant]
US 8479122B2 · Hotelling et al. · 2013 [cited by applicant]
US 8624836B1 · Miller · 2014 [cited by examiner]
US 8736162B2 · Jin et al. · 2014 [cited by applicant]
US 8743091B2 · Bernstein · 2014 [cited by applicant]
US 8976141B2 · Myers et al. · 2015 [cited by applicant]
US 9047009B2 · King et al. · 2015 [cited by applicant]
US 9070648B2 · De Jong et al. · 2015 [cited by applicant]
US 9753436B2 · Ely et al. · 2017 [cited by applicant]
US 10261584B2 · Gill · 2019 [cited by examiner]
US 10503271B2 · Ely et al. · 2019 [cited by applicant]
US 20040164970A1 · Benard et al. · 2004 [cited by applicant]
US 20050017959A1 · Kraus et al. · 2005 [cited by applicant]
US 20050052432A1 · Kraus et al. · 2005 [cited by applicant]
US 20050083313A1 · Hardie-bick · 2005 [cited by applicant]
US 20050248548A1 · Tsumura et al. · 2005 [cited by applicant]
US 20060026521A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060097991A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060197750A1 · Kerr et al. · 2006 [cited by applicant]
US 20060197753A1 · Hotelling · 2006 [cited by applicant]
US 20070181410A1 · Baier · 2007 [cited by applicant]
US 20070211031A1 · Marc · 2007 [cited by applicant]
US 20070240913A1 · Schermerhorn · 2007 [cited by applicant]
US 20080059761A1 · Norman · 2008 [cited by applicant]
US 20080114251A1 · Weymer et al. · 2008 [cited by applicant]
US 20080207281A1 · Tsuchiya et al. · 2008 [cited by applicant]
US 20080266266A1 · Kent et al. · 2008 [cited by applicant]
US 20080297638A1 · Hiratsuka · 2008 [cited by applicant]
US 20090273570A1 · Degner et al. · 2009 [cited by applicant]
US 20100026667A1 · Bernstein · 2010 [cited by applicant]
US 20100231238A1 · Toyota et al. · 2010 [cited by applicant]
US 20110298699A1 · Goto et al. · 2011 [cited by applicant]
US 20120139852A1 · Huang et al. · 2012 [cited by applicant]
US 20120139880A1 · Shirakawa · 2012 [cited by applicant]
US 20120212445A1 · Heikkinen et al. · 2012 [cited by applicant]
US 20130076649A1 · Myers et al. · 2013 [cited by applicant]
US 20130154955A1 · Guard · 2013 [cited by applicant]
US 20140009441A1 · Bernstein et al. · 2014 [cited by applicant]
US 20140016048A1 · Omote et al. · 2014 [cited by applicant]
US 20140045547A1 · Singamsetty et al. · 2014 [cited by applicant]
US 20140055352A1 · Davis · 2014 [cited by examiner]
US 20140078318A1 · Alameh · 2014 [cited by examiner]
US 20140087658A1 · Hou et al. · 2014 [cited by applicant]
US 20140088761A1 · Shamlian · 2014 [cited by examiner]
US 20140106814A1 · Schmidt · 2014 [cited by applicant]
US 20140299884A1 · Park et al. · 2014 [cited by applicant]
US 20140328147A1 · Yang et al. · 2014 [cited by applicant]
US 20150015512A1 · Kwak et al. · 2015 [cited by applicant]
US 20150070309A1 · Kang · 2015 [cited by applicant]
US 20150070312A1 · Her et al. · 2015 [cited by applicant]
US 20150109744A1 · Jufer et al. · 2015 [cited by applicant]
US 20150177836A1 · Ouchi · 2015 [cited by examiner]
US 20150227227A1 · Myers et al. · 2015 [cited by applicant]
US 20150323998A1 · Kudekar · 2015 [cited by examiner]
US 20150324000A1 · Park · 2015 [cited by examiner]
US 20150334211A1 · Shin et al. · 2015 [cited by applicant]
US 20150370376A1 · Harley et al. · 2015 [cited by applicant]
US 20160004367A1 · Shimada · 2016 [cited by applicant]
US 20160033342A1 · Lyon et al. · 2016 [cited by applicant]
US 20160058375A1 · Rothkopf · 2016 [cited by applicant]
US 20160098016A1 · Ely et al. · 2016 [cited by applicant]
US 20160116592A1 · Hiromi · 2016 [cited by examiner]
US 20160116983A1 · Lim · 2016 [cited by examiner]
US 20160170624A1 · Zambetti et al. · 2016 [cited by applicant]
US 20160209939A1 · Zambetti et al. · 2016 [cited by applicant]
US 20160327911A1 · Eim et al. · 2016 [cited by applicant]
US 20160357265A1 · Maani · 2016 [cited by examiner]
US 20170010751A1 · Shedletsky · 2017 [cited by examiner]
US 20170083162A1 · Kan · 2017 [cited by examiner]
US 20170090592A1 · Ely et al. · 2017 [cited by applicant]
US 20170090599A1 · Kuboyama et al. · 2017 [cited by applicant]
US 20170090614A1 · Kuboyama et al. · 2017 [cited by applicant]
US 20170308200A1 · Mugiraneza et al. · 2017 [cited by applicant]
US 20180181733A1 · Shim et al. · 2018 [cited by applicant]
US 20180343023A1 · Park · 2018 [cited by examiner]
US 20210303081A1 · Kuboyama et al. · 2021 [cited by applicant]
JP 2000163031A · 2000 [cited by applicant]
JP 2001202178A · 2001 [cited by applicant]
JP 2002342033A · 2002 [cited by applicant]
JP 2004184396A · 2004 [cited by applicant]
WO 2005103872A2 · 2005 [cited by applicant]
WO 2005103872A3 · 2006 [cited by applicant]
WO 2014124173A1 · 2014 [cited by applicant]
WO 2014200766A1 · 2014 [cited by applicant]
WO 2015034969A2 · 2015 [cited by applicant]
WO 2015119637A1 · 2015 [cited by applicant]
WO 2015122885A1 · 2015 [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/275,323, mailed on Jan. 6, 2021, 3 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 17/347,000, mailed on Aug. 30, 2024, 3 Pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 12/184,232, mailed on Aug. 27, 2013, 26 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 12/184,232, mailed on Feb. 20, 2013, 25 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 14/870,905, mailed on Dec. 14, 2018, 24 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/275,323, mailed on Nov. 26, 2019, 15 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/275,323, mailed on Oct. 13, 2020, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/347,000 , mailed on Jul. 1, 2024, 15 Pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/347,000, mailed on Jun. 1, 2023, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 12/184,232, mailed on Jul. 25, 2012, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 12/184,232, mailed on Nov. 18, 2011, 22 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 14/870,905, mailed on Feb. 23, 2018, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 14/870,905, mailed on Jul. 19, 2019, 25 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/275,323, mailed on Apr. 9, 2020, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/275,323, mailed on Apr. 18, 2019, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/347,000, mailed on Oct. 24, 2023, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/347,000, mailed on Nov. 10, 2022, 15 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 12/184,232, mailed on Mar. 14, 2014, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 14/870,905, mailed on Dec. 2, 2019, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/275,323, mailed on Feb. 10, 2021, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 14/870,905, mailed on Mar. 16, 2020, 10 pages. [cited by applicant]
Restriction Requirement received for U.S. Appl. No. 14/870,905, mailed on Sep. 8, 2017, 6 pages. [cited by applicant]
Restriction Requirement received for U.S. Appl. No. 15/275,323, mailed on Jul. 2, 2018, 8 pages. [cited by applicant]
Restriction Requirement received for U.S. Appl. No. 17/347,000, mailed on Jun. 2, 2022, 6 Pages. [cited by applicant]
Lee et al., “A Multi-Touch Three Dimensional Touch-Sensitive Tablet”, CHI'85 Proceedings, Apr. 1985, pp. 21-25. [cited by applicant]
Rubine, Dean, “Combining Gestures and Direct Manipulation”, CHI'92, May 3-7, 1992, pp. 659-660. [cited by applicant]
Rubine, Deanh. , “The Automatic Recognition of Gestures”, CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, Dec… [cited by applicant]
Westerman, Wayne, “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface”, A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requiremen… [cited by applicant]