IP Library › Granted Patent US 12,219,631
Granted Patent B2
US 12,219,631 · App. 17/821,460 · Granted Feb 4, 2025

Controlling electronic devices based on wireless ranging

Inventors: James H. Foster (Oxford, GB); Duncan R. Kerr (San Francisco, CA)
Assignee: Apple Inc.
H04W76/14G01C21/20G06F1/1626G06F1/1694G06F1/1698G06F3/011G06F3/016G06F3/017G06F3/14G06T19/00G08C17/02H04W4/023G08C2201/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,219,631
App. No.
17/821,460
Filed
Aug 22, 2022
Granted
Feb 4, 2025
Kind
B2
Examiner
FAN, HONGMIN
Art Unit
2687
USPC
340/12.5
Abstract

A wireless communication device may wirelessly control an object, such as a physical device, directly or through interaction with a virtual representation (or placeholder) of the object situated at a predefined physical location. In particular, the wireless communication device may identify an intent gesture performed by a user that indicates intent to control the object. For example, the intent gesture may involve pointing or orienting the wireless communication device toward the object, with or without additional input. Then, the wireless communication device may determine the object associated with the intent gesture using wireless ranging and/or device orientation. Moreover, the wireless communication device may interpret sensor data from one or more sensors associated with the wireless communication device to determine an action gesture corresponding to a command or a command value. The wireless communication device may then transmit the command value to control the object.

Claims (37)

1. A method comprising:

by a wireless device:

determining an intent to control an object within wireless range of the wireless device;

identifying the object to be controlled based at least in part on an identifier received from the object during a wireless ranging operation, wherein the identifier varies over time, to protect privacy and provide security, and distinguishes the object from a second object;

determining a command to control the object identified by the wireless ranging operation; and

transmitting a command value corresponding to the command to control the object.

2. The method of claim 1 , wherein determining the intent to control the object comprises interpreting sensor data of the wireless device to identify an intent gesture.

3. The method of claim 2 , wherein interpreting the sensor data includes identifying an orientation of the wireless device.

4. The method of claim 2 , wherein interpreting the sensor data includes identifying a movement of the wireless device.

5. The method of claim 4 , wherein the movement of the wireless device comprises a predefined intent gesture motion.

6. The method of claim 5 , wherein the predefined intent gesture motion comprises a forward extension of the wireless device toward the object to be controlled.

7. The method of claim 1 , wherein determining the command to control the object comprises interpreting sensor data to identify an action gesture.

8. The method of claim 7 , wherein the action gesture comprises movement of the wireless device in at least two dimensions.

9. The method of claim 1 , wherein the identifier is assigned by a network server.

10. The method of claim 9 , wherein the identifier is updated periodically by the network server.

11. The method of claim 1 , further comprising:

by the wireless device:

determining whether the object is in the same environment as the wireless device.

12. The method of claim 11 , wherein the determining whether the object is in the same environment as the wireless device comprises comparing ambient sound measured by the wireless device to ambient sound captured by the object.

13. The method of claim 11 , wherein the determining whether the object is in the same environment as the wireless device comprises transmitting one or more ultrasonic acoustic chirps.

14. A wireless device comprising:

wireless circuitry; and

a processor communicatively coupled to the wireless circuitry and to a memory storing instructions that, when executed by the processor, configure the wireless device to perform actions including:

determining an intent to control an object within wireless range of the wireless device;

identifying the object to be controlled based at least in part on an identifier received from the object during a wireless ranging operation, wherein the identifier varies over time, to protect privacy and provide security, and distinguishes the object from a second object;

determining a command to control the object identified by the wireless ranging operation; and

transmitting a command value corresponding to the command to control the object.

15. The wireless device of claim 14 , further comprising a sensor, wherein determining the intent to control the object comprises interpreting sensor data to identify a predefined intent gesture comprising movement of the wireless device toward the object to be controlled.

16. The wireless device of claim 14 , further comprising a sensor, wherein determining the command to control the object comprises interpreting sensor data to identify a predefined action gesture comprising movement of the wireless device in at least two dimensions.

17. The wireless device of claim 14 , wherein the actions further include determining whether the object is in the same environment as the wireless device based on analysis of ambient acoustic data.

18. The wireless device of claim 14 , wherein the object comprises a virtual object associated with a physical object in a different location.

19. A computer-program product for use in conjunction with a wireless device, the computer-program product comprising a non-transitory computer-readable storage medium and a computer-program mechanism embedded therein to control an object, the computer-program mechanism including:

instructions for determining an intent to control an object within wireless range of the wireless device;

instructions for identifying the object to be controlled based at least in part on an identifier received from the object during a wireless ranging operation, wherein the identifier varies over time to protect privacy and provide security and distinguishes the object from a second object;

instructions for determining a command to control the object identified by the wireless ranging operation; and

instructions for transmitting a command value corresponding to the command to control the object.

20. The computer-program product of claim 19 , wherein the object comprises a virtual object that represents a physical object in a different location.

Continuity (5)
Continuation 17142171 · Jan 5, 2021
Continuation 16525408 · Jul 29, 2019
Continuation 15424394 · Feb 3, 2017
Provisional Application 62291504 · Feb 4, 2016
Related Publication 20230121160A1 · Apr 20, 2023
References Cited (139)
US 5694335A · Hollenberg · 1997 [cited by applicant]
US 6236398B1 · Kojima et al. · 2001 [cited by applicant]
US 6791467B1 · Ben-Ze'ev · 2004 [cited by applicant]
US 7062279B2 · Cedervall et al. · 2006 [cited by applicant]
US 8464184B1 · Cook et al. · 2013 [cited by applicant]
US 8593576B2 · Friedman · 2013 [cited by applicant]
US 8665075B2 · Pratt et al. · 2014 [cited by applicant]
US 9235241B2 · Newham et al. · 2016 [cited by applicant]
US 9860204B2 · Touloumtzis · 2018 [cited by applicant]
US 10044847B2 · Economy et al. · 2018 [cited by applicant]
US 10368378B2 · Foster et al. · 2019 [cited by applicant]
US 20010035860A1 · Segal et al. · 2001 [cited by applicant]
US 20020180604A1 · Yamaashi et al. · 2002 [cited by applicant]
US 20030080992A1 · Haines · 2003 [cited by applicant]
US 20040006642A1 · Jang et al. · 2004 [cited by applicant]
US 20040203900A1 · Cedervall et al. · 2004 [cited by applicant]
US 20050280546A1 · Ganley et al. · 2005 [cited by applicant]
US 20060265664A1 · Simons et al. · 2006 [cited by applicant]
US 20070130582A1 · Chang et al. · 2007 [cited by applicant]
US 20070255111A1 · Baldus et al. · 2007 [cited by applicant]
US 20080152263A1 · Harrison · 2008 [cited by applicant]
US 20090091658A1 · Hirose · 2009 [cited by applicant]
US 20090167919A1 · Anttila et al. · 2009 [cited by applicant]
US 20100171635A1 · Chu · 2010 [cited by applicant]
US 20100309849A1 · Park et al. · 2010 [cited by applicant]
US 20100328201A1 · Marvit et al. · 2010 [cited by applicant]
US 20110037712A1 · Kim et al. · 2011 [cited by applicant]
US 20110058107A1 · Sun et al. · 2011 [cited by applicant]
US 20110060652A1 · Morton · 2011 [cited by applicant]
US 20110080120A1 · Talstra et al. · 2011 [cited by applicant]
US 20110095873A1 · Pratt et al. · 2011 [cited by applicant]
US 20110112969A1 · Zaid et al. · 2011 [cited by applicant]
US 20110149821A1 · Hong et al. · 2011 [cited by applicant]
US 20110175822A1 · Poon et al. · 2011 [cited by applicant]
US 20110234366A1 · Feng et al. · 2011 [cited by applicant]
US 20110292819A1 · Ekbal et al. · 2011 [cited by applicant]
US 20110310087A1 · Wright, Jr. et al. · 2011 [cited by applicant]
US 20110312311A1 · Abifaker et al. · 2011 [cited by applicant]
US 20120000431A1 · Khoshkish · 2012 [cited by applicant]
US 20120089946A1 · Fukui · 2012 [cited by applicant]
US 20120158297A1 · Kim et al. · 2012 [cited by applicant]
US 20120317489A1 · Kuulusa et al. · 2012 [cited by applicant]
US 20130057395A1 · Ohashi · 2013 [cited by applicant]
US 20130096575A1 · Olson · 2013 [cited by applicant]
US 20130097525A1 · Kim et al. · 2013 [cited by applicant]
US 20130214926A1 · Huang · 2013 [cited by applicant]
US 20130234853A1 · Kazerouni · 2013 [cited by applicant]
US 20130298200A1 · Cai · 2013 [cited by applicant]
US 20130328762A1 · McCulloch et al. · 2013 [cited by applicant]
US 20130331130A1 · Lee · 2013 [cited by applicant]
US 20140016821A1 · Arth et al. · 2014 [cited by applicant]
US 20140018097A1 · Goldstein · 2014 [cited by applicant]
US 20140028539A1 · Newham et al. · 2014 [cited by applicant]
US 20140320274A1 · De Schepper et al. · 2014 [cited by applicant]
US 20140337732A1 · Bevilacqua et al. · 2014 [cited by applicant]
US 20140363168A1 · Walker · 2014 [cited by applicant]
US 20150023562A1 · Moshfeghi · 2015 [cited by applicant]
US 20150071438A1 · Lambert · 2015 [cited by applicant]
US 20150082256A1 · Lee · 2015 [cited by applicant]
US 20150088283A1 · Fiedler et al. · 2015 [cited by applicant]
US 20150133051A1 · Jamal-Syed et al. · 2015 [cited by applicant]
US 20150179058A1 · Crafts et al. · 2015 [cited by applicant]
US 20150223017A1 · Lou et al. · 2015 [cited by applicant]
US 20150372754A1 · Choi · 2015 [cited by examiner]
US 20160094934A1 · Yang et al. · 2016 [cited by applicant]
US 20160187995A1 · Rosewall · 2016 [cited by examiner]
US 20160205501A1 · Lee et al. · 2016 [cited by applicant]
US 20160224036A1 · Baker et al. · 2016 [cited by applicant]
US 20160232479A1 · Skaaksrud · 2016 [cited by applicant]
US 20160241910A1 · Rowe · 2016 [cited by applicant]
US 20160334880A1 · Favre et al. · 2016 [cited by applicant]
US 20160358459A1 · Singhar et al. · 2016 [cited by applicant]
US 20170038948A1 · Cun et al. · 2017 [cited by applicant]
US 20170146348A1 · Vandanapu et al. · 2017 [cited by applicant]
US 20170147074A1 · Buttolo et al. · 2017 [cited by applicant]
US 20170228935A1 · Foster et al. · 2017 [cited by applicant]
US 20170229009A1 · Foster et al. · 2017 [cited by applicant]
US 20170243469A1 · Vega et al. · 2017 [cited by applicant]
US 20180103339A1 · Roundtree et al. · 2018 [cited by applicant]
US 20180196527A1 · Poupyrev et al. · 2018 [cited by applicant]
US 20200092925A1 · Foster et al. · 2020 [cited by applicant]
US 20210307093A1 · Foster et al. · 2021 [cited by applicant]
CN 1939009A · 2007 [cited by applicant]
CN 1969197A · 2007 [cited by applicant]
CN 102083236A · 2011 [cited by applicant]
CN 103813449A · 2014 [cited by applicant]
CN 104350730A · 2015 [cited by applicant]
CN 105278674A · 2016 [cited by applicant]
JP 11249778A · 1999 [cited by applicant]
JP 2004040806A · 2004 [cited by applicant]
JP 2004320209A · 2004 [cited by applicant]
JP 2007004777A · 2007 [cited by applicant]
JP 2007531113A · 2007 [cited by applicant]
JP 2008232907A · 2008 [cited by applicant]
JP 2009289192A · 2009 [cited by applicant]
JP 2010282401A · 2010 [cited by applicant]
JP 2011114796A · 2011 [cited by applicant]
JP 2012511275A · 2012 [cited by applicant]
JP 2013051593A · 2013 [cited by applicant]
JP 2013509640A · 2013 [cited by applicant]
JP 2013532338A · 2013 [cited by applicant]
JP 2013533956A · 2013 [cited by applicant]
JP 2014123906A · 2014 [cited by applicant]
JP 2014191367A · 2014 [cited by applicant]
JP 2015118697A · 2015 [cited by applicant]
JP 2015179493A · 2015 [cited by applicant]
JP 2015531130A · 2015 [cited by applicant]
JP 2016009888A · 2016 [cited by applicant]
KR 20110002818A · 2011 [cited by applicant]
KR 20130056275A · 2013 [cited by applicant]
WO 2010137831A2 · 2010 [cited by applicant]
WO 2015030520A1 · 2015 [cited by applicant]
WO 2016005649A1 · 2016 [cited by applicant]
PCT Patent Application No. PCT/US2017/016478—International Search Report and Written Opinion dated May 12, 2017. [cited by applicant]
Australian Patent Application No. 2017214547—Examination Report No. 1 dated Mar. 26, 2019. [cited by applicant]
European Patent Application No. 17748261.9—Extended European Search Report dated Jul. 9, 2019. [cited by applicant]
Japanese Patent Application No. 2018-539298—Office Action dated Aug. 26, 2019. [cited by applicant]
Korean Patent Application No. 10-2018-7021505—Office Action dated Dec. 26, 2019. [cited by applicant]
Japanese Patent Application No. 2018-539298—final rejection dated May 18, 2020. [cited by applicant]
Korean Patent Application No. 10-2018-7021505—Notice of Final Rejection dated Jun. 22, 2020. [cited by applicant]
Korean Patent Application No. 10-2018-7021505—Notice of Final Rejection dated Oct. 15, 2020. [cited by applicant]
Chinese Patent Application No. 201780009457.0—First Office Action dated Oct. 27, 2020. [cited by applicant]
Indian Application No. 201817028409—First Examination Report dated Nov. 9, 2020. [cited by applicant]
Korean Patent Application No. 10-2020-7027200—Notice of Preliminary Rejection dated Nov. 19, 2020. [cited by applicant]
U.S. Appl. No. 16/827,610—Non-Final OA dated Dec. 10, 2020. [cited by applicant]
Australian Patent Application No. 2020203003—Examination Report No. 1 dated May 5, 2021. [cited by applicant]
Chinese Patent Application No. 201780009457.0—Second Office Action dated Jun. 9, 2021. [cited by applicant]
European Patent Application No. 17748261.9—Communication pursuant to Article 94(3) EPC dated Aug. 2, 2021. [cited by applicant]
Japanese Patent Application No. 2020-157320—Office Action dated Sep. 1, 2021. [cited by applicant]
Chinese Patent Application No. 201780009457.0—Notice of Allowance dated Sep. 18, 2021. [cited by applicant]
Korean Patent Application No. 10-2021-7024715—Notice of Preliminary Rejection dated Sep. 28, 2021. [cited by applicant]
U.S. Appl. No. 16/827,610—Final OA dated Apr. 12, 2022. [cited by applicant]
Korean Patent Application No. 10-2022-7019017—Notice of Preliminary Rejection dated Aug. 22, 2022. [cited by applicant]
Japanese Patent Application No. 2022-086623—Notice of Grounds for Rejection dated Jun. 15, 2023. [cited by applicant]
Australian Patent Application No. 2022205199—First Office Action dated Jun. 20, 2023. [cited by applicant]
Korean Patent Application No. 10-2023-7010046—Notice of Preliminary Rejection dated Apr. 6, 2023. [cited by applicant]
European Patent Application 24150583.3—Extended European Search Report dated May 7, 2024. [cited by applicant]
Chinese Patent Application No. 202111466610.7—First Office Action dated Mar. 30, 2024. [cited by applicant]
Chinese Patent Application No. 202111466610.7—Second Office Action dated Nov. 30, 2024. [cited by applicant]
Cited By (1)
US 12,402,225