IP Library › Granted Patent US 12,743,244

Granted Patent B2

US 12,743,244 · App. 18/634,130 · Granted Sep 22, 2026

User interfaces for devices with multiple displays

Inventors: Thomas Steven Hulbert (Palo Alto, CA); Madeleine Cordier (San Francisco, CA); Seung Wook Kim (San Jose, CA); Brigit E. Lamberson (San Francisco, CA); Gemma Roper (San Francisco, CA); Max L. L. McCarthy (San Francisco, CA); Mikael Silvanto (San Francisco, CA)

Assignee: Apple Inc.

G06F3/1423 G06F3/0482 G06F3/04845 G06F3/0485 G06F3/04883 G06F2203/04803 G06F2203/04806 G09G5/373 G09G5/38 G09G2340/0492 G09G2356/00

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,743,244
App. No.: 18/634,130
Granted: Sep 22, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

In some embodiments, an electronic device displays and allows user interaction with content on multiple displays. In some embodiments, an electronic device displays three-dimensional content using coordinated views on multiple displays. In some embodiments, an electronic device shares content while displaying a video conferencing user interface. In some embodiments, an electronic device facilitates the display or keeping private of content on multiple displays. In some embodiments, an electronic device facilitates the display of information from applications using a shared graphical input coordinate space. In some embodiments, an electronic device presents indications of notifications. In some embodiments, an electronic device presents representations of items of content that are related to content presented on the one or more electronic devices. In some embodiments, an electronic device presents user interfaces including a soft keyboard.

Claims (156)

1 . A method comprising:

at an electronic device in communication with a first display, a second display, and one or more input devices:

concurrently displaying:

first content on the first display;

auxiliary content on the first display; and

second content associated with the first content on the second display;

while concurrently displaying the first content and the auxiliary content on the first display and the second content on the second display, receiving, via the one or more input devices, an input corresponding to a request to change currently-displayed content on the electronic device;

in response to receiving the input, updating the first display in accordance with the input to include respective content along with the auxiliary content, wherein the respective content was not displayed prior to receiving the input;

while concurrently displaying the respective content and the auxiliary content on the first display, detecting that a relative angle between the first display and the second display has increased above a threshold angle; and

in response to detecting that the relative angle between the first display and the second display has increased above the threshold angle, updating the first display to cease displaying the auxiliary content on the first display while maintaining display of the respective content.

2 . The method of claim 1 , further comprising:

prior to receiving the input corresponding to the request to change the currently-displayed content on the electronic device, displaying a first portion of the first content on the first display; and

in accordance with a determination that the input was directed towards the second display as part of the request to change the currently-displayed content:

in accordance with a determination that the input was directed to a first displayed portion of the second display, updating the first display to display a second portion of the first content, different from the first portion of the first content, corresponding to the first displayed portion of the second display; and

in accordance with a determination that the input was directed to a second displayed portion of the second display, different from the first displayed portion of the second display, updating the first display to display a third portion of the first content, different from the first portion of the first content and the second portion of the first content, corresponding to the second displayed portion of the second display.

3 . The method of claim 1 , wherein the input comprises an input directed towards the second display and corresponds to a request to filter the second content displayed on the second display, and wherein the method further comprises:

in response to the input directed towards the second display, displaying fifth content on the second display comprising the second content having been filtered based on the requested filter.

4 . The method of claim 3 , wherein the fifth content selected by the requested filter is related to the first content.

5 . The method of claim 3 , wherein the fifth content is related to key words associated with the first content.

6 . The method of claim 3 , wherein the fifth content includes commentary about the first content.

7 . The method of claim 3 , wherein

the first content comprises one or more links to additional content, and

the fifth content comprises one or more previews of content corresponding to the one or more links.

8 . The method of claim 3 , wherein:

the requested filter corresponds to a requested category-filter, and

the fifth content filtered based on the requested category-filter comprises content, of the requested category, related to the first content.

9 . The method of claim 3 , wherein:

the requested filter corresponds to a people-filter, and

the fifth content selected based on the requested filter comprises a plurality of representations of people associated with the first content that include information about the people associated with the first content.

10 . The method of claim 3 , further comprising:

while displaying the first content and the auxiliary content on the first display and displaying the second content on the second display, receiving, via the one or more input devices, an input corresponding to a request to move the second content to the first display; and

in response to receiving the input corresponding to the request to move the second content to the first display, ceasing the display of the first content on the first display; and

displaying the second content on the first display.

11 . The method of claim 3 , wherein:

the first display comprises a touch screen, and

the input directed towards the first display comprises a selection of an affordance displayed on the first display, corresponding to third content that is displayed on the first display in accordance with a determination that the input was directed towards the first display.

12 . The method of claim 11 , wherein:

before receiving the selection of the affordance corresponding to the third content and while displaying the first content on the first display including the auxiliary content and displaying the second content on the second display, the second content was filtered according to first filtering criteria, and

in response to receiving the selection of the affordance corresponding to the third content and while displaying the third content on the first display and displaying fourth content on the second display, the fourth content is filtered according to the first filtering criteria.

13 . The method of claim 1 , wherein the second display comprises a touch screen, and the method further comprises:

while displaying the first content on the first display and the second content, including one or more content items corresponding to respective portions of the first content on the first display, on the second display, receiving, at the touch screen, a second input; and

in response to receiving the second input:

in accordance with a determination that the second input comprises a single-contact selection of a respective content item displayed on the second display that corresponds to a respective portion of the first content on the first display:

displaying, on the first display, the respective portion of the first content related to the selected respective content item; and

in accordance with a determination that the second input comprises a two-contact swipe input:

scrolling the first content on the first display in accordance with the two-contact swipe input.

14 . The method of claim 13 , further comprising:

before detecting the single-contact selection of the respective content item of the second content, displaying, on the second display, a first representation of the respective content item including first information corresponding to the respective content item; and

in response to receiving the single-contact selection of the respective content item:

displaying, on the second display, a second representation of the respective content item that includes second information corresponding to the respective content item, more than the first information; and

updating the first content on the first display to visually emphasize one or more portions of the first content associated with the respective content item.

15 . The method of claim 1 , further comprising:

while displaying the first content on the first display and the second content on the second display while the electronic device is in a first orientation, detecting that the electronic device has been rotated to a second orientation, different than the first orientation; and

in response to detecting that the electronic device has been rotated to the second orientation:

updating the first display to display a first portion of the first content; and

updating the second display to display a second portion of the first content.

16 . The method of claim 15 , further comprising:

in response to the detecting that the electronic device has been rotated from the first orientation to the second orientation, ceasing the displaying of the second content on the second display.

17 . The method of claim 15 , further comprising:

while displaying the second portion of the first content on the second display, receiving, via the one or more input devices, an input corresponding to a selection of a respective item of the second portion of the first content that corresponds to a respective portion of the first portion of the first content; and

in response to receiving the selection of the respective item of the second portion of the first content, updating the first display to display the respective portion of the first portion of the first content.

18 . The method of claim 1 , wherein the second display comprises a touch screen, and the method further comprises:

while displaying the first content on the first display and the second content on the second display, receiving, via the one or more input devices, an input corresponding to selection and movement of a respective content item of the second content towards the first display; and

in response to receiving the input corresponding to the selection and movement of the respective content item of the second content towards the first display, updating the first display to display content corresponding to the respective content item of the second content.

19 . The method of claim 1 , further comprising:

in response to detecting that the relative angle between the first display and the second display has increased above the threshold angle:

updating the second display to display sixth content associated with the emphasized first content on the first display.

20 . The method of claim 19 , further comprising:

detecting, at the electronic device, an event corresponding to a notification; and

in response to detecting the event:

in accordance with a determination that the relative angle between the first display and the second display is less than the threshold angle:

presenting, at the electronic device, an indication of the notification; and

in accordance with a determination that the relative angle between the first display and the second display is greater than the threshold angle:

forgoing the presenting of the indication of the notification.

21 . The method of claim 19 , wherein:

updating the first display to cease displaying the auxiliary content comprises displaying, on the first display, a first portion of the first content without displaying a second portion of the first content on the first display, and

updating the second display to display the sixth content associated with the emphasized first content displayed on the first display comprises displaying the second portion of the first content on the second display.

22 . The method of claim 21 , further comprising:

while displaying the second portion of the first content on the second display, wherein the second portion of the first content includes a plurality of items, receiving, via the one or more input devices, an input selecting a respective item of the plurality of items; and

in response to the input selecting the respective item of the second portion of the first content displayed on the second display:

updating the first display to present a third portion of the first content corresponding to the selected respective item of the second portion of the first content.

23 . The method of claim 21 , further comprising:

while displaying the second portion of the first content on the second display and the first portion of the first content on the first display, wherein the second portion of the first content includes a plurality of items corresponding to the first portion of the first content, receiving, via the one or more input devices, an input corresponding to a request to zoom out of the first portion of the first content displayed on the first display; and

in response to the input to zoom out of the first portion of the first content on the first display:

updating the first display to display the first portion of the first content and a third portion of the first content; and

updating the second display to display the plurality of items corresponding to the first portion of the first content on the first display and one or more items corresponding to the third portion of the first content on the first display.

24 . The method of claim 1 , further comprising:

prior to displaying the first content on the first display and the second content on the second display, displaying, on the electronic device a home screen user interface, wherein displaying the home screen user interface comprises concurrently displaying:

on the first display, one or more first items that are not customized to a user of the electronic device; and

on the second display, one or more second items that are customized to the user of the electronic device,

wherein:

the first content on the first display and the second content on the second display are displayed in response to detecting selection of a respective item of the one or more first items or the one or more second items,

the first content on the first display comprises content corresponding to the selected respective item, and

the second content on the second display comprises one or more controls for navigating the first content on the first display.

25 . An electronic device, comprising:

one or more processors;

a first display;

a second display;

one or more input devices;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

concurrently displaying:

first content on the first display;

auxiliary content on the first display; and

second content associated with the first content on the second display;

26 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device having a first display, a second display and one or more input devices, cause the electronic device to perform:

concurrently displaying:

first content on the first display;

auxiliary content on the first display; and

second content associated with the first content on the second display;

27 . The electronic device of claim 25 , wherein the one or more programs include further instructions for:

prior to receiving the input corresponding to the request to change the currently-displayed content on the electronic device, displaying a first portion of the first content on the first display;

and in accordance with a determination that the input was directed towards the second display as part of the request to change the currently-displayed content:

28 . The electronic device of claim 25 , wherein the second display comprises a touch screen, and wherein the one or more programs includes further instructions for:

in response to receiving the second input:

displaying, on the first display, the respective portion of the first content related to the selected respective content item; and

in accordance with a determination that the second input comprises a two-contact swipe input:

scrolling the first content on the first display in accordance with the two-contact swipe input.

29 . The electronic device of claim 28 , wherein the one or more programs include further instructions for:

detecting, at the electronic device, an event corresponding to a notification; and

in response to detecting the event:

in accordance with a determination that the relative angle between the first display and the second display is less than the threshold angle:

presenting, at the electronic device, an indication of the notification; and

in accordance with a determination that the relative angle between the first display and the second display is greater than the threshold angle:

forgoing the presenting of the indication of the notification.

30 . The non-transitory computer readable storage medium of claim 26 , further storing instructions which, when executed by the one or more processors, further cause the electronic device to perform:

prior to receiving the input corresponding to the request to change the currently-displayed content on the electronic device, displaying a first portion of the first content on the first display; and

in accordance with a determination that the input was directed towards the second display as part of the request to change the currently-displayed content:

31 . The non-transitory computer readable storage medium of claim 26 , wherein the second display comprises a touch screen, and wherein the non-transitory computer readable storage medium further stores instructions which, when executed by the one or more processors, further causes the electronic device to perform:

in response to receiving the second input:

displaying, on the first display, the respective portion of the first content related to the selected respective content item; and

in accordance with a determination that the second input comprises a two-contact swipe input:

scrolling the first content on the first display in accordance with the two- contact swipe input.

32 . The non-transitory computer readable storage medium of claim 31 , further storing instructions which, when executed by the one or more processors, further cause the electronic device to perform:

detecting, at the electronic device, an event corresponding to a notification; and

in response to detecting the event:

in accordance with a determination that the relative angle between the first display and the second display is less than the threshold angle:

presenting, at the electronic device, an indication of the notification; and

in accordance with a determination that the relative angle between the first display and the second display is greater than the threshold angle:

forgoing the presenting of the indication of the notification.

Continuity (5)

Continuation 17389041 · Jul 29, 2021

Continuation 16147183 · Sep 28, 2018

Provisional Application 62737030 · Sep 26, 2018

Provisional Application 62566368 · Sep 30, 2017

Related Publication 20240281189A1 · Aug 22, 2024

References Cited (253)

US 5483261A · Yasutake · 1996 [cited by applicant]

US 5488204A · Mead et al. · 1996 [cited by applicant]

US 5825352A · Bisset et al. · 1998 [cited by applicant]

US 5835079A · Shieh · 1998 [cited by applicant]

US 5880411A · Gillespie et al. · 1999 [cited by applicant]

US 6188391B1 · Seely et al. · 2001 [cited by applicant]

US 6310610B1 · Beaton et al. · 2001 [cited by applicant]

US 6323846B1 · Westerman et al. · 2001 [cited by applicant]

US 6570557B1 · Westerman et al. · 2003 [cited by applicant]

US 6677932B1 · Westerman · 2004 [cited by applicant]

US 6690387B2 · Zimmerman et al. · 2004 [cited by applicant]

US 6839741B1 · Tsai · 2005 [cited by applicant]

US 7015894B2 · Morohoshi · 2006 [cited by applicant]

US 7184064B2 · Zimmerman et al. · 2007 [cited by applicant]

US 7209948B2 · Srinivasa · 2007 [cited by applicant]

US 7277901B2 · Parker et al. · 2007 [cited by applicant]

US 7483899B2 · Berry et al. · 2009 [cited by applicant]

US 7503007B2 · Goodman et al. · 2009 [cited by applicant]

US 7529796B2 · Riddle · 2009 [cited by applicant]

US 7614008B2 · Ording · 2009 [cited by applicant]

US 7633076B2 · Huppi et al. · 2009 [cited by applicant]

US 7653883B2 · Hotelling et al. · 2010 [cited by applicant]

US 7657849B2 · Chaudhri et al. · 2010 [cited by applicant]

US 7663607B2 · Hotelling et al. · 2010 [cited by applicant]

US 7707249B2 · Spataro et al. · 2010 [cited by applicant]

US 7756935B2 · Gaucas · 2010 [cited by applicant]

US 7761507B2 · Herf et al. · 2010 [cited by applicant]

US 7844914B2 · Andre et al. · 2010 [cited by applicant]

US 7957762B2 · Herz et al. · 2011 [cited by applicant]

US 7970850B1 · Callanan et al. · 2011 [cited by applicant]

US 8006002B2 · Kalayjian et al. · 2011 [cited by applicant]

US 8060820B2 · Bedi et al. · 2011 [cited by applicant]

US 8108464B1 · Rochelle et al. · 2012 [cited by applicant]

US 8239784B2 · Hotelling et al. · 2012 [cited by applicant]

US 8279180B2 · Hotelling et al. · 2012 [cited by applicant]

US 8381135B2 · Hotelling et al. · 2013 [cited by applicant]

US 8453052B1 · Newman et al. · 2013 [cited by applicant]

US 8464147B2 · Seetharam · 2013 [cited by applicant]

US 8479122B2 · Hotelling et al. · 2013 [cited by applicant]

US 8713106B2 · Spataro et al. · 2014 [cited by applicant]

US 8806382B2 · Matsuda · 2014 [cited by applicant]

US 8826148B2 · Yuniardi et al. · 2014 [cited by applicant]

US 8826375B2 · Smith et al. · 2014 [cited by applicant]

US 9031543B2 · Lee · 2015 [cited by applicant]

US 9165285B2 · Schultz et al. · 2015 [cited by applicant]

US 9189480B2 · Thiruvidan et al. · 2015 [cited by applicant]

US 9282167B2 · Jo et al. · 2016 [cited by applicant]

US 9348458B2 · Hotelling et al. · 2016 [cited by applicant]

US 9413891B2 · Dwyer et al. · 2016 [cited by applicant]

US 9418117B1 · Molina et al. · 2016 [cited by applicant]

US 9603123B1 · Jackson et al. · 2017 [cited by applicant]

US 9703468B2 · Reeves et al. · 2017 [cited by applicant]

US 9832195B2 · Gillett et al. · 2017 [cited by applicant]

US 9852761B2 · Anzures · 2017 [cited by applicant]

US 9933937B2 · Lemay et al. · 2018 [cited by applicant]

US 10057731B2 · Grossman et al. · 2018 [cited by applicant]

US 10185932B2 · Costenaro et al. · 2019 [cited by applicant]

US 10291560B2 · Bern et al. · 2019 [cited by applicant]

US 10318034B1 · Hauenstein et al. · 2019 [cited by applicant]

US 11079995B1 · Hulbert et al. · 2021 [cited by applicant]

US 11122158B2 · Christie et al. · 2021 [cited by applicant]

US 11310178B2 · Crevier et al. · 2022 [cited by applicant]

US 11310181B2 · Park et al. · 2022 [cited by applicant]

US 11422765B2 · Sun et al. · 2022 [cited by applicant]

US 11556225B1 · Romagnoli et al. · 2023 [cited by applicant]

US 11558323B1 · Yamamoto et al. · 2023 [cited by applicant]

US 11604561B2 · Deets et al. · 2023 [cited by applicant]

US 11616749B2 · Voss · 2023 [cited by applicant]

US 12099772B2 · Sun et al. · 2024 [cited by applicant]

US 12107803B2 · Estrada et al. · 2024 [cited by applicant]

US 12294555B2 · Kim · 2025 [cited by applicant]

US 20020015024A1 · Westerman et al. · 2002 [cited by applicant]

US 20030131062A1 · Miyashita · 2003 [cited by applicant]

US 20030212746A1 · Fitzpatrick et al. · 2003 [cited by applicant]

US 20030236752A1 · Dawson et al. · 2003 [cited by applicant]

US 20050165584A1 · Boody et al. · 2005 [cited by applicant]

US 20050165920A1 · Kerr et al. · 2005 [cited by applicant]

US 20050190059A1 · Wehrenberg · 2005 [cited by applicant]

US 20060017692A1 · Wehrenberg et al. · 2006 [cited by applicant]

US 20060033724A1 · Chaudhri et al. · 2006 [cited by applicant]

US 20060036703A1 · Fulmer et al. · 2006 [cited by applicant]

US 20060041848A1 · Lira · 2006 [cited by applicant]

US 20060053195A1 · Schneider et al. · 2006 [cited by applicant]

US 20060197753A1 · Hotelling · 2006 [cited by applicant]

US 20060256008A1 · Rosenberg · 2006 [cited by applicant]

US 20070049258A1 · Thibeault · 2007 [cited by applicant]

US 20070168444A1 · Chen et al. · 2007 [cited by applicant]

US 20070222768A1 · Geurts et al. · 2007 [cited by applicant]

US 20080028017A1 · Garbow et al. · 2008 [cited by applicant]

US 20080028323A1 · Rosen et al. · 2008 [cited by applicant]

US 20080298720A1 · Klassen et al. · 2008 [cited by applicant]

US 20090019392A1 · Higuchi et al. · 2009 [cited by applicant]

US 20090037605A1 · Li · 2009 [cited by applicant]

US 20090322689A1 · Kwong et al. · 2009 [cited by applicant]

US 20100081475A1 · Chiang et al. · 2010 [cited by applicant]

US 20100184375A1 · Ohkita · 2010 [cited by applicant]

US 20100235746A1 · Anzures · 2010 [cited by applicant]

US 20100257457A1 · De · 2010 [cited by applicant]

US 20100287513A1 · Singh et al. · 2010 [cited by applicant]

US 20110066685A1 · Kitada et al. · 2011 [cited by applicant]

US 20110078573A1 · Ooba · 2011 [cited by applicant]

US 20110083111A1 · Forutanpour et al. · 2011 [cited by applicant]

US 20110107234A1 · Lee et al. · 2011 [cited by applicant]

US 20110107272A1 · Aguilar · 2011 [cited by examiner]

US 20110209102A1 · Hinckley et al. · 2011 [cited by applicant]

US 20110225178A1 · Ingrassia et al. · 2011 [cited by applicant]

US 20120131491A1 · Lee · 2012 [cited by applicant]

US 20120136951A1 · Mulder · 2012 [cited by applicant]

US 20120154294A1 · Hinckley et al. · 2012 [cited by applicant]

US 20120284344A1 · Costenaro et al. · 2012 [cited by applicant]

US 20120284345A1 · Costenaro et al. · 2012 [cited by applicant]

US 20120289203A1 · Santo et al. · 2012 [cited by applicant]

US 20120317489A1 · Kuulusa et al. · 2012 [cited by applicant]

US 20130024778A1 · Reeves et al. · 2013 [cited by applicant]

US 20130036364A1 · Johnson · 2013 [cited by applicant]

US 20130076595A1 · Sirpal et al. · 2013 [cited by applicant]

US 20130198304A1 · Jung · 2013 [cited by applicant]

US 20130321340A1 · Seo et al. · 2013 [cited by applicant]

US 20140006994A1 · Koch et al. · 2014 [cited by applicant]

US 20140101575A1 · Kwak et al. · 2014 [cited by applicant]

US 20140101578A1 · Kwak et al. · 2014 [cited by applicant]

US 20140101579A1 · Kim et al. · 2014 [cited by applicant]

US 20140104643A1 · Park · 2014 [cited by applicant]

US 20140115469A1 · Pendergast et al. · 2014 [cited by applicant]

US 20140123038A1 · Ahn et al. · 2014 [cited by applicant]

US 20140152576A1 · Kim et al. · 2014 [cited by applicant]

US 20140164365A1 · Graham · 2014 [cited by examiner]

US 20140187162A1 · Mei · 2014 [cited by applicant]

US 20140188989A1 · Stekkelpak et al. · 2014 [cited by applicant]

US 20140195928A1 · Carlen · 2014 [cited by applicant]

US 20140247207A1 · Pahud et al. · 2014 [cited by applicant]

US 20140247346A1 · Bozarth et al. · 2014 [cited by applicant]

US 20140280748A1 · Hinckley et al. · 2014 [cited by applicant]

US 20140310365A1 · Sample et al. · 2014 [cited by applicant]

US 20140323162A1 · Ezra et al. · 2014 [cited by applicant]

US 20140365912A1 · Shaw et al. · 2014 [cited by applicant]

US 20140372390A1 · Matsuzawa et al. · 2014 [cited by applicant]

US 20150009189A1 · Nagara · 2015 [cited by applicant]

US 20150026595A1 · Lu et al. · 2015 [cited by applicant]

US 20150061968A1 · Park et al. · 2015 [cited by applicant]

US 20150074615A1 · Han et al. · 2015 [cited by applicant]

US 20150095430A1 · Kaushik et al. · 2015 [cited by applicant]

US 20150121535A1 · Fiss · 2015 [cited by applicant]

US 20150143211A1 · Kaufthal et al. · 2015 [cited by applicant]

US 20150195220A1 · Hawker et al. · 2015 [cited by applicant]

US 20150220493A1 · Hayashi et al. · 2015 [cited by applicant]

US 20150242110A1 · Balakrishnan et al. · 2015 [cited by applicant]

US 20150264111A1 · Aleksandrov · 2015 [cited by applicant]

US 20150317120A1 · Kim · 2015 [cited by examiner]

US 20150338888A1 · Kim et al. · 2015 [cited by applicant]

US 20150347368A1 · Carlen et al. · 2015 [cited by applicant]

US 20150350134A1 · Yang et al. · 2015 [cited by applicant]

US 20160035312A1 · Lee et al. · 2016 [cited by applicant]

US 20160085319A1 · Kim · 2016 [cited by examiner]

US 20160124698A1 · Reeves et al. · 2016 [cited by applicant]

US 20160198499A1 · Lee et al. · 2016 [cited by applicant]

US 20160234135A1 · Kim · 2016 [cited by applicant]

US 20160234659A1 · Luo · 2016 [cited by applicant]

US 20160308940A1 · Procopio et al. · 2016 [cited by applicant]

US 20170032021A1 · Watanachote · 2017 [cited by applicant]

US 20170149906A1 · Demaris et al. · 2017 [cited by applicant]

US 20170164140A1 · Li et al. · 2017 [cited by applicant]

US 20170177194A1 · Lyons et al. · 2017 [cited by applicant]

US 20170177610A1 · Knotts et al. · 2017 [cited by applicant]

US 20170187656A1 · Bastide et al. · 2017 [cited by applicant]

US 20170220546A1 · Codrington et al. · 2017 [cited by applicant]

US 20170273050A1 · Levak et al. · 2017 [cited by applicant]

US 20170285895A1 · Nathwani et al. · 2017 [cited by applicant]

US 20180018636A1 · Bisti et al. · 2018 [cited by applicant]

US 20180095611A1 · Kuscher et al. · 2018 [cited by applicant]

US 20180113520A1 · Klein · 2018 [cited by examiner]

US 20180121465A1 · Bajaj et al. · 2018 [cited by applicant]

US 20180145937A1 · Choi et al. · 2018 [cited by applicant]

US 20180225132A1 · Pierce · 2018 [cited by examiner]

US 20180246933A1 · Darrow et al. · 2018 [cited by applicant]

US 20180352072A1 · Christie et al. · 2018 [cited by applicant]

US 20190179501A1 · Seeley et al. · 2019 [cited by applicant]

US 20190243889A1 · Carter et al. · 2019 [cited by applicant]

US 20190334847A1 · Genovese et al. · 2019 [cited by applicant]

US 20190361950A1 · Ganesan et al. · 2019 [cited by applicant]

US 20190362002A1 · Dowling et al. · 2019 [cited by applicant]

US 20200019367A1 · Sun et al. · 2020 [cited by applicant]

US 20200125792A1 · Rochelle et al. · 2020 [cited by applicant]

US 20200274916A1 · Choi · 2020 [cited by applicant]

US 20200356221A1 · Behzadi et al. · 2020 [cited by applicant]

US 20210103366A1 · Behzadi et al. · 2021 [cited by applicant]

US 20210110327A1 · Bellet et al. · 2021 [cited by applicant]

US 20210133681A1 · Dhaliwal et al. · 2021 [cited by applicant]

US 20210174188A1 · Hewitt et al. · 2021 [cited by applicant]

US 20210357169A1 · Hulbert et al. · 2021 [cited by applicant]

US 20220014486A1 · Botwick et al. · 2022 [cited by applicant]

US 20220108413A1 · Hack et al. · 2022 [cited by applicant]

US 20220155920A1 · Behzadi et al. · 2022 [cited by applicant]

US 20230053643A1 · Yamamoto et al. · 2023 [cited by applicant]

US 20230078889A1 · Sun et al. · 2023 [cited by applicant]

US 20230208662A1 · Choi · 2023 [cited by applicant]

US 20230379286A1 · Maruyama et al. · 2023 [cited by applicant]

US 20240143553A1 · Chang et al. · 2024 [cited by applicant]

US 20250028688A1 · Chang et al. · 2025 [cited by applicant]

US 20250123786A1 · Sun et al. · 2025 [cited by applicant]

US 20250165207A1 · Hulbert et al. · 2025 [cited by applicant]

US 20250224852A1 · Behzadi et al. · 2025 [cited by applicant]

CN 104246678A · 2014 [cited by applicant]

EP 2073514A2 · 2009 [cited by applicant]

EP 2293531A1 · 2011 [cited by applicant]

EP 3041313A1 · 2016 [cited by applicant]

JP 2000163031A · 2000 [cited by applicant]

JP 2002342033A · 2002 [cited by applicant]

JP 2003152615A · 2003 [cited by applicant]

WO 2013169849A2 · 2013 [cited by applicant]

WO 2014105276A1 · 2014 [cited by applicant]

WO 2017176036A1 · 2017 [cited by applicant]

Corrected Notice of Allowability received for U.S. Appl. No. 17/086,205, mailed on Nov. 10, 2021, 2 pages. [cited by applicant]

Corrected Notice of Allowance received for U.S. Appl. No. 16/506,697, mailed on Jul. 18, 2022, 2 pages. [cited by applicant]

Final Office Action received for U.S. Appl. No. 16/147,183, mailed on Oct. 14, 2020, 18 pages. [cited by applicant]

Final Office Action received for U.S. Appl. No. 16/506,697, mailed on Mar. 25, 2021, 15 pages. [cited by applicant]

International Search Report received for PCT Patent Application No. PCT/US2020/031732, mailed on Sep. 28, 2020, 5 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 16/147,183, mailed on Mar. 5, 2020, 16 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 16/506,697, mailed on Sep. 7, 2021, 15 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 16/506,697, mailed on Sep. 15, 2020, 13 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 16/584,685, mailed on Jan. 2, 2020, 17 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 17/389,041, mailed on May 3, 2023, 13 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 17/589,309, mailed on Jan. 31, 2023, 22 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 16/147,183, mailed on Apr. 2, 2021, 6 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 16/506,697, mailed on Apr. 8, 2022, 8 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 16/584,685, mailed on Jul. 27, 2020, 10 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 17/086,205, mailed on Oct. 20, 2021, 10 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 17/389,041, mailed on Dec. 13, 2023, 6 pages. [cited by applicant]

Supplemental Notice of Allowability received for U.S. Appl. No. 17/086,205, mailed on Dec. 30, 2021, 5 pages. [cited by applicant]

Dearman et al., “Determining the orientation of proximate mobile devices using their back facing camera.”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems., May 2012, 4 pages. [cited by applicant]

Gostner et al., “Usage of Spatial Information for Selection of Co-located Devices”, Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services, Sep. 2008, pp. 427-430. [cited by applicant]

Hazas et al., “A Relative Positioning System for Co-located Mobile Devices”, Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services, Jun. 2005, pp. 177-190. [cited by applicant]

Kortuem et al., “Sensing and Visualizing Spatial Relations of Mobile Devices”, Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, Oct. 2005, pp. 93-102. [cited by applicant]

Lee et al., “A Multi-Touch Three Dimensional Touch-Sensitive Tablet”, CHI'85 Proceedings, Apr. 1985, pp. 21-25. [cited by applicant]

Rubine, Dean, “Combining Gestures and Direct Manipulation”, CHI'92, May 3-7, 1992, pp. 659-660. [cited by applicant]

Rubine, Dean H., “The Automatic Recognition of Gestures”, CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, Dec… [cited by applicant]

Westerman, Wayne, “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface”, A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requiremen… [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 18/328,704, mailed on Mar. 26, 2024, 26 pages. [cited by applicant]

Final Office Action received for U.S. Appl. No. 17/589,309, mailed on Nov. 13, 2023, 24 pages. [cited by applicant]

Final Office Action received for U.S. Appl. No. 18/328,704, mailed on Sep. 10, 2024, 26 pages. [cited by applicant]

International Search Report received for PCT Patent Application No. PCT/US2023/024377, mailed on Sep. 25, 2023, 4 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 17/821,457, mailed on Jan. 30, 2024, 10 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 18/328,704, mailed on Dec. 18, 2024, 28 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 17/589,309, mailed on Mar. 6, 2024, 7 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 17/821,457, mailed on May 16, 2024, 5 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 17/589,309, mailed on Jul. 3, 2024, 5 pages. [cited by applicant]

Search Report received for Chinese Patent Application No. 202210128123.8, mailed on Dec. 9, 2023, 4 pages (2 pages of English Translation and 2 pages of Official Copy). [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 18/893,844, mailed on May 19, 2025, 10 pages. [cited by applicant]

Final Office Action received for U.S. Appl. No. 18/328,704, mailed on May 15, 2025, 30 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 18/904,945, mailed on Aug. 11, 2025, 32 pages. [cited by applicant]

Advisory Action received for U.S. Appl. No. 18/328,704, mailed on Jun. 16, 2025, 4 pages. [cited by applicant]

Non-Final Office Action received for U.S. Appl. No. 18/328,704, mailed on Aug. 28, 2025, 44 pages. [cited by applicant]

Notice of Allowance received for U.S. Appl. No. 18/893,844, mailed on Sep. 9, 2025, 5 pages. [cited by applicant]