IP Library Granted Patent US 12,200,164
Granted Patent B2
US 12,200,164 · App. 18/184,614 · Granted Jan 14, 2025

Coordinated video data presentation using a head-worn wearable device and a communicatively coupled electronic device, and methods of use thereof

Inventors: Willy Huang (San Francisco, CA); David Sven Woodland (Issaquah, WA); Hind Hobeika (San Francisco, CA); Benjamin Neal Bethurum (Shoreline, WA)
Assignee: Meta Platforms Technologies, LLC
H04M1/72439G02B27/0093G02B27/0101G02B27/017G02B27/0179G06F1/163G06F3/014G06F3/017G06F3/0346G06V40/28G10L13/08H04M1/724095H04M1/724097H04N7/141G02B2027/0138G02B2027/014G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,164
App. No.
18/184,614
Granted
Jan 14, 2025
Kind
B2
Abstract

Systems and methods are provided for determining when to present video data via a head-worn wearable device. A head-wearable device includes a display, one or more processors, and memory. The memory includes instructions that, when executed by the one or more processors, cause a head-wearable device, when worn, to detect an electronic device associated with a user of the head-wearable device. The instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to in accordance with a determination that the electronic device is in proximity to the head-wearable device and presenting video data, and further in accordance with a determination that sensor data received at the head-wearable device indicates that a video-viewing precondition is present, cease to cause presentation of the video data at the electronic device, and cause the presentation of the video data at the display of the head-wearable device.

Claims (68)

1. A head-wearable device, comprising:

a display;

one or more processors; and

memory including instructions that, when executed by the one or more processors, cause a head-wearable device to:

detect an electronic device associated with a user of the head-wearable device;

in accordance with a determination that the electronic device is in proximity to the head-wearable device and presenting video data:

in accordance with a determination that sensor data received at the head-wearable device indicates that a video-viewing precondition is present while the head-wearable device is worn by the user:

cease to cause presentation of the video data at the electronic device, and

cause presentation of the video data at the display of the head-wearable device; and

in accordance with a determination that the head-wearable device is no longer worn:

cease presenting, via the display, the video data, and

cause the electronic device to present the video data.

2. The head-wearable device of claim 1 , wherein a determination that a video-viewing precondition is present is based on one or both of (i) a position of the head-wearable device and (ii) a position of the electronic device.

3. The head-wearable device of claim 1 , wherein the instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to:

detect one or more gestures performed by the user, the one or more gestures associated with one or more commands to be performed at the head-wearable device and/or the electronic device; and

cause performance of the one or more commands at the head-wearable device and/or the electronic device.

4. The head-wearable device of claim 2 , further comprising:

one or more imaging devices; and

wherein the instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to:

capture, via the one or more imaging devices, image data, and

detect, based on the image data, one or more gestures performed by the user, the one or more gestures including one or more hand gestures.

5. The head-wearable device of claim 1 , wherein the instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to:

in response to receiving one or more electronic messages at the head-wearable device and/or the electronic device, cause the head-wearable device to provide a notification to the user, the notification indicating receipt of the one or more electronic messages.

6. The head-wearable device of claim 1 , wherein the video data is associated with a video call received by the electronic device from another electronic device.

7. The head-wearable device of claim 6 , wherein the instructions, when executed by the one or more processors, further cause the head-wearable device, when worn, to:

while the video call is ongoing, provide an avatar representing the user's face to the other electronic device via the head-wearable device and/or the electronic device such that the other electronic device is caused to present the avatar representing the user's face.

8. The head-wearable device of claim 1 , wherein the instructions, when executed by the one or more processors, further cause the head-wearable device to:

in accordance with a determination that the video-viewing precondition is no longer present:

cease presenting, via the display, the video data, and

cause the electronic device to present the video data.

9. The head-wearable device of claim 1 , wherein the electronic device is selected from the group consisting of: a wrist-wearable device, a laptop, a tablet, a smartphone, a computer, and a TV.

10. A non-transitory, computer-readable storage medium including instructions that, when executed by one or more processors of a head-wearable device, cause the head-wearable device to:

detect an electronic device associated with a user of the head-wearable device;

in accordance with a determination that the electronic device is in proximity to the head-wearable device and presenting video data:

in accordance with a determination that sensor data received at the head-wearable device indicates that a video-viewing precondition is present while the head-wearable device is worn by the user:

cease to cause presentation of the video data at the electronic device, and

cause presentation of the video data at a display of the head-wearable device; and

in accordance with a determination that the head-wearable device is no longer worn;

cease presenting, via the display, the video data, and

cause the electronic device to present the video data.

11. The non-transitory, computer-readable storage medium of claim 10 , wherein a determination that a video-viewing precondition is present is based on one or both of (i) a position of the head-wearable device and (ii) a position of the electronic device.

12. The non-transitory, computer-readable storage medium of claim 10 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device, when worn, to:

detect one or more gestures performed by the user, the one or more gestures associated with one or more commands to be performed at the head-wearable device and/or the electronic device; and

cause performance of the one or more commands at the head-wearable device and/or the electronic device.

13. The non-transitory, computer-readable storage medium of claim 10 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device, when worn, to:

capture, via one or more imaging devices, image data, and

detect, based on the image data, one or more gestures performed by the user, the one or more gestures including one or more hand gestures.

14. The non-transitory, computer-readable storage medium of claim 10 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device, when worn, to:

in response to receiving one or more electronic messages at the head-wearable device and/or the electronic device, cause the head-wearable device to provide a notification to the user, the notification indicating receipt of the one or more electronic messages.

15. The non-transitory, computer-readable storage medium of claim 10 , wherein the video data is associated with a video call received by the user.

16. The non-transitory, computer-readable storage medium of claim 10 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

in accordance with a determination that the video-viewing precondition is no longer present:

cease presenting, via the display, the video data, and

cause the electronic device to present the video data.

17. The non-transitory, computer-readable storage medium of claim 10 , wherein the electronic device is selected from the group consisting of: a wrist-wearable device, a laptop, a tablet, a smartphone, a computer, and a TV.

18. A method performed by a head-wearable device, comprising:

detecting, an electronic device associated with a user of the head-wearable device;

in accordance with a determination that the electronic device is in proximity to the head-wearable device and presenting video data:

in accordance with a determination that sensor data received at the head-wearable device indicates that a video-viewing precondition is present while the head-wearable device is worn by the user:

ceasing to cause presentation of the video data at the electronic device, and

causing presentation of the video data at a display of the head-wearable device; and

in accordance with a determination that the head-wearable device is no longer worn:

ceasing to cause presentation, via display, of the video data, and

causing the electronic device to present the video data.

19. The method of claim 18 , wherein a determination that a video-viewing precondition is present is based on one or both of (i) a position of the head-wearable device and (ii) a position of the electronic device.

20. The method of claim 18 , further comprising:

detecting one or more gestures performed by the user, the one or more gestures associated with one or more commands to be performed at the head-wearable device and/or the electronic device; and

causing performance of the one or more commands at the head-wearable device and/or the electronic device.

Continuity (8)
Continuation 17721304 · Apr 14, 2022
Continuation 17721327 · Apr 14, 2022
Continuation 17721322 · Apr 14, 2022
Provisional Application 63307624 · Feb 7, 2022
Provisional Application 63254498 · Oct 11, 2021
Provisional Application 63223939 · Jul 20, 2021
Provisional Application 63176839 · Apr 19, 2021
Related Publication 20230328168A1 · Oct 12, 2023
References Cited (74)
US 5689669A · Lynch et al. · 1997 [cited by applicant]
US 6002853A · De Hond · 1999 [cited by applicant]
US 6243091B1 · Berstis · 2001 [cited by applicant]
US 6271843B1 · Lection et al. · 2001 [cited by applicant]
US 6285757B1 · Carroll et al. · 2001 [cited by applicant]
US 6362817B1 · Powers et al. · 2002 [cited by applicant]
US 6414679B1 · Miodonski et al. · 2002 [cited by applicant]
US 6570563B1 · Honda · 2003 [cited by applicant]
US 6573903B2 · Gantt · 2003 [cited by applicant]
US 6590593B1 · Robertson et al. · 2003 [cited by applicant]
US 6621508B1 · Shiraishi et al. · 2003 [cited by applicant]
US 6690393B2 · Heron et al. · 2004 [cited by applicant]
US 6763226B1 · McZeal, Jr. · 2004 [cited by applicant]
US 6961055B2 · Doak et al. · 2005 [cited by applicant]
US 7382288B1 · Wilson et al. · 2008 [cited by applicant]
US 7414629B2 · Santodomingo et al. · 2008 [cited by applicant]
US 7467356B2 · Gettman et al. · 2008 [cited by applicant]
US 7653877B2 · Matsuda · 2010 [cited by applicant]
US 7746343B1 · Charaniya et al. · 2010 [cited by applicant]
US 8316104B2 · Galvez et al. · 2012 [cited by applicant]
US 9024842B1 · Prada et al. · 2015 [cited by applicant]
US 9274507B2 · Kim et al. · 2016 [cited by applicant]
US 9432839B2 · Stanley-Marbell et al. · 2016 [cited by applicant]
US 9442523B2 · Lee et al. · 2016 [cited by applicant]
US 9674694B2 · Subbaramoo et al. · 2017 [cited by applicant]
US 9743045B2 · Lin et al. · 2017 [cited by applicant]
US 9952433B2 · Um et al. · 2018 [cited by applicant]
US 11200869B1 · Post et al. · 2021 [cited by applicant]
US 20010018667A1 · Kim · 2001 [cited by applicant]
US 20020021622A1 · Baroche · 2002 [cited by applicant]
US 20020095463A1 · Matsuda · 2002 [cited by applicant]
US 20050093719A1 · Okamoto et al. · 2005 [cited by applicant]
US 20050128212A1 · Edecker et al. · 2005 [cited by applicant]
US 20080169998A1 · Jacobsen et al. · 2008 [cited by applicant]
US 20080235570A1 · Sawada et al. · 2008 [cited by applicant]
US 20130127980A1 · Haddick et al. · 2013 [cited by applicant]
US 20130342637A1 · Felkai · 2013 [cited by examiner]
US 20150111558A1 · Yang · 2015 [cited by applicant]
US 20150215351A1 · Barzuza · 2015 [cited by examiner]
US 20150281569A1 · Mizuno et al. · 2015 [cited by applicant]
US 20150309316A1 · Osterhout et al. · 2015 [cited by applicant]
US 20150355677A1 · Breedvelt-Schouten et al. · 2015 [cited by applicant]
US 20170064071A1 · Won et al. · 2017 [cited by applicant]
US 20170237986A1 · Choi · 2017 [cited by examiner]
US 20180324562A1 · Park et al. · 2018 [cited by applicant]
US 20190149937A1 · Norris et al. · 2019 [cited by applicant]
US 20200004313A1 · Kelley et al. · 2020 [cited by applicant]
US 20210255461A1 · Watanabe · 2021 [cited by examiner]
US 20220067965A1 · Woods et al. · 2022 [cited by applicant]
CA 2275784A1 · 1999 [cited by applicant]
CA 2275784C · 2000 [cited by applicant]
CN 101345962A · 2009 [cited by applicant]
CN 108881778A · 2018 [cited by applicant]
EP 2863276A2 · 2015 [cited by applicant]
EP 3089658A1 · 2016 [cited by applicant]
FR 2979517A3 · 2013 [cited by applicant]
GB 2419058A · 2006 [cited by applicant]
WO 0055978A1 · 2000 [cited by applicant]
Burns G., “iPhone Users are Getting this Temperature Warning,” SlashGear, Jun. 25, 2018, Retrieved on [Feb. 18, 2021], 11 pages, Retrieved from the Internet: URL: https://www.slashgear.com/iphone-users-are-getting-this-… [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/025290, mailed Sep. 8, 2022, 18 pages. [cited by applicant]
Invitation to Pay Additional Fees for International Application No. PCT/US2022/025290 mailed Jul. 18, 2022, 14 pages. [cited by applicant]
Iphonetrics, “Apple Watch Temperature Warning Screen,” TILs, Sep. 28, 2015, Retrieved on [Feb. 18, 2021], 10 pages, Retrieved from the Internet: URL: https://www.iphonetricks.org/apple-watch-temperature-warning-screen/. [cited by applicant]
Machine Translation of FR2979517A3, Mar. 1, 2013, 21 pages. [cited by applicant]
Non-Final Office Action mailed Jul. 1, 2022 for U.S. Appl. No. 17/721,322, filed Apr. 14, 2022, 13 pages. [cited by applicant]
Non-Final Office Action mailed Jun. 10, 2022 for U.S. Appl. No. 17/721,304, filed Apr. 14, 2022, 10 pages. [cited by applicant]
Non-Final Office Action mailed Jun. 20, 2022 for U.S. Appl. No. 17/721,327, filed Apr. 14, 2022, 13 pages. [cited by applicant]
Notice of Allowance mailed Feb. 8, 2023 for U.S. Appl. No. 17/721,304, filed Apr. 14, 2022, 11 pages. [cited by applicant]
Notice of Allowance mailed Dec. 9, 2022 for U.S. Appl. No. 17/721,327, filed Apr. 14, 2022, 8 pages. [cited by applicant]
Notice of Allowance mailed Dec. 16, 2022 for U.S. Appl. No. 17/721,322, filed Apr. 14, 2022, 12 pages. [cited by applicant]
Notice of Allowance mailed Nov. 2, 2022 for U.S. Appl. No. 17/721,322, filed Apr. 14, 2022, 11 pages. [cited by applicant]
Notice of Allowance mailed Aug. 24, 2022 for U.S. Appl. No. 17/721,327, filed Apr. 14, 2022, 9 pages. [cited by applicant]
Notice of Allowance mailed Aug. 25, 2022 for U.S. Appl. No. 17/721,304, filed Apr. 14, 2022, 8 pages. [cited by applicant]
Notice of Allowance mailed Mar. 27, 2023 for U.S. Appl. No. 17/721,327, filed Apr. 14, 2022, 8 pages. [cited by applicant]
European Search Report for European Patent Application No. 24172578.7, dated Jun. 19, 2024, 8 pages. [cited by applicant]