IP Library › Granted Patent US 12,206,980

Granted Patent B2

US 12,206,980 · App. 18/208,836 · Granted Jan 21, 2025

Devices, methods, and graphical user interfaces for capturing and recording media in multiple modes

Inventors: Matthew I. Brown (New York, NY); Jeffrey T. Bernstein (San Francisco, CA); William D. Lindmeier (San Francisco, CA); Lukas Robert Tom Girling (Bristol, GB)

Assignee: APPLE INC.

H04N23/62 G06F3/0485 G06F3/0488 G06F3/04883 G06F3/04886 G11B27/02 G11B27/34 H04M1/72403 H04N1/2145 H04N5/91 H04N5/9201 H04N7/0122 H04N23/631 H04N23/633 H04N23/667 H04N23/695 H04N23/698 G06F2203/04808 H04M2250/22 H04M2250/52 H04N2101/00

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,206,980
App. No.: 18/208,836
Granted: Jan 21, 2025
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A device displays, in a first display region of a camera user interface, a first live view from a first camera. While displaying the first live view from the first camera, the device detects movement of a first user input (e.g., a first contact on a touch-sensitive surface). In accordance with a determination that the movement of the first user input meets first movement criteria, the device moves the first live view in the first display region in accordance with the movement of the first user input, displays a second live view from a second camera, and moves the second live view in the first display region in accordance with the movement of the first user input.

Claims (182)

1. A method, comprising:

at an electronic device having a first camera and a second camera, the electronic device in communication with a display generation component:

displaying, in a first display region of a camera user interface, a first live view from the first camera of the electronic device;

while displaying the first live view from the first camera in the first display region of the camera user interface, detecting movement of a first user input; and

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets first movement criteria:

moving the first live view in the first display region in accordance with the movement of the first user input;

displaying a second live view from the second camera of the electronic device in the first display region; and

moving the second live view in the first display region in accordance with the movement of the first user input.

2. The method of claim 1 , wherein:

the first live view is displayed on a first side of a multi-sided user interface object;

the second live view is displayed on a second side of the multi-sided user interface object; and

moving the first live view and the second live view in accordance with the movement of the first user input includes rotating the multi-sided user interface object in accordance with the movement of the first user input.

3. The method of claim 2 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

rotating the multi-sided user interface object in accordance with the movement of the first user input includes:

rotating the multi-sided user interface object in the first direction in response to the first portion of the movement; and

rotating the multi-sided user interface object in the second direction in response to the second portion of the movement.

4. The method of claim 2 , including:

after rotating the multi-sided user interface object in accordance with the first user input, detecting termination of the first user input; and

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets second movement criteria, continuing to rotate the multi-sided user interface object after the lift off termination of the first user input, until the second side of the multi-sided user interface object occupies an entirety of the first display region.

5. The method of claim 4 , including:

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets third movement criteria, reversing rotation of the multi-sided user interface object after the termination of the first user input, until the first side of the multi-sided user interface object reoccupies the entirety of the first display region.

6. The method of claim 1 , wherein:

the first live view is displayed in a first panel of a multi-panel user interface object;

the second live view is displayed in a second panel of the multi-panel user interface object; and

moving the first live view and the second live view in accordance with the movement of the first user input includes sliding the multi-panel user interface object in the first display region in accordance with the movement of the first user input.

7. The method of claim 6 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

sliding the multi-panel user interface object in accordance with the movement of the first user input includes:

sliding the multi-panel user interface object in the first direction in response to the first portion of the movement; and

sliding the multi-panel user interface object in the second direction in response to the second portion of the movement.

8. The method of claim 6 , including:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detecting termination of the first user input; and

in response to detecting the lift off termination of the first user input:

in accordance with a determination that the movement of the first user input meets fourth movement criteria, continuing to slide the multi-panel user interface object after the termination of the first user input, until the second panel of the multi-panel user interface object occupies an entirety of the first display region.

9. The method of claim 8 , including:

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets fifth movement criteria, reversing sliding of the multi-panel user interface object after the termination of the first user input, until the first panel of the multi-panel user interface object reoccupies the entirety of the first display region.

10. The method of claim 6 , including:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detecting termination of the first user input; and

in response to detecting the termination of the first user input, ceasing to slide the multi-panel user interface object after the termination of the first user input, wherein the first display region concurrently displays a part of the first panel of the multi-panel user interface object and a part of the second panel of the multi-panel user interface object.

11. The method of claim 1 , including:

detecting termination of the first user input, wherein after termination of the first user input:

in accordance with a determination that the movement of the first user input meets sixth movement criteria, the first live view ceases to be displayed in the first display region, and the second live view occupies an entirety of the first display region; and

in accordance with a determination that the movement of the first user input meets seventh movement criteria, the first display region is split between displaying a part of the first live view and a part of the second live view.

12. The method of claim 1 , wherein:

the movement of the first user input is detected while video recording through the first camera is in progress.

13. The method of claim 12 , including:

continuing to record video after detecting the movement of the first user input.

14. The method of claim 13 , wherein continuing to record video after detecting the movement of the first user input includes:

continuing to record video captured by the first camera while moving the first live view and the second live view in accordance with the movement of the first user input.

15. The method of claim 13 , wherein continuing to record video after detecting the movement of the first user input includes:

ceasing to record video captured by the first camera when the first live view captured by the first camera is no longer displayed in the first display region; and

starting to record video captured by the second camera when the second live view captured by the second camera is displayed in the first display region.

16. The method of claim 13 , wherein continuing to record video after detecting the movement of the first user input includes:

continuing to record video as shown in the first display region, including recording the movement of the first live view and the second live view.

17. The method of claim 13 , wherein continuing to record video after detecting the movement of the first user input includes:

continuing to record video captured by the first camera while displaying the second live view captured by the second camera.

18. The method of claim 13 , wherein continuing to record video after detecting the movement of the first user input includes:

concurrently recording video captured by the first camera and captured by the second camera.

19. The method of claim 13 , including:

detecting activation of a stop-recording affordance while continuing to record video after detecting the movement of the first user input; and

in response to detecting activation of the stop-recording affordance, ceasing to record video.

20. The method of claim 1 , including:

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets eighth movement criteria:

changing an aspect ratio of the first live view or an aspect ratio of the first display region in accordance with the movement of the first user input.

21. The method of claim 1 , wherein the first user input is directed to locations within the first display region, and the method further includes:

while displaying the first display region including the first live view captured by the first camera, detecting movement of a second user input directed to locations outside of the first display region; and

in response to detecting the movement of the second user input in a second direction, switching from a first media capture mode to a second media capture mode of the first camera in accordance with the movement of the second user input.

22. An electronic device, comprising:

a first camera;

a second camera;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via a display generation component in communication with the electronic device, in a first display region of a camera user interface, a first live view from the first camera of the electronic device;

while displaying the first live view from the first camera in the first display region of the camera user interface, detecting movement of a first user input; and

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets first movement criteria:

moving the first live view in the first display region in accordance with the movement of the first user input;

displaying a second live view from the second camera of the electronic device in the first display region; and

moving the second live view in the first display region in accordance with the movement of the first user input.

23. The electronic device of claim 22 , wherein:

the first live view is displayed on a first side of a multi-sided user interface object;

the second live view is displayed on a second side of the multi-sided user interface object; and

24. The electronic device of claim 23 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

rotating the multi-sided user interface object in accordance with the movement of the first user input includes:

rotating the multi-sided user interface object in the first direction in response to the first portion of the movement; and

rotating the multi-sided user interface object in the second direction in response to the second portion of the movement.

25. The electronic device of claim 23 , the one or more programs including instructions for:

after rotating the multi-sided user interface object in accordance with the first user input, detecting termination of the first user input; and

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets second movement criteria, continuing to rotate the multi-sided user interface object after the termination of the first user input, until the second side of the multi-sided user interface object occupies an entirety of the first display region.

26. The electronic device of claim 22 , wherein:

the first live view is displayed in a first panel of a multi-panel user interface object;

the second live view is displayed in a second panel of the multi-panel user interface object; and

27. The electronic device of claim 26 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

sliding the multi-panel user interface object in accordance with the movement of the first user input includes:

sliding the multi-panel user interface object in the first direction in response to the first portion of the movement; and

sliding the multi-panel user interface object in the second direction in response to the second portion of the movement.

28. The electronic device of claim 26 , the one or more programs including instructions for:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detecting termination of the first user input; and

in response to detecting the termination of the first user input:

29. The electronic device of claim 26 , the one or more programs including instructions for:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detecting termination of the first user input; and

30. The electronic device of claim 22 , the one or more programs including instructions for:

detecting termination of the first user input, wherein after termination of the first user input:

31. The electronic device of claim 22 , wherein:

the movement of the first user input is detected while video recording through the first camera is in progress.

32. The electronic device of claim 31 , the one or more programs including instructions for:

continuing to record video after detecting the movement of the first user input.

33. The electronic device of claim 22 , the one or more programs including instructions for:

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets eighth movement criteria:

changing an aspect ratio of the first live view or an aspect ratio of the first display region in accordance with the movement of the first user input.

34. The electronic device of claim 22 , wherein the first user input is directed to locations within the first display region, and the one or more programs include instructions for:

35. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device having a first camera and a second camera, cause the electronic device to:

display, in a first display region of a camera user interface, a first live view from the first camera of the electronic device;

while displaying the first live view from the first camera in the first display region of the camera user interface, detect movement of a first user input; and

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets first movement criteria:

move the first live view in the first display region in accordance with the movement of the first user input;

display a second live view from the second camera of the electronic device in the first display region; and

move the second live view in the first display region in accordance with the movement of the first user input.

36. The non-transitory computer readable storage medium of claim 35 , wherein:

the first live view is displayed on a first side of a multi-sided user interface object;

the second live view is displayed on a second side of the multi-sided user interface object; and

37. The non-transitory computer readable storage medium of claim 36 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

rotating the multi-sided user interface object in accordance with the movement of the first user input includes:

rotating the multi-sided user interface object in the first direction in response to the first portion of the movement; and

rotating the multi-sided user interface object in the second direction in response to the second portion of the movement.

38. The non-transitory computer readable storage medium of claim 36 , the one or more programs including instructions that cause the electronic device to:

after rotating the multi-sided user interface object in accordance with the first user input, detect termination of the first user input; and

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets second movement criteria, continue to rotate the multi-sided user interface object after the termination of the first user input, until the second side of the multi-sided user interface object occupies an entirety of the first display region.

39. The non-transitory computer readable storage medium of claim 35 , wherein:

the first live view is displayed in a first panel of a multi-panel user interface object;

the second live view is displayed in a second panel of the multi-panel user interface object; and

40. The non-transitory computer readable storage medium of claim 39 , wherein:

the movement of the first user input includes a first portion of the movement in a first direction, and a second portion of the movement in a second direction opposite the first direction; and

sliding the multi-panel user interface object in accordance with the movement of the first user input includes:

sliding the multi-panel user interface object in the first direction in response to the first portion of the movement; and

sliding the multi-panel user interface object in the second direction in response to the second portion of the movement.

41. The non-transitory computer readable storage medium of claim 39 , the one or more programs including instructions that cause the electronic device to:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detect termination of the first user input; and

in response to detecting the termination of the first user input:

in accordance with a determination that the movement of the first user input meets fourth movement criteria, continue to slide the multi-panel user interface object after the termination of the first user input, until the second panel of the multi-panel user interface object occupies an entirety of the first display region.

42. The non-transitory computer readable storage medium of claim 39 , the one or more programs including instructions that cause the electronic device to:

after sliding the multi-panel user interface object in accordance with the movement of the first user input, detect termination of the first user input; and

in response to detecting the termination of the first user input, cease to slide the multi-panel user interface object after the termination of the first user input, wherein the first display region concurrently displays a part of the first panel of the multi-panel user interface object and a part of the second panel of the multi-panel user interface object.

43. The non-transitory computer readable storage medium of claim 35 , the one or more programs including instructions that cause the electronic device to:

detect termination of the first user input, wherein after termination of the first user input:

44. The non-transitory computer readable storage medium of claim 35 , wherein:

the movement of the first user input is detected while video recording through the first camera is in progress.

45. The non-transitory computer readable storage medium of claim 44 the one or more programs including instructions that cause the electronic device to:

continue to record video after detecting the movement of the first user input.

46. The non-transitory computer readable storage medium of claim 35 , the one or more programs including instructions that cause the electronic device to:

in response to detecting the movement of the first user input:

in accordance with a determination that the movement of the first user input meets eighth movement criteria:

change an aspect ratio of the first live view or an aspect ratio of the first display region in accordance with the movement of the first user input.

47. The non-transitory computer readable storage medium of claim 35 , wherein the first user input is directed to locations within the first display region, and the one or more programs include instructions that cause the electronic device to:

while displaying the first display region including the first live view captured by the first camera, detect movement of a second user input directed to locations outside of the first display region; and

in response to detecting the movement of the second user input in a second direction, switch from a first media capture mode to a second media capture mode of the first camera in accordance with the movement of the second user input.

Continuity (5)

Continuation 17074521 · Oct 19, 2020

Continuation 16711138 · Dec 11, 2019

Continuation 15691701 · Aug 30, 2017

Provisional Application 62399292 · Sep 23, 2016

Related Publication 20230328359A1 · Oct 12, 2023

References Cited (92)

US 6122013A · Tamir et al. · 2000 [cited by applicant]

US 6680749B1 · Anderson et al. · 2004 [cited by applicant]

US 6741911B2 · Simmons · 2004 [cited by applicant]

US 7319480B2 · Akiyama et al. · 2008 [cited by applicant]

US 7714925B2 · Kim · 2010 [cited by applicant]

US 7714926B2 · Kobayashi et al. · 2010 [cited by applicant]

US 7729608B2 · Okubo · 2010 [cited by applicant]

US 8478347B2 · Kim et al. · 2013 [cited by applicant]

US 8666223B2 · Momosaki · 2014 [cited by applicant]

US 9100588B1 · Seymour · 2015 [cited by applicant]

US 10021295B1 · Baldwin et al. · 2018 [cited by applicant]

US 10051141B2 · Suzuki · 2018 [cited by applicant]

US 10127632B1 · Burke et al. · 2018 [cited by applicant]

US 10645294B1 · Manzari · 2020 [cited by examiner]

US 20020012526A1 · Sai et al. · 2002 [cited by applicant]

US 20020064387A1 · Miyake et al. · 2002 [cited by applicant]

US 20030120183A1 · Simmons · 2003 [cited by applicant]

US 20050007468A1 · Stavely et al. · 2005 [cited by applicant]

US 20050193425A1 · Sull et al. · 2005 [cited by applicant]

US 20070157089A1 · Van Os et al. · 2007 [cited by applicant]

US 20080055416A1 · Aoki · 2008 [cited by applicant]

US 20080055453A1 · Battles et al. · 2008 [cited by applicant]

US 20090237547A1 · Misawa et al. · 2009 [cited by applicant]

US 20100023851A1 · Schormann · 2010 [cited by applicant]

US 20100074590A1 · Momosaki · 2010 [cited by applicant]

US 20110032259A1 · Kim et al. · 2011 [cited by applicant]

US 20110126105A1 · Isozu · 2011 [cited by applicant]

US 20120093477A1 · M · 2012 [cited by applicant]

US 20120218453A1 · Hosokawa · 2012 [cited by applicant]

US 20120243738A1 · Sakata · 2012 [cited by applicant]

US 20130201217A1 · Morinaga et al. · 2013 [cited by applicant]

US 20130208143A1 · Chou et al. · 2013 [cited by applicant]

US 20140009643A1 · Ito et al. · 2014 [cited by applicant]

US 20140198027A1 · Edelstein · 2014 [cited by applicant]

US 20140204243A1 · Hayashi · 2014 [cited by applicant]

US 20140204244A1 · Choi et al. · 2014 [cited by applicant]

US 20140218370A1 · Mishra et al. · 2014 [cited by applicant]

US 20140351763A1 · Lee et al. · 2014 [cited by applicant]

US 20140362274A1 · Christie et al. · 2014 [cited by applicant]

US 20150042543A1 · Kim et al. · 2015 [cited by applicant]

US 20150067596A1 · Brown et al. · 2015 [cited by applicant]

US 20150145952A1 · Hirata · 2015 [cited by examiner]

US 20150162048A1 · Hirata · 2015 [cited by examiner]

US 20150201134A1 · Carr et al. · 2015 [cited by applicant]

US 20150271402A1 · Guo et al. · 2015 [cited by applicant]

US 20150281296A1 · Takaichi et al. · 2015 [cited by applicant]

US 20150334291A1 · Cho et al. · 2015 [cited by applicant]

US 20150338988A1 · Lee et al. · 2015 [cited by applicant]

US 20150350611A1 · Pearson et al. · 2015 [cited by applicant]

US 20150358550A1 · Faber et al. · 2015 [cited by applicant]

US 20160080643A1 · Kimura · 2016 [cited by examiner]

US 20160241767A1 · Cho et al. · 2016 [cited by applicant]

US 20160259497A1 · Foss · 2016 [cited by examiner]

US 20160306511A1 · Park et al. · 2016 [cited by applicant]

US 20160353012A1 · Kao et al. · 2016 [cited by applicant]

US 20170019604A1 · Kim et al. · 2017 [cited by applicant]

US 20170026539A1 · Chang et al. · 2017 [cited by applicant]

US 20170034428A1 · Kwon et al. · 2017 [cited by applicant]

US 20170075092A1 · Kim et al. · 2017 [cited by applicant]

US 20170303002A1 · Esaylan, Jr. et al. · 2017 [cited by applicant]

US 20180081502A1 · Sangco et al. · 2018 [cited by applicant]

US 20180091728A1 · Brown et al. · 2018 [cited by applicant]

US 20190042066A1 · Kim · 2019 [cited by examiner]

US 20190182422A1 · Takahashi · 2019 [cited by examiner]

US 20200167631A1 · Rezgui · 2020 [cited by examiner]

US 20200120265A1 · Brown et al. · 2020 [cited by applicant]

US 20210051275A1 · Brown et al. · 2021 [cited by applicant]

CN 103139480A · 2013 [cited by applicant]

CN 103533216A · 2014 [cited by applicant]

CN 106231181A · 2016 [cited by applicant]

Office Action, dated Feb. 2, 2019, received in U.S. Appl. No. 15/691,701, 25 pages. [cited by applicant]

Notice of Allowance, dated Jun. 25, 2019, received in U.S. Appl. No. 15/691,701, 9 pages. [cited by applicant]

Notice of Allowance, dated Oct. 17, 2019, received in U.S. Appl. No. 15/691,701, 9 pages. [cited by applicant]

Office Action, dated Jul. 10, 2020, received in Chinese Patent Application No. 201780053139.4, which corresponds with U.S. Appl. No. 15/691,701, 12 pages. [cited by applicant]

Office Action, dated Apr. 23, 2021, received in Chinese Patent Application No. 201780053139.4, which corresponds with U.S. Appl. No. 15/691,701, 1 page. [cited by applicant]

Notice of Allowance, dated Aug. 5, 2021, received in Chinese Patent Application No. 201780053139.4, which corresponds with U.S. Appl. No. 15/691,701, 2 pages. [cited by applicant]

Patent, dated Oct. 29, 2021, received in Chinese Patent Application No. 201780053139.4, which corresponds with U.S. Appl. No. 15/691,701, 5 pages. [cited by applicant]

Office Action, dated Dec. 8, 2020, received in European Patent Application No. 17771920.0, which corresponds with U.S. Appl. No. 15/691,701, 6 pages. [cited by applicant]

Office Action, dated Jan. 28, 2020, received in European Patent Application No. 17771920.0, which corresponds with U.S. Appl. No. 15/691,701, 6 pages. [cited by applicant]

Intent to Grant, dated Jan. 2022, received in European Patent Application No. 17771920.0, which corresponds with U.S. Appl. No. 15/691,701, 10 pages. [cited by applicant]

Decision to Grant, dated Feb. 14, 2022, received in European Patent Application No. 17771920.0, which corresponds with U.S. Appl. No. 15/691,701, 4 pages. [cited by applicant]

Patent, dated Mar. 29, 2022, received in European Patent Application No. 17771920.0, which corresponds with U.S. Appl. No. 15/691,701, 2 pages. [cited by applicant]

Office Action, dated May 6, 2020, received in U.S. Appl. No. 16/711,138, 7 pages. [cited by applicant]

Notice of Allowance, dated Jul. 15, 2020, received in U.S. Appl. No. 16/711,138, 9 pages. [cited by applicant]

Office Action, dated Oct. 5, 2022, received in U.S. Appl. No. 17/074,521, 19 pages. [cited by applicant]

Notice of Allowance, dated Feb. 27, 2023, received in U.S. Appl. No. 17/074,521, 9 pages. [cited by applicant]

Office Action, dated Sep. 20, 2022, received in Chinese Patent Application No. 202111213035.X, which corresponds with U.S. Appl. No. 17/074,521, 2 pages. [cited by applicant]

Invitation to Pay Additional Fees, dated Dec. 7, 2017, received in International Patent Application No. PCT/US2017/049752, which corresponds with U.S. Appl. No. 15/691,701, 13 pages. [cited by applicant]

International Search Report and Written Opinion, dated Jan. 31, 2018, received in International Application No. PCT/US2017/049752, which corresponds with U.S. Appl. No. 15/691,701, 18 pages. [cited by applicant]

Notice of Allowance, dated Jun. 21, 2023, received in U.S. Appl. No. 17/074,521, 10 pages. [cited by applicant]

Notice of Allowance, dated Jun. 30, 2023, received in Chinese Patent Application No. 202111213035.X, which corresponds with U.S. Appl. No. 17/074,521, 2 pages. [cited by applicant]

Patent, dated Sep. 26, 2023, received in Chinese Patent Application No. 202111213035.X, which corresponds with U.S. Appl. No. 17/074,521, 4 pages. [cited by applicant]