Method and device for detecting planes and/or quadtrees for use as a virtual substrate

1. A method comprising:

at an electronic device with one or more processors, non-transitory memory, an image sensor, a display, and one or more input devices:

displaying, on the display, a reticle element in a first appearance state overlaid on a media capture preview of objects in a field of view of the image sensor, wherein the media capture preview changes as the objects in the field of view of the image sensor change;

detecting a plane in the media capture preview; and

in response to detecting the plane, displaying, on the display, the reticle element in a second appearance state, different from the first appearance state, overlaid on the media capture preview, wherein the reticle element corresponds to an indication of a portion of the extent of the plane while displayed in the second appearance state.

2. The method of claim 1 , wherein the detected plane is proximate to the reticle element.

3. The method of claim 1 , wherein the detected plane is within a threshold distance of the reticle element.

4. The method of claim 1 , further comprising:

displaying a transition animation from the first appearance state of the reticle element to the second appearance state of the reticle element, wherein the transition animation corresponds to adjusting an orientation of the reticle element to match an orientation of the detected plane.

5. The method of claim 1 , further comprising:

while the reticle element is displayed in the second appearance state, modifying a size of the reticle element to correspond to a size of the detected plane.

6. The method of claim 1 , further comprising:

while the reticle element is displayed in the second appearance state, detecting, via the one or more inputs devices, a first user input that corresponds to adjusting a size of the reticle element; and

in response to detecting the first user input, modifying the size of the reticle element based on the detected plane and at least one of: a direction of the first user input, a magnitude of the first user input, or a speed of the first user input.

7. The method of claim 1 , further comprising:

while the reticle element is displayed in the second appearance state, detecting, via the one or more inputs devices, a second user input that corresponds to selecting an augmented or virtual reality object from an object selection interface; and

in response to detecting the second user input, displaying, on the display, the selected augmented or virtual reality object overlaid on the media capture preview relative to the detected plane.

8. The method of claim 7 , wherein displaying the selected augmented or virtual relative object overlaid on the media capture previous relative to the detected plane comprises:

applying a rotation on the selected augmented or virtual reality object based on an orientation of the plane.

9. The method of claim 7 , further comprising:

in response to detecting the second user input, ceasing to display the reticle element overlaid on the media capture preview.

10. The method of claim 7 , further comprising:

detecting, via the one or more inputs devices, a third user input that corresponds to interacting with the augmented or virtual reality object; and

in response to detecting the third user input, modifying the augmented or virtual reality object based at least in part on one or more characteristics of the third user input.

11. A non-transitory computer-readable medium having instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to perform a method comprising:

displaying, on the display, a reticle element in a first appearance state overlaid on a media capture preview of objects in a field of view of the image sensor, wherein the media capture preview changes as the objects in the field of view of the image sensor change;

detecting a plane in the media capture preview; and

in response to detecting the plane, displaying, on the display, the reticle element in a second appearance state, different from the first appearance state, overlaid on the media capture preview, wherein the reticle element corresponds to an indication of a portion of the extent of the plane while displayed in the second appearance state.

12. The non-transitory computer-readable medium of claim 11 , wherein the detected plane is proximate to the reticle element.

13. The non-transitory computer-readable medium of claim 11 , wherein the detected plane is within a threshold distance of the reticle element.

14. The non-transitory computer-readable medium of claim 11 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

display a transition animation from the first appearance state of the reticle element to the second appearance state of the reticle element, wherein the transition animation corresponds to adjusting an orientation of the reticle element to match an orientation of the detected plane.

15. The non-transitory computer-readable medium of claim 11 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

while the reticle element is displayed in the second appearance state, modifying a size of the reticle element to correspond to a size of the detected plane.

16. The non-transitory computer-readable medium of claim 11 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

while the reticle element is displayed in the second appearance state, detecting, via the one or more inputs devices, a first user input that corresponds to adjusting a size of the reticle element; and

in response to detecting the first user input, modifying the size of the reticle element based on the detected plane and at least one of: a direction of the first user input, a magnitude of the first user input, or a speed of the first user input.

17. The non-transitory computer-readable medium of claim 11 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

while the reticle element is displayed in the second appearance state, detecting, via the one or more inputs devices, a second user input that corresponds to selecting an augmented or virtual reality object from an object selection interface; and

in response to detecting the second user input, displaying, on the display, the selected augmented or virtual reality object overlaid on the media capture preview relative to the detected plane.

18. The non-transitory computer-readable medium of claim 17 , wherein displaying the selected augmented or virtual relative object overlaid on the media capture previous relative to the detected plane comprises:

applying a rotation on the selected augmented or virtual reality object based on an orientation of the plane.

19. The non-transitory computer-readable medium of claim 17 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

in response to detecting the second user input, ceasing to display the reticle element overlaid on the media capture preview.

20. The non-transitory computer-readable medium of claim 17 , further comprising instructions encoded thereon that, when executed by one or more processors of an electronic device, causes the electronic device to:

detecting, via the one or more inputs devices, a third user input that corresponds to interacting with the augmented or virtual reality object; and

in response to detecting the third user input, modifying the augmented or virtual reality object based at least in part on one or more characteristics of the third user input.

21. An electronic device comprising:

one or more processors;

non-transitory memory; and

one or more programs, wherein the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, on the display, a reticle element in a first appearance state overlaid on a media capture preview of objects in a field of view of the image sensor, wherein the media capture preview changes as the objects in the field of view of the image sensor change;

detecting a plane in the media capture preview; and

in response to detecting the plane, displaying, on the display, the reticle element in a second appearance state, different from the first appearance state, overlaid on the media capture preview, wherein the reticle element corresponds to an indication of a portion of the extent of the plane while displayed in the second appearance state.

22. The electronic device of claim 21 , wherein the one or more programs further include instructions for:

displaying a transition animation from the first appearance state of the reticle element to the second appearance state of the reticle element, wherein the transition animation corresponds to adjusting an orientation of the reticle element to match an orientation of the detected plane.

23. The electronic device of claim 21 , wherein the one or more programs further include instructions for:

while the reticle element is displayed in the second appearance state, modifying a size of the reticle element to correspond to a size of the detected plane.

24. The electronic device of claim 21 , wherein the one or more programs further include instructions for:

while the reticle element is displayed in the second appearance state, detecting, via the one or more inputs devices, a second user input that corresponds to selecting an augmented or virtual reality object from an object selection interface; and

in response to detecting the second user input, displaying, on the display, the selected augmented or virtual reality object overlaid on the media capture preview relative to the detected plane.

25. The electronic device of claim 24 , wherein displaying the selected augmented or virtual relative object overlaid on the media capture previous relative to the detected plane comprises:

applying a rotation on the selected augmented or virtual reality object based on an orientation of the plane.

26. The electronic device of claim 24 , wherein the one or more programs further include instructions for:

in response to detecting the second user input, ceasing to display the reticle element overlaid on the media capture preview.