IP Library › Granted Patent US 10,679,062
Granted Patent B1
US 10,679,062 · App. 16/702,283 · Granted Jun 9, 2020

Systems and methods for device positioning surface detection

Inventors: Timothy Donnelly (Oakland, CA); Adam Debreczeni (Oakland, CA); Russ Maschmeyer (Oakland, CA)
Assignee: Primer Supply, Inc.
G06K9/00671G06T11/001H04N5/23222H04N5/23258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,679,062
App. No.
16/702,283
Granted
Jun 9, 2020
Kind
B1
Abstract

Methods, hardware, and software establish surfaces for graphics processing by setting a position of the capture device fixed on or relative to that surface. A user may hold the device against the surface or through other means. Ambient setting, potentially including the surface itself, is visually captured at the position. Using that position the surface is established—readily known by position, size, shape, etc. within the surroundings. Stable positioning can be determined in any way, using any data. Motion of the device may be known via internal or external sensors, and stable surface touching can be detected with a lack of motion. A user may input when the device is steady. Abutment can be measured from visual input or impact sensors. All such input may determine and/or verify a stable position. Visual input from the stable position may thus be used to establish the surface for graphical processing.

Claims (42)

1. A mobile device configured to establish a surface for graphical processing, the device comprising:

a display;

a camera; and

a computer processor configured to,

instruct, through the display, a user to stabilize the camera against the surface to be established,

determine that the camera is in a position stabilized against the surface,

capture, with the camera, environment at the position, and

establish the surface within the environment using the position.

2. The mobile device of claim 1 , wherein the computer processor is further configured to,

augment the established surface in the environment as augmented reality.

3. The mobile device of claim 2 , wherein the computer processor is further configured to,

track, with the camera, the environment for the augmented reality before the instructing, wherein the augmenting tracks the established surface in the environment as augmented reality.

4. The mobile device of claim 1 , wherein the surface is a featureless, reflective, or substantially transparent plane, and wherein the environment captured by the camera includes the plane.

5. The mobile device of claim 1 , wherein the position is a position of the mobile device directly contacting the surface.

6. The mobile device of claim 1 , wherein the determining includes sensing motion of the camera followed by a lack of motion indicating the camera is stabilized on the surface.

7. The mobile device of claim 1 , further comprising:

an accelerometer, wherein the determining uses at least one of user input, the accelerometer, and visual input from the camera to determine that the device is in the position stabilized against the surface.

8. A method of establishing a surface for graphical processing, the method comprising:

instructing, with a display, a user to stabilize a camera against the surface to be established;

determining, with a computer processor, that the camera is in a position stabilized against the surface;

capturing, with the camera, environment at the position; and

establishing, with the computer processor, the surface within the environment using the position.

9. The method of claim 8 , further comprising:

augmenting, with the computer processor, the established surface in the environment as augmented reality.

10. The method of claim 9 , further comprising:

tracking, with the computer processor and the camera, the environment for the augmented reality before the instructing, wherein the augmenting tracks the established surface in the environment as augmented reality.

11. The method of claim 8 , wherein the surface is a featureless, reflective, or substantially transparent plane, and wherein the environment captured by the camera includes the plane.

12. The method of claim 8 , wherein the display, computer processor, and camera are all co-located within a mobile device.

13. The method of claim 12 , wherein the position is a position of the mobile device directly contacting the surface.

14. The method of claim 8 , wherein the determining includes sensing motion of the camera followed by a lack of motion indicating the camera is stabilized on the surface.

15. The method of claim 8 , wherein the determining uses at least one of user input, an accelerometer, and visual input from the camera to determine that the camera is in the position stabilized against the surface.

16. A method of establishing a wall for recoloring in augmented reality, the method comprising,

establishing world tracking through an augmented reality application on a device having a camera, a display, and a processor;

determining, with the processor, that the device has been stabilized on the wall;

capturing, with the camera, an environment from the wall; and

establishing the wall as an augmented reality element in the environment shown on the display through the augmented reality application.

17. The method of claim 16 , further comprising:

recoloring the wall as the augmented reality element in the environment shown on the display.

18. The method of claim 16 , further comprising:

instructing, through the display, the user to stabilize the device on the wall.

19. The method of claim 16 , wherein the determining includes sensing motion of the device followed by a lack of motion indicating the device is stabilized on the wall.

20. The method of claim 16 , wherein the determining uses at least one of user input, an accelerometer, and visual input from the camera to determine that the device is in the position stabilized against the wall.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2019
From: DONNELLY, TIMOTHY; DEBRECZENI, ADAM; MASCHMEYER, RUSS
To: PRIMER SUPPLY, INC.
Reel/Frame 051166/0700 →
Cited By (1)
US 12,205,195