IP Library Granted Patent US 8,781,151
Granted Patent B2
US 8,781,151 · App. 11/840,170 · Granted Jul 15, 2014

Object detection using video input combined with tilt angle information

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,781,151
App. No.
11/840,170
Granted
Jul 15, 2014
Kind
B2
Abstract

A method for use in obtaining input data from an object includes capturing a live image of the object with an image capture device, receiving information related to a tilt angle of the object from one or more sensors other than the image capture device, using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, comparing the live image of the object with the rotated reference image of the object, and generating an indication in response to the live image matching the rotated reference image. An apparatus and a storage medium storing a computer program executable by a processor based system are also disclosed.

Claims (43)

1. A method for use in obtaining input data from an object, comprising:

capturing a live image of the object with an image capture device;

receiving information related to a tilt angle of the object from one or more sensors other than the image capture device;

using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object;

comparing the live image of the object with the rotated reference image of the object; and

generating an indication in response to the live image matching the rotated reference image.

2. A method in accordance with claim 1 , wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

3. A method in accordance with claim 1 , wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

4. A method in accordance with claim 1 , wherein the rotated reference image of the object is obtained by retrieving it from storage.

5. A method in accordance with claim 1 , wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

6. A method in accordance with claim 1 , further comprising:

passing the live image of the object and the rotated reference image of the object through a normalizing filter.

7. A method in accordance with claim 1 , wherein the image capture device comprises a camera.

8. A method in accordance with claim 1 , wherein the image capture device comprises a Z-camera.

9. A method in accordance with claim 1 , wherein the object comprises a hand-held controller.

10. A method in accordance with claim 1 , wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.

11. An apparatus for use in obtaining input data from an object, comprising:

an image capture device configured to capture a live image of the object; and

a processor based system configured to receive information related to a tilt angle of the object from one or more sensors other than the image capture device, use the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, compare the live image of the object with the rotated reference image of the object, and generate an indication in response to the live image matching the rotated reference image.

12. An apparatus in accordance with claim 11 , wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

13. An apparatus in accordance with claim 11 , wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

14. An apparatus in accordance with claim 11 , wherein the rotated reference image of the object is obtained by retrieving it from storage.

15. An apparatus in accordance with claim 11 , wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

16. An apparatus in accordance with claim 11 , wherein the processor based system is further configured to pass the live image of the object and the rotated reference image of the object through a normalizing filter.

17. An apparatus in accordance with claim 11 , wherein the image capture device comprises a camera.

18. An apparatus in accordance with claim 11 , wherein the object comprises a hand-held controller.

19. An apparatus in accordance with claim 11 , wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.

20. A non-transitory computer readable storage medium storing a computer program executable by a processor based system, the computer program causing the processor based system to execute steps comprising:

receiving a captured live image of an object from an image capture device;

receiving information related to a tilt angle of the object from one or more sensors other than the image capture device;

using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object;

comparing the live image of the object with the rotated reference image of the object; and

generating an indication in response to the live image matching the rotated reference image.

21. A storage medium in accordance with claim 20 , wherein the one or more sensors other than the image capture device comprises a gyro sensor in the object.

22. A storage medium in accordance with claim 20 , wherein the one or more sensors other than the image capture device comprises an accelerometer in the object.

23. A storage medium in accordance with claim 20 , wherein the rotated reference image of the object is obtained by retrieving it from storage.

24. A storage medium in accordance with claim 20 , wherein the rotated reference image of the object is obtained by rotating a reference image of the object.

25. A storage medium in accordance with claim 20 , wherein the computer program is further configured to cause the processor based system to execute a step comprising:

passing the live image of the object and the rotated reference image of the object through a normalizing filter.

26. A storage medium in accordance with claim 20 , wherein the image capture device comprises a camera.

27. A storage medium in accordance with claim 20 , wherein the image capture device comprises a Z-camera.

28. A storage medium in accordance with claim 20 , wherein the object comprises a hand-held controller.

29. A storage medium in accordance with claim 20 , wherein the information relating to the tilt angle of the object is used to obtain a plurality of rotated reference images of the object, and the live image of the object is compared with each of the plurality of rotated reference images of the object.

Assignments (4)
CHANGE OF NAME Recorded Jul 1, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039239/0356 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2011
From: SONY NETWORK ENTERTAINMENT PLATFORM INC.
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 027557/0001 →
CHANGE OF NAME Recorded Dec 26, 2011
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Reel/Frame 027446/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2007
From: MARKS, RICHARD; ZALEWSKI, GARY M.
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 019707/0658 →