IP Library Granted Patent US 10,272,324
Granted Patent B2
US 10,272,324 · App. 14/998,163 · Granted Apr 30, 2019

Classifying collision events using inertial and audio data

Inventors: Steven T. Holmes (Redwood City, CA); Jason Wright (Santa Cruz, CA)
Assignee: Intel Corporation
A63F13/211A63B69/02A63F13/215A63H5/00A63H33/009A63H33/22F41B15/02A63B69/38A63B71/0669A63B2069/0008A63B2069/0044A63B2220/40A63B2220/44A63B2220/801A63B2220/803A63B2220/808A63B2220/833A63B2225/50A63F13/424A63F13/428
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,272,324
App. No.
14/998,163
Granted
Apr 30, 2019
Kind
B2
Abstract

Systems, apparatuses and methods may obtain motion data, obtain audio data, and detect a collision between a handheld device and an object based on the motion data and the audio data. In one example, noise may be removed from the motion data and the audio data to obtain filtered collision data, wherein the object is classified based on the filtered collision data.

Claims (71)

1. A handheld device comprising:

an inertial sensor to generate one or more motion signals;

a microphone to generate one or more audio signals;

a wireless transceiver to transmit information regarding a collision between the handheld device and an object; and

logic, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to:

obtain motion data associated with the one or more motion signals,

obtain audio data associated with the one or more audio signals,

detect the collision between the handheld device and the object based on the motion data and the audio data, and

classify the object as one of a person or a second handheld device based on filtered collision data, wherein classification of the object includes operations to: distinguish between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event is to have the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event is to have the different second audible sound generation quality based at least in part on a material of the person.

2. The handheld device of claim 1 , wherein the logic is to:

remove noise from the motion data and the audio data to obtain the filtered collision data.

3. The handheld device of claim 2 , wherein the logic is to:

identify one or more features of the collision, wherein the one or more features are to include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum, and

compare the one or more features to training data to classify the object.

4. The handheld device of claim 2 , wherein the logic is to trigger one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

5. The handheld device of claim 1 , further including one or more buffers, wherein the logic is to:

detect an availability of one or more new data samples, and

retrieve the motion data and the audio data from the one or more buffers in response to the availability.

6. The handheld device of claim 1 , wherein the logic is to:

determine, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold, and

determine, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

7. The handheld device of claim 1 , further including a housing having a form of a sword, saber, foil, epee, or blade.

8. An apparatus comprising:

logic, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to:

obtain motion data,

obtain audio data,

detect a collision between a handheld device and an object based on the motion data and the audio data, and

classify the object based on filtered collision data, wherein the object to be classified is one of a person or a second handheld device, and wherein the classification of the object includes: distinguishing between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event is to have the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event is to have the different second audible sound generation quality based at least in part on a material of the person.

9. The apparatus of claim 8 , wherein the logic is to:

remove noise from the motion data and the audio data to obtain the filtered collision data.

10. The apparatus of claim 9 , wherein the logic is to:

identify one or more features of the collision, wherein the one or more features are to include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum, and

compare the one or more features to training data to classify the object.

11. The apparatus of claim 9 , wherein the logic is to trigger one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

12. The apparatus of claim 8 , wherein the logic is to: detect an availability of one or more new data samples, and retrieve the motion data and the audio data from one or more buffers in response to the availability.

13. The apparatus of claim 8 , wherein the logic is to:

determine, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold, and

determine, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

14. A method comprising:

obtaining motion data;

obtaining audio data;

detecting a collision between a handheld device and an object based on the motion data and the audio data, and

classifying the object based on filtered collision data, wherein the object to be classified is one of a person or a second handheld device, and wherein the classification of the object includes: distinguishing between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event has the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event has the different second audible sound generation quality based at least in part on a material of the person.

15. The method of claim 14 , further including:

removing noise from the motion data and the audio data to obtain the filtered collision data.

16. The method of claim 15 , wherein classifying the object includes: identifying one or more features of the collision, wherein the one or more features include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum; and

comparing the one or more features to training data.

17. The method of claim 15 , wherein the method further includes triggering one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

18. The method of claim 14 , wherein obtaining the motion data and the audio data includes:

detecting an availability of one or more new data samples; and

retrieving the motion data and the audio data from one or more buffers in response to the availability.

19. The method of claim 14 , wherein detecting the collision includes:

determining, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold; and

determining, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

20. At least one computer readable storage medium comprising a set of instructions, which when executed by a handheld device, cause the handheld device to:

obtain motion data;

obtain audio data;

detect a collision between the handheld device and an object based on the motion data and the audio data, and

classify the object based on filtered collision data, wherein the object to be classified is one of a person or a second handheld device, and wherein the classification of the object includes: distinguishing between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event is to have the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event is to have the different second audible sound generation quality based at least in part on a material of the person.

21. The at least one computer readable storage medium of claim 20 , wherein the instructions, when executed, cause the handheld device to:

remove noise from the motion data and the audio data to obtain the filtered collision data.

22. The at least one computer readable storage medium of claim 21 , wherein the instructions, when executed, cause the handheld device to:

identify one or more features of the collision, wherein the one or more features are to include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum; and

compare the one or more features to training data to classify the object.

23. The at least one computer readable storage medium of claim 21 , wherein the instructions, when executed, cause the handheld device to trigger one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

24. The at least one computer readable storage medium of claim 20 , wherein the instructions, when executed, cause the handheld device to:

detect an availability of one or more new data samples; and

retrieve the motion data and the audio data from one or more buffers in response to the availability.

25. The at least one computer readable storage medium of claim 20 , wherein the instructions, when executed, cause the handheld device to:

determine, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold; and

determine, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

Assignments (2)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (063804/0702) Recorded Jun 2, 2026
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: TELEPHONICS CORPORATION; TTM TECHNOLOGIES, INC.; TTM TECHNOLOGIES NORTH AMERICA, LLC
Reel/Frame 075679/0852 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2019
From: HOLMES, STEVEN T.; WRIGHT, JASON
To: INTEL CORPORATION
Reel/Frame 048515/0963 →
Continuity (1)
Related Publication 20170182405A1 · Jun 29, 2017
Cited By (1)
US 12,318,684