Granted Patent B2

US 10,747,413 · App. 15/341,097 · Granted Aug 18, 2020

Inventors: Daniel Schneider (Kaiserslautern, DE); Thomas Kuhn (Langensohl, DE); Rasmus Adler (Kaiserslautern, DE); Viet Yen Nguyen (Kaiserslautern, DE); Patrik Feth (Hochspeyer, DE); Emilia Cioroaica (Kaiserslautern, DE); Bastian Zimmer (Kaiserslautern, DE); Martin Kremmer (Mannheim, DE); Thomas Floerchinger (Mannheim, DE); Benjamin Neermann (Mannheim, DE); Norbert Fritz (Ilvesheim, DE); Stefan Volz (Mannheim, DE)

Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

G06F3/04847A01B59/002A01B71/02A01D34/008G05B19/0426G06F3/0346G06F3/04886G08C17/02G05B2219/36159G08C2201/93

Abstract

Claims (44)

1. An apparatus for a mobile communication device for providing a sensor input signal to an external machine control entity to control a machine, the apparatus comprising

one or more sensor modules for providing first user input sensor data and second user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action and wherein the second user input sensor data is based on user input related to controlling of the machine, and

a control module configured to:

control the one or more sensor modules,

determine the sensor input signal based on the first user input sensor data and the second user input sensor data, and

provide the sensor input signal to the machine control entity to control the machine via an interface,

obtain a sensor feedback signal from the machine control entity via the interface wherein the sensor feedback signal is based on the first user input sensor data and the second user input sensor data, and wherein the sensor feedback signal comprises information related to a validation of the second user input sensor data based on a comparison of the first user input sensor data with a validation criterion.

2. The apparatus of claim 1 , wherein the control module is configured to determine a feedback presentation signal based on the sensor feedback signal, and wherein the control module is further configured to provide the feedback presentation signal to a feedback presentation device configured to provide feedback on the first user input sensor data and the second user input sensor data based on the feedback presentation signal.

3. The apparatus of claim 2 further comprising the feedback presentation device, wherein the feedback presentation device corresponds to at least one element of a screen, a vibration module, a light module, an electromechanical tactile display, or a speaker, and/or wherein the feedback presentation device is configured to provide at least one element of the group of audio, visual and tactile feedback, and/or wherein the control module is configured to determine and provide a visual representation of the first user input sensor data and/or the second user input sensor data via the feedback presentation device.

4. The apparatus of claim 1 , wherein the one or more sensor modules comprises a first sensor module configured to provide the first user input sensor data and a second sensor module configured to provide the second user input sensor data, and/or wherein the one or more sensor modules comprises at least one element of the group of a touch sensor, an accelerometer, a gyroscope, and a camera sensor.

5. The apparatus of claim 1 , wherein the first user input sensor data and/or the second user input sensor data corresponds to raw user input sensor data, and/or wherein the first user input sensor data and/or the second user input sensor data corresponds to at least one element of the group of touch screen coordinates, angular data of a gyroscope, acceleration data of an accelerometer, or imaging data of a camera sensor.

6. The apparatus of claim 1 further comprising the interface, wherein the interface corresponds to a wireless communication interface for communication via a mobile communication system, and wherein the control module is configured to wirelessly communicate with the machine control entity via the interface.

7. The apparatus of claim 1 , wherein the first user input sensor data corresponds to touch screen coordinates, and wherein the second input sensor data correspond to angular data of a gyroscope, and wherein the control module is configured to provide the sensor input signal to the machine control entity to control a hitch of a tractor.

8. Apparatus for a machine control entity for controlling a machine based on a sensor input signal from a mobile communication device, the apparatus comprising

at least one interface for receiving the sensor input signal from the mobile communication device, wherein the sensor input signal comprises information related to a first user input sensor data and information related to a second user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action and wherein the second user input sensor data is based on user input related to controlling of the machine; and

a control module configured to:

validate the second user input sensor data based on the first user input sensor data,

wherein the validation is based on a comparison of the first user input sensor data with at least one validation criterion, and

control the machine based on the first user input sensor data and the second user input sensor data after the second user input sensor data has been validated.

9. The apparatus of claim 8 , wherein the control module is further configured to determine a sensor feedback signal based on the first user input sensor data, the second user input sensor data and the validation, wherein the sensor feedback signal comprises information related to a result of a validation comparison of the second user input sensor data based on the first user input sensor data.

10. The apparatus of claim 8 , wherein the control module is further configured to determine a plausibility of the first user input sensor data and the second user input sensor data based on a plausibility criterion, and wherein the control module is configured to control the machine after the first user input sensor data and the second user sensor data has been determined to meet the plausibility criterion.

11. The apparatus of claim 8 , wherein the control module is configured to determine whether the first user input sensor data is within a range defined by the validation criterion to validate the second user input sensor data.

12. The apparatus of claim 8 , wherein the first user input sensor data corresponds to touch coordinates, and wherein the control module is configured to determine whether the touch coordinates are within one of one or more pre-defined areas within a pre-defined coordinate system, wherein the one or more pre-defined areas represent one or more pre-defined control actions for controlling the machine.

13. The apparatus of claim 8 , wherein the control module is configured to control the machine based on the first user input sensor data and the second user input sensor data, wherein the control module is configured to determine a category of the controlling based on the first user input sensor data and wherein the control module is configured to determine an extent of the controlling based on the second user input sensor data.

14. The apparatus of claim 13 , wherein the category of the controlling corresponds to at least one element of the group of a directivity of the controlling, a selection of a machine component to be controlled, a selection of a controlling sensitivity, and a selection of controlling limits.

15. A method for a mobile communication device for providing a sensor input signal to an external machine control entity to control a machine, the method comprising

providing first user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action;

providing second user input sensor data, wherein the second user input sensor data is based on user input related to controlling of the machine;

determining the sensor input signal based on the first user input sensor data and the second user input sensor data; and

providing the sensor input signal to the machine control entity to control the machine, obtaining a sensor feedback signal from the machine control entity wherein the sensor feedback signal is based on the first user input sensor data and the second user input sensor data, and wherein the sensor feedback signal comprises information related to a validation of the second user input sensor data based on a comparison of the first user input sensor data with a validation criterion.

16. A method for a machine control entity for controlling a machine based on a sensor input signal from a mobile communication device, the method comprising

receiving the sensor input signal from the mobile communication device, wherein the sensor input signal comprises information related to first user input sensor data and information related to second user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action and wherein the second user input sensor data is based on user input related to controlling of the machine,

validating the second user input sensor data based on the first user input sensor data, wherein the validation is based on a comparison of the first user input sensor data with at least one validation criterion; and

controlling the machine based on the first user input sensor data and the second user input sensor data after the second user input sensor data has been validated.

17. Computer program product comprising a non-transitory storage device having a program code embodied therewith, the program code executable by a processor of a computer to perform a method, the method comprising:

providing first user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action;

providing second user input sensor data, wherein the second user input sensor data is based on user input related to controlling of the machine;

determining the sensor input signal based on the first user input sensor data and the second user input sensor data, and

providing the sensor input signal to the machine control entity to control the machine,

obtaining a sensor feedback signal from the machine control entity wherein the sensor feedback signal is based on the first user input sensor data and the second user input sensor data, and wherein the sensor feedback signal comprises information related to a validation of the second user input sensor data based on a comparison of the first user input sensor data with a validation criterion.

18. Computer program product comprising a non-transitory storage device having a program code embodied therewith, the program code executable by a processor of a computer to perform a method, the method comprising:

receiving the sensor input signal from the mobile communication device, wherein the sensor input signal comprises information related to first user input sensor data and information related to second user input sensor data, wherein the first user input sensor data is based on user input related to an unlocking action and wherein the second user input sensor data is based on user input related to controlling of the machine;

validating the second user input sensor data based on the first user input sensor data, wherein the validation is based on a comparison of the first user input sensor data with at least one validation criterion; and

controlling the machine based on the first user input sensor data and the second user input sensor data after the second user input sensor data has been validated.

Assignments (1)

Priority Claims (1)

Continuity (1)

Cited By (12)

US 12,296,694 US 12,369,509 US 12,425,197 US 12,443,180 US 12,472,611 US 12,510,892 US 12,564,130 US 12,653,097 US 12,677,737 US 12,690,518 US 12,696,838 US 12,714,019