Method and device for assisting walking

1. A method of controlling a driving device of a walking assistance device, the method comprising:

capturing, via a camera attached to a first leg of a user, a leg image of a second leg of the user;

adjusting an orientation of the leg image to generate an adjusted leg image based on at least one of acceleration information and orientation information acquired from an inertial measurement unit (IMU) attached to at least one of the first leg and the second leg;

determining a gait state of the second leg based on the adjusted leg image;

determining an assist torque value output to the first leg based on the gait state of the second leg; and

controlling the driving device to output the assist torque value to the first leg.

2. The method of claim 1 , wherein the camera is a multi-view camera, and the capturing of the leg image comprises:

capturing, via the multi-view camera, a plurality of leg images; and

generating the leg image by merging the plurality of leg images.

3. The method of claim 1 , wherein the camera is an infrared camera or a thermal imaging camera.

4. The method of claim 1 , wherein the determining of the gait state of the second leg comprises:

detecting, in the leg image, a ground and the second leg; and

determining the gait state of the second leg based on the ground and the second leg in the leg image.

5. The method of claim 4 , wherein the determining of the gait state of the second leg based on the ground and the second leg in the leg image comprises:

determining the gait state of the second leg based on an angle between the ground and the second leg in the leg image.

6. The method of claim 4 , wherein the determining of the gait state of the second leg based on the ground and the second leg in the leg image comprises:

determining a position of the second leg in the leg image; and

determining the gait state based on the position of the second leg in the leg image.

7. The method of claim 6 , wherein the determining of the gait state based on the position of the second leg in the leg image comprises:

determining a relative position of the second leg with respect to at least two feature positions;

determining a degree of process of a gait cycle based on the relative position; and

determining the gait state based on the degree of process of the gait cycle.

8. The method of claim 6 , wherein the determining of the gait state based on the position of the second leg in the leg image comprises:

determining whether the second leg has passed a threshold position in a set direction based on the position of the second leg in the leg image; and

determining the gait state to be a target gait state in response to the second leg passing the threshold position in the set direction.

9. The method of claim 8 , wherein the determining of the assist torque value output to the first leg comprises:

determining the assist torque value for push-off of the first leg in response to the gait state of the second leg being the target gait state.

10. The method of claim 8 , wherein the determining of the assist torque value output to the first leg comprises:

determining the assist torque value for dorsiflexion of the first leg in response to the gait state of the second leg being the target gait state.

11. The method of claim 1 , wherein the determining of the assist torque value output to the first leg comprises:

determining the assist torque value from an assist torque table or an assist torque trajectory mapped to the gait state of the second leg.

12. The method of claim 1 , wherein the determining of the assist torque value output to the first leg comprises:

determining a gait state of the first leg based on the gait state of the second leg; and

determining the assist torque value output to the first leg based on the gait state of the first leg.

13. The method of claim 12 , wherein the determining of the gait state of the first leg comprises:

acquiring a pressure value from at least one pressure sensor attached to the first leg; and

determining the gait state of the first leg based on the pressure value and the gait state of the second leg.

14. A non-transitory computer-readable medium comprising computer readable instructions that, when executed, configure a computer to perform the method of claim 1 .

15. A walking assistance device for providing an assist torque to an ankle of a first leg of a user, the walking assistance device comprising:

a memory including a program for providing the assist torque; and

a processor configured to execute the program to,

capture, via a camera attached to the first leg of the user, a leg image of a second leg of the user,

adjust an orientation of the leg image to generate an adjusted leg image based on at least one of acceleration information and orientation information acquired from an inertial measurement unit (IMU) attached to at least one of the first leg and the second leg,

determine a gait state of the second leg based on the adjusted leg image,

determine an assist torque value output to the first leg based on the gait state of the second leg, and

control a driving device to output the assist torque value to the first leg such that the driving device provides the assist torque to the ankle of the first leg of the user.

16. A walking assistance device for assisting walking of a user, the walking assistance device comprising:

a camera configured to attach to a first leg of the user such that the camera is configured to capture a leg image of a second leg of the user;

a processor configured to,

adjust an orientation of the leg image to generate an adjusted leg image based on at least one of acceleration information and orientation information acquired from an inertial measurement unit (IMU) attached to at least one of the first leg and the second leg,

determine a gait state of the second leg based on the adjusted leg image, and

determine an assist torque value to output to the first leg based on the gait state of the second leg; and

a driving device configured to generate an assist torque having the assist torque value.