IP Library › Granted Patent US 12,236,013
Granted Patent B2
US 12,236,013 · App. 17/988,154 · Granted Feb 25, 2025

Mobility device and method for controlling the same

Inventors: Seung Kyu Nam (Seoul, KR); Il Yong Yoon (Seoul, KR); Tae Jun Lee (Suwon-si, KR); Chang Hwan Im (Seoul, KR); Jin Uk Kwon (Seoul, KR); Hye Rin Nam (Seoul, KR); Ji Hun Hwang (Seoul, KR)
Assignees: Hyundai Motor Company; Kia Corporation; IUCF-HYU (Industry-University Cooperation Foundation Hanyang University)
G06F3/015H04N9/3182H04N9/3194
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,013
App. No.
17/988,154
Granted
Feb 25, 2025
Kind
B2
Abstract

A mobility device may include a drive for driving the mobility device, a projector for outputting a visual stimulus, an electroencephalogram device for detecting a brainwave of a user, and a controller for controlling the drive and/or the projector. The controller may be connected to the EEG device, and may be configured to control the projector to output the visual stimulus to a surface at a position spaced by a specified distance from the mobility device.

Claims (39)

1. An apparatus comprising:

an electric wheelchair;

a drive for driving the electric wheelchair;

a projector for outputting a visual stimulus;

an electroencephalogram (EEG) device for detecting a brainwave of a user; and

a controller configured to:

receive information from the EEG device;

control the drive;

detect an electromyography (EMG) signal generated from the user in a waiting state; and

cause the projector to output the visual stimulus at a distance from the electric wheelchair based on detecting the EMG signal.

2. The apparatus of claim 1 , wherein the EEG device is configured to:

establish a communication channel with the controller in a designated wireless communication scheme; and

transmit a signal corresponding to the brainwave to the controller via the communication channel.

3. The apparatus of claim 1 , wherein the EEG device is configured for mounting on a head of the user in a dry manner and generating an electrical signal corresponding to the brainwave.

4. The apparatus of claim 1 , wherein the visual stimulus comprises a plurality of objects related to movement of the apparatus.

5. The apparatus of claim 4 , wherein the plurality of objects are output at different frequencies.

6. The apparatus of claim 4 , wherein each of the plurality of objects has a checkerboard pattern.

7. The apparatus of claim 4 , wherein the plurality of objects are positioned in a lower area in a vertical direction of the visual stimulus.

8. The apparatus of claim 1 , wherein the projector is mounted at a base of the electric wheelchair.

9. The apparatus of claim 1 , wherein the controller is configured to control the projector to output the visual stimulus and to suspend control of the drive for a specified time duration.

10. The apparatus of claim 1 , wherein the brainwave includes a steady-state visual evoked potential (SSVEP).

11. The apparatus of claim 1 , wherein the controller is configured to:

detect ambient light; and

adjust brightness of the visual stimulus based on the ambient light.

12. The apparatus of claim 1 , wherein the controller is configured to adjust brightness of the visual stimulus, based on an angle at which the visual stimulus is output or a distance by which the visual stimulus is projected at a position.

13. The apparatus of claim 1 , wherein the projector is configured to output the visual stimulus at brightness greater than or equal to a specified brightness level.

14. The apparatus of claim 1 , wherein the controller is configured to:

detect a color of a surface around the electric wheelchair; and

control the projector to output the visual stimulus in a color contrasting with the color of the surface.

15. The apparatus of claim 1 , wherein the controller is configured to end movement of the electric wheelchair based on detecting a designated EMG signal.

16. A method comprising:

detecting, by a controller, an electromyography (EMG) signal generated from a user in a waiting state;

causing, by the controller, a projector to output a visual stimulus to a surface spaced apart from an electric wheelchair by a specified distance based on the detecting the EMG signal;

receiving, from an electroencephalogram (EEG) device, a signal indicating a brainwave induced based on the visual stimulus;

generating a control signal corresponding to the signal; and

controlling a drive of the electric wheelchair based on the control signal.

17. The method of claim 16 , wherein the receiving the signal comprises receiving a signal indicating an electrical signal generated by the EEG device in response to the brainwave detected via dry contact of one or more electrodes of the EEG device with a user's head.

18. The method of claim 16 , wherein the visual stimulus comprises a plurality of indications of possible actions of the electric wheelchair.

19. The method of claim 18 , wherein the plurality of indications are output at different frequencies.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: NAM, SEUNG KYU; YOON, IL YONG; LEE, TAE JUN; IM, CHANG HWAN; KWON, JIN UK; NAM, HYE RIN; HWANG, JI HUN
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION; IUCF-HYU (INDUSTRY-UNIVERSITY COOPERATION FOUNDATION HANYANG UNIVERSITY)
Reel/Frame 061792/0962 →
Priority Claims (1)
KR 10-2022-0047653 · Apr 18, 2022 · national
Continuity (1)
Related Publication 20230333652A1 · Oct 19, 2023
References Cited (28)
US 11402908B2 · Kang et al. · 2022 [cited by applicant]
US 20140051961A1 · Badower · 2014 [cited by examiner]
US 20140347265A1 · Aimone · 2014 [cited by examiner]
US 20150309572A1 · Shi · 2015 [cited by examiner]
US 20160370774A1 · Lamti et al. · 2016 [cited by applicant]
US 20180024640A1 · Yeom · 2018 [cited by examiner]
US 20190104968A1 · Fedele · 2019 [cited by applicant]
US 20210117000A1 · Kang et al. · 2021 [cited by applicant]
CN 102973371B · 2015 [cited by applicant]
CN 106681494A · 2017 [cited by examiner]
CN 106821628B · 2018 [cited by applicant]
CN 210631403U · 2020 [cited by examiner]
CN 107961120B · 2020 [cited by examiner]
KR 101400141B1 · 2014 [cited by applicant]
KR 101465878B1 · 2014 [cited by applicant]
KR 1020210046236A · 2021 [cited by applicant]
WO 20190073603A1 · 2019 [cited by applicant]
Machine Translation of CN-210631403-U (Year: 2020). [cited by examiner]
Iturrate et al, “A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation”, 2009, IEEE (Year: 2009). [cited by examiner]
Pallab Dutta et al, “A Novel Approach to Power Optimization for Projection Systems”, 2017, Indian Journal of Science and Technology (Year: 2017). [cited by examiner]
Son et al, “Color Correction of Images Projected on a Colored Screen for Mobile Beam Projector”, 2008, Journal of Imaging Science and Technology (Year: 2008). [cited by examiner]
Watanabe et al, “Communicating Robotic Navigational Intentions”, 2015, IEEE (Year: 2015). [cited by examiner]
Huang et al, “Electroencephalography (EEG)-Based Brain-Computer Interface (BCI): a 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control”, 2012, IEEE (Year: 2012). [cited by examiner]
Machine translation of KR101465878B1 (Year: 2014). [cited by examiner]
Kurth et al, “Real-Time Adaptive Color Correction in Dynamic Projection Mapping”, 2020, IEEE (Year: 2020). [cited by examiner]
Xie, Jun et al., “The Performance Evaluation of SSVEP-BCE Actuated Wheelchair with Parameter Setting of Time-Window Length and Stimulation Layout,” (2020), Institute of Electrical and Electronics Engineers, pp. 581-585. [cited by applicant]
Müller, Sandraw Mara, Bastos, Teodiano Freire and Filho, Mario Sarcinelli, “Proposal of a SSVEP-BCI to Command a Robotic Wheelchair,” J Control Autom Electr Sys, (2013) 24, pp. 97-105. [cited by applicant]
Mistry, Krupal Sureshbai, et al., “An SSVEP Based Brain Computer Interface System to Control Electric Wheelchairs,” (2018), Institute of Electrical and Electronics Engineers, 6 pages. [cited by applicant]
Cited By (1)
US 12,554,326