Transit vending machine with automatic user interface adaption
View Patent ↗Techniques are disclosed for providing a transit vending machine that accommodates its users by automatically adjusting a layout of the user interface based on information determined about the user as obtained from image information of the user. Information about the user can be indicative of user height, hand used to interact with the touchscreen display, an offset of user input, and the like.
1. A transit system vending machine comprising: a touchscreen display configured to display an output, wherein:
the output comprises a set of displayed elements including a set of one or more interactive controls disposed in a first area of the touchscreen display and at least one other displayed element disposed in a second area of the touchscreen display; and
the first area of the touchscreen display comprises a right-hand portion of the touchscreen display and the second area of the touchscreen display comprises a left-hand portion of the touchscreen display;
a camera configured to capture an image of a user of the transit system vending machine and provide the captured image to a processing unit; and
the processing unit, communicatively coupled to the touchscreen display and the camera, wherein the processing unit is configured to perform operations including: causing the touchscreen display to display the output; receiving user input corresponding to the user pressing one of the set of one or more interactive controls;
receiving the captured image of the user from the camera; after receiving the captured image, conducting image analysis of the captured image of the user to determine that a triggering event occurred, the triggering event comprising:
the user approaching the transit system vending machine, and the user raising a left arm to press one of the set of one or more interactive controls; and
after determining that the triggering event occurred and after receiving the user input causing the touchscreen display to automatically rearrange the output by moving the one or more interactive controls from the first area of the touchscreen display to the second area of the touchscreen display and by moving the at least one other displayed element from the second area of the touchscreen display to the first area of the touchscreen display;
determining that input data regarding locations of a plurality of touchscreen display inputs received by the user when pressing interactive controls on the touchscreen display is indicative of an offset between the locations of the plurality of touchscreen display inputs and the locations of the corresponding interactive controls; and automatically adjusting a position of at least the interactive controls on the touchscreen display to compensate for the offset.
2. The transit system vending machine of claim 1 , wherein the processing unit is further configured to determine, from first image information captured by the camera, that a height of the user is above a certain threshold.
3. The transit system vending machine of claim 2 , wherein the processing unit is further configured to make the determination regarding the height of the user based on the image information, wherein the image information comprises the captured image of the user.
4. The transit system vending machine of claim 2 , wherein the processing unit is further configured to make the determination regarding the height of the user based on an established reference position within a field of view of the camera.
5. The transit system vending machine of claim 4 , wherein the processing unit is further configured to cause the transit system vending machine to establish the reference position from second information captured by the camera during a calibration of the transit system vending machine.
6. The transit system vending machine of claim 4 , wherein the processing unit is further configured to cause the transit system vending machine to modify the established reference position based on the determination regarding the height of the user.
7. A method of automatic user interface adaption in a transit system vending machine, the method comprising:
displaying, with a touchscreen display, an output, wherein: the output comprises a set of displayed elements including a set of one or more interactive controls disposed in a first area of the touchscreen display and at least one other displayed element disposed in a second area of the touchscreen display; and the first area of the touchscreen display comprises a right-hand portion of the touchscreen display and the second area of the touchscreen display comprises a left-hand portion of the touchscreen display; causing the touchscreen display to display the output; receiving user input corresponding to a user pressing one of the set of one or more interactive controls; capturing an image of the user of the transit system vending machine with a camera; after capturing the image, analyzing, with a processing unit of the transit system vending machine, the captured image of the user to determine that a triggering event occurred, the triggering event comprising:
the user approaching the transit system vending machine, and the user raising a left hand to press one of the set of one or more interactive controls; and after determining that the triggering event occurred and after receiving the user input causing the touchscreen display to automatically rearrange the output by moving the one or more interactive controls from the first area of the touchscreen display to the second area of the touchscreen display and by moving the at least one other displayed element from the second area of the touchscreen display to the first area of the touchscreen display;
determining that input data regarding locations of a plurality of touchscreen display inputs received by the user when pressing interactive controls on the touchscreen display is indicative of an offset between the locations of the plurality of touchscreen display inputs and the locations of the corresponding interactive controls; and automatically adjusting a position of at least the interactive controls on the touchscreen display to compensate for the offset.
8. The method of automatic user interface adaption in a transit system vending machine as in claim 7 , further comprising determining, from first image information captured by the camera, that a height of the user is above a certain threshold.
9. The method of automatic user interface adaption in a transit system vending machine as in claim 8 , further comprising making the determination regarding the height of the user based on an established reference position within a field of view of the camera.
10. The method of automatic user interface adaption in a transit system vending machine as in claim 9 , further comprising causing the transit system vending machine to establish the reference position from second information captured by the camera during a calibration of the transit system vending machine.
11. The method of automatic user interface adaption in a transit system vending machine as in claim 9 , further comprising causing the transit system vending machine to modify the established reference position based on the determination regarding the height of the user.
12. A non-transitory machine-readable medium having instructions embedded thereon for providing automatic user interface adaption in a transit system vending machine, instructions including computer code for:
displaying, with a touchscreen display, an output, wherein: the output comprises a set of displayed elements including a set of one or more interactive controls disposed in a first area of the touchscreen display and at least one other displayed element disposed in a second area of the touchscreen display; and the first area of the touchscreen display comprises a right-hand portion of the touchscreen display and the second area of the touchscreen display comprises a left-hand portion of the touchscreen display;
causing the touchscreen display to display the output; receiving user input corresponding to a user pressing one of the set of one or more interactive controls; capturing an image of the user of the transit system vending machine with a camera;
after capturing the image, analyzing, with a processing unit of the transit system vending machine, the captured image of the user to determine that a triggering event occurred, the triggering event comprising:
the user approaching the transit system vending machine, and the user raising a left hand to press one of the set of one or more interactive controls; and
after determining that the triggering event occurred and after receiving the user input causing the touchscreen display to automatically rearrange the output by moving the one or more interactive controls from the first area of the touchscreen display to the second area of the touchscreen display and by moving the at least one other displayed element from the second area of the touchscreen display to the first area of the touchscreen display;
determining that input data regarding locations of a plurality of touchscreen display inputs received by the user when pressing interactive controls on the touchscreen display is indicative of an offset between the locations of the plurality of touchscreen display inputs and the locations of the corresponding interactive controls; and automatically adjusting a position of at least the interactive controls on the touchscreen display to compensate for the offset.