Unattended commodity selling assistance system using vehicle, and vehicle assisting in unattended commodity selling
An unattended commodity selling assistance system using a vehicle. The vehicle includes an in-vehicle camera, an image data acquisition unit, a door lock device, a notification unit, a communication device, and an identification unit. The image data acquisition unit acquires the image data on the image captured by the in-vehicle camera. The notification unit notifies a purchaser in unattended selling of information. The identification unit performs image processing on the image data acquired by the image data acquisition unit. The identification unit is configured to identify the purchaser registered in advance as being present around the vehicle, based on data obtained from an information terminal of the purchaser by the communication device, and acquire settlement data from the data obtained from the information terminal of the purchaser. On the condition that the identification unit has acquired the settlement data, the door lock device unlocks the trunk door.
1 . An unattended commodity selling assistance system using a vehicle, the vehicle comprising:
an in-vehicle camera configured to capture an image of at least a surrounding view of a commodity accommodated by the vehicle; and
a processor and a memory having a program that, when executed by the processor, cause the processor to be configured to:
acquire image data on the image captured by the in-vehicle camera;
control a door lock device to lock or unlock a trunk door of a trunk, the trunk providing room for the commodity;
notify a purchaser;
communicate with an information terminal of the purchaser and an information terminal of a vendor through a network;
perform image processing on the image data;
identify, based on wireless communication data received from the information terminal of the purchaser, that the purchaser is located within a wireless communication range of the vehicle, wherein the purchaser is registered in advance;
acquire, from the information terminal of the purchaser, settlement verification data indicating that a registered settlement method is valid and available for payment; and
control the door lock device to unlock the trunk door only in response to determining that both identification of the purchaser and the settlement verification data are successfully authenticated,
wherein the processor is further configured to acquire purchaser-related data based on a wireless communication established between a communication device of the vehicle and the information terminal of the purchaser,
wherein the in-vehicle camera comprises a trunk camera configured to capture images of the commodity in the trunk and movements of a hand of the purchaser while the hand of the purchaser is in the trunk, an aperture camera configured to capture images of the purchaser and surroundings of the purchaser, and a perimeter camera configured to capture images of surroundings of the vehicle,
wherein, in response to the trunk door unlocking and the trunk door opening, the processor is configured to cause the trunk camera, the aperture camera, and the perimeter camera to start to capture images,
wherein the processor is further configured to use second image data captured by the trunk camera and third image data captured by the aperture camera to determine that the hand captured by the trunk camera is the hand of the purchaser,
wherein the processor is configured to identify, based on the determination that the hand captured by the trunk camera is the hand of the purchaser-determined, that the purchaser is holding an object other than the commodity or that the purchaser is holding belongings of the purchaser, and display a notification on an interface of the vehicle in response to determining the purchaser is holding the object other than the commodity or that the purchaser is holding the belongings of the purchaser, and
wherein, in response to determining the trunk door is unlocked, the trunk door is not opened, and the identification of the purchaser and the settlement verification data are successfully authenticated, the processor is further configured to check, by using the communication device of the vehicle, presence or absence of the purchaser, and control the door lock device to lock the trunk door in response to determining the absence of the purchaser.
2 . The unattended commodity selling assistance system using the vehicle according to claim 1 , wherein the processor is configured to, in response to identifying that the purchaser is holding the commodity based on the image processing, give the purchaser a notification including data regarding the commodity.
3 . The unattended commodity selling assistance system using the vehicle according to claim 1 , wherein the processor is configured to display the notification until the purchaser releases the object other than the commodity.
4 . The unattended commodity selling assistance system using the vehicle according to claim 1 , wherein, in response to determining the trunk door is unlocked and the trunk door is opened, the processor is further configured to transmit an unlock notification to the information terminal of the vendor.
5 . The unattended commodity selling assistance system using the vehicle according to claim 1 , wherein, in response to determining that a face of the purchaser is not accurately identifiable, the processor is further configured to present a notification advising the purchaser to take off a hat or a mask.
6 . The unattended commodity selling assistance system using the vehicle according to claim 1 , wherein the processor is configured further to identify that the object other than the commodity is an item not for sale based on data regarding commodity registration stored in a storage and at least one of the second image data and the third image data.
7 . A vehicle configured to assist in unattended commodity selling, the vehicle comprising:
an in-vehicle camera configured to capture an image of at least a surrounding view of a commodity accommodated by the vehicle; and
a processor and a memory having a program that, when executed by the processor, cause the processor to be configured to:
acquire image data on the image captured by the in-vehicle camera;
control a door lock device to lock or unlock a trunk door of a trunk, the trunk providing room for the commodity;
notify a purchaser;
communicate with an information terminal of the purchaser and an information terminal of a vendor through a network; and
perform image processing on the image data;
identify, based on wireless communication data received from the information terminal of the purchaser, that the purchaser is located within a wireless communication range of the vehicle, wherein the purchaser is registered in advance;
acquire, from the information terminal of the purchaser, settlement verification data indicating that a registered settlement method is valid and available for payment; and
control the door lock device to unlock the trunk door only in response to determining that both identification of the purchaser and the settlement verification data are successfully authenticated,
wherein the processor is further configured to acquire purchaser-related data based on a wireless communication established between a communication device of the vehicle and the information terminal of the purchaser,
wherein the in-vehicle camera comprises a trunk camera configured to capture images of the commodity in the trunk and movements of a hand of the purchaser while the hand of the purchaser is in the trunk, an aperture camera configured to capture images of the purchaser and surroundings of the purchaser, and a perimeter camera configured to capture images of surroundings of the vehicle,
wherein, in response to the trunk door unlocking and the trunk door opening, the processor is configured to cause the trunk camera, the aperture camera, and the perimeter camera to start to capture images,
wherein the processor is further configured to use second image data captured by the trunk camera and third image data captured by the aperture camera to determine that the hand captured by the trunk camera is the hand of the purchaser,
wherein the processor is configured to identify, based on the determination that the hand captured by the trunk camera is the hand of the purchaser, that the purchaser is holding an object other than the commodity or that the purchaser is holding belongings of the purchaser, and display a notification on an interface of the vehicle in response to determining the purchaser is holding the object other than the commodity or that the purchaser is holding the belongings of the purchaser, and
wherein, in response to determining the trunk door is unlocked, the trunk door is not opened, and the identification of the purchaser and the settlement verification data are successfully authenticated, the processor is further configured to check, by using the communication device of the vehicle, presence or absence of the purchaser, and control the door lock device to lock the trunk door in response to determining the absence of the purchaser.
8 . An unattended commodity selling assistance system using a vehicle, the vehicle comprising:
an in-vehicle camera configured to capture an image of at least a surrounding view of a commodity accommodated by the vehicle; and
a trunk door of a trunk that provides room for the commodity,
the unattended commodity selling assistance system comprising circuitry configured to:
acquire image data on the image captured by the in-vehicle camera;
control a door lock device of the vehicle to lock or unlock the trunk door of the trunk;
cause the vehicle to notify a purchaser;
cause the vehicle to communicate with an information terminal of the purchaser and an information terminal of a vendor through a network;
perform image processing on the image data; and
identify, based on wireless communication data received from the information terminal of the purchaser, that the purchaser is located within a wireless communication range of the vehicle, wherein the purchaser is registered in advance;
acquire, from the information terminal of the purchaser, settlement verification data indicating that a registered settlement method is valid and available for payment; and
control the door lock device to unlock the trunk door only in response to determining that both identification of the purchaser and the settlement verification data are successfully authenticated,
wherein the circuitry is further configured to acquire purchaser-related data based on a wireless communication established between a communication device of the vehicle and the information terminal of the purchaser,
wherein the in-vehicle camera comprises a trunk camera configured to capture images of the commodity in the trunk and movements of a hand of the purchaser while the hand of the purchaser is in the trunk, an aperture camera configured to capture images of the purchaser and surroundings of the purchaser, and a perimeter camera configured to capture images of surroundings of the vehicle,
wherein, in response to the trunk door unlocking and the trunk door opening, the circuitry is configured to cause the trunk camera, the aperture camera, and the perimeter camera to start to capture images,
wherein the circuitry is further configured to use second image data captured by the trunk camera and third image data captured by the aperture camera to determine that the hand captured by the trunk camera is the hand of the purchaser,
wherein the circuitry is configured to identify, based on the determination that the hand captured by the trunk camera is the hand of the purchaser, that the purchaser is holding an object other than the commodity or that the purchaser is holding belongings of the purchaser, and display a notification on an interface of the vehicle in response to determining the purchaser is holding the object other than the commodity or that the purchaser is holding the belongings of the purchaser, and
wherein, in response to determining the trunk door is unlocked, the trunk door is not opened, and the identification of the purchaser and the settlement verification data are successfully authenticated, the circuitry is further configured to check, by using the communication device of the vehicle, presence or absence of the purchaser, and control the door lock device to lock the trunk door in response to determining the absence of the purchaser.
9 . A vehicle configured to assist in unattended commodity selling, the vehicle comprising:
an in-vehicle camera configured to capture an image of at least a surrounding view of a commodity accommodated by the vehicle;
a trunk door of a trunk that provides room for the commodity; and
circuitry configured to:
acquire image data on the image captured by the in-vehicle camera;
control a door lock device of the vehicle to lock or unlock the trunk door of the trunk;
cause the vehicle to notify a purchaser;
cause the vehicle to communicate with an information terminal of the purchaser and an information terminal of a vendor through a network;
perform image processing on the image data; and
identify, based on wireless communication data received from the information terminal of the purchaser, that the purchaser is located within a wireless communication range of the vehicle, wherein the purchaser is registered in advance;
acquire, from the information terminal of the purchaser, settlement verification data indicating that a registered settlement method is valid and available for payment; and
control a door lock device to unlock the trunk door only in response to determining that both identification of the purchaser and the settlement verification data are successfully authenticated,
wherein the circuitry is further configured to acquire purchaser-related data based on a wireless communication established between a communication device of the vehicle and the information terminal of the purchaser,
wherein the in-vehicle camera comprises a trunk camera configured to capture images of the commodity in the trunk and movements of a hand of the purchaser while the hand of the purchaser is in the trunk, an aperture camera configured to capture images of the purchaser and surroundings of the purchaser, and a perimeter camera configured to capture images of surroundings of the vehicle,
wherein, in response to the trunk door unlocking and the trunk door opening, the circuitry is configured to cause the trunk camera, the aperture camera, and the perimeter camera to start to capture images,
wherein the circuitry is further configured to use second image data captured by the trunk camera and third image data captured by the aperture camera to determine that the hand captured by the trunk camera is the hand of the purchaser,
wherein the circuitry is configured to identify, based on the determination that the hand captured by the trunk camera is the hand of the purchaser, that the purchaser is holding an object other than the commodity or that the purchaser is holding belongings of the purchaser, and display a notification when the purchaser is holding the object other than the commodity or that the purchaser is holding the belongings of the purchaser, and
wherein, in response to determining the trunk door is unlocked, the trunk door is not opened, and the identification of the purchaser and the settlement verification data are successfully authenticated, the circuitry is further configured to check, by using the communication device of the vehicle, presence or absence of the purchaser, and control the door lock device to lock the trunk door in response to determining the absence of the purchaser.