Gesture-based search systems and methods for vehicles that output primary and secondary search results
Systems, methods, and other embodiments described herein relate to gesture-based searching in a vehicle. In one embodiment, a vehicle-based search system, in response to detecting a gesture performed by an occupant of a vehicle, correlates the gesture with a target. The system also constructs a search query based on the target correlated with the gesture and an occupant request. The system also executes the search query to acquire search results. The system also processes the search results to generate primary search results and secondary search results. The primary and secondary search results are different in scope. The system also communicates the primary and secondary search results to the occupant via a primary output device and a secondary output device, respectively, to provide assistance to the occupant pertaining to the target.
1 . A system, comprising:
a processor; and
a memory storing machine-readable instructions that, when executed by the processor, cause the processor to:
in response to detecting a gesture performed by an occupant of a vehicle, correlate the gesture with a target;
construct a search query based on the target correlated with the gesture and an occupant request;
execute the search query to acquire search results;
process the search results to generate primary search results and secondary search results, wherein the primary and secondary search results are different in scope and processing the search results to generate the primary search results includes using a generative-artificial-intelligence-based text summarization algorithm; and
communicate the primary and secondary search results to the occupant via a primary output device and a secondary output device, respectively, to provide assistance to the occupant pertaining to the target, wherein, for safety reasons, when the secondary search results are communicated via an output system of the vehicle, the secondary search results are displayed via the output system of the vehicle only after the vehicle is parked.
2 . The system of claim 1 , wherein the secondary search results are more detailed than the primary search results.
3 . The system of claim 1 , wherein the machine-readable instructions to communicate the primary search results to the occupant include instructions that, when executed by the processor, cause the processor to output a computer-synthesized natural-language statement via an output system of the vehicle that includes the primary output device.
4 . The system of claim 1 , wherein the secondary output device is one of a cloud server, an occupant mobile device, an occupant laptop computer, an occupant desktop computer, and an output system of the vehicle.
5 . The system of claim 1 , wherein the machine-readable instructions include further instructions that, when executed by the processor, cause the processor to:
receive a natural-language request from the occupant to capture an image of a particular portion of one of an external environment of the vehicle and an internal environment of the vehicle;
capture the image in accordance with the natural-language request from the occupant; and
transmit the captured image to the secondary output device.
6 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to:
in response to detecting a gesture performed by an occupant of a vehicle, correlate the gesture with a target;
construct a search query based on the target correlated with the gesture and an occupant request;
execute the search query to acquire search results;
process the search results to generate primary search results and secondary search results, wherein the primary and secondary search results are different in scope and processing the search results to generate the primary search results includes using a generative-artificial-intelligence-based text summarization algorithm; and
communicate the primary and secondary search results to the occupant via a primary output device and a secondary output device, respectively, to provide assistance to the occupant pertaining to the target, wherein, for safety reasons, when the secondary search results are communicated via an output system of the vehicle, the secondary search results are displayed via the output system of the vehicle only after the vehicle is parked.
7 . The non-transitory computer-readable medium of claim 6 , wherein the secondary search results are more detailed than the primary search results.
8 . The non-transitory computer-readable medium of claim 6 , wherein the instructions to communicate the primary search results to the occupant include instructions that, when executed by the processor, cause the processor to output a computer-synthesized natural-language statement via an output system of the vehicle that includes the primary output device.
9 . The non-transitory computer-readable medium of claim 6 , wherein the secondary output device is one of a cloud server, an occupant mobile device, an occupant laptop computer, an occupant desktop computer, and an output system of the vehicle.
10 . A method, comprising:
in response to detecting a gesture performed by an occupant of a vehicle, correlating the gesture with a target;
constructing a search query based on the target correlated with the gesture and an occupant request;
executing the search query to acquire search results;
processing the search results to generate primary search results and secondary search results, wherein the primary and secondary search results are different in scope and processing the search results to generate the primary search results includes using a generative-artificial-intelligence-based text summarization algorithm; and
communicating the primary and secondary search results to the occupant via a primary output device and a secondary output device, respectively, to provide assistance to the occupant pertaining to the target, wherein, for safety reasons, when the secondary search results are communicated via an output system of the vehicle, the secondary search results are displayed via the output system of the vehicle only after the vehicle is parked.
11 . The method of claim 10 , wherein the secondary search results are more detailed than the primary search results.
12 . The method of claim 10 , wherein the primary search results are communicated to the occupant as a computer-synthesized natural-language statement via an output system of the vehicle that includes the primary output device.
13 . The method of claim 10 , wherein the secondary output device is one of a cloud server, an occupant mobile device, an occupant laptop computer, an occupant desktop computer, and an output system of the vehicle.
14 . The method of claim 10 , further comprising:
receiving a natural-language request from the occupant to capture an image of a particular portion of one of an external environment of the vehicle and an internal environment of the vehicle;
capturing the image in accordance with the natural-language request from the occupant; and transmitting the captured image to the secondary output device.