System and method for communicating target information to users
A system for communicating interactive instructions to a user intercepts video and audio information from an information handling system hosting a game, analyzes where a user is looking and listens for user commands, generates a list of candidate targets, selects a target profile for each candidate target, applies a prioritization policy to select a target from the list of candidate targets, and communicates haptic information to the user to signal an action to take relative to the selected target. The target may be a threat that the user must engage or evade, an object the user must get or avoid, a location the user must move to or avoid, or a route the user must take to attack or evade a threat or achieve a reward.
1. A targeting system for a game hosted by an information handling system, the targeting system comprising:
a memory storing a set of instructions executable by a processor to:
intercept video information; and
identify a first set of target candidates based on the intercepted video information;
intercept audio information; and
identify a second set of target candidates based on the intercepted audio information;
determine a position on a display corresponding to a user gaze location; and
identify a third set of target candidates based on the user gaze location;
receive verbal instructions from a user; and
identify a fourth set of target candidates based on the verbal instructions;
generate a list of target candidates from the first set of target candidates, the second set of target candidates, the third set of target candidates and the fourth set of target candidates;
for each target candidate, select a target profile from a plurality of target profiles, wherein each target profile defines a behavior associated with a target;
apply a target prioritization policy from a plurality of target prioritization policies to select a target from the list of target candidates, wherein each target prioritization policy identifies a set of target criteria for determining a target priority; and
send a set of instructions to a mouse for generating a haptic signal for communicating information to the user to perform an action associated with the target.
2. The targeting system of claim 1 , wherein the set of instructions is executable by the processor to apply a target prioritization policy based on one or more of a target candidate distance, a target candidate speed and a target candidate classification in the set of target criteria.
3. The targeting system of claim 2 , wherein the set of instructions is executable by the processor to apply a target prioritization policy based on one or more of a status of a character and a game state in the set of target criteria.
4. The targeting system of claim 1 , wherein the set of instructions sent to the mouse includes one or more of a direction of motion of the mouse, a speed of motion of the mouse, a haptic signal profile and a haptic signal intensity.
5. The targeting system of claim 1 , wherein the memory stores:
a predicted outcome corresponding to the set of instructions sent to the mouse; and
the set of instructions is executable by the processor to:
determine an outcome associated with the action performed by the user; and
update one or more of the target prioritization policy and the set of instructions for sending to the mouse based on the action taken by the user.
6. The targeting system of claim 5 , wherein the set of instructions is executable by the processor to:
send the set of instructions to the mouse based on a usage score;
compare the outcome associated with the action performed by the user with the predicted outcome; and
update the usage score associated with the set of instructions sent to the mouse.
7. The targeting system of claim 5 , wherein if the outcome associated with the action performed by the user does not match the outcome corresponding to the set of instructions, the set of instructions is executable by the processor to:
update one or more of the target prioritization policy and the set of instructions for sending to the mouse based on the action taken by the user.
8. An information handling system, comprising:
a processor subsystem;
a display for displaying information to a user;
a mouse for receiving information from the user; and
a targeting system comprising:
a memory storing a set of instructions executable by a processor to:
intercept video information; and
identify a first set of target candidates based on the intercepted video information;
intercept audio information; and
identify a second set of target candidates based on the intercepted audio information;
a visual-based target acquisition subsystem configured to:
determine a position on a display corresponding to a user gaze location; and
identify a third set of target candidates based on the user gaze location;
a verbal-based target acquisition subsystem configured to:
receive verbal instructions from the user; and
identify a fourth set of target candidates based on the verbal instructions;
a memory storing:
a plurality of target profiles, wherein each target profile defines a behavior associated with a target;
a plurality of target prioritization policies, wherein each target prioritization policy identifies a set of target criteria for determining a target priority; and
a set of instructions executable by a processor to:
generate a list of target candidates from the first set of target candidates, the second set of target candidates, the third set of target candidates and the fourth set of target candidates;
for each target candidate, select a target profile from the plurality of target profiles;
apply a target prioritization policy from the plurality of target prioritization policies to select a target from the list of target candidates; and
send a set of instructions to a mouse for generating a haptic signal for communicating information to the user to perform an action associated with the target.
9. The information handling system of claim 8 , wherein the set of instructions is executable by the processor to apply a target prioritization policy based on one or more of a target candidate distance, a target candidate speed and a target candidate classification in the set of target criteria.
10. The information handling system of claim 9 , wherein the set of instructions is executable by the processor to apply a target prioritization policy based on one or more of a status of a character and a game state in the set of target criteria.
11. The information handling system of claim 8 , wherein the set of instructions sent to the mouse includes one or more of a direction of motion of the mouse, a speed of motion of the mouse, a haptic signal profile and a haptic signal intensity.
12. The information handling system of claim 8 , wherein
the memory stores:
a predicted outcome corresponding to the set of instructions sent to the mouse; and
the set of instructions is executable by the processor to:
determine an outcome associated with the action performed by the user; and
update one or more of the target prioritization policy and the set of instructions for sending to the mouse based on the action taken by the user.
13. The information handling system of claim 12 , wherein the set of instructions is executable by the processor to:
send the set of instructions to the mouse based on a usage score;
compare the outcome associated with the action performed by the user with the predicted outcome; and
update the usage score associated with the set of instructions sent to the mouse.
14. The information handling system of claim 12 , wherein if the outcome associated with the action performed by the user does not match the outcome corresponding to the set of instructions, the set of instructions is executable by the processor to:
update one or more of the target prioritization policy and the set of instructions for sending to the mouse based on the action taken by the user.
15. A computer-implemented method for identifying targets in a game hosted by an information handling system, the method comprising:
intercepting one or more of video information and audio information from an information handling system hosting a game;
monitoring a display to determine a position on a display corresponding to a user gaze location;
monitoring a microphone to receive verbal instructions from a user;
generating a list of target candidates based on one or more of the intercepted video information, the intercepted audio information, the user gaze location and a verbal instruction;
associating a target profile with each target candidate, wherein each target profile defines a behavior associated with a target;
applying a target prioritization policy from a plurality of target prioritization policies to select a target from the list of target candidates, wherein each target prioritization policy identifies a set of target criteria for determining a target priority; and
sending a set of instructions to a mouse for generating a haptic signal for communicating information to the user to perform an action associated with the target.
16. The method of claim 15 , wherein sending the set of haptic signal instructions comprises sending a first instruction for a first haptic intensity and sending a second instruction for a second haptic intensity greater than or less than the first haptic intensity.
17. The method of claim 16 , wherein the first haptic intensity is associated with a first proximity of the target and the second haptic intensity is associated with a second proximity of the target.
18. The method of claim 16 , wherein:
the first haptic intensity is associated with movement of a user character toward the target; and
the second haptic intensity is associated with movement of the user character away from the target.
19. The method of claim 16 , wherein:
the first haptic intensity is associated with movement of a game reticle towards the target; and
the second haptic intensity is associated with movement of the game reticle away from the target.
20. The method of claim 16 , wherein:
the game is hosted by an information handling system coupled to a network; and
intercepting one or more of video information and audio information from the information handling system hosting the game comprises intercepting one or more of video information and audio information received by a network interface.