Immersive interview with real-time interactive feedback in augmented reality
In an approach for providing an immersive interview system with real-time interactive feedback, a processor presents a simulated environment of an interview based on an interview type and an interview format selected by a user. A processor collects a set of data regarding at least one performance related factor and nonperformance related factor for a length of the interview. A processor evaluates the set of data collected to detect a deficiency associated with the at least one performance related factor of the user. A processor detects the deficiency associated with the at least one performance related factor of the user. A processor outputs a notification to the user, wherein the notification is a recommendation explaining to the user a suggested change to improve the interview skill during the interview.
1 . A computer-implemented method for providing real-time feedback while simulating an interview environment, the computer-implemented method comprising:
receiving an interview format selection from a first user interface presenting a user with a plurality of interview formats;
receiving an interview type selection from a second user interface, the user interface presenting a user with a plurality of interview types;
presenting, by an interview simulation program, a simulated interview environment to the user via an augmented reality device, the interview environment representative of the selected interview type and the selected interview format;
recording to a database a set of time stamped data including content of discussion and biometric data of the user while the user participates in a simulated interview in the interview environment;
analyzing, by the interview simulation program, the set of time stamped data for performance related factors based on the content of discussion spoken by the user and corresponding biometric data;
detecting a deficiency in a first performance related factor associated with the content of discussion and the corresponding biometric data during the simulated interview, the deficiency detected in part by comparison of the content of discussion with a presentation of a portfolio; and
mirroring, via the augmented reality device, a behavior of the user when exhibiting the first performance related factor during the simulated interview, the mirroring including inserting, in real time, one or more color-coded indicators into a display of the augmented reality device to advise the user of a suggested change in the content of discussion during the simulated interview.
2 . The computer-implemented method of claim 1 , wherein:
the plurality of interview formats include at least one of a one-on-one interview, a panel interview, and a company specific interview, and
the plurality of interview types include at least one of a behavioral review option, a technical review option, and a portfolio review option.
3 . The computer-implemented method of claim 1 , wherein the mirroring inserts one or more flags to advise the user of one or more suggested changes in a body posture of the user during the interview.
4 . The computer-implemented method of claim 1 , further comprising:
replaying the mirroring to the user; and
highlighting a span of the mirroring associated with the suggested change.
5 . The computer-implemented method of claim 1 , further comprising:
replaying the mirroring to the user and a coach selected by the user, simultaneously;
pausing the interview at one or more spans of the mirroring associated with the suggested change; and
enabling the coach to communicatively critique the interview with the user.
6 . The computer-implemented method of claim 5 , wherein the coach is presented for selection based on a machine learning model to identify a match between the deficiency of the user during the interview and a candidate coach proficient in the deficiency of the user.
7 . The computer-implemented method of claim 1 , further comprising:
outputting a notification to the user during the simulated interview, wherein the notification is an explanation of the suggested change, which is made to improve an interview skill.
8 . The computer-implemented method of claim 1 , wherein the one or more color-coded indicators is a change in screen color to coordinate with whether the user is on track or off track with the presentation of the portfolio.
9 . A computer program product for providing real-time feedback while simulating an interview environment, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to receive an interview format selection from a first user interface presenting a user with a plurality of interview formats;
program instructions to receive an interview type selection from a second user interface, the user interface presenting a user with a plurality of interview types;
program instructions to present a simulated interview environment to the user via an augmented reality device, the interview environment representative of the selected interview type and the selected interview format;
program instructions to record to a database a set of time stamped data including content of discussion and biometric data of the user while the user participates in a simulated interview in the interview environment;
program instructions to analyze the set of time stamped data for performance related factors based on the content discussion spoken by the user and corresponding biometric data;
program instructions to detect a deficiency in a first performance related factor associated with the content of discussion and the corresponding biometric data during the simulated interview, the deficiency detected in part by comparison of the content of discussion with a presentation of a portfolio; and
program instructions to mirror, via the augmented reality device, a behavior of the user when exhibiting the first performance related factor during the simulated interview, the mirroring including inserting, in real time, one or more color-coded indicators into a display of the augmented reality device to advise the user of a suggested change in the content of discussion during the simulated interview.
10 . The computer program product of claim 9 , wherein the program instructions further comprise:
program instructions to replay a mirroring to the user; and
program instructions to highlight a span of the mirroring associated with the suggested change.
11 . The computer program product of claim 9 , wherein the program instructions further comprise:
program instructions to replay the mirroring to the user and a coach selected by the user, simultaneously;
program instructions to pause the interview at one or more spans of the mirroring associated with the suggested change; and
program instructions to enable the coach to communicatively critique the interview with user.
12 . The computer program product of claim 9 , wherein:
the plurality of interview formats include at least one of a one-on-one interview, a panel interview, and a company specific interview, and
the plurality of interview types include at least one of a behavioral review option, a technical review option, and a portfolio review option.
13 . The computer program product of claim 9 , wherein the mirroring inserts one or more flags to advise the user of one or more suggested changes in a body posture of the user during the interview.
14 . The computer program product of claim 9 , wherein the program instructions further comprise:
program instructions to output a notification to the user during the simulated interview, wherein the notification is an explanation of the suggested change, which is made to improve an interview skill.
15 . A computer system for providing real-time feedback while simulating an interview environment, the computer system comprising:
one or more computer processors;
one or more computer readable storage media;
program instructions collectively stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the stored program instructions comprising:
program instructions to receive an interview format selection from a first user interface presenting a user with a plurality of interview formats;
program instructions to receive an interview type selection from a second user interface, the user interface presenting a user with a plurality of interview types;
program instructions to present a simulated interview environment to the user via an augmented reality device, the interview environment representative of the selected interview type and the selected interview format;
program instructions to record to a database a set of time stamped data including content of discussion and biometric data of the user while the user participates in a simulated interview in the interview environment;
program instructions to analyze the set of time stamped data for performance related factors based on the content discussion spoken by the user and corresponding biometric data;
program instructions to detect a deficiency in a first performance related factor associated with the content of discussion and the corresponding biometric data during the simulated interview, the deficiency detected in part by comparison of the content of discussion with a presentation of a portfolio; and
program instructions to mirror, via the augmented reality device, a behavior of the user when exhibiting the first performance related factor during the simulated interview, the mirroring including inserting, in real time, one or more color-coded indicators into a display of the augmented reality device to advise the user of a suggested change in the content of discussion during the simulated interview.
16 . The computer system of claim 15 , wherein the program instructions further comprise:
program instructions to replay a mirroring to the user; and
program instructions to highlight a span of the mirroring associated with the suggested change.
17 . The computer system of claim 15 , wherein the program instructions further comprise:
program instructions to replay the mirroring to the user and a coach selected by the user, simultaneously;
program instructions to pause the interview at one or more spans of the mirroring associated with the suggested change; and
program instructions to enable the coach to communicatively critique the interview with user.
18 . The computer system of claim 15 , wherein the stored program instructions further comprise:
program instructions to output a notification to the user during the simulated interview, wherein the notification is an explanation of the suggested change, which is made to improve an interview skill.
19 . The computer system of claim 15 , wherein:
the plurality of interview formats include at least one of a one-on-one interview, a panel interview, and a company specific interview, and
the plurality of interview types include at least one of a behavioral review option, a technical review option, and a portfolio review option.
20 . The computer system of claim 15 , wherein the mirroring inserts one or more flags to advise the user of one or more suggested changes in a body posture of the user during the interview.