IP Library › Granted Patent US 9,026,678
Granted Patent B2
US 9,026,678 · App. 13/374,516 · Granted May 5, 2015

Detection of deceptive indicia masking in a communications interaction

Inventors: Clarence T. Tegreene (Mercer Island, WA); Royce A. Levien (Lexington, MA); Richard T. Lord (Tacoma, WA); Robert W. Lord (Seattle, WA); Mark A. Malamud (Seattle, WA)
Assignee: Elwha LLC
H04N21/42201H04N21/4394H04N21/44008H04N21/44218H04N21/4788H04N21/84A61B5/021A61B5/024A61B5/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,026,678
App. No.
13/374,516
Granted
May 5, 2015
Kind
B2
Abstract

Systems, methods, computer-readable storage mediums including computer-readable instructions and/or circuitry for detecting masking of deceptive indicia in communications content may implement operations including, but not limited to: receiving one or more signals associated with communications content provided by a first participant in a communications interaction; and detecting at least one indicia of a modification of the communications content associated with at least one indicia of deception by the first participant.

Claims (71)

1. A system comprising:

at least one computing device; and

one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.

2. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of one or more pixels of a video frame of the video data representing the participant.

3. The system of claim 2 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior replacement of one or more video frames of the video data representing the participant.

4. The system of claim 2 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior reduction in a resolution of the video data representing the participant.

5. The system of claim 2 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior reduction in a frame rate of the video data representing the participant.

6. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an audio characteristic of the audio data representing the participant.

7. The system of claim 6 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior replacement of one or more portions of the audio data representing the participant.

8. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an eye dilation of the participant in the video data representing the participant.

9. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an eye movement of the participant in the video data representing the participant.

10. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a heart rate of the participant in the audio and/or video data representing the participant.

11. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a blood pressure of the participant in the audio and/or video data representing the participant.

12. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a perspiration level of the participant in the video data representing the participant.

13. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a breathing rate of the participant in the audio and/or video data representing the participant.

14. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of video data representing one or more micro expressions of the participant.

15. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of audio data representing voice stress of the participant.

16. The system of claim 1 , wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of audio data representing characteristic language of the participant.

17. The system of claim 1 , wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant.

18. The system of claim 17 , wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a visual indicator indicative of a number of occurrences of detected indicia of a prior modification of the audio and/or video data representing the participant.

19. The system of claim 17 , wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a visual indicator indicative of a rate of occurrences of detected indicia of a prior modification of the audio and/or video data representing the participant.

20. The system of claim 17 , wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a color coded visual indicator indicative of one or more detected indicia of a prior modification of the prior modification of the audio and/or video data representing the participant.

21. The system of claim 1 , wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

emitting an audible notification, to the at least one other participant, that is indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant.

22. The system of claim 1 , wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

providing a notification, to the at least one other participant, that is indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant to the at least one other participant during the at least one of an audio or audio/video conferencing interaction with at least one other participant.

23. The system of claim 1 , wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

providing a notification indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant to the at least one other participant following the at least one of an audio or audio/video conferencing interaction with at least one other participant.

24. The system of claim 1 , further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant.

25. The system of claim 24 , wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

sampling at least a portion of the audio and/or video data representing the participant including at least one detected indicia of a modification of the audio and/or video data representing the participant.

26. The system of claim 24 , wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

inserting a graphical element associated with at least one detected indicia of a modification of the video data representing the participant into the video data representing the participant.

27. The system of claim 24 , wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

storing one or more time stamps associated with at least one detected indicia of a modification of the audio and/or video data representing the participant.

28. The system of claim 24 , wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant in response to a user input.

29. A computer-implemented method comprising:

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.

30. A non-transitory computer-readable medium comprising computer-readable instructions for executing a computer implemented method, the method comprising:

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2014
From: LEVIEN, ROYCE A.; LORD, RICHARD T.; LORD, ROBERT W.; MALAMUD, MARK A.
To: ELWHA LLC
Reel/Frame 033130/0803 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2012
From: TEGREENE, CLARENCE T.
To: ELWHA LLC
Reel/Frame 027892/0118 →
Continuity (5)
Continuation In Part 13373799 · Nov 30, 2011
Continuation In Part 13373798 · Nov 30, 2011
Continuation In Part 13373938 · Dec 5, 2011
Continuation In Part 13374521 · Dec 30, 2011
Related Publication 20130139255A1 · May 30, 2013