IP Library Granted Patent US 9,030,292
Granted Patent B2
US 9,030,292 · App. 13/088,883 · Granted May 12, 2015

Interactive audio/video system and device for use in a secure facility

Inventors: Richard Torgersrud (San Francisco, CA); Kevin O'Neil (Parma, ID); Grant Gongaware (San Francisco, CA); Morgan Collins (San Mateo, CA)
G06F21/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,030,292
App. No.
13/088,883
Granted
May 12, 2015
Kind
B2
Abstract

A system and device for providing services to a secure facility. The system includes a kiosk with a processor, display, speaker, microphone, and a camera, and the kiosk communicates with a server that includes a server processor, a network interface unit, and a computer memory. The kiosk receives communications and transmits audio and video of the communications to the server via an internet connection, and the server records the audio and video and transmits the audio and video to a destination. The kiosk is configured to authenticate the identity of a user by verifying a personal identification number entered by the user and also performing one or more of a facial recognition via the camera or a biometric voice recognition via the microphone. The kiosk provides access to services including internet services, text-based messaging, tele-medical services, religious and educational materials, commissary ordering, and entertainment.

Claims (63)

1. A system for providing services to a secure facility, the system comprising:

a kiosk located at a secure facility, the kiosk comprising a processor, display, speaker, microphone, and a camera; and

a server that communicates with the kiosk via a network connection, the server comprising a server processor, a network interface unit, and a computer memory;

the kiosk being configured to receive communications from the camera and microphone and transmit audio and video of the communications to the server via the network connection;

wherein the server records the audio and video and transmits the audio and video to a destination;

wherein the kiosk is configured to authenticate the identity of a user of the kiosk by verifying log in information entered by the user and also performing a biometric verification;

wherein, after the user identity has been authenticated by the kiosk and during the transmission of the video, the server is configured to periodically extract a frame of the video and perform a check to determine if a face is present in the frame, and the server is further configured to blur the video being transmitted to the destination when the check determines that the face is not present in the frame; and

wherein the destination is a device communicating with the server, and the server is configured to authenticate a user of the device.

2. The system of claim 1 , further comprising:

a second kiosk located in a visitation area of the secure facility; and

a local server located at the secure facility;

the kiosk being configured to transmit the audio and video to the local server when the communications are intended for the second kiosk located in the visitation area; and

wherein the local server is configured to record the audio and video and transmit the audio and video to the second kiosk located in the visitation area.

3. The system of claim 1 , wherein the server is configured to periodically extract a frame of the video and authenticate a face in the frame against a stored identification image of the user.

4. The system of claim 1 , wherein during a singular communications session, the kiosk is configured to periodically record a frame of video and transmit the frame to the server, and wherein the server processor authenticates a face in the frame against a stored identification image of the user.

5. The system of claim 1 , wherein the kiosk is configured to accept messages input by the user after the user has logged on and transmit the messages to the server, and the server is configured to provide a third party access to the messages.

6. The system of claim 1 , wherein the server is configured to receive an incoming call for the user from a third party caller, determine whether the user has permission to receive incoming calls, if the user has permission, transmit the incoming call to the kiosk and at least a second kiosk, and

wherein the kiosk and the second kiosk are configured to, upon receipt of the incoming call, display a screen notifying the user of the incoming call, and prompt the user to input the log in information.

7. The system of claim 1 , wherein the kiosk is configured to provide the user with at least two of: access to audio, video, and text of educational material stored on the server and/or the kiosk, access to audio, video, and text of religious material stored on the server and/or the kiosk, and the ability to order items from a list of commissary items.

8. The system of claim 1 , wherein the kiosk is configured to receive text-based messages from a server, and to display a notification of an available text-based message on an idle screen of the kiosk.

9. The system of claim 1 , wherein the log in information is a personal identification number.

10. The system of claim 1 , wherein the biometric verification comprises a facial authentication via the camera.

11. The system of claim 1 , wherein the biometric verification comprises a voice authentication via the microphone.

12. The system of claim 1 , wherein the server is configured to detect the presence of a second face in the video frame and, while the presence of the second face is detected, the kiosk is configured to blur the video.

13. The system of claim 1 , wherein the server is configured to record video in a tele-medical session mode wherein the blurring the video being transmitted to the destination is not performed when the check determines that the face is not present in the frame.

14. The system of claim 1 , further comprising a plurality of kiosks located at the secure facility, wherein the server is configured to receive a request for a resident from a caller outside the secure facility, identify one of the plurality of kiosks that is located in an area the resident is housed in using a schedule of the resident, and activate the identified one of the plurality of kiosks to play an alert tone and display the resident's name.

15. A kiosk for providing facility services in a secure manner, comprising:

a computer processor;

a memory connected to the processor via a bus;

a camera connected to the bus for inputting video communications;

a microphone connected to the bus for inputting audio communications;

a speaker connected to the bus;

a touchscreen display connected to the bus; and

a network interface connected to the bus for communicating with a server via a network connection,

wherein the kiosk authenticates a user by receiving personal log in information and comparing the received personal log in information against a known personal log in information associated with the user, verifies the user's identity using a biometric verification, records audio and video communications and transmits the audio and video communications to the server, and provides access to internet web pages via a web proxy, and

wherein, after the user has been authenticated and during the transmission of the video, the kiosk is configured to periodically extract a frame of the video and perform a check to determine if a face is present in the frame, and the kiosk is further configured to blur video being transmitted to a destination when the check determines that the face is not present in the frame.

16. The kiosk of claim 15 , wherein the kiosk provides the user with at least one of: access to audio, video, and text of educational material; access to audio, video, and text of religious material; the ability to order items from a list of commissary items; the ability to reserve times for using the kiosk; and the ability to send text messages to third parties.

17. The kiosk of claim 15 , wherein the personal log in information is a personal identification number.

18. The kiosk of claim 15 , wherein the biometric verification comprises a facial authentication of an image captured by the camera.

19. The kiosk of claim 15 , wherein the biometric verification comprises a voice authentication of an audible phrase recorded using the microphone.

20. The kiosk of claim 15 , wherein the kiosk is configured to detect the presence of a second face in the video frame and, while the presence of the second face is detected, the kiosk is configured to blur the video.

21. The kiosk of claim 15 , wherein the kiosk is configured to record video in a tele-medical session mode wherein the blurring the video being transmitted to the destination is not performed when the check determines that the face is not present in the frame.

22. A method of monitoring use of an interactive kiosk during a video transmission, comprising:

authenticating the identity of a user of the kiosk by verifying log in information entered by the user and also performing a biometric verification;

using a camera of the kiosk to capture video of a user of the kiosk during use of the kiosk;

transmitting the video to a server;

periodically extracting, at the server, a frame of the video;

performing a check after the user identity has been authenticated by the kiosk and during the transmission of the video, at the server, to determine if a face is present during the frame; and

blurring the video transmission, at the server, to a destination if the check determines that the face is not present in the frame.

23. The method of claim 22 , further comprising:

detecting the presence of a second face in the video frame and, while the presence of the second face is detected, blurring the video transmission, at the server, to the destination.

24. A system for providing services to a secure facility, the system comprising:

a plurality of kiosks located at a secure facility, each kiosk comprising a processor, display, speaker, and microphone; and

a server that communicates with the kiosks and a device of an outside party via one or more network connections, the server comprising a server processor, a network interface unit, and a computer memory;

wherein the server is configured to receive a communications request from the device of the outside party and, in response to the received communications request, identify a kiosk in a vicinity of a requested party and transmit a message to the kiosk,

wherein the kiosk is configured to receive the message, and, upon receipt of the message, display an incoming communications request message and initiate a login procedure,

wherein the server is configured to authenticate a user of the device, and

wherein, after the user has been authenticated and during a transmission of a video, the video being transmitted from the kiosk to the calling party, the server is configured to periodically extract a frame of the video; and perform a check to determine if a face is present in the frame, and the server is further configured to blur the video being transmitted to the calling party when the check determines that the face is not present in the frame.

25. The system of claim 24 , wherein the communications request is a request to initiate a voice call or a video call.

26. The system of claim 24 , wherein the server identifies the kiosk in the vicinity of the requesting party by referencing a resident schedule that is stored on a computer readable medium of the server.

27. The system of claim 24 , wherein the kiosk is configured to play an alert tone or audio message upon receiving the message.

28. The system of claim 24 , wherein the server is configured to detect the presence of a second face in the video frame and, while the presence of the second face is detected, the server is configured to blur the video being transmitted to the calling party.

29. The system of claim 24 , wherein the server is configured to receive a request for a resident from the device of outside party, identify one of the plurality of kiosks that is located in an area the resident is housed in using a schedule of the resident, and activate the identified one of the plurality of kiosks to play an alert tone and display the resident's name.

Assignments (10)
PATENT SECURITY AGREEMENT Recorded Aug 7, 2024
From: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC; 3V TECHNOLOGIES INCORPORATED
To: TEXAS CAPITAL BANK, AS COLLATERAL AGENT
Reel/Frame 068510/0764 →
RELEASE OF SECURITY INTEREST Recorded Aug 6, 2024
From: UBS AG CAYMAN ISLANDS BRANCH (AS SUCCESSOR IN INTEREST TO CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH)
To: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC
Reel/Frame 069177/0067 →
RELEASE OF SECURITY INTEREST Recorded Aug 6, 2024
From: UBS AG CAYMAN ISLANDS BRANCH (AS SUCCESSOR IN INTEREST TO CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH)
To: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC
Reel/Frame 069175/0165 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2023
From: INTELMATE LLC
To: GLOBAL TEL*LINK CORPORATION
Reel/Frame 063419/0450 →
SECURITY INTEREST Recorded Dec 5, 2018
From: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 047720/0576 →
SECURITY INTEREST Recorded Dec 5, 2018
From: GLOBAL TEL*LINK CORPORATION; DSI-ITI, INC.; VALUE-ADDED COMMUNICATIONS, INC.; TOUCHPAY HOLDINGS, LLC; RENOVO SOFTWARE, INC.; INTELMATE LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 048788/0014 →
SECURITY INTEREST Recorded Jul 31, 2017
From: INTELMATE LLC
To: CREDIT SUISSE AG
Reel/Frame 043382/0128 →
SECURITY INTEREST Recorded Jul 31, 2017
From: INTELMATE LLC
To: CREDIT SUISSE AG
Reel/Frame 043382/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2015
From: TELMATE, LLC
To: INTELMATE LLC
Reel/Frame 036826/0294 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2011
From: TORGERSRUD, RICHARD; O'NEIL, KEVIN; GONGAWARE, GRANT; COLLINS, MORGAN
To: TELMATE, LLC
Reel/Frame 026144/0452 →
Continuity (1)
Related Publication 20120262271A1 · Oct 18, 2012