IP Library Granted Patent US 9,953,301
Granted Patent B2
US 9,953,301 · App. 14/180,472 · Granted Apr 24, 2018

Searchable screen sharing sessions

Inventors: Anand Shyam Rohra (San Francisco, CA); Igor Morozov (San Francisco, CA)
Assignee: salesforce.com, Inc.
G06Q10/103G06F17/30713G06F3/0481G06F17/3005G06F17/3089G06F17/30722G06Q10/101H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,953,301
App. No.
14/180,472
Granted
Apr 24, 2018
Kind
B2
Abstract

Systems and methods are provided for searchable screen sharing sessions. A system records at least one image associated with a screen sharing session. The system extracts content from the at least one image. The system stores the content as searchable content associated with the screen sharing session.

Claims (66)

1. An apparatus for searchable screen sharing sessions, the apparatus comprising:

a processor; and

one or more stored sequences of instructions which, when executed by the processor, cause the processor to:

record at least one image associated with a screen sharing session;

extract text and non-text graphical content from the at least one image;

generate metadata based on the extracted non-text graphical content, the generated metadata identifying the screen sharing session that includes the extracted non-text content as being associated with one or more enterprises;

associate the generated metadata with the screen sharing session and the one or more enterprises;

store the text content and the generated metadata as searchable content associated with the screen sharing session;

output at least one of the text content, the non-text graphical content and the screen sharing session metadata in response to a query based on at least one of the text content, the non-text graphical content and the screen sharing session metadata.

2. The apparatus of claim 1 , wherein the one or more stored sequences of instructions further cause the processor to:

record audio associated with the screen sharing session;

extract audio-based content from the audio recording;

store the audio-based content as searchable audio-based content associated with the screen sharing session.

3. The apparatus of claim 2 , wherein the one or more stored sequences of instructions further cause the processor to:

generate semantic information based on applying natural language processing to the text content; and

store the generated semantic information as searchable semantic information associated with the screen sharing session.

4. The apparatus of claim 3 , wherein the one or more stored sequences of instructions further cause the processor to output a transcript associated with the screen sharing session based on at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information.

5. The apparatus of claim 3 , wherein the one or more stored sequences of instructions further cause the processor to output at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information in response to a query based on at least one of the text content, the non-text graphical content, screen sharing session metadata, the audio-based content, and the generated semantic information.

6. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein to be executed by one or more processors, the program code including instructions to:

record at least one image associated with a screen sharing session;

extract text and non-text graphical content from the at least one image;

generate metadata based on the extracted non-text graphical content, the generated metadata identifying the screen sharing session that includes the extracted non-text content as being associated with one or more enterprises;

associate the generated metadata with the screen sharing session and the one or more enterprises;

store the text content and the generated metadata as searchable content associated with the screen sharing session; and

output at least one of the text content, the non-text graphical content and the screen sharing session metadata in response to a query based on at least one of the text content, the non-text graphical content and the screen sharing session metadata.

7. The computer program product of claim 6 , wherein the program code includes further instructions to:

record audio associated with the screen sharing session;

extract audio-based content from the audio recording; and

store the audio audio-based content as searchable audio-based content associated with the screen sharing session.

8. The computer program product of claim 6 , wherein the program code includes further instructions to:

generate semantic information based on applying natural language processing to the text content; and

store the generated semantic information as searchable semantic information associated with the screen sharing session.

9. The computer program product of claim 8 , wherein the program code includes further instructions to output a transcript associated with the screen sharing session based on at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information.

10. The computer program product of claim 8 , wherein the program code includes further instructions to output at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information in response to a query based on at least one of the text content, the non-text graphical content, screen sharing session metadata, the audio-based content, and the generated semantic information.

11. A method for searchable screen sharing sessions, the method comprising:

recording, by a processor of a computing device, at least one image associated with a screen sharing session;

extracting, by the processor of a computing device, text and non-text content from the at least one image;

generating metadata based on the extracted non-text graphical content, the generated metadata identifying the screen sharing session that includes the extracted non-text content as being associated with one or more enterprises;

associating the generated metadata with the screen sharing session and the one or more enterprises;

storing, by the processor of a computing device, the text content and the generated metadata as searchable content associated with the screen sharing session; and

outputting, by the processor, at least one of the text content, the non-text graphical content and the screen sharing session metadata in response to a query based on at least one of the text content, the non-text graphical content and the screen sharing session metadata.

12. The method of claim 11 , the method further comprising:

recording, by the processor of a computing device, audio associated with the screen sharing session;

extracting, by the processor of a computing device, audio-based content from the audio recording; and

storing, by the processor of a computing device, the audio audio-based content as searchable audio-based content associated with the screen sharing session.

13. The method of claim 11 , the method further comprising:

generating, by the processor of a computing device, semantic information based on applying natural language processing to the text content; and

storing, by the processor of a computing device, the generated semantic information as searchable semantic information associated with the screen sharing session.

14. The method of claim 13 , the method further comprising outputting, by the processor of a computing device, a transcript associated with the screen sharing session based on at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information.

15. The method of claim 13 , the method further comprising outputting, by the processor of a computing device, at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information in response to a query based on at least one of the text content, the non-text graphical content, screen sharing session metadata, the audio-based content, and the generated semantic information.

16. A method for transmitting code for searchable screen sharing sessions, the method comprising:

transmitting code to record at least one image associated with a screen sharing session;

transmitting code to extract text and non-text graphical content from the at least one image;

transmitting code to generate metadata based on the extracted non-text graphical content, the generated metadata identifying the screen sharing session that includes the extracted non-text content as being associated with one or more enterprises;

transmitting code to associate the generated metadata with the screen sharing session and the one or more enterprises;

transmitting code to store the text content and the generated metadata as searchable content associated with the screen sharing session; and

transmitting code to output at least one of the text content, the non-text graphical content and the screen sharing session metadata in response to a query based on at least one of the text content, the non-text graphical content and the screen sharing session metadata.

17. The method for transmitting code of claim 16 , the method further comprising:

transmitting code to record audio associated with the screen sharing session;

transmitting code to extract audio-based content from the audio recording; and

transmitting code to store the audio audio-based content as searchable audio-based content associated with the screen sharing session.

18. The method for transmitting code of claim 16 , the method further comprising:

transmitting code to generate semantic information based on applying natural language processing to the text content; and

transmitting code to store the generated semantic information as searchable semantic information associated with the screen sharing session.

19. The method for transmitting code of claim 18 , the method further comprising transmitting code to output a transcript associated with the screen sharing session based on at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information.

20. The method for transmitting code of claim 18 , the method further comprising transmitting code to output at least one of the text content, the non-text graphical content, audio-based content, and generated semantic information in response to a query based on at least one of the text content, the non-text graphical content, screen sharing session metadata, the audio-based content, and the generated semantic information.

Assignments (2)
CHANGE OF NAME Recorded Sep 20, 2023
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 064974/0185 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2014
From: ROHRA, ANAND SHYAM; MOROZOV, IGOR
To: SALESFORCE.COM, INC.
Reel/Frame 032218/0637 →
Continuity (2)
Provisional Application 61807868 · Apr 3, 2013
Related Publication 20140304216A1 · Oct 9, 2014