Systems and methods for determining types of references in content and mapping to particular applications
Systems and methods are provided herein for determining types of references within a content item and mapping them to particular applications. A content management application identifies an entity and a context of the entity at a location within the content item. The content management application may identify the entity and the context of the entity in real time as a first user device processes the content item, or the content management application may identify and store the entity and the context of the entity in a database before providing the content item. After determining a presence of a second user device associated with a profile, the content management application determines at least one application associated with the entity and the context of the entity on the second user device and launches the application to create an immersive content consumption experience.
1 . A computer-implemented method for providing an immersive content consumption experience for a profile, the method comprising:
providing a content item for a first user device associated with the profile;
identifying, using processing circuitry, an entity within a segment of the content item;
identifying, using the processing circuitry, a context of the entity within the segment of the content item;
identifying an action being performed within the segment of the content item with respect to the entity in relation to the context;
identifying, using the processing circuitry, and based at least in part on the entity and the context, a presence of a second user device associated with the profile that is physically in a vicinity to but is distinct from the first user device;
identifying, using the processing circuitry, and based on the entity and the context, at least one application installed on the second user device, wherein the at least one application can execute a particular action at the second user device corresponding to the identified action being performed within the segment of the content item, provided at the first user device, with respect to the entity in relation to the context; and
based at least in part on the identifying the presence of the second user device is physically in the vicinity but is distinct from the first user device, transmitting a command from the first user device to the second user device, the command from the first user device instructing the at least one application on the second user device to perform the particular action at the second user device by the at least one application.
2 . The method of claim 1 , wherein the identifying the entity within the segment of the content item and the identifying the context of the entity within the segment of the content item comprise processing the content item, while providing the content item, in real time to identify the entity within the segment of the content item and the context within the segment of the content item.
3 . The method of claim 2 , further comprising storing information, concurrently with processing and providing the content item, about the identified entity within the segment of the content item and about the identified context of the entity within the segment of the content item.
4 . The method of claim 2 , further comprising triggering, by a user action, the identifying the entity within the segment of the content item.
5 . The method of claim 1 , wherein the identifying the entity within the segment of the content item comprises accessing an identity of the entity from a storage device in which the identity of the entity was stored prior to the providing the content item.
6 . The method of claim 1 , wherein the identifying the entity within the segment of the content item further comprises at least one of processing closed captioning, using natural language processing on the content item, or using computer vision technique on the content item.
7 . The method of claim 1 , further comprising providing a selectable option on the first user device associated with the entity and the context.
8 . The method of claim 1 , wherein the identifying the presence of the second user device associated with the profile comprises determining the presence of an appliance associated with the profile.
9 . The method of claim 1 , wherein the identifying the presence of the second user device associated with the profile comprises detecting the second user device on a computer network shared with the first user device.
10 . The method of claim 1 , wherein the command is generated in a format recognizable by at least one of the second user device or the at least one application to perform the action.
11 . A system for providing an immersive content consumption experience for a profile, the system comprising:
a communication port; and
control circuitry communicably coupled to the communication port and configured to:
provide a content item for a first user device associated with the profile;
identify, using processing circuitry, an entity within a segment of the content item;
identify, using the processing circuitry, a context of the entity within the segment of the content item;
identify an action being performed within the segment of the content item with respect to the entity in relation to the context;
identify, using the processing circuitry, and based at least in part on the entity and the context, a presence of a second user device associated with the profile that is physically in a vicinity to but is distinct from the first user device;
identify, using the processing circuitry, and based on the entity and the context, at least one application installed on the second user device, wherein the at least one application can execute a particular action at the second user device corresponding to the identified action being performed within the segment of the content item, provided at the first user device, with respect to the entity in relation to the context; and
based at least in part on the identifying the presence of the second user device is physically in the vicinity but is distinct from the first user device, transmit, using the processing circuitry, a command from the first user device to the second user device, the command from the first user device instructing the at least one application on the second user device to perform the particular action at the second user device by the at least one application.
12 . The system of claim 11 , wherein the identifying the entity within the segment of the content item and the identifying the context of the entity within the segment of the content item comprise processing the content item, while providing the content item, in real time to identify the entity within the segment of the content item and the context within the segment of the content item.
13 . The system of claim 12 , further comprising storing information, concurrently with processing and providing the content item, about the identified entity within the segment of the content item and about the identified context of the entity within the segment of the content.
14 . The system of claim 12 , further comprising triggering, by a user action, the identifying the entity within the segment of the content item.
15 . The system of claim 11 , wherein the identifying the entity within the segment of the content item comprises accessing an identity of the entity from a storage device in which the identity of the entity was stored prior to the providing the content item.
16 . The system of claim 11 , wherein the identifying the entity within the segment of the content item further comprises at least one of processing closed captioning, using natural language processing on the content item, or using computer vision technique on the content item.
17 . The system of claim 11 , further comprising providing a selectable option on the first user device associated with the entity and the context.
18 . The system of claim 11 , wherein the identifying the presence of the second user device associated with the profile comprises determining the presence of an appliance associated with the profile.
19 . The system of claim 11 , wherein the identifying the presence of the second user device associated with the profile comprises detecting the second user device on a computer network shared with the first user device.
20 . The system of claim 11 , wherein the command is generated in a format recognizable by at least one of the second user device or the at least one application to perform the action.