Method for detecting display screen boundaries
A computer-implemented method for detecting a display screen using an extended reality display device, comprising receiving, at the extended reality display device, an image, or data defining an image, corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points, monitoring a display screen that is displaying the video stream, detecting at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen, and determining, based on the detected specified feature points, the physical boundaries of the display screen.
1 . A computer-implemented method for detecting a display screen using an extended reality display device, comprising:
receiving, at the extended reality display device, an image corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points;
receiving, at the extended reality display device, data from a game data stream associated with the video stream;
monitoring a display screen that is displaying the video stream;
detecting, using image tracking, at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen; and
determining, based on the data received from the game data stream and a known location of each detected specified feature points relative to at least one physical boundary of the display screen, the physical boundaries of the display screen.
2 . The computer-implemented method of claim 1 , further comprising:
determining, based on the detected specified feature points, an orientation and a location of the display screen.
3 . The computer-implemented method of claim 1 , wherein determining, based on the detected specified feature points, the physical boundaries of the display screen, comprises:
comparing the detected specified feature points to the image corresponding to the predetermined frame of the video stream.
4 . The computer-implemented method of claim 1 , wherein, in response to the extended reality display device failing to detect a sufficient number of the specified feature points to enable the physical boundaries of the display screen to be detected, the method comprises outputting a notification from the extended reality display device.
5 . The computer-implemented method of claim 1 , comprising receiving, at the extended reality display device, a plurality of images, each image corresponding to one of a plurality of predetermined frames of the video stream, each predetermined frame comprising a respective plurality of specified feature points.
6 . The computer-implemented method of claim 5 , wherein in response to the extended reality display device failing to detect a sufficient number of the specified feature points in a first one of the plurality of predetermined frames to enable the physical boundaries of the display screen to be determined, the method comprises receiving a second image corresponding to a second predetermined frame of the video stream.
7 . The computer-implemented method of claim 6 , comprising:
detecting at least some of the plurality of specified feature points in the second predetermined frame of the video stream as displayed on the display screen; and
determining, based on the detected specified feature points of the second predetermined frame, the physical boundaries of the display screen.
8 . The computer-implemented method of claim 1 , wherein in response to the extended reality display device failing to determine the physical boundaries of the display screen, the method comprises:
receiving at the extended reality display device a test image, the test image comprising a plurality of specified feature points;
detecting at least some of the plurality of specified feature points in the test image as displayed on the display screen; and
determining, based on the detected specified feature points in the test image, the physical boundaries of the display screen.
9 . The computer-implemented method of claim 1 , wherein the video stream is a video game or a computer game.
10 . The computer-implemented method of claim 1 , further comprising:
providing the determined physical boundaries of the display screen to one or more electronic devices operably connected to the extended reality display device via a communication network.
11 . The computer-implemented method of claim 1 , wherein the extended reality display device and the display screen are in communication with a plurality of electronic devices via a communication network, the method further comprising:
communicating with the plurality of electronic devices to determine if the physical boundaries of the display screen are known by any of the plurality of electronic devices.
12 . The computer-implemented method of claim 1 , further comprising:
generating one or more virtual boundaries aligned with or overlapping with the determined physical boundaries of the display screen.
13 . The computer-implemented method of claim 12 , wherein:
the one or more virtual boundaries are fixed relative to the respective physical boundaries of the display screen; and/or
the one or more virtual boundaries provide a virtual representation of the physical boundaries of the display screen within a virtual environment created by the extended reality display device.
14 . A device comprising:
a display;
a processor; and
a memory including executable instructions that, as a result of execution by the processor, causes the device to:
receive, at the device, an image corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points;
receive, at the device, data from a game data stream associated with the video stream;
monitor the display that is displaying the video stream;
detect, using image tracking, at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display; and
determine, based on the data received from the game data stream and a known location of each detected specified feature points relative to at least one physical boundary of the display, the physical boundaries of the display.
15 . The device of claim 14 , wherein the device is an augmented reality, AR, headset.
16 . A system comprising:
a display screen;
a computing device; and
an extended reality display device, wherein the display screen, the computing device and the extended reality display device are operably connected by a communication network, and wherein the extended reality display device comprises:
a processor; and
a memory including executable instructions that, as a result of execution by the processor, causes the extended reality display device:
receive, at the extended reality display device, an image corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points;
receive, at the extended reality display device, data from a game data stream associated with the video stream;
monitor a display screen that is displaying the video stream;
detect, using image tracking, at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen; and
determine, based on the data received from the game data stream and a known location of each detected specified feature points relative to at least one physical boundary of the display screen, the physical boundaries of the display screen.