Granted Patent B2

US 12,236,919 · App. 17/212,457 · Granted Feb 25, 2025

Inventors: Naveen Kolati (Bangalore, IN); Sreekanth Majji (Bangalore, IN); Ravi Surana (Bangalore, IN); Vinayak Goyal (Bangalore, IN)

Assignee: Samsung Electronics Co., Ltd.

G09G5/14G06F3/013G09G3/003H04L1/08H04L43/0829G09G2354/00G09G2370/10

Abstract

Claims (54)

1. A method of managing image data packets, the method comprising:

receiving an image divided into a plurality of segments;

identifying a segment which a user is looking at, from among the plurality of segments;

determining whether at least one data packet is lost in the segment which the user is looking at; and

based on determining that the at least one data packet in the segment is lost, requesting to retransmit only the lost at least one data packet in the segment that the user is looking at, without requesting retransmission of lost data packets in segments that the user is not looking at,

wherein the identifying of the segment which the user is looking at, from among the plurality of segments, comprises:

determining a viewport at which the user is looking; and

identifying a segment to which the determined viewport belongs, from among the plurality of segments,

when the determined viewport belongs to two or more segments, further dividing each of the plurality of segments into a plurality of sub-segments; and

identifying a sub-segment to which the viewport belongs, from among the plurality of sub-segments,

wherein the determining of whether the at least one data packet is lost in the segment, which the user is looking at, comprises determining whether there is a loss in at least one data packet in the identified sub-segment, and

wherein, based on determining that the at least one data packet in the sub-segment is lost, the requesting to retransmit the lost at least one data packet in the segment which the user is looking at comprises requesting to retransmit the lost at least one data packet in the sub-segment, which the user is looking at.

2. The method of claim 1 , further comprising sharing with a sender of the image a number of the plurality of segments and each of segment identifiers respectively allocated to the plurality of segments.

3. The method of claim 2 , wherein the segment identifiers comprise at least one of a synchronization source identifier for synchronization between a sending device and a receiving device of the data packet, a payload type, or a packet identifier in a data header field.

4. The method of claim 1 , further comprising receiving, in response to the requesting, a retransmitted data packet corresponding to the lost at least one data packet.

5. The method of claim 1 , wherein the plurality of segments are independently decodable.

6. The method of claim 1 , wherein the determining of the viewport comprises determining the viewport based on a viewing angle of a gaze of the user, a gaze direction of the user, and a segment identifier allocated to each of the plurality of segments.

7. The method of claim 1 , wherein the requesting to retransmit the lost at least one data packet comprises transmitting a packet identifier of the lost at least one data packet.

8. The method of claim 7 , wherein the requesting to retransmit the lost at least one data packet further comprises transmitting an identifier of a segment to which the lost at least one data packet belongs.

9. The method of claim 1 , further comprising periodically receiving an entire image that the user is to look at.

10. An image display apparatus comprising:

an input/output (I/O) interface through which an image divided into a plurality of segments is received;

a display configured to display the image divided into the plurality of segments; and

a processor configured to:

identify a segment which a user is looking at, from among the plurality of segments,

determine whether at least one packet data is lost in the segment, which the user is looking at, and

based on determining that the at least one data packet is lost in the segment, request to retransmit only the lost at least one data packet in the segment that the user is looking at, without requesting retransmission of lost data packets in segments that the user is not looking at,

wherein the processor is further configured, when identifying, by the processor, of the segment which the user is looking at, to:

determine a viewport at which the user is looking; and

identify the segment to which the determined viewport belongs, from among the plurality of segments,

wherein the processor is further configured to:

when the determined viewport belongs to two or more segments, further divide each of the plurality of segments into a plurality of sub-segments; and

identifying a sub-segment to which the viewport belongs, from among the plurality of sub-segments,

wherein the determining of whether the at least one data packet is lost in the segment, which the user is looking at, comprises determining whether there is a loss in at least one data packet in the identified sub-segment, and

wherein, based on determining that the at least one data packet in the sub-segment is lost, the requesting to retransmit the lost at least one data packet in the segment which the user is looking at comprises requesting to retransmit the lost at least one data packet in the sub-segment, which the user is looking at.

11. The image display apparatus of claim 10 , wherein the I/O interface is configured to share with a sender sending the image, a number of the plurality of segments and each of segment identifiers respectively allocated to the plurality of segments.

12. The image display apparatus of claim 10 , wherein the I/O interface is configured to receive, in response to the requesting by the processor, a retransmitted data packet corresponding to the lost at least one data packet.

13. The image display apparatus of claim 10 , wherein the image display apparatus comprises a head mounted device.

14. A non-transitory computer readable medium having recorded thereon a program, which when executed by at least one processor, performs a method of managing image data packets, the method comprising:

receiving an image divided into a plurality of segments;

identifying a segment, which a user is looking at, from among the plurality of segments;

determining whether at least one data packet is lost in the segment, which the user is looking at; and

based on determining that the at least one data packet is lost in the segment, requesting to retransmit only the lost at least one data packet in the segment, which the user is looking at, without requesting retransmission of lost data packets in segments that the user is not looking at,

wherein the identifying of the segment which the user is looking at, from among the plurality of segments, comprises:

determining a viewport at which the user is looking; and

identifying a segment to which the determined viewport belongs, from among the plurality of segments,

when the determined viewport belongs to two or more segments, further dividing each of the plurality of segments into a plurality of sub-segments; and

identifying a sub-segment to which the viewport belongs, from among the plurality of sub-segments,

wherein the determining of whether the at least one data packet is lost in the segment, which the user is looking at, comprises determining whether there is a loss in at least one data packet in the identified sub-segment, and

wherein, based on determining that the at least one data packet in the sub-segment is lost, the requesting to retransmit the lost at least one data packet in the segment which the user is looking at comprises requesting to retransmit the lost at least one data packet in the sub-segment, which the user is looking at.

15. The non-transitory computer readable medium of claim 14 , wherein, when the lost at least one data packet is greater than one packet, the request to retransmit the lost at least one data packet in the segment comprises an identifier for each of the lost at least one data packet.

16. The non-transitory computer readable medium of claim 14 , the method further comprising:

based on the determining that the at least one data packet is lost outside the segment, which the user is looking at, ignoring the lost at least one data packet outside the segment.

17. The non-transitory computer readable medium of claim 14 , wherein, a number of segments of the plurality of segments is received prior to the receiving of the receiving of the image divided into the plurality of segments.

Assignments (1)

Priority Claims (2)

Continuity (1)

References Cited (35)