Systems and methods for provisioning content using barrel projection representation
Systems, methods, and non-transitory computer-readable media can determine at least one salient point of interest in a frame of a content item based at least in part on a saliency prediction model, the saliency prediction model being trained to identify salient points of interest that appear in content items; determine a barrel projection representation for the frame; and apply a view-based projection to the barrel projection representation for the frame, wherein the view-based projection enhances a quality in which a region corresponding to the at least one salient point of interest is presented.
1. A computer-implemented method comprising:
determining, by a computing system, at least one salient point of interest in a frame of a content item based at least in part on a saliency prediction model, the saliency prediction model being trained to identify salient points of interest that appear in content items;
generating, by the computing system, a barrel projection representation for the frame, wherein the barrel projection representation comprises portions including a circular top portion, a circular bottom portion, and a middle portion, wherein each of the portions includes at least one pixel of the frame; and
applying, by the computing system, a view-based projection to the barrel projection representation for the frame, wherein the view-based projection enhances a quality in which a region corresponding to the at least one salient point of interest is presented.
2. The computer-implemented method of claim 1 , wherein the plurality of distinct portions comprises a top portion of the frame associated with a first circular projection, a bottom portion of the frame associated with a second circular projection, and a middle portion of the frame associated with a rectangular projection.
3. The computer-implemented method of claim 2 , wherein the middle portion of the frame represents a middle 90 degrees field-of-view of a scene represented in the frame.
4. The computer-implemented method of claim 2 , wherein applying the view-based projection to the barrel projection representation of the frame further comprises:
increasing, by the computing system, a pixel density associated with a region in the middle portion of the frame that corresponds to the at least one salient point of interest.
5. The computer-implemented method of claim 4 , wherein the region is stretched horizontally by a threshold amount.
6. The computer-implemented method of claim 2 , wherein applying the view-based projection to the barrel projection representation of the frame further comprises:
decreasing, by the computing system, respective pixel densities associated with one or more other regions in the middle portion of the frame.
7. The computer-implemented method of claim 6 , wherein the quality is enhanced in a portion of the plurality of distinct portions in the region.
8. A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
determining at least one salient point of interest in a frame of a content item based at least in part on a saliency prediction model, the saliency prediction model being trained to identify salient points of interest that appear in content items;
generating a barrel projection representation for the frame, wherein the barrel projection representation comprises portions including a circular top portion, a circular bottom portion, and a middle portion, wherein each of the portions includes at least one pixel of the frame; and
applying a view-based projection to the barrel projection representation for the frame, wherein the view-based projection enhances a quality in which a region corresponding to the at least one salient point of interest is presented.
9. The system of claim 8 , wherein the plurality of distinct portions comprises a top portion of the frame associated with a first circular projection, a bottom portion of the frame associated with a second circular projection, and a middle portion of the frame associated with a rectangular projection.
10. The system of claim 9 , wherein the middle portion of the frame represents a middle 90 degrees field-of-view of a scene represented in the frame.
11. The system of claim 9 , wherein applying the view-based projection to the barrel projection representation of the frame further causes the system to perform:
increasing a pixel density associated with a region in the middle portion of the frame that corresponds to the at least one salient point of interest.
12. The system of claim 11 , wherein the region is stretched horizontally by a threshold amount.
13. The system of claim 9 , wherein applying the view-based projection to the barrel projection representation of the frame further causes the system to perform:
decreasing respective pixel densities associated with one or more other regions in the middle portion of the frame.
14. The system of claim 11 , wherein the quality is enhanced in a portion of the plurality of distinct portions in the region.
15. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:
determining at least one salient point of interest in a frame of a content item based at least in part on a saliency prediction model, the saliency prediction model being trained to identify salient points of interest that appear in content items;
generating a barrel projection representation for the frame, wherein the barrel projection representation comprises portions including a circular top portion, a circular bottom portion, and a middle portion, wherein each of the portions includes at least one pixel of the frame; and
applying a view-based projection to the barrel projection representation for the frame, wherein the view-based projection enhances a quality in a portion of the plurality of distinct portions in which a region corresponding to the at least one salient point of interest is presented.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the plurality of distinct portions comprises a top portion of the frame associated with a first circular projection, a bottom portion of the frame associated with a second circular projection, and a middle portion of the frame associated with a rectangular projection.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the middle portion of the frame represents a middle 90 degrees field-of-view of a scene represented in the frame.
18. The non-transitory computer-readable storage medium of claim 16 , wherein applying the view-based projection to the barrel projection representation of the frame further causes the computing system to perform:
increasing a pixel density associated with a region in the middle portion of the frame that corresponds to the at least one salient point of interest.
19. The non-transitory computer-readable storage medium of claim 16 , wherein applying the view-based projection to the barrel projection representation of the frame further causes the system to perform:
decreasing respective pixel densities associated with one or more other regions in the middle portion of the frame.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the applying the view-based projection to the barrel projection representation for the frame enhances the quality in the portion of the plurality of distinct portions by allocating increased number of pixels to the region.