IP Library › Granted Patent US 11,514,554
Granted Patent B2
US 11,514,554 · App. 17/205,129 · Granted Nov 29, 2022

Method to generate additional level of detail when zooming in on an image

Inventor: Michael Chen (Wallingford, PA)
Assignee: Comcast Cable Communications, LLC
G06T3/4053G06T11/001G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,514,554
App. No.
17/205,129
Granted
Nov 29, 2022
Kind
B2
Abstract

A viewer may zoom in on an image to see a portion of the image. The image may be analyzed to determine if zoom enhancement is necessary. The zoomed region may be matched to a replacement texture. The replacement texture may be used to enhance the image by replacing some or all of the image data.

Claims (96)

1. An apparatus comprising:

one or more processors; and

memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

receive an input indicative of a zoom region for an image;

determine a first characteristic of image data associated with the zoom region;

determine, based on the first characteristic, to enhance the zoom region;

determine, based on a second characteristic of the image data, a texture; and

modify, based on the texture, the image data.

2. The apparatus of claim 1 , wherein the first characteristic is:

a distance from a virtual camera to a virtual object; or

a measure of detail of the image data.

3. The apparatus of claim 1 , wherein the first characteristic is a zoom ratio based on a dimension of the zoom region and a dimension of the image, and

wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to determine the second characteristic based on the zoom ratio satisfying a zoom ratio threshold.

4. The apparatus of claim 1 , wherein the texture comprises vector data.

5. The apparatus of claim 1 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to modify the image data by replacing a portion of the image data with the texture.

6. The apparatus of claim 1 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to modify the image data by:

adjusting an opacity of the texture; and

combining the image data with the texture.

7. The apparatus of claim 1 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to determine the texture based on a zoom direction indicated by the received input.

8. The apparatus of claim 1 , wherein the second characteristic is a local binary pattern.

9. The apparatus of claim 1 , wherein the image is a frame of a video sequence, and

wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to determine the texture based on a content type associated with the video sequence.

10. A non-transitory computer-readable medium storing instructions that, when executed, cause:

receiving an input indicative of a zoom region for an image;

determining a first characteristic of image data associated with the zoom region;

determining, based on the first characteristic, to enhance the zoom region;

determining, based on a second characteristic of the image data, a texture; and

modifying, based on the texture, the image data.

11. The non-transitory computer-readable medium of claim 10 , wherein the first characteristic is:

a distance from a virtual camera to a virtual object; or

a measure of detail of the image data.

12. The non-transitory computer-readable medium of claim 10 , wherein the first characteristic is a zoom ratio based on a dimension of the zoom region and a dimension of the image, and

wherein the computer-readable instructions, when executed, cause the determining the second characteristic based on the zoom ratio satisfying a zoom ratio threshold.

13. The non-transitory computer-readable medium of claim 10 , wherein the texture comprises vector data.

14. The non-transitory computer-readable medium of claim 10 , wherein the computer-readable instructions, when executed, cause the modifying the image data by replacing a portion of the image data with the texture.

15. The non-transitory computer-readable medium of claim 10 , wherein the computer-readable instructions, when executed, cause the modifying the image data by:

adjusting an opacity of the texture; and

combining the image data with the texture.

16. The non-transitory computer-readable medium of claim 10 , wherein the computer-readable instructions, when executed, cause the determining the texture based on a zoom direction indicated by the received input.

17. The non-transitory computer-readable medium of claim 10 , wherein the second characteristic is a local binary pattern.

18. The non-transitory computer-readable medium of claim 10 , wherein the image is a frame of a video sequence, and

wherein the computer-readable instructions, when executed, cause the determining the texture based on a content type associated with the video sequence.

19. An apparatus comprising:

one or more processors; and

memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

determine, based on an input, a zoom region of an image;

determine image data associated with the zoom region;

segment, based on a first characteristic associated with an object included in the image data, the image data into a plurality of segments; and

modify, based on a second characteristic, a texture of each respective segment of the plurality of segments.

20. The apparatus of claim 19 , wherein the computer-readable instructions, when executed by the one or more processors, further cause the apparatus to:

select the texture from a texture database associated with the image or from a texture database containing textures derived from the image.

21. The apparatus of claim 19 , wherein the computer-readable instructions, when executed by the one or more processors, further cause the apparatus to:

search a texture database for textures corresponding to the second characteristic; and

select the texture from the textures corresponding to the second characteristic.

22. A non-transitory computer-readable medium storing instructions that, when executed, cause:

determining, based on an input, a zoom region of an image;

determining image data associated with the zoom region;

segmenting, based on a first characteristic associated with an object included in the image data, the image data into a plurality of segments; and

modifying, based on a second characteristic, a texture of each respective segment of the plurality of segments.

23. The non-transitory computer-readable medium of claim 22 , wherein the computer-readable instructions, when executed, further cause:

selecting the texture from a texture database associated with the image or from a texture database containing textures derived from the image.

24. The non-transitory computer-readable medium of claim 22 , wherein the computer-readable instructions, when executed, further cause:

searching a texture database for textures corresponding to the second characteristic; and

selecting the texture from the textures corresponding to the second characteristic.

25. An apparatus comprising:

one or more processors; and

memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

determine a first texture associated with a virtual object in a three-dimensional scene;

select, from a texture database and based on the first texture, a second texture;

generate, based on the first texture and the second texture, a third texture; and

map the third texture to the virtual object.

26. The apparatus of claim 25 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to select the second texture based on:

a distance from a virtual camera to the virtual object; or

metadata associated with the three-dimensional scene.

27. The apparatus of claim 25 , wherein the computer-readable instructions, when executed by the one or more processors, further cause the apparatus to:

generate, based on the first texture, a generated texture; and

add the generated texture to the texture database.

28. The apparatus of claim 27 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to select the second texture from the texture database by selecting the generated texture from the texture database.

29. The apparatus of claim 25 , wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to generate the third texture based on a scaled vector representation of the first texture.

30. A system comprising:

a first computing device; and

a second computing device,

wherein the first computing device is configured to send, to the second computing device, a video signal comprising a three-dimensional scene, and

wherein the second computing device is configured to:

determine a first texture associated with a virtual object in the three-dimensional scene;

select, from a texture database and based on the first texture, a second texture;

generate, based on the first texture and the second texture, a third texture; and

map the third texture to the virtual object.

31. The system of claim 30 , wherein the second computing device is configured to select the second texture based on:

a distance from a virtual camera to the virtual object; or

metadata associated with the three-dimensional scene.

32. The system of claim 30 , wherein the second computing device is further configured to:

generate, based on the first texture, a generated texture; and

add the generated texture to the texture database.

33. The system of claim 32 , wherein the second computing device is configured to select the second texture from the texture database by selecting the generated texture from the texture database.

34. The system of claim 30 , wherein the second computing device is configured to generate the third texture based on a scaled vector representation of the first texture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: CHEN, MICHAEL
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 056054/0650 →
Continuity (3)
Continuation 16751055 · Jan 23, 2020
Continuation 15818158 · Nov 20, 2017
Related Publication 20210272238A1 · Sep 2, 2021