IP Library › Granted Patent US 12,217,385
Granted Patent B2
US 12,217,385 · App. 17/575,304 · Granted Feb 4, 2025

Image processing device, method and computer-readable storage medium to determine resolution of processed regions

Inventors: Tiankuo Shi (Beijing, CN); Xiaomang Zhang (Beijing, CN); Xuefeng Wang (Beijing, CN); Bin Dai (Beijing, CN); Lingyun Shi (Beijing, CN); Wei Sun (Beijing, CN); Bo Gao (Beijing, CN); Yue Li (Beijing, CN)
Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
G06T3/4038G06T7/11G06V40/18G06T2207/20021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,385
App. No.
17/575,304
Filed
Jan 13, 2022
Granted
Feb 4, 2025
Kind
B2
Examiner
LE, MICHAEL
Art Unit
2614
USPC
345/471
Abstract

An image display method, an image processing method, an image processing device, a display system, and a computer-readable storage medium are disclosed. The image processing method is applied to an image processing device and includes: determining a first region in an original image; performing first processing on the first region in the original image to obtain a first processed region; performing second processing on the original image to obtain a second processed region; generating a first image based on the first processed region and the second processed region. A resolution of the first processed region is greater than a resolution of the second processed region.

Claims (67)

1. An image processing method, applied to an image processing device and comprising:

determining a first region in an original image;

performing first processing on the first region in the original image to obtain a first processed region;

performing second processing on the original image to obtain a second processed region;

generating a first image based on the first processed region and the second processed region;

outputting the first image to a display device;

wherein a resolution of the first processed region is greater than a resolution of the second processed region;

wherein the image processing method further comprises:

determining a plurality of boundary pixels in the original image based on a position of the first region in the original image, wherein the first region is a region defined by the plurality of boundary pixels in the original image, performing mapping processing on coordinate values of the plurality of boundary pixels to convert the coordinate values of the plurality of boundary pixels into a value interval corresponding to grayscale values of pixels in the first image to obtain a plurality of labeled pixel data; or

determining at least one labeled pixel in the original image based on a position of the first region in the original image; performing mapping processing on a coordinate value of the at least one labeled pixel and size information of the first region to convert the coordinate value of the at least one labeled pixel and the size information of the first region into a value interval corresponding to grayscale values of pixels in the first image to obtain a plurality of labeled pixel data;

wherein the plurality of labeled pixel data is used to represent the position of the first region in the original image and is not used for display, and the first image comprises at least one pixel whose grayscale value is the plurality of labeled pixel data.

2. The image processing method according to claim 1 , wherein performing the second processing on the original image to obtain the second processed region comprises:

determining a region other than the first region in the original image to obtain a second region;

performing the second processing on the second region to obtain the second processed region.

3. The image processing method according to claim 2 , wherein the first processing comprises up-scaling processing or not processing, the second processing comprises down-scaling processing or not processing, performing the second processing on the second region comprises: performing down-scaling processing on the second region.

4. The image processing method according to claim 1 , wherein performing the second processing on the original image to obtain the second processed region comprises:

analyzing the original image to obtain at least one image block;

performing the second processing on the at least one image block to obtain the second processed region.

5. The image processing method according to claim 4 , wherein a region other than the first region in the original image is a second region, analyzing the original image to obtain at least one image block comprises:

dividing the second region into a plurality of image blocks that do not overlap with each other;

performing the second processing on the at least one image block to obtain the second processed region comprises:

rearranging the plurality of image blocks to generate a rearrangement region, wherein a shape of the rearrangement region is a rectangle;

performing the second processing on the rearrangement region to obtain the second processed region.

6. The image processing method according to claim 4 , wherein the at least one image block comprises the original image;

performing the second processing on the at least one image block to obtain the second processed region comprises:

directly performing the second processing on the original image to obtain the second processed region.

7. The image processing method according to claim 4 , wherein a shape of the first processed region and a shape of the second processed region are both rectangular, a size of at least one side of the first processed region is identical with a size of at least one side of the second processed region, respectively.

8. The image processing method according to claim 1 , wherein a shape of the first region is a rectangle, a rhombus, a circle, an ellipse, or a triangle.

9. The image processing method according to claim 1 , wherein a shape of the second processed region is a rectangle,

generating the first image based on the first processed region and the second processed region comprises:

determining a to-be-transmitted region based on the first processed region and the second processed region, wherein the to-be-transmitted region comprises the first processed region, a shape of the to-be-transmitted region is a rectangle, and a size of at least one side of the to-be-transmitted region is identical with a size of at least one side of the second processed region;

generating the first image based on the to-be-transmitted region and the second processed region; or

generating the first image based on the first processed region and the second processed region comprises:

determining a to-be-transmitted region based on the first processed region and the second processed region, wherein the to-be-transmitted region comprises the second processed region, a shape of the to-be-transmitted region is a rectangle, and a size of at least one side of the to-be-transmitted region is identical with a size of at least one side of the first processed region;

generating the first image based on the to-be-transmitted region and the first processed region.

10. The image processing method according to claim 1 , wherein performing the first processing on the first region in the original image to obtain the first processed region comprises: performing the first processing on the first region to obtain a plurality of first image pixel data corresponding to all pixels in the first region; obtaining the first processed region based on the plurality of labeled pixel data and the plurality of first image pixel data; or

performing the second processing on the original image to obtain the second processed region comprises: performing the second processing on the original image to obtain a plurality of second image pixel data corresponding to at least some pixels of the original image; obtaining the second processed region based on the plurality of labeled pixel data and the plurality of second image pixel data; or

generating the first image based on the first processed region and the second processed region, comprises: generating the first image based on the plurality of labeled pixel data, the first processed region and the second processed region.

11. The image processing method according to claim 1 , further comprising:

performing mapping processing on a processing parameter corresponding to the second processing to obtain at least one parameter pixel data.

12. The image processing method according to claim 11 , wherein performing the first processing on the first region in the original image to obtain the first processed region comprises: performing the first processing on the first region to obtain a plurality of first image pixel data corresponding to all pixels in the first region; obtaining the first processed region based on the plurality of labeled pixel data, the at least one parameter pixel data, and the plurality of first image pixel data; or

performing the second processing on the original image to obtain the second processed region comprises: performing the second processing on the original image to obtain a plurality of second image pixel data corresponding to at least some pixels of the original image; obtaining the second processed region based on the plurality of labeled pixel data, the at least one parameter pixel data, and the plurality of second image pixel data; or

generating the first image based on the first processed region and the second processed region, comprises: generating the first image based on the plurality of labeled pixel data, the at least one parameter pixel data, the first processed region and the second processed region.

13. The image processing method according to claim 1 , wherein determining the first region in the original image comprises:

determining a target pixel in the original image;

determining the first region based on the target pixel and a distance threshold, wherein a distance between each pixel in the first region and the target pixel is less than or equal to the distance threshold; or

determining the first region in the original image comprises:

determining a target pixel in the original image;

determining that a region located in a predetermined shape with a predetermined size centered on the target pixel is the first region.

14. The image processing method according to claim 13 , wherein the target pixel is a preset pixel, or the target pixel is a gaze point of a human eye on the original image.

15. The image processing method according to claim 1 ,

wherein the display device performs analyzing processing on the first processed region by using a first analyzing algorithm and performs analyzing processing on the second processed region by using a second analyzing algorithm to obtain a second image, and the display device displays the second image.

16. The image processing method according to claim 15 , wherein a resolution corresponding to the first analyzing algorithm is greater than a resolution corresponding to the second analyzing algorithm.

17. An image processing device, comprising:

a memory, configured to storage computer-readable instructions non-transiently;

a processor, configured to run the computer-readable instructions, wherein when the computer-readable instructions are executed by the processor, the image processing method according to claim 1 is implemented.

18. An image processing method, applied to an image processing device and comprising:

determining a first region in an original image;

performing first processing on the first region in the original image to obtain a first processed region;

performing second processing on the original image to obtain a second processed region;

outputting the first processed region and the second processed region to a display device;

wherein a resolution of the first processed region is greater than a resolution of the second processed region;

wherein the image processing method further comprises:

determining a plurality of boundary pixels in the original image based on a position of the first region in the original image, wherein the first region is a region defined by the plurality of boundary pixels in the original image, performing mapping processing on coordinate values of the plurality of boundary pixels to convert the coordinate values of the plurality of boundary pixels into a value interval corresponding to grayscale values of pixels in the first image to obtain a plurality of labeled pixel data; or

determining at least one labeled pixel in the original image based on a position of the first region in the original image; performing mapping processing on a coordinate value of the at least one labeled pixel and size information of the first region to convert the coordinate value of the at least one labeled pixel and the size information of the first region into a value interval corresponding to grayscale values of pixels in the first image to obtain a plurality of labeled pixel data;

wherein the plurality of labeled pixel data is used to represent the position of the first region in the original image and is not used for display, and the plurality of labeled pixel data is a grayscale value of at least one pixel and is output to the display device together with the first processed region and the second processed region.

19. The image processing method according to claim 18 , wherein the display device performs analyzing processing on the first processed region by using a first analyzing algorithm to obtain a first to-be-displayed region, performs analyzing processing on the second processed region by using a second analyzing algorithm to obtain a second to-be-displayed region, and the display device displays the first to-be-displayed region and the second to-be-displayed region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: SHI, TIANKUO; ZHANG, XIAOMANG; WANG, XUEFENG; DAI, BIN; SHI, LINGYUN; SUN, WEI; GAO, BO; LI, YUE
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 058651/0123 →
Priority Claims (1)
CN 201710674693.6 · Aug 9, 2017 · national
Continuity (2)
Continuation In Part 16309355
Related Publication 20220138901A1 · May 5, 2022
References Cited (55)
US 10460676B2 · Yashiki · 2019 [cited by examiner]
US 10614549B2 · Berghoff · 2020 [cited by applicant]
US 10803829B2 · Harada · 2020 [cited by examiner]
US 10979676B1 · Kelly · 2021 [cited by examiner]
US 20020141614A1 · Lin · 2002 [cited by examiner]
US 20080290794A1 · Yuasa · 2008 [cited by applicant]
US 20090142000A1 · Sono · 2009 [cited by examiner]
US 20100225680A1 · Kido · 2010 [cited by applicant]
US 20110279457A1 · Song · 2011 [cited by examiner]
US 20120121209A1 · Li · 2012 [cited by examiner]
US 20120189221A1 · Inada · 2012 [cited by examiner]
US 20120268465A1 · Inada · 2012 [cited by applicant]
US 20140368494A1 · Sakharnykh et al. · 2014 [cited by applicant]
US 20150287165A1 · Berghoff · 2015 [cited by applicant]
US 20150371583A1 · Guo · 2015 [cited by examiner]
US 20160234488A1 · Zhao et al. · 2016 [cited by applicant]
US 20160267713A1 · Patel · 2016 [cited by examiner]
US 20160267884A1 · Binstock · 2016 [cited by examiner]
US 20160307297A1 · Akenine-Moller · 2016 [cited by examiner]
US 20170041502A1 · Fuse · 2017 [cited by examiner]
US 20170094163A1 · Ohba · 2017 [cited by examiner]
US 20170178408A1 · Bavor, Jr. et al. · 2017 [cited by applicant]
US 20170263190A1 · Yashiki · 2017 [cited by examiner]
US 20180047176A1 · Toyoda · 2018 [cited by examiner]
US 20180336660A1 · Gu · 2018 [cited by applicant]
US 20180336867A1 · Gu et al. · 2018 [cited by applicant]
US 20190355332A1 · Knez · 2019 [cited by examiner]
US 20190362063A1 · Wu · 2019 [cited by applicant]
US 20200034947A1 · Wang · 2020 [cited by examiner]
US 20200388002A1 · Jung · 2020 [cited by examiner]
CN 103745448A · 2014 [cited by applicant]
CN 103886825A · 2014 [cited by applicant]
CN 106373537A · 2017 [cited by applicant]
CN 106412563A · 2017 [cited by applicant]
CN 106485790A · 2017 [cited by applicant]
CN 106980983A · 2017 [cited by applicant]
CN 107194890A · 2017 [cited by applicant]
CN 107194891A · 2017 [cited by applicant]
EP 2242280A2 · 2010 [cited by applicant]
JP 2010210704A · 2010 [cited by applicant]
JP 2017517025A · 2017 [cited by applicant]
Reingold et al., Gaze-Contingent Multiresolutional Displays: An Integrative Review, Human Factors, pp. 307-328, vol. 45, No. 2, Summer 2003 (Year: 2003). [cited by examiner]
International Search Report of PCT/CN2018/082294 in Chinese, mailed May 30, 2018 with English translation. [cited by applicant]
Notice of Transmittal of the International Search Report of PCT/CN2018/082294 in Chinese, mailed May 30, 2018. [cited by applicant]
Written Opinion of the International Searching Authority of PCT/CN2018/082294 in Chinese, mailed May 30, 2018 with English translation. [cited by applicant]
Extended European Search Report in European Patent Application No. 18814480.2 dated Mar. 22, 2021. [cited by applicant]
Reingold et al., Gaze-Contingent Multiresolutional Displays: An Integrative Review, Human Factors, pp. 307-328, vol. 45, No. 2, Summer 2003. [cited by applicant]
Stengel et al., Gaze-Contingent Computational Displays, IEEE Signal Processing Magazine, Sep. 2016, pp. 139-148. [cited by applicant]
Guenter et al., Foveated 3D Graphics, Microsoft Research, 10 pages. [cited by applicant]
Ohshima et al., Gaze-Directed Adaptive Rendering for Interacting with Virtual Space, Media Technology Laboratory, Canon Inc., IEEE Proceedings of VRAIS '96, pp. 103-110. [cited by applicant]
U.S. Office Action in U.S. Appl. No. 16/309,355 dated May 28, 2021. [cited by applicant]
Notice of Allowance in U.S. Appl. No. 16/309,355 dated Sep. 10, 2021. [cited by applicant]
Chinese Office Action in Chinese Application No. 201710674693.6, mailed Dec. 16, 2019 with English translation. [cited by applicant]
Display Daily: “BOE Shows a Wide Range of Panels”, May 31, 206; SID Display Week 2016: vol. 23, Issue 21 (Year: 2016). [cited by applicant]
Japanese Office Action in Japanese Application No. 2018-566354 dated May 8, 2022 with English translation. [cited by applicant]