IP Library Granted Patent US 12,368,953
Granted Patent B2
US 12,368,953 · App. 18/334,205 · Granted Jul 22, 2025

Image processing device, method of processing image, image processing program, and imaging device

Inventors: Toshiki Ono (Tokyo, JP); Ryuji Shibata (Kanagawa, JP)
Assignee: Sony Group Corporation
H04N23/675G06T5/73G06V40/161H04N23/61H04N23/611H04N23/632H04N23/633H04N23/672H04N23/673
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,368,953
App. No.
18/334,205
Granted
Jul 22, 2025
Kind
B2
Abstract

An information processing system configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image.

Claims (44)

1. An image processing device comprising:

a touch panel display, and

circuitry configured to

determine an attention area and a non-attention area in a through image, the non-attention area is distinct from the attention area,

control the touch panel display to display the through image,

control the touch panel display to display a single blur adjustment user interface including a dynamic user interface element that is movable by operation of an user and a static user interface element that indicates a moving path of the dynamic user interface element, and

change a blur amount of the non-attention area according to a position of the dynamic user interface element relative to the static user interface element,

wherein a portion of the static user interface element visually distinguishes a range between a maximum blur amount and a zero blur amount of the non-attention area,

wherein a position of the static user interface element does not change,

wherein the blur amount of the non-attention area changes when the position of the dynamic user interface element changes relative to the position of the static user interface element, and

wherein the single blur adjustment user interface is a single user control that controls the blur amount.

2. The image processing device according to claim 1 , wherein the circuitry is further configured to

detect a change of the dynamic user interface element from a first position relative to the static user interface element to a second position relative to the static user interface element, and

change the blur amount from a first blur amount associated with the first position to a second blur amount associated with the second position.

3. The image processing device according to claim 1 , wherein the touch panel display is further configured to receive a user input, and wherein the circuitry is further configured to determine the attention area based on the user input that is received.

4. The image processing device according to claim 3 , wherein the user input is received while the through image is displayed on the touch panel display, wherein the user input indicates designates a portion of the through image as the attention area, and wherein the portion of the through image is less than all of the through image.

5. The image processing device according to claim 1 , wherein the attention area is in-focus area, the non-attention area is out of focus area.

6. The image processing device according to claim 1 , wherein the circuitry is further configured to control the touch panel display to display the through image in a first area and display the single blur adjustment user interface in a second area that is different from the first area.

7. The image processing device according to claim 1 , wherein the circuitry is further configured to control the touch panel display to display the through image and the single blur adjustment user interface at the same time.

8. The image processing device according to claim 1 , wherein the moving path is a curved path.

9. The image processing device according to claim 1 , wherein the dynamic user interface element is overlaid on the portion of the static user interface element.

10. The image processing device according to claim 1 , wherein the dynamic user interface element is a circular user interface element representing the blur amount, and wherein the static user interface element is a rounded rectangular user interface element representing the moving path.

11. The image processing device according to claim 1 , wherein the through image has an upper edge defining a first plane and a lower edge defining a second plane that is distinct from the first plane, wherein the moving path extends between the first plane and the second plane, wherein a first portion of the moving path that is closest to the first plane is a first blur amount, wherein a second portion of the moving path that is closest to the second plane is a second blur amount, and wherein the second blur amount is a higher blur amount than the first blur amount.

12. A non-transitory computer-readable medium comprising instructions that, when executed by an electronic processor, cause the electronic processor to perform a set of operations comprising:

determining an attention area and a non-attention area in a through image, the non-attention area is distinct from the attention area,

controlling a touch panel display to display the through image,

controlling the touch panel display to display a single blur adjustment user interface including a dynamic user interface element that is movable by operation of an user and a static user interface element that indicates a moving path of the dynamic user interface element, and

changing a blur amount of the non-attention area according to a position of the dynamic user interface element,

wherein a portion of the static user interface element visually distinguishes a range of blur amounts between a maximum blur amount and a zero blur amount,

wherein a position of the static user interface element does not change,

wherein the blur amount of the non-attention area changes when the position of the dynamic user interface element changes relative to the position of the static user interface element, and

wherein the single blur adjustment user interface is a single user control that controls the blur amount.

13. The non-transitory computer-readable medium according to claim 12 , wherein the set of operations further includes

detecting a change of the dynamic user interface element from a first position relative to the static user interface element to a second position relative to the static user interface element; and

changing the blur amount from a first blur amount associated with the first position to a second blur amount associated with the second position.

14. The non-transitory computer-readable medium according to claim 12 , wherein the set of operations further includes

receiving a user input; and

determining the attention area based on the user input that is received.

15. The non-transitory computer-readable medium according to claim 14 , wherein the user input is received while the through image is displayed on the touch panel display, wherein the user input indicates designates a portion of the through image as the attention area, and wherein the portion of the through image is less than all of the through image.

16. The non-transitory computer-readable medium according to claim 12 , wherein the set of operations further includes controlling the touch panel display to display the through image in a first area and display the single blur adjustment user interface in a second area that is different from the first area.

17. The non-transitory computer-readable medium according to claim 12 , wherein the set of operations further includes controlling the touch panel display to display the through image and the single blur adjustment user interface at the same time.

18. The non-transitory computer-readable medium according to claim 12 , wherein the dynamic user interface element is overlaid on the portion of the static user interface element.

19. The non-transitory computer-readable medium according to claim 12 , wherein the dynamic user interface element is a circular user interface element representing the blur amount, and wherein the static user interface element is a rounded rectangular user interface element representing the moving path.

20. The non-transitory computer-readable medium according to claim 12 , wherein the through image has an upper edge defining a first plane and a lower edge defining a second plane that is distinct from the first plane, wherein the moving path extends between the first plane and the second plane, wherein a first portion of the moving path that is closest to the first plane is a first blur amount, wherein a second portion of the moving path that is closest to the second plane is a second blur amount, and wherein the second blur amount is a higher blur amount than the first blur amount.

Priority Claims (1)
JP 2013-152937 · Jul 23, 2013 · national
Continuity (5)
Continuation 17851439 · Jun 28, 2022
Continuation 16924956 · Jul 9, 2020
Continuation 16557240 · Aug 30, 2019
Continuation 14894435
Related Publication 20230353873A1 · Nov 2, 2023
References Cited (73)
US 4794459A · Moberg et al. · 1988 [cited by applicant]
US 5818975A · Goodwin · 1998 [cited by examiner]
US 6208748B1 · Troccolo · 2001 [cited by applicant]
US 6229568B1 · Kawaguchi et al. · 2001 [cited by applicant]
US 6473326B2 · Higashihara et al. · 2002 [cited by applicant]
US 6526232B1 · Mizumura · 2003 [cited by applicant]
US 6538249B1 · Takane et al. · 2003 [cited by applicant]
US 6570566B1 · Yoshigahara · 2003 [cited by applicant]
US 6937284B1 · Singh · 2005 [cited by examiner]
US 6956612B2 · Bean et al. · 2005 [cited by applicant]
US 7030351B2 · Wasserman et al. · 2006 [cited by applicant]
US 7034883B1 · Rosenqvist · 2006 [cited by applicant]
US 7053953B2 · Belz et al. · 2006 [cited by applicant]
US 7289143B2 · Takagi et al. · 2007 [cited by applicant]
US 7432975B2 · Lee · 2008 [cited by applicant]
US 7536094B2 · Ichimiya · 2009 [cited by applicant]
US 7634187B2 · Li et al. · 2009 [cited by applicant]
US 7821545B2 · Sato · 2010 [cited by applicant]
US 7821570B2 · Gallagher et al. · 2010 [cited by applicant]
US 7860388B2 · Tsujimoto · 2010 [cited by applicant]
US 8558942B2 · Murata · 2013 [cited by applicant]
US 8701028B2 · Kokemohr · 2014 [cited by examiner]
US 8749695B2 · Kita · 2014 [cited by applicant]
US 8824793B2 · Intwala · 2014 [cited by examiner]
US 8831371B2 · Intwala et al. · 2014 [cited by applicant]
US 9174860B2 · Wernersson et al. · 2015 [cited by applicant]
US 9305374B2 · Kocienda · 2016 [cited by examiner]
US 9858649B2 · Liang · 2018 [cited by examiner]
US 10440251B2 · Ono et al. · 2019 [cited by applicant]
US 10482583B1 · Suszek · 2019 [cited by examiner]
US 11722770B2 · Ono · 2023 [cited by examiner]
US 20040217257A1 · Fiete et al. · 2004 [cited by applicant]
US 20050212817A1 · Cannon et al. · 2005 [cited by applicant]
US 20070297641A1 · Criddle · 2007 [cited by examiner]
US 20090195666A1 · Chen et al. · 2009 [cited by applicant]
US 20100061642A1 · Kondo et al. · 2010 [cited by applicant]
US 20100214540A1 · Sajadi et al. · 2010 [cited by applicant]
US 20110013072A1 · Choi · 2011 [cited by applicant]
US 20110019502A1 · Eick et al. · 2011 [cited by applicant]
US 20110199502A1 · Okamura · 2011 [cited by applicant]
US 20110227950A1 · Suzuki · 2011 [cited by applicant]
US 20110234818A1 · Sugihara · 2011 [cited by applicant]
US 20110270580A1 · Hedlund et al. · 2011 [cited by applicant]
US 20110317768A1 · Liu et al. · 2011 [cited by applicant]
US 20120075492A1 · Nanu et al. · 2012 [cited by applicant]
US 20120148409A1 · Kawamura et al. · 2012 [cited by applicant]
US 20130177254A1 · Nattress · 2013 [cited by applicant]
US 20140013273A1 · Ng · 2014 [cited by applicant]
US 20140111534A1 · Niles · 2014 [cited by examiner]
US 20140036128A1 · Choi · 2014 [cited by applicant]
US 20140233853A1 · Fransson · 2014 [cited by examiner]
US 20150215519A1 · Nattress · 2015 [cited by applicant]
US 20160171651A1 · Lee et al. · 2016 [cited by applicant]
US 20160217346A1 · Puetter et al. · 2016 [cited by applicant]
US 20160269620A1 · Romanenko et al. · 2016 [cited by applicant]
US 20170124928A1 · Edwin et al. · 2017 [cited by applicant]
US 20170270704A1 · Deb et al. · 2017 [cited by applicant]
EP 2048878A1 · 2009 [cited by applicant]
EP 2426911A1 · 2012 [cited by applicant]
JP 2002112008A · 2002 [cited by applicant]
JP 2007116437A · 2007 [cited by applicant]
JP 2008233470A · 2008 [cited by applicant]
JP 2009188697A · 2009 [cited by applicant]
JP 2010146264A · 2010 [cited by applicant]
JP 2011146957A · 2011 [cited by applicant]
JP 2011155420A · 2011 [cited by applicant]
JP 2011166641A · 2011 [cited by applicant]
JP 2011199740A · 2011 [cited by applicant]
JP 2013090010A · 2013 [cited by applicant]
JP 5824364B2 · 2015 [cited by applicant]
WO 2013080552A1 · 2013 [cited by applicant]
Japanese Office Action issued Nov. 11, 2016 for corresponding Japanese Application No. 2013-152937. [cited by applicant]
European Patent Office Communication Pursuant to Article 94 (3) dated Apr. 23, 2020 for related European Application No. 14755170.9. [cited by applicant]