IP Library › Granted Patent US 12,730,557
Granted Patent B2
US 12,730,557 · App. 18/886,026 · Granted Sep 8, 2026

Display device, display controlling method, and computer program

Inventors: Mitsuo Okumura (Tokyo, JP); Hazime Matsuda (Kanagawa, JP); Shoji Imamura (Tokyo, JP); Katsuji Miyazawa (Kanagawa, JP); Motoki Higashide (Tokyo, JP); Kunihito Sawai (Kanagawa, JP)
Assignee: Sony Group Corporation
G06F3/04886G06F3/041G06F3/0412G06F3/044G06F3/0482G06F3/04847H04N1/00392H04N7/147H04N7/15H04N23/62G06F3/04855G06F2203/04108G06F2203/04803H04N2101/00H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,730,557
App. No.
18/886,026
Filed
Sep 16, 2024
Granted
Sep 8, 2026
Kind
B2
Art Unit
2629
USPC
715/771
Abstract

A display device, method, computer-readable storage medium and user interface, each of which detects contact to or proximity of an object with respect to a generated image, and responsive to detection of contact to or proximity of the object to the generated image, disables any operational functions associated with a first portion of the generated image. Additionally, operation associated with a second portion of the generated image is allowed responsive to the detection of contact to or proximity of the object to the generated image, where the second portion of the generated image is different from the first portion of the generated image. An indication corresponding to the second portion of the generated image for which operation is enabled may be displayed on the generated image.

Claims (57)

1 . A method, comprising:

detecting, using circuitry, a first contact on a first operational portion of a first image generated on a touch screen;

in response to the first contact being detected on the first operational portion, displaying, using the circuitry, on the touch screen a text and a second image at the first operational portion of the first image;

detecting, using the circuitry, a second contact on a second operational portion of the first image generated on the touch screen;

in response to the second operation being detected on the second operational portion, setting, using the circuitry, a state of a camera, the state corresponding to a movement amount of the camera;

displaying, using the circuitry, a captured image on the touch screen, the captured image being captured by the camera with the state of the camera being set; and

deleting, using the circuitry, the text and the second image from the first operational portion of the first image in response to detecting, using the circuitry, the first contact being removed from the touch screen at the first operational portion.

2 . The method according to claim 1 , wherein

the first contact is a contact on the touch screen by a user's first finger, and

the second contact is another contact on the touch screen by the user's second finger.

3 . The method according to claim 1 , wherein

the first image is comprised of a plurality of graphics.

4 . The method according to claim 1 , further comprising:

allowing, using the circuitry, an operation associated with the first operational portion of the first image while the first operational portion of the first image is contacted.

5 . The method according to claim 1 , further comprising:

allowing, using the circuitry, an operation associated with the second operational portion of the first image while the second operational portion of the first image is contacted.

6 . The method according to claim 5 , further comprising:

controlling, using the circuitry, an orientation of the camera based on the operation associated with the second operational portion of the first image.

7 . The method according to claim 5 , further comprising:

controlling, using the circuitry, a zoom state of the camera based on the operation associated with the second operational portion of the first image.

8 . The method according to claim 1 , wherein

the touch screen is a screen of a hand-held portable device or an information appliance.

9 . The method according to claim 1 , wherein

the camera and the hand-held portable device or the information appliance are physically separated devices.

10 . An apparatus, comprising:

a touch screen; and

circuitry configured to

detect a first contact on a first operational portion of a first image generated on the touch screen,

in response to the first contact being detected on the first operational portion, display on the touch screen a text and a second image at the first operational portion of the first image,

detect a second contact on a second operational portion of the first image generated on the touch screen,

in response to the second operation being detected on the second operational portion, set a state of a camera, the state corresponding to a movement amount of the camera,

display a captured image on the touch screen, the captured image being captured by the camera with the state of the camera being set, and

delete the text and the second image from the first operational portion of the first image in response to detecting the first contact being removed from the touch screen at the first operational portion.

11 . The apparatus according to claim 10 , wherein

the circuitry is configured to allow an operation associated with the second operational portion of the first image while the second operational portion of the first image is contacted.

12 . The apparatus according to claim 11 , wherein

the circuitry is configured to control an orientation of the camera based on the operation associated with the second operational portion of the first image.

13 . The apparatus according to claim 11 , wherein

the circuitry is configured to control a zoom state of the camera based on the operation associated with the second operational portion of the first image.

14 . The apparatus according to claim 10 , wherein

the camera and the apparatus are physically separated devices.

15 . A non-transitory computer readable medium including executable instructions, which when executed by a computer cause the computer to:

detect a first contact on a first operational portion of a first image generated on a touch screen;

in response to the first contact being detected on the first operational portion, display on the touch screen a text and a second image at the first operational portion of the first image;

detect a second contact on a second operational portion of the first image generated on the touch screen;

in response to the second operation being detected on the second operational portion, set a state of a camera, the state corresponding to a movement amount of the camera;

display a captured image on the touch screen, the captured image being captured by the camera with the state of the camera being set; and

delete the text and the second image from the first operational portion of the first image in response to detecting the first contact being removed from the touch screen at the first operational portion.

16 . The non-transitory computer readable medium according to claim 15 , wherein the executable instructions when executed by the computer cause the computer to:

allow an operation associated with the second operational portion of the first image while the second operational portion of the first image is contacted.

17 . The non-transitory computer readable medium according to claim 16 , wherein the executable instructions when executed by the computer cause the computer to:

control an orientation of the camera based on the operation associated with the second operational portion of the first image.

18 . The non-transitory computer readable medium according to claim 16 , wherein the executable instructions when executed by the computer cause the computer to:

control a zoom state of the camera based on the operation associated with the second operational portion of the first image.

19 . The non-transitory computer readable medium according to claim 15 , wherein

the touch screen is a screen of a hand-held portable device or an information appliance, and

the camera and the hand-held portable device or the information appliance are physically separated devices.

Priority Claims (1)
JP 2013-133583 · Jun 26, 2013 · national
Continuity (7)
Continuation 18482090 · Oct 6, 2023
Continuation 18061488 · Dec 5, 2022
Continuation 17510411 · Oct 26, 2021
Continuation 16839088 · Apr 3, 2020
Continuation 15244458 · Aug 23, 2016
Continuation 14296506 · Jun 5, 2014
Related Publication 20250004636A1 · Jan 2, 2025
References Cited (51)
US 6232971B1 · Haynes · 2001 [cited by examiner]
US 6545669B1 · Kinawi · 2003 [cited by examiner]
US 7479949B2 · Jobs et al. · 2009 [cited by applicant]
US 8493350B2 · Park · 2013 [cited by applicant]
US 8896562B2 · Horiguchi · 2014 [cited by applicant]
US 9146628B2 · Wakizaka et al. · 2015 [cited by applicant]
US 9483987B2 · Kawachi et al. · 2016 [cited by applicant]
US 9667881B2 · Harris et al. · 2017 [cited by applicant]
US 9772744B2 · Yamano et al. · 2017 [cited by applicant]
US 10375313B1 · Van Os et al. · 2019 [cited by applicant]
US 10592101B2 · Okumura et al. · 2020 [cited by applicant]
US 10757552B2 · Gross et al. · 2020 [cited by applicant]
US 20060097991A1 · Hotelling · 2006 [cited by examiner]
US 20060269264A1 · Stafford et al. · 2006 [cited by applicant]
US 20070128899A1 · Mayer · 2007 [cited by applicant]
US 20080094356A1 · Ording · 2008 [cited by examiner]
US 20080168290A1 · Jobs et al. · 2008 [cited by applicant]
US 20080180408A1 · Forstall et al. · 2008 [cited by applicant]
US 20090143141A1 · Wells et al. · 2009 [cited by applicant]
US 20090167700A1 · Westerman et al. · 2009 [cited by applicant]
US 20090265670A1 · Kim et al. · 2009 [cited by applicant]
US 20100090971A1 · Choi et al. · 2010 [cited by applicant]
US 20100275150A1 · Chiba et al. · 2010 [cited by applicant]
US 20100311493A1 · Miller et al. · 2010 [cited by applicant]
US 20110013049A1 · Thörn · 2011 [cited by applicant]
US 20110074698A1 · Rapp et al. · 2011 [cited by applicant]
US 20110074830A1 · Rapp et al. · 2011 [cited by applicant]
US 20110083104A1 · Minton · 2011 [cited by applicant]
US 20110163971A1 · Wagner et al. · 2011 [cited by applicant]
US 20110216095A1 · Rydenhag · 2011 [cited by applicant]
US 20110267280A1 · De Mers et al. · 2011 [cited by applicant]
US 20110291988A1 · Bamji et al. · 2011 [cited by applicant]
US 20120071212A1 · Endo et al. · 2012 [cited by applicant]
US 20120254808A1 · Gildfind · 2012 [cited by applicant]
US 20120306928A1 · Yoshinaka · 2012 [cited by applicant]
US 20130024806A1 · Funabashi et al. · 2013 [cited by applicant]
US 20130076941A1 · Palanciuc et al. · 2013 [cited by applicant]
US 20130135234A1 · Hisano · 2013 [cited by examiner]
US 20130222229A1 · Kanda · 2013 [cited by applicant]
US 20140104217A1 · Horiguchi · 2014 [cited by applicant]
US 20140208957A1 · Imai et al. · 2014 [cited by applicant]
US 20140359438A1 · Matsuki · 2014 [cited by applicant]
US 20150135132A1 · Josephson · 2015 [cited by applicant]
US 20150160776A1 · Ajichi · 2015 [cited by applicant]
US 20150338975A1 · Shima · 2015 [cited by examiner]
US 20160004420A1 · Noda · 2016 [cited by examiner]
US 20160202856A1 · Hiro et al. · 2016 [cited by applicant]
US 20160239203A1 · Sato · 2016 [cited by applicant]
US 20170206747A1 · Miller et al. · 2017 [cited by applicant]
JP 2012257074A · 2012 [cited by applicant]
JP 2014016948A · 2014 [cited by applicant]