IP Library › Granted Patent US 12,416,977
Granted Patent B1
US 12,416,977 · App. 18/597,555 · Granted Sep 16, 2025

On-screen virtual keyboards with side-by-side keyboard portions

Inventors: Francis Wu (Waterloo, CA); Sakib Chowdhury (Toronto, CA); Jack Cobb (Mono, CA); Michael Kazman (Kitchener, CA); Sidhartha Singh (Brampton, CA); Qinghe Tian (Waterloo, CA); Mathew Snyder (Kitchener, CA)
Assignee: Sony Interactive Entertainment LLC
G06F3/0236A63F13/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,416,977
App. No.
18/597,555
Granted
Sep 16, 2025
Kind
B1
Abstract

Systems and methods described herein include displaying a keyboard on a display. The virtual keyboard is split into a first keyboard portion including an inner zone including one or more letters and an outer zone including a first group of letters that are positioned to surround the inner zone of the first keyboard portion; and into a second keyboard portion including an inner zone including one or more letters and an outer zone including a second group of letters that are positioned to surround the inner zone of the second keyboard portion. The methods and systems described herein include respectively generate first and second signals pertaining to selection of a letter on the first and second keyboard portion in response to a user interacting with one or more control inputs in a first of second group of control inputs on a handheld controller.

Claims (68)

1. A method comprising:

displaying a keyboard on a display, wherein the keyboard is split into:

a first keyboard portion including an inner zone including one or more first letters of an alphabet and an outer zone including a first group of letters of the alphabet that are positioned to surround the one or more first letters included in the inner zone of the first keyboard portion with even spacing, the first group of letters being different than the one or more first letters; and

a second keyboard portion including an inner zone including one or more second letters of the alphabet and an outer zone including a second group of letters of the alphabet that are positioned to surround the one or more second letters included in inner zone of the second keyboard portion with even spacing, the second group of letters being different than the one or more second letters;

generating first signals pertaining to selection of a letter on the first keyboard portion in response to a user interacting with one or more control inputs in a first group of control inputs on a handheld controller; and

generating second signals pertaining to selection of a letter on the second keyboard portion in response to the user interacting with one or more control inputs in a second group of control inputs on the handheld controller.

2. The method of claim 1 , wherein:

the first signals cause a first cursor to move within the first keyboard portion and cause the letter in the first keyboard portion to be selected; and

the second signals cause a second cursor to move within the second keyboard portion and cause the letter in the second keyboard portion to be selected.

3. The method of claim 1 ,

wherein the first group of letters of the alphabet of the outer zone of the first keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the first keyboard portion, and

wherein the second group of letters of the alphabet of the outer zone of the second keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the second keyboard portion.

4. The method of claim 1 , wherein:

the first group of control inputs is located on a left side of the handheld controller; and

the second group of control inputs is located on a right side of the handheld controller.

5. The method of claim 1 , wherein:

the user interacting with one or more control inputs in the first group of control inputs on the handheld controller comprises the user interacting with a first analog control input; and

the user interacting with one or more control inputs in the second group of control inputs on the handheld controller comprises the user interacting with a second analog control input.

6. The method of claim 1 , wherein the one or more control inputs in the first group of control inputs and the one or more control inputs in the second group of control inputs are respectively configured to allow a first cursor on the first keyboard portion and a second cursor on the second keyboard portion to be moved substantially simultaneously.

7. The method of claim 1 , wherein:

the inner zone of each of the first and second keyboards includes one letter and the outer zone of each of the first and second keyboards includes twelve letters; or

the inner zone of each of the first and second keyboards includes at least two letters and the outer zone of each of the first and second keyboards includes at most eleven letters.

8. The method of claim 1 , wherein the user interacting with the one or more control inputs in the first group of control inputs on the handheld controller comprises the user selecting one or more of the first letters of the alphabet in the inner zone of the first keyboard portion using a particular control input that is different than a directional input of an analog joystick.

9. A non-transitory computer readable storage medium storing one or more computer programs configured to cause a processor-based system to execute steps comprising:

displaying a keyboard on a display, wherein the keyboard is split into:

a first keyboard portion including an inner zone including one or more first letters of an alphabet and an outer zone including a first group of letters of the alphabet that are positioned to surround the one or more first letters included in inner zone of the first keyboard portion with even spacing, the first group of letters being different than the one or more first letters; and

a second keyboard portion including an inner zone including one or more second letters of the alphabet and an outer zone including a second group of letters of the alphabet that are positioned to surround the one or more second letters included in the inner zone of the second keyboard portion with even spacing, the second group of letters being different than the one or more second letters;

generating first signals pertaining to selection of a letter on the first keyboard portion in response to a user interacting with one or more control inputs in a first group of control inputs on a handheld controller; and

generating second signals pertaining to selection of a letter on the second keyboard portion in response to the user interacting with one or more control inputs in a second group of control inputs on the handheld controller.

10. The non-transitory computer readable storage medium of claim 9 , wherein:

the first signals cause a first cursor to move within the first keyboard portion and cause the letter in the first keyboard portion to be selected; and

the second signals cause a second cursor to move within the second keyboard portion and cause the letter in the second keyboard portion to be selected.

11. The non-transitory computer readable storage medium of claim 9 ,

wherein the first group of letters of the alphabet of the outer zone of the first keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the first keyboard portion, and

wherein the second group of letters of the alphabet of the outer zone of the second keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the second keyboard portion.

12. The non-transitory computer readable storage medium of claim 9 , wherein:

the first group of control inputs is located on a left side of the handheld controller; and

the second group of control inputs is located on a right side of the handheld controller.

13. The non-transitory computer readable storage medium of claim 9 , wherein:

the user interacting with one or more control inputs in the first group of control inputs on the handheld controller comprises the user interacting with a first analog control input; and

the user interacting with one or more control inputs in the second group of control inputs on the handheld controller comprises the user interacting with a second analog control input.

14. The non-transitory computer readable storage medium of claim 13 , wherein the one or more control inputs in the first group of control inputs and the one or more control inputs in the second group of control inputs are respectively configured to allow a first cursor on the first keyboard portion and a second cursor on the second keyboard portion to be moved substantially simultaneously.

15. The non-transitory computer readable storage medium of claim 13 , wherein:

the inner zone of each of the first and second keyboards includes one letter and the outer zone of each of the first and second keyboards includes twelve letters; or

the inner zone of each of the first and second keyboards includes at least two letters and the outer zone of each of the first and second keyboards includes at most eleven letters.

16. A system, comprising:

a display;

a handheld controller; and

a processor-based system in communication with the display and the handheld controller and configured to execute steps comprising:

displaying a keyboard on a display, wherein the keyboard is split into:

a first keyboard portion including an inner zone including one or more first letters of an alphabet and an outer zone including a first group of letters of the alphabet that are positioned to surround the one or more first letters included in the inner zone of the first keyboard portion with even spacing, the first group of letters being different than the one or more first letters; and

a second keyboard portion including an inner zone including one or more second letters of the alphabet and an outer zone including a second group of letters of the alphabet that are positioned to surround the one or more second letters included in the inner zone of the second keyboard portion with even spacing, the first group of letters being different than the one or more first letters;

generating first signals pertaining to selection of a letter on the first keyboard portion in response to a user interacting with one or more control inputs in a first group of control inputs on a handheld controller; and

generating second signals pertaining to selection of a letter on the second keyboard portion in response to the user interacting with one or more control inputs in a second group of control inputs on the handheld controller.

17. The system of claim 16 , wherein:

the first signals cause a first cursor to move within the first keyboard portion and cause the letter in the first keyboard portion to be selected; and

the second signals cause a second cursor to move within the second keyboard portion and cause the letter in the second keyboard portion to be selected.

18. The system of claim 16 , wherein the first group of letters of the alphabet of the outer zone of the first keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the first keyboard portion, and wherein the second group of letters of the alphabet of the outer zone of the second keyboard portion is positioned to encircle the one or more first letters of the alphabet of the inner zone of the second keyboard portion.

19. The system of claim 16 , wherein:

the first group of control inputs is located on a left side of the handheld controller; and

the second group of control inputs is located on a right side of the handheld controller.

20. The system of claim 16 , wherein:

the user interacting with one or more control inputs in the first group of control inputs on the handheld controller comprises the user interacting with a first analog control input; and

the user interacting with one or more control inputs in the second group of control inputs on the handheld controller comprises the user interacting with a second analog control input.

21. The system of claim 16 , wherein the one or more control inputs in the first group of control inputs and the one or more control inputs in the second group of control inputs are respectively configured to allow a first cursor on the first keyboard portion and a second cursor on the second keyboard portion to be moved substantially simultaneously.

22. The system of claim 16 , wherein:

the inner zone of each of the first and second keyboards includes one letter and the outer zone of each of the first and second keyboards includes twelve letters; or

the inner zone of each of the first and second keyboards includes at least two letters and the outer zone of each of the first and second keyboards includes at most eleven letters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: WU, FRANCIS; CHOWDHURY, SAKIB; COBB, JACK; KAZMAN, MICHAEL; SINGH, SIDHARTHA; TIAN, QINGHE; SNYDER, MATHEW
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 066756/0281 →
References Cited (75)
US 5408621A · Ben-Arie · 1995 [cited by applicant]
US 5543818A · Scott · 1996 [cited by applicant]
US 5704837A · Iwasaki et al. · 1998 [cited by applicant]
US 5874906A · Willner et al. · 1999 [cited by applicant]
US 6259431B1 · Futatsugi et al. · 2001 [cited by applicant]
US 6392640B1 · Will · 2002 [cited by applicant]
US 6486870B1 · Kozu · 2002 [cited by applicant]
US 6512511B2 · Willner et al. · 2003 [cited by applicant]
US 6593913B1 · Krohn et al. · 2003 [cited by applicant]
US 6710766B1 · Ogata · 2004 [cited by applicant]
US 7151525B2 · McAlindon · 2006 [cited by applicant]
US 7199786B2 · Suraqui · 2007 [cited by applicant]
US 7218249B2 · Chadha · 2007 [cited by applicant]
US 7487147B2 · Bates et al. · 2009 [cited by applicant]
US 8405601B1 · Beale · 2013 [cited by applicant]
US 8456425B2 · Walker et al. · 2013 [cited by applicant]
US 8576167B2 · Longe et al. · 2013 [cited by applicant]
US 8780043B2 · Yoshioka · 2014 [cited by examiner]
US 20020063687A1 · Kim · 2002 [cited by applicant]
US 20020156615A1 · Takatsuka et al. · 2002 [cited by applicant]
US 20040008186A1 · McAlindon · 2004 [cited by applicant]
US 20040070567A1 · Longe et al. · 2004 [cited by applicant]
US 20040080487A1 · Griffin et al. · 2004 [cited by applicant]
US 20040139254A1 · Tu et al. · 2004 [cited by applicant]
US 20040160413A1 · Tamai et al. · 2004 [cited by applicant]
US 20040196260A1 · Lin et al. · 2004 [cited by applicant]
US 20040222963A1 · Guo et al. · 2004 [cited by applicant]
US 20040227728A1 · McAlindon · 2004 [cited by applicant]
US 20060114235A1 · Larom · 2006 [cited by applicant]
US 20070205983A1 · Naimo · 2007 [cited by applicant]
US 20080062015A1 · Bowen · 2008 [cited by applicant]
US 20080222318A1 · Yoshioka · 2008 [cited by examiner]
US 20080222571A1 · Yoshioka · 2008 [cited by applicant]
US 20130019204A1 · Kotler et al. · 2013 [cited by applicant]
US 20160034179A1 · Medina · 2016 [cited by examiner]
CN 102289290A · 2011 [cited by applicant]
JP H09062451A · 1997 [cited by applicant]
JP H10275046A · 1998 [cited by applicant]
JP 2004220386A · 2004 [cited by applicant]
WO WO2000075765A1 · 2000 [cited by applicant]
WO WO2006073273A1 · 2006 [cited by applicant]
WO WO2008097196A1 · 2008 [cited by applicant]
WO WO2008109480A2 · 2008 [cited by applicant]
WO WO2013127431A1 · 2013 [cited by applicant]
U.S. Appl. No. 18/597,508, filed Mar. 6, 2024, Michael Kazman. [cited by applicant]
[No Author Listed], “Computer Keyboard Design”, upon information and belief, available no later than Jun. 2014, retrieved on Jan. 23, 2025, retrieved from URL<https://ergo.human.cornell.edu/AHTutorials/ckd.htm>, 3 pages. [cited by applicant]
Amento, et al., “Performance Models: Fitts Law”, 1996, retrieved on Jan. 23, 2025, retrieved from URL< https://ei.cs.vt.edu/˜cs5724/g1/>, 2 pages. [cited by applicant]
Arif et al., “Analysis of Text Entry Performance Metrics,” 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH), Sep. 2009, 6 pages. [cited by applicant]
Baker et al., “Why do we all use Qwerty keyboards?,” BBC News Technology, Aug. 11, 2010, retrieved on Jan. 23, 2025, retrieved from URL<https://www.bbc.com/news/technology-10925456>, 9 pages. [cited by applicant]
Bi et al., “Quasi-qwerty soft keyboard optimization,” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Apr. 2010, pp. 283-286. [cited by applicant]
Breuer, “InkBoard—designing a pen-centric on-screen keyboard,” Jan. 10, 2011, retrieved on Jan. 23, 2025, retrieved from URL<http://blog.felixbreuer.net/2011/01/10/inkboard.html>, 9 pages. [cited by applicant]
Bucao, “The Workman Keyboard Layout Philosophy,” Sep. 6, 2010, retrieved on Jan. 23, 2025, retrieved from URL<https://viralintrospection.wordpress.com/2010/09/06/a-different-philosophy-in-designing-keyboard-layouts/>, 7… [cited by applicant]
Card et al., “Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT,” Book of Human-Computer Interaction, Apr. 1977, 29 pages. [cited by applicant]
Entertainment Software Association (ESA), “Essential Facts About the Computer and Video Game Industry”, Jul. 2013, 16 pages. [cited by applicant]
Fitts, “The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement,” Journal of Experimental Psychology, Jun. 1954, 47(6):381-391. [cited by applicant]
Göktürk, “Fitts's Law”, Encyclopedia of Human-Computer Interaction, 2013, retrieved on Jan. 23, 2025, retrieved from URL<https://www.interaction-design.org/literature/book/the-glossary-of-human-computer-interaction/fitt… [cited by applicant]
Hopkins, “The Design and Implementation of Pie Menus,” Dr. Dobb's Journal, Dec. 1991, retrieved on Jan. 23, 2025, retrieved from URL<https://donhopkins.medium.com/the-design-and-implementation-of-pie-menus-80db1e1b5293>… [cited by applicant]
Hosken, “An introduction to keyboard design theory: What Goes Where?”, NRSI: Computer & Writing Systems, Feb. 17, 2003, retrieved on Jan. 23, 2025, retrieved from URL<https://scripts.sil.org/cms/scripts/page.php?id=keyb… [cited by applicant]
Huot et al., “Spiralist: A Compact Visualization Technique for One-Handed Interaction with Large Lists on Mobile Devices,” Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, Oct. 200… [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2015/042195, mailed on Oct. 19, 2015, 10 pages. [cited by applicant]
Kurtenbach, “The Design and Evaluation of Marking Menus,” Thesis submitted in conformity with the requirements of the Degree of Doctor of Philosophy, Graduate Department of Computer Science, University of Toronto, Jun. … [cited by applicant]
MacKenzie et al., “The Design and Evaluation of a High-Performance Soft Keyboard,” CHI 99: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, May 1999, pp. 25-31. [cited by applicant]
MacKenzie, “Fitts' Law as a Research and Design Tool in Human-Computer Interaction,” Human-Computer Interaction, Mar. 1992, 7(1):91-139. [cited by applicant]
MacKenzie, “Movement Time Prediction in Human-Computer Interfaces”, Human-Computer Interaction, Jun. 1995, 17 pages. [cited by applicant]
netflix.com [online], “Netflix Official Site,” upon information and belief, available no later than Jan. 17, 1999, retrieved on Jan. 23, 2025, retrieved from URL<https//netflix.com/>, 5 pages. [cited by applicant]
Samp, “Designing graphical menus for novices and expert: connecting design characteristics with design goals”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Apr. 2013, pp. 3159-3168. [cited by applicant]
Screenshot at 0:47 of “Radial—Netflix Hack Day—Feb. 2014” video at «http://www.youtube.com/watch?v=DfS4zmryYo4» posted Feb. 26, 2014, 1 page. [cited by applicant]
Screenshot at 1 :12 of “Steam's Big Picture” video at <<http://store.steampowered.com/bigpicture>>, accessed Jun. 12, 2014, 1 page. [cited by applicant]
Stamp, “Fact of Fiction? The Legend of the Qwerty Keyboard”, Smithsonian Magazine, May 3, 2013, retrieved on Jan. 24, 2025, retrieved from URL<https://www.smithsonianmag.com/arts-culture/fact-of-fiction-the-legend-of-th… [cited by applicant]
statisticbrain..com [online], “Television Watching Statistics”, Sep. 2013, retrieved on Jan. 24, 2025, retrieved from URL<https://web.archive.org/web/20131011193623/http://www.statisticbrain.com:80/television-watching-s… [cited by applicant]
steampowered.com [online], “Valves Steam Official Site”, upon information and belief, available no later than May 14, 2007, retrieved on Jan. 23, 2025, retrieved from URL<store.steampowered.com/>, 4 pages. [cited by applicant]
Wong, “Soft Keyboard (onscreen keyboard or software keyboard)”, TechTarget, Mar. 2011, retrieved on Jan. 23, 2025, retrieved from URL<whatis.techtarget.com/definition/sofl-keyboard-onscreen-keyboard-or-software-keyboard… [cited by applicant]
xbox.com [online], “Microsoft Xbox One Official Site (Meet Xbox One. The all=in-one entertainment system,” upon information and belief, available no later than Aug. 19, 2013, retrieved on Jan. 23, 2025, retrieved from U… [cited by applicant]
xbox.com [online], “Microsoft Xbox SmartGlass Official Site (Introducing Xbox SmartGlass)”, upon information and belief, available no later than Oct. 24, 2012, retrieved on Jan. 23, 2025, retrieved from URL<http://www.x… [cited by applicant]
Yamada, “A Historical Study of Typewriters and Typing Methods: From the Position of Planning Japanese Parallels” Journal of Information Processing, Jan. 1980, 2(4):175-202. [cited by applicant]