IP Library › Granted Patent US 12,267,743
Granted Patent B2
US 12,267,743 · App. 18/639,990 · Granted Apr 1, 2025

Method and system for realizing function by causing elements of hardware to perform linkage operation

Inventors: Takehiro Hagiwara (Kanagawa, JP); Hiroyuki Masuda (Kanagawa, JP); Genta Kondo (Kanagawa, JP); Hiromu Takizawa (Kanagawa, JP)
Assignee: Sony Group Corporation
H04W36/14G06F9/5044G06F9/5077H04L12/2809H04L67/01H04W4/70H04W4/80H04W48/16H04W84/12H04W88/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,743
App. No.
18/639,990
Granted
Apr 1, 2025
Kind
B2
Abstract

A system that stores functional information indicating a capability of each of a plurality of elements located remotely from the system; identifies a function capable of being performed by linking a plurality of the elements based on the stored functional information; and transmits information corresponding to the identified function capable of being performed by linking the plurality of elements to a first device remote from the system.

Claims (37)

1. A first hardware element comprising:

a microphone that detects voice or sound;

wireless communication circuitry separate from the microphone and communicatively connected to the microphone so as to receive data based on the detected voice or sound, the wireless communication circuitry configured to

wirelessly connect to one or more servers in a system, each server including a memory having stored therein information indicating a capability of each of a plurality of hardware elements located remotely from the server,

transmit data based on the detected voice or sound to identify a linkage operation capable of being performed by linking the first hardware element with one or more second hardware elements, and

receive an instruction signal generated based on the identified linkage operation; and

control circuitry configured to perform, based on the received instruction signal, the identified linkage operation of the first hardware element and the one or more second hardware elements, each second hardware element including output circuitry.

2. The first hardware element according to claim 1 , wherein the control circuitry is separate from the microphone and the wireless communication circuitry.

3. The first hardware element according to claim 1 , wherein the control circuitry is separate from the microphone.

4. The first hardware element according to claim 1 , wherein the wireless communication circuitry is a communication card.

5. The first hardware element according to claim 1 , wherein the control circuitry is further configured to output audio information.

6. The first hardware element according to claim 5 , wherein the first hardware element is configured to operate as a speaker, a headphone or an earphone.

7. The first hardware element according to claim 6 , wherein the audio information includes a sound effect or an alert.

8. The first hardware element according to claim 6 , wherein one or more second hardware elements is configured to perform a lamp function.

9. The first hardware element according to claim 5 , wherein the audio information includes a sound effect or an alert.

10. The first hardware element according to claim 1 , wherein one or more second hardware elements is configured to perform a lamp function.

11. The first hardware element according to claim 1 , wherein the wireless communication circuitry is one of Bluetooth, WiFi, and a mobile communication network.

12. A method of operating a first hardware element in a system comprising one or more servers and one or more second hardware elements, the method comprising:

detecting voice or sound using a microphone in the first hardware element;

connecting the first hardware element to the one or more servers via wireless communication circuitry, separate from the microphone, each server including a memory storing functional information indicating a capability of each of a plurality of hardware elements located remotely from the server;

transmitting, from the wireless communication circuitry, data based on the detected voice or sound to identify a function capable of being performed by linking the first hardware element and the one or more second hardware elements;

receiving, at the wireless communication circuitry, an instruction signal generated based on the identified linkage operation; and

performing, based on the received instruction signal, via control circuitry, the identified function with the first hardware element and the one or more second hardware elements, the one or more second hardware elements including output circuitry.

13. The method according to claim 12 , wherein the control circuitry is separate from the microphone and the wireless communication circuitry.

14. The method according to claim 12 , wherein the control circuitry is separate from the microphone.

15. The method according to claim 12 , wherein the wireless communication circuitry is a communication card.

16. The method according to claim 12 , further comprising outputting audio information.

17. The method according to claim 12 , wherein one or more second hardware elements is configured to perform a lamp function, the method further comprising controlling the lamp function based on the transmitted data.

18. A kit for a first hardware element comprising:

a microphone that detects voice or sound;

wireless communication circuitry separate from the microphone and to be communicatively connected to the microphone so as to receive data based on the detected voice or sound, the wireless communication circuitry configured to

wirelessly connect to one or more servers in a system, each server including a memory having stored therein information indicating a capability of each of a plurality of hardware elements located remotely from the server,

transmit data based on the detected voice or sound to identify a linkage operation capable of being performed by linking the first hardware element with one or more second hardware elements, and

receive an instruction signal generated based on the identified linkage operation; and

control circuitry to be connected between the microphone and the wireless communication circuitry, the control circuitry configured to perform, based on the received instruction signal, the identified linkage operation of the first hardware element and the one or more second hardware elements, each second hardware element including output circuitry.

19. The kit according to claim 18 , wherein the control circuitry is separate from the microphone and the wireless communication circuitry.

20. The kit according to claim 18 , wherein the control circuitry is separate from the microphone.

Priority Claims (1)
JP 2014-101507 · May 15, 2014 · national
Continuity (8)
Continuation 18149685 · Jan 4, 2023
Continuation 17092490 · Nov 9, 2020
Continuation 16896225 · Jun 9, 2020
Continuation 16582656 · Sep 25, 2019
Continuation 16163091 · Oct 17, 2018
Continuation 16008770 · Jun 14, 2018
Continuation 15123171
Related Publication 20240267815A1 · Aug 8, 2024
References Cited (84)
US 5479502A · Ohga · 1995 [cited by examiner]
US 6437692B1 · Petite · 2002 [cited by examiner]
US 6601233B1 · Underwood · 2003 [cited by applicant]
US 6804701B2 · Muret et al. · 2004 [cited by applicant]
US 7020501B1 · Elliott · 2006 [cited by applicant]
US 7076211B2 · Donner · 2006 [cited by applicant]
US 7099947B1 · Nadeau · 2006 [cited by examiner]
US 7561544B2 · Ganesh · 2009 [cited by examiner]
US 7564805B1 · Cortez · 2009 [cited by applicant]
US 7761591B2 · Graham · 2010 [cited by examiner]
US 7813822B1 · Hoffberg · 2010 [cited by applicant]
US 8140679B2 · Hatanaka · 2012 [cited by examiner]
US 8380817B2 · Okada · 2013 [cited by applicant]
US 8392229B2 · Macbeth et al. · 2013 [cited by applicant]
US 8452906B2 · Grohman · 2013 [cited by applicant]
US 8885706B2 · Bankoski · 2014 [cited by examiner]
US 8971519B1 · Hoffberg · 2015 [cited by examiner]
US 9031581B1 · Haney · 2015 [cited by applicant]
US 9185654B2 · Holcman · 2015 [cited by applicant]
US 9697822B1 · Naik · 2017 [cited by examiner]
US 9953630B1 · Aubrey · 2018 [cited by examiner]
US 10391636B2 · Breazeal · 2019 [cited by examiner]
US 10748529B1 · Milden · 2020 [cited by examiner]
US 20030144868A1 · MacIntyre · 2003 [cited by applicant]
US 20040176170A1 · Eck · 2004 [cited by examiner]
US 20050091647A1 · McCollum · 2005 [cited by examiner]
US 20060166643A1 · Puthenpura · 2006 [cited by examiner]
US 20060282436A1 · Chaudhuri · 2006 [cited by applicant]
US 20060291473A1 · Chase · 2006 [cited by examiner]
US 20060293933A1 · Millhouse et al. · 2006 [cited by applicant]
US 20070168885A1 · Muller · 2007 [cited by examiner]
US 20070280463A1 · Kouchri et al. · 2007 [cited by applicant]
US 20070288454A1 · Bolivar · 2007 [cited by examiner]
US 20070299712A1 · Macbeth · 2007 [cited by examiner]
US 20080184170A1 · Periyalwar · 2008 [cited by applicant]
US 20100172257A1 · Yu · 2010 [cited by applicant]
US 20100283586A1 · Ikeda · 2010 [cited by applicant]
US 20110156879A1 · Matsushita · 2011 [cited by applicant]
US 20110179104A1 · Hakoda · 2011 [cited by applicant]
US 20110264484A1 · Macbeth · 2011 [cited by examiner]
US 20120311530A1 · Graviers · 2012 [cited by applicant]
US 20120331438A1 · Moskal · 2012 [cited by applicant]
US 20130082827A1 · Cho et al. · 2013 [cited by applicant]
US 20130159021A1 · Felsher · 2013 [cited by examiner]
US 20130311610A1 · Kim · 2013 [cited by applicant]
US 20140089947A1 · Han et al. · 2014 [cited by applicant]
US 20140123001A1 · M · 2014 [cited by examiner]
US 20140328216A1 · Coustal · 2014 [cited by applicant]
US 20150181407A1 · El Moumouhi · 2015 [cited by applicant]
CN 1188267A · 1998 [cited by applicant]
CN 1445669A · 2003 [cited by applicant]
CN 1804744A · 2006 [cited by applicant]
CN 101221635A · 2008 [cited by examiner]
CN 201854979U · 2010 [cited by applicant]
CN 102609435A · 2012 [cited by examiner]
CN 103416023A · 2013 [cited by applicant]
CN 103609071A · 2014 [cited by applicant]
CN 103677804A · 2014 [cited by applicant]
JP 200256163A · 2002 [cited by applicant]
JP 2004240954A · 2004 [cited by applicant]
JP 2005204099A · 2005 [cited by applicant]
JP 2009533138A · 2009 [cited by applicant]
JP 2010279498A · 2010 [cited by applicant]
JP 2012208747A · 2012 [cited by applicant]
JP 201392997A · 2013 [cited by applicant]
JP 2013531839A · 2013 [cited by applicant]
WO WO2005074634A2 · 2005 [cited by examiner]
WO 2008073025A1 · 2008 [cited by applicant]
WO WO2011160715A1 · 2011 [cited by examiner]
WO 2014024442A1 · 2014 [cited by applicant]
WO 2015174058A1 · 2015 [cited by applicant]
Ren Omura, and one member, “Construction of Sensor Network Application Platform according to Twitter and ECA Rule”, Collection of Multimedia, Distributed, Cooperative, and Mobile (DICOMO 2012) Symposium, The Information… [cited by applicant]
“Let's Move robot through Internet, Lego Mindstorms Robolab”, Internet magazine, Impress, Inc., Apr. 1, 2001, No. 75, pp. 332-333. [cited by applicant]
Masayuki Iwai, et al., “A Study of Distributed Application Composition through Multiple and Multimodal User Interface”, Computer Software, Japan Society for Software Science and Technology, Jan. 27, 2004, vol. 21, No. 1… [cited by applicant]
Japanese Office Action issued Apr. 14, 2020 in Japanese Application No. 2019-078326. [cited by applicant]
Office Action and Search Report issued in Chinese Application 201580024150.9 dated Nov. 21, 2019. [cited by applicant]
European Office Action mailed Aug. 15, 2018 in European Application No. 157267 44.4-1221. [cited by applicant]
Office Action issued Jun. 26, 2018 in Japanese Patent Application No. 2014-101507. [cited by applicant]
International Search Report issued Sep. 1, 2015, PCT/JP2015/002350 filed May 8, 2015. [cited by applicant]
Japanese Office Action issued Jan. 30, 2018 in Patent Application No. 2014-101507. [cited by applicant]
Koji Tsukada, “Simple Middleware for Sunday Ubiquitous”, Computer Software, Japan Society for Software Science and Technology, Jan. 26, 2010, vol. 27. No. 1, pp. 3-17. with English abstract, 19 pages. [cited by applicant]
European Communication Article 94(3) issued in corresponding European Application No. 15726744.4, dated Aug. 15, 2018, 9 pages. [cited by applicant]
Office Action issued in Japanese Application 2014-101507 dated Jan. 29, 2019. [cited by applicant]
Tsukada, K., et al., “Lightweight Middleware for Developing Ubiquitous Interfaces” Japan Society for Software Science and Technology, vol. 27, No. 1, 20 Pages total, (Jan. 26, 2010). [cited by applicant]