IP Library › Granted Patent US 12,062,233
Granted Patent B2
US 12,062,233 · App. 17/278,512 · Granted Aug 13, 2024

Information processing apparatus and information processing method

Inventors: Miki Tokitake (Tokyo, JP); Hiroaki Toriumi (Tokyo, JP); Katsuji Miyazawa (Tokyo, JP); Shoji Watanabe (Tokyo, JP); Tetsuo Ikeda (Tokyo, JP); Yoshihito Ichiyama (Tokyo, JP)
Assignee: SONY CORPORATION
G06V20/20G03B21/26G06F3/0425G06V20/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,062,233
App. No.
17/278,512
Granted
Aug 13, 2024
Kind
B2
Abstract

There is provided an information processing apparatus including a projection control unit ( 150 ) that causes visual information to be projected onto a projection surface. The visual information corresponds to content that is provided to the projection surface and disposed on a first object. The content is identified on the basis of a recognition result of the first object and a recognition result of a second object. The second object is provided along with the first object.

Claims (67)

1. An information processing apparatus, comprising:

a processor configured to:

recognize a size of a first object from an image, wherein

the first object is on a projection surface, and

the first object includes content;

recognize a second object from the image, wherein the second object is on the projection surface;

determine the recognized size of the first object is not in a first range;

identify, based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the first range, the content that is on the projection surface; and

control projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the first range, wherein the visual information corresponds to the identified content that is on the projection surface.

2. The information processing apparatus according to claim 1 , wherein the second object is associated with each piece of a plurality of pieces of the content.

3. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

continuously recognize the first object and the second object; and

dynamically control the projection of the visual information onto the projection surface based on the continuous recognition of the first object and the second object.

4. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

recognize a position of the first object and a position of the second object; and

control the projection of the visual information corresponding onto the projection surface based on the position of the first object and the position of the second object.

5. The information processing apparatus according to claim 4 , wherein

the processor is further configured to control the projection of the visual information onto the projection surface based on the position of the first object in a case where the position of the second object is not in a second range, and

the position of the second object is based on the position of the first object.

6. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

recognize a state change in the content; and

control the projection of the visual information onto the projection surface based on the state change.

7. The information processing apparatus according to claim 6 , wherein

the state change includes a mass change in the content, and

the processor is further configured to control the projection of the visual information corresponding to the mass change onto the projection surface.

8. The information processing apparatus according to claim 1 , wherein the visual information is associated with each piece of a plurality of pieces of the content.

9. The information processing apparatus according to claim 1 , wherein the processor is further configured to control the projection the visual information onto the first object.

10. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

recognize a third object; and

control the projection of the visual information onto the projection surface based on a recognition result of the third object.

11. The information processing apparatus according to claim 10 , wherein

the processor is further configured to control the projection of the visual information onto the projection surface based on interaction of the third object with at least one of the first object or the second object, and

the interaction indicates that the third object one of comes closer to or comes into contact with the at least one of the first object or the second object.

12. The information processing apparatus according to claim 1 , wherein the processor is further configured to control the projection of the visual information onto the projection surface based on a time elapsed since the projection of the visual information corresponding to the identified content is started.

13. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

identify a plurality of pieces of the content; and

control the projection of the visual information corresponding to the plurality of pieces of the content onto the projection surface.

14. The information processing apparatus according to claim 1 , wherein

the content includes a food product, and

the second object is on the food product.

15. The information processing apparatus according to claim 14 , wherein the processor is further configured to control the projection of the visual information onto the projection surface to be started at a timing of provision of the food product.

16. An information processing method, comprising:

recognizing, by a processor, a size of a first object from an image, wherein

the first object is on a projection surface, and

the first object includes content;

recognizing, by the processor, a second object from the image, wherein the second object is on the projection surface;

determining, by the processor, the recognized size of the first object is not in a specific range;

identifying, by the processor, the content that is on the projection surface, wherein the identification is based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the specific range; and

controlling, by the processor, projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the specific range, wherein the visual information corresponds to the identified content that is on the projection surface.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

recognizing a size of a first object from an image, wherein

the first object is on a projection surface, and

the first object includes content;

recognizing a second object from the image, wherein the second object is on the projection surface;

determining the recognized size of the first object is not in a specific range;

identifying, based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the specific range, the content that is on the projection surface; and

controlling projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the specific range, wherein the visual information corresponds to the identified content that is on the projection surface.

18. An information processing apparatus, comprising:

a processor configured to:

recognize a position of a first object from an image, wherein

the first object is on a projection surface, and

the first object includes content;

recognize a position of a second object from the image, wherein

the second object is on the projection surface, and

the position of the second object is based on the position of the first object;

determine the position of the second object is not in a specific range; and

control projection of visual information onto the projection surface, based on the position of the first object and the determination that the position of the second object is not in the specific range, wherein the visual information corresponds to the content that is on the projection surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: TOKITAKE, MIKI; TORIUMI, HIROAKI; MIYAZAWA, KATSUJI; WATANABE, SHOJI; IKEDA, TETSUO; ICHIYAMA, YOSHIHITO
To: SONY CORPORATION
Reel/Frame 056658/0215 →
Priority Claims (1)
JP 2018-186422 · Oct 1, 2018 · national
Continuity (1)
Related Publication 20220036076A1 · Feb 3, 2022
Cited By (1)
US 12,361,476