IP Library Granted Patent US 11,326,768
Granted Patent B2
US 11,326,768 · App. 16/315,839 · Granted May 10, 2022

Apparatus for providing semantic information and a method of operating the same

Inventors: Vincentius Paulus Buil (Veldhoven, NL); Frederik Jan De Bruijn (Eindhoven, NL); Daniel Willem Elisabeth Schobben (Waalre, NL)
Assignee: KONINKLIJKE PHILIPS N.V.
F21V23/0464A47G1/02F21V23/0478A47G2200/08F21W2131/302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,326,768
App. No.
16/315,839
Granted
May 10, 2022
Kind
B2
Abstract

An apparatus including a display surface for presenting an image of a user; a light emitting portion for using light to convey semantic information to the user; a sensor for measuring the position of the user relative to the light emitting portion; and a control unit to control the light emitting portion based on the measured position of the user relative to the light emitting portion so as to minimize an effect of the light conveying the semantic information provided by the light emitting portion on the presented image of the user.

Claims (26)

1. A method of operating an apparatus to convey semantic information to a user of the apparatus, the apparatus comprising a display surface configured to display a real-time image of the user, the method comprising:

measuring a position of the user relative to a light emitting portion;

determining semantic information, regarding at least one of a timing and a quality of a performed personal care activity by monitoring the performance of the personal care activity by the user; and

controlling the light emitting portion to emit light to convey to the user the determined at least one of the timing and the quality of the monitored personal care activity, wherein controlling the light emitting portion comprises controlling the light emitting portion to minimize a shadowing and/or color-casting effect of the light conveying the semantic information on the user and a real-time image of the user presented on the display surface based on the measured position of the user relative to the light emitting portion.

2. The method as claimed in claim 1 , wherein the controlling comprises controlling the light emitting portion by adjusting a brightness or intensity of the light used to convey the semantic information based on the measured position of the user relative to the light emitting portion, and presenting the semantic information as an updated indication of at least one of the timing and the quality of the personal care activity as the personal care activity of the user progresses.

3. The method as claimed in claim 1 , wherein the light emitting portion comprises a plurality of light emitting diodes and the controlling comprises determining the quality of the personal care activity and controlling the light emitting portion to convey the determined quality as lit proportionate numbers of the plurality of light emitting diodes as the personal care activity of the user progresses.

4. The method as claimed in claim 1 , wherein the light emitting portion comprises a plurality of light emitting elements that convey the semantic information, and wherein the controlling comprises determining the timing of the personal care activity and controlling the plurality of light emitting elements to convey the determined timing as lit proportionate numbers of the plurality of light emitting diodes as the personal care activity of the user progresses.

5. The method as claimed in claim 1 , wherein the light emitting portion comprises an adjustable optical arrangement and a plurality of light emitting elements that convey the semantic information, and the controlling comprises controlling the adjustable optical arrangement to change a light emission angle or focus of the light emitted by the light emitting elements based on the measured position of the user relative to the light emitting portion.

6. The method as claimed in claim 1 , wherein the method further comprises:

obtaining one or more images or a video sequence of the monitored personal care activity of the user of the apparatus;

analyzing the obtained one or more images or video sequence to determine a shadowing and/or color-casting effect of light conveying the semantic information on the user and/or to determine an evenness of lighting on the user; and

wherein the controlling comprises controlling the light emitting portion to minimize the shadowing and/or color-casting effect of the light conveying the semantic information provided by the light emitting portion on the user and the presented real-time image of the user based on the measured position of the user relative to the light emitting portion and the determined effect of the light and/or determined evenness of the lighting.

7. The method as claimed in claim 1 , wherein the method further comprises:

detecting an ambient light level or contribution of ambient light; and

wherein the controlling comprises controlling the light emitting portion to minimize the shadowing and/or color-casting effect of the semantic information provided by the light emitting portion on the user and the presented real-time image of the user based on the detected ambient light and the measured position of the user relative to the light emitting portion or the detected contribution of ambient light and the measured position of the user relative to the light emitting portion.

8. A tangible computer-readable storage media that is not a transitory propagating signal or wave, comprising control instructions for a method of operating an apparatus to convey semantic information to a user of the apparatus, the apparatus comprising a display surface configured to display a real-time image of the user, the method comprising:

determining a position of the user relative to a light emitting portion;

determining semantic information, regarding at least one of a timing and a quality of a performed personal care activity by monitoring the performance of the personal care activity by the user; and

controlling the light emitting portion to emit light to convey to the user the determined at least one of the timing and the quality of the monitored personal care activity, wherein controlling the light emitting portion comprises controlling the light emitting portion to minimize a shadowing and/or color-casting effect of the light conveying the semantic information on the user and a real-time image of the user presented on the display surface based on the determined position of the user relative to the light emitting portion.

9. The tangible computer-readable storage media as claimed in claim 8 , wherein the controlling comprises controlling the light emitting portion by adjusting a brightness or intensity of the light used to convey the semantic information based on the measured position of the user relative to the light emitting portion, and presenting the semantic information as an updated indication of at least one of the timing and the quality of the personal care activity as the personal care activity of the user progresses.

10. The tangible computer-readable storage media as claimed in claim 8 , wherein the light emitting portion comprises a plurality of light emitting diodes and the controlling comprises determining the quality of the personal care activity and controlling the light emitting portion to convey the determined quality as lit proportionate numbers of the plurality of light emitting diodes as the personal care activity of the user progresses.

11. The tangible computer-readable storage media as claimed in claim 8 , wherein the light emitting portion comprises a plurality of light emitting elements that convey the semantic information, and wherein the controlling comprises determining the timing of the personal care activity and controlling the plurality of light emitting elements to convey the determined timing as lit proportionate numbers of the plurality of light emitting diodes as the personal care activity of the user progresses.

12. The tangible computer-readable storage media as claimed in claim 8 , wherein the method further comprises:

obtaining one or more images or a video sequence of the monitored personal care activity of the user of the apparatus;

analyzing the obtained one or more images or video sequence to determine a shadowing and/or color-casting effect of light conveying the semantic information on the user and/or to determine an evenness of lighting on the user; and

wherein the controlling comprises controlling the light emitting portion to minimize the shadowing and/or color-casting effect of the light conveying the semantic information provided by the light emitting portion on the user and the presented real-time image of the user based on the measured position of the user relative to the light emitting portion and the determined effect of the light and/or determined evenness of the lighting.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2019
From: BUIL, VINCENTIUS PAULUS; DE BRUIJN, FREDERIK JAN; SCHOBBEN, DANIEL WILLEM ELISABETH
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 047932/0950 →
Priority Claims (1)
EP 16178600 · Jul 8, 2016 · regional
Continuity (1)
Related Publication 20200109845A1 · Apr 9, 2020