IP Library Granted Patent US 12,229,998
Granted Patent B2
US 12,229,998 · App. 17/583,605 · Granted Feb 18, 2025

Electronic apparatus and controlling method thereof

Inventors: Jaesung Park (Suwon-si, KR); Jiman Kim (Suwon-si, KR); Junhee Woo (Suwon-si, KR); Seongwoon Jung (Suwon-si, KR); Junghwa Choi (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/90G06T7/30G06V10/56H04N9/3111H04N9/3182G06T2200/24G06T2207/10024G06T2207/20068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,998
App. No.
17/583,605
Granted
Feb 18, 2025
Kind
B2
Abstract

An electronic apparatus is disclosed. The electronic apparatus includes: a memory storing a first pattern image and a second pattern image, a communication interface comprising communication circuitry configured to communicate with an external terminal apparatus, a projection part including a projection lens, and a processor configured to: control the projection part to project the first pattern image on a screen member comprising a reflector located on a projection surface, and based on receiving a first photographed image which photographed the screen member from the external terminal apparatus through the communication interface, acquire transformation information based on the first photographed image and the first pattern image, control the projection part to project the second pattern image on the projection surface, and based on receiving a second photographed image which photographed the projection surface from the external terminal apparatus through the communication interface, perform color calibration based on the characteristic of the projection surface based on the second photographed image, the second pattern image, and the transformation information.

Claims (63)

1. An electronic apparatus comprising:

memory storing a first pattern image and a second pattern image;

a communication interface comprising communication circuitry configured to communicate with an external terminal apparatus;

a projector; and

at least one processor configured to:

control the projector to project the first pattern image on a screen member overlaid onto at least a portion of a projection surface, wherein the screen member comprises a white reflector which is separate from the projection surface,

receive a first photographed image which includes the screen member on which the first pattern image is projected from the external terminal apparatus through the communication interface,

acquire color space transformation information based on the first photographed image and color space information corresponding to the first pattern image,

control the projector to project the second pattern image on the projection surface without the screen member being overlaid,

receive a second photographed image which includes the projection surface without the screen member being overlaid on which the second pattern image is projected from the external terminal apparatus through the communication interface, and

perform color calibration of an image to be projected on the projection surface according to a characteristic of the projection surface based on the second photographed image, color space information corresponding to the second pattern image, and the color space transformation information.

2. The electronic apparatus of claim 1 ,

wherein the at least one processor is configured to:

acquire the color space transformation information based on red, green blue (RGB) information corresponding to the first photographed image and XYZ color space information corresponding to the first pattern image.

3. The electronic apparatus of claim 1 ,

wherein the color space transformation information comprises a color space transformation matrix transforming RGB information into XYZ color space information.

4. The electronic apparatus of claim 1 ,

wherein the at least one processor is configured to:

transform RGB information corresponding to the second photographed image into XYZ color space information based on the color space transformation information,

acquire a color difference between the XYZ color space information corresponding to the second photographed image and XYZ color space information corresponding to the second pattern image, and

perform the color calibration based on the acquired color difference.

5. The electronic apparatus of claim 4 ,

wherein the at least one processor is configured to:

change at least one of a gain value or an offset value related to an RGB signal based on the acquired color difference.

6. The electronic apparatus of claim 1 ,

wherein the at least one processor is configured to:

based on identifying that a predetermined object related to the screen member is included in the first photographed image, acquire the color space transformation information based on the first photographed image, and

based on identifying that a predetermined object related to the screen member is not included in the first photographed image, control the projector to project a user interface (UI) including information that the screen member is not recognized.

7. The electronic apparatus of claim 1 ,

wherein the first pattern image includes at least one of a white pattern image, a red pattern image, a green pattern image, or a blue pattern image, and

the second pattern image includes a white pattern image.

8. The electronic apparatus of claim 7 ,

wherein the at least one processor is configured to:

control the projector to project the white pattern image included in the first pattern image first, and project remaining pattern images sequentially.

9. A method of controlling an electronic apparatus storing a first pattern image and a second pattern image and communicating with an external terminal apparatus, the method comprising:

projecting the first pattern image on a screen member overlaid onto at least a portion of a projection surface, wherein the screen member comprises a white reflector which is separate from the projection surface;

receiving a first photographed image which includes the screen member on which the first pattern image is projected from the external terminal apparatus;

acquiring color space transformation information based on the first photographed image and color space information corresponding to the first pattern image;

projecting the second pattern image on the projection surface without the screen member being overlaid;

receiving a second photographed image which includes the projection surface without the screen member being overlaid on which the second pattern image is projected from the external terminal apparatus; and

performing color calibration of an image to be projected on the projection surface according to a characteristic of the projection surface based on the second photographed image, color space information corresponding to the second pattern image, and the color space transformation information.

10. The method of claim 9 ,

wherein the acquiring the transformation information comprises:

acquiring the color space transformation information based on red green blue (RGB) information corresponding to the first photographed image and XYZ color space information corresponding to the first pattern image.

11. The method of claim 9 ,

wherein the color space transformation information is a color space transformation matrix transforming RGB information into XYZ color space information.

12. The method of claim 9 ,

wherein the performing the color calibration comprises:

transforming RGB information corresponding to the second photographed image into XYZ color space information based on the color space transformation information,

acquiring a color difference between the XYZ color space information corresponding to the second photographed image and XYZ color space information corresponding to the second pattern image, and

performing the color calibration based on the acquired color difference.

13. The method of claim 12 ,

wherein the performing the color calibration comprises:

changing at least one of a gain value or an offset value related to an RGB signal based on the acquired color difference.

14. The method of claim 9 , further comprising:

based on identifying that a predetermined object related to the screen member is included in the first photographed image, acquiring the color space transformation information based on the first photographed image, and

based on identifying that a predetermined object related to the screen member is not included in the first photographed image, projecting a user interface (UI) including information that the screen member is not recognized.

15. The method of claim 9 ,

wherein the first pattern image includes at least one of a white pattern image, a red pattern image, a green pattern image, or a blue pattern image, and

the second pattern image includes a white pattern image.

16. The method of claim 15 ,

wherein the projecting the first pattern image comprises:

projecting the white pattern image included in the first pattern image first, and projecting remaining pattern images sequentially.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2022
From: PARK, JAESUNG; KIM, JIMAN; WOO, JUNHEE; JUNG, SEONGWOON; CHOI, JUNGHWA
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 058759/0661 →
Priority Claims (2)
KR 10-2021-0052220 · Apr 22, 2021 · national
KR 10-2021-0144246 · Oct 27, 2021 · national
Continuity (2)
Continuation PCTKR2022000018 · Jan 3, 2022
Related Publication 20220343541A1 · Oct 27, 2022
References Cited (28)
US 7822269B2 · Tsukada · 2010 [cited by applicant]
US 9022576B2 · Jeong et al. · 2015 [cited by applicant]
US 10080004B2 · Grundhofer · 2018 [cited by applicant]
US 10225464B2 · Narikawa · 2019 [cited by applicant]
US 10694160B2 · Tait et al. · 2020 [cited by applicant]
US 20030164927A1 · Tsukada · 2003 [cited by examiner]
US 20030234785A1 · Matsuda et al. · 2003 [cited by applicant]
US 20040140982A1 · Pate · 2004 [cited by examiner]
US 20070110304A1 · Tsukada · 2007 [cited by applicant]
US 20100171933A1 · Kim et al. · 2010 [cited by applicant]
US 20130113975A1 · Gabris · 2013 [cited by examiner]
US 20170344543A1 · Inata · 2017 [cited by examiner]
US 20180160086A1 · Naganuma · 2018 [cited by applicant]
US 20190297306A1 · Narikawa · 2019 [cited by applicant]
JP 4120841 · 2008 [cited by applicant]
JP 2012068364 · 2012 [cited by applicant]
JP 2017059903 · 2017 [cited by applicant]
KR 100852664 · 2008 [cited by applicant]
KR 100866882 · 2008 [cited by applicant]
KR 1020100081040 · 2010 [cited by applicant]
KR 1020110095556 · 2011 [cited by applicant]
KR 1020150054452 · 2015 [cited by applicant]
KR 1020180042030 · 2018 [cited by applicant]
Search Report and Written Opinion dated May 3, 2022 in counterpart International Patent Application No. PCT/KR2022/000018 and English-language translation. [cited by applicant]
“Colorful Walls, No Screen, but Still Want a Projector? It's Possible!”, Oct. 7, 2019 https://www.benq.com/en-us/knowledge-center/knowledge/colorful-office-walls-no-screen-but-still-want-a-projector-it.html, 4 pages. [cited by applicant]
Brown, “From RAW to sRGB and Back: Modeling the Onboard Camera Processing Pipeline”, Tutorial #3 International Conference on Image Processing (ICIP'13), Sep. 15, 2013, 258 pages. [cited by applicant]
Extended Search Report dated Apr. 30, 2024 in European Patent Application No. 22791841.4. [cited by applicant]
Sadlo et al: “A practical structured light acquisition system for point-based geometry and texture”, Point-based Graphics, 2005. Eurographics/IEEE VGTC Symposium Proceedings, IEEE, Jun. 21, 2005, 10 pages. [cited by applicant]