IP Library › Granted Patent US 12,244,934
Granted Patent B2
US 12,244,934 · App. 17/728,421 · Granted Mar 4, 2025

System on chip and mobile device including the same

Inventors: Sun-Ae Kim (Yongin-si, KR); Seong Woon Kim (Suwon-si, KR); Kil Whan Lee (Seoul, KR); Sang Hoon Lee (Seoul, KR); Yong Kwon Cho (Yongin-si, KR); Sang Hoon Ha (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N23/741G06T1/20G06T1/60G06T5/92G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,244,934
App. No.
17/728,421
Granted
Mar 4, 2025
Kind
B2
Abstract

A system on chip and a mobile device are provided, the mobile device including a processor that receives raw image data, processes the raw image data into floating-point format image data, and output the floating-point format image data; a memory that stores therein the floating-point format image data; and a display processing unit that receives the floating-point format image data stored in the memory therefrom, and performs high dynamic range (HDR) processing on the floating-point format image data.

Claims (71)

1. A mobile device comprising:

a processor configured to

receive raw image data,

process the raw image data into processed image data comprising one of floating-point format image data and fixed-point format image data, and

output the processed image data;

a memory configured to store therein the processed image data; and

a display processing unit configured to

receive the processed image data stored in the memory,

perform high dynamic range (HDR) processing on the processed image data comprising the floating-point format image data through a first path of the display processing unit, and

perform integer image processing on the processed image data comprising the fixed-point format image data through a second path of the display processing unit that is different than the first path.

2. The mobile device of claim 1 , wherein the processor includes a graphic processing unit configured to perform rendering on the raw image data and output the floating-point format image data as a rendering result.

3. The mobile device of claim 1 , wherein the processor includes an image signal processor configured to process the raw image data generated from a plurality of camera modules into the floating-point format image data and output the floating-point format image data.

4. The mobile device of claim 1 , wherein the display processing unit includes a floating-point image processing unit configured to perform floating-point arithmetic related to the HDR processing,

wherein the floating-point format image data stored in the memory is not subjected to a separate conversion process and the floating-point format image data is directly transferred from the memory to the floating-point image processing unit.

5. The mobile device of claim 4 , wherein the floating-point arithmetic includes color gamut mapping and tone mapping.

6. The mobile device of claim 4 , wherein the display processing unit further includes:

an integer image processing unit configured to perform integer arithmetic; and

an interfacing device for receiving the processed image data from the memory,

wherein the interfacing device is configured to perform at least one of

in response to the processed image data provided from the memory being the floating-point format image data, provide the floating-point format image data to the floating-point image processing unit; or

in response to the processed image data provided from the memory being fixed-point format image data, provide the fixed-point format image data to the integer image processing unit.

7. The mobile device of claim 6 , wherein the mobile device further comprises a converter configured to

receive the floating-point format image data from the interfacing device,

convert the floating-point format image data into second fixed-point format image data, and then

provide the second fixed-point format image data to the integer image processing unit.

8. The mobile device of claim 1 , wherein the processor includes a multi format codec configured to encode or decode the raw image data into the processed image data comprising the floating-point format image data and output the floating-point format image data.

9. The mobile device of claim 1 , wherein the mobile device further comprises:

a display driver integrated circuit configured to generate data voltage based on an output of the display processing unit; and

a display panel configured to display an image based on the data voltage.

10. A mobile device comprising:

a memory configured to store therein floating-point format image data; and

a display processing unit configured to

receive the floating-point format image data stored in the memory, and

perform high dynamic range (HDR) processing on the floating-point format image data,

wherein the display processing unit includes

an integer image processing unit configured to perform integer arithmetic, and

a first converter configured to

receive the floating-point format image data,

convert the floating-point format image data into fixed-point format image data, and

provide the fixed-point format image data to the integer image processing unit.

11. The mobile device of claim 10 , wherein the display processing unit further includes:

a second converter configured to receive an output of the integer image processing unit and convert the received output into floating-point format image data; and

a first multiplexer configured to select one of the floating-point format image data provided from the memory and the floating-point format image data output from the second converter.

12. The mobile device of claim 11 , wherein the display processing unit further includes:

a floating-point image processing unit configured to receive the selected one of the floating-point format image data from the first multiplexer and perform floating-point arithmetic related to the HDR processing on the selected one; and

a second multiplexer configured to select one of an output of the integer image processing unit and an output of the floating-point image processing unit.

13. The mobile device of claim 10 , wherein the display processing unit further includes an interfacing device for receiving image data from the memory,

wherein the interfacing device is configured to perform at least one of:

in response to the image data provided from the memory being the floating-point format image data, provide the floating-point format image data to the first converter; or

in response to the image data provided from the memory being the fixed-point format image data, provide the fixed-point format image data to the integer image processing unit.

14. The mobile device of claim 10 , wherein the HDR processing includes color gamut mapping and tone mapping.

15. The mobile device of claim 10 , wherein the mobile device further comprises a graphic processing unit configured to perform rendering on raw image data and generate the floating-point format image data as a rendering result and store the generated floating-point format image data in the memory.

16. The mobile device of claim 10 , wherein the mobile device further comprises an image signal processor configured to process raw image data generated from a plurality of camera modules to generate the floating-point format image data, and store the floating-point format image data in the memory.

17. The mobile device of claim 10 , wherein the mobile device further comprises a multi format codec configured to encode or decode raw image data to generate the floating-point format image data and store the floating-point format image data in the memory.

18. A system on chip (SoC) comprising:

a processor configured to

receive raw image data,

process the raw image data to provide processed image data, and

store the processed image data in a memory;

an integer image processing unit configured to perform integer arithmetic;

a floating-point image processing unit configured to perform floating-point arithmetic related to high dynamic range (HDR) processing; and

an interfacing device for receiving the processed image data from the memory,

wherein the interfacing device is configured to perform at least one of:

in response to the processed image data provided from the memory being floating-point format image data, directly provide the floating-point format image data to the floating-point image processing unit; or

in response to the processed image data provided from the memory being fixed-point format image data, provide the fixed-point format image data to the integer image processing unit.

19. The SoC of claim 18 further comprising a first converter configured to receive the floating-point format image data, convert the floating-point format image data into fixed-point format image data and provide the fixed-point format image data to the integer image processing unit,

wherein the interfacing device is configured to, in response to the processed image data provided from the memory being the floating-point format image data, provide the floating-point format image data to the first converter.

20. The SoC of claim 19 further comprising:

a second converter configured to receive an output of the integer image processing unit and convert converts the received output into floating-point format image data;

a first multiplexer configured to select one of the floating-point format image data provided from the memory and the floating-point format image data output from the second converter; and

a second multiplexer configured to select one of the output of the integer image processing unit and an output of the floating-point image processing unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2022
From: KIM, SUN-AE; KIM, SEONG WOON; LEE, KIL WHAN; LEE, SANG HOON; CHO, YONG KWON; HA, SANG HOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059746/0472 →
Priority Claims (1)
KR 10-2021-0118305 · Sep 6, 2021 · national
Continuity (1)
Related Publication 20230070191A1 · Mar 9, 2023
References Cited (10)
US 8593480B1 · Ballestad et al. · 2013 [cited by applicant]
US 8879628B2 · Tourapis et al. · 2014 [cited by applicant]
US 10009613B2 · Seifi et al. · 2018 [cited by applicant]
US 10187622B1 · Chappalli et al. · 2019 [cited by applicant]
US 10277771B1 · Haynold · 2019 [cited by examiner]
US 10432952B2 · Jacobson et al. · 2019 [cited by applicant]
US 10674150B2 · Baylon et al. · 2020 [cited by applicant]
US 10681321B2 · Sun et al. · 2020 [cited by applicant]
US 10979729B2 · Rusanovskyy et al. · 2021 [cited by applicant]
US 20210365230A1 · Sul · 2021 [cited by examiner]