IP Library › Granted Patent US 12,356,035
Granted Patent B2
US 12,356,035 · App. 18/485,572 · Granted Jul 8, 2025

Apparatus and method with artificial intelligence for scaling image data

Inventors: Taejun Park (Suwon-si, KR); Sangjo Lee (Suwon-si, KR); Sangkwon Na (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N21/2662G06T3/4007H04N19/115H04N19/117H04N19/157H04N19/439H04N19/82G06T9/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,035
App. No.
18/485,572
Granted
Jul 8, 2025
Kind
B2
Abstract

The disclosure relates to an artificial intelligence (AI) system that uses a machine learning algorithm and an application thereof. A method for controlling an electronic apparatus according to the disclosure includes receiving image data and information associated with a filter set that is applied to an artificial intelligence model for upscaling the image data from an external server; decoding the image data; upscaling the decoded image data using a first artificial intelligence model that is obtained based on the information associated with the filter set; and providing the upscaled image data for output.

Claims (31)

1. A server comprising:

a memory; and

a processor configured to:

obtain downscaled image data by downscaling original image data;

based on a multi-artificial intelligence (AI) filter option being turned on, obtain a plurality of upscaled image data by respectively inputting the downscaled image data into a plurality of artificial intelligence (AI) upscaling models stored in the memory, identify a filter index among a plurality of filter indexes of the plurality of AI upscaling models by comparing the original image data and each of the plurality of upscaled image data, and encode the downscaled image data based on the identified filter index, the identified filter index being a filter index of an AI upscaling model among the plurality of AI upscaling models; and

based on the multi-AI filter option not being turned on, encode the downscaled image data based on a value indicating that no filter index is used.

2. The server of claim 1 , the processor is further configured to:

obtain a plurality of differences by comparing the original image data and the each of the plurality of upscaled image data, and

identify the filter index of the AI upscaling model corresponding to a minimum difference among the plurality of differences.

3. The server of claim 1 , further comprising:

a communication interface comprising communication circuitry,

wherein the processor is further configured to control the communication interface to transmit the encoded image data to an electronic apparatus.

4. The server of claim 1 , wherein each of the plurality of AI upscaling models comprises a plurality of filter sets.

5. The server of claim 4 , wherein parameters of the plurality of filter sets are trained to reduce a difference between the plurality of upscaled image data and the original image data.

6. The server of claim 1 , wherein the processor is further configured to obtain the downscaled image data by inputting the original image data into an AI downscaling model for downscaling image data.

7. The server of claim 6 , wherein a number of filters of the AI upscaling model is smaller than a number of filters of the AI downscaling model.

8. The server of claim 1 , wherein the plurality of AI upscaling models are a Convolutional Neural Network (CNN).

9. A method for controlling a server, the method comprising:

obtaining downscaled image data by downscaling original image data;

based on a multi-artificial intelligence (AI) filter option being turned on, obtaining a plurality of upscaled image data by respectively inputting the downscaled image data into a plurality of artificial intelligence (AI) upscaling models;, identifying a filter index among a plurality of filter indexes of the plurality of AI upscaling models by comparing the original image data and each of the plurality of upscaled image data, and encoding the downscaled image data based on the identified filter index, the identified filter index being a filter index of an AI upscaling model among the plurality of AI upscaling models; and

based on the multi-AI filter option not being turned on, encoding the downscaled image data based on a value indicating that no filter index is used.

10. The method of claim 9 , the identifying comprises:

obtaining a plurality of differences by comparing the original image data and the each of the plurality of upscaled image data, and

identifying the filter index of the AI upscaling model corresponding to a minimum difference among the plurality of differences.

11. The method of claim 9 , further comprising:

transmitting the encoded image data to an electronic apparatus.

12. The method of claim 9 , wherein each of the plurality of AI upscaling models comprises a plurality of filter sets.

13. The method of claim 12 , wherein parameters of the plurality of filter sets are trained to reduce a difference between the plurality of upscaled image data and the original image data.

14. The method of claim 9 , wherein the obtaining the downscaled image data comprises obtaining the downscaled image data by inputting the original image data into an AI downscaling model for downscaling image data.

15. The method of claim 14 , wherein a number of filters of the AI upscaling model is smaller than a number of filters of the AI downscaling model.

16. The method of claim 9 , wherein the plurality of AI upscaling models are a Convolutional Neural Network (CNN).

Priority Claims (1)
KR 10-2018-0093511 · Aug 10, 2018 · national
Continuity (3)
Continuation 17496507 · Oct 7, 2021
Continuation 16535784 · Aug 8, 2019
Related Publication 20240040179A1 · Feb 1, 2024
References Cited (42)
US 5134396A · Sirat et al. · 1992 [cited by applicant]
US 7956930B2 · Sullivan · 2011 [cited by applicant]
US 9491479B2 · Zhao · 2016 [cited by applicant]
US 10009622B1 · Mukherjee · 2018 [cited by examiner]
US 20050091524A1 · Abe · 2005 [cited by applicant]
US 20090034622A1 · Huchet · 2009 [cited by examiner]
US 20130129240A1 · Shima · 2013 [cited by applicant]
US 20140010294A1 · Ye et al. · 2014 [cited by applicant]
US 20180183998A1 · Menachem et al. · 2018 [cited by applicant]
US 20180184102A1 · Navarrete Michelini et al. · 2018 [cited by applicant]
US 20190124348A1 · Yang · 2019 [cited by applicant]
US 20190347541A1 · Li · 2019 [cited by examiner]
US 20200228820A1 · Joshi · 2020 [cited by examiner]
CN 107194347A · 2017 [cited by applicant]
CN 108305214A · 2018 [cited by applicant]
JP 6197227A · 1994 [cited by applicant]
KR 1020180007239A · 2018 [cited by applicant]
KR 1020180050832A · 2018 [cited by applicant]
TW 200611573A · 2006 [cited by applicant]
WO 2016132145A1 · 2016 [cited by applicant]
WO 2018112514A1 · 2018 [cited by applicant]
WO 2018120082A1 · 2018 [cited by applicant]
Communication dated Feb. 1, 2019, issued by the Korean Intellectual Property Office in corresponding Korean Application No. 10-2018-0093511. [cited by applicant]
Communication dated Sep. 9, 2020 issued by the European Intellectual Property Office in counterpart European Application No. 19 762 283.0. [cited by applicant]
Yongwoo Kim et al. “A Real-Time Convolutional Neural Networks for Super-Resolution on FPGA with Applications to 4K UHD 60 fps Video Services” IEEE Transactions on Circuits and Systems for Video Technology, 2018, (pp. 1-… [cited by applicant]
Communication issued by the European Patent Office dated May 13, 2022 in EP Application No. 19762283.0. [cited by applicant]
Communication dated Jan. 10, 2020, from the European Patent Office in counterpart European Application No. 19762283.0. [cited by applicant]
International Search Report (PCT/ISA/210), issued by International Searching Authority in corresponding International Application No. PCT/KR2019/010034, on Nov. 18, 2019. [cited by applicant]
Communication dated Sep. 17, 2021, issued by the European Patent Office in counterpart European Application No. 19 762 283.0. [cited by applicant]
Communication issued by the European Patent Office dated Apr. 13, 2022 in EP Application No. 19762283.0. [cited by applicant]
Communication dated Jul. 17, 2020 issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201910738429.3. [cited by applicant]
Office Action issued Jan. 8, 2021 by the China National Intellectual Property Administration in corresponding Chinese Application No. 201910738429.3. [cited by applicant]
Reexamination Notification issued Aug. 19, 2022 by the Chinese Patent Office for Chinese Patent Application No. 201910738429.3. [cited by applicant]
Reexamination Decision, dated Nov. 29, 2022 issued by the Chinese Patent Office for Chinese Patent Application No. 201910738429.3. [cited by applicant]
Communication dated Mar. 31, 2022 issued by the Chinese Patent Office in CN Application No. 201910738429.3. [cited by applicant]
Communication dated Apr. 25, 2021, from The China National Intellectual Property Administration in Application No. 201910738429.3. [cited by applicant]
Communication dated Mar. 27, 2021, from the Intellectual Property Office of India in Application No. 201947042000. [cited by applicant]
Written Opinion (PCT/ISA/237) issued by the International Searching Authority in corresponding International Application No. PCT/KR2019/010034, on Nov. 18, 2019. [cited by applicant]
Office Action, dated Feb. 6, 2023, issued by the Taiwan Patent Office for Taiwan Patent Application No. 108128335. [cited by applicant]
Communication issued by the European Patent Office dated May 10, 2022 in EP Application No. 19762283.0. [cited by applicant]
“Artificial Intelligence”, Apr. 4, 2022, 71 pages. https://en.wikipedia.org/w/index.php?title=Artificial_intelligence&oldid=854123634. [cited by applicant]
Office Action issued on Jul. 31, 2024 by the Vietnam Patent Office for Vietnam Patent Application No. 1-2021-00742. [cited by applicant]