USB2.0 PC Camera Controller with Color Processing

General Description

The RTS5803 is a USB 2.0 HS/FS and UVC compatible camera controller designed for notebook and desktop PCs. The built-in extremely low-power transceiver provides superior compatibility with USB hosts and high quality for image applications. It is fully compatible with the USB Video Class, and operates with native drivers provided in Windows XP, Windows Vista, and Windows 7 operating systems.

The RTS5803 integrates a USB 2.0 transceiver that is optimized for high performance data transfer rate, high speed MCU (Micro Controller Unit), DC-to-DC regulators, sensor controller, color processing, and noise reduction into a single chip. It supports most available SOC CMOS sensors from VGA (640x480) to UXGA (1600x1200) resolution.

The RTS5803 is designed to support various types of access interface to achieve the best compatibility with major SOC CMOS image sensors.

The RTS5803 supports both an internal MCU program ROM and an external NOR-Flash interface. The control firmware could be easily re-configured via a USB link. This could ease the software developing work and shorten the prototyping schedule.

UVC defined image processing functions are supported by using sensor’s ISP engine. In addition, RTS5803 supports color processing functions. These functions are very useful to compensate intrinsic inaccuracy in lens and image sensor to get better image quality.

The RTS5803 integrates two regulators to save BOM cost and PCB area. One 3.3V-to-1.8~3.1V adjustable regulator converts 3.3V power for the sensor’s analog parts, and 3.3V power to 1.8V core power for the RTS5803.


General System Features

  • USB2.0 HS/FS PC Camera Controller
  • USB Video Class compatible, works with native driver in Microsoft Windows XP 32-bit/64-bit, VISTA 32-bit/64-bit, and Windows 7 systems
  • On-chip high-performance and low-power MCU
  • Supports I2C serial EEPROM interface for configuring customized parameters
  • Embedded 64K bytes ROM, 2.5Kbytes SRAM, 5K bytes ring Buffer
  • On chip firmware default supports major sensors without external serial flash and EEPROM
  • Upgradeable partial firmware and customized parameters through USB interface
  • Software controlled connection to USB bus for re-enumeration
  • Built in 3.3V to 1.8V regulator for internal core power
  • Built in 3.3V to 1.8V~3.1V adjustable regulator output for image sensor analog circuitry
  • Adjustable and dynamic frame rate control on USB transaction
  • Automatic frame rate adjustment when exposure is in low light environment
  • Selective suspend to minimize power consumption
  • Supports 2 GPIO (General Purpose Input/Output) pins with programmable driving strength
  • LED indicator on video streaming through GPIO
  • 24-pin QFN ‘Green’ package

USB Controller

  • Compatible with USB Specification 2.0 Full-Speed and High-Speed transfer mode
  • Compatible with USB Video Class Specification Rev1.0 required for Windows XP, Vista, and 7
  • Support 3 Endpoints:
    • End Point 0: Control endpoint
    • End Point A: Video Streaming Isochronous IN endpoint with varying packaged size
    • End Point C: Interrupt IN endpoint
  • Supports Suspend mode
  • Built in Self-Loop-Back BIST for testing purposes

Sensor Controller

  • Supports 16 bits YUV (4:2:2) and 8-bit RAW input data format
  • Supports standard 2-wire serial interface for sensor control
  • Wide range (2MHz to 96MHz, default 24MHz) and programmable system clock output for sensor
  • Programmable VSYNC and HSYNC timing and polarity to support various sensor
  • Supports SOC type (with ISP) of CMOS sensors up to 2 Mega Pixels
    • Aptina MI360, MI367, MI1330, MI2030
    • Hynix YACBAA0SDDAS(HI702)
    • OmniVision OV7675, OV7725, OV7739, OV7740, OV9665, OV2655
    • Samsung S5K6AA
    • SETi SIV120B, SIV120D
  • Note: The above sensors shown in bold type are default sensors supported by the RTS5803 and achieve good image quality without serial flash or EEPROM configuration. New sensors can be supported via upgraded firmware from an external I2C EEPROM.

Micro Controller Unit

  • Variable clock speed (15MHz/20MHz/24MHz) for performance and power saving
  • 64K bytes mask ROM code memory and 2.5K bytes SRAM data memory
  • On-the-fly configuration of I2C EEPROM through USB interface
  • Software controlled connection to USB bus for re-enumeration
  • Watchdog control for MCU reset and interrupt
  • Configurable VID (Vendor ID), PID (Product ID), and serial number from external serial EEPROM
  • Upgradeable firmware from external serial EEPROM to replace embedded firmware
  • Supports customized parameters for UVC (USB Video Class) defined and Realtek proprietary functions from external serial EEPROM

Color Processing

  • Automatic White Balance adjustment (Sensor ISP dependence)
  • Manual White Balance control according to color temperature setting (Sensor ISP dependence)
  • Power line flicker compensation (Sensor ISP dependence)
  • Low pass filter design for Noise Reduction
  • Auto Exposure adjustment (Sensor ISP dependence)
  • Brightness/Contrast/ Saturation/Hue processing
  • Backlight compensation (Sensor ISP dependence)
  • Color Correction Matrix
  • Global Y Gamma
  • Scaling down function support at 1.3M and VGA sensor resolution

Video/Still Image Output Formats

  • Supports up to 2M resolution for still image capture
  • Uses UVC still image capture method 2 (Isochronous transaction)
  • Supports YUV420 video format
  • Supports RGB Bayer pattern bypass output mode
  • Supports USB Video Class uncompressed YUV (4:2:2), I420, 8-bit RAW (Bayer pattern pass through) and still image format output. The maximum output frame rate of these two video formats in various USB operation modes is listed in the following tables.

Software Features

  • USB Video Class compatible, works with native drivers in Microsoft Windows XP 32-bit/64-bit and VISTA 32-bit/64-bit systems
  • Provides certified logo driver for Microsoft Windows XP, VISTA, and Window 7 operating systems
  • Linux UVC driver, open source at http://linux-uvc.berlios.de/
  • Intuitive Control Panel (Realtek Camera Manager) to enhance user experience
    • Enables face tracking function for single and multiple users
    • Digital Zoom-In and Zoom-Out processing
    • Video and voice streaming recording
    • Still image capture
    • Gamma curve adjustment
  • Selective suspend function to save power in Standby mode


  • Notebook PCs
  • Netbook PCs
  • All-In-One PCs