USB2.0 PC Camera Controller with Image Signal Processing and MJPEG Encoder

General Description

The RTS5822 is a USB 2.0 compatible camera controller designed for notebook and desktop PCs. The built-in extremely low-power transceiver provides superior compatibility with USB hosts and high quality for image applications. It is fully compatible with the USB Video Class, and operates with native drivers provided in Windows XP, Windows Vista, Windows 7, and Windows 8 operating systems.

The RTS5822 integrates a USB 2.0 transceiver that is optimized for high performance data transfer rate, high speed MCU (Micro Processor Unit), DC-to-DC regulators, sensor controller, image signal processing engine, MJPEG compression, and Analog-to-Digital converter for analog microphone into a single chip. It supports most available CMOS sensors from VGA (640x480) to QXGA (2048x1536) resolution.

The RTS5822 is designed to support various types of access interface to achieve the best compatibility with major SOC CMOS image sensors.

The RTS5822 supports an internal MCU program ROM, external NOR-Flash interface, and external Serial-Flash interface. With the external Serial-Flash interface, the internal program ROM can be fully replaced and the control firmware can be easily accessed via the USB link. This helps speed software updating.

A new generation ISP (Image Signal Processing) engine supports most UVC defined image adjustments. In addition, this engine also has offers functions such as Lens Shading Correction, dead pixel cancellation, G1G2 filter, Color Correction Matrix, histogram statistic Auto White Balance, scaling function and so on. These functions help compensate for intrinsic inaccuracy in lens and image sensors to provide better image quality. The internal scaling filter can scale down higher resolutions for size reduction purposes, and also scale up a VGA image to 800x600, 960x720, 1024x768 and 1280x960 resolution.

The RTS5822 integrates five regulators to save BOM cost and PCB area. Two 3.3V-to-1.2~3.1V adjustable regulators convert 3.3V power for the sensor’s IO and analog power. One 5V-to-3.3V and two 3.3V-to-1.2V regulators are used for RTS5822 analog and digital core power.

A high performance Analog-to-Digital converter is also integrated to convert analog voice signal from analog microphone to be digital signal, its output is identical to digital microphone signal could be connected to onboard HD Audio Codec through non-shielding cable without interference from RF or other noisy device. UAC (Universal Audio Class) function is supported also.

A significant feature of the RTS5822 is enhanced power management. Its power consumption is 20% lower than similar controllers. With multiple regulators, an integrated image signal processing engine and motion JPEG encoder, the RTS5822 consumes less power from the USB bus whether in normal operation, standby, or suspend mode.


General System Features

  • USB2.0/1.1 PC Camera Controller with Image Signal Processing engine and MJPEG encoder
  • USB Video Class compatible, works with native driver in Microsoft Windows XP 32-bit/64-bit, VISTA 32-bit/64-bit, Windows 7 32-bit/64-bit, and Windows 8 32-bit/64-bit systems
  • USB Audio Class compatible, works with native driver in Microsoft Windows XP 32-bit/64-bit, VISTA 32-bit/64-bit, Windows 7 32-bit/64-bit, and Windows 8 32-bit/64-bit systems
  • On-chip high-performance and low-power MCU
  • SPI (Serial Peripheral Interface, Mode 0~Mode 3) connection to external serial flash for switching code and configuring customized parameters
  • Embedded 64K ROM, 3Kbytes SRAM, 6Kbytes ring Buffer
  • On chip firmware default supports major sensors without external serial flash
  • Upgradeable firmware and customized parameters through USB interface
  • Software controlled connection to USB bus for re-enumeration
  • Motion JPEG hardware encoder integrated
  • Built in 5.0V to 3.3V regulator output for I/O power
  • Built in 3.3V to 1.2V regulator for internal core power
  • Built in 3.3V to 1.2V~3.1V adjustable regulator output for image sensor analog circuitry & IO power
  • High quality Sigma-Delta ADC to convert analog microphone signal to digital microphone output.
  • Audio Loudness Control (ALC) function support
  • Adjustable and dynamic frame rate control on USB transaction
  • Automatic frame rate adjustment when exposure is in low light environment
  • Dynamic dead pixel compensation support
  • Selective suspend to minimize power consumption
  • Supports 8 GPIO (General Purpose Input/Output) pins with programmable driving strength
  • LED indicator on video streaming through GPIO
  • Spread-spectrum host clock for reducing EMI
  • 46-pin QFN ‘Green’ package
  • Memory BIST (Built-In Self Test) integrated

USB Controller

  • Compatible with USB Specification 2.0/1.1 Full-Speed and High-Speed transfer mode
  • Compatible with USB Video Class Specification Rev1.0 required for Windows XP and Vista
  • Support 5 Endpoints:
    • End Point 0: Control endpoint
    • End Point A: Video Streaming Isochronous IN endpoint
    • End Point B: Audio Streaming Isochronous IN endpoint
    • End Point C: Interrupt IN endpoint for UVC
    • End Point D: Interrupt IN endpoint for UAC
  • Built in Self-Loop-Back BIST for testing purposes
  • Non-crystal supported
  • Supports USB Low Power Mode

Sensor Controller

  • Supports 10 bits raw image data (Bayer pattern) format from sensor
  • Supports 16 bits YUV (4:2:2) input format from sensor
  • MJPEG up to FHD@30 fps supported
  • Supports standard 2-wire serial interface for sensor control
  • Wide range (2MHz to 96MHz, default 24MHz) and programmable system clock output for sensor
  • Programmable VSYNC and HSYNC timing and polarity to support various sensors from 3rd party vendors
  • Supports up to 3M resolution for still image capture
  • Uses UVC still image capture method 2
  • Supports major brands of CMOS sensors up to 3 Mega Pixels(2048x1536)
    • OmniVision OV7675, OV7725, OV9665, OV2655, OV9710, OV9726, OV2710
    • Aptina MI-0360 (MT9V011), MI-1330 (MT9M113), MI-2030 (MT9D113), MI1040
    • Samsung S5K4B2F, S5K6A1GX

Micro Controller Unit

  • Variable clock speed (15MHz/20MHz/24MHz/30MHz/40MHz/48MHz/60MHz) for performance and power saving
  • 64K bytes mask ROM code memory and 3K bytes SRAM data memory
  • Firmware is upgradeable, with fast on-the-fly configuration of serial flash through the USB interface
  • Software controlled connection to USB bus for re-enumeration
  • Supports property page write-back in serial flash cache mode
  • Watchdog control for MCU reset and interrupt
  • Configurable VID (Vendor ID), PID (Product ID), and serial number string from external serial flash
  • Supports customized parameters for UVC (USB Video Class) defined and Realtek proprietary functions from external serial flash

Image Signal Processing (ISP) Engine

  • Programmable global Gamma correction (UVC defined)
  • Sharpness enhancement and smooth processing (UVC defined)
  • Auto Exposure and Manual Exposure adjustment (UVC defined)
  • Automatic White Balance (AWB) adjustment (UVC defined)
  • Manual White Balance control according to color temperature setting (UVC defined)
  • High friendly brightness adjust, RGB domain (UVC defined)
  • Dynamic contrast adjust, RGB domain (UVC defined)
  • High friendly saturation adjust, RGB domain (UVC defined)
  • Hue processing (UVC defined)
  • Backlight compensation (UVC defined)
  • Power line flicker compensation (UVC defined)
  • Individual Lens Shading Correction for R/G/B channels
  • Negative, Mono, and Gray Processing
  • G1G2 compensation filter
  • Programmable gamma table and Y gamma block
  • Black Level Compensation for individual R/G/B channels
  • Static dead pixels cancellation, up to 512 pixels information stored in serial flash
  • Dynamic dead pixel detection and cancellation
  • Edge detection and enhancement
  • Input pattern interpolation and noise reduction
  • Global and individual gain control for R/G/B channels
  • Configurable Color Correction Matrix for R/G/B channels
  • AE (Auto Exposure) adjustment with Y channel of histogram statistic
  • Auto Focus edge statistics
  • Zoom In and Zoom Out image from sensor, and output with various resolutions
  • Scaling up function to emulate VGA (640x480) image output to 800x600, 960x720, 1024x768 and 1280x960 resolutions
  • Lens Shading Correction: Auto tuning for color temperature

Motion JPEG Encoder Engine

  • 60MHz operation clock rate, maximum up to 160MHz
  • Supports compression resolution up to UXGA (2048H x 1536V)
  • Compatible with USB Video Class MJPEG payload
  • Programmable compression ratio depends on transport bandwidth and image quality option

Video/Still Image Output Formats

  • Supports up to 3M resolution for still image capture
  • Uses UVC still image capture method 2 (Isochronous transaction)
  • Supports M420 video format
  • Supports RGB Bayer pattern bypass output mode
  • Supports USB Video Class uncompressed YUV (4:2:2) and USB Video Class MJPEG video, and still image format output

Microphone Interface

  • Stereo Digital microphone is supported
  • Integrates high quality Sigma-Delta ADC to convert analog microphone signal into digital voice
  • Supports industry standard digital microphone interface to output digital voice to onboard HD (High Definition) Audio Codec
  • Provides reference voltage output to bias analog microphone directly without requiring external regulator
  • AMIC (with Vref as MIC bias)/DMIC to UAC.
    • Mode 1: DMIC to UAC
    • Mode 2: AMIC to UAC
    • Mode 3: AMIC to DMIC (the same as RTS5802)
  • Clock rate for sample data 8KHz/16KHz /44.1KHz/48KHz

Software Features

  • USB Video Class compatible, works with native drivers in Microsoft Windows XP 32-bit/64-bit and VISTA 32-bit/64-bit systems
  • Provides certified logo driver for Microsoft Windows XP, VISTA, and Window 7 operating systems
  • Linux UVC driver, open source at http://linux-uvc.berlios.de/
  • Intuitive Control Panel (Realtek Camera Manager) to enhance user experience
    • Enables face tracking function for single and multiple users
    • Digital Zoom-In and Zoom-Out processing
    • Video and voice streaming recording
    • Still image capture
    • Interface for R/G/B gamma curve adjustment
    • Provide various preset image styles for video streaming and still captured image
  • Selective suspend function to save power in Standby mode


  • Notebook PCs
  • Netbook PCs
  • All-In-One PCs
  • Ultra mobile devices
  • Stand-alone Webcam