Imaging Solutions Using Application Processors あらまし Milbeaut MB86S62 Abstract The imaging solutions using application processors is a form of providing customers with an application platform including software and evaluation boards by taking advantage of image processing technology at which Fujitsu excels. By using this platform, customers who are assembly manufacturers can develop multifunctional and new products in a short time and bring them to market. This platform realizes a high-performance image processing system when combined with the Milbeaut imaging processor, and manufacturers can use it to emphasize their superiority over other assembly manufacturers. This paper presents examples of imaging application platforms that use application processor MB86S62. FUJITSU. 63, 4, p. 401-410 07, 2012 401
まえがき LTE 1 40 nm LSI LSI ROI Return On Investment 40 nm LSI ASIC ASIC Milbeaut MB86S62 MB86S62 を用いた画像アプリケーションプラットフォーム 図 -1 ASIC Milbeaut CPU/GPU ASSPPF 図 -2 SoC 402 FUJITSU. 63, 4 07, 2012
ASSP PF SoC CPU Linux O/S GPU DSP connectivity API -1 Android BSP Google ARM OpenGL ES Lib Linux BSP Audio HAL Display HAL Kernel Generic Platform Specific V4 Standard HALs GPU FSL ISP ISP HAL Others HALs FSL ISP CSI DSI HDMI ISP Codec Post proc. disp audio CPU Cluster DRAM I/F GPU Cluster Cache coherent interconnect High Bandwidth interconnect with QoS High bandwidth Connectivity System control low bandwidth Connectivity USB SATA GMII/Ether PCIe Clock Reset I2C UART GPIO UART I2C SPI I2S DRAM -2 MB86S62 Linux 2 Android 3 BSP Board Support Package Linux Android BSP FUJITSU. 63, 4 07, 2012 403
MPEG-2 TS Rx I/F X2 Smart Card I/F X2 HD USB 2.0 Host & OTG Cortex TM -A8 1 GHz HDMI Tx 2D/3D -3 MB86S62 CPU -1 MB86S62 ARM Cortex TM -A8 1 GHz 1080 p @30 fps MPEG-4 H.264 720 p 1080 p @30 fps MPEG-2/4 H.264 VC-1 RV8.9.10 H.263 / Divx OpenGL2.0/OpenVG1.1 30 MPoly/s 400 Mpixel/s XGA LCD I/FLCD 24RGB or MIPI DSI/3D De-Interlacer 8 M 3 M USB Host 1 OTG 1 PHY MPEG-2 TS RX 2 SPI 3 SmartCard I/F 2 SD/MMC/SDIO/SDHC I/F SATAII/HDMI 19 mm 19 mm 620FBGA 0.65 MB86S62 MB86S62 図 -3 表 -1 1 45 nm Low Power 2 ARM Cortex TM -A8 ARM 1 GHz ID32 K 256 K 3 404 FUJITSU. 63, 4 07, 2012
MIPI CSI8 8 Mpixel 8 3 Mpixel MPEG-2 4 H.264 5 VC-1 6 HD 1080 p/30 fps/ 720 p MP3 7 AAC I2S 8 SPDIF 9 4 3D 2D/3D OpenVG1.1 10 OpenGL ES2.0 30 MPoly/s 400 Mpixel/s 5 3 XGA 24RGBMIPI 11 DSI XGA 1024 768 LCD LCD LCDHDMI 12 TV NTSC/ PAL 6 Normal/Idle/Stop/Sleep/Deep Sleep MB86S6219 mmfbga DRAM 図 -4 SiP System in Package 評価環境 MB86S62 評価キット (DTK) の概要 DTKMB86S62 MB86S52 図 -5 a DTK b DTK LinuxAndroid BSP DTKの基本機能 LCD 800 480 pixel DDR Capacity 512 M System256 M Media NAND 8 GMLC USB 13 OTG Non-cross 5 V/2 A 3.7 VMax 4.2 V 12 mm 1.5 mm 4 FLIP-CHIP -4 SiP FUJITSU. 63, 4 07, 2012 405
a DTK b -5 MB86S52 DTKの機能詳細 1 Power Indicate LED 2 AC supply 5 V 3.7 V Single-Cell Battery 2 PC Ethernet JTAG RS-232C USB 3 NAND UART1 SD 14 Ch0/Ch1 USB Host USB 0 1 MIPIMIPI Micro SATA 15 External 1.8SATA HDD D-TVD-TV 4 7LED LCD -/ 5 8 Ohm CVBS Out SPDIF HDMI 6 CPU Boot 406 FUJITSU. 63, 4 07, 2012
ソフトウェア構成 OS Android Linux Android 図 -6 5 1 Android 2 Android 3/Android Runtime SQLite Libc Webkit OpenGL ES CoreLibrary Dalvik Virtual Machine 4 Android 5 Linux Linux Linux Android Android SDK Software Development Kit Android NDK Native Development Kit 2 OpenMAX/GStreamer 16 2D/3D OpenVG/OpenGL ES Android API Home Browser Media Player Contacts Active Manager Window Manager Resource Manager Content Providers Android Surface Manager Media Framework SQLite Libc OpenGL ES Audio Manager FreeType Dalvik VM Graphics Audio Camera Bluetooth GPS Wi-fi Linux Display Driver Camera Driver Bluetooth Driver Shared Memory Driver Binder IPC Driver USB Driver Key Driver Wifi Driver Audio Drivers Power Management -6 Android FUJITSU. 63, 4 07, 2012 407
OpenGL ES/OpenMAX SoC API 応用事例 DTK Milbeaut 2 ch MIPI 1 ch3 図 -7 Android Andorid API Android I/F Milbeaut -7 DTK MIPI I/F DTK 今後の展開 MB86S62 1 CPU Linux AndroidOS KhronosAPI OpenCL OpenCV 17 2 図 -8 a Linux Android 1 b 2c 3 2013 28 nm Cortex TM -A154 K 図 -9 408 FUJITSU. 63, 4 07, 2012
DDR I/F Interchip Interchip DDR I/F DDR I/F Interchip a b Interchip ASIC c 2-8 2012 2013 2014 2015 MB86S62 45 nm Cortex TM -A8 @1 GHz H.264 full HD Codec OpenGL ES OpenVG Full HD MB86S64 28 nm Cortex TM -A15 dual @2 GHz Cortex TM -A7 dual @1 GHz OpenGL ES OpenVG OpenCL 4K2K / MB86S7x 20 nm Next CPU multi-core OpenGL ES OpenVG OpenCL OpenSL ES OpenCV 8K4K MB86S6x 28 nm Cortex TM -A7 quad @1 GHz OpenGL ES OpenVG OpenCL OpenSL ES OpenCV 4K2K -9 むすび MB86S62 20 nm FUJITSU. 63, 4 07, 2012 409
参考文献 1 The 3rd Generation Partnership Project http://www.3gpp.org/ 2 Linux http://www.kernel.org/ 3 Android Developers http://developer.android.com/index.html 4 MPEG LA http://www.mpegla.com/main/default.aspx 5 International Telecommunication Union Telecommunication Standardization Sector http://www.itu.int/en/pages/default.aspx 6 Society of Motion Picture and Television Engineers http://www.smpte.org/ 7 International Organization for Standardization http://www.iso.org/iso/home.html 8 NXP Semiconductors http://www.classic.nxp.com/acrobat_download2/ various/i2sbus.pdf 9 International Electrotechnical Commission http://www.iec.ch/ 10 The Khronos Group Connecting Software to Silicon http://jp.khronos.org/ 11 MIPI Alliance www.mipi.org 12 HDMI Licensing, LLC http://www.hdmi.org/ 13 USB Implementers Forum, Inc http://www.usb.org/home 14 SD https://www.sdcard.org/jp/home 15 Serial ATA International Organization http://www.serialata.org/ 16 freedesktop.org http://gstreamer.freedesktop.org/ 17 OpenCV http://code.opencv.org/embedded/opencv/index.html 著者紹介 須賀敦浩 ( すがあつひろ ) 兵頭正人 ( ひょうどうまさと ) 中原英利 ( なかはらひでとし ) 瀧本伸一 ( たきもとしんいち ) 410 FUJITSU. 63, 4 07, 2012