面向嵌入式系统的音视频解码与同步播放实现

doi:10.3969/j.issn.0255-8297.2018.03.010

Abstract

Abstract:

An MPEG-2 TS stream decoding and synchronous playback system is designed and implemented based on ARM embedded system. In order to make full use of the resource of video codec embed in ARM processor, a hardware MFC codec is adopted to decode video data, and the open-source Mad- library (libmad) is used to decode audio data. Furthermore, V4L2 driver interface and ALSA library are adopted to play video and audio frame. Due to the delay of hardware decoding from video frame period, there exists a time difference between audio and video playbacks, causing audio and video unsynchronized. In the designed system, a method that synchronizes the video playback to the audio playback is used to achieve synchronization of audio and video playback. Test results show that the designed system can realize audio and video data decoding and synchronous playback.

Key words: audio and video decoding, audio and video synchronization, embedded system, multithreading

CLC Number:

TN911

ZHANG Sen-yong, GAO Shu-li, CHEN Wei-gang. Implementation of Audio and Video Decoding and Synchronous Playback Based on Embedded Systems[J]. Journal of Applied Sciences, 2018, 36(3): 504-514.

References

[1] Park K, Lim Y, Suh D Y. Delivery of ATSC 3.0 services with MPEG media transport standard considering redistribution in MPEG-2 TS format[J]. IEEE Transactions on Broadcasting, 2016, 62(1):338-351.
[2] Lin Y Y, Hsu H H. General Architecture for MPEG-2/H.263/H.264/AVC to H.264/AVC intra frame transcoding[J]. Journal of Signal Processing Systems, 2015, 79(3):299-311.
[3] Yuste L B, Boronat F, Montagud M. Understanding timelines within MPEG standards[J]. IEEE Communications Surveys & Tutorials, 2016, 18(1):368-400.
[4] 黄晓伟,徐元欣,王匡. 数字电视系统中的音视频同步实现[J]. 电视技术,2005(7):45-46. Huang X W, Xu Y X, Wang K. Synchronization between audio and video in digital[J]. TV System, 2005(7):45-46. (in Chinese)
[5] Wu W, Chang Y. A novel algorithm of media synchronization for MPEG-2[J]. IEEE Transactions on Consumer Electronics, 2006, 52(2):646-650.
[6] Abdallah F B, Trabelsi C, Atitallah R B. Early power-aware design space exploration for embedded systems:MPEG-2 case study[C]//Proceedings of 2014 International Symposium on System-on-Chip (SoC). Tampere, Finland, IEEE, 2014:1-8.
[7] Fei W, Cong K. Implementation of linux video capture driver based on V4L2 architecture[J]. Electronic Science and Technology, 2012, 25(2):86-87.
[8] Belloch J A, Gonzalez A, Mayo R. Evaluating the potential of low power systems for headphone-based spatial audio applications[J]. Procedia Computer Science, 2015, 51:191-200.
[9] Binh N, Chung S T, Cho S. Design and implementation of an embedded multimedia live streaming decoder system[C]//2014 International Conference on Advanced Technologies for Communications (ATC 2014). Hanoi, Vietnam, IEEE, 2014:377-382.
[10] Lei X, Jiang X, Wang C. Design and implementation of a real-time video stream analysis system based on FFmpeg[C]//Proceedings of 4th IEEE World Congress on Software Engineering (WCSE). Beijing, China, 2013:212-216.
[11] International Organization for Standardization (ISO). Information technology-generic coding of moving pictures and associated audio information:systems[S]. Geneva, Switzerland:ISO, 2000.
[12] Zhang J, Li Y, Wei Y. Using timestamp to realize audio-video synchronization in real-time streaming media transmission[C]//Proceedings of International Conference on Audio, Language and Image Processing. Shanghai, China, 2008:1073-1076.
[13] Mosharafa S M, Ebrahim G A, Zekry A A. A novel algorithm for synchronizing audio and video streams in MPEG-2 system layer[C]//20149th International Conference on Computer Engineering & Systems (ICCES). Cairo, Egypt, IEEE, 2014:142-147.
[14] Yang M, Bourbakis N, Chen Z. An efcient audio-video synchronization methodology[C]//Proceedings of IEEE International Conference on Multimedia and Expo. Beijing, China, 2007:767-770.

Implementation of Audio and Video Decoding and Synchronous Playback Based on Embedded Systems

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 6

Recommended Articles

Metrics

Comments

[1]	WANG Deming, SUI Xiuwu, ZHANG Yang, WAN Kaixin, SHI Feng. Diameter Control Technology of Ultra-fine Sutures Based on DMA and Improved GPC Algorithm [J]. Journal of Applied Sciences, 2019, 37(3): 349-358.
[2]	LIU Bo, WANG Xue-xiang, SHI Long-xing. Implementation of Software-Controllable Cache for Embedded Systems [J]. Journal of Applied Sciences, 2009, 27(6): 623-629.
[3]	XIAO Zhe;CHEN Bing. Design and Implementation of Embedded Radio Network Management Model Based on SNMP Protocol [J]. Journal of Applied Sciences, 2008, 26(2): 117-117 .
[4]	YANG Hong-bin;WU Yue;LIU Quan-sheng. Distributed Reservation Architecture of Simultaneous Multithreading Processor [J]. Journal of Applied Sciences, 2008, 26(2): 188-188 .
[5]	BU Ai-guo, LIU Hao, HU Chen, WANG Chao. PCF Dynamic Power Management Predictive Policy Based on AR Model [J]. Journal of Applied Sciences, 2005, 23(5): 483-488.
[6]	ZHU Min, XU Guo-zhi. The Implementation of the Audio Module in Embedded System [J]. Journal of Applied Sciences, 2004, 22(3): 415-418.