应用科学学报 ›› 2026, Vol. 44 ›› Issue (4): 657-668.doi: 10.3969/j.issn.0255-8297.2026.04.010

• 智能视觉感知 • 上一篇    下一篇

文本视觉融合的全参考屏幕内容图像质量评价

张尹, 杨超, 安平, 黄新彭   

  1. 上海大学 通信与信息工程学院, 上海 200444
  • 收稿日期:2025-12-30 发布日期:2026-08-01
  • 通信作者: 杨超,博士,副教授,研究方向为视频处理与传输。E-mail:yangchaoie@shu.edu.cn E-mail:yangchaoie@shu.edu.cn
  • 基金资助:
    国家自然科学基金(No.62371279,No.62171002,No.62071287,No.62020106011,No.62371278)

Full-Reference Screen Content Image Quality Assessment via Text-Visual Fusion

ZHANG Yin, YANG Chao, AN Ping, HUANG Xinpeng   

  1. School of Communication & Information Engineering, Shanghai University, Shanghai 200444, China
  • Received:2025-12-30 Published:2026-08-01

摘要: 随着互联网技术的快速发展,屏幕内容图像(screen content image,SCI)在网络中的应用日益广泛,其客观质量评价问题已成为研究热点。本文提出一种融合文本完整性与图像感知特征的全参考SCI质量评价方法。针对SCI丰富的文本特性,本文利用光学字符识别(optical character recognition,OCR)技术提取文本内容,并计算字符错误率(character error rate,CER)作为文本完整性特征,同时结合空间、结构以及信息论等多种质量感知特征,采用随机森林学习特征的自适应权重,并通过支持向量回归(support vector regression,SVR)建立融合特征与主观质量分数的映射关系。在两个广泛使用的SCID与SIQAD数据集上的实验结果表明,本文所提方法取得了优异的性能。相较于现有优秀方法,本文方法在SCID数据集上的预测精度提升超2%,更准确地反映了人类视觉系统对屏幕内容的感知特性。

关键词: 屏幕内容图像, 图像质量评价, 文本完整性, 多特征融合

Abstract: With the rapid development of Internet technology, the application of screen content image(SCI) in the network is becoming increasingly widespread, and the issue of objective quality assessment has become a research hotspot. A full-reference SCI quality assessment method integrating text integrity and image perception features was proposed. To address the rich text characteristics of SCI, optical character recognition(OCR) technology was utilized to extract text content, and character error rate(CER) was calculated as the text integrity feature. Simultaneously, multiple quality perception features, including spatial, structural, and information-theoretic features, were incorporated. Random forest was employed to learn the adaptive weights of the features, and support vector regression(SVR) was utilized to establish the mapping relationship between the fused features and subjective quality scores. The experimental results on two widely used datasets, SCID and SIQAD, demonstrate that the proposed method achieves superior performance. Compared with existing competitive methods, the prediction accuracy of the proposed method on the SCID dataset improves by more than 2%, which more accurately reflects the perception characteristics of the human visual system for screen content.

Key words: screen content image, image quality assessment, text integrity, multi-feature fusion

中图分类号: