应用科学学报 ›› 2026, Vol. 44 ›› Issue (5): 787-799.doi: 10.3969/j.issn.0255-8297.2026.05.006

• 智能信息处理 • 上一篇    下一篇

基于RAW域的多曝光图像融合

舒勇, 沈礼权   

  1. 上海大学 通信与信息工程学院, 上海 200444
  • 收稿日期:2024-05-07 发布日期:2026-10-09
  • 通信作者: 沈礼权,研究员,博士生导师,研究方向为视频编码、高动态范围图像/视频处理。E-mail:jsslq@shu.edu.cn
  • 基金资助:
    国家自然科学基金(No.62531014,No.62271301,No.61931022);上海市优秀学科带头人项目(No.23XD1401400)

Multi-exposure Image Fusion Based on RAW Domain

SHU Yong, SHEN Liquan   

  1. School of Communication & Information Engineering, Shanghai University, Shanghai 200444, China
  • Received:2024-05-07 Published:2026-10-09

摘要: 针对现有sRGB域多曝光图像融合方法在处理运动幅度较大场景时容易产生鬼影现象,融合出的高动态范围(high dynamic range,HDR)图像质量不佳、算法效率不高等问题,提出了一种基于多尺度对齐和融合的RAW域多曝光图像融合模型,可直接在RAW域进行多曝光图像融合。该模型设计了多尺度可形变对齐模块(multi-scale deformable alignmentmodule,MS-DAM),通过在多个尺度上对不同曝光的特征进行隐式对齐,实现了更加准确的对齐效果,显著减轻了鬼影现象;同时,为了更好地进行多曝光特征融合,设计了渐进式融合模块(progressive fusion module,PFM),该模块在多个尺度上进行多曝光特征融合,并预测相应尺度下的HDR图像,逐渐强化对后续融合有利的特征表达。考虑到RAW域多曝光融合数据集的缺乏,构建了一个RAW域多曝光图像融合基准数据集。实验结果表明,在RAW域进行多曝光图像融合,本文方法优于先前的多曝光图像融合方法。

关键词: 多曝光图像融合, 高动态范围成像, 可形变卷积

Abstract: Existing multi-exposure image fusion methods in the sRGB domain are prone to generating ghost artifacts when tackling scenes with large motion amplitude; the fused high dynamic range (HDR) images have poor quality, and the algorithm efficiency is low. To this end, this paper proposed a multi-exposure image fusion model based on multi-scale alignment and fusion to directly perform multi-exposure image fusion in the RAW domain. The model designed a multi-scale deformable alignment module (MS-DAM) to implicitly align features of different exposures at multiple scales, thus achieving more accurate alignment and greatly reducing ghost artifacts. Meanwhile, to better perform multi-exposure feature fusion, this paper designed a progressive fusion module (PFM) to perform multiexposure feature fusion at multiple scales and predict the HDR images at the corresponding scales, with features beneficial to subsequent multi-exposure fusion gradually enhanced. Considering the lack of multi-exposure fusion datasets in the RAW domain, this paper constructed a benchmark dataset for multi-exposure image fusion based on the RAW domain. Experimental results show that the proposed method outperforms previous methods for multi-exposure image fusion based on the RAW domain.

Key words: multi-exposure image fusion, high dynamic range imaging, deformable convolution

中图分类号: