应用科学学报 ›› 2026, Vol. 44 ›› Issue (5): 787-799.doi: 10.3969/j.issn.0255-8297.2026.05.006
舒勇, 沈礼权
收稿日期:2024-05-07
发布日期:2026-10-09
通信作者:
沈礼权,研究员,博士生导师,研究方向为视频编码、高动态范围图像/视频处理。E-mail:jsslq@shu.edu.cn
基金资助:SHU Yong, SHEN Liquan
Received:2024-05-07
Published:2026-10-09
摘要: 针对现有sRGB域多曝光图像融合方法在处理运动幅度较大场景时容易产生鬼影现象,融合出的高动态范围(high dynamic range,HDR)图像质量不佳、算法效率不高等问题,提出了一种基于多尺度对齐和融合的RAW域多曝光图像融合模型,可直接在RAW域进行多曝光图像融合。该模型设计了多尺度可形变对齐模块(multi-scale deformable alignmentmodule,MS-DAM),通过在多个尺度上对不同曝光的特征进行隐式对齐,实现了更加准确的对齐效果,显著减轻了鬼影现象;同时,为了更好地进行多曝光特征融合,设计了渐进式融合模块(progressive fusion module,PFM),该模块在多个尺度上进行多曝光特征融合,并预测相应尺度下的HDR图像,逐渐强化对后续融合有利的特征表达。考虑到RAW域多曝光融合数据集的缺乏,构建了一个RAW域多曝光图像融合基准数据集。实验结果表明,在RAW域进行多曝光图像融合,本文方法优于先前的多曝光图像融合方法。
中图分类号:
舒勇, 沈礼权. 基于RAW域的多曝光图像融合[J]. 应用科学学报, 2026, 44(5): 787-799.
SHU Yong, SHEN Liquan. Multi-exposure Image Fusion Based on RAW Domain[J]. Journal of Applied Sciences, 2026, 44(5): 787-799.
| [1] Nayar S K, Mitsunaga T. High dynamic range imaging: spatially varying pixel exposures [C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2000: 472- 479. [2] Han J, Yang Y X, Duan P Q, et al. Hybrid high dynamic range imaging fusing neuromorphic and conventional images [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(7): 8553-8565. [3] Mertens T, Kautz J, Reeth F V. Exposure fusion [C]//15th Pacific Conference on Computer Graphics and Applications (PG’07), 2007: 382-390. [4] Kalantari N K, Ramamoorthi R. Deep high dynamic range imaging of dynamic scenes [J]. ACM Transactions on Graphics, 2017, 36(4): 1-12. [5] Hu J, Gallo O, Pulli K, et al. HDR deghosting: how to deal with saturation? [C]//26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013: 1163-1170. [6] Yan Q S, Dong G, Shi, Q F, et al. Attention-guided network for ghost-free high dynamic range imaging [C]//32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019: 1751-1760. [7] Liu Z, Wang Y L, Zeng B, et al. Ghost-free high dynamic range imaging with context-aware transformer [C]//17th European Conference on Computer Vision (ECCV), 2022: 344-360. [8] Chen R F, Zheng B L, Zhang H, et al. Improving dynamic HDR imaging with fusion transformer [C]//37th AAAI Conference on Artificial Intelligence (AAAI)/35th Conference on Innovative Applications of Artificial Intelligence /13th Symposium on Educational Advances in Artificial Intelligence, 2023: 340-349. [9] Wang X T, Chan K C K, Yu K, et al. EDVR: video restoration with enhanced deformable convolutional networks [C]//32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019: 1954-1963. [10] Shi W Z, Caballero J, Huszár F, et al. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network [C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 1874-1883. [11] He K M, Zhang X Y, Ren S Q, et al. Deep residual learning for image recognition [C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 770- 778. [12] Zamir W S, Arora A, Khan S, et al. Learning enriched features for real image restoration and enhancement [C]//16th European Conference on Computer Vision (ECCV), 2020: 492-511. [13] Debevec P E, Malik J. Recovering high dynamic range radiance maps from photographs [C]//24th Annual Conference on Computer Graphics and Interactive Techniques, 1997: 369- 378. [14] Khashabi D, Nowozin S, Jancsary J, et al. Joint demosaicing and denoising via learned nonparametric random fields [J]. IEEE Transactions on Image Processing, 2014, 23(12): 4968-4981. [15] Mantiuk R, Kim K J, Rempel A G, et al. HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions [J]. ACM Transactions on Graphics, 2011, 30(4): 1-14. [16] Wu S Z, Xu J R, Tai Y W, et al. Deep high dynamic range imaging with large foreground motions [C]//15th European Conference on Computer Vision (ECCV), 2018: 120-135. [17] Tel S, Heyrman B, Ginhac D. CEN-HDR: computationally efficient neural network for real-time high dynamic range imaging [C]//17th European Conference on Computer Vision (ECCV), 2022: 378-394. [18] Liu Z, Lin W J, Li X P, et al. ADNet: attention-guided deformable convolutional network for high dynamic range imaging [C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021: 463-470. [19] Yan Q S, Zhang L, Liu Y, et al. Deep HDR imaging via a non-local network [J]. IEEE Transactions on Image Processing, 2020, 29: 4308-4322. |
| [1] | 尚雨婷, 范春年, 陈北京. 基于三元组特征分布损失的GAN生成人脸反取证方法[J]. 应用科学学报, 2026, 44(5): 800-815. |
| [2] | 张括, 胡众义. 基于注意力增强的卷积框架在阿尔茨海默症分类中的应用[J]. 应用科学学报, 2026, 44(5): 827-837. |
| [3] | 江泽涛, 金鑫, 冷路, 朱文才. 基于特征优化的低照度小样本目标检测方法[J]. 应用科学学报, 2026, 44(3): 422-436. |
| [4] | 高光亮, 梁伟超, 朱涛, 洪磊, 夏玲玲. 融合图文特征的多模态谣言检测方法[J]. 应用科学学报, 2026, 44(3): 503-514. |
| [5] | 李永桢, 马涪元, 马世旋, 王钰涵, 王英. 基于结构增强和深度聚类的网络群体识别[J]. 应用科学学报, 2026, 44(1): 1-20. |
| [6] | 金正洋, 阎少宏, 张艳博, 姚旭龙, 陶志刚, 陈志远. 融合空间纹理特征的三维模糊聚类算法[J]. 应用科学学报, 2026, 44(1): 134-148. |
| [7] | 王金伟, 王海桦, 吴昊, 罗向阳, 马宾. 通过可迁移性差距提升对抗可迁移性[J]. 应用科学学报, 2025, 43(5): 799-807. |
| [8] | 张爱玲, 杨林英, 闫士举. 基于ResNeSt网络的糖网病及糖尿病黄斑水肿联合分级[J]. 应用科学学报, 2025, 43(5): 849-862. |
| [9] | 王金伟, 张玫瑰, 张家伟, 罗向阳, 马宾. 基于关键帧的频域多特征融合的Deepfake视频检测[J]. 应用科学学报, 2025, 43(3): 451-462. |
| [10] | 杨婉, 陈爱斌, 赵莹, 武阅, 甑鑫, 肖治术. 基于双层路由注意力和自校准卷积的豹个体识别[J]. 应用科学学报, 2025, 43(2): 348-360. |
| [11] | 邓抒憧, 陈爱斌, 戴子健. 基于多路激励和金字塔切分注意力的鸟类行为识别[J]. 应用科学学报, 2025, 43(1): 154-168. |
| [12] | 贺加贝, 周菊香, 甘健侯, 吴迪, 温晓宇. 基于多任务学习的课堂表情分类模型[J]. 应用科学学报, 2024, 42(6): 947-961. |
| [13] | 栗莎, 王永雄, 王哲, 陈旭, 何嘉欣. 融合局部和全局特征的铸件缺陷检测[J]. 应用科学学报, 2024, 42(5): 757-768. |
| [14] | 华怡坦, 黄影平, 过文昊. 基于CNN和Transformer点云图像融合的道路检测[J]. 应用科学学报, 2024, 42(4): 695-708. |
| [15] | 金彦亮, 吴筱. 基于双流自适应时空增强图卷积网络的手语识别[J]. 应用科学学报, 2024, 42(2): 189-199. |
| 阅读次数 | ||||||
|
全文 |
|
|||||
|
摘要 |
|
|||||