English

应用科学学报 ›› 2026, Vol. 44 ›› Issue (2): 234-249.doi: 10.3969/j.issn.0255-8297.2026.02.005

• 智能信息处理 • 上一篇    下一篇

线特征约束的影像与点云多视角联合平差配准方法

陈露1, 王安妮1, 兰紫瑜2, 许晖3, 张鹏林1   

  1. 1. 武汉大学 遥感信息工程学院, 湖北 武汉 430079;
    2. 浙江省自然资源厅 信息中心, 浙江 杭州 310007;
    3. 自然资源部测绘标准化研究所, 陕西 西安 710054
  • 收稿日期:2025-04-17 发布日期:2026-04-07
  • 通信作者: 张鹏林，教授，研究方向为地理国情监测。E-mail:zpl@whu.edu.cn E-mail:zpl@whu.edu.cn
  • 基金资助:
    国家重点研发计划项目（No.2022YFC3006305）

Multi-view Joint Adjustment Registration Method for Images and Point Clouds with Line Feature Constraints

CHEN Lu1, WANG Anni1, LAN Ziyu2, XU Hui3, ZHANG Penglin1   

  1. 1. School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, Hubei, China;
    2. Information Center, Department of Natural Resources of Zhejiang Province, Hangzhou 310007, Zhejiang, China;
    3. Institute of Surveying and Mapping Standardization, Ministry of Natural Resources, Xi'an 710054, Shaanxi, China
  • Received:2025-04-17 Published:2026-04-07

PDF

1

摘要： 影像与激光点云的配准是场景三维重建的关键技术，为爆炸事故溯源分析提供重要的科学支持，并在自动驾驶、灾害溯源等领域展现出广阔的应用前景。然而异源传感器采集的二、三维数据之间存在空间尺度和几何特征的差异，为影像与点云两种模态数据的精细配准带来了困难。鉴于此，本文提出一种基于线特征约束的多视角联合平差配准方法。首先从影像和点云数据中提取线特征并进行粗配准，然后在标准PnP（perspective-n-point）模型基础上引入线特征的方向一致性与正交一致性约束，以最小化多个视角下的误差函数为目标，将变换参数求解转化为非线性最小二乘问题进行迭代优化，最终实现影像与点云的准确配准。该过程无需进行二维-三维投影转换或尺度变换，从而可防止引入投影误差。对比实验结果表明，本文提出的具有线特征约束的多视角联合平差方法可显著提升影像和点云两种模态数据的配准精度。相较于单视角标准PnP模型，本文方法的配准误差降低了60%以上。

关键词: 影像和点云配准, 多视角联合平差, 线特征约束, PnP模型

Abstract: The registration of images and laser point clouds is a key technology for 3D scene reconstruction, providing critical scientific support for origin analysis of explosion accidents and holding broad application prospects in fields such as autonomous driving and disaster origin tracing. However, the spatial scale and geometric feature differences between 2D and 3D data collected by heterogeneous sensors pose challenges to the refined registration of image and point cloud modalities. To this end, this paper proposed a multi-view joint adjustment registration method based on line feature constraints. Firstly, line features were extracted from both images and point cloud data for coarse registration. Then, based on the standard perspective-n-point (PnP) model, constraints of directional consistency and orthogonal consistency of line features were introduced. By aiming to minimize the error function across multiple views, the transformation parameter solution was transformed into a nonlinear least squares problem for iterative optimization, ultimately achieving the accurate registration of images and point clouds. This process does not require 2D-3D projection transformations or scale conversions, thus preventing the introduction of projection errors. Comparative experiments show that the proposed multi-view joint adjustment method with line feature constraints can significantly improve the registration accuracy of image and point cloud modalities, reducing registration errors by over 60% compared to the single-view standard PnP model.

Key words: registration of images and point clouds, multi-view joint adjustment, line feature constraint, PnP model

中图分类号: