基于语言特征增强的汉-缅平行句对抽取方法

doi:10.3969/j.issn.0255-8297.2026.03.003

应用科学学报 ›› 2026, Vol. 44 ›› Issue (3): 377-389.doi: 10.3969/j.issn.0255-8297.2026.03.003

• 智能信息处理 • 上一篇

基于语言特征增强的汉-缅平行句对抽取方法

赵子霄^1,2, 王昊^1,2, 申涛^1,2, 江姝婷^1,2, 张思琦^1,2, 赖华^1,2, 黄于欣^1,2, 余正涛^1,2

1. 昆明理工大学信息工程与自动化学院, 云南昆明 650500;
2. 昆明理工大学云南省人工智能重点实验室, 云南昆明 650500

收稿日期:2026-03-15 发布日期:2026-06-23
通信作者: 赖华，教授，研究方向为模式识别与智能系统、机器翻译。E-mail:405904235@qq.com E-mail:405904235@qq.com
基金资助:
国家自然科学基金(No.U24A20334,No.62366027,No.62266027);云南省基础研究计划重大项目(No.202401BC070021);云南省重大科技专项(No.202402AG050007,No.202303AP140008,No.202502AD080014);昆明理工大学“双一流”建设联合专项(No.202201BE070001-021)

Method for Extracting Chinese-Burmese Parallel Sentence Pairs Based on Language Feature Enhancement

ZHAO Zixiao^1,2, WANG Hao^1,2, SHEN Tao^1,2, JIANG Shuting^1,2, ZHANG Siqi^1,2, LAI Hua^1,2, HUANG Yuxin^1,2, YU Zhengtao^1,2

1. Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, Yunnan, China;
2. Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, Yunnan, China

Received:2026-03-15 Published:2026-06-23

摘要/Abstract

摘要： 针对低资源语言平行句对抽取中标注资源稀缺、模型表征能力不足的问题，本文提出一种基于语言特征增强的汉-缅平行句对抽取方法。该方法从数据增强、模型架构、训练机制3方面进行优化：首先，基于孪生网络构建汉语与缅甸语双编码器以形成跨语言语义表示空间；其次，引入基于词向量L₂范数的信息量评估机制，对高信息特征进行替换与样本增强，以缓解低资源下的数据稀疏问题；最后，通过正负样本构造与对比学习的动态建模，优化样本边界，实现更精准的汉-缅语义对齐。实验表明，所提方法在汉-缅平行句对抽取任务上F1值达95.03%，优于基线模型。此外，该文构建了5×10⁵句对规模的高质量汉-缅通用的数据集，为低资源语言相关研究提供数据支撑。

关键词: 平行句对抽取, 信息增强, 对比学习, 孪生网络

Abstract: To address the scarcity of labeled resources and the limited representational capacity of models in extracting parallel sentence pairs in low-resource languages, this paper proposed a language-feature-enhanced method for Chinese-Burmese parallel sentence pair extraction. The method was optimized from three aspects: data augmentation, model architecture, and training mechanism. First, a Chinese-Burmese dual encoder based on a Siamese network was constructed to build a cross-lingual semantic representation space.Second, an information-content evaluation mechanism based on the L₂ norm of word vectors was introduced to replace high-information features and perform sample augmentation,thus alleviating the data sparsity problem under low-resource conditions. Finally, positive and negative samples were constructed and dynamically modeled through contrastive learning to optimize sample boundaries and achieve more accurate Chinese-Burmese semantic alignment. Experimental results show that the proposed method achieves an F1 score of 95.03% on the Chinese-Burmese parallel sentence pair extraction task, outperforming the baseline model. In addition, this paper constructs a high-quality general-domain ChineseBurmese dataset containing 5 × 10⁵ sentence pairs, providing data support for research on low-resource languages.

Key words: parallel sentence pair extraction, information augmentation, contrastive learning, Siamese network

中图分类号:

TP391

赵子霄, 王昊, 申涛, 江姝婷, 张思琦, 赖华, 黄于欣, 余正涛. 基于语言特征增强的汉-缅平行句对抽取方法[J]. 应用科学学报, 2026, 44(3): 377-389.

ZHAO Zixiao, WANG Hao, SHEN Tao, JIANG Shuting, ZHANG Siqi, LAI Hua, HUANG Yuxin, YU Zhengtao. Method for Extracting Chinese-Burmese Parallel Sentence Pairs Based on Language Feature Enhancement[J]. Journal of Applied Sciences, 2026, 44(3): 377-389.

参考文献

[1] Artetxe M, Labaka G, Agirre E. Bilingual lexicon induction through unsupervised machine translation [C]//57th Annual Meeting of the Association for Computational Linguistics, 2019: 5002-5007.
[2] Bouamor H, Sajjad H. Parallel sentence extraction from comparable corpora using multilingual sentence embeddings [C]//Eleventh International Conference on Language Resources and Evaluation, 2018: 7-12.
[3] Grégoire F, Langlais P. A deep neural network approach to parallel sentence extraction [DB/OL]. (2017-09-28) [2026-03-15]. https://doi.org/10.48550/arXiv.1709.09783.
[4] Yang Z Q, Ma W T, Cui Y M, et al. Bilingual alignment pre-training for zero-shot crosslingual transfer [C]//3rd Workshop on Machine Reading for Question Answering, 2021: 100-105.
[5] Xue L T, Constant N, Roberts A, et al. MT5: a massively multilingual pre-trained textto-text transformer [C]//2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021: 483-498.
[6] Song Z J, Hu Z Z, Zhou Y E, et al. Embedded heterogeneous attention transformer for cross-lingual image captioning [J]. IEEE Transactions on Multimedia, 2024, 26: 9008-9020.
[7] Aftan S, Shah H. A survey on BERT and its applications [C]//20th Learning and Technology Conference (L&T), 2023: 161-166.
[8] Vu T T, He X L, Phung D, et al. Generalised unsupervised domain adaptation of neural machine translation with cross-lingual data selection [C]//2021 Conference on Empirical Methods in Natural Language Processing, 2021: 3335-3346.
[9] 郭军军, 田应飞, 余正涛, 等. 基于语义自适应编码的汉-越伪平行句对抽取方法[J]. 中文信息学报, 2021, 35(9): 58-65. Guo J J, Tian Y F, Yu Z T, et al. Pseudo-parallel sentence pair extraction for ChineseVietnamese based on semantic adaptive coding [J]. Journal of Chinese Information Processing, 2021, 35(9): 58-65. (in Chinese)
[10] 周远卓, 毛存礼, 沈政, 等. 基于孪生对比网络的汉语-东南亚语言多语言平行句对抽取[J]. 模式识别与人工智能, 2023, 36(10): 931-941. Zhou Y Z, Mao C L, Shen Z, et al. Siamese contrastive network based multilingual parallel sentence pair extraction between Chinese and Southeast Asian languages [J]. Pattern Recognition and Artificial Intelligence, 2023, 36(10): 931-941. (in Chinese)
[11] Zhu S L, Gu S W, Li S J, et al. Mining parallel sentences from Internet with multi-view knowledge distillation for low-resource language pairs [J]. Knowledge and Information Systems, 2024, 66(1): 187-209.
[12] Feng F, Yang Y, Cer D, et al. Language-agnostic BERT sentence embedding [C]//60th Annual Meeting of the Association for Computational Linguistics, 2022: 878-891.
[13] Sun Y, Wang S, Li Y, et al. ERNIE: enhanced representation through knowledge integration [DB/OL]. (2019-04-19) [2026-03-15]. https://doi.org/10.48550/arXiv.1904.09223.
[14] Wang L, Yang N, Huang X, et al. Text embeddings by weakly-supervised contrastive pretraining [DB/OL]. (2022-12-07) [2026-03-15]. https://doi.org/10.48550/arXiv.2212.03533.
[15] Zhang H X, Liu M T, Li C Y, et al. A reinforcement learning approach to improve lowresource machine translation leveraging domain monolingual data [C]//2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, 2024: 1486-1497.
[16] Zhu S L, Yang Y, Xu C. Extracting parallel sentences from nonparallel corpora using parallel hierarchical attention network [J]. Computational Intelligence and Neuroscience, 2020, 2020: 8823906.
[17] Steingrímsson S, Lohar P, Loftsson H, et al. Effective bitext extraction from comparable corpora using a combination of three different approaches [C]//14th Workshop on Building and Using Comparable Corpora (BUCC 2021), 2021: 8-17.
[18] 陈庆宇, 季繁繁, 袁晓彤. 基于伪孪生网络双层优化的对比学习[J]. 模式识别与人工智能, 2022, 35(10): 928-938. Chen Q Y, Ji F F, Yuan X T. Contrastive learning based on bilevel optimization of pseudo siamese networks [J]. Pattern Recognition and Artificial Intelligence, 2022, 35(10): 928-938. (in Chinese)
[19] Gao T Y, Yao X C, Chen D Q. SimCSE: simple contrastive learning of sentence embeddings [C]//2021 Conference on Empirical Methods in Natural Language Processing, 2021: 6894-6910.
[20] Pan X, Wang M, Wu L, et al. Contrastive learning for many-to-many multilingual neural machine translation [C]//The 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021: 244-258.
[21] Hong W, Zhang Z S, Wang J Y, et al. Sentence-aware contrastive learning for open-domain passage retrieval [C]//60th Annual Meeting of the Association for Computational Linguistics, 2022: 1062-1074.
[22] Ma X, Li H, Shi J W, et al. Importance-aware contrastive learning via semantically augmented instances for unsupervised sentence embeddings [J]. International Journal of Machine Learning and Cybernetics, 2023, 14(9): 2979-2990.
[23] Sutskever I, Vinyals O, Le Q V. Sequence to sequence learning with neural networks [C]//28th International Conference on Neural Information Processing Systems-Volume 2, 2014: 3104-3112.
[24] Bromley J, Guyon I, Lecun Y, et al. Signature verification using a “siamese” time delay neural network [C]//Advances in Neural Information Processing Systems, 1993, 6: 737-744.
[25] Schakel A M J, Wilson B J. Measuring word significance using distributed representations of words [DB/OL]. (2015-08-10) [2026-03-15]. https://doi.org/10.48550/arXiv.1508.02297.
[26] Thu Y K, Pa W P, Utiyama M, et al. Introducing the Asian language treebank (ALT) [C]//10th International Conference on Language Resources and Evaluation, 2016: 1574-1578.
[27] Tiedemann J. Parallel data, tools and interfaces in OPUS [C]//8th International Conference on Language Resources and Evaluation, 2012: 2214-2218.
[28] Ott M, Edunov S, Baevski A, et al. Fairseq: a fast, extensible toolkit for sequence modeling [C]//Conference of the North, 2019: 48-53.
[29] Dreiseitl S, Ohno-Machado L. Logistic regression and artificial neural network classification models: a methodology review [J]. Journal of Biomedical Informatics, 2002, 35(5/6): 352-359.
[30] Pires T, Schlinger E, Garrette D. How multilingual is multilingual BERT? [C]//57th Annual Meeting of the Association for Computational Linguistics, 2019: 4996-5001.
[31] 毛存礼, 高旭, 余正涛, 等. 结构特征一致性约束的双语平行句对抽取[J]. 重庆大学学报, 2021, 44(1): 46-56. Mao C L, Gao X, Yu Z T, et al. Extraction of bilingual parallel sentence pairs constrained by consistency of structural features [J]. Journal of Chongqing University, 2021, 44(1): 46-56. (in Chinese)
[32] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need [C]//Advances in Neural Information Processing Systems, 2017, 30: 5998-6008.

基于语言特征增强的汉-缅平行句对抽取方法

Method for Extracting Chinese-Burmese Parallel Sentence Pairs Based on Language Feature Enhancement

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价

[1]	吴文强, 陈爱斌, 李潇瑶. 基于特征融合注意力和对比学习的森林图像去雾[J]. 应用科学学报, 2026, 44(1): 97-109.
[2]	金彦亮, 方洁, 高塬, 周嘉豪. 基于对比学习的半监督加密流量分类模型[J]. 应用科学学报, 2025, 43(3): 437-450.
[3]	熊娟, 张孙杰, 阚亚亚, 陈家豪. 基于CAFPN和细化双头解耦的遥感图像目标检测[J]. 应用科学学报, 2023, 41(6): 989-1003.