Umeå University's logo

umu.sePublications
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Reliable cultural knowledge preservation in multilingual LLMs through model merging
Umeå University, Faculty of Science and Technology, Department of Computing Science. WASP Media & Language, Umeå University, Sweden.
VNG Corporation, Vietnam.
Arcee.ai, San Francisco, USA.
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0001-8503-0118
Show others and affiliations
2025 (English)In: Proceedings of machine learning research: reliable and trustworthy artificial intelligence, 12 December 2025, multiple, ML Research Press , 2025, p. 59-66Conference paper, Published paper (Refereed)
Abstract [en]

We introduce a reliable approach for enhancing multilingual language models that preserves cultural knowledge while improving reasoning capabilities, focusing on low-resource languages. Using Qwen as a base model, we demonstrate that trust-aware model merging can verifiably improve performance without compromising cultural understanding. Our proposed approach achieves quantifiable improvements in both reasoning tasks and cultural benchmarks while maintaining computational efficiency. Results on Vietnamese and Arabic language tasks show consistent performance gains while preserving cultural knowledge, offering a reliable path for developing trustworthy multilingual AI systems. Our models are available at github.com/WARA-ML/waraml-mini-brains.

Place, publisher, year, edition, pages
ML Research Press , 2025. p. 59-66
Series
Proceedings of Machine Learning Research, E-ISSN 2640-3498 ; 310
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-250954Scopus ID: 2-s2.0-105031432839OAI: oai:DiVA.org:umu-250954DiVA, id: diva2:2046052
Conference
The 17th Asian Conference on Machine Learning, ACML 2025, Taipei, Taiwan, December 9-12, 2025
Available from: 2026-03-16 Created: 2026-03-16 Last updated: 2026-03-16Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

ScopusProceedings

Authority records

Nguyen, Hoang QuanBjörklund, JohannaVu, Xuan-Son

Search in DiVA

By author/editor
Nguyen, Hoang QuanBjörklund, JohannaVu, Xuan-Son
By organisation
Department of Computing Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 78 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf