PetteriPano

@PetteriPano@lemmy.world · Joined ⁨Sep⁩ ⁨2024⁩

6Posts
0Following0Followers
PetteriPano@PetteriPano@lemmy.world

Replying to @⁨Meron35@lemmy.world⁩

I didn’t say it’s more token efficient. I said training multiple languages improves reasoning.

arXiv logoarXiv.orgBeyond English-Centric Training: How Reinforcement Learning Improves Cross-Lingual Reasoning in LLMsEnhancing the complex reasoning capabilities of Large Language Models (LLMs) attracts widespread attention. While reinforcement learning (RL) has shown superior performance for improving complex reasoning, its impact on cross-lingual generalization compared to Supervised Fine-Tuning (SFT) remains unexplored. We present the first systematic investigation into cross-lingual reasoning generalization of RL and SFT. Using Qwen2.5-3B-Base as our foundation model, we conduct experiments on diverse multilingual reasoning benchmarks, including math reasoning, commonsense reasoning, and scientific reasoning. Our investigation yields two significant findings: (1) Tuning with RL not only achieves higher accuracy but also demonstrates substantially stronger cross-lingual generalization capabilities compared to SFT. (2) RL training on non-English data yields better overall performance and generalization than training on English data, which is not observed with SFT. Furthermore, through comprehensive