ianncity/KIMI-K2.5-1000000x
Viewer • Updated • 733k • 2.45k • 189
NexThinkLabs
NexThinkLabs
AI & ML interests
None yet
Recent Activity
liked a dataset 11 days ago
ianncity/KIMI-K2.5-1000000x liked a dataset 12 days ago
OpenMOSS-Team/OmniAction liked a dataset 26 days ago
markov-ai/computer-use-largeOrganizations
liked a
dataset 11 days ago
liked a
dataset 12 days ago
liked a
dataset 26 days ago
liked a
model 26 days ago
liked a
model 27 days ago
liked a
dataset about 1 month ago
liked a
model about 1 month ago
liked 5
datasets about 1 month ago
Jackrong/Qwen3.5-reasoning-700x
Viewer • Updated • 633 • 7.22k • 102
Crownelius/Opus-4.6-Reasoning-3300x
Viewer • Updated • 2.16k • 3.08k • 259
TuringEnterprises/Open-RL
Viewer • Updated • 40 • 892 • 179
fka/prompts.chat
Viewer • Updated • 1.64k • 36.1k • 9.65k
togethercomputer/CoderForge-Preview
Viewer • Updated • 827k • 6.34k • 160
reactedto hannayukhymenko's post with 🔥 about 1 month ago
Post
2003
Do you translate your benchmarks from English correctly? 🤔
Turns out, for many languages it is much harder than you can imagine!
Introducing Recovered in Translation 🌍 together with @aalexandrov
https://ritranslation.insait.ai
Translating benchmarks is a painful process, requiring a lot of manual inspection and adjustments. You start from setting up the whole pipeline and adapting to every format type, including task specifics. There already exist some massive benchmarks, but they still have some simple (and sometimes silly) bugs, which can hurt the evaluations :( We present a novel automated translation framework to help with that!
Eastern and Southern European languages introduce richer linguistic structures compared to English and for benchmarks which heavily rely on grammatical coherence machine translation presents a risk of harming evaluations. We discover potential answer leakage or misleading through grammatical structure of the questions. Some benchmarks are also just outdated and need to be retranslated with newer and better models.
We present a framework with novel test-time scaling methods which allow to control time and cost investments, while at the same time mitigate the need for human-in-the-loop verification. While working on Ukrainian-focused MamayLM models, we had to translate 10+ benchmarks in a short span of time. Finding human evaluators is costly and time-consuming, same goes for using professional translators. With our pipeline we were able to do it in 3 days🏎️
We hope our findings will help enable stronger multilingual evaluations and developments. We release all produced benchmarks on Hugging Face together with the source code and Arxiv paper 🤗
Paper: Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets (2602.22207)
Code: https://github.com/insait-institute/ritranslation
Benchmarks: https://huggingface.co/collections/INSAIT-Institute/multilingual-benchmarks
Turns out, for many languages it is much harder than you can imagine!
Introducing Recovered in Translation 🌍 together with @aalexandrov
https://ritranslation.insait.ai
Translating benchmarks is a painful process, requiring a lot of manual inspection and adjustments. You start from setting up the whole pipeline and adapting to every format type, including task specifics. There already exist some massive benchmarks, but they still have some simple (and sometimes silly) bugs, which can hurt the evaluations :( We present a novel automated translation framework to help with that!
Eastern and Southern European languages introduce richer linguistic structures compared to English and for benchmarks which heavily rely on grammatical coherence machine translation presents a risk of harming evaluations. We discover potential answer leakage or misleading through grammatical structure of the questions. Some benchmarks are also just outdated and need to be retranslated with newer and better models.
We present a framework with novel test-time scaling methods which allow to control time and cost investments, while at the same time mitigate the need for human-in-the-loop verification. While working on Ukrainian-focused MamayLM models, we had to translate 10+ benchmarks in a short span of time. Finding human evaluators is costly and time-consuming, same goes for using professional translators. With our pipeline we were able to do it in 3 days🏎️
We hope our findings will help enable stronger multilingual evaluations and developments. We release all produced benchmarks on Hugging Face together with the source code and Arxiv paper 🤗
Paper: Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets (2602.22207)
Code: https://github.com/insait-institute/ritranslation
Benchmarks: https://huggingface.co/collections/INSAIT-Institute/multilingual-benchmarks
- 1 reply
liked a
dataset about 1 month ago
liked a
model about 1 month ago
liked a
dataset about 1 month ago
reactedto albertvillanova's post with 🤗 about 1 month ago
Post
2315
🚀 TRL v0.29.0 introduces trl-training: an agent-native training skill.
This makes the TRL CLI a structured, agent-readable capability, allowing AI agents to reliably execute training workflows such as:
- Supervised Fine-Tuning (SFT)
- Direct Preference Optimization (DPO)
- Group Relative Policy Optimization (GRPO)
We’re excited to see what the community builds on top of this.
If you’re working on AI agents, alignment research, or scalable RL training infrastructure: give TRL v0.29.0 a try! 🤗
The future of ML tooling is agent-native.
🔗 https://github.com/huggingface/trl/releases/tag/v0.29.0
This makes the TRL CLI a structured, agent-readable capability, allowing AI agents to reliably execute training workflows such as:
- Supervised Fine-Tuning (SFT)
- Direct Preference Optimization (DPO)
- Group Relative Policy Optimization (GRPO)
We’re excited to see what the community builds on top of this.
If you’re working on AI agents, alignment research, or scalable RL training infrastructure: give TRL v0.29.0 a try! 🤗
The future of ML tooling is agent-native.
🔗 https://github.com/huggingface/trl/releases/tag/v0.29.0
liked 2
models about 2 months ago
liked a
dataset about 2 months ago