Banaxi-Tech (Banaxi)

reacted to their post with 🔥 about 7 hours ago

Post

585

We're excited to announce BananaMind 2V, our small vision model series!
These models are NOT released yet.
We will release them in mid-august!
BananaMind 2V will include:
BananaMind 2V 256M, the flagship based on BananaMind 2 Pro (BananaMind 2 Pro is not released yet).
BananaMind 2V 100M, our mid model, based on BananaMind 2 Medium.
BananaMind 2V 50M, our smallest vision model, based on BananaMind 2 Mini.
These are currently unreleased and will release in mid-august.
Our training will start after BananaMind 2 Pro has finished training.

posted an update about 7 hours ago

Post

585

We're excited to announce BananaMind 2V, our small vision model series!
These models are NOT released yet.
We will release them in mid-august!
BananaMind 2V will include:
BananaMind 2V 256M, the flagship based on BananaMind 2 Pro (BananaMind 2 Pro is not released yet).
BananaMind 2V 100M, our mid model, based on BananaMind 2 Medium.
BananaMind 2V 50M, our smallest vision model, based on BananaMind 2 Mini.
These are currently unreleased and will release in mid-august.
Our training will start after BananaMind 2 Pro has finished training.

replied to their post about 19 hours ago

Oh, for that, ALWAYS smol-smoltalk its very good

replied to their post about 21 hours ago

I reccomend using fineweb edu, dclm, cosmopedia v2 and finemath together as datasets

reacted to appvoid's post with 🔥 1 day ago

Post

1402

Two big projects are open sourced soon. Get ready.

1 reply

·

replied to their post 1 day ago

Yeah new version of the big model should be coming out soon, recently havent had access to my training hardwaare but should be online soon with an upgrade!

will gpt x2.5 be continued pretraining or SFT on X2?

replied to their post 1 day ago

Yeah code is hard in 50m, the 140m when it releases will be alot better

replied to their post 2 days ago

are you going to release gpt x3 soon?

replied to their post 2 days ago

Ahh ok no worries then, Is pro going to be bigger then 50m?

140m so yes

replied to their post 2 days ago

No i dont have it

replied to their post 2 days ago

This comment has been hidden

replied to their post 2 days ago

dont think i can get #1 on All with Pro because of Nexus Erebus 135M

replied to their post 2 days ago

it will take a bit

reacted to their post with 👍🔥 2 days ago

Post

2494

We're excited to release BananaMind 2 Medium and BananaMind 2 Medium Chat!

They’re both 50M parameter models trained on 50B tokens from FineWeb-Edu, DCLM, Cosmopedia v2, FineMath-4+ and NPSet-2 Python-Edu.

The base model reached 61.86% on PIQA, 43.81% on ARC Easy and 32.43% on HellaSwag. The Chat version was fine-tuned on Smol-SmolTalk and scored 38% overall on our internal instruction benchmark, with 56% on multi-turn, 60% on context recall and 80% on code.

The full details are in the model repos.

Check it out at
BananaMind/BananaMind-2-Medium
BananaMind/BananaMind-2-Medium-Chat

17 replies

·

posted an update 2 days ago

Post

2494

We're excited to release BananaMind 2 Medium and BananaMind 2 Medium Chat!

They’re both 50M parameter models trained on 50B tokens from FineWeb-Edu, DCLM, Cosmopedia v2, FineMath-4+ and NPSet-2 Python-Edu.

The base model reached 61.86% on PIQA, 43.81% on ARC Easy and 32.43% on HellaSwag. The Chat version was fine-tuned on Smol-SmolTalk and scored 38% overall on our internal instruction benchmark, with 56% on multi-turn, 60% on context recall and 80% on code.

The full details are in the model repos.

Check it out at
BananaMind/BananaMind-2-Medium
BananaMind/BananaMind-2-Medium-Chat

17 replies

·

reacted to their post with 🧠 2 days ago

Post

1437

Lets get 80 followers on my account and 30 on BananaMind.
When we hit that we are going to release BananaMind 2 Medium tomorrow.
Me: @Banaxi-Tech
BananaMind:

BananaMind

Early checkpoint shows #1 for <50M on the Open SLM Leaderboard!

Keep Shipping! 🚀

7 replies

·

reacted to HannesVonEssen's post with 👍 2 days ago

Post

1160

📣 Countdown Kimi K3 with us!

Read our deep dive into the architecture of Kimi K3 and get notified on July 27 when it gets released and is viewable on hfviewer.com!

https://hfviewer.com/moonshotai/kimi-k3

replied to their post 2 days ago

Huh? I trained a custom 70M model on 15B tokens in just 1 day and didn't have any issues with it. Have you actually tried using it? Even if it's really 12 hours (they might have changed it), it's still powerful enough to train small models in about 6 hours. For instance, I managed to train a 50M model on 10B tokens in 6 hours, and it would probably take around 9 hours for 30B tokens.

idk why because they say 12 hours

reacted to ucr-max's post with 🔥 3 days ago

Post

2943

We have released the first version of CompactLMIndex UniversalComputingResearch/clmi, a curated benchmark for smaller language models.

The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.

The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.

If you have results for a model that fits the benchmark scope, please open a discussion on the Space.

6 replies

·

Banaxi PRO

AI & ML interests

Recent Activity

Organizations

Banaxi PRO

AI & ML interests

Recent Activity

Organizations

Banaxi-Tech's activity