Guilherme Penedo

guipenedo's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 7 months ago

view article

Article

SmolLM3: smol, multilingual, long-context reasoner

• 
• 
• +21

Jul 8, 2025

•

754

upvoted 2 papers 8 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Paper • 2506.20920 • Published Jun 26, 2025 • 77

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

Paper • 2506.05209 • Published Jun 5, 2025 • 60

upvoted an article 10 months ago

view article

Article

Welcome Llama 4 Maverick & Scout on Hugging Face

• 
• 
• +5

Apr 5, 2025

•

147

upvoted an article 11 months ago

view article

Article

Open R1: Update #3

• 

Mar 11, 2025

•

296

upvoted 2 articles 12 months ago

view article

Article

Finding Moroccan Arabic (Darija) in Fineweb 2

• 

Dec 8, 2024

•

23

view article

Article

Open R1: Update #2

• 

Feb 10, 2025

•

218

upvoted a paper about 1 year ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Paper • 2502.02737 • Published Feb 4, 2025 • 254

upvoted an article about 1 year ago

view article

Article

Open-R1: Update #1

• 

Feb 2, 2025

•

305

upvoted a paper about 1 year ago

Towards Best Practices for Open Datasets for LLM Training

Paper • 2501.08365 • Published Jan 14, 2025 • 62

upvoted an article about 1 year ago

view article

Article

FineWeb2-C: Help Build Better Language Models in Your Language

• 

Dec 23, 2024

•

21

upvoted a collection about 1 year ago

🥂 FineWeb2

Collection

3 items • Updated Jun 27, 2025 • 23

upvoted a paper about 1 year ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7, 2024 • 127

upvoted an article about 1 year ago

view article

Article

Releasing the largest multilingual open pretraining dataset

• 

Nov 13, 2024

•

105

upvoted an article over 1 year ago

view article

Article

🇨🇿 BenCzechMark - Can your LLM Understand Czech?

• 
• 
• +11

Oct 1, 2024

•

23

upvoted a paper over 1 year ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 100

upvoted a paper almost 2 years ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3, 2024 • 103

upvoted 2 papers about 2 years ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 150

The Falcon Series of Open Language Models

Paper • 2311.16867 • Published Nov 28, 2023 • 14

upvoted a paper over 2 years ago

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 42