mradermacher/Qwen2.5-Coder-1.5B-Unsensored-DPO-GGUF
2B • Updated • 1.3k • 3
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
10,600
Active filters: dpo, trl
CEIA-RL/energy-exp1-dpo-offline
Text Generation • 4B • Updated • 204 • 8
wxzhang/dpo-selective-redteaming
Text Generation • 7B • Updated • 139 • 6
Riyan200324200324/Qwen3-Next-80B-A3B-Instruct-Decensored-i1-GGUF
80B • Updated • 1.62k • 1
zaydsyed/TactLM-Instruction-DPO-Qwen2.5-0.5B
Text Generation • 0.5B • Updated • 39 • 1
zaydsyed/TactLM-Instruction-DPO-GRPO-Qwen2.5-0.5B
Text Generation • 0.5B • Updated • 44 • 1
hokseng789/Qwen3-0.6B-French-DPO
Text Generation • 0.6B • Updated • 42 • 1
lewtun/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 14
alignment-handbook/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 95 • 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 32 • 9
amirali1985/gpt-neo-125m_hh_reward
Text Generation • 0.1B • Updated • 13
lewtun/zephyr-7b-dpo-qlora
Updated • 31
sambar/zephyr-7b-ipo-lora
Text Generation • Updated • 18
nlee282/moai-dpo-1.0
Updated • 13
nikkoyabut/merged_model_dpo
Updated • 5
sambar/zephyr-7b-ipo-lora-5ep
Text Generation • Updated • 12
alexredna/TinyLlama-1.1B-Chat-v1.0-reasoning-v2-dpo
Text Generation • 1B • Updated • 26 • 2
AlbelTec/mistral-dpo-old
Updated • 5
Yaxin1992/mixtral-dpo-1000
Updated • 5
adhi29/openhermes-mistral-dpo-gptq
Updated
ybelkada/test-tags-model
Text Generation • 1.03M • Updated • 11
ybelkada/test-tags-model-2
Text Generation • 1.03M • Updated • 7
justinj92/dpoplatypus-phi2
Text Generation • 3B • Updated
Belred/mistral-dpo
Updated • 4
lewtun/zephyr-7b-dpo-qlora-8e0975a
Updated • 14
mecoaoge2/results
Updated • 9
mecoaoge2/fununun
Updated • 15
akashkumarbtc/openhermes-mistral-dpo-gptq
Updated
darshan8950/openhermes-mistral-dpo-gptq
Updated
sonu2023/mistral-dpo
Updated