minnesotanlp/Finch-4B-KTO
Text Generation • 5B • Updated • 10 • 2
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
183
Active filters: preference-learning
minnesotanlp/Finch-8B-KTO
Text Generation • 8B • Updated • 16 • 2
Haleshot/Mathmate-7B-DELLA-ORPO
7B • Updated • 8
ilgee/Binary-Think-RM-8B
8B • Updated • 9
ilgee/Multiclass-Think-RM-8B
8B • Updated • 12
codelion/gemma-3-1b-it-reasoning-grpo-lora
Text Generation • Updated • 3 • 4
ilgee/Binary-Think-RM-3B
3B • Updated • 5 • 1
codelion/Qwen2.5-Coder-0.5B-Instruct-security-grpo-lora
Text Generation • Updated • 15
pyamy/llama3-dpo-pairrm
Updated • 7
pyamy/llama3-dpo-llm-judge
Updated • 4
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 5
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 17
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 13
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 8
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 6
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 15
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 25
5456es/implicit_reward_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 10
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 10
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated • 6
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 17
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 4
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 21
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 5
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 6
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated • 5
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated • 5
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated • 12
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated • 27
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated • 8