Skip to content

Pull requests: huggingface/trl

New pull request New
78 Open 2,396 Closed
78 Open 2,396 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Clarify Accelerate usage in SFTTrainer documentation
#4744 opened Dec 23, 2025 by Likhita-17 Loading…
1 task done
2
fix minillm trainer
#4743 opened Dec 23, 2025 by t1101675 Loading…
5 tasks
3
[GRPOTrainer]: Agent Training Supports Async Tool Calls
#4742 opened Dec 23, 2025 by pramodith Loading…
5 tasks done
9
[WIP] feat: Bidirectional masked importance sampling ratio (MIS) for IcePop
#4732 opened Dec 20, 2025 by casinca • Draft
5 tasks
1
Fix MiniLLM Training
#4731 opened Dec 20, 2025 by t1101675 Loading…
2
Up to 50% less VRAM during forward with forward_masked_logits function
#4729 opened Dec 20, 2025 by qgallouedec Loading…
4
Improve PEFT integration
#4723 opened Dec 19, 2025 by qgallouedec Loading…
2
Refactor vLLM generation [2/N]: Decouple rollout_func and vLLM functionalities
#4712 opened Dec 17, 2025 by albertvillanova • Draft
1
Refactor vLLM generation [1/N]: Extract vLLM generation
#4700 opened Dec 16, 2025 by albertvillanova Loading…
18
fix: invalidate ZeRO-3 param coordinator trace in add_hooks
#4693 opened Dec 15, 2025 by roycho96 Loading…
1 of 5 tasks
@kashif
6
feat: DeepSeek V3.2 Off-policy sequence masking
#4689 opened Dec 13, 2025 by casinca Loading…
4 of 5 tasks
1
10
GKDTrainer: Fix return_outputs in Liger kernel path and update tests
#4688 opened Dec 13, 2025 by roycho96 Loading…
2 of 5 tasks
2
Update import structure
#4665 opened Dec 11, 2025 by qgallouedec Loading…
1
[WIP] GRPO-inspired Online DPO refactor
#4659 opened Dec 10, 2025 by d-tiapkin • Draft
2 of 7 tasks
@kashif
feature: Add RTPO Trainer
#4652 opened Dec 9, 2025 by SolarWindRider Loading…
6 tasks done
6
CPOTrainer - Incorrect handling of different length chosen/rejected p…
#4639 opened Dec 8, 2025 by davmels Loading…
Update docs landing with latest details
#4624 opened Dec 4, 2025 by sergiopaniego Loading…
6 tasks
1
Add cross-tokenizer distillation support for GKD and MiniLLM trainers
#4561 opened Nov 22, 2025 by sambhavnoobcoder Loading…
1
Add PSPO trust region method as alternative to clipping in GRPOTrainer
#4548 opened Nov 19, 2025 by MCDwyer Loading…
2 of 5 tasks
@kashif
4
Add compute_metrics parameter for GRPOTrainer
#4534 opened Nov 17, 2025 by colinzhaoxp Loading…
3
[GRPO] switch grpo liger loss to triton version
#4519 opened Nov 13, 2025 by kashif Loading…
1 of 8 tasks
10
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
4
refactor: simplify parameter freezing in modeling_base.py
#4305 opened Oct 20, 2025 by Ki-Seki Loading…
2 of 5 tasks
2
ProTip! Adding no:label will show everything without a label.