Skip to content

Add multi-GPU training support via FSDP #176

Open
Open
Add multi-GPU training support via FSDP#176
Labels
enhancementNew feature or requesttrainingTraining pipeline issues

Description

@SahilKumar75
SahilKumar75
opened on Jun 28, 2026

Currently training is single-GPU only. Add FSDP wrapping in finetune.py controlled by a NUM_GPUS config flag for users with multi-GPU nodes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesttrainingTraining pipeline issues

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions