We finetuned XGLM-7.5B on 4 V100 GPU (32GB VARM) with the hyperparameters described in script/train_sft_peft_multi_world.py. python -m torch.distributed.launch ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback