I have checked the code and there are few places which talk about TP. I saw from_pretrained method for model contains tp_plan and device_mesh. I also checked that the TrainingArgument can take ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback