We use 4 nodes each has 8 H20 GPUs. We use TP32 docker run -dit --gpus all --shm-size 32g --name sglang_multinode1 --network host -p 30000:30000 -p 5000:5000 -v /data:/root/data --ipc=host ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback