diff --git a/Tutorial.md b/Tutorial.md index e433763..bb3e59c 100644 --- a/Tutorial.md +++ b/Tutorial.md @@ -93,7 +93,13 @@ $ nvidia-smi ``` +6. + + 5. 선행학습(pretrain) 진행 + + 참고: 그래픽 카드 수에 따라 `--num_processes` 값 조정하여야 함. + ``` - $ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json + $ accelerate launch --num_processes=1 --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json ``` \ No newline at end of file