From 4238ec37c1c8b8e6577cac5c8a1c527116de5e1e Mon Sep 17 00:00:00 2001 From: Namhyeon Go Date: Sat, 15 Jun 2024 18:05:02 +0000 Subject: [PATCH] Update Tutorial --- Tutorial.md | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/Tutorial.md b/Tutorial.md index e433763..bb3e59c 100644 --- a/Tutorial.md +++ b/Tutorial.md @@ -93,7 +93,13 @@ $ nvidia-smi ``` +6. + + 5. 선행학습(pretrain) 진행 + + 참고: 그래픽 카드 수에 따라 `--num_processes` 값 조정하여야 함. + ``` - $ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json + $ accelerate launch --num_processes=1 --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json ``` \ No newline at end of file