diff --git a/Tutorial.md b/Tutorial.md index ef90e4e..f22246a 100644 --- a/Tutorial.md +++ b/Tutorial.md @@ -45,6 +45,10 @@ * 데이터 로딩 실행 ``` - $python3 dataset/dataset.py + $ python3 dataset/dataset.py ``` +5. 선행학습(pretrain) 진행 + ``` + $ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json + ``` \ No newline at end of file