From 98f17bf0f6c38bb8b932dcd5dacb48c32ee85543 Mon Sep 17 00:00:00 2001 From: Namhyeon Go Date: Sat, 15 Jun 2024 12:16:31 +0000 Subject: [PATCH] Update Tutorial --- Tutorial.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/Tutorial.md b/Tutorial.md index ef90e4e..f22246a 100644 --- a/Tutorial.md +++ b/Tutorial.md @@ -45,6 +45,10 @@ * 데이터 로딩 실행 ``` - $python3 dataset/dataset.py + $ python3 dataset/dataset.py ``` +5. 선행학습(pretrain) 진행 + ``` + $ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json + ``` \ No newline at end of file