Update Tutorial

Namhyeon Go 2024-06-15 12:16:31 +00:00
parent dc9f9785ab
commit 98f17bf0f6

@ -45,6 +45,10 @@
* 데이터 로딩 실행
```
$python3 dataset/dataset.py
$ python3 dataset/dataset.py
```
5. 선행학습(pretrain) 진행
```
$ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json
```