gnh1201/Open-Llama
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update Tutorial

Namhyeon Go 2024-06-15 18:05:02 +00:00
parent a946794ee3
commit 4238ec37c1
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
Tutorial.md

@ -93,7 +93,13 @@
$ nvidia-smi
```
6.
5. 선행학습(pretrain) 진행
참고: 그래픽 카드 수에 따라 `--num_processes` 값 조정하여야 함.
```
$ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json
$ accelerate launch --num_processes=1 --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json
```