gnh1201/Open-Llama
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update Tutorial

Namhyeon Go 2024-06-15 12:56:09 +00:00
parent 548637ec36
commit 57d583c97f
1 changed files with 11 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
Tutorial.md

@ -79,6 +79,17 @@
$ sudo apt-get -y install cuda $ sudo apt-get -y install cuda
``` ```
* nvidia 모듈 다시 로드
```
$ sudo rmmod nvidia_drm
$ sudo rmmod nvidia_modeset
$ sudo rmmod nvidia_uvm
$ sudo rmmod nvidia
$ nvidia-smi
```
설치된 그래픽 카드가 정상적으로 표시되는지 확인.
5. 선행학습(pretrain) 진행 5. 선행학습(pretrain) 진행
``` ```
$ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json $ accelerate launch --config_file configs/accelerate_configs/ds_stage1.yaml train_lm.py --train_config configs/pretrain_config.yaml --model_config configs/model_configs/7B.json