The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.

LiangSong 73a81a4205 add high-performance Llama pre-train code		2023-03-26 23:59:53 +08:00
configs	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
data	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
dataset	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
models	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
.gitignore	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
LICENSE	Initial commit	2023-03-26 22:40:04 +08:00
pretrain_llama.py	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
requirements.txt	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00