LiangSong 73a81a4205 add high-performance Llama pre-train code		2023-03-26 23:59:53 +08:00
..
download_the_pile.sh	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
download_wudao.sh	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
preprocess_the_pile.py	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00
preprocess_wudao.py	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00