4 Commits

Author	SHA1	Message	Date
LiangSong	95973b5de1	update header	2023-05-17 22:21:46 +07:00
LiangSong	f8f4cde228	using huggingface datasets to accelerate training, using open-llama to pretrain	2023-04-24 19:13:53 +08:00
LiangSong	918a8cdc3d	reformat code with black	2023-03-27 14:34:59 +08:00
LiangSong	73a81a4205	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00