5 Commits

Author	SHA1	Message	Date
LiangSong	97aff0e051	use split_dataset_by_node instead accelerate.prepare to accelerate data loading by 50%	2023-04-27 00:04:11 +08:00
LiangSong	f8f4cde228	using huggingface datasets to accelerate training, using open-llama to pretrain	2023-04-24 19:13:53 +08:00
LiangSong	c67d365db3	update format	2023-04-07 23:20:20 +08:00
LiangSong	f4ba4b6ff2	update chinese readme	2023-04-07 23:19:42 +08:00
LiangSong	1a731953da	update server	2023-04-07 10:04:05 +08:00