2 Commits

Author	SHA1	Message	Date
LiangSong	ec2b4d6ee7	fix split by shard bug	2023-05-08 14:03:05 +08:00
LiangSong	4a1e7bb44b	Optimized the structure of configs, added support for deepspeed stage3, reduced memory usage by using Auto class to load models, and added support for training 65B models.	2023-05-06 23:37:17 +08:00