5 Commits

Author	SHA1	Message	Date
LiangSong	bc16df4751	add more instruction data	2023-04-06 03:45:24 +08:00
LiangSong	562067230f	update dataset, add concat sequence from multiple docs	2023-04-05 22:42:34 +08:00
LiangSong	b9bc7eaf35	fix long seq bug	2023-03-31 10:12:28 +08:00
LiangSong	918a8cdc3d	reformat code with black	2023-03-27 14:34:59 +08:00
LiangSong	73a81a4205	add high-performance Llama pre-train code	2023-03-26 23:59:53 +08:00