update readme

This commit is contained in:
LiangSong 2023-03-29 21:44:58 +08:00
parent 87776f4370
commit 0e31648d5f
5 changed files with 20 additions and 2 deletions

View File

@ -2,7 +2,7 @@
* @Author: LiangSong(sl12160010@gmail.com)
* @Date: 2023-03-10 21:18:35
* @LastEditors: LiangSong(sl12160010@gmail.com)
* @LastEditTime: 2023-03-27 02:40:54
* @LastEditTime: 2023-03-29 21:44:01
* @FilePath: /Open-Llama/README.md
* @Description:
*
@ -14,6 +14,15 @@
Open-Llama是一个开源项目提供了一整套用于构建大型语言模型的训练流程从数据集准备到分词、预训练、指令调优以及强化学习技术 RLHF。
## 进展
经过30K step的预训练已经展现出了一定的胡说八道的能力如下分别是编写代码、续写论文和续写中文虽然正确性存在问题但是已经像是一句话了。
<div style="display:flex;">
<div style="flex:1"><img src="assets/code.JPG" width="100%"></div>
<div style="flex:1"><img src="assets/paper.JPG" width="100%"></div>
<div style="flex:1"><img src="assets/chinese.JPG" width="100%"></div>
</div>
## **特性**
### 易用性

View File

@ -2,7 +2,7 @@
* @Author: LiangSong(sl12160010@gmail.com)
* @Date: 2023-03-10 21:18:35
* @LastEditors: LiangSong(sl12160010@gmail.com)
* @LastEditTime: 2023-03-27 02:41:39
* @LastEditTime: 2023-03-29 21:44:43
* @FilePath: /Open-Llama/README_en.md
* @Description:
*
@ -14,6 +14,15 @@ Translated by ChatGPT.
Open-Llama is an open source project that provides a complete set of training processes for building large-scale language models, from data preparation to tokenization, pre-training, instruction tuning, and reinforcement learning techniques such as RLHF.
## Progress
After 30K steps of pre-training, the model has demonstrated some language capabilities, as shown below in coding, paper continuation, and Chinese continuation tasks. Although there are still issues with correctness, the generated outputs resemble sentences.
<div style="display:flex;">
<div style="flex:1"><img src="assets/code.JPG" width="100%"></div>
<div style="flex:1"><img src="assets/paper.JPG" width="100%"></div>
<div style="flex:1"><img src="assets/chinese.JPG" width="100%"></div>
</div>
## **Features**
### Ease of Use
We believe that ease of use is one of the most important features when building large-scale language models. To make Open-Llama more accessible, we focus on the following:

BIN
assets/chinese.JPG Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 960 KiB

BIN
assets/code.JPG Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 202 KiB

BIN
assets/paper.JPG Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 289 KiB