gnh1201/wasm-micro-runtime
1
0
Fork 0
mirror of https://github.com/bytecodealliance/wasm-micro-runtime.git synced 2025-02-06 15:05:19 +00:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity
0599351262
wasm-micro-runtime/core/iwasm
History
liang.he 0599351262
wasi-nn: Add a new target for llama.cpp as a wasi-nn backend (#3709) 
Minimum support:
- [x] accept (WasmEdge) customized model parameters. metadata.
- [x] Target [wasmedge-ggml examples](https://github.com/second-state/WasmEdge-WASINN-examples/tree/master/wasmedge-ggml)
  - [x] basic
  - [x] chatml
  - [x] gemma
  - [x] llama
  - [x] qwen

---

In the future, to support if required:
- [ ] Target [wasmedge-ggml examples](https://github.com/second-state/WasmEdge-WASINN-examples/tree/master/wasmedge-ggml)
  - [ ] command-r. (>70G memory requirement)
  - [ ] embedding. (embedding mode)
  - [ ] grammar. (use the grammar option to constrain the model to generate the JSON output)
  - [ ] llama-stream. (new APIS `compute_single`, `get_output_single`, `fini_single`)
  - [ ] llava. (image representation)
  - [ ] llava-base64-stream. (image representation)
  - [ ] multimodel. (image representation)
- [ ] Target [llamaedge](https://github.com/LlamaEdge/LlamaEdge)
2024-09-10 08:45:18 +08:00
..
aot Remove unnecessary code duplication in aot runtime (#3767) 2024-09-05 11:10:18 +08:00
common Add support for multi-memory proposal in classic interpreter (#3742) 2024-08-21 12:22:23 +08:00
compilation Add wamrc parameter to configure stack frame features (#3763) 2024-09-05 21:44:06 +08:00
doc Fix some more spelling issues (#3393) 2024-05-08 09:30:29 +08:00
fast-jit Add support for multi-memory proposal in classic interpreter (#3742) 2024-08-21 12:22:23 +08:00
include Add wamrc parameter to configure stack frame features (#3763) 2024-09-05 21:44:06 +08:00
interpreter Add wamrc parameter to configure stack frame features (#3763) 2024-09-05 21:44:06 +08:00
libraries wasi-nn: Add a new target for llama.cpp as a wasi-nn backend (#3709) 2024-09-10 08:45:18 +08:00
README.md Add architecture diagram for wasm globals and classic-interp stack frame (#2058) 2023-03-25 09:39:20 +08:00

README.md

vmcore architecture

Wasm function

Exports

globals

classic interpreter