liang.he 0599351262 wasi-nn: Add a new target for llama.cpp as a wasi-nn backend (#3709) ... Minimum support: - [x] accept (WasmEdge) customized model parameters. metadata. - [x] Target [wasmedge-ggml examples](https://github.com/second-state/WasmEdge-WASINN-examples/tree/master/wasmedge-ggml) - [x] basic - [x] chatml - [x] gemma - [x] llama - [x] qwen --- In the future, to support if required: - [ ] Target [wasmedge-ggml examples](https://github.com/second-state/WasmEdge-WASINN-examples/tree/master/wasmedge-ggml) - [ ] command-r. (>70G memory requirement) - [ ] embedding. (embedding mode) - [ ] grammar. (use the grammar option to constrain the model to generate the JSON output) - [ ] llama-stream. (new APIS `compute_single`, `get_output_single`, `fini_single`) - [ ] llava. (image representation) - [ ] llava-base64-stream. (image representation) - [ ] multimodel. (image representation) - [ ] Target [llamaedge](https://github.com/LlamaEdge/LlamaEdge)		2024-09-10 08:45:18 +08:00
..
utils	[wasi-nn] Add a new wasi-nn backend openvino (#3603)	2024-07-22 17:16:41 +08:00
wasi_nn_llamacpp.c	wasi-nn: Add a new target for llama.cpp as a wasi-nn backend (#3709)	2024-09-10 08:45:18 +08:00
wasi_nn_openvino.c	wasi-nn: Apply new architecture (#3692)	2024-08-13 09:14:52 +08:00
wasi_nn_openvino.h	wasi-nn: Apply new architecture (#3692)	2024-08-13 09:14:52 +08:00
wasi_nn_private.h	wasi-nn: Apply new architecture (#3692)	2024-08-13 09:14:52 +08:00
wasi_nn_tensorflowlite.cpp	wasi-nn: Apply new architecture (#3692)	2024-08-13 09:14:52 +08:00
wasi_nn_tensorflowlite.hpp	wasi-nn: Apply new architecture (#3692)	2024-08-13 09:14:52 +08:00
wasi_nn.c	wasi-nn: Add a new target for llama.cpp as a wasi-nn backend (#3709)	2024-09-10 08:45:18 +08:00