414 Commits

Author	SHA1	Message	Date
liang.he	8acce563b4	Merge branch main into dev/instantiate_linking (#4100) ... - fix: when load aot init expr,no type_idx set. (#4094) - Cmake improvements (#4076) - fix(aot_emit_aot_file): prevent buffer emission for zero byte_count (#4095) - fix(unit-test): libc_builtin_test issues (#4073) - feat: add support for EXTERNREF value type and enable AOT validator in fuzz tests (#4083) - [gc] Subtyping fix (#4075) - Add a conditional check for the macro __STDC_VERSION__ (#4080) - Unit test:type matching issue and code redundancy (#4079) - build(deps): Bump github/codeql-action from 3.28.8 to 3.28.9 (#4074) - fix(aot): ensure value_cmp does not exceed br_count in branch table compilation (#4065) - In wasm32, fix potential conversion overflow when enlarging 65536 pages (#4064) - [fuzzing] execute every exported function (#3959) - Update memory allocation functions to use allocator user data (#4043) - Show wasm proposals status during compilation and execution (#3989) - add a validator for aot module (#3995) - Use wasm32-wasip1 instead of wasm32-wasi target for rust code (#4057) - Update Rust target from 'wasm32-wasi' to 'wasm32-wasip1' in CI (#4050) - Fix wasm loader check data segment count (#4039) - Synchronize the GC spec tests to the commit from December 9. 2024. (#4022) - Refine getting const offsets in wasm loader of fast-interp (#4012) - fixes for compiling on windows (#4026) - .github: Add shared lib builds (#3975) - Refine read leb int wasm loader of fast interpreter (#4017) - build(deps): Bump github/codeql-action from 3.28.0 to 3.28.1 (#4020) - build(deps): Bump actions/upload-artifact from 4.5.0 to 4.6.0 (#4021) - Enable shrunk memory by default and add related configurations (#4008) - Add documentation regarding security issues and the status of Wasm proposals (#3972) - Improve stack consistency by ensuring sufficient space for dummy offsets (#4011) - Check whether related table has funcref elem in opcode call_indirect (#3999) - [fuzzing] Use software bound-check during fuzzing (#4003) - Add an example of how to embed WAMR in Zephyr user mode (#3998) - Fix table index calculations in wasm_loader and wasm_mini_loader (#4004) - Ensure __heap_base and __data_end global indices are validated against import count (#3996) - Error message improvement (#4000) - Handle a new scenario where an item is both exported and imported. (#3984) - Optimize memory initialization handling in AOT loader (#3983) - build(deps): Bump actions/upload-artifact from 4.4.3 to 4.5.0 (#3981) - build(deps): Bump github/codeql-action from 3.27.9 to 3.28.0 (#3982) - Add Tianlong into code owners (#3970) - Set thread information earlier in exec_env creation (#3967) - top-level cmake: link llvm libraries to our shared library (#3973) - add reference type support by default for darwin to support WASI-SDK-25 (#3978) - CMakeLists.txt: Do not require C++ (#3956) - [fuzzing] Enable instantiation (#3958) - use a random secret key (#3971) - top-level cmakefile: fix macOS build (#3968) - Only access Zephyr thread stats info when it's available (#3962) - build(deps): Bump github/codeql-action from 3.27.6 to 3.27.9 (#3960) - wasm_export.h: Use "default" visibility for gcc and clang (#3957) - set alignment 4 when loading multi return value (#3955) - Fix aot table instantiate (#3946) - Consume the placeholders that were put when emitting table info (#3940) - Refactor SConscript and add file checks in iwasm.c (#3945) - Improvements for platform thread APIs on Windows and Zephyr (#3941) - Fix incorrect assignment in win_file.c (#3939) - don't return an uninitialized trap if argv_to_results fails (#3935) - support WASM_FUNCREF return type in argv_to_results (#3936) - add thread cpu time for zephyr (#3937) - build(deps): bump github/codeql-action from 3.27.4 to 3.27.5 (#3931) - Update README.md to clarify Windows toolchain support and ESP-IDF reference (#3917) - Enable ref types by default (#3894) - Fix loader small bug (#3928) - add testcases for shared heap and fix POP_MEM_OFFSET of memory64 (#3916) - Use plain assignment rather than bh_memcpy_s (#3924) - Fix WASI Path Mapping Processing (#3923) - Drop declarative elements on module instantiation (#3922) - Check possible integer overflow in aot memory boundary check (#3920) - Fix CI wamr-ide error (#3913) - Support external toolchain on Windows for aot compiler (#3911) - build(deps): bump github/codeql-action from 3.27.1 to 3.27.4 (#3912) - Correct the table index calculation in aot_instantiation (#3903) - Fix a leak in wasm_loader_emit_br_info (#3900) - GlobalValueSet was moved to IRPartitionLayer recently, but we have a local definition anyway (#3899) - build(deps): bump github/codeql-action from 3.27.0 to 3.27.1 (#3902) - Fix linked global initialization in multimodule (#3905) - Wasm loader enhancement: check code size in code entry (#3892) - Refactor AOT loader to support compatible versions (#3891) - Fix out of bounds issue in is_native_addr_in_shared_heap function (#3886) - Fix mmap flags for AOT loader on non-Linux SGX platforms (#3890) - Bump AOT_CURRENT_VERSION for WAMR 2.x (gc, memory64) (#3880) - Refine looking up aot function with index (#3882) - build(deps): bump github/codeql-action from 3.26.13 to 3.27.0 (#3888) - fix(ios): Remove `float-abi` flag (#3889) - Fix out of bounds issues after memory.grow on non-aot non-threads builds (#3872) - Exclude fuzz test python and npm packages in scoreboard scan (#3871) Author: Chris Woods <6069113+woodsmc@users.noreply.github.com> Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Author: Dylan Johnston <18252447+dpjohnst@users.noreply.github.com> Author: edoardo <48774736+xdoardo@users.noreply.github.com> Author: eric <chenliuyang_1989@163.com> Author: Fadumina Barre <bafadumi@amazon.com> Author: Huang Qi <huangqi3@xiaomi.com> Author: James Ring <sjr@jdns.org> Author: Jérôme Vouillon <jerome.vouillon@gmail.com> Author: kk <zhkag@foxmail.com> Author: liang.he@intel.com <liang.he@intel.com> Author: liang.he <liang.he@intel.com> Author: Maks Litskevich <makslit@amazon.com> Author: Marcin Kolny <mkolny@amazon.com> Author: peter-tatrai <peter.tatrai.ext@siemens.com> Author: TianlongLiang <111852609+TianlongLiang@users.noreply.github.com> Author: Tomáš Malý <malytomas@users.noreply.github.com> Author: Viacheslav Palchikov <palchikov@gmail.com> Author: WenLY1 <130950131+WenLY1@users.noreply.github.com> Author: Wenyong Huang <wenyong.huang@intel.com> Author: Xavier Del Campo <90845888+midokura-xavi92@users.noreply.github.com> Author: YAMAMOTO Takashi <yamamoto@midokura.com> Author: yangkun27 <yangkun27@xiaomi.com>	2025-03-03 14:07:14 +08:00
liang.he	918b364bbe	[instantiation linking] Optimize aot func inst list (#4018)	2025-02-19 09:31:13 +08:00
liang.he	b18cb3b2cb	[instantiation linking] Create and import WASMGlobalInstance (#3914)	2024-12-19 16:52:29 +08:00
liang.he	23c8be1649	[instantiation linking] refactor wasm_table_inst_t (#3901) ... - refactor wasm_table_inst_t and add functions to retrieve export type by name	2024-12-11 06:41:36 +08:00
liang.he	ee2d60bf62	[instantiation linking] Create and import WASMTableInstance (#3898) ... - Implement import table and table creation - Enhance memory de-instantiation checks and adjust stack size for wasm execution environment - Improve shared memory reference handling and enhance table de-instantiation checks	2024-12-06 10:13:53 +08:00
liang.he	8c48d717fc	[instantiation linking] Refactor wasm_runtime_instantiate() (#3893) ... The main goal is to let existed code run without modification.	2024-11-21 10:16:29 +08:00
Wenyong Huang	534c493328	Merge branch main into dev/instantiate_linking (#3915) ... * Exclude fuzz test python and npm packages in scoreboard scan (#3871) * Fix out of bounds issues after memory.grow on non-aot non-threads builds (#3872) * fix(ios): Remove `float-abi` flag (#3889) * build(deps): bump github/codeql-action from 3.26.13 to 3.27.0 (#3888) * Refine looking up aot function with index (#3882) * Bump AOT_CURRENT_VERSION for WAMR 2.x (gc, memory64) (#3880) * Fix mmap flags for AOT loader on non-Linux SGX platforms (#3890) * Fix out of bounds issue in is_native_addr_in_shared_heap function (#3886) * Refactor AOT loader to support compatible versions (#3891) * Wasm loader enhancement: check code size in code entry (#3892) * Fix linked global initialization in multimodule (#3905) * build(deps): bump github/codeql-action from 3.27.0 to 3.27.1 (#3902) * GlobalValueSet was moved to IRPartitionLayer recently, but we have a local definition anyway (#3899) * Fix a leak in wasm_loader_emit_br_info (#3900) * Correct the table index calculation in aot_instantiation (#3903) * build(deps): bump github/codeql-action from 3.27.1 to 3.27.4 (#3912) * Support external toolchain on Windows for aot compiler (#3911) * Fix CI wamr-ide error (#3913) Co-authored-by: TianlongLiang <111852609+TianlongLiang@users.noreply.github.com> Co-authored-by: Maks Litskevich <makslit@amazon.com> Co-authored-by: Deniz Sokmen <dsokmen@amazon.com> Co-authored-by: edoardo <48774736+xdoardo@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: YAMAMOTO Takashi <yamamoto@midokura.com> Co-authored-by: liang.he <liang.he@intel.com> Co-authored-by: Fadumina Barre <bafadumi@amazon.com> Co-authored-by: Marcin Kolny <mkolny@amazon.com> Co-authored-by: James Ring <sjr@jdns.org>	2024-11-20 13:21:48 +08:00
liang.he	9b5058c7fe	[instantiation linking] create and import WASMMemoryInstance for aot (#3887)	2024-11-20 11:19:02 +08:00
liang.he	e030350bd7	[instantiation linking] create and import WASMMemoryInstance for interp (#3845) ... APIs to create and import WASMMemoryInstance for Interp - add a demo (sample/linking/raw) for APIs test - new APIs for instances of spawned threads to build imports list from parents'	2024-11-04 15:38:20 +08:00
Wenyong Huang	48eaa2286a	Refine wasm/aot function instance lookup (#3865) ... Sort the module instance's export functions with the function name, and use binary search to lookup the wasm/aot function.	2024-10-18 15:15:33 +08:00
Wenyong Huang	74d2427fdc	Allow to set native stack boundary to exec_env (#3862) ... Add runtime API wasm_runtime_set_native_stack_boundary. p.s. https://github.com/bytecodealliance/wasm-micro-runtime/issues/3816	2024-10-18 12:49:57 +08:00
Wenyong Huang	327374cfee	Fix some compile warnings and typos (#3854) ... - Clear some compile warnings - Fix some typos - Fix llvm LICENSE link error - Remove unused aot file and binarydump bin - Add checks when loading AOT exports	2024-10-15 16:04:58 +08:00
Wenyong Huang	b038f2721b	Merge pull request #3823 from bytecodealliance/dev/shared_heap ... Implement the shared heap feature for interpreter, aot and llvm jit. Add below runtime APIs: ```C wasm_shared_heap_t wasm_runtime_create_shared_heap(SharedHeapInitArgs *init_args); bool wasm_runtime_attach_shared_heap(wasm_module_inst_t module_inst, wasm_shared_heap_t shared_heap); void wasm_runtime_detach_shared_heap(wasm_module_inst_t module_inst); uint64_t wasm_runtime_shared_heap_malloc(wasm_module_inst_t module_inst, uint64_t size, void **p_native_addr); void wasm_runtime_shared_heap_free(wasm_module_inst_t module_inst, uint64_t ptr); ``` And allow wasm app to call API shared_heap_malloc and shared_heap_free: ```C void *shared_heap_malloc(uint32_t size); void shared_heap_free(void *ptr); ```	2024-10-15 14:26:22 +08:00
TianlongLiang	36d438051e	Support table64 extension in classic-interp and AOT running modes (#3811) ... Add table64 extension(in Memory64 proposal) support in classic-interp and AOT running modes, currently still use uint32 to represent table's initial and maximum size to keep AOT ABI unchanged.	2024-10-11 21:14:56 +08:00
WenLY1	19160f0e1d	Fix issues of destroy_shared_heaps (#3847) ... Set shared_heap_list to NULL with lock, and destroy shared_heap_list_lock. Signed-off-by: wenlingyun1 <wenlingyun1@xiaomi.com>	2024-10-10 10:56:36 +08:00
Wenyong Huang	9ba36e284c	Implement shared heap for AOT (#3815)	2024-09-29 12:50:59 +08:00
Wenyong Huang	e87f7a920d	Fix Windows compile error when uvwasi is enabled (#3810) ... No need to compile win_file.c when uvwasi is enabled.	2024-09-25 16:43:00 +08:00
Wenyong Huang	1fd422ae6e	Merge branch main into dev/shared_heap	2024-09-20 14:34:00 +08:00
WenLY1	4dacef2d60	shared heap: Fix some issues and add basic unit test case (#3801) ... Fix some issues and add basic unit test case for shared heap feature. Signed-off-by: wenlingyun1 <wenlingyun1@xiaomi.com>	2024-09-20 14:24:38 +08:00
Anders Bakken	21330990a8	Add no_resolve to LoadArgs and wasm_runtime_resolve_symbols (#3790) ... Add no_resolve to LoadArgs and wasm_runtime_resolve_symbols so one can delay resolving of symbols. This is useful for inspecting the module between loading and instantiating.	2024-09-20 08:54:09 +08:00
Wenyong Huang	5e20cf383e	Refactor shared heap feature for interpreter mode (#3794) ... To add test cases and samples.	2024-09-18 14:53:41 +08:00
WenLY1	92852f3719	Implement a first version of shared heap feature (#3789) ... ps. https://github.com/bytecodealliance/wasm-micro-runtime/issues/3546	2024-09-14 10:51:42 +08:00
Benbuck Nason	926f662231	Add memory instance support apis (#3786) ... Now that WAMR supports multiple memory instances, this PR adds some APIs to access them in a standard way. This involves moving some existing utility functions out from the `WASM_ENABLE_MULTI_MODULE` blocks they were nested in, but multi-memory and multi-module seem independent as far as I can tell so I assume that's okay. APIs added: ```C wasm_runtime_lookup_memory wasm_runtime_get_default_memory wasm_runtime_get_memory wasm_memory_get_cur_page_count wasm_memory_get_max_page_count wasm_memory_get_bytes_per_page wasm_memory_get_shared wasm_memory_get_base_address wasm_memory_enlarge ```	2024-09-14 10:31:13 +08:00
YAMAMOTO Takashi	f453d9d5ce	Appease GCC strict prototypes warning (#3775)	2024-09-10 09:42:23 +08:00
Wenyong Huang	1329e1d3e1	Add support for multi-memory proposal in classic interpreter (#3742) ... Implement multi-memory for classic-interpreter. Support core spec (and bulk memory) opcodes now, and will support atomic opcodes, and add multi-memory export APIs in the future. PS: Multi-memory spec test patched a lot for linking test to adapt for multi-module implementation.	2024-08-21 12:22:23 +08:00
Wenyong Huang	d67cc26d56	Fix load error not reported when magic header is invalid (#3734) ... When AOT isn't enabled and the input is a wasm file, wasm_runtime_load doesn't report error. Same when interpreter isn't enabled and the input is AOT file. This PR makes wasm_runtime_load report error "magic header not detected" for such situations.	2024-08-20 16:03:04 +08:00
Huang Qi	58ca02bc5f	Add support for RISCV32 ILP32F (#3708)	2024-08-15 15:17:42 +08:00
Marcin Kolny	37d7439ef9	[refactoring] Extract read leb to a separate file, share the code between loader and mini loader (#3701) ... There's probably a number of other places where the bh_leb_read could be used (e.g. aot loader) but I'm making the change as small as possible. Further refactoring can be done later.	2024-08-14 08:46:24 +08:00
liang.he	140ff25d46	wasi-nn: Apply new architecture (#3692) ... ps. https://github.com/bytecodealliance/wasm-micro-runtime/issues/3677	2024-08-13 09:14:52 +08:00
liang.he	5e7d3ed59b	Add APIs into wasm_c_api.h to summary wasm function execution duration (#3639) ... - `wasm_instance_sum_wasm_exec_time()` -> `wasm_runtime_sum_wasm_exec_time()` - `wasm_instance_get_wasm_func_exec_time()` -> `wasm_runtime_get_wasm_func_exec_time()`	2024-07-23 16:34:47 +08:00
Benbuck Nason	b086d5820a	Change log of import function to be consistent (#3656)	2024-07-23 09:14:49 +08:00
Wenyong Huang	8af155076c	Update version to 2.1.1 and update release notes (#3618)	2024-07-16 09:50:11 +08:00
Benbuck Nason	501d7d5adf	Add apis to get package version (#3601) ... Add three APIs: - wasm_runtime_get_file_package_version - wasm_runtime_get_module_package_version - wasm_runtime_get_current_package_version	2024-07-16 08:15:59 +08:00
HongxiaWangSSSS	7affac0ed3	wasm_application.c: Avoid null pointer dereference (#3620)	2024-07-12 16:59:59 +08:00
Wenyong Huang	73caf19e69	Fix compile warnings/error reported in Windows (#3616) ... Clear some compile warnings and fix undefined reference error for symbol ffs in Windows platform.	2024-07-12 16:43:22 +08:00
YAMAMOTO Takashi	1b1ec715e9	wasm loader: Reject v128 for interpreters (#3611) ... discussed in: https://github.com/bytecodealliance/wasm-micro-runtime/pull/3592	2024-07-10 13:50:52 +08:00
Benbuck Nason	8a6379bd0a	Add wasm_runtime_get_module_package_type() and wasm_runtime_get_file_package_type() (#3600) ... wasm_runtime_get_file_package_type() is the counterpart of get_file_package_type(). See discussion in #3595.	2024-07-10 10:45:19 +08:00
liang.he	f118492b1d	Add integer overflow check for some indices in wasm/aot loader (#3579) ... Check whether the indices overflow UINT32_MAX or not for: - import function count + function count - import global count + global count - import tag count + tag count This PR fixes the issue reported by Oss-fuzz test (#69920).	2024-07-02 15:48:37 +08:00
Benbuck Nason	837ff63662	Use 64-bit wasm_runtime_enlarge_memory() increment (#3573) ... ps. https://github.com/bytecodealliance/wasm-micro-runtime/pull/3569#discussion_r1654398315	2024-06-27 14:34:43 +08:00
Benbuck Nason	74dbafc699	Export API wasm_runtime_enlarge_memory (#3569) ... Export API wasm_runtime_enlarge_memory to support memory growth.	2024-06-26 11:07:16 +08:00
Xenia Lu	6754b62195	Optimize for multi-module support in AOT mode (#3563) ... - Split the `aot_loader_resolve_function` into two functions to prevent redundant module lookups and loads - Access pre-associated module instances from `import_func_module_insts`, avoiding unnecessary instance lookups and improving performance	2024-06-26 09:56:01 +08:00
Xenia Lu	f7d2826772	Allow missing imports in wasm loader and report error in wasm instantiation instead (#3539) ... The wasm loader is failing when multi-module support is on and the dependent modules are not found; this enforces the AOT compiler integrations to prepare dependent modules while it isn't necessary. This PR allows allows missing imports in wasm loader and report error in wasm instantiation instead, which enables the integrated AOT compiler to work as if the multi-module support isn't turned on.	2024-06-25 10:04:39 +08:00
YAMAMOTO Takashi	4c2af25aff	aot compiler: Use larger alignment for load/store when possible (#3552) ... Consider the following wasm module: ```wast (module (func (export "foo") i32.const 0x104 i32.const 0x12345678 i32.store ) (memory 1 1) ) ``` While the address (0x104) is perfectly aligned for i32.store, as our aot compiler uses 1-byte alignment for load/store LLVM IR instructions, it often produces inefficient machine code, especially for alignment-sensitive targets. For example, the above "foo" function is compiled into the following xtensa machine code. ``` 0000002c <aot_func_internal#0>: 2c: 004136 entry a1, 32 2f: 07a182 movi a8, 0x107 32: 828a add.n a8, a2, a8 34: 291c movi.n a9, 18 36: 004892 s8i a9, a8, 0 39: 06a182 movi a8, 0x106 3c: 828a add.n a8, a2, a8 3e: ffff91 l32r a9, 3c <aot_func_internal#0+0x10> (ff91828a <aot_func_internal#0+0xff91825e>) 3e: R_XTENSA_SLOT0_OP .literal+0x8 41: 004892 s8i a9, a8, 0 44: 05a182 movi a8, 0x105 47: 828a add.n a8, a2, a8 49: ffff91 l32r a9, 48 <aot_func_internal#0+0x1c> (ffff9182 <aot_func_internal#0+0xffff9156>) 49: R_XTENSA_SLOT0_OP .literal+0xc 4c: 41a890 srli a10, a9, 8 4f: 0048a2 s8i a10, a8, 0 52: 04a182 movi a8, 0x104 55: 828a add.n a8, a2, a8 57: 004892 s8i a9, a8, 0 5a: f01d retw.n ``` Note that the each four bytes are stored separately using one-byte-store instruction, s8i. This commit tries to use larger alignments for load/store LLVM IR instructions when possible. with this commit, the above example is compiled into the following machine code, which seems more reasonable. ``` 0000002c <aot_func_internal#0>: 2c: 004136 entry a1, 32 2f: ffff81 l32r a8, 2c <aot_func_internal#0> (81004136 <aot_func_internal#0+0x8100410a>) 2f: R_XTENSA_SLOT0_OP .literal+0x8 32: 416282 s32i a8, a2, 0x104 35: f01d retw.n ``` Note: this doesn't work well for --xip because aot_load_const_from_table() hides the constness of the value. Maybe we need our own mechanism to propagate the constness and the value.	2024-06-22 10:32:52 +08:00
Benbuck Nason	7d3bac62af	Add linked field comment for aot import type (#3557)	2024-06-21 10:24:56 +08:00
Florian Castellane	0418041b0d	wasm_memory.c: Fix typo: hasn't been initialize -> hasn't been initialized (#3547)	2024-06-19 17:02:09 +08:00
Benbuck Nason	3746534010	Add table type API support (#3515) ... Add `wasm_runtime_get_export_table_inst` and `wasm_table_get_func_inst`, and related wasm_table_type_get_xxx APIs.	2024-06-19 14:50:46 +08:00
liang.he	c19bc95391	Validate func type in aot loader (#3535) ... Fix issue reported by Oss-fuzz test (#69629).	2024-06-18 14:23:32 +08:00
liang.he	f844b33b2d	Make wasi-nn backends as separated shared libraries (#3509) ... - All files under *core/iwasm/libraries/wasi-nn* are compiled as shared libraries - *wasi-nn.c* is shared between backends - Every backend has a separated shared library - If wasi-nn feature is enabled, iwasm will depend on shared library libiwasm.so instead of linking static library libvmlib.a	2024-06-14 12:06:56 +08:00
liang.he	40c41d5110	Fix several issues reported by oss-fuzz (#3526) ... - possible integer overflow in adjust_table_max_size: unsigned integer overflow: 2684354559 * 2 cannot be represented in type 'uint32' - limit max memory size in wasm_runtime_malloc - add more checks in aot loader - adjust compilation options	2024-06-13 16:06:36 +08:00
Benbuck Nason	8239dd4aa7	Add wasm_export.h APIs to expose memory type (#3496) ... Support to get `wasm_memory_type_t memory_type` from API `wasm_runtime_get_import_type` and `wasm_runtime_get_export_type`, and then get shared flag, initial page cout, maximum page count from the memory_type: ```C bool wasm_memory_type_get_shared(const wasm_memory_type_t memory_type); uint32_t wasm_memory_type_get_init_page_count(const wasm_memory_type_t memory_type); uint32_t wasm_memory_type_get_max_page_count(const wasm_memory_type_t memory_type); ```	2024-06-06 09:20:24 +08:00