Module wit

Expand description

Implements the wasi-nn API for the WIT (“preview2”) ABI.

Note that wasi-nn is not yet included in an official “preview2” world (though it could be) so by “preview2” here we mean that this can be called with the component model’s canonical ABI.

This module exports its types for use throughout the crate and the ML object, which exposes ML::add_to_linker. To implement all of this, this module proceeds in steps:

generate all of the WIT glue code into a generated::* namespace
wire up the generated::* glue to the context state, delegating actual computation to a Backend
convert some types

Modules§

types

Structs§

Error: A wasi-nn error; this appears on the Wasm side as a component model resource.
GraphEncodingParseError
ML: Auto-generated bindings for an instance a component which implements the world ml.
WasiNnCtx: Capture the state necessary for calling into the backend ML libraries.
WasiNnView: A wrapper capturing the needed internal wasi-nn state.

Enums§

ErrorCode: The list of error codes available to the wasi-nn API; this should match what is specified in WIT.
ExecutionTarget: Define where the graph should be executed.
GraphEncoding: Describes the encoding of the graph. This allows the API to be implemented by various backends that encode (i.e., serialize) their graph IR with different formats.
TensorType: The type of the elements in a tensor.

Functions§

add_to_linker: Add the WIT-based version of the wasi-nn API to a [wasmtime::component::Linker].

Type Aliases§