Module backend

Define the Rust interface a backend must implement in order to be used by this crate. The Box<dyn ...> types returned by these interfaces allow implementations to maintain backend-specific state between calls.

Modules

openvino

Implements a wasi-nn BackendInner using OpenVINO.

Enums

BackendError

Errors returned by a backend; BackendError::BackendAccess is a catch-all for failures interacting with the ML library.

Id

An identifier for a tensor in a Graph.

Traits

BackendExecutionContext

A BackendExecutionContext performs the actual inference; this is the backing implementation for a user-facing execution context.

BackendFromDir

Some Backends support loading a Graph from a directory on the filesystem; this is not a general requirement for backends but is useful for the Wasmtime CLI.

BackendGraph

A BackendGraph can create BackendExecutionContexts; this is the backing implementation for the user-facing graph.

BackendInner

A Backend contains the necessary state to load Graphs.

Functions

list

Return a list of all available backend frameworks.