Enum LiteRtActivationDataType
- Namespace
- LiteRtLmSharp
- Assembly
- LiteRtLmSharp.dll
Activation tensor precision for ActivationDataType, mirroring
upstream's ActivationDataType enum. Only Float32 and Float16 are
distinctly honored, and only on the GPU backend (see
ActivationDataType).
public enum LiteRtActivationDataType
Fields
Float16 = 116-bit float: half the activation memory on GPU at lower precision. The runtime's own GPU default for the text executor; see ActivationDataType.
Float32 = 032-bit float: full precision, more activation memory on GPU. The binding's default.
Int16 = 216-bit integer — present for parity with the native enum, but not distinctly implemented by the shipped executors (folded to F16 on GPU, ignored on CPU).
Int8 = 38-bit integer — present for parity with the native enum, but not distinctly implemented by the shipped executors (folded to F16 on GPU, ignored on CPU).