Enum LiteRtTokenKind

Namespace

LiteRtLmSharp

Assembly

LiteRtLmSharp.dll

Whether a LiteRtTokenUnion carries a literal string or a sequence of token ids.

public enum LiteRtTokenKind

Fields

Ids = 1

The token is a sequence of token ids; read Ids.

String = 0

The token is a literal string (e.g. "<eos>"); read Text.