tokenId property
The token's numerical ID.
While the token field provides the string representation of the token,
the token_id is the numerical representation that the model uses
internally. This can be useful for developers who want to build custom
logic based on the model's vocabulary.
Implementation
core.int? tokenId;