liteRtLmPrefillChunkSize property

int? liteRtLmPrefillChunkSize
final

Native LiteRT-LM prefill chunk size for CPU dynamic models.

null keeps the runtime default. Positive values are forwarded to litert_lm_engine_settings_set_prefill_chunk_size.

Implementation

final int? liteRtLmPrefillChunkSize;