topP property

double? topP
getter/setter pair

Specifies the nucleus sampling threshold.

The model considers only the smallest set of tokens whose cumulative probability is at least top_p. This helps generate more diverse and less repetitive responses. For example, a top_p of 0.9 means the model considers tokens until the cumulative probability of the tokens to select from reaches 0.9. It's recommended to adjust either temperature or top_p, but not both.

Optional.

Implementation

core.double? topP;