openai.createchatcompletionprops.logitbias

Home > @runlightyear/openai > CreateChatCompletionProps > logitBias

CreateChatCompletionProps.logitBias property

Defaults to null Modify the likelihood of specified tokens appearing in the completion.

Accepts a json object that maps tokens (specified by their token ID in the tokenizer) to an associated bias value from -100 to 100. Mathematically, the bias is added to the logits generated by the model prior to sampling. The exact effect will vary per model, but values between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 should result in a ban or exclusive selection of the relevant token.

Signature:

logitBias?: object;