Skip to content

Getting logprobs for OpenAI models #9914

@bglearning

Description

@bglearning

Is your feature request related to a problem? Please describe.

Afaict, there isn't a way to get the logprobs from OpenAI models (at least the ones that support it). It is lost during conversion to ChatMessage.

Could be good to have it in for things like confidence proxy (though crude) or autocomplete suggestions.

Metadata

Metadata

Assignees

Labels

P1High priority, add to the next sprint

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions