Kinference Picker gRPC API
The kinference.v1 Picker gRPC service used by the Kinference router - given an inference request it picks a model and destination (a local inference engine pod or an off-cluster provider), with streaming PushBody/PullBody, Pick, ReportFirstToken, ReportFinalToken and Abort RPCs. Self-hosted inside the customer's Kubernetes cluster, so there is no public base URL. Contract published by Buoyant in the Kinference-AI/kinference repository.