Interface SampleResponse.Builder

  • Method Details

    • sequences

      The list of generated sequences.

      Parameters:
      sequences - The list of generated sequences.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • sequences

      SampleResponse.Builder sequences(SampledSequence... sequences)

      The list of generated sequences.

      Parameters:
      sequences - The list of generated sequences.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • sequences

      The list of generated sequences.

      This is a convenience method that creates an instance of the SampledSequence.Builder avoiding the need to create one manually via SampledSequence.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to sequences(List<SampledSequence>).

      Parameters:
      sequences - a consumer that will call methods on SampledSequence.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • promptLogprobs

      SampleResponse.Builder promptLogprobs(Collection<Double> promptLogprobs)

      The per-token log-probabilities for the input prompt. Populated only when includePromptLogprobs is true.

      Parameters:
      promptLogprobs - The per-token log-probabilities for the input prompt. Populated only when includePromptLogprobs is true.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • promptLogprobs

      SampleResponse.Builder promptLogprobs(Double... promptLogprobs)

      The per-token log-probabilities for the input prompt. Populated only when includePromptLogprobs is true.

      Parameters:
      promptLogprobs - The per-token log-probabilities for the input prompt. Populated only when includePromptLogprobs is true.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • topkPromptLogprobs

      SampleResponse.Builder topkPromptLogprobs(Collection<? extends Collection<TokenLogprob>> topkPromptLogprobs)

      The top-k log-probabilities per prompt token, as a list of lists. Populated only when topkPromptLogprobs is greater than 0.

      Parameters:
      topkPromptLogprobs - The top-k log-probabilities per prompt token, as a list of lists. Populated only when topkPromptLogprobs is greater than 0.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • topkPromptLogprobs

      SampleResponse.Builder topkPromptLogprobs(Collection<TokenLogprob>... topkPromptLogprobs)

      The top-k log-probabilities per prompt token, as a list of lists. Populated only when topkPromptLogprobs is greater than 0.

      Parameters:
      topkPromptLogprobs - The top-k log-probabilities per prompt token, as a list of lists. Populated only when topkPromptLogprobs is greater than 0.
      Returns:
      Returns a reference to this object so that method calls can be chained together.