Interface SampleTokenUsage.Builder

  • Method Details

    • prefill

      The number of tokens in the input prompt (prefill phase).

      Parameters:
      prefill - The number of tokens in the input prompt (prefill phase).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • decode

      The number of tokens generated (decode phase).

      Parameters:
      decode - The number of tokens generated (decode phase).
      Returns:
      Returns a reference to this object so that method calls can be chained together.