Configure LLM Log and Metrics Monitoring

Collect data from LLM APIs used inside your application. The collected data can be checked in log monitoring and metrics charts.

Note

Requirements

WhaTap Python Agent version 1.8.12 or higher is required.

Option Settings

• trace_llm_log_enabled Boolean

  Default: false

  Enables LLM log monitoring and collection.

• counter_thread_enabled Boolean

  Default: false

  Enables the Python Agent’s metrics transfer thread.

• llm_stat_enabled Boolean

  Default: false

  Enables LLM metrics collection. This requires trace_llm_log_enabled and counter_thread_enabled to also be set to true.

• llm_stat_interval Int

  Default: 5 (in seconds)

  Sets the collection interval for LLM metrics.