What does the metric NECE mean?
Chandler is still young and makes mistakes in his calculations sometimes — reach out to the Data & Analytics team in #analytics-questions-and-alerts if you have questions.
Per-step detail — each LLM call, each Omni request, each rejected draft —
is traced to stdout only and is not stored, so it cannot be shown here.
Query attempts counts run_query executions, not model turns.
| When | Rating | Comment |
|---|---|---|
| 2026-09-11 13:41 | negative | NECE metric lookup failed ("not defined in the provided documentation"), but the user says NECE is defined in the `Product Usage - Accounts.topic.yaml` file. Chandler should have been able to find and surface this definition. Please investigate why it wasn't picked up. |
Cost is the LLM completion spend LiteLLM priced for each call, summed per
request.
Chandler is running on the Codex CLI, which draws ChatGPT plan quota
rather than per-token API billing, so this figure is not money paid —
it is what the same traffic would have cost on the API, priced from the
token counts Codex reports. Read it as the size of the bill avoided.
Two known limits: embedding spend is not recorded, so
retrieval and matching cost is missing, and because the figure is one sum
per request it cannot be split by model within a request — a
request's classifier and agent calls can use different models while
llm_model holds only one name.
Only authenticated calls are logged, USAGE_LOG_ENABLED can
switch logging off, and log writes are fail-soft — this is not a complete
record of traffic. Questions are grouped into sessions: a session is
exact when the caller echoed its id back to us and otherwise inferred from
a 30-minute gap in that user’s activity, so a grouping is only as
good as the source shown on the session itself. A call with no
attributable user gets no session at all; those questions are listed
separately rather than dropped.