Metrics

Overview

The model metrics service provides a clear insight into AI performance and usage across an enterprise. Its APIs return the number of predictions made, data processed, active users, and active models.

The metrics object

{
  "ranking": 1,
  "modelIdentifier": "",
  "name": "",
  "modelVersion": "",
  "elapsedTime": 1,
  "jobs": 1,
  "userIdentifier": "",
  "firstName": "",
  "lastName": "",
  "email": "",
  "predictionsMade": {},
  "dataProcessed": {},
  "recent": []
}

Parameter

Type

Description

ranking

number

Ranks users or models in DESC order by elapsed time.

modelIdentifier

string

A model identifier provided by Modzy. It contains 10 random alphanumeric characters.

name

string

The model’s name. It may only contain alphanumeric, dash, and underscore characters.

modelVersion

string

The model’s version number. It follows the semantic versioning format.

elapsedTime

number

The time between the job starts to run until it is completed in milliseconds.

jobs

number

An object that contains the user’s or model’s job count.

userIdentifier

string

The user’s identifier.

firstName

string

The user’s first name.

lastName

string

The user’s last name.

email

string

The user’s email.

predictionsMade

object

An object that contains the inputs processed in the current and previous time frames.

dataProcessed

object

An object that contains the bytes processed in the current and previous time frames.

recent

array

An array that contains the daily predictions objects.

Prometheus query parameters

Parameter

Description

cpu-requested

The number of cores requested by a container.

cpu-available

The cluster’s total number of available CPU cores.

cpu-used

The total amount of “system” time + the total amount of “user” time.

memory-requested

The number of memory bytes requested by a container.

memory-available

A node’s total allocatable memory bytes.

memory-used

The current memory usage in bytes, it includes all memory regardless of when it was accessed.

cpu-overall-usage

The cpu-used divided by the cpu-available.

memory-overall-usage

The memory-used divided by the memory-available.

cpu-current-usage

The cpu-requested divided by the cpu-available.