Overview

The model metrics service provides a clear insight into AI performance and usage across an enterprise. Its APIs return the number of predictions made, data processed, active users, and active models.

The metrics object

{
  "ranking": 1,
  "modelIdentifier": "",
  "name": "",
  "modelVersion": "",
  "elapsedTime": 1,
  "jobs": 1,
  "userIdentifier": "",
  "firstName": "",
  "lastName": "",
  "email": "",
  "predictionsMade": {},
  "dataProcessed": {},
  "recent": []
}

Parameter	Type	Description
ranking	number	Ranks users or models in DESC order by elapsed time.
modelIdentifier	string	A model identifier provided by Modzy. It contains 10 random alphanumeric characters.
name	string	The model’s name. It may only contain alphanumeric, dash, and underscore characters.
modelVersion	string	The model’s version number. It follows the semantic versioning format.
elapsedTime	number	The time between the job starts to run until it is completed in milliseconds.
jobs	number	An object that contains the user’s or model’s job count.
userIdentifier	string	The user’s identifier.
firstName	string	The user’s first name.
lastName	string	The user’s last name.
email	string	The user’s email.
predictionsMade	object	An object that contains the inputs processed in the current and previous time frames.
dataProcessed	object	An object that contains the bytes processed in the current and previous time frames.
recent	array	An array that contains the daily predictions objects.

Prometheus query parameters

Parameter	Description
cpu-requested	The number of cores requested by a container.
cpu-available	The cluster’s total number of available CPU cores.
cpu-used	The total amount of “system” time + the total amount of “user” time.
memory-requested	The number of memory bytes requested by a container.
memory-available	A node’s total allocatable memory bytes.
memory-used	The current memory usage in bytes, it includes all memory regardless of when it was accessed.
cpu-overall-usage	The cpu-used divided by the `cpu-available`.
memory-overall-usage	The memory-used divided by the `memory-available`.
cpu-current-usage	The `cpu-requested` divided by the `cpu-available`.