Overview
The model metrics service provides a clear insight into AI performance and usage across an enterprise. Its APIs return the number of predictions made, data processed, active users, and active models.
The metrics object
{
"ranking": 1,
"modelIdentifier": "",
"name": "",
"modelVersion": "",
"elapsedTime": 1,
"jobs": 1,
"userIdentifier": "",
"firstName": "",
"lastName": "",
"email": "",
"predictionsMade": {},
"dataProcessed": {},
"recent": []
}
Parameter | Type | Description |
---|---|---|
ranking | number | Ranks users or models in DESC order by elapsed time. |
modelIdentifier | string | A model identifier provided by Modzy. It contains 10 random alphanumeric characters. |
name | string | The model’s name. It may only contain alphanumeric, dash, and underscore characters. |
modelVersion | string | The model’s version number. It follows the semantic versioning format. |
elapsedTime | number | The time between the job starts to run until it is completed in milliseconds. |
jobs | number | An object that contains the user’s or model’s job count. |
userIdentifier | string | The user’s identifier. |
firstName | string | The user’s first name. |
lastName | string | The user’s last name. |
string | The user’s email. | |
predictionsMade | object | An object that contains the inputs processed in the current and previous time frames. |
dataProcessed | object | An object that contains the bytes processed in the current and previous time frames. |
recent | array | An array that contains the daily predictions objects. |
Prometheus query parameters
Parameter | Description |
---|---|
cpu-requested | The number of cores requested by a container. |
cpu-available | The cluster’s total number of available CPU cores. |
cpu-used | The total amount of “system” time + the total amount of “user” time. |
memory-requested | The number of memory bytes requested by a container. |
memory-available | A node’s total allocatable memory bytes. |
memory-used | The current memory usage in bytes, it includes all memory regardless of when it was accessed. |
cpu-overall-usage | The cpu-used divided by the |
memory-overall-usage | The memory-used divided by the |
cpu-current-usage | The |