Minimum Requirements

Modzy Platform

In order to deploy Modzy, the infrastructure below is required which is not provided by Modzy. The requirements do not include specifications for the inference nodes that would be used run to your AI/ML jobs. The type, size, and quantity of inference nodes vary by workload.

Resource

Qty

Specification

AWS Equivalent

Azure Equivalent

Notes

Kubernetes Control Plane

1

version 1.21

EKS Control Plane

AKS Kubernetes Service

Worker Nodes

3

8 vCPU, 32GB RAM
100G SSD

m5.2xlarge.
EBS storage

D4ds v4

These nodes are used exclusively to run the Modzy application.

Object Storage

1

1TB recommended

S3

Blob storage

Object Storage can be any S3-protocol object storage equivalent, such as Minio, Ceph or NetApp.

Postgres Database

1

PostgreSQL v11+ (12.2 recommended)

RDS Postgres db.t3.large

Azure Database for PostgreSQL

All persistent data is under client control. HA, backup, and retention are per client's internal policy.

NAT Gateway

1

Customer Existing

NAT

NAT

SAML identity provider

1

Customer Existing

Any SAML 2.0-compatible Identity Provider

Inference Nodes

X

Customer specified

Customer specified

Customer specified

These nodes run inferencing – one node per PE and at least 1TB object storage based on the requirements of the models.

Load Balancer

Optional

Customer Existing

ELB

ALB

We recommend Round-robin DNS if no LB exists.

Modzy Management

Optional

t3.small

D2 v4

This node is optional and only used to stage initialization and installation scripts.

720720

(Left): Existing customer infrastructure required to interface with Modzy. (Middle): Created by the Modzy platform installer. (Right): On-demand inference nodes, according to the requirements of models running in the system.


Did this page help you?