What's Modzy?

:tada: Welcome to Modzy!

If you've never heard of Modzy before, you might be wondering what it is and how to use it.

In a nutshell, Modzy does 4 things:

  1. Deploys machine learning models to a private library
  2. Runs machine learning models and serves them as REST/gRPC APIs
  3. Monitors models while they're running production data
  4. Integrates into other applications via integrations and SDKs

:wrench: What can you do with Modzy?

Developers can...

  • Build custom, AI-powered apps using APIs and SDKs
  • Integrate AI into other software using Modzy's integrations

Data Scientists can...

  • Deploy their models from popular training tools such as MLFlow, SageMaker, and AzureML, among others
  • Monitor their models for drift over time
  • Embed explainability into their models

Machine Learning Engineers can...

  • Configure hardware and auto-scaling settings for their team's models
  • Monitor model performance, latency, and resource usage
  • Connect model deployment into existing CI/CD process

:arrow-forward: How do you get started?

The easiest way to get started is to create an account, download an API Key, and install one of our SDKs. Then you're ready to start building AI-powered apps!

📘

Using Modzy on app.modzy.com

One of the fastest ways to get started with Modzy, is to create an account on app.modzy.com. This hosted instance of Modzy is available for anyone and offers two account types:

Developer accounts (Free):

  • Offer access to 30+ open source and commercial models (See full list at https://app.modzy.com/models)
  • Allow for up to 500 model predictions per day

Basic+ accounts ($4.99/month):

  • Offer the same access to 30+ open source and commercial models (See full list at https://app.modzy.com/models)
  • Allow for up to 10,000 model predictions per day
  • Enable deployment of up to 5 custom models
    • Models will have access to 2 CPU Cores and 8 GiB RAM (larger models will not run)
    • Models will operate in "on-demand" mode, meaning they will spin up when requested, and then shut down after 5 minutes of inactivity

Caveats:

  • Certain enterprise features, such as hardware management and administration tools, are not available on app.modzy.com. If you're interested in trying out a fully-featured version of Modzy, you can request an Enterprise Trial
  • GPU acceleration is not available at this time on app.modzy.com which may impact inference speed for certain models

Did this page help you?