Modzy Edge provides a way for machine learning models to run "at the edge" on hardware such as remove servers and edge devices.
When you connect your edge device to Modzy, the following things happen:
- It downloads a copy of
Modzy Coreto your edge device. This small executable provides an API interface for any models you deploy to the edge. You can learn more about the Modzy Edge API here.
- It registers your device with Modzy and associates it with a device group
- It automatically downloads any models you've added to your device group and starts running them on your edge device
To use Modzy Edge on an edge device, that device must meet some minimum hardware requirements. These requirements are typically easy to meet in the cloud, or on-prem, but Modzy Edge also works with many small form-factor devices.
|CPU||Requires an ARM 32-bit, ARM 64-bit, or x86 (AMD or Intel) 64-bit processor, with at least 2 cores|
|RAM||2+ GiB of RAM is recommended, but more may be required for running larger models or multiple models at once|
|GPU||Not required, but Modzy Edge supports NVIDIA GPUs|
|TPU||Not required and not yet supported (though models will still run on a CPU)|
|Device Storage||16+ GiB of storage is recommended, but more may be required for storing model results|
|Dependencies||Docker v20.10.x or newer|
Modzy Edge has been tested on the following small form-factor edge devices
- Nvidia Jetson Nano 4GB
- Raspberry Pi 3 Model B+
Updated 5 days ago