./modzy-core server
Start the Modzy Edge model server on a remote device
$ modzy-core server [flags]
starts an HTTP and gRPC server that implements Modzy Edge's inference, jobs, and results APIs.
Usage
Enter the following code into the terminal after making the following replacements:
Replace <https://trial.app.modzy.com
> with the URL of your instance of Modzy,
Replace s.dP0JrRSS3AJ38hykhKebl0MG
with a valid token
$ ./modzy-core server --modzy.url https://trial.app.modzy.com --modzy.token s.dP0JrRSS3AJ38hykhKebl0MG
The output is similar to the following:
2022-11-14T21:34:28.427Z INFO logger/logger.go:108 acquiring lock
2022-11-14T21:34:28.427Z INFO modzy/registration.go:49 connecting to Modzy...
2022-11-14T21:34:28.429Z INFO modzy/registration.go:124 device token provided, proceeding with registration via http
2022-11-14T21:34:28.996Z INFO nats/server.go:26 starting internal NATS server...
2022-11-14T21:34:29.085Z INFO cmd/server.go:159 migrating database
2022-11-14T21:34:29.101Z INFO runner/runner.go:93 starting model: k8cjaqdcgz 1.0.0
2022-11-14T21:34:29.102Z INFO runtime/docker.go:89 Checking if container is running...
2022-11-14T21:34:29.109Z INFO runtime/docker.go:123 creating container...
2022-11-14T21:34:30.117Z INFO runtime/docker.go:182 container is ready: running
2022-11-14T21:34:41.490Z INFO apiserver/server.go:69 Modzy Core server is starting...
2022-11-14T21:34:41.493Z INFO apiserver/server.go:228 Server is starting...
2022-11-14T21:34:41.493Z INFO apiserver/server.go:270 Server is listening at :55000
Server Flags
Flag | Type | Description |
---|---|---|
--cert | string | TLS cert to use |
-h, --help | Help for direct mode | |
--http.port | string | Http port exposed for core server (default "55000") |
--key | string | TLS key to use |
--model.runtime | string | The model container runtime. Only recommended to use when container requires GPU to run (i.e., nvidia ). (default "docker") |
--model.timeout | float | Length of time (in seconds) to wait while attempting to connect to model container. (default 10) |
--model.memory | int | Model container Memory usage limit (in MB). Applies to all models running on Core |
--modzy.token | string | Registration token |
--modzy.url | string | Url of Modzy Platform |
--resume | Resume running after registering. | |
--runtime | string | Container runtime to use. valid choices are.... (default "docker") |
--storage.filesystem.path | string | Directory to store data in. (default = ~/.modzy/core/data or /opt/modzy/core/data) |
--testmode | Test mode |
Updated 6 months ago