./modzy-core server

Start the Modzy Edge model server on a remote device

$ modzy-core server [flags] starts an HTTP and gRPC server that implements Modzy Edge's inference, jobs, and results APIs.

Usage

Enter the following code into the terminal after making the following replacements:

Replace <https://trial.app.modzy.com> with the URL of your instance of Modzy,
Replace s.dP0JrRSS3AJ38hykhKebl0MG with a valid token

$ ./modzy-core server --modzy.url https://trial.app.modzy.com --modzy.token s.dP0JrRSS3AJ38hykhKebl0MG

The output is similar to the following:

2022-11-14T21:34:28.427Z	INFO	logger/logger.go:108	acquiring lock
2022-11-14T21:34:28.427Z	INFO	modzy/registration.go:49	connecting to Modzy...
2022-11-14T21:34:28.429Z	INFO	modzy/registration.go:124	device token provided, proceeding with registration via http
2022-11-14T21:34:28.996Z	INFO	nats/server.go:26	starting internal NATS server...
2022-11-14T21:34:29.085Z	INFO	cmd/server.go:159	migrating database
2022-11-14T21:34:29.101Z	INFO	runner/runner.go:93	starting model: k8cjaqdcgz 1.0.0
2022-11-14T21:34:29.102Z	INFO	runtime/docker.go:89	Checking if container is running...
2022-11-14T21:34:29.109Z	INFO	runtime/docker.go:123	creating container...
2022-11-14T21:34:30.117Z	INFO	runtime/docker.go:182	container is ready: running
2022-11-14T21:34:41.490Z	INFO	apiserver/server.go:69	Modzy Core server is starting...
2022-11-14T21:34:41.493Z	INFO	apiserver/server.go:228	Server is starting...
2022-11-14T21:34:41.493Z	INFO	apiserver/server.go:270	Server is listening at :55000

Server Flags

FlagTypeDescription
--certstringTLS cert to use
-h, --helpHelp for direct mode
--http.portstringHttp port exposed for core server (default "55000")
--keystringTLS key to use
--model.runtimestringThe model container runtime. Only recommended to use when container requires GPU to run (i.e., nvidia).
(default "docker")
--model.timeoutfloatLength of time (in seconds) to wait while attempting to connect to model container. (default 10)
--model.memoryintModel container Memory usage limit (in MB). Applies to all models running on Core
--modzy.tokenstringRegistration token
--modzy.urlstringUrl of Modzy Platform
--resumeResume running after registering.
--runtimestringContainer runtime to use. valid choices are.... (default "docker")
--storage.filesystem.pathstringDirectory to store data in.
(default = ~/.modzy/core/data or /opt/modzy/core/data)
--testmodeTest mode