./modzy-core server

$ modzy-core server [flags] starts an HTTP and gRPC server that implements Modzy Edge's inference, jobs, and results APIs.

Usage

Enter the following code into the terminal after making the following replacements:

Replace <https://trial.app.modzy.com> with the URL of your instance of Modzy,
Replace s.dP0JrRSS3AJ38hykhKebl0MG with a valid token

$ ./modzy-core server --modzy.url https://trial.app.modzy.com --modzy.token s.dP0JrRSS3AJ38hykhKebl0MG

The output is similar to the following:

2022-11-14T21:34:28.427Z	INFO	logger/logger.go:108	acquiring lock
2022-11-14T21:34:28.427Z	INFO	modzy/registration.go:49	connecting to Modzy...
2022-11-14T21:34:28.429Z	INFO	modzy/registration.go:124	device token provided, proceeding with registration via http
2022-11-14T21:34:28.996Z	INFO	nats/server.go:26	starting internal NATS server...
2022-11-14T21:34:29.085Z	INFO	cmd/server.go:159	migrating database
2022-11-14T21:34:29.101Z	INFO	runner/runner.go:93	starting model: k8cjaqdcgz 1.0.0
2022-11-14T21:34:29.102Z	INFO	runtime/docker.go:89	Checking if container is running...
2022-11-14T21:34:29.109Z	INFO	runtime/docker.go:123	creating container...
2022-11-14T21:34:30.117Z	INFO	runtime/docker.go:182	container is ready: running
2022-11-14T21:34:41.490Z	INFO	apiserver/server.go:69	Modzy Core server is starting...
2022-11-14T21:34:41.493Z	INFO	apiserver/server.go:228	Server is starting...
2022-11-14T21:34:41.493Z	INFO	apiserver/server.go:270	Server is listening at :55000

Server Flags

Flag	Type	Description
`--cert`	`string`	TLS cert to use
`-h, --help`		Help for direct mode
`--http.port`	`string`	Http port exposed for core server (default "55000")
`--key`	`string`	TLS key to use
`--model.runtime`	`string`	The model container runtime. Only recommended to use when container requires GPU to run (i.e., `nvidia`). (default "docker")
`--model.timeout`	`float`	Length of time (in seconds) to wait while attempting to connect to model container. (default 10)
`--model.memory`	`int`	Model container Memory usage limit (in MB). Applies to all models running on Core
`--modzy.token`	`string`	Registration token
`--modzy.url`	`string`	Url of Modzy Platform
`--resume`		Resume running after registering.
`--runtime`	`string`	Container runtime to use. valid choices are.... (default "docker")
`--storage.filesystem.path`	`string`	Directory to store data in. (default = ~/.modzy/core/data or /opt/modzy/core/data)
`--testmode`		Test mode