client.jobs.submit_aws_s3

Submit a job using aws s3 files as inputs

client.jobs.submit_aws_s3(model, version, sources, access_key_id, secret_access_key, region, explain=False)

Submit a job based on data files stored in AWS S3 buckets, the sources dictionary is a double dict structure as follows:

{
  '<<<<input-item-key>>>>': {
    '<<<<data-input-item-key>>>>: {
      'bucket': '<<aws_bucket>>',
      'key': '<<aws_file_key>>'
    }
  }
}

Where:

<<<<input-item-key>>>>: are user defined keys to identify the input items.
<<<<data-input-item-key>>>>: are model defined keys (usually file names).

Parameters

Parameter

Type

Description

Example

model

str
Model

Model identifier provided by Modzy or a model object previusly loaded.

'ed542963de'

version

str

The model’s version number. It follows the semantic versioning format.

'1.0.1'

sources

dict

A mapping of source names to s3 bucket/key references. Each source should be a mapping of model input key to a aws s3 bucket/key reference.

'{'my-input': {'input.txt': {'bucket': 'some_bucket', 'key': 'some_key.txt'}}}'

access_key_id

str

The AWS access key

'SomeAccessKey

secret_access_key

str

The AWS secret access key

'SomeSecretAccessKey

region

str

The AWS Region

'us-east-1

explain

bool

If the model supports explainability, flag this job to return an explanation of the predictions

True

Returns

A Job object with the status from the server

{
  "job_identifier": "string",
  "status",
  "account_identifier": "string",        
  "explain": "boolean",        
  "created_at": "date-time",
  "updated_at": "date-time",
  "submitted_at": "date-time",
  "submitted_by": "string",        
  "pending": "integer",
  "completed": "integer",    
  "failed": "integer",
  "total": "integer",    
  "model": {
    "identifier": "string",
    "version": "string",
    "name": "string"
  },
  "job_inputs": ["string"],
  "user": {
    "identifier": "string",
    "external_identifier": "string",
    "email": "string",
    "firstName": "string",      
    "lastName": "string",
    "status": "string",
    "title": "string"
    "access_keys": [
        {
            "prefix": "string",
        "is_default": "boolean"
        }
    ]                        
  }
}

Examples

>>>sources = {'my-input': {'input.txt': {'bucket': 'some-bucket', 'key': 'some_key.txt'}}}
>>>job = client.jobs.submit_file('ed542963de', '0.0.27', sources, 'aws_key', 'aws_secret_key', 'us-east-1')
>>>job.job_identifier
'14856eb1-0ad8-49e7-9da3-887acb80fea5'
>>>job.status
'SUBMITTED'

Did this page help you?