Provides concrete implementation of job containers.
Provides concrete implementation of the job container that uses PPlus library (https://bitbucket.org/slipguru/pplus). IMPORTANT NOTE: this job container works only with PPlus v0.5.2.
Bases: kdvs.fw.Job.JobContainer
Job container that uses PPlus v0.5.2. During instantiation, all parameters except ‘incrementID’, are passed directly to ‘pplus.PPlusConnection’. Refer to the PPlus documentation for more details.
See also
pplus.PPlusConnection
Parameters : | kwargs : dict
|
---|
By default, provide some time for auto–discovery of Parallel Python to warm up (by sleeping for 5 secs).
See also
The job is added to Parallel Python queue and then executed based on internal Parallel Python scheduler. Once added, its status is changed to EXECUTING. The job is actually passed as ‘depfunc’, together with its name, found in proper scope on worker machine, and executed there. NOTE: earlier versions of PPlus will raise an exception here since they require submission of job as callable, not as name.
Parameters : | job : Job
importable : boolean
|
---|
Get PPlus key for the file that contains job raw input for the specific job.
Parameters : | jobID : string
|
---|---|
Returns : | key : string
|
Notes
See ‘File key’ in PPlus documentation
Get PPlus key for the file that contains job raw output for the specific job.
Parameters : | jobID : string
|
---|---|
Returns : | key : string
|
Notes
See ‘File key’ in PPlus documentation
Get identifier of the job for specific PPlus file key.
Parameters : | key : string
|
---|---|
Returns : | jobID : string
|
Notes
See ‘File key’ in PPlus documentation
Collect all raw results from jobs already added. Blocking call.
Returns : | exceptions : tuple of tuples
|
---|
See also
PPlusConnection.collect, PPlusError
Perform the following operations AFTER the container has been close()d: copy ‘experiment.log’ to results sublocation specified with file system directory path ‘destPath’, and copy ‘master session’ log to the same sublocation.
Notes
See ‘PPlus logging’ in PPlus documentation
Provides simple ‘null’ job container that executes jobs as ordinary callables in the order of submission; no parallel execution mechanisms are used. It requires no external libraries.
Bases: kdvs.fw.Job.JobContainer
Simple ‘null’ job container. It recognizes single parameter ‘incrementID’; if not present, it is assumed to be True.
Parameters : | kwargs : dict
|
---|
The job is added to internal list.
Parameters : | job : Job
kwargs : dict
|
---|
Finish job submission stage and execute already added jobs, in the order of adding. Blocking call.
Finish execution stage and return any exceptions raised during execution.
Returns : | exception : tuple of tuples
|
---|
Do nothing in post–closing stage.
Bases: object
Convenient wrapper for an iterable of jobs that creates simple job container which executes them.
Parameters : | jobs_to_execute : iterable of Job
|
---|---|
Raises : | Error :
|
Create an instance of SimpleJobContainer, add requested jobs, and execute them.
Close simple job container and return any exceptions raised during execution.
See also
Get iterable of all job results for executed jobs.
See also
JobContainer.getJobResults