matflow.DirectPosix#

class matflow.DirectPosix(*args, **kwargs)#

Bases: DirectPosix

A direct scheduler for POSIX systems.

Keyword Arguments:

shell_args (str) – Arguments to pass to the shell. Pre-quoted.
shebang_args (str) – Arguments to set on the shebang line. Pre-quoted.
options (dict) – Options to the jobscript command.

Methods

`cancel_jobs`	Cancel some jobs.
`get_job_state_info`	Query the scheduler to get the states of all of this user's jobs, optionally filtering by specified job IDs.
`get_submit_command`	Get the concrete submission command.
`get_version_info`	Get the version of the scheduler.
`is_jobscript_active`	Query if a jobscript is running.
`is_num_cores_supported`	Test whether particular number of cores is supported in given range of cores.
`parse_submission_output`	Parse the output from a submission to determine the submission ID.
`process_resources`	Perform scheduler-specific processing to the element resources.
`wait_for_jobscripts`	Wait until the specified jobscripts have completed.

Attributes

`DEFAULT_SHEBANG_ARGS`	Default value for arguments on the shebang line.
`DEFAULT_SHELL_ARGS`	Default value for arguments to the shell.
`DEFAULT_SHELL_EXECUTABLE`	Default shell.
`app`
`unique_properties`	Unique properties, for hashing.

DEFAULT_SHEBANG_ARGS = ''#: Default value for arguments on the shebang line.

DEFAULT_SHELL_ARGS = ''#: Default value for arguments to the shell.

DEFAULT_SHELL_EXECUTABLE = '/bin/bash'#: Default shell.

app = App(name='MatFlow', version='0.3.0a131')#

cancel_jobs(js_refs, jobscripts=None)#

Cancel some jobs.

Parameters:

js_refs (List[Tuple[int, List[str]]]) –
jobscripts (List) –

get_job_state_info(js_refs, num_js_elements)#

Query the scheduler to get the states of all of this user’s jobs, optionally filtering by specified job IDs.

Jobs that are not in the scheduler’s status output will not appear in the output of this method.

Parameters:

js_refs (List[Tuple[int, List[str]]]) –
num_js_elements (int) –

Return type:

Dict[int, Dict[int, JobscriptElementState]]

get_submit_command(shell, js_path, deps)#

Get the concrete submission command.

Parameters:

shell (Shell) –
js_path (str) –
deps (List[Tuple]) –

Return type:

List[str]

get_version_info()#: Get the version of the scheduler.

is_jobscript_active(process_ID, process_cmdline)#

Query if a jobscript is running.

Note that a “running” jobscript might be waiting on upstream jobscripts to complete.

Parameters:

process_ID (int) –
process_cmdline (List[str]) –

static is_num_cores_supported(num_cores, core_range)#

Test whether particular number of cores is supported in given range of cores.

Parameters:: core_range (List[int]) –

parse_submission_output(stdout)#

Parse the output from a submission to determine the submission ID.

Parameters:: stdout (str) –
Return type:: None

classmethod process_resources(resources, scheduler_config)#

Perform scheduler-specific processing to the element resources.

Note: this mutates resources.

Parameters:: scheduler_config (Dict) –
Return type:: None

property unique_properties#: Unique properties, for hashing.

classmethod wait_for_jobscripts(js_refs, callback=None)#

Wait until the specified jobscripts have completed.

Parameters:

js_refs (List[Tuple[int, List[str]]]) –
callback (Callable | None) –

Return type:

None