batchtools0.9.17 package

Tools for Computation on Batch Systems

addAlgorithm

Define Algorithms for Experiments

addExperiments

Add Experiments to the Registry

addProblem

Define Problems for Experiments

assertRegistry

assertRegistry

batchExport

Export Objects to the Slaves

batchMap

Map Operation for Batch Systems

batchMapResults

Map Over Results to Create New Jobs

batchReduce

Reduce Operation for Batch Systems

batchtools-package

batchtools: Tools for Computation on Batch Systems

btlapply

Synchronous Apply Functions

cfBrewTemplate

Cluster Functions Helper to Write Job Description Files

cfHandleUnknownSubmitError

Cluster Functions Helper to Handle Unknown Errors

cfKillJob

Cluster Functions Helper to Kill Batch Jobs

cfReadBrewTemplate

Cluster Functions Helper to Parse a Brew Template

chunk

Chunk Jobs for Sequential Execution

clearRegistry

Remove All Jobs

doJobCollection

Execute Jobs of a JobCollection

estimateRuntimes

Estimate Remaining Runtimes

execJob

Execute a Single Jobs

findConfFile

Find a batchtools Configuration File

findJobs

Find and Filter Jobs

findTemplateFile

Find a batchtools Template File

getDefaultRegistry

Get and Set the Default Registry

getErrorMessages

Retrieve Error Messages

getJobTable

Query Job Information

getStatus

Summarize the Computational Status

grepLogs

Grep Log Files for a Pattern

JobCollection

JobCollection Constructor

JobExperiment

Jobs and Experiments

JobNames

Set and Retrieve Job Names

JoinTables

Inner, Left, Right, Outer, Semi and Anti Join for Data Tables

killJobs

Kill Jobs

loadRegistry

Load a Registry from the File System

loadResult

Load the Result of a Single Job

makeClusterFunctions

ClusterFunctions Constructor

makeClusterFunctionsDocker

ClusterFunctions for Docker

makeClusterFunctionsInteractive

ClusterFunctions for Sequential Execution in the Running R Session

makeClusterFunctionsLSF

ClusterFunctions for LSF Systems

makeClusterFunctionsMulticore

ClusterFunctions for Parallel Multicore Execution

makeClusterFunctionsOpenLava

ClusterFunctions for OpenLava

makeClusterFunctionsSGE

ClusterFunctions for SGE Systems

makeClusterFunctionsSlurm

ClusterFunctions for Slurm Systems

makeClusterFunctionsSocket

ClusterFunctions for Parallel Socket Execution

makeClusterFunctionsSSH

ClusterFunctions for Remote SSH Execution

makeClusterFunctionsTORQUE

ClusterFunctions for OpenPBS/TORQUE Systems

makeExperimentRegistry

ExperimentRegistry Constructor

makeRegistry

Registry Constructor

makeSubmitJobResult

Create a SubmitJobResult

reduceResults

Reduce Results

reduceResultsList

Apply Functions on Results

removeExperiments

Remove Experiments

removeRegistry

Remove a Registry from the File System

resetJobs

Reset the Computational State of Jobs

runHook

Trigger Evaluation of Custom Function

runOSCommand

Run OS Commands on Local or Remote Machines

saveRegistry

Store the Registy to the File System

showLog

Inspect Log Files

submitJobs

Submit Jobs to the Batch Systems

summarizeExperiments

Quick Summary over Experiments

sweepRegistry

Check Consistency and Remove Obsolete Information

syncRegistry

Synchronize the Registry

Tags

Add or Remove Job Tags

testJob

Run Jobs Interactively

unwrap

Unwrap Nested Data Frames

waitForJobs

Wait for Termination of Jobs

Worker

Create a Linux-Worker

As a successor of the packages 'BatchJobs' and 'BatchExperiments', this package provides a parallel implementation of the Map function for high performance computing systems managed by schedulers 'IBM Spectrum LSF' (<https://www.ibm.com/products/hpc-workload-management>), 'OpenLava' (<https://www.openlava.org/>), 'Univa Grid Engine'/'Oracle Grid Engine' (<https://www.univa.com/>), 'Slurm' (<https://slurm.schedmd.com/>), 'TORQUE/PBS' (<https://adaptivecomputing.com/cherry-services/torque-resource-manager/>), or 'Docker Swarm' (<https://docs.docker.com/engine/swarm/>). A multicore and socket mode allow the parallelization on a local machines, and multiple machines can be hooked up via SSH to create a makeshift cluster. Moreover, the package provides an abstraction mechanism to define large-scale computer experiments in a well-organized and reproducible way.

  • Maintainer: Michel Lang
  • License: LGPL-3
  • Last published: 2023-04-20