Task Queue for Parallel Computing Based on PostgreSQL
Clean All Tables and Definitions from Database
Connect to PostgreSQL Database
Disconnect from PostgreSQL Database
Initialize PostgreSQL Database for taskqueue
A Wrapper function for DBI interface
Check absolute path for system
Check absolute path for Linux
Check absolute path for Windows
Test Database Connection
Create a New Project
Delete a Project
Get Project Information
List All Projects
Reset a Project
Manage SLURM Job List for Project Resource
Assign a Resource to a Project
Get resources of a project
Delete Log Files for a Project Resource
Start a Project
Display Project Status
Stop a Project
Add a New Computing Resource
Get Information for a Specific Resource
List All Computing Resources
Launch Shiny App for Monitoring Projects
Check whether a table is existed
Add Tasks to a Project
Remove All Tasks from a Project
Get Detailed Task Information
Reset Task Status to Idle
Get Task Status Summary
Set or Get taskqueue Options
Reset taskqueue Options to Defaults
Apply a Function with Task Queue (Simplified Workflow)
Create a worker on slurm cluster
Execute Tasks as a Worker
Implements a task queue system for asynchronous parallel computing using 'PostgreSQL' <https://www.postgresql.org/> as a backend. Designed for embarrassingly parallel problems where tasks do not communicate with each other. Dynamically distributes tasks to workers, handles uneven load balancing, and allows new workers to join at any time. Particularly useful for running large numbers of independent tasks on high-performance computing (HPC) clusters with 'SLURM' <https://slurm.schedmd.com/> job schedulers.
Useful links