MyQueue¶
MyQueue is a frontend for SLURM/PBS/LSF that makes handling of tasks easy.
It has a command-line interface called mq with a number of Sub-commands
and a Python interface for managing Workflows. Simple to set up: no
system administrator or database required.
Features
- Easy task submission:
- from the command line:
mq submit <task> -R <cores>:<time> - from Python:
myqueue.submit()
- from the command line:
- Automatic restarting of timed-out/out-of-memory tasks with more time/cores
- Remembers your finished and failed tasks
- Powerful list command for monitoring
- Can be used together with Python
venv’s - Folder-based Workflows
Contents:
- Installation
- Configure your queue
- A quick start
- Documentation
- How it works
- Command-line interface
- Sub-commands
- Help: Show how to use this tool
- List (ls): List tasks in queue
- Submit: Submit task(s) to queue
- Resubmit: Resubmit failed or timed-out tasks
- Remove (rm): Remove or cancel task(s)
- Info: Show detailed information about task
- Workflow: Submit tasks from Python script or several scripts matching pattern
- Run: Run task(s) on local computer
- Kick: Restart T and M tasks (timed-out and out-of-memory)
- Modify: Modify task(s)
- Init: Initialize new queue
- Sync: Make sure SLURM/LSF/PBS and MyQueue are in sync
- Completion: Set up tab-completion for Bash
- Daemon: Interact with the background process
- Sub-commands
- Workflows
- Python API
- Release notes
- Development
