IEEE.org     |     IEEE Xplore Digital Library     |     IEEE Standards     |     IEEE Spectrum     |     More Sites

Skip to content

Parallel jobs

Amy Rose requested to merge parallel-jobs into main

This MR implements parallel job execution for coordinator. The previous batching and queueing system has been completely replaced and simplified with a first-come-first-serve + priority system on a per-job basis.

This feature adds the MAX_JOBS environment variable for configuration, with a default value of 5.

Resolves #6 (closed)

REMAINING TO DO:

  • update all relevant documentation
  • stress testing and validation on another machine
  • implement feedback
  • clean up logging
Edited by Amy Rose

Merge request reports