Here are some requirements for a queue:
- Every few days add ~100k tasks with various priorities
- Workers will pull tasks at typically less than 10 / second
- Tasks need to be completed ~3 times by unique workers (for error checking)
Since the task processing rate is quite modest is it worth adding a dedicated message queueing system to my stack, or reusing the database (MongoDB)?