class Mosquito::ConcurrencyLimitedDequeueAdapter

• Mosquito::ConcurrencyLimitedDequeueAdapter
• Mosquito::DequeueAdapter
• Reference
• Object

Overview

A dequeue adapter that enforces per-queue concurrency limits.

Each queue can be assigned a maximum number of jobs that may execute concurrently. When a queue has reached its limit, it is skipped during dequeue until an in-flight job finishes.

Queues not present in the limits table have no concurrency ceiling and are bounded only by the total executor pool size.

Among eligible queues the adapter uses a shuffle to provide rough fairness, similar to ShuffleDequeueAdapter.

Example

Mosquito.configure do |settings|
  settings.executor_count = 8

  settings.dequeue_adapter = Mosquito::ConcurrencyLimitedDequeueAdapter.new({
    "queue_a" => 3,
    "queue_b" => 5,
  })
end

In this configuration at most 3 jobs from "queue_a" and 5 from "queue_b" will execute at the same time. Other queues are unlimited.

Defined in:

mosquito/dequeue_adapters/concurrency_limited_dequeue_adapter.cr

Constructors

• .new(limits : Hash(String, Int32))

Instance Method Summary

• #active_count(queue_name : String) : Int32

  Returns the current number of in-flight jobs for the given queue.

• #dequeue(queue_list : Runners::QueueList) : WorkUnit | Nil

  Attempt to dequeue a job from one of the queues managed by queue_list.

• #finished_with(job_run : JobRun, queue : Queue) : Nil

  Called by the Overseer when a job from this queue has finished executing.

• #limits : Hash(String, Int32)
• #limits=(limits : Hash(String, Int32))

Constructor Detail

Instance Method Detail