Trying to do some backfills, and all the dag runs start up fine, but for some reason they can't get by a specific task, instead they get stuck in a "Scheduled" state. Not sure what "Scheduled" means and why they don't move to "Running". It works fine in the daily run, but the backfill gets stuck for some reason.
This is super annoying since it means I have to start all the tasks for the backfill manually, which works.
Any idea why a task might be stuck in a "Scheduled" state?
Tasks stuck in a “queued” state usually mean one of two things, no queue to execute on or no pool to execute in.
Which executor are you using? Local, sequential, celery?
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With