ACW detection and ID Queue stalled

Support
,
1

What Wildbook are you working in?
ACW

Can you describe what the issue is you’re experiencing?

Detection and ID queue stalled

Please restart the queue and/or identify the user/job hung up.

Thanks

Paul

2

Hi @PaulK

Are there specific bulk imports that appear to be stuck? I’ll need the URLs to some examples to look into this further.

3

Hi @Anastasia

This specific one has errors showing

https://africancarnivore.wildbook.org/import.jsp?taskId=bb5eb73c-aa36-436a-83a5-135d13070c59

All the others above it in the log are waiting, so I expect this is the one that has errored out.

Wildbook-for-Carnivores-12-12-2024_12_46_PM
Wildbook-for-Carnivores-12-12-2024_12_46_PM1128×498 63.6 KB

Thanks

Paul

4

Two bulk uploads seeing errors have been deleted and I am waiting on original images as Excel files seem clean.

Please do a restart on server if needed and then resend the balance of the jobs in the queue back to ID.

Thanks

Paul

5

Hi @PaulK

I cleared out the Wildbook and WBIA queues last night and pushed the latest bulk import on the stack back through. Please send the stalled bulk imports in small batches back through the system. I’m finding that queues of about 2000-3000 jobs on the WBIA side is where it can stall, so we’re looking at perhaps having Wildbook monitor WBIA queues and only only submit new jobs (from Wildbook’s own queue) if the queue on the WBIA side is <1000.

Thank you,
Jason

6

Thanks @jason

I shall coordinate getting jobs resubmitted.

Paul

7

@jason

Hi Jason

A couple of questions

  1. Do we need to stop any further bulk uploads until we have submitted all of the current jobs one at a time?

And

  1. Can you stop all current jobs in the queues and waiting to queue etc. so that we can start sending them one at a time?

Thanks

Paul

8

Hi @PaulK

I previously cleared out all queues (Wildbook and WBIA).

A large mass of jobs seems to have been resent (>3000) after that. I cleared them out again Sunday AM and sent a list of the most recent and incomplete bulk imports successfully to ID. I don’t know if someone is trying to resubmit older, large bulk imports. That’s totally fine, but we’ll probably want to know who and just give them a quiet moment in the queue to do it so that jobs don’t creep above 2000.

Queue is currently empty and quiet, ready for more bulk imports.

Thanks,
Jason