Large backlogs in machine learning queue in Flukebook

What Wildbook are you working in?
Flukebook
What is the entire URL out of the browser, exactly where the error occurred?
https://www.flukebook.org/iaResults.jsp?taskId=37f65d20-3143-4905-aac0-cb791af4e0cf (This is one image that has been waiting in the queue for 3-4 hours)
Can you describe what the issue is you’re experiencing?
The machine learning queue is frequently backed up with 200+ images, so importing a single images takes hours/days. I either need to bulk import hundreds of my own images so that I’m not waiting for days for a single image to go through the queue, or there needs to be a limit to how many images can be bulk imported at once so that the queue doesn’t get such a large backlog. I’m not sure what the best solution is.
Can you provide steps on how to reproduce what you’re experiencing?
Start match on any image that hasn’t gone through the machine learning queue yet (ex. 13-0366-LSI-M), and you will be met with “249 images in machine learning queue. Time to completion is averaging 186 minutes. Your time may be faster or slower.”
If this is a bulk import report, send the spreadsheet to services@wildme.org with the email subject line matching your bug report

Hi @achantal14

The backlog has been cleared, and the queue is currently empty. I see that the maximum turnaround time on a single job was 6 hours, with most completing in somewhere between 2-4 due to the heavy load that has now been resolved. There was a lot of traffic moving through the machine learning queue, but all of it completed successfully. We are looking to add more scalability through load balancing later this year or early next.

Thanks,
Jason

1 Like