What happened?
I changed the default # of match results from 12 to 20 for this set. When I went to review the additional results for the 2nd annotation on the page, match results #17, 18 19 & 20 are all missing the “inspect” button. Interestingly, all other match results for that annotation DO have the inspect button.
This, curiously, is not actually a bug!
By default, IA only generates side-by-side inspection images for the top 16 results on a match.
We actually hid the inspect button beyond the 16th candidate as part of the fix for WB-1196 (related community post: Inspection issues - #8 by ACWadmin1).
Hi, @ACWadmin1 !
WB-1196 essentially hid the inspect button for match candidates beyond 16, which, to my knowledge, don’t have inspect images due to constraints with image analysis.
What those constraints are and why 16 are questions I don’t know the answer to. I know that a lot of the algorithm assessment occurs using criteria such as, say, “percentage of the time the true match occurs in the top 15”. That’s my best guess. Let me loop in @Drew who might know more.
I can confirm @MarkF’s intuition. We do not produce those inspection images for results 17 and higher (that number was chosen semi-arbitrarily) because
Those images are computationally very expensive to produce.
There would be very many images to produce and save if we made that number say 25 or 50 for every match we run.
There would be pretty low actual utility because not only is finding a match at rank 17+ rare, but since the similarity scores are so low the inspection image would not contain much information anyway.
If you regularly see matches at ranks 17 and above, we could discuss raising the number of generated images. Making the number of images variable per job would not be a trivial change so we are unlikely to add that option.
