Proposed matches for opposing viewpoints

Support
#1

In which Wildbook did the issue occur? ACW

What operating system were you using? Win 10

What web browser were you using? latest chrome

What is your role on the site? admin

What happened?
I ran matching for a random sighting and found several instances, even within 1 set of match results, where the viewpoint of the proposed match is the opposite of the viewpoint in the target image.

Here’s the example: Wildbook for Carnivores

I also saw instances of this yesterday with another species but it was during a demo so I didn’t take the time to capture them and send in this report

thanks
Maureen

cc: @PaulK

#2

Hi Maureen,

This was a detection prediction of “down” (rather than the expected prediction of “left”) on the viewpoint, causing it to match against what looks like a rogue’s gallery of other “down” and down-related (mis)predictions.

image
image747×759 136 KB

It may be that “down” is a viewpoint class with insufficient data. If we see a lot of this, then we may eventually need to retrain the model with additional “down” examples or rebalance the dataset to do better at this viewpoint versus others.

With the misprediction of down, the system then actually behaved as designed and filtered on related viewpoints (where they were actual “down” viewpoints or not).

The workaround is to delete the annotation and redraw it manually, setting the correct viewpoint. Let’s monitor for more of these.

Thanks,
Jason

#3

Hi @jason, here’s an instance where the system matched a left to a front right - is the “front” part what makes the system think there’s possible overlap in that angle, even tho the image of the left profile doesn’t have a “front” angle detected?
https://africancarnivore.wildbook.org/iaResults.jsp?taskId=858a7a51-8da1-422b-87ba-83a9ec35953f

thanks
Maureen

#4

Hi @ACWadmin1,

Was this match kicked off by bulk import? I’m trying to understand the pathway because it is too many annotations ( against 8493 candidates). When I click start another match and make sure not to filter by location, I get a much smaller set of candidates (filtered by viewpoint), and a clean slate of no potential matches.

https://africancarnivore.wildbook.org/iaResults.jsp?taskId=452a36ef-eb96-4fd5-a874-1d84636cf1c3

Was it kicked off by bulk import matching?

Thanks,
Jason

#5

Hi @jason - no this was kicked off manually by the researcher on the date specified:

image
image1162×502 247 KB

The difference in the # of candidates btw what you ran and what he ran, which will have been using the My data filter criteria, is strange. I’m not sure if the time stamp on the match page run by the researcher reflects his time zone or mine - I assume his? If so, this would have been run around the time that @MarkF was applying some updates so maybe that had an effect?

thanks
Maureen

#6

Perhaps. Please let me know if you can find a way to reproduce this. It is an unusual result, but I can’t find a pathway to recreate it and dig further.