Hello,
The sighting with this name exists in the system and contains 12 encounters:
https://africancarnivore.wildbook.org/occurrence.jsp?number=MR_PK_Duba_2019_11_20_PM
Since the import was partially successful I will need to inspect the excel sheet to see any differences between rows that were assigned to the sighting and those that weren’t, or at least try to replicate this behavior.
Please send along the excel sheet when you have a chance. Thanks!
Thanks for providing that!
It appears that the 12 encounters associated with the import are the ones referenced in the excel file, and the ones you see not connected to the sighting are sibling encounters generated from images with multiple animals.
I have created issue ticket WB-1223 to find a solution. We don’t usually see this happen, it is a unique case to investigate.
I recommend adding the sighting ID manually to these in the encounter page ‘Identity’ menu since there are only a couple, and we will provide an update when this is fully diagnosed and resolved.
Hi @colin, I’ve actually been noticing quite a few examples of this as I’ve been going through our list of “Annotations Duplicated in Two or More Encounters”. I can dig up and send other examples later today if that helps.
Hi @ACWadmin1,
There is now a fix deployed that should remedy this behavior. I’ve tested the new code with truncated copies of your imports where the behavior was observed, and seen successful occurrence assignment in each one.
Please confirm that this the solves the problem for you with future imports or re-runs of these.
Thanks!
Hi @colin, glad to have a fix for future uploads, thanks. I have a few follow up questions:
Does this mean you can’t fix the encounters in the system that currently do not have OccIDs assigned where they should have done?
Are these encounters with missing OccIDs actually somehow still connected to the sighting it was originally connected to in the upload, even if the OccID is missing in the record? In other words, is this just a display issue or are these encounters actually disconnected from their original sighting until we find them and re-enter the OccID?
If I go to a sighting that I know has encounters with this issue and open each encounter, will I find the ones that are missing the OccID? If not, how do I find the encounters with this issue and fix them all?
In the last pair of examples I sent above, can you explain why this is happening? I’ve seen a lot of these examples in the duplicates list. That is, a duplicate annotation, that is missing its occurrence ID, that has the same Import task ID as its duplicate with an occurrence ID, and the same file name.
But the import did not have 2 copies of the same file so it appears that the duplicate was created by the system (“cloneWithoutAnnotations”). Is this a separate bug?
Thanks
Maureen
Hi @ACWadmin1,
Here’s some answers to your questions.
Creating a new scripted way to repair these encounters would at this point be slower.
The interface for assigning the occurrence ID to encounters where it is missing, or removing and
re-running an import is a shortcut to the actions that would need to be taken and has already been
tested.
Only through the encounter. All the encounters referenced are connected to the appropriate sighting, it is only the extra ones generated from multi animal images that are not connected. It’s not a display issue, they were not assigned the sighting ID.
Yes. You could visit each encounter in the sighting with a multi animal image, visit the cloned encounters through the blue arrows on the annotation boxes and assign ID. This would reach all that were affected. On many sightings this is likely this quickest method. On a larger import removing and resubmitting may be faster.
I’ll poke around a little more at those two, they appear to be a bit different. The duplicate encounters were created two days after the original from the import.
Thanks @colin for the detail.
Re: #2 - the encounters that are missing OccIDs must be linked to the sighting somehow because in the first set of examples I sent above, I got to these encounters by using the sighting ID as the search filter and opened them from the resulting list. So the sighting ID is linked to these encounters somehow, otherwise how would it know to display it in the search results?
The outstanding concern I have then is, how do I find all of the instances where this has happened?
Do you know when the problem started? We have thousands of encounters and hundreds of sightings in the system, most of which were uploaded in the past 3 months. Was the bug present from the start of our use of ACW? Or was it introduced in a later release? Knowing that would at least help me know where to start looking.
Also, does this only affect one species or is it across all species in ACW? If it’s all species then for at least one, deleting and re-importing isn’t an option due to the amount of matching work already done.
Lastly, re:#4 - I have many other examples in the duplicates list if you need more. I deleted a bunch of them already, before I noticed the pattern. Let me know if you want me to send additional examples.
thanks
M
Hi @ACWadmin1,
First of all, for the encounters referenced in bullet point #4 there is now a fix deployed to prevent it happening again. This behavior would only be triggered when something was accidentally sent to detection twice. This was something that emerged on Oct 19 and was fixed today.
When I search for these sightings by name I only see the one sighting created by the import. Visiting that sighting shows a list of the entries on the import sheet, but not any cloned encounters generated by detection. If you have an example search result that shows otherwise you could link me so I can take a look.
The other behavior- cloned encounters not receiving the occurrence ID from the original encounter would effect all multi-animal images from an import where an occurrence ID is specified.
Since this original issue appears to have a broader effect than we thought we are evaluating a scripting solution.
Hello,
I’ve just run a script to add all the “sibling” encounters generated from detection to the occurrence referenced in the import sheet for an encounter and image. This should repair all instances
of this disconnect since detection on ACW was enabled. I’ve checked the encounters from your original post and several others and can see the additions to the sighting record.
This doesn’t effect the doubled encounters from #4 above, those hopefully are minimal since the bug was short lived and only occurred on when an import was sent to detection twice. There should be little effect on the system from these and they can be deleted when found.
Thanks, and happy new year!
Hi @colin, that’s terrific, thanks so much! It would have been a nightmare to try to find these and clean them up manually so you saved us a huge amount of work.
It’s unfortunate about the dupes not getting fixed; there are, I believe, about 200-300, based on what I’ve been finding in the duplicates list in the Data Integrity tool. But I’ve already fixed a few hundred of those anyway so I’ll just keep plowing through them.
Have a wonderful New Year’s and a vaccine-filled, healthy 2021 to us all!!! 