There is so much wrong with trying to navigate through that MediaAsset that I don’t know where to start.
First and foremost, I’m going to say absolutely. The change in how annotations and MediaAssets display should help to resolve some of the weird overlap and other madness going on. But additionally, a true delete should be available for annotations. If we trust you to make them, we should trust you to remove them. I’m going to tag @brmscheiner to make sure he has visibility into this incredibly confusing issue.