An exorcist? The problem you have with the island is not something an exorcist can handle.

Your emotions are centered on the point that your family was traumatized by their experiences at Duel Academy. I might not know what those experiences were, but I suspect they were less tied to the island itself, and more to the events surrounding those who attended at that time.

In short: the island itself isn't cursed. But the people attending might be, and they'll make it everyone else's problem, even unintentionally.