I found that a workaround to remove an object from NSOrderedSet is to remove it from its mutable copy. After fixing XCode's warnings that's the code I have:
let tempSet: NSMutableOrderedSet? = playset!.musicItems!.mutableCopy as? NSMutableOrderedSet
tempSet!.remove(musicItem)
playset!.musicItems = tempSet
But it gives me an error EXC_BAD_INSTRUCTION. How can I fix it?