I tend to agree. I think that if he were to leave he has to do it in a way where people don't think he's simply leaving for a better option.
In fairness to him, I think the only reason he would leave Cleveland is because of Gilbert.
Outside of leaving to go to a team with better ownership, how would he be leaving for a better situation?