No, he’s right. If you hate him now, you don’t really “get” his humour.
And no, I’m not condoning mocking people with mental disabilities. (I’m one of ‘em.) I’m just saying take your head out of your ass for one second and try not being offended just because you’re supposed to be.