I'm guessing the humor comes from the fact that whether you put "yes" or "no" in the blank the meaning stays the same. Am I right? Of course other parts of the sentence have to be modified to agree positively or negatively. But maybe it isn't like that in the joke tellers native language so it seems strange to him? Am I right?

BTW it's "I don't have A brain"