It isn't just 'whispers' where you entertain a certain thought from hearing a voice(s). The shaytaan(s) can affect the human psychology and make a person think or feel something that is not from themselves. For instance, he (they) makes the non mahrams of the opposite gender appear more attractive to us than they really are when we look at them, hence keeping the gaze down is for our own protection. 