Does Islam or Muslims believe in hell?

Yes, Muslims believe in Paradise and Hell. See this thread for details: Jannah wa an-Naar - In The Light of the Qur'an and Sunnah