That is where Islaah of the Nafs comes in. All of these feelings can be removed. Tasawwuf focuses on that.
Tasawwuf is about connecting the Khalq (creation) with Allaah Ta`aalaa, Who is al-Khaaliq (The Creator). It is about establishing that Nisbat Ma`allaah. It is about ridding the heart from everything and everyone besides Allaah (the purest Tawheed). Also, it is about removing the Akhlaaq-e-Razeelah (evil characteristics) and replacing them with the Akhlaaq-e-Hameedah (praiseworthy characteristics).
Examples of the Akhlaaq-e-Razeelah are envy, jealousy, anger for the wrong reasons, love of wealth, love of fame, thinking ill of other Muslims, gossiping, etc.
Examples of the Akhlaaq-e-Hameedah are Sabr (patience), Hilm (tolerance), truthfulness, thinking good of other Muslims, Zuhd (abstinence towards the Dunyaa), etc.