Assalamu Alaikum
You know what? I had to go through the EXACT same thing.
When I decided I wanted to stop listening to music completely (I was never addicted to it Alhemdulilah, but I did listen to it from time to time, and it was heard almost all the time, I'd even wake up to it because it'd be played in the house often), it was when I couldn't memorize an ayah for Surah Yasin, and I started crying a lot because I found myself in a situation where I could memorize a few songs easily, in a matter of only a few minutes, and here this ONE ayah, I couldn't even fathom! It was so shameful.
The very first thing I did was I told everyone, listen I want to try to memorize Quran, I want to try to get closer to my deen, so don't bother me with Music...I'm through with that. Okkk? And they were like ok. Did it work? No, course not
lol, some even tried to justify that there was nothing haram in it, and anyone that thought that way was just an extremist.
I even remember a time when I had to pray, I'm the only person in my house that prays, and my sister had the music on loud on the television, and I turned the tv off, and went into my room and was trying to pray (this was when I was learning how to pray as well, so I needed all the concentration I could get), and someone turned it back on! So I messed up in my salaah, went back out and turned it off, and then someone shouts about it getting turned off, and I said that it was too loud and couldn't concentrate, and they were like well shut your bedroom door!..and of course, that didn't help, and I had just given up on learning salaah that day and instead just kept making du'a, as much du'a as I could.
But eventually, I'd only listen to Quran, I'd have it on all the time, even if music was on. I'd put on headfones, I'd turn it up high, anything to drown out the sound of music. I got angry once when someone told me to turn it down and I said we have so many problems in the house because the shayateen are always lurking around from the music. So my love for Quran grew and it started to show, and even started to affect people around me that they'd start noticing that the lifestyle of Islam is bettering me Alhemdulilah.
In one incident, some music was being played in my room, and I was just sitting there, listening to it, and my mom came in and said to me "I thought you quit? You can't just give up, why would you replace your Quran with this?" and I don't know, like I was so happy but shocked. Not only did people around me start to acknowledge the fact that I stopped, but they became my reminder!
I'm sorry if I wrote too much, but I don't want you to give up. If it is in your heart to get closer to the deen, then get closer to it, despite everything occurring around you. I always think even if I were in a situation where I was physically forced to do something haram, I'd want to be reciting Quran... I want to be thinking of Allah...I want my last breath to exhale with His remembrance. You have to do the same, because when you're in the exact middle of a situation of falling into sin or straying, and working towards a good deed or being guided, then you will be judged by which you were striving hardest to work towards, so don't ever give up the intention to better yourself, once you give it up, shaytan controls you. So as long as you don't give in to giving up, by Allah's grace and mercy, it will work in your favor in the end, bi'dinillah!
There's a quote that says something like
"If you give your companion a date and he rejects it, then give him a stone."
And it complies with the following ayahs:
If anyone withdraws himself from remembrance of ((Allah)) Most Gracious, We appoint for him an evil one, to be an intimate companion to him.
Such (evil ones) really hinder them from the Path, but they think that they are being guided aright!
At length, when (such a one) comes to Us, he says (to his evil companion): "Would that between me and thee were the distance of East and West!" Ah! evil is the companion (indeed)!
When ye have done wrong, it will avail you nothing, that Day, that ye shall be partners in Punishment! [43:36-39]
Basically, Allah subhanahu wa ta'ala grants us so many blessings, and often when we lack taqwah, when we give up, we forget. We forget to to thank Allah subhanahu wa ta'ala. I mean even this one tiny, simple thing, dhikr, we get reward for it! Even the most wealthy human beings on this earth, if you say thank you, would they reward you for it? No! But Allah rewards us, He builds our house in Jannah with our deeds and then some! He makes us wealthy while we may might not even have water to drink or make wudhu to purify our bodies in! and all He asks is for us to remind ourselves, to call on him, to work for Him. And the moment we give this thought up, shaytan is appointed for us who will continue to lead us astray that we will make excuses for ourselves, thinking "oh, it's ok, Allah will understand our struggle, Allah will understand how easily tempted we can get", yes of course Allah understands, but that does not free us from the consequence of
us not understanding the immense reward there is in not giving up and still working righteously to purify ourselves. In Surah Shams, Allah makes 11 oaths, and then says "Qad aflaha man zakaha!" Whoever works righteously to purify his soul, will surely find success!
SO DON'T GIVE UP! If it's what you want and its for the sake of Allah, nothing will keep you from gaining it, except you. And don't ever think it's impossible, because with Allah, nothing is impossible. And yes you do feel empty inside, but fill your emptiness with Allah...you don't need anyone else. He's always there, He doesn't leave...we're the ones that turn ourselves away, and when we decide to come back, He's still there waiting for us, He will even run towards us when we may only take a step! But you just have to not give up...keep trying. You can't say you've tried unless you've accomplished something, or gained something out of it, even if it wasn't what you were striving towards, because when we keep trying, we gain strength even for the things we haven't started working towards yet or we gain a particular strength to get us closer to the goal.
Again, sorry for the long reply.
I will make du'a for you.
Edit: Oh yeah, sorry, and another thing, when you get tempted to listen to it and can't control yourself, then better to listen to it privately than with a group of people or with friends, because eventually they will get the hint that you want to quit and will eventually stop asking you to listen to them and might even ask you why you stopped (a chance for dawah!), and you will be able to feel more shameful about it considering you're doing it privately and the influence will be stopped and then inshallah you stop completely as well...if that makes sense :\ lol
Fi aman Allah
w'aalaikum asalaam