Greetings and peace be with you Studentofdeed;
I worked with people with challenging behaviour for about fifteen years. Challenging behaviour means that you can get punched, kicked have things thrown at you and of course all the verbal stuff too. I have lost count of the number of times I have been hit. In order to help these people in their daily life, you have to stand within striking distance.
You can't avoid fearful things in life, they can come at a time and place that you do not expect. But what you can do, is learn to overcome your fear. So my philosophy is this, I would rather be hit, than live in fear of being hit; and this is why. All the times I have been hit, the pain generally lasted minutes, or possibly an hour or so. In my younger life, I can remember getting bullied and living in fear of being bullied, and the fear lasted years. So for me, I have learned to confront my fears, I still do this at the age of 70.
Fear is self generating, in other words, if you avoid a place, you are telling yourself to be afraid. The more you avoid that place, the more your fear will grow.
If you need to go to the library twice a week for an hour each time. Sort your mind out first, make the appointment in your mind, but instead of going for an hour; do something extra. Say to yourself, I will go for an hour and a half each time, or I will go three times a week instead of two. Then just go, despite all your fears and worries, and force yourself to do the extra bit you have committed too; even if your mind will not concentrate very well on studying. The more you push yourself to do the uncomfortable and fearful stuff, the stronger you will become.
Here's the thing, I believe that you can overcome your fear, you don't have to believe me, you have to believe in yourself and put your trust in Allah.
May Allah bless you with the wisdom and the peace to overcome your fears,
Eric