there may be several reasons for your problem:
one thing you should acertain is whether your husband is impotent. If he is, then there are medications for that and he should talk to a doctor about it. If not, then it may be that he has a western upbringing and may not believe it is right to make love to an unwilling partner. Since he has repeatedly tried being close to you, it may be that your behavior is causing him to stay away.
so you need to analyze your behavior. are you responsive or do you freeze up and not do anything? while eastern men might not mind women who just lie there doing nothing, western men are not used to it and want a responsive partner. Therefore, if youre not kissing back, stroking him, telling him you love him and want him, then you are giving him the feeling that you aren't ready which keeps him from proceeding.
So before you blame his past, you need to seriously analyze your behavior. You can also read some western romance novels to see how women act in bed. One website is
http://www.eharlequin.com/articlelist.html;jsessionid=B87C64753220C06D6C85A906693025A2 with romance stories written by real published authors. you can read
http://www.eharlequin.com/articlepage.html?articleId=1423&chapter=5 to see what how one virgin acts and i'm only suggesting this to put light on your problem. I am in no way encouraging ppl to read romance .
another thing that may be affecting your marital life is sihr, since you already said that people wanted you to marry their relatives, so they may have done sihr so the marriage would be unsuccessful and you would end up getting divorced.
it seems like sihr is the likely reason, as your family don't seem to suggest treatment for the infertility. did theyask whether youwent to a doctor or not? why are they putting the blame on your husband, the woman can also be infertile, not just the husband. So why are they looking for ahusband for you?
The solution to this is reading the various surahs and verses to protect you and your husband as well as all your belongings from the effects of sihr and evil eye.
Another thing you can do is to go to another city for a few days and stay in a hotel to see whether your behavior changes there. Try to take only newly bought items (clothes, bags, shoes, etc) with you as the ones in your house may have had sihr done on them.
If these don't work and the problem really lies with your husband, then you need to seriously tell him that you want to consummate the marriage right now and he should make love to you even if you seem afraid. (might be a good idea to do it in the dark so he can't see your face.) Tell him that if he doesn't then you will have to go to a marriage counselor (who have helped by digging up the past and bringing fears to the surface and helping couples over come them. ) If marriage counseling doesn't work, then you need to ask whether you are willing to live your life in such a marriage. do istikhaara and if you aren't happy in this marriage,better to end it while you're still young and can get other husband easily. If you wait many years, then you might not be able to remarry, so you need to take all that into consideration.
May Allah help solve your problems and make your marriage a happy one!