If you could look into the matter from outside of scenario, may be you will find those problems very silly. When we are facing a certain situation, we are obliged to think in our own way. I will request you to look the matter from the other party point of view. Try to sit you both relax & ask what a course of action to be taken next. If even then, you both consider, this is the only option left, go for it as it is a permissible act.
May Allah help you (Amen)