Bismillahir Rahmanir Raheem,
As-Salaamu 'Alaykum Wa Rahmatullah.
It all depends, maybe you should have a survey, you need to know why they get bored?
Are they bored because of the actual topics? Or the way the topic is presented? Or because they feel they are learning nothing?
Have you guys spoken to the Imam of the Masjid, what does he suggest, he, I assume, knows the situation better than most of us here.
Also what are you aiming to do? What does your area need, do you need to work on a building a stronger community? If so then maybe cooking days or days where people go to someone's house or stuff like that may be helpful, or having one day a week dedicated to a certain group (over 30s, or Mothers, or under 13s etc). Or are you looking to provide islamic knowledge first and foremost, if so, then you may want to find out the how the people work, put them in groups, to do different tasks, have one day teaching one important topic and another day another, then have the rest of thedays as days of revisions where the groups can choose to get together to revise etc.
Have notices, i.e. such and such sister is sick if anyone wants to visit her, or such and such sister's husband died so if anyone would like to help her out with things whilst she mourns.
EDIT: Also you could have days where you have the Imam with a Trustworthy Muslim Dr. and the sisters can write questions and have them answer, I'm sure you'll get questions about giving birth and all that. Also with a lawyer or someone in the legal system.
There's so much you can do, I hope it goes well!
br.al-Habeshi