There are quite a few people who've converted in their 20s and who have gone on to study the deen and become imams and even scholars.
You might be intersted in this article about
Imam Suhaib Webb who is currently studying at al Azhar. He made his shahada at age 20, and didn't start to study seriously until after that.
I feel a pull to study the deen formally, and I'm 26 and don't know more than a few words in arabic, but I'm not giving up!
If you'd still like to go to college, try to study arabic while you're there, so when you graduate, you'll be able to get into Islamic studies more easily. Check out distance learning programs and do some of those while you're in school as well, to get the basics down.
Also, you can talk to imams in your area and elsewhere about what kind of training they had, what their life is like, why they chose the path they did, etc. Ask them if they would be willing to mentor you. Maybe one would be willing to teach you as well.
Above all,
pray Istikhara and ask Allah (swt) to guide you onto the path that is most beneficial to you.