You're resorting to all sorts of media, lol...I like your handwriting...
Are you suuure it's not in fact (1 - x^2)^3/2??...because otherwise, I agree with GreyKode; the substitution used when the bottom is (1 + x^2) usually involves tan...
If it IS (1 - x^2), the only thing wrong with your working is where you've written 1/cos u dx ...(not to add the the confusion, but I'm gonna use u instead of theta :X).....because dx/du = cos(u), you replace the dx in the integral with cos(u) du....ultimately, you want everything in the integral to be in terms of u...
So, the integral will just be:
1/(1-sin^2(u))^3/2 * cos(u) du
= 1/cos*3(u) * cos(u) du...........(basically, the last cos(u) is at the top, not the bottom)
= 1/cos^2(u) du = sec^2(u) du >> integrated, this gives you tan(u)
Also, the new limits are pi/6 and 0, I think; evaluate tan(u) between these... all this assuming the question may be wrong, lol... :blind: