Okely. So if you visualise this you have a circle in the x-y plane, with lines shooting up from the x-axis to intersect the circle. That forms a section of a circle. The rectangle is then made by joining the y-intercepts.
That was really vague. Picture the rectangle, with lines extending up from x = -1 and x = 1 to where they intersect the circle at y = sqrt(9 - (+/-1)^2) = sqrt(

. If you can see that we're already halfway there. Anyway, the area of that rectangle at those values of x and y is base * height = |2*1(base)*8(height)| = |2x*y| (there are magnitude signs because 'x' can be plus or minus and area is always positive)
Now, let's not give x a numeric value. Let's just keep x = x and y = sqrt(9 - x^2). Because to get the area, it's just going to be 2*x*y or 2*x*sqrt(9-x^2).
Thus, A = 2Xsqrt(9-X^2)
We want to maximise the area, so we need to differentiate that. Using product rule:
dA/dx = 2sqrt(9 - X^2) + (1/2)*2X((9 - X^2)^(-1/2))*-2X
= 2sqrt(9 - X^2) - 2x^2/((9 - X^2)^(1/2))
Area is maximised when dA/dx = 0
So, 2sqrt(9 - X^2) - 2x^2/((9 - X^2)^(1/2)) = 0
2sqrt(9 - X^2) = 2X^2/((9 - X^2)^(1/2))
9 - X^2 = X^2
2X^2 = 9
X^2 = 9/2
X = (+/-)3/sqrt(2)
You can take either value because the area will be the magnitude. But, for easiness, let's take X = 3/sqrt(2) remember that Area = |2*x*y| = |2*x*sqrt(9 - X^2) = 2*(3/sqrt(2))*sqrt(9 - (3/sqrt(2))^2)
= 3*sqrt(2) * sqrt(9 - 9/2)
= 3*sqrt(2)*sqrt(9/2)
= 3*sqrt(2*9/2)
= 3*sqrt(9)
= 3*3
= 9 square units.
Sorry for no latex! Feel free to ask any questions about this, it probably looks real confusing