\(1\le a\le2\Rightarrow\left(a-1\right)\left(a-2\right)\le0\) \(\Rightarrow a^2-3a+2\le0\Rightarrow a^2+2\le3a\)
\(\Rightarrow a+\frac{2}{a}\le3\)\(\Rightarrow\left(a+\frac{2}{a}\right)^2\le9\Rightarrow a^2+\frac{4}{a^2}\le5\)
Tương tự : \(b+\frac{2}{b}\le3\); \(b^2+\frac{4}{b^2}\le5\)
\(\Rightarrow a+\frac{2}{a}+a^2+\frac{4}{a^2}+b+\frac{2}{b}+b^2+\frac{4}{b^2}\le16\)
Áp dụng BĐT Cô-si,ta có :
\(16=\left(a+b^2+\frac{4}{a^2}+\frac{2}{b}\right)+\left(b+a^2+\frac{4}{b^2}+\frac{2}{a}\right)\ge2\sqrt{\left(a+b^2+\frac{4}{a^2}+\frac{2}{b}\right)\left(b+a^2+\frac{4}{b^2}+\frac{2}{a}\right)}\)
\(\Leftrightarrow8\ge\sqrt{\left(a+b^2+\frac{4}{a^2}+\frac{2}{b}\right)\left(b+a^2+\frac{4}{b^2}+\frac{2}{a}\right)}\)
\(\Leftrightarrow A=\left(a+b^2+\frac{4}{a^2}+\frac{2}{b}\right)\left(b+a^2+\frac{4}{b^2}+\frac{2}{a}\right)\le64\)
Vậy GTLN của A là 64 \(\Leftrightarrow\orbr{\begin{cases}a=b=1\\a=b=2\end{cases}}\)