\(-x^2+2xy-4y^2+2x+10y-8\)
\(=-\left(x^2-2xy+y^2\right)+2\left(x-y\right)+12y-8-3y^2\)
\(=-\left(x-y\right)^2+2\left(x-y\right)-3\left(y^2-4y+4\right)+4\)
\(=-\left[\left(x-y\right)^2-2\left(x-y\right)+1\right]-3\left(y-2\right)^2+5\)
\(=-\left(x-y-1\right)^2-3\left(y-2\right)^2+5\)
\(=-\left[\left(x-y-1\right)^2+3\left(y-2\right)^2\right]+5\le5\forall x;y\)
Dấu " = " xảy ra
\(\Leftrightarrow\left\{{}\begin{matrix}\left(x-y-1\right)^2=0\\3\left(y-2\right)^2=0\end{matrix}\right.\Leftrightarrow\left\{{}\begin{matrix}x-y-1=0\\\left(y-2\right)^2=0\end{matrix}\right.\)
\(\Leftrightarrow\left\{{}\begin{matrix}x-y=1\\y-2=0\end{matrix}\right.\Leftrightarrow\left\{{}\begin{matrix}x=y+1\\y=2\end{matrix}\right.\)
\(\Leftrightarrow\left\{{}\begin{matrix}x=3\\y=2\end{matrix}\right.\)
Vậy GTLN của biểu thức trên là : \(5\Leftrightarrow\left\{{}\begin{matrix}x=3\\y=2\end{matrix}\right.\)