ĐKXĐ: \(\left[{}\begin{matrix}x>3\\x\le-1\end{matrix}\right.\)
- Với \(x>3\) BPT tương đương:
\(\left(x-3\right)\left(x+1\right)+2\sqrt{\left(x-3\right)\left(x+1\right)}-3< 0\)
\(\Leftrightarrow\left(\sqrt{\left(x-3\right)\left(x+1\right)}-1\right)\left(\sqrt{\left(x-3\right)\left(x+1\right)}+3\right)< 0\)
\(\Leftrightarrow\left(x-3\right)\left(x+1\right)< 1\)
\(\Leftrightarrow x^2-2x-4< 0\Rightarrow3< x< 1+\sqrt{5}\)
- Với \(x\le-1\)
\(\Leftrightarrow\left(x-3\right)\left(x+1\right)-2\sqrt{\left(x-3\right)\left(x+1\right)}< 3\)
\(\Leftrightarrow\left(\sqrt{\left(x-3\right)\left(x+1\right)}+1\right)\left(\sqrt{\left(x-3\right)\left(x+1\right)}-3\right)< 0\)
\(\Leftrightarrow\left(x-3\right)\left(x+1\right)< 9\Leftrightarrow x^2-2x-12< 0\)
\(\Rightarrow1-\sqrt{13}< x\le-1\)
Vậy nghiệm của BPT là: \(\left[{}\begin{matrix}3< x< 1+\sqrt{5}\\1-\sqrt{13}< x\le-1\end{matrix}\right.\)