Cách 1:
Ta có: \(tan\alpha=\sqrt{2}\Rightarrow\left\{{}\begin{matrix}\dfrac{sin\alpha}{cos\alpha}=\sqrt{2}\\1+\left(\sqrt{2}\right)^2=\dfrac{1}{cos^2\alpha}\end{matrix}\right.\Leftrightarrow\left\{{}\begin{matrix}sin\alpha=\sqrt{2}\cdot cos\alpha\\cos^2\alpha=\dfrac{1}{3}\end{matrix}\right.\)
\(P=\dfrac{sin\alpha-cos\alpha}{sin^3\alpha+3cos^3\alpha+2sin\alpha}\)
\(=\dfrac{\sqrt{2}\cdot cos\alpha-cos\alpha}{\left(\sqrt{2}\cdot cos\alpha\right)^3+3cos^3\alpha+2\cdot\sqrt{2}\cdot cos\alpha}\)
\(=\dfrac{cos\alpha\left(\sqrt{2}-1\right)}{2\sqrt{2}\cdot cos^3\alpha+3cos^3\alpha+2\sqrt{2}\cdot cos\alpha}\)
\(=\dfrac{cos\alpha\left(\sqrt{2}-1\right)}{cos\alpha\left(2\sqrt{2}\cdot cos^2\alpha+3cos^2\alpha+2\sqrt{2}\right)}\)
\(=\dfrac{\sqrt{2}-1}{2\sqrt{2}\cdot cos^2\alpha+3cos^2\alpha+2\sqrt{2}}\)
Thay \(cos^2\alpha=\dfrac{1}{3}\) vào \(P\) ta có:
\(P=\dfrac{\sqrt{2}-1}{2\sqrt{2}\cdot\dfrac{1}{3}+3\cdot\dfrac{1}{3}+2\sqrt{2}}=\dfrac{\sqrt{2}-1}{1+\dfrac{8}{3}\sqrt{2}}\)
\(=\dfrac{3\left(\sqrt{2}-1\right)}{3\left(1+\dfrac{8}{3}\sqrt{2}\right)}=\dfrac{3\left(\sqrt{2}-1\right)}{3+8\sqrt{2}}\)
\(=\dfrac{3\left(\sqrt{2}-1\right)}{3+2^3\sqrt{2}}=\dfrac{a\left(\sqrt{b}-1\right)}{a+b^3\sqrt{b}}\)
\(\Rightarrow\left\{{}\begin{matrix}a=3\\b=2\end{matrix}\right.\Rightarrow a+b=5\)
Chọn đáp án A.
Cách 2:
\(P=\dfrac{sin\alpha-cos\alpha}{sin^3\alpha+3cos^3\alpha+2sin\alpha}=\dfrac{\left(sin\alpha-cos\alpha\right)\div cos^3\alpha}{\left(sin^3\alpha+3cos^3\alpha+2sin\alpha\right)\div cos^3\alpha}\)
\(=\dfrac{\dfrac{sin\alpha}{cos^3\alpha}-\dfrac{1}{cos^2\alpha}}{\dfrac{sin^3\alpha}{cos^3\alpha}+3+2\cdot\dfrac{sin\alpha}{cos^3\alpha}}=\dfrac{\dfrac{sin\alpha}{cos\alpha}\cdot\dfrac{1}{cos^2\alpha}-\dfrac{1}{cos^2\alpha}}{tan^3\alpha+3+2\cdot\dfrac{sin\alpha}{cos\alpha}\cdot\dfrac{1}{cos^2\alpha}}\)
\(=\dfrac{tan\alpha\cdot\left(1+tan^2\alpha\right)-\left(1+tan^2\alpha\right)}{tan^3\alpha+3+2tan\alpha\cdot\left(1+tan^2\alpha\right)}\)
Thay \(tan\alpha=\sqrt{2}\) vào ta có:
\(P=\dfrac{\sqrt{2}\cdot\left[1+\left(\sqrt{2}\right)^2\right]-\left[1+\left(\sqrt{2}\right)^2\right]}{\left(\sqrt{2}\right)^3+3+2\sqrt{2}\cdot\left[1+\left(\sqrt{2}\right)^2\right]}=\dfrac{3\sqrt{2}-3}{2\sqrt{2}+3+6\sqrt{2}}\)
\(=\dfrac{3\left(\sqrt{2}-1\right)}{3+8\sqrt{2}}=\dfrac{3\left(\sqrt{2}-1\right)}{3+2^3\sqrt{2}}=\dfrac{a\left(\sqrt{b}-1\right)}{a+b^3\sqrt{b}}\)
\(\Rightarrow\left\{{}\begin{matrix}a=3\\b=2\end{matrix}\right.\Rightarrow a+b=3+2=5\)
Chọn đáp án A