Statistical significance tells you a result is real. Practical significance tells you if it is worth caring about. As UX researchers, we need both so we do not overreact to tiny effects or ignore big, noisy signals.
This is why context matters. I have this exact case at the moment. A very small sample, but 90% of my users go towards one specific direction. Those users are representing their own business lines.
https://www.nngroup.com/articles/practical-significance/
