What is evidence-based medicine and why should it be practiced?

What is evidence-based medicine and why should it be practiced?