What element is principally responsible for making olivine, pyroxene, amphibole, and biotite dark?

That element is iron.

Given that olivine, pyroxene, amphibole, and biotite are all minerals found in mafic igneous rocks, the answer is quite simple if you know something about such rocks. Mafic rocks contain elevated amounts of iron, which makes them dark in color.