Why would it be unusual to find a fossil of an organism's eye?

The preservation of anything other than mineral skeletons is (with a few exceptions described below) an extremely rare event. Anything that can decay is likely to be lost. Fur, skin, internal organs - all are immensely vulnerable to the destruction by bacteria, fungi and scavengers that assure their recycling back into the ecosystem.