This type of anisocoria is the result of physical damage to the eye ... Medical conditions that may lead to anisocoria include: Third nerve palsy (TNP) can cause pupils of different sizes.