A parolee was taken into custody moments after holding up a Hesperia Walgreens store, law enforcement officials said.