Fingerprint sensor not working occasionally

I've been recently getting some instances where I would lock the phone and the fingerprint sensor won't respond to my finger.

This really started when I changed my lock to pattern swiping. Anyone have the same issue? I rebooted and changed it back to pin lock and it seems to be working all the time again, but I don't know what caused it in the first place.

Thoughts?