Voice search keeps waiting

I'm having tons of issues with my nexus player, but one in particular is with voice search. It was working initially but now more often then not when you initiate a search my speech is dictated into the search box, but it waits for more dictation rather then searching. I can just continue to talk forever and it keeps entering text. Super annoying, I've tried resetting the device, factory resets, clearing data on different system apps and sometimes it works temporarily but the problem always returns. Running latest marshmallow OTA but it's done it on 5.1 as well.

Any ideas?