Mark McGowan must see his critics aren’t just cranks after People’s Voice poll shows drop in approval rating