The prime minister is relentlessly pursuing the politics of panic, but validating voter anxiety can only go so far