The former prime minister says the issue of modern slavery has fallen down the political agenda.