Lord Michael Gove has told Sky News that a national inquiry could see some "tough questions" asked of the Home Office about it culture and its interactions with the police.
But those questions will also be posed to two departments he led - the Department for Local Government and the Department of Education.
The veteran cabinet minister welcomes the inquiry and the accompanying "tough question", saying: "I think it's right that there should be, because the nature and scale of what the victims have endured means that there's an obligation on all of us who've been in any form of elected office to be honest and unsparing in looking at what went on."
He said he "certainly didn't have the knowledge at my command that we now do about the widespread nature of this activity".
'Not nearly enough' progress made
Sophy Ridge put to Lord Gove that despite commissioning a report on what was happening to girls in care, and not seeking to block the publication of Andrew Norkfolk's story, he still failed to make change.
He replied: "Yes, so it is undoubtedly the case that more should have been done."
He admitted that it "absolutely" weights on him, and that "not nearly enough" progress was made.
"With the benefit of hindsight, I do wish that I had been more vehement in trying to persuade people to take appropriate action," he said.
The Department for Education and Rotherham Council were approached for comment earlier this week on the claims first made by Dominic Cummings, revealed by Sky News.