The Aussie shock-jock described the PM a "complete clown" in August.
The Project host addressed the stoush between the politician and Mark Richardson.
"We as a political party are not going to leave this scene and leave it like it is."
"I want to make sure that people can say what they think even where it's a bit un-PC."
Jacinda Ardern is distancing herself from the Deputy PM's comments.
"It's time to rule out the old dog and show some leadership."
In an impassioned speech, Richardson said Peters lacks basic human respect.
Party members are reconsidering their position after a clash with the youth wing on Sunday.
But he was tight-lipped about who's been tapped to replace him.
The Deputy Prime Minister addressed the conference on Sunday afternoon.
"The hope we entrusted to New Zealand First for our future has come to nothing."
"I think I've got more terms in me than some of those asking the questions."
More than 500 jobs are hanging in the balance.
Winston Peters is promising a screening of the CCTV footage.
The Police Association says any change would be deeply disappointing.
A proposal has been with the Government since December.
He's refusing to stand by while his MP is criticised.
The Prime Minister's popularity has been tarnished by a cacophony of cock-ups and controversies.
New Zealand First has referred the leak to the police.