The arrests prevented an attack on a foreign businessman, according to a statement by APEC's Peru office.
Iconic site is closed to tourists.
The government of the leftist leader had been mired in chaos since inauguration.
"I am not what the complaint at the police station says," said the Prime Minister on his third day on the job.
Manuel Merino resigned on Sunday