Inspectors issued nine improvement notices.
"They've had 40 years to make a change."
"We are deeply saddened by the harm members of our community have experienced."
It follows a landmark Employment Court ruling stating that three former residents were employees there, not volunteers.
The Employment Court ruled the leavers were employees, not volunteers.
A judge found three young men who worked there from the age of six were employees, not volunteers.
One WorkSafe investigator noted Gloriavale residents had "little to no knowledge" of worker rights.
An employment court case is examining whether those at the secretive community are volunteers or not.
A former resident is currently facing 38 charges in relation to 10 victims.