Over-regulation of the banking sector is blamed for stifling competition.
Malaysian oil company Tamarind should be "exited from NZ".
Minister Shane Jones says the closure is evidence of de-industrialisation.
Cabinet has agreed to liberalise the foreign investor regime in time for a March summit.