European Union finance ministers agreed on Tuesday to remove the Pacific island of Palau from an EU list of tax havens.