Quitting the EU could leave British households up to 960 pounds ($1,260) worse off each year, according to a report.