Ukrainian government forces and pro-Russian separatists in eastern Ukraine have started a prisoner swap, the office of Ukrainian president said on Thursday.