S.Korea ending deal damages trust: Japan