Brexit deal 'more and more difficult': EU