Travel between France and countries outside the European Union will be banned from Sunday, said Prime Minister Jean Castex.