Trouble appears to be looming in the effort to keep Britain as part of the European Union.