I assume you are talking about that little plastic/brass bit...
It should spin easily, but should not be easy to just pull out.
That little black ring on the water pump must be pushed in to allow the fitting to be pulled out.
It cannot come out on it's own.
Did you put it in far enough (ha, ha...