You need to rebuild everything that depends on libxcb.
Code:
sudo portupgrade -r x11/libxcb
if you are using portupgrade or
Code:
sudo portmaster -r x11/libxcb
if you are using portmaster instead.
I do not know anything about the 'portmanager' program that you mentioned above.