His castration plays a big role in why he acts as he does. It was hinted at & has nothing to do with the normal absence of sexual desire.Varys is sneaky. His castration is not something that needs to be advertised - merely his intellect and deviousness.