If it is online, they could send private messages to each other.
  Or they could be members of a group that you are not in. If it
  is in person, they can simply make a look at each other that you
  don't understand that means, "What an idiot!" that they
  understand.

  It happens. Also, in public groups, someone can talk "behind
  your back" publicly by having a kind of 'code" where they are
  making fun of someone in a way that the person doesn't
  understand, but they do. The secret is to understand all of the
  codes, but not let them know that you know the codes.* That
  gives you insight.