Easy enough. That's called a netsplit, meaning that one or more server(s) go down and therefore people part. People that are on other, working servers will stay on the network, and therefore also in the channel. It's quite common on EFNet, it's one reason why it's free.
