There is no hint that the wicked servant was frustrated with the evil of the other servants and therefore beat them and ate and drank with sinners in order to quell the pain of the disappointment he felt. This is a teaching that we dare not adopt for ourselves. It was because the servant thought that his Lord would not come back yet and he would later have time enough to straighten up that he engaged in such sins. That is what Christ clearly says—let us not read something else into it.
"But and if that evil servant shall say in his heart, My lord delayeth his coming; And shall begin to smite his fellowservants, and to eat and drink with the drunken; The lord of that servant shall come in a day when he looketh not for him, and in an hour that he is not aware of."