Notice the phrasing. "What he did to the people." And "what are you doing to the people?"
In other words, your being a workaholic and taking everything on your shoulders isn't doing these people any favors! You are doing more harm than good to these people.
*You are diminishing your own abilities to minister to them. You are wearing yourself out.
*Many of them are capable of doing some of this work, but you are robbing them of the blessing of serving.
*You are training them to just let you do it.
In short, delegate dude!