Which general was one of the first union officials to refuse to return runaway slaves to their masters?

Benjamin Butler was one of the first officials. He felt that the runaway slaves could be considered "contraband" and, as such, did not have to be returned to their masters. He felt that the Union could keep them and use them as soldiers if they so chose.