Which founding father warned against interest groups in the federalist papers?

James Madison

James Madison was the founding father who warned against the Interest group in Federalist papers. Madison warned against the dangers of fractions because the minority may involve in creating issues which they felt strongly which possibly detriment majority. However, he believed that the natural way of controlling interest group is by allowing them to flourish and compete for each other.