Who, if any, in JFK's inner circle argued against the plans for the Bay of Pigs invasion?

There was only one person by the name of Arthur Schlesinger who wrote a memo against the plans for the Bay of Pigs invasion. Nobody else went against the plans as JFK himself was in favor of the invasion. Arthur Schlesinger wrote the memo but never pushed for the plans to be scuttled. So the invasion went on and met with the failure that was expected. The inner circle of JFK failed in communicating the problems regarding the invasion to JFK and this was a major reason behind this failure. The committee had failed to deliver correctly and this was a case of failed group thinking.