James Madison Porter (January 6, 1793 – November 11, 1862), a Pennsylvanian, was the 18th United States Secretary of War and a founder of Lafayette College.Porter was born near Norristown, Pennsylvania on January 6, 1793 to General Andrew Porter of the Revolutionary War. As a child he was home schooled, but he later attended Norristown Academy.