Away from work, Rutledge enjoys fishing, hunting, and spending time with his family. Rutledge is active in a number of charitable and social organizations in Charleston. Rutledge and his wife Molly live in West Ashley with their three children.