Gulfport is a place for tranquility, reconnection and a weekend getaway, boasting mid-century cottages, beach picnics and rich local history.