The Fragrance Garden is a small courtyard garden planted with fragrant trees, shrubs, and perennials. Walled inside the cloister-like Clothier Courtyard, it is often detectable from a distance. A few of the plants growing here are southern magnolia (Magnolia grandiflora), an espaliered Chinese witchhazel, salvias, and roses.

This garden and the Theresa Lang Fragrance Garden Endowment Fund, which supports its maintenance, was a gift from Gene Lang, Class of 1938.