The museum resides in the carriage house of Mr. Larz Anderson, a former ambassador. Mrs. Isabel Anderson became the wealthiest woman in the world when she received her inheritance from her grandfather's trading company. The two met in Italy while she was traveling.

The Andersons purchased a new car almost every year they were married, acquiring 32 brand-new motorcars during their marraige.

At the top of the hill stood the estate, now gone, which has a fantastic view of the city.

The museum changes the cars on display throughout the year; some of the cars belong to private owners.