Isleworth is an affluent community outside Windermere, Florida, in Orange County.Located outside the Orlando city limits, the community is desirable for its proximity to the city's downtown, its location within the Butler chain of lakes, and as a local status symbol of wealth and grandeur.Isleworth traces its roots to the Chase family, a group of citrus grove owners from Philadelphia who purchased land in the area after the U.S. Civil War.