The fire broke out late Wednesday at the site along Green Avenue near Highway 97, the property that once housed the estate of prominent businessman David Kampe.