Guaicum

I don't know the common name, but it's a small tree, always blooming in late May or June. They have gnarly, old trunks, and I've never seen any seedlings.