Medical charity says its exit will leave significant gap in healthcare for thousands of local residents