Chamber of Commerce policy director Ross Smith made his comments after a Government report showed the region will be hit hardest by Brexit