Hairs on the caterpillars can cause fevers and eye and throat irritations, officials say.