Wild swans are stopping off further north as winters become milder, experts say.