xml driver needs paging

[jacobthill]

The xml driver currently only harvests the first page of metadata. Shahre Farang is a collection with multiple pages e.g. https://shahrefarang.com/en/feed/?paged=2

Newcastle and Harvard SCW need xml paging

[edsu]

Since they are using Atom for linking, it would be great if they could use paging by adding a <link rel=next ..> like:

<atom:link href="https://shahrefarang.com/en/feed/?paged=2" rel="next" type="application/rss+xml" />

Then our XML driver could follow it's nose to the next URL if paging is on? Otherwise I guess we could add some URL pattern to the intake configuration.

Of course there would be work to do in the driver to follow the link, whichever way we choose to go.