openrss.org feeds don't work

[Araly]

hey, I have a bunch of tumblr feeds, general website feeds, buttondown feeds and they all work without issues.

I also have some bluesky feeds but since bluesky's rss feeds are only text, I use openrss.org feeds for bluesky, so that I can have images.

the openrss.org feeds don't seem to work well.

at first I was able to add new feeds and it would populate with some items

now I can't add any more feeds anymore, and my existing feeds don't update.

for example https://openrss.org/bsky.app/profile/doginacafe.bsky.social I can see the items up to the 25th of October (latest when I added the feed) but nothing new since.

I see here https://openrss.org/issues that there issue in other readers with openrss.org sometimes, maybe something similar is happening with the nextcloud News app ?

let me know if anyone knows how to get it to work, or some other way to get unable bluesky feeds

[Grotax]

I'm not familiar with openrss but I can imagine that they block your IP.
It seems that they do not block the Nextcloud News user agent or to be precise the one of the alpha version that I use.

Which version of News do you use?
How many feeds do you have that come from openrss?
Do you see errors/warnings from News in the logs regarding these feeds?

[Grotax]

Yea so that message tells us that while trying to read the feed from openrss their system sends you the internal server error so some HTTP 500 code.

I don't think we can do something about that, in the past some operators complained about news creating too many requests but that has improved now and I think we do what is possible, except etags we don't support that.

And I can imagine that they get from their view too many requests from your IP because for me I can access these feeds without issue.

[Araly]

i'll see if openrss.org can let me know what wrong then. thanks !

[Araly]

I talked with the openrss.org people, and they told me that the issue is that I send too wany requests at the same time, and I get blocked. They said that News should try to follow these guidelines if we want to get openrss feeds.
https://openrss.org/guides/developers-guide-to-open-rss-feeds

they said that specially polling slower doesn't change much, it's the simultaneous requests that are an issue.

no idea if that's something you guys can do, let me know if I should write an issue about it. I tried looking in the settings if I could disable automatic refreshing only for a folder, and then I would go fetch feed by feed manually, but couldn't find anything like that

[Grotax]

I read their suggestions they sound good.

News would need to be able to have individual update times based on the cache headers or other factors, the feed library we use already reports back when the next update would make sense and I think it also considers the average post frequency of the feed.

Storing that information should be easy.
I don't know how we would then run the update when we have that next update timestamp.

There are multiple options that could be considered and all probably have some downsides.

And then all of that would need to be implemented and tested.

So I think in your case it makes sense to use one of their recommended feed readers because otherwise it won't work for the foreseeable future.