Syndication: increase maximum feed size
Short, concise description of the idea
Increase the maximum RSS/ATOM/etc feed size that will be processed from the current 150KB to, eg, 250KB.
Full description of the idea
Some syndicated feeds to LJ (eg, ip_list) are not being processed because the total feed size is larger than the 150KB limit imposed on the feed. (At present the ip_list ATOM feed file is 200KB, due to the mailing list from which it is generated being fairly busy.) This results in the feeds not updating at all/for days at a time, despite there being several new entries.
Since I assume that the maximum feed size is imposed to avoid downloading stupidly large files by accident, but not to prevent busier feeds from updating, an increase in the maximum size that will be processed (or the ability to override this on a per-feed basis) would allow these larger, busier, feeds to be processed.
Modern technology will hopefully allow even an eg, 250KB feed file to be processed fairly efficiently.
- Larger/busier syndicated feeds will be processed rather than ignored.
An ordered list of problems/issues involved
- Potentially more bandwidth consumed downloading the larger feed files.
- Potentially more memory and CPU time consumed while processing the larger feed files.
An organized list, or a few short paragraphs detailing suggestions for implementation
- The simplest solution would be to raise the current global limit of 150KB to something higher, eg 250KB or 300KB.
- Alternatively a per-feed option (eg, set by an administrator) could be added to allow selected feeds to be configure to accept larger feed files.