Ewen McNeill (edm) wrote in suggestions,
Ewen McNeill

Syndication: increase maximum feed size

Syndication: increase maximum feed size

Short, concise description of the idea
Increase the maximum RSS/ATOM/etc feed size that will be processed from the current 150KB to, eg, 250KB.

Full description of the idea
Some syndicated feeds to LJ (eg, ip_list) are not being processed because the total feed size is larger than the 150KB limit imposed on the feed. (At present the ip_list ATOM feed file is 200KB, due to the mailing list from which it is generated being fairly busy.) This results in the feeds not updating at all/for days at a time, despite there being several new entries.

Since I assume that the maximum feed size is imposed to avoid downloading stupidly large files by accident, but not to prevent busier feeds from updating, an increase in the maximum size that will be processed (or the ability to override this on a per-feed basis) would allow these larger, busier, feeds to be processed.

Modern technology will hopefully allow even an eg, 250KB feed file to be processed fairly efficiently.

An ordered list of benefits
  • Larger/busier syndicated feeds will be processed rather than ignored.

An ordered list of problems/issues involved
  • Potentially more bandwidth consumed downloading the larger feed files.
  • Potentially more memory and CPU time consumed while processing the larger feed files.

An organized list, or a few short paragraphs detailing suggestions for implementation
  • The simplest solution would be to raise the current global limit of 150KB to something higher, eg 250KB or 300KB.
  • Alternatively a per-feed option (eg, set by an administrator) could be added to allow selected feeds to be configure to accept larger feed files.
Tags: syndication, § implemented
  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded