Дмитрий Александрович (uisky) wrote in suggestions,
Дмитрий Александрович

Memories export

Memories export

Short, concise description of the idea
Create analogue of fdata.bml, that export all memories of a certain user, that are visible to all

Full description of the idea
The only way to fetch someone's memories is to visit memories.bml, where entries are splitted to many pages with keywords. Sometimes it is neccesary for the bot just to get a list of all user's public avaliable memories without keywords - just a list оf URLs or even journalid and itemid. I propose writing a script that exports all user's public memories entries in a plaintext.

An ordered list of benefits
  • As for now I support a website http://ljplus.ru/ that is used by 108000 russian LJ users, and we have a bot, that indexes user's memories for searching and statistics. We have to download memories.bml of each user, then parse it for keywords, fetch a page for each keyword... This is much traffic and processing resources for both sides. Using memories export we could fetch just one file and LJ servers do not need to perform JOIN with memkeyword table.

An ordered list of problems/issues involved
  • Well, it's a new script that should be created. Someone should do it.

An organized list, or a few short paragraphs detailing suggestions for implementation
  • I guess it's something like SELECT * FROM memorable WHERE userid='$uid' and security='public'; The output is a tab-separated list of journalid, jitemid and des fields.
Tags: data mining, external services, memories, ~ deferred - needs retagging
  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded