{"id":216,"date":"2003-03-24T21:56:37-05:00","date_gmt":"2003-03-25T05:56:37+00:00","guid":{"rendered":"http:\/\/peterjanes.ca\/wordpress\/?p=216"},"modified":"2003-03-24T21:56:37-05:00","modified_gmt":"2003-03-25T05:56:37+00:00","slug":"spyce-up-your-life","status":"publish","type":"post","link":"https:\/\/peterjanes.ca\/blog\/2003\/03\/24\/spyce-up-your-life\/","title":{"rendered":"Spyce up your life"},"content":{"rendered":"

Good lord, I just quoted the Spice Girls<\/a>. I need to sit down for a second.


<\/p>\n\n

OK, better now. Still, this will just be a jumble of thoughts more than a proper entry.<\/p>\n\n

I’ve been playing some more with Spycyroll<\/a>, and I think I’m making headway on adapting it for my purposes. Until today I’ve just been letting it continue to accumulate posts without removing any; as a result, my aggregate page was well over 400K<\/abbr> and growing. (The reason for this is related to the date issues I referred to earlier<\/a>.) Tonight I got (slightly) brighter and realized all I had to do is to put read<\/cite> files in one directory and unread<\/cite> files in another. Through the magic of Python, that took all of about five lines of code, and my aggregate page is a much healthier 16K.<\/p>\n\n

Holding on to all of those deleted files is still an issue. Because I can’t tell what items are no longer in a feed, it’s necessary to hold on to all of them. I’m thinking a database will be necessary, probably of MD5<\/cite> checksums for each post, but I’m not comfortable enough with Python to start messing around with its database support yet.<\/p>\n\n

I’ve also realized that although rssparser.py<\/code> does nice resource retrieval (using If-Modified-Since<\/code>\/Last-Modified<\/code>, If-None-Match<\/code>\/ETag<\/code>, and Accept-Encoding: gzip<\/code>), Spycyroll doesn’t take advantage of it. I’ll probably use the filesystem to store that information too in the interim.<\/p>\n\n

A few things to consider there, and there’s more, but I’m getting antsy to try some of this out….<\/p>\n\n

It works, mostly. Now that I’m taking advantage of smart retrieval, the site links in the blogroll<\/cite> part of the page aren’t being filled in, because they’re pulled from the channel. Two steps forward….<\/ins><\/p><\/div>

<\/div>","protected":false},"excerpt":{"rendered":"Good lord, I just quoted the Spice Girls. I need to sit down for a second. OK, better now. Still, this will just be a jumble of thoughts more than a proper entry. I’ve been playing some more with Spycyroll, and I think I’m making headway on adapting it for my purposes. Until today I’ve…","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"mf2_syndication":[],"venue_id":0},"categories":[3],"tags":[],"kind":false,"_links":{"self":[{"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/posts\/216"}],"collection":[{"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/comments?post=216"}],"version-history":[{"count":0,"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/posts\/216\/revisions"}],"wp:attachment":[{"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/media?parent=216"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/categories?post=216"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/peterjanes.ca\/blog\/wp-json\/wp\/v2\/tags?post=216"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}