Automatically Downloading Content from RSS

By Deane Barker on December 12, 2003

Aggregators that automatically download web pages: Some people have made the request that NewsGator download the “target” page of a blog posting so disconnected users can have the content too. Greg has a good discussion of the implications.

So we’re caught between doing what the publisher wants (driving a click-through), or doing what the user says they want (scrape the page). It’s a tough call – we don’t want to upset the publishers, as they’re the ones providing the content…