Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > Python > Python RSS aggregator?

Reply
Thread Tools

Python RSS aggregator?

 
 
Erik Max Francis
Guest
Posts: n/a
 
      12-17-2004
Back in 2000 I made a news aggregation site (REALpolitik,
http://www.realpolitik.com/) since I didn't find anything that fit my
needs. (REALpolitik is unfortunately made in Perl; it was my last
significant project before I started using Python for most of my work.)
At the time, RSS had not reached the near-universality that it has
now, so RP itself uses a combination of custom scraping and whatever
XML-type feeds that were available.

I've checked and all the feeds _I_ care about are available in RSS
now, so it would make sense to move to an RSS aggregator if it has the
same features. I've looked around at some that are available, both in
Python and not, and haven't found anything that had the feature set I
want. One in Python would obviously be a huge benefit.

I'm not looking for anything all that fancy, but there are a combination
of some seemingly basic features I just can't seem to find in other
aggregators. They are:

- one-page display: It's awkward going back and forth between multiple
feeds in a hierarchical format, and so it's much nicer if they're all
presented on one page available for perusal.

- filtering news items: Preferably for filtering out as well as
highlighting, and also being able to selectively pass on, say, the first
item in an RSS feed, since some popular feeds use that slot as an
advertisement.

- caching news items: I read news sporadically throughout the day, so
one feature I really like is the ability to queue up new items over
time, as distinguished by unique GUID. For example, if an RSS feed only
provided one (unique) item at all in its feed and that was updated once
a day, letting the system run for several days would collect them all,
each stored uniquely and available.

- recent items: When you check for news, it only shows you the news
items in each category that are new since you last caught up (catching
up is the equivalent of a "mark all as read" feature). That way, new
news accumulates, and it's only news you haven't seen before.

Somewhat surprisingly to me, I can't seem to find an aggregator that
supports all these features (using Mozilla). Is it possible it's time
for another Yet Another-type project?

--
Erik Max Francis && && http://www.alcyone.com/max/
San Jose, CA, USA && 37 20 N 121 53 W && AIM erikmaxfrancis
If love be good, from whence cometh my woe?
-- Chaucer
 
Reply With Quote
 
 
 
 
Evan Simpson
Guest
Posts: n/a
 
      12-17-2004
Erik Max Francis wrote:
> I've checked and all the feeds _I_ care about are available in RSS
> now, so it would make sense to move to an RSS aggregator if it has the
> same features. I've looked around at some that are available, both in
> Python and not, and haven't found anything that had the feature set I
> want. One in Python would obviously be a huge benefit.


http://www.nongnu.org/straw/ would be a great place to start, even if it
doesn't have all of your desired features.

Cheers,

Evan @ 4-am

 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Two ways to generate RSS - rss/maker and rss/2.0 - which is better? Jonathan Groll Ruby 1 06-27-2009 03:53 AM
Post RSS feed w/o RSS-to-Javascript.com Scott Gordo HTML 5 08-29-2006 01:34 AM
is RSS 2.0 still RSS 2.0 if we add our own unique tags to it? Jake Barnes XML 1 11-14-2005 01:54 AM
RSS Feed - need an Idiot's Guide to RSS News on my website teach_me6@hotmail.com HTML 5 02-25-2005 11:01 AM
Searches in multiple RSS feeds -> new rss feed Motta XML 1 06-09-2004 10:55 PM



Advertisments
 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57