RSS & Aggregation

This group should probably have more organizers. See documentation on this recommendation.

Working on the improvement of the RSS/ATOM aggregation provided by Drupal.

Need some help

Posted by neocary on July 21, 2009 at 8:56pm

I am having a real tough time trying to import rss images over into individual nodes..I CAN do video and kudos to
http://www.drupaltherapy.com/node/34

for some great tutorials..I have tried several suggestions outlined in
http://groups.drupal.org/node/16799

My source is the following http://www.u2start.com/rss/photos/

I have even tried the new feedapi scraper-but I do not know how to set that up.
http://drupal.org/project/feedapi_scraper

Feedapi and Location information

Posted by summit on July 17, 2009 at 12:11am

Hi,
Feedapi has a location_cck mapper (the location mapper itself doesn't work anymore). Does anyone have a xml-feed with location info working through feedapi?
what fields are obligated?
Thanks for your answers in advance please!

Greetings,
Martijn

Munging?

Posted by reikiman on July 12, 2009 at 3:01am

I have built an aggregator site (http://wwwatts.net) using some home grown software written in groovy to do aggregation and publishing pages. The result is okay but now I want to shift to Drupal for it and the FeedAPI is nigh on perfect. However there are some things which were required on wwwatts.net which I don't see how to do in FeedAPI.. so I just wrote a little module for one of these things.

Namely...

Fields inheritance

Posted by ademarco on June 10, 2009 at 10:12am

I've just contributed a new module for FeedAPI, it's called FeedAPI Field Inherit (http://drupal.org/project/feedapi_field_inherit). Here the project description:

Generalizing what the Feed Element Mapper module does for taxonomy, this module allows to automatically set fields in the feed items individual nodes by inheriting field values from the parent node.

Feed Scraper

Posted by ademarco on May 18, 2009 at 8:57am

Hi all,

I've been working on an add-on module for Feed Element Mapper that extract content from raw HTML contained into syndication feeds. It is called Feed Scraper, here its project page: http://drupal.org/project/feedapi_scraper.

As you can see from the screenshot it uses xpath queries to scrape out the information you are interested in. It allows to plug in other parsers as well, a regular expression one is already available with the module.

After defining a set of scrapers you are then able to map them to CCK fields using Feed Element Mapper. Since I've just released the first dev version every feedback, comment or feature request is really welcome.

Planet Drupal TV

Posted by jbrown on April 28, 2009 at 9:11pm

I have created a new site called Planet Drupal TV that aggregates Drupal video feeds in a manner similar to how Planet Drupal aggregates Drupal blog posts. Videos can be viewed in-browser or downloaded. There is a "most popular" section that utilizes the fantastic Radioactivity module.

It utilizes my Blue Droplet Video module and its Feed API integration.

I've added all the Drupal video feeds I could find, although it does not work with YouTube feeds as they do not use the enclosure tag. Miro can acquire video from YouTube, so it should be possible in future. Really, blip.tv is much better than YouTube, or you could use Blue Droplet which outputs the source video in the enclosure tag.

Best feed aggregation module to build a community blog aggregator

Posted by alnds on April 14, 2009 at 6:17pm

I'm building a community blog aggregator using Drupal and have tried out several feed aggregation modules. May be I'm missing the logic of doing this but none of the modules seem to fit my purpose. What I'd want to do is have "Most recent posts", "Most voted posts" etc (i.e. feed items coming not from a single feed, but from multiple feeds and then have them mixed according to the criteria I need). On the front page, I'd want to list the posts of the listed blogs as an when they are published, ordered by the time of their posting.

Filtering of RSS news from a huge database

Posted by spawinter on March 29, 2009 at 12:31pm

Hi guys,

I would be very interested in knowing your opinion and shall appreciate a little help concerning some functionality of RSS news feeds.

The idea is the following: my website visitors should be able to create a single database of RSS news feeds. Simply that could be a single wiki page with many RSS links. Then obviously when the link database becomes big, there will be too many news ITEMS to read. To solve this problem users could set up their own personal keywords, so that the module saves only those news items which matches the keyword.

RDFizing Drupal: Upgrading the RSS Feeds

Posted by Arto on March 25, 2009 at 1:42pm

I've just posted step-by-step instructions on how to use the Drupal 6.x RDF module to upgrade your Drupal site's RSS feeds for compatibility with RDF and the Semantic Web:

http://ar.to/2009/03/rdfizing-drupal-rss-feeds

Only local images are allowed.

As I don't do comments on my site, please feel free to discuss here.

FeedAPI processor to modify item titles before saving

Posted by weimeng on March 5, 2009 at 11:25am

I tried writing a FeedAPI Processor module to remove the Username: string that preceeds each item on a Twitter feed. To this end I copied code from the example processor posted on this group and also took the preg_replace code from the Activitystream module. However, it doesn't seem to work even when feedapi_node is enabled and placed at a higher weight (0) than my own processor module (-1).

I'm not very good with PHP or Drupal (just someone that understands a little bit of programming knowledge and does a lot of copy/pasting), so it's probably a fault with the code. Would really appreciate if someone could look at it and point me in the right direction. :)

Code after break.

Create one feed out of several Drupal feeds?

Posted by no2e on March 3, 2009 at 3:12am

I have a multi-site Drupal installation. Each multi-site is a subdomain of example.com (like ms1.example.com, ms2.example.com, etc.)

Now, the homepage (http://example.com) is not run by Drupal, but I want to insert a feed, which consists of a mash-up of several selected feeds of the subsites. And this new feed shall not have the URL of a subsite, but the URL of the homepage (where no Drupal is installed).

Example:

the feeds

sub1.example.com/new-nodes.rss
sub2.example.com/feed.rss
sub3.example.com/blog.rss

which module to use for feed filtering?

Posted by spawinter@drupal.org on February 25, 2009 at 9:43pm

Hi guys,

I am a bit lost and need your advise. I want to be able to simply filter all feeds by my keywords.

In other words, if I subscribe to many many news feeds (let say all available RSS feeds from a many many websites), I do not really wanna read all that stuff. Instead I would just like to set up my own keywords and filter or delete the rest of the feeds downloaded from all these websites.

I am using drupal 6. I have check already built-in module "aggregator" and "aggregation" module - it is not possible, right?

Thank you for advise.

Aggregation BoF at DrupalCon DC

Posted by alex_b on February 24, 2009 at 6:56pm

At DrupalCon DC next week, I'd love to get together with other aggregation heads to discuss ongoing and upcoming work in aggregation modules in Drupal. Who's interested, what issue would you like to talk about?

Read more and reply to the BoF post on the drupalcon web site: http://dc2009.drupalcon.org/node/3834

Create feed from node content

Posted by dan.crouthamel on February 23, 2009 at 2:56am

I'm wondering what would be the best way to generate a feed (xml file) for data associated with a node. I have a custom node type with a cck imagefield that allows multiple images to be attached. Think of the node as an album. What I would like to do when the node is created is to generate the appropriate feed file needed by piclens, but I'm unsure where is the appropriate place to do that.

Example FeedAPI Processor

Posted by benroot on February 9, 2009 at 11:44pm
Last updated by Chris Johnson on Tue, 2009-10-13 21:25

FeedAPI Node lets you aggregate feed items into nodes. What if you need slightly different behavior but still want to retain the most of the functionality of FeedAPI Node (save feeds as nodes, check whether nodes already exist before importing them, deleting nodes when content expires, etc)? Just create an additional processor, weight it "lighter" than the FeedAPI Node processor and enable it. Note: the code below will only work if another processor is enabled because it does not implement its own saving or purging of feed items. Also, it must be given a lower weight so that it executes before the FeedAPI Node processor so that it can modify each feed item before FeedAPI Node processor saves it.

This example addresses the problem of parsing the date of an aggregated item directly from its URL. This should work for items that encode the date in the URL in the following format: YYYY/MM/DD

Kendra Hub - Media Asset/Content Management, Semantic Syndication/Promotion and Commerce Tool

Posted by dahacouk on February 8, 2009 at 12:38pm

Integrate a podcast RSS-feed into a site

Posted by MatthijsG on January 30, 2009 at 3:30pm

For over a week i'm looking for a way to integrate a RSS feed in my site. The RSS feed is a podcast. There's also an open dir which i could use.

I use Feedapi & Views to show the feed. The feed is only showing the link to the MP3, not a Mp3-field. I tried several players and methods, but none of them worked.

1) How can i convert in Views a link to a MP3 field to a player?
2) which modules do i need definitely?
3) what is the shortest way (with not too many modules) to accomplish this?

Hopefully, someone here with some experience (and maybe an up&running site) can help me

Interfacing an external db during ingestion?

Posted by pixelantegroup on January 19, 2009 at 7:13pm

Just wanted to get some advice on a content aggregation project I'm working on.

I'll be sucking content from multiple XML feeds (Atom and custom XML feeds). I'm going to use either FeedAPI or SimpleFeed. I haven't decided that yet, but I'm sure either will work just fine for the basic requirements. I'm using Drupal 6.x.

Can someone post a walk-thru for creating a Feed API processor for scrapped content?

Posted by bflora on January 5, 2009 at 1:07pm

Hi there,

I'm using Feed Api to aggregate a few blogs and want to grab the photos that accompany the posts as well.

I've taught myself the PHP to get the files, parse them and return the image URLs and have it all themed and looking nice.

But I need to store this data with the feed items at the time of "capture" rather than calling it everytime I reload the page and hotlinking the images. Not cool.

Feed API appears to have hooks that will let me create a processor that can add specific scraping functions like this to specific feeds.

Displaying Video with RSS feeds

Posted by sdudenhofer on December 30, 2008 at 9:42pm

Sorry if this has already been discussed.

I have a website that would like to display RSS feeds, but the feeds are actually audio and video. I would like to aggregate the data and display the video, so a user would come to the site and see all the video's or audio and be able to just start the video or audio.

Subscribe with RSS