Feed Scraper 2: ideas and future development
Posted by ademarco on September 24, 2009 at 8:05am
After a good talk with alex_b at DrupalCon in Paris about Feed Scraper I've got to share some ideas about how the next version of the module could look like.
Here the main ones:
- Pipes: in Feed Element Mapper you can set a list of parsers for each feed content type. Sometimes, having a unique sequence of parsers for the entire XML feed is not enough to catch all the information a feed carries on. It would be handy to be able to have a specialized sequence of parsers (a "pipe") for each CCK field you want to map the result to. In this respect projects like QueryPath could nicely suit: quoting its "About the Name" section "The path part is intended to convey the chain-like "path" that one creates through". On Feed Scraper module page an issue has already been raised about how to transform a list of words in taxonomy terms (http://drupal.org/node/571358), here a pipe system could really help: after getting the list of comma-separated words, using the RegEx Parser, you would apply a String Explosion Parser to get the final array-like result, for example.
