There are various ways of integration Pentaho with drupal, couple of thoughts:
1. Integrating the Publishing part, i.e.using Drupal just as web client.
2) Integrating the data source with Drupal as drupal content and using the same for reporting.
3) Integrating the Pentaho engine as an internal part of Drupal with flexibility to store the data as content types and internal publishing.
Personally I happen to be doing a system with a Drupal front end and a Hadoop/Pig back end plus some custom code for fetching the large amounts of data.
I then thought - why not use the Pentaho system since it can use Hadoop.
For me I want Pentaho to create data/reports/diagrams/whatever which can be fed to Drupal as content.
Posted by Alex Komm on February 21, 2011 at 4:10pm
I don't have experience in integration and work with any BI but I'll be glad if you let me to help with your project.
I have a drupal development experience and good general web development skills
I am currently working on a project utilizing Pentaho as a reporting front-end for my Drupal instance DB. I have a few years of experience with Pentaho and would def. love to contribute here if possible. Wish I was going to DrupalCon this year.
I'm interested in using Pentaho Kettle and potentially Hadoop for medium scale data migration / merging - eg 3 - 4 million contact records per merge. I expect to create a variety of transformations from various data sources for this. It seems to have much greater functionality and a much better UI than the Migrate module in D7, but, well, I haven't used either so it's hard to know.
(The main data store will be in CiviCRM, but we're also looking to expose all CiviCRM data through D7 entities to benefit from Drupal's goodness. CRUD operations would call back into the business logic layer in CiviCRM.)
I am considering whether Pentaho's reporting facilities might be nice to add to CiviCRM's and Views'.
I've just installed Pentaho Kettle on my Mac. Would be nice if those more familiar with Drupal, particular D7, could throw out their ideas on architecture / approaches.
I am trying to do integration between pentaho and drupal, where drupal will encapsulate pentaho application by calling pentaho solution url (dashboard) from drupal. I start testing with pasting pentaho url solution in the browser and it is ok.
But when I access this url from drupal, there is an error message : object type cccBarChart can't be mapped to a valid class, and the dashboard is not shown.
When I look at firebug-> dom, it seems that all *ChartComponent are not listed in DOM.
And I see an offending line in js (line 462):
try{xhr.send(noContent||s.data==null?null:s.data);}catch(sendError){jQuery.handleError(s,xhr,null,sendError);jQuery.handleComplete(s,xhr,status,data);}
Has anyone had the same issue ?
How can I fix this problem ? Thanks
I use CDF bundle 1 GA and pentaho BI Server ce 4.0
Posted by brunoslessa on November 22, 2011 at 12:06pm
Hi,
I work with Pentaho and Drupal in different projects. But I am in a own project that integrate python (ETL + TextMining) and Drupal. In this case, Drupal is the front-end of python scripts. Variables and parameters are set in drupal, the python capture data from Internet using these parameters and transform it in contents for drupal.
I think you can use Pentaho and Drupal in the same case. Drupal is the front-end for the business users, where it change some parameter without the need to change the Pentaho ETL scripts. He doesn't need to have pentaho tools on his machine, he needs just go to drupal.
You can either use drupal do call the reports, OLAP and dashboard that are in a Pentaho Servers, but you will need two servers, one to java and other to php (is it possible have both in same server? I don't know).
I think that one day, who knows, drupal could read a pentaho report file - that is XML like - and mount your own report. A Pentaho report file have, basicaly, definitions of data access and how to create a visualization of that data.
Comments
Ideas worth sharing
Hello All,
There are various ways of integration Pentaho with drupal, couple of thoughts:
1. Integrating the Publishing part, i.e.using Drupal just as web client.
2) Integrating the data source with Drupal as drupal content and using the same for reporting.
3) Integrating the Pentaho engine as an internal part of Drupal with flexibility to store the data as content types and internal publishing.
More thoughts..?
Rachit Gupta
Blisstering Solutions
http://www.blisstering.com
Rachit Gupta
www.blisstering.com
Personally I happen to be
Personally I happen to be doing a system with a Drupal front end and a Hadoop/Pig back end plus some custom code for fetching the large amounts of data.
I then thought - why not use the Pentaho system since it can use Hadoop.
For me I want Pentaho to create data/reports/diagrams/whatever which can be fed to Drupal as content.
Want to contribute
I don't have experience in integration and work with any BI but I'll be glad if you let me to help with your project.
I have a drupal development experience and good general web development skills
Drupalcon Chicago BoF
Anyone up for a BoF at Drupalcon Chicago?
There is some discussion here http://groups.drupal.org/node/13704#comment-425734
Ray
Pentaho Integration
I am currently working on a project utilizing Pentaho as a reporting front-end for my Drupal instance DB. I have a few years of experience with Pentaho and would def. love to contribute here if possible. Wish I was going to DrupalCon this year.
cheers,
Graham
Using Kettle for ETL
I'm interested in using Pentaho Kettle and potentially Hadoop for medium scale data migration / merging - eg 3 - 4 million contact records per merge. I expect to create a variety of transformations from various data sources for this. It seems to have much greater functionality and a much better UI than the Migrate module in D7, but, well, I haven't used either so it's hard to know.
(The main data store will be in CiviCRM, but we're also looking to expose all CiviCRM data through D7 entities to benefit from Drupal's goodness. CRUD operations would call back into the business logic layer in CiviCRM.)
I am considering whether Pentaho's reporting facilities might be nice to add to CiviCRM's and Views'.
I've just installed Pentaho Kettle on my Mac. Would be nice if those more familiar with Drupal, particular D7, could throw out their ideas on architecture / approaches.
Joe Murray
How did you get on with this?
How did you get on with this? I've been looking at combining Drupal with a Hadoop backend for processing, and possibly using Pentaho.
Using drupal to show dashboard content
I am trying to do integration between pentaho and drupal, where drupal will encapsulate pentaho application by calling pentaho solution url (dashboard) from drupal. I start testing with pasting pentaho url solution in the browser and it is ok.
But when I access this url from drupal, there is an error message : object type cccBarChart can't be mapped to a valid class, and the dashboard is not shown.
When I look at firebug-> dom, it seems that all *ChartComponent are not listed in DOM.
And I see an offending line in js (line 462):
try{xhr.send(noContent||s.data==null?null:s.data);}catch(sendError){jQuery.handleError(s,xhr,null,sendError);jQuery.handleComplete(s,xhr,status,data);}
Has anyone had the same issue ?
How can I fix this problem ? Thanks
I use CDF bundle 1 GA and pentaho BI Server ce 4.0
Pentaho Integration with Drupal
how to integrate pentaho with drupal..
any suggestions?
Front-end
Hi,
I work with Pentaho and Drupal in different projects. But I am in a own project that integrate python (ETL + TextMining) and Drupal. In this case, Drupal is the front-end of python scripts. Variables and parameters are set in drupal, the python capture data from Internet using these parameters and transform it in contents for drupal.
I think you can use Pentaho and Drupal in the same case. Drupal is the front-end for the business users, where it change some parameter without the need to change the Pentaho ETL scripts. He doesn't need to have pentaho tools on his machine, he needs just go to drupal.
You can either use drupal do call the reports, OLAP and dashboard that are in a Pentaho Servers, but you will need two servers, one to java and other to php (is it possible have both in same server? I don't know).
I think that one day, who knows, drupal could read a pentaho report file - that is XML like - and mount your own report. A Pentaho report file have, basicaly, definitions of data access and how to create a visualization of that data.
Bruno Lessa
plugin?
I look at your answer from the question before.
Did drupal need the plugin pentaho for the integration?