Drupal.org Testing Infrastructure

This project is intended as a collection and organization point for the 'Modernizing Testbot' project, an unofficial Drupal community initiative with the goal of improving the Drupal.org automated testing environment. This is being accomplished through the design and implementation of a new automated testing / job dispatch infrastructure to replace the existing PIFT/PIFR module combination currently being used; increasing both the flexibility and functionality of the current environment in an attempt to bring it up to speed with other modern continuous integration platforms and better meet the evolved testing needs of the Drupal community.

hestenet's picture

Modernizing TestBot Initiative meeting #14 2015 - North America Friendly Time

Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

This meeting may be the last North America friendly timezone meeting before DrupalCon Los Angeles

To Know more about the testbot initiative check out the documentation.

hestenet's picture

Modernizing TestBot Initiative meeting #12 2015 - North America Friendly Time

Start: 
2015-04-15 02:30 - 03:30 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please watch out we will be coming with more Europe friendly time slots shortly.

To Know more about the testbot initiative check out the documentation.

Shyamala's picture

TestBot sprint in Portland

Start: 
2015-03-31 (All day) - 2015-04-02 (All day) UTC
Organizers: 

Jeremy Thorson, Nick Schuch, Ricardo Amaro, Bastian Widmer, Rudy Grigar, Archie Brentano, Neil Drumm, Michael Prasuhn, Jonathan Hedstrom, Ryan Aslett, Tim Lehnen, Chx & Angie Byron (remote) are connect at Portland, Oregon for a D8 Accelerate-funded sprint on DrupalCI: Modernizing Testbot Initiative!

Read more
webchick's picture

Plan for upcoming D8 Accelerate sprint on DrupalCI (Modernizing Testbot Initiative)

Next week, an international conglomeration of awesome folks will convene in Portland, Oregon for a D8 Accelerate-funded sprint on DrupalCI: Modernizing Testbot Initiative.

The main aim of DrupalCI is to rebuild Drupal's current testbot infrastructure (which is currently powered by an aging Drupal 6 site) to industry-standard components such as Jenkins, Docker, and so on, architected to be generally useful outside of Drupal.org. See Nick Schuch's Architecting DrupalCI at DrupalCon Amsterdam blog post for more details.

The goal is to end the sprint with an "MVP" product on production hardware, with integration to Drupal.org, which can be used to demonstrate a full end-to-end D8 core ‘simpletest’ test run request from Drupal.org through to results appearing on the results server.

You can read and subscribe to the sprint hit-list issue to get an idea of who's going to be working on what, and the places where you too can jump in (see the much longer version for more details).

This is a particularly important initiative to help with, since it not only unblocks Drupal 8 from shipping, it also makes available awesome new testing tools for all Drupal.org projects!

Go Team! :)

hestenet's picture

Modernizing TestBot Initiative meeting #11 2015 - North America Friendly Time

Start: 
2015-03-17 02:30 - 03:30 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please watch out we will be coming with more Europe friendly time slots shortly.

To Know more about the testbot initiative check out this blog post.

Shyamala's picture

Modernizing TestBot Initiative meeting #10 2015 - Europe Friendly times!

Start: 
2015-03-11 09:30 - 10:00 UTC
Organizers: 

Here we are with Europe Friendly Times for the TestBot Initiative Public Meetings!

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please note the meetings on alternate weeks at US Friendly Times.

Read more
Shyamala's picture

Modernizing TestBot Initiative meeting #9 2015

Start: 
2015-03-04 02:30 - 03:00 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please watch out we will be coming with more Europe friendly time slots shortly.

To Know more about the testbot initiative check out Wednesday,March 4th, 2015: 2:30AM UTC

Read more
hestenet's picture

Modernizing TestBot Initiative meeting #8 2015

Start: 
2015-02-25 02:30 - 03:30 UTC

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please watch out we will be coming with more Europe friendly time slots shortly.

To Know more about the testbot initiative check out this blog post.

Read more
Shyamala's picture

Modernizing TestBot Initiative meeting #7 2015

Start: 
2015-02-18 02:30 - 03:00 UTC

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

For those of you who can't, please watch out we will be coming with more Europe friendly timesolts shortly.

To Know more about the testbot initiative checkout: https://www.previousnext.com.au/blog/architecting-drupalci-drupalcon-ams...

Read more
Shyamala's picture

Modernizing TestBot Initiative meeting #6 2015

Start: 
2015-02-11 02:30 - 03:30 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

To Know more about the testbot initiative checkout: https://www.previousnext.com.au/blog/architecting-drupalci-drupalcon-ams...

The meeting will be held as a Google+ Hangout (online video) at: https://plus.google.com/hangouts/_/calendar/cmFqYXJhbS5zaHlhbWFsYUBnbWFp...

Wednesday, Feb 11th, 2015: 2:30AM UTC

Read more
Shyamala's picture

Modernizing TestBot Initiative meeting #5 Jan 2015

Start: 
2015-02-04 02:30 - 03:00 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

To Know more about the testbot initiative checkout: https://www.previousnext.com.au/blog/architecting-drupalci-drupalcon-ams...

The meeting will be held as a Google+ Hangout (online video) at: https://plus.google.com/hangouts/_/calendar/cmFqYXJhbS5zaHlhbWFsYUBnbWFp...

Wednesday, Feb 4th, 2015: 2:30AM UTC

Read more
Shyamala's picture

Modernizing TestBot Initiative meeting #4 Jan 2015

Start: 
2015-01-28 02:30 - 03:00 UTC
Organizers: 

The Testbot team is conducting public meetings. Want to join & help them, need support or just talk to the team, join the meetings! Come and share what you did last week & the plan for the weeks ahead.

To Know more about the testbot initiative checkout: https://www.previousnext.com.au/blog/architecting-drupalci-drupalcon-ams...

The meeting will be held as a Google+ Hangout (online video) at: https://plus.google.com/hangouts/_/calendar/cmFqYXJhbS5zaHlhbWFsYUBnbWFp...

Wednesday, Jan 28th, 2015: 2:30AM UTC

Read more

Documentation for DrupalCI APIs - [Draft]

This is a work in progress, please feel free to add or modify.

Overview of DrupalCI API Project

This sub-project provides an API layer between Drupal.org and the DrupalCI dispatcher, allowing the modular substitution of backend components without requiring code changes within the Drupal.org integration module.
Link to Project: https://www.drupal.org/project/drupalci_api
Link to the issue queue: https://www.drupal.org/node/2373627

APIs

  • jobRun: Runs a Jenkins Job, to be called by the DrupalCI module to automate the job run
Read more
nick_schuch's picture

DrupalCI results component

One component which had not received much attention until the DrupalCon Amsterdam sprints is the results server. This is responsible for archiving and exposing test results and build artefacts for all DrupalCI jobs. Im happy to announce that this component is now implemented as a minimal viable product (MVP). So what does MVP mean? It means we now need to have a serious discussion about how the project should progress from here.

Here is a demo on the component in action!

https://www.youtube.com/watch?v=QYj7_bDnKj4

Read more
nick_schuch's picture

DrupalCI weekly meeting #3

Outcomes

  • Results CLI generating a "Summary" string based on Junit and Drupal XML artefacts.
  • Lots of work done on documenting infrastructure and how to access environments.
  • We can now trigger a build through the API, this results in a new testbot and build.
  • Currently looking at moving the weekly meeting to a more desirable time. Please contact Jeremy, Ricardo or myself if you wish to join.
Read more
nick_schuch's picture

DrupalCI weekly meeting #3

Outcomes

  • Results CLI generating a "Summary" string based on Junit and Drupal XML artefacts.
  • Lots of work done on documenting infrastructure and how to access environments.
  • We can now trigger a build through the API, this results in a new testbot and build.
  • Currently looking at moving the weekly meeting to a more desirable time. Please contact Jeremy, Ricardo or myself if you wish to join.

Goals

Nick Schuch:
* Finish of Symfony console application for results site interaction.

Read more
jthorson's picture

DrupalCI: Drupal.org Integration - Status and To-Do's

A brief outline of the current status and To-Do's for this DrupalCI component can be found within the Google Document link below:

https://docs.google.com/document/d/1QM7AIW6Qjh413mecCgEv55QEbMA-ryf5HGiP...

Summarized version: We have a simple form which will allows us to trigger Jenkins jobs, but still need to build out the automated triggering, configuration pages, on-demand job triggering capabilities, and all of the associated User Interface designs for deployment on drupal.org.

Read more
nick_schuch's picture

DrupalCI weekly meeting #2

Notes

  • Results installation profile is finished and ready for a review.
  • Consider installing a clone of this Results site to act as a "Github GIST" style site eg. Push my artefacts (logs db etc) and share with others for 24 hours. This is long term though.
Read more
nick_schuch's picture

DrupalCI weekly meeting #1

Overview

DrupalCI will start posting weekly updates to keep the community informed on the progress of the initiative. This is the first, welcome!

The most notable items from this weeks meeting are:

  • Jeremy has an initial implementation of the "Simpletest" build step in the Job Runner.
  • Nick has some mockups for a minimal viable product of the Results site.

Attendees

  • Nick Schuch (nick_schuch)
  • Jeremy Thorson (jthorson)
Read more
jthorson's picture

Modernizing Testbot: Next Steps & (bi?)weekly calls.

Hey all!

First of all, I'd like to extend a great big thank-you to everyone who chipped in to work on the Modernizing Testbot initiative during the DrupalCon Austin sprints, both locally and via remote!

Read more
Subscribe with RSS Syndicate content