As I write this, I’m on a plane back to the US after a whirlwind 10 days in Amsterdam for DrupalCon Amsterdam 2014. As always it is so gratifying to meet and work with the international Drupal community. I love getting to take a look at what everyone is working on and collaborate with people that you might otherwise only know as IRC nicks. Here are my highlights of DrupalCon Amsterdam:
Sprints and Drupal.org Logging
I volunteer my time to help the drupal.org infrastructure team with their logging infrastructure. I was very happy to be able to sprint for 3 days, mainly on drupal.org infrastructure. On Sunday, Friday, and Saturday, I worked with the Drupal.org Puppet configuration to get a new CentOS 6-based log aggregation host ready to go running the latest versions of the ELK (ElasticSearch, Logstash, and Kibana) stack. The new Logstash configuration that we’ll be rolling out is much simpler. Stay tuned to the blog for information on some of the improvements we made in the process. We hope to deploy the new logging host within the week.
DevOps Meetup
Tuesday evening, I attended the DevOps Amsterdam meetup. The meetup was sponsored by ElasticSearch, who bought a delicious dinner for all attendees as well as some drinks. During dinner, I sat with some folks from Germany and had a chance to speak with a number of ops-attuned folks about Docker and the possible use cases for it.
The meetup had some great content. There was a talk on how GitLab uses omnibus to package GitLab with far less hassle, a talk from fellow d.o infra team volunteer Ricardo Amaro on building the next-gen Drupal testbot on Docker, and a great talk from the DrupalCon Amsterdam DevOps chair Bastian Widmer on developing culture and sharing knowledge in an agency.
LSD Leadership Meeting
Earlier this year, Phase2 contributed some of its innovation hours to the LSD project and worked with Acquia to present a webinar on Behat and release a pre-built virtual machine designed to make it easy to start doing automated testing using Behat. During the LSD leadership meeting I joined Melissa Anderson of Tag1 Consulting and Hugh Fidgens of Pfizer in a breakout session discussing Behat. Quite a few organizations present were very interested in how they could use Behat to enable a behavior-driven development workflow with their developers, or to develop a good set of automated tests that could be run either as smoke tests or as end-to-end integration tests.
Behat Everywhere
In addition to the LSD leadership meeting, automated testing and BDD were topics on everyone’s minds throughout DrupalCon.
I attended 2 BoF about automated testing or Behat, the Testing Drupal 8 BoF, and Hugh Fidgen’s Organizational Behat BoF. These talked about how we could better leverage automated testing tools in Drupal core and in client work we build today, respectively. Many people have had some success in getting automated tests or a BDD workflow started, but there was a lot of talk about writing good sustainable tests and how to integrate these tools into your workflow.
Speaking of writing sustainable tests, my favorite session of the conference was definitely the session by Konstantin Kudryashov (the creator of Behat and Mink) on how to do BDD with Behat. The session was remarkable and left an impact on many folks who went there. It really emphasized the point that BDD must be about identifying and delivering business value in our projects, and that doing that is the way to write good tests. It is definitely worth an hour of your time to watch.
As testing best practices are refined in the Drupal community as well as in Phase2, I’m very excited that the talented Jonathan Hedstrom has joined the Phase2 team. Jonathan is a maintainer of the Behat DrupalExtension, and is sure to help us further refine our testing practices as Phase2. Jonathan has been doing work recently on upgrading the DrupalExtension to support Behat 3 and has plans to generalize the drivers that the Behat DrupalExtensions provides so that it could be used with Mink for writing tests in straight PHP without needing to use Behat.
My “Open Source Logging and Monitoring Tools” Session
On Wednesday I presented my session “Using Open Source Logging and Monitoring Tools.” I covered a lot of information in my session including using Logstash, ElasticSearch, and Kibana. Thanks to the tireless work of the DrupalCon A/C crew, the video recording of my session is online, and the slides are available on SlideShare if you would like to follow along. The session had an excellent turnout, and there were some great questions and discussions following my session. I was quite pleased at the large turnout, and so was @KrisBuytaert, who been bringing information about DevOps-related topics to DrupalCons for years.
I need to rephrase my state of #devops and #drupal conclusion, 2 years ago in Munich there were 10 people in this talk ..(1/2)
— Kris Buytaert (@KrisBuytaert) October 1, 2014
Back then by @samkottler , this year @stevenmerrill ‘s talk is packed , we are winning this ! #logstash, #drupalcon #elasticsearch
— Kris Buytaert (@KrisBuytaert) October 1, 2014
We were also fortunate to have Leslie Hawthorne of ElasticSearch in the audience. She gave out ElasticSearch ELKs to sprinters at the Friday event.
Packed house for @stevenmerrill in #DrupalCon #DevOps track. About to learn how the d.o infra team uses #elkstack pic.twitter.com/MThDhkA48E
— Leslie Hawthorn (@lhawthorn) October 1, 2014
Takeaways
Based on the sheer number of people interested and sessions to devoted to both topics, it is clear that there is a growing interest in both logging and metrics and automated testing or BDD in the Drupal Community. This is also the 11th DrupalCon I’ve been to, and this year’s keynotes were the best I could remember. I really enjoyed Dries’s ideation around sustainable methods for getting contributions to Drupal core and contrib, and getting to see Cory Doctorow speak live about the perils of DRM and restrictions software freedoms was also excellent.
This is an exciting time for Drupal. Drupal 8 beta 1 is live. The community is active and engaged around making Drupal better, both by contributing to Drupal 8 and by doing a better job testing projects built on it. The DA and an army of volunteers have made huge strides on improving the infrastructure around core testing as well as around all the online communities under drupal.org.