Learning from the other side: Thoughts on conferences, workshops, learning and test ideas

NB: This blog post is adapted from one I wrote for an internal blog post at work, so it has been sanitised for content.

When learning new things, ideas, skills or exploring new perspectives, the image above reflects how I am feeling when I am trying to assimilate and process all the activities I take part in within the testing community. It’s that beautiful and terrifying moment when you are flying and the sun is ablaze on the horizon. It’s knowing you’ve learned a lot, but there is so much left to learn. Perhaps a move one way or another will lead to failure, but as long as you are quick to learn from those mistakes you can be on a well-lit path again.

Over the last month or so I’ve been attending a few events, including ITAKE Unconference in Bucharest, Romania, Let’s Test in Stockholm, Sweden and Nordic Testing Days in Tallinn, Estonia. Each of these events offered something new and different for myself as a contributor to those events. However, it is the other aspects of what they provide that are important.

ITAKE Unconference

ITAKE Unconference was my first time giving a Keynote talk at a conference. This was a huge honour not just to be asked to give a talk, but also the fact that it wasn’t a testing conference. ITAKE is a developer conference. Every attendee is highly technical, lives and breathes the code they write and the tools they use. It made me realise that whilst I have spent a lot of time learning about security, there is so much else to learn. Especially about how developers learn and work, and how applications are crafted.

I spent hours talking about how to build good environments for testing using tools like Docker and Heroku, or exploring how developers think about testing. A lot of it is about unit testing, some of it is about automation. But there are a lot of developers who understand the value of good testing and want to work with testers to make it happen. There is a lot we can do better to support them in this endeavour. These are things we should be doing at Medidata…testing cannot happen or exist in a vacuum.

Yes, there were those that think the role of testing or testers is now defunct, where a technical person can achieve all things they need to on a project. It was interesting to be able to discuss and challenge some of that thinking, where a tester can be a specialist or advocate for testing on their project; rather than someone who executes tests, gathers test results and creates endless meaningless reports. I’m not saying reporting is bad, just the doing the wrong reporting is bad, and unhelpful. It doesn’t add value, nor does it explain to those who don’t test what the value of the testing is.

ITAKE is a hotbed of software craftspeople. People who want to build and develop great software for their customers and clients. The best talk I went to while I was there was one of the other keynotes. Felienne Hermans, of the Netherlands, gave a talk called:

What is science? On craftsmanship for children

This reflected on her approaches to teaching coding to children. Children learn predominately through play, exploring their environment, and asking questions. It’s something that adults have largely forgotten how to do, or if we haven’t has become more formalised. We’ve turned play and learning into work instead. We can make our learning far more creative through events such as hackathons. We should review, model and landscape our applications inside the environment we are working in. Children do this far more naturally than (some) adults.

felliene1

 

She also talks about introducing children to the scientific method, how we observe behaviour, theorise about why the behaviour occurs and make a hypothesis, and then on to experiment in order to prove/disprove that hypothesis. This can be applied to coding as much as any branch of science or other learning.

smelly code

Let’s Test Sweden

This was a bittersweet event for me. This was my third visit to Let’s Test in as many years, but sadly it will be the last ever Let’s Test in Sweden. The organisers have decided to call it a day. This edition of Let’s Test had a distinctly technical focus, with each session being a three-hour workshop, held over two days.

I ran a workshop called Web Application Security, a Hands On Testing Challenge. We have Security Awareness Training in-house, which covers many of the techniques and tools of security testing, so this follows a similar path. Given the time and space in the office, we should be able to make this learning much more hands on. I try and provide a safe space for the attendees to find problems and ask questions about the application under test so that they can also talk with confidence about security in their own environments.

I attended a number of other workshops, including Alan Richardson’s Evil Tester’s Testing Games of Evil Testing. In this workshop, Alan introduced us to how we can use simple tools such as the browser developer tools to interact with simple JavaScript, API clients and HTTP requests to give us a competitive advantage in debugging web based games.

Whilst the topic might sound trivial, the application and usage of these tools are crucial for testing and debugging modern web applications. Browser based development tools will allow us to do so many useful things:

  • Viewing the source, both HTML and JavaScript
  • Debugging JavaScript, via the Console
  • Tampering HTTP requests
  • Testing REST services from the browser
  • Custom headers
  • Throttling application performance
  • Emulating other browsers, devices and screen resolutions

During the workshop, we played the games to understand them and their gameplay. We found bugs and fixed them, we wrote code and created cheats to make it easier to win, get massively high scores or infinite lives.

One of the other workshops I attended was Aare Nurm’s Pedal to the Metal. Aare hails from Estonia. His workshop was a fantastic, practical exploration of how software and hardware combine to make products, solving problems and exploring how stakeholder demands can cause issues and constraints with your testing, and how your testing value is perceived and acted upon.

We were given the exercise to test a keyfob for a new kind of car that was coming on the market. We didn’t have access to the vehicle, but only to a prototype to the keyfob. We needed to utilise all our testing savvy to come up with test ideas, find problems, analyse logs and even fix the issues ourselves.

arduino

Essentially the keyfob was a Raspberry Pi Zero, with a pin board and wires which could be configured to give different settings. We also had a set of LED’s which would flash according to the function the keyfob was supposed to be executing, including:

  • Unlock the car
  • Lock the car
  • Remote closing the windows
  • Activating the headlights
  • Remote boot/trunk opening
  • Start the engine

We initially observed the behaviour of the keyfob in order to determine it’s function. We were given minimal, but rapidly changing requirements not only for the product but also the business. Essentially if the car failed in the market, the company would go out of business. Hardware and software are so entwined, that even if the product is solid, well made and easy to use if the underlying software architecture is poorly implemented, this can result in a poor customer experience.

Here with my workshop partner Phil, you can observe our testing and learning. This was honestly one of the best learning experiences of my life. Check out the videos here:

Nordic Testing Days

I’ve run testing events before, such as South West Test in Bristol, and SWEWT (South West Exploratory Workshop in Testing). Never before have I helped to run a conference. Nordic Testing Days 2017 was my first adventure in being a conference organiser. It’s hard work, let me tell you.

nordic1

I’ve been lucky enough to speak at every Nordic Testing Days since 2014, on both using emotional heuristics in our testing, and security testing. Last year I decided not to submit again, to allow new voices to be heard. However, the organisers asked me if I wanted to be a part of the team for 2017. This responsibility came with all sorts of challenges, including organising the venue, social events, curating and selecting the content from the call for papers, interviewing the prospective speakers, organising and facilitating tutorials and talks, as well as solving logistical problems and finding replacement speakers for those that couldn’t make it.

chris1 grete1 fiona1
Christopher Chant

Friend and Volunteer

Grete Napits Marketing Manager/Chairperson Fiona Charles Keynote Speaker and Tutorial presenter

I had the pleasure of facilitating Fiona Charle’s tutorial The Art & Science of Test Heuristics. In this session, we were tasked with coming up with test ideas for two different scenarios, interspersed with both group activities and discussion in the round.

The first activity was to generate test ideas for a number of different puzzle games, such as SmartGames IQ Steps and IQ Fit. The task was to not only solve the puzzles but also identify and utilise heuristics for solving the problems that the puzzles posed. Many questions needed to be asked, including how many ways could we solve the puzzle, what problems or issues did we identify when solving the problem, what oracles can we use when solving the problems? It was no easy task, and one of the teams gave a massive cheer when they eventually solved their puzzle.

fiona2

The second activity was to generate test ideas from this video:

How many test ideas can you come up with to test the Oh Canada Beer Fridge? The main takeaway from this workshop for me was looking at heuristics as a tool to generate great testing ideas. It’s a complex problem, with no one size fits all solution. Test ideas are our life blood, by being the fuel for our learning and our ability to do our work.

 

Journeys – in time and space

We’re all on a continuum. Life will take you in all sorts of strange directions, be it professionally or personally. These are some reflections on some of the goings on I have experienced recently.

Goodbyeee

blackadder

Going over the top… Blackadder: Goodbyeee Copyright BBC (1989)

Up till the end of September, I had been working at NewVoiceMedia for nearly three years, initially as a contractor, and then latterly as a permanent member of the development team.

It was an incredible time. The opportunities that working at NVM afforded me were huge. Learning new skills, particularly in security testing, and working within strong, fast paced, agile (Agile) teams.

I thank everyone that I worked with at that time, especially Rob Lambert for giving me that chance, and enabling great testing and work in general.

I want to be a part of it…

New York. My first visit to this incredible city afforded me many great opportunities for learning, as much about being a citizen of the world (which Theresa May insists that I am not), than it was about anything else. Whilst the traffic, noise and hubbub are all consuming and sometimes overwhelming, especially in Manhattan, there is a sense of energy that I have felt that is unlike any other city.

I was there for Test Masters Academy, which was organised by Anna Royzman. Whilst I have presented workshops and talks on the subject of security testing before, this was my first time presenting in the United States. Also, this was the first time presenting using a tool that I had helped to build myself.

I came to a conclusion earlier in the year, following European Testing Conference in Bucharest. I needed to step up my game. The best workshops I had been to had been well planned, with great resources and learning opportunities. The course teacher had often created or supplied applications for the attendees to explore and test. I needed to do the same.

At ETC I met Franziska Sauerwien, of Codurance, who put me in touch with the Software Craftsmanship Slack group. There I paired up with Java developer David Hatanian, also of Codurance. Together, we created Ticket Magpie, a vulnerable web application written in Java. (More on Ticket Magpie in a future blog post)

ticketmagpie-the-place-to-get-all-the-tickets

Ticket Magpie

 

During the workshop, a few technical issues were to be had regarding deployment and hosting of the application on the attendees laptops. I wasn’t to be deterred, and adapted using a couple of publicly available web based vulnerable applications.

However, I quickly found that basing the content solely upon a list of well known application vulnerabilities was a mistake. It’s more important to understand the concepts of security testing rather than the vulnerabilities, without a framework in which to understand them, and the skills to explore them. This realisation was further clear to me after discussing them with Maaret Pyhäjärvi, and having a post mortem discussion with Jess Ingrassellino at the conference.

Future workshops will be supported by Ticket Magpie being deployable via a stable Docker Hub image, rather than relying on Virtual Box images, or attendees setting up the system themselves. Also there will be more of a focus on the techniques and skills of security testing, rather than just vulnerabilities.

New Pastures

This is now the beginning of my second week at Medidata. This is a new way forward for me in a number of ways. It’s my first time working in the medical and life sciences sector. Medidata build cloud platforms for their clients to manage clinical trials on new drugs and treatments. There is a lot of new domain knowledge to learn, people to meet and company culture to become a part of. It’s exciting.

Next, and this is often the tricky part…adapting to a new role. I have come from a role where I focussed predominantly on the security testing needs of the business. The objectives were to support the team with my security knowledge, plan and execute penetration testing against our services, as well as provide coaching and mentoring to my peers on the topic.

My new role has somewhat a broader remit. It’s not focussed solely on security for a start, which means I’ll get to re-explore other aspects of the testing craft. This is exciting to me. I’ll be working at a more strategic level, supporting the testers, test managers, senior management and other team members across the entire business, globally. They’ll be opportunities for training, coaching and mentoring too! I can’t wait to get my teeth stuck in to it!

Another great aspect of this, is my new commute. Now, I could complain about the cost of the British rail network. It’s one of the oldest in the world, but it does run, and usually gets me to London on time. My commute is usually between 90-120 mins each way, which affords me a great deal of time for reading, learning, and maybe catch up on some work. (Sure, I’ll probably sneak in an episode or two of my favourite TV show, or have a nap if I need one).

Time is a great resource. We shouldn’t waste it. If I’m going to spend up to four hours a day in a tin can, I’m not going to squander it.

Distance Learning

Hey testers. It’s been a while since I have blogged last. This has mostly been because of such a massive workload, but also various personal events taking place. I normally blog when either I feel that I have something to share, or if I have a reaction to something I have learned – such as on this occasion.

CAST2015 – The Conference of the Association for Software Testing  is running as I type this, from Grand Rapids, Michigan, USA. This is the first year I have been able to monitor the live stream. This is a fantastic service, offered to allow folks who aren’t attending to listen, watch and take part (via Twitter).

I want to reflect first on yesterday’s opening keynote speech by Karen Johnson entitled “Moving Testing Forward”. This was a very personal exploration of her career, learning and life; much of which resonated with me.

This is something I have sometimes had issues with in the past, and sometimes with great detrimental effects. Without going into too much detail, I’ve been places where I have been unable to establish good working relationships, or had personal problems intrude on my working life and vice versa.

The work/life balance has always been a hard road to travel. Family, friends and other personal commitments should take priority. Whilst I was building my career often that wasn’t the case, and my personal life suffered.

I also made possibly poor choices, but yet choices that have ultimately gotten me to where I am now – a great role, testing, learning, working with great people at an exciting business. A business that does it’s best to support its employees when they have personal issues and gives them breathing space and learning opportunities to be able to craft and shape their own careers. I am very lucky.

Secondly, I’d like to reflect on the keynote from the second day by Ajay Balamurugadas, entitled “The Future of Testing”. I haven’t met Ajay yet, but I feel that I know him through his work.

As a facilitator at Weekend Testing Europe we are part of his vision to provide great learning opportunities for the entire testing community. This tweet from Maria Kedemo sums up this attitude succintly.

A long time ago I did not feel empowered at all to learn for myself. I felt that all my learning needed to come from my employer, be paid for by my employer, if they were ultimately to benefit from it. Employers invariably are businesses with their own priorities and concerns – not necessarily with the personal learning and welfare of their employees.

As Ajay said, not being able to afford to go to conferences or attend courses should never be a blocker to learning. We have blogs, books, free webinars, meetups and tester gatherings, brown bags, Skype sessions on Weekend Testing, and any number of other roads to learning.

I had an epiphany on this several years ago. I was never going to get to where I wanted to be – be a home owner, clear my student debt, start a family If I didn’t take control of that learning. So I read blogs, I joined the Software Testing Club, I started looking at the work of other testers I had heard about, I even started implementing some of their approaches and techniques. All great learning.

But to take that further and on to the next stage, I had to get away from companies that didn’t support that approach to learning. I decided to go freelance, and this I have done for about 4 years or so. Now being at New Voice Media has allowed me to expand that learning into avenues that I hadn’t thought possible, exposing me to thinking and choices that may take me away from testing to focus on security, as I do at the moment.

Thanks to the organisers of CAST and making it available to all.

From Tallinn, With Love – Looking back on Nordic Testing Days 2015

It’s been a week since I have returned from Tallinn and the Nordic Testing Days conference, which has again been brilliantly organised and executed by Grete Napits and her wonderful team in Estonia. Helena Jeret-Mäe led the curation of this years content alongside her colleagues, and without doubt the organising team had certainly raised the bar again.

Santosh Tuppad, Rob Sabourin and Helena Jeret-Mäe out in the Old town of Tallinn

Santosh Tuppad, Rob Sabourin and Helena Jeret-Mäe out in the Old town of Tallinn

There were speakers from almost all corners of the testing globe, from Canada, UK, Australia, New Zealand, India and of course Estonia. A fantastic achievement! As a result of this breadth and depth of testing talent, it was hard to choose whose talks and workshops to go to, but choose I did.

Warming up

The hospitality and warmth of the conference, and Tallinn is evident. It began with an impromptu walk round the old town with Helena and a whole bunch of other great testers. The amazing architecture, the views from the city walls and the discussion made for a fantastic evening.

Relaxing with the Friendly Tester - Richard Bradshaw

Relaxing with the Friendly Tester – Richard Bradshaw

Snap happy! Rob Lambert

Snap happy! Rob Lambert

But first on to the tutorial days! Bill Matthews and I had already run “Exploring App (In)security” at Let’s Test the previous week, and without a doubt we had learned from that experience. So, we aimed this time to rebalance the session to make it much more interactive and practical at the outset. Many of the challenges of security testing come not only from understanding the threats to applications and therefore businesses, but also understanding how those threats can be translated into real world vulnerabilities, which attackers can then exploit.

Bill Matthews - telling it like it is

Bill Matthews – telling it like it is

Bringing forward those experiences in early, so the attendees were doing practical exercises from the beginning  was our primary goal for the day, so that they got the most out of Bill and I, the material we produced and the learning they could elicit from the discussion.

Again, we started out with an exploration of the application under test, but then we burst straight into a group threat modelling exercise!

Threat modelling with these budding new security testers!

Threat modelling with these budding new security testers!

After that, all the testers broke into small groups and pairs as we all found ways to exploit the threats we modelled, by exploring the vulnerabilities that might lurk under the covers.

Pairing up with Katrina Clokie (and another tester whose name I can't remember, sorry)

Pairing up with Katrina Clokie (and another tester whose name I can’t remember, sorry)

It was a long and exhausting day. Bill and I were rarely off our feet. We had a great time working with all these fantastic testers. One or two have even got in touch since to ask follow up questions and look for further study. Very encouraging and inspiring! It’s also inspiring me to do a whole lot more in 2016!

On to the first day of the conference proper, and following an interesting keynote by Mart Noorma on the Estonian contributions on space exploration and technology, I had my first major decision to make.

Spinning up your own influence

Katrina Clokie’s workshop “Become someone who makes things happen” was one of the highlights of the conference for me. In this workshop we were challenged to make sense of what our problems are in terms of making an impact on our teams, and influencing the decision making process.

Communicating our beliefs, needs and thinking is a huge problem for testers. I often have issues on influence myself, as I have explained in this blog post: The MEWTation of Communication. So, Katrina’s workshop really resonated with me because of that. We usually worked in pairs or small groups, working through scenarios where our sales skills specifically would be challenged – selling our own ideas, thoughts, and needs in testing.

Katrina Clokie - Becoming someone who makes things happen

Katrina Clokie – Become someone who makes things happen

Katrina referred to SPIN (Situation, Problem, Implication, Need) is a sales methodology that focusses on the needs of a customer, and attunes their offerings based on a mutually agreed solution. The problem here is not necessarily getting another person to recognise that the situation you have identified is a problem, that needs resolving, but also the impact to the person you are working with.

For testers there are always scenarios where this technique, and others like it, would be useful. Communicating your thoughts and feelings on acceptance criteria, resolving issues surrounding test planning and estimation, ensuring that you have effective resources and tools to do your job, bug advocacy – the list is endless.

Katrina encouraged us not only to explore the feedback we received, but also attitudes and feelings. Whether you are respectful and caring to those you work with, the difference between aggression and assertiveness, asking the right questions at the right time and using non verbal queues can all have an impact on your influence and ability to get things done.

This was a fantastic workshop that drew the best out of everyone in the room, both new to testing, experienced and hands on, and managers too!

Testing? Thats insanity!

Next up for me was Santosh Tuppad. His energy and enthusiasm for his craft was tested to the full, as Santosh lead us through a beautiful and colourful journey, as he became inspired to begin his own journey by starting Test Insane, his own exploratory test consultancy.

Santosh Tuppad from Test Insane

Santosh Tuppad from Test Insane

The great thing about conferences of any sort is that it can bring people together. Santosh and I have been in touch for many years now, but we have never met until we came to Nordic Testing Days. It’s like we have been friends for years, so a warm hug was in order, for this strong man had traversed continents to come and speak for an hour! However his love of testing and learning permeated the social side of this conference completely.

The impressive thing about this talk though was not just Santosh’s clear love of testing as a craft, but also his contribution to the wider community. Sure, Test Insane is a consultancy, but much of the material, tools, mind maps, and papers his team produce are shared across the board – for free! A valuable resource indeed, and Santosh and his team are a very valuable addition to the testing community.

First time speaker – but not the last

My Weekend Testing colleague Neil Studd made his speaking debut at Nordic Testing Days with “Weekend Testing Europe: A behind the scenes guide to facilitating effective learning”.

Neil loves Fonzie

Neil loves Fonzie

Neil came across with a confidence that belied both his nerves and trepidation at speaking for the first time. He not only talked about the drivers to establishing an exciting and dynamic learning community for testers online, which was the main thrust of his talk – but also some of the psychological thinking that was involved in that process.

Neil talked about the imposter syndrome – where people who are extremely skilled and competent in their chosen field, and yet still feel as if they are frauds, not deserving of acclaim, attention or feel their achievements are of any worth. I think that this is a phenomenon that a lot of people encounter – only the most arrogant of people wouldn’t question themselves occasionally.

However, I feel that this is something that Neil should have no issue with. He is a highly skilled and intuitive tester, with a great breadth and depth of knowledge, and he expresses it well.

Neil’s story is a shared story however, and with Amy Phillips, and their journey to bringing back to life the Europe chapter of Weekend Testing. My involvement in that is a footnote in this story, but I hope to be very much of its future.

Gaming the system

Next up was Kristoffer Nordström and his talk “Gamification – How to Engage Your End Users”. Kris is another tester that I have known about for a while, but had neither met not seen speak. Another great opportunity to learn from someone new.

Kris’ talk was a fascinating exploration of using gamification to encourage the teams he worked with to not only produce great work, but enjoy doing it. By using elements of game thinking and mechanics, developers and testers on his teams were able to contribute to the product by finding bugs and fixing code; and were encouraged to do so by earning points (and points mean prizes).

Kris's Moomins on tour in Tallinn

Kris’s Moomins on tour in Tallinn

Here lies the problem that Kris elaborated on. How do you get people to want to work on code and bugs, but to not want to do just because they are going to earn prizes for their efforts. It’s a complex balance to strike. Renumerating them enough, with branded, high quality pencils, mugs and t-shirts; AND trying to make it fun and exciting for the dev teams.

Kris even gamed the talk, with attendees playing bingo, trying to pick out the key words from the talk. I think I would need to spend some more time with Kris to get more of a handle on this topic, as it is an interesting one. I’ve had to use similar techniques during my time as a trainee teacher and Scout leader to help children become more engaged with activities – collecting stars or badges for examples. Great stuff!

Valuable lessons

Like the rest of the conference, this keynote was another one full of firsts. Rob Sabourin is another tester who I have never met, but had heard many interesting things about. His talk ‘Value Sync’ was an exciting and dynamic discussion about what we value as testers, what people on projects and teams value, and what our stakeholders and customers value – and seeing the relationships between those values.

Rob Sabourin - Value Sync

Rob Sabourin – Value Sync

Rob’s main point was whether the conflicts in these values could be resolved, where one person values low cost over quality, or speed to market over market saturation. There are a lot of elements to balance in teams, organisations and businesses; and testers have a part to play here in expressing what they value, and ensuring that the needs of stakeholders are also met by their testing.

It was a great ending to a long hard day of learning, networking and testing! But it wasn’t over yet.

Lightning in a bottle

So, there was a big sheet of paper on a pillar in the conference lobby – Lightning talks 9pm! I was tired, but there was so much energy in the room. Bill Matthews had already pressed ganged me into speaking – 5 mins of talk + Q&A. So, I contributed the short talk I did at MEWT and compressed it down…trying to pull out the salient points – about how personal identity and problems surrounding being a ‘geek’ in the workplace affects communication and influence.

'Question Assurance' with Guna Petrova

‘Question Assurance’ with Guna Petrova

Up Periscope! - Richard Bradshaw

Up Periscope! – Richard Bradshaw

A whole bunch of great people got up to talk – Bill Matthews, Neil Studd, Guna Petrova, Pekka Marjamäki, Kristjan Uba, Erik Brickarp and Olari Koppel. Resoundingly my favourite talk of the night was Neil’s on ‘9-5 testers’. Here is his blog post on the topic: Whats wrong with 9 to 5 testers.

In the past I have been a 9 to 5 tester, getting to work, doing my work competently, going home. That’s ok! There is nothing wrong with that. I had other interests and needs – I was in a new relationship and/or recently married, or I was playing in my gaming clan. Later, in 2007 I found other interests and got in to Scouting in a big way, which takes up a huge amount of my time. It didn’t stop me wanting to be a better tester, I just didn’t go to many meetups or do much reading, and certainly no conferences. As I have encountered various family crisis recently, I have scaled back my Scouting to focus on those, but my engagement with the testing community has filled quite a lot of that void; and it has been very rewarding.

A lot of this has to do with a number of factors – and one of the major ones for me was working in an environment that allowed me to be the kind of tester I wanted to be. Some of the companies that I have worked with have been less than supportive about attending conferences, worrying about the cost and the value to the business (perfectly valid considerations, I might add). Sometimes, if they allowed it, they specified the kinds of meetings to go to, rather than the testers choice. I don’t think I went to my first meetup until around 2008/9, almost a decade into my career.

I raised a question – ‘isn’t this about bad testers?’ not whether you spend every waking hour testing? It’s a different question, and not one we focussed on. Bad testing is not the same as being someone who doesn’t want to do testing or talk about testing in their spare time.

Neil also talked about introverted behaviours and how they might be a blocker to getting people engaged. It’s a complex problem, and not one easily solved. Except that creating a safe space for learning, either physical or not, that allows anyone to learn at their own speed and their own time can only be a good thing.

Rob Remaining Relevant

Friday morning brought new experiences and new challenges, namely watching Rob Lambert’s opening keynote on the second day of the conference. “Why remaining relevant is so important” reflects on the fast pace of change needed in businesses and services, and our place within that change. Do we sit on our hands and do nothing to meet that challenge and let opportunities pass us by, or do we skill up and start adding lots of value to our teams and businesses.

Ten Behaviours - with Rob Lambert

Ten Behaviours – with Rob Lambert

Whilst it may seem to be basic to talk about how you can remain  employable, it talks a lot more to ensure you remain valuable to your team, and continue to be valuable throughout. It’s a challenge we face every day, not only as testers, but as members of a wider development organisation. And ALL of what Rob talks about in this talk is valuable to everyone, not just testers. One of the main points here I took home was adding skills. Add as many skills as you can, become good at them – it might be coding, or using a particular tool, or being knowledgeable about a particular testing approach, or domain knowledge in your organisation. These ALL add value!.

I’d like to reflect further on these points in due course, but it would take too long here to discuss. However I would say this. Rob’s book “Remaining relevant and employable” is a great read. I read it in one sitting by the pool in the Canary Islands, and was one of the main reasons I decided to take a permanent role at New Voice Media. I’ve told this to Rob myself, and I don’t mind telling you now.

Preaching to the unconverted

Lastly, before I wrap up, I wanted to say a word about Katrina Clokie’s talk, which was a last minute substitution to the programme. “Sharing Testing with Non-testers in Agile teams” was a fantastic case study on how Katrina went into a business with little or no testing, little or no agility and was expected to give them all that in a 90 minute training session.

Super sub - Katrina Clokie

Super sub – Katrina Clokie

Katrina’s experience here was an expression of a depth of knowledge and skill, but also patience, timing, communication, tact and learning. Something we all should pay heed to.

Fantastic Revelations, Amazing Revelations

I’m not going to write much about my own talk “The Testing of Fear” here. I can’t really reflect on this easily in public. Giving this talk was emotionally difficult for me. I had practiced the talk before, at meetups in the UK. All the talks went well.

Due to the unfortunate and untimely death of an early mentor in my career, Adrian Smith, I changed the initial few slides late the previous night. Adrian was important to me, not least because he helped me get my first step on the ladder. His encouragement, leadership, skill and fortitude was an example to all who met and worked with him.

I went to his funeral this afternoon, and I learned a lot about him. As a lad he learned to be a butcher in his home town. He was a Royal Marine Commando, and served his country on many occasions. After leaving the Marines, he served as a police officer, where he met his late wife Deena. After that, he began a largely self taught career in IT – project and people manager, developer, tester, architect, DBA – almost everything you could think of, he could do! We all respected him and loved him. His funeral service this afternoon reflected that, as many of his friends and colleagues joined his family to celebrate his life today.

He was an agent of change – no fear of that.

Farewell…but not goodbye

Nordic Testing Days 2015 was an intense three days of learning and development for me. I hope to be privileged enough to attend again next year, and for years to come. It is a dynamic and exciting conference, with a wide breadth and depth of excellent testers and experiences. I know it will go on being that way! I can’t wait for 2016!

Life is always better with two – Let’s Test 2015 Reflections Day 2 & 3

Day 2

Crunch time. Day 2 comes and so does the Exploring App (In)Security workshop alongside one of my most important testing mentors, Bill Matthews.

We had been planning this workshop for some time, and we really wanted to make this work for the attending delegates. Bill had pulled out all the stops to create a really brilliant learning resource in the Ace Encounters web application, and together we planned the learning objectives we wanted to achieve.

Our aim was to provide a safe learning environment where the delegates could learn about security test design techniques, the key vulnerabilities in web applications and how to exploit them. It was also our intention to elicit discussion around these issues in the context of software testing, rather than hacking.

Bill Matthews in Action!

Bill Matthews in Action!

There were lots of great opportunities for Bill and I to learn as well, feeding off the needs of the attendees, and also their experiences. It’s the best way for us to get better at presenting the content, making it more relevant and exciting for everyone. Here are some photos of the day, where we got to work with some really great testers!
          Let’s Test is famous for it’s more social activities. You can’t go far from the conference venue, as it is in the middle of nowhere. So, we all have to create our own entertainment.

As Day 2 drew to a close and after a great chat with some awesome people in The Test Lab, a few of us retired to the games room – ostensibly to play pool, but as always things descended into testing games and chat!

This is part of the attraction of Let’s Test, where you can just hang out, with a few beers (or whisky in our case) and talk about test, the universe and everything.

Chris Chant, Dan Ashby and Phil Quinn

Chris Chant, Dan Ashby and Phil Quinn

On to Day 3, which was again a fantastic day of learning. This conference was my first chance to speak to many testers that I had admired and followed for sometime – such as Patrick Prill – @testpappy on Twitter. I hooked up with Patrick, Christina Ohanian and Dan Ashby at lunch time, and we did an impromptu recording of Testing in the Pub! I can’t wait for that episode to come out.

Patrick Prill

Patrick Prill

The morning lead me to more facilitation responsibilities, this time trying to manage the events at Jean-Paul Varwijk’s very well researched presentation and debate on the proposed ISO 29119 standard.

It wasn’t my job to get involved so much in the debate, but ensure that all the participants of the meeting at least got a chance to take part (If they wanted to) and ensure there was some sort of order to the questions, follow ups and burning issues being raised.

There was a lot of passion in the discussion. Clearly this issue has sparked much interest and concern within the context driven testing community. My main issue however that there was no real moderate or conflicting view arising from this discussion  – most if not all people who spoke up had little that was positive to say about the proposed standard, or opposed it out right.

Still, Jean-Paul had presented a tonne of material he had researched and gathered over time, and presented a cogent argument in as balanced a way as he possibly could. All in all, I am glad I volunteered for this session, as it allowed me to see testers debating in action!

Jean-Paul Varwijk

Jean-Paul Varwijk

Without doubt the highlight of Day 3 for me though was the fantastic session “Coders to the Left” lead Jan Eumann and Philip Quinn. This workshop encouraged us to work in pairs and small groups, with each activity with a different focus, for example working as a tester, developer or observer.

They had created an excellent resource for learning via a GitHub project called Fixture Finder. It essentially allowed you to search football match fixtures, using date and country as search criteria. More than that though, the workshop allowed us to explore what working like a developer might be like – and it was a challenge.

Rather than just finding bugs, we would isolate the cause and fix it on the fly, within our own instance of the app in Chrome. There were some very interesting bugs to find, such as blatant security flaws, or little bits of code that stripped search results from the list, or tampered with the results of football matches under certain conditions.

I know a bit of code. Not so much that it would allow me to call myself any kind of developer. I can use code, and other tools to help me solve testing problems. However this activity really did let us get to grips with how testers and developers can really work well together, reducing and improving the feedback loop as we test and code together. A brilliant exercise in collaborative learning.

Jan Eumann and Phil Quin

Jan Eumann and Phil Quin

Anders, Dan and me pairing up

Anders, Dan and me pairing up

So, as my first experience of Let’s Test draws to a close I want to reflect on what has been a most rewarding and exhausting experience in equal measure. The learning from the workshop I ran helped us feed this learning into the following session at Nordic Testing Days, yet it made me realise that I don’t really blog much about security. I should rectify that.

Let’s Test allowed me to engage deeply with my personal approaches to testing, and what I value about myself as a human being. The impromptu chats, podcast recordings, Reiki healing workshops with Dawn Haynes, the testing games, workshops and talks I attended all helped with that. I do attend to go again, as it is such an intense and engaging place to be.

Testing the testers: Let’s Test 2015 Reflections – Day 1

The night before

It is now almost a week since I arrived at Let’s Test near Stockholm in Sweden. I had heard a lot about Let’s Test, not least from my Weekend Testing colleagues Amy Phillips and Neil Studd. It was there this time last year that they decided to restart the Europe chapter. I had also heard a lot of good things about the conference from others in the community, all of which were overwhelmingly positive. So, as I recall my feelings and trepidations about attending and working at Let’s Test, I do it now with a renewed vigour regarding my career and learning.

The venue, nestled in a Swedish rural idyll on the Baltic coast close to Stockholm, is the perfect place. To say that it is beautiful is an understatement. The conference centre has the perfect combination of location and facilities that create a fantastic environment for learning, and of course, the socialising! After all, the conference is organised for testers, by testers.

Testers at the bar

Testers at the bar © Martin Nilsson / Lets Test Conference 2015
https://flic.kr/p/syAx7f

In addition to this challenge, I was not only running a workshop on security testing with Bill Matthews (more on that later) but I had also volunteered to be a facilitator. This meant that the workshops or talks I had volunteered for, I had to assist the speaker as much as possible with setting up and equipment, generally being a gopher for them. During the “Open Season” portion of the sessions, facilitators had to manage all the questions fielded by the attendees. The conference organisers had given us all K-Cards, to allow us all to take part fairly in the discussions. If you want to know more about K-Cards, check out this blog by Paul Holland – The history of K-Cards

Ben Simo -

Ben Simo – “there was not a breach, there was a blog’

Day One

The opening keynote was in a word, fantastic!

Ben Simo is a tester that I have been following for some time. His experiences and learning from attempting to organise health insurance on for his family would have been hilarious, if it hadn’t been so serious. “there was not a breach, there was a blog” was a fascinating journey through the issues and problems surrounding the release of healthcare.gov, the US Government website and initiative more popularly known as Obamacare.

Not only were there many functional, usability and performance issues with this site upon release, but also a huge range of potential security vulnerabilities. At the time, Ben blogged about these issues, trying to make the government aware of the problems and ultimately found himself somewhat reluctantly being the subject of media interest.

Ben is an eloquent and humorous speaker, who is extremely skilled and knowledgeable about his craft. His experiences also reflect strongly upon my recently learning in the sphere of security testing and as a result, the most significant takeaway I had from this talk was the matter of ethics when reporting issues in live, public systems. Ben emphasises the need to constantly be aware of the ethics of testing, and not harming the site. All in all, a brilliant start to proceedings.

Next up was an exciting and challenging workshop run by Emma Armstrong – “Equipping you for the unexpected challenges of testing”. I’ve known Emma for a while, but I’ve never seen her speak or run a workshop.

Emma Armstrong -

Emma Armstrong -“Equipping You For the Unexpected Challenges of Testing”

Emma had created a huge range of resources and a challenging application for us to investigate. Emma’s workshop encouraged us to examine and use a wide range and techniques and thinking in order to solve a testing problem. I really love pairing and working in groups with others, so this workshop really resonated with me. There is no better way to learn than to learn from others, in practical situations.

Emma’s enthusiasm, deep knowledge and skill in her craft is evident and clear from the content and presentation of the material. By examining and utilising thinking like Shneiderman’s Eight Golden Rules of Interface Design and Elizabeth Hendrickson’s Test Heuristic cheat sheet, we can overcome complex testing problems, without overwhelming ourselves. Using them as an oracle for any testing, where appropriate, then we can surely begin to equip ourselves for any unexpected scenario.

One of the best takeaways I had from this whole conference was during this session. I was pairing with two other testers, one from Sweden, the other from Romania. We discovered that our cultural differences, and in turn our similarities, often drive our thinking while testing. It’s not often I get to pair with testers from outside the UK, so this was a fantastic experience.

Our backgrounds and values often will impact the way we think about testing, and the problems we uncover – for example – a “Title” field would be almost unthinkable outside the UK, yet in the UK to not to be able to select whether you were Mr, Ms, Mrs, Miss or even a Captain or Lord would be equally strange.

After lunch I attended a half day workshop run by John Stevenson – “A Journey towards self learning”. I was facilitating this session, so helping out John with logistics and cold beverages! Despite my responsibilities preventing me from taking many notes, this workshop was and extremely engaging exploration of our own learning.

John Stevenson - A Journey towards self learning

John Stevenson – A Journey towards self learning

One of the major themes of the workshop was how constraints on information gathering can impact the quality of our learning and analysis of the information we gather. It can inform our opinions and how we apply values or biases to the learning we do.

One great example of this was a particular exercise. The group had to divide into three where each team had a particular task – discover as much as they could about the conference venue, with particular focus on the local flora. However each team had a major constraint imposed upon them – one was only able to use internet resources, another group could only use observations of the local environment, and the third could only speak to people at the conference venue. I went around with the third team to make sure the rules were adhered to.

The results were impressive and eye opening – whilst the team who had access to the web were able to gather a lot of data very quickly, they didn’t have the richness of data gathered by the other teams. It wasn’t easy for the other teams either, where it was fairly hard for team three to use information other than that gathered through word of mouth, as there was so much visual data to gather. Also, we were able to observe discrepancies and contradictions in the information that had been gathered. Its up to us as testers to be able to be mindful of our values and biases when analysing data, manage and work within constraints. John’s workshop was a fantastic way to engage with our own learning in an active and positive way!

All in all a fantastic start to an intense few days of learning! I’ll be blogging about day one and two over the next few days. Watch this space!

It’s all about the conversations – TestBash 2015 Review

Firstly, a preemptive strike for my love of TestBash.

I make no bones about it, I love this conference. No other expression of emotion comes close. Its almost up there with my wife, family, friends, my cat and Doctor Who. (And to anyone that knows me, that is a pretty big deal)

Regardless of the quality of the conference track, speakers and workshops, this annual event is now rapidly becoming a part of me, my learning as a tester and driving my desire to evolve my testing. It also helps me support and mentor other testers – both those I work with, and those I don’t.

As I mentioned in my previous post, where I previewed TestBash 2015, if it hadn’t been for TestBash I most likely wouldn’t be working where I do today, with a company I enjoy working for, and a team that I admire and value. I also wouldn’t have had the courage to do any public speaking or workshops if I hadn’t attended TestBash in 2013. As long as it is running, and as long as I can attend, I will go. With some luck and preparation, I hope to be more involved in TestBash 2016!

Now with the context of this blog post set out, I’ll try to present my ‘impartial’ review of this conference. It’ll be hard!

For the last three years I have made a pilgrimage back to my home town of Brighton to attend TestBash. Each year it has produced a different mix of learning, excitement, comradeship and an emotional exhaustion that my friend and BrighTest organiser Kim Knup has aptly described as the post TestBash blues. Through TestBash, social media acquaintances have become colleagues in testing, and in some cases firm friends. I may only see them for a few hours a year, but for that, above anything else I am grateful to Rosie Sherry, Simon Knight and all of the Ministry of Testing team that run the event.

Brighton Pavillion at Night

Brighton Pavillion at night

I took the photo above of Brighton Pavillion, whilst having a fantastic chat with Stephen Janaway on our way to the meetup on the Thursday night. And it is this that indicates the value to me of TestBash as a whole. It’s all about the conversations. Stephen was not the first great chat that weekend, nor was it the last. We discussed testing, my poor recollection of the geography of Brighton seafront, our upcoming conference talks and workshops and even family. I suppose you could say that the testing community, formed around this conference has become as sort of family to me.

Here we are at dinner with Chris Chant, Vernon Richards and Rosie. For me, the conversations start with the small events and gestures like this, and reminds me that I owe Rosie dinner! It had become a bit of an in joke that Vernon was going to wear a tutu on stage on the conference day, and in the end he did, but not in the way you might expect.  More on that later. I was lucky enough to hangout with some of the conference speakers and workshop facilitators at dinner, discussing their experiences and feedback on the day. As conferences and workshops go, it very good value for money, as the Ministry of Testing is able to attract some high calibre speakers and contributors every year from across the community, even just to attend!

Chris, Vernon and Rosie at Dinner

Chris, Vernon and Rosie at dinner

Sadly, I was unable to attend the workshop day on the Thursday. However, I was able to catch up with some folks at the end of the day down at the Brighton Dome. There was an open meetup and test gaming session to wrap things up, so I watched a round of Set, and led a few testers in a few rounds of Zendo. If it hadn’t been for a lunchtime learning session with my colleague and friend Chris Simms a few months ago, I wouldn’t have had a set of rules in my head ready to play! All power to the test community. Even though he hadn’t attended this year, Chris’s impact was felt from afar!

Ryan and Danny at the Meetup

Ryan and Danny at the meetup

So, off to the meetup, at a bar I hadn’t been too since my early 20’s. We took a minor detour on the way, but got there in the end. Here is my colleague and good mate Danny Dainton, enjoying a drink with Ryan Rapaport, a representative of one of the conference sponsors QA Symphony. (Shameless Plug 1: I use their tool QSnap, it’s pretty good).

The greatest value of TestBash for me comes from the conversations had at meetups like this. Sure, there was a lot of talk about testing, about our experiences of testing, our learning from various books and speakers, the relative merits of one conference over another, the relative merits of one beer over another. Here I was able to catch up with my (Shameless Plug 2) Weekend Testing Europe colleagues Neil Studd and Amy Philips, and plan our ground breaking trio 99 second talk for the following day! I also managed to grab conversations with; Matt Archer, about the Ministry of Testing Dojo and Abbie Maddison, the new runner of the NottsTest meetup. It was also fantastic to catch up with Guna Petrova from Latvia, who is a key player and track organiser at Nordic Testing Days. Her outlook on testing is always refreshing and enlightening.

Without communities like TestBash, and those generated around other conferences like Let’s Test, Weekend Testing wouldn’t exist. Communities generate conversation, which lead to initiatives and plans, which lead to more communities and more conversations and deeper learning experiences. Similarly, though meetups like this, there are opportunities to develop professional relationships, which can lead to other meetups, brown bag sessions, invites to speak at conferences, or even work!

Weekend Testing Europe: Amy, Neil and Me

Weekend Testing Europe: Amy, Neil and Me

Later in the evening led to even more discovery and exploration of our craft (testing, beer and music). It with great surprise that I could discuss the merits of the music of Fairport Convention and Jefferson Airplane (whom, thanks to my Father, I have an appreciation of) with Michael Bolton and Neil Thompson.

But that isn’t really what we were there for. Here’s Radomir Sebek, a tester from Serbia, who works for a music production software house in Berlin. He’s playing “The Pen Game” with Michael, one of the many testing games that were going down at The Globe late into the night. That same conversation led me to be challenged on a variation of the Pen Game, this time with my observation and listening skills put to the test. I got the solution, in the end!

The Pen Game with Michael and Radomir

The Pen Game with Michael and Radomir

Richard challenges Abby and Dan

Richard challenges Abby and Dan

Above is conference speaker Richard Bradshaw challenging Abby Bangser, from Thoughtworks, and Dan Caseley, from Common Time, to more testing games over a beer or three.

So here is the problem. With so many fantastic folk to talk to and learn from, you can’t really chose from them all. You pick up on different sounds and movements, explore what is interesting to you, find people you have never met before, or have had online communication with. It’s a bit like (exploratory) testing, in that you can define your conference by the actions you take, the information you gather, the people you speak to and your responses to them, and how you record them…like this.

So to the main event.

Each year, Rosie manages to attract excellent speakers to TestBash. And this year was no exception. As I mentioned in my previous post, there was no diversity in terms of gender at the 2014 conference. Not so this year, with three female speakers on the conference track. I have no details on the selection process, but I feel that the overall content, tone and message of the conference was all the better for the selections made this year.

There was also a lot to learn, from a range of experience reports, new thought leadership and science around testing, as well as technical challenges. Where TestBash is usually strong is dealing with the human element of testing, rather than drowning the attendees with technical jargon. Testing is for me very much a social discipline, as much as it is a technical discipline.

First up was Michael Bolton with “The Rapid Software Testing Guide to What you meant to say”, which looked to our use of language as a tool of our trade, and challenged many potential assumptions that could be drawn from testing behaviours. It’s my interpretation of this talk that Michael was trying to draw out the reasoning behind certain language choices in software development, and in some ways subverting their use through the prism of context driven testing. Why for example would we say automate all the testing, where we couldn’t possibly do that with development?

Up next was Iain McCowatt, with an excellent and animated discussion of the need to include intuition and the importance of tacit knowledge in our detection of bugs.  Iain emphasised that socialisation and interactional expertise was an essential skill of testing.  Being able to discuss and share our work and experiences appear to be key in finding bugs and communicating them effectively. It was also a great reminder to pick up the work of Harry Collins, whose writing and research contributed greatly to the themes Iain was conveying. I managed to catch up with Iain during a break, and sought his advice on combating biases in my testing. I find sometimes that because I test a lot for security, I feel that this sometimes blinds me to other considerations whilst I am testing. His insight will be invaluable in trying to balance my approach and test design processes in future.

Next up was an interesting talk about the challenges and learning gained from The Guardian’s approach to mobile testing and delivering software across multiple platforms. Sally Goble and Jonathan Hare-Winton presented a fascinating and humorous exploration of the differences and pitfalls of testing on both the iOS and Android operating systems and associated hardware. Playing on the rivalry in historic advertising campaigns between PC and Mac, and a distinctly divided audience (seemed to be more Android users than iOS, but only marginally so). This was a great talk for me, as I know very little at all about mobile application testing. The style of presentation drew more out of the audience than I expected it would, and it did not dwell too much on technical details. Great stuff!

After the break came the double bill of Martin Hynie and Stephen Janaway. Both talks approached the problem of organisational change and perceptions of testing and test management within development teams and businesses as a whole. Placing these two talks together was a masterstroke, as they complimented each other so well. Martin’s talk “What’s in a name? Experimenting with Testing Job Titles” focused on a social and professional science experiment. Martin found that following a change in job title and team name, to remote test, or testing; enabled his teams to have greater impact and authority within the business. He did all this under the radar, with the testers maintaining their responsibilities, whilst having a different job title. With an exciting presentation style, Martin was able to convey that maybe businesses see testing and testers as limiting and a blocker to progress. In doing so, he discovered that other teams and key stakeholders responded more positively to the alternatives. There is a lot to discover in this talk, and I won’t spoilt it further for anyone who want’s to watch the video when it comes online. Let’s just say for me that Martin’s talk it is one of the highlights of the conference.

To Stephen’s talk. For a while now, Stephen has been an inspiring member of the testing community, both personally and professionally. I was invited to speak to his team at Net-A-Porter last year, which was a fantastic opportunity. So its exciting to see how he managed to evolve into his new role as a Testing Coach, in his talk “Why I lost my job as a Test Manager and what I learned as a result”.

Organisational change is a very real challenge for testers. Stephen’s experiences here are both common, in terms of the need of testers to adapt professionally to change, but also uncommon in the approach taken by Stephen’s organisation. Rather than having overlapping development and test managers supervising the work of many people across teams, each team had its own development manager.

As a testing coach across the whole business, Stephen’s new role is to mentor the testers, enable and guide their professional development and learning, whilst not being responsible for their line management. This must have been an awesome task, reorganising the development team of a major online retailer, whilst at the same time maintaining delivery of products and services. This was an experience report beyond the normal recollection of events and dry facts, and really drove home that testers need to be able to be at the forefront of change in organisations, rather than being reactive to it.

Vernon Richards was up next, with “Myths and legends of software testing”. In 2014 Vernon blew the house down with his 99 second talk on this topic; a rapid fire list of misconceptions, musings, biases, and warnings. What Vernon did here was to distill the core of his message into an blisteringly and entertaining talk. After lunch and with everyone feeling a little full, it was the best of antidotes to wake us up.

Vernon’s talk drove home the need for testers to not only be creative in their approaches to testing, but to be wary of the fallacies and biases that can be derived from poor research, assumptions and inaccuracies. Also, looking at how to challenge the language used to describe testers and testing by non testers; such as “It’s just clicking a load of buttons” or “Anyone can do testing”. If we are to take ownership and responsibility for our craft we have to believe in our skills, and champion them to those outside testing, so that they are recognised and valued appropriately.

Maaret Pyhäjärvi came next, with “Quality doesn’t belong to the tester”. Maaret’s experiences of being the sole tester on the team, feeling responsible for quality when it seemed that no one else appeared to care resonated with me deeply. This story described how she managed approaches to testing on her team and began to build more positive relationships with the developers. In order to test sooner, and test better, Maaret elicited a collective responsibility for quality and testing, rather than taking on the burden on her own.

Matthew Heusser encouraged us to rethink our approach to regression and releases in his talk “Getting Rid of Release Testing”. This talk lead us through an approach to testing and releasing software incrementally, and becoming less reliant on the big bang “test everything” approach to release management.

Through drawing rather than slides, Matthew explained what he termed “The Swiss cheese model of risk”, where at each stage in a software release life cycle there can be different layers of testing, where there will be gaps and overlaps in coverage. It’s probably a scary approach for some, but resonates with me as working in a continuous delivery environment means that to test everything at the end would be inefficient, costly in terms of time and resources and likely not give us meaningful data. The tweet below reiterates clearly one of Matt’s main messages in a challenging and insightful talk.

Nearing the end of the main conference day leads us to Richard Bradshaw’s “Automation in testing”. I’ve never seen Richard speak before, but I have heard much about his ability to convey complex thinking in a clear and approachable way. I was not to be disappointed. Richard guided us through his evolving process of  supporting testing using automation. Built up over a number of years of learning and experimentation, he described a mature and adaptable way of incorporating automation into your testing, for the right reasons – enabling the important checks that you might need to do frequently, allowing the tester to focus on exploration, learning and asking questions about the software under test. This was an inspired and entertaining talk, which engaged me in a topic that in the past has not always held my interest.

Now to the final presentation of the day, with Karen Johnson’s “The Art of asking questions”. This was hands down my favourite talk of the day. It was less of a presentation, more of a conversation with the audience. Karen’s slides were a simple guidance to invite us to flow through the discussion with her.

Karen explored with us the finer points of questioning, both of others and ourselves. Timing was a key theme, asking the right question at the right time, something I have struggled with in the past. Even more resonate with me was the idea that, quoting author Joshua Harris “The right thing at the wrong time is the wrong thing” in his book I Kissed Dating Goodbye: A New Attitude Toward Relationships and Romance

Drawing on her journalism background, Karen asked us to consider the kinds of questions we ask and how they might influence the kinds of responses we get in return. The classic, yet always useful what, where, why, who and how that will never fail you as long as you use them appropriately. After all, a lot of testing is about asking questions, and asking the right question could even prevent defects from occurring before a single line of code is written. The Q&A afterward brought many excellent questions from the audience, with Karen responding with great advice, book recommendations (see Twitter for a tonne of them) and practical suggestions to solving communication issues.

TestBash has now established a tradition of 99 second talks, led for the final time by Simon Knight. Many great folk stepped up to the stage alongside Neil, Amy and myself. Jokin Aspiazu really coined it with “If you can’t get money for conferences, ask for time. Time is valuable.” No truer thing has been said in such a short space of time!

The after party is both a chance to relax after a long day, but to engage with as many people as possible. The quite excellent and intimate bar The Mesmerist proved to be a great place to hang out and talk testing, such as with Mark Tomlinson (he of the infamous spinning cat at TestBash 2014).

Mark Tominson at the meetup

Mark Tomlinson at the meetup

It’s the camaraderie and convivial atmosphere that really makes this event, year in year out. I recommend you come, make a week of it…to really let Brighton and TestBash soak in to you. You won’t regret it.

Reflections in a single malt

Reflections in a single malt

Although, I might do by the end of the evening

Critical Mass: A TestBash 2015 Preview

Hey testers!

Spring has sprung on the UK testing scene once more, as it is now seven days from TestBash 2015, held each year so far in Brighton. To those of you living under a rock, TestBash is the one day conference track and two day workshop run by the good people of Ministry of Testing, and especially Rosie Sherry. You can find out more here.

This year there are some established members of the testing community speaking, such as Michael Bolton, Iain McCowatt, Stephen Janaway and Matthew Heusser. I am looking forward to seeing these guys speak again, as they are always excellent, with insights and content beyond the conventional.

If there was a criticism of TestBash 2014 was that there wasn’t a diverse range of speakers. There were no female speakers last year, where now there are three; Karen Johnson, Maaret Pyhäjärvi and Sally Goble. Whilst I have read blogs and tweets by these testers, I’ve never seen them speak before so this is going to be incredibly exciting.

There are also new speakers to TestBash, such as Richard Bradshaw and Vernon Richards.

I’ve known Richard for a few years now, and he is an inspiring and knowledgeable tester. I’ve never seen him speak before other than during a 99 second talk. He’s the first guy I would go to for information on automation. He describes his talk as ““Test Automation” = Things don’t have to be this way”.

On to Vernon Richards, whose epic 99 Second talk on Myths and Legends of Software testing has been expanded into a full blown talk. Again, I have known Vernon for a while in the community. Being isolated down in the South West of England means that I don’t always get to meet testers based and working in the London area, but Vernon has been on my radar for ages.  Vernon’s 99 second talk last year earned him a huge cheer, and rightly so. This talk might turn out to be the jewel in the TestBash crown.

On to the workshops. Sadly I can’t attend the workshop day this year. With the TestBash workshops, it is your learning that is at the heart of it. The likes of John Stevenson, Simon Knight, Karen Johnson, Nicola Sedgwick and my Weekend Testing colleague Neil Studd all providing courses, it should add up to a fantastic day. Also running a workshop on BDD is Rikke Simonsen, who I had the pleasure of having lunch with last TestBash. Such a shame that I will be missing this fantastic opportunity to learn from them all. I’m definitely going to see if I can get in on that in 2016, as a learner or a trainer.

I cannot impress upon you enough the importance of TestBash in my career. I first attended in 2013. This was my first testing conference in three years, after what felt like some what of a period in the doldrums. I felt that I was coasting in my career and not doing enough to learn more, stretch myself creatively or professionally. I was just working.

A number of personal and professional events led me to attending that year, which gave me the kick up the backside that I really needed. As a result, I had my first speaking gigs in 2014. I am now speaking again at Nordic Testing Days this year, and visiting Let’s Test for the first time, running a workshop with Bill Matthews.

Sure, there are bigger conferences, with more tracks and a wider variety of talks, workshops and test labs, Some conferences are more popular with different testers, because of the variety of speakers and the depth and breadth of the content. However, what TestBash squeezes into only a few days in the compact and vibrant city of Brighton is phenomenal.

I’m also very proud to say that Brighton is sort of my home town. I grew up in a village not far away from there. This adds for me an additional pride and gratitude for the awesome effort that MOT and Rosie put into organising and running the event. As a result of the conference, and MOT as a whole, careers have been forged due to the community outreach and sponsorship of new testers so that they can attend courses and the conference for free, as well as other support. Some testers have even sponsored tickets themselves, which is hugely rewarding to the community. They should be thanked!

Two testers that are very important to me have so far benefited from this amazing community scholarship. Emma Keaveny has since moved to the UK from Ireland, secured her first testing role and along with Kim Knup have started to establish the first regular Brighton and Hove testing meetups.

The other was Danny Dainton, an ex infantry soldier, who actively pursued a career in testing after leaving the Army, and who I have the great honour of working with at New Voice Media. I really look forward to what these two fantastic testers do in the future, be it speaking themselves, or organising community events or just being able to work closely with them.

So, if you are going to TestBash next week, I look forward to seeing you there. It should be a fantastic event, full opportunities to learn and grow as a tester. If you want to talk to me, just grab me at Lean Bacon (ahem, Lean Coffee), at the queue for lunch, or at the Thursday or Friday meetups. It’s going to be EPIC!