Final User Testing

After making our build water resistant with black electrical tape, we moved to the Hex Box to hang up the LEDs for user testing. For user testing we had two versions of the code that we wanted to evaluate. We were initially unclear as to what components would feel intuitive to users but also had a hint of exploration so the interaction wasn’t too simple. For this we conducted AB testing. We had 7 responses for each version.

A – Functionality:

Leaning the rainstick increases the sparkle rate of the LEDs
Rolling the rainstick alters the color

B – Functionality:

Leaning the rainstick increases the LED refresh rate and changes the color scheme of the LEDs

The results from the user testing were quite interesting. Although all user were able to uncover how the system worked, many of them missed out on some of the finer elements. In regards to version A, the rolling element to alter the color of the LEDs was never uncovered. This means this type of interaction with a rainstick is not intuitive or looked at. We agreed that this feature would be left out of our final installation. Users did understand the leaning feature, but also related this to the change in color. Therefore the reaction of the system was slightly obscured to users who tried to manipulate the color with leaning the rainstick.

In regards to version B, the form of interaction was fairly clear to users. Some, however, did not notice the increase in refresh rate and had only referred to the color alteration. Most users had a general understanding of the color scheme in reaction to the rainstick’s orientation. However, some did not notice that 3 different color schemes were presented, but rather focused on the 2 schemes at the extremes.

This gives us insight into how we may amend the code to be more intuitive to users. With regards to the build itself, we had fairly positive results. Users were reminded of various different natural elements such as the beach, stars, or rain. Although we aimed for rain to be the main focus, this is not a negative. The important factor is that users are carried away from their current state of mind for just a few moments. However there were two outliers who did not feel they were given this moment very well.

Test users also ranged in how they initially played with the rainstick. It was clear that some were unfamiliar with it, whilst others immediately grasped what it was. Ultimately, all users came to understand how to use it.

Lastly, there were a few suggestions for improvement that were put forward. We will have to assess their viability at this stage as it is too late to make any major changes to the system. Some users did feel that some instruction were necessary. This would however remove our desire to provide explorative play.