"TestFairy is the only tool that really pulled everything together in one way and made it easy for us to tie into development activities"- Andrea Greggo, SaaS Business Architect, Pitney Bowes
MEET pitney bowes
Pitney Bowes is a global technology company known for its postage meters, mailing equipment and services, and global e-commerce software solutions. The company was founded in 1920 and was the first to provide a commercial postage meter. Based in Stamford, Connecticut, Pitney Bowes provides customer engagement, customer information management, global e-commerce solutions, location intelligence, and mailing and shipping services to approximately 1 million customers in more than 100 countries around the world.
TestFairy provides companies with a mobile testing platform allowing teams to find, report and solve complex problems with their mobile apps, all from one simple dashboard. TestFairy provides an easy to use app-distribution service for iOS and Android apps, as well as an SDK that collects valuable information such as videos of user behavior, app logs and crash reports. This information is collected and neatly organized in a single, easy-to-use dashboard.TestFairy facilitates frictionless communication between developers, beta testers and business partners with the “shake to report bug” capability, which provides accurate, information-rich bug reports. With TestFairy’s videos, logs and device metrics, teams are able to quickly reproduce and understand problems, providing accurate and timely bug fixes and a faster time-to-market.
As the Pitney Bowes team planned on distribution of an early phase client Beta, they wanted to get some clear visibility into the app itself
When Pitney Bowes started building their mobile “Companion” app, the team had some core requirements; The desired outcome was to distribute the app, get feedback on it, and make it easier for clients to interact with it and engage the mobile team. As the Pitney Bowes team planned on distribution of an early phase client Beta, they wanted to get some clear visibility into the app itself: how people were using it, what people are doing with it, and in case of a problem, what happened before something went wrong. Pitney Bowes considered a variety of tools to handle these tasks, and TestFairy was chosen with the intention of tackling multiple challenges, revolving around the data and feedback collection capabilities offered with the TestFairy technology.
THE TESTFAIRY SOLUTION
Enterprise App Distribution
The Pitney Bowes team uses TestFairy’s distribution platform to easily distribute iOS and Android apps in various ways:
Specific user groups are invited to test the apps throughout the various preliminary stages of the Beta process. The invitation is made via email, which includes instructions and a download link to easily access and install the app.
In addition, the team uses TestFairy’s download pages, which are automatically created for every app in the TestFairy platform, allowing users to simply download, if they’re interested, by clicking a link or scanning a QR code. The pages also offer both iOS and Android versions, for cases of using multiple devices.
In order to have a successful Beta testing process, it is crucial to make sure all users are using the latest version of the tested app. This should be carried out automatically in order to ensure that no mistakes are made by users, and to avoid having users put extra effort into updating their apps.
The Pitney Bowes team used the auto-update mechanism, which prompts the users to update their app whenever a new version is out. This prompt only shows up when a user opens up the app, and doesn’t create unnecessary noise by sending out push notifications. This mechanism is also available via API to allow seamless integration.
Valuable User Feedback
Receiving feedback from users, which is usually the hardest part of any testing process, became extremely easy using the TestFairy’s SDK. All a user has to do in order to send out feedback is shake their phone. This allows users to provide detailed feedback associated with whatever version they’re running, along with an attached screenshot that can even be scribbled upon, so you know exactly what page they’re on and what went wrong. This feature proved extremely helpful to the Pitney Bowes team. The TestFairy SDK also records a video of the tested session, so developers can see exactly what the users were doing before they shook the phone for feedback, and in some cases even what happened after that.
"This is just a total lifesaver for us, we were going to have to use so many different tools and then manually integrate them all, and that was just not feasible for the timeline we had"- Andrea Greggo, SaaS Business Architect, Pitney Bowes
The Pitney Bowes team integrated TestFairy with a variety of other tools, in order to automate the process of creating bugs, and easily alert the team regarding new issues and app versions in real-time.
PB team uses TestFairy’s JIRA integration in order to automatically open up issues in JIRA. New issues automatically contain technical variables such as user version, platform, IP address, etc, as well as logs, screenshots and a video recording of the testing session. The video recording is playable within the JIRA issue, using the TestFairy JIRA plugin. Using TestFairy, a JIRA user can see all the metrics, recording and feedback that was given on this issue, making each ticket extremely information-rich and reliable, containing a full session view of what has happened and why was this ticket created. This allows the Pitney Bowes team to see issues and relevant data all right from JIRA, rather than manually pulling the information from the TestFairy dashboard.
As opposed to JIRA, Slack is used by teams for real-team communication. If and when something happens, you want to know about it right away and easily discuss it with your team. The TestFairy Slack integration allows teams to be notified when an app crashes, an issue is recorded, or when a new version is available for testing. This Slack integration compliments the JIRA integration, by allowing real-time, information-rich sharing and discussion of issues with the relevant team members.
clearly see your data
Pitney Bowes found great clarity in the dashboard view of the app itself. They use it to understand the statistics of how many sessions took place, how many crashes happened, how much feedback was submitted, etc. This allowed them to get a view of how well tested the app is, for the given release associated with it, and use that information to look into the completion of the app testing itself.
Without this tool it would have been a lot more difficult for the team to complete the abundance of tasks they had prepared with the given amount of time and users. It just made everything really easy!
We'll let them sum it up:
"I don’t really know how we’d have done this as effectively as we did without TestFairy. And in fact, in any mobile app that my team does moving forward, this is going to be our go-to tool. TestFairy is really a very powerful tool for us to use."- Andrea Greggo, SaaS Business Architect, Pitney Bowes
More case studies