Email Subscription Form

Saturday, August 4, 2018

Mobile Testing Part II: Manual Mobile Testing

I am a firm believer that no matter how great virtual devices and automated tests are, you should always do some mobile testing with a physical device in your hand.  But none of us has the resources to acquire every possible mobile device with every possible carrier.  So today's post will discuss how to assemble a mobile device portfolio that meets your minimum testing criteria, and how to get your mobile testing done on other physical devices.  We'll also talk about the manual tests that should be part of every mobile test plan.

Every company is different, and will have a different budget available for acquiring mobile devices.  Here is an example of how I would decide on which phones to buy if I was allowed to purchase no more than ten.  I am based in the United States, so I would be thinking about US carriers.  I would want to make sure that I had at least one AT&T, Verizon, T-Mobile, and Sprint device in my portfolio.  I would also want to have a wifi-only device.  I would want to make sure that I had at least one iOS device and at least one Android device.  For OS versions, I'd want to have the both the latest OS version and the next-to-latest OS version for each operating system.  For Android devices, I'd want to have Samsung, LG, and Motorola represented, because these are the most popular Android devices in the US.  Finally, I would want to make sure that I had at least one tablet for each operating system.

With those stipulations in mind, I would create a list of devices like this:


In this portfolio, we have three iOS devices and six Android devices.  All four carriers I wanted are represented, and we have one wifi only device.  We have three tablets and six smartphones.  We have the latest iOS and Android versions, and the next-to-latest versions.  And we also have a variety of screen sizes.  It's easy to modify a device plan like this if for some reason devices aren't available.  For example, if I went to purchase these devices and found that Sprint wasn't carrying the iPhone X, I could easily switch my plan around so I could get an iPhone X from AT&T and an iPhone 8 Plus from Sprint instead. 

The benefit of having a physical device portfolio is that you can add to it every year as your budget allows. Each year you can purchase a new set of devices with the latest OS version, and you can keep your old devices on the older OS versions, thus expanding the range of OS versions you can test with.

Once you have a device portfolio, you'll need to make sure you are building good mobile tests into your test plans.  You can add the following tests:

  • Test the application in the mobile browser, in addition to testing the native app
  • Test in portrait and landscape modes, switching back and forth between the two
  • Change from using the network to using wifi, to using no service, and back again
  • Test any in-app links and social media features
  • Set the phone or device timer to go off during your testing
  • Set text messages or low battery warnings to come in during your testing

What about testing on the dozens of devices that you don't have?  This is where device farms come in.  A device farm is made of many physical devices housed in one location that you can access through the Web.  From your computer, you can access the device controls such as the Home or Back buttons, swipe left and right on the screen, and click on the controls in your application.  You may even be able to do things like rotate the device and receive a phone call.  With a device farm, you can expand the range of devices you are testing on.  Good ideas for expanding your test plan would be adding devices with older OS versions, and adding devices from manufacturers that you don't have in your portfolio.  In my case above, this might mean adding in HTC and Huawei devices.  

For manual device farm testing, I have had good experiences with Perfecto.  Other popular device farms with manual testing capabilities are AWS, Sauce Labs, and Browserstack.

You may be saying to yourself at this point, "You've got some great devices and carriers for US testing, but my users come from all over the world.  How can I make sure that they are all having a good user experience with my app?"  This is where crowd-testing comes in!  There are testing companies that specialize in using testers from many countries, who are using devices with their local carriers.  They can test your application in their own time zone on a device in their own language.  Popular global test companies include Testlio and Global App Testing.  Another good resource is uTest, which matches up independent testers with companies who are looking for testing on specific devices in specific countries.  

With a mobile device portfolio, a mobile test plan, a device farm, and a crowd-testing service in place, you will be able to to execute a comprehensive suite of tests on your application and ensure a great user experience worldwide.  But all of this manual testing takes a lot of time!  Next week, we'll discuss how to save time and maximize your mobile test coverage through automated mobile testing.  






38 comments:

  1. Nice to come across with your article and great to know about basic Mobile Testing Pathway we should learn. Recently, when i tested one of my app in Mobile App testing Kochi, they recommend some idea concerned the same. Well, im a tester as well, this will be something an advanced tips. Cheers.

    ReplyDelete

  2. Such an informative post. Thank you for sharing
    Mobile Development

    ReplyDelete
  3. I really liked your Information. Keep up the good work.This is a really informative knowledge, Thanks for posting this informative Information.

    Buy The Iphone Back Case

    ReplyDelete
  4. This site is excellent and so is how the subject matter was explained. I also like some of the comments too. Waiting for the next post.best astrologer

    ReplyDelete
  5. Thank you for sharing your thoughts and knowledge on this topic. This is really helpful and informative.

    If you want to make custom website & application, you can hire Mobile Application Development Company and Android Application Development Company anytime.

    ReplyDelete
  6. Check if you site is online and get notified by email, telegram or custom requests, when it is getting offline.online ping test

    ReplyDelete
  7. Thank you so much to share such an amazing article with us.

    ReplyDelete
  8. I wanted to thank you for this great read. Your blog is one of the best, and this is true iOS app development is a very large, secure, and successful operating system today. Thanks for posting this informative article.

    Visit: iOS App Development Services India & USA

    ReplyDelete
  9. Nice and interesting post, I appreciate your hard work. keep it up…!!!Thanks for such useful information, It is true that now if you want to grow your business you will surely need the mobile app testing services for your business. But for that purpose everyone needs best mobile app testing companies.

    ReplyDelete
  10. This is excellent information. It is amazing and wonderful to visit your site. Our Indian Psychic Sharma ji is that the best and renowned Psychic in Mississauga, Canada. Psychic Reader in Mississauga | Palm Reader in Mississauga | Fortune Teller in Mississauga

    ReplyDelete
  11. Interesting post. Thanks to share with us. Also Get in touch with Astrologer pandit ramdial Ji, who offered effective solutions to many customers all over USA, UK, Canada & australia. click on below link & clear your probles start your's happy life...!

    Famous astrologer in new york

    ReplyDelete
  12. Thank you for sharing this coaching-related information with local and global audiences. Primary audiences (Coaching Center, Training Center, Business Coaching Class) who wants coaching software, book a free trial of coaching management software to generate the leads, schedule appointments, inquiry management, payments, and business reports in 2022.

    ReplyDelete
  13. thanks for sharing a good information for us.are you looking for best python training institutes in Hyderabad
    Washing machine repairing services in Islamabad

    ReplyDelete
  14. Hey,
    Thanks for sharing this great blog. It contains a lot of information. It is easy to locate a Web Application Development in India. But hard to choose the best Web Design services like this. All your services look very professional. Keep posting.

    ReplyDelete
  15. Loved this post! reading this article is nice, have ever discuss about your astrology.Tarot Reading in Toronto

    ReplyDelete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Mobile applications are at the heart of digital change. There are
    several mobile test service providers in the market, but before choosing one,
    compare them to your selection criteria Make a list of the requirements that the service provider must satisfy.

    ReplyDelete
  18. Thanks for sharing this informative article on Manual Mobile Testing in detail. If you have any requirement to Hire QA Specialists for your project. Please visit us and hire our resources on remote.

    ReplyDelete
  19. Extremely useful information which you have shared here Manual Software Testing

    ReplyDelete
  20. Thanks for sharing great information. Its very useful for me.
    hire Remote mobile app developers

    ReplyDelete
  21. Thank you for sharing these informative insights on mobile app testing. Every custom mobile app development company should be aware of them. It's crucial to utilize all aspects of testing strategies before publishing a mobile app. This ensures a high-quality and bug-free user experience.

    ReplyDelete

New Blog Location!

I've moved!  I've really enjoyed using Blogger for my blog, but it didn't integrate with my website in the way I wanted.  So I&#...