Friday, 2 August 2013

QA First World Problems

We have recently created an automated test suite to replace some of the manual tests that we used to run for regression. I'm finding the below more of an occurrence now!


2 comments:

  1. If you don't build your automation logs well - this will become:
    "I have to spend 3 days investigating a failed automated test, rather than spending a whole day running manual tests."
    Drill-down logs infrastructure is highly required, yet, hardly any common tools for that.
    @halperinko - Kobi Halperin

    ReplyDelete
    Replies
    1. We've set up our automated tests to give us as much information as possible when they fail, a screenshot is captured and the assertions all have pretty descriptive error messages. When debugging we'll see the stack trace as much as possible, so it's not all doom and gloom.

      All too often however, tests don't have informative errors or it's difficult to find out why a test failed, then you'll get your 3 days investigating!!!

      Delete