Tests failing for no reason

[KMuller]

I have a problem where previously Passed tests will start to Fail when no change has been made to either the application or test script.

I have had this problem for quite some time, and find it very frustrating.

I use the Test Editor to create the tests, which I would have thought was the most reliable way to create tests - no mouse movements or XY positions that can change.

In the first attachment you can see the list of Pass/Fails for a single test (failedTests.jpg). After editing the test yesterday it Passed, I run it today with no changes to the application or test, and it Fails. I update the test so it Passes, and then it starts Failing again.

The reason (in this example) for the test failing is "Unable to find Text Box". If I edit the test (again), save, it may Pass once or twice then again begin to fail.

This means I find the results of Testing Anywhere very unpredictable and unreliable - what works today may not work tomorrow or even in five minutes. Of course the reason for using an automated testing application is so you create the tests once, and they should run unaided indefinately if created well to begin with.

As I said, I have had this problem for quite some time with various tests. I can't understand why a test would Pass, then Fail on the same application for no reason whatsoever.

The application in this example is written in C# .NET.

Please advise.

[KMuller]

And another screenshot showing the tests passing yesterday (after I had again modified it to find the object it has problems with), and today failing.

[forumstaff]

Hello KMuller,

This is quite strange behavior please let us know further more details about your application. Is it a web based application or it is system based application.

It will be more helpful if one of our experts can contact you and look at the behavior of the test and understand the issue much better. You can forward your contact details at support@automationanywhere.com in case you would like to go for meeting.

[KMuller]

It is a standalone Windows application, not web. It is using a standard form, and when the test fails, TA is unable to find a Text Box.

I then 're-learn' the text box. It will pass a few times, and either a few hours later or the next day, with nothing changing, the tests will fail.

[KMuller]

I still have this problem. Three tests today have passed 20+ times without a problem, nothing in this part of the applicaiton has changed, but all the tests failed, could not find objects, so I had to 're-learn' all the actions again for the tests to run.

Why? What causes this?

[KMuller]

Any ideas? I Logged this 5 months ago and still haven't received a response.

[forumstaff]

Hello KMuller,

We would like to schedule a call and have an online meeting at your end. Please share your contact information (email address and contact number) on support@automationanywhere.com and let us know your preferred time for an online meeting.

Thanks & Regards

[KMuller]

This STILL occurs (although not a surprise as there have been no suggestions or releases to fix the problems).

I spent an entire day updating tests, they (eventually!) ran yesterday. I run them this morning, and I again receive 'Unable to find xxx object' errors.

Why?

Why is TA so unpredictable and unreliable? People have spent a lot of money on this application, only for it not to work!?

The application I am testing has not changed. It worked one day (after a LOT of work getting there), and the next the tests fail.

When is the next TA update being released that RESOLVES these problems?

[Petra]

I assume you were using smart recorder. In a specific case I posted in this forum, I am positive that Smart recorder is not using true object recognition but actually mouse coordinates. In the defect I posted TA stopped posting replies in the forum and the dialog continued outside the forum. It has been over a month, since I sent them a simple program that proves if you move the window from the originally recorded position it fails to find the standard window menu item. They don’t seem to want to run the test file, nd they still can’t answer my basic question why mouse coordinates are being used

[KMuller]

I have problems with both the SMART Recorder and Manage Windows Objects ('MWO'). Both pass one day (or one minute), then for no reason fail the next.

Common examples are 'MWO' failing to find and set tick boxes.
SMART Rec not being able to find objects.
SMART Rec locating the WRONG variables (ie button2 instead of button1).

I have run these tests and they pass, then literally 2 minutes later they start to fail, and will continue to fail.

I emailed TA support again and they scheduled a telepone meeting with an 'expert' for 3 hours ago.... still no phone call, email, nothing. I think they've gone home, or are perhaps hoping the problem will just go away?

Very unimpressed.