Those of you who have been following my blog would have expected this news. I mentioned in my post about Testing Evidence that I was working on this plugin. Test Results is a plugin for Selenium-IDE to save the results of the test execution for the test suite and included test cases in a single click. The plugin also allows you to export the test results for individual test cases. I have uploaded it to the Mozilla Addons website, but the approval process to make it public usually takes a while. The good news is that you can grab it right now from the addons page.
Once you install the plugin, two new menu items will appear in the File menu.
They are titled as follows and should be self explanatory.
- Export test case results…
- Export test suite results…
See the screen-shot for the position of these menu items.
Mini user guide for the plugin
- Click on the Export test case results… menu item to export the test results for the currently selected test case.
- Click on the Export test suite results… menu item to export the test results for the currently test suite including all test cases. Another screen-shot shows the results.
- Don’t forget to save the test cases as you usually do. The test results are not supposed to replace your saved test cases and trying to open them in Selenium IDE may have unexpected effects.
Known Issues
- The test case name when exporting test results for individual test cases may not be available.
To use this plugin, you will need to install Selenium IDE extension of at least version 1.0.4 first. Only in English for now.
Other Thoughts
This released version is the second complete rewrite of the plugin. Even though the first version worked, I was not happy with the code. While this caused a delay in releasing the plugin, I am quite happy with the new code. This is also the first plugin where I started to experiment with automated tests for the plugin. The current tools support does leave a lot to be desired, but it should still save me a bit of time when releasing the next version.
As usual feel free to leave comments, improvements, advise, criticism, problems…
Pingback: Kavin School » Blog Archive » Seleium IDE Test Results v1.0 – New Plugin - Your Training Partner for Latest Technology – An IT School
Nice plugin thanks.
Would be great to see an automatic email results feature for this.
The results are already captured now we just need to be able to email them.
Keep up the good work.
Cheers
Duane
Hi Duane,
I am happy to hear that you like my plugin. I doubt that I will add the feature to email the results anytime soon. The reason for this is that there tons of command line tools and scripts in Perl, Ruby, Python and rest of languages to email stuff and it is just a matter of scheduling a script to email the results whenever you like. Try a Google search and see if you can use one of these. If you find nothing, I will be happy to point you in the right direction.
Cheers,
Samit
Hi There,
Wouldn’t it be possible to get the results in reporting format, I mean no. of test cases passed, failed and no run etc..
Thx,
Supreet
Hi Supreet,
You mean just a summary. Please explain to me this use case in further detail.
Cheers,
Samit
Hi Samit,
Isn’t it possible to get just the Test Case Name and Results ( Pass / Fail / No Run) in html format vs getting all the commands.
It will make my life much more easier.. 😉
Thanks,
Supreet
Hi Supreet,
Your life will be made much more easier someday
They will eventually be available. I need to make a few changes to Selenium IDE itself first.
Cheers,
Samit
How do you see the test results once they are saved?
Hi Cameron,
You can open the saved file in a Web Browser like Firefox, Chrome, Safari or Internet Explorer to view it.
Cheers,
Samit
I am using Selenium IDE 2.0.0 With FF Version 21.0 : Test results not working … when i open to see results …it displays all commands…
Any idea sir, when you will update test results to above new ide and ff.
Hi Suresh,
Thanks for the feedback. I will look into it soon.
Cheers,
Samit
Hi Suresh,
I just checked it with Selenium IDE v2.2.0 and Firefox v22 without any issues. Please update and recheck.
Cheers,
Samit
Hi Samit,
I am facing the same problem as Suresh.. Is that this plugin dont work on firefox 21.
Thanks,
Mamta
Hi Mamta,
I will check it again soon and upload a fix if it not working.
Cheers,
Samit
Hi Samit,
I am currently using Selenium IDE V2.4.0 and FF 24.0. I was able to install the plug in and can see it on the IDE’s Options>Plugins tab. However, the two “Save Test” options that should appear under the File menu are not present. In other words, it seems the IDE accepted the plug in but it did not populate the options on the File menu as it should. Will you please advise what other action I need to take or if a fix is in the works?
Thanks!
Joel
Hi Joel,
Please raise an issue on the Selenium website on Google code.
Cheers,
Samit
Hi Samit,
I installed the plugin and it works fine. But I was interested in knowing if it is possible to save the file automatically rather than saving manually once the test suite if finished compiling.
The reason I am asking this is in case we are running the test suite in an automated env where we have a loop of running the test suite for 100 users for 10 mins in that case it will not be possible for someone to manually save the file each time.
Our objective is to save the test case result in database eventually and generate reports out of it.
Thanks in advance!!
Hi Reet,
There will be a new version out soon which automatically saves the results if the tests are run through the test scheduler.
FYI, a server componenet is also being developed that stores the results in a databse and sends emails and stuff.
Cheers,
Samit
‘Test Results’ works great. The only additional thing I would like is to include the date and time the results file was created at the top of the results page.
Current: Test Suite Results
Proposed: Test Suite Results – 2014-04-11 13:59:23
Thanks,
Jeff
Hi Jeff,
The new versions adds this and a bunch of other pieces of information. Expect a release soon.
Cheers,
Samit
Hi
Is it possible to export the test result in the following format in different columns please?
Columns:
1. S No.
2. Test Case Name
3. Test run date and time
4. Test Result (Pass/Fail/No Run)
Thanks in advance..
Hi Vikas,
It should be possible to build a custom version, when I get some time.
Cheers,
Samit
Hi Samit,
Thankyou for supplying an excellent set of testing addins.
How can I configure Selenium Se to export the test or suite results at the end of a test run?
Preferably with today’s date.
Cheers
Jamie Ingram
Hi Jamie,
Currently there is no way to do this. Selenium IDE is meant to be an interactive tool. Users do a fair amount of debugging and test maintenance where saving a test suite result would not be very useful.
Don’t lose hope though. A new feature for running tests periodically is in the final stages of testing. Tests run using this feature would automatically have the test results saved. There is also a test dashboard that would show all tests that were run and let you view the results.
Cheers,
Samit Badle
It would be greater if it will include the logs as well. (y)