We typically target our Test Plans for a beta or final release so we always add all of the Test Suites once. It would be nice if the Add Test Suite mechanism provided an easy way to select multiple suites from the project and add them with one click. I'd even settle for an extra item in the current list titled "All" that would do exactly that.
Feature Request: Add many Test Suites to Test Plan at once
C# API Test Case Result
Does anyone here know how to add a test case result via C# or .net through an API call?
Error while submitting test result to test rail using c#
Hi,
I am receiving this error message while submitting a test result.
"{\"result\":false,\"error\":\"Use of undefined constant GI_MINIAPI_USER_ID - assumed 'GI_MINIAPI_USER_ID'\"}"
Any ideas?
Feature Request: test Start/Stop Progress button location
Hello,
I would like the team to use the start/stop progress buttons when starting a testcase so that we can use the forecasting feature of TestRail.
However, the team feedback has been that it is too cumbersome to go to the testcase level and then press the button. Most of the team is looking at the list of tests in the the testrun view and just changing the status from untested to pass/fail. The team finds going back and forth between testrun and testcase view too annoying just to use this feature.
If the start/stop progress button can appear in the testrun view, I think the team would be much more inclined to use the feature.
Thoughts ?
Ali
New site feature: Market place for apps, code, utilities
I think it would be great to have a marketplace on your site where testrail users can post things we have written on top of the TestRail API.
For example, I would love to post
- plugins for Jenkins, TeamCity, Bamboo which can upload results directly from CI to TestRail
- report templates for next release of TestRail
- sample code in JAVA/C#/Python/etc
Most people will probably just post for free but I can see many who would like to make some $$$. Similar to how you can do this for Bamboo/Teamcity, etc
ALi
Release 3.0?
Hi,
I'm in the middle of implementing TestRail in our organisation. It'll likely be live in the next couple of weeks, and I just wondered whether you had any news on the release date of 3.0?
I know you can't commit to a date, but I guess I'm quite excited and was just asking in the hope that you might share something with us
Thanks,
Bryan.
Project Overview Formatting
I was wondering if it was possible to change the "In the Past 14 Days" graph and data section in the Project Overview viewer to display "For All Time" or any period greater than 14 Days?
Test Runs - finding out test cases that were removed from a Test Run
Is there a way to see a list of test cases that were removed from a test run? I can see passes|failed|blocked but cannot see test cases that were removed from the test run.
Thanks
Deleting test results/changing final status
Hi there,
I'm in the final stages of evaluating TestRail for our future test management, and I have had a great time with it so far. It was very easy to start using and customising straight away.
Two questions
1. When I order results by filtering according to column headings in test runs, and then go to print the test run, it prints the overview unfiltered. I was a little confused by this as it was great to be able to sort the tests based on status, having them grouped, and it would be nice to print them with the filter on. Is there something I'm not doing?
2. Because I have been entering things in a hurry there have been a couple of times where I've set the test results with the individual test statuses and then forgotten to set the correct overall final status, or accidentally pressed enter and the whole thing is entered without me finishing the results. When I edit the test results I can change the individual step result status, but not the overall result status. So I thought, fair enough, I'll just delete that result and enter a new one, but it appeared as though results can't be deleted. Is there a solution to this that I'm missing?
Thanks in advance,
Bethani
Email Notifications
Hi,
I cant find any comprehensive documentation on testrail email notifications.
I know that emails are sent out to newly added testrail users. Can you possibly give me a list of scenarios where emails are sent from an admin point of view?
Eg. Are emails sent out when users are assigned/removed from project? When projects are marked as completed? When fields are added to a project?
Feature Request - audit log for test plans or test runs
It would be really nice from an auditing perspective if we could track changes made to test plans (or test runs). By changes, I mean the addition or subtraction of test cases or test suites (in the case of a test plan).:)
UI Script that accesses "Runs Completed"
Hey again,
I'm trying to write a few UI scripts. Is it possible for me to access the data that testruns accesses to read "Total Runs Completed"? Or if not that, access the "# of tests Passed. # Blocked" etc? I just want to have my script display this data elsewhere. Doesn't matter where for now, just trying to access them in general.
UI Script to set default sorting of Test Runs
Is it possible to change the default sort value for test runs to be by Status_ID? To give you a scale of what I want to reference it could pertain to either the individual grouping of test cases within a run to their status ID or the entire document of test runs to status ID.
I've tried two UI Scripts, one running App.Tables.group_by = 'cases:status_id'; and the other running App.Runs.setTestGrouping('tests:status_id');.
Currently neither of my scripts work. I'm not sure if that means I'm referencing these calls incorrectly(I'm not extremely familiar with javascript, learning as I go) , or if these are default values set by test rails that override my UI Scripts.
Any help would be appreciated.
API error "Maximum POST size was exceeded"
I am trying to use the API and I am receiving an error: "Maximum POST size was exceeded".
my post looks like this:
/index.php?/miniapi/add_result/36908&key=mykey
{"status_id":1,"comment":"Automated Test Passed."}
Headers:
Accept: application/json
Content-Length: 66
Content-Type: application/x-www-form-urlencoded; charset=utf-8
etc...
I'm using FireFox 21.0
I've tried changing the Content-Type "application/json" to "application/x-www-form-urlencoded" but no change.
Any ideas of what the issue is?
Forecasting calculations
I am trying to look into forecasting feature of TestRail and I have a questions.
1. Is forecasting based on test case estimate or based on elapsed time field or both? I can definitely ask the team to bulk update estimate filed. However getting the team to use elapsed as they run test will take some time.
2. does forecasting take into account the resources ?
Thanks
Ali
version and milestone column purpose in testrun
Hello,
I notice that when selecting what columns to display in the test run view, there are two columns which dont see to have any purpose
1. version
2. milestone
Both of these seems to be built in column are not in my testrail customizations. Even though test plan is part of my milestone, it doesn't show the milestone in this column. Am I doing something wrong?
Ali
Retrieve value of a custom field for a specific test using mini API.
Hi,
I would like to retrieve the value of a custom field from the last time a test was run to compare against the results of the current test run (we are intending on storing a performance test result in the custom field, and then automatically comparing it to see if there has been any significant degradation).
I can work out the ID for the test that I need to compare the data with, and I was hoping that
index.php?/miniapi/get_test/<test_id>
would give me the value of the custom field, but it isn't in the data returned from this call. I noticed that the comments and the defect list fields also aren't provided, and it would be good to be able to see these too.
Is there any way to get this information via HTTP?
General Feedback/Questions
Hi,
My testers have raised the following questions/feedback.
I think the answer to most of them is no, but please correct me if I'm wrong and consider these things for future releases.
1. When creating a test case, can the test step box size be configurable? Maybe make it bigger or make is an expandable box.
2. When creating a test case, ds there a keyboard step for adding a new step?
3. Can a Save and Cancel button be added to the top as well as the bottom of the add test case screen?
4. Is it possible to export a single test case or a group of test cases from within a Suite or Run?
5. When creating a Test Case, can we copy single/multiple test steps/expected results, rather than just the contents of one individual field?
6. When adding a Suite to a Plan/Run, the default option is to include all Test Cases in the Suite. This doesn't work for us and we'll always select the ones we want. Is there a way to prevent the default option from including everything, or at least making it clearer that all have been included?
7. Can the permissions be changed to allow individuals to delete just the things they have created?
Thanks
API requires application/json
I'm working on an integration at the JSON API level that is running into some challenges. When we try to do a jquery ajax call, we receive errors that we can't call it because it doesn't exist on the same server. The alternative is using JSONP.
However, with JSONP, there is no way to set the Accept: header to application/json. The result is an ongoing error indicating that we haven't passed the right accept header. Is it truly critical to fail on this small detail, because it seems to be preventing us from integrating it into our defect system.
Thanks
History or logging of deleting a Test Case
Is there any where in TestRail that shows that a Test Case has been deleted? I can't seem to find a record of this happening.
Certainly deleting a Test Suite shows on the Project overview page, but while it may be hiding somewhere, I can't see a record if just a Test Case (or cases) has been deleted from a Test Suite.
I would note that currently only our Admin has the permission to delete Suites and Cases, but it would still be good to know that there was some indication within TestRail that such an event had occurred.
Neil