Bugs‌ ‌found‌ ‌in‌ TestRail SaaS

TestRail

TestRail is a web-based platform designed for testers, developers, and team leaders to streamline software testing processes, gain real-time visibility into QA, and deliver exceptional solutions.

The platform seamlessly connects with DevOps pipelines, issue-tracking tools, and popular test automation frameworks like JUnit, Cypress, and Robot Framework. Users can easily log test results for various versions and environments, add screenshots and attachments, and create reports. TestRail is already trusted by more than 10,000 QA teams to handle test repositories, devise test plans, monitor test progress, and produce comprehensive reports.

Here is a detailed report from our QA team after crawling TestRail SaaS for bugs.

Error occurs when clicking on search field

Severity:

Critical

Precondition:

Log in to the account.

Steps to Reproduce:
  1. Click the “Add Example Project” button.
  2. Enter a project name.
  3. Click the “Add Example Project” button again.
  4. Close the popup.
  5. Click the search field.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

An error occurs when clicking on the search field.

Expected Result:

There should be no error when clicking on the search field.

Error occurs when clicking on search field
Error occurs when clicking on search field

Error "Robot verification failed" is displayed during registration

Severity:

Major

Precondition:

Visit the main page of the site https://www.testrail.com/.

Steps to Reproduce:
  1. Click the “Try TestRail” button.
  2. Fill in the following fields: “First Name”, “Last Name”, “Work Email” (an email you have access to), “Company Name”, “Country”, and “Web Address”.
  3. Select an option from the “How many users do you expect to access TestRail?” dropdown list.
  4. Check the box labeled “I agree to the TestRail Cloud Terms of Service, the Gurock Privacy Policy, and the Gurock Data Processing Agreement (DPA).”
  5. Click the “Create an Account” button.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Microsoft Edge v. 116.0.1938.76

Actual Result:

An error message, “Robot verification failed,” appears during registration, even though there are no captchas on the registration page.

Expected Result:

There should not be any “Robot verification failed” error during the registration process.

Error Robot verification failed is displayed during registration

Defect for this case is not saved

Severity:

Major

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
    1. Go to the Example Project page from the Todos list.
    2. In the list, click on “Browser test (Chrome) (83).”
    3. Go to the task “Verify title, subtitle, and heading styles.”
    4. Click on the “Defects” button.
    5. Click on the “Push New Defect” button.
    6. Fill in the following fields: “Title”, “Project”, “Area”, and “Priority”.
    7. Click the “Submit” button.
    8. Remember the defect ID.
    9. Close the popup.
    10. Click on the “View case” button.
    11. Click on the “Defects” button.
    12. Verify the defect ID displayed in the list.

 

Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The defect for this case is not saved.

Expected Result:

The defect for this case should be saved.

Pages have different number of “Passed test cases”

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Go to the Example Project page from the Todos list.
  2. In the list, click on “Browser test (Chrome) (83).”
  3. Check the number of Passed test cases on the pie chart.
  4. Click on the “Activities” button in the side menu.
  5. Check the number of Passed test cases.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

Pages have varying numbers of “Passed test cases”.

Expected Result:

Passed test cases for the same checklist should be consistent across different pages.

When sending test case for printing, paragraphs disappear

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Go to the Example Project page from the Todos list.
  2. In the list, click on “Browser test (Chrome) (83).”
  3. Click on the “Test cases” button in the top menu.
  4. Click on the “Add test case” button.
  5. Fill in the following fields: “Title”, “Section”, “Template”, “Type”, and “Priority”.
  6. In the “Preconditions” field, enter text in 3-5 paragraphs.
  7. In the “Steps” field, enter text in 3-5 paragraphs.
  8. Click the “Add test case” button.
  9. Click the print button.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

When sending the test case for printing, paragraphs disappear.

Expected Result:

When printing, the content should not lose its formatting.

Example Project is not added to account when clicking on “Create an Example Project” field

Severity:

Minor

Precondition:
  1. Register with any email provider.
  2. Go to the main page of the site https://www.testrail.com/.
Steps to Reproduce:
  1. Click on the “Try TestRail” button.
  2. Fill in the following fields: “First Name”, “Last Name”, “Work Email” (an email to which you have access), “Company Name”, “Country”, and “Web Address”.
  3. Choose an option from the drop-down list for “How many users do you expect to access TestRail?”.
  4. Check the box indicating “I agree to the TestRail Cloud Terms of Service, the Gurock Privacy Policy, and the Gurock Data Processing Agreement (‘DPA’).”
  5. Click the “Create an Account” button.
  6. Open your email inbox.
  7. Locate and open emails from the TestRail Team.
  8. Follow the link in the email to confirm your email.
  9. Wait for the account to be created.
  10. Click on the information numbers indicating the current step, e.g., “1/3.”
  11. Click on “2/3.”
  12. Click the “Done” button.
  13. Click on the “Create an Example Project” field.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The Example Project is not added to the account when clicking on the “Create an Example Project” field.

Expected Result:

The Example Project should be added to the account when clicking on the “Create an Example Project” field.

No left-side margin for all placeholders and input fields

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Go to the Example Project page from the Todos list.
  2. In the list, select “Browser test (Chrome) (83).”
  3. Click the “Test cases” button in the top menu.
  4. Choose “Add test case.”
  5. Begin filling in the following fields: “Title”, “Estimate”, and “References”.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

There is no left-side margin for all placeholders and input fields.

Expected Result:

All placeholders and input fields are single-line types and should include a left-side margin.

No left-side margin for all placeholders and input fields
No left-side margin for all placeholders and input fields
No left-side margin for all placeholders and input fields

Status of test case does not fit within page

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Navigate to the Example Project page from the Todos list.
  2. Within the list, select “Browser test (Chrome) (83).”
  3. Click on the right-facing arrow next to any of the test cases.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The status of the test case does not fit within the page.

Expected Result:

The status of the test case should fit within the page.

Status of test case does not fit within page

“Next” button is not only one that switches to next step

Severity:

Minor

Precondition:
  1. Register an email with any email provider.
  2. Go to the main page of the site https://www.testrail.com/.
Steps to Reproduce:
  1. Click on the “Try TestRail” button.
  2. Fill in the following fields: “First Name”, “Last Name”, “Work Email” (an email to which you have access), “Company Name”, “Country”, and “Web Address”.
  3. Choose an option from the drop-down list for “How many users do you expect to access TestRail?”.
  4. Check the box indicating “I agree to the TestRail Cloud Terms of Service, the Gurock Privacy Policy, and the Gurock Data Processing Agreement (‘DPA’).”
  5. Click the “Create an Account” button.
  6. Open your email inbox.
  7. Open emails from the TestRail Team.
  8. Follow the link to confirm your email.
  9. Wait for the account to be created.
  10. Click on the information numbers that indicate the current step, e.g., “1/3.”
  11. Click on “2/3.”
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The “Next” button is not the only one that switches to the next step.

Expected Result:

The “Next” button should be the only option to switch to the next step.

Not all elements of pie chart legend are displayed

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Navigate to the Example Project page from the Todos list.
  2. In the list, select “Browser test (Chrome) (83).”
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

Not all elements of the pie chart legend are displayed.

Expected Result:

All elements of the pie chart legend should be displayed.

Not all elements of pie chart legend are displayed

Comment field is not empty by default

Severity:

Minor

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Navigate to the Example Project page from the Todos list.
  2. In the list, locate and click on “Browser test (Chrome) (83).”
  3. Click on the “Test cases” button in the top menu.
  4. Select “Add test case” from the dropdown menu.
  5. Complete the following fields: “Title”, “Section”, “Template”, “Type”, and “Priority”.
  6. Click the “Add test case” button.
  7. Click on the “Defects” button.
  8. Choose “Push New Defect” from the options.
  9. Click on the comment field on the right.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The comment field is not empty by default.

Expected Result:

The comment field should be empty by default.

Cross button for filters is shifted upwards

Severity:

Trivial

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Go to the Example Project page from the Todos list.
  2. Click on “Browser test (Chrome) (83)” in the list.
  3. Click “None” next to Filter.
  4. Select “Assigned To” and choose yourself from the list.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The cross button for filters has been shifted upwards.

Expected Result:

The cross button should align with its corresponding applied filter.

Cross button for filters is shifted upwards

"Download chart as ..." button is shifted

Severity:

Trivial

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Go to the Example Project page from the Todos list.
  2. In the list, click on “Browser test (Chrome) (83)”.
  3. Go to the task “Verify title, subtitle and heading styles”.
  4. Click on the “View case” button.
  5. Click on the “Defects” button.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The “Download chart as …” and “Download chart as a CSV” buttons have been shifted.

Expected Result:

The buttons should be aligned vertically with each other.

Download chart as ... button is shifted

White search on dark theme

Severity:

Trivial

Precondition:

Log in to the account.

Steps to Reproduce:
  1. Click on your professional account in the top menu.
  2. Choose “My settings” from the menu.
  3. In the “Theme” section, select “Dark” from the dropdown.
  4. Click “Save settings.”
  5. Click on the search field in the top menu.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

A white search bar on a dark theme.

Expected Result:

In a dark theme, the search should have a dark background.

White search on dark theme

Dark theme features white-background graphics

Severity:

Trivial

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Click on your professional account in the top menu.
  2. Select “My settings” from the menu.
  3. In the “Theme” section, choose “Dark” from the dropdown.
  4. Click “Save settings.”
  5. Click “Cancel.”
  6. Navigate to the Example Project page from the Todos list.
  7. In the list, select “Browser test (Chrome) (83).”
  8. Go to the task titled “Verify title, subtitle, and heading styles.”
  9. Click the “View case” button.
  10. Click the “Defects” button.
Environment:

Windows 10 Pro

Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

A dark theme features white-background graphics.

Expected Result:

In a dark theme, graphics should have a dark background.

Dark theme features white-background graphics
Dark theme features white-background graphics

Loading progress block disappears after first picture in pack is loaded

Severity:

Trivial

Precondition:
  1. Log in to your account.
  2. Add an Example Project.
  3. Upload a minimum of 3 images to your computer.
Steps to Reproduce:
  1. Navigate to the Example Project page from the Todos list.
  2. Click “Milestones” in the top menu.
  3. Select “Add Milestones.”
  4. Use the plus sign to add three files from your computer.
  5. Wait for the first file to upload.
Environment:

Windows 10 Pro
Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

The loading progress block disappears after the first picture in the pack is loaded.

Expected Result:

The progress block should not disappear.

In dark theme, file upload block is displayed with white background

Severity:

Trivial

Precondition:
  1. Log in to the account.
  2. Add an Example Project.
Steps to Reproduce:
  1. Click on your professional account in the top menu.
  2. Select “My settings.”
  3. In the “Theme” section, choose “Dark” from the dropdown.
  4. Click “Save settings.”
  5. Click “Cancel.”
  6. Go to the Example Project page from the Todos list.
  7. Click on the “Milestones” button in the top menu.
  8. Select “Add Milestones.”
  9. Use the plus sign to add files twice.
  10. Choose 3 files from your computer.
  11. Wait for the first file to upload.
Environment:

Windows 10 Pro
Chrome v.117.0.5938.62, Firefox v.117.0.1, Microsoft Edge v. 116.0.1938.76

Actual Result:

In the dark theme, the file upload block is displayed with a white background.

Expected Result:

In a dark theme, the file upload block should have a dark background.

In dark theme, file upload block is displayed with white background
To ensure TestRail's quality and reliability, I recommend a mix of functional tools like automated testing frameworks, thorough non-functional tests, including performance assessments for scalability and responsiveness, and usability and compatibility testing across browsers and devices.
Iryna, QA engineer

Iryna, QA engineer

Need a reliable QA partner?

Hire us