Define the initial configuration of Test Manager

Azure DevOps Server 2022 - Azure DevOps Server 2019 | TFS 2018 - TFS 2013

By using the plug-in for Microsoft Test Manager, you can define a project's initial test management setup. You can define settings such as test variables and test configurations that combine test variables. For example, you can define the hardware platform, the operating system, the browser version, or another type of hardware or software to be used for testing, and then you can define test configurations that combine these variables. In addition, you can customize the default test settings and the list of valid test resolution states. After you create a project, you can modify each test configuration through Microsoft Test Manager except for test resolution states.

The test management plug-in file is provided with the default process templates. Microsoft Test Manager is available with Visual Studio Ultimate (2015), Visual Studio Enterprise, and Visual Studio Test Professional. For more information, see Testing overview.

The names of the file, the folder, and the plug-in for the default process templates are as follows:

File name: testmanagement.xml
Folder name: Test Management
Plug-in name: Microsoft.ProjectCreationWizard.TestManagement

Test Management tasks and dependencies

In the testmanagement.xml file, you specify one or more tasks and their dependencies. The plug-in file specifies four tasks, and each task uploads a test management file. The testconfiguration.xml file depends on the information that is specified in the testvariable.xml file. For more information about the task, taskXml, and dependency elements, see Define the tasks to process a plug-in and Define dependencies for task groups and tasks.

The following syntax represents the default testmanagement.xml file that is defined for the default process templates:

<?xml version="1.0" encoding="utf-8"?>  
<tasks>  
  <task id="TestVariable" name="Default test variables" plugin="Microsoft.ProjectCreationWizard.TestManagement" completionMessage="Default test variables created">  
    <taskXml>  
      <TestVariables fileName="Test Management\TestVariable.xml" />  
    </taskXml>  
  </task>  
  <task id="TestConfiguration" name="Default test configurations" plugin="Microsoft.ProjectCreationWizard.TestManagement" completionMessage="Default test configurations created">  
    <dependencies>  
      <dependency taskId="TestVariable" />  
    </dependencies>  
    <taskXml>  
      <TestConfigurations fileName="Test Management\TestConfiguration.xml" />  
    </taskXml>  
  </task>  
  <task id="TestSettings" name="Default test settings" plugin="Microsoft.ProjectCreationWizard.TestManagement" completionMessage="Default test settings created">  
    <taskXml>  
      <TestSettings fileName="Test Management\TestSettings.xml" />  
    </taskXml>  
  </task>  
  <task id="TestResolutionState" name="Default test resolution states" plugin="Microsoft.ProjectCreationWizard.TestManagement" completionMessage="Default test resolution states created">  
    <taskXml>  
      <TestResolutionStates fileName="Test Management\TestResolutionState.xml" />  
    </taskXml>  
  </task>  
</tasks>  

Define test configuration variables

You use the TestVariable and AllowedValue elements to define test configuration variables. You can define any number of test configuration variables and their valid values. The following values are defined in the testvariable.xml file in the default process templates:

• Operating systems:

  • Windows Vista
  • Windows XP

• Default browsers:

  • Internet Explorer 7.0
  • Internet Explorer 8.0
  • Firefox 3.0

  After the project is created, you can modify these variables and create other variables. For more information, see Test configurations: specifying test platforms.

  The TestVariable element must be encapsulated within its corresponding container element: TestVariables. You use the following syntax structure for these elements:

<TestVariables>  
   <TestVariable name="VariableName" name="Operating System" description="Description of VariableName">  
        <AllowedValue value ="Name of Allowed Value"/>  
    </TestVariable>  
</TestVariables>  

You use the following syntax for the test variables that are defined in the default process templates:

<?xml version="1.0" encoding="utf-8" ?>  
<TestVariables>  
  <TestVariable  
                name="Operating System" description="Default operating systems">  
    <AllowedValue value ="Windows 8" />  
    <AllowedValue value ="Windows 7" />  
    <AllowedValue value ="Windows Vista" />  
    <AllowedValue value ="Windows XP" />  
  </TestVariable>  
  <TestVariable  
                name="Browser" description="Default browsers">  
    <AllowedValue value ="Internet Explorer 9.0" />  
    <AllowedValue value ="Internet Explorer 8.0" />  
    <AllowedValue value ="Internet Explorer 7.0" />  
    <AllowedValue value ="FireFox 3.0" />  
    <AllowedValue value ="Internet Explorer 10.0" />  
  </TestVariable>  
</TestVariables>  

Define test configurations

You use the TestConfiguration and TestVariable elements to define test configurations that combine one or more test configuration variables. One default configuration is defined in the testconfiguration.xml file: Windows Vista and Internet Explorer 7.0. After the project is created, you can delete these configurations and create other configurations. For more information, see Test configurations: specifying test platforms.

You must encapsulate the TestConfiguration element within its corresponding container element: TestConfigurations. You use the following syntax structure for these elements:

<TestConfigurations>  
    <TestConfiguration name="Test Configuration Name" description=" Test Configuration Description " state="active" isdefault="true | false">  
        <TestVariable name="VariableName" value="Variable Value" />  
        <TestVariable name="VariableName" value="Variable Value" />  
    </TestConfiguration>  
</TestConfigurations>  

The following table describes the attributes for the TestConfiguration element.

You use the following syntax for the test configurations that are defined in the default process templates.

<?xml version="1.0" encoding="utf-8" ?>  
<TestConfigurations>  
    <TestConfiguration name="Windows 8"   
                        description="Default operating system for testing" state="active" isdefault="true">  
        <TestVariable   
                        name="Operating System" value="Windows 8" />  
    </TestConfiguration>  
</TestConfigurations>  

Define test resolution states

You use the TestResolutionState element to specify the reasons why a test failed. The following states are defined in the testresolutionstate.xml: Needs investigation, Test issue, Product issue, and Configuration issue.

You must encapsulate the TestResolutionState element within its corresponding container element: TestResolutionStates.

You use the following syntax structure for these elements:

<TestResolutionStates>  
    <TestResolutionState name="ResolutionName" />  
</TestResolutionStates>  

You use the following syntax for the resolution states that are defined in the default process templates.

<?xml version="1.0" encoding="utf-8" ?>  
<TestResolutionStates>  
    <TestResolutionState name="Needs investigation" />  
    <TestResolutionState name="Test issue" />  
    <TestResolutionState name="Product issue" />  
    <TestResolutionState name="Configuration issue" />  
</TestResolutionStates>  

Define the default test settings for a local test run

You use the TestSetting element to specify the name of the file to use when a test is run. The following file is defined in the testsettings.xml: localrun.testsettings. For more information, see Setting Up Test Machines to Run Tests or Collect Data.

You must encapsulate the TestSetting element within its corresponding container element: TestSettings. You use the following syntax structure for these elements:

<TestSettings>  
    <TestSetting name="Name of Test Setting " filename="FileName" />  
</TestSettings>  

You use the following syntax for the testsettings.xml file that is defined in the default process templates.

<?xml version="1.0" encoding="utf-8" ?>  
<TestSettings>  
    <TestSetting name="Local Test Run" filename="localrun.testsettings" />  
</TestSettings>  

Related articles

• Testing overview
• Customize and manage the test experience