List Performance Tests (Compact 7)
3/12/2014
This test suite measures the frame-rate that is achieved when performing pan and flick gestures on a ListBox. The ListBoxes are populated using data-binding.
Performance logs can be found at: \\release\XRListPerfResults.xml
Test Prerequisites
Your device must meet the following requirements before you run this test.
The following prerequisites must be met to run this test.
The Silverlight for Windows Embedded Performance Test suite can be run on any connected device. Some of the tests may run out of memory on devices with less than 256 MB of memory.
The following table shows the software requirements for the Windows Embedded Compact-based device that will be running the performance test suite. In addition, the run-time image for the devices must include support for Silverlight for Windows Embedded (SYSGEN_XAML_RUNTIME) and CEPerf (IMGCEPERF).
| Requirement | Description |
|---|---|
Tux.exe |
Tux test harness, required for executing the test. |
Kato.dll |
Kato logging engine, required for logging test data |
Gse2.dll |
Utility that generates simulated gesture events |
Subtests
The table below lists the subtests included in this test.
| SubTest ID | Description |
|---|---|
3024347 |
Pan in a list of 1000 items where each item is a simple string |
3024348 |
Pan in a list of 1000 items where each item is a template of strings and PNG images |
3024349 |
Pan in a list of 1000 items where each item is a template of JPG images |
3024350 |
Flick in a list of 1000 items where each item is a simple string |
3024351 |
Flick in a list of 1000 items where each item is a template of strings and PNG images |
3024352 |
Flick in a list of 1000 items where each item is a template of JPG images |
3028437 |
Scroll in a list of 1000 items where each item is a simple string |
3028438 |
Scroll in a list of 1000 items where each item is a template of string and PNG images |
3028439 |
Scroll in a list of 1000 items where each item is a template of JPG images |
Setting Up the Test
For each of the tests it is recommended that you first clear the log file (unless you wish to aggregate the results of a number of tests into a single log file). Enter the following at the command line in order to clear the log file:
log 0x0
y
log -flush
Running the Test
s tux -o -d \release\XRListPerfTests.dll -c data=\release\xamlruntime\test\perf\ListPerf\vspperf.testsuite.xml;repeats=<repeats>;seconds=<seconds>;<UseBaml> -x <test#>
| Argument | Description |
|---|---|
Repeats |
How many times to run the test. 1 is typically a good value. |
Seconds |
How many seconds to run the test. 30 is typically a good value. |
UseBAML |
If this is included, the test will run using a binary form of XAML which loads faster. |
Test# |
Which of the tests to run. Here are the recommended tests: |
(1) Pan in a list of 1000 items where each item is a simple string
(2) Pan in a list of 1000 items where each item is a template of strings and PNG images
(3) Pan in a list of 1000 items where each item is a template of JPG images
(11) Flick in a list of 1000 items where each item is a simple string
(12) Flick in a list of 1000 items where each item is a template of strings and PNG images
(13) Flick in a list of 1000 items where each item is a template of JPG images
(21) Scroll in a list of 1000 items where each item is a simple string
(22) Scroll in a list of 1000 items where each item is a template of strings and PNG images
(23) Scroll in a list of 1000 items where each item is a template of JPG images
Verifying the Test
This test reports a Pass or Fail result.
The logs can be found in the CTK log directory:
| • | Applications Load tests: XRAppLoadPerfScenario.xml |
|---|---|
• |
Background Animation: XRBackgroundAnimationPerfResults.xml |
• |
Image Manipulation: XRImageManipulationPerfResults.xml |
• |
List Performance Tests: XRListPerfResults.xml |
• |
Screen Transitions: XRScreenTransitionPerfResults.xml |
The following values are common performance measurements:
| • | Avg Frame Rate\ChangeAverage - frame per second during Animation, in fps (frames per second) |
|---|---|
• |
Load Image from Resource\Average - average time for loading images from dll resource in microseconds |
• |
Load Image from File\Average - average time for loading images from files, in microseconds |
• |
Create Host From Xaml\Average - average time for loading and parsing xaml and generating the visual element tree, in microseconds |
• |
Paint Element Tree\Average - average time for rendering the visual element tree , in microseconds |
• |
First Paint - time from process launch to the end of the first rendering of the visual element tree, in microseconds |
Troubleshooting the Test
Known issues: Tests with large resources may fail cause lower-end devices to run out of memory, failing the test.
If running from cmd:
Re-run the test from command line with the following parameter at the end: -f Logfile.txt. The log file, which can be found the release directory after the test executes will have more detailed information on the failure.
If running from a test framework:
Open the test framework’s log file for a more detailed information on the failure.
For additional platform specific issues, consult the CTK articles on the TechNet wiki.