NSG – Web Map Tile Service 1.0 Profile Conformance Test Suite

Scope

This test suite verifies that a WMTS implementation conforms to the NSG Web Map Tile Service 1.0 Implementation Interoperability Profile, v1.0.0 (NGA.STND.0063_1.0_WMTS, 2016-09-15). The aim is to cover the MANDATORY and RECOMMENDED capabilities stipulated in all relevant specifications.

Note that this profile extends and restricts the specifications upon which it is based. The main dependencies are:

  • OGC WMTS 1.0.0 (REST, KVP bindings) [OGC 07-057r7]

Visit the project documentation website for more information, including the API documentation.

Conformance testing is a kind of “black box” testing that examines the externally visible characteristics or behaviors of the IUT while disregarding any implementation details.

What is tested

  • The requirements 2 - 17 and 19 and 20 from WMTS 1.0 NSG Profile are currently tested. Limitations are documented below.

What is not tested

  • The OGC WMTS 1.0.0 test suite is not included in this test suite.
  • A WMTS 1.0 NSG Profile service must also be compliant to the (core) WMTS standard. This means that the WMTS 1.0 (core) tests must be passed. Currently, the OGC WMTS 1.0 test suite is not included in this test suite. For this reason, it is required to execute the WMTS 1.0 test suite separately to ensure that the service is compliant to the WMTS 1.0 NSG Profile.
  • Currently, the following requirements from WMTS 1.0 NSG Profile are not or incompletely tested:

    • Requirement 1 is not tested. The test pass if requirements 2, 4, 5, 7, 8, and 10 are successful.
    • Requirement 11: The CRS of the GetTile response is not tested
    • Requirement 14: The requirement ‘A response to a “GetCapabilities” request in English language’ is skipped.
    • Requirement 18 is not tested as it is optional

Test requirements

The documents listed below stipulate requirements that must be satisfied by a conforming implementation.

  1. NGA.STND.0063_1.0_WMTS
  2. Web Map Tile Service Implementation Specification, Version 1.0.0 ( 07-057r7)

If any of the following preconditions are not satisfied then all tests in the suite will be marked as skipped.

  1. WMS capabilities document must be available.

Test suite structure

The test suite definition file (testng.xml) is located in the root package, org.opengeospatial.cite.wmts10.nsg. A group corresponds to a <test> element, each of which includes a set of test classes that contain the actual test methods. The general structure of the test suite is shown in Table 1.

Table 1 - Test suite structure
Group Test classes
Preconditions org.opengeospatial.cite.wmts10.nsg.ets.testsuite.Prerequisites
NSG Test A.3 - Server Test Module; Requirement 1 Not yet tested (Reqirement is passed when Requirements 2, 4, 5, 7, 8, and 10 pass)
NSG Test A.3 - Server Test Module; Requirement 2 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesOperations
NSG Test A.3 - Server Test Module; Requirement 3 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesSoap
NSG Test A.3 - Server Test Module; Service Metadata Content Test (Requirements 4,7 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.ServiceMetadataContent
NSG Test A.3 - Server Test Module; Requirement 4 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesRest
NSG Test A.3 - Server Test Module; Requirement 5 org.opengeospatial.cite.wmts10.nsg.testsuite.gettile.GetTileParametersKvp
NSG Test A.3 - Server Test Module; Requirement 6 org.opengeospatial.cite.wmts10.nsg.testsuite.gettile.GetTileParametersSoap
NSG Test A.3 - Server Test Module; Requirement 7 org.opengeospatial.cite.wmts10.nsg.testsuite.gettile.GetTileParametersRest
NSG Test A.3 - Server Test Module; Requirement 8 org.opengeospatial.cite.wmts10.nsg.testsuite.getfeatureinfo.GetFeatureInfoKvp
NSG Test A.3 - Server Test Module; Requirement 9 org.opengeospatial.cite.wmts10.nsg.testsuite.getfeatureinfo.GetFeatureInfoSoap
NSG Test A.3 - Server Test Module; Requirement 10 org.opengeospatial.cite.wmts10.nsg.testsuite.getfeatureinfo.GetFeatureInfoRest
NSG Test A.3 - Server Test Module; Requirement 11 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesCrsTest
NSG Test A.3 - Server Test Module; Requirement 12 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesProjectionTest
NSG Test A.3 - Server Test Module; Requirement 13 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesWellKnownScaleTest
G Test A.3 - Server Test Module; Requirement 14 org.opengeospatial.cite.wmts10.nsg.testsuite.gettile.GetTileOfferings
G Test A.3 - Server Test Module; Requirement 15 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesKvpVersionTest
G Test A.3 - Server Test Module; Requirement 16 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesSoapVersionTest
G Test A.3 - Server Test Module; Requirement 17 org.opengeospatial.cite.wmts10.nsg.testsuite.getcapabilities.GetCapabilitiesKeywordTest
G Test A.3 - Server Test Module; Requirement 18 Test is missing as it is optional.
G Test A.3 - Server Test Module; Requirement 19 org.opengeospatial.cite.wmts10.nsg.testsuite.gettile.GetTileCachingInfo
G Test A.3 - Server Test Module; Requirement 20 org.opengeospatial.cite.wmts10.nsg.testsuite.getfeatureinfo.GetFeatureInfoResponse

The Javadoc documentation provides more detailed information about the test methods that constitute the suite.

Test run arguments

The test run arguments are summarized in Table 2. The Obligation descriptor can have the following values: M (mandatory), O (optional), or C (conditional).

Table 2 -Test run arguments
Name Value domain Obligation Description
wmts URI M A URI that refers to the implementation under test or metadata about it. Ampersand ('&') characters must be percent-encoded as '%26'.