Conformance Test Suite: NSG WFS 2.0 Profile

Scope

This executable test suite (ETS) verifies the conformance of the implementation under test (IUT). Conformance testing is a kind of “black box” testing that examines the externally visible characteristics or behaviors of the IUT while disregarding any implementation details.

Several conformance classes are defined in the principal specifications; the ones listed below are covered by this test suite:

  • NSG Basic WFS Conformance Class
    • The service shall comply with the DGIWG Basic WFS conformance class as extended and restricted by this specification.
  • NSG Locking WFS
    • The service shall comply with the DGIWG Locking (Transactional) WFS conformance class as extended and restricted by this specification.
  • Inheritance
    • The service shall implement the schema-element() function for XPath expressions.
  • Remote Resolve
    • The service shall implement the ability to resolve remote resource references.
  • NSG Manage Stored Queries
    • The service shall implement the CreateStoredQuery and the DropStoredQuery operations.
  • SOAP
    • The service shall implement XML encoded requests and results within SOAP Envelopes.
  • Enhanced Paging
    • The service shall implement the ability to return the page specified by the user from a set of response features or values.

Test coverage

Some optional conformance classes are not covered by the test suite. The following capabilities are not tested:

  • Inheritance
  • Remote resolve

As a request timeout cannot be produced by a test suite, tests for following requirements are restricted:

  • Requirement 12 - OperationProcessingTimeout is not tested.
  • Requirement 15 - Is not tested as request timeout is required.

Hints:

  • Requirements 22 and 24 are included in NSG Basic WFS Conformance Class test group. However, the specification states that these two requirements should be included in NSG Locking WFS Conformance Class test group. Due to technical reasons this is not possible.

Test suite structure

The test suite definition file (testng.xml) is located in the root package, org.opengis.cite.wfs20.nsg. A conformance class corresponds to a <test> element, each of which includes a set of test classes that contain the actual test methods. The general structure of the test suite is shown in Table 1.

Table 1 - Test suite structure
Conformance class Test packages and classes
Preconditions
  • org.opengis.cite.iso19142.SuitePreconditions
All GML application schemas
  • org.opengis.cite.iso19136.general.XMLSchemaTests
  • org.opengis.cite.iso19136.general.GeneralSchemaTests
  • org.opengis.cite.iso19136.general.ModelAndSyntaxTests
  • org.opengis.cite.iso19136.general.ComplexPropertyTests
GML application schemas defining features
  • org.opengis.cite.iso19136.components.FeatureComponentTests
NSG Basic WFS Conformance Class
  • org.opengis.cite.iso19142.simple
  • org.opengis.cite.iso19142.basic
  • org.opengis.cite.iso19142.basic.filter
  • org.opengis.cite.iso19142.basic.filter.temporal
  • org.opengis.cite.iso19142.basic.filter.spatial
  • org.opengis.cite.iso19142.paging
  • org.opengis.cite.iso19142.versioning
  • org.opengis.cite.iso19142.joins.SpatialJoinTests
  • de.latlon.ets.wfs20.core.dgiwg.testsuite.getcapabilities.GetCapabilitiesKeywordTest
  • de.latlon.ets.wfs20.core.dgiwg.testsuite.getcapabilities.GetCapabilitiesVersionTest
  • de.latlon.ets.wfs20.core.dgiwg.testsuite.getcapabilities.GetCapabilitiesFeatureTypeElementsTest
  • de.latlon.ets.wfs20.core.dgiwg.testsuite.describestoredqueries.DescribeStoredQueriesElementsTest
  • de.latlon.ets.wfs20.core.wfs20.testsuite.basic.filter.PropertyIsBetweenOperatorTests
  • de.latlon.ets.wfs20.core.wfs20.testsuite.spatialfilter.SpatialFilterTest
  • de.latlon.ets.wfs20.core.wfs20.testsuite.spatialfilter.ExtendedSpatialFilterTest
  • de.latlon.ets.wfs20.core.wfs20.testsuite.temporalfilter.TemporalFilterTest
  • de.latlon.ets.wfs20.core.wfs20.testsuite.temporalfilter.ExtendedTemporalFilterTest
  • de.latlon.ets.wfs20.core.dgiwg.testsuite.getcapabilities.GetCapabilitiesSrsTest
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.CapabilitiesServiceBindings
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.ServiceConstraints (partly)
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.OperationConstraints (partly)
  • org.opengis.cite.wfs20.nsg.testsuite.describefeaturetype.DescribeFeatureTypeOutputFormat
  • org.opengis.cite.wfs20.nsg.testsuite.getfeature.GetFeatureOutputFormat
  • org.opengis.cite.wfs20.nsg.testsuite.getfeaturewithlock.GetFeatureWithLockOutputFormat
  • org.opengis.cite.wfs20.nsg.testsuite.getpropertyvalue.GetPropertyValueOutputFormat
  • org.opengis.cite.wfs20.nsg.testsuite.pageresults.PageResultsOutputFormat
  • org.opengis.cite.wfs20.nsg.testsuite.featureinstance.InstanceIdentifier
  • org.opengis.cite.wfs20.nsg.testsuite.getfeature.CountParameter
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.CapabilitiesAbstract
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.CapabilitiesProfile
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.CapabilitiesTimeout
  • org.opengis.cite.wfs20.nsg.testsuite.getfeature.GetFeatureWIthResultTypeIndex
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.AccessConstraints
NSG Locking WFS
  • org.opengis.cite.iso19142.transaction.TransactionCapabilitiesTests
  • org.opengis.cite.iso19142.transaction.Update
  • org.opengis.cite.iso19142.transaction.InsertTests
  • org.opengis.cite.iso19142.transaction.ReplaceTests
  • org.opengis.cite.iso19142.transaction.DeleteTests
  • org.opengis.cite.iso19142.locking.LockingCapabilitiesTests
  • org.opengis.cite.iso19142.locking.LockFeatureTests
  • org.opengis.cite.iso19142.locking.GetFeatureWithLockTests
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.ServiceConstraints (partly)
Inheritance Not tested yet
Remote Resolve
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.OperationConstraints (partly)
NSG Manage Stored Queries
  • org.opengis.cite.iso19142.querymgmt
Enhanced Paging
  • org.opengis.cite.wfs20.nsg.testsuite.getcapabilities.ServiceConstraints(partly)
  • org.opengis.cite.wfs20.nsg.testsuite.pageresults.PageResults

The Javadoc documentation provides more detailed information about the test methods that constitute the suite.

How to run the tests

The test suite may be run in any of the following environments:

  • Integrated development environment (IDE): The main Java class is org.opengis.cite.wfs20.nsg.TestNGController.
  • REST API: Submit a request that includes the necessary arguments to the test run controller (/rest/suites/wfs20-nsg/0.2/run).
  • TEAM Engine: Run the CTL script located in the /src/main/ctl/ directory.

The test run arguments are summarized in Table 2. The Obligation descriptor can have the following values: M (mandatory), O (optional), or C (conditional).

Table 2 - Test run arguments
Name Value domain Obligation Description
wfs URI M A URI that refers to a representation of the service capabilities document. This document does not need to be obtained from the service under test (SUT), but it must describe the SUT. Ampersand ('&') characters appearing within a query parameter value must be percent-encoded as '%26'.
fid NCName M An identifier that matches the @gml:id attribute value of an available featureinstance.

Note: A test method is skipped if any preconditions were not satisfied. Test prerequisites are usually checked in a configuration method; the results of these can be viewed in the TestNG report by selecting the “Config” check box.