Skip to main content

Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "COSMOS QA End2End Tests"

Line 477: Line 477:
 
== Scalability/Stability Tests ==
 
== Scalability/Stability Tests ==
  
 +
= References =
 +
* http://wiki.eclipse.org/COSMOS_Use_Cases
 +
* http://wiki.eclipse.org/COSMOS_QA_i11_Activities
 +
* http://wiki.eclipse.org/COSMOS_i10_QA_Phase_Execution
  
 
[[Category:COSMOS_Bugzilla_Designs]]
 
[[Category:COSMOS_Bugzilla_Designs]]

Revision as of 08:10, 22 May 2008

Overview

The purpose of this page is to articulate all COSMOS End-to-End test scenarios for QA testing. This page will be filled in by the QA team and will be updated with every new iteration.

COSMOS Installation

As a pre-requisite for below test scenarios, install the COSMOS application as per the instructions available at http://wiki.eclipse.org/COSMOS_DEMO_i11#Installation

COSMOS End2End Tests

Build Installation and Configuration

Test Description:

  1. <cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

Expected Result:

Starting COSMOS components : Management Console

Test Description:

  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker

Expected Result:

Test Description:

  1. COSMOS> broker registerAllDataManagers

Expected Result:

Test Description:

  1. COSMOS> broker getDataManagers

Expected Result:

Test Description:

  1. COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp StatDataManager

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp LoggingDataManager

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp TestFederatingCMDB

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp ExampleMdr

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp SMLMDR

Expected Result:

Test Description:

  1. COSMOS> broker deregister domsr01-xp AperiMdr

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt

Expected Result:

Test Description:

  1. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt

Expected Result:

Test Description:

  1. COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt

Expected Result:

Using the COSMOS Web User Interface

Test Description:

  1. http://localhost:8080/COSMOSUI/?page=cosmos

Expected Result:

Test Description:

  1. StatDataManager
  2. server 33 tomcat1181829221515 CBE

Expected Result:

Test Description:

  1. StatDataManager
  2. server 33 tomcat1181829221515 TomcatSet

Expected Result:

Test Description:

  1. LoggingDataManager
  2. access_log.cbe.xml

Expected Result:

Test Description:

  1. LoggingDataManager
  2. windows_app_log.cbe.xml

Expected Result:

Test Description:

  1. Sample Repository with Registration
  2. Submit Query

Expected Result:

Test Description:

  1. Sample Repository with Registration
  2. Register Configuration Items...

Expected Result:

Test Description:

  1. Sample Repository with Registration
  2. Deregister Configuration Items...

Expected Result:

Test Description:

  1. Sample Repository with Registration
  2. Submit Query

Expected Result:

Test Description:

  1. Sample Repository with Registration
  2. View MetaData

Expected Result:

Test Description:

  1. Resource Repository
  2. Submit Query

Expected Result:

Test Description:

  1. Resource Repository
  2. View MetaData

Expected Result:

Test Description:

  1. AperiMDR
  2. Submit Query

Expected Result:

Test Description:

  1. AperiMDR
  2. View MetaData

Expected Result:

Test Description:

  1. Sample Repository with Query
  2. Get All Students

Expected Result:

Test Description:

  1. Sample Repository with Query
  2. Get All Teachers

Expected Result:

Test Description:

  1. Sample Repository with Query
  2. Get All Classes

Expected Result:

Test Description:

  1. Sample Repository with Query

3Staff01 Expected Result:

Test Description:

  1. Sample Repository with Query
  2. Staff02

Expected Result:

Test Description:

  1. Sample Repository with Query
  2. Submit Query

Expected Result:

Test Description:

  1. Sample Repository with Query
  2. View MetaData

Expected Result:

End2End Supplement Tests (Negative)

COSMOS Command Line Client : Management Console

Test Description:

  • Configure tomcat port to 9080 (other than default port : 8080) and test the following:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker

Expected Result:

  1. Should display COSMOS prompt without any errors

Test Description:

  • Test Broker registration other than defaul port 8080 (say 9080):
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker registerAllDataManagers http://localhost:9080/axis2/services/CosmosServiceFinder

Expected Result:

  1. All DataManagers should successfuly get registered to broker on port 9080

Test Description:

  • Test Broker registration multiple times:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker registerAllDataManagers http://localhost:9080/axis2/services/CosmosServiceFinder
  3. COSMOS> broker registerAllDataManagers http://localhost:9080/axis2/services/CosmosServiceFinder

Expected Result:

  1. Under tomcat console window, it should display "Service has already been registered at this broker. No new brokers are registered."

Test Description:

  • Without broker registration, test the following:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker getDataManagers

Expected Result:

  1. Should display empty list of DataManagers

Test Description:

  • After succesful broker registration, test the following:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker getDataManagers

Expected Result:

  1. Should display all 6 DataManagers registered with broker

Test Description:

  • Without any broker registration, test the following
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> finddatamanagers http://localhost:9080/axis2/services/CosmosServiceFinder

Expected Result:

  1. Should display all 6 DataManagers deployed under tomcat with port 9080

Test Description:

  • Test deregistration of StatDataManager with valid hostname and valid datamanager name :
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker deregister domsr01-xp StatDataManager

Expected Result:

  1. Deregistration should be successful

Test Description:

  • Test deregistration of StatDataManager with invalid hostname and valid datamanager name :
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker deregister unknown StatDataManager

Expected Result:

  1. Deregistration should fail and should display appropriate error message

Test Description:

  • Test deregistration of StatDataManager with valid hostname and invalid datamanager name :
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> broker deregister domsr01-xp StatDataMgr

Expected Result:

  1. Deregistration should fail and should display appropriate error message

Test Description:

  • Test graphQuery for SMLMDR, with valid hostname,valid DataManager,valid query path:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Expected Result:

  1. Query execution should be succesful.

Test Description:

  • Test graphQuery for SMLMDR, with invalid hostname,valid DataManager,valid query path:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery unknown SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Expected Result:

  1. Query execution should fail and throw appropriate error message.

Test Description:

  • Test graphQuery for SMLMDR, with valid hostname,invalid DataManager,valid query path:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp StatDataManager D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Expected Result:

  1. Query execution should fail and throw appropriate error message.

Test Description:

  • Test graphQuery for SMLMDR, with valid hostname,valid DataManager,invalid query path:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDRTest\testInstanceIdQuery.txt

Expected Result:

  1. Query execution should fail and throw appropriate error message.

Test Description:

  • Test graphQuery for SMLMDR, with valid hostname,valid DataManager,valid query path with spaces:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp SMLMDR "D:\cosmos i10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt"

Expected Result:

  1. Query execution should be successful

Test Description:

  • Test graphQuery for AperMdr with valid data, with valid Aperi database settings:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt

Expected Result:

  1. Query should execute successfully

Test Description:

  • Test graphQuery for AperMdr with invalid query data, with valid Aperi database settings:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt

Expected Result:

  1. Query execution should fail and display appropriate error message

Test Description:

  • Test graphQuery for AperMdr with valid data, with invalid Aperi database settings:
  1. <cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:9080/axis2/services/Broker
  2. COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt

Expected Result:

  1. Query execution should fail, with DB Connection error

Using the COSMOS Web User Interface

Test Description

  • Open COSMOSUI with 8090 port (Make sure all COSMOS Components are up and running at this port)
  1. http://localhost:8090/COSMOSUI/?page=cosmos

Expected Result:

  1. Should display all 6 DataManagers properly

Test Description:

  • Open COSMOSUI, Verify Properties of all DataManagers
  1. StatDataManager
  2. LoggingDataManager
  3. Sample Repository with Registration
  4. Sample Repository with Query
  5. Resource Repository
  6. AperiMdr

Expected Result:

  1. All properties should display the correct EPR with port 9080

Test Description:

  • Test StatDataManager, "Statistical Report" generation:
  1. StatDataManager : server 33 tomcat1181829221515 CBE

Expected Result:

  1. Statistical Report should get generated properly

Test Description:

  • Test "LoggingDataManager", Top 10 Log Report generation:
  1. LoggingDataManager : access_log.cbe.xml

Expected Result:

  1. Top 10 Log report should get generated properly

Test Description:

  • Test "Sample Repository with Registration",self registration
  1. Select "Sample Repository with Registration"
  2. Click on "Register Configuration Items..."
  3. Select "Sample Repository with Registration" under registration window

Expected Result

  1. Either it should not be allowed or it should display appropriate error message

Test Description:

  • Test "Sample Repository with Registration",Resource Repository registration
  1. Select "Sample Repository with Registration"
  2. Click on "Register Configuration Items..."
  3. Select "Resource Repository" under registration window

Expected Result

  1. Either registration should not be allowed or it should display appropriate error message

Test Description:

  • Test "Sample Repository with Registration",AperiMdr registration
  1. Select "Sample Repository with Registration"
  2. Click on "Register Configuration Items..."
  3. Select "AperiMdr" under registration window

Expected Result

  1. Either registration should not be allowed or it should display appropriate error message

Test Description:

  • Test Resource Repository, with valid query
  1. select "Resource Repository" and click on "Submit Query"
  2. Provide valid query and submit

Expected Result:

  1. Query should execute successfully

Test Description:

  • Test Resource Repository, with invalid query
  1. select "Resource Repository" and click on "Submit Query"
  2. Provide invalid query and submit

Expected Result:

  1. Query should fail with appropriate error message

Test Description:

  • Test AperiMDR with proper db configuration and with valid query
  1. select "AperiMdr" and create valid query using Query Builder

Expected Result:

  1. Query should execute successfully

Test Description:

  • Test AperiMDR with proper db configuration and with invalid query
  1. select "AperiMdr" and create invalid query using Query Builder

Expected Result:

  1. Query execution should fail and display appropriate error message

Test Description:

  • Test AperiMDR with invalid db configuration and with valid query
  1. select "AperiMdr" and create valid query using Query Builder

Expected Result:

  1. Query execution should fail with db connection error

Test Description:

  • Test "Sample Repository with Query", with valid query
  1. select "Sample Repository with Query"
  2. Create a valid query from query builder and submit it

Expected Result:

  1. Query execution should be successful

Test Description:

  • Test "Sample Repository with Query", with invalid query
  1. select "Sample Repository with Query"
  2. Create an invalid query from query builder and submit it

Expected Result:

  1. Should display Empty Query response under GraphResponseViewer

Basic Operational efficiency tests

Concurrency Tests

Volume/Performance Tests

Scalability/Stability Tests

References

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_QA_End2End_Tests&oldid=99257"

Back to the top