Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

COSMOS i11 QA Phase Execution

Revision as of 03:40, 25 June 2008 by Domsr01.ca.com (Talk | contribs) (→‎COSMOS Command Line Client)

QA i11 Execution - Activities

QA Test Execution Activities for i11

Primary Tasks:

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

  • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

  • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
  • SML Tooling - adhoc UI testing for editor/validator/import/export features

Secondary Tasks:

6. Basic operational efficiency tests (limited performance tests)


For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i11_Activities

QA i11 Test Execution Summary

QA i11 Execution - Complete Status


1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Download COSMOS Demo and Prerequisites Passed Passed Passed None
2.Installing COSMOS Web applications and Web Services

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

Passed Passed Passed None
3.Installing COSMOS SDK Passed Passed Passed None
4.Installing Resource Modeling Tooling Passed Passed Passed None

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1. Start the COSMOS Command Line Client

<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker

Passed Passed Passed None
2. Security Header - Set SoapVersion

COSMOS> set soapversion 12

Passed Passed Passed None
3. Security Header - Set Username

COSMOS> set username test

Passed Passed Passed None
4. Security Header - Set Password

COSMOS> set password test123

Passed Passed Passed None
5. Security Header - Show Details

COSMOS> Show

Passed Passed Passed None
6. Register All Data Managers with Broker

COSMOS> broker registerAllDataManagers

Passed Passed Passed None
7. Registering Individual Data Manager with Broker

COSMOS> broker register AperiMdr

Passed Passed Passed None
7a. Registering Individual Data Manager with Broker

COSMOS> broker register SMLMDR

Passed Passed Passed None
7b. Registering Individual Data Manager with Broker

COSMOS> broker register ExampleMdr

Passed Passed Passed None
7c. Registering Individual Data Manager with Broker

COSMOS> broker register TestFederatingCMDB

Passed Passed Passed None
7d. Registering Individual Data Manager with Broker

COSMOS> broker register LoggingDataManager

Passed Passed Passed None
7e. Registering Individual Data Manager with Broker

COSMOS> broker register StatDataManager

Passed Passed Passed None
8. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 AperiMdr http://localhost:8080/axis2/services/AperiMdrDataManager?wsdl http://localhost:8080/axis2/services/AperiMdrQueryService?wsdl

Passed Passed Passed None
8a. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 SMLMDR http://localhost:8080/axis2/services/SmlMdrDataManager?wsdl http://localhost:8080/axis2/services/SmlMdrQueryService?wsdl

Passed Passed Passed None
8b. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8080/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8080/axis2/services/ExampleMdrQueryService?wsdl

Passed Passed Passed None
8c. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 LoggingDataManager http://localhost:8080/axis2/services/LoggingDataManager?wsdl http://localhost:8080/axis2/services/CBEServices?wsdl

Passed Passed Passed None
8d. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 StatDataManager http://localhost:8080/axis2/services/StatisticalDataManager?wsdl http://localhost:8080/axis2/services/StatDataManager?wsdl

Passed Passed Passed None
8e. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 TestFederatingCMDB http://localhost:8080/axis2/services/TestFederatingCMDBDataManager?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBRegistrationService?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBQueryService?wsdl

Passed Passed Passed None
9. Print Broker EPR

COSMOS> broker epr print

Passed Passed Passed None
10. Modifiying Broker EPR

COSMOS> broker epr change http://HOST2:PORT2/axis2/services/Broker

Passed Passed Passed None
11. List All Data Managers Registered with Broker

COSMOS> broker getDataManagers

Passed Passed Passed None
12. Find all DataManagers using CosmosServiceFinder web service

COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

Passed Passed Passed None
13. Deregistering Data Managers from broker

COSMOS> broker deregister host1 StatDataManager

Passed Passed Passed None
13a. COSMOS> broker deregister host1 LoggingDataManager Passed Passed Passed None
13b. COSMOS> broker deregister host1 TestFederatingCMDB Passed Passed Passed None
13c. COSMOS> broker deregister host1 ExampleMdr Passed Passed Passed None
13d. COSMOS> broker deregister host1 SMLMDR Passed Passed Passed None
13e. COSMOS> broker deregister host1 AperiMdr Passed Passed Passed None
14. Executing CMDBf Queries using the command line client

COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Passed Passed Passed Empty Response
14a. COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt Passed Passed Passed Empty Response
15. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt Passed Passed Passed None
15a. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt Passed Passed Passed None
15b. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt Passed Passed Passed None
15c. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt Passed Passed Passed None
16. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml Passed Passed Passed None
16a. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml Passed Passed Passed None
16b. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml Passed Passed Passed None
16c. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml Passed Passed Passed None
16e. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml Passed Passed Passed None
16f. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml Passed Passed Passed None
16g. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml Passed Passed Passed None
16h. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml Passed Passed Passed None
16i. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml Passed Passed Passed None
16j. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml Passed Passed Passed None
16k. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml Passed Passed Passed None
16l. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml Passed Passed Passed None
16m. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml Passed Passed Passed None
16n. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml Passed Passed Passed None
16o. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml Passed Passed Passed None
16p. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml Passed Passed Passed None
16q. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml Passed Passed Passed None
16r. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml Passed Passed Passed None
16s. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml Passed Passed Passed None
16t. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml Passed Passed Passed None
16u. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml Passed Passed Passed None
16v. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml Passed Passed Passed None
16w. COSMOS> COSMOS> graphQuery host1 TestFederatingCMDB C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt Passed Passed Passed None.

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly
2.Data Managers View

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed Found All 6 DataManagers under COSMOS Web UI
3.StatDataManager

server 33 tomcat1181829221515 CBE -> Statistical Report

Passed Passed Passed Statistical Report generated successfully
3a.StatDataManager

StatDataManager -> Properties...

Passed Passed Passed Able to set security properties information
4.LoggingDataManager

access_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully
4a.LoggingDataManager

windows_app_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully
4b.LoggingDataManager

LoggingDataManager -> Properties...

Passed Passed Passed Able to set security information properly
5.Resource Repository (SML MDR)

Resoure Repository->All Computer Systems

Passed Passed Passed Pre-defined CMDBf query for All Computer systems, executed successfully
5a.Resource Repository (SML MDR)

Resoure Repository->All Operating Systems

Passed Passed Passed Pre-defined CMDBf query for All Operating systems, executed successfully
5b.Resource Repository (SML MDR)

Resoure Repository->Operating System of Computer

Passed Passed Passed Pre-defined CMDBf query for 'Operating System of Computer', executed successfully
5c.Resource Repository (SML MDR)

Resoure Repository->New Folder...

Passed Passed Passed Able to create new folder
5d.Resource Repository (SML MDR)

Resoure Repository->Submit Query...

Passed Passed Passed Able to execute CMDBf queries (Works same as Submit Query as Text)
5e.Resource Repository (SML MDR)

Resoure Repository->Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
5f.Resource Repository (SML MDR)

Resoure Repository->View MetaData

Passed Passed Passed Able to see appropriate metadata information - No Metadata available
5g.Resource Repository (SML MDR)

Resource Repository->Properties

Passed Passed Passed Able to set security properties properly
5h.Resource Repository (SML MDR)

Resource Repository->New Folder->New Folder...

Passed Passed Passed Able to create subfolder under existing folder
5i.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see CMDBf response data as Tabular view
5j.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed Able to view Hierarchial view of CMDBf data
5k.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Partial registration works fine
5l.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Partial deregistration works fine
5m.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder name works fine
5n.Resource Repository (SML MDR)

Resource Repository->New Folder->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder under subfolder is working fine
5o.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Refresh

Passed Passed Passed Refresh works fine
5p.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Response History...

Passed Passed Passed Response History works fine with history data
6.Sample Repository with Query (EXAMPLE MDR)

Get All Students

Passed Passed Passed Displayed Query Result for Students data correctly
6a.Sample Repository with Query (EXAMPLE MDR)

Get All Teachers

Passed Passed Passed Displayed Query Result for Teachers data correctly
6b.Sample Repository with Query (EXAMPLE MDR)

Get All Classes

Passed Passed Passed Displayed Query Result for Classes data correctly
6c.Sample Repository with Query (EXAMPLE MDR)

Staff01

Passed Passed Passed Displayed data for 'students taught by teacher-staff01' correctly
6d.Sample Repository with Query (EXAMPLE MDR)

Staff02

Passed Passed Passed Displayed data for 'students taught by teacher-staff02' correctly
6e.Sample Repository with Query (EXAMPLE MDR)

Submit Query

Passed Passed Passed Using Query Builder, able to create and execute queries correctly
6f.Sample Repository with Query (EXAMPLE MDR)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
6g.Sample Repository with Query (EXAMPLE MDR)

View MetaData

Passed Passed Passed Displayed MetaData information correctly
6h.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->Properties

Passed Passed Passed Able to set Security information correctly
6i.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder...

Passed Passed Passed Able to create New Folder correctly
6j.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->New Folder...

Passed Passed Passed Able to create Sub Folder under existing folder correctly
6k.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see tabular view of CMDBf query result data correctly, Having some problem with IE
6l.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed Able to see Hierarchial view of CMDBf query result data correctly
6m.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Able to do partial registration correctly
6n.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Able to do partial deregistration correctly
6o.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Rename...

Passed Passed Passed Able to Rename Query or folder name correctly
6p.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->CMDBf Query...->Rename...

Passed Passed Passed Able to Rename Query or folder under existing folder
6q.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh works fine
6r.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Response History...

Passed Passed Passed Response history works fine with history data
7.Sample Repository with Registration (Federating CMDB)

All Items and Relationships

Passed Passed Passed Pre-defined Query - All Items and Relationships executed successfully
7a.Sample Repository with Registration (Federating CMDB)

Submit Query

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
7b.Sample Repository with Registration (Federating CMDB)

Submit Query as Text

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
7c.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Registration with Example MDR is successful
7d.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Registration with SML MDR is successful
7e.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Registration with AperiMdr - Failed (No response on UI)
7f.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Deregistration with Example MDR is successful
7g.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Deregistration with SML MDR is successful
7h.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Deregistration with Aperi MDR - Failed
7i.Sample Repository with Registration (Federating CMDB)

register Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full registration with Example Mdr and SML Mdr - Passed
7j.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full deregistration with Example Mdr and SML Mdr - Passed
7k.Sample Repository with Registration (Federating CMDB)

New Folder...

Passed Passed Passed Able to create New Folder successfully
7l.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Rename...

Passed Passed Passed Able to rename Query/Folder successfully
7m.Sample Repository with Registration (Federating CMDB)

Properties...

Passed Passed Passed Able to set Security Information correctly
7n.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to view CMDBf query result under Tabular view properly (IE is having some problem)
7o.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Hierarchial View

Passed Passed Passed Hierarchial View of CMDBf result data working properly
7p.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh is working fine
7q.Sample Repository with Registration (Federating CMDB)

View MetaData

Passed Passed Passed Able to view appropriate message for View MetaData
7r.Sample Repository with Registration (Federating CMDB)

Response History...

Passed Passed Passed Able to view Response Histories with last queried data
8a.AperiMDR (Storage Repository)

New Folder...

Passed Passed Passed None
8b.AperiMDR (Storage Repository)

Submit Query

Passed Passed Passed Using Query builder able to execute and validate queries properly
8c.AperiMDR (Storage Repository)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries correctly
8d.AperiMDR (Storage Repository)

View MetaData

Passed Passed Passed Displayed MetaData properly
8e.AperiMDR (Storage Repository)

Properties...

Passed Passed Passed Able to set security properties properly
8f.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Tabular View

Passed Passed Passed Able to view Tabular View of CMDBf query response data
8g.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Hierarchial View

Passed Passed Passed Able to view Hierarchial View of CMDBf query response data
8h.AperiMDR (Storage Repository)

CMDBf Query->Register Configuration Items...

Passed Passed Passed Partial registration with FederatingCMDB works fine
8i.AperiMDR (Storage Repository)

CMDBf Query->DeRegister Configuration Items...

Passed Passed Passed Partial Deregistration with FederatingCMDB works fine
8k.AperiMDR (Storage Repository)

CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names works fine
8l.AperiMDR (Storage Repository)

New Folder->CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names under subfolder - Works fine
8m.AperiMDR (Storage Repository)

CMDBf Query->Refresh

Passed Passed Passed CMDBf query refresh work fine
8n.AperiMDR (Storage Repository)

CMDBf Query->Response History...

Passed Passed Passed Response History is working fine

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

DataVisualization.UI.Component.Widget.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.navigate Passed Passed In i11, StatDataManager node contains only 1 child node
2.navigate2 Passed Passed Given query returns empty Response, however there are some pre-defined queries, where we can see query results
3.properties Passed Passed Property pane reveils appropriate information correctly
4.visualize log report Passed Passed Top 10 Log Report generated successfully without any errors
5.visualize stat report Passed Passed Statistical Report generated successfully
6.properties 2 Passed Passed Properties for all Data Managers have been verified and found to be correct
7.Multiple Graph Response Viewers Failed Failed java.util.MissingResourceException: Can't find bundle for base name org.eclipse.cosmos.internal.dr.drs.service.outputter.messages, locale en_AU.
8.Registration Example Passed Passed Full registration of ExampleMDR with FederatingCMDB is successful
9.DeRegistration Example Passed Passed Full deregistration of ExampleMDR with FederatingCMDB is successful
10.Partial Registration of MDR with CMDBf Passed Passed Partial registration of SMLMDR - predefined query data with FederatingCMDB is successful
11.Partial DeRegistration of MDR with CMDBf Passed Passed Partial deregistration of SMLMDR - predefined query data with FederatingCMDB is successful
12.Creating Named Query Passed Passed Creation of Named Query and execution successful
13.Rename a Query Passed Passed Renaming a Query works fine
14.Creating a Query Folder Passed Passed Able to create New Folder successfully
15.Rename a folder Passed Passed Renaming folder works fine
16.Enter Security Info Passed Passed Able to enter security information and executed CMDBf queries successfully
17.Save Queries Passed Passed Able to save queries and response histories
18.Using Submit Query as Text Passed Passed "Submit Query as Text" works fine.
19.Query Properties Passed Passed "Get All Students" - Query properties displayed different data

DataVisualization.UI.Reports.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Reports.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.LogReport Passed Passed LogReport generated successfully
2.StatReport Passed Passed StatReport generated successfully

4. Execution of i11 supplement e2e tests (negative) from QA.

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.Installing COSMOS Web applications and Web Services - tomcatDir with spaces running on port 8090

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

Passed Passed On Linux,configDemo.sh requires quotes over command line argument variables

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1. Register All Data Managers with Broker (running on port 8090)

COSMOS> broker registerAllDataManagers

Passed Passed None
1a. Register All Data Managers with Broker (re-doing registration again)
  • COSMOS> broker registerAllDataManagers
  • COSMOS> broker registerAllDataManagers
 Passed Passed SOAP response displays appropriate message as 'REGISTRATION_DUPLICATE_SERVICE', however COSMOS Command line client displays inappropriate messages.
1b. Register All Data Managers with Broker (with invalid Broker EPR) Passed Passed Displays appropriate message as 'AxisFault: check the EPR being used'
2. Registering Individual Data Manager with Broker (running on port 8090)

COSMOS> broker register AperiMdr

Passed Passed Registered successfully and displayed message as 'Registering AperiMdr'
2a. Registering Individual Data Manager with Broker (registring multiple times)

COSMOS> broker register AperiMdr

Passed Passed SOAP response displays appropriate message, however COSMOS Command line client displays inappropriate message 'Registering AperiMdr'
2b. Registering Individual Data Manager with Broker (with invalid Broker EPR)
  • start cosmosClient.bat with invalid broker epr
  • COSMOS> broker register AperiMdr
 Passed Passed AxisFault: check the EPR being used.
2c. Registering Individual Data Manager with Broker (with Invalid DataManager Name)

COSMOS> broker register MyAperiMdr

Passed Passed Displays message as 'Not Found!'
3. Registering ServiceGroup (registring Multiple times) Passed Passed SOAP response displays appropriate message, but COSMOS CLI displays inappropriate message.
3a. Registering ServiceGroup (with Incorrect Host Name)

COSMOS> broker registerServiceGroup myhost AperiMdr http://localhost:8090/axis2/services/AperiMdrDataManager?wsdl http://localhost:8090/axis2/services/AperiMdrQueryService?wsdl

Passed Passed Registered group successfully with hostname as 'myhost'. Is this correct behaviour ?
3b. Registering ServiceGroup (with Incorrect DataManager Name)

COSMOS> broker registerServiceGroup host1 MySMLMDR http://localhost:8090/axis2/services/SmlMdrDataManager?wsdl http://localhost:8090/axis2/services/SmlMdrQueryService?wsdl

Passed Passed Registered group successfully with Group Name as 'MySMLMDR'
3c. Registering ServiceGroup (with invalid/non-existing WSDL files)

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/MyExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/MyExampleMdrQueryService?wsdl

Failed Failed Found some exceptions - "Could not get WSDL!; Command error: null java.lang.NullPointerException"
3d. Registering ServiceGroup (with invalid Broker EPR)

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/ExampleMdrQueryService?wsdl

Passed Passed Registration failed with Command error: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/services/MBroker
4. List All Data Managers Registered with Broker (With no registration)

COSMOS> broker getDataManagers

Passed Passed Display empty response with message 'Data managers registered at the broker:'
4a. List All Data Managers Registered with Broker (With invalid broker EPR)

COSMOS> broker getDataManagers

Passed Passed Displays error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/service/MBroker"
5. Find all DataManagers using CosmosServiceFinder web service (Invalid CosmosServiceFinder EPR)

COSMOS> finddatamanagers http://localhost:8080/axis2/services/myCosmosServiceFinder

Passed Passed Displays appropriate message as 'AxisFault: check the EPR being used.'
5a. Find all DataManagers using CosmosServiceFinder web service (with no DataManagers deployed)

COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

Passed Passed None
6. Deregistering Data Managers from broker (with Port 8090)

COSMOS> broker deregister host1 StatDataManager

Passed Passed Deregistered successfully
6a. Deregistering Data Managers from broker (with invalid hostname)

COSMOS> broker deregister host1 LoggingDataManager

Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
6b. Deregistering Data Managers from broker (with invalid DataManager Name)

COSMOS> broker deregister host1 TestFederatingCMDB

Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
6c. Deregistering Data Managers from broker (deregistring multiple times)
  • COSMOS> broker deregister host1 ExampleMdr
  • COSMOS> broker deregister host1 ExampleMdr
Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
7. Executing CMDBf Queries using the command line client (Query Path with spaces)

COSMOS> graphQuery localhost ExampleMdr C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt

Passed Passed Displays error as "java.io.FileNotFoundException: C:\Program (The system cannot find the file specified)"
7a. Executing CMDBf Queries using the command line client (Query Path with quotes)

COSMOS> graphQuery localhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Executed Query successfully
7b. Executing CMDBf Queries using the command line client (Incorrect path)

COSMOS> graphQuery host1 ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\MyExampleMDR\all-students.txt"

Passed Passed Display error as "java.io.FileNotFoundException"
7c. Executing CMDBf Queries using the command line client (Wrong Query)

COSMOS> graphQuery localhost SMLMDR "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Empty Response
7d. Executing CMDBf Queries using the command line client (Invalid host)

COSMOS> graphQuery myhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Display error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown"
7e. Executing CMDBf Queries using the command line client (Invalid DataManager)

COSMOS> graphQuery localhost MyExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Display error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown"
7f. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt (with inactive DataManager) Passed Passed Passed None
7g. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml (with no Aperi Database setup) Passed Passed Passed None

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface (with port 8090)

http://localhost:8090/COSMOSUI/?page=cosmos

Passed Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly
2.Resource Repository (SML MDR)

Resoure Repository->New Folder... (with Invalid FolderName)

Passed Passed Passed Able to create new folder
2a.Resource Repository (SML MDR)

Resoure Repository->New Folder... (with existing FolderName)

Passed Passed Passed Able to create new folder


2b.Resource Repository (SML MDR) (with invalid Query data)

Resoure Repository->Submit Query...

Passed Passed Passed Able to execute CMDBf queries (Works same as Submit Query as Text)
2c.Resource Repository (SML MDR) (with multiple selection - all 3 DMs)

Resource Repository->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Partial registration works fine
2d.Resource Repository (SML MDR) (with multiple selection - all 3 DMs)

Resource Repository->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Partial deregistration works fine
2e.Resource Repository (SML MDR) (Invalid filename with spaces)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder name works fine
3.Sample Repository with Query (EXAMPLE MDR) (Invalid Query data)

Submit Query

Passed Passed Passed Using Query Builder, able to create and execute queries correctly
3a.Sample Repository with Query (EXAMPLE MDR) (invalid query data)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
4.Sample Repository with Registration (Federating CMDB)

Submit Query (invalid query data)

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
4a.Sample Repository with Registration (Federating CMDB) (Multiple Selection)

Register Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Registration with Example MDR is successful
4b.Sample Repository with Registration (Federating CMDB)(Multiple Selection)

Register Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Registration with SML MDR is successful
4c.AperiMDR (Storage Repository) (with no Aperi DB setup)

Submit Query

Passed Passed Passed Using Query builder able to execute and validate queries properly
4d.AperiMDR (Storage Repository) (Invalid Query Data)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries correctly

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)

ManagementEnablement.UI.dmtoolkit.testsuite

/org.eclipse.cosmos.me.dmtoolkit.tests/manual/ManagementEnablement.UI.dmtoolkit.testsuite

Test Description Test Status 
 Windows XP SP2
Remarks
1.Creating a Data Manager Project Passed Data Manager Project Creation wizard, executed successfully
2.Facet Interface for creating DM Project Passed Facet Interface for creating DM Project, executed successfully

6. Basic operational efficiency tests (limited performance tests)

QA i11 Execution - Miscellaneous

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_i11_QA_Phase_Execution&oldid=106760"

Back to the top