Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

COSMOS i11 QA Phase Execution

QA i11 Execution - Activities

QA Test Execution Activities for i11

Primary Tasks:

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

  • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

  • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
  • SML Tooling - adhoc UI testing for editor/validator/import/export features

Secondary Tasks:

6. Basic operational efficiency tests (limited performance tests)


For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i11_Activities

QA i11 Test Execution Summary

The following activities were completed by QA, as per defined scope of i11 QA's primary activities (http://wiki.eclipse.org/COSMOS_QA_i11_Activities)

  • Data Visualization TPTP Manual Tests Execution
    • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite
  • Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
    • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
    • SML Tooling - adhoc UI testing for editor/validator/import/export features

Bugs Reported:

QA i11 Execution - Complete Status


1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Download COSMOS Demo and Prerequisites Passed Passed Passed None
2.Installing COSMOS Web applications and Web Services

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

Passed Passed Passed None
3.Installing COSMOS SDK Passed Passed Passed None
4.Installing Resource Modeling Tooling Passed Passed Passed None

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1. Start the COSMOS Command Line Client

<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker

Passed Passed Passed None
2. Security Header - Set SoapVersion

COSMOS> set soapversion 12

Passed Passed Passed None
3. Security Header - Set Username

COSMOS> set username test

Passed Passed Passed None
4. Security Header - Set Password

COSMOS> set password test123

Passed Passed Passed None
5. Security Header - Show Details

COSMOS> Show

Passed Passed Passed None
6. Register All Data Managers with Broker

COSMOS> broker registerAllDataManagers

Passed Passed Passed None
7. Registering Individual Data Manager with Broker

COSMOS> broker register AperiMdr

Passed Passed Passed None
7a. Registering Individual Data Manager with Broker

COSMOS> broker register SMLMDR

Passed Passed Passed None
7b. Registering Individual Data Manager with Broker

COSMOS> broker register ExampleMdr

Passed Passed Passed None
7c. Registering Individual Data Manager with Broker

COSMOS> broker register TestFederatingCMDB

Passed Passed Passed None
7d. Registering Individual Data Manager with Broker

COSMOS> broker register LoggingDataManager

Passed Passed Passed None
7e. Registering Individual Data Manager with Broker

COSMOS> broker register StatDataManager

Passed Passed Passed None
8. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 AperiMdr http://localhost:8080/axis2/services/AperiMdrDataManager?wsdl http://localhost:8080/axis2/services/AperiMdrQueryService?wsdl

Passed Passed Passed None
8a. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 SMLMDR http://localhost:8080/axis2/services/SmlMdrDataManager?wsdl http://localhost:8080/axis2/services/SmlMdrQueryService?wsdl

Passed Passed Passed None
8b. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8080/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8080/axis2/services/ExampleMdrQueryService?wsdl

Passed Passed Passed None
8c. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 LoggingDataManager http://localhost:8080/axis2/services/LoggingDataManager?wsdl http://localhost:8080/axis2/services/CBEServices?wsdl

Passed Passed Passed None
8d. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 StatDataManager http://localhost:8080/axis2/services/StatisticalDataManager?wsdl http://localhost:8080/axis2/services/StatDataManager?wsdl

Passed Passed Passed None
8e. Registering ServiceGroup

COSMOS> broker registerServiceGroup host1 TestFederatingCMDB http://localhost:8080/axis2/services/TestFederatingCMDBDataManager?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBRegistrationService?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBQueryService?wsdl

Passed Passed Passed None
9. Print Broker EPR

COSMOS> broker epr print

Passed Passed Passed None
10. Modifiying Broker EPR

COSMOS> broker epr change http://HOST2:PORT2/axis2/services/Broker

Passed Passed Passed None
11. List All Data Managers Registered with Broker

COSMOS> broker getDataManagers

Passed Passed Passed None
12. Find all DataManagers using CosmosServiceFinder web service

COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

Passed Passed Passed None
13. Deregistering Data Managers from broker

COSMOS> broker deregister host1 StatDataManager

Passed Passed Passed None
13a. COSMOS> broker deregister host1 LoggingDataManager Passed Passed Passed None
13b. COSMOS> broker deregister host1 TestFederatingCMDB Passed Passed Passed None
13c. COSMOS> broker deregister host1 ExampleMdr Passed Passed Passed None
13d. COSMOS> broker deregister host1 SMLMDR Passed Passed Passed None
13e. COSMOS> broker deregister host1 AperiMdr Passed Passed Passed None
14. Executing CMDBf Queries using the command line client

COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Passed Passed Passed Empty Response
14a. COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt Passed Passed Passed Empty Response
15. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt Passed Passed Passed None
15a. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt Passed Passed Passed None
15b. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt Passed Passed Passed None
15c. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt Passed Passed Passed None
16. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml Passed Passed Passed None
16a. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml Passed Passed Passed None
16b. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml Passed Passed Passed None
16c. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml Passed Passed Passed None
16e. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml Passed Passed Passed None
16f. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml Passed Passed Passed None
16g. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml Passed Passed Passed None
16h. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml Passed Passed Passed None
16i. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml Passed Passed Passed None
16j. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml Passed Passed Passed None
16k. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml Passed Passed Passed None
16l. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml Passed Passed Passed None
16m. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml Passed Passed Passed None
16n. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml Passed Passed Passed None
16o. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml Passed Passed Passed None
16p. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml Passed Passed Passed None
16q. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml Passed Passed Passed None
16r. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml Passed Passed Passed None
16s. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml Passed Passed Passed None
16t. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml Passed Passed Passed None
16u. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml Passed Passed Passed None
16v. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml Passed Passed Passed None
16w. COSMOS> COSMOS> graphQuery host1 TestFederatingCMDB C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt Passed Passed Passed None.

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly
2.Data Managers View

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed Found All 6 DataManagers under COSMOS Web UI
3.StatDataManager

server 33 tomcat1181829221515 CBE -> Statistical Report

Passed Passed Passed Statistical Report generated successfully
3a.StatDataManager

StatDataManager -> Properties...

Passed Passed Passed Able to set security properties information
4.LoggingDataManager

access_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully
4a.LoggingDataManager

windows_app_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully
4b.LoggingDataManager

LoggingDataManager -> Properties...

Passed Passed Passed Able to set security information properly
5.Resource Repository (SML MDR)

Resoure Repository->All Computer Systems

Passed Passed Passed Pre-defined CMDBf query for All Computer systems, executed successfully
5a.Resource Repository (SML MDR)

Resoure Repository->All Operating Systems

Passed Passed Passed Pre-defined CMDBf query for All Operating systems, executed successfully
5b.Resource Repository (SML MDR)

Resoure Repository->Operating System of Computer

Passed Passed Passed Pre-defined CMDBf query for 'Operating System of Computer', executed successfully
5c.Resource Repository (SML MDR)

Resoure Repository->New Folder...

Passed Passed Passed Able to create new folder
5d.Resource Repository (SML MDR)

Resoure Repository->Submit Query...

Passed Passed Passed Able to execute CMDBf queries (Works same as Submit Query as Text)
5e.Resource Repository (SML MDR)

Resoure Repository->Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
5f.Resource Repository (SML MDR)

Resoure Repository->View MetaData

Passed Passed Passed Able to see appropriate metadata information - No Metadata available
5g.Resource Repository (SML MDR)

Resource Repository->Properties

Passed Passed Passed Able to set security properties properly
5h.Resource Repository (SML MDR)

Resource Repository->New Folder->New Folder...

Passed Passed Passed Able to create subfolder under existing folder
5i.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see CMDBf response data as Tabular view
5j.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed Able to view Hierarchial view of CMDBf data
5k.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Partial registration works fine
5l.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Partial deregistration works fine
5m.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder name works fine
5n.Resource Repository (SML MDR)

Resource Repository->New Folder->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder under subfolder is working fine
5o.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Refresh

Passed Passed Passed Refresh works fine
5p.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Response History...

Passed Passed Passed Response History works fine with history data
6.Sample Repository with Query (EXAMPLE MDR)

Get All Students

Passed Passed Passed Displayed Query Result for Students data correctly
6a.Sample Repository with Query (EXAMPLE MDR)

Get All Teachers

Passed Passed Passed Displayed Query Result for Teachers data correctly
6b.Sample Repository with Query (EXAMPLE MDR)

Get All Classes

Passed Passed Passed Displayed Query Result for Classes data correctly
6c.Sample Repository with Query (EXAMPLE MDR)

Staff01

Passed Passed Passed Displayed data for 'students taught by teacher-staff01' correctly
6d.Sample Repository with Query (EXAMPLE MDR)

Staff02

Passed Passed Passed Displayed data for 'students taught by teacher-staff02' correctly
6e.Sample Repository with Query (EXAMPLE MDR)

Submit Query

Passed Passed Passed Using Query Builder, able to create and execute queries correctly
6f.Sample Repository with Query (EXAMPLE MDR)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
6g.Sample Repository with Query (EXAMPLE MDR)

View MetaData

Passed Passed Passed Displayed MetaData information correctly
6h.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->Properties

Passed Passed Passed Able to set Security information correctly
6i.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder...

Passed Passed Passed Able to create New Folder correctly
6j.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->New Folder...

Passed Passed Passed Able to create Sub Folder under existing folder correctly
6k.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see tabular view of CMDBf query result data correctly, Having some problem with IE
6l.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed Able to see Hierarchial view of CMDBf query result data correctly
6m.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Able to do partial registration correctly
6n.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Able to do partial deregistration correctly
6o.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Rename...

Passed Passed Passed Able to Rename Query or folder name correctly
6p.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->CMDBf Query...->Rename...

Passed Passed Passed Able to Rename Query or folder under existing folder
6q.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh works fine
6r.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Response History...

Passed Passed Passed Response history works fine with history data
7.Sample Repository with Registration (Federating CMDB)

All Items and Relationships

Passed Passed Passed Pre-defined Query - All Items and Relationships executed successfully
7a.Sample Repository with Registration (Federating CMDB)

Submit Query

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
7b.Sample Repository with Registration (Federating CMDB)

Submit Query as Text

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
7c.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Registration with Example MDR is successful
7d.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Registration with SML MDR is successful
7e.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Registration with AperiMdr - Failed (No response on UI)
7f.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Deregistration with Example MDR is successful
7g.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Deregistration with SML MDR is successful
7h.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Deregistration with Aperi MDR - Failed
7i.Sample Repository with Registration (Federating CMDB)

register Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full registration with Example Mdr and SML Mdr - Passed
7j.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full deregistration with Example Mdr and SML Mdr - Passed
7k.Sample Repository with Registration (Federating CMDB)

New Folder...

Passed Passed Passed Able to create New Folder successfully
7l.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Rename...

Passed Passed Passed Able to rename Query/Folder successfully
7m.Sample Repository with Registration (Federating CMDB)

Properties...

Passed Passed Passed Able to set Security Information correctly
7n.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to view CMDBf query result under Tabular view properly (IE is having some problem)
7o.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Hierarchial View

Passed Passed Passed Hierarchial View of CMDBf result data working properly
7p.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh is working fine
7q.Sample Repository with Registration (Federating CMDB)

View MetaData

Passed Passed Passed Able to view appropriate message for View MetaData
7r.Sample Repository with Registration (Federating CMDB)

Response History...

Passed Passed Passed Able to view Response Histories with last queried data
8a.AperiMDR (Storage Repository)

New Folder...

Passed Passed Passed None
8b.AperiMDR (Storage Repository)

Submit Query

Passed Passed Passed Using Query builder able to execute and validate queries properly
8c.AperiMDR (Storage Repository)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries correctly
8d.AperiMDR (Storage Repository)

View MetaData

Passed Passed Passed Displayed MetaData properly
8e.AperiMDR (Storage Repository)

Properties...

Passed Passed Passed Able to set security properties properly
8f.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Tabular View

Passed Passed Passed Able to view Tabular View of CMDBf query response data
8g.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Hierarchial View

Passed Passed Passed Able to view Hierarchial View of CMDBf query response data
8h.AperiMDR (Storage Repository)

CMDBf Query->Register Configuration Items...

Passed Passed Passed Partial registration with FederatingCMDB works fine
8i.AperiMDR (Storage Repository)

CMDBf Query->DeRegister Configuration Items...

Passed Passed Passed Partial Deregistration with FederatingCMDB works fine
8k.AperiMDR (Storage Repository)

CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names works fine
8l.AperiMDR (Storage Repository)

New Folder->CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names under subfolder - Works fine
8m.AperiMDR (Storage Repository)

CMDBf Query->Refresh

Passed Passed Passed CMDBf query refresh work fine
8n.AperiMDR (Storage Repository)

CMDBf Query->Response History...

Passed Passed Passed Response History is working fine

2. i11 ERs – JUnits/Manual Tests inspection

Bugzilla ID ID Summary JUnits Tests Manual Tests Remarks
https://bugs.eclipse.org/bugs/show_bug.cgi?id=223271 Need ability to rename saved queries NA Available Found test cases as part of DataVisualization.UI.Component.Widget.testsuite

and test execution passed.

https://bugs.eclipse.org/bugs/show_bug.cgi?id=231400 Design & implement simple MDR authentication (login / password) for COSMOS 1.0 NA Available Found some test cases as part of DataVisualization.UI.Component.Widget.testsuite in setting up security information and test execution passed.
https://bugs.eclipse.org/bugs/show_bug.cgi?id=223270 Need ability to manage queries NA Available Found TPTP Manual tests defined under /org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite for managing queries
https://bugs.eclipse.org/bugs/show_bug.cgi?id=222504 UI cannot show the query request NA Available Found TPTP Manual tests defined under

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite, for viewing CMDBf query document

https://bugs.eclipse.org/bugs/show_bug.cgi?id=224166 Improve the Graph Response Viewer View NA NA No explicit tests provided, however this has been covered as part of End2End tests defined at http://wiki.eclipse.org/COSMOS_DEMO_i11
https://bugs.eclipse.org/bugs/show_bug.cgi?id=224172 Improve registration/deregistration response dialog box NA NA No explicit tests provided, however this has been covered as part of End2End tests defined at http://wiki.eclipse.org/COSMOS_DEMO_i11
https://bugs.eclipse.org/bugs/show_bug.cgi?id=224173 Dialog Box: Press escape should close dialog box NA NA No explicit tests provided, however this has been tested as part of End2End

testing based on http://wiki.eclipse.org/COSMOS_DEMO_i11

https://bugs.eclipse.org/bugs/show_bug.cgi?id=228268 Dialog Box: Press escape should close dialog box NA NA No explicit tests provided, however this has been tested as part of End2End

testing based on http://wiki.eclipse.org/COSMOS_DEMO_i11

https://bugs.eclipse.org/bugs/show_bug.cgi?id=234373 Provide security capabilites in the UI NA Available Found TPTP Manual tests defined under

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite,for setting Security information.

3. Data Visualization TPTP Manual Tests Execution

DataVisualization.UI.Component.Widget.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.navigate Passed Passed In i11, StatDataManager node contains only 1 child node
2.navigate2 Passed Passed Given query returns empty Response, however there are some pre-defined queries, where we can see query results
3.properties Passed Passed Property pane reveils appropriate information correctly
4.visualize log report Passed Passed Top 10 Log Report generated successfully without any errors
5.visualize stat report Passed Passed Statistical Report generated successfully
6.properties 2 Passed Passed Properties for all Data Managers have been verified and found to be correct
7.Multiple Graph Response Viewers Failed Failed java.util.MissingResourceException: Can't find bundle for base name org.eclipse.cosmos.internal.dr.drs.service.outputter.messages, locale en_AU.
8.Registration Example Passed Passed Full registration of ExampleMDR with FederatingCMDB is successful
9.DeRegistration Example Passed Passed Full deregistration of ExampleMDR with FederatingCMDB is successful
10.Partial Registration of MDR with CMDBf Passed Passed Partial registration of SMLMDR - predefined query data with FederatingCMDB is successful
11.Partial DeRegistration of MDR with CMDBf Passed Passed Partial deregistration of SMLMDR - predefined query data with FederatingCMDB is successful
12.Creating Named Query Passed Passed Creation of Named Query and execution successful
13.Rename a Query Passed Passed Renaming a Query works fine
14.Creating a Query Folder Passed Passed Able to create New Folder successfully
15.Rename a folder Passed Passed Renaming folder works fine
16.Enter Security Info Passed Passed Able to enter security information and executed CMDBf queries successfully
17.Save Queries Passed Passed Able to save queries and response histories
18.Using Submit Query as Text Passed Passed "Submit Query as Text" works fine.
19.Query Properties Passed Passed "Get All Students" - Query properties displayed different data

DataVisualization.UI.Reports.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Reports.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.LogReport Passed Passed LogReport generated successfully
2.StatReport Passed Passed StatReport generated successfully

4. Execution of i11 supplement e2e tests (negative) from QA.

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.Installing COSMOS Web applications and Web Services - tomcatDir with spaces running on port 8090

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

Passed Passed On Linux,configDemo.sh requires quotes over command line argument variables

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1. Register All Data Managers with Broker (running on port 8090)

COSMOS> broker registerAllDataManagers

Passed Passed None
1a. Register All Data Managers with Broker (re-doing registration again)
  • COSMOS> broker registerAllDataManagers
  • COSMOS> broker registerAllDataManagers
 Passed Passed SOAP response displays appropriate message as 'REGISTRATION_DUPLICATE_SERVICE', however COSMOS Command line client displays inappropriate messages.
1b. Register All Data Managers with Broker (with invalid Broker EPR) Passed Passed Displays appropriate message as 'AxisFault: check the EPR being used'
2. Registering Individual Data Manager with Broker (running on port 8090)

COSMOS> broker register AperiMdr

Passed Passed Registered successfully and displayed message as 'Registering AperiMdr'
2a. Registering Individual Data Manager with Broker (registring multiple times)

COSMOS> broker register AperiMdr

Passed Passed SOAP response displays appropriate message, however COSMOS Command line client displays inappropriate message 'Registering AperiMdr'
2b. Registering Individual Data Manager with Broker (with invalid Broker EPR)
  • start cosmosClient.bat with invalid broker epr
  • COSMOS> broker register AperiMdr
 Passed Passed AxisFault: check the EPR being used.
2c. Registering Individual Data Manager with Broker (with Invalid DataManager Name)

COSMOS> broker register MyAperiMdr

Passed Passed Displays message as 'Not Found!'
3. Registering ServiceGroup (registring Multiple times) Passed Passed SOAP response displays appropriate message, but COSMOS CLI displays inappropriate message.
3a. Registering ServiceGroup (with Incorrect Host Name)

COSMOS> broker registerServiceGroup myhost AperiMdr http://localhost:8090/axis2/services/AperiMdrDataManager?wsdl http://localhost:8090/axis2/services/AperiMdrQueryService?wsdl

Passed Passed Registered group successfully with hostname as 'myhost'. Is this correct behaviour ?
3b. Registering ServiceGroup (with Incorrect DataManager Name)

COSMOS> broker registerServiceGroup host1 MySMLMDR http://localhost:8090/axis2/services/SmlMdrDataManager?wsdl http://localhost:8090/axis2/services/SmlMdrQueryService?wsdl

Passed Passed Registered group successfully with Group Name as 'MySMLMDR'
3c. Registering ServiceGroup (with invalid/non-existing WSDL files)

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/MyExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/MyExampleMdrQueryService?wsdl

Failed Failed Found some exceptions - "Could not get WSDL!; Command error: null java.lang.NullPointerException"
3d. Registering ServiceGroup (with invalid Broker EPR)

COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/ExampleMdrQueryService?wsdl

Passed Passed Registration failed with Command error: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/services/MBroker
4. List All Data Managers Registered with Broker (With no registration)

COSMOS> broker getDataManagers

Passed Passed Display empty response with message 'Data managers registered at the broker:'
4a. List All Data Managers Registered with Broker (With invalid broker EPR)

COSMOS> broker getDataManagers

Passed Passed Displays error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/service/MBroker"
5. Find all DataManagers using CosmosServiceFinder web service (Invalid CosmosServiceFinder EPR)

COSMOS> finddatamanagers http://localhost:8080/axis2/services/myCosmosServiceFinder

Passed Passed Displays appropriate message as 'AxisFault: check the EPR being used.'
5a. Find all DataManagers using CosmosServiceFinder web service (with no DataManagers deployed)

COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

Passed Passed None
6. Deregistering Data Managers from broker (with Port 8090)

COSMOS> broker deregister host1 StatDataManager

Passed Passed Deregistered successfully
6a. Deregistering Data Managers from broker (with invalid hostname)

COSMOS> broker deregister host1 LoggingDataManager

Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
6b. Deregistering Data Managers from broker (with invalid DataManager Name)

COSMOS> broker deregister host1 TestFederatingCMDB

Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
6c. Deregistering Data Managers from broker (deregistring multiple times)
  • COSMOS> broker deregister host1 ExampleMdr
  • COSMOS> broker deregister host1 ExampleMdr
Passed Passed SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully'
7. Executing CMDBf Queries using the command line client (Query Path with spaces)

COSMOS> graphQuery localhost ExampleMdr C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt

Passed Passed Displays error as "java.io.FileNotFoundException: C:\Program (The system cannot find the file specified)"
7a. Executing CMDBf Queries using the command line client (Query Path with quotes)

COSMOS> graphQuery localhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Executed Query successfully
7b. Executing CMDBf Queries using the command line client (Incorrect path)

COSMOS> graphQuery host1 ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\MyExampleMDR\all-students.txt"

Passed Passed Display error as "java.io.FileNotFoundException"
7c. Executing CMDBf Queries using the command line client (Wrong Query)

COSMOS> graphQuery localhost SMLMDR "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Empty Response
7d. Executing CMDBf Queries using the command line client (Invalid host)

COSMOS> graphQuery myhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Display error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown"
7e. Executing CMDBf Queries using the command line client (Invalid DataManager)

COSMOS> graphQuery localhost MyExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Displayed error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown"
7f. Executing CMDBf Queries using the command line client (with Inactive DataManager)
  • COSMOS> broker deregister localhost ExampleMdr
  • COSMOS> graphQuery localhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"
Passed Passed Displayed error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown"
7g. Executing CMDBf Queries using the command line client (with no Aperi DB startup)

COSMOS> graphQuery host1 AperiMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml"

Passed Passed Displayed error as "Aperi Exception: java.net.ConnectException : Error connecting to server localhost on port 1527 with message Connection refused: connect."
8 Broker epr change test scenario Passed Passed All DataManagers registered with second broker displayed correctly

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface (with port 8090) Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly and all 6 DataManagers are displayed correctly
2.Resource Repository (SML MDR)(with Invalid FolderName)

Resoure Repository->New Folder...

Passed Passed Able to create new folder with any kind of name
2a.Resource Repository (SML MDR)(with existing FolderName)

Resoure Repository->New Folder...

Passed Passed Able to create duplicate folder/query name
2b.Resource Repository (SML MDR) (with invalid Query data)

Resoure Repository->Submit Query...

Passed Passed Query execution failed, and displays appropriate error
2c.Resource Repository (SML MDR) (Invalid filename with spaces)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Renaming Query or folder name with any junk values works
3.Sample Repository with Query (EXAMPLE MDR) (Invalid Query data)

Submit Query

Passed Passed Using Query Builder, able to create and execute invalid/incomplete query and on execution found an appropriate error message
3a.Sample Repository with Query (EXAMPLE MDR) (invalid query data)

Submit Query as Text

Passed Passed Able to execute invalid CMDBf query and found an appropriate error message
4.Sample Repository with Registration (Federating CMDB) (Multiple Selections of DM)

Register Configuration Items...->select all 3 Data Managers

Passed Passed Full Registration with AperiMDR is not working, other combinations of DM's are working fine
4a.Sample Repository with Registration (Federating CMDB)(Multiple Selection)

DeRegister Configuration Items...->select all 3 Data Managers

Passed Passed Full DeRegistration with AperiMDR is not working, other combinations of DM's are working fine
4b.AperiMDR (Storage Repository) (with no Aperi DB setup)

Submit Query

Passed Passed Using Query builder able to create and execute queries. Upon execution, query resulted in error with appropriate Database connectivity message.
4c.AperiMDR (Storage Repository) (Invalid Query Data)

Submit Query as Text

Passed Passed Able to execute invalid CMDBf query and upon execution found appropriate error message

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)

ManagementEnablement.UI.dmtoolkit.testsuite

/org.eclipse.cosmos.me.dmtoolkit.tests/manual/ManagementEnablement.UI.dmtoolkit.testsuite

Test Description Test Status 
 Windows XP SP2
Remarks
1.Creating a Data Manager Project Passed Data Manager Project Creation wizard, executed successfully
2.Facet Interface for creating DM Project Passed Facet Interface for creating DM Project, executed successfully

SML Tooling tests (UI Validation)

  • SML editor/import/export UI validation tests
Test Description Test Status 
 Windows XP SP2
Remarks
1.Using SML-IF editor,validating SMLIF document
  • On Validation, for any errors it should produce expected markers in the errors view
  • Should show appropriate line number with correct location
 Passed Dispalying appropriate markers and line numbers for any errors during validation
2.Creating SML-IF document
  • Open File->New->Other->Service Modelling Language->Interchange Format file
  • Provide valid file name and fill all other details with default values
  • After creating SMLIF file, validate the document
 Passed Validation failed with Error - "cvc-complex-type.2.4.a: Invalid content was found starting with element 'smlif:description'. One of '{WC[##other:"http://www.w3.org/2008/03/sml-if"]}' is expected. Line:12 Column:22"
3.Using SML-IF editor,Overview tab
  • Open any SML-IF file by double clicking on it
  • Under SML-IF editor, select overview tab and type some sample data under description section
  • Now select source tab and verify that new sample data is visible under description section
 Passed Overview tab changes are visible under source file
4.importing a SML-IF file
  • Select File->import->Service Modelling Language->InterChange Format File
  • Select source and destination locations
  • click finish
 Passed Able to import SML-IF file successfully
5.importing a SML-IF file, Validating the resulting folder
  • Select File->import->Service Modelling Language->InterChange Format File
  • Select source and destination locations
  • click finish
  • Select the imported file and validate the resulting folder
 Passed Able to import SML-IF file successfully.
6.importing a SML-IF file, exporting the resulting folder
  • Select File->import->Service Modelling Language->InterChange Format File
  • Select source and destination locations
  • click finish
  • Select the imported file,right click and select export
  • select Service Modelling Language->InterChange Format File
  • select destination path and click finish
 Passed Able to import and export SML-IF file successfully
7.Exporting a SML-IF file, with new rule bindings
  • Select File->Export->Service Modelling Language->InterChange Format File
  • Select resource file and destination path
  • Click Next twice and on last page add new rule bindings, click finish
 Failed Able to export the file but unable to add new rule bindings

6. Basic operational efficiency tests (limited performance tests)

Configuration Tests

Test Description Test Status Remarks
1.Testing the scenario where COSMOSUI,COSMOSReportViewer running on windows PC1,broker running on windows PC2 and all datamanagers running on linux PC1
  • Install and deploy COSMOSUI,COSMOSReportViewer applications under windows PC1
  • Install and deploy COSMOS Broker service under windows PC2
  • Install and deploy COSMOS Data Managers/MDR's services and ServiceFinder service under linux PC1
  • Now Open COSMOS Command line interface from any of the PC's with Broker URL,

<cosmos-demo>/cosmosClient/bin/cosmosClient.bat http://<WindowsPC2host>:8080/axis2/services/Broker COMSOS>broker registerAllDataManagers http://<linuxPC1host:8080>/axis2/services/CosmosServiceFinder

  • Now Modify BROKER EPR value under <COSMOSUI>/Configuration.properties file, pointing to windows PC2 hostname
  • From windows PC1 open COSMOSUI,http://localhost:8080/COSMOSUI
  • Inspect the properties of all datamanagers
  • Expected Result:
    • COSMOS UI should display all 6 Data Managers and all it's operations should work normally
Passed COSMOS UI works fine with this setup.
2.Testing the scenario where COSMOSUI running on windows and all COSMOS services running on Linux
  • Install COSMOS service components under linux box
  • Install COSMOSUI,COSMOSReportViewer webapps application under windows
  • Modify BROKER EPR value under <COSMOSUI>/Configuration.properties file, pointing to linux hostname
  • From windows, open http://localhost:8080/COSMOSUI
  • Expected Result:
    • COSMOS UI should display all 6 Data Managers and all it's operations should work normally
Passed COSMOS UI works fine with this setup.

Concurrency Tests

Test Description Test Status Remarks
1.Concurrency tests, where multiple COSMOSUI's running on one machine
  • Install all COSMOS components on windows PC
  • open 2 COSMOSUI's under IE and 2 COSMOSUI's under Firebox browsers
  • Perform various test operations - Generating Stat/Log reports on all COSMOSUI's
  • simultaneously,Executing CMDBf queries on all COSMOSUI's simultaneously
  • Expected Result:
    • All COSMOS UI's should work normally and should get appropriate results without any errors
Passed None
2.Concurrency tests, where multiple COSMOSUI's and multiple COSMOS Command Line Clients running on one machine
  • Install all COSMOS components on windows PC
  • open 1 COSMOSUI under IE and 1 COSMOSUI under Firebox browser
  • open 2 COSMOS Command Line Shells
  • Perform various test operations - Execute CMDBf queries on all COSMOS Clients simultaneously
  • Expected Result:
    • All COSMOS clients should work normally and should get appropriate results without any errors
Passed None

Volume/Performance Tests

QA i11 Execution - Miscellaneous

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_i11_QA_Phase_Execution&oldid=108002"

This page was last modified 06:06, 1 July 2008 by Srinivas Reddy.

Back to the top