Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "COSMOS i11 QA Phase Execution"

(1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0)
(1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0)
Line 461: Line 461:
 
|-
 
|-
 
|StatDataManager
 
|StatDataManager
server 33 tomcat1181829221515 CBE
+
server 33 tomcat1181829221515 CBE -> Statistical Report
 
|
 
|
 
|
 
|
Line 469: Line 469:
  
 
|StatDataManager
 
|StatDataManager
server 33 tomcat1181829221515 TomcatSet
+
StatDataManager -> Properties...
 
|
 
|
 
|
 
|
 
|
 
|
|Statistical Report generated successfully
+
|None
  
 
|-
 
|-
 
|LoggingDataManager
 
|LoggingDataManager
access_log.cbe.xml
+
access_log.cbe.xml -> Top 10 Log Report
 
|
 
|
 
|
 
|
 
|
 
|
 
|Top 10 Log Report generated successfully
 
|Top 10 Log Report generated successfully
|-
 
  
 +
|-
 
|LoggingDataManager
 
|LoggingDataManager
windows_app_log.cbe.xml
+
windows_app_log.cbe.xml -> Top 10 Log Report
 
|
 
|
 
|
 
|
 
|
 
|
 
|Top 10 Log Report generated successfully
 
|Top 10 Log Report generated successfully
 +
 +
|-
 +
|LoggingDataManager
 +
LoggingDataManager -> Properties...
 +
|
 +
|
 +
|
 +
|None
  
 
|-
 
|-
 
|Resource Repository (SML MDR)
 
|Resource Repository (SML MDR)
View MetaData
+
Resoure Repository->New Folder...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resoure Repository->Submit Query...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resoure Repository->Submit Query as Text
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resoure Repository->View MetaData
 
|
 
|
 
|
 
|
Line 501: Line 533:
 
|-
 
|-
 
|Resource Repository (SML MDR)
 
|Resource Repository (SML MDR)
Submit Query
+
Resource Repository->Properties
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->New Folder...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->Open With>>->Tabular View
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->Open With>>->Hierarchal View
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->Register Configuration Items...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->DeRegister Configuration Items...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->Rename...
 +
|
 +
|
 +
|
 +
|None
 +
 
 +
|-
 +
|Resource Repository (SML MDR)
 +
Resource Repository->CMDBf Query..->Refresh
 
|
 
|
 
|
 
|
 
|
 
|
|Queries executed successfully with proper results
+
|None
  
 
|-
 
|-

Revision as of 05:52, 16 June 2008

QA i11 Execution - Activities

QA Test Execution Activities for i11

Primary Tasks:

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

  • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

  • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
  • SML Tooling - adhoc UI testing for editor/validator/import/export features

Secondary Tasks:

6. Basic operational efficiency tests (limited performance tests)


For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i10_Activities


QA i11 Test Execution Summary


QA i11 Execution - Complete Status

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

Test Description Test Status
 Windows XP SP2
Test Status
 Windows 2003 SP1
Test Status
 RHES 5.0
Remarks
===Build Installation and Configuration===
Download COSMOS Demo and Prerequisites None
Installing COSMOS Web applications and Web Services

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>

None
Installing COSMOS SDK None
Installing Resource Modeling Tooling None
===COSMOS Command Line Client===


Start the COSMOS Command Line Client

<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker

None
Security Header - Set SoapVersion

COSMOS> set soapversion [11 or 12]

None
Security Header - Set Username

COSMOS> set username [username]

None
Security Header - Set Password

COSMOS> set password [password]

None
Security Header - Show Details

COSMOS> Show

None
Register All Data Managers with Broker

COSMOS> broker registerAllDataManagers

Registering Individual Data Manager with Broker

COSMOS> broker register <DataManager name> [service finder EPR]

Registering ServiceGroup

COSMOS> broker registerServiceGroup <host> <name> <wsdl URL #1> [wsdl URL #2] ...


Print Broker EPR

COSMOS> broker epr print

Modifiying Broker EPR

COSMOS> broker epr change

List All Data Managers Registered with Broker

COSMOS> broker getDataManagers

None
Find all DataManagers using CosmosServiceFinder web service

COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder

None
Deregistering Data Managers from broker

COSMOS> broker deregister domsr01-xp StatDataManager

None
COSMOS> broker deregister domsr01-xp LoggingDataManager None
COSMOS> broker deregister domsr01-xp TestFederatingCMDB None
COSMOS> broker deregister domsr01-xp ExampleMdr None
COSMOS> broker deregister domsr01-xp SMLMDR None
COSMOS> broker deregister domsr01-xp AperiMdr None
Executing CMDBf Queries using the command line client

COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

None
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml None
COSMOS> graphQuery domsr01-xp AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml None
COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt None.
===Using the COSMOS Web User Interface===
Layout of the User Interface

http://localhost:8080/COSMOSUI/?page=cosmos

Found All 6 DataManagers under COSMOS Web UI
Data Managers View

http://localhost:8080/COSMOSUI/?page=cosmos

Found All 6 DataManagers under COSMOS Web UI
StatDataManager

server 33 tomcat1181829221515 CBE -> Statistical Report

Statistical Report generated successfully
StatDataManager

StatDataManager -> Properties...

None
LoggingDataManager

access_log.cbe.xml -> Top 10 Log Report

Top 10 Log Report generated successfully
LoggingDataManager

windows_app_log.cbe.xml -> Top 10 Log Report

Top 10 Log Report generated successfully
LoggingDataManager

LoggingDataManager -> Properties...

None
Resource Repository (SML MDR)

Resoure Repository->New Folder...

None
Resource Repository (SML MDR)

Resoure Repository->Submit Query...

None
Resource Repository (SML MDR)

Resoure Repository->Submit Query as Text

None
Resource Repository (SML MDR)

Resoure Repository->View MetaData

No Metadata available
Resource Repository (SML MDR)

Resource Repository->Properties

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->New Folder...

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Tabular View

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Hierarchal View

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Register Configuration Items...

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->DeRegister Configuration Items...

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Rename...

None
Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Refresh

None
Sample Repository with Query (EXAMPLE MDR)

Get All Students

Displayed Query Result for Students data correctly
Sample Repository with Query (EXAMPLE MDR)

Get All Teachers

Displayed Query Result for Teachers data correctly
Sample Repository with Query (EXAMPLE MDR)

Get All Classes

Displayed Query Result for Classes data correctly
Sample Repository with Query (EXAMPLE MDR)

Staff01

Displayed data for 'students taught by teacher-staff01' correctly
Sample Repository with Query (EXAMPLE MDR)

Staff02

Displayed data for 'students taught by teacher-staff02' correctly
Sample Repository with Query (EXAMPLE MDR)

Submit Query

Using Query Builder, able to create and execute queries correctly
Sample Repository with Query (EXAMPLE MDR)

View MetaData

Displayed MetaData information correctly
Sample Repository with Registration (Federating CMDB)

Submit Query

Query for all-items resulted Empty Reponse, no data found.
Sample Repository with Registration (Federating CMDB)

Register Configuration Items...

Registration with Example MDR is successful
Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...

Deregistration with Example MDR is successful (Federating CMDB)
Sample Repository with Registration

Submit Query

Query for all-items resulted Empty Reponse, no data found.
Sample Repository with Registration (Federating CMDB)

View MetaData

No Metadata available
AperiMDR (Storage Repository)

Submit Query

Using Query builder able to execute and validate queries properly
AperiMDR (Storage Repository)

View MetaData

Displayed MetaData properly

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

6. Basic operational efficiency tests (limited performance tests)


QA i11 Execution - Miscellaneous


Back to the top