Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "COSMOS i11 QA Phase Execution"

(→‎QA i11 Execution Activities)
(→‎1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0)
Line 32: Line 32:
  
 
==1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 ==
 
==1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 ==
 +
 +
==E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0) ==
 +
 +
{|{{BMTableStyle}}
 +
|-{{BMTHStyle}}
 +
! Test Description
 +
! Test Status
 +
  Windows XP SP2
 +
! Test Status
 +
  Windows 2003 SP1
 +
! Test Status
 +
  RHES 5.0
 +
! Remarks
 +
 +
|-
 +
|'''Build Installation and Configuration'''
 +
|
 +
|
 +
|
 +
|
 +
 +
|-
 +
|<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path>
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|'''Starting COSMOS components : Management Console'''
 +
|
 +
|
 +
|
 +
|
 +
 +
 +
|-
 +
|<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker registerAllDataManagers
 +
|
 +
|
 +
|
 +
|
 +
 +
|-
 +
|COSMOS> broker getDataManagers
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp StatDataManager
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp LoggingDataManager
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp TestFederatingCMDB
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp ExampleMdr
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp SMLMDR
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> broker deregister domsr01-xp AperiMdr
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt
 +
|
 +
|
 +
|
 +
|None
 +
 +
|-
 +
|COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt
 +
|
 +
|
 +
|
 +
|Empty Response, no data found.
 +
 +
|-
 +
|'''Using the COSMOS Web User Interface'''
 +
|
 +
|
 +
|
 +
|
 +
 +
|-
 +
|http://localhost:8080/COSMOSUI/?page=cosmos
 +
|
 +
|
 +
|
 +
|Found All 6 DataManagers under COSMOS Web UI
 +
|-
 +
|StatDataManager
 +
server 33 tomcat1181829221515 CBE
 +
|
 +
|
 +
|
 +
|Statistical Report generated successfully
 +
|-
 +
|StatDataManager
 +
server 33 tomcat1181829221515 TomcatSet
 +
|
 +
|
 +
|
 +
|Statistical Report generated successfully
 +
|-
 +
|LoggingDataManager
 +
access_log.cbe.xml
 +
|
 +
|
 +
|
 +
|Top 10 Log Report generated successfully
 +
|-
 +
|LoggingDataManager
 +
windows_app_log.cbe.xml
 +
|
 +
|
 +
|
 +
|Top 10 Log Report generated successfully
 +
|-
 +
|Sample Repository with Registration
 +
Submit Query
 +
|
 +
|
 +
|
 +
|Query for all-items resulted Empty Reponse, no data found.
 +
|-
 +
|Sample Repository with Registration
 +
Register Configuration Items...
 +
|
 +
|
 +
|
 +
|Registration with Example MDR is successful
 +
|-
 +
|Sample Repository with Registration
 +
Deregister Configuration Items...
 +
|
 +
|
 +
|
 +
|Deregistration with Example MDR is successful
 +
|-
 +
|Sample Repository with Registration
 +
Submit Query
 +
|
 +
|
 +
|
 +
|Query for all-items resulted Empty Reponse, no data found.
 +
|-
 +
|Sample Repository with Registration
 +
View MetaData
 +
|
 +
|
 +
|
 +
|No Metadata available
 +
|-
 +
|Resource Repository
 +
Submit Query
 +
|
 +
|
 +
|
 +
|Queries executed successfully with proper results
 +
|-
 +
|Resource Repository
 +
View MetaData
 +
|
 +
|
 +
|
 +
|No Metadata available
 +
|-
 +
|AperiMDR
 +
Submit Query
 +
|
 +
|
 +
|
 +
|Using Query builder able to execute and validate queries properly
 +
|-
 +
|AperiMDR
 +
View MetaData
 +
|
 +
|
 +
|
 +
|Displayed MetaData properly
 +
|-
 +
|Sample Repository with Query
 +
Get All Students
 +
|
 +
|
 +
|
 +
|Displayed Query Result for Students data correctly
 +
|-
 +
|Sample Repository with Query
 +
Get All Teachers
 +
|
 +
|
 +
|
 +
|Displayed Query Result for Teachers data correctly
 +
|-
 +
|Sample Repository with Query
 +
Get All Classes
 +
|
 +
|
 +
|
 +
|Displayed Query Result for Classes data correctly
 +
|-
 +
|Sample Repository with Query
 +
Staff01
 +
|
 +
|
 +
|
 +
|Displayed data for 'students taught by teacher-staff01' correctly
 +
|-
 +
|Sample Repository with Query
 +
Staff02
 +
|
 +
|
 +
|
 +
|Displayed data for 'students taught by teacher-staff02' correctly
 +
|-
 +
|Sample Repository with Query
 +
Submit Query
 +
|
 +
|
 +
|
 +
|Using Query Builder, able to create and execute queries correctly
 +
|-
 +
|Sample Repository with Query
 +
View MetaData
 +
|
 +
|
 +
|
 +
|Displayed MetaData information correctly
 +
|}
 +
 
==2. i11 ERs – JUnits/Manual Tests inspection ==
 
==2. i11 ERs – JUnits/Manual Tests inspection ==
 
==3. Data Visualization TPTP Manual Tests Execution ==
 
==3. Data Visualization TPTP Manual Tests Execution ==

Revision as of 02:58, 16 June 2008

QA i11 Execution - Activities

QA Test Execution Activities for i11

Primary Tasks:

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

  • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

  • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
  • SML Tooling - adhoc UI testing for editor/validator/import/export features

Secondary Tasks:

6. Basic operational efficiency tests (limited performance tests)


For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i10_Activities

QA i11 Test Execution Summary

QA i11 Execution - Complete Status

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> None
Starting COSMOS components : Management Console


<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker None
COSMOS> broker registerAllDataManagers
COSMOS> broker getDataManagers None
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder None
COSMOS> broker deregister domsr01-xp StatDataManager None
COSMOS> broker deregister domsr01-xp LoggingDataManager None
COSMOS> broker deregister domsr01-xp TestFederatingCMDB None
COSMOS> broker deregister domsr01-xp ExampleMdr None
COSMOS> broker deregister domsr01-xp SMLMDR None
COSMOS> broker deregister domsr01-xp AperiMdr None
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt None
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt None
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt None
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt None
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt None
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt None
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt None
COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt Empty Response, no data found.
Using the COSMOS Web User Interface
http://localhost:8080/COSMOSUI/?page=cosmos Found All 6 DataManagers under COSMOS Web UI
StatDataManager

server 33 tomcat1181829221515 CBE

Statistical Report generated successfully
StatDataManager

server 33 tomcat1181829221515 TomcatSet

Statistical Report generated successfully
LoggingDataManager

access_log.cbe.xml

Top 10 Log Report generated successfully
LoggingDataManager

windows_app_log.cbe.xml

Top 10 Log Report generated successfully
Sample Repository with Registration

Submit Query

Query for all-items resulted Empty Reponse, no data found.
Sample Repository with Registration

Register Configuration Items...

Registration with Example MDR is successful
Sample Repository with Registration

Deregister Configuration Items...

Deregistration with Example MDR is successful
Sample Repository with Registration

Submit Query

Query for all-items resulted Empty Reponse, no data found.
Sample Repository with Registration

View MetaData

No Metadata available
Resource Repository

Submit Query

Queries executed successfully with proper results
Resource Repository

View MetaData

No Metadata available
AperiMDR

Submit Query

Using Query builder able to execute and validate queries properly
AperiMDR

View MetaData

Displayed MetaData properly
Sample Repository with Query

Get All Students

Displayed Query Result for Students data correctly
Sample Repository with Query

Get All Teachers

Displayed Query Result for Teachers data correctly
Sample Repository with Query

Get All Classes

Displayed Query Result for Classes data correctly
Sample Repository with Query

Staff01

Displayed data for 'students taught by teacher-staff01' correctly
Sample Repository with Query

Staff02

Displayed data for 'students taught by teacher-staff02' correctly
Sample Repository with Query

Submit Query

Using Query Builder, able to create and execute queries correctly
Sample Repository with Query

View MetaData

Displayed MetaData information correctly

2. i11 ERs – JUnits/Manual Tests inspection

3. Data Visualization TPTP Manual Tests Execution

4. Execution of i11 supplement e2e tests (negative) from QA.

5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()

6. Basic operational efficiency tests (limited performance tests)

QA i11 Execution - Miscellaneous

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_i11_QA_Phase_Execution&oldid=104167"

Back to the top