Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i10 QA Phase Execution"
(→i10 End2End Supplement Tests (Negative)) |
(→i10 End2End Supplement Tests (Negative)) |
||
Line 603: | Line 603: | ||
! Test Status | ! Test Status | ||
Windows XP SP2 | Windows XP SP2 | ||
− | |||
− | |||
! Test Status | ! Test Status | ||
RHES 5.0 | RHES 5.0 | ||
Line 610: | Line 608: | ||
|- | |- | ||
|http://localhost:8080/COSMOSUI/?page=cosmos | |http://localhost:8080/COSMOSUI/?page=cosmos | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 617: | Line 614: | ||
|StatDataManager | |StatDataManager | ||
server 33 tomcat1181829221515 CBE | server 33 tomcat1181829221515 CBE | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 624: | Line 620: | ||
|StatDataManager | |StatDataManager | ||
server 33 tomcat1181829221515 TomcatSet | server 33 tomcat1181829221515 TomcatSet | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 631: | Line 626: | ||
|LoggingDataManager | |LoggingDataManager | ||
access_log.cbe.xml | access_log.cbe.xml | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 638: | Line 632: | ||
|LoggingDataManager | |LoggingDataManager | ||
windows_app_log.cbe.xml | windows_app_log.cbe.xml | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 645: | Line 638: | ||
|Sample Repository with Registration | |Sample Repository with Registration | ||
Submit Query | Submit Query | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 652: | Line 644: | ||
|Sample Repository with Registration | |Sample Repository with Registration | ||
Register Configuration Items... | Register Configuration Items... | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 659: | Line 650: | ||
|Sample Repository with Registration | |Sample Repository with Registration | ||
Deregister Configuration Items... | Deregister Configuration Items... | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 666: | Line 656: | ||
|Sample Repository with Registration | |Sample Repository with Registration | ||
Submit Query | Submit Query | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 673: | Line 662: | ||
|Sample Repository with Registration | |Sample Repository with Registration | ||
View MetaData | View MetaData | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 680: | Line 668: | ||
|Resource Repository | |Resource Repository | ||
Submit Query | Submit Query | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 687: | Line 674: | ||
|Resource Repository | |Resource Repository | ||
View MetaData | View MetaData | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 694: | Line 680: | ||
|AperiMDR | |AperiMDR | ||
Submit Query | Submit Query | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 701: | Line 686: | ||
|AperiMDR | |AperiMDR | ||
View MetaData | View MetaData | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 708: | Line 692: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Get All Students | Get All Students | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 715: | Line 698: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Get All Teachers | Get All Teachers | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 722: | Line 704: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Get All Classes | Get All Classes | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 729: | Line 710: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Staff01 | Staff01 | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 736: | Line 716: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Staff02 | Staff02 | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 743: | Line 722: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
Submit Query | Submit Query | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed | ||
Line 750: | Line 728: | ||
|Sample Repository with Query | |Sample Repository with Query | ||
View MetaData | View MetaData | ||
− | |||
|Passed | |Passed | ||
|Passed | |Passed |
Revision as of 02:36, 30 April 2008
This page is created by QA to track all i10 test execution activities from 21 Apr'08 to 02 May'08. This page will be filled in by the QA team as i10 testing phase proceeds.
Contents
- 1 QA Test Execution Activities for i10
- 2 QA Status Summary
- 3 E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
- 4 Data Visualization TPTP Manual Tests
- 5 i10 ERs - JUnits/Manual Tests Inspection
- 6 i10 End2End Supplement Tests (Negative)
- 7 Basic Operational efficiency tests
- 8 i10 Test Execution Results
QA Test Execution Activities for i10
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i10 )
- i10 ERs – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_10_Enhancements)
- Data Visualization TPTP Manual Tests Execution (DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite)
Secondary Tasks:
- Execution of i10 supplement e2e tests (negative) from QA.
- Basic operational efficiency tests (limited performance tests)
For complete i10 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i10_Activities
QA Status Summary
E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
Build Installation and Configuration
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> | Passed | Passed | Passed | None |
Starting COSMOS components : Management Console
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker | Passed | Passed | Passed | None |
COSMOS> broker registerAllDataManagers | Passed | Passed | Passed | Found warnings - "log4j:WARN No appenders could be found for logger (org.apache.axis2.util.Loader).
log4j:WARN Please initialize the log4j system properly." |
COSMOS> broker getDataManagers | Passed | Passed | Passed | None |
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp StatDataManager | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp LoggingDataManager | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp TestFederatingCMDB | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp ExampleMdr | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp SMLMDR | Passed | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp AperiMdr | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt | Passed | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt | Passed | Passed | Passed | None |
COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | Passed | Passed | Passed | Empty Response, no data found. |
Using the COSMOS Web User Interface
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
http://localhost:8080/COSMOSUI/?page=cosmos | Passed | Passed | Passed | Found All 6 DataManagers under COSMOS Web UI |
StatDataManager
server 33 tomcat1181829221515 CBE |
Passed | Passed | Passed | Statistical Report generated successfully |
StatDataManager
server 33 tomcat1181829221515 TomcatSet |
Passed | Passed | Passed | Statistical Report generated successfully |
LoggingDataManager
access_log.cbe.xml |
Passed | Passed | Passed | Top 10 Log Report generated successfully |
LoggingDataManager
windows_app_log.cbe.xml |
Passed | Passed | Passed | Top 10 Log Report generated successfully |
Sample Repository with Registration
Submit Query |
Passed | Passed | Passed | Query for all-items resulted Empty Reponse, no data found. |
Sample Repository with Registration
Register Configuration Items... |
Passed | Passed | Passed | Registration with Example MDR is successful |
Sample Repository with Registration
Deregister Configuration Items... |
Passed | Passed | Passed | Deregistration with Example MDR is successful |
Sample Repository with Registration
Submit Query |
Passed | Passed | Passed | Query for all-items resulted Empty Reponse, no data found. |
Sample Repository with Registration
View MetaData |
Passed | Passed | Passed | No Metadata available |
Resource Repository
Submit Query |
Passed | Passed | Passed | Queries executed successfully with proper results |
Resource Repository
View MetaData |
Passed | Passed | Passed | No Metadata available |
AperiMDR
Submit Query |
Passed | Passed | Passed | Using Query builder able to execute and validate queries properly |
AperiMDR
View MetaData |
Passed | Passed | Passed | Displayed MetaData properly |
Sample Repository with Query
Get All Students |
Passed | Passed | Passed | Displayed Query Result for Students data correctly |
Sample Repository with Query
Get All Teachers |
Passed | Passed | Passed | Displayed Query Result for Teachers data correctly |
Sample Repository with Query
Get All Classes |
Passed | Passed | Passed | Displayed Query Result for Classes data correctly |
Sample Repository with Query
Staff01 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff01' correctly |
Sample Repository with Query
Staff02 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff02' correctly |
Sample Repository with Query
Submit Query |
Passed | Passed | Passed | Using Query Builder, able to create and execute queries correctly |
Sample Repository with Query
View MetaData |
Passed | Passed | Passed | Displayed MetaData information correctly |
Data Visualization TPTP Manual Tests
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
navigate | Passed | Passed | 6 nodes should be shown under "Data Managers"
No "Monitoring Data Repository" node, it should be "StatDataManager" node |
navigate2 | Passed | Passed | No "Create Query" found, it should be "Submit Query" |
properties | Passed | Passed | Given EPR is wrong, it should be http://localhost:8080/axis2/services/ExampleMdrDataManager |
visualize log report | Passed | Passed | No "Monitoring Data Repository" available, it should be "StatDataManager |
visualize stat report | Passed | Passed | None |
properties 2 | Passed | Passed | None |
example cmdbf query | Passed | Passed | XML output contents seems to be wrong, actual result shows only one student detail - "firstName="Mike" id="03 lastname="Lee"" |
SML CMDBF Graph Response Viewer | Passed | Passed | None |
Example MDR CMDBF Graph Response Viewer | Passed | Passed | No cancel button available under details view window, it should be OK button. |
Multiple Graph Response Viewers | Passed | Passed | No "Cancel" button available under detail area, it should be Ok button |
Registration Example | Passed | Passed | None |
DeRegistration Example | Passed | Passed | None |
Partial Registration of MDR with CMDBf | Passed | Passed | None |
Partial DeRegistration of MDR with CMDBf | Passed | Passed | None |
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Reports.testsuite
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
LogReport | Passed | Passed | None |
StatReport | Passed | Passed | None |
i10 ERs - JUnits/Manual Tests Inspection
Bugzilla ID | ID Summary | JUnits Status | Manual Tests | Remarks |
---|
i10 End2End Supplement Tests (Negative)
Build Installation and Configuration
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> | Passed | Passed | None |
Starting COSMOS components : Management Console
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker | Passed | Passed | None |
COSMOS> broker registerAllDataManagers | Passed | Passed | Found warnings - "log4j:WARN No appenders could be found for logger (org.apache.axis2.util.Loader).
log4j:WARN Please initialize the log4j system properly." |
COSMOS> broker getDataManagers | Passed | Passed | None |
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp StatDataManager | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp LoggingDataManager | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp TestFederatingCMDB | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp ExampleMdr | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp SMLMDR | Passed | Passed | None |
COSMOS> broker deregister domsr01-xp AperiMdr | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt | Passed | Passed | None |
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt | Passed | Passed | None |
COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | Passed | Passed | Empty Response, no data found. |
Using the COSMOS Web User Interface
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
http://localhost:8080/COSMOSUI/?page=cosmos | Passed | Passed | Found All 6 DataManagers under COSMOS Web UI |
StatDataManager
server 33 tomcat1181829221515 CBE |
Passed | Passed | Statistical Report generated successfully |
StatDataManager
server 33 tomcat1181829221515 TomcatSet |
Passed | Passed | Statistical Report generated successfully |
LoggingDataManager
access_log.cbe.xml |
Passed | Passed | Top 10 Log Report generated successfully |
LoggingDataManager
windows_app_log.cbe.xml |
Passed | Passed | Top 10 Log Report generated successfully |
Sample Repository with Registration
Submit Query |
Passed | Passed | Query for all-items resulted Empty Reponse, no data found. |
Sample Repository with Registration
Register Configuration Items... |
Passed | Passed | Registration with Example MDR is successful |
Sample Repository with Registration
Deregister Configuration Items... |
Passed | Passed | Deregistration with Example MDR is successful |
Sample Repository with Registration
Submit Query |
Passed | Passed | Query for all-items resulted Empty Reponse, no data found. |
Sample Repository with Registration
View MetaData |
Passed | Passed | No Metadata available |
Resource Repository
Submit Query |
Passed | Passed | Queries executed successfully with proper results |
Resource Repository
View MetaData |
Passed | Passed | No Metadata available |
AperiMDR
Submit Query |
Passed | Passed | Using Query builder able to execute and validate queries properly |
AperiMDR
View MetaData |
Passed | Passed | Displayed MetaData properly |
Sample Repository with Query
Get All Students |
Passed | Passed | Displayed Query Result for Students data correctly |
Sample Repository with Query
Get All Teachers |
Passed | Passed | Displayed Query Result for Teachers data correctly |
Sample Repository with Query
Get All Classes |
Passed | Passed | Displayed Query Result for Classes data correctly |
Sample Repository with Query
Staff01 |
Passed | Passed | Displayed data for 'students taught by teacher-staff01' correctly |
Sample Repository with Query
Staff02 |
Passed | Passed | Displayed data for 'students taught by teacher-staff02' correctly |
Sample Repository with Query
Submit Query |
Passed | Passed | Using Query Builder, able to create and execute queries correctly |
Sample Repository with Query
View MetaData |
Passed | Passed | Displayed MetaData information correctly |
Basic Operational efficiency tests
Test Description | Output | Status | Remarks |
---|