Skip to main content

Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

COSMOS i9 QA Phase Execution

Revision as of 06:47, 4 March 2008 by Unnamed Poltroon (Talk) (→‎i9 End2End Supplement Tests)

This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.

QA Test Execution Activities for i9

Primary Tasks:

  1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
  2. i9 ERs (17 ERs) – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_9_Enhancements)
  3. Data Visualization TPTP Manual Tests Execution (DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite)

Secondary Tasks:

  1. Execution of i9 supplement e2e tests from QA.
  2. Basic operational efficiency tests (limited performance tests)

E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)

Build ID: COSMOS-1.0.0-200802261616 http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616

Last updated : --Domsr01.ca.com 07:21, 29 February 2008 (EST)

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
Build Installation and Configuration

<cosmos-demo>/bin/configDemo.bat

Passed Passed Passed None
Starting COSMOS components

<tomcat-install-dir>/bin/startup.bat

Passed Passed Passed All 5 Data Managers started successfully
Get Brokers registered at Management Domain

COSMOS> domain getBrokers

Passed Passed Passed Listed Broker EPR successfully
Get Data Managers register at the Broker

COSMOS> broker getDataManagers

Passed Passed Passed Listed All 5 Data Managers EPRs
CMDBf Query Execution

COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt

Passed Passed Passed Query Executed Successfully
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt Passed Passed Passed Query Executed Successfully
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt Passed Passed Passed Query Executed Successfully
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt Passed Passed Passed Query Executed Successfully
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-

classes.txt

Passed Passed Passed Query Executed Successfully
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt Passed Passed Passed Query Executed Successfully
COSMOS>examplemdr getWSD Passed Passed Passed Displayed WSDL information from Example MDR
Data Manager Services : Collecting Log Events from Logging Data Manager

logging getDatasets

Passed Passed Passed Listed 2 DataSources successfully
logging getAllCBE access_log.cbe.xml Passed Passed Passed Diplayed long list of CommonBaseEvent objects obtained from the logfile specified
logging getCBECountBySeverity access_log.cbe.xml Passed Passed Passed Displayed event type summary from the logfile specified
logging getAllCBE windows_app_log.cbe.xml Passed Passed Passed Diplayed long list of CommonBaseEvent objects obtained from the logfile specified
logging getCBECountBySeverity access_log.cbe.xml Passed Passed Passed Displayed event type summary from the logfile specified
Data Manager Services : Collect webserver performance data from Statistical Data Manager

stat getDatasourceKeyset

Passed Passed Passed Displayed dataset/keyset combinations available
stat getStatDataForSource "server 33 tomcat1181829221515" CBE Passed Passed Passed Displayed formatted output for the given dataset/keyset
stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet Passed Passed Passed Displayed formatted output for the given dataset/keyset
COSMOS Web User Interface tests (should be verified on both IE and Firefox)

Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes)

Passed Passed Passed Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully
Expand Statistical node and check for Dataset/Keyset values Passed Passed Passed Diplayed 2 Dataset/keyset values successfully
Expand CBE node and check for 2 log files Passed Passed Passed Diplayed 2 log file names successfully
Verify the properties of all 5 nodes under Properties pane Passed Passed Passed All properties values are rendering properly
Using SMLMDR and verify CMDBf response viewer Passed Passed Passed All existing SMLMDR CMDBf queries executed properly
Using EXAMPLE MDR Query Builder and verifying CMDBf response viewer Passed Passed Passed Query Builded successfully and displayed all data properly under CMDBf Response Viewer
RegistrationExample

Registering configuration items with the test Federating CMDB

Passed Passed Passed Registered configured items successfully
Deregistering configuration items with the test Federating CMDB Passed Passed Passed Deregistered configured items successfully
Generate Top 10 Log reports for CBE of access_log.cbe.xml Passed Passed Passed Generated Top 10 Log reports for access_log_cbe.xml successfully
Generate Top 10 Log reports for CBE of windows_app_log.cbe.xml Passed Passed Passed Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully
Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE Passed Passed Passed Generated Stat report for given CBE dataset/keyset values successfully
Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet Passed Passed Passed Generated Stat report for given TomcatSet dataset/keyset values successfully

i9 ERs - JUnits/Manual Tests Inspection

(Bugzilla: i9 Enhancements)


Bugzilla ID ID Summary JUnits Status Manual Tests Remarks
216210 Define & document COSMOS 1.0 hardware & software operational guidelines, recommendations, and best practices NA NA This ER refers to documentation
215123 Complete CMDBf 1.0 Service Metadata implementation NA Available Manual Tests available under Design Doc.
214672 Registration of MDR configuration items with a federating CMDB NA NA No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests
216211 We need an ongoing build process to facilitate a continuous test loop NA NA This ER refers to Documentation
205826 Update DataCenter model based on latest SML changes NA NA This ER refers to Documentation
217301 Visualizing a CMDBf status response NA NA No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests
214794 "Generic" metadata driven CMDBf Query Builder Available Available Manual Tests & JUnits available (JUnits CVS path is missing)
217337 Generate JSON outputter for generic CMDBf Graph Response View NA Available Manual Tests available under Design Doc
208274 Create a data manager toolkit that will allow adopters to easily register and use a data provider inside COSMOS framework NA Available Manual TPTP tests available under CVS
215267 Provide support for adding a federating CMDB to COSMOS framework NA NA No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests
214145 Generic CMDBf Graph Response View NA Available Manual Tests available under Design Doc
209980 MDR (and Data Manager) deployment outside of OSGi environment NA NA No explicit Manual Tests/Junits available, however these tests have been covered under End2End testing demo page
214903 Provide a mechanism for testing the registration service and client NA NA No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests
216529 Define scope and detail the i9 QA activities NA NA This ER refers to Documentation
220181 Complete the i9 QA activities NA NA This ER refers to Documentation
205825 Update SML validator implementation based on changes to the SML latest draft NA NA This ER referes to SML-IF Documentation

i9 End2End Supplement Tests

Build ID: COSMOS-1.0.0-200802261616 http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
Starting COSMOS Components
  1. Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with port 8090 (other than default 8080)
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with default port 8080, hostname other than localhost
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with default port 8080, hostname as localhost, provide tomcat-path and

cosmos-dir path with spaces in them

  1. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with invalid configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders (except log,stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders (except cosmos) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
  1. Unzip COSMOS demo zip file and copy all folders (except COSMOSUI) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
 None
COSMOS Command Line Operations - CMDBf Queries
  1. Unzip COSMOS demo zip file and copy all folders (except examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
  4. run 'examplemdr query <valid-query-path>' with valid Example EPR as input
 None
  1. Unzip COSMOS demo zip file and copy all folders (except examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
  4. run 'examplemdr query <valid-query-path>' with valid SML EPR as input
 None
  1. Unzip COSMOS demo zip file and copy all folders (except smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
  4. run 'smlmdr query <valid-query-path>' with valid SML EPR as input
 None
  1. Unzip COSMOS demo zip file and copy all folders (except smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps
  2. Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data
  3. Start tomcat (<tomcat-dir>/bin/startup.bat)
  4. run 'smlmdr query <valid-query-path>' with valid Example EPR as input
 None
COSMOS Web User Interface None

Basic Operational effeciency tests

To be added

i9 Test Execution Results

--Domsr01.ca.com 07:33, 29 February 2008 (EST) COSMOS i9 E2E Tests

  1. COSMOS Command line Client, test results :

https://bugs.eclipse.org/bugs/attachment.cgi?id=90988 https://bugs.eclipse.org/bugs/attachment.cgi?id=91166

  1. COSMOS Web UI tests Snapshots :

https://bugs.eclipse.org/bugs/attachment.cgi?id=90987 https://bugs.eclipse.org/bugs/attachment.cgi?id=91167

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_i9_QA_Phase_Execution&oldid=85527"

Back to the top