Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TPTP-Test-Tools-20080204"
(→Notes) |
(→Defects) |
||
(10 intermediate revisions by the same user not shown) | |||
Line 19: | Line 19: | ||
* [http://www.eclipse.org/tptp/home/downloads/?ver=4.4.1 Download.] | * [http://www.eclipse.org/tptp/home/downloads/?ver=4.4.1 Download.] | ||
− | * [http://www.eclipse.org/tptp/reports/test/ | + | * [http://www.eclipse.org/tptp/reports/test/testpass_441.php?source=All Test reports.] |
=== Where are we at? === | === Where are we at? === | ||
− | * We are currently starting the 4.4.1 test pass (TP) | + | * We are currently starting the last week of the 4.4.1 test pass (TP) (target: February 8). |
=== Testing === | === Testing === | ||
− | * | + | * Candidate driver: [http://www.eclipse.org/tptp/home/downloads/?buildId=TPTP-4.4.1-200801280906 TPTP-4.4.1-200801280906] |
− | * | + | |
+ | * Blocker: | ||
+ | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217035 (Linux) Cannot connect to the Agent Controller]: Paul will verify the fix today in the [http://www.eclipse.org/tptp/home/downloads/?buildId=TPTP-4.4.1-200802010100 TPTP-4.4.1-200802010100] driver. | ||
+ | |||
+ | ==== 4.4.1 TP1 ==== | ||
+ | |||
+ | * Tony completed a most of the 4.4.1 testing as part of his orientation. He did an exceptional job completing the testing on-time and without errors. A job well done Tony! | ||
+ | |||
* The outstanding testing includes: | * The outstanding testing includes: | ||
** Duwayne: | ** Duwayne: | ||
Line 36: | Line 43: | ||
*** /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite | *** /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite | ||
*** /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.ManualRunner.Windows_XP.testsuite | *** /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.ManualRunner.Windows_XP.testsuite | ||
+ | *** /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite | ||
+ | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Platform.Reporting_BIRT_Linux.testsuite | ||
** Tony: | ** Tony: | ||
− | *** /org.eclipse. | + | *** /org.eclipse.tptp.test.auto.gui.tests/junit/TestAutoGUIUtil.testsuite |
− | *** /org.eclipse.hyades.test. | + | *** /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite |
− | + | *** /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite | |
− | *** /org.eclipse.hyades.test. | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartBoundsSVG.testsuite |
− | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartInternationlizationSVG.testsuite | |
− | *** /org.eclipse.tptp. | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartStaticImage.testsuite |
− | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSVG.testsuite | |
− | *** /org.eclipse.tptp. | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSWT.testsuite |
− | *** /org.eclipse.tptp. | + | *** /org.eclipse.tptp.platform.report.tests/manual/Reporting/Platform.Reporting_BIRT.testsuite |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | *** /org.eclipse. | + | |
− | + | ||
− | + | ||
− | *** /org.eclipse.tptp. | + | |
− | *** /org.eclipse.tptp. | + | |
== 4.5 == | == 4.5 == | ||
Line 72: | Line 72: | ||
=== Where are we at? === | === Where are we at? === | ||
− | * We | + | * We are starting a 1.5 week I5 TP1 (target: February 13) since the 4.4.1 TP is nearly complete. |
− | * | + | * I5 development is closed and requires Project/PMC approval. |
=== Testing === | === Testing === | ||
− | * | + | * We want to complete the I5 TP1 by Friday, February 8. |
− | + | * The [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.0 candidate driver] will be announced by the Release Engineering Team later today. | |
− | + | ||
− | + | ||
− | === 4.5 I5 TP1 === | + | ==== 4.5 I5 TP1 ==== |
* TP1 testing assignments: | * TP1 testing assignments: | ||
**Manual: | **Manual: | ||
+ | ***Tony: | ||
+ | ****/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite | ||
+ | ****/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite | ||
+ | ****/org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite | ||
+ | ****/org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite | ||
+ | ****/org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite | ||
+ | ****/org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite | ||
***Paul: | ***Paul: | ||
− | ****org.eclipse. | + | ****/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite |
− | + | ****/org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite | |
− | + | ****/org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartBoundsSVG.testsuite | |
− | + | ****/org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartInternationlizationSVG.testsuite | |
− | + | ****/org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartStaticImage.testsuite | |
− | ****org.eclipse.tptp.test.tools.api.tests | + | ****/org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSVG.testsuite |
− | ****org.eclipse. | + | ****/org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSWT.testsuite |
− | + | ****/org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite | |
− | + | ||
− | ****org.eclipse.tptp.platform.report.tests | + | |
− | ****org.eclipse.tptp.platform.report.tests | + | |
− | ****org.eclipse.tptp.platform.report.tests | + | |
− | ****org.eclipse.tptp.platform.report.tests | + | |
− | ****org.eclipse. | + | |
***Duwayne: | ***Duwayne: | ||
− | ****org.eclipse.hyades.test.URLTest.tests | + | ****/org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite |
− | ****org.eclipse.hyades.test.URLTest.tests | + | ****/org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite |
− | ****org.eclipse.hyades.test.URLTest.tests | + | ****/org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite |
**JUnit: | **JUnit: | ||
***Paul: | ***Paul: | ||
− | ****org.eclipse.tptp.test.testservices.tests | + | ****/org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite |
− | ****org.eclipse.tptp.test.testservices.tests | + | ****/org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite |
− | ****org.eclipse.tptp.test.testservices.tests | + | ****/org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite |
− | ****org.eclipse.tptp.test.testservices.tests | + | ****/org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite |
− | ****org.eclipse.hyades.test.ui.logViewer.tests | + | ***Tony: |
+ | ****/org.eclipse.hyades.test.ui.logViewer.tests/JUnit/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite | ||
**JUnit Plug-in: | **JUnit Plug-in: | ||
***Paul: | ***Paul: | ||
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite |
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite |
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite |
− | ****org.eclipse.hyades.test.core.tests | + | ****/org.eclipse.hyades.test.core.tests/junit/launch/facade/TestLaunchConfigurationFacadeTest.testsuite |
− | ****org.eclipse.hyades.test.core.tests | + | ****/org.eclipse.hyades.test.core.tests/junit/launch/facade/DeploymentLaunchConfigurationFacadeTest.testsuite |
− | ****org.eclipse.hyades.test.core.tests | + | ****/org.eclipse.hyades.test.core.tests/junit/launch/facade/ExecutionHistoryLaunchConfigurationFacadeTest.testsuite |
− | ****org.eclipse.hyades.test.core.tests | + | ****/org.eclipse.hyades.test.core.tests/junit/launch/extensions/DeploymentsProviderTest.testsuite |
− | ****org.eclipse.hyades.test.core.tests | + | ****/org.eclipse.hyades.test.core.tests/junit/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite |
**AGR: | **AGR: | ||
***Paul: | ***Paul: | ||
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite |
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite |
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite |
− | ****org.eclipse.hyades.test.java.tests | + | ****/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite |
− | ****org.eclipse.hyades.test.ui.logViewer.tests | + | ***Tony: |
− | ****org.eclipse.hyades.test.ui.logViewer.tests | + | ****/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite |
− | ****org.eclipse.hyades.test.ui.navigator.tests | + | ****/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite |
− | ****org.eclipse.hyades.test.ui.navigator.tests | + | ****/org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite |
− | + | ****/org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite | |
=== Test Automation Initiative === | === Test Automation Initiative === | ||
* Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure: | * Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure: | ||
+ | ** On Friday, Paul and Joel were able to run JUnit/JUnit Plug-in BVTs on the Reference Platform. The next step is for Joel to integrate these BVTs with the nightly build process and post the Test Reports. | ||
** For more information, see the [http://wiki.eclipse.org/4.5_Test_Automation_Initiative WIKI page]. | ** For more information, see the [http://wiki.eclipse.org/4.5_Test_Automation_Initiative WIKI page]. | ||
** Outstanding defect against the Test Project include: | ** Outstanding defect against the Test Project include: | ||
*** Paul: | *** Paul: | ||
− | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=214638 Test log not accurate]: Completed in i5. |
− | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215082 publication task problems]: Completed in i5. |
− | + | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests]: Targeted to i5. | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests]: Targeted to i5. | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215078 Content missing in Tabular Report]: Targeted to i6. | ||
*** Duwayne: | *** Duwayne: | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=200194 ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results]: Targeted to i6. | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=200194 ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results]: Targeted to i6. | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210289 ANT test results property requires trailing slash to specify location]: Targeted to i6. | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210289 ANT test results property requires trailing slash to specify location]: Targeted to i6. | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210292 ANT importExistingProjects throws Exception]: Targeted to i6. | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210292 ANT importExistingProjects throws Exception]: Targeted to i6. | ||
− | |||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216635 Running ASF through Ant requires display export]: Targeted to i6. | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216635 Running ASF through Ant requires display export]: Targeted to i6. | ||
Line 160: | Line 160: | ||
* Duwayne: | * Duwayne: | ||
− | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=162605 Test execution should support parallel execution of tests]: See the [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-162605 meeting minutes] for more details. Duwayne will complete this enhancement | + | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=162605 Test execution should support parallel execution of tests]: See the [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-162605 meeting minutes] for more details. Duwayne will complete this enhancement, including test cases and product documentation in I5/I6 development. This past week, Duwayne finished code changes for parallel agent start-up and running multiple simultaneous agents but is still seeing an IllegalMonitorStateException exception. Test cases are outstanding. Duwayne will schedule a call for next week to discuss the progress and outstanding items. |
* Jerome: | * Jerome: | ||
− | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets]: Jerome | + | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets]: Jerome completed the engine work (bugs remain in tee delete use case) and chaired a follow-on [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01282008 call/demo]. Test cases are outstanding. For more information, see: |
− | *** [http://wiki.eclipse.org/index.php?title=TPTP-Test-Tools-Design-Review-166025 Design Review | + | *** [http://wiki.eclipse.org/index.php?title=TPTP-Test-Tools-Design-Review-166025 Design Review] |
− | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025 Design Decisions] | + | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025 Design Decisions] |
− | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01112008#Core_Use_Cases Core Use Cases | + | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01112008#Core_Use_Cases Core Use Cases] |
*** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01112008#Detailed_Design Detailed Design Document] | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01112008#Detailed_Design Detailed Design Document] | ||
+ | *** [http://wiki.eclipse.org/TPTP-Test-Tools-Design-Review-166025-01282008 Design Discussion and Demo] | ||
* Paul: | * Paul: | ||
− | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=208110 Generic Recorder Wizard enhancement to filter the list of recorders]: Paul has closed with the consuming product on removing the duplicate HTTP recording wizard (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=137591 defect 137591) and wizard to import HTTP recordings (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206078 defect 206078) since both are currently supported by the GRF. Paul will complete the implementation/testing in | + | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=208110 Generic Recorder Wizard enhancement to filter the list of recorders]: Paul has closed with the consuming product on removing the duplicate HTTP recording wizard (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=137591 defect 137591) and wizard to import HTTP recordings (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206078 defect 206078) since both are currently supported by the GRF. Paul will complete the implementation/testing in I6. |
=== Defects === | === Defects === | ||
Line 181: | Line 182: | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215082 publication task problems.] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215082 publication task problems.] | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216635 Running ASF through Ant requires display export.] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216635 Running ASF through Ant requires display export.] | ||
− | + | ** Jerome: | |
− | * | + | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216958 Copying lots of test results to a newly created folder hangs the system] |
− | ** | + | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216916 Wrong behaviour when using Working Sets in Test Navigator] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
* Remaining I5 defects: | * Remaining I5 defects: | ||
** Paul: | ** Paul: | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests.] | ||
− | |||
− | |||
− | |||
− | |||
− | |||
** Duwayne: | ** Duwayne: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201412 Repeated launch through Automated Services Framework eventually fails]: Required by a consuming product. |
+ | |||
+ | * The following I5 defects have been deferred to I6: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=194503 ASF marshalling return value between service and client adapter does not have support for failures / exceptions] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=194503 ASF marshalling return value between service and client adapter does not have support for failures / exceptions] | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211066 RecorderException when HTTP recording with Internet Explorer on Windows XP.] |
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=189128 Vista-specific error dialog when recording using IAC/IE on XP.] | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201150 Text in Recorder Control should be copyable.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201150 Text in Recorder Control should be copyable.] | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201896 Get rid of the Remove option from the Http Requests tab of the Hyades URL Test Suite] |
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | ||
− | |||
− | |||
− | |||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=137591 Duplicate wizards for creating a URL recording/test.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=205477 Copy / Paste should not be available in the logical test navigator] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=151922 (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=212537 Remove references to internal APIs.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213318 Exported datapool with deleted variables is incorrect.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213329 Importing large datapool freezes wizard.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201900 scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210742 Log Viewer : navigation button on event part of test log are not enabled by default] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213205 TPTP test pass reports show test type ID instead of meaningful name.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=200201 Need new icon for testlog files] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206078 Cannot import HTTP recording file.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206355 (Usability) Switch to Test Perspective after test execution.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=182128 (Usability) Test invocation error message cannot be copied] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206356 (Usability) Switch to Test Perspective after creating a test asset.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201828 Report Icon is incorrect for Test Pass and Time Frame Historic] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=174460 (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.] | ||
=== Miscellaneous === | === Miscellaneous === | ||
Line 226: | Line 222: | ||
* Test project topics for upcoming AG calls include: | * Test project topics for upcoming AG calls include: | ||
− | ** | + | ** ASF and Test Services: Joe |
** Test automation initiative: Alan/Joel | ** Test automation initiative: Alan/Joel | ||
** EMMA: Paul | ** EMMA: Paul | ||
Line 237: | Line 233: | ||
** Worked on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=208110 Generic Recorder Wizard enhancement to filter the list of recorders]. | ** Worked on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=208110 Generic Recorder Wizard enhancement to filter the list of recorders]. | ||
** Completed defects: | ** Completed defects: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216423 (Test Project) (Web) (Matrix) Update the TPTP Matrix and Bugzilla component owners.] |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217483 Ant impoertExistingProjects task does not build projects] | |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215082 publication task problems] | |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216588 Fix project/compilation errors in the TPTP test bucket.] | |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217295 Platform.Communication.Installation.Uninstallation testsuite failed to run] | |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=214638 Test log not accurate] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | + | ||
− | + | ||
− | + | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | + | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
* This Week: | * This Week: | ||
** 4.4.1 TP. | ** 4.4.1 TP. | ||
− | ** | + | ** 4.5 I5 TP. |
− | + | ** Defect: | |
− | ** | + | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=211476 Remove XMLUnit dependency and convert reporting tests to TPTP tests.] | ||
− | ** | + | ** Finish reviewing: |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=202695 Encrypted datapool variable support] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets] |
=== Duwayne === | === Duwayne === | ||
* Last Week: | * Last Week: | ||
+ | ** 4.4.1 TP. | ||
** Working on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=162605 Test execution should support parallel execution of tests] including investigating sequence of events and setting up a test environment for multiple agents. | ** Working on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=162605 Test execution should support parallel execution of tests] including investigating sequence of events and setting up a test environment for multiple agents. | ||
+ | ** Defect: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201412 Repeated launch through Automated Services Framework eventually fails] | ||
* This Week: | * This Week: | ||
** 4.4.1 TP. | ** 4.4.1 TP. | ||
− | ** | + | ** 4.5 I5 TP. |
− | + | ||
** Defect: | ** Defect: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201412 Repeated launch through Automated Services Framework eventually fails] |
=== Jerome === | === Jerome === | ||
Line 282: | Line 267: | ||
* Last Week: | * Last Week: | ||
* Working on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets]. | * Working on enhancement [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets]. | ||
− | ** Completed | + | ** Completed a [https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025#c25 stable patch] for review. |
* This Week: | * This Week: | ||
− | ** | + | ** No TPTP contribution. |
− | + | ||
− | + | ||
=== Tony === | === Tony === | ||
* Last Week: | * Last Week: | ||
− | ** | + | ** 4.4.1 TP. |
* This Week: | * This Week: | ||
− | ** | + | ** 4.4.1 TP. |
+ | ** 4.5 I5 TP. | ||
== Action items == | == Action items == | ||
Line 306: | Line 290: | ||
=== News === | === News === | ||
+ | |||
+ | * The [http://www.giants.com/ New York Giants] are the [http://www.nfl.com/superbowl Super Bowl XLII] champions! | ||
* The PMC approved Jerome as the Lead Committer for the following components: | * The PMC approved Jerome as the Lead Committer for the following components: |
Latest revision as of 10:16, 11 February 2008
Attendees
- Present:
- Paul Slauenwhite
- DuWayne Morris
- Jerome Bozier
- Tony Wang
4.4.1
Release Information
- 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).
Where are we at?
- We are currently starting the last week of the 4.4.1 test pass (TP) (target: February 8).
Testing
- Candidate driver: TPTP-4.4.1-200801280906
- Blocker:
- (Linux) Cannot connect to the Agent Controller: Paul will verify the fix today in the TPTP-4.4.1-200802010100 driver.
4.4.1 TP1
- Tony completed a most of the 4.4.1 testing as part of his orientation. He did an exceptional job completing the testing on-time and without errors. A job well done Tony!
- The outstanding testing includes:
- Duwayne:
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
- Paul:
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
- /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.ManualRunner.Windows_XP.testsuite
- /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Platform.Reporting_BIRT_Linux.testsuite
- Tony:
- /org.eclipse.tptp.test.auto.gui.tests/junit/TestAutoGUIUtil.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartBoundsSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartInternationlizationSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartStaticImage.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSWT.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Platform.Reporting_BIRT.testsuite
- Duwayne:
4.5
Release Information
- 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).
Where are we at?
- We are starting a 1.5 week I5 TP1 (target: February 13) since the 4.4.1 TP is nearly complete.
- I5 development is closed and requires Project/PMC approval.
Testing
- We want to complete the I5 TP1 by Friday, February 8.
- The candidate driver will be announced by the Release Engineering Team later today.
4.5 I5 TP1
- TP1 testing assignments:
- Manual:
- Tony:
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
- /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
- Paul:
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
- /org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartBoundsSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartInternationlizationSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartStaticImage.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSVG.testsuite
- /org.eclipse.tptp.platform.report.tests/manual/Reporting/Plaform.UI.Charting_ChartSWT.testsuite
- /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
- Duwayne:
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
- Tony:
- JUnit:
- Paul:
- /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite
- /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite
- /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite
- /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite
- Tony:
- /org.eclipse.hyades.test.ui.logViewer.tests/JUnit/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
- Paul:
- JUnit Plug-in:
- Paul:
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit/launch/facade/TestLaunchConfigurationFacadeTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit/launch/facade/DeploymentLaunchConfigurationFacadeTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit/launch/facade/ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit/launch/extensions/DeploymentsProviderTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
- Paul:
- AGR:
- Paul:
- /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
- /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
- /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
- /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
- Tony:
- /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite
- Paul:
- Manual:
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- On Friday, Paul and Joel were able to run JUnit/JUnit Plug-in BVTs on the Reference Platform. The next step is for Joel to integrate these BVTs with the nightly build process and post the Test Reports.
- For more information, see the WIKI page.
- Outstanding defect against the Test Project include:
- Paul:
- Test log not accurate: Completed in i5.
- publication task problems: Completed in i5.
- Remove XMLUnit dependency and convert reporting tests to TPTP tests: Targeted to i5.
- Content missing in Tabular Report: Targeted to i6.
- Duwayne:
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results: Targeted to i6.
- ANT test results property requires trailing slash to specify location: Targeted to i6.
- ANT importExistingProjects throws Exception: Targeted to i6.
- Running ASF through Ant requires display export: Targeted to i6.
- Paul:
Enhancements
- Xin Ying Huang:
- Encrypted datapool variable support: The implementation is complete. Paul and Joe will be finishing the code review this week.
- Duwayne:
- Test execution should support parallel execution of tests: See the meeting minutes for more details. Duwayne will complete this enhancement, including test cases and product documentation in I5/I6 development. This past week, Duwayne finished code changes for parallel agent start-up and running multiple simultaneous agents but is still seeing an IllegalMonitorStateException exception. Test cases are outstanding. Duwayne will schedule a call for next week to discuss the progress and outstanding items.
- Jerome:
- Move, Copy, Delete, Rename and Import/Export test assets: Jerome completed the engine work (bugs remain in tee delete use case) and chaired a follow-on call/demo. Test cases are outstanding. For more information, see:
- Paul:
- Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed with the consuming product on removing the duplicate HTTP recording wizard (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=137591 defect 137591) and wizard to import HTTP recordings (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206078 defect 206078) since both are currently supported by the GRF. Paul will complete the implementation/testing in I6.
Defects
- Defects requiring a sizing:
- Remaining I5 defects:
- Paul:
- Duwayne:
- Repeated launch through Automated Services Framework eventually fails: Required by a consuming product.
- The following I5 defects have been deferred to I6:
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- RecorderException when HTTP recording with Internet Explorer on Windows XP.
- Vista-specific error dialog when recording using IAC/IE on XP.
- Text in Recorder Control should be copyable.
- Get rid of the Remove option from the Http Requests tab of the Hyades URL Test Suite
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- Duplicate wizards for creating a URL recording/test.
- Copy / Paste should not be available in the logical test navigator
- (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
- Remove references to internal APIs.
- Exported datapool with deleted variables is incorrect.
- Importing large datapool freezes wizard.
- scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
- Log Viewer : navigation button on event part of test log are not enabled by default
- TPTP test pass reports show test type ID instead of meaningful name.
- Need new icon for testlog files
- Cannot import HTTP recording file.
- (Usability) Switch to Test Perspective after test execution.
- (Usability) Test invocation error message cannot be copied
- (Usability) Switch to Test Perspective after creating a test asset.
- Report Icon is incorrect for Test Pass and Time Frame Historic
- (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
Miscellaneous
- (Scalability) Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI.
- Test project topics for upcoming AG calls include:
- ASF and Test Services: Joe
- Test automation initiative: Alan/Joel
- EMMA: Paul
Round-table
Paul
- Last Week:
- Worked on enhancement Generic Recorder Wizard enhancement to filter the list of recorders.
- Completed defects:
- (Test Project) (Web) (Matrix) Update the TPTP Matrix and Bugzilla component owners.
- Ant impoertExistingProjects task does not build projects
- publication task problems
- Fix project/compilation errors in the TPTP test bucket.
- Platform.Communication.Installation.Uninstallation testsuite failed to run
- Test log not accurate
- This Week:
- 4.4.1 TP.
- 4.5 I5 TP.
- Defect:
- Finish reviewing:
Duwayne
- Last Week:
- 4.4.1 TP.
- Working on enhancement Test execution should support parallel execution of tests including investigating sequence of events and setting up a test environment for multiple agents.
- Defect:
- This Week:
- 4.4.1 TP.
- 4.5 I5 TP.
- Defect:
Jerome
- Last Week:
- Working on enhancement Move, Copy, Delete, Rename and Import/Export test assets.
- Completed a stable patch for review.
- This Week:
- No TPTP contribution.
Tony
- Last Week:
- 4.4.1 TP.
- This Week:
- 4.4.1 TP.
- 4.5 I5 TP.
Action items
Duwayne
- Schedule a call for next week to discuss the progress and outstanding items for enhancement Test execution should support parallel execution of tests.
Notes
News
- The New York Giants are the Super Bowl XLII champions!
- The PMC approved Jerome as the Lead Committer for the following components:
- Test.UI
- Test.UI.ConfigEditors
- Test.UI.DatapoolEditor
- Test.UI.FrameworkEditors
- Test.UI.TestPerspective
- Paul created a Test Tools Project Code Snippets page (linked from the Miscellaneous page in the TPTP WIKI) for code snippets that demonstrate specific programmatic tasks commonly requested by Test Tools users on the news group or mailing list.
EclipseCon 2008
Reminders
Lead Committers
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections.