TPTP-Test-Tools-20071217

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Kendric Wang

• Absent:
  • Jerome Bozier - vacation

4.4.1

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• All defects will require project/PMC approval.

• All fixes MUST be checked-in to both 4.4.1 (TPTP-4_1_1) and 4.5 (HEAD) streams.

4.5

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• We are in the first week of Test Pass (TP) 1 for 4.5 I4 (target: December 19).

• Newsgroup posts requiring replies:
  • Duwayne:
    • asf query test result and generate report from ant
    • BIRT classpath issue when publishing report
    • Create a Deployment programmatically

• Test Automation Initiative blocking issues:

1. Defect 200194: Targeted to i5.
2. Defect 190453: Targeted to i6.
3. Defect 210289: Targeted to i6.
4. Defect 210292: Targeted to i6.
5. Defect 210955: Fixed.
6. Defect 211476: Paul will fix during i4 TP1.

• We are reorganizing several components to accommodate the change in resources for 4.5:
  • See 4.5 Component Reorganization for more information.
  • Note:
    • New and existing defects for as-is components will be returned as WONTFIX with a comment.
      • All existing defects for the Test Project components have been returned as WONTFIX, with the exception of defects for internal TPTP project users.
    • New news group and mailing list posts on as-is components that cannot be easily answered (for example, configuration problems, installation issues, etc.) will be answered with a comment.

• Enhancements:
  • The milestones for these enhancements have been scheduled on the weekly schedule.
  • 202695 Encrypted datapool variable support: Will be completed by a non-committer from IBM (Xin Ying Huang). Paul and Joe are working closely with Xin Ying to answer design-specific questions through the implementation.
  • 162605 Test execution should support parallel execution of tests: Duwayne has scheduled a call for Tuesday to discuss the following
    • Use cases:
      • Launch two or more tests (different or same test types).
      • Launching/running agents and collecting results in parallel.
    • Test cases for these use cases.
    • Results from running the test cases on the existing implementation.
    • Itemized list of failures.
    • See the meeting minutes for more details.
  • 166025 Move, Copy, Delete, Rename and Import/Export test assets.: See the meeting minutes for the design review. Paul will work with Jerome after I4 development to continue the original design discussion since this is an important enhancement for TPTP in 4.5, Jerome is new to the project, and Jerome is only 50% on TPTP.
  • 208110 Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed on the design with the originator (see meeting minutes).

• Defects:
  • Defect query

• 144950 [Scalability] Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI this week.

• Paul smoke tested the TPTP-4.5.0-200712070935 candidate driver and found and resolved the following blocking defect:
  • Defect 212393
  • The Release Engineering Team will announce the 4.5 I4 TP1 candidate driver later today.

4.5 I4 TP1

• TP1 testing assignments
  • Manual:
    • Jerome:
      • org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_editing.testsuite
      • org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_importExport.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
    • Kendric:
      • org.eclipse.tptp.test.tools.api.tests\manual\Recorder\Test.UI.APIRecorder.Windows_IA32.testsuite
      • org.eclipse.hyades.execution.harness.tests\manual\defects\Test.Execution.ExecutionHarness.testsuite
    • Paul:
      • org.eclipse.tptp.test.doc.user\manual\Doc\Test.Doc.smoke.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartBoundsSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartInternationlizationSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartStaticImage.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartSWT.testsuite
    • Duwayne:
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Windows.testsuite
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Linux.testsuite
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Paul:
      • org.eclipse.tptp.test.testservices.tests\junit\Test.IBM142_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.IBM15_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.Sun142_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.Sun15_TestServices.testsuite
  • JUnit Plug-in:
    • Paul:
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.CodeSynchronizationTest.testsuite
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\TestLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\DeploymentLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\extensions\DeploymentsProviderTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\extensions\ExecutionHistoryDefaultsProviderTest.testsuite
  • AGR:
    • Paul:
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.IBM142_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.IBM15_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.Sun142_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.Sun15_JUnitRunner.testsuite
    • Jerome:
      • org.eclipse.hyades.test.ui.logViewer.tests\gui\Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\gui\Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • org.eclipse.hyades.test.ui.navigator.tests\gui\TestNavigator_Logical_auto.testsuite
      • org.eclipse.hyades.test.ui.navigator.tests\gui\TestNavigator_Resource_auto.testsuite

• Test project topics for upcoming AG calls include:
  • Enhancement 166025 (Move, Copy, Delete, Rename and Import/Export test assets): Jerome.
  • Test automation initiative: Alan/Joel
  • EMMA: Paul

Round-table

• Status updates and summary of defects, blocking issues, and architectural issues/concerns that we will focus on completing the upcoming week:
  • Paul:
    • Last Week:
      • Finished reviewing, integrating, and accepting/rejecting EclipseCon 2008 submissions of the Test and Performance category.
      • Completed defects:
        • 210955
        • 207777
        • 210576
        • 210744
    • This Week:
      • 4.5 I4 TP1.
      • Resolve the issue with the automated tests (AGR/JUnit/JUnit Plug-in tests) hanging when running with EMMA by refactoring the test runner code to allow testers to add the EMMA JAR to the class path and the emma.rt.control=false system property to the session JVM.
      • Defects:
        • 170656
        • 211476
      • Deferred to I5:
        • 145070
        • 151919
        • 186148
        • 210742
  • Duwayne:
    • Last Week:
      • Chaired a design review for enhancement 162605.
        • See the meeting minutes for more details.
      • Continued on AGR defect 171083 (resolves blocking issue 210939).
      • Continued on IPv6 defect 107432.
    • This Week:
      • 4.5 I4 TP1.
      • Finish AGR defect 171083 (resolves blocking issue 210939).
      • Finish IPv6 defect 107432.
        • Duwayne will open two dependent defects for release notes related to browser limitations.
      • Finish HTTP recorder defect 211066.
      • Finish test automation (defect 170654).
      • Outstanding news group posts.
  • Jerome:
    • Last Week:
      • Completed datapool defect 208583.
    • This Week:
      • 4.5 I4 TP1.
  • Kendric:
    • Last Week:
      • Continued on automating API Recorder test cases (see defect 170656).
    • This Week:
      • 4.5 I4 TP1.
      • Select and start the Test Project defects:
        • 186148
        • 151922
        • 201886
        • 182128
        • 206355
        • 206356

Action items

• n/a

Notes

• EclipseCon 2008:
  • Test and Performance Category: This category covers topics related to test and performance tooling that leverage Eclipse. Test and Performance tooling is used throughout the software development and test life cycle, from early unit testing, profiling, and tuning to post-deployment monitoring, tracing, and log analysis. This category is focused on the implementation, extension, and use of test and performance tooling - both open source and commercial - targeting a broad spectrum of systems including embedded, stand-alone, distributed, and enterprise. There is particular interest in exploitation and user experience of the Test and Performance Tools Platform (TPTP) project.
  • If you are interested in proposing a poster (presented at the poster reception session) or BoF (informal one-and-a-half-hour gatherings of people who want to talk about a particular topic), please:
    • Review the EclipseCon 2008 Submission Guidelines
    • Submit your poster or BoF
  • Important dates include:
    • December 10, 2007: Tutorials, Long Talks, and Short Talks selected.
    • January 19, 2008: Submissions open for posters and BoFs.

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure. For more information, see the WIKI page and meeting minutes.

Reminders

• Lead Committers:
  • Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
  • Add the Original Estimate (PH) when triaging a new defect.
  • Update the Hours Worked (PH) when completing a defect.
  • Test their components or review/track testing contributed by other committers/resources.
  • Monitor the TPTP news group and answer posts specific to their Test Project components.
  • Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
  • Use the MyFoundation Portal for committer elections. The Portal adds more automation to the elections and makes the individual project elections more transparent to the entire Eclipse community. If you have been experiencing problems or have other issues with the Portal election process, please contact the EMO (emo@eclipse.org).

• All Committers:
  • Monitor the TPTP news group and answer posts on topics other than the Test Project to support our user community.