Difference between revisions of "TPTP-Test-Tools-20071217"

Latest revision as of 16:49, 18 December 2007

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Kendric Wang
  • Joe Toomey

• Absent:
  • Jerome Bozier - vacation

4.4.1

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• All defects will require project/PMC approval.

• All fixes MUST be checked-in to both 4.4.1 (TPTP-4_1_1) and 4.5 (HEAD) streams.

4.5

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• We are in the second week of Test Pass (TP) 1 for 4.5 I4 (target: December 19).
  • TPTP-4.5.0-200712070935 candidate driver.
  • 4.5 I4 TP1 defects:
    • Paul:
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
      • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
      • URL and JUnit Plug-in Test documentation missing from TOC.
      • (Web Doc) IPV6 not supported for Internet Explorer
      • (Web Doc) IPv6 Limitation on Firefox
      • Update plugin version numbers.
      • JUnit code generator does not check against project existence
      • TPTP test results are not reported correctly.
    • Duwayne:
      • (Test Automation) Automate manual test suites using the Automated GUI Recorder.

• Newsgroup posts requiring replies:
  • Duwayne:
    • asf query test result and generate report from ant
    • BIRT classpath issue when publishing report
    • Create a Deployment programmatically

• Test Automation Initiative blocking issues:

1. Defect 200194: Targeted to i5.
2. Defect 190453: Targeted to i6.
3. Defect 210289: Targeted to i6.
4. Defect 210292: Targeted to i6.
5. Defect 211476: Paul will fix during i4 TP1.

• Enhancements:
  • The milestones for these enhancements have been scheduled on the weekly schedule.
  • 202695 Encrypted datapool variable support: Will be completed by a non-committer from IBM (Xin Ying Huang). Paul and Joe are working closely with Xin Ying to answer design-specific questions through the implementation.
  • 162605 Test execution should support parallel execution of tests: See the meeting minutes for more details.
  • 166025 Move, Copy, Delete, Rename and Import/Export test assets.: See the meeting minutes for the design review. Paul will work with Jerome after I4 to continue the original design discussion since this is an important enhancement for TPTP in 4.5, Jerome is new to the project, and Jerome is only 50% on TPTP.
  • 208110 Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed on the design with the originator (see meeting minutes).

• Defects:
  • Defect query

• 144950 [Scalability] Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI this week.

• Test project topics for upcoming AG calls include:
  • Enhancement 166025 (Move, Copy, Delete, Rename and Import/Export test assets): Jerome.
  • Test automation initiative: Alan/Joel
  • EMMA: Paul

4.5 I4 TP1

• TP1 testing assignments:
  • Manual:
    • Jerome (covered by Paul):
      • org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_editing.testsuite
      • org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_importExport.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\manual\Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
    • Kendric:
      • org.eclipse.tptp.test.tools.api.tests\manual\Recorder\Test.UI.APIRecorder.Windows_IA32.testsuite
      • org.eclipse.hyades.execution.harness.tests\manual\defects\Test.Execution.ExecutionHarness.testsuite
    • Paul:
      • org.eclipse.tptp.test.doc.user\manual\Doc\Test.Doc.smoke.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartBoundsSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartInternationlizationSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartStaticImage.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartSVG.testsuite
      • org.eclipse.tptp.platform.report.tests\manual\Reporting\Plaform.UI.Charting_ChartSWT.testsuite
    • Duwayne:
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Windows.testsuite
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Linux.testsuite
      • org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Paul:
      • org.eclipse.tptp.test.testservices.tests\junit\Test.IBM142_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.IBM15_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.Sun142_TestServices.testsuite
      • org.eclipse.tptp.test.testservices.tests\junit\Test.Sun15_TestServices.testsuite
    • Jerome (covered by Paul):
      • org.eclipse.hyades.test.ui.logViewer.tests\JUnit\Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • JUnit Plug-in:
    • Paul:
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.CodeSynchronizationTest.testsuite
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite
      • org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\TestLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\DeploymentLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\facade\ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\extensions\DeploymentsProviderTest.testsuite
      • org.eclipse.hyades.test.core.tests\junit\launch\extensions\ExecutionHistoryDefaultsProviderTest.testsuite
  • AGR:
    • Paul:
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.IBM142_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.IBM15_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.Sun142_JUnitRunner.testsuite
      • org.eclipse.hyades.test.java.tests\autoui\Test.Execution.Sun15_JUnitRunner.testsuite
    • Jerome (covered by Paul):
      • org.eclipse.hyades.test.ui.logViewer.tests\gui\Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • org.eclipse.hyades.test.ui.logViewer.tests\gui\Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • org.eclipse.hyades.test.ui.navigator.tests\gui\TestNavigator_Logical_auto.testsuite
      • org.eclipse.hyades.test.ui.navigator.tests\gui\TestNavigator_Resource_auto.testsuite

• TP1 testing status:
  • Paul: Complete. Will complete Jerome's test suites by Wednesday.
  • Duwayne: Complete.
  • Kendric: Will complete test suites by Wednesday.
  • Jerome: Issues installing the candidate driver.

Round-table

• Status updates and summary of defects, blocking issues, and architectural issues/concerns that we will focus on completing the upcoming week:
  • Paul:
    • Last Week:
      • 4.5 I4 TP1.
      • Completed defects:
        • 212391
        • 212535
        • 212393
        • 212762
    • This Week:
      • Finish 4.5 I4 TP1.
        • Complete Jerome's test suites.
      • Resolve the issue with the automated tests (AGR/JUnit/JUnit Plug-in tests) hanging when running with EMMA by refactoring the test runner code to allow testers to add the EMMA JAR to the class path and the emma.rt.control=false system property to the session JVM.
      • Defects:
        • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
        • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
        • URL and JUnit Plug-in Test documentation missing from TOC.
        • (Web Doc) IPV6 not supported for Internet Explorer
        • (Web Doc) IPv6 Limitation on Firefox
        • Update plugin version numbers.
        • JUnit code generator does not check against project existence
        • TPTP test results are not reported correctly.
        • Update Test Tools section of TPTP Project Matrix.
        • Provide a TPTP icon for Ganymede.
  • Duwayne:
    • Last Week:
      • Completed IPv6 defect 107432.
      • 4.5 I4 TP1.
    • This Week:
      • Finish 4.5 I4 TP1.
      • Finish test automation (defect 170654).
      • Outstanding news group posts.
      • Deferred to I5:
        • 171083.
        • 211066.
      • Vacation (Thursday - Friday).
  • Jerome:
    • Last Week:
      • Issues installing the candidate driver.
    • This Week:
      • Vacation.
  • Kendric:
    • Last Week:
      • Continued on automating API Recorder test cases (see defect 170656).
      • 4.5 I4 TP1.
    • This Week:
      • Finish 4.5 I4 TP1.
      • Finish automating API Recorder test cases (see defect 170656).
      • Select and start the Test Project defects:
        • 186148
        • 151922
        • 201886
        • 182128
        • 206355
        • 206356

Action items

• n/a

Notes

• The next two Test Project calls will be canceled due to Christmas vacation. We will resume on Monday, January 7, 2008.

• EclipseCon 2008:
  • Test and Performance Category.
    • Tutorials:
      • Code Coverage Analysis for Eclipse (Marc R. Hoffmann)
      • How to apply Software Archeology to your development process (Michael Rozlog)
      • Profiling Java applications using Eclipse TPTP (Alexander Alexeev/Mikhail Voronin)
      • GUI test creation before application availability – GUIdancer Tutorial (Hans-J. Brede)
      • Methodologies for Test-Driven Development of OSGi enabled Embedded Devices (Marcus Harringer/Christine Mitterbauer)
      • Practical testing of Eclipse plugins and OSGi bundles (Philippe Ombredanne)
    • Long Talks:
      • Software Metrics - The Good, The Bad and the CRAPpy (Richard Sharpe/Alberto Savoia/Bob Evans)
      • A Harmonious Combo : Experiences Profiling Apache Harmony with Eclipse TPTP (Chris Elford)
      • Using Automating Heap Dump Analysis and Hardware Performance Counters To Identify Performance Issues (Gary Frost/Andreas Buchen)
      • Extending TPTP for database unit testing (Wei Liu/Der Ping Chou/Hong-Lee Y/Don Clare)
      • Functional Testing with the Eclipse TPTP Project (Eric Long)
    • Short Talks:
      • Source code analysis – beyond the basics (Gwyn Fisher)
      • Experiences in agile testing (Hans-J. Brede)
      • A Performance Analysis Framework For C/C++ and Fortran (Wyatt Spear)
      • UI Testing Patterns and Best Practices (Phil Quitslund)
      • SWT/Eclipse Testing, and lessons learned along the way (Ketan Padegaonkar)
      • Revisiting Functional Testing Part 1 (Sriram Narayanan)
      • GUI Testing of RCP Applications with RCP Robot and FIT (Frank Gerhardt)
      • Code Quality Analysis Toolset for Embedded Systems (Kouhei Nadehara)
      • Extending TPTP for TTCN-3. (Paul Slauenwhite)
      • Revisiting Functional Testing Part 2 (Sriram Narayanan)
  • If you are interested in proposing a poster (presented at the poster reception session) or BoF (informal one-and-a-half-hour gatherings of people who want to talk about a particular topic), please:
    • Review the EclipseCon 2008 Submission Guidelines
    • Submit your poster or BoF
  • Important dates include:
    • January 19, 2008: Submissions open for posters and BoFs.

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure. For more information, see the WIKI page and meeting minutes.

Reminders

• Lead Committers:
  • Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
  • Add the Original Estimate (PH) when triaging a new defect.
  • Update the Hours Worked (PH) when completing a defect.
  • Test their components or review/track testing contributed by other committers/resources.
  • Monitor the TPTP news group and answer posts specific to their Test Project components.
  • Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
  • Use the MyFoundation Portal for committer elections.

• All Committers:
  • Monitor the TPTP news group and answer posts on topics other than the Test Project to support our user community.