Difference between revisions of "TPTP-Test-Tools-20071119"

Latest revision as of 08:31, 28 November 2007

Attendees

• Present:
  • Paul Slauenwhite
  • Jerome Bozier
  • DuWayne Morris
  • Kendric Wang
  • Joseph Toomey

4.4.1

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• All defects will require project/MC approval.

• All fixes MUST be checked-in to both 4.4.1 (TIPTOP-4_1_1) and 4.5 (HEAD) streams.

• Defect(s):
  • 209263 Deleted data pool row back in data pool upon import: Blocking a consuming product. Jerome B. completed the fix and manual test to verify the fix. Patch and patched plug-in attached to the Bugzilla. Jerome has submitted in the stop-ship template project/PMC approval. Paul has approved for the Test Project and forwarded it to the PMC for approval.

• After a review of the AP report for 4.4.1, the following APIs were added without the @provisional tag (see the TPTP API Contract) and Java Doc comments:
  • JNIWrapper.java
  • InternetExplorerAdapter#clientConnectNotification()
  • Duwayne will resolve these problems under defect 168597 in both 4.4.1 and HEAD.

• There will be a smoke test pass in the next few weeks (target date: TBD) aligned with the latest release of the IBM 1.5 JRE.

4.5

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect query.

• Download.

• Test reports.

• Newsgroup posts requiring replies:
  • Duwayne:
    • asf query test result and generate report from ant
    • BIRT classpath issue when publishing report
    • Create a Deployment programmatically
    • ant execution on linux

• We have finished I3 TP2.

• Duwayne has automated several manual tests for URL test with the AGR but has found several issues.
  • Duwayne will itemize these issues and discuss them on next week's call.

• Joe has fixed several key ASF defects in 4.4.1 and 4.5 that may assist the Test Automation initiative.
  • Joe will itemize these fixes and discuss them on next week's call.

• Test Auotmation Initiative blocking issues:

1. Defect 208616: Paul and Jerome are working on a fix.
2. Defect 210289: Duwayne is investigating.
3. Defect 210292: Duwayne is investigating.

• Voting is complete for the following component changes:
  • Notes:
    • TPTP Project Matrix and Bugzilla component updates will be handled under defect 207968.
      • See the voting summary.
    • Current Component Leads maintain their committer status as developer committers for the component.
    • Duwayne will need to be a committer on the Platform Project to commit ASF fixes.
      • Joe will nominate Duwayne using the MyFoundation Portal for committer elections.

• In 4.5, we will accommodate the decrease in resources by:
  • Isolating and moving Manual Test to Technology Preview (see defect 207777).
  • Smoke testing the Technology Previews (Manual Test, API Recorder, and AGR) per iteration and maintenance release.
  • Fixing only critical and blocking defects for the Technology Previews (Manual Test, API Recorder, and AGR).
  • Reduced user support (news group and mailing list posts) for the Technology Previews (Manual Test, API Recorder, and AGR).
  • Focus on GA function for TPTP/Test Project presentations (e.g. EclipseCon 2008).

• Enhancements:
  • The milestones for these enhancements have been scheduled on the weekly schedule.

1. 202695 Encrypted datapool variable support: Will be completed by a non-committer from IBM (Xin Ying Huang). Paul and Joe are working with Xin Ying to close on the design.
2. 162605 Test execution should support parallel execution of tests: Duwayne has reviewed the existing code to determine if desiging/coding a new solution or reusing the existing code (including defects) is the most efficient solution. Duwayne has started to consider the design points, such as launching/running agents and collecting results in parallel. Duwayne will prepare a design summary for two weeks.
3. 166025 Move, Copy, Delete, Rename and Import/Export test assets.: See the meeting minutes for the design review. Jerome has reviewed the existing code and is attempting to port the code to TPTP 4.5. Paul will assist with Jerome's defects so he can focus his reosufce (50%) on this enahcment. Jerome will prepare a design summary for two weeks.
4. 208110 Generic Recorder Wizard enhancement to filter the list of recorders: Paul has reviewed the enhancement with the consuming product requesting the feature and held an AG review call this past week (see meeting minutes.

• Defects:
  • All of the defects have been triaged and 81 defects have been put in plan:
    • Defect query
  • No defects have been resolved this past week.
  • The following 4.5 defects require a target for a specific iteration:
    • Defect query.
  • The following 4.5 defects require a sizing:
    • Defect query.

• 144950 [Scalability] Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI this week.

• Test project topics for upcoming AG calls include:
  • Enhancement 166025 (Move, Copy, Delete, Rename and Import/Export test assets): Jerome B./Jerome G.
  • Test automation initiative: Alan/Joel
  • EMMA: Paul

Roundtable

• Status updates and summary of defects, blocking issues, and architectural issues/concerns that we will focus on completing the upcoming week:
  • Paul:
    • Finished 4.5 I3 TP2.
    • Investigated the issue with automated tests (AGR/JUnit/JUnit Plug-in tests) hanging when running with EMMA. Determine that we will need to modify the test runner code to allow testers to add the EMMA JAR to the class path and the emma.rt.control=false system property to the session JVM.
    • Held AG review for enhancement 208110.
    • Close on design of enhancement 208110.
    • Finish reporting defect 187864.
    • Assist Jerome with defect 208616.
  • Duwayne:
    • Finished 4.5 I3 TP2.
    • Worked with Joel on several ASF issues found with the Test Automation Initiative.
    • Code review for design enhancement 162605.
    • Finish IPv6 defect 107432.
    • Prepare design summary for enhancement 162605.
    • Update defect sizings.
    • Fix ASF defect 200194.
    • Off Wed. Nov. 21 - Fri. Nov. 23 for Thanksgiving.
  • Jerome:
    • Finished 4.5 I3 TP2.
    • Working on defect 208616.
    • Prepare design summary for enhancement 166025.
    • Update defect sizings (see Jerome G.).
  • Kendric:
    • Automating Test Log Viewer test cases (see defect 170652).
    • Automating API Recorder test cases (see defect 170656).
    • Review, select, and prioritize candidate Test Project defects:
      • Defect query

Action items

• Duwayne, Jerome, and Paul to discuss the design work for the 4.5 enhancements on the call in two weeks.

• Duwayne will itemize and discuss several AGR issues on next week's call.

• Joe will itemize and discuss several key ASF fixes on next week's call.

• Joe will nominate Duwayne as a committer on the Platform project using the MyFoundation Portal for committer elections.

• The following 4.5 defects require a target for a specific iteration:
  • Defect query.

• The following 4.5 defects require a sizing:
  • Defect query

Notes

• EclipseCon 2008:
  • Reminder to participate in EclipseCon 2008 by proposing a talk or tutorial for the Test and Performance category. This category covers topics related to test and performance tooling that leverage Eclipse. Test and Performance tooling is used throughout the software development and test life cycle, from early unit testing, profiling, and tuning to post-deployment monitoring, tracing, and log analysis. This category is focused on the implementation, extension, and use of test and performance tooling - both open source and commercial - targeting a broad spectrum of systems including embedded, stand-alone, distributed, and enterprise. There is particular interest in exploitation and user experience of the Test and Performance Tools Platform (TPTP) project. Presentation types include:
    • Tutorial: A two hour presentation, with coding and/or a hands on workshop.
    • Long Talk: A one hour presentation that goes into detail and/or demonstration on a topic.
    • Short Talk: A five to ten minute presentation that covers the highlights of a topic.
    • Posters: Posters are presented at the poster reception session.
    • Birds of a Feather (BoF): BoF meetings are informal one-and-a-half-hour gatherings of people who want to talk about a particular topic.
  • If you are interested in proposing a talk or tutorial, please:
    • Review the EclipseCon 2008 Submission Guidelines
    • Submit your talk or tutorial
  • Important dates include:
    • November 19, 2007: Submission deadline.
    • December 10, 2007: Tutorials, Long Talks, and Short Talks selected.
    • January 19, 2008: Submissions open for posters and BoFs.

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure. For more information, see the WIKI page and meeting minutes.

Reminders

• Lead Committers:
  • Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
  • Add the Original Estimate (PH) when triaging a new defect.
  • Update the Hours Worked (PH) when completing a defect.
  • Test their components or review/track testing contributed by other committers/resources.
  • Monitor the TPTP news group and answer posts specific to their Test Project components.
  • Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
  • Use the MyFoundation Portal for committer elections. The Portal adds more automation to the elections and makes the individual project elections more transparent to the entire Eclipse community. If you have been experiencing problems or have other issues with the Portal election process, please contact the EMO (emo@eclipse.org).

• All Committers:
  • Monitor the TPTP news group and answer posts on topics other than the Test Project to support our user community.