Difference between revisions of "TPTP-Test-Tools-20080421"

Revision as of 10:57, 21 April 2008

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP1 (target: April 25).

Testing

• We want to complete the I7 TP1 by Thursday, April 24.
• The candidate driver will be announced by the Release Engineering Team later today.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
      • /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
      • /org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/bugzilla_166025_namecheck.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/deployment_check.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.General.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Manual.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/JUnit/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • JUnit Plug-in:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/TestLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/DeploymentLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/DeploymentsProviderTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM6_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• We still have a backlog of news group posts that require a reply. Please work this week at replying to the posts for your component.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Jerome is continuing on the test cases (use cases) and documentation (extension points). Jerome attached a patch to cover a failing case (Paul will review).

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and waiting for the Contribution Questionnaire (CQ) to be completed for the contribution.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TP:
  • Paul:
    • Running a test linked to a datapool cause Severe Error: Paul will fix today.
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d: Paul is investigating.
  • Jerome:
    • Unable to create proxy for testsuite

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.

• Defects with Community patches that MUST be integrated in I7 (e.g. this week):
  • Duwayne:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.: Resolved (FIXED).
    • Certain characters in text on Button causes recorded script not playable: Resolved (FIXED).
    • Continuous single selection in List/Table/Tree cannot be recorded correctly: Resolved (FIXED).
    • Redundant dependency on org.eclipse.ui.testing: Resolved (FIXED).
    • Redundant message to STDOUT when execute in quick mode: Resolved (FIXED).

• Defects that MUST be completed in I7 (e.g. this week):
  • Duwayne:
    • Exception when canceling a recording (before "recording "actually starts): Unresolved. Triaged and Duwayne is working on the fix for Friday.
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
    • Cannot remove a test invocation to a removed HTTP request.: Unresolved. Duwayne has a patch and is testing. Once tested/reviewed/approved, Duwayne will integrate by Friday.
      • The invocation for some deleted testcases can't be removed in behaviour tab: Unresolved. Will be fixed with patch for 201896.
  • Jerome:
    • Move, Copy, Delete, Rename and Import/Export test assets: Unresolved (see above.
      • Filename vs. logical name in UI: Unresolved.
      • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
    • Test assets' editors (locations, datapools etc) allow save with empty internal names: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
  • Paul:
    • UI allows to launch non-profilable tests in profile mode: Resolved (FIXED).
    • Unmovable rows in Datapool Editor: Resolved (FIXED).
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename): Resolved (FIXED).
    • (Usability) creating TPTP test but you need to have parent project created first.: Resolved (FIXED).
    • Context sensitive help requires refactoring and new content.: Unresolved. Requires a technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Deferring to I8.
    • scroll bars not appearing when needed in test suite editor and other Hyades: Resolved (FIXED).
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?: Resolved (FIXED).
    • doc updates for section Creating a test deployment: Resolved (FIXED).
    • Location does not contain port number.: Unresolved. Harm raised issues with extending the Test Model to add a port number to a org.eclipse.hyades.models.common.configuration.CFGMachine. Deferring to future.
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Unresolved. Insufficient times to complete in I7. Deferring to I8.
    • Test editors: links to test elements don't do highlighting anymore: Resolved (FIXED).
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Unresolved. Insufficient times to complete in I7. Will complete this week. Required for the technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Will complete this week.
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Unresolved. Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

Round-table

Paul

• Last Week:
  • Resolved defects:
    • (Web) Test execution periodically hangs.

• This Week:
  • 4.5 I7 TP1 (see [?????????????????? Defects]).
  • See Defects.

Duwayne

• Last Week:

Product adoption of M5 on Linux (1 day) Testing product defect of M5 on Windows. Model code (3 days). Jimmy Jins

• • Resolved defects:

• • • Test Execution Fails

• This Week:

Jerome

• Last Week:
  • 2 days off

enh

• This Week:

off Tuesday - Friday

Tony

• Last Week:
  • Worked on Accessibility-Need shortcuts for all Test Navigator pulldowns.

• This Week:
  • See Defects.
  • Testing:
    • P2 Equinox

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.