Difference between revisions of "TPTP-Test-Tools-20080421"

Revision as of 14:24, 21 April 2008

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP1 (target: April 25).

Testing

• We want to complete the I7 TP1 by Thursday, April 24.
• The candidate driver will be announced by the Release Engineering Team later today.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
      • /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
      • /org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/bugzilla_166025_namecheck.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/deployment_check.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.General.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Manual.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/JUnit/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • JUnit Plug-in:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/TestLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/DeploymentLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/DeploymentsProviderTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM6_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• We still have a backlog of news group posts that require a reply. Please work this week at replying to the posts for your component.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Jerome will complete the documentation (extension points) and final code changes (see comments 77) next week to be integrated in I8. Jerome attached a patch to cover a failing case for Paul to review.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Deferred to I8 for integration and testing.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TP:
  • Paul:
    • Running a test linked to a datapool cause Severe Error: Paul will fix today.
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d: Paul is investigating.
  • Jerome:
    • Unable to create proxy for testsuite

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.

• Defects with Community patches that MUST be integrated in I7 (e.g. this week):
  • Duwayne:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.: Resolved (FIXED).
    • Certain characters in text on Button causes recorded script not playable: Resolved (FIXED).
    • Continuous single selection in List/Table/Tree cannot be recorded correctly: Resolved (FIXED).
    • Redundant dependency on org.eclipse.ui.testing: Resolved (FIXED).
    • Redundant message to STDOUT when execute in quick mode: Resolved (FIXED).

• Defects that MUST be completed in I7 (e.g. this week):
  • Duwayne:
    • Exception when canceling a recording (before "recording "actually starts): Unresolved. Triaged and Duwayne is working on the fix for Friday.
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
    • Cannot remove a test invocation to a removed HTTP request.: Unresolved. Duwayne has a patch and is testing. Once tested/reviewed/approved, Duwayne will integrate by Friday.
      • The invocation for some deleted testcases can't be removed in behaviour tab: Unresolved. Will be fixed with patch for 201896.
  • Jerome:
    • Move, Copy, Delete, Rename and Import/Export test assets: Unresolved (see above.
      • Filename vs. logical name in UI: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
      • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
    • Test assets' editors (locations, datapools etc) allow save with empty internal names: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
  • Paul:
    • UI allows to launch non-profilable tests in profile mode: Resolved (FIXED).
    • Unmovable rows in Datapool Editor: Resolved (FIXED).
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename): Resolved (FIXED).
    • (Usability) creating TPTP test but you need to have parent project created first.: Resolved (FIXED).
    • Context sensitive help requires refactoring and new content.: Unresolved. Requires a technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Deferring to I8.
    • scroll bars not appearing when needed in test suite editor and other Hyades: Resolved (FIXED).
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?: Resolved (FIXED).
    • doc updates for section Creating a test deployment: Resolved (FIXED).
    • Location does not contain port number.: Unresolved. Harm raised issues with extending the Test Model to add a port number to a org.eclipse.hyades.models.common.configuration.CFGMachine. Deferring to future.
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Unresolved. Insufficient times to complete in I7. Deferring to I8.
    • Test editors: links to test elements don't do highlighting anymore: Resolved (FIXED).
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Unresolved. Insufficient times to complete in I7. Will complete this week. Required for the technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Will complete this week.
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Unresolved. Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

Round-table

Paul

• Last Week:
  • Resolved defects:
    • Regression - Firefox recording error
    • NLS34 - Found 2 consecutive single quotes in text not handled by Java MessageFormat class
    • Garbage output in recorder log when non-translated strings are sent by the agent
    • (Web) (Linux) Cannot not delete test assets in the Test Navigator.
    • (Web) Test execution periodically hangs.
    • (Web) (Vista) Test execution terminates abnormally.
    • doc updates for section Creating a test deployment
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • Time Frame Historical Report view does not have tabs and is missing info
    • Test Tools documentation I5/I6 smoke test failures.
    • UI allows to launch non-profilable tests in profile mode
    • Time out error message during test execution is not resolving.
    • InactiveProcessException when launching AGR tests using the Agent Controller.
    • Time-out Threshold always set to default of 30000
    • InactiveProcessException when launching JUnit Plug-in tests using the Agent Controller.
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • Can not load datapool file while running a Juint test
    • Create TVT/enablement test cases for new Test Project UI.
    • Can not cancel changes while closing datapool editor
    • Test editors: links to test elements don't do highlighting anymore
    • Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • variables are listed twice in the "EquivalenceClass" pane of Datapool
    • Test Tools about.properties files contain incorrect descriptions.
    • (Test Navigator) Resource Information is not available for package and source folder nodes
    • "Paste" doesn't not complete normally
    • NullPointerException when deleting artifact location pairs.
    • Encrypted datapool variable support
    • Unmovable rows in Datapool Editor
    • No help for datapool/TPTP wizard.
    • The 'Encrypt' option doesn't work with keyboard selection
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • creating TPTP test but you need to have parent project created first.
    • No test report generators appear in the New Report dialog.
    • Report Icon is incorrect for Test Pass and Time Frame Historic
    • Test Report reports the last test execution only
    • Generate Report: Test Navigator does not refresh to show new report
    • TVT:PRT70_CHT_Duplicate mnemonics
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • Unable to load file /Test/ejb2.testsuite during test generation
    • System default browser is not used as the default browser for URL recording.
    • Recorder Control view is not opened or has focus when a recording is started

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Running a test linked to a datapool cause Severe Error
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.
    • Technical review of Test Project documentation before 4.5 release

Duwayne

• Last Week:
  • Integrated community patches for:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.
    • Certain characters in text on Button causes recorded script not playable
    • Continuous single selection in List/Table/Tree cannot be recorded correctly
    • Redundant dependency on org.eclipse.ui.testing
    • Redundant message to STDOUT when execute in quick mode
  • Resolved defect:
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
  • Worked on defect Cannot remove a test invocation to a removed HTTP request.
  • Product testing of TPTP M5.

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Exception when canceling a recording (before "recording "actually starts)
    • Cannot remove a test invocation to a removed HTTP request.
    • The invocation for some deleted testcases can't be removed in behaviour tab

Jerome

• Last Week:
  • Vacation: 2 days
  • Continued working on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

• This Week:
  • Vacation: 4 days
  • Defect:
    • Unable to create proxy for testsuite
    • Close on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • Continued working on defect Accessibility-Need shortcuts for all Test Navigator pulldowns.

• This Week:
  • 4.5 I7 TP1:
    • P2 Equinox

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.