Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TPTP-Test-Tools-20080602"
(→Test Automation Initiative) |
|||
(4 intermediate revisions by the same user not shown) | |||
Line 75: | Line 75: | ||
* Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure: | * Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure: | ||
** For more information, see the [http://wiki.eclipse.org/4.5_Test_Automation_Initiative WIKI page]. | ** For more information, see the [http://wiki.eclipse.org/4.5_Test_Automation_Initiative WIKI page]. | ||
− | ** To see the BVT results for a specific build, open the [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.0 Build Reports] page for a specific build and select | + | ** To see the BVT results for a specific build, open the [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.0 Build Reports] page for a specific build and select BVT Results. |
− | + | ** Outstanding defects include: | |
− | + | ||
− | ** Outstanding | + | |
*** Paul: | *** Paul: | ||
− | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=219041 JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.] |
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222759 AGR Tests require absolute path to Equinox JAR] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222759 AGR Tests require absolute path to Equinox JAR] | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222760 Clear remote workspace launch does not work for remote test execution] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222760 Clear remote workspace launch does not work for remote test execution] | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222761 AGR Tests cannot be run with start ACServer] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222761 AGR Tests cannot be run with start ACServer] | ||
− | |||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215078 Test Execution Tabular Report contains empty or incorrect child reports.] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215078 Test Execution Tabular Report contains empty or incorrect child reports.] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=147859 IExecutionDeploymentAdapter.cleanUpTestAssets no longer called] | ||
+ | *** Duwayne: | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220390 Connection property does not deploy all dependencies] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220390 Connection property does not deploy all dependencies] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException] | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220391 Connection property does not allow JUnit Plug-in Tests to be executed] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220391 Connection property does not allow JUnit Plug-in Tests to be executed] | ||
− | |||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=194503 ASF marshalling return value between service and client adapter does not have support for failures / exceptions] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=194503 ASF marshalling return value between service and client adapter does not have support for failures / exceptions] | ||
**** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217487 Confusing exceptions when running automated services.] | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217487 Confusing exceptions when running automated services.] | ||
Line 102: | Line 101: | ||
* Alexander Nyßen: | * Alexander Nyßen: | ||
− | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor]: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved | + | ** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor]: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Since the AGR is an As-Is component, Paul will complete the integration, testing, and check-in after the I8 TP2 AGR tests have been completed. |
=== Defects === | === Defects === | ||
Line 114: | Line 113: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199135#c7 jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199135#c7 jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless] | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201896#c39 Cannot remove a test invocation to a removed HTTP request.] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201896#c39 Cannot remove a test invocation to a removed HTTP request.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233137#c3 Unable to publish BIRT reports through ASF] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234771#c10 NullPointerException when generating a Test Execution Tabular Report using ASF.] | ||
* Defects require a sizing: | * Defects require a sizing: | ||
** Duwayne: | ** Duwayne: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException] | ||
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233137 Unable to publish BIRT reports through ASF] | |
− | + | ||
− | + | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | * Platform Project impacting the Test Project: | + | * Platform Project defects impacting the Test Project: |
** Critical/Blocker: | ** Critical/Blocker: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229189 Random intermitten errors while launching a test against remote agents]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229189 Random intermitten errors while launching a test against remote agents]: Targeted to I8. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233039 command line and runtime workbench unsatisfied link error]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233039 command line and runtime workbench unsatisfied link error]: Targeted to I8. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233470 The edit option is not working properly in probe targets]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233470 The edit option is not working properly in probe targets]: '''Resolved.''' |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232168 Cannot add method entry fragment data items [regression]]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232168 Cannot add method entry fragment data items [regression]]: '''Resolved.''' |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234594 Probekit context menu is disabled.Probekit context menu is periodically disabled.] | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234594 Probekit context menu is disabled.Probekit context menu is periodically disabled.]: '''Resolved.''' |
** Major/Normal: | ** Major/Normal: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: Targeted to I8. |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
* Remaining I8 Bugzillas: | * Remaining I8 Bugzillas: | ||
** Paul: | ** Paul: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234774 Execution of any plugin junit testsuite fails]: Critical issue with running JUnit Plug-in test suites via ASF. Blocking COSMOS' test automation initiative. Blocked by Platform Project defect [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]. | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213340 profiling trace generated from running a java app instrumented with api recording probe does not contain information]: Reopened from I8 TP1 testing since work-around did not resolve the symptom. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213340 profiling trace generated from running a java app instrumented with api recording probe does not contain information]: Reopened from I8 TP1 testing since work-around did not resolve the symptom. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228930 Test editor is too wide for users to read]: Usability issue. Required this week. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228930 Test editor is too wide for users to read]: Usability issue. Required this week. | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor]: Paul will complete the integration, testing, and check-in after the I8 TP2 AGR tests have been completed. |
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=87285 Automated Test Execution Harness Tests]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=87285 Automated Test Execution Harness Tests]: Test automation to be completed during TP2. | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=135103 All external APIs should have JUnit tests]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=135103 All external APIs should have JUnit tests]: Test automation to be completed during TP2. | ||
** Duwayne: | ** Duwayne: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229134 Parallel agent startup errors, InactiveProcessException]: Required by a consuming product. | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229134 Parallel agent startup errors, InactiveProcessException]: Required by a consuming product. Inconsistent test results. Blocked by Platform Project defect [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229189 Random intermitten errors while launching a test against remote agents]. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233137 Unable to publish BIRT reports through ASF]: Critical issue with generating test reports via ASF. Requires verification using the correct configuration. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException] | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException]: Critical issue with running test suites via ASF. |
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | ||
** Jerome: | ** Jerome: | ||
− | |||
− | |||
− | |||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170651 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170651 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation to be completed during TP2. | ||
** Tony: | ** Tony: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213446 (Linux) AGR test suite does not run.]: Test automation to be completed during TP2. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213446 (Linux) AGR test suite does not run.]: Test automation to be completed during TP2. | ||
+ | |||
+ | * On today's [http://wiki.eclipse.org/TPTP-AG-20080602 AG call], we will be discussing the defects that cannot be contained in 4.5.0 but are required by the community or a consuming product, causing us to do a point release (e.g. 4.5.0.1): | ||
+ | ** Paul: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234774 Execution of any plugin junit testsuite fails]: Critical issue with running JUnit Plug-in test suites via ASF. Blocking COSMOS' test automation initiative. Blocked by Platform Project defect [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]. | ||
+ | ** Duwayne: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229134 Parallel agent startup errors, InactiveProcessException]: Required by a consuming product. Blocked by Platform Project defect [https://bugs.eclipse.org/bugs/show_bug.cgi?id=229189 Random intermitten errors while launching a test against remote agents]. | ||
== Round-table == | == Round-table == | ||
Line 168: | Line 161: | ||
* Last Week: | * Last Week: | ||
− | |||
** Assisted consuming product triage several symptoms/issues found during their testing. | ** Assisted consuming product triage several symptoms/issues found during their testing. | ||
− | ** | + | ** Triaged all 'future' Bugzillas to determine duplicates and relevance. |
− | ** | + | ** Reviewing patches. |
** Resolved defects: | ** Resolved defects: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228029 NullPointerException constructing navigator proxies: DefaultTestSuiteProxyNode.addInvocationReferences] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228873 ClassNotFoundException when running ASF automation services without OSGi/ICU.] |
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234224 NullPointerException when switch between resource and logical test navigator] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232166 Datapools cannot be created/opened without JCA.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234771 NullPointerException when generating a Test Execution Tabular Report using ASF.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213622 Technical review of Test Project documentation before 4.5 release.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220875 Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228253 Documentation smoke test failures.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=234608 (Webdoc] (Readme] Datapool variables are not encrypted without the MD5 hash algorithm.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=142209 Should be able to use Right Click button on keyboard] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=185356 ExecutionEvent.toString() horribly inefficient] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=186815 Document TPTP Test Project test bucket.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=231561 Adding to new deployment wizard has duplicate shortcuts] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233238 Missing title for Test Generation wizard in Resource perspective] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=146290 JScrib test report generators enable the wizard Finish button befrore report name is entered.] | ||
* This Week: | * This Week: | ||
− | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Action items. |
− | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#4.5_I8_TP2 I8 TP2]. |
+ | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defects I8 defects]. | ||
=== Duwayne === | === Duwayne === | ||
* Last Week: | * Last Week: | ||
− | ** | + | ** Out of office: 1 day |
+ | ** Assisted consuming product triage several symptoms/issues found during their testing. | ||
+ | ** Reviewing patches. | ||
+ | ** Completed [http://wiki.eclipse.org/TPTP-Test-Tools-20080526#Testing testing]. | ||
+ | ** Resolved defect: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=201896 Cannot remove a test invocation to a removed HTTP request.] | ||
* This Week: | * This Week: | ||
− | ** | + | ** Action items. |
− | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#4.5_I8_TP2 I8 TP2]. |
− | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defects I8 defects]. |
=== Jerome === | === Jerome === | ||
* Last Week: | * Last Week: | ||
+ | ** Reviewing patches. | ||
** Resolved defects: | ** Resolved defects: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232089 Test assets are allowed to have same, non-unique IDs] |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232397 Unable to delete a test or a project] | |
− | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=232310 Rename error in java perspective] | |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | |
− | + | ||
* This Week: | * This Week: | ||
− | ** | + | ** Non-TPTP responsibilities. |
=== Tony === | === Tony === | ||
* Last Week: | * Last Week: | ||
− | ** | + | ** Completed [http://wiki.eclipse.org/TPTP-Test-Tools-20080526#Testing testing]. |
− | ** | + | ** Technical review of the Test Project documentation. |
+ | ** Verifying 'future' Bugzillas to determine if the symptoms are reproducible. | ||
+ | ** Testing patches. | ||
* This Week: | * This Week: | ||
− | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Action items. |
− | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools- | + | ** Complete [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#4.5_I8_TP2 I8 TP2]. |
+ | ** Finish verifying 'future' Bugzillas to determine if the symptoms are reproducible. | ||
+ | ** Work on remaining [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defects I8 defects]. | ||
== Action items == | == Action items == | ||
− | * | + | * Duwayne: |
+ | ** Reply to your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#News_Group news group posts]. | ||
+ | ** Verify/close your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defect_Verification resolved defects]. | ||
+ | ** Reply to questions in your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defects defects]. | ||
+ | ** Add a sizing to your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defects defects]. | ||
+ | |||
+ | * Paul: | ||
+ | ** Verify/close your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defect_Verification resolved defects]. | ||
+ | |||
+ | * Tony: | ||
+ | ** Verify/close your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defect_Verification resolved defects]. | ||
+ | |||
+ | * Jerome: | ||
+ | ** Verify/close your [http://wiki.eclipse.org/TPTP-Test-Tools-20080602#Defect_Verification resolved defects]. | ||
== Notes == | == Notes == |
Latest revision as of 12:53, 6 June 2008
Attendees
- Present:
- Paul Slauenwhite
- Tony Wang
- Jerome Bozier
- DuWayne Morris
4.5
Release Information
- 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 25, 2008).
Where are we at?
- This week is I8 TP2 (target: June 6).
- All defects require patch reviews, Stop Ship Template, and Project/PMC approval.
- RC1 was delivered on Tuesday, May 20.
- RC2 was delivered for Tuesday, May 27.
- RC3 is scheduled for Tuesday, June 3.
- RC4 (final RC) is scheduled for Friday, June 6.
Defect Verification
- A note has been sent to the originators of all resolved defects reminding them to verify/close these defects before Ganymede releases.
Testing
- We want to complete the I8 TP2 by Thursday June 5.
- The candidate driver will be announced by the Release Engineering Team later today.
- Please use the TPTP all-in-one package and install dependent/As-Is/Technology Preview components in the <Eclipse installation directory>/eclipse/dropins directory.
- Note: When testing in a Java 1.4.x environment, do NOT use the TPTP all-in-one package since it requires Java 1.5.x+.
4.5 I8 TP2
- TP2 testing assignments.
- Note, do not run any of the documentation technical review test suites (/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.<component>.technical_review.Windows_IA32.testsuite).
News Group
- The following news group posts require an IMMEDIATE reply:
- Duwayne:
- Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
- Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
- tptp execuation task issue (April 2, 2008 3:12 PM)
- Multi-Language tests with AGR (April 7, 2008 3:11 PM)
- Testing an application with Custom component (April 8, 2008 11:03 AM)
- Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)
- Re: Multiple instances for Verification Class (April 28, 2008 3:11 PM)
- Re: Reusable Thread Error in standard mode (April 29, 2008 6:12 PM)
- Duwayne:
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- For more information, see the WIKI page.
- To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
- Outstanding defects include:
- Paul:
- JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
- AGR Tests require absolute path to Equinox JAR
- Clear remote workspace launch does not work for remote test execution
- AGR Tests cannot be run with start ACServer
- Test Execution Tabular Report contains empty or incorrect child reports.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- Duwayne:
- Connection property does not deploy all dependencies
- Test Execution fails when project defined incorrectly - ResourceException
- Connection property does not allow JUnit Plug-in Tests to be executed
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- Confusing exceptions when running automated services.
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
- ANT test results property requires trailing slash to specify location
- Exceptions when running ASF tasks.
- Only the name of the execution result is used from the results property.
- Paul:
Enhancements
- Alexander Nyßen:
- Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Since the AGR is an As-Is component, Paul will complete the integration, testing, and check-in after the I8 TP2 AGR tests have been completed.
Defects
- Defects require a reply:
- Defects require a sizing:
- Platform Project defects impacting the Test Project:
- Critical/Blocker:
- Random intermitten errors while launching a test against remote agents: Targeted to I8.
- command line and runtime workbench unsatisfied link error: Targeted to I8.
- The edit option is not working properly in probe targets: Resolved.
- Cannot add method entry fragment data items [regression]: Resolved.
- Probekit context menu is disabled.Probekit context menu is periodically disabled.: Resolved.
- Major/Normal:
- Critical/Blocker:
- Remaining I8 Bugzillas:
- Paul:
- Execution of any plugin junit testsuite fails: Critical issue with running JUnit Plug-in test suites via ASF. Blocking COSMOS' test automation initiative. Blocked by Platform Project defect Execution of any testsuite fails using the IAC - InactiveProcessException.
- profiling trace generated from running a java app instrumented with api recording probe does not contain information: Reopened from I8 TP1 testing since work-around did not resolve the symptom.
- Test editor is too wide for users to read: Usability issue. Required this week.
- Providing the ability to record user's interactions with GEF objects in a GEF editor: Paul will complete the integration, testing, and check-in after the I8 TP2 AGR tests have been completed.
- Automated Test Execution Harness Tests: Test automation to be completed during TP2.
- All external APIs should have JUnit tests: Test automation to be completed during TP2.
- Duwayne:
- Parallel agent startup errors, InactiveProcessException: Required by a consuming product. Inconsistent test results. Blocked by Platform Project defect Random intermitten errors while launching a test against remote agents.
- Unable to publish BIRT reports through ASF: Critical issue with generating test reports via ASF. Requires verification using the correct configuration.
- Test Execution fails when project defined incorrectly - ResourceException: Critical issue with running test suites via ASF.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
- Jerome:
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
- Tony:
- (Linux) AGR test suite does not run.: Test automation to be completed during TP2.
- Paul:
- On today's AG call, we will be discussing the defects that cannot be contained in 4.5.0 but are required by the community or a consuming product, causing us to do a point release (e.g. 4.5.0.1):
- Paul:
- Execution of any plugin junit testsuite fails: Critical issue with running JUnit Plug-in test suites via ASF. Blocking COSMOS' test automation initiative. Blocked by Platform Project defect Execution of any testsuite fails using the IAC - InactiveProcessException.
- Duwayne:
- Parallel agent startup errors, InactiveProcessException: Required by a consuming product. Blocked by Platform Project defect Random intermitten errors while launching a test against remote agents.
- Paul:
Round-table
Paul
- Last Week:
- Assisted consuming product triage several symptoms/issues found during their testing.
- Triaged all 'future' Bugzillas to determine duplicates and relevance.
- Reviewing patches.
- Resolved defects:
- NullPointerException constructing navigator proxies: DefaultTestSuiteProxyNode.addInvocationReferences
- ClassNotFoundException when running ASF automation services without OSGi/ICU.
- NullPointerException when switch between resource and logical test navigator
- Datapools cannot be created/opened without JCA.
- NullPointerException when generating a Test Execution Tabular Report using ASF.
- Technical review of Test Project documentation before 4.5 release.
- Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.
- Documentation smoke test failures.
- (Webdoc (Readme] Datapool variables are not encrypted without the MD5 hash algorithm.]
- Should be able to use Right Click button on keyboard
- ExecutionEvent.toString() horribly inefficient
- Document TPTP Test Project test bucket.
- Adding to new deployment wizard has duplicate shortcuts
- Missing title for Test Generation wizard in Resource perspective
- JScrib test report generators enable the wizard Finish button befrore report name is entered.
- This Week:
- Action items.
- Complete I8 TP2.
- Work on remaining I8 defects.
Duwayne
- Last Week:
- Out of office: 1 day
- Assisted consuming product triage several symptoms/issues found during their testing.
- Reviewing patches.
- Completed testing.
- Resolved defect:
- This Week:
- Action items.
- Complete I8 TP2.
- Work on remaining I8 defects.
Jerome
- Last Week:
- Reviewing patches.
- Resolved defects:
- This Week:
- Non-TPTP responsibilities.
Tony
- Last Week:
- Completed testing.
- Technical review of the Test Project documentation.
- Verifying 'future' Bugzillas to determine if the symptoms are reproducible.
- Testing patches.
- This Week:
- Action items.
- Complete I8 TP2.
- Finish verifying 'future' Bugzillas to determine if the symptoms are reproducible.
- Work on remaining I8 defects.
Action items
- Duwayne:
- Reply to your news group posts.
- Verify/close your resolved defects.
- Reply to questions in your defects.
- Add a sizing to your defects.
- Paul:
- Verify/close your resolved defects.
- Tony:
- Verify/close your resolved defects.
- Jerome:
- Verify/close your resolved defects.
Notes
- None.
Reminders
Lead Committers
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections.