[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [jakartaee-tck-dev] Release of 8.0.2 platform TCK...
|
On Mon, Jan 20, 2020 at 10:07 AM Scott Marlow <smarlow@xxxxxxxxxx> wrote:
>
> On Sun, Jan 19, 2020 at 11:22 PM Gurunandan Rao
> <gurunandan.rao@xxxxxxxxxx> wrote:
> >
> > thanks Scott, If all the tests are passing and test cases count add up
> > to the 8.0.1 certifications, then we should release 8.0.2.
>
> Hi Guru,
>
> I see the results for GlassFish 5.1 + the 8.0.0 TCK but not with the
> 8.0.1 TCK.
>
> I compared the Full Platform test case count from the 8.0.0
> certification (https://github.com/eclipse-ee4j/jakartaee-platform/issues/99),
> which has a total test count of 46970. Against, the Full Platform
> test case count from the two (8.0.2) TCK test runs.
> https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/11/artifact/junit-reports-with-handlebars/testsPassed.html
> shows 46375 tests run, plus
> https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/13/artifact/junit-reports-with-handlebars/testsPassed.html
> shows 574 tests run, for a total (TCK 8.0.2) Full Platform count of
> 46949 tests run.
>
> The test count is expected, as 8.0.2 TCK excludes 1 test
> (https://github.com/eclipse-ee4j/jakartaee-tck/commit/1035639c2cad80734875b3c6f6c9ca730ec6f859)
> and 8.0.1 TCK excludes 20 tests
> (https://github.com/eclipse-ee4j/jakartaee-tck/commit/4a21d363e9a5c22aa40796ea895c48d29579e81f
> + https://github.com/eclipse-ee4j/jakartaee-tck/commit/3ead0f872ccab2eb4079547dd6c374d3efed3305
> + https://github.com/eclipse-ee4j/jakartaee-tck/commit/889a96bd7b27750ec3f36bf1956db9a4893f8c13).
>
> I'll compare the Web Profile test counts next.
Web Profile with TCK 8.0.0
(https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/340/testReport)
shows test count of 19,482, the Web Profile with TCK 8.0.2
(https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/8.0/42/testReport
+ https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/8.0/44/testReport
+ https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/8.0/45/testReport)
shows test count of 19,481 which is expected since we excluded one
securityapi test in the 8.0.2 TCK
(https://github.com/eclipse-ee4j/jakartaee-tck/commit/1035639c2cad80734875b3c6f6c9ca730ec6f859).
Scott
>
> Scott
>
> >
> > regards,
> >
> > Guru
> >
> > On 1/19/2020 9:37 PM, Scott Marlow wrote:
> > > On Fri, Jan 17, 2020 at 8:50 AM Scott Marlow <smarlow@xxxxxxxxxx> wrote:
> > >> Hi Guru,
> > >>
> > >> On Thu, Jan 16, 2020 at 12:11 AM Gurunandan Rao
> > >> <gurunandan.rao@xxxxxxxxxx> wrote:
> > >>> Hi Scott,
> > >>>
> > >>> We have not seen these error before for the
> > >>> eftl-jakartaeetck-certification-web jobs, these seem to be intermittent
> > >>> errors,please check if restart of jobs helps. Please raise a ticket with
> > >>> CI Eclipse, if the issue is
> > >>> reproduced(https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.eclipse.org_bugs_enter-5Fbug.cgi-3Fproduct-3DCommunity&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PcGH1I163RbgeHNPoPPK3L7PvfpHYLurH5PxB7BOpBY&e= ).
> > >> The (memory allocation) failures do seem to recreate, although I'd
> > >> like to understand a bit more about what is going on, before creating
> > >> a bug issue. I did mention the failure on the ee4j-build@xxxxxxxxxxx
> > >> mailing list.
> > >>
> > >> To workaround the
> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_11_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=eNWuAhbLNHk8pjJjksqQCcVw08owJmWK9pK_MJWgkvs&e=
> > >> failure, I'm trying to run 1/2 of the Web Profile tests, if that
> > >> succeeds, I will then run the other 1/2 of the tests. If this works,
> > >> we will have completed EFTL testing of the 8.0.2 TCK release.
> > > The Web Profile tests passed! I did have to run them in a few
> > > separate batches to avoid failure:
> > >
> > > Passed connector - el jobs via
> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_12_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=LY06EfPjyKgfRZ9YnHl0MVFysiYv84m8J0B7U5ptNnw&e=
> > > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_42_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=mx-ZbaHjcVkVVfWEfchNFcRa6xgDdsL1D1aaM6pXZdg&e=
> > >
> > > Passed jacc - jpa via
> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_14_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=1vQd5_VvlUnOVd5ImEKqbJvYtdsBSyRjRD72rDrajgs&e=
> > > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_44_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PMbzcSa_cPHys1hRLJTkLRP3ScHOUsRY-0NlWOKLxqo&e=
> > >
> > > Passed jsf - websocket via
> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_15&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=SDGS5d0Hl6si8JphzCL1TM_0k_0WWfgxCz3Q2BUNzK4&e=
> > > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_44_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PMbzcSa_cPHys1hRLJTkLRP3ScHOUsRY-0NlWOKLxqo&e=
> > >
> > > Scott
> > >
> > >> For the Full Platform testing, I had similar issues with
> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification_11_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=HEOSb9VZromEfUFIlRy6nmkcvGsQo3FHtQK-R3GLuT0&e=
> > >> which had some failures shown under
> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_39&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=OqnB4y9k3BPhSH_8U0WlL-AJuigXZEDeRdbGAE9bPhQ&e=
> > >> (samples, ejb30/zombie, connector, compat13, appclient). I reran the
> > >> Full Platform test, with only running these failing tests and they
> > >> passed (no memory allocation failures).
> > >>
> > >>> For information on jakartaeetck CI jobs, following wiki should help -
> > >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_eclipse-2Dee4j_jakartaee-2Dtck_wiki_Jakarta-2DEE-2DTCK-2DJenkins-2Djobs&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=QwlD20FXpic_iq5xz5uThkkdGaKVFDFTRDwn1kcP_YQ&e=
> > >> Thanks, this was useful!
> > >>
> > >> Scott
> > >>
> > >>>
> > >>> regards,
> > >>>
> > >>> Guru
> > >>>
> > >>> On 1/16/2020 8:40 AM, Scott Marlow wrote:
> > >>>> Also seem to hit
> > >>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com_questions_53251117_jenkins-2Derror-2Derror-2Dcloning-2Dremote-2Drepo-2Dorigin&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=q59RZi9jJ6fX07aogr_E49vtFbZxO60dtBP1mvEFeUc&e=
> > >>>> on https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_36_console&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=duYO8ltePn8ntnMAIhMBB6B53YqR8dG6JLQ4jMXnrkY&e= ,
> > >>>> which failed with: `"git checkout -f
> > >>>> c457c40af61d307b0dea0e0489fed7ab4c3e8490" returned status code 137`, I
> > >>>> think that may also be memory related.
> > >>>>
> > >>>> Scott
> > >>>>
> > >>>> On Wed, Jan 15, 2020 at 9:43 PM Scott Marlow <smarlow@xxxxxxxxxx> wrote:
> > >>>>> Hi,
> > >>>>>
> > >>>>> I started a eftl-jakartaeetck-certification-web test [1] run this
> > >>>>> morning that ended with a NIO "java.io.IOException: Cannot allocate
> > >>>>> memory" failure [2]. Is this typical for the
> > >>>>> eftl-jakartaeetck-certification-web test [1] job? Should we restart
> > >>>>> with fewer tests selected (perhaps with just the first 1/2 of the
> > >>>>> tests?)
> > >>>>>
> > >>>>> Scott
> > >>>>>
> > >>>>> [1] https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_11_console&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=EWvO3dWmrUw3jK-CfT_DBOoJ5SWbUo6wwGWnuXZExbo&e=
> > >>>>> [2] https://urldefense.proofpoint.com/v2/url?u=https-3A__pastebin.com_keJytrYt&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=RNvA9BZC-e0lJTm1QI3oCJOIg32Bda2z899rRTdIces&e=
> > >>>> _______________________________________________
> > >>>> jakartaee-tck-dev mailing list
> > >>>> jakartaee-tck-dev@xxxxxxxxxxx
> > >>>> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> > >>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=8DfbX4EAcAM3uW6BKLny2EOVh1kXtPTB5CiOjDNEGPo&e=
> > >>> _______________________________________________
> > >>> jakartaee-tck-dev mailing list
> > >>> jakartaee-tck-dev@xxxxxxxxxxx
> > >>> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> > >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=Xp9rNP8l1SwoJ8famQ0zdPuh1fXJSDZRqubw6mYGt-k&e=
> > >>>
> > > _______________________________________________
> > > jakartaee-tck-dev mailing list
> > > jakartaee-tck-dev@xxxxxxxxxxx
> > > To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=Xp9rNP8l1SwoJ8famQ0zdPuh1fXJSDZRqubw6mYGt-k&e=
> > _______________________________________________
> > jakartaee-tck-dev mailing list
> > jakartaee-tck-dev@xxxxxxxxxxx
> > To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> > https://www.eclipse.org/mailman/listinfo/jakartaee-tck-dev
> >
