[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [jakartaee-tck-dev] Release of 8.0.2 platform TCK...
|
On Sun, Jan 19, 2020 at 11:22 PM Gurunandan Rao
<gurunandan.rao@xxxxxxxxxx> wrote:
>
> thanks Scott, If all the tests are passing and test cases count add up
> to the 8.0.1 certifications, then we should release 8.0.2.
Hi Guru,
I see the results for GlassFish 5.1 + the 8.0.0 TCK but not with the
8.0.1 TCK.
I compared the Full Platform test case count from the 8.0.0
certification (https://github.com/eclipse-ee4j/jakartaee-platform/issues/99),
which has a total test count of 46970. Against, the Full Platform
test case count from the two (8.0.2) TCK test runs.
https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/11/artifact/junit-reports-with-handlebars/testsPassed.html
shows 46375 tests run, plus
https://ci.eclipse.org/jakartaee-tck/view/EPL-EFTL-CERTIFICATION-JOBS/job/eftl-jakartaeetck-certification/13/artifact/junit-reports-with-handlebars/testsPassed.html
shows 574 tests run, for a total (TCK 8.0.2) Full Platform count of
46949 tests run.
The test count is expected, as 8.0.2 TCK excludes 1 test
(https://github.com/eclipse-ee4j/jakartaee-tck/commit/1035639c2cad80734875b3c6f6c9ca730ec6f859)
and 8.0.1 TCK excludes 20 tests
(https://github.com/eclipse-ee4j/jakartaee-tck/commit/4a21d363e9a5c22aa40796ea895c48d29579e81f
+ https://github.com/eclipse-ee4j/jakartaee-tck/commit/3ead0f872ccab2eb4079547dd6c374d3efed3305
+ https://github.com/eclipse-ee4j/jakartaee-tck/commit/889a96bd7b27750ec3f36bf1956db9a4893f8c13).
I'll compare the Web Profile test counts next.
Scott
>
> regards,
>
> Guru
>
> On 1/19/2020 9:37 PM, Scott Marlow wrote:
> > On Fri, Jan 17, 2020 at 8:50 AM Scott Marlow <smarlow@xxxxxxxxxx> wrote:
> >> Hi Guru,
> >>
> >> On Thu, Jan 16, 2020 at 12:11 AM Gurunandan Rao
> >> <gurunandan.rao@xxxxxxxxxx> wrote:
> >>> Hi Scott,
> >>>
> >>> We have not seen these error before for the
> >>> eftl-jakartaeetck-certification-web jobs, these seem to be intermittent
> >>> errors,please check if restart of jobs helps. Please raise a ticket with
> >>> CI Eclipse, if the issue is
> >>> reproduced(https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.eclipse.org_bugs_enter-5Fbug.cgi-3Fproduct-3DCommunity&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PcGH1I163RbgeHNPoPPK3L7PvfpHYLurH5PxB7BOpBY&e= ).
> >> The (memory allocation) failures do seem to recreate, although I'd
> >> like to understand a bit more about what is going on, before creating
> >> a bug issue. I did mention the failure on the ee4j-build@xxxxxxxxxxx
> >> mailing list.
> >>
> >> To workaround the
> >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_11_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=eNWuAhbLNHk8pjJjksqQCcVw08owJmWK9pK_MJWgkvs&e=
> >> failure, I'm trying to run 1/2 of the Web Profile tests, if that
> >> succeeds, I will then run the other 1/2 of the tests. If this works,
> >> we will have completed EFTL testing of the 8.0.2 TCK release.
> > The Web Profile tests passed! I did have to run them in a few
> > separate batches to avoid failure:
> >
> > Passed connector - el jobs via
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_12_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=LY06EfPjyKgfRZ9YnHl0MVFysiYv84m8J0B7U5ptNnw&e=
> > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_42_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=mx-ZbaHjcVkVVfWEfchNFcRa6xgDdsL1D1aaM6pXZdg&e=
> >
> > Passed jacc - jpa via
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_14_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=1vQd5_VvlUnOVd5ImEKqbJvYtdsBSyRjRD72rDrajgs&e=
> > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_44_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PMbzcSa_cPHys1hRLJTkLRP3ScHOUsRY-0NlWOKLxqo&e=
> >
> > Passed jsf - websocket via
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_15&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=SDGS5d0Hl6si8JphzCL1TM_0k_0WWfgxCz3Q2BUNzK4&e=
> > + https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_44_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=PMbzcSa_cPHys1hRLJTkLRP3ScHOUsRY-0NlWOKLxqo&e=
> >
> > Scott
> >
> >> For the Full Platform testing, I had similar issues with
> >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification_11_&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=HEOSb9VZromEfUFIlRy6nmkcvGsQo3FHtQK-R3GLuT0&e=
> >> which had some failures shown under
> >> https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_39&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=OqnB4y9k3BPhSH_8U0WlL-AJuigXZEDeRdbGAE9bPhQ&e=
> >> (samples, ejb30/zombie, connector, compat13, appclient). I reran the
> >> Full Platform test, with only running these failing tests and they
> >> passed (no memory allocation failures).
> >>
> >>> For information on jakartaeetck CI jobs, following wiki should help -
> >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_eclipse-2Dee4j_jakartaee-2Dtck_wiki_Jakarta-2DEE-2DTCK-2DJenkins-2Djobs&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=QwlD20FXpic_iq5xz5uThkkdGaKVFDFTRDwn1kcP_YQ&e=
> >> Thanks, this was useful!
> >>
> >> Scott
> >>
> >>>
> >>> regards,
> >>>
> >>> Guru
> >>>
> >>> On 1/16/2020 8:40 AM, Scott Marlow wrote:
> >>>> Also seem to hit
> >>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com_questions_53251117_jenkins-2Derror-2Derror-2Dcloning-2Dremote-2Drepo-2Dorigin&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=q59RZi9jJ6fX07aogr_E49vtFbZxO60dtBP1mvEFeUc&e=
> >>>> on https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_job_jakartaee-2Dtck_job_8.0_36_console&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=duYO8ltePn8ntnMAIhMBB6B53YqR8dG6JLQ4jMXnrkY&e= ,
> >>>> which failed with: `"git checkout -f
> >>>> c457c40af61d307b0dea0e0489fed7ab4c3e8490" returned status code 137`, I
> >>>> think that may also be memory related.
> >>>>
> >>>> Scott
> >>>>
> >>>> On Wed, Jan 15, 2020 at 9:43 PM Scott Marlow <smarlow@xxxxxxxxxx> wrote:
> >>>>> Hi,
> >>>>>
> >>>>> I started a eftl-jakartaeetck-certification-web test [1] run this
> >>>>> morning that ended with a NIO "java.io.IOException: Cannot allocate
> >>>>> memory" failure [2]. Is this typical for the
> >>>>> eftl-jakartaeetck-certification-web test [1] job? Should we restart
> >>>>> with fewer tests selected (perhaps with just the first 1/2 of the
> >>>>> tests?)
> >>>>>
> >>>>> Scott
> >>>>>
> >>>>> [1] https://urldefense.proofpoint.com/v2/url?u=https-3A__ci.eclipse.org_jakartaee-2Dtck_view_EPL-2DEFTL-2DCERTIFICATION-2DJOBS_job_eftl-2Djakartaeetck-2Dcertification-2Dweb_11_console&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=EWvO3dWmrUw3jK-CfT_DBOoJ5SWbUo6wwGWnuXZExbo&e=
> >>>>> [2] https://urldefense.proofpoint.com/v2/url?u=https-3A__pastebin.com_keJytrYt&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=RNvA9BZC-e0lJTm1QI3oCJOIg32Bda2z899rRTdIces&e=
> >>>> _______________________________________________
> >>>> jakartaee-tck-dev mailing list
> >>>> jakartaee-tck-dev@xxxxxxxxxxx
> >>>> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> >>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=YiLWjaOe09d-Kg-JZS7B0wa43iItsEVrabE8jZcCYHM&s=8DfbX4EAcAM3uW6BKLny2EOVh1kXtPTB5CiOjDNEGPo&e=
> >>> _______________________________________________
> >>> jakartaee-tck-dev mailing list
> >>> jakartaee-tck-dev@xxxxxxxxxxx
> >>> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=Xp9rNP8l1SwoJ8famQ0zdPuh1fXJSDZRqubw6mYGt-k&e=
> >>>
> > _______________________________________________
> > jakartaee-tck-dev mailing list
> > jakartaee-tck-dev@xxxxxxxxxxx
> > To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.eclipse.org_mailman_listinfo_jakartaee-2Dtck-2Ddev&d=DwICAg&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=lKA7K_I0P1vPHlxQ6X__NZrmglHx2dhG4RUJCc5vtkc&m=hlKDiH4p1KqYhoko21FQz-eWq19fR0CJPwKHcu9-5Wg&s=Xp9rNP8l1SwoJ8famQ0zdPuh1fXJSDZRqubw6mYGt-k&e=
> _______________________________________________
> jakartaee-tck-dev mailing list
> jakartaee-tck-dev@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> https://www.eclipse.org/mailman/listinfo/jakartaee-tck-dev
>
