Re: [jsonp-dev] [External] : TCK distribution question

[Lukas Jungmann <lukas.jungmann@xxxxxxxxxx>]

Hi,

On 4/20/22 9:08 PM, Kyle Aure wrote:
> Hello All,
>
> Thank you for the clarifications.
>
> I understand we need to use the distributed TCK for certification and we 
> will.
>
> Most other specifications have been updating both a Distributed TCK and 
> Singular TCK concurrently (JSON-B for example).
> What we have come to enjoy about the transition to standalone TCKs is 
> the ability to create an automated test that uses the Singular TCK 
> artifact as we develop our implementation.
> Then for certification, we will pull down the distributed TCK for 
> certification.
>
> Our automated tests run very frequently so we are conscious of the 
> performance and memory implications of continuing to pull a bloated zip 
> archive, unzipping, and throwing away everything but the TCK itself.
> We certainly can work around it, but it has been a nice workflow.
> Maybe a suggested change for the next release?

what exactly do you expect the TCK to provide? As I have already 
mentioned earlier - I need to figure out why some artifacts are missing 
in staging -> that is obviously wrong. Once artifacts get in place, what 
exactly is preventing anybody to write his pom, ant, gradle or any other 
script to run what is needed to avoid working with the zip? jsonp tck 
zip contains poms which one can use as a base and/or tweak them as 
needed. One can probably come up with a solution to run all tests from 
one pom - would be great if such solution gets contributed back to this 
project.

thanks,
--lukas


> Thank you,
> Kyle Jon Aure
>
> On Wed, Apr 20, 2022 at 10:57 AM Scott Marlow <smarlow@xxxxxxxxxx 
> <mailto:smarlow@xxxxxxxxxx>> wrote:
>
>
>     On 4/20/22 11:48 AM, Lukas Jungmann wrote:
> >     On 4/20/22 5:36 PM, Kyle Aure wrote:
> > >     Hi Lucas,
> > >     Thanks for the quick response.
> > >     You are right I should have included links :D
> > >
> > >     TCK Zip Distribution:
> > >     https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-dist-epl/
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-dist-epl/__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZ_R4-7mY$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-dist-epl/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NHAxocUs$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-dist-epl/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NHAxocUs$>
> > >
> > >     Has version 2.1.0 and not 2.1.0-SNAPSHOT
> > >
> > >     Singular TCK Jar:
> > >     https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-tests/
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-tests/__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZIEy93Os$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-tests/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NpncMvYU$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/content/repositories/staging/jakarta/json/jakarta.json-tck-tests/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NpncMvYU$>
> > >
> > >     Has version 2.1.0-SNAPSHOT but not 2.1.0
> > >
> > >     The TCK Zip Distribution is great for manual testing where we
> > >     want to set up a project and run this test once.
> > >     But for automated testing, we would like to just pull the
> > >     Singular TCK Jar and use that so we don't have to extract it from
> > >     the distribution zip.
> > >     However, a 2.1.0 version of the singular jar does not exist and
> > >     is different from what is currently being used in the
> > >     distribution zip.
> >
> >     there are two ways one can run it:
> >
> >     1)
> >     $ wget -O jakarta.json-tck.zip
> >     https://download.eclipse.org/jakartaee/jsonp/2.1/jakarta-jsonp-tck-2.1.0.zip
> >     <https://urldefense.com/v3/__https://download.eclipse.org/jakartaee/jsonp/2.1/jakarta-jsonp-tck-2.1.0.zip__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZzI3NTuk$>
> >     $ unzip jakarta.json-tck.zip
> >     $ mvn -f jsonp-tck/bin/pom.xml verify
> >
> >     2) mimic what
> >     https://github.com/eclipse-ee4j/jsonp/blob/master/tck/tck-dist-eftl/src/main/bin/pom.xml
> >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/blob/master/tck/tck-dist-eftl/src/main/bin/pom.xml__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZHo906BE$>
> >     does
> >
> >     (if it does not work, use -Pstaging)
> >
> >     note that, unless I'm mistaken, to certify, one has to use 1), for
> >     automated builds, one has to use 2) (or get EPL licensed bundle
> >     for wget in 1))
>
>     I believe that certification request needs to include a link to the
>     EFTL license TCK used to pass the tests.  So just passing the tests
>     with the EPL TCK is not enough (currently).
>
>     Scott
>
> >     thanks,
> >     --lukas
> >
> > >     NOTE: using the phrase `singular jar`, to avoid confusion with
> > >     the overloaded term `standalone` when it relates to Jakarta TCKs :D
> > >
> > >     Thank you,
> > >     Kyle Jon Aure
> > >
> > >     On Wed, Apr 20, 2022 at 9:45 AM Lukas Jungmann
> > >     <lukas.jungmann@xxxxxxxxxx <mailto:lukas.jungmann@xxxxxxxxxx>
> > >     <mailto:lukas.jungmann@xxxxxxxxxx>
> > >     <mailto:lukas.jungmann@xxxxxxxxxx>> wrote:
> > >
> > >         Hi,
> > >
> > >         On 4/20/22 4:26 PM, Kyle Aure wrote:
> > >          > Hello all,
> > >          >
> > >          > I am working on running the TCK for Open Liberty and
> > >     noticed that
> > >         in the
> > >          > Jarkarta Stagging repository there is a distribution zip, and
> > >         singular
> > >          > jar artifacts for the TCK.
> > >          > The distribution zip is at version 2.1.0 while the
> > >     singular jar
> > >         is at
> > >          > version 2.1.0-SNAPSHOT.
> > >
> > >         I see no SNAPSHOT in
> > >     https://jakarta.oss.sonatype.org/service/local/repositories/jakartajson-1053/archive/jakarta/json/jakarta.json-tck-dist-epl/2.1.0/jakarta.json-tck-dist-epl-2.1.0.zip/!/jsonp-tck/artifacts
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/service/local/repositories/jakartajson-1053/archive/jakarta/json/jakarta.json-tck-dist-epl/2.1.0/jakarta.json-tck-dist-epl-2.1.0.zip/!/jsonp-tck/artifacts__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZajRDCO4$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/service/local/repositories/jakartajson-1053/archive/jakarta/json/jakarta.json-tck-dist-epl/2.1.0/jakarta.json-tck-dist-epl-2.1.0.zip/!/jsonp-tck/artifacts__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NrY1-5No$>
> > >     <https://urldefense.com/v3/__https://jakarta.oss.sonatype.org/service/local/repositories/jakartajson-1053/archive/jakarta/json/jakarta.json-tck-dist-epl/2.1.0/jakarta.json-tck-dist-epl-2.1.0.zip/!/jsonp-tck/artifacts__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NrY1-5No$>
> > >
> > >         which artifact you are looking into? what do you mean by the
> > >         "singular jar"?
> > >
> > >         note that one can get final (EFTL licensed) TCK dist from
> > >     https://jakarta.ee/specifications/jsonp/2.1/
> > >     <https://urldefense.com/v3/__https://jakarta.ee/specifications/jsonp/2.1/__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZCiMc8_0$>
> > >
> > >     <https://urldefense.com/v3/__https://jakarta.ee/specifications/jsonp/2.1/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NzWh_TWI$>
> > >     <https://urldefense.com/v3/__https://jakarta.ee/specifications/jsonp/2.1/__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NzWh_TWI$>
> > >
> > >         thanks,
> > >         --lukas
> > >
> > >          > I compared the contents of both jars (from zip and
> > >     singular) and
> > >         there
> > >          > are differences in the signature files.
> > >          > Based on this issue being closed:
> > >          > https://github.com/eclipse-ee4j/jsonp/issues/371
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZpEfxidU$>
> > >
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NwkACwn8$>
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NwkACwn8$>
> > >
> > >          >
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzX-ADlI8$
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzX-ADlI8$>
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzX-ADlI8$>
> > >     <https://urldefense.com/v3/__https://github.com/eclipse-ee4j/jsonp/issues/371__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzX-ADlI8$>>
> > >          > I would think that both artifacts should be at version
> > >     2.1.0 now.
> > >          > Can we upload the newer version of the TCK so that it can
> > >     be used
> > >          > without having to extract it from the distribution zip?
> > >          >
> > >          > Thank you,
> > >          > Kyle Jon Aure
> > >          >
> > >          > _______________________________________________
> > >          > jsonp-dev mailing list
> > >          > jsonp-dev@xxxxxxxxxxx <mailto:jsonp-dev@xxxxxxxxxxx>
> > >     <mailto:jsonp-dev@xxxxxxxxxxx> <mailto:jsonp-dev@xxxxxxxxxxx>
> > >          > To unsubscribe from this list, visit
> > >     https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzngofVoI$
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzngofVoI$>
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzngofVoI$>
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eM7lyUkCZu-nDTmoOI4j8z7Y8udhL1BArATNWPYWS_rKun0dKDNxhl_Ec1YzngofVoI$>
> > >
> > >         _______________________________________________
> > >         jsonp-dev mailing list
> > >     jsonp-dev@xxxxxxxxxxx <mailto:jsonp-dev@xxxxxxxxxxx>
> > >     <mailto:jsonp-dev@xxxxxxxxxxx> <mailto:jsonp-dev@xxxxxxxxxxx>
> > >         To unsubscribe from this list, visit
> > >     https://www.eclipse.org/mailman/listinfo/jsonp-dev
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZtr4P3xY$>
> > >
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NM_KC1_c$>
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NM_KC1_c$>
> > >
> > >
> > >     _______________________________________________
> > >     jsonp-dev mailing list
> > >     jsonp-dev@xxxxxxxxxxx <mailto:jsonp-dev@xxxxxxxxxxx>
> > >     To unsubscribe from this list, visit
> > >     https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NM_KC1_c$
> > >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!eKOz-kEwygmFNOBWA3ywjfblKY0mGqvQ5xq0ifGOjefIpClMiGvauO9S2Z0NM_KC1_c$>
> >
> >     _______________________________________________
> >     jsonp-dev mailing list
> >     jsonp-dev@xxxxxxxxxxx <mailto:jsonp-dev@xxxxxxxxxxx>
> >     To unsubscribe from this list, visit
> >     https://www.eclipse.org/mailman/listinfo/jsonp-dev
> >     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZtr4P3xY$>
>     _______________________________________________
>     jsonp-dev mailing list
>     jsonp-dev@xxxxxxxxxxx <mailto:jsonp-dev@xxxxxxxxxxx>
>     To unsubscribe from this list, visit
>     https://www.eclipse.org/mailman/listinfo/jsonp-dev
>     <https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZtr4P3xY$>
>
>
> _______________________________________________
> jsonp-dev mailing list
> jsonp-dev@xxxxxxxxxxx
> To unsubscribe from this list, visit https://urldefense.com/v3/__https://www.eclipse.org/mailman/listinfo/jsonp-dev__;!!ACWV5N9M2RV99hQ!dTM0IBiaHaevcfVhzmPOzaTtwuRrztV6Q6tjTmq_z38-Xh7FhJIa_f7QBRPZtr4P3xY$