Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [ee4j-build] Summary of this morning's Build Team meeting
  • From: Denis Roy <denis.roy@xxxxxxxxxxxxxxxxxxxxxx>
  • Date: Thu, 21 Jun 2018 10:34:13 -0400
  • Autocrypt: addr=denis.roy@xxxxxxxxxxxxxxxxxxxxxx; prefer-encrypt=mutual; keydata= xsBNBFSQVYcBCACphCllQd59H3sF23T1XUD8h6pNPvRwuKKpfcwTAL7qe98PbMBQBLuy3ocj 04PcvlRj8lCR9JmChFc9V5Bi61MTdCrshEbiyomw/ZWdfFbmc4/rlMWg00gTO94SP0zMl96x np0aNi8cGwD258NUVD1+tlvraukr6yixD25qCGQ313lOO71l1R8eJun/Kx7SEFXtMFJ7Er4r /QnfFioFFwWGiUXbGhioCZhggQWnq3U+LOZzGKp0SuWSQuu0RzQB57Fy8EN2bmX61EKGaFnr TR/8yk8EdifupYgDc6XCxndktFJYFse4v4XQSPNIIUwcBT/Ji732xdXiR4YnL0SNAVBDABEB AAHNNkRlbmlzIFJveSAoRWNsaXBzZSkgPGRlbmlzLnJveUBlY2xpcHNlLWZvdW5kYXRpb24u b3JnPsLAeAQTAQIAIgUCWWjoCAIbAwYLCQgHAwIGFQgCCQoLBBYCAwECHgECF4AACgkQQI23 cA21ZyMHGgf/THQqUR43XqUhSytf3q0Wmq1KBCDUpLXQYfpe1uh464robj4iUsoCMDhlEzbU uy0p+de87aVv68ZGRPOlz0oIt80NZbHxLErhunjFGhJvnw/V5jf2lYThiWysDcQMUSIGERuy 3wIyVFVF4RDZB4jjvrPvQ/dy+x+mN38t76C8x5sp4oup19sy9u4EUzPpEInBNs8ADoKO9kOl ZbTOkIFSqC4aI0yABRMbur+mks+b9IaVVQytK4zlzTROuBNHnjx6kgfAV5L8ezQpgBkVLrLw HwB+Rmsnx/qbRXrRmESiiD6aVQQntkfj0zXK/XzMpm1+9qxA8TBj6nFXo/ivNqDx7M7ATQRU kFWHAQgAy/xnfKzcxiCyHtP2a3mbRW04xMwDoLWj+3khfudiHgQWNLDiN/oTAJag5cOrh17L ewRDuhEctJ71Nb+bkMNHvJvq5KC0oB1x54ocQGa493Q/9irIYaEbXVcVqyggmTO6lPvLcA9+ mdQZNvfFlnxS05z+c2CvNNqhgrFU4xS6MTuGEA6oduha0mbDodPKNBh8MkL7OjlYO/44H4l0 MsBYJ57QhQqeOVv1C8Sc2hstk8ZcCc3G2W29Beh0Li5WFYf7F8L0JtxuDSLGisWJL5cAZvdE Zrd/BNAOE02+fANl9iYkX+pG1rjYMdtm/UpLo38jovcyWhOc+TE7qab72wO8iQARAQABwsBf BBgBAgAJBQJUkFWHAhsMAAoJEECNt3ANtWcjxEMH/Rer0weIKA1jV72FNQpHaKuGuUmqW6ak qQHSRKZEECjTa9E1M/Mvdr21qE/zYR7tFD9zc2wqhxBDBD8azKQLZo2TSTnqyUPdr2Dy3KFS FoavCvaVzEt7c3sA/TxXWXQhxGJL56yj2VZaF+k7j/DtYl6nG62bS0rQbg/3/RllmXa51QIT V5ZPnTo6NFJ5K3lbn7EoQbVT2LdkPmabPqw6DT+ZjQlJS3Q8iI0wSoS6r9D7QQG/VaeKGjoK TRDRn/5YUnof4vjpao8jIRMJ+5RBlRto96jwt7hfNm842GsqT4ddMyYmTLGnYLUae9rl2GmN ahBMbQ9PB8Ta/DeCpIxpOyk=
  • Delivered-to: ee4j-build@xxxxxxxxxxx
  • List-archive: <https://dev.eclipse.org/mailman/private/ee4j-build>
  • List-help: <mailto:ee4j-build-request@eclipse.org?subject=help>
  • List-subscribe: <https://dev.eclipse.org/mailman/listinfo/ee4j-build>, <mailto:ee4j-build-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://dev.eclipse.org/mailman/options/ee4j-build>, <mailto:ee4j-build-request@eclipse.org?subject=unsubscribe>
  • Openpgp: preference=signencrypt
  • User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0

Thanks, Ed.

I'd like to follow-up about the lack of access to kubectl and other k8s tools: Once the setup is all functional and we have a better idea of how everything works together, we can consider creating some front-end tools to allow committers to interface (in a limited/controlled environment) with kubectl and perhaps accessing pod logs. I have nothing specific in mind, and I certainly don't want to promise or commit to anything specific, but I can already foresee the possibilities.


Denis



On 2018-06-20 10:51 AM, Ed Bratt wrote:
Arindam -- working on converting build system to Jenkins pipeline type CI job. No CloudBees access yet. Hopefully, finished next week. Had some access questions, but these seem to be resolved. Local builds use Maven. In K8S,  builds are 30-45 minutes. In CloudBees, may take longer. Info. from Romain: Maven cache held in persistent claim. Can share maven repositry/cache. Otherwise, each build will have to recreate their local maven cache for each build (so Cache is not useful). Local Maven proxy "near" the build systems. Eclipse does have this. Can cache include maven.java.net (will we decommission? No.) Eclipse can create a second proxy for maven.java.net. Nexus open-source proxy.

GF uses docker. CTS / TCKs don't. Biggest issue is creating the Docker image. Arindam will work with Bhat and Romain to create Docker image builds/tests for CTS and TCKs. Will run some experiments to see how this can be done in preliminary fashion (CTS/TCK repositories aren't public).

Maybe we can use private Oracle GH organization. Docker image issues seem readily solvable. Then need to work on getting build pipelined. (Jenkins image/clone repository, etc.)

Will provide update next week on progress.

Discussions regarding how to create new Jenkins instance. Romain walked through New instance, then walk through the web-ui to create new instance. will create new instance/work with support. GH API / token/key maybe needed.

200 Jenkins instances on current stack. Intend to migrate all to CloudBees. Will require some YAML changes. Worker nodes should try to limit to 4 CPU/8GB RAM. There are no quotas, but these will be added. Will add this to the YAML data. Can one log into worker nodes? (not accessible directly.) No Kube-ctl is planned. Romain is concerned about this. This will require additional hardening so that any error is caught and an archive is created, no matter what the failure. Cluster nodes are managed, but there are restrictions due to CloudBees.

Trying to create pipeline, but failing. then successfully created. Templates that are misconfigured can fail in an opaque fashion if they fail in the script. (See example log output below in chat from Denis). Oracle (Romain and Arindam) will continue to see if/how we can preserve these details to facilitate debugging.

Can they precreate PVC (Persistent Volume Claim) resources (we don't have credentials with perm. to generate)? Not clear. Will use "default" storage for now.

Use Eclipse issues when problems are encountered so that these can be handled more quickly (don't message/e-mail directly).

Create an issue for follow-up.

Chat from session:

07:02:17     From  Mikaël Barbero : https://jenkins.eclipse.org/glassfish/
07:31:59     From  Romain Grecourt : https://jenkins.eclipse.org/glassfish/blue/pipelines
07:38:23     From  Denis Roy :   <invalid> <invalid>       1       kubelet, osnode-vm2.eclipse.org                 Warning FailedMount             Unable to mount volumes for pod "mypod-95q3t-kg5g2_cje(33b4223a-7497-11e8-91ae-525400f11ca1)": timeout expired waiting for volumes to attach/mount for pod "cje"/"mypod-95q3t-kg5g2". list of unattached/unmounted volumes=[maven-repo-storage]

07:44:22     From  Mikaël Barbero : https://bugs.eclipse.org/bugs/enter_bug.cgi?product=Community&component=CI-Jenkins

_______________________________________________
ee4j-build mailing list
ee4j-build@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/ee4j-build

--

Denis Roy

Director, IT Services | Eclipse Foundation, Inc.

Eclipse Foundation: The Platform for Open Innovation and Collaboration

Twitter: @droy_eclipse


Back to the top