Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[cross-project-issues-dev] SimRel JIPP migration to new infrastructure is now complete
  • From: Frederic Gurr <frederic.gurr@xxxxxxxxxxxxxxxxxxxxxx>
  • Date: Thu, 14 Jan 2021 15:38:16 +0100
  • Autocrypt: addr=frederic.gurr@xxxxxxxxxxxxxxxxxxxxxx; prefer-encrypt=mutual; keydata= xsFNBFeN7eABEADU1DWW0e6X3UBsKwwN8+EtviRWuEcUTJBCspUfyhS+LnfzB944GN3h32uT 5ClPPc8bUIuipCfW/2BlkP9EhK3hfiD/LwDv2tS9K5nFsi+SawjYLRvQG+7d21Pe3LVUWpv3 K6OXuEZvdf+e/ljkhtATt0OmwbvxN3i9vzJHAYiFUTNgTO27ui2sqOI9uDXXTP7L0OdMbjun lsBMKMzd8BZLvsqbBvUbWihXqDvCgnPLbJw6VWrLjlfvWXQ9qIQQemzyG8tlII49LpX3gwH0 /jS6HVgSh52L7xohIivkJa4JkpPhGi8srAfxptQ3Kl2udhQkM8wswXsbIT89gsbJflsbYfDt uZLfjA9U+9UyrlgF5mYwpgGIawvuyi+YcJy8OzJWLnGq7jayJRT85udCiyDkCTDXxu0jSSjk By+NKG2T/dO2R96RbR2PuSzERhyMSCMAZOxoqCYf3mD9oeiNB9flwnxJpHKxuGBkG8zaQE6x sw4f4ZS88OCh854t33JKrlHXB9UTlMRHO9jj4cVKzFrEFZlUdIuu2WuDxYnFsI4tZAabn8V1 mFOkwz8ir/3IpM7GQbbq3ierJ5rYd87rkYroeNAOmUZW/7cM/5u7bOEzb+xlpn9OqQ63nAmN M2vMZEUIfzU/HhkhM3ItjWf74Fr4I9jseIvkrF3CrMyU1wPcJwARAQABzTRGcmVkZXJpYyBH dXJyIDxmcmVkZXJpYy5ndXJyQGVjbGlwc2UtZm91bmRhdGlvbi5vcmc+wsF9BBMBCAAnBQJZ 7dQrAhsjBQkJZgGABQsJCAcCBhUICQoLAgQWAgMBAh4BAheAAAoJEBCQq+fyYxnhN40P/jrs 1JqFahe2AV5P14GXIB0dWTt+pmiTk2r31hhPIfKz5/PiANzVc7yqRbjgNA8ZcH5Fjz94AFEv aza8Rapce4GFFwYVlL4+jtDhEMpWX6ZFTd1Ok25x7HhMpjHodk+Bc2fzxejKZ2oS+cApPTeW sS2WwLL+MVk8nLSZTgQYe5Bu0Vepoiql8x12BAPWNQfv1D3Mef1c4ttvN1bg+NAMAoovVa88 FdIlzurw2zIwcStOS0YoD44P+21TKe3TYYnbtLwz+bSH0N2WRHpRJ8GUKdYt9dgdRBnZnijd CV0qK0ksA5Zf9oMr/na+PcSuQ7/674RIvhlFx3bQ/qmTYhKq2GDJImRsXS0jfQBZ4RJUwYdh I7wnnD7NS0U5HypohY5Zv833TnawJVqzXhZwSu2TjK7S6YsgYhCQRgvTrhrXNy/1c6DtsEfx qP3AqCRoDGQJNO5rZKh6NFpppZnU1n+hDEHCR1SJntgiUV7GhHy+V9ECk/AZJA+wOoWdNamh fcobFZ6+q+jWo6a6UQNt30c14knKZbOx2W20jb0W0nIlFjOcvAJtEhwWilJr9StZDi17Sa4z eWmKQtGS/FguZ0O881u1TsH8c1+J84SO/EtSbdbaEze9AG2rWRYb0BTYFF+r7X8M2RVjnKF/ iiwAW/+mHRt+/VnFR0bC7Ry62CI5LMzKzsFNBFeN7eABEAC9vYYVrwmSpm/J7FbR2M5GCC9C 7veXd7VSQ0TEnq98v8pje7rd8gakUFkMyqxEb06354aRDJIsyHZmSJCKhAcRPrzwkrVXYTMT GS/TC2Vrk0x88F1nWQm5h2eNLvIybT0JYd728P/5fSh208T2BCgvgL9w3e2/z5tH3IHW490B Wm5xji2cGCaqkeQw7hzxjCXp/k24EcZ1EzH0x4mTHmP3s7WAKSb6bx8+38wKsrYNhpkw847R 3MZadmitMqvOJ+em8K+67U+NDaergoRUL3oSgNYx67mm9xXBYLjiSAx1e+yhzjLfC+WziaXq CELFpdldR5Ds1Fe+BeeeK7v7EhmDi+h/Guh2KDWRbbafDzAc8EG5Ifuf/5g4NI1kEiK49c3L xIzvT9dzujBPFvl9We7Hd+jp/rZ7YSsOHEpXrcRUMuSFpQUfsTsp6fYxeFQRy/38hO1Ye6sp PwfcRTJEi9reMJbA+bR4Mk2LWsqlHuZzHMA5chS7XbVCngcEdlu1vTMlycYuKb+wAg9vrEbb cWHbeUffZx2+fy4+lLUygWRJmGAY5MdXOSn31tL0Ou+rF+moNZDo3EgjSZ7GqIKOzpptCFoh BqJQ/fgBIBIfAfKf5ThvEZ8pOvFGA61YT6MJHmUK4JbZT6mrf8a2s4yhQKjlNo/FodTy5SyQ TQFntR+DBwARAQABwsFlBBgBCAAPBQJXje3gAhsMBQkJZgGAAAoJEBCQq+fyYxnhQa4P/jhB N9NXFncGD2TzaLnSsBQNpvJp9wRK70Ea3mwMxbAayOiIV7CF1Cjp/L0aCgLnO8nl0yZMBbkM Ntot0qZ5M9nZZYxKyrbZS6ElWoHLKJHQNfazW5Jc5/8RBJvxtWbR/RfwCzLEYFI0hUY1UsVB hsq4KCNKBt6eWqoFaSM+hzWAc1rOYlDKswkA+bqJiPifYatWcrjolmuAMNUWAuWKgRtVbcCZ IqHkDyvvc0LkV4nhCHGbqLE6+MoaLb/JZMChvPN+tl+sHxxQJcagJ5U15dgSp+XYDIN2fCw+ ViRTr/2nKsUh/WKfyXnXq1PwJoVMGUFOULHaLBmqTfoubPQRZXWhcKzU68CdvLykyDKVdrQL SI0acgK8ZOZwRIZvVdjDM2iR5PtoX2RtAoU7blkjHTrL9C23yesvM1woFStaCt6DMwMJ1n0U oODmwf8/d65AM4mLjHd4eQn8fqnfG66y9RGnO+uYohDm22v6jxbhC9HeUf7EB2Sz+t6zllEM hkGvKr7W0yW9aXuv1ClyhVLypzh5g1fKPf29TGLT1pFecyF19Hxz5BHP1eH7nEVj/OsF9hmt RHZstOSALb4H+IXZrc7x2Q2okEcWui03fQJrKiL/gtyyU4aH62nI5VOGu5zoa669m0cbBofS kr0KPtEgdm15rQ8tiPH8bKZLHQ5e/2Li
  • Delivered-to: cross-project-issues-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/cross-project-issues-dev/>
  • List-help: <mailto:cross-project-issues-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/cross-project-issues-dev>, <mailto:cross-project-issues-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/cross-project-issues-dev>, <mailto:cross-project-issues-dev-request@eclipse.org?subject=unsubscribe>
  • Organization: Eclipse Foundation
  • User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0
Hi,

As you might know, the SimRel JIPP has been migrated to our new
cluster-based infrastructure (see
https://bugs.eclipse.org/bugs/show_bug.cgi?id=568118).

This has some implications on the SimRel aggregation build:
On the old infra, the SimRel JIPP could utilize up to 16 CPUs of the
host machine (hipp8) and had file system access (via NFS mounts) to
download.eclipse.org. On the new infra, resource restrictions are in
place and there is no direct access to download.eclipse.org (only via
SCP/SSH).

Therefore we are using a dedicated "promotion" build agent with 4vCPUs
that provides filesystem access. Due to the CPU resource limits of the
build agent, an aggregation build (simrel.runaggregator.pipeline) now
takes approximately 2 hours on the new infra (vs ~1h hour on the old
infra). One hour of this build was spent on "repo reports" alone. AFAIK
nobody reads the repo reports on a regular basis...if ever. Hence I've
split out the repo report generation from the aggregation build.
I'd suggest to run the separate repo reports job
(https://ci-staging.eclipse.org/simrel/job/simrel.reporeports.pipeline/)
at least every day/night, but not after every aggregation build anymore.

Please also note, more changes (e.g. native Tycho build) will come soon,
but the focus is on the migration for now.

If you have any questions or concerns, please let me know.

Regards,

Fred


-- 
Frederic Gurr
Release Engineer | Eclipse Foundation Europe GmbH

Berliner Allee 47, D-64295 Darmstadt
Handelsregister: Darmstadt HRB 92821
Managing Directors: Gaël Blondelle, Mike Milinkovich

Back to the top