Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: Moving GEF to Athena (was Re: [gef-dev] Re: Last build on emft.eclipse.org today)

With the help of Andrew, I sorted out the version number problem.

Even though we define our own version numbers, PDE/Build looks inside our custom script and updates the version number for us, so I think the custom scripts we have should work.

Having said that, Andrew N. suggests that we move towards customBuildCallbacks for this. This is how the platform generates their docs.  I'm happy to try and get this working in our build scripts.

Also, just to clarify, by moving to Athena/Hudson (and away from modeling builds I assume), what does this change?  The way we kick off builds?  Anything else?

Is the idea to move all the modeling builds to this new method? Or is there good reasons to keep people using the existing infrastructure? 

Sorry if I sound a bit confused, but looking around eclipse.org at build related stuff I see:

Buckminster, bucky build, gan-o-matic, PDE/Build, Athena, modeling build, Hundson, and some sort of Build-In-A-Box, and now b3.  I'm just trying to wrap my head around the similarities / differences, between these technologies and understand what we "should" be using in an ideal world.

thanks for the help Nick,

Cheers,
Ian

On Wed, Jul 29, 2009 at 10:51 AM, Nick Boldt <nickboldt@xxxxxxxxx> wrote:
it should, yes. Or allElements.xml, if not customTargets.xml

Andrew Niefer (discodan in #eclipse-dev or #equinox-dev, if you can find someone to ping him on ST to join IRC) should be able to advise you here, if help.eclipse.org isn't sufficient.

Ian Bull wrote:
Cool, I will try the ant _javascript_ thing and see if that works.

I'm still unsure about the hard coded version numbers in the build.xml.  It seems we have 3.2 hardcoded in the custom build.xml, but we are still getting the proper 3.5.0.qualifier versions.
I wonder if using a customerTargets.xml would work (then we wouldn't need the custom build.xml at all).

cheers,
ian

On Wed, Jul 29, 2009 at 10:23 AM, Nick Boldt <nickboldt@xxxxxxxxx <mailto:nickboldt@xxxxxxxxx>> wrote:

   So... turns out you're right. GEF's javadoc gen is completely
   different from the rest of Modeling.

   For example, in EMF, we have a doc plugin w/ a custom build.xml (so
   PDE doesn't generate one). This script calls antJavadoc.sh. So it's
   ant -> shell -> ant -> <javadoc/>

   Ugly, yes.

   --

   In GEF, you do custom build.xml which calls buildDoc.xml which runs
   <exec executable="${JAVADOC14_HOME}/javadoc"/>. So here it's ant ->
   shell -> ./javadoc.

   I suspect that if you switched to <javadoc> from <exec> then you
   wouldn't even need to set JAVADOC14_HOME in build.properties.

   Whether you'd get the same output from ./javadoc and <javadoc> is
   another question.

   --

   Anyway, I've learned a valuable lesson today: read the sources
   before assuming what's happening in a build. :)

   N

   Ian Bull wrote:

       Thanks Nick,

       I will check this out and see where I can get with it.

       I'm a little confused about the shell script problem.  From what
       I can tell, the doc (custom build script) is calling (through
       exec) the javadoc tool that comes with the JDK. This is not a
       shell script, but rather an ELF binary (at least on Linux).
        Does windows not have an equivalent tool, or does exec not work
       in Windows?

       cheers,
       ian

       On Wed, Jul 29, 2009 at 9:44 AM, Nick Boldt <nickboldt@xxxxxxxxx
       <mailto:nickboldt@xxxxxxxxx> <mailto:nickboldt@xxxxxxxxx

       <mailto:nickboldt@xxxxxxxxx>>> wrote:

          FYI, last night I copied the .releng I've been using to run
       GEF w/
          Athena in Hudson on build.eclipse.org
       <http://build.eclipse.org> <http://build.eclipse.org>


          into the GEF CVS. It's here:

                /cvsroot/tools/org.eclipse.gef/releng/org.eclipse.gef.athena.releng

          So now you can control what happens in Hudson directly from there
          (ie., the map file needs to be updated when you tag & release
       new bits).

          The job is here, and can be used for scheduled or ad hoc builds:

                https://build.eclipse.org/hudson/view/Athena%20CBI/job/cbi-gef-3.5/

          Oh, and I never said I *wouldn't* do the javadoc stuff, only that
          there's a lot of things competing for my attention. Patches
       welcome,
          esp. of a translation from shell to ant of the javadoc.sh script.

          N

          Anthony Hunter wrote:

              Hi Team, I ran and promoted 3.5.1 M and 3.6.0 I GEF
       builds from
              modeling.eclipse.org <http://modeling.eclipse.org>
       <http://modeling.eclipse.org>.


              The GEF team is good to go with the emft.eclipse.org
       <http://emft.eclipse.org>
              <http://emft.eclipse.org> shutdown.

              I will remove the emft.eclipse.org
       <http://emft.eclipse.org> <http://emft.eclipse.org>


              config from CVS.

              Cheers...
              Anthony
              --
              Anthony Hunter mailto:anthonyh@xxxxxxxxxx
       <mailto:anthonyh@xxxxxxxxxx>
              <mailto:anthonyh@xxxxxxxxxx <mailto:anthonyh@xxxxxxxxxx>>
              Software Development Manager: Eclipse Open Source Components
              IBM Rational Software: Aurora / GEF / GMF / Modeling Tools
              Phone: 613-270-4613


              Inactive hide details for Anthony Hunter---2009/07/29
       11:36:53
              AM---Yes, this was either
              https://bugs.eclipse.org/bugs/show_bugAnthony
              Hunter---2009/07/29 11:36:53 AM---Yes, this was either
              https://bugs.eclipse.org/bugs/show_bug.cgi?id=256211 or
              https://bugs.eclipse.or


              From:          Anthony Hunter/Ottawa/IBM

              To:            Ian Bull <irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>
              <mailto:irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>>>


              Cc:            GEF development <gef-dev@xxxxxxxxxxx
       <mailto:gef-dev@xxxxxxxxxxx>
              <mailto:gef-dev@xxxxxxxxxxx
       <mailto:gef-dev@xxxxxxxxxxx>>>, nickboldt+build@xxxxxxxxx
       <mailto:nickboldt%2Bbuild@xxxxxxxxx>
              <mailto:nickboldt%2Bbuild@xxxxxxxxx
       <mailto:nickboldt%252Bbuild@xxxxxxxxx>>

              Date:          2009/07/29 11:36 AM

              Subject:                Re: [gef-dev] Re: Last build on
       emft.eclipse.org <http://emft.eclipse.org>
              <http://emft.eclipse.org> today

                    ------------------------------------------------------------------------


              Yes, this was either
              https://bugs.eclipse.org/bugs/show_bug.cgi?id=256211 or
              https://bugs.eclipse.org/bugs/show_bug.cgi?id=269290 .

              Also https://bugs.eclipse.org/bugs/show_bug.cgi?id=274170
       is an
              issue with the GEF (and other projects) JavaDoc. Nick
       cannot do
              everything, so he was not going to fix this one.

              Cheers...
              Anthony
              --
              Anthony Hunter mailto:anthonyh@xxxxxxxxxx
       <mailto:anthonyh@xxxxxxxxxx>
              <mailto:anthonyh@xxxxxxxxxx <mailto:anthonyh@xxxxxxxxxx>>
              Software Development Manager: Eclipse Open Source Components
              IBM Rational Software: Aurora / GEF / GMF / Modeling Tools
              Phone: 613-270-4613



              Inactive hide details for Ian Bull ---2009/07/29 10:23:22
       AM---I
              played around with GEF and Athena last night, and by enabling
              Ian Bull ---2009/07/29 10:23:22 AM---I played around with GEF
              and Athena last night, and by enabling the path to the
       javadoc
              tool (and running the build), javadoc i


              From:          Ian Bull <irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>
              <mailto:irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>>>

              To:            Anthony Hunter/Ottawa/IBM@IBMCA

              Cc:            GEF development <gef-dev@xxxxxxxxxxx
       <mailto:gef-dev@xxxxxxxxxxx>
              <mailto:gef-dev@xxxxxxxxxxx
       <mailto:gef-dev@xxxxxxxxxxx>>>, nickboldt+build@xxxxxxxxx
       <mailto:nickboldt%2Bbuild@xxxxxxxxx>
              <mailto:nickboldt%2Bbuild@xxxxxxxxx
       <mailto:nickboldt%252Bbuild@xxxxxxxxx>>

              Date:          2009/07/29 10:23 AM

              Subject:                Re: [gef-dev] Re: Last build on
       emft.eclipse.org <http://emft.eclipse.org>
              <http://emft.eclipse.org> today

                    ------------------------------------------------------------------------



              I played around with GEF and Athena last night, and by
       enabling
              the path to the javadoc tool (and running the build),
       javadoc is
              being generated in the doc plugin.          Was this the
       concern we were having, or am I missing something?

              cheers,
              ian

              On Wed, Jul 29, 2009 at 6:43 AM, Anthony Hunter
              <_anthonyh@xxxxxx.com_ <mailto:anthonyh@xxxxxxxxxx
       <mailto:anthonyh@xxxxxxxxxx>
              <mailto:anthonyh@xxxxxxxxxx
       <mailto:anthonyh@xxxxxxxxxx>>>> wrote:

                   Hi again,

                   As Nick says, EMF QVF is moving to Athena as well.
       So we can
                   likely get others to help too.

                   We can follow the recent platform p2 zips only as
       well. EMF
              QVT is
                   probably going to do the same.



                   Cheers...
                   Anthony
                   --
                   Anthony Hunter _mailto:anthonyh@xxxxxx.com_
       <mailto:anthonyh@xxxxxx.com_>
              <mailto:anthonyh@xxxxxx.com_ <mailto:anthonyh@xxxxxx.com_>>
                   Software Development Manager: Eclipse Open Source
       Components
                   IBM Rational Software: Aurora / GEF / GMF / Modeling
       Tools
                   Phone: 613-270-4613


                   Inactive hide details for Ian Bull ---2009/07/28
       08:18:10
                   PM---Nick, do you know what's required to get javadoc
              generated in
                   thIan Bull ---2009/07/28 08:18:10 PM---Nick, do you
       know what's
                   required to get javadoc generated in the doc plugin?
       (i.e. what
                   parts are not implemented yet). I cou

                   From:                 Ian Bull
       <_irbull@eclipsesource.com_
                   <mailto:irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>
              <mailto:irbull@xxxxxxxxxxxxxxxxx
       <mailto:irbull@xxxxxxxxxxxxxxxxx>>>>

                   To:                   GEF development
       <_gef-dev@eclipse.org_
              <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
       <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>>>>


                   Cc:                   Anthony
       Hunter/Ottawa/IBM@IBMCA, _nickboldt+build@gmail.com_
                   <mailto:nickboldt%2Bbuild@xxxxxxxxx
       <mailto:nickboldt%252Bbuild@xxxxxxxxx>
              <mailto:nickboldt%252Bbuild@xxxxxxxxx
       <mailto:nickboldt%25252Bbuild@xxxxxxxxx>>>



                   Date:                 2009/07/28 08:18 PM

                   Subject:               Re: [gef-dev] Re: Last build
       on _emft.eclipse.org_
                   <http://emft.eclipse.org/> today

                               ------------------------------------------------------------------------



                   Nick,
                   do you know what's required to get javadoc generated
       in the doc
                   plugin? (i.e. what parts are not implemented yet). I
       could
              take a
                   stab at some of this.
                   I got myself setup with Athena today, and I'm pretty
       impressed
                   with what it can do.

                   cheers,
                   ian

                   On Fri, Jul 24, 2009 at 2:53 PM, Nick Boldt
              <_nickboldt@gmail.com_
                   <mailto:nickboldt@xxxxxxxxx
       <mailto:nickboldt@xxxxxxxxx> <mailto:nickboldt@xxxxxxxxx

       <mailto:nickboldt@xxxxxxxxx>>>>

              wrote:
                               Well, FWIW, not everyone's worried about
       javadoc in
                               their doc plugin, or supporting legacy
       zip file
                               formats (sdk and runtime "runnable" zips).

                               EMF-QTV moved this week. MWE, Xpand,
       Xtext, OCL are
                               coming soon.

                               The revolution will be Hudson'fied. :)

                               Anthony Hunter wrote:
                               OK,

                               Athena is a non-starter until the JavaDoc
              generation
                               is fixed. We can tackle these in Helios when
              the other
                               modeling projects start to take advantage of
              the new
                               Athena technology.

                               Cheers...
                               Anthony
                               --
                               Anthony Hunter mailto:_anthonyh@xxxxxx.com_
                               <mailto:anthonyh@xxxxxxxxxx
       <mailto:anthonyh@xxxxxxxxxx>
              <mailto:anthonyh@xxxxxxxxxx <mailto:anthonyh@xxxxxxxxxx>>>
                               Software Development Manager: Eclipse
       Open Source
                               Components
                               IBM Rational Software: Aurora / GEF / GMF /
              Modeling Tools
                               Phone: 613-270-4613


                               Inactive hide details for Nick Boldt
       ---2009/07/24
                               02:58:44 PM---> Nick, should we consider
       moving to
                               Hudson / Athena ?Nick Boldt
       ---2009/07/24 02:58:44
                               PM---> Nick, should we consider moving
       to Hudson /
                               Athena ?


                               From:                    Nick Boldt
              <_nickboldt@gmail.com_
                               <mailto:nickboldt@xxxxxxxxx
       <mailto:nickboldt@xxxxxxxxx>
              <mailto:nickboldt@xxxxxxxxx <mailto:nickboldt@xxxxxxxxx>>>>

                               To:                      Anthony
              Hunter/Ottawa/IBM@IBMCA

                               Cc:                      GEF development
              <_gef-dev@eclipse.org_
                               <mailto:gef-dev@xxxxxxxxxxx
       <mailto:gef-dev@xxxxxxxxxxx>
              <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>>>>,
                               _nickboldt+build@gmail.com_
                               <mailto:nickboldt%2Bbuild@xxxxxxxxx
       <mailto:nickboldt%252Bbuild@xxxxxxxxx>
              <mailto:nickboldt%252Bbuild@xxxxxxxxx
       <mailto:nickboldt%25252Bbuild@xxxxxxxxx>>>



                               Date:                    2009/07/24 02:58 PM

                               Subject:                          Re: Last
              build on _emft.eclipse.org_
                               <http://emft.eclipse.org/> today

                                           ------------------------------------------------------------------------



                                > Nick, should we consider moving to
       Hudson /
              Athena ?
                                >
              _https://build.eclipse.org/hudson/view/Athena%20CBI/_
                                > The part that is missing I think is
       how to
              promote
                               the builds to the
                                > downloads site.

                               There are three missing pieces if you
       want to
              have the
                               exact same
                               experience w/ Athena as you do w/ Modeling:

                               a) javadoc generation in .doc plugins is
       broken
              - I'd
                               argue you don't
                               need it if you use Eclipse and install
       the sources
                               instead. Isn't the
                               source navigation in Eclipse (and
       javadoc view) WAY
                               more useful than the
                               canned, generated javadoc in Help?

                               b) Galileo .build file won't be
       automatically
              updated,
                               but you only need
                               to do that by hand, what, 4 more times
       between
              now and
                               February? (2 RCs
                               and 2 GAs). For Helios we'll set
       something up.

                               c) Publishing is MUCH simpler. You need a
              properties
                               file, a boilerplate
                               promote.xml, and an entry in your crontab on
                               build.eclipse. C'est tout!_
                               __
                                           __http://wiki.eclipse.org/Common_Build_Infrastructure/Publishing_

                               Oh, and until I set up the weekly
       tag&release
                               automation you use for GEF
                               on emft.eclipse as part of the Athena system
              (see (c)
                               - this'll be
                               another crontab entry you control)
       you'll have
              to go
                               back to manually
                               tagging & releasing from within Eclipse
       using the
                               releng tools plugin.

                               But as to setting up a GEF build in
       Athena, there's
                               already one for 3.5:_
                               __
                                           __https://build.eclipse.org/hudson/view/Athena%20CBI/job/cbi-gef-3.5.x-nightly/_

                               N
                               --                  Nick Boldt ::
              _http://nick.divbyzero.com_
                               <http://nick.divbyzero.com/>
                               Release Engineer :: Eclipse Modeling &
       Dash Athena



                               --                  Nick Boldt ::
              _http://nick.divbyzero.com_
                               <http://nick.divbyzero.com/>
                               Release Engineer :: Eclipse Modeling &
       Dash Athena
                                     _______________________________________________
                               gef-dev mailing list_
                               __gef-dev@eclipse.org_
              <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
       <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>>>_

                                           __https://dev.eclipse.org/mailman/listinfo/gef-dev_                      --      R. Ian Bull | EclipseSource Victoria | +1
       250 477 7484_
                   __http://eclipsesource.com_
       <http://eclipsesource.com/> |
                   _http://twitter.com/eclipsesource_





              --        R. Ian Bull | EclipseSource Victoria | +1 250
       477 7484_
              __http://eclipsesource.com_ <http://eclipsesource.com/> |
              _http://twitter.com/eclipsesource_


                    ------------------------------------------------------------------------

              _______________________________________________
              gef-dev mailing list
              gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
       <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>>

              https://dev.eclipse.org/mailman/listinfo/gef-dev


          --    Nick Boldt :: http://nick.divbyzero.com
          Release Engineer :: Eclipse Modeling & Dash Athena
          _______________________________________________
          gef-dev mailing list
          gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
       <mailto:gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>>

          https://dev.eclipse.org/mailman/listinfo/gef-dev




       --        R. Ian Bull | EclipseSource Victoria | +1 250 477 7484
       http://eclipsesource.com | http://twitter.com/eclipsesource




       ------------------------------------------------------------------------

       _______________________________________________
       gef-dev mailing list
       gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
       https://dev.eclipse.org/mailman/listinfo/gef-dev


   --    Nick Boldt :: http://nick.divbyzero.com
   Release Engineer :: Eclipse Modeling & Dash Athena
   _______________________________________________
   gef-dev mailing list
   gef-dev@xxxxxxxxxxx <mailto:gef-dev@xxxxxxxxxxx>
   https://dev.eclipse.org/mailman/listinfo/gef-dev




--
R. Ian Bull | EclipseSource Victoria | +1 250 477 7484
http://eclipsesource.com | http://twitter.com/eclipsesource


------------------------------------------------------------------------

_______________________________________________
gef-dev mailing list
gef-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/gef-dev

--
Nick Boldt :: http://nick.divbyzero.com
Release Engineer :: Eclipse Modeling & Dash Athena
_______________________________________________
gef-dev mailing list
gef-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/gef-dev



--
R. Ian Bull | EclipseSource Victoria | +1 250 477 7484
http://eclipsesource.com | http://twitter.com/eclipsesource

Back to the top