I’m a bit confused, so please help me understand the problem.
In addition to Peter’s concerns, below, about the testing aspect, this raises some other questions:
Are we currently running tests using RCPTT recordings or test suites? If so, what is used to run these tests? The existing Tester Setup (as per wiki)? The existing User Setup (as per wiki)? A developer runtime environment?
Is there an assumption that RCPTT tests would generate different results depending on how the Papyrus-RT instance is created/deployed? In particular, for the same user type, RCP vs. Oomph-base installations? This would have some major implications to both our testing and support approaches!
Hi,
I think this sounds as a good idea in general. I have one concern/question though, related to the QA aspect with RCPTT, and when and thus how fast we can detect regressions by the RCPTT test suites.
I am not sure if this change of breaking out the RCP build will impact the RCPTT testing. Is the RCPTT test suites executed against the latest RCP build, which then will be executed more seldom? Or is is some other build that is used for executing the RCPTT test suites?
I have already before raised a question whether the RCPTT test suites should be executed also for Gerrit changes, to detect that the Gerrit change causes regressions in the RCPTT test suites (or requires updates of the scripts, e.g. when we do changes in the UI). As I have understood it, currently we do not detect regression by the RCPTT test suites until the Gerrit change actually have been merged (which could be considered to late).
Or do we expect the RCPTT test suites to only detect regressions once a week (based on the new RCP build run once a week)? What will the process be to make needed changes? Will we track that by new Bugzillas?
/Peter Cigéhn
_______________________________________________ papyrus-rt-dev mailing list papyrus-rt-dev@xxxxxxxxxxxTo change your delivery options, retrieve your password, or unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/papyrus-rt-dev
|