Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [papyrus-rt-dev] Runtime tests [was: [Bug 469429] [runtime] [bmaher/runtime/cygwin] branch - application crashes after de-registering SAP port]

Comments inline.

On Wed, Nov 2, 2016 at 10:40 AM charles+zeligsoft.com <charles@xxxxxxxxxxxxx> wrote:
BTW, you referred to this test as “Barry’s model.” would that not then make him a “modeler” ;-)

Slip of the tongue. The tests mimic some models but they are not generated from models.
 

The only downside to having target language self-coded “models" is that there is no validation of those “pseudo” models to conform to UML-RT as implemented in Papyrus-RT, past their ability to compile and run against the RTS. They would also not be portable if (when) we add other implementation languages.

Not all tests are meant to conform to UML-RT. For example, we have several unit tests which test only specific aspects of the code generator. It doesn't even make sense to talk about these as "conforming" to a language. 

The point is that there are tests (such as unit tests) that are not only reasonable, but even necessary and which we cannot call "UML-RT conformant", because they only tests certain aspects of either the code generator or the runtime, and we wouldn't get rid of unit tests, so it is reasonable for the project to keep tests that are not "UML-RT conformant". Although not proper "unit tests", I would classify Barry's tests in the same category. Perhaps it would be desirable if Barry turned these into proper unit tests integrated into the build, but I'm not sure this is either easy or desirable, and in any case, I think Barry's opinion on this would be important.
 

If we decide continue to have non-modeler developers create these tests, but they may very well be limited to checking for regressions during development and could not be used to express any other quality metric against the whole of the Papyrus-RT product.

Just like unit tests: we need not just tests for the product as a whole, but also tests for parts of it, and this includes parts that the user doesn't see or experience directly. That's why Barry's tests and other unit tests are in separate folders, and not under the "models" hierarchy in the repo.
 

I think that this is also is a good case for using the textual capability being built to express the runtime tests!


To the extent that you want to test full models, rather than individual aspects of the component in question, yes.

 

Regards,

Charles Rivet
Senior Product Manager

On 2016.11.02, at 10:21 , Ernesto Posse <eposse@xxxxxxxxxxxxx> wrote:

These tests are in the git repo under plugins/umlrt/runtime, rather than in the actual model tests, and they are not packaged or deployed. They are intended exclusively for testing the runtime "directly", this is, they are not intended to exercise the generated code, but the runtime itself. Those have been written by hand by Barry for him to do his own testing of the runtime, so they do not necessarily correspond to generated code. They do not have a model. They are just plain C++.

It might be that it is preferable that tests have models, but not all developers are modellers. If a developer works best with code, we might not be improving the process, by forcing all tests to be models. I think it makes sense to allow for some flexibility towards developers who have their own non-model-based tests and to allow those developers to push tests into the repo that are not model-based.

--
Ernesto Posse
Zeligsoft






On Wed, Nov 2, 2016 at 8:07 AM charles+zeligsoft.com <charles@xxxxxxxxxxxxx> wrote:
We need to review the tests found in "plugins/umlrt/runtime/tests” to determine which aren’t runnable or maintainable and, therefore, need to be removed or updated.

Although it was totally justified to do this at the time, my take on this is that we really should be creating tests by modelling them and not creating them by hand.


Regards,

Charles Rivet
Senior Product Manager, Papyrus-RT product lead

Begin forwarded message:

Subject: [Bug 469429] [runtime] [bmaher/runtime/cygwin] branch - application crashes after de-registering SAP port
Date: November 1, 2016 at 15:07:03 EDT

https://bugs.eclipse.org/bugs/show_bug.cgi?id=469429
Product/Component: Papyrus-rt / runtime

Ernesto Posse <eposse@xxxxxxxxx> changed:

          What    |Removed                     |Added
----------------------------------------------------------------------------
                CC|                            |eposse@xxxxxxxxx

--- Comment #2 from Ernesto Posse <eposse@xxxxxxxxx> ---
I can't reproduce.

I tested SAPs on Windows 7 with Cygwin, more precisely the Services model in
the git repo and it works as expected.

I am unable to build Barry's custom (hand-written) tests under
plugins/umlrt/runtime/tests on Windows, and there are no instructions on how to
do it, hence, I assume that Barry's model may be outdated, and I would suggest
that he looks into it.

--
You are receiving this mail because:
You are on the CC list for the bug.
You are watching the assignee of the bug.

_______________________________________________
papyrus-rt-dev mailing list
papyrus-rt-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/papyrus-rt-dev
_______________________________________________
papyrus-rt-dev mailing list
papyrus-rt-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/papyrus-rt-dev

_______________________________________________
papyrus-rt-dev mailing list
papyrus-rt-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/papyrus-rt-dev

Back to the top