Skip to main content


Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » Eclipse Platform » Eclipse Platform UI testing
Eclipse Platform UI testing [message #333742] Tue, 30 December 2008 23:41 Go to next message
Pawan Singh is currently offline Pawan SinghFriend
Messages: 9
Registered: July 2009
Junior Member
Hi

I wanted to know how does Eclipse Platform Team test Eclipse Platform UI
on Windows, Linux and Solaris? What tools do they use to test the UI? Is
it automated or is it manual? If it is manual, are there manual test plans
around which we can take a look at?

We are going to be building RCP based on Eclipse platform and we are going
to use the same methodology of testing UI as Eclipse Platform or other
Eclipse UI projects do.

-Pawam
Re: Eclipse Platform UI testing [message #333747 is a reply to message #333742] Wed, 31 December 2008 13:40 Go to previous messageGo to next message
Paul Webster is currently offline Paul WebsterFriend
Messages: 6859
Registered: July 2009
Location: Ottawa
Senior Member

We test with the platform-ui-tests module from CVS:
:pserver:anonymous@dev.eclipse.org:/cvsroot/eclipse

Most of our tests are automated, and test the workbench code. We have
some code that digs into SWT to test specific scenarios, but not much.

We do have manual tests, but they are in the nature of "test this area"
as opposed to specific steps. http://wiki.eclipse.org/Platform_UI/Testing

For SWT level testing there is http://swtbot.sourceforge.net/index.html
but we don't use that in the platform UI testing itself.

PW

--
Paul Webster
http://wiki.eclipse.org/Platform_Command_Framework
http://wiki.eclipse.org/Command_Core_Expressions
http://wiki.eclipse.org/Menu_Contributions
http://wiki.eclipse.org/Menus_Extension_Mapping
http://help.eclipse.org/ganymede/index.jsp?topic=/org.eclips e.platform.doc.isv/guide/workbench.htm


Re: Eclipse Platform UI testing [message #333748 is a reply to message #333747] Wed, 31 December 2008 17:35 Go to previous messageGo to next message
Pawan Singh is currently offline Pawan SinghFriend
Messages: 9
Registered: July 2009
Junior Member
Thanks a lot.

So I am assuming from your post that SWTBot is used for testing Eclipse UI
for various projects and most of the UI testing is automated on all
platforms (Windows, Linux and Solaris).

Can I also assume that SWTBot lets you run the same tests on Windows,
Linux and Solaris without re-writing them for specific platform?

Is this the tool Eclipse Community would recommend for testing RCPs on
Windows, Linux and Solaris? There are commercial tools available - but if
Eclipse projects use SWTBot, I would rather try to use SWTBot because of
shared community knowledgebase in using this tool.

Thanks
Pawan
Re: Eclipse Platform UI testing [message #333764 is a reply to message #333748] Sat, 03 January 2009 18:51 Go to previous messageGo to next message
Eclipse UserFriend
Originally posted by: dcarver.starstandard.org

Actually, SWTBot is now an official eclipse project, and you can find
more information here:

http://www.eclipse.org/swtbot/

It's a new project so not too many project are using it yet at eclipse.

Dave


Pawan Singh wrote:
> Thanks a lot.
>
> So I am assuming from your post that SWTBot is used for testing Eclipse
> UI for various projects and most of the UI testing is automated on all
> platforms (Windows, Linux and Solaris).
> Can I also assume that SWTBot lets you run the same tests on Windows,
> Linux and Solaris without re-writing them for specific platform?
>
> Is this the tool Eclipse Community would recommend for testing RCPs on
> Windows, Linux and Solaris? There are commercial tools available - but
> if Eclipse projects use SWTBot, I would rather try to use SWTBot because
> of shared community knowledgebase in using this tool.
>
> Thanks
> Pawan
>
Re: Eclipse Platform UI testing [message #333782 is a reply to message #333764] Mon, 05 January 2009 17:00 Go to previous messageGo to next message
Pawan Singh is currently offline Pawan SinghFriend
Messages: 9
Registered: July 2009
Junior Member
Do other Eclipse projects use SWTBot for testing or do they use commercial
tools like IBM Rational, HP QuickTestPro, Segue Silk? If SWTBot is a new
project, that implies that there is very little automated UI testing for
Eclipse projects.

Are there any UI tests done for Linux and Solaris for various Eclipse
projects? Typically, in my experience with these commercial tools, you
have to rewrite tests for each platform making UI testing three times as
costly as other forms of testing. SWT does not seem to hide the UI testing
complexity for each platform.
Re: Eclipse Platform UI testing [message #333789 is a reply to message #333782] Tue, 06 January 2009 00:26 Go to previous messageGo to next message
Walter Harley is currently offline Walter HarleyFriend
Messages: 847
Registered: July 2009
Senior Member
"Pawan Singh" <psingh@fnfr.com> wrote in message
news:2d38ab669a7abb67c258864ff1b9ec63$1@www.eclipse.org...
> that implies that there is very little automated UI testing for Eclipse
> projects.

Unfortunately I believe that is indeed the situation.
Re: Eclipse Platform UI testing [message #333792 is a reply to message #333789] Tue, 06 January 2009 05:12 Go to previous messageGo to next message
Pawan Singh is currently offline Pawan SinghFriend
Messages: 9
Registered: July 2009
Junior Member
This means that Eclipse Foundation needs to work hard to get resources
allocated to SWTBot project. In this age of automation driven testing, SWT
seems to be lagging behind. I can get good tools for Java Swing, Adobe
FLASH, Windows Native UI, Selenium for Web interfaces (like Ajax) - but
SWT testing is primarily done using a few commercial tools (which are not
very good at SWT testing) and on Windows only. One of the reasons for
choosing Eclipse as a platform is that it runs on Linux, Solaris and Mac.
But there are no commercial crossplatform UI testing tools for SWT.

BTW - how do Eclipse UI developers ensure that once they check something
in, they have not broken the Eclipse UI in some really dumb way? Do they
indirectly get this information from millions of Eclipse beta testers who
are effectively manually testing Eclipse?
Re: Eclipse Platform UI testing [message #333794 is a reply to message #333792] Tue, 06 January 2009 06:25 Go to previous messageGo to next message
Prakash G.R. is currently offline Prakash G.R.Friend
Messages: 621
Registered: July 2009
Senior Member
"Paul Webster" <pwebster@ca.ibm.com> wrote in message
news:gjft9i$jmn$1@build.eclipse.org...
> We test with the platform-ui-tests module from CVS:
> :pserver:anonymous@dev.eclipse.org:/cvsroot/eclipse
>
> Most of our tests are automated, and test the workbench code. We have
> some code that digs into SWT to test specific scenarios, but not much.


Pawan,

Did you have a look at the Platform UI tests that Paul mentioned? It
would answer your question on how the team ensures Eclipse UI is not broken.

- Prakash
--

http://blog.eclipse-tips.com

"Pawan Singh" <psingh@fnfr.com> wrote in message
news:661e468e23b0ec5f8621da4fccaf434f$1@www.eclipse.org...
> This means that Eclipse Foundation needs to work hard to get resources
> allocated to SWTBot project. In this age of automation driven testing, SWT
> seems to be lagging behind. I can get good tools for Java Swing, Adobe
> FLASH, Windows Native UI, Selenium for Web interfaces (like Ajax) - but
> SWT testing is primarily done using a few commercial tools (which are not
> very good at SWT testing) and on Windows only. One of the reasons for
> choosing Eclipse as a platform is that it runs on Linux, Solaris and Mac.
> But there are no commercial crossplatform UI testing tools for SWT.
>
> BTW - how do Eclipse UI developers ensure that once they check something
> in, they have not broken the Eclipse UI in some really dumb way? Do they
> indirectly get this information from millions of Eclipse beta testers who
> are effectively manually testing Eclipse?
>
Re: Eclipse Platform UI testing [message #333796 is a reply to message #333748] Tue, 06 January 2009 12:32 Go to previous message
Ketan Padegaonkar is currently offline Ketan PadegaonkarFriend
Messages: 873
Registered: July 2009
Senior Member
Pawan,

SWTBot is cross platform, it supports Windows, linux, solaris(untested)
and mac, and the tests are not platform specific. SWTBot hides away the
differences between all platforms, so the tests are agnostic of the
platform on which they run.

SWTBot is quite mature, has been around for little over a year, and is
used by quite a few people. Not many projects at eclipse.org use it.
There are a few open source projects including Apache's Directory
Studio[1], Matrex[2], and a lot more[3]

Feel free to ask questions on the eclipse.swtbot newsgroup

[1] - http://directory.apache.org/studio/working.html
[2] - http://matrexblog.blogspot.com/2008/09/swtbot-for-dialogs.ht ml
[3] -
http://greensopinion.blogspot.com/2008/09/eclipse-gui-testin g-is-viable-with.html,
http://richardadams606blog.blogspot.com/2008/10/swtbot-gui-t esting-for-rcp.html

-- Ketan

On 31/12/08 23:05, Pawan Singh wrote:
> Thanks a lot.
>
> So I am assuming from your post that SWTBot is used for testing Eclipse
> UI for various projects and most of the UI testing is automated on all
> platforms (Windows, Linux and Solaris).
> Can I also assume that SWTBot lets you run the same tests on Windows,
> Linux and Solaris without re-writing them for specific platform?
>
> Is this the tool Eclipse Community would recommend for testing RCPs on
> Windows, Linux and Solaris? There are commercial tools available - but
> if Eclipse projects use SWTBot, I would rather try to use SWTBot because
> of shared community knowledgebase in using this tool.
>
> Thanks
> Pawan
>
Re: Eclipse Platform UI testing [message #333798 is a reply to message #333782] Tue, 06 January 2009 12:26 Go to previous message
Paul Webster is currently offline Paul WebsterFriend
Messages: 6859
Registered: July 2009
Location: Ottawa
Senior Member

Pawan Singh wrote:
> Do other Eclipse projects use SWTBot for testing or do they use
> commercial tools like IBM Rational, HP QuickTestPro, Segue Silk? If
> SWTBot is a new project, that implies that there is very little
> automated UI testing for Eclipse projects.

"Eclipse projects" is very broad. The SDK projects do have a lot
(thousands) of automated (junit plug-in) tests for their UI (don't get
me wrong, there could always be more :-) Most of the tests just don't
use an external product for UI testing, but set up the UI and validate
it from Java.

Some other EF projects hardly supply any tests at all, let alone UI tests.

--
Paul Webster
http://wiki.eclipse.org/Platform_Command_Framework
http://wiki.eclipse.org/Command_Core_Expressions
http://wiki.eclipse.org/Menu_Contributions
http://wiki.eclipse.org/Menus_Extension_Mapping
http://help.eclipse.org/ganymede/index.jsp?topic=/org.eclips e.platform.doc.isv/guide/workbench.htm


Previous Topic:Meaning of decoration of files in tabs of texteditor
Next Topic:Deselecting a combo with JFace Databinding
Goto Forum:
  


Current Time: Fri Oct 18 10:49:20 GMT 2024

Powered by FUDForum. Page generated in 0.03609 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top