Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [che-dev] Status of nightly testing for CHE Multiuser-OCP
Hello everyone.

I just want to confirm comments from Igor Okhrimenko, that it turned out that Selenium chrome-node image of latest version 3.14.0 is mutable. It is periodically updated with latest changes from https://github.com/SeleniumHQ/docker-selenium
master branch. 
As a result, 6 days ago there were new Google Chrome of newer version 69 and the other changes appeared in chrome-node image, and it led to unexpected regression.
To fix the problem Che QE team has decided to downgrade Selenium chrome-node image to immutable one: 3.14.0-curium with Google Chrome of version 68.

On Tue, Sep 11, 2018 at 3:24 PM Ihor Okhrimenko <iokhrime@xxxxxxxxxx> wrote:
Please take a look 
https://ci.codenvycorp.com/view/qa/job/che-integration-tests-multiuser-master-ocp/347/changes
  • Update selenium chrome-node to 3.14.0 (#10869)

As I understood on today's QE meeting the chrome-node 3.14.0 didn't have a final defined version of Google Chrome

On Tue, Sep 11, 2018 at 2:56 PM Yevhen Ivantsov <yivantso@xxxxxxxxxx> wrote:
Hm.. but in this case, section `Changes since last report` does not have much to do with new test failures as it does not look like commits from that list may have caused new failures. Just thinking out loud. What is the purpose of Changes since last report? Thank you

On Tue, Sep 11, 2018 at 2:47 PM, Ihor Okhrimenko <iokhrime@xxxxxxxxxx> wrote:
All unstable tests have "Known issue" try/catch block.
All another cases requires more precision investigating. 
For example, today's regression related to the new version of Google Chrome


On Tue, Sep 11, 2018 at 11:34 AM Oleksandr Garagatyi <ogaragat@xxxxxxxxxx> wrote:
It looks like there are some tests fails all the time. Can we split the report of failures to tests that are considered unstable (fails from time to time) and stable test that failed? That would provide more clarity to the report.

On Tue, Sep 11, 2018 at 11:25 AM Ihor Okhrimenko <iokhrime@xxxxxxxxxx> wrote:
Hello Here is the short report on nightly testing for CHE multi-user on ocp assembly

Last Published: 2018-09-11  | Version: 6.11.0-SNAPSHOT ( Link )

95.075% Success rate
  • 670 Tests run
  • 14 failed with known issue
  • 14 failed - we are investigating the root cause

Changes since last nightly report ( details )
  • Tune a list of owners for  multi-user modules (#11108)
  • Add icons to project explorer tree for files with ".ts", ".jsx" and ".es6" extensions (#11043)
  • [Selenium] Fix unexpected fail of "WorkspaceDetailsMachineActionsTest" selenium test on docker infrastructure (#11102)
  • Fix NPE and NumberFormatException in some cases
    Fix NPE on start of a workspace created from the Theia stack. Fix
    NumberFormatException when machine doesn't have memory property.
  • Add migration to fix signature keys inconsistency
  • Apply WaitUtils.waitSuccessCondition() method to HotUpdateUtil (#11127)
  • Remove instructions to fork test repos (#11126)
  • Selenium: update NewWorkspacePageTest selenium test according to the
    addition of new stacks (#11150)

--

IHOR OKHRIMENKO

ASSOCIATE QUALITY ENGINEER EMEA R&D DEVELOPER

Red Hat Ukraine

Cherkasy, Schevchenka 242/1, office 603

iokhrime@xxxxxxxxxx    M: +380972928305    

_______________________________________________
che-dev mailing list
che-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/che-dev


--

OLEKSANDR GARAGATYI

SENIOR SOFTWARE ENGINEER

Red Hat 

_______________________________________________
che-dev mailing list
che-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/che-dev


--

IHOR OKHRIMENKO

ASSOCIATE QUALITY ENGINEER EMEA R&D DEVELOPER

Red Hat Ukraine

Cherkasy, Schevchenka 242/1, office 603

iokhrime@xxxxxxxxxx    M: +380972928305    


_______________________________________________
che-dev mailing list
che-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/che-dev




--

EUGENE IVANTSOV

Red Hat 

eivantsov@xxxxxxxxxx   

_______________________________________________
che-dev mailing list
che-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/che-dev


--

IHOR OKHRIMENKO

ASSOCIATE QUALITY ENGINEER EMEA R&D DEVELOPER

Red Hat Ukraine

Cherkasy, Schevchenka 242/1, office 603

iokhrime@xxxxxxxxxx    M: +380972928305    

_______________________________________________
che-dev mailing list
che-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/che-dev


--
With best regards,
Dmytro Nochevnov
Codenvy Associate

Back to the top