Hi,
I am having an issue with file system
quota tools not reporting correctly on the directory where jetty is
deployed. After some investigation I think it's down to left over file
descriptors like these (output from lsof):
java 39467 sclient 5r REG 8,1 134017 101365281 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/HikariCP-java7-2.4.13.jar (deleted)
java 39467 sclient 5r REG 8,1 134017 101365281 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/HikariCP-java7-2.4.13.jar (deleted)
java 39467 sclient 45r REG 8,1 69409 101365257 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/activation-1.1.1.jar (deleted)
java 39467 sclient 46r REG 8,1 267827 101365259 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/admin_2.13.jar (deleted)
java 39467 sclient 47r REG 8,1 499844 101365280 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/c3p0-0.9.5.4.jar (deleted)
java 39467 sclient 48r REG 8,1 246918 101365265 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-beanutils-1.9.4.jar (deleted)
java 39467 sclient 49r REG 8,1 347669 101365260 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-codec-1.14.jar (deleted)
java 39467 sclient 50r REG 8,1 588337 101365276 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-collections-3.2.2.jar (deleted)
java 39467 sclient 51r REG 8,1 208475 101365250 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-dbcp2-2.7.0.jar (deleted)
java 39467 sclient 52r REG 8,1 146108 101365282 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-digester-1.8.1.jar (deleted)
java 39467 sclient 53r REG 8,1 214788 101365256 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-io-2.6.jar (deleted)
java 39467 sclient 54r REG 8,1 61829 101365278 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-logging-1.2.jar (deleted)
java 39467 sclient 55r REG 8,1 129592 101365268 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-pool2-2.7.0.jar (deleted)
java 39467 sclient 56r REG 8,1 186077 102297951 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/commons-validator-1.6.jar (deleted)
java 39467 sclient 57r REG 8,1 580870 101365271 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/flyway-core-6.3.3.jar (deleted)
java 39467 sclient 58r REG 8,1 1586948 101365273 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/freemarker-2.3.29.jar (deleted)
java 39467 sclient 59r REG 8,1 80511 101365272 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/geny_2.13-0.6.0.jar (deleted)
java 39467 sclient 60r REG 8,1 219146 101365253 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/javax.mail-api-1.6.2.jar (deleted)
java 39467 sclient 61r REG 8,1 25464 101365283 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/jetty-continuation-9.4.28.v20200408.jar (deleted)
java 39467 sclient 62r REG 8,1 624036 101365275 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/mchange-commons-java-0.2.15.jar (deleted)
java 39467 sclient 63r REG 8,1 927447 101365252 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/postgresql-42.2.10.jar (deleted)
java 39467 sclient 64r REG 8,1 134017 1352185 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/HikariCP-java7-2.4.13.jar (deleted)
java 39467 sclient 65r REG 8,1 4250 101365255 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scala-collection-compat_2.13-2.1.6.jar (deleted)
java 39467 sclient 66r REG 8,1 5865349 101365264 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scala-library-2.13.2.jar (deleted)
java 39467 sclient 67r REG 8,1 225338 101365277 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scala-parser-combinators_2.13-1.1.2.jar (deleted)
java 39467 sclient 68r REG 8,1 129113 101365279 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scalaj-http_2.13-2.4.2.jar (deleted)
java 39467 sclient 69r REG 8,1 3625052 101365254 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scala-reflect-2.13.2.jar (deleted)
java 39467 sclient 70r REG 8,1 1801315 101365266 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scalikejdbc-core_2.13-3.4.2.jar (deleted)
java 39467 sclient 71r REG 8,1 6504 102297938 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scalikejdbc-interpolation-macro_2.13-3.4.2.jar (deleted)
java 39467 sclient 72r REG 8,1 201322 101365263 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scalikejdbc-interpolation_2.13-3.4.2.jar (deleted)
java 39467 sclient 73r REG 8,1 19036 101365261 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/scalikejdbc_2.13-3.4.2.jar (deleted)
java 39467 sclient 74r REG 8,1 41472 101365274 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/slf4j-api-1.7.30.jar (deleted)
java 39467 sclient 75r REG 8,1 35063 101365284 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/stats_collector_2.13-0.1.0-SNAPSHOT.jar (deleted)
java 39467 sclient 76r REG 8,1 187761 101365270 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/ujson_2.13-1.1.0.jar (deleted)
java 39467 sclient 77r REG 8,1 114284 101365269 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-1577458225866104653.dir/webapp/WEB-INF/lib/upickle-core_2.13-1.1.0.jar (deleted)
java 39467 sclient 94r REG 8,1 69409 1220495 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/activation-1.1.1.jar (deleted)
java 39467 sclient 95r REG 8,1 267827 1352165 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/admin_2.13.jar (deleted)
java 39467 sclient 96r REG 8,1 499844 1352184 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/c3p0-0.9.5.4.jar (deleted)
java 39467 sclient 97r REG 8,1 246918 1352170 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-beanutils-1.9.4.jar (deleted)
java 39467 sclient 98r REG 8,1 347669 1352166 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-codec-1.14.jar (deleted)
java 39467 sclient 99r REG 8,1 588337 1352180 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-collections-3.2.2.jar (deleted)
java 39467 sclient 100r REG 8,1 208475 957623 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-dbcp2-2.7.0.jar (deleted)
java 39467 sclient 101r REG 8,1 146108 1352186 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-digester-1.8.1.jar (deleted)
java 39467 sclient 102r REG 8,1 214788 1212954 /home/client/tmp/jetty-0_0_0_0-8443-root_war-_-any-17785782056536538882.dir/webapp/WEB-INF/lib/commons-io-2.6.jar (deleted)
...
The
file system tools(du) correctly report used disk space but file system
quota is not seeing space being released after each update of deployed
WAR file (used space grows). After I restart jetty file system quota is
updated correctly. It's only JAR files from what I can tell so could it
be related to the class loader in some way?
FS is xfs on centos8 with pquota (project quota)
I am using latest release 9.4.30.v20200611
Regards
_______________________________________________