SLOB Chewed Up All My File System Space and Spit It Out. But, Why?

kevinclosson's picture

This is a quick blog post in response to a recent interaction with a SLOB user. The user reached out to me to lament that all her file system space was consumed as the result of a SLOB execution (runit.sh). I reminded her that runit.sh will alert to possible derelict mpstat/iostat/vmstat processes from an aborted SLOB test. If these processes exist they will be spooling their output to unlinked files.

The following screen shot shows what to expect if a SLOB test detects potential “deadwood” processes. If you see this sort of output from runit.sh, it’s best to investigate whether in fact they remain from an aborted test or whether there are other users on the system that left these processes behind.

 

#000000;" src="https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iostat.png?w=500&h=277" alt="" width="500" height="277" srcset="https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iostat.png?w=500&h=277 500w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iost... 1000w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iost... 150w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iost... 300w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic1-derilect-iost... 768w" sizes="(max-width: 500px) 100vw, 500px" />

The next screenshot shows how to take action on the runit.sh output:

#000000;" src="https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iostat.png?w=500&h=290" alt="" width="500" height="290" srcset="https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iostat.png?w=500&h=290 500w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iost... 150w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iost... 300w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iost... 768w, https://kevinclosson.files.wordpress.com/2018/10/blog-pic2-derilect-iost... 917w" sizes="(max-width: 500px) 100vw, 500px" />

Summary

If SLOB is consuming all your file system space, it’s probably already telling you why–all you need to do is take action. I hope this is helpful for some wayward Googler someday.

To prevent automated spam submissions leave this field empty.