128byte memory leak in ZFS
Description
Problem/Justification
Impact
duplicates
SmartDraw Connector
Katalon Manual Tests (BETA)
Activity

Alexander Motin June 28, 2021 at 9:03 PM
Lets guess for now it is already fixed speculative prefetcher issue.

William Gryzbowski May 14, 2021 at 4:38 PM
did you get a chance to try with 12.0-U3?

Alexander Motin April 12, 2021 at 5:07 PM
In the new debug in `vmstat -m` I see >10GB of RAM consumed by ex-Solaris code, likely ZFS in 128 byte chunks:
Unfortunately I can't guess what it is just from that line. It could help if you find out what exactly workload makes it to grow that fast. And really make sure to upgrade in case it is something that was already fixed. We expect TrueNAS 12.0-U3 to be released tomorrow.

Jason Lingohr April 10, 2021 at 12:31 AMEdited
Hi, I haven't had the chance to upgrade, but I think this is heading back into a tailspin.
I think this latest began at 4 April, 00:00. Out of swap space again, wasn't doing anything special other than file serving. New debugs attached. Have also attached some syslogs, and a graph of swap usage from Zabbix.
I also now have no web interface access, and several process in D state:

Alexander Motin April 5, 2021 at 7:18 PM
I'm sorry for the delay. Unfortunately in the provided debug I see no logs before the last reboot. Not sure what happened to them, considering that now the system dataset seems to be stored on the data pool. But any way I can't say anything about hang, neither I see any swap-related errors. Please update to the latest TrueNAS 12.0-U2.1 and then report the problem again with the debug that hopefully show anything.
Details
Details
Assignee

Reporter

Not entirely sure what happened, but the NAS just hung hard, 19 Feb 2021, sometime between 2am and 8am Australian daylight time. In the previous week, I had been seeing weird errors around a lack of swap.