Replication hanging

Description

I have a TrueNAS vm which I was using to observe middlewared memory usage. There is no load on the NAS, but snapshot & replication tasks are set up to run each minute. A few datasets are created for this purpose, and the replication destination is the NAS itself (i.e. localhost). This eliminates any networking issues. This was running well, until I’ve upgraded the NAS to 13.3-BETA. Since then I periodically observe replication task hanging. Fortunately, snapshots are taken, howewer, replication is blocked, and also, snapshot retention does not take effect. ps of such a case:

There is no progress. As there is no load the vm, the snapshots effectively are empty,

It seems that replication command is constructed something like zfs send | ssh ... | zfs receive.

procstat for the sending zfs process is:

The next command seems to be simply waiting for input:

There was no such issue with TrueNAS 13.0-U6.

Problem/Justification

None

Impact

None

Activity

Show:

Bug Clerk July 11, 2024 at 11:55 AM

This issue has now been closed. Comments made after this point may not be viewed by the TrueNAS Teams. Please open a new issue if you have found a problem or need to re-engage with the TrueNAS Engineering Teams.

Bug Clerk July 11, 2024 at 11:55 AM

Richard, thanks for the ticket. Unfortunately, this isn’t something we’re going to investigate on CORE. While I know you probably don’t run SCALE, we’d like to know if this problem exists on SCALE. If it does, please open a fresh ticket with the details and we’ll investigate.

Michelle Johnson June 10, 2024 at 12:47 PM

Thank you for your report, !

This issue ticket is now in the queue for review. An Engineering representative will update with further details or questions in the near future.

Bug Clerk June 8, 2024 at 4:53 AM

Thank you for submitting this TrueNAS Bug Report! So that we can quickly investigate your issue, please attach a Debug file and any other information related to this issue through our secure and private upload service below. Debug files can be generated in the UI by navigating to System -> Advanced -> Save Debug.

https://ixsystems.atlassian.net/servicedesk/customer/portal/15/group/37/create/153