Resource deadlock avoided
Description
Problem/Justification
Impact
SmartDraw Connector
Katalon Manual Tests (BETA)
Activity
Matt Kessler October 29, 2020 at 4:48 PM
timeout due to corona…
Moving nextcloud to a new jail is a lot of work, plus there are many clients connecting to this nextcloud server.
Going back and forth, with client data being uploaded is also hard, as NC is file and database driven.
Cloning an old snapshot and test restarting the jail there, wouldn't be helpful?
Waqar Ahmed October 18, 2020 at 1:52 PM
Feedback timeout
Waqar Ahmed October 6, 2020 at 12:52 PM
ping @Matt Kessler
Waqar Ahmed September 11, 2020 at 9:42 PM
@Matt Kessler unfortunately I cannot say that for sure. For the error log, you can grep in the debug to find the location.
It is possible it might have happened after the update, however the error message is a best guess for now and it's not certain that bad perms are really the cause. Why I would recommend going with a new jail is that I have not been able to reproduce and have not been able to find circular mounts or any process using those paths which might have been a good explanation for the problem at hand and with this error message, i think it would be best if we start this from scratch in a controlled environment ?
Matt Kessler September 11, 2020 at 9:10 PM
Thank you Waqar
Where did you find these issues in the logs, please.
There was a bit of a rocky iocage update, I remember.
But I can not recall setting any permissions if this is what your are saying!?
Looking at the snapshot time and the files in question, I'd say this had to do with the update, right!?
Sea3/iocage/jails/nchub/root ioc_update_11.3-RELEASE-p6
Sea3/iocage/jails/nchub/root ioc_update_11.3-RELEASE-p6_2020-07-17_20-25-03
root@freenas:/mnt/Sea3/iocage/jails/nchub/root/usr/lib# ls -halt
total 56518
drwxr-xr-x 9 root wheel 700B Jul 17 20:25 .
-r--r--r-- 1 root wheel 21K Jul 17 20:25 libusbhid_p.a
-r--r--r-- 1 root wheel 20K Jul 17 20:25 libusbhid.a
-r--r--r-- 1 root wheel 1.8M Jul 17 20:25 libprivateunbound_p.a
-r--r--r-- 1 root wheel 1.7M Jul 17 20:25 libprivateunbound.a
-r--r--r-- 1 root wheel 64K Jul 17 20:25 libalias_p.a
-r--r--r-- 1 root wheel 11K Jul 17 20:25 libalias_ftp_p.a
-r--r--r-- 1 root wheel 10K Jul 17 20:25 libalias_ftp.a
-r--r--r-- 1 root wheel 60K Jul 17 20:25 libalias.a
-r--r--r-- 1 root wheel 16K Jul 17 20:25 libusbhid.so.4
-r--r--r-- 1 root wheel 1.0M Jul 17 20:25 libprivateunbound.so.5
-r--r--r-- 1 root wheel 111K Mar 14 12:12 libfetch_p.a
-r--r--r-- 1 root wheel 108K Mar 14 12:12 libfetch.a
-r--r--r-- 1 root wheel 13M Mar 14 12:12 libc_pic.a
-r--r--r-- 1 root wheel 4.2M Mar 14 12:12 libc_p.a
-r--r--r-- 1 root wheel 4.0M Mar 14 12:12 libc.a
-r--r--r-- 1 root wheel 91K Mar 14 12:12 libbz2_p.a
-r--r--r-- 1 root wheel 89K Mar 14 12:12 libbz2.a
-r--r--r-- 1 root wheel 119K Mar 14 12:12 libbsnmp_p.a
-r--r--r-- 1 root wheel 116K Mar 14 12:12 libbsnmp.a
-r--r--r-- 1 root wheel 74K Mar 14 12:12 libfetch.so.6
-r--r--r-- 1 root wheel 76K Mar 14 12:12 libbz2.so.4
-r--r--r-- 1 root wheel 77K Mar 14 12:12 libbsnmp.so.6
lrwxr-xr-x 1 root wheel 12B Mar 14 12:11 libcurses.a -> libncurses.a
lrwxr-xr-x 1 root wheel 15B Mar 14 12:11 pam_permit.so -> pam_permit.so.6
lrwxr-xr-x 1 root wheel 15B Mar 14 12:11 libarchive.so -> libarchive.so.6
lrwxr-xr-x 1 root wheel 22B Mar 14 12:11 libjail.so -> ../../lib/libjail.so.1
lrwxr-xr-x 1 root wheel 25B Mar 14 12:11 libncurses.so -> ../../lib/libncurses.so.8
lrwxr-xr-x 1 root wheel 23B Mar 14 12:11 libgcc_s.so -> ../../lib/libgcc_s.so.1
lrwxr-xr-x 1 root wheel 20B Mar 14 12:11 libxo.so -> ../../lib/libxo.so.0
lrwxr-xr-x 1 root wheel 16B Mar 14 12:11 pam_lastlog.so -> pam_lastlog.so.6
lrwxr-xr-x 1 root wheel 17B Mar 14 12:11 libkadm5srv.so -> libkadm5srv.so.11
lrwxr-xr-x 1 root wheel 21B Mar 14 12:11 libctf.so -> ../../lib/libctf.so.2
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libefivar.so -> libefivar.so.1
lrwxr-xr-x 1 root wheel 12B Mar 14 12:11 pam_ksu.so -> pam_ksu.so.6
lrwxr-xr-x 1 root wheel 17B Mar 14 12:11 libibnetdisc.so -> libibnetdisc.so.5
lrwxr-xr-x 1 root wheel 24B Mar 14 12:11 libpjdlog.so -> ../../lib/libpjdlog.so.0
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libibumad.so -> libibumad.so.1
lrwxr-xr-x 1 root wheel 17B Mar 14 12:11 pam_ftpusers.so -> pam_ftpusers.so.6
lrwxr-xr-x 1 root wheel 13B Mar 14 12:11 snmp_atm.so -> snmp_atm.so.6
lrwxr-xr-x 1 root wheel 11B Mar 14 12:11 libdpv.so -> libdpv.so.1
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libtermlibw.so -> libncursesw.so
lrwxr-xr-x 1 root wheel 23B Mar 14 12:11 lib80211.so -> ../../lib/lib80211.so.1
lrwxr-xr-x 1 root wheel 24B Mar 14 12:11 libbsdxml.so -> ../../lib/libbsdxml.so.4
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libfigpar.so -> libfigpar.so.0
lrwxr-xr-x 1 root wheel 24B Mar 14 12:11 libkiconv.so -> ../../lib/libkiconv.so.4
lrwxr-xr-x 1 root wheel 13B Mar 14 12:11 libasn1.so -> libasn1.so.11
lrwxr-xr-x 1 root wheel 22B Mar 14 12:11 libpcap.so -> ../../lib/libpcap.so.8
lrwxr-xr-x 1 root wheel 17B Mar 14 12:11 libbluetooth.so -> libbluetooth.so.4
lrwxr-xr-x 1 root wheel 24B Mar 14 12:11 libcasper.so -> ../../lib/libcasper.so.0
lrwxr-xr-x 1 root wheel 21B Mar 14 12:11 libzfs.so -> ../../lib/libzfs.so.2
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libugidfw.so -> libugidfw.so.5
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 librpcsvc.so -> librpcsvc.so.5
lrwxr-xr-x 1 root wheel 14B Mar 14 12:11 libtermcap_p.a -> libncurses_p.a
lrwxr-xr-x 1 root wheel 16B Mar 14 12:11 pam_tacplus.so -> pam_tacplus.so.6
lrwxr-xr-x 1 root wheel 11B Mar 14 12:11 libpam.so -> libpam.so.6
…
CUT, due to: ErrorThe entered text is too long. It exceeds the allowed limit of 32767 characters.
When restarting or stop/starting a this jail from the GUI I'm getting:
Error: [EFAULT] mount_nullfs: /mnt/Sea3/iocage/jails/nchub/root/mnt/nextcloud: Resource deadlock avoided
jail: ioc-nchub: /sbin/mount -t nullfs -o rw /mnt/Westeros2/nextcloud /mnt/Sea3/iocage/jails/nchub/root/mnt/nextcloud: failed
Same on CLI:
root@freenas:~ # iocage start nchub
No default gateway found for ipv6.
Starting nchub
+ Start FAILED
mount_nullfs: /mnt/Sea3/iocage/jails/nchub/root/mnt/nextcloud: Resource deadlock avoided
jail: ioc-nchub: /sbin/mount -t nullfs -o rw /mnt/Westeros2/nextcloud /mnt/Sea3/iocage/jails/nchub/root/mnt/nextcloud: failed
On reboot things are fine.
This problem did not exist before 11.3-U4.1