Apps not starting on reboot

Description

After rebooting the machine running truenas SCALE no apps start and the apps screen show the message " ". Running midclt call service.start kubernetes returns this error:

[EFAULT] Command umount -f -R /var/lib/kubelet failed (code 32):
umount: /var/lib/kubelet: target is busy.
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 175, in call_method
result = await self.middleware._call(message['method'], serviceobj, methodobj, params, app=self,
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1275, in _call
return await methodobj(*prepared_call.args)
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1261, in nf
return await func(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1129, in nf
res = await f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 135, in start
await service_object.before_start()
File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/kubernetes.py", line 50, in before_start
await self.mount_kubelet_dataset()
File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/kubernetes.py", line 26, in mount_kubelet_dataset
await self.unmount_kubelet_dataset()
File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/kubernetes.py", line 22, in unmount_kubelet_dataset
await run('umount', '-f', '-R', self.kubelet_mountpoint, check=True)
File "/usr/lib/python3/dist-packages/middlewared/utils/_init_.py", line 64, in run
cp.check_returncode()
File "/usr/lib/python3.9/subprocess.py", line 460, in check_returncode
raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '('umount', '-f', '-R', '/var/lib/kubelet')' returned non-zero exit status 32.

Problem/Justification

None

Impact

None

duplicates

Activity

Show:

Muhammad Rehan March 19, 2022 at 12:43 PM

it is indeed a weird issue..From code wise it seems impossible to get into that state but it is happening so not so impossible..Anyways,it will be looked at in the related ticket

Bernat Villà Martí March 19, 2022 at 11:52 AM

I can reproduce it after reboot but not reliably. Sometimes it happends, sometimes not and apps start succesfully. 

Muhammad Rehan March 19, 2022 at 11:43 AM

This is the same issue as in the related ticket..

We have one iptable rule missing which is why this happens.

can you please confirm if you are ale to reproduce this after a reboot..?

Michelle Johnson March 16, 2022 at 12:30 PM

Thank you for your report,  

This issue ticket is now in the queue for review. An engineering representative will update with further questions or details in the near future.

Bernat Villà Martí March 15, 2022 at 10:59 PM

EDIT: The message the app page shows is "No Applications Installed"

Duplicate
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Impact

Medium

Time remaining

0m

Fix versions

Affects versions

Priority

Katalon Platform

Created March 15, 2022 at 10:57 PM
Updated July 6, 2022 at 8:58 PM
Resolved March 19, 2022 at 11:43 AM