"Initializing Apps Service" runs forever after restart

Description

Dragonfish-24.04.0

I've ran into this issue multiple times now.

Apps running fine until I decide to restart the server. Only solution I've found so far is completely deleting the dataset that the apps are stored on and starting fresh.

I have noticed that the Kubelet will not ready up due to some cni plugin failing to initialize.

Some investigation lead to me discovering that the `/etc/cni/net.d` is empty.

So I added this config file:
nano /etc/cni/net.d/10-bridge.conf
```
{
"cniVersion": "0.3.1",
"name": "mynet",
"type": "bridge",
"bridge": "cni0",
"isGateway": true,
"ipMasq": true,
"ipam": {
"type": "host-local",
"ranges": [
[
{
"subnet": "10.244.0.0/16"
}
]
],
"routes": [
{ "dst": "0.0.0.0/0" }
]
}
}

```

This resolved the cni error and the kubelet became ready however when attempting to start an app there were taints applied:

```
Taints: ix-svc-stop:NoExecute
node.kubernetes.io/not-ready:NoSchedule
```

Removing these taints solved the taint related error however then the app I was attempting to start ran on a boot-loop where it would fail a liveness probe. I thought maybe this was an issue with the probe delay so I extended that however this did not solve the issue.

Host ID: 2ef5f5626e0629f660d2a0e9292b0dc966cde6aaeae45c49313c503c24dc0ca3

Session ID: dd49e122-7c5d-088c-da26-75368f0e83b7

Problem/Justification

None

Impact

None

Activity

Show:

Bug Clerk May 28, 2024 at 3:25 PM

This issue has now been closed. Comments made after this point may not be viewed by the TrueNAS Teams. Please open a new issue if you have found a problem or need to re-engage with the TrueNAS Engineering Teams.

Bug Clerk May 28, 2024 at 3:24 PM

Thank you for reporting this issue! This has already been reported (see the "Duplicate" ticket linked above), so this issue is being closed to focus effort in the existing ticket.

Daniel Pizappi May 23, 2024 at 2:16 PM

Thanks for your submission! This is in our queue to review now. An engineering representative will update with any further questions or details in the near future.

Bug Clerk May 23, 2024 at 5:33 AM

Thank you for submitting this TrueNAS Bug Report! So that we can quickly investigate your issue, please attach a Debug file and any other information related to this issue through our secure and private upload service below. Debug files can be generated in the UI by navigating to System -> Advanced -> Save Debug.

https://ixsystems.atlassian.net/servicedesk/customer/portal/15/group/37/create/153

Not Applicable
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Components

Fix versions

Priority

More fields

Katalon Platform

Created May 23, 2024 at 5:33 AM
Updated May 28, 2024 at 4:11 PM
Resolved May 28, 2024 at 3:24 PM