App disappeared TrueNAS Scale 24.10.2

Description

I was running TureNAS Scale 24.10.0.2 in a VM. It was a fresh installation, not upgraded from older version. I have around 7 apps including some community apps such as NPM, NextCloud, Minio, Redis, and some custom apps including crowdsec, fail2ban, vault. It has been working nicely since December.

Yesterday, I upgraded all the apps to their latest. Then, I tried to install the Ollama community app, and it failed complaining about out of space in /mnt/.ix-apps volume. From them on, all installed apps disappeared. I tried

cleaning up unused docker images
rebooting; the apps never showed up, but the containers did get started after reboot.
upgrading from 24.10.0.2 to 24.10.2 and rollback
timedatectl shows proper RTC time
there is no nvidia card in the VM

Please let me know what I need to provide for further troubleshooting

Problem/Justification

None

Impact

None

Attachments

Activity

Show:

Bug Clerk 2 days ago

This issue has now been closed. Comments made after this point may not be viewed by the TrueNAS Teams. Please open a new issue if you have found a problem or need to re-engage with the TrueNAS Engineering Teams.

Bug Clerk 2 days ago

Unfortunately out of space is a worst case scenario and we cannot predict it. Although there may be a few things we could potentially do to improve its an edge case. For you to get back to a working state we suggest you to Unset the pool for Apps, delete the leftover datasets (make sure you dont have valuable data in them first) and configure it again.

Bug Clerk 3 days ago

Thanks for your submission! This is in our queue to review now. An engineering representative will update with any further questions or details in the near future.

Chuck Huang 4 days ago

File uploaded. Also a screenshot showing all the containers. Let me know if you need anything else.

Thanks

Bug Clerk 4 days ago

Thank you for submitting this TrueNAS Bug Report! So that we can quickly investigate your issue, please attach a Debug file and any other information related to this issue through our secure and private upload service below. Debug files can be generated in the UI by navigating to System -> Advanced -> Save Debug.

https://ixsystems.atlassian.net/servicedesk/customer/portal/15/group/37/create/153