TrueNAS 13 crash: bhyve CD-image in prior use, when loaded by VM will hard-crash TrueNAS (13.0 RC1)
Description
Problem/Justification
Impact
Activity
William Gryzbowski May 18, 2022 at 7:26 PM
Not much we can do ourselves about it. Seems a pretty strange edge case.
Waiting an upstream fix.
iX-Tony April 29, 2022 at 8:52 PM
Thanks for your submission! This is in our queue to review now. An engineering representative will update with any further questions or details in the near future.
dan L April 29, 2022 at 6:43 AM
I'm not sure how much of this debug dump is relevant as I've managed to crash my virtual machines quite a few times since the bug post(s) & am unsure if the relevant information is still in the logs.
Feel free to contact me for more info.
Bonnie Follweiler April 28, 2022 at 3:33 PM
Thank you for the report, .
Can you please attach a debug file to the "Private Attachments" section of this ticket?
To generate a debug file on TrueNAS CORE, log in to the TrueNAS web interface, go to System > Advanced, then click Save Debug and wait for the file to download to your local system.
All references to TrueNAS below were tested on TrueNAS 13.0 RC1.
I believe this should also be applicable to TrueNAS 12.1 (202103300439) and 12.0.x
Summary
Attempting to boot a bhyve VM with an assigned image file, which happens to be in use (written to) will hard crash TrueNAS.
Web interface will stop functioning, file sharing services will stop functioning.
Still able to power off via the power button for a safe shutdown at least.
Unable to confirm whether the command-line interface was responsive after the crash.
To replicate this bug:
Create a VM, with everything except an ISO assigned to the CD drive.
Set the CD drive as the boot device. Do not power on the VM yet.
Copy a large ISO file onto the hosting TrueNAS (13.0 RC1) instance, one which will take longer to finish copying than this the following steps once the copy starts.
Example: A 4GB image over a 1 Gigabit ethernet connection.
As soon as the transfer has started, find and assign the ISO on the TrueNAS server itself as the disk to use for the CD drive.
Start the VM, making sure that the interface is accessible to boot from the CD ("press any key to continue" or something like that). I used the built-in VNC web interface.
Attempt to boot from the image while the file is still being written. The server will crash at this step.
Try to access the TrueNAS server. Web-interface login via IP should no longer work, file-sharing services should no longer work.
Apologies in advance if my bug report wasn't done correctly. This is my first bug report and post here.