error open-webui cuda support

Description

error when i try to use cuda support:
ERROR [open_webui.routers.ollama] Connection error: Cannot connect to host localhost:11434 ssl:default [Connect call failed ('127.0.0.1', 11434)]

Session ID: bb0a9a07-e2cb-6c22-df52-cbe205254ac0

Problem/Justification

None

Impact

None

Attachments

2

Activity

Show:

Aurelio Osorio January 2, 2025 at 9:08 PM

Fresh install, same problem.

i check the information but nothing like this.
if i use a fresh install with this selector:

But if use this:

Dont work, always trying a fresh install of WebUI

the standard image with external ollama server works correctly too.

 

Uvicorn running on http://0.0.0.0:31028 (Press CTRL+C to quit)

2025-01-02 20:57:50.094758+00:00INFO: ('187.199.46.25', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket" [accepted]

2025-01-02 20:57:50.095242+00:00INFO: connection open

2025-01-02 20:59:17.136018+00:00INFO: 187.199.46.25:0 - "GET /admin/settings HTTP/1.1" 200 OK

2025-01-02 20:59:17.144947+00:00INFO: connection closed

2025-01-02 20:59:17.205998+00:00INFO: 187.199.46.25:0 - "GET /api/config HTTP/1.1" 200 OK

2025-01-02 20:59:17.217540+00:00INFO: 187.199.46.25:0 - "GET /api/v1/auths/ HTTP/1.1" 401 Unauthorized

2025-01-02 20:59:17.228066+00:00INFO: ('187.199.46.25', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket" [accepted]

2025-01-02 20:59:17.228268+00:00INFO: connection open

2025-01-02 20:59:17.229813+00:00INFO: 187.199.46.25:0 - "GET /_app/immutable/nodes/33.BdT1jcW6.js HTTP/1.1" 304 Not Modified

2025-01-02 20:59:17.248883+00:00INFO: 187.199.46.25:0 - "GET /assets/images/galaxy.jpg HTTP/1.1" 200 OK

2025-01-02 20:59:17.249286+00:00INFO: 187.199.46.25:0 - "GET /assets/images/adam.jpg HTTP/1.1" 200 OK

2025-01-02 20:59:17.252470+00:00INFO: 187.199.46.25:0 - "GET /assets/images/space.jpg HTTP/1.1" 200 OK

2025-01-02 20:59:17.253505+00:00INFO: 187.199.46.25:0 - "GET /assets/images/earth.jpg HTTP/1.1" 200 OK

2025-01-02 20:59:17.277184+00:00INFO: 187.199.46.25:0 - "GET /assets/fonts/InstrumentSerif-Regular.ttf HTTP/1.1" 200 OK

2025-01-02 20:59:22.934063+00:00INFO [open_webui.env] Saving 'ENABLE_SIGNUP' to the database

2025-01-02 20:59:23.196455+00:00INFO [open_webui.models.auths] insert_new_auth

2025-01-02 20:59:23.284014+00:00INFO: 187.199.46.25:0 - "POST /api/v1/auths/signup HTTP/1.1" 200 OK

2025-01-02 20:59:23.296657+00:00INFO: 187.199.46.25:0 - "GET /api/config HTTP/1.1" 200 OK

2025-01-02 20:59:23.344731+00:00INFO: 187.199.46.25:0 - "GET /api/changelog HTTP/1.1" 200 OK

2025-01-02 20:59:23.361480+00:00INFO: 187.199.46.25:0 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK

2025-01-02 20:59:23.371554+00:00INFO [open_webui.routers.openai] get_all_models()

2025-01-02 20:59:23.654793+00:00INFO [open_webui.routers.ollama] get_all_models()

2025-01-02 20:59:23.856081+00:00ERROR [open_webui.routers.ollama] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known]

2025-01-02 20:59:23.859879+00:00INFO: 187.199.46.25:0 - "GET /api/models HTTP/1.1" 200 OK

2025-01-02 20:59:23.871074+00:00INFO: 187.199.46.25:0 - "GET /api/v1/configs/banners HTTP/1.1" 200 OK

2025-01-02 20:59:23.882401+00:00INFO: 187.199.46.25:0 - "GET /api/v1/tools/ HTTP/1.1" 200 OK

2025-01-02 20:59:23.937505+00:00INFO: 187.199.46.25:0 - "GET /api/v1/channels/ HTTP/1.1" 200 OK

2025-01-02 20:59:23.988210+00:00INFO: 187.199.46.25:0 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK

2025-01-02 20:59:24.041221+00:00INFO: 187.199.46.25:0 - "GET /api/v1/chats/all/tags HTTP/1.1" 200 OK

2025-01-02 20:59:24.053946+00:00INFO: 187.199.46.25:0 - "GET /api/v1/chats/pinned HTTP/1.1" 200 OK

2025-01-02 20:59:24.070562+00:00INFO: 187.199.46.25:0 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK

2025-01-02 20:59:24.071560+00:00INFO: 187.199.46.25:0 - "GET /api/v1/folders/ HTTP/1.1" 200 OK

2025-01-02 20:59:24.099070+00:00ERROR [open_webui.routers.ollama] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known]

Bug Clerk January 2, 2025 at 12:14 PM

This issue has now been closed. Comments made after this point may not be viewed by the TrueNAS Teams. Please open a new issue if you have found a problem or need to re-engage with the TrueNAS Engineering Teams.

Stavros January 2, 2025 at 12:14 PM

Hello, Looks like an upstream issue (or expected behavior, depending on what you do when you get the error).




Maybe you can check with them to see if there is something specific to what you are doing.
Thanks

Bonnie Follweiler December 30, 2024 at 1:48 PM

Good Morning .

I have moved this ticket into our queue to review now.
An engineering representative will update with any further questions or details in the near future.

Aurelio Osorio December 27, 2024 at 4:01 PM

file uploaded

Third Party to Resolve

Details

Assignee

Reporter

Labels

Time remaining

0m

Components

Fix versions

Priority

Katalon Platform

Created December 27, 2024 at 3:59 PM
Updated January 2, 2025 at 9:08 PM
Resolved January 2, 2025 at 12:14 PM