c_transformers is broken

Expected Behavior
Please describe the behavior you are expecting.
Install LoLLMS, use GGML model, It just works
Current Behavior
Please describe the behavior you are currently experiencing.
Install LoLLMS, use c_transformers for GGML, install GGML, crash app.py
Steps to Reproduce
Please provide detailed steps to reproduce the issue.

Step 1 run webui.sh from arbitrary user folder on clean Ubuntu Server 22.04.2 minimal install +build-essential
Step 2 install c_transformers and any model (tested so far) via web interface/zoo or terminal
Step 3 crash app.py at line 144

Possible Solution
If you have any suggestions on how to fix the issue, please describe them here.
Context
Please provide any additional context about the issue.
Tested on clean Ubuntu server vm no gpu and Manjaro latest (modified  webui.sh to accept Python 3.11) with RTX 2060. Localhost was replaced with local IP in local_config.yaml to allow remote access to headless system for vm.
Screenshots
If applicable, add screenshots to help explain the issue.
corey@llm:~/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH     .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH.     ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.##  HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_*,*,*,*,*,*,*,*,***,*,**#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.*,,***,***,***,***,***,***,*******HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,***,***,***,***,***,***,***,***,***,***_HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,***,***,***,***,***,***,***,***,***,***,***,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*#HHHHHHHHHHHHHHHH
HHHHHHH,,,**,_H*,***,***,***,,,*,***,***,***,**,,,**,***,***,***H,,*,***HHHHHHHH
HHHHHH.*,,,*,,,,,*,*,*,***#HHHHH.,,*,*,*,*,**_HHHHH.,*,*,*,*,*,*,*,*****HHHHHHHH
HHHHHH.*,***,*,*,***,***,.HHHHHHH_**,***,****HHHHHHH.***,***,***,*******HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,***HHHHHHHH
HHHHHH.,,,,,,_H,,,**,***,***,,,*,***,***,***,**,,,,*,***,***,***H***,***HHHHHHHH
HHHHHHH.,,,,*.H,,,,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,***H*,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH*,***,***,**,,***,***,***,***,***,***,***,***,**.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,*,,#H#,,,,,*,,,*,,,,,,,,*#H*,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,*,***,***,**_.HHHHHHHHHHHHH#*,,,*,***,***,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH**,***,***,***,***,***,***,***,***,***,***,*.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH**,***,***,*******_..HHHHHHHHH.#_*,*,,,***,***HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH*,*,*,******#HHHHHHHHHHHHHHHHHHHHHHHHHHHH._**,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,*,***.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.*#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,*.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3.10...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.26)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.215)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (3.0.10)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.33.3)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.6.3)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->lollms->-r requirements.txt (line 10)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->lollms->-r requirements.txt (line 10)) (1.16.0)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.

Current binding: c_transformers
Current model: None
Menu:
1 - wizard-falcon-7b.ggmlv3.q5_0.bin
2 - wizard-falcon40b.ggmlv3.q6_K.bin
3 - Install model
4 - Change binding
5 - Back
Enter your choice: 5
Couldn't build model. Try to reinstall binding c_transformers
 ╔══════════════════════════════════════════════════╗
 ║           Building mounted Personalities         ║
 ╚══════════════════════════════════════════════════╝
* english/generic/lollms
selected : 0
 ╔══════════════════════════════════════════════════╗
 ║                      Done                        ║
 ╚══════════════════════════════════════════════════╝
Checking discussions database... ok
Your personal data is stored here :/home/corey/Documents/lollms
debug mode:false
Please open your browser and go to http://<IP_ADDRESS>:9600 to view the ui
Client yzykF6SKfBInYTB9AAAB connected
Install model triggered
Model install requested
Model path : https://huggingface.co/TheBloke/orca_mini_3B-GGML/resolve/main/orca-mini-3b.ggmlv3.q4_0.bin
100%|██████████████████████████████████████| 1.93G/1.93G [02:58<00:00, 10.8MB/s]
File downloaded successfully
Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/socketio/server.py", line 733, in _handle_event_internal
    r = server._trigger_event(data[0], namespace, sid, *data[1:])
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/socketio/server.py", line 758, in _trigger_event
    return self.handlers[namespace][event](*args)
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/flask_socketio/__init__.py", line 282, in _handler
    return self._handle_event(handler, message, namespace, sid,
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/flask_socketio/__init__.py", line 828, in _handle_event
    ret = handler(*args)
  File "/home/corey/webui/lollms-webui/api/__init__.py", line 168, in cancel_install
    model_name = data["model_name"]
KeyError: 'model_name'
2023-06-25T20:37:17Z <Thread at 0x7f5e31992660: <bound method Server._handle_event_internal of <socketio.server.Server object at 0x7f5e31ac25c0>>(<socketio.server.Server object at 0x7f5e31ac25c0>, 'yzykF6SKfBInYTB9AAAB', 'k2DKRbBIWYxfpHnAAAAA', ['cancel_install', {}], '/', None)> failed with KeyError

./webui.sh: line 144: 17897 Illegal instruction     (core dumped) python app.py

Hi ParisNeo, thanks for looking into this. The app.py line 144 crash when installing a model for c_transformers is still repeatable via the terminal or web UI, with or without cancelling the install.
Also, commit c56bf45 added a requirement for the python3-tk or python3.10-tk deb package (maybe equivalent for windows, idk) in app.py, line 44.
Is the line 144 crash due to 0 vram usage by chance? This machine is all (dual xeon, server) CPU.
There is one error in the output that remains constant, but I don't THINK it is related. CUDA isn't being used here, only CPU.:
`Collecting lit (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/lit-15.0.7.tar.gz (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.3/132.3 kB 13.3 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [3 lines of output]
Looking in indexes: https://download.pytorch.org/whl/cu117
ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=40.8.0
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Couldn't find Cuda build tools on your PC. Reverting to CPU.`
I've tried many ways, but here's a clean run output with the same result every time (after installing tk)# comments for steps:
`corey@llm:~/webui$ rm -rf ~/Documents/lollms/!("models")#deleted all user files outside of models
corey@llm:~/webui$ rm -rf *#deleted all lolms buid files+webui.sh
corey@llm:~/webui$ wget https://github.com/ParisNeo/lollms-webui/raw/main/webui.sh
--2023-06-29 00:57:03--  https://github.com/ParisNeo/lollms-webui/raw/main/webui.sh
Resolving github.com (github.com)... <IP_ADDRESS>
Connecting to github.com (github.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/ParisNeo/lollms-webui/main/webui.sh [following]
--2023-06-29 00:57:03--  https://raw.githubusercontent.com/ParisNeo/lollms-webui/main/webui.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5923 (5.8K) [text/plain]
Saving to: ‘webui.sh’
webui.sh                                        100%[=====================================================================================================>]   5.78K  --.-KB/s    in 0s
2023-06-29 00:57:03 (16.3 MB/s) - ‘webui.sh’ saved [5923/5923]
corey@llm:~/webui$ chmod +x webui.sh#made webui.sh executable
corey@llm:~/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH     .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH.     ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.##  HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Cloning repository...
./webui.sh: line 66: rem: command not found
Cloning into './lollms-webui'...
remote: Enumerating objects: 7023, done.
remote: Counting objects: 100% (7023/7023), done.
remote: Compressing objects: 100% (1968/1968), done.
remote: Total 7023 (delta 4858), reused 7006 (delta 4853), pack-reused 0
Receiving objects: 100% (7023/7023), 14.45 MiB | 9.75 MiB/s, done.
Resolving deltas: 100% (4858/4858), done.
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (22.0.2)
Collecting pip
Using cached pip-23.1.2-py3-none-any.whl (2.1 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 22.0.2
Uninstalling pip-22.0.2:
Successfully uninstalled pip-22.0.2
Successfully installed pip-23.1.2
Collecting tqdm (from -r requirements.txt (line 1))
Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting psutil (from -r requirements.txt (line 2))
Using cached psutil-5.9.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
Collecting flask (from -r requirements.txt (line 3))
Using cached Flask-2.3.2-py3-none-any.whl (96 kB)
Collecting flask_socketio (from -r requirements.txt (line 4))
Using cached Flask_SocketIO-5.3.4-py3-none-any.whl (17 kB)
Collecting pytest (from -r requirements.txt (line 5))
Using cached pytest-7.4.0-py3-none-any.whl (323 kB)
Collecting pyyaml (from -r requirements.txt (line 6))
Using cached PyYAML-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (682 kB)
Collecting markdown (from -r requirements.txt (line 7))
Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting gevent (from -r requirements.txt (line 8))
Using cached gevent-22.10.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.4 MB)
Collecting gevent-websocket (from -r requirements.txt (line 9))
Using cached gevent_websocket-0.10.1-py3-none-any.whl (22 kB)
Collecting lollms (from -r requirements.txt (line 10))
Using cached lollms-2.0.28-py3-none-any.whl (518 kB)
Collecting langchain (from -r requirements.txt (line 11))
Using cached langchain-0.0.218-py3-none-any.whl (1.2 MB)
Collecting requests (from -r requirements.txt (line 12))
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Collecting eventlet (from -r requirements.txt (line 13))
Using cached eventlet-0.33.3-py2.py3-none-any.whl (226 kB)
Collecting websocket-client (from -r requirements.txt (line 14))
Using cached websocket_client-1.6.1-py3-none-any.whl (56 kB)
Collecting Werkzeug>=2.3.3 (from flask->-r requirements.txt (line 3))
Using cached Werkzeug-2.3.6-py3-none-any.whl (242 kB)
Collecting Jinja2>=3.1.2 (from flask->-r requirements.txt (line 3))
Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting itsdangerous>=2.1.2 (from flask->-r requirements.txt (line 3))
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from flask->-r requirements.txt (line 3))
Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting blinker>=1.6.2 (from flask->-r requirements.txt (line 3))
Using cached blinker-1.6.2-py3-none-any.whl (13 kB)
Collecting python-socketio>=5.0.2 (from flask_socketio->-r requirements.txt (line 4))
Using cached python_socketio-5.8.0-py3-none-any.whl (56 kB)
Collecting iniconfig (from pytest->-r requirements.txt (line 5))
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting packaging (from pytest->-r requirements.txt (line 5))
Using cached packaging-23.1-py3-none-any.whl (48 kB)
Collecting pluggy<2.0,>=0.12 (from pytest->-r requirements.txt (line 5))
Using cached pluggy-1.2.0-py3-none-any.whl (17 kB)
Collecting exceptiongroup>=1.0.0rc8 (from pytest->-r requirements.txt (line 5))
Using cached exceptiongroup-1.1.1-py3-none-any.whl (14 kB)
Collecting tomli>=1.0.0 (from pytest->-r requirements.txt (line 5))
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting zope.event (from gevent->-r requirements.txt (line 8))
Using cached zope.event-5.0-py3-none-any.whl (6.8 kB)
Collecting zope.interface (from gevent->-r requirements.txt (line 8))
Using cached zope.interface-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (246 kB)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Collecting greenlet>=2.0.0 (from gevent->-r requirements.txt (line 8))
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting Pillow (from lollms->-r requirements.txt (line 10))
Using cached Pillow-9.5.0-cp310-cp310-manylinux_2_28_x86_64.whl (3.4 MB)
Collecting flask-cors (from lollms->-r requirements.txt (line 10))
Using cached Flask_Cors-4.0.0-py2.py3-none-any.whl (14 kB)
Collecting simple-websocket (from lollms->-r requirements.txt (line 10))
Using cached simple_websocket-0.10.1-py3-none-any.whl (7.5 kB)
Collecting SQLAlchemy<3,>=1.4 (from langchain->-r requirements.txt (line 11))
Using cached SQLAlchemy-2.0.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
Collecting aiohttp<4.0.0,>=3.8.3 (from langchain->-r requirements.txt (line 11))
Using cached aiohttp-3.8.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)
Collecting async-timeout<5.0.0,>=4.0.0 (from langchain->-r requirements.txt (line 11))
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting dataclasses-json<0.6.0,>=0.5.7 (from langchain->-r requirements.txt (line 11))
Using cached dataclasses_json-0.5.8-py3-none-any.whl (26 kB)
Collecting langchainplus-sdk>=0.0.17 (from langchain->-r requirements.txt (line 11))
Using cached langchainplus_sdk-0.0.17-py3-none-any.whl (25 kB)
Collecting numexpr<3.0.0,>=2.8.4 (from langchain->-r requirements.txt (line 11))
Using cached numexpr-2.8.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (381 kB)
Collecting numpy<2,>=1 (from langchain->-r requirements.txt (line 11))
Using cached numpy-1.25.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.6 MB)
Collecting openapi-schema-pydantic<2.0,>=1.2 (from langchain->-r requirements.txt (line 11))
Using cached openapi_schema_pydantic-1.2.4-py3-none-any.whl (90 kB)
Collecting pydantic<2,>=1 (from langchain->-r requirements.txt (line 11))
Using cached pydantic-1.10.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Collecting tenacity<9.0.0,>=8.1.0 (from langchain->-r requirements.txt (line 11))
Using cached tenacity-8.2.2-py3-none-any.whl (24 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 12))
Using cached charset_normalizer-3.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 12))
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 12))
Using cached urllib3-2.0.3-py3-none-any.whl (123 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 12))
Using cached certifi-2023.5.7-py3-none-any.whl (156 kB)
Collecting dnspython>=1.15.0 (from eventlet->-r requirements.txt (line 13))
Using cached dnspython-2.3.0-py3-none-any.whl (283 kB)
Collecting six>=1.10.0 (from eventlet->-r requirements.txt (line 13))
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting attrs>=17.3.0 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached multidict-6.0.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (114 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached yarl-1.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (268 kB)
Collecting frozenlist>=1.1.1 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached frozenlist-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (149 kB)
Collecting aiosignal>=1.1.2 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting marshmallow<4.0.0,>=3.3.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached marshmallow-3.19.0-py3-none-any.whl (49 kB)
Collecting marshmallow-enum<2.0.0,>=1.5.1 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting typing-inspect>=0.4.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached typing_inspect-0.9.0-py3-none-any.whl (8.8 kB)
Collecting MarkupSafe>=2.0 (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3))
Using cached MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting typing-extensions>=4.2.0 (from pydantic<2,>=1->langchain->-r requirements.txt (line 11))
Using cached typing_extensions-4.7.0-py3-none-any.whl (33 kB)
Collecting bidict>=0.21.0 (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4))
Using cached bidict-0.22.1-py3-none-any.whl (35 kB)
Collecting python-engineio>=4.3.0 (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4))
Using cached python_engineio-4.4.1-py3-none-any.whl (53 kB)
Collecting wsproto (from simple-websocket->lollms->-r requirements.txt (line 10))
Using cached wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting mypy-extensions>=0.3.0 (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Collecting h11<1,>=0.9.0 (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10))
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Installing collected packages: zope.interface, zope.event, websocket-client, urllib3, typing-extensions, tqdm, tomli, tenacity, six, pyyaml, python-engineio, psutil, pluggy, Pillow, packaging, numpy, mypy-extensions, multidict, MarkupSafe, markdown, itsdangerous, iniconfig, idna, h11, greenlet, frozenlist, exceptiongroup, dnspython, click, charset-normalizer, certifi, blinker, bidict, attrs, async-timeout, yarl, wsproto, Werkzeug, typing-inspect, SQLAlchemy, requests, python-socketio, pytest, pydantic, numexpr, marshmallow, Jinja2, gevent, eventlet, aiosignal, simple-websocket, openapi-schema-pydantic, marshmallow-enum, langchainplus-sdk, gevent-websocket, flask, aiohttp, flask_socketio, flask-cors, dataclasses-json, lollms, langchain
Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.3 Pillow-9.5.0 SQLAlchemy-2.0.17 Werkzeug-2.3.6 aiohttp-3.8.4 aiosignal-1.3.1 async-timeout-4.0.2 attrs-23.1.0 bidict-0.22.1 blinker-1.6.2 certifi-2023.5.7 charset-normalizer-3.1.0 click-8.1.3 dataclasses-json-0.5.8 dnspython-2.3.0 eventlet-0.33.3 exceptiongroup-1.1.1 flask-2.3.2 flask-cors-4.0.0 flask_socketio-5.3.4 frozenlist-1.3.3 gevent-22.10.2 gevent-websocket-0.10.1 greenlet-2.0.2 h11-0.14.0 idna-3.4 iniconfig-2.0.0 itsdangerous-2.1.2 langchain-0.0.218 langchainplus-sdk-0.0.17 lollms-2.0.28 markdown-3.4.3 marshmallow-3.19.0 marshmallow-enum-1.5.1 multidict-6.0.4 mypy-extensions-1.0.0 numexpr-2.8.4 numpy-1.25.0 openapi-schema-pydantic-1.2.4 packaging-23.1 pluggy-1.2.0 psutil-5.9.5 pydantic-1.10.9 pytest-7.4.0 python-engineio-4.4.1 python-socketio-5.8.0 pyyaml-6.0 requests-2.31.0 simple-websocket-0.10.1 six-1.16.0 tenacity-8.2.2 tomli-2.0.1 tqdm-4.65.0 typing-extensions-4.7.0 typing-inspect-0.9.0 urllib3-2.0.3 websocket-client-1.6.1 wsproto-1.2.0 yarl-1.9.2 zope.event-5.0 zope.interface-6.0
Welcome! It seems this is your first use of the new lollms app.
To make it clear where your data are stored, we now give the user the choice where to put its data.
This allows you to mutualize models which are heavy, between multiple lollms compatible apps.
You can change this at any tome using the lollms-update_path script or by simply change the content of the global_paths_cfg.yaml file.
Please provide a folder to store your configurations files, your models and your personal data (database, custom personalities etc).
Folder path: (/home/corey/Documents/lollms):
Selected: /home/corey/Documents/lollms
No personalities found in your personal space.
Cloning the personalities zoo
Cloning into '/home/corey/Documents/lollms/personalities_zoo'...
remote: Enumerating objects: 1559, done.
remote: Counting objects: 100% (788/788), done.
remote: Compressing objects: 100% (433/433), done.
remote: Total 1559 (delta 366), reused 592 (delta 280), pack-reused 771
Receiving objects: 100% (1559/1559), 41.40 MiB | 10.41 MiB/s, done.
Resolving deltas: 100% (513/513), done.
No personalities found in your personal space.
Cloning the personalities zoo
Cloning into '/home/corey/Documents/lollms/bindings_zoo'...
remote: Enumerating objects: 571, done.
remote: Counting objects: 100% (423/423), done.
remote: Compressing objects: 100% (202/202), done.
remote: Total 571 (delta 328), reused 299 (delta 215), pack-reused 148
Receiving objects: 100% (571/571), 2.91 MiB | 7.08 MiB/s, done.
Resolving deltas: 100% (387/387), done.
Current binding: None
Menu:
1 -  Lord of LLMs Remote nodes (by ParisNeo)
2 -  gpt4all (by Nomic-ai)
3 -  Hugging Face (by Hugging face Inc)
4 -  Official llamacpp binding (by abetlen)
5 -  C Transformer (by marella)
6 -  GPT-J (by marella)
7 -  The original GPT (by Open AI)
8 -  PyLLamaCpp (by abdeladim)
9 -  GPT-J (by abdeladim)
10 -  AutoGPTQ (by PanQiWei)
11 -  This is a binding template (Not usable) (by the binding author)
12 - Back
Enter your choice: 5
You selected binding: c_transformers
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
----------------------*
Installing c_transformers
----------------------*
Checking pytorch
Looking in indexes: https://download.pytorch.org/whl/cu117
Collecting torch
Downloading https://download.pytorch.org/whl/cu117/torch-2.0.1%2Bcu117-cp310-cp310-linux_x86_64.whl (1843.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 GB 12.1 MB/s eta 0:00:00
Collecting torchvision
Downloading https://download.pytorch.org/whl/cu117/torchvision-0.15.2%2Bcu117-cp310-cp310-linux_x86_64.whl (6.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.1/6.1 MB 11.8 MB/s eta 0:00:00
Collecting torchaudio
Downloading https://download.pytorch.org/whl/cu117/torchaudio-2.0.2%2Bcu117-cp310-cp310-linux_x86_64.whl (4.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 11.7 MB/s eta 0:00:00
Collecting filelock (from torch)
Downloading https://download.pytorch.org/whl/filelock-3.9.0-py3-none-any.whl (9.7 kB)
Requirement already satisfied: typing-extensions in ./env/lib/python3.10/site-packages (from torch) (4.7.0)
Collecting sympy (from torch)
Downloading https://download.pytorch.org/whl/sympy-1.11.1-py3-none-any.whl (6.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.5/6.5 MB 11.9 MB/s eta 0:00:00
Collecting networkx (from torch)
Downloading https://download.pytorch.org/whl/networkx-3.0-py3-none-any.whl (2.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 11.8 MB/s eta 0:00:00
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch) (3.1.2)
Collecting triton==2.0.0 (from torch)
Downloading https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.3/63.3 MB 11.5 MB/s eta 0:00:00
Collecting cmake (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/cmake-3.25.0-py2.py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 11.6 MB/s eta 0:00:00
Collecting lit (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/lit-15.0.7.tar.gz (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.3/132.3 kB 13.3 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [3 lines of output]
Looking in indexes: https://download.pytorch.org/whl/cu117
ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=40.8.0
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Couldn't find Cuda build tools on your PC. Reverting to CPU.
Collecting torch
Downloading torch-2.0.1-cp310-cp310-manylinux1_x86_64.whl (619.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 619.9/619.9 MB 10.9 MB/s eta 0:00:00
Collecting torchvision
Downloading torchvision-0.15.2-cp310-cp310-manylinux1_x86_64.whl (6.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 11.1 MB/s eta 0:00:00
Collecting torchaudio
Downloading torchaudio-2.0.2-cp310-cp310-manylinux1_x86_64.whl (4.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 11.6 MB/s eta 0:00:00
Collecting filelock (from torch)
Downloading filelock-3.12.2-py3-none-any.whl (10 kB)
Requirement already satisfied: typing-extensions in ./env/lib/python3.10/site-packages (from torch) (4.7.0)
Collecting sympy (from torch)
Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 10.4 MB/s eta 0:00:00
Collecting networkx (from torch)
Downloading networkx-3.1-py3-none-any.whl (2.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 11.1 MB/s eta 0:00:00
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch) (3.1.2)
Collecting nvidia-cuda-nvrtc-cu11==11.7.99 (from torch)
Downloading nvidia_cuda_nvrtc_cu11-11.7.99-2-py3-none-manylinux1_x86_64.whl (21.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21.0/21.0 MB 11.2 MB/s eta 0:00:00
Collecting nvidia-cuda-runtime-cu11==11.7.99 (from torch)
Downloading nvidia_cuda_runtime_cu11-11.7.99-py3-none-manylinux1_x86_64.whl (849 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 849.3/849.3 kB 12.9 MB/s eta 0:00:00
Collecting nvidia-cuda-cupti-cu11==11.7.101 (from torch)
Downloading nvidia_cuda_cupti_cu11-11.7.101-py3-none-manylinux1_x86_64.whl (11.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 11.2 MB/s eta 0:00:00
Collecting nvidia-cudnn-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_cudnn_cu11-<IP_ADDRESS>-2-py3-none-manylinux1_x86_64.whl (557.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 557.1/557.1 MB 10.0 MB/s eta 0:00:00
Collecting nvidia-cublas-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_cublas_cu11-<IP_ADDRESS>-py3-none-manylinux1_x86_64.whl (317.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 317.1/317.1 MB 11.1 MB/s eta 0:00:00
Collecting nvidia-cufft-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_cufft_cu11-<IP_ADDRESS>-py3-none-manylinux1_x86_64.whl (168.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 168.4/168.4 MB 11.4 MB/s eta 0:00:00
Collecting nvidia-curand-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_curand_cu11-<IP_ADDRESS>-py3-none-manylinux1_x86_64.whl (54.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.6/54.6 MB 11.1 MB/s eta 0:00:00
Collecting nvidia-cusolver-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_cusolver_cu11-<IP_ADDRESS>-2-py3-none-manylinux1_x86_64.whl (102.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 102.6/102.6 MB 11.6 MB/s eta 0:00:00
Collecting nvidia-cusparse-cu11==<IP_ADDRESS> (from torch)
Downloading nvidia_cusparse_cu11-<IP_ADDRESS>-py3-none-manylinux1_x86_64.whl (173.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.2/173.2 MB 10.7 MB/s eta 0:00:00
Collecting nvidia-nccl-cu11==2.14.3 (from torch)
Downloading nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl (177.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 177.1/177.1 MB 10.4 MB/s eta 0:00:00
Collecting nvidia-nvtx-cu11==11.7.91 (from torch)
Downloading nvidia_nvtx_cu11-11.7.91-py3-none-manylinux1_x86_64.whl (98 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.6/98.6 kB 13.8 MB/s eta 0:00:00
Collecting triton==2.0.0 (from torch)
Downloading triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.3/63.3 MB 11.4 MB/s eta 0:00:00
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==<IP_ADDRESS>->torch) (59.6.0)
Collecting wheel (from nvidia-cublas-cu11==<IP_ADDRESS>->torch)
Downloading wheel-0.40.0-py3-none-any.whl (64 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.5/64.5 kB 10.4 MB/s eta 0:00:00
Collecting cmake (from triton==2.0.0->torch)
Downloading cmake-3.26.4-py2.py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (24.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.0/24.0 MB 10.2 MB/s eta 0:00:00
Collecting lit (from triton==2.0.0->torch)
Downloading lit-16.0.6.tar.gz (153 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.7/153.7 kB 16.2 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy in ./env/lib/python3.10/site-packages (from torchvision) (1.25.0)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from torchvision) (2.31.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./env/lib/python3.10/site-packages (from torchvision) (9.5.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from jinja2->torch) (2.1.3)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->torchvision) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->torchvision) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->torchvision) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->torchvision) (2023.5.7)
Collecting mpmath>=0.19 (from sympy->torch)
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 12.5 MB/s eta 0:00:00
Building wheels for collected packages: lit
Building wheel for lit (pyproject.toml) ... done
Created wheel for lit: filename=lit-16.0.6-py3-none-any.whl size=93582 sha256=c1768dff6ef06bf0601d1de860882d304f0319aae0a8a375f88c234eb104483e
Stored in directory: /tmp/pip-ephem-wheel-cache-lact0le1/wheels/14/f9/07/bb2308587bc2f57158f905a2325f6a89a2befa7437b2d7e137
Successfully built lit
Installing collected packages: mpmath, lit, cmake, wheel, sympy, nvidia-nccl-cu11, nvidia-cufft-cu11, nvidia-cuda-nvrtc-cu11, networkx, filelock, nvidia-nvtx-cu11, nvidia-cusparse-cu11, nvidia-curand-cu11, nvidia-cuda-runtime-cu11, nvidia-cuda-cupti-cu11, nvidia-cublas-cu11, nvidia-cusolver-cu11, nvidia-cudnn-cu11, triton, torch, torchvision, torchaudio
Successfully installed cmake-3.26.4 filelock-3.12.2 lit-16.0.6 mpmath-1.3.0 networkx-3.1 nvidia-cublas-cu11-<IP_ADDRESS> nvidia-cuda-cupti-cu11-11.7.101 nvidia-cuda-nvrtc-cu11-11.7.99 nvidia-cuda-runtime-cu11-11.7.99 nvidia-cudnn-cu11-<IP_ADDRESS> nvidia-cufft-cu11-<IP_ADDRESS> nvidia-curand-cu11-<IP_ADDRESS> nvidia-cusolver-cu11-<IP_ADDRESS> nvidia-cusparse-cu11-<IP_ADDRESS> nvidia-nccl-cu11-2.14.3 nvidia-nvtx-cu11-11.7.91 sympy-1.12 torch-2.0.1 torchaudio-2.0.2 torchvision-0.15.2 triton-2.0.0 wheel-0.40.0
Pytorch installed successfully!!
Trying to install a cuda enabled version of ctransformers
Collecting ctransformers
Downloading ctransformers-0.2.10.tar.gz (213 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 213.7/213.7 kB 3.0 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting huggingface-hub (from ctransformers)
Downloading huggingface_hub-0.15.1-py3-none-any.whl (236 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 236.8/236.8 kB 12.7 MB/s eta 0:00:00
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (3.12.2)
Collecting fsspec (from huggingface-hub->ctransformers)
Downloading fsspec-2023.6.0-py3-none-any.whl (163 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 13.5 MB/s eta 0:00:00
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (2.31.0)
Requirement already satisfied: tqdm>=4.42.1 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.65.0)
Requirement already satisfied: pyyaml>=5.1 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (6.0)
Requirement already satisfied: typing-extensions>=<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.7.0)
Requirement already satisfied: packaging>=20.9 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (23.1)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2023.5.7)
Building wheels for collected packages: ctransformers
Building wheel for ctransformers (pyproject.toml) ... done
Created wheel for ctransformers: filename=ctransformers-0.2.10-cp310-cp310-linux_x86_64.whl size=394541 sha256=3a43651c247d10da748467005cfefa0e742338938f858f140659902ef9011030
Stored in directory: /tmp/pip-ephem-wheel-cache-rc9okwme/wheels/e2/96/f0/eddd9a9febd7f45c948d3bbda84f847186bf46c82a8e7d967b
Successfully built ctransformers
Installing collected packages: fsspec, huggingface-hub, ctransformers
Successfully installed ctransformers-0.2.10 fsspec-2023.6.0 huggingface-hub-0.15.1
Collecting transformers (from -r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading transformers-4.30.2-py3-none-any.whl (7.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.2/7.2 MB 10.0 MB/s eta 0:00:00
Collecting accelerate (from -r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2))
Downloading accelerate-0.20.3-py3-none-any.whl (227 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.6/227.6 kB 13.8 MB/s eta 0:00:00
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.12.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (0.15.1)
Requirement already satisfied: numpy>=1.17 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (1.25.0)
Requirement already satisfied: packaging>=20.0 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (23.1)
Requirement already satisfied: pyyaml>=5.1 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (6.0)
Collecting regex!=2019.12.17 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading regex-2023.6.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (770 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 770.4/770.4 kB 9.5 MB/s eta 0:00:00
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2.31.0)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 10.7 MB/s eta 0:00:00
Collecting safetensors>=0.3.1 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading safetensors-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 8.1 MB/s eta 0:00:00
Requirement already satisfied: tqdm>=4.27 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: torch>=1.6.0 in ./env/lib/python3.10/site-packages (from accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: fsspec in ./env/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2023.6.0)
Requirement already satisfied: typing-extensions>=<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (4.7.0)
Requirement already satisfied: sympy in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (1.12)
Requirement already satisfied: networkx in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.1)
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-cublas-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-cufft-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-curand-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-cusolver-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-cusparse-cu11==<IP_ADDRESS> in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (<IP_ADDRESS>)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==<IP_ADDRESS>->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (59.6.0)
Requirement already satisfied: wheel in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==<IP_ADDRESS>->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (0.40.0)
Requirement already satisfied: cmake in ./env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.26.4)
Requirement already satisfied: lit in ./env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (16.0.6)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from jinja2->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in ./env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (1.3.0)
Installing collected packages: tokenizers, safetensors, regex, transformers, accelerate
Successfully installed accelerate-0.20.3 regex-2023.6.3 safetensors-0.3.1 tokenizers-0.13.3 transformers-4.30.2
Installed successfully
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Current binding: c_transformers
Current model: None
Menu:
1 - orca-mini-3b.ggmlv3.q4_0.bin
2 - wizard-falcon-7b.ggmlv3.q5_0.bin
3 - wizard-falcon40b.ggmlv3.q6_K.bin
4 - Install model
5 - Change binding
6 - Back
Enter your choice: 1
You selected model: orca-mini-3b.ggmlv3.q4_0.bin
./webui.sh: line 144:  2989 Illegal instruction     (core dumped) python app.py
corey@llm:~/webui$ sed 's/orca-mini-3b.ggmlv3.q4_0.bin/wizard-falcon-7b.ggmlv3.q5_0.bin/' ~/Documents/lollms/configs/local_config.yaml
active_personality_id: 0
binding_name: c_transformers
config: local_config
ctx_size: 2048
db_path: database.db
debug: false
host: localhost
model_name: wizard-falcon-7b.ggmlv3.q5_0.bin
n_predict: 1024
n_threads: 8
override_personality_model_parameters: false
personalities:

english/generic/lollms
port: 9600
repeat_last_n: 40
repeat_penalty: 1.2
seed: -1
temperature: 0.9
top_k: 50
top_p: 0.95
user_name: user
version: 7
corey@llm:~/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH     .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH.     ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.##  HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.28)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.218)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (0.33.3)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (4.0.0)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (1.16.0)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.7.0)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
./webui.sh: line 144:  3329 Illegal instruction     (core dumped) python app.py
corey@llm:~/webui$ sed 's/orca-mini-3b.ggmlv3.q4_0.bin/wizard-falcon40b.ggmlv3.q6_K.bin/' ~/Documents/lollms/configs/local_config.yaml
active_personality_id: 0
binding_name: c_transformers
config: local_config
ctx_size: 2048
db_path: database.db
debug: false
host: localhost
model_name: wizard-falcon40b.ggmlv3.q6_K.bin
n_predict: 1024
n_threads: 8
override_personality_model_parameters: false
personalities:
english/generic/lollms
port: 9600
repeat_last_n: 40
repeat_penalty: 1.2
seed: -1
temperature: 0.9
top_k: 50
top_p: 0.95
user_name: user
version: 7
corey@llm:~/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH     .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH.     ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.##  HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.28)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.218)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (0.33.3)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (4.0.0)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (1.16.0)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.7.0)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.

No model selected
Personality  lollms mounted successfully but no model is selected
Checking discussions database... ok
Your personal data is stored here :D:\ZZZZZZZ_Local_AI_Inferencing\lollms-data
Your personal data is stored here :D:\ZZZZZZZ_Local_AI_Inferencing\lollms-data
debug mode:false
Please open your browser and go to http://localhost:9600 to view the ui
 * Serving Flask app 'Lollms-WebUI'
 * Debug mode: off
Client 1OlNYTLbxFuVcHmxAAAB connected
Client 1OlNYTLbxFuVcHmxAAAB disconnected
Lollms webui version : 4.0
Client JGg905kNuyizM3T1AAAD connected
Listing models
Recovering available models
Couldn't load model: [[WinError 2] The system cannot find the file specified: 'D:\\ZZZZZZZ_Local_AI_Inferencing\\lollms-webui\\installer_files\\lollms_env\\bin']
Traceback (most recent call last):
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-webui\lollms-webui\app.py", line 617, in update_setting
    self.model = self.binding.build_model()
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-data\bindings_zoo\c_transformers\__init__.py", line 124, in build_model
    self.model = AutoModelForCausalLM.from_pretrained(
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\hub.py", line 168, in from_pretrained
    return LLM(
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 208, in __init__
    self._lib = load_library(lib, cuda=config.gpu_layers > 0)
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 99, in load_library
    os.add_dll_directory(os.path.join(os.environ["CUDA_PATH"], "bin"))
  File "D:\ZZZZZZZ_Local_AI_Inferencing\lollms-webui\installer_files\lollms_env\lib\os.py", line 1118, in add_dll_directory
    cookie = nt._add_dll_directory(path)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'D:\\ZZZZZZZ_Local_AI_Inferencing\\lollms-webui\\installer_files\\lollms_env\\bin'

it seems to be a problem on my end, but I am a noob in this regard, I have reinstalled c_transformers many times, but same error occurs.
Suggestion: there should be some small models for every binding to check the bindings.

Same problem here with c_transformers and the model "TheBloke/Llama-2-13B-chat-GGML"...
Any fix yet?

Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Extensions zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
>Loading binding c_transformers. Please wait ...
Binding c_transformers loaded successfully.
No model selected
Personality  lollms mounted successfully but no model is selected
Checking discussions database... ok
Your personal data is stored here :C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models
Your personal data is stored here :C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models
debug mode:false
Please open your browser and go to http://localhost:9600 to view the ui
 * Serving Flask app 'Lollms-WebUI'
 * Debug mode: off
Lollms webui version : 5.0
Client WHvHwLa9C067o4jmAAAB connected
Listing models
Recovering available models
Reference created, please make sure you don't delete or move the referenced file. This can cause the link to be broken
Install model triggered
Model install requested
Model path : https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/resolve/main/llama-2-13b-chat.ggmlv3.q2_K.bin
100%|██████████████████████████████████████| 5.51G/5.51G [01:36<00:00, 57.0MB/s]
File downloaded successfully
Building model
Model type : llama
Couldn't load model: [[WinError 2] The system cannot find the file specified: 'C:\\Users\\wichtco\\switchdrive\\Mandats\\AI\\lollms-webui\\installer_files\\lollms_env\\bin']
Traceback (most recent call last):
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\lollms-webui\app.py", line 708, in update_setting
    self.model = self.binding.build_model()
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\bindings_zoo\c_transformers\__init__.py", line 130, in build_model
    self.model = AutoModelForCausalLM.from_pretrained(
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\hub.py", line 178, in from_pretrained
    return LLM(
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 227, in __init__
    self._lib = load_library(lib, cuda=config.gpu_layers > 0)
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 119, in load_library
    os.add_dll_directory(os.path.join(os.environ["CUDA_PATH"], "bin"))
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\os.py", line 1118, in add_dll_directory
    cookie = nt._add_dll_directory(path)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'C:\\Users\\wichtco\\switchdrive\\Mandats\\AI\\lollms-webui\\installer_files\\lollms_env\\bin'

OK
 ╔══════════════════════════════════════════════════╗
 ║           Building mounted Personalities         ║
 ╚══════════════════════════════════════════════════╝
* generic/lollms
selected : 0
 ╔══════════════════════════════════════════════════╗
 ║                      Done                        ║
 ╚══════════════════════════════════════════════════╝
Loading discussion for client WHvHwLa9C067o4jmAAAB
Loading discussion for client WHvHwLa9C067o4jmAAAB

The version of lollms you are using is depricated.
Now the current version is 5.5. Try to update it by executing the update script.
I advise you to do a full upgrade using the settings tab.
As of llama2 model, I just installed it and it does work! Make sure you have the latest version of everything:
1- lollms library
2- lollms-webui
3- models zoo
4- personalities zoo
5- extensions zoo
Best regards

Hi. I am sorry. I have already fixed this error. It is definetely in my binding. Sorry. I forgot to add a correspondance to this model as llama.

The version of lollms you are using is depricated. Now the current version is 5.5. Try to update it by executing the update script.
I advise you to do a full upgrade using the settings tab.
As of llama2 model, I just installed it and it does work! Make sure you have the latest version of everything: 1- lollms library 2- lollms-webui 3- models zoo 4- personalities zoo 5- extensions zoo
Best regards

Dear ParisNeo, many thanks for your reply.
I have updated to the latest 6.2 version running both the win_update.bat file and within the UI under "Settings" by clicking on "Upgrade Program" and the same error keeps happening:
Starting LOLLMS Web UI...
"     ___       ___           ___       ___       ___           ___      "
"    /\__\     /\  \         /\__\     /\__\     /\__\         /\  \     "
"   /:/  /    /::\  \       /:/  /    /:/  /    /::|  |       /::\  \    "
"  /:/  /    /:/\:\  \     /:/  /    /:/  /    /:|:|  |      /:/\ \  \   "
" /:/  /    /:/  \:\  \   /:/  /    /:/  /    /:/|:|__|__   _\:\~\ \  \  "
"/:/__/    /:/__/ \:\__\ /:/__/    /:/__/    /:/ |::::\__\ /\ \:\ \ \__\ "
"\:\  \    \:\  \ /:/  / \:\  \    \:\  \    \/__/~~/:/  / \:\ \:\ \/__/ "
" \:\  \    \:\  /:/  /   \:\  \    \:\  \         /:/  /   \:\ \:\__\   "
"  \:\  \    \:\/:/  /     \:\  \    \:\  \       /:/  /     \:\/:/  /   "
"   \:\__\    \::/  /       \:\__\    \:\__\     /:/  /       \::/  /    "
"    \/__/     \/__/         \/__/     \/__/     \/__/         \/__/     "
By ParisNeo
----------------------Paths information-----------------------
personal_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models
personal_configuration_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\configs
personal_databases_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\databases
personal_models_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\models
personal_user_infos_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\user_infos
personal_trainers_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\trainers
personal_trainers_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\trainers\gptqlora
personal_data_path:C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\data
-------------------------------------------------------------
Bindings zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Extensions zoo found in your personal space.
Pulling last Extensions zoo
Already up to date.
Qlora found in your personal space.
Pulling last qlora code
fatal: cannot change to 'C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\trainers\gptqlora': No such file or directory
>Loading binding c_transformers. Please wait ...
Binding c_transformers loaded successfully.
>Loading model llama-2-13b-chat.ggmlv3.q3_K_L.bin. Please wait ...
Building model
Model type : llama
Couldn't load model. Please verify your configuration file at C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\configs or use the next menu to select a valid model
Binding returned this exception : [WinError 2] The system cannot find the file specified: 'C:\\Users\\wichtco\\switchdrive\\Mandats\\AI\\lollms-webui\\installer_files\\lollms_env\\bin'
Traceback (most recent call last):
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\lollms\app.py", line 113, in load_model
    model = ModelBuilder(self.binding).get_model()
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\lollms\binding.py", line 328, in __init__
    self.build_model()
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\lollms\binding.py", line 331, in build_model
    self.model = self.binding.build_model()
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\bindings_zoo\c_transformers\__init__.py", line 141, in build_model
    self.model = AutoModelForCausalLM.from_pretrained(
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\hub.py", line 175, in from_pretrained
    llm = LLM(
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 241, in __init__
    self._lib = load_library(lib, cuda=config.gpu_layers > 0)
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\site-packages\ctransformers\llm.py", line 119, in load_library
    os.add_dll_directory(os.path.join(os.environ["CUDA_PATH"], "bin"))
  File "C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\installer_files\lollms_env\lib\os.py", line 1118, in add_dll_directory
    cookie = nt._add_dll_directory(path)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'C:\\Users\\wichtco\\switchdrive\\Mandats\\AI\\lollms-webui\\installer_files\\lollms_env\\bin'

personal_models_path: C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models\models
Binding name:c_transformers
Model name:llama-2-13b-chat.ggmlv3.q3_K_L.bin
Please select a valid model or install a new one from a url
Personality  lollms mounted successfully but no model is selected
Checking discussions database... ok
Your personal data is stored here :C:\Users\wichtco\switchdrive\Mandats\AI\lollms-webui\Models
debug mode:false
Please open your browser and go to http://localhost:9600 to view the ui
 * Serving Flask app 'Lollms-WebUI'
 * Debug mode: off
Client Z88H_CX3LmoIV4M0AAAB connected
Lollms webui version : 6.2
Listing models
Listing models
Loading discussion for client Z88H_CX3LmoIV4M0AAAB
Listing models
Listing models
Recovering available models

Do you have any idea what this missing file C:\\Users\\wichtco\\switchdrive\\Mandats\\AI\\lollms-webui\\installer_files\\lollms_env\\bin could be? Looks like a folder not a file to me...

Hi. What version of the install are you using? This has been fixed in the new win_install.bat !
You can easily fix it. just create an empty bin folder and it will work.

Hi. What version of the install are you using? This has been fixed in the new win_install.bat ! You can easily fix it. just create an empty bin folder and it will work.

Dear ParisNeo, you were right I was using an outdated installer version.
Nevertheless, I think you made a small mistake in the requirements.txt file of your latest v.6.2 release:

Correcting it (i.e., numpy==2.40.0) lead to another issue:

The latest numpy stable release is 1.25.2...
Which version were you actually referring to?
Best,
C.

it should be fixed by now.
update and try again

I am also having issues with model TheBloke/WizardCoder-Python-13B-V1.0-GGUF using c_transformers, any idea what is going on here?

Thanks for reporting this bug.
As I saif, V6.5 is still in beta.
I have fixed the bug.

I'm getting Could not find module '.....\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax. The directory and file do exist, so it could be a Windows -> Python path translation issue?
No errors during install of the application. I can load the GPT4All binding just fine.

Can you try again? I did some updates. Can you reinstall the binding?

I'm getting Could not find module '.....\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax. The directory and file do exist, so it could be a Windows -> Python path translation issue?
No errors during install of the application. I can load the GPT4All binding just fine.

Have same error, working only ollama, was trying c_transformers and bs_exllama but same error: "could`nt find module"


Crash with requiem due to missing null check

Original issue: Ladysnake/Requiem#470
https://github.com/dayofpi/super_block_world/blob/12370893b33d6808ab125d8c177372bf1a3f1424/src/main/java/com/dayofpi/super_block_world/main/common/entity/mob/goomba/GoombaEntity.java#L87-L90
target is marked as nullable but this method assumes it's not, causing a crash when some mod tries to unset a goomba's target. I believe the quickest fix would be to add another null check on line 88.

Ah thanks for letting me know! I'll fix it asap

A fix has been released to fix the missing null check


Add title to each column in UI

Codecov Report

Merging #121 (851ccb1) into appointment (4e1a958) will decrease coverage by 1.68%.
The diff coverage is n/a.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4e1a958...851ccb1. Read the comment docs.


how to load dem file?

how to load dem file?
thanks~

😆

😀

Don't need 2

Hi danlawler,
Thank you for your response~  What exactly do you mean by "Open" with gee web?

@addriumruss Are you asking how to import a .dem file as a Fusion resource? You should be able to add it like any other terrain resource.
In the Asset Manager, just click the "New Terrain Resource" button, then click "Add" in the next dialog. DEM is a supported file type.

@tst-sbayard  Thanks, I will try it. Right now the compilation stopped me.


FE: Create Game History page

/#/game-history
gameHistory.html
gameHistoryCtrl

Needs creative + styling

WIP: needs compare hover