Image upload failed

Image upload failed
http://cytomine.local/api/imageserver/format.json（Return 500）
http://upload.cytomine.local/upload?cytomine=http://cytomine.local&idStorage=51&idProject=（Return  404）
Do you have any good troubleshooting suggestions

Hi,
On which operating system are you running Cytomine ?
Please give the most detailed context on your installation and your use.
Thank you.
Grégoire

Server system version Centos 7.9 kernel version 3.10.0-1160. el7.x86_ sixty-four

It has been resolved so far http://cytomine.local/api/imageserver/format.json The problem of returning 500 is due to the Domain Name System configuration of the core container.

Image upload still exists http://upload.cytomine.local/upload?cytomine=http://cytomine.local&idStorage=51&idProject= (Return to 404), via git clone https://github.com/cytomine/Cytomine-community-edition.git Install the version and execute docker compose up - d

thanks

Found an error in nginx
2023/05/29 02:40:37 [error] 58#58: *334 upstream prematurely closed connection while reading response header from upstream, client: <IP_ADDRESS>, server: upload.local, request: "POST /upload?cytomine=http://core.local&idStorage=51&idProject= HTTP/1.1", upstream: "http://<IP_ADDRESS>:5000/upload?cytomine=http://core.local&idStorage=51&idProject=", host: "upload.local", referrer: "http://core.local/"
Attempt local access to pims, curl http://<IP_ADDRESS>:5000 Return {"detail": "Method Not Allowed"}, curl http://<IP_ADDRESS>:5000/upload?cytomine=http://core.local , return {"detail": "Method Not Allowed"}
Do you have any troubleshooting suggestions

The nginx error seems to be an issue with containers IP Addresses.
Could you try to restart your Cytomine instance?
docker compose down
docker compose up -d

If the problem persists, could you please try to debug the dns resolutions?
# Enter the container
docker exec -it nginx sh

# Install dig
apk add --update bind-tools

# See DNS resolution of upload.local
dig upload.local

# Same for core
docker exec -it core bash
apt install dnsutils
dig upload.local

Hope this helps :nerd_face:

Hello, I have modified the hosts files of the internal core and nginx of the container. Executing the ping command returns the IP address of the domain name mapping in the hosts file. By executing the dig upload.local command, I have returned an NXDOMAIN response, which means that the domain name cannot be resolved in the local DNS.
I plan to access in the intranet environment. For Domain Name System, it seems useless to modify the local hosts file. What other solutions are recommended? Thank you!

I'm having the same issue. File upload works fine when the server is run locally but when it's distant I get an error at the end of the file upload. Core is returning 2 exceptions in the console, A json parser exception and a nullpointer:
com.fasterxml.jackson.core.JsonParseException: Unexpected character ('<' (code 60)): expected a valid value (JSON String, Number, Array, Object or token 'null', 'true' or 'false')
 at [Source: (String)"<!DOCTYPE html><html><head><meta charset="utf-8"><meta http-equiv="X-UA-Compatible" content="IE=edge"><meta name="viewport" content="width=device-width,initial-scale=1"><meta name="version" content="2.6.1"><link rel="icon" href="/favicon.ico?v=2"><title>Cytomine</title><link href="/css/app.102a0df7.css" rel="preload" as="style"><link href="/css/chunk-vendors.44629b2d.css" rel="preload" as="style"><link href="/js/app.cfbc550a.js" rel="preload" as="script"><link href="/js/chunk-vendors.b9534804.js"[truncated 439 chars]; line: 1, column: 2]
        at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:2391)
        at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:735)
        at com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:659)
        at com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleOddValue(ReaderBasedJsonParser.java:2005)

2023-06-22 07:53:39.056 ERROR 1 --- [io-8080-exec-10] o.a.c.c.C.[.[.[/].[dispatcherServlet]    : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is java.lang.NullPointerException: Cannot invoke "be.cytomine.utils.JsonObject.get(Object)" because "jsonObject" is null] with root cause

java.lang.NullPointerException: Cannot invoke "be.cytomine.utils.JsonObject.get(Object)" because "jsonObject" is null
        at be.cytomine.service.middleware.ImageServerService.formats(ImageServerService.java:110)
        at be.cytomine.service.middleware.ImageServerService$$FastClassBySpringCGLIB$$b94584bb.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)

I dunno if it's related.
here are the results for the DNS resolutions:
# Enter the container
docker exec -it nginx sh

# Install dig
apk add --update bind-tools

# See DNS resolution of upload.local
$ dig upload.local

; <<>> DiG 9.18.16 <<>> upload.local
;; global options: +cmd
;; Got answer:
;; WARNING: .local is reserved for Multicast DNS
;; You are currently testing what happens when an mDNS query is leaked to DNS
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 1929
;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; WARNING: recursion requested but not available

;; QUESTION SECTION:
;upload.local.                                    IN      A

;; Query time: 0 msec
;; SERVER: <IP_ADDRESS>#53(<IP_ADDRESS>)
;; WHEN: Thu Jun 22 08:03:46 UTC 2023
;; MSG SIZE  rcvd: 30

Hello folks, right now Cytomine and the final client need to resolve the URLs defined in the cytomine.template (and after the installer has been run, in the .env file) to the IP of the machine running Cytomine.
URLS_CORE=cytomine.local
URLS_IMAGE_SERVER=ims.cytomine.local
URLS_UPLOAD=upload.cytomine.local

In other words, in your LAN, those URLs must resolve to the IP of the machine running Cytomine. That must be true from within the containers and for the end-user browsing those URLs.
Hope this helps.

Hello folks, right now Cytomine and the final client need to resolve the URLs defined in the cytomine.template (and after the installer has been run, in the .env file) to the IP of the machine running Cytomine.
URLS_CORE=cytomine.local
URLS_IMAGE_SERVER=ims.cytomine.local
URLS_UPLOAD=upload.cytomine.local

In other words, in your LAN, those URLs must resolve to the IP of the machine running Cytomine. That must be true from within the containers and for the end-user browsing those URLs.
Hope this helps.

Thanks for the help but I believe I've already set the correct values, it still doesn't explain why the upload is working locally but not remotely. I get an HTTP 413 when used remotely. I tried to change the nginx upload size but it didn't work.


test(serving-functions): add more logs

- Summary
Follow up on https://github.com/netlify/cli/pull/3015
Adds more logs to print the CLI output when requests to ntl dev fail
- Test plan
Existing tests
- A picture of a cute animal (not mandatory but encouraged)
🦁

Thanks for looking into this @erezrokah! 🙏🏻


Fury3 Support?

Would it be possible to implement support for Fury3? As of right now, DDrawCompat doesn't seem to recognize the game at all.

Generally, you can check if a game uses DirectDraw with Process Explorer:
https://learn.microsoft.com/en-us/sysinternals/downloads/process-explorer
In the view menu, make sure "Show Lower Pane" is enabled and "Lower Pane View" is set to "DLLs". Then you can see the list of DLLs loaded by the process. If it doesn't have ddraw.dll there (you can sort it by clicking on the Name column), then of course DDrawCompat won't do anything.
Are you sure the game has a DirectDraw mode at all? I can't see the system ddraw.dll being loaded.

Huh. I guess it doesn't? But it's still a windows software-rendered game, so I wonder what API it uses...

gho has it listed as a WinG32 app, which is supposedly just a wrapper over GDI.
https://sourceforge.net/p/dxwnd/discussion/general/thread/2227213f/#9773

Bit more info on wiki, which also lists Fury3: https://en.wikipedia.org/wiki/WinG

Bit more info on wiki, which also lists Fury3: https://en.wikipedia.org/wiki/WinG

Well, damn. Looks like I'm not gonna find a wrapper for that one any time soon. I'm surprised Windows 11 still has native WinG support.


Fixed Statistics With Missing Elevation Data

Hi,
Thank you very much for your useful library :1st_place_medal:
My GPX files have some missing elevation data, in that case calcElevation() returns null values. I wasn't expected that.
I changed the behaviour in order to return statistics despite missing elevation data.
Hope that helps

Fixed with the 3.0.7 release

Fixed with the 3.0.7 release


Bing imagery key

iD uses the Bing imagery key that was originally set up for Potlatch 2: https://github.com/openstreetmap/iD/blob/898b2e3d0a01652bc5a821a601480a2d36d4a442/modules/renderer/background_source.js#L223
This key is registered to my email address. Occasionally I get emails like this:

Thank you for being a valued Bing Maps Customer.
You are receiving this notification as you have been identified as an owner of the Bing Maps Account ID 1041305.  Account limits reset at the beginning of each calendar year. To continue using Bing Maps Platform APIs, you will need to either remain within the Terms of Use limits, or you will to upgrade to an Enterprise license. Having an Enterprise license will improve overall service quality and provide an increased level of support.

I then try and get this fixed by emailing/tweeting people at Microsoft, who either say "oh sure we've fixed it" or point me towards a series of options I should supposedly set on my account, which would be fine if those options actually existed, which they don't. It's all a bit beware of the leopard. Then a few months later it happens again.
Frankly I have exhausted my patience for arguing with them, and won't be following it up any more.
It's therefore possible that Bing imagery may break in any app that uses this key. Personally I don't think this would be a bad thing as it might finally embarrass Microsoft into fixing it, but this is by way of a heads-up to warn you. If you feel like arguing with the Microsoft bureaucracy then I wish you godspeed.

Received today:

Thank you for being a valued Bing Maps Customer.

You are receiving this notification as you have been identified as an owner of the Bing Maps Account ID 1041305. Your basic key(s) have exceeded the daily usage limits as per the Bing Maps Platform APIs' Terms of Use (TOU). Your basic key(s) will no longer work until either it is reset or it is upgraded to an enterprise key(s).

If you do not currently hold a Bing Maps for Enterprise license, You can learn about the Bing Maps licensing options that are available by visiting the Bing Maps licensing website.

It seems the API key has been revoked today: https://josm.openstreetmap.de/ticket/17744

It seems the API key has been revoked today: https://josm.openstreetmap.de/ticket/17744

Thanks for the ping - I'm following up with their team on a replacement key.

Hey @bhousel do let me know if you need help getting to the right people. I can help expedite.

Thanks for the offer! We're working on getting a new key now.
Actually the existing key is still working, we think it might have just exceeded the daily 50k view limit yesterday. (It started working again last night even before the emails went out 😆)

Good to know! I was a bit surprised to not be spammed by bug reports today. Maybe this is time every editor get its own key? This way the probability to reach the 50k limit will decrease.

Maybe this is time every editor get its own key?

Yes, I think this would be the best, although for different reasons. It does increase the administrative workload since each editor needs to have contact with Bing for getting the key setup properly.

Maybe this is time every editor get its own key?

We are considering this, but from the sounds of it the 50k limit is per organization, not per application.  Working with the enterprise support team to decide best next steps.   We aren't even sure at this point whether all the traffic is actually ours.

Update on this - we have a second nonprofit key that we may use for testing, and I've switched iD over to use it. (Will deploy a patch update to iD soon).
This should free up a significant number of mapviews so that other editors can continue the existing key without hitting the limit.  We will also be able to better tell whether all of the traffic is really ours, or whether someone else is using the other OSM key.

Update on this - we have a second nonprofit key that we may use for testing, and I've switched iD over to use it.

IIRC vespucci (cc @simonpoole ) has an own key, too.

@bhousel thanks a lot!

@bhousel  is the key change live in production? We just hit the quota again.

I believe it is in production as of this morning, but have not checked yet.

@bhousel is the key change live in production? We just hit the quota again.

Is JOSM still using the P2 key?

@pnorman yes. @bhousel did you check if osm.org is using the new key? We're still hitting the limit.

@bhousel did you check if osm.org is using the new key? We're still hitting the limit.

@don-vip  Yes current versions of iD are using the new key.. Looks like we are using about 20k-25k transactions per day.


[#5] error: building bzip2:x64-windows failed with: BUILD_FAILED

Operating system
windows10
Compiler
Visual Studio Community 2022
Steps to reproduce the behavior
vcpkg install tesseract

Failure logs
vcpkg-master\installed\vcpkg\issue_body.md:
Package<EMAIL_ADDRESS>Host Environment

Host: x64-windows
Compiler: MSVC 19.41.34120.0
vcpkg-tool version: 2024-08-01-fd884a0d390d12783076341bd43d77c3a6a15658
vcpkg-scripts version: unknown

To Reproduce
vcpkg install tesseract
Failure logs
-- Using cached bzip2-1.0.8.tar.gz.
-- Cleaning sources at D:/ALL/vcpkg-master/buildtrees/bzip2/src/bzip2-1-336d4794a3.clean. Use --editable to skip cleaning for the packages you specify.
-- Extracting source D:/ALL/vcpkg-master/downloads/bzip2-1.0.8.tar.gz
-- Applying patch fix-import-export-macros.patch
-- Using source at D:/ALL/vcpkg-master/buildtrees/bzip2/src/bzip2-1-336d4794a3.clean
-- Found external ninja('1.11.0').
-- Configuring x64-windows
-- Building x64-windows-dbg
-- Building x64-windows-rel
-- Fixing pkgconfig file: D:/ALL/vcpkg-master/packages/bzip2_x64-windows/lib/pkgconfig/bzip2.pc
-- Downloading https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://repo.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.yandex.ru/mirrors/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.tuna.tsinghua.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.ustc.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.selfnet.de/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst -> msys2-mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst...

CMake Error at scripts/cmake/vcpkg_download_distfile.cmake:32 (message):

      Failed to download file with error: no such file or directory
      If you are using a proxy, please check your proxy setting. Possible causes are:

      1. You are actually using an HTTP proxy, but setting HTTPS_PROXY variable
         to `https://address:port`. This is not correct, because `https://` prefix
         claims the proxy is an HTTPS proxy, while your proxy (v2ray, shadowsocksr
         , etc..) is an HTTP proxy. Try setting `http://address:port` to both
         HTTP_PROXY and HTTPS_PROXY instead.

      2. If you are using Windows, vcpkg will automatically use your Windows IE Proxy Settings
         set by your proxy software. See https://github.com/microsoft/vcpkg-tool/pull/77
         The value set by your proxy might be wrong, or have same `https://` prefix issue.

      3. Your proxy's remote server is out of service.

      If you've tried directly download the link, and believe this is not a temporary
      download server failure, please submit an issue at https://github.com/Microsoft/vcpkg/issues
      to report this upstream download server failure.

Call Stack (most recent call first):
  scripts/cmake/vcpkg_download_distfile.cmake:270 (z_vcpkg_download_distfile_show_proxy_and_fail)
  scripts/cmake/vcpkg_acquire_msys.cmake:25 (vcpkg_download_distfile)
  scripts/cmake/vcpkg_acquire_msys.cmake:124 (z_vcpkg_acquire_msys_download_package)
  scripts/cmake/vcpkg_acquire_msys.cmake:212 (z_vcpkg_acquire_msys_download_packages)
  scripts/cmake/vcpkg_find_acquire_program(PKGCONFIG).cmake:52 (vcpkg_acquire_msys)
  scripts/cmake/vcpkg_find_acquire_program.cmake:121 (include)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  ports/bzip2/portfile.cmake:53 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)

vcpkg install tesseract
Computing installation plan...
The following packages will be built and installed:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>vcpkg-cmake-get-vars:x64-windows@2023-12-31
<EMAIL_ADDRESS><EMAIL_ADDRESS>Additional packages (*) will be modified to complete this operation.
Detecting compiler hash for triplet x64-windows...
Compiler found: D:/VS2022Community/VisualStudioCommunity/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe
Restored 0 package(s) from C:\Users\xingzesheng\AppData\Local\vcpkg\archives in 436 us. Use --debug to see more details.
Installing 1/18<EMAIL_ADDRESS>Building<EMAIL_ADDRESS>-- Using cached bzip2-1.0.8.tar.gz.
-- Cleaning sources at D:/ALL/vcpkg-master/buildtrees/bzip2/src/bzip2-1-336d4794a3.clean. Use --editable to skip cleaning for the packages you specify.
-- Extracting source D:/ALL/vcpkg-master/downloads/bzip2-1.0.8.tar.gz
-- Applying patch fix-import-export-macros.patch
-- Using source at D:/ALL/vcpkg-master/buildtrees/bzip2/src/bzip2-1-336d4794a3.clean
-- Found external ninja('1.11.0').
-- Configuring x64-windows
-- Building x64-windows-dbg
-- Building x64-windows-rel
-- Fixing pkgconfig file: D:/ALL/vcpkg-master/packages/bzip2_x64-windows/lib/pkgconfig/bzip2.pc
-- Downloading https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://repo.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.yandex.ru/mirrors/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.tuna.tsinghua.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.ustc.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.selfnet.de/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst -> msys2-mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst...

CMake Error at scripts/cmake/vcpkg_download_distfile.cmake:32 (message):
  Failed to download file with error: no such file or directory
  If you are using a proxy, please check your proxy setting. Possible causes are:

  1. You are actually using an HTTP proxy, but setting HTTPS_PROXY variable
     to `https://address:port`. This is not correct, because `https://` prefix
     claims the proxy is an HTTPS proxy, while your proxy (v2ray, shadowsocksr
     , etc..) is an HTTP proxy. Try setting `http://address:port` to both
     HTTP_PROXY and HTTPS_PROXY instead.

  2. If you are using Windows, vcpkg will automatically use your Windows IE Proxy Settings
     set by your proxy software. See https://github.com/microsoft/vcpkg-tool/pull/77
     The value set by your proxy might be wrong, or have same `https://` prefix issue.

  3. Your proxy's remote server is out of service.

  If you've tried directly download the link, and believe this is not a temporary
  download server failure, please submit an issue at https://github.com/Microsoft/vcpkg/issues
  to report this upstream download server failure.

Call Stack (most recent call first):
scripts/cmake/vcpkg_download_distfile.cmake:270 (z_vcpkg_download_distfile_show_proxy_and_fail)
scripts/cmake/vcpkg_acquire_msys.cmake:25 (vcpkg_download_distfile)
scripts/cmake/vcpkg_acquire_msys.cmake:124 (z_vcpkg_acquire_msys_download_package)
scripts/cmake/vcpkg_acquire_msys.cmake:212 (z_vcpkg_acquire_msys_download_packages)
scripts/cmake/vcpkg_find_acquire_program(PKGCONFIG).cmake:52 (vcpkg_acquire_msys)
scripts/cmake/vcpkg_find_acquire_program.cmake:121 (include)
scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
ports/bzip2/portfile.cmake:53 (vcpkg_fixup_pkgconfig)
scripts/ports.cmake:192 (include)
error: building bzip2:x64-windows failed with: BUILD_FAILED
See https://learn.microsoft.com/vcpkg/troubleshoot/build-failures?WT.mc_id=vcpkg_inproduct_cli for more information.
Elapsed time to handle bzip2:x64-windows: 12 s
Please ensure you're using the latest port files with git pull and vcpkg update.
Then check for known issues at:
https://github.com/microsoft/vcpkg/issues?q=is%3Aissue+is%3Aopen+in%3Atitle+bzip2
You can submit a new issue at:
https://github.com/microsoft/vcpkg/issues/new?title=[bzip2]+Build+error+on+x64-windows&body=Copy+issue+body+from+D%3A%2F项目管理%2FOCRmyPDF%2FALL%2Fvcpkg-master%2Finstalled%2Fvcpkg%2Fissue_body.md
vcpkg-master\buildtrees\detect_compiler\config-x64-windows-out.log：
[1/1] "D:/ALL/vcpkg-master/downloads/tools/cmake-3.29.2-windows/cmake-3.29.2-windows-i386/bin/cmake.exe" -E chdir ".." "D:/ALL/vcpkg-master/downloads/tools/cmake-3.29.2-windows/cmake-3.29.2-windows-i386/bin/cmake.exe" "D:/ALL/vcpkg-master/scripts/detect_compiler" "-G" "Ninja" "-DCMAKE_BUILD_TYPE=Release" "-DCMAKE_INSTALL_PREFIX=D:/ALL/vcpkg-master/packages/detect_compiler_x64-windows" "-DCMAKE_MAKE_PROGRAM=D:/VS2022Community/VisualStudioCommunity/Common7/IDE/CommonExtensions/Microsoft/CMake/Ninja/ninja.exe" "-DBUILD_SHARED_LIBS=ON" "-DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=D:/ALL/vcpkg-master/scripts/toolchains/windows.cmake" "-DVCPKG_TARGET_TRIPLET=x64-windows" "-DVCPKG_SET_CHARSET_FLAG=ON" "-DVCPKG_PLATFORM_TOOLSET=v143" "-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON" "-DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE" "-DCMAKE_VERBOSE_MAKEFILE=ON" "-DVCPKG_APPLOCAL_DEPS=OFF" "-DCMAKE_TOOLCHAIN_FILE=D:/ALL/vcpkg-master/scripts/buildsystems/vcpkg.cmake" "-DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON" "-DVCPKG_CXX_FLAGS=" "-DVCPKG_CXX_FLAGS_RELEASE=" "-DVCPKG_CXX_FLAGS_DEBUG=" "-DVCPKG_C_FLAGS=" "-DVCPKG_C_FLAGS_RELEASE=" "-DVCPKG_C_FLAGS_DEBUG=" "-DVCPKG_CRT_LINKAGE=dynamic" "-DVCPKG_LINKER_FLAGS=" "-DVCPKG_LINKER_FLAGS_RELEASE=" "-DVCPKG_LINKER_FLAGS_DEBUG=" "-DVCPKG_TARGET_ARCHITECTURE=x64" "-DCMAKE_INSTALL_LIBDIR:STRING=lib" "-DCMAKE_INSTALL_BINDIR:STRING=bin" "-D_VCPKG_ROOT_DIR=D:/ALL/vcpkg-master" "-DZ_VCPKG_ROOT_DIR=D:/ALL/vcpkg-master" "-D_VCPKG_INSTALLED_DIR=D:/ALL/vcpkg-master/installed" "-DVCPKG_MANIFEST_INSTALL=OFF"
-- The C compiler identification is MSVC 19.41.34120.0
-- The CXX compiler identification is MSVC 19.41.34120.0
#COMPILER_HASH#41fcbe159d3e0157ad0ffb47ecaf454584e3c371
#COMPILER_C_HASH#44ea048b252ee29d93bf1b3f14059b71485bcbe2
#COMPILER_C_VERSION#19.41.34120.0
#COMPILER_C_ID#MSVC
#COMPILER_C_PATH#D:/VS2022Community/VisualStudioCommunity/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe
#COMPILER_CXX_HASH#44ea048b252ee29d93bf1b3f14059b71485bcbe2
#COMPILER_CXX_VERSION#19.41.34120.0
#COMPILER_CXX_ID#MSVC
#COMPILER_CXX_PATH#D:/VS2022Community/VisualStudioCommunity/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe
-- Configuring done (3.9s)
-- Generating done (0.0s)
CMake Warning:
Manually-specified variables were not used by the project:
BUILD_SHARED_LIBS
CMAKE_INSTALL_BINDIR
CMAKE_INSTALL_LIBDIR
_VCPKG_ROOT_DIR

-- Build files have been written to: D:/ALL/vcpkg-master/buildtrees/detect_compiler/x64-windows-rel
Additional context
No response

I cannot repro this issue locally, your problem is downloading pkgconf, please confirm the status of your internet.
-- Fixing pkgconfig file: D:/ALL/vcpkg-master/packages/bzip2_x64-windows/lib/pkgconfig/bzip2.pc
-- Downloading https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://repo.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.yandex.ru/mirrors/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.tuna.tsinghua.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirrors.ustc.edu.cn/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst;https://mirror.selfnet.de/msys2/mingw/mingw64/mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst -> msys2-mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst...
CMake Error at scripts/cmake/vcpkg_download_distfile.cmake:32 (message):

  Failed to download file with error: no such file or directory

I can input web pages in the browser: https://mirror.msys2.org/mingw/mingw64/mingw-w64-x86_64-pkgconf-1 ~2.2.0-1-any. pkg. tar. zst is downloading normally, which should indicate that the network is working properly, right?The manually downloaded software package is placed in:ALL\vcpkg-master\downloads

You could download it manually, then rename it to msys2-mingw-w64-x86_64-pkgconf-1~2.2.0-1-any.pkg.tar.zst, and put it to _D:\ALL\vcpkg-master\downloads_.

Yes, I downloaded and renamed all the packages needed for building, but now there is a new issue:CMake Warning at installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:344 (message):
The following variables are not used in CMakeLists.txt:
  PKG_CONFIG_EXECUTABLE

Please recheck them and remove the unnecessary options from the
vcpkg_cmake_configure call.
If these options should still be passed for whatever reason, please use the
MAYBE_UNUSED_VARIABLES argument.
Call Stack (most recent call first):
ports/curl/portfile.cmake:76 (vcpkg_cmake_configure)
scripts/ports.cmake:192 (include)
-- Building x64-windows-dbg
CMake Warning at scripts/cmake/vcpkg_execute_build_process.cmake:65 (message):
Please ensure your system has sufficient memory.
Call Stack (most recent call first):
installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_build.cmake:74 (vcpkg_execute_build_process)
installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_install.cmake:16 (vcpkg_cmake_build)
ports/curl/portfile.cmake:90 (vcpkg_cmake_install)
scripts/ports.cmake:192 (include)
-- Restarting build without parallelism
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:134 (message):
Command failed: D:/CMake/bin/cmake.exe --build . --config Debug --target install -- -v -j21
Working Directory: D:/ALL/vcpkg-master/buildtrees/curl/x64-windows-dbg
See logs for more information:
D:\ALL\vcpkg-master\buildtrees\curl\install-x64-windows-dbg-out.log
D:\ALL\vcpkg-master\buildtrees\curl\install-x64-windows-dbg-out-1.log
Call Stack (most recent call first):
installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_build.cmake:74 (vcpkg_execute_build_process)
installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_install.cmake:16 (vcpkg_cmake_build)
ports/curl/portfile.cmake:90 (vcpkg_cmake_install)
scripts/ports.cmake:192 (include)
D:\ALL\vcpkg-master\buildtrees\curl\install-x64-windows-dbg-out-1.log：
Change Dir: 'D:/ALL/vcpkg-master/buildtrees/curl/x64-windows-dbg'
Run Build Command(s): D:/VS2022Community/VisualStudioCommunity/Common7/IDE/CommonExtensions/Microsoft/CMake/Ninja/ninja.exe -v -v -j1 install
[1/3] D:/CMake/bin/cmcldeps.exe RC D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\lib\libcurl.rc lib\CMakeFiles\libcurl_shared.dir\libcurl.rc.res.d lib\CMakeFiles\libcurl_shared.dir\libcurl.rc.res "Note: including file: " "D:/VS2022Community/VisualStudioCommunity/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe" "D:\Windows Kits\10\bin\10.0.22621.0\x64\rc.exe" -DBUILDING_LIBCURL -DCURLDEBUG -DDEBUGBUILD -DHAVE_CONFIG_H -DUNICODE -D_CRT_NONSTDC_NO_DEPRECATE -D_CRT_SECURE_NO_DEPRECATE -D_UNICODE -Dlibcurl_shared_EXPORTS -I D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\include -I D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib..\include -I D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\lib.. -I D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\lib..\include -I D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib.. -I D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\lib -I D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib -I D:\ALL\vcpkg-master\installed\x64-windows\include -c65001 /DWIN32 -DCURL_EMBED_MANIFEST -D_DEBUG /fo lib\CMakeFiles\libcurl_shared.dir\libcurl.rc.res D:\ALL\vcpkg-master\buildtrees\curl\src\curl-8_9_1-bb74e44024.clean\lib\libcurl.rc
[2/3] C:\Windows\system32\cmd.exe /C "C:\Windows\system32\cmd.exe /C "D:\CMake\bin\cmake.exe -E __create_def D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib\CMakeFiles\libcurl_shared.dir.\exports.def D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib\CMakeFiles\libcurl_shared.dir.\exports.def.objs && cd D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg" && D:\CMake\bin\cmake.exe -E vs_link_dll --intdir=lib\CMakeFiles\libcurl_shared.dir --rc="D:\Windows Kits\10\bin\10.0.22621.0\x64\rc.exe" --mt="D:\Windows Kits\10\bin\10.0.22621.0\x64\mt.exe" --manifests  -- D:\VS2022Community\VisualStudioCommunity\VC\Tools\MSVC\14.41.34120\bin\Hostx64\x64\link.exe  @CMakeFiles\libcurl_shared.rsp  /out:lib\libcurl-d.dll /implib:lib\libcurl-d.lib /pdb:lib\libcurl-d.pdb /dll /version:0.0 /machine:x64 /nologo    /debug /INCREMENTAL  /DEF:lib\CMakeFiles\libcurl_shared.dir.\exports.def && cd ."
FAILED: lib/libcurl-d.dll lib/libcurl-d.lib
C:\Windows\system32\cmd.exe /C "C:\Windows\system32\cmd.exe /C "D:\CMake\bin\cmake.exe -E __create_def D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib\CMakeFiles\libcurl_shared.dir.\exports.def D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg\lib\CMakeFiles\libcurl_shared.dir.\exports.def.objs && cd D:\ALL\vcpkg-master\buildtrees\curl\x64-windows-dbg" && D:\CMake\bin\cmake.exe -E vs_link_dll --intdir=lib\CMakeFiles\libcurl_shared.dir --rc="D:\Windows Kits\10\bin\10.0.22621.0\x64\rc.exe" --mt="D:\Windows Kits\10\bin\10.0.22621.0\x64\mt.exe" --manifests  -- D:\VS2022Community\VisualStudioCommunity\VC\Tools\MSVC\14.41.34120\bin\Hostx64\x64\link.exe  @CMakeFiles\libcurl_shared.rsp  /out:lib\libcurl-d.dll /implib:lib\libcurl-d.lib /pdb:lib\libcurl-d.pdb /dll /version:0.0 /machine:x64 /nologo    /debug /INCREMENTAL  /DEF:lib\CMakeFiles\libcurl_shared.dir.\exports.def && cd ."
LINK Pass 1: command "D:\VS2022Community\VisualStudioCommunity\VC\Tools\MSVC\14.41.34120\bin\Hostx64\x64\link.exe @CMakeFiles\libcurl_shared.rsp /out:lib\libcurl-d.dll /implib:lib\libcurl-d.lib /pdb:lib\libcurl-d.pdb /dll /version:0.0 /machine:x64 /nologo /debug /INCREMENTAL /DEF:lib\CMakeFiles\libcurl_shared.dir.\exports.def /MANIFEST /MANIFESTFILE:lib\CMakeFiles\libcurl_shared.dir/intermediate.manifest lib\CMakeFiles\libcurl_shared.dir/manifest.res" failed (exit code 1104) with the following output:
LINK : fatal error LNK1104: cannot open file 'D:\ALL\vcpkg-master\installed\x64-windows\debug\lib\zlibd.lib'
ninja: build stopped: subcommand failed.

I deleted vcpkg, re extracted and installed vcpkg, re executed vcpkg install teseract, and it was successful. I no longer need to manually download any packages. Can the decompression path of vcpkg package only be in English, right? I decompressed vcpkg for the second time and placed it in the full English path.


Show Profile status, joined dated, webaite and location

Closing as a duplicate of #223 (although this one came first, the reporter no longer has an account)


SvelteKit 2 migration and dependency updates

Adds backwards-compatible support for SvelteKit 2.
I included a version bump, but am happy to remove it.
Closes #12

[x] tested with<EMAIL_ADDRESS>[x] tested with<EMAIL_ADDRESS>[x] tested with vitePreprocess from @sveltejs/kit/vite
[x] tested with vitePreprocess from @sveltejs/vite-plugin-svelte (SvelteKit 2 change)
[x] npm test passing

@accuser thank you for the invitation! Any concerns if I merge this?

I'm also looking for this update to land. :)

@till merged!


RecipeJournal Folder in media library (1.10.1)

Why do I see RecipeJournal folder in media library?

It should be filtered.

The recipe journal filter should not even exist on a 1.10.1 install, as the recipe journal was removed from Orchard. Is this site an upgrade from an earlier version, with the Media folder contents migrated?


Add and modify templates for SNAX

In this PR, we:

Add the SNAX definition to the the schema (located in docs) so that SNAX is disabled by default regardless if it was declared in the core templates or not.
Modify the snitch cluster template to add the default SNAX during snitch cluster generation.
Add a custom configuration that anyone can use if needed. It also follows the initial architecture SNAX has: 1 SNAX core and 1 DMA core.

Before building, make sure you create a generated directory under the repo/target/snitch_cluster/ path. Then invoke:
/repo/target/snitch_cluster/../../util/clustergen.py -c cfg/snax.hjson -o /repo/target/snitch_cluster/generated --wrapper

Under the same repo/starget/snitch_cluster/ path.
@xiaoling-yi Please remind me to teach you why these files are important. Just so that you can get up to speed! I think @JosseVanDelm  knows these already.
NOTE: This PR is next after #13

Before building, make sure you create a generated directory under the repo/target/snitch_cluster/ path. Then invoke:
/repo/target/snitch_cluster/../../util/clustergen.py -c cfg/snax.hjson -o /repo/target/snitch_cluster/generated --wrapper

Under the same repo/starget/snitch_cluster/ path.

This seems like a useful time to switch over to automated testing in CI, please add a workflow that runs all examples with the new configuration before merging

@JosseVanDelm and @xiaoling-yi the last 2 commits do the following:

First we have a separate test list found under target/snitch_cluster/sw/test/ called snax-run.yaml which is a copy of the run.yaml BUT with some tests not included because those tests require the multi-core setting. Or rather, require all 9 cores which we don't do in SNAX.

Here are a few details about the excluded tests. I won't discuss in detail because I can only trace what happened so far. I spent hours trying to debug only to find out these tests require multicore settings. You could see some of the runs in the github actions log we have.

event_unit.c - this literally waits for an interrupt response from other cores. If you trace the original code, the SNAX (core 0) will be issuing commands to other cores but it expects other compute cores because it skips the DMA core.
openmp_parallel.c is waiting for a response from 8 different cores.
openmp_for_static_schedule - this one is harder to trace but the code somewhat implies it's dispatching tasks on 8 threads (8 cores)
team_global.c - this literally asks if the 9 cores exist so it doesn't make sense at all to run on SNAX.

I had to separate the CI for the SNAX test only because it was convenient or easier to test a separate set of tests. Might be useful also for later. I tested if the matrix in CI works, it does but I got stuck figuring out how to separate the tests in a single job run. It's possible if we use conditionals in the .yml, but I figured this is more elegant only because it logs also a separate set of tests for SNAX.

Bump @JosseVanDelm or @xiaoling-yi please review so we can merge these today and have a playground for tests :)


Add NetworkPolicy

Overview
Add the ability to create a network policy with customizable egress
What this PR does / why we need it
Network policies are a best practice.
Specifically when deploying in a NS already containing network policies, it is required.
Special notes for your reviewer
N/A
Checklist

[x] Change log updated in Chart.yaml (see the contributing guide for details)
[x] Chart version bumped in Chart.yaml (see the contributing guide for details)
[x] Documentation regenerated by running make docs

Network policy is extremely use case specific IMO. I haven't really seen open source projects bundling network policies with their deployment manifests, but I may be wrong.
Can you find some examples from the ecosystem?

@sagikazarmark I wouldn't say that security is use case specific, having network policies enabled is a best practice.
Anyway, I haven't searched much but some of prometheus-community charts have it and almost all of bitnami charts have it.

@mkilchhofer I've just rebased my PR can you give your approval (again) ?

@mkilchhofer Sorry about the misunderstanding!

@sagikazarmark Have you seen https://github.com/dexidp/helm-charts/pull/74#pullrequestreview-1095560543 ? Are those examples enough for you ? If so, can you approve the PR ?

Maybe squash merge would be nice @sagikazarmark


Make the Automated Smoke Test faster

Testing #27456
On my Surface Book running the integration tests took 14m.
I would expect the integration tests to run a lot faster. Some ideas:

keep the VS Code window opened between tests
only if a test fails initially, rerun the test with a fresh VS Code window (and increased timeouts)

Performance is improved


Fix python venv creation in init.sh and pip deps installation in install-pythonpackages.sh

TLDR

Changes on init.sh is to solve an issue that couldn't create a python virtual environment.
Change on install-pythonpackages.sh and requirements.txt is to solve an issue that couldn't install gym==0.21.0

Tested on both Ubuntu 22.04 (jammy) and Ubuntu 20.04 (focal).
Code changes on init.sh
Both on Ubuntu 22.04 (jammy) and Ubuntu 20.04 (focal), I encountered an issue while running init.sh
Error: Command '['$HOME/$USER/CyberBattleSim/venv/bin/python3', '-Im', 'ensurepip', '--upgrade', '--default-pip']' returned non-zero exit status 1.

It seems python -m venv venv didn't create a virtual environment as expected.
Since we already installed virtualenv
https://github.com/microsoft/CyberBattleSim/blob/bb9f70116f9252feebcefc6de5f000a26e955798/init.sh#L106-L107
I change to use virtualenv to create a virtual environment, and it works.
Code changes on install-pythonpackages.sh
After resolving the issue above, the environment was set up perfectly on Ubuntu 20.04 (focal). But I found gym==0.21.0 couldn't be installed on Ubuntu 22.04.
The outputs were like
Collecting gym==0.21.0
  Using cached gym-0.21.0.tar.gz (1.5 MB)
  Preparing metadata (setup.py) ... done
Collecting numpy>=1.18.0 (from gym==0.21.0)
  Downloading numpy-1.24.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 12.5 MB/s eta 0:00:00
Collecting cloudpickle>=1.2.0 (from gym==0.21.0)
  Using cached cloudpickle-2.2.1-py3-none-any.whl (25 kB)
Building wheels for collected packages: gym
  Building wheel for gym (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─
  ...
 raise InvalidRequirement(str(e)) from e
      wheel.vendored.packaging.requirements.InvalidRequirement: Expected end or semicolon (after version specifier)
          opencv-python>=3.
                       ~~~^
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for gym
  Running setup.py clean for gym
Failed to build gym
ERROR: Could not build wheels for gym, which is required to install pyproject.toml-based projects

I found these two related issues:

[Bug Report] Building wheel for gym (setup.py) ... error · Issue #3202 · openai/gym (github.com)
Insufficient Requirements in Documentation to Install (Specifically Gym 0.21.0) · Issue #23 · netneurolab/conn2res (github.com)

And then I checked the installed wheel on  Ubuntu 20.04 and Ubuntu 22.04:
Ubuntu 20.04 focal
(venv) pip list | grep wheel
wheel                    0.34.2

Ubuntu 22.04 jammy
(venv) pip list | grep wheel
wheel                    0.40.0

So I added a line to install-pythonpackages.sh and the issue was resolved.
$PYTHON -m pip install wheel==0.38.4

您好，您的邮件我已收到，
看到后，我会立即回复您。
This is an automatic reply, confirming that your e-mail was received.Thank you

@microsoft-github-policy-service agree

Thank you @vokey for submitting the PR!
The other PR #106 that was just submitted should resolve all problems with initializing the environment. With this change, all the dependencies get installed via conda instead of apt and pip. The packages venv and virtualenv are thus not needed anymore.

Thank you @vokey for submitting the PR!
The other PR #106 that was just submitted should resolve all problems with initializing the environment. With this change, all the dependencies get installed via conda instead of apt and pip. The packages venv and virtualenv are thus not needed anymore.

Cool, that's awesome. I'll close this PR then.


⚠ Bofrost.at has degraded performance

In 075b1e3, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1157 ms

Resolved: Bofrost.at performance has improved in f1b0045.


SE-309: Covariant erasure for dependent member types

This change enables us to access existential members when their type signatures, as seen in the context of the base type, reference Self-rooted associated types only in covariant positions, by type-erasing these references to their upper bounds. This implies that you can use a protocol value to call a method that returns an associated type, or a method that accepts one if the associated type is bound to a fully concrete type via generic requirements on the protocol. Accessing these members becomes possible because their types are adjusted so as to become well-defined from outside their protocol context, which is key to type-safe member accesses on a type-erased value.
protocol P {
  associatedtype A: P
  func method1() -> A
  func method2(_: A)
}
protocol PBool: P where A == Bool {}

func test(p: P, pBool: PBool) {
  let _: P = p.method1() // ok, p.method1 has type () -> P

  pBool.method2(true) // ok, pBool.method2 has type (Bool) -> Void
}

@swift-ci please smoke test

@swift-ci please smoke test macOS

@swift-ci please smoke test macOS

@swift-ci please clean smoke test macOS

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please test source compatibility

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test macOS

@swift-ci please clean smoke test Linux

@swift-ci please test source compatibility

@slavapestov This is finally ready for another review.

@swift-ci please smoke test

Ah, looks like some minor bit-rot due to the change in the signature of transformRec. @AnthonyLatsis would you like to fix things up to get this merged, or would you like some help?

@DougGregor Already at it!

@swift-ci please smoke test

@swift-ci please smoke test

@DougGregor Thanks for reviewing!


connect to mongodb on aws ec2 ubuntu

Hi Team,
I have mongo db running on mongodb on aws ec2 ubuntu.
Below is code :
bot = ChatBot(
    'IVLI',
    storage_adapter='chatterbot.storage.MongoDatabaseAdapter',
    database='chatterbot-database',
    database_uri='mongodb://ec2-52-66-113-108.ap-south-1.compute.amazonaws.com:27017',
    logic_adapters=[
        {
            'import_path': 'chatterbot.logic.BestMatch',
            "response_selection_method": "chatterbot.response_selection.get_random_response"

        },
        {
            'import_path': 'chatterbot.logic.LowConfidenceAdapter',
            'threshold': 0.60,
            'default_response': 'I am sorry, but I do not understand.'
        },

    ],
    preprocessors=['chatterbot.preprocessors.clean_whitespace','chatterbot.preprocessors.unescape_html','chatterbot.preprocessors.convert_to_ascii'],
    silence_performance_warning=True,
    trainer='chatterbot.trainers.ChatterBotCorpusTrainer',
    filters=["chatterbot.filters.RepetitiveResponseFilter"]
)

But i am getting below error:
  File "C:\Python27\lib\site-packages\pymongo\helpers.py", line 210, in _check_command_response
    raise OperationFailure(msg % errmsg, code, response)
pymongo.errors.OperationFailure: not authorized on chatterbot-database to execute command { createIndexes: "statements", indexes: [ { unique: true, name: "text_1", key: { text: 1 } } ], writeConcern: {} }

Any help would be appriciated,I spent almost a day on it & not able to figure out cause.

@bainadeashish From the error console log, this issue was with Mongo DB driver issue, not an chatterbot issue.
I hunch could be the firewall issue, Recently i registered with Mongo DB course, One learning was

In order to continue in this course, you must be able to make outgoing requests from your computer to database servers we have set up in MongoDB Atlas. Those servers run on port 27017 in Amazon AWS.
Please confirm that port 27017 is not blocked by clicking http://portquiz.net:27017.
If successful, you will see a page load that indicates you can make outgoing requests on port 27017.
If a page does not load and your request eventually times out, outgoing traffic to port 27017 is probably blocked on your local network. If this is the case, please contact your IT department to see if there is a workaround or try to make the request from another location.

Apart from this information I am googled your issues, some of the solution i found are

https://community.bitnami.com/t/pymongo-errors-operationfailure-not-authorized-on-mydb-to-execute/44164/2
https://stackoverflow.com/a/41871203/358458

Let me know if you need any further help from us

@vkosuri If i use mongodb without authentication then there is know issue.
But when i use authentication i am getting above error.
Wha t is code to pass username & pwd to mongodb instanace?Because while creating chatterbot instanace we are just passing url without authentication info.Please see below
database_uri='mongodb://ec2-52-66-113-108.ap-south-1.compute.amazonaws.com:27017'
Let me know how to pass username & password at this point.

Here is the standard connection string format Mongo db suggested
mongodb://[username:password@]host1[:port1][,host2[:port2],...[,hostN[:portN]]][/[database][?options]]

In your case, it could be like this
database_uri='mongodb://username:password@ec2-52-66-113-108.ap-south-1.compute.amazonaws.com:27017

thanks this is thing i needed:)
big thank you:)


Add docs detailing how to uninstall EKS-A Cilium

Summary
This PR adds documentation detailing how a user can uninstall the EKS Anywhere Cilium CNI and provides e2e walk throughs of the process.

/lgtm

/approve

/cherry-pick release-0.15


After using this package texfield is not moving up with the keyboard

Before using this package texfield was going up with keyboard but when I used this package for my splash screen, I think it somehow damaged my layout and now the texfield is having some issue. It does not go up with the keyboard now.

https://stackoverflow.com/questions/62102445/textfield-hiding-under-keyboard-flutter/62102617?noredirect=1#comment109859624_62102617
I posted the issue in StackOverflow thinking I have made mistakes in the layout but I came to know that after using this package to build splash screen for my app, the problem came.


The design of RoutableDoc for Bulk Action

I have few comments for RoutableDoc. For me it seems a bit intrusive to implement this interface for the json data within a bulk request. If I've a model that is shared between different services (each is using for different internal usage storage, query, etc), implementing RoutableDoc exposes the internals of my repository to these services. The caller has to understand that index is something internal to OpenSearch and doesn't have any specific meaning in that model. I can create a generic model without Index variable and then use a wrapper struct on top of it to implement RoutableDoc. However, this is again an extra object for the sake of implementing RoutableDoc. Wouldn't it be simpler to have json.Raw or IoReader instead and provide the dedicated fields index and id within bulk action? Furthermore, there can be cases where the Id of the document can be derived from a different logic (ID() and Index() functions are called multiple times so a dynamic implementation of them is not optimal) or the Id generation is left to OpenSearch. WDYT?

A couple different points to break down.

Model that is shared between different services
I would argue this model should not implement RoutableDoc. Like you said, RoutableDoc is very much an implementation of needs for OpenSearch. For the majority of usecases, a document needs to be routable to a specific index. So that implementation should be left to the internal model that interfaces with OpenSearch.

Not a very strong argument, but this is same pattern that popular ElasticSearch libraries use like the oliere elastic library.

Id generation is left to OpenSearch
This is definitely a bug we have in our flow. I don't think we can do a create bulk action without providing a non empty id. Which is not valid, since you can leave OpenSearch to generate the ID for a new document.

dynamic implementations of ID() and Index()
I think if they're dynamic or simple accessors is up to the implementers of the interface.

I think overall I'm not very attached to the RoutableDoc being a necessity for the bulk actions. I do think that it is convenient, but that convenience is built a lot from habit of my past experience with the olivere elastic library.

I think removing RoutableDoc would be a bad direction.
The main reason is that switching to "raw" JSON converts a compile time error (you must pass in a type that can provide an ID and index) to a runtime one where we'll have to inspect the generated JSON for correctness.

Id generation is left to OpenSearch

I assume that one would let the Open Search server generate IDs by not passing one.  With RoutableDoc, that's trivial to implement by having a ID() return an empty string.  If we have code that's erroring out for that case then we can re-evaluate that logic.
On the topic of efficiency, something will have to do the work of determining which index each document should be routed to.  This interface defines that contract as concisely as possible and the expectation is that consumers would implement that logic.
For both ID and index, the DocumentRef type is a trivial implementation but any consumer of the library is free (encouraged, in fact) to provide their own if there's more logic needed.

a model that is shared between different services

IMO this goes against the fundamental idea of microservices.  Two services should not be sharing a model.  I'd even go so far as to argue that the storage and API layers of a single service shouldn't be sharing model types.

we'll have to inspect the generated JSON for correctness.

With having ioreader to consume the json and index and id additional variables, then I don't think we'll have to inspect the generate Json: if the provided body of the json is not correct then that's on the caller. I agree having a struct implementing reduces this issues and body is always generated from the passed model.

I assume that one would let the Open Search server generate IDs by not passing one

For the use case, where all the Bulk actions are routed to the same index (provided in the request) and IDs will be generated by OpenSearch (used in a plenty of usecases). The dummy implementation of Index() and ID() will be useless. True we can have empty string for IDs but wouldn't it be cleaner to have an option in the request that says if the IDs generation is delegated to OpenSearch or not?

For both ID and index, the DocumentRef type is a trivial implementation

True but by the first look, without going into the doc details, It doesn't really shows if these should be used only as accessor or not. I learnt by doing some tests that Index() is called multiple times, hence, I shouldn't not have any complex logic defined within Index(). For me RoutableDoc looks more like a Java interface where methods are generally the accessors :)

IMO this goes against the fundamental idea of microservices.

True, but the anti-pattern of sharing models between services (usually in monorepo) (at storage level -->  ingestor and api) is commonly used. Sharing has both pros and cons (both at services and storage, API level).
This is just from my PoV and I think it could have been simpler (cleaner) for the caller to have dedicated variables for Index, ID instead of using the interface implementation.

Ultimately you want a
NewCreateWithoutRoutingBulkAction(doc any)

Where it would no-op on both index and id? I don't think that's a terrible utility usecase to support.

It doesn't really shows if these should be used only as accessor or not

If it's just an accessor or not is entirely up to the consumer. All the library cares about is getting the index and id value. I think I still fail to see the problem with this.

RoutableDoc looks more like a Java interface where methods are generally the accessors

It absolutely is. Otherwise we couldn't have the RoutableDoc anything. We'd have to either have three methods for everything that uses a document:
// names are bad here
New*WithDoc(doc any)
New*WithDocAndID(id string, doc any)
New*WithDocAndFullRouting(id, index string, doc any)

Or always ask for all three items. By having the "accessor" java-like interface, this allows us to have a simpler more generic signature.

Ok got it.
What I was referring to have something like this:
type BulkAction struct {
	Type BulkActionType
	Doc  IoReader
        Index string
        ID   string
}

and then
NewCreateBulkAction(doc IoReader, index, ID string) and. NewCreateBulkAction(doc IoReader)
Same for the reader part: opensearchtools.ReadDocument takes the Routable Doc by we don't need index in it. The search request should be based on the index or alias.
But I agree moving away from Routable Doc will require quite some work.


Bookstore: add reducers and actions

In this branch:

Added redux toolkit
Set up reducers and actions for books.js and categories.js
Configured store in configureStore.js and combined all reducer functions.

Hi @Wahaj-Ali ,
Good job so far! There are some issues that you still need to work on to go to the next project but you are almost there!

Highlights
✅ Correct use of Gitflow ✅ No linter error ✅ Organised code
Required Changes ♻

[x]  Kindly include the future features in your readme for it to be more proffessional

Optional suggestions
N/A Every comment with the [OPTIONAL] prefix is not crucial enough to stop the approval of this PR. However, I strongly recommend you to take them into account as they can make your code better.
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear. Please, remember to tag me in your question so I can receive the notification.
Please, do not open a new Pull Request for re-reviews. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise.
As described in the Code reviews limits policy you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.

@frank1738 thank you for your suggestion. I am going to make the changes 😄


Considerations on destroying and spawning objects

The way we currently handle objects we don't clean anything up after we destroy them. Therefore, if we give their slot away for someone else later we will end up with objects that have residual components from earlier objects that don't belong to them.
Consider:

is it ok to just never reuse slots?

this might work alright with heavy usage of Pools
maybe even mandatory (automatic?) pooling for every recipe? This would potentially allow some nice memory layout optimizations even up to not needing different Storage types at all

if not, how do we clean up?

attach a generation number to every component?
require a list of all containers in the FeatureSet from the user? (would allow some nice automations + remove need for the IterSeed thing, but create error-prone boilerplate)

Obsolete after #38


Fix SDWebImageDownloaderOperation not call done when use SDWebImageDownloaderIgnoreCachedResponse

New Pull Request Checklist

[x] I have read and understood the CONTRIBUTING guide

[x] I have read the Documentation

[x] I have searched for a similar pull request in the project and found none

[x] I have updated this branch with the latest master to avoid conflicts (via merge from master or rebase)

[x] I have added the required tests to prove the fix/feature I am adding

[x] I have updated the documentation (if necessary)

[x] I have run the tests and they pass

[x] I have run the lint and it passes (pod lib lint)

This merge request fixes / reffers to the following issues: ...
Pull Request Description
@bpoplauschi  Sorry to bother. In #2032 I adopt the previous behavior and add a cache image check. But there is a mistake that the early return code in line 475 will cause [self done] not been called. It will not mark this operation to be completed and may cause problems(such as memory leak, logic error. SD itself will be safe but our users may add KVO to this NSOperation. And maybe this is why all the tests is passed with no issues). So I advice to fix it as soon as possible(Maybe another little patch release?). 😢

The fix looks ok, I totally missed this. Should we release a 4.1.2 patch before people start complaining? :)

@bpoplauschi It's better to merge it to master soon. And I may need a little more time(less than one day) to review other changes marked 4.1.1 milestone again. After that I think a patch version is more suitable.

Ok @dreampiggy I am merging this. Please let me know when you are done with the review and if I can help in any way.


feat: Init bootstrap source

Looks good I think. :)

@phatpham9 are you going to accept this or shall I do it?

@chauduong1192 the travis-ci should be updated to have npm deployment & mattermost notification

Hi @phatpham9, please give the secure of mattermost notification.

@chauduong1192 seems like the travis ci is failing. Will you look into this when you get the time?


Enable Access of Header Values from a Chain

Closes https://github.com/LucasPickering/slumber/issues/184#issuecomment-2081204155
This MR adds an additional component enum to the chain request variant. This allows users to pull a certain header value and use it in other requests.
Currently this is limited to a single header retrieval
Tested with the following collection:
chains:
  auth_token:
    source: !request
      recipe: login
      section: !header Token

requests:
  login: !request
    # This returns headers with {"token": "abc123"}
    method: POST
    url: "http://localhost:5000/login"
    body: |
      {}

  send_header_token_from_chain: !request
    method: POST
    url: "http://localhost:5000/test"
    body: |
      {}
    headers:
      Token: "{{chains.auth_token}}"

Checklist

[ ] Did you update CHANGELOG.md?

Only user-facing changes belong in the changelog. Internal changes such as refactors should only be included if they'll impact users, e.g. via performance improvement.

[x] Did you remove all TODOs?

If there are unresolved issues, please open a follow-on issue and link to it in a comment so future work can be tracked

Current todos:

[x] Decide on naming for component, is something more specific needed
[x] Add tests

Thought about it some more, I think "section" is a better word than component. They're basically the same but I just wanted to avoid component because that word is already used in the UI architecture so I just want to make it easier to search for etc. Do you mind updating all the type/field names to match that?
Also, the PR is still in draft mode, could you move it to ready please?

Agreed on this, have resolved all comments and merged latest master. Do I need to add changelog changes here?


some doubts creating own server cloud instance

Hello,
I launched a server instance and the system correctly manages the data between QGIS and QField (this is great!!!).
There are some things I don't understand:

my COMPOSE_FILE is still the default (COMPOSE_FILE=docker-compose.yml:docker-compose.override.local.yml).
I don't understand what changes I need to make to go into production...
the /var/local/qfieldcloud folder does not contain any files
if I open the page relating to a PERSON and click on "View on site" I see this error

Similar errors appear on the website when I perform some actions.

Can you give me some suggestions? Thank you
Paolo

Thank you for running QFieldCloud.
I cannot provide detailed answers on what you are dealing with, but I can try my best to guess.

You are running a local development version of QFieldCloud. If you want to use the production version, you should use COMPOSE_FILE=docker-compose.yml:docker-compose.override.yml. Note it is required to provide external Object Storage (s3) and PostGIS database services, they are not part of QFC stack.
not clear what you mean. Where is /var/local/qfieldcloud  located?
Confirmed error, added in the backlog to be fixed. See https://github.com/opengisch/qfieldcloud/issues/842

I am closing this issue as it is more a support request. If you need professional support, please contact us on<EMAIL_ADDRESS>


Setting autostyle always true in public views

Related to #11392
This PR sets autostyle to true in public views.
Acceptance

Delete the auto-style FF of your user.
Set a map with autostyle widgets. That is, select a map with category and histogram widgets.
In private and public views, autostyle icons should show up in both widgets.

Deploy
Remember to purge caches

Deleted the feature flag in staging. Tested category and histogram widgets in Builder and embed. Everything is ✅
Waiting for backend tests and deploying.


Allow multiple Body panes from different nodes, other than the selected one. (Mirror LeoInteg #259)

Those 'body panes' opened aside, (other than the main body pane), stay opened until the node's gnx becomes invalid/deleted, or it's commander is closed.
To be implemented as a (yet) another 'fake' file system. :)
(Mirror this feature in LeoInteg's #259 also!)

Note: Instead of creating another fake file system, The fragment part of the URI  (after the gnx path) could be used to signify that that body is an 'open aside' to be kept open aside and stay locked on that gnx.

Instead of fragments, simply prepending the commander's id separated with as slash from the gnx might be better.
Eg. 123/leoid123456789.1

I'll still use another distinct file system scheme for those 'detached' body editors for a fixed gnx. This will allow to selectively permit or disallow commands.

This is now in 0.2.13 beta ! 😮


Inconsistency between package.yaml and hamler.cabal

Hi, The hamler.cabal file is automatically generated by hpack. If you want to commit a new version of the package.yaml file, I think you should also commit the new version of the hamler.cabal file or remove the hamler.cabal file from the repository.
/path/to/hamler/hamler.cabal was modified manually. Ignoring /path/to/hamler/package.yaml in favor of the cabal file.
If you want to use the package.yaml file instead of the cabal file,
then please delete the cabal file.

@sio-funmatsu The issue has been fixed in PR #211


Use padding-top on modal-window instead of margin-top on modal-inner

The margin-top on modal-inner pushes scrolled content outside the viewport if you have a lot of content inside the modal.
My solution right now is to use padding-top on modal-window instead.

@ryanburnette thank you! I merged this in.


Release 165

Hi @dependabot[bot],
It seems you haven't yet signed a CLA. Please do so here.
Once you do that we will be able to review and accept this pull request.
Thanks!


Feedback on portal UI deployment

Creating this issue to consolidate feedback on the custom portal UI:
https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Favdaccelerator%2Fem-customui%2F01-avd-framework.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Favdaccelerator%2Fem-customui%2FPortalDefinitions%2F01-landingzone.json

Some initial comments:

New scaling tab: There should be an scaling tab to let you you choose if using start vm on connect or scaling plan (once it is GA).
Components tab: depending on the automation option selected the custom role should be created if it doesn't exist and the RBAC permissions assignment created, maybe we could show a message saying this will be done, but don't see a reason for the option since deploying the role is mandatory for the feature to work. (this could be moved to the scaling tap if we create it).
Components tab: we should have an option to deploy an empty application group for remote apps.
Host pool settings tab, we could add and advanced option with a text box field to enter specific RDP properties
Idenity: don't see an option for authentication (ADDS or AADDS), for the MVP we could just show a message about it on the network section. on the network section stating that the subnet hosting the session hosts needs to have line of sight to the identity service (ADDS or AADDS).
Network: when selecting existing vNet, we should show a message stating  that the subnet hosting the session hosts needs to have line of sight to the identity service (ADDS or AADDS).
Network: when selecting to create a new vNet we should ask for vNet where ADDS or AADDS exist to create peering (we could remove the new vNet option on the MVP).


how to solve this please help, thanks

===================================BUG REPORT===================================
The following directories listed in your path were found to be non-existent: {WindowsPath('tmp/restart')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 8.6.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cuda118.so...
argument of type 'WindowsPath' is not iterable
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_1a
CUDA SETUP: Solution 1c): For a permanent solution add the export from 1b into your .bashrc file, located at ~/.bashrc
CUDA SETUP: Solution 2: If no library was found in step 1a) you need to install CUDA.
CUDA SETUP: Solution 2a): Download CUDA install script: wget https://github.com/TimDettmers/bitsandbytes/blob/main/cuda_install.sh
CUDA SETUP: Solution 2b): Install desired CUDA version to desired location. The syntax is bash cuda_install.sh CUDA_VERSION PATH_TO_INSTALL_INTO.
CUDA SETUP: Solution 2b): For example, "bash cuda_install.sh 113 ~/local/" will download CUDA 11.3 and install into the folder ~/localWARNING:dreambooth.optimization:Exception importing 8bit AdamW:
CUDA Setup failed despite GPU being available. Please run the following command to get more information:
    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

Traceback (most recent call last):
File "C:\Users\muneer\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\optimization.py", line 594, in get_optimizer
from bitsandbytes.optim import AdamW8bit
File "C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes_init_.py", line 6, in
from . import cuda_setup, utils, research
File "C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research_init_.py", line 1, in
from . import nn
File "C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research\nn_init_.py", line 1, in
from .modules import LinearFP8Mixed, LinearFP8Global
File "C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research\nn\modules.py", line 8, in
from bitsandbytes.optim import GlobalOptimManager
File "C:\Users\muneer\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\optim_init_.py", line 6, in
from bitsandbytes.cextension import COMPILED_WITH_CUDA

Same issue!

Same issue!

RuntimeError:
CUDA Setup failed despite GPU being available. Please run the following command to get more information:
    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "A:\SD\stable-diffusion-webui\modules\script_loading.py", line 26, in preload_extensions
module = load_module(preload_script)
File "A:\SD\stable-diffusion-webui\modules\script_loading.py", line 10, in load_module
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "A:\SD\stable-diffusion-webui\extensions-builtin\LDSR\preload.py", line 2, in
from modules import paths
File "A:\SD\stable-diffusion-webui\modules\paths.py", line 61, in
import sgm  # noqa: F401
File "A:\SD\stable-diffusion-webui\repositories\generative-models\sgm_init.py", line 1, in
from .models import AutoencodingEngine, DiffusionEngine
File "A:\SD\stable-diffusion-webui\repositories\generative-models\sgm\models_init_.py", line 1, in
from .autoencoder import AutoencodingEngine
File "A:\SD\stable-diffusion-webui\repositories\generative-models\sgm\models\autoencoder.py", line 6, in
import pytorch_lightning as pl
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning_init_.py", line 35, in
from pytorch_lightning.callbacks import Callback  # noqa: E402
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks_init_.py", line 14, in
from pytorch_lightning.callbacks.batch_size_finder import BatchSizeFinder
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks\batch_size_finder.py", line 24, in
from pytorch_lightning.callbacks.callback import Callback
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks\callback.py", line 25, in
from pytorch_lightning.utilities.types import STEP_OUTPUT
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\utilities\types.py", line 27, in
from torchmetrics import Metric
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\torchmetrics_init_.py", line 14, in
from torchmetrics import functional  # noqa: E402
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional_init_.py", line 120, in
from torchmetrics.functional.text._deprecated import bleu_score as bleu_score
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text_init.py", line 50, in
from torchmetrics.functional.text.bert import bert_score  # noqa: F401
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text\bert.py", line 23, in
from torchmetrics.functional.text.helper_embedding_metric import (
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text\helper_embedding_metric.py", line 27, in
from transformers import AutoModelForMaskedLM, AutoTokenizer, PreTrainedModel, PreTrainedTokenizerBase
File "", line 1075, in _handle_fromlist
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\import_utils.py", line 1076, in getattr
module = self._get_module(self._class_to_module[name])
File "A:\SD\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\import_utils.py", line 1088, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.modeling_utils because of the following error (look up to see its traceback):
    CUDA Setup failed despite GPU being available. Please run the following command to get more information:

    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "A:\SD\stable-diffusion-webui\launch.py", line 48, in
main()
File "A:\SD\stable-diffusion-webui\launch.py", line 39, in main
prepare_environment()
File "A:\SD\stable-diffusion-webui\modules\launch_utils.py", line 400, in prepare_environment
run_extensions_installers(settings_file=args.ui_settings_file)
File "A:\SD\stable-diffusion-webui\modules\launch_utils.py", line 268, in run_extensions_installers
run_extension_installer(path)
File "A:\SD\stable-diffusion-webui\modules\launch_utils.py", line 235, in run_extension_installer
errors.report(str(e))
File "A:\SD\stable-diffusion-webui\modules\errors.py", line 29, in report
record_exception()
File "A:\SD\stable-diffusion-webui\modules\errors.py", line 17, in record_exception
from modules import sysinfo
File "A:\SD\stable-diffusion-webui\modules\sysinfo.py", line 13, in
from modules import paths_internal, timer, shared, extensions, errors
File "A:\SD\stable-diffusion-webui\modules\shared.py", line 5, in
from modules import shared_cmd_options, shared_gradio_themes, options, shared_items, sd_models_types
File "A:\SD\stable-diffusion-webui\modules\shared_cmd_options.py", line 10, in
script_loading.preload_extensions(extensions_builtin_dir, parser)
File "A:\SD\stable-diffusion-webui\modules\script_loading.py", line 31, in preload_extensions
errors.report(f"Error running preload() for {preload_script}", exc_info=True)
File "A:\SD\stable-diffusion-webui\modules\errors.py", line 29, in report
record_exception()
File "A:\SD\stable-diffusion-webui\modules\errors.py", line 18, in record_exception
exception_records.append(sysinfo.format_exception(e, tb))
AttributeError: partially initialized module 'modules.sysinfo' has no attribute 'format_exception' (most likely due to a circular import)
Press any key to continue . . .

I tried deleting the 'ven' folder, and the SD web UI starts. However, when I attempt to check for any updates, the software stops working and gives me the error mentioned above.
Thanks for your attention

i'm having same issue.  new WebUI install does same.  deleting venv... same..

Same issue here. I found that removing roop from extensions works on one install but nothing I can do to get the backup install to work at all>>>
===================================BUG REPORT===================================
Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cuda_setup\main.py:166: UserWarning: Welcome to bitsandbytes. For bug reports, please run
python -m bitsandbytes
warn(msg)
The following directories listed in your path were found to be non-existent: {WindowsPath('tmp/restart')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 7.5.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cuda118.so...
argument of type 'WindowsPath' is not iterable
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_1a
CUDA SETUP: Solution 1c): For a permanent solution add the export from 1b into your .bashrc file, located at ~/.bashrc
CUDA SETUP: Solution 2: If no library was found in step 1a) you need to install CUDA.
CUDA SETUP: Solution 2a): Download CUDA install script: wget https://github.com/TimDettmers/bitsandbytes/blob/main/cuda_install.sh
CUDA SETUP: Solution 2b): Install desired CUDA version to desired location. The syntax is bash cuda_install.sh CUDA_VERSION PATH_TO_INSTALL_INTO.
CUDA SETUP: Solution 2b): For example, "bash cuda_install.sh 113 ~/local/" will download CUDA 11.3 and install into the folder ~/local
Traceback (most recent call last):
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\import_utils.py", line 1086, in get_module
return importlib.import_module("." + module_name, self.name)
File "C:\Users\Mastertouch\AppData\Local\Programs\Python\Python310\lib\importlib_init.py", line 126, in import_module
return _bootstrap.gcd_import(name[level:], package, level)
File "", line 1050, in gcd_import
File "", line 1027, in find_and_load
File "", line 1006, in find_and_load_unlocked
File "", line 688, in load_unlocked
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\transformers\modeling_utils.py", line 85, in
from accelerate import version as accelerate_version
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\accelerate_init.py", line 3, in
from .accelerator import Accelerator
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 35, in
from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\accelerate\checkpointing.py", line 24, in
from .utils import (
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils_init.py", line 131, in
from .bnb import has_4bit_bnb_layers, load_and_quantize_model
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils\bnb.py", line 42, in
import bitsandbytes as bnb
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes_init.py", line 6, in
from . import cuda_setup, utils, research
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research_init.py", line 1, in
from . import nn
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research\nn_init.py", line 1, in
from .modules import LinearFP8Mixed, LinearFP8Global
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\research\nn\modules.py", line 8, in
from bitsandbytes.optim import GlobalOptimManager
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\optim_init.py", line 6, in
from bitsandbytes.cextension import COMPILED_WITH_CUDA
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py", line 20, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Please run the following command to get more information:
    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "Q:\AUTO1111\stable-diffusion-webui\launch.py", line 48, in
main()
File "Q:\AUTO1111\stable-diffusion-webui\launch.py", line 44, in main
start()
File "Q:\AUTO1111\stable-diffusion-webui\modules\launch_utils.py", line 432, in start
import webui
File "Q:\AUTO1111\stable-diffusion-webui\webui.py", line 13, in
initialize.imports()
File "Q:\AUTO1111\stable-diffusion-webui\modules\initialize.py", line 16, in imports
import pytorch_lightning  # noqa: F401
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning_init_.py", line 35, in
from pytorch_lightning.callbacks import Callback  # noqa: E402
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks_init_.py", line 14, in
from pytorch_lightning.callbacks.batch_size_finder import BatchSizeFinder
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks\batch_size_finder.py", line 24, in
from pytorch_lightning.callbacks.callback import Callback
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\callbacks\callback.py", line 25, in
from pytorch_lightning.utilities.types import STEP_OUTPUT
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\pytorch_lightning\utilities\types.py", line 27, in
from torchmetrics import Metric
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\torchmetrics_init_.py", line 14, in
from torchmetrics import functional  # noqa: E402
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional_init_.py", line 82, in
from torchmetrics.functional.text.bleu import bleu_score
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text_init_.py", line 30, in
from torchmetrics.functional.text.bert import bert_score  # noqa: F401
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text\bert.py", line 24, in
from torchmetrics.functional.text.helper_embedding_metric import (
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\torchmetrics\functional\text\helper_embedding_metric.py", line 26, in
from transformers import AutoModelForMaskedLM, AutoTokenizer, PreTrainedModel, PreTrainedTokenizerBase
File "", line 1075, in _handle_fromlist
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\import_utils.py", line 1076, in getattr
module = self._get_module(self._class_to_module[name])
File "Q:\AUTO1111\stable-diffusion-webui\venv\lib\site-packages\transformers\utils\import_utils.py", line 1088, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.modeling_utils because of the following error (look up to see its traceback):
    CUDA Setup failed despite GPU being available. Please run the following command to get more information:

    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

Press any key to continue . . .

i had same issue just uninstalled bitsandbytes and reinstalled it as shown and it works file:
pip uninstall bitsandbytes
python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

can confirm this worked.

Thanks let me try this and will give you the feedback

It didn't work for me :(

i had same issue just uninstalled bitsandbytes and reinstalled it as shown and it works file:
pip uninstall bitsandbytes python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

It work for me （windows11 environment）

Sorry for the dumb noob question. But where/how would one use these?

A recent update:
deleting Roop plugin and ven folder it did the trick for me.

i had same issue just uninstalled bitsandbytes and reinstalled it as shown and it works file:
pip uninstall bitsandbytes python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

It work for me （windows11 environment）

where do you run that from?

Refere

can confirm this worked.

i had same issue just uninstalled bitsandbytes and reinstalled it as shown and it works file:
pip uninstall bitsandbytes python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

this worked for me on windows 11, thanks

Bitsandbytes was not supported windows before, but my method can support windows.（yuhuang）
1  open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD
or WIN+R, CMD  。enter，cd /d J:\StableDiffusion\sdwebui
2  J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes
3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows
4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl
Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

Bitsandbytes was not supported windows before, but my method can support windows.（yuhuang） 1 open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD or WIN+R, CMD 。enter，cd /d J:\StableDiffusion\sdwebui 2 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes
3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows
4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl
Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

what exactly do you mean by Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）?

i had same issue just uninstalled bitsandbytes and reinstalled it as shown and it works file:
pip uninstall bitsandbytes python -m pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

Thank you so much


fix frozenset + list and unsupport styles parameter

I found this bug  when trying to delete a sub-items on my homepage.

Exception Value: unsupported operand type(s) for +: 'frozenset' and 'list'

See #2054 - but at least you have supplied a fix. Let's hope it gets merged.


Problem: cert_file issue with get_url and python 3.12

Issue
Encountering an issue when running against hosts such as Ubuntu 24.04 LTS. The version of python on these hosts begins at python 3.12.3. The issues I am running into in the semaphore output
#15
—
TASK [ansible-role-direnv : Fetch install script "direnv"] *********************
12:19:41 PM
An exception occurred during task execution. To see the full traceback, use -vvv. The error was: TypeError: HTTPSConnection.__init__() got an unexpected keyword argument 'cert_file'
12:19:41 PM
fatal: [dev05.lan]: FAILED! => {"changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 and not [200]: An unknown error occurred: HTTPSConnection.__init__() got an unexpected keyword argument 'cert_file'", "

The issue is that cert_file and key_file are deprecated parameters and is best documented in ansible here: https://github.com/ansible/ansible/issues/80490
Impact
Ansible (task execution), Semaphore Project
Installation method
Docker
Browser
No response
Semaphore Version
v2.9.75
Ansible Version
This is an ansible issue, I am assuming it begins with the version of ansible inside the semaphore docker image

ansible [core 2.14.5]
  config file = None
  configured module search path = ['/home/semaphore/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python3.11/site-packages/ansible
  ansible collection location = /home/semaphore/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/bin/ansible
  python version = 3.11.8 (main, Feb 19 2024, 22:58:08) [GCC 12.2.1 20220924] (/usr/bin/python3)
  jinja version = 3.1.2
  libyaml = True

Internal python is 3.11.8

### Logs & errors

_No response_

### Manual installation - system information

_No response_

### Configuration

_No response_

### Additional information

- digging into this, the "fix" appears to be backported to ansible 2.15.  But recommend bumping anisble to latest (2.16)

Contributions are welcome, just upgrade ansible from 9.4.0 to 9.6.0 until renovate gets activated for this project:
https://github.com/semaphoreui/semaphore/blob/develop/deployment/docker/server/Dockerfile#L52
https://github.com/semaphoreui/semaphore/blob/develop/deployment/docker/runner/Dockerfile#L52
:)

In the meantime you should be able to upgrade ansible by mounting a requirements.txt to /etc/semaphore with a version constraint.

@tboerger It might take me a few days to get back to this.  But I will attempt to report back any findings.  Thanks for the suggestions

@tboerger
So my environment at work is pretty dumb, so I took the low bridge approach of creating the requirements.txt.  Ansible now returns as
ansible [core 2.16.7]
  config file = None
  configured module search path = ['/home/semaphore/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/semaphore/.local/lib/python3.11/site-packages/ansible
  ansible collection location = /home/semaphore/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/bin/ansible
  python version = 3.11.8 (main, Feb 19 2024, 22:58:08) [GCC 12.2.1 20220924] (/usr/bin/python3)
  jinja version = 3.1.2
  libyaml = True

Unfortunately, this must not be as back ported as I was led to believe as I still receive the following error
 1:07:19 PM
fatal: [dev06.lan]: FAILED! => {"changed": false, "dest": "/usr/local/bin/yq", "elapsed": 0, "msg": "An unknown error occurred: HTTPSConnection.__init__() got an unexpected keyword argument 'cert_file'", "url": "https://github.com/mikefarah/yq/releases/latest/download/yq_linux_amd64"}
1:07:19 PM
fatal: [dev05.lan]: FAILED! => {"changed": false, "dest": "/usr/local/bin/yq", "elapsed": 0, "msg": "An unknown error occurred: HTTPSConnection.__init__() got an unexpected keyword argument 'cert_file'", "url": "https://github.com/mikefarah/yq/releases/latest/download/yq_linux_amd64"}
1:07:19 PM

I am starting to think the dockerfile approach may be the best and the version of alpine needs to be bumped to 3.20 as this appears to be when python 3.12 makes it into the alpine repos

@tboerger
So I pulled the latest semaphore docker image today: v2.9.109-e32ce6b-1716748351

The primary issue appears now resolved
Cannot just call ansible on the cli anymore, needs the full path to the executable in the venv

Having said that, I believe this ticket can be closed. If the issue comes up again I will open a new ticket


Flipping the layout manually

i want to do manual flip i mean card must follow the finger not automatically flip how can i do?  did anyone do it?

@emreakcan I know its very late. But, finally I managed to create manual flipping and created a new library called as EasyFlipViewPager. You can check the Poker Card Demo to see how you can achieve manual flipping with that library 😄


Quick attach/reattach file open issue

Steps To Reproduce
Details: https://github.com/criblio/appscope/pull/1110#issuecomment-1265808778
The EPERM errno translates to fact that the operation was prevented by a file seal.
I can confirm that after following part of the code I can see:
    fd = scope_open(path, O_RDONLY);
    if (fd == -1) {
        scope_perror("scope_open O_RDONLY() of dynamic config file");
        // return EXIT_FAILURE;
    } else {
        int fres = scope_fcntl(fd, F_GET_SEALS);
        scope_fprintf(scope_stderr, "fcntl get_seal %d", fres); //F_SEAL_SEAL
        scope_close(fd);
    }

Why is this problem occurred for /dev/shm and not for /tmp due to fact that:
The default set of seals depends on the type of
       the underlying file and filesystem.

/dev/shm/ is type of tmpfs  -> https://github.com/torvalds/linux/blob/b90cb1053190353cc30f0fef0ef1f378ccc063c5/mm/shmem.c#L2338
/tmp/.. is type of ext4 -> where in similar situation fres == -1 and errno is set to EINVAL which means that filesystem does not support sealing.
Possible approaches to avoid the problem:

change the location for the dynamic configuration file to the filesystem which doesn't support sealing
in the situation when a file is a present wait in the loader till it will be consumed by a process with library (receiver)
in a situation when a file is present unlink the file before creating a new - unlink on the sender side

Reproduction steps:
htop
sudo ldscope -a `pidof htop`
sudo ldscope -d `pidof htop`
sudo ldscope -a `pidof htop`
sudo ldscope -a `pidof htop`

See that there is no message on console like mentioned in https://github.com/criblio/appscope/pull/1110#issuecomment-1265808778


Remove redundant executeAsync in parallel operators in tests

It is no longer necessary because async boundaries should be inserted automatically

Hey Avasil, I would like to pick this issue.


mybatis insert returns the number of inserted rows not the generated id

The User.id should be long and in the mapper interface the addUser method should look like this:
@Insert("insert into user (email, userName) values (#{email}, #{userName})")
@SelectKey(keyProperty = "id", resultType = long.class, before = false, statement = "CALL SCOPE_IDENTITY()")
public int addUser(User user);

It will still return the number of inserted records (always 1 in this case) but after service call you can get the generated id with User.getId() in MyBatisApplication.run method

I also want this feature

Try this
@Insert("insert into user (email, userName) values (#{email}, #{userName})")
@Options(useGeneratedKeys = true, keyProperty = "id", keyColumn = "id")
public int addUser(User user);
Once you finish insert operation, the User's setId() method will be invoked, and is set to id of last inserted record. You can use user.getId() to get the last insert id.