Freeze your script with Pyinstaller

Hi,
You might want to freeze your script into a standalone executable to run on any system without the need of installing python or face_recognition and maybe you want to create a demo for your application and want to give it to someone else without giving your source code. Here is a simple tutorial to do that. I tested this method with python3.6 on Windows 10, but I think you can get it working on Linux with a similar method.

Make sure you have correctly installed both face_recognition and dlib and you see no error when importing them into your script.
Make sure your script works fine, and all its dependencies are right next to it, and you can run it fine with python yourscript.py.
Install Pyinstaller with pip:
pip install pyinstaller
Create a new directory and move your python script and all dependencies into it. I call it myproject and myscript.py
Copy face_recognition_models and scipy-extra-dll from your python installed directory to your project directory.
Create an empty file called <yourscriptname>.spec like myscript.spec next to your python script.
Use below Pyinstaller spec file sample and edit some parts according to your needs: (I mark it with <> tag)

# -*- mode: python -*-

block_cipher = None

face_models = [
('.\\face_recognition_models\\models\\dlib_face_recognition_resnet_model_v1.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\mmod_human_face_detector.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_5_face_landmarks.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_68_face_landmarks.dat', './face_recognition_models/models'),
]

a = Analysis(['<your python script name.py>'],
             pathex=['<path to working directory>'],
             binaries=face_models,
             datas=[],
             hiddenimports=['scipy._lib.messagestream', 'scipy', 'scipy.signal', 'scipy.signal.bsplines', 'scipy.special', 'scipy.special._ufuncs_cxx',
                            'scipy.linalg.cython_blas',
                            'scipy.linalg.cython_lapack',
                            'scipy.integrate',
                            'scipy.integrate.quadrature',
                            'scipy.integrate.odepack',
                            'scipy.integrate._odepack',
                            'scipy.integrate.quadpack',
                            'scipy.integrate._quadpack',
                            'scipy.integrate._ode',
                            'scipy.integrate.vode',
                            'scipy.integrate._dop', 'scipy._lib', 'scipy._build_utils','scipy.__config__',
                            'scipy.integrate.lsoda', 'scipy.cluster', 'scipy.constants','scipy.fftpack','scipy.interpolate','scipy.io','scipy.linalg','scipy.misc','scipy.ndimage','scipy.odr','scipy.optimize','scipy.setup','scipy.sparse','scipy.spatial','scipy.special','scipy.stats','scipy.version'],

             hookspath=[],
             runtime_hooks=[],
             excludes=[],
             win_no_prefer_redirects=False,
             win_private_assemblies=False,
             cipher=block_cipher)

a.datas += Tree('./scipy-extra-dll', prefix=None)

pyz = PYZ(a.pure, a.zipped_data,
             cipher=block_cipher)
exe = EXE(pyz,
          a.scripts,
          a.binaries,
          a.zipfiles,
          a.datas,
          name='<your python script name>',
          debug=False,
          strip=False,
          upx=True,
          runtime_tmpdir=None,
          console=True )

Generate your executable with python -m pyinstaller myscript.spec
If you see no error then your executable can be found in dist directory.
Enjoy!

Thanks to @ageitgey and @davisking for their awesome work.

Cool, thanks for sharing!

I found this worked very well when running on Windows desktop, but the application would crash on Windows Server 2012 - 2016 with an unhelpful, vague unable to execute DLL error. I found this issue was caused by using the latest version of dlib linked above (19.9.99 at this time). However, by using 'pip install dlib', which installs 19.9.0 (again, at this time). The frozen executable is running without errors on both desktop and server. I've also been testing freezing this in both 32-bit and 64-bit python and both are working. Thanks

@vgreis I haven't tested Pyinstaller with the new version of dlib  but I think you can get it working by just add the missing DLL's to binaries it will then be extracted when running the app and again remember that it doesn't matter if you install dlib by source or pip, just make sure your installation is successful.

Thanks! It works

Incompatible library version: dlib.so requires version 51.0.0 or later, but libpng16.16.dylib provides version 38.0.0

@inewlife Can you post the complete error log? I haven't tested this method with the new version of dlib but I think it is not related because what you need here is just adding scipy and face_recognition_modules manually not the dlib itself.

I did as what the first floor told,but still got this:
Traceback (most recent call last):
File "C:\PyInstaller-3.3.1\temp_classroom.py", line 16, in
import face_recognition
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 655, in load_unlocked
File "C:\PyInstaller-3.3.1\PyInstaller\loader\pyimod03_importers.py", line 631
, in exec_module
exec(bytecode, module.dict)
File "C:\ProgramData\Anaconda3\Lib\site-packages\face_recognition_init.py"
, line 7, in
from .api import load_image_file, face_locations, batch_face_locations, face
_landmarks, face_encodings, compare_faces, face_distance
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 655, in _load_unlocked
File "C:\PyInstaller-3.3.1\PyInstaller\loader\pyimod03_importers.py", line 631
, in exec_module
exec(bytecode, module.dict)
File "C:\ProgramData\Anaconda3\Lib\site-packages\face_recognition\api.py", lin
e 21, in
pose_predictor_5_point = dlib.shape_predictor(predictor_5_point_model)
RuntimeError: Unable to open C:\Users\ADMINI~1\AppData\Local\Temp_MEI71042\face
_recognition_models\models\shape_predictor_5_face_landmarks.dat
[5948] Failed to execute script temp_classroom
how did the  exe file come to this dir ?
and _MEI71042 changes every time the exe file run

@fordffx Hi,
As I said in the first post you must first install all dependencies for your python. About the _MEI71042, every time you run the executable pyinstaller tries to extract dependencies in the temp directory and when your program ends without exception it deletes that folder automatically,

i replaced
datas=[]
with
datas=[('shape_predictor_68_face_landmarks.dat','./face_recognition_models/models'),('shape_predictor_5_face_landmarks.dat','./face_recognition_models/models'),('mmod_human_face_detector.dat','./face_recognition_models/models'),('dlib_face_recognition_resnet_model_v1.dat','./face_recognition_models/models')]
that works,thanks

thanks for sharing your knowledge...i can't find scipy-extra-dll ...how i can to find them in python directory??i am in ubuntu 16.04,
thank you in advance

@roiksail Hi, dll files are not made for Linux systems so you can't find any. I think you don't need to add scipy dependencies. Just build your binary file and try to run it. If It complains about some files just find that and add it manually like above method. That is it.

thank you so much,i mmaked executable application in ubuntu but when i copied this file in ubuntu then it was simply file and it does not executed,how i fix this??

@roiksail I think you need to find out what is Pyinstaller and how to use it in from here. In general, after you run the command you should find the executable with the exact name of the script. I think Pyinstaller will make the file as executable binary so you can just use ./yourscriptname command and if it didn't work try to make it executable with sudo chmod +x yourscriptname. That is it.

@vgreis thanks, when I build use dlib from github source code, The version is 19.10.99, It can only run on x64 system, and when I use pip install dlib, the version is 19.10.0, It can run on x86 system

@masoudr
I'm not find scipy-extra-dll in my site-packages, should I need install scipy?
1, when I am not install scipy, I can run face_recognition, Is scipy necessary?
2, I install scipy, and copy scipy dir from site-packages to project dir, with a.datas += Tree('./scipy-extra-dll', prefix=None), I can't find scipy-extra-dll, but I find extra-dll in scipy dir, can I write scipy/extra-dll instead it or not
thank you

@sincerefly Hi, If I remember correctly there are some examples that need scipy so if you are using scipy with your project you need those files but if you don't,  just use face_models no need for hidden imports that is it. And remember you just need to first freeze your script normally and if you got any errors about missing packages, you need to feed them manually in your spec file.

@masoudr Can you please explain to me how can I get the face_recognition_models/**/*.dat resources added from the .spec file? It does not seem to work for me. It says unable to open shape_predictor_68_face_landmarks.dat for some reason.
So far, I have tried:

Creating with --onedir

Adding the files to the directory and then running pyinstaller with --onedir.

@tinshade I've already added all 4 model files in the example above, you just need to use the above sample spec file and fill parameters and this should solve your problem. But if you still need to add other models you can just add this to your spec file.
a = Analysis(...
     datas= [ ('face_recognition_models/**/*.dat', './face_recognition_models/models' ) ],
     ...
     )

i already install Pyinstaller, and while i check the directory its true no module name Pyinstaller. when i check in /home/attendance/anaconda3/envs/attendance_env/bin/python3.6/site-packages i find the module.
(attendance_env) attendance@attendance-desktop:~/Documents/face_attendance$ python -m Pyinstaller attendance.spec
/home/attendance/anaconda3/envs/attendance_env/bin/python: No module named Pyinstaller

can u help me

@alexpardede I'm not familiar with Conda but I would suggest you first check your naming, it is case sensitive (python -m PyInstaller). Second, you can check your installed modules with pip freeze. Also if you have any problem with installing PyInstaller you should ask in its repo.

thansk for your help. python -m PyInstaller work for me. but i didn't
solve the step 5 cause i don't know where i can find the module
[image: image.png]
[image: image.png]
and in step 5. how to copy face_recognition models to project directory. i
didn't find the module. can u help me to solve this step ?
[image: image.png]
thank you for your help.
Pada tanggal Jum, 29 Mar 2019 pukul 00.41 Masoud R. <
<EMAIL_ADDRESS>menulis:

@alexpardede https://github.com/alexpardede I'm not familiar with Conda
but I would suggest you first check your naming, it is case sensitive (python
-m PyInstaller). Second, you can check your installed modules with pip
freeze. Also if you have any problem with installing PyInstaller you
should ask in its repo https://github.com/pyinstaller/pyinstaller.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ageitgey/face_recognition/issues/357#issuecomment-477689748,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ap6Yx00vbFHCqupMPLV5tSqekZmWJrBTks5vbPidgaJpZM4SBU9b
.

can you help me for this error ? i already have face-recognition-models while i check with pip freeze. and i already create and execute the attendance.spec. please help me. Thank You

can you help me for this error ? i already have face-recognition-models while i check with pip freeze. and i already create and execute the attendance.spec. please help me. Thank You

try to copy the dependencies that open fail to your output dependencies dir, its helpful for me

thanks. i already done with this problem.
thanks for your attention
Pada tanggal Jum, 29 Mar 2019 pukul 13.40 zkywalker <
<EMAIL_ADDRESS>menulis:

[image: image]
https://user-images.githubusercontent.com/43948231/55208909-a86b3d00-5212-11e9-98ad-a0cbe52b89c1.png
can you help me for this error ? i already have face-recognition-models
while i check with pip freeze. and i already create and execute the
attendance.spec. please help me. Thank You
try to copy the dependencies that open fail to your output dependencies
dir, its helpful for me
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ageitgey/face_recognition/issues/357#issuecomment-477886736,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ap6Yx6GTHAJC9j0_Ykg63C7l4oytf0h5ks5vbbVtgaJpZM4SBU9b
.

i have new issue.  my main script refere to a other script. and the script call library "frozen_inference_graph_face.pb" from another folder. can you help me to solve the problem  ?
thank for your attention.

i have new issue. my main script refere to a other script. and the script call library "frozen_inference_graph_face.pb" from another folder. can you help me to solve the problem ?
thank for your attention.

lol, the solution is same to dependencies no find, just copy them to the output dependencies dir. And its helpful when you do not use the -f arg, which will generate a file with all dependencies in it.

sorry brother. but i already copy to the output dependencies dir. and i'm
not using -f  arg. if the file in the different dependencies i don't show
the issue.
Pada tanggal Jum, 29 Mar 2019 pukul 18.37 zkywalker <
<EMAIL_ADDRESS>menulis:

[image: image]
https://user-images.githubusercontent.com/43948231/55227664-aae98900-524a-11e9-83e9-ecf4a1f0f4f7.png
i have new issue. my main script refere to a other script. and the script
call library "frozen_inference_graph_face.pb" from another folder. can you
help me to solve the problem ?
thank for your attention.
lol, the solution is same to dependencies no find, just copy them to the
output dependencies dir. And its helpful when you do not use the -f arg,
which will generate a file with all dependencies in it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ageitgey/face_recognition/issues/357#issuecomment-477966958,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ap6Yx8igtJPtrNZHJIMjicVA64RecNN_ks5vbfr0gaJpZM4SBU9b
.

[image: image.png]
can you help me with this problem ?
[image: image.png]
i already insert the library. please help me
thank you
Pada tanggal Jum, 29 Mar 2019 pukul 00.41 Masoud R. <
<EMAIL_ADDRESS>menulis:

@alexpardede https://github.com/alexpardede I'm not familiar with Conda
but I would suggest you first check your naming, it is case sensitive (python
-m PyInstaller). Second, you can check your installed modules with pip
freeze. Also if you have any problem with installing PyInstaller you
should ask in its repo https://github.com/pyinstaller/pyinstaller.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ageitgey/face_recognition/issues/357#issuecomment-477689748,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ap6Yx00vbFHCqupMPLV5tSqekZmWJrBTks5vbPidgaJpZM4SBU9b
.

Hello I am facing following issue

I found this worked very well when running on Windows desktop, but the application would crash on Windows Server 2012 - 2016 with an unhelpful, vague unable to execute DLL error. I found this issue was caused by using the latest version of dlib linked in the project install guide under issue 175 (currently 19.9.99). However, by using 'pip install dlib', which installs 19.9.0 (again, currently as of writing this). The frozen executable is running without errors on both desktop and server. I've also been testing freezing this in both 32-bit and 64-bit python and both are working. Thanks

sorry to bother you.I don't understand.is 19.9.0dlib installed in the computer which pyinstaller the file or in winserver2012?My my application can run in my windows computer,but it can't work on my windows server2012.And my dlib package can't be uninstalled completely now....

I found this worked very well when running on Windows desktop, but the application would crash on Windows Server 2012 - 2016 with an unhelpful, vague unable to execute DLL error. I found this issue was caused by using the latest version of dlib linked in the project install guide under issue 175 (currently 19.9.99). However, by using 'pip install dlib', which installs 19.9.0 (again, currently as of writing this). The frozen executable is running without errors on both desktop and server. I've also been testing freezing this in both 32-bit and 64-bit python and both are working. Thanks

sorry to bother you.I don't understand.is 19.9.0dlib installed in the computer which pyinstaller the file or in winserver2012?My my application can run in my windows computer,but it can't work on my windows server2012.And my dlib package can't be uninstalled completely now....

maybe you could try building the latest version of dlib on the target platform

31 INFO: PyInstaller: 3.5
32 INFO: Python: 3.6.9
32 INFO: Platform: Linux-5.0.0-37-generic-x86_64-with-Zorin-15-bionic
33 INFO: UPX is not available.
35 INFO: Extending PYTHONPATH with paths
['/home/ragesh/Desktop/myproject', '/home/ragesh/Desktop/myproject']
35 INFO: checking Analysis
35 INFO: Building Analysis because Analysis-00.toc is non existent
35 INFO: Initializing module dependency graph...
36 INFO: Initializing module graph hooks...
37 INFO: Analyzing base_library.zip ...
2303 INFO: Analyzing hidden import 'scipy._lib.messagestream'
2704 INFO: Processing pre-find module path hook   distutils
3588 INFO: Processing pre-safe import module hook   setuptools.extern.six.moves
3886 INFO: Processing pre-find module path hook   site
3886 INFO: site: retargeting to fake-dir '/home/ragesh/.local/lib/python3.6/site-packages/PyInstaller/fake-modules'
6109 INFO: Analyzing hidden import 'scipy.signal'
7681 INFO: Processing pre-safe import module hook   six.moves
11696 INFO: Processing pre-safe import module hook   gi.repository.GObject
13029 INFO: Analyzing hidden import 'scipy.special._ufuncs_cxx'
13029 INFO: Analyzing hidden import 'scipy.linalg.cython_blas'
13029 INFO: Analyzing hidden import 'scipy.linalg.cython_lapack'
13029 INFO: Analyzing hidden import 'scipy._build_utils'
13050 INFO: Analyzing hidden import 'scipy.cluster'
13126 INFO: Analyzing hidden import 'scipy.fftpack'
13157 INFO: Analyzing hidden import 'scipy.io'
13332 INFO: Analyzing hidden import 'scipy.odr'
13370 INFO: Analyzing hidden import 'scipy.setup'
13374 INFO: running Analysis Analysis-00.toc
13399 INFO: Caching module hooks...
13402 INFO: Analyzing script.py
13455 INFO: Loading module hooks...
13455 INFO: Loading module hook "hook-scipy.py"...
13456 INFO: Loading module hook "hook-PyQt5.QtGui.py"...
13537 INFO: Loading module hook "hook-PyQt5.QtCore.py"...
13556 INFO: Loading module hook "hook-pytz.py"...
13557 INFO: Loading module hook "hook-scipy.io.matlab.py"...
13557 INFO: Loading module hook "hook-PyQt5.py"...
15933 WARNING: Hidden import "PyQt5.sip" not found!
15933 INFO: Loading module hook "hook-scipy.sparse.csgraph.py"...
15935 INFO: Loading module hook "hook-PIL.Image.py"...
16323 INFO: Loading module hook "hook-numpy.core.py"...
16450 INFO: Loading module hook "hook-matplotlib.backends.py"...
16934 INFO:   Matplotlib backend "GTK": ignored
Gtk* backend requires pygtk to be installed.
17828 INFO:   Matplotlib backend "GTKAgg": ignored
Gtk* backend requires pygtk to be installed.
18071 INFO:   Matplotlib backend "GTKCairo": ignored
No module named 'gtk'
18409 INFO:   Matplotlib backend "MacOSX": ignored
cannot import name '_macosx'
18768 INFO:   Matplotlib backend "Qt4Agg": added
19143 INFO:   Matplotlib backend "Qt5Agg": added
19489 INFO:   Matplotlib backend "TkAgg": added
19828 INFO:   Matplotlib backend "WX": ignored
Matplotlib backend_wx and backend_wxagg require wxPython >=2.8.12
20167 INFO:   Matplotlib backend "WXAgg": ignored
Matplotlib backend_wx and backend_wxagg require wxPython >=2.8.12
20577 INFO:   Matplotlib backend "GTK3Cairo": added
/usr/lib/python3/dist-packages/matplotlib/backends/backend_gtk3agg.py:17: UserWarning: The Gtk3Agg backend is known to not work on Python 3.x with pycairo. Try installing cairocffi.
"The Gtk3Agg backend is known to not work on Python 3.x with pycairo. "
20998 INFO:   Matplotlib backend "GTK3Agg": added
21604 INFO:   Matplotlib backend "WebAgg": added
21889 INFO:   Matplotlib backend "nbAgg": ignored
No module named 'IPython'
22229 INFO:   Matplotlib backend "agg": added
22570 INFO:   Matplotlib backend "cairo": added
22813 INFO:   Matplotlib backend "gdk": ignored
No module named 'gobject'
23129 INFO:   Matplotlib backend "pdf": added
23491 INFO:   Matplotlib backend "pgf": added
23784 INFO:   Matplotlib backend "ps": added
24135 INFO:   Matplotlib backend "svg": added
24474 INFO:   Matplotlib backend "template": added
24651 INFO: Processing pre-safe import module hook   gi.repository.Gtk
24651 INFO: Processing pre-safe import module hook   gi.repository.Gdk
24651 INFO: Processing pre-safe import module hook   gi.repository.GLib
24749 INFO: Loading module hook "hook-pkg_resources.py"...
25087 INFO: Processing pre-safe import module hook   win32com
25093 INFO: Loading module hook "hook-distutils.py"...
25093 INFO: Loading module hook "hook-matplotlib.py"...
25337 INFO: Loading module hook "hook-pydoc.py"...
25338 INFO: Loading module hook "hook-setuptools.py"...
25761 INFO: Loading module hook "hook-gi.repository.GObject.py"...
25898 WARNING: Hidden import "gi._gobject" not found!
25898 INFO: Loading module hook "hook-lib2to3.py"...
25899 INFO: Loading module hook "hook-_tkinter.py"...
25974 INFO: checking Tree
25974 INFO: Building Tree because Tree-00.toc is non existent
25974 INFO: Building Tree Tree-00.toc
25979 INFO: checking Tree
25979 INFO: Building Tree because Tree-01.toc is non existent
25979 INFO: Building Tree Tree-01.toc
25981 INFO: Loading module hook "hook-gi.py"...
25981 INFO: Loading module hook "hook-scipy.linalg.py"...
25982 INFO: Loading module hook "hook-encodings.py"...
26029 INFO: Loading module hook "hook-gi.repository.Gtk.py"...
28333 INFO: Processing pre-safe import module hook   gi.repository.xlib
28334 INFO: Processing pre-safe import module hook   gi.repository.Atk
28334 INFO: Loading module hook "hook-scipy.special._ufuncs.py"...
28334 INFO: Loading module hook "hook-PIL.py"...
28337 INFO: Excluding import 'tkinter'
28339 INFO:   Removing import of tkinter from module PIL.ImageTk
28339 INFO: Import to be excluded not found: 'FixTk'
28340 INFO: Excluding import 'PyQt5'
28341 INFO:   Removing import of PyQt5.QtGui from module PIL.ImageQt
28341 INFO:   Removing import of PyQt5.QtCore from module PIL.ImageQt
28342 INFO: Excluding import 'PyQt4'
28344 INFO: Excluding import 'PySide'
28347 INFO: Loading module hook "hook-PyQt5.QtWidgets.py"...
28411 INFO: Loading module hook "hook-scipy.special._ellip_harm_2.py"...
28411 INFO: Loading module hook "hook-xml.etree.cElementTree.py"...
28412 INFO: Loading module hook "hook-cv2.py"...
28412 INFO: Loading module hook "hook-numpy.py"...
28412 INFO: Loading module hook "hook-sysconfig.py"...
28418 INFO: Loading module hook "hook-gi.repository.GLib.py"...
28610 INFO: Loading module hook "hook-xml.py"...
28623 INFO: Loading module hook "hook-PIL.SpiderImagePlugin.py"...
28627 INFO: Excluding import 'tkinter'
28628 INFO: Import to be excluded not found: 'FixTk'
28628 INFO: Loading module hook "hook-gi.repository.Gdk.py"...
28741 INFO: Processing pre-safe import module hook   gi.repository.cairo
28742 INFO: Processing pre-safe import module hook   gi.repository.Pango
28743 INFO: Processing pre-safe import module hook   gi.repository.Gio
28743 INFO: Processing pre-safe import module hook   gi.repository.GdkPixbuf
28743 INFO: Loading module hook "hook-gi.repository.GdkPixbuf.py"...
28744 WARNING: "hook-gi.repository.GdkPixbuf" ignored, since GDK not found (i.e., "gdk-pixbuf-query-loaders" not in $PATH).
28744 INFO: Loading module hook "hook-gi.repository.xlib.py"...
28840 INFO: Loading module hook "hook-gi.repository.cairo.py"...
28944 INFO: Loading module hook "hook-gi.repository.Pango.py"...
29049 INFO: Loading module hook "hook-gi.repository.Atk.py"...
29155 INFO: Loading module hook "hook-gi.repository.Gio.py"...
29617 INFO: Looking for ctypes DLLs
29718 WARNING: library user32 required via ctypes not found
29754 INFO: Analyzing run-time hooks ...
29766 INFO: Including run-time hook 'pyi_rth_mplconfig.py'
29768 INFO: Including run-time hook 'pyi_rth_mpldata.py'
29768 INFO: Including run-time hook 'pyi_rth_glib.py'
29769 INFO: Including run-time hook 'pyi_rth_gdkpixbuf.py'
29771 INFO: Including run-time hook 'pyi_rth_gio.py'
29771 INFO: Including run-time hook 'pyi_rth_gtk.py'
29772 INFO: Including run-time hook 'pyi_rth__tkinter.py'
29773 INFO: Including run-time hook 'pyi_rth_pyqt5.py'
29774 INFO: Including run-time hook 'pyi_rth_gi.py'
29776 INFO: Including run-time hook 'pyi_rth_multiprocessing.py'
29779 INFO: Including run-time hook 'pyi_rth_pkgres.py'
29797 INFO: Looking for dynamic libraries
34474 INFO: Looking for eggs
34474 INFO: Python library not in binary dependencies. Doing additional searching...
34499 INFO: Using Python library /usr/lib/x86_64-linux-gnu/libpython3.6m.so.1.0
34538 INFO: Warnings written to /home/ragesh/Desktop/myproject/build/script/warn-script.txt
34637 INFO: Graph cross-reference written to /home/ragesh/Desktop/myproject/build/script/xref-script.html
36326 INFO: Appending 'binaries' from .spec
Unable to find ".\face_recognition_models\models\dlib_face_recognition_resnet_model_v1.dat" when adding binary and data files.

Help me with this.

I can't find the scipy-extra-dll  in windows although I installed scipy. Help me.

@Ragesh77 I haven't tested the new version. But check if you can import scipy without any problem and then double-check the file existence. If you still can't find it skip it and check if the executable works or not.

@masoudr Hey Than

@Ragesh77 I haven't tested the new version. But check if you can import scipy without any problem and then double-check the file existence. If you still can't find it skip it and check if the executable works or not.
@masoudr  Thanks for answering. I downgraded scipy to 1.3.0 and could locate all the files.

I can't find the scipy-extra-dll in windows although I installed scipy. Help me.

You can search extra-dll using below code on cmd
dir extra-dll /s /p
I hope you will find it in scipy directory. After create scipy-extra-dll directory.
Then all dll files transfer to scipy-extra-dll directory.

Hi,
You might want to freeze your script into a standalone executable to run on any system without the need of installing python or face_recognition and maybe you want to create a demo for your application and want to give it to someone else without giving your source code. Here is a simple tutorial to do that. I tested this method with python3.6 on Windows 10 but I think you can get it working on Linux with similar method.

Make sure you have correctly installed both face_recognition and dlib correctly and you see no error when importing them into your script.
Make sure your script works fine and all it dependencies are right next to it and you can run it fine with python yourscript.py.
Install Pyinstaller with pip:
pip install pyinstaller
Create a new directory and move your python script and all dependencies into it. I call it myproject and myscript.py
Copy face_recognition_models and scipy-extra-dll from your python installed directory to your project directory.
Create an empty file called <yourscriptname>.spec like myscript.spec next to your python script.
Use below Pyinstaller spec file sample and edit some parts according to your needs: (I mark it with <> tag)

# -*- mode: python -*-

block_cipher = None

face_models = [
('.\\face_recognition_models\\models\\dlib_face_recognition_resnet_model_v1.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\mmod_human_face_detector.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_5_face_landmarks.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_68_face_landmarks.dat', './face_recognition_models/models'),
]

a = Analysis(['<your python script name.py>'],
             pathex=['<path to working directory>'],
             binaries=face_models,
             datas=[],
             hiddenimports=['scipy._lib.messagestream', 'scipy', 'scipy.signal', 'scipy.signal.bsplines', 'scipy.special', 'scipy.special._ufuncs_cxx',
                            'scipy.linalg.cython_blas',
                            'scipy.linalg.cython_lapack',
                            'scipy.integrate',
                            'scipy.integrate.quadrature',
                            'scipy.integrate.odepack',
                            'scipy.integrate._odepack',
                            'scipy.integrate.quadpack',
                            'scipy.integrate._quadpack',
                            'scipy.integrate._ode',
                            'scipy.integrate.vode',
                            'scipy.integrate._dop', 'scipy._lib', 'scipy._build_utils','scipy.__config__',
                            'scipy.integrate.lsoda', 'scipy.cluster', 'scipy.constants','scipy.fftpack','scipy.interpolate','scipy.io','scipy.linalg','scipy.misc','scipy.ndimage','scipy.odr','scipy.optimize','scipy.setup','scipy.sparse','scipy.spatial','scipy.special','scipy.stats','scipy.version'],

             hookspath=[],
             runtime_hooks=[],
             excludes=[],
             win_no_prefer_redirects=False,
             win_private_assemblies=False,
             cipher=block_cipher)

a.datas += Tree('./scipy-extra-dll', prefix=None)

pyz = PYZ(a.pure, a.zipped_data,
             cipher=block_cipher)
exe = EXE(pyz,
          a.scripts,
          a.binaries,
          a.zipfiles,
          a.datas,
          name='<your python script name>',
          debug=False,
          strip=False,
          upx=True,
          runtime_tmpdir=None,
          console=True )

Generate your executable with python -m pyinstaller myscript.spec
If you see no error then your executable can be found in dist directory.
Enjoy!

Thanks to @ageitgey and @davisking for their awesome work.

Thanks for everything all guys. I did what you said and I created an exe file successfully. But when I click exe file it's working only once then suddenly closes. Before close it says something but I don't read because it is so fastly close. How can I fix this problem

@HAKANMAZI Try to run executable with CMD and you should get the error in the console. Then put the error.

Can Someone help me in deploying this app in docker.I searched google nothing is clear.Could someone guide me?

@Ragesh77  It is not an app. But if you trying to deploy your app with docker you can follow this.

@HAKANMAZI Try to run executable with CMD and you should get the error in the console. Then put the error.

Thanks @masoudr ;  output error below
T

raceback (most recent call last):
File "C:\Users\HH\Desktop\python\exe\test.py", line 94, in
openCamera()
File "C:\Users\HH\Desktop\python\exe\test.py", line 66, in openCamera
predictions = predict(facePath, model_path=model_path)
File "C:\Users\HH\Desktop\python\exe\test.py", line 30, in predict
knn_clf = pickle.load(f)
ModuleNotFoundError: No module named 'sklearn'
[14372] Failed to execute script test
[ WARN:0] global C:\projects\opencv-python\opencv\modules\videoio\src\cap_msmf.cpp (674) SourceReaderCB::~SourceReaderCB terminating async callback

@HAKANMAZI Your error is not related to this tutorial (because you are using sklearn which is another module), but you can use this.

hello I am new to this freezer part,
I have made a separate folder as mentioned and move my python script and models in it.
also i copied the freezer script(.spec) file. finally i got the build giving the error "ImportError: No module named 'face_recognition'"
Please help me with it I am using anaconda, and not using scipy.
I have attached the freezer script also
freeze_app .txt

@daynial132 First make sure that your script is working fine in your environment also you must be sure that you run PyInstaller from your environment (with using python -m PyInstaller). I think you are running the PyInstaller from your main Python installation which doesn't have face_recognition.

@masoudr I have placed my python script,3 pics and the freezer file (.spec) and the face_recognition_models in the folder only. do I need any thing else?
I have check my python script to run on my anaconda shell, it is running fine that's mean dlib and face_recognition lib is installed properly. Am i right or missing some thing?
Also I have used anaconda shell to run (python -m PyInstaller) command.
Thank you for your reply

@daynial132 I haven't tested this with Conda yet, but I don't think it would be a problem. Your error means that PyInstaller can't find the face_recognition. Try to run pip freeze inside your console and make sure that face_recognition exists in the output. If it is there but you still get that error try to add face_recognition into the hidden_imports as I did for the scipy modules.

I am having this output after freezing my code with this .spec file below. When I run my app on console on Linux I get this:
Traceback (most recent call last):
  File "main.py", line 6, in <module>
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "/home/neo/Desktop/faseez/dev/refasee/venv/lib/python3.6/site-packages/PyInstaller/loader/pyimod03_importers.py", line 623, in exec_module
    exec(bytecode, module.__dict__)
  File "face_recognition/__init__.py", line 7, in <module>
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "/home/neo/Desktop/faseez/dev/refasee/venv/lib/python3.6/site-packages/PyInstaller/loader/pyimod03_importers.py", line 623, in exec_module
    exec(bytecode, module.__dict__)
  File "face_recognition/api.py", line 20, in <module>
RuntimeError: Unable to open /tmp/_MEIHAOamS/face_recognition_models/models/shape_predictor_68_face_landmarks.dat
[11437] Failed to execute script main

Fascee.spec.txt

@mend4x Make sure that you have the shape_predictor_68_face_landmarks.dat when building the project. Also if the error came double check that the shape_predictor_68_face_landmarks.dat exists in the given path (e.g /tmp/_MEIHAOamS/face_recognition_models/models).

@masoudr I actually do have this file in script directory. The given path is tmp so each time it runs it's new directory

@mend4x Double check that the files in models directory and also when you run the script check the tmp directory and verify the file and its size.

@masoudr   我的问题是，打包的时候没有问题，打包后，点击exe 只有小黑窗口，程序没办法运行。
界面没办法显示。请教您帮忙

窗口提示：
Fatal Python error: initfsencoding:
unable to load the file system codec zipimport.ZipImportError:
can't find module' encodings

Thank you sooooooooooooooooooooooooooooooooo much! :)

hi Masoud Rahimi
please help me i cant seem to find spicy-extra-dll

THANK YOU SO MUCH BRO!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Error loading Python DLL 'C:\Users\91880\Desktop\application\python310.dll'. getting this error please help.

@divyangana009 This is a basic error that I think might be related to PyInstaller itself. Have you tried freezing a simple script, I mean without face_recognition, and see if the executable can be run? Also, try to create a virtual environment and install the latest version of PyInstaller with pip install -U PyInstaller.

I've tried out what you suggested and my program runs with no errors in VSC but every time I convert it to .exe it simply runs so quickly that the terminal pops up so quick and close. I tried executing the exe file in Anaconda prompt and still giving me this error:
SyntaxError: Non-UTF-8 code starting with '\x90' in file C:\Users\PC\Desktop\VSworkSpace\FaceRecProject\dist\main\main.exe on line 1, but no encoding declared; see https://python.org/dev/peps/pep-0263/ for details
Even though I've added # -- coding: utf-8 -- at the first line of my code

Please help me solving this issue

@SAUDIANO I'm not sure what is the cause of the problem, but first, make sure that you running your executable directly from a standard CMD and not python [this]. Second, create a clean virtual environment with Conda and generate the executable in that env. Moreover, try to update the Pyinstaller to the latest version.

Hi, You might want to freeze your script into a standalone executable to run on any system without the need of installing python or face_recognition and maybe you want to create a demo for your application and want to give it to someone else without giving your source code. Here is a simple tutorial to do that. I tested this method with python3.6 on Windows 10, but I think you can get it working on Linux with a similar method.

Make sure you have correctly installed both face_recognition and dlib and you see no error when importing them into your script.
Make sure your script works fine, and all its dependencies are right next to it, and you can run it fine with python yourscript.py.
Install Pyinstaller with pip:
pip install pyinstaller
Create a new directory and move your python script and all dependencies into it. I call it myproject and myscript.py
Copy face_recognition_models and scipy-extra-dll from your python installed directory to your project directory.
Create an empty file called <yourscriptname>.spec like myscript.spec next to your python script.
Use below Pyinstaller spec file sample and edit some parts according to your needs: (I mark it with <> tag)

# -*- mode: python -*-

block_cipher = None

face_models = [
('.\\face_recognition_models\\models\\dlib_face_recognition_resnet_model_v1.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\mmod_human_face_detector.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_5_face_landmarks.dat', './face_recognition_models/models'),
('.\\face_recognition_models\\models\\shape_predictor_68_face_landmarks.dat', './face_recognition_models/models'),
]

a = Analysis(['<your python script name.py>'],
             pathex=['<path to working directory>'],
             binaries=face_models,
             datas=[],
             hiddenimports=['scipy._lib.messagestream', 'scipy', 'scipy.signal', 'scipy.signal.bsplines', 'scipy.special', 'scipy.special._ufuncs_cxx',
                            'scipy.linalg.cython_blas',
                            'scipy.linalg.cython_lapack',
                            'scipy.integrate',
                            'scipy.integrate.quadrature',
                            'scipy.integrate.odepack',
                            'scipy.integrate._odepack',
                            'scipy.integrate.quadpack',
                            'scipy.integrate._quadpack',
                            'scipy.integrate._ode',
                            'scipy.integrate.vode',
                            'scipy.integrate._dop', 'scipy._lib', 'scipy._build_utils','scipy.__config__',
                            'scipy.integrate.lsoda', 'scipy.cluster', 'scipy.constants','scipy.fftpack','scipy.interpolate','scipy.io','scipy.linalg','scipy.misc','scipy.ndimage','scipy.odr','scipy.optimize','scipy.setup','scipy.sparse','scipy.spatial','scipy.special','scipy.stats','scipy.version'],

             hookspath=[],
             runtime_hooks=[],
             excludes=[],
             win_no_prefer_redirects=False,
             win_private_assemblies=False,
             cipher=block_cipher)

a.datas += Tree('./scipy-extra-dll', prefix=None)

pyz = PYZ(a.pure, a.zipped_data,
             cipher=block_cipher)
exe = EXE(pyz,
          a.scripts,
          a.binaries,
          a.zipfiles,
          a.datas,
          name='<your python script name>',
          debug=False,
          strip=False,
          upx=True,
          runtime_tmpdir=None,
          console=True )

Generate your executable with python -m pyinstaller myscript.spec
If you see no error then your executable can be found in dist directory.
Enjoy!

Thanks to @ageitgey and @davisking for their awesome work.

i use ultralytics then how to use


This Month 2021-09: multiboot2

Hey! This is my first time adding information to the "This Month"-newsletter. I hope I didn't miss anything.

Not directly related, but if you're planning to release the new header crate under the name multiboot2-header, I would recommend to squat that name on crates.io already

Already done and marked rust-osdev team as co-owner.

Great, thanks!


HeadJS : http://headjs.com/

Request for a definition file for headjs http://headjs.com/
Was requested on Stackoverflow : http://stackoverflow.com/questions/30165072/definitelytyped-file-for-headjs-where-to-find/30166407

Well, I'll take care of this and I'm gonna try to deliver it until next week.

As a workaround here is what I use:
declare module head {
export function load(...arguments: any[])
}
A more detailled d.ts should be provided.

Any updates on this? I am also looking for the typings for headjs.


Remove nodes for accessor init effects

The language feature was removed before it got accepted. We don’t need syntax nodes for it.

@swift-ci Please test

https://github.com/apple/swift/pull/67582
@swift-ci Please test

https://github.com/apple/swift/pull/67582
@swift-ci Please test Windows


error: missing key: 'url'

When running rustup update, I get the following output:
info: syncing channel updates for 'stable-x86_64-unknown-linux-gnu'
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
error: missing key: 'url'

       stable-x86_64-unknown-linux-gnu unchanged - rustc 1.16.0 (30cf806ef 2017-03-10)
  nightly-x86_64-unknown-linux-gnu update failed - rustc 1.18.0-nightly (c58c928e6 2017-04-11)

As the targets for the channels suggest, I'm running an x86_64 Linux machine. I have rustup 1.2.0 installed.

have the same issue in Mac
$ rustup --version
rustup 1.2.0 (70faf07 2017-04-08)

$ rustup update
info: syncing channel updates for 'nightly-x86_64-apple-darwin'
error: missing key: 'url'
info: checking for self-updates

  nightly-x86_64-apple-darwin update failed - rustc 1.17.0-nightly (ccce2c6eb 2017-03-27)

$ rustup install nightly-x86_64-apple-darwin
info: syncing channel updates for 'nightly-x86_64-apple-darwin'
173.9 KiB / 173.9 KiB (100 %)  41.4 KiB/s ETA:   0 s
error: missing key: 'url'

I have the same issue when Travis tries to install Rust nightly using travis-cargo. Stable and beta work, though.
Installing Rust
$ curl -sSf https://build.travis-ci.org/files/rustup-init.sh | sh -s -- --default-toolchain=$TRAVIS_RUST_VERSION -y
info: downloading installer
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
error: missing key: 'url'
rustup: command failed: /tmp/tmp.GY1L9aI7C8/rustup-init --default-toolchain=nightly -y

$ curl -sSf https://sh.rustup.rs | sh -s -- --default-toolchain=$TRAVIS_RUST_VERSION -y
info: downloading installer
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
error: missing key: 'url'

The command "curl -sSf https://sh.rustup.rs | sh -s -- --default-toolchain=$TRAVIS_RUST_VERSION -y" failed and exited with 1 during .

@erickt and I are looking into this and coordinating investigation in the #rust-infra IRC room

This might have been broken by https://github.com/rust-lang/rust/pull/40584, which modifies the code that I think generates https://static.rust-lang.org/dist/channel-rust-nightly.toml.
cc @nrc / @alexcrichton / @brson

from https://static.rust-lang.org/dist/channel-rust-nightly.toml, rls part is indeed missing url: that the other parts have:
[pkg.rls]
version = "0.1.0-nightly (016cbc514 2017-04-08)"

[pkg.rls.target]

wait though, there are other things in this file that don't have url:

[[pkg.rust.target.x86_64-unknown-netbsd.extensions]]
pkg = "rust-std"
target = "i686-unknown-linux-gnu"

I have the same issue on osx.

acrichto> 2 bugs here
11:02 PM  1) rustup doesn't handle available = false well
11:02 PM  2) we're not producing analysis packages for targets

acrichto> rustup bug is here -
11:04 PM  https://github.com/rust-lang-nursery/rustup.rs/blob/master/src/rustup-dist/src/manifest.rs#L231
11:04 PM  that's just not handling the case where available = false
11:04 PM  avialale = false is intended for "this failed to build tonight but we decided to ship a nightly"
11:04 PM  in practice that's never been exercised

Alex is fixing the rustbuild side of this but testing it might take some time and might not be fixed until tomorrow PDT.

@carols10cents thanks for the heads up.
If there are rls-related things that need to be fixed, lemme know (though I'll soon be out for the next four days for Easter break)

same on debian testing

I've submitted a fix for rust-lang/rust at https://github.com/rust-lang/rust/pull/41267

For the sake of anybody stuck without rust toolchain due to this bug, this is a workaround for the install nightly:
rustup install nightly-2017-04-11

rustup update
info: syncing channel updates for 'stable-x86_64-apple-darwin'
info: syncing channel updates for 'nightly-x86_64-apple-darwin'
error: missing key: 'url'
info: checking for self-updates
   stable-x86_64-apple-darwin unchanged - rustc 1.16.0 (30cf806ef 2017-03-10)

nightly-x86_64-apple-darwin update failed - rustc 1.18.0-nightly (ad36c2f55 2017-04-09)``

As a workaround for travis, in your .travis.yml, you can change:
 rust:
  - nightly

to this, to pin to last night's nightly for today:
rust:
  - nightly-2017-04-11

This worked for me.

Got a potential fix for this up in #1063.

Thanks for the fix, it seems to be working again! I'm a little hesitant to unilaterally close this issue with so many other people having experienced the same issue, but feel free to close it if it's working for others as well (or you're sure it's fixed).

FWIW, I was experiencing this issue as well and it's now fixed for me :)

I have the same error with different output
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
info: update not yet available, sorry! try again later
error: checksum failed, expected: 'ce0922b4314fd90e72909b12fe624478d177b635e36bdc86139a0ad95ecc53af', calculated: '1dd13e0516336102fc66d4c735448e0a418bfae55b3148dbe24a6f35f613b35a'

Closing as fixed upstream
@marti1125 that is a different issue - it just means that the CDN is temporarily out of sync due to caching pecularities, it should have fixed itself within a few minutes.

Infra team is investigating the recurrence of this failure.

I encountered this error message but re-running about an hour later succeeded.  I hadn't updated in a while, if that matters.
First run:
[2017-09-29 01:50:00] ~ $ rustup update
info: syncing channel updates for 'stable-x86_64-unknown-linux-gnu'
error: missing key: 'url'
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
info: downloading component 'rustc'
 54.0 MiB /  54.0 MiB (100 %)   6.6 MiB/s ETA:   0 s
info: downloading component 'rust-std'
 81.4 MiB /  81.4 MiB (100 %)   6.7 MiB/s ETA:   0 s
info: downloading component 'cargo'
info: downloading component 'rust-docs'
 14.3 MiB /  14.3 MiB (100 %)   6.7 MiB/s ETA:   0 s
info: installing component 'rustc'
info: installing component 'rust-std'
info: installing component 'cargo'
info: installing component 'rust-docs'
info: checking for self-updates
info: downloading self-update

  stable-x86_64-unknown-linux-gnu update failed - rustc 1.8.0 (db2939409 2016-04-11)
       nightly-x86_64-unknown-linux-gnu updated - rustc 1.22.0-nightly (3c96d40d3 2017-09-28)

Second run:
[2017-09-29 03:06:39] ~ $ rustup update
info: syncing channel updates for 'stable-x86_64-unknown-linux-gnu'
info: latest update on 2017-08-31, rust version 1.20.0 (f3d6973f4 2017-08-27)
info: downloading component 'rustc'
 38.3 MiB /  38.3 MiB (100 %)   6.6 MiB/s ETA:   0 s
info: downloading component 'rust-std'
 57.9 MiB /  57.9 MiB (100 %)   6.7 MiB/s ETA:   0 s
info: downloading component 'cargo'
info: downloading component 'rust-docs'
info: removing component 'rustc'
info: removing component 'rust-std'
info: removing component 'rust-docs'
info: removing component 'cargo'
info: installing component 'rustc'
info: installing component 'rust-std'
info: installing component 'cargo'
info: installing component 'rust-docs'
info: syncing channel updates for 'nightly-x86_64-unknown-linux-gnu'
info: checking for self-updates

     stable-x86_64-unknown-linux-gnu updated - rustc 1.20.0 (f3d6973f4 2017-08-27)
  nightly-x86_64-unknown-linux-gnu unchanged - rustc 1.22.0-nightly (3c96d40d3 2017-09-28)

@numberoverzero I had that situation too.  I believe it's because of the "downloading self-update" step in the first run, which has applied a fix.  Future runs should proceed without error, hopefully.

Hi,
Same problem here:
$ rustup update stable
info: syncing channel updates for 'stable-x86_64-apple-darwin'
error: missing key: 'url'
$ rustup update stable
info: syncing channel updates for 'stable-x86_64-apple-darwin'
error: missing key: 'url'

Then I tried
$ rustup update
info: syncing channel updates for 'stable-x86_64-apple-darwin'
error: missing key: 'url'
info: checking for self-updates
info: downloading self-update

  stable-x86_64-apple-darwin update failed - rustc 1.17.0 (56124baa9 2017-04-24)

And finally:
$ rustup update stable
info: syncing channel updates for 'stable-x86_64-apple-darwin'
info: latest update on 2017-10-12, rust version 1.21.0 (3b72af97e 2017-10-09)
info: downloading component 'rustc'
 35.2 MiB /  35.2 MiB (100 %)   2.1 MiB/s ETA:   0 s
info: downloading component 'rust-std'
 48.0 MiB /  48.0 MiB (100 %)   2.1 MiB/s ETA:   0 s
info: downloading component 'cargo'
  2.7 MiB /   2.7 MiB (100 %)   2.3 MiB/s ETA:   0 s
info: downloading component 'rust-docs'
  4.0 MiB /   4.0 MiB (100 %)   2.3 MiB/s ETA:   0 s
info: removing component 'rustc'
info: removing component 'rust-std'
info: removing component 'cargo'
info: removing component 'rust-docs'
info: installing component 'rustc'
info: installing component 'rust-std'
info: installing component 'cargo'
info: installing component 'rust-docs'

  stable-x86_64-apple-darwin updated - rustc 1.21.0 (3b72af97e 2017-10-09)

Still happening - this time on Windows 7, running rustup-init  ---default-host x86_64-pc-windows-gnu.
Any further clues? I like Windows GNU toolchain and would hate to have to have the dreaded cl.exe on this machine.

Ay could rustup update provide a clearer error message, or default to the stable URL, or something?

I also had this problem today. The rustup update && rustup update nightly fix worked for me.
Would it not make sense to update the necessary part automatically?

@mqzry thanks rustup update worked for me :)


brackets-beautify adding extra blank lines before head, body, /html tags

This is a great extension, but I was getting annoyed by this behavior. This is apparently the default option for js-beautify with html.
There was no option in the "default.jsbeautifyrc" file for this option, so I added
"extra_liners": []
to the "html" section of "default.jsbeautifyrc"  within my Brackets extensions folder, based on the documentation for js-beautify. Works like a charm!
https://github.com/beautify-web/js-beautify
-E, --extra_liners    List of tags (defaults to [head,body,/html] that should have an extra newline before them.

Happy you like it.
As your problem seems to be solved, I am going to close this.


replaced master with primary

@tomresing : Thanks for your contribution! The author(s) have been notified to review your proposed change.


How to use zilliz cloud url and token

How to use zilliz cloud uri and token in
ops.ann_insert.milvus_client(host, port, collection_name, user= None, password=None, collection_schema=None, index_params=None)

Hi @bhuvneshsaini , try towhee.ops.ann_insert.milvus_client(collection_name='test_collection', uri=<your-uri>, token=<your-token>). Please clear your local ann-insert namespce cache  in .towhee directory and re-download the operator from hub.

How to clear from cache through programming as i am using this command in pipeline.

https://towhee.readthedocs.io/en/latest/operator/usage.html
Use the latest() interface, which will update the operator to the latest.


calc( + ) neat minification error

This an example that works fine
margin-left: calc(33.33333% + 0px);
But the compressor remove extra spaces
margin-left: calc(33.33333%+0px);
And this becomes as invalid css
Temporary fix. I modified inside neat folder every mixin
For example
width: calc(100% + #{($_grid-gutter * 2)});
To
width: calc(100% - -#{($_grid-gutter * 2)});
It fix the problem when the css is monified
Any idea.

What compressor/minifier are you using?

I am running sass with gulp. The compressor is "liferay css compressor" is the cms automatic compressor.

I did a quick search if this issue and it seems just about every CSS compressor has run afoul and had to fix this issue. The CSS spec calls for spaces between math operators in calc, which means compressors need to not strip whitespace inside those operations. Unfortunately, the issue here is not with Neat, but with liferay

Yeah i know. The issue is not with neat. It is only with every compressor.

Both cssmin and postCSS with cssnano properly compress calc functions. I've had no issue with either on my pipeline

Seems like this is simply not an issue with Neat. Closing


Uncaught TypeError: Cannot read property 'prev' of undefined in php.js:187

Hey guys, using version 5.18.2 i am getting the above error in chrome.
Thought you want to know.
Thanks.

Which code triggers this?

Seems that any code that also has html in it then some php mixed inside, i.e:
<?php

use \some\namespaced\Library;
?>

    <?= Library::staticMethodCall(); ?>

That doesn't cause any problem on http://codemirror.net/mode/php/ . Could it be that you're using an old version?

Can you try this code please:
<?php

use yii\helpers\Html;
use yii\widgets\ActiveForm;

/* @var $this yii\web\View */
/* @var $model app\models\User */
/* @var $form yii\widgets\ActiveForm */
?>

    <?php $form = ActiveForm::begin(); ?>

    <?= $form->field($model, 'id')->textInput() ?>

    <?= $form->field($model, 'first_name')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'last_name')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'email')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'password')->passwordInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'auth_key')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'access_token')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'status')->textInput(['maxlength' => true]) ?>

    <?= $form->field($model, 'created_at')->textInput() ?>

    <?= $form->field($model, 'updated_at')->textInput() ?>

        <?= Html::submitButton($model->isNewRecord ? Yii::t('app', 'Create') : Yii::t('app', 'Update'), ['class' => $model->isNewRecord ? 'btn btn-success' : 'btn btn-primary']) ?>

    <?php ActiveForm::end(); ?>

As this causes the issues for me instantly.
I am using latest version, just updated today before pasting you this.
Hope it helps.
Thanks.

So did you paste this into http://codemirror.net/mode/php/ ? Because I just did and there is no error.

Yeah, basically what i am doing is i have a file manager, and when i click on any file, i make an ajax request to the server to get the file contents and detect the file mode for codemirror.
When the ajax call returns, i open a modal popup that has a textarea in it where codemirror is instantiated and i set the right mode and contents for codemirror.
This works just fine for any other file type and even for php if i disable the php mode and use htmlmixed instead.

That doesn't help reproduce this, though. What would help is a small, minimal HTML demo that triggers the issue.

Sure, there you go: http://mygd.im/cmphp/

That still contains a lot of unnecessary complexity, and isn't something I can easily run locally to debug.

Well, i don't think i can do more than this, the issue is there, i'll be removing php mode and will be using html mixed instead. I also attached the above code in an archive for you to look at if you need to.
cmphp.zip
Sorry for not being able to do more.
Thank you.

Adding clike mode will remove this error, i don't know why but it's work.

Hi, ..
I have the same problem. Pasting the code - taken from W3School crashes the code.
php.js:187 Uncaught TypeError: Cannot read property 'prev' of undefined
    at Object.dispatch [as token] (php.js:187)
    at readToken (codemirror.js:1646)
    at runMode (codemirror.js:1703)
    at highlightLine (codemirror.js:1549)
    at getLineStyles (codemirror.js:1593)
    at buildLineContent (codemirror.js:1839)
    at getLineContent (codemirror.js:2217)
    at buildLineElement (codemirror.js:2298)
    at patchDisplay (codemirror.js:4317)
    at updateDisplayIfNeeded (codemirror.js:4225)

Could you show the code you pasted that triggers the problem?

Actually a newline after <?php crashed it, giving two errors, this was the second one.
The first time I saw this error was while pasting the following code:
<?php
echo "
PHP is Fun!
";
echo "Hello world!
";
echo "I'm about to learn PHP!
";
echo "This ", "string ", "was ", "made ", "with multiple parameters.";
?>

So the code triggering the crash itself seems to be irrelevant
I think we should take a look at included libs.
<!doctype html>
<title>
    <%- file %>
</title>
<meta charset="utf-8" />

<link rel="stylesheet" href="/pad.css">
<link rel="stylesheet" href="/codemirror/lib/codemirror.css">
<link rel="stylesheet" href="/codemirror/addon/display/fullscreen.css">
<link rel="stylesheet" href="/codemirror/theme/<%- theme %>.css">

<link rel="stylesheet" href="/codemirror/addon/hint/show-hint.css">

<link rel="stylesheet" href="/codemirror/addon/lint/lint.css">

<link rel="stylesheet" href="/codemirror/addon/dialog/dialog.css">
<link rel="stylesheet" href="/codemirror/addon/search/matchesonscrollbar.css">

<textarea id="code" name="code" rows="5"></textarea>

Add  this file to solve this problem


Improve nif and port support for stm32

Adds support for REGISTER_PORT_DRIVER and REGISTER_NIF_COLLECTION macros to stm32 platform.
These changes are made under both the "Apache 2.0" and the "GNU Lesser General
Public License 2.1 or later" license terms (dual license).
SPDX-License-Identifier: Apache-2.0 OR LGPL-2.1-or-later

Yes, I did test nif and port with my soon to be submitted rewrite of the gpio driver, which is fully functional, but I am tracking down a bug before it is ready.


SSL cleanup errors for selfsigned certs

https://www.python.org/dev/peps/pep-0476/

Done as in described pep 0476. Currently disabled globally. Maybe later more specific.


[WIP] Re-synchronizing data loaders

Hacking around the ChunkBuffer class to return synchronous functionality to data loaders in light of performance regressions from asynchronous loading. Ideally, some of this functionality can be retained long-term to make asychronous data loading an __init__ kwarg on the DataLoader class, in case users don't want it for some reason

rerun tests

@jperez999 do these torch test failures help elucidate what might be going wrong at all?


AzureActivity_CL

Isn't the "AzureActivity_CL" table it asks you to make in Step 5.3 referring to the value you set in step 3."Add Log Analytics Send Data action".4, where the value is listed as "AzureActivity"?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4b70bc73-e0ce-a558-bf66-c02577859f3e
Version Independent ID: 1d80eb59-7698-8faa-e514-cac47eca799b
Content: Collect Azure Activity logs into a Log Analytics workspace across Azure tenants
Content Source: articles/azure-monitor/platform/activity-log-collect-tenants.md
Service: azure-monitor
Sub-service: logs
GitHub Login: @MGoedtel
Microsoft Alias: magoedte

@dcbrown16 Yes, it is. Ideally, you would have to type the custom log name you choose and append _CL as mentioned in step 5.3.

Sorry, I see that it says that on a reread. Which system is appending _CL? Is this due to Log Analytics specification in some way? I don't see anything mentioning this in the custom logs docs.

@dcbrown16 No problem. :) It's mentioned in step 5.3 in the document you were referring and it's mentioned here in the Azure Log Analytics Custom Logs document. Hope this helps!

Ah, under the OS settings, not "collect custom data". Thanks for your quick response! Closing


⚠ SceneTime has degraded performance

In 2aa5f84, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1508 ms

Resolved: SceneTime performance has improved in aad7644 after 6 minutes.


enable/disable profile at runtime

Easegress could generate CPU & memory profiles for troubleshooting, but this feature can only be enabled from the configuration at startup.
However, some issues only happen after Easegress runs for a long time, if profiling is not enabled at first, it will be very hard to reproduce the issue.
So, we need to add new admin APIs to enable/disable profiles at runtime.

This would be very useful for debugging memory or cpu issues!
I could work on this. The API could be following:

Path
Method
Description
Data

/profile/
GET
Get info of current CPU & memory profiling. For example, whether enabled and what's the path to file.
-

/profile/start/cpu
POST
Start profiling CPU to given file.
Path for CPU profile file.

/profile/stop/cpu
POST
Stops profiling and dumps the results to file.
-

/profile/start/memory
POST
Start profiling memory to given file.
Path to Memory profile file.

/profile/stop/memory
POST
Stop profiling and dumps results to file.
-

The profiling logic already exists in https://github.com/megaease/easegress/blob/main/pkg/profile/profile.go and the endpoint methods above could use it to start and stop profiling.


tulane.edu is not a dispoable email domain

Hi, would like to recommend that tulane.edu be removed from the disposable email domain list. It is a legitimate university.
https://tulane.edu/

Done!
66260fa6d261eff0c372add2d08d2123282a636f
Should be available on the next release (weekend).


Decouple tutorial from vercel sql functionality

This is completely unnecessary and pretty much breaks the entire tutorial for any other tools.

I agree it's a pain in the ass to have to find an alternative to make the tutorial working with a locally installed postgres database ...

I'd really like to do this tutorial, but without having to link a github account to a third-part service. I have postgres locally, but supplying a connection string in the .env doesn't seem to be enough. This shouldn't be so hard.

I'll second what others have said here.
I respect that tutorials can be funnels into your products, nothing wrong with getting a return on your investment, but at the very least you should lay out the tutorial requirements at the start, so it's clear before someone starts that they will need GitHub/Vercel accounts part way through, and then they can make an informed decision about proceeding or not..
After going through the first 5 chapters and enjoying myself, my tutorial experience ground to a disappointing halt when it went from doing all the work locally to suddenly having to create an account and pushing code and switching to your cloud services.


Uncaught<PHONE_NUMBER> ___throw opencv.js:30

I am having an exception while using openCV with react-p5, after some time opencv start throwing error  Uncaught<PHONE_NUMBER>  @ttt43ttt

error

try to use cv.exceptionFromPtr(err) to see what the exception is.


[SPARK-49038][SQL] SQLMetric should report the raw value in the accumulator update event

What changes were proposed in this pull request?

Some SQLMetrics set the initial value to -1, so that we can recognize no-update metrics (e.g. there is no input data and the metric is not updated at all) and filter them out later in the UI.
However, there is a bug here. Spark turns accumulator updates into AccumulableInfo, using AccumulatorV2#value. To avoid exposing the internal -1 value to end users, SQLMetric#value turns -1 into 0 before returning the value. See more details in https://github.com/apache/spark/pull/39311 . UI can no longer see -1 and filter them out.
This PR fixes the bug by using the raw value of SQLMetric to create AccumulableInfo, so that UI can still see -1 and filters it.
Why are the changes needed?

To avoid getting the wrong min value for certain SQL metrics when some partitions have no data.
Does this PR introduce any user-facing change?

Yes, if people write spark listeners to watch the SparkListenerExecutorMetricsUpdate event, they can see the correct value of SQL metrics.
How was this patch tested?

manual UI tests. We do not have an end-to-end UI test framework for SQL metrics yet.
Was this patch authored or co-authored using generative AI tooling?

no

cc @viirya

Also,

cc @HyukjinKwon too from https://github.com/apache/spark/pull/39311 .
cc @virrrat and @abmodi from #47516

To @cloud-fan , do you think we can have a new test case to verify and protect this behavior change in the future?

+1 to have a new test.

@dongjoon-hyun This is really beyond my expertise... we have some simple UI tests for the HTML content, but the SQL plan UI is SVG AFAIK. @yaooqinn do you have any ideas?

@cloud-fan If this helps, we can try reusing the new test I added in #47516 with some minor tweaks to protect this behavior. Given UI see -1 value now after this change, it gets filtered out correctly by SQLMetrics.stringValue

@virrrat The problem is we need to test that the input to SQLMetrics.stringValue contains -1 correctly, instead of the actual implementation of stringValue.

Got it, makes sense.

Maybe just add a test to verify SQLMetric.toInfoUpdate return the raw value?

@dongjoon-hyun This is really beyond my expertise... we have some simple UI tests for the HTML content, but the SQL plan UI is SVG AFAIK. @yaooqinn do you have any ideas?

Testing this change with the UI is a bit too heavy, I think we can test it directly in SQLMetricsSuite

Merged to master.
Thank you, @cloud-fan and all.
There is a conflict on branch-3.5 from JsonProtocol.scala part. Could you make backporting PRs for branch-3.5 and branch-3.4?


No connection associated with this transaction

Getting a funky exception.
Callee (this crashes, when it gives the SqlConnectionManager as a parameter from the value from the tx workflow builder):

System.ArgumentNullException: Argument cannot be null.
Parameter name: No connection associated with this transaction
  at Mono.Data.Sqlite.SqliteTransaction.IsValid (Boolean throwError) [0x00011] in /private/tmp/source-mono-mac-3.12.0-branch-32/bockbuild-mono-3.12.0-branch/profiles/mono-mac-xamarin/build-root/mono-3.12.0/mcs/class/Mono.Data.Sqlite/Mono.Data.Sqlite_2.0/SQLiteTransaction.cs:148
  at Mono.Data.Sqlite.SqliteTransaction.Rollback () [0x00000] in /private/tmp/source-mono-mac-3.12.0-branch-32/bockbuild-mono-3.12.0-branch/profiles/mono-mac-xamarin/build-root/mono-3.12.0/mcs/class/Mono.Data.Sqlite/Mono.Data.Sqlite_2.0/SQLiteTransaction.cs:127
  at Tx.subscribe@113[Unit,Unit] (Microsoft.FSharp.Core.FSharpFunc`2 f, IDbTransaction tx, Microsoft.FSharp.Core.FSharpFunc`2 onCommit) [0x00000] in <filename unknown>:0
  at Tx+transactional@125-1[Microsoft.FSharp.Core.Unit,Microsoft.FSharp.Core.Unit].Invoke (IDbConnection conn) [0x00000] in <filename unknown>:0
  at FsSqlPrelude.withResource[IDbConnection,TxResult`2] (Microsoft.FSharp.Core.FSharpFunc`2 create, Microsoft.FSharp.Core.FSharpFunc`2 dispose, Microsoft.FSharp.Core.FSharpFunc`2 action) [0x00000] in <filename unknown>:0
  at Tx+Run@132[Microsoft.FSharp.Core.Unit,Microsoft.FSharp.Core.Unit].Invoke (ConnectionManager cmgr) [0x00000] in <filename unknown>:0

Is that code open source? Could you point me to it?

No, sorry, not open source...
I'm trying to reproduce in a unit test, but since most calls in this function go through just fine...
Could you see under what circumstances this would be thrown? It would help me narrow it down.

Here's a stack-trace with line numbers:
System.ArgumentNullException: Argument cannot be null.
Parameter name: No connection associated with this transaction
  at Mono.Data.Sqlite.SqliteTransaction.IsValid (Boolean throwError) [0x00011] in /private/tmp/source-mono-mac-3.12.0-branch-32/bockbuild-mono-3.12.0-branch/profiles/mono-mac-xamarin/build-root/mono-3.12.0/mcs/class/Mono.Data.Sqlite/Mono.Data.Sqlite_2.0/SQLiteTransaction.cs:148
  at Mono.Data.Sqlite.SqliteTransaction.Rollback () [0x00000] in /private/tmp/source-mono-mac-3.12.0-branch-32/bockbuild-mono-3.12.0-branch/profiles/mono-mac-xamarin/build-root/mono-3.12.0/mcs/class/Mono.Data.Sqlite/Mono.Data.Sqlite_2.0/SQLiteTransaction.cs:127
  at Tx.subscribe@113[Unit,Unit] (Microsoft.FSharp.Core.FSharpFunc`2 f, IDbTransaction tx, Microsoft.FSharp.Core.FSharpFunc`2 onCommit) [0x00066] in c:\prg\FsSql\FsSql\Transactions.fs:121
  at Tx+transactional@125-1[Microsoft.FSharp.Core.Unit,Microsoft.FSharp.Core.Unit].Invoke (IDbConnection conn) [0x0001c] in c:\prg\FsSql\FsSql\Transactions.fs:130
  at FsSqlPrelude.withResource[IDbConnection,TxResult`2] (Microsoft.FSharp.Core.FSharpFunc`2 create, Microsoft.FSharp.Core.FSharpFunc`2 dispose, Microsoft.FSharp.Core.FSharpFunc`2 action) [0x0000a] in c:\prg\FsSql\FsSql\prelude.fs:14
  at Tx+Run@132[Microsoft.FSharp.Core.Unit,Microsoft.FSharp.Core.Unit].Invoke (ConnectionManager cmgr) [0x00026] in c:\prg\FsSql\FsSql\Transactions.fs:134

    member x.Run (f: ConnectionManager -> TxResult<'a,_>) =
        let subscribe (tx: IDbTransaction) (onCommit: IDbTransaction -> 'a -> TxResult<'a,_>) =
            let r = f (withTransaction tx) // 4, prepares a ConnectionManager that doesn't do anything, invokes f
            // what closes the connection opened in withResource (all of this is in its callback `action`)?
            match r with
            | Commit a -> onCommit tx a
            | Rollback a ->
                tx.Rollback()
                Rollback a
            | Failed e ->
                tx.Rollback() // last FsSql call
                Failed e

        let transactional (conn: IDbConnection) =
            let il = defaultArg isolation IsolationLevel.Unspecified
            let tx = conn.BeginTransaction(il) // 2: this passes
            let onCommit (tran: IDbTransaction) result =
                tran.Commit()
                Commit result
            subscribe tx onCommit // 3.

        fun cmgr ->
            match cmgr.tx with
            | None ->
               // 1: inlined to withResource cmgr.create cmgr.dispose transactional
               doWithConnection cmgr transactional
            | Some t -> subscribe t (fun _ -> Commit)

// 5:
 12 /// Creates a <see cref="ConnectionManager"/> with an externally-owned transaction¬
 11 let withTransaction (tx: IDbTransaction): ConnectionManager =¬
 10     let id = Guid.NewGuid().ToString()¬
  9     let create() =·¬
  8         logf "creating connection from const %s" id¬
  7         tx.Connection¬
  6     let dispose c = logf "disposing connection (but not really) %s" id¬
  5     ConnectionManager.make(create, dispose, tx)¬

How about a bit more logging infrastructure? I'd be interested in the trace that's currently hard-coded to ()?

It might have something to do with multiple Tx.execNonQueryi calls in a tx {}.

I believe this issue has earned the official Yak-shaving reward!

It also seems that the Tx functionality makes it so that exceptions aren't always raised properly.

Repro, finally:
module logibit.Sqlite.Tests.ExternalBugs

open Fuchu
open NodaTime
open System
open logibit.Sqlite

let prepare () =
  let mgr = Sql.withNewConnection (fun () -> Conn.sqlite_open' InMemory)
  Sql.execNonQuery mgr "
CREATE TABLE some_table
  ( id TEXT CONSTRAINT pk_id PRIMARY KEY,
    required_field TEXT NOT NULL )"
    []
  |> ignore
  mgr, Sql.Parameter.make, Tx.TransactionBuilder()

[<Tests>]
let tests =
  testList "https://github.com/mausch/FsSql/issues/23" [
    testCase "'No connection associated with' ... nested with outer error" <| fun _ ->
      let mgr, P, tx = prepare ()

      let nested (f_cont : Sql.ConnectionManager -> _) =
        tx {
          let! ret = f_cont
          return ret
        }
      let inner =
        tx {
          do! Tx.execNonQueryi "insert into some_table(id) values(@id)"
                               [ P("@id", "290345632deadbeef") ]
        }

      match nested inner mgr with
      | Tx.Commit _ -> ()
      | other -> Tests.failtestf "got %A" other
  ]

Did you manage to repro from this?

Ping

I just took a look and the problem here is definitely with the TransactionBuilder.Run method. This is the one that does the actual Rollback/Commit on the real IDbTransaction object.
The problem is that this particular arrangement in the test calls Run twice. As the first call to Run closes the transaction (either by calling Commit or Rollback on IDbTransaction), the second call tries to use the same transaction but fails because it has been already closed.

Fixed in aca1d81fa0786f3898db44e550c123af546206f8

:ice_cream:


added optional token to product list calls

added optional token to product list calls

note that I did NOT keep the version bump commit in this PR.


GraphQL Subscription parameters are ignored when mocking

Describe the bug
When subscribing to a Subscription with parameters, specified parameters are ignored, and events are pushed out to all clients regardless of what was specified in the parameters. This is when using amplify mock to test locally.
Amplify CLI Version
4.37.0
To Reproduce
Here is an example GraphQL schema:
type FooList {
  optID: String!
  foos: [Foo!]!
}

type Mutation {
  triggerFooChanged(optID: String!): FooList
}

type Subscription {
  onFooChanged(optID: String!): FooList @aws_subscribe(mutations: ["triggerFooChanged"])
}

After subscribing to onFooChanged using optID = 'something' I'm getting all the events coming through, not just the ones where optID = 'something'.
For example, calling the mutation triggerFooChanged(optID: 123) returns {optID: 123, foos: []}. However, someone subscribed to onFooChanged(optID: 333) also gets this data.
Expected behavior
Clients subscribed to a specific optID should only get events with that optID
Desktop (please complete the following information):

OS: Mac
Node Version: v12.20.0

Also, the documentation isn't very clear on how the subscription parameters filter mutations. Is it filtering on the returned data? Is it filtering based on the mutation argument? Both could be true looking at the given example.

re: Issue -> I've had a few customers reach out about this, only happens when running amplify mock like @half2me suggested cc @renebrandel @manueliglesias @elorzafe
re: docs cc @awsed for filtered subscriptions, maybe we can improve some messaging here going over importance of return values from mutations.

Closing, as duplicate of #4725


Favicon

You can assign me to create a custom favicon for your web page according to your requirements.

@AMISH-KHAN you can start working on it

hi @Akshatchaube01 need some suggestion here
1:

for this one I decided to go with the cartoon we have at about us. It just looks cool.
2:

the 2nd one is in png form I will convert it into favicon if you approve.
so what are your thoughts?

2nd one is fine

@Akshatchaube01  please review pr #100


Digital Public Good

Collaboration with Digital Public Good - https://digitalpublicgoods.net/
Note: Issue migrated from Trello - https://trello.com/c/1dcztR1l/117-digital-public-good

Once solution design is there, we'll reach out to them.


WASM Fix Send requirements for Database

Database incorrectly requires : Send. This tries to fix that but in a generic way.

Concept ACK, most of the module code won't need it anymore as soon as we untangle client and server part.

Weird warning:
fedimint-workspace-clippy>    --> fedimint-core/src/db/mod.rs:263:14
fedimint-workspace-clippy>     |
fedimint-workspace-clippy> 252 | pub trait IDatabaseTransaction<'a>: 'a + MaybeSend {
fedimint-workspace-clippy>     |           -------------------- this trait cannot be made into an object...
fedimint-workspace-clippy> ...
fedimint-workspace-clippy> 263 |     async fn raw_remove_by_prefix(&mut self, key_prefix: &[u8]) -> Result<()> {
fedimint-workspace-clippy>     |              ^^^^^^^^^^^^^^^^^^^^ ...because method `raw_remove_by_prefix` references the `Self` type in its `where` clause
fedimint-workspace-clippy>     = help: consider moving `raw_remove_by_prefix` to another trait
fedimint-workspace-clippy>     = note: `-D where-clauses-object-safety` implied by `-D warnings`
fedimint-workspace-clippy> error: could not compile `fedimint-core` due to 2 previous errors
fedimint-workspace-clippy> warning: build failed, waiting for other jobs to finish...
fedimint-workspace-clippy> error: could not compile `fedimint-core` due to 2 previous errors

https://github.com/fedimint/fedimint/actions/runs/4197884089/jobs/7280789847#step:6:58

Concept ACK, most of the module code won't need it anymore as soon as we untangle client and server part, till then it's an improvement though

Should we make an issue for this so we remember to do the refactor?
Also, going forward, is the recommendation to always send MaybeSend in place of Send? What is the best way of preventing new code from being merged that breaks the pattern you're introducing here?

MaybeSend in place of Send

Yes, use MaybeSend whenever possible, sometimes it is not. Example: anyhow::from requires Send

help: consider moving raw_remove_by_prefix to another trait
= note: -D where-clauses-object-safety implied by -D warnings

see https://github.com/dtolnay/async-trait/issues/228
this is a false positive, fixed in Rust 1.69
solution is slapping #![allow(where_clauses_object_safety)] on every crate
OR
allowing it CI (passing -- -A where_clauses_object_safety to clippy)

solution is slapping #![allow(where_clauses_object_safety)] on every crate

Only ones that are using these macros?
These warning will be annoying for users building locally, so I think this is the route we need to pursue.


Figure out how to ensure construction/powering of circuit is simultaneous

Yes, this is important. So far, my best idea is to ensure that the clock is initially off and needs to be manually turned on. The drawback is that this needs to be conveyed to the user in some form.

Fixed by: https://github.com/acbabis/factorio-state-machine/commit/e3aa023e49b936df84895ae58306c972f1df4ed9


Separate development and production environments

Set up development (SQLite) and production (MySQL) databases.
Use environment variables to switch between them easily.
Scripts like "yarn dev" will automatically use the development environment.

Done


Rollup failed to resolve import "@oslojs/jwt"

I get in V2 this build error if I want build my app with vite and astro.
I use only GitHub and my self created Etsy provider. I don't usweapple
13:18:28 [ERROR] [vite] x Build failed in 309ms [vite]: Rollup failed to resolve import "@oslojs/jwt" from "/Users/andre/Projekte/JS/mrbiber/node_modules/arctic/dist/providers/apple.js". This is most likely unintended because it can break your application at runtime. If you do want to externalize this module explicitly add it to build.rollupOptions.external``

Works fine on my Astro project. Probably your "self created Etsy provider" is causing issues

I missed the re run of "nom i" after switching from 1.9.x to 2.0.x. it works all great plus the etsy provider


Update GitHub Actions dependency cache to avoid deprecation message

:rocket: PR was released in v1.1.2 :rocket:


[ZEPPELIN-5510]There are some logic problems, which may lead to thread leaks.

[ZEPPELIN-5510] There are some logic problems, which may lead to thread leaks
What is this PR for?
Fix code issues.
What type of PR is it?
[Improvement]
What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-5510

Thanks for the contribution @NicolasGong , could you update the title to be more specific ? e.g. Thread leakage in JobManager of flink interpreter, and please check the CI, seems flink CI is failed

ping @NicolasGong

ping @NicolasGong

ping @NicolasGong

ping @NicolasGong

Thanks @NicolasGong Could you do rebase ? Recently we fixed flaky CI test.

Ok, I'll try

Sorry, I updated the branch code, but CI still failed. I don't know why. This problem should not be caused by the changed code.

Sorry, I rebase the code and fixed a problem. But I don't know the reason why other CI failed.

CI is passed now, thanks @NicolasGong Sometimes some tests will still fail due to network or other unknown reason, usually rerun will turn CI to green

Will merge if no more comment


Register crash

RegisterCrash issue 49 criteria have been met.
The car will register a crash if the altar sensors come to close to the car. What is either touching it or literally right next to it.
The car will also register if the angle is changed more than 55 above or below because it is not possible for the car to do that naturally. Finally if the car is stationary or moving at 0.000400 and the angle changes more than 2° the car will register crash.
I want to merge this into the master.
close #49

Also change title it something a bit more meaningful and also clarify the explanation in the pull request.


ESPHome: Recovery failed: SCL is held LOW on the I2C bus

I did not add the OLED display and my SHT31 sensor does not seem to work with the Airgradient Basic Board v2.
With ESPHome I get "Recovery failed: SCL is held LOW on the I2C bus" - while the Arduino Version works...
I tried deactivating the OLED and temperature sensor in the YAML - but I cannot get rid of this error and the board takes a veeery long time to get ready like this.

fixed by switching i2c:
sda: D1
scl: D2


Creating new folders on network drive does not refresh application

Describe the bug
When creating a new folder on a network drive, the new folder is created but does not appear in the Files application unless I force it to refresh.
To reproduce
Steps to reproduce the behavior:

Go to a network drive
Right-click and select New | Folder
Give the new folder a name and click on Set Name
The new folder does not appear
Click on the refresh button and you will see the new folder appear

Expected behavior
Expect the new folder to be immediately visible
Log file
debug_fulltrust.txt
Screenshots
Not applicable
System Information

OS Version: Windows 10 20H2 19042.867]
App version: <IP_ADDRESS>

Additional context

Merging with #2042. At some point we changed how we listen for folders update, the "old" method would be working in this case.


HSEARCH-3708 Simplify the syntax of the range predicate DSL by leveraging the Range class

https://hibernate.atlassian.net/browse/HSEARCH-3708
The main purpose is to remove the gazillion interfaces that allow to write .from(..).excludeLimit().to(...).excludeLimit() or .from(..).excludeLimit().to(...) and then chain with other calls, because if we leave them, solving HSEARCH-3687 will be a nightmare.
But I think the new APIs are sane, and maybe even better, considering they are more consistent with the syntax introduced for the range aggregation DSL.

Addressed your comment and merged. Thanks!


We miss you!

I think this is a dupe of an issue on another project ;)

I think this is a dupe of an issue on another project ;)


Main Page Wording

Wording of main page should be updated. This includes the content part and page title.

Done for now. If needed, open new issue for refinement in the future.


add PktConnFdController for Config

When developing app on some platforms, like Android, we need to do some special operations on outbound connections. For Hysteria, it is just one single UDP connection. PktConnFdController can give us a chance to finish these operations.

Is there any reason why the logic can't be put into ConnFactory?

Is there any reason why the logic can't be put into ConnFactory?

No special reason. I just try to implement this feature.
I think the logic cound be placed in a better place.
And I just found that there are some bugs. It can not work well on all cases.
I will improve it.

All work is done. Is that OK? Should I continue to improve it?

I think you misunderstood what I meant. If you want to create a special connection, you can always create your own implementation of ConnFactory and put your operations there.
ConnFactory is designed for this kind of use case, see how obfuscation is handled here: https://github.com/apernet/hysteria/blob/master/app/cmd/client.go#L205

I see. But because of  udphop, I still need to modify the api of https://github.com/apernet/hysteria/blob/f48a5edd39433f51647c3739e8fed3adae21525c/extras/transport/udphop/conn.go#L46 and https://github.com/apernet/hysteria/blob/f48a5edd39433f51647c3739e8fed3adae21525c/extras/transport/udphop/conn.go#L118.
I need to do operations on them before they send and receive any packet.
Is that OK?

Yes, in that case you can modify the code in UDPHopPacketConn and add control function support for the underlying UDP connections.


Some questions about the visualization by group

Hi,
Thanks for this cool tool!
I have two questions about the visualization of .by group data.
Here is my data and metadata.
> names(tcr$data)
 [1] "0619_LN1" "0619_LN2" "0619_LN3" "0619_LN4" "0619_LN5" "0619_LN6" "0619_N1"  "0619_N2"  "0619_N3"  "0619_N4"  "0619_N5"
[12] "0619_P1"

> tcr$meta
# A tibble: 12 x 4
   Sample   patient source tissue
   <chr>    <chr>   <chr>  <chr>
 1 0619_LN1 S0619   LN1    LN
 2 0619_LN2 S0619   LN2    LN
 3 0619_LN3 S0619   LN3    LN
 4 0619_LN4 S0619   LN4    LN
 5 0619_LN5 S0619   LN5    LN
 6 0619_LN6 S0619   LN6    LN
 7 0619_N1  S0619   N1     normal
 8 0619_N2  S0619   N2     adjacent
 9 0619_N3  S0619   N3     tumor
10 0619_N4  S0619   N4     tumor
11 0619_N5  S0619   N5     tumor
12 0619_P1  S0619   P1     PBMC

First, I visualized the clonality by proportion.
tcr.imm_pr = repClonality(tcr$data, .method = "clonal.prop")
vis(tcr.imm_pr)

vis(tcr.imm_pr, .by = 'tissue', .meta = tcr$meta, .test = F)

From the individual samples. "0619_N3", "0619_N4" and "0619_N5" (from tumor) all have higher values than that of "0619_P1" (from PBMC). Why does PBMC have higher value than that of tumor after using .by = 'tissue'?
Second, visualized the clonal space homeostasis.
tcr.imm_hom = repClonality(tcr$data, .method = "homeo", .clone.types = c(Small = .0001, Medium = .001, Large = .01, Hyperexpanded = 1))
vis(tcr.imm_hom)

vis(tcr.imm_hom, .by = c('tissue'), .meta = tcr$meta, .test = F)

In the figure of individual samples, "0619_N2" does not have "Small" clones while all others have. But in the group view, "adjacent" (from "0619_N2") has over 20% "Small" clones. Also, nearly all samples have high proportion of "Medium" clones, but only tissue "LN" shows in the group view. So, how to understand this?
I am looking forward to hearing you.
Bests,
Yiwei Niu

HI, thank you, will look into it and get back with updates or questions as quick as possible!

Hi, please update to the latest package version and check if everything is OK. The version should be <IP_ADDRESS>06

Thank you for your quick reply!
The problem is solved after using the newer version.


initial core install mgmnt content

Summary
Content describing when it is appropriate to remove previous versions of the SDK and Runtime.

@mairaw @leecow I finished editing this.  It's ready for a final review.

Well, this is no longer WIP, but I can't remove that message without doing more changes. (force push after a rebase -i says that nothing has changed, so no push needed)
@mairaw After reviewing this, we can :shipit:

LGTM. Thanks, Bill.


Add Cloudkitty playbooks

@stackhpc/kayobe These are just standard cloudkitty playbooks. Would be nice to have in s-k-c

@technowhizz where are these coming from and what do they accomplish? Could you add a release note, and perhaps some documentation for what they are and how to use them?

Thanks for proposing this. The playbooks have been converted to a role in the stackhpc.openstack collection, and support added to openstack-config.


GoMod and GoDep packages should use the same Identifier.type

Currently there are two ways to refer to the same thing:

GoMod::github.com/nats-io/nats-server/v2:v2.1.0
GoDep::github.com/nats-io/nats-server/v2:v2.1.0

Use Go as Identifier.type for packages of the managers GoMod and GoDep to fix that issue.

I would not rename GoDep only GoMod to Go as GoDep project has been archived and removing this type make it more difficult for ORT users to detect where they have a legacy dependency on GoDep.

Currenty, GoMod uses versions strings for the identifier which correspond to the (pseudo) version specification in the [Go Modules Reference] (url. As the v prefix is part of the pseudo version format, we need to decide:

Should we stop using the Go specific version format
If yes, how to map Go's versions to version strings


Package request: TBSM

Project description
TBSM is a lightweight console desktop manager written in bash that supports wayland out-of-the-box.
Metadata

homepage URL: https://loh-tar.github.io/tbsm/
source URL: https://github.com/loh-tar/tbsm
license: GNU gpl2
platforms: linux, unix

Add a :+1: reaction to issues you find important.

I'm not sure if the platforms are right, but I didn't find much information about them, so if anyone knows, please correct me.


Animated.View::onPanResponderMove Stops Updating Animated.Value When Child Element Is Deleted

Description
When a child element inside an Animated.View is deleted, the onPanResponderMove stops updating an Animated.Value, which stops the dragging animation. This issue doesn't exist on old architecture.
Steps to reproduce

Clone the included reproducer.
Install project dependencies with yarn.
Run the application on Android.
Drag element on the screen.
Notice that dragging is interrupted on new architecture when a child element is removed.

React Native Version
0.74.2
Affected Platforms
Runtime - Android, Other (please specify)
Areas
Fabric - The New Renderer
Output of npx react-native info
System:
  OS: macOS 14.4.1
  CPU: (8) arm64 Apple M2
  Memory: 161.36 MB / 16.00 GB
  Shell:
    version: "5.9"
    path: /bin/zsh
Binaries:
  Node:
    version: 18.19.0
    path: ~/.asdf/installs/nodejs/18.19.0/bin/node
  Yarn:
    version: 3.6.4
    path: ~/.asdf/installs/nodejs/18.19.0/.npm/bin/yarn
  npm:
    version: 10.2.5
    path: ~/.asdf/plugins/nodejs/shims/npm
  Watchman:
    version: 2<IP_ADDRESS>
    path: /opt/homebrew/bin/watchman
Managers:
  CocoaPods:
    version: 1.13.0
    path: /usr/local/bin/pod
SDKs:
  iOS SDK:
    Platforms:
      - DriverKit 23.5
      - iOS 17.5
      - macOS 14.5
      - tvOS 17.5
      - visionOS 1.2
      - watchOS 10.5
  Android SDK:
    API Levels:
      - "33"
      - "34"
    Build Tools:
      - 30.0.3
      - 33.0.0
      - 34.0.0
    System Images:
      - android-33 | Android TV ARM 64 v8a
      - android-33 | Android TV Intel x86 Atom
      - android-33 | Google TV ARM 64 v8a
      - android-33 | Google TV Intel x86 Atom
      - android-33 | Google APIs ARM 64 v8a
      - android-33 | Google APIs Intel x86_64 Atom
      - android-33 | Google Play ARM 64 v8a
      - android-33 | Google Play Intel x86_64 Atom
    Android NDK: Not Found
IDEs:
  Android Studio: 2022.3 AI-223.8836.35.2231.10671973
  Xcode:
    version: 15.4/15F31d
    path: /usr/bin/xcodebuild
Languages:
  Java:
    version: 17.0.9
    path: /usr/bin/javac
  Ruby:
    version: 2.6.10
    path: /usr/bin/ruby
npmPackages:
  "@react-native-community/cli": Not Found
  react:
    installed: 18.2.0
    wanted: 18.2.0
  react-native:
    installed: 0.74.2
    wanted: 0.74.2
  react-native-macos: Not Found
npmGlobalPackages:
  "*react-native*": Not Found
Android:
  hermesEnabled: true
  newArchEnabled: true
iOS:
  hermesEnabled: Not found
  newArchEnabled: false

Stacktrace or Logs
This issue isn't a crash or failure.

Reproducer
https://github.com/kasperski95/repro-rn-na-pan-responder-issue
Screenshots and Videos
New Architecture
https://github.com/facebook/react-native/assets/9629577/8ba364f1-42cf-46b3-b08e-70f4ad42491a
Old Architecture (expected behavior)
https://github.com/facebook/react-native/assets/9629577/3d57d3c1-f0d0-4795-afd6-d4a13aac0f4e

@kasperski95 out of curiosity, is this issue happening also on iOS?


Delete all .duckdb files from refs/convert/parquet

see https://github.com/huggingface/datasets-server/issues/1914

Completed with https://github.com/huggingface/datasets-server/pull/2540


Remove extra sass conversion rules from Gruntfile

Coverage remained the same at 54.442% when pulling 46c8c3a1954a85f9dbb5702b17b33bd4afc62c78 on TheRealJon:add-less-to-sass into dcf798824652c9de26728766ca1ea8fb69ac3be8 on dtaylor113:add-less-to-sass.


link blog to healthsites.io navigation

Add the blog to the navigation of https://healthsites.io/
 Blog -About -Map -Country data - How it works- Share data- Partners

@markherringer - I created PR #1039, note that this will redirect visitors to Medium and out of the website. Alternatively we can open a new window or tab with the blog post when visitors click on the "Blog" button.

@ericboucher good call. open a new window


Boot system clock initialization based on RTC

This was implemented and tested on board with RTC available and tested in the case where RTC is not available too.

Contributor checklist

[x] Changes have been tested
[x] Change-type present on at least one commit
[x] Signed-off-by is present
[x] The PR complies with the Open Embedded Commit Patch Message Guidelines

Reviewer Guidelines

When submitting a review, please pick:

'Approve' if this change would be acceptable in the codebase (even if there are minor or cosmetic tweaks that could be improved).
'Request Changes' if this change would not be acceptable in our codebase (e.g. bugs, changes that will make development harder in future, security/performance issues, etc).
'Comment' if you don't feel you have enough information to decide either way (e.g. if you have major questions, or you don't understand the context of the change sufficiently to fully review yourself, but want to make a comment)

Is a0ca596 the cleanup udev one related to the PR in some way?

@ZubairLK Speaking of which, we should think how to structure it on long-term because having it all in one file might not be an ideal solution.

I agree. Made #1070

While working on #860 , I realised that there is no service that 'fixes' the rtc time in case the rtc time is broken (battery plugged in/out etc)?
Did I miss a service or is that a gap.
Switch to chrony will hopefully fix this as it manages hw rtc time. Came across this I was deleting the timeinit-rtc service.


Correct pagination logic when rate limiting data is present in response

I see now why #422 made the builds so fast - it broke pagination, because of a bug in the 'find the thing we should be paginating in the response' logic. I've updated the unit tests to reflect the new output and got everything passing.
With a clean cache, this is what I get running the change locally for one of the extensions where we don't know the exact path, like mariadb:

We won't see this in action in the preview because of caching, so merging based on local testing.


Align findp with findo (both to utilise attribute search)

findp command can now search for attributes:

name findp n/Alex Ben Charlotte
phone findp p/12345678 87654321
email findp<EMAIL_ADDRESS><EMAIL_ADDRESS>address  findp a/Serangoon Geylang

findo and findp will return a clearer result query.
Example of matching query:

"Listed 2 orders by searching through attribute 'name' with keyword(s) [Alex, Ben]"
"Listed 2 persons by searching through attribute 'phone' with keyword(s) [12345678, 87654321]"

Example of no matching query:

"Listed 0 orders by searching through attribute 'name' with keyword(s) [12345678, 87654321]"
"Listed 0 orders by searching through attribute 'phone' with keyword(s) [Alex, Ben]"

Codecov Report

Merging #164 (06d1b6a) into master (569ac44) will increase coverage by 0.14%.
The diff coverage is 58.38%.

@@             Coverage Diff              @@
##             master     #164      +/-   ##
============================================
+ Coverage     67.38%   67.52%   +0.14%
- Complexity      631      687      +56
============================================
  Files           112      122      +10
  Lines          2091     2279     +188
  Branches        238      275      +37
============================================
+ Hits           1409     1539     +130
- Misses          592      623      +31
- Partials         90      117      +27

Impacted Files
Coverage Δ

...main/java/seedu/address/commons/core/Messages.java
0.00% <ø> (ø)

...seedu/address/logic/commands/FindOrderCommand.java
100.00% <ø> (ø)

...u/address/logic/parser/FindOrderCommandParser.java
17.85% <0.00%> (-5.22%)
:arrow_down:

...dress/logic/commands/FindPersonAddressCommand.java
36.36% <36.36%> (ø)

...address/logic/commands/FindPersonEmailCommand.java
36.36% <36.36%> (ø)

...address/logic/commands/FindPersonPhoneCommand.java
36.36% <36.36%> (ø)

...ddress/logic/commands/FindPersonRemarkCommand.java
36.36% <36.36%> (ø)

...model/person/AddressContainsKeywordsPredicate.java
37.50% <37.50%> (ø)

...s/model/person/EmailContainsKeywordsPredicate.java
37.50% <37.50%> (ø)

.../model/person/RemarkContainsKeywordsPredicate.java
37.50% <37.50%> (ø)

... and 19 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 569ac44...06d1b6a. Read the comment docs.