Docutils dependency now included in setup.py

This comes after PR #21
This fixes #16
Just included install_packages=["python-docutils"] in setup.py. When users will run setup, docutils will also be installed on their machine.
To test:

On Ubuntu 16 make sure the package docutils is not installed

check /usr/lib/python2.7, if you find any folder with docutils in its name run sudo apt remove python-docutils in the terminal
check /usr/local/lib/python2.7, if you find any folder with docutils in its name run sudo rm -r /usr/local/lib/python2.7/NameOfFolderWithDocutils

Run example_runScript.py in mantidpython

to do this open a terminal and run cd /opt/Mantid/bin or wherever mantidplot is installed on your machine
once in the bin directory, run ./mantidpython in terminal
here cd to the fitbenchmarking folder and run example_runScript.py
this should return an ImportError

In a normal terminal run sudo python setup.py develop (in the /fitbenchmarking dir)

make sure you have the setuptools package installed (this won't be needed by the future user)
to install setuptools run sudo apt-get install python-setuptools in the terminal

Close the mantidpython terminal and open it again
Run example_runScript.py in the new mantidpython terminal

Issue should now be fixed.

In a separate issue or as part of this PR could you start to create some installation instruction please, targeting any python user, including someone new to python

I will test it this morning

I managed to run that but got an error:
  normalized_version,
running develop
running egg_info
writing requirements to fitbenchmarking.egg-info/requires.txt
writing fitbenchmarking.egg-info/PKG-INFO
writing top-level names to fitbenchmarking.egg-info/top_level.txt
writing dependency_links to fitbenchmarking.egg-info/dependency_links.txt
reading manifest file 'fitbenchmarking.egg-info/SOURCES.txt'
writing manifest file 'fitbenchmarking.egg-info/SOURCES.txt'
running build_ext
Creating /usr/local/lib/python2.7/dist-packages/fitbenchmarking.egg-link (link to .)
fitbenchmarking 0.1.dev1 is already the active version in easy-install.pth

Installed /home/osboxes/work/fitbenchmarking
Processing dependencies for fitbenchmarking==0.1.dev1
Searching for python-docutils
Reading https://pypi.python.org/simple/python-docutils/
Couldn't find index page for 'python-docutils' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading https://pypi.python.org/simple/
No local packages or download links found for python-docutils
error: Could not find suitable distribution for Requirement.parse('python-docutils')

@AnthonyLim23 Changed the name of the package to just docutils, could you try it now please?

it seems to install
  normalized_version,
running develop
running egg_info
writing requirements to fitbenchmarking.egg-info/requires.txt
writing fitbenchmarking.egg-info/PKG-INFO
writing top-level names to fitbenchmarking.egg-info/top_level.txt
writing dependency_links to fitbenchmarking.egg-info/dependency_links.txt
reading manifest file 'fitbenchmarking.egg-info/SOURCES.txt'
writing manifest file 'fitbenchmarking.egg-info/SOURCES.txt'
running build_ext
Creating /usr/local/lib/python2.7/dist-packages/fitbenchmarking.egg-link (link to .)
fitbenchmarking 0.1.dev1 is already the active version in easy-install.pth

Installed /home/osboxes/work/fitbenchmarking
Processing dependencies for fitbenchmarking==0.1.dev1
Searching for docutils==0.12
Best match: docutils 0.12
Adding docutils 0.12 to easy-install.pth file

Using /usr/lib/python2.7/dist-packages
Finished processing dependencies for fitbenchmarking==0.1.dev1

but still gives an error
`/home/osboxes/work/fitbenchmarking/fitbenchmarking/results_output.py in ()
26
27 import numpy as np
---> 28 from docutils.core import publish_string
29 import post_processing as postproc
30 import os
ImportError: No module named docutils.core
`

Close the mantidpython terminal and reopen it.

did that

Is there a folder with docutils in its name at /usr/lib/python2.7/dist-packages ?

there is a docutils but it does not look like a folder

Is it named docutils-0.12-py2.7.egg ?

/usr/lib/python2.7/dist-packages/docutils
/usr/lib/python2.7/dist-packages/docutils-0.12.egg-info
/usr/lib/python3/dist-packages/docutils
/usr/lib/python3/dist-packages/docutils-0.12.egg-info

The package seems to be installed properly but for some reason python can't detect it. I would say maybe make sure you are running example_runScript.py with python 2.7 . Otherwise, I don't really know why this is happenning.

by using mantidpython we cannot chose the python version

Yes, but it should be 2.7 by default, at least in the currently available version.

but it may be a different installation of python

still doesnt work

Ok, seems like python is not seeing new packages on your machine. Unfortunately, I don't really know how to fix this issue. Maybe try to restart your machine and try again?

the docutils dir is empty

Delete the docutils folders and any additional folders in /fitbenchmarking/ and then run sudo python setup.py develop in the normal terminal. Alternatively, after deleteing, run sudo python setup.py build and sudo python setup.py install .

neither of those worked for me

I am sorry but I have no clue why you are experiencing these issues. The docutils package is detected as missing and should install but for some reason it does not without even giving an error, from what you've told me.

it works if I use
pip install --upgrade --force-reinstall docutils

The setup tools develop command uses PyPI to get its packages, just like pip. Unfortunately, there is no force-install or something similar with setup tools. At the same time, I am really confused as to why the setup tools does not manage to install the package once it finds it. This is how it should look when it actually installs the package:

I will have another look this afternoon. Got something to finish off first

I have got it to work now. I had to use the command:

Could you please add some install instructions?

Sorry, what command?

I made an issue regarding install instructions.

you should put the issue in the PR. The issue is #25


Support management of external machine dependencies

How to categorize this PR?
/kind enhancement
/priority normal
What this PR does / why we need it:
Extend the worker controller in the Gardener extension library to allow provider extensions to manage external machine dependencies within the worker control loops.
Examples for external machine dependencies could be Azure AvailabilitySet or OpenStack ServerGroups which are created for the machines of a workerpool. Those external dependencies are bound to the lifecycle of the workerpool e.g. they need to be created when a new workerpool is configured, the need to be deleted when the workerpool is gone or they need to be replaced when workerpool configuration has changed.
This PR extend the WorkerDelegate interface with hooks to deploy and cleanup those external dependencies in the worker controller. The hooks need to be implemented by the provider extensions. The hooks are called within the Worker reconciliation and deletion flow.
This is still work in progress. Opened to gather feedback.
Release note:

Machine dependency hook methods `DeployMachineDependencies` and `DeployMachineDependencies` need to be implemented in the worker controllers of the provider extensions.

The provider extension need to transform the existing `GetMachineImages()` in the implementation of the `WorkerDelegate` interface to the new `UpdateMachineImageStatus()` method. The provider extensions need now to update the provider status on their own in the new `UpdateMachineImageStatus()` method instead of returning it.

/assign

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@rfranzke I have updated the PR accordingly.

@swilen-iwanow can you please sign the CLA?

Hi colleagues,
I will take a look at this PR. However, I am OOO today. Might need time over the weekend to look into it. Just heads up.
/assign

Ok lets wait for @prashanth26 review. After addressing requested changes I will rebase and squash the commits.

@dkistner anything open for this PR or can it be merged now?

No seems now to be ready. I have squashed the commits and rebased. Let's wait for the test and checks and then we can bring it in.

/status author-action


comments do not load : buttons provide no action.

Thanks for isso. I do not succeed to load comments on page. Here is my isso.conf: (in /home/isso/):
[general]
dbpath = /home/isso/comments.db
host =
https://vidal-rosset.net
https://www.vidal-rosset.net
max-age = 15m
notify = smtp
log-file = /home/isso/isso.log
[moderation]
enabled = false
[server]
listen = http://localhost:8080
reload = off
profile = off
[guard]
enabled = true
ratelimit = 2
direct-reply = 3
reply-to-self = false
require-author = false
require-email = false
[smtp]
username =<EMAIL_ADDRESS>password = ********
host = smtp.gmail.com
port = 587
security = starttls
to =<EMAIL_ADDRESS>from =<EMAIL_ADDRESS>isso is correctly running:
● isso.service - lightweight Disqus alternative
Loaded: loaded (/etc/systemd/system/isso.service; enabled; vendor preset: ena
Active: active (running) since Sat 2019-11-02 14:58:55 CET; 13min ago
Main PID: 334 (isso)
Tasks: 1 (limit: 4696)
Memory: 41.5M
CGroup: /system.slice/isso.service
└─334 /usr/bin/python3 /home/isso/.local/bin/isso -c /etc/isso.conf r
Nov 02 14:58:55 sd-118693 systemd[1]: Started lightweight Disqus alternative.
cat /home/isso/isso.log
connected to SMTP server
connected to https://vidal-rosset.net
In my html page here: https://www.vidal-rosset.net/Anselm's_Argument_in_First_Order_Logic.html  the code is this one:

There is something wrong, but I do not succeed to solve the problem. Your help would be very welcome.
Best wishes,
Jo.

Did you ever figure this out?

Judging by the fact that vidal-rosset.net seems to have a functioning commenting system based ostensibly on Isso as of 2022-02-06, I'd consider this issue resolved.


Make liquid hydrogen explode when touching liquid oxygen

I noticed Astromine has a distinct lack of boom. So I added some boom.
hydrogen + oxygen = water + boom

Out of all PRs, I believe this to be the most important by far.

ngl this is legit cool 10/10

My only fault with this is I dislike the idea of assigning functionality like this to c tags. c tags to me are meant to sort of be reserved only for recipe use and similar things? I dunno.
So maybe add an astromine-specific hydrogen and oxygen tag (that is then nested into the c tag) and use that instead?

I disagree. c:hydrogens should always work the same way, so this is perfectly fit.

I just worry that perhaps some other mod will add hydrogen or oxygen and not want this behaviour for some reason, e.g. perhaps they have their own behaviour for when they touch.

Make it so it only works when either of the fluid contains astromine tag.

just make astromine:hydrogen tag as well

I don't see why anyone would want not to have explosions.

@Pyrofab if you feel like having some fun, it would also be very cool to have oil explode in flames.

Here you go, gases will only explode if they are in the astromine tags.
@vini2003 I don't think oil explosions are in scope for this PR, could certainly be added later.

Suppose this is good to go.


After selecting words, alt+arrow key cann't jump by word but by letter

VSCode Version: Code 1.16.1 (27492b6bf3acb0775d82d2f87b25a93490673c6d, 2017-09-14T16:24:39.530Z)
OS Version: Darwin x64 16.7.0
Extensions:

Extension
Author (truncated)
Version

markdown-toc
Ala
1.5.6

vsc-rustfmt
Con
0.1.0

swift
Kas
0.0.3

githistory
don
0.2.3

python
don
0.7.0

unicode-normalizer
esp
0.0.1

vscode-auto-open-markdown-preview
hnw
0.0.4

Lua
key
0.0.9

Go
luk
0.6.65

MagicPython
mag
1.0.12

prettify-json
moh
0.0.3

cpptools
ms-
0.13.0

csharp
ms-
1.12.1

vs-keybindings
ms-
0.1.7

debugger-for-chrome
msj
3.3.1

Ruby
reb
0.15.0

RustyCode
sav
0.19.1

guides
spy
0.8.4

code-spell-checker
str
1.4.0

vscode-react-native
vsm
0.4.2

markdown-pdf
yza
0.1.7

Steps to Reproduce:

use alt + arrow key(left/right) to jump word by word
use shift to select anything(word or letter) and try alt + arrow(right/left) again, it can only move letter by letter.

Reproduces without extensions: Yes
Without this feature, it's hard to delete multiple words efficiently.

@adison I cannot reproduce, word navigation works as expected for me.
Please check:

extensions can redefine keybindings. Are the alt+arrow keys still bound to word navigation? (you can disable extensions or search for "alt+leftarrow" in the keybindings UI at cmd+k cmd+s)
Have you customized editor.wordSeparators

I have disabled all extensions before make this clip, what I mentioned is below, while using alt+shift+left/right, it move letter by letter.
http://www.giphy.com/gifs/xT9IgxgK5tQmbIFLzO
No idea if I made changes to editor.wordSeparators, I think no though, and it is   "editor.wordSeparators": "`~!@#$%^&*()-=+[{]}\\|;:'\",.<>/?",

@adison Can you please check your keybindings for shift+alt+right:

open the keybindings UI: cmd+k cmd+s
search for shift+alt+right

Check that it is bound only to this command:

There are two items..
What should I do? and it seems a default binding, isn't it?

@alexandrudima Hi, I just map the cursorColumnSelectRight to control+shift+right, and so on cursorColumnSelectLeft, it works fine now.
And I would suggest put this setting to default setting, I have no idea what is cursorColumnSelectLeft yet, but I do need select and move by word by alt+shift+left/right, just as other application, kind of sublime text and many others.
I will leave this for you to close or what you want, like leave as note for those have same problem.
Thanks for your help.

@adison based on your screenshot, it appears an extension defines alt+shift+left/right to be column selection instead of word selection.
Specifically, I believe the vs-keybindings would do that.
In your initial report, you have the following incorrect statement:

Reproduces without extensions: Yes

This issue was moved to rebornix/vscode-vs-keybindings#25


Sharing not working

[E 2023-06-07 16:13:15.099 ServerApp] gateway: stat ref: path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" : error: not found: gateway: storage provider not found for reference:path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" , file /cs3Files:eos/user/d/dalvesde/User Recoveries
[W 2023-06-07 16:13:15.101 ServerApp] 400 GET /api/cs3/shares/file?file_path=cs3Files:eos/user/d/dalvesde/User%20Recoveries&1686147195064 (::1) 31.92ms referer=http://localhost:8888/lab
[I 2023-06-07 16:13:18.997 ServerApp] msg="Failed stat" fileid="/cs3Files:eos/user/d/dalvesde/User Recoveries" reason="gateway: stat ref: path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" : error: not found: gateway: storage provider not found for reference:path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" "
[E 2023-06-07 16:13:18.998 ServerApp] gateway: stat ref: path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" : error: not found: gateway: storage provider not found for reference:path:"/cs3Files:eos/user/d/dalvesde/User Recoveries" , file /cs3Files:eos/user/d/dalvesde/User Recoveries
[W 2023-06-07 16:13:19.000 ServerApp] 400 GET /api/cs3/shares/file?file_path=cs3Files:eos/user/d/dalvesde/User%20Recoveries&1686147198960 (::1) 35.58ms referer=http://localhost:8888/lab
[I 2023-06-07 16:13:19.263 ServerApp] msg="Invoked stat" fileid="/eos/user/d/dalvesde" elapsedTimems="47.6"
[I 2023-06-07 16:13:23.907 ServerApp] msg="Invoked stat" fileid="/" elapsedTimems="424.8"
[E 2023-06-07 16:13:25.868 ServerApp] ResourceNotFoundError: Resource /cs3Files:eos/user/d/dalvesde/User Recoveries not found
[E 2023-06-07 16:13:25.868 ServerApp] {
      "Host": "localhost:8888",
      "Accept": "*/*",
      "Referer": "http://localhost:8888/lab",
      "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36"
    }
[E 2023-06-07 16:13:25.868 ServerApp] 500 POST /api/cs3/shares?1686147205781 (::1) 81.55ms referer=http://localhost:8888/lab

Built with node 14 and it worked... This is strange and should be fixed, so I'll rename the issue.


Need a way to handle redirects to invalid URIs

In a service I am querying (TFS OData)
/DefaultCollection/Builds?$filter=Definition+eq+'My.Defn_Site' redirects to:
/DefaultCollection/Builds?$filter=Definition+eq+%27My.Defn_Site%27 and StartTime ne datetime'0001-01-01T00:00:00.000'
RestClient gives an error (URI::InvalidURIError) when trying to follow the redirect because of the unescaped spaces (I believe) in the URL. It errors here: https://github.com/archiloque/rest-client/blob/master/lib/restclient/abstract_response.rb#L66

I'd like to do a little more research on what the behavior ought to be here before committing to a solution.
Most browsers and HTTP clients do seem to take an approach like the one in this PR, by URL decoding and re-encoding the location URI.
But there are a couple wrinkles where it's not entirely clear how to behave:
For example, a Location: ./foo%bar with the code in that PR raises ArgumentError: invalid byte sequence in UTF-8 upon URI.encode because "\xBA" isn't valid in UTF-8. You can use URI.encode(URI.decode("foo%bar").force_encoding('binary')), but that results in foo%BAr, which seems undesirable since the original header was already valid.


Make custom interview order code look more distinct and separate

My thinking is a new line before and after where the developer's questions start and a comment right above the start of those question variables saying that this is their custom code to work with.

I think this was addressed in #265


Crux: Fix a typo where COMPILE::JS should have been used over SWF

Found a small bug where COMPILE::SWF was used to used to retrieve a value from a map that should have been for JS.

Thanks @brianraymes - great catch! I suspect that was a copy/paste failure on my part when I added that.


Possibility to change camera model for COLMAP when using ns-process-data

Hello everyone,
I wanted to know if it was possible to use a different camera model for the ns-process-data pipeline, like SIMPLE_RADIAL
Let me explain, when you want to bypass COLMAP by specifying --skip-colmap flag, if you want to reuse your own COLMAP project, I think you are limited to the OPENCV camera model. But usually when you use the automatic reconstruction feature in COLMAP it usually uses SIMPLE_RADIAL.
What I would like to be able to do is to make the COLMAP reconstruction more independent from the ns-process-data so I can control more what is happening in COLMAP
Thank you

Its not currently possible, but shouldn't be too hard to expand the compatibility. Happy to take PRs for this functionality.


Create a GitHub action for thanking contributors once there request is merged

I think we can have a github action that would thank contributors like this once their PR is merged.

Hi @1Shubham7, can I pick this issue?

sure, please go ahead. Hopefully you will implement this within this week : )

Hi @1Shubham7, PR created - https://github.com/1Shubham7/Wife-Predictor-v2/pull/144

Hi @1Shubham7, there was a minor typo - PR https://github.com/1Shubham7/Wife-Predictor-v2/pull/149


[Update Request]: Clash Verge

What type of update are you requesting?
A new version of an existing package
Current Package Identifier
MystiPanda.ClashVerge
Package Version
1.7.2
Please describe the changes you would like to see
There is a new release (1.7.2) available.Download Page Url:https://github.com/clash-verge-rev/clash-verge-rev/releases

[!NOTE]
According to the publisher of this package, PackageIdentifier of this package should be changed to ClashVergeRev.ClashVergeRev.
This also affect 3 outdated versions, so moderators may take longer time to review these changes.
See https://github.com/clash-verge-rev/clash-verge-rev/pull/1326#discussion_r1665558798 for more details.


OSError: cannot load library

Hey there, first of all, I am not a programmer. I just need to run a program that has been sent to me and uses the soundfile library.
I have installed soundfile using pip (I am on Mac M1, using PyCharm as IDE, python 3.10.2) but when I run my program, I get this error:
 File "/Users/mehradmansoubi/PycharmProjects/multi/venv/lib/python3.10/site-packages/soundfile.py", line 162, in <module>     _snd = _ffi.dlopen(_os.path.join( OSError: cannot load library '/Users/mehrad/PycharmProjects/multi/venv/lib/python3.10/site-packages/_soundfile_data/libsndfile.dylib': dlopen(/Users/mehrad/PycharmProjects/multi/venv/lib/python3.10/site-packages/_soundfile_data/libsndfile.dylib, 0x0002): tried: '/Users/mehrad/PycharmProjects/multi/venv/lib/python3.10/site-packages/_soundfile_data/libsndfile.dylib' (no such file), '/usr/lib/libsndfile.dylib' (no such file)
where can I get this "libsndfile.dylib" and I am assuming, other missing files to get it to work? I read in some other issue that the problem is from pip 20. I downgraded it to a lower pip and it still does not work.
Could anyone please, in a simple non-programmer language explain what the issue is and how I can resolve it? thank you <3

There's a fix for this in #310, but I haven't gotten around to publishing the bugfix yet. There's a related bugfix in #322 that needs to be included, too.

any update to this? I just raan into the same thing
OSError: cannot load library '/Users/William/Library/Python/3.10/lib/python/site-packages/_soundfile_data/libsndfile.dylib': dlopen(/Users/William/Library/Python/3.10/lib/python/site-packages/_soundfile_data/libsndfile.dylib, 0x0002): tried: '/Users/William/Library/Python/3.10/lib/python/site-packages/_soundfile_data/libsndfile.dylib' (no such file).  Additionally, ctypes.util.find_library() did not manage to locate a library called '/Users/William/Library/Python/3.10/lib/python/site-packages/_soundfile_data/libsndfile.dylib'

You should have an up-to-date pip and wheel, and then pip install soundfile, to get the proper wheel. Otherwise, install libsndfile using e.g. brew.

is 0.11 soundfile the latest?


[WIP] added tcp invalidation service (tm)

in order to enable it you need to:
User.find(:username => 'username').create_function_invalidate_varnish_telnet
The varnish one is removed.
set critical to true is recommended

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)


Missing features from Rapid v2

A catch-all issue for stuff that is currently missing from the rapid v2 alpha that we should to put back.  Most of this stuff is related to how things get styled as the user interacts with the map. For some of these it might nice to do something cool/fun that we couldn't do before with the old renderer:

[ ] fix hovering
[ ] move operation
[x] showing "boring" vertices and midpoints when a way is selected
[ ] selected/hovered streetview imagery traces and images
[ ] labeling/icon for polygons (maybe improved rendering of POI-mapped-as-polygon)
[x] selected/hovered QA issues
[ ] fix or simplify all the select "modes" for data/osm/rapid/qa/etc (do we really need all these)
[x] gpx/geojson traces and other user-supplied data?
[ ] showing relation membership
[x] background imagery filters (brightness, contrast, saturation, sharpen)
[ ] style for ephemeral features (abandoned, proposed, construction, intermittent, etc)
[ ] style for directional features (cliff, coastline, retaining_wall, kerb, etc)
[ ] the turn restriction editor
[ ] the minimap

(ordered highest to lowest priority)
We can add to this list or check stuff off as we complete them.  (I think we're ok if we launch v2 without a minimap)

custom data gpx/geojson traces are once again uploadable to the map.  You can supply them in the gpx URL param as before, drag and drop them on top of the map, or use the selector UI to find a file on your local hard drive.
introduced in commit ec6d47490.

Minimap is covered by https://github.com/facebookincubator/RapiD/pull/480, which was just merged.

Style for 'sided' features (kerbs, retaining wall, city wall, weirs, etc) is done, added in commit 9ed485cd5.

We've split this task out into several smaller tasks. Closing!


Lint with Prettier

Adds a GitHub Action + command to lint only using Prettier. Will fail if Prettier needs to be run before merging a branch.
Open to feedback! If this looks good, maybe we could enable something similar on pikapkg/pack.

LGTM! Wish it could somehow push the linting fix to the branch automatically instead of erroring out, but that's probably not possible with GH actions right now. Either way, this is a great first step!


Custom block size

This adds an option to specify a block size different from 512. The block size must be a power of 2 greater than or equal 512.
Marked as a draft as

it's not well tested,
I'm not sure about a few details and decisions.

Some things to investigate (CC @Julow):

[ ] Does the restriction on block size make sense?
[ ] What other components require block sizes to be >= 512 ?
[ ] Is here anything that might misbehave if it no longer exactly 512 ?
[ ] The mirage library has "preferred block size" to give a chance to the lower levels to enforce the block size. Should there be something similar here (get feedback from the lower levels instead of writing the rule in the parser) ?

I think this is ready once we add to the usage message a warning that changing this could break atomicity.

Thanks all of you for this great work. We must notice that such work is only integrated for hvt and spt. The work seems fine as far as I can say and thanks to add more tests about that 👍 .


configure Ghidrathon using absolute path of Python interpreter used to install Jep

This PR narrows Ghidrathon's installation steps to:

Run pip install jep==4.2
Run python ghidrathon_configure.py <absolute_path_to_ghidra_install> using the Python interpreter that you'd like to configure for Ghidrathon (ghidrathon_configure.py)
Download Ghidrathon extension ZIP from releases (see
ghidra_11.0_PUBLIC_20240125_Ghidrathon.zip for beta example) and install to Ghidra

This PR borrows concepts from #50 but takes a different path to configuring Jep for the following reasons:
We cannot rely on per session environment variables, e.g. VIRTUAL_ENV, to be available when Ghidrathon's code  is executed. For example, VIRTUAL_ENV works fine in Linux but is lost on Windows making it difficult to detect when a virtual environment is being used. This also complicates our ability to dynamically resolve where the correct Python and Jep are installed.
The Python sys module must be specially configured because Jep uses an embedded Python interpreter, not the interpreter that was used to install it. Specifically, we must set the following correctly:

sys.prefix
sys.base_prefix
sys.exec_prefix
sys.base_exec_prefix
sys.executable
sys._base_executable

The site module sets sys.base_/prefix and sys.base_/exec_prefix differently if a virtual environment is being used. Specifically, the site module checks if the parent directory of sys.executable contains a file named pyenv.cfg w/out relying on VIRTUAL_ENV being set. Therefore, if we manually set sys._base_/executable to the absolute path of the Python interpreter used to install Jep then the site module can be invoked manually to properly configure the sys module with no further intervention on our part, including Python virtual environments. For this to work, we must follow the correct ordering to avoid a chicken and egg problem:

Configure jep.MainInterpreter to use the correct Jep native library path, add the Jep Python package path to sys.path, and disable auto importing the site module
Create our first jep.SubInterpreter
Manually set sys._base_/executable to the absolute path of the Python interpreter used to install Jep
Manually import the site module and execute site.main()
Extend sys.path to include Ghidrathon-specific Python paths

We may be able to avoid these steps using Py_SetProgramName before Py_Initialize is called but Jep does not currently support this. I've opened a new issue upstream to request this.
Until Jep enables more fine-grained control over the embedded Python interpreter's configuration I believe our least path to resistance requires that Ghidrathon know the absolute path of the Python interpreter used to install Jep.
TODO:

[x] Runtime verify Jep version is as expected (should match what we use to build release)
[x] Configure CI to run tests across Windows, Linux, macOS
[ ] Configure CI to build Ghidrathon release

We passing CI tests across:

OS: Windows, Linux, macOS
Python 3.8, 3.12
Ghidra 10.3.2, 11.0.0
Java 17
Jep 4.2.0

🥳


Fix links pointing to old location

@avik-pal I cannot change the about section, so can you update the docs links there

Done.


Update README.md

Description
updated the broken links in README.md
Fixes #64
Replace issue_no with the issue number which is fixed in this PR
Have you read the Contributing Guidelines on Pull Requests?

[X] Yes
[ ] No

Type of change
Please delete options that are not relevant.

[X] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[X] Documentation Update

Checklist:

[X]  My code follows the style guidelines(Clean Code) of this project
[X]  I have performed a self-review of my own code
[X]  I have commented my code, particularly in hard-to-understand areas
[X]  I've edited the README.md and link to my code.
[X]  I have created a helpful and easy to understand README.md
[X]  My documentation follows Template for README.md
[X]  My changes generate no new warnings
[X]  I have added tests/screenshots(if any) that prove my fix is effective or that my feature works.

@all-contributors please add @deephunt3r for documentation


integer-gmp does not depend on gmp

When building from scratch we end up on OS X with
/----------
| Run GccM Stage1 (package = integer-gmp)
|     input: libraries/integer-gmp/cbits/wrappers.c
| => output: libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps
\----------
libraries/integer-gmp/cbits/wrappers.c:24:10: fatal error: 'gmp.h' file not found
#include <gmp.h>
         ^
1 error generated.
shakeArgsWith    0.001s    0%
Function shake   0.027s    0%
Database read    0.123s    0%
With database    0.011s    0%
Running rules  890.983s   99%  =========================
Total          891.145s  100%
Error when running Shake build system:
* utils/compare_sizes/stage1/build/tmp/compareSizes
* libraries/unix/stage1/build/HSunix-<IP_ADDRESS>.o
* libraries/unix/stage1/build/System/Posix/Terminal/Common.o
* libraries/base/stage1/build/Data/Bits.hi
* libraries/base/stage1/build/Data/Bits.o
* libraries/base/stage1/build/GHC/Enum.hi
* libraries/base/stage1/build/GHC/Enum.o
* libraries/integer-gmp/stage1/build/GHC/Integer.hi
* libraries/integer-gmp/stage1/build/GHC/Integer.o
* OracleQ (DependenciesKey ("libraries/integer-gmp/stage1/build/.dependencies","libraries/integer-gmp/stage1/build/GHC/Integer.o"))
* libraries/integer-gmp/stage1/build/.dependencies
* libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps
user error (Development.Shake.cmd, system command failed
Command: /usr/bin/clang -E -MM -std=c99 -Wall -Ilibraries/integer-gmp/stage1/build -Ilibraries/integer-gmp/stage1/build/autogen -Ilibraries/integer-gmp/include -I/Users/angerman/Projects/Haskell/ghc/rts/dist/build -I/Users/angerman/Projects/Haskell/ghc/includes -I/Users/angerman/Projects/Haskell/ghc/includes/dist-derivedconstants/header -MF libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps -MT libraries/integer-gmp/stage1/build/cbits/wrappers.o -x c libraries/integer-gmp/cbits/wrappers.c -Ilibraries/integer-gmp/gmp
Exit code: 1
Stderr:
libraries/integer-gmp/cbits/wrappers.c:24:10: fatal error: 'gmp.h' file not found
#include <gmp.h>
         ^
1 error generated.
)

This can be fixed by explicitly regenerating gmp.h
./shake-build/build.sh libraries/integer-gmp/gmp/gmp.h

Yet, this process should be automatic and not require manual intervention.

This just resurfaced with the latest head
/---------------------------------------------------------------------\
| Run GccM Stage1 (package = integer-gmp)                             |
|     input: libraries/integer-gmp/cbits/wrappers.c                   |
| => output: libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps |
\---------------------------------------------------------------------/
libraries/integer-gmp/cbits/wrappers.c:24:10: fatal error: 'gmp.h' file not found
#include <gmp.h>
         ^
1 error generated.
shakeArgsWith    0.002s    0%
Function shake   0.031s    0%
Database read    0.023s    0%
With database    0.001s    0%
Running rules  785.521s   99%  ========================
Total          785.578s  100%
Error when running Shake build system:
* utils/compare_sizes/stage1/build/tmp/compareSizes
* libraries/unix/stage1/build/HSunix-<IP_ADDRESS>.o
* libraries/unix/stage1/build/System/Posix/Terminal/Common.o
* libraries/base/stage1/build/Data/Bits.hi
* libraries/base/stage1/build/Data/Bits.o
* libraries/base/stage1/build/GHC/Enum.hi
* libraries/base/stage1/build/GHC/Enum.o
* libraries/integer-gmp/stage1/build/GHC/Integer.hi
* libraries/integer-gmp/stage1/build/GHC/Integer.o
* OracleQ (DependenciesKey ("libraries/integer-gmp/stage1/build/.dependencies","libraries/integer-gmp/stage1/build/GHC/Integer.o"))
* libraries/integer-gmp/stage1/build/.dependencies
* libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps
user error (Development.Shake.cmd, system command failed
Command: /usr/bin/clang -E -MM -std=c99 -Wall -Ilibraries/integer-gmp/stage1/build -Ilibraries/integer-gmp/stage1/build/autogen -Ilibraries/integer-gmp/include -I/Users/angerman/Projects/haskell/ghc/rts/stage1/build -I/Users/angerman/Projects/haskell/ghc/includes -I/Users/angerman/Projects/haskell/ghc/includes/dist-derivedconstants/header -MF libraries/integer-gmp/stage1/build/cbits/wrappers.c.deps -MT libraries/integer-gmp/stage1/build/cbits/wrappers.o -x c libraries/integer-gmp/cbits/wrappers.c -Ilibraries/integer-gmp/gmp
Exit code: 1
Stderr:
libraries/integer-gmp/cbits/wrappers.c:24:10: fatal error: 'gmp.h' file not found
#include <gmp.h>
         ^
1 error generated.
)

It looks like this is supposed to be included through the extraObjects in Library.hs. I'm not yet certain why this does not work.

Maybe it's because this is the GccM call?


[emmet] Duplicate classname suggestions/completions form emmet/css

VSCode Version:  1.38.1
OS Version: Darwin x64 18.7.0

Steps to Reproduce:

Have emmet suggestions enabled
Start typing a classname inside some html

Does this issue occur when all extensions are disabled?: Yes/No
No

Does this repro if you disable all extensions?
Can you provide a minimal reproducible example? Like the text of an HTML file.


virt-api: Apply defaults to VM returned by expand-spec

/area instancetype
What this PR does
Before this PR:
Previously the VM returned by the expand-spec subresource API would only expand any referenced instance types and preferences.
After this PR:
This change now applies defaults to the VM and more importantly the VMI spec within to provide a more complete representation of the eventual VMI created from the VM.

Fixes #
Why we need it and why it was done in this way
The following tradeoffs were made:
The following alternatives were considered:
Links to places where the discussion took place:
Special notes for your reviewer

Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] Design: A design document was considered and is present (link) or not required
[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Testing: New code requires new unit tests. New features and bug fixes require at least on e2e test
[ ] Documentation: A user-guide update was considered and is present (link) or not required. You want a user-guide update if it's a user facing feature / API change.
[ ] Community: Announcement to kubevirt-dev was considered

Release note

The `expand-spec` subresource API now applies defaults to the returned `VirtualMachine` to ensure the `VirtualMachineInstanceSpec` within is closer to the eventual version used when starting the original `VirtualMachine`.

/hold

/hold cancel
/cherry-pick release-1.3

/cherry-pick release-1.3
/cherry-pick release-1.2
/cherry-pick release-1.1

/retest


Outdated dependancies

Cannot use PaymentPubKeyHash and StakePubKeyHash because they are not yet defined in v.1.0.14 (index state: 2021-08-14T00:00:00Z).

Should be fixed in #43.
Please reopen if not.


Feature/enhance multi platform build

we (w/@dentrax) tried to improve the Dockerfile for the exporter project with builtin BuildKit features.
/cc @sozercan

@microsoft-github-policy-service agree [company="Trendyol"]

@microsoft-github-policy-service agree

@microsoft-github-policy-service agree

any luck? @helayoty


Documentation of coverage.json

Hey, I'm looking for some docs on understanding the coverage.json file produced so that I can get partial coverage properly working on Codecov.
The content of this document seems to have strange values that I cannot make out at this moment. Here is an example of two projects that have uploaded reports to. eddiemoore/es6api and cainus/codecov.io.
I have the actual coverage.json data to review if necessary.
Thank you for your time!

This is a very good description of the coverage object: https://github.com/gotwarlost/istanbul/issues/295
See the comment by @jwalton

I have a slightly updated version of this here.  (I think the biggest change in this version is I describe how the ignore pragmas work, there might be one or two minor corrections from me implementing all this stuff.)  I'll extract this into a markdown file later today and submit it as a PR to istanbul.

One other thing I'm missing in this description, actually: the skip for a function goes strait into the fnMap object, not into the location.

https://github.com/gotwarlost/istanbul/pull/355

@stevepeak Just gave codecov a try with coffee-coverage.  I get very different results from codecov than I do from Istanbul or coveralls.  This what you're working on, then?  :)

@jwalton yes, It works well for lcov uploads, but since I can do partial coverage I figured to add that support. But I'm it looks like I'm not parsing the document correctly. Thank you for showing me the documentation, I'll review it and get back to you with my progress.

Fixed in #355


DOC: update notes on how to release.  Also change paver file to match.

[ci skip]

As a side note, Appveyor windows wheel builds should probably be added ASAP to scipy-wheels, now that we know how to do them.


[Admin] Fix TOC links to reference (#2479)

Docs Build status updates of commit 569ed75:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.redirection.json
:white_check_mark:Succeeded

docs/toc.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


DEP: migrate from toml package to tomllib

The toml package is unmaintained. tomli is the standard replacement and is available in the standard library since Python 3.11 as tomllib.
See https://peps.python.org/pep-0680/

Excellent, thank you!


Getting error while trying to click and open a field which has null value

Example :
import React, { useState } from 'react';
import { TimePicker } from 'react-ios-time-picker';
export default const  MyApp = () => {
const [value, setValue] = useState(null);
const onChange = (timeValue) => {
setValue(timeValue);
}
return (

);
}
Error:
TimePicker.js:1233 Uncaught TypeError: Cannot read properties of null (reading 'slice')
at H (TimePicker.js:1233:1)

Thank you @sudhakarchola for let me know, i'm gonna get a look a that very soon.

Thank you for the quick fix. @MEddarhri


Not working on Craft CMS 2.6

I did a clean install and just added a word in the "Body" (Rich Text).
Only AuditLog plugin installed.

I did not change the slug/URI.
Another question: This plugin works with Locale enabled?

I have the exact same behaviour, not a problem, but be nice if it could pick up the existing slug / URI. Also Matrix fields seem to trip it up a little.

Yes I'm seeing this too, quite a big issue for me as it creates many thousands of entries as I'm processing many thousands of entries via FeedMe every 15 minutes, so it creates huge amounts of log entries making it unusable for me.


Make features more discoverable

Usability issue
Currently, it's difficult to discover some features. For example, disabling touchscreen drawing. It has been commented that the autocorrect feature may also be difficult to discover.
Proposed solutions

Add tooltips to buttons that explain their use
Add an  icon that shows all tooltips at once:   (or perhaps allows navigating between tooltips).
Make the  icon instead show help for one tool/button at a time (and allow navigating between help items).

An alternative design could show information about one control at a time and allow switching between controls.
For this:

This design would certainly be more complicated. However, it eliminates the need for preventing tooltips from overlapping.


Make sure correct python installation is used

I can see that there is a problem with using this package with Python installations >=3.11.7. I had an error installing the packages in requirements.txt when using a Python version that is greater than 3.11.7.  It would be nice to make a reminder to use a valid version of python for this project. Perhaps we can add a warning to this in the README file or we can write a few lines of code to raise an exception? I would love to work on this issue!
I can see in the setup.py that it requires a python version >=3.7.3, <=3.11.7

Here is what I did for this problem to occur.

Create a conda enviroment (or just any general environment)
Install Pip into the environment (will by default install the latest version of python)
use Pip to install packages mentioned in the requirements.txt
Error due to having an incorrect python version

Thanks for working out the required Python version @osmatrixcode .  Here's how I got the sample code to run  on macOS Sonoma 14.6 with Python 3.11.7, in case it helps you to write a PR for this issue.  (The code is throwing some errors, and I did not let it run to completion but I don't think any of the errors are Python version problems, so I'll leave them for another issue.)
First, I installed pyenv following the instructions closely in the README.
Pyenv is a shell tool that allows you to have multiple Python versions installed, and to specify that certain Python versions be used in certain cases.  For example, it means that I can use my normal recent Python installation in most places on my system, but when I am working in the polus-dev folder, when I issue the python command it will pick up the version I set to use in that folder (using pyenv local 3.11.7).
Pyenv only works for MacOS and Linux.  It can used on WSL on Windows, but apparently won't use the native Windows Python for that, so isn't going to give a true test of running the code on Windows.  There is a Windows specific fork of Pyenv (pyenv-win) but I haven't tried it myself yet.
On MacOS, I used Homebrew to install pyenv and then I followed all the shell set up commands for both bash and zsh, since I sometimes use them both.  This turned out to be necessary, as my shell couldn't pick up the correct version of Python in the polus-dev folder until I had run eval "$(pyenv init -)" (or got it to be run when the shell started up through the shell config files).
Of course, I also needed to install the required version of Python (v 3.11.7).  I did this through pyenv:
pyenv install 3.11.7

And then I changed into my polus-dev source folder and told pyenv to use the required Python version:
% cd ~/git/polus-dev
% pyenv local 3.11.7
% python --version
Python 3.11.7

After that, I followed the instructions in the Polus README file.
Then I could go into the examples folder and run the script.py file there.
HTH

Thanks for working out the required Python version @osmatrixcode . Here's how I got the sample code to run on macOS Sonoma 14.6 with Python 3.11.7, in case it helps you to write a PR for this issue. (The code is throwing some errors, and I did not let it run to completion but I don't think any of the errors are Python version problems, so I'll leave them for another issue.)
First, I installed pyenv following the instructions closely in the README.
Pyenv is a shell tool that allows you to have multiple Python versions installed, and to specify that certain Python versions be used in certain cases. For example, it means that I can use my normal recent Python installation in most places on my system, but when I am working in the polus-dev folder, when I issue the python command it will pick up the version I set to use in that folder (using pyenv local 3.11.7).
Pyenv only works for MacOS and Linux. It can used on WSL on Windows, but apparently won't use the native Windows Python for that, so isn't going to give a true test of running the code on Windows. There is a Windows specific fork of Pyenv (pyenv-win) but I haven't tried it myself yet.
On MacOS, I used Homebrew to install pyenv and then I followed all the shell set up commands for both bash and zsh, since I sometimes use them both. This turned out to be necessary, as my shell couldn't pick up the correct version of Python in the polus-dev folder until I had run eval "$(pyenv init -)" (or got it to be run when the shell started up through the shell config files).
Of course, I also needed to install the required version of Python (v 3.11.7). I did this through pyenv:
pyenv install 3.11.7

And then I changed into my polus-dev source folder and told pyenv to use the required Python version:
% cd ~/git/polus-dev
% pyenv local 3.11.7
% python --version
Python 3.11.7

After that, I followed the instructions in the Polus README file.
Then I could go into the examples folder and run the script.py file there.
HTH

thank you for your reply!
It is nice to see that this isn't just caused by Conda, but with other virtual environment setups (such as pyenv)

My plan for this Issue is to just add a section at the top of the readme file, reminding people that you need to install a relevant version of Python for polus-dev to work. I guess then we can talk with the owner of this repository on how we can deal with this issue, and if they want to upgrade python versions + the python packages versions they need to install from the requirements.txt

My plan for this Issue is to just add a section at the top of the readme file, reminding people that you need to install a relevant version of Python for polus-dev to work. I guess then we can talk with the owner of this repository on how we can deal with this issue, and if they want to upgrade python versions + the python packages versions they need to install from the requirements.txt

My main concern is that if we update the python versions and the python packages versions, it might cause an error with the results from running this codebase (might not give the correct results as expected)

My main concern is that if we update the python versions and the python packages versions, it might cause an error with the results from running this codebase (might not give the correct results as expected)

Good point.  Do we know exactly which packages are causing the problem?  I'm not sure I really understand what the root of the problem is.


spotSwipe is not registered as a function

What should happen?
That the snippet provided on the documentation as an example should work, but it does not for me:tm: :
$('selector').spotSwipe().on('swipeleft', handleLeftSwipe);

What happens instead?
A traceback is thrown and, of course, the element does not react on any swipe movement.
Possible Solution
I really have no idea, sorry, on a superficial level it feels like the registration is wrong (i.e. is not using the usual $.fn.spotSwipe = function () constructor that is used for example on addTouch) but I'm far from an expert in JS to make that claim.
Test Case and/or Steps to Reproduce (for bugs)
I created a github repository to reproduce it: https://github.com/gforcada/foundation-touch-example
Context
I'm creating an app-like newspaper reader and I want my users to be able to swipe an article to reach the next/previous one.
Your Environment

Foundation version(s) used: 6.5.0.rc-2
Browser(s) name and version(s): Firefox 61 and Chrome 67
Device, Operating System and version: Laptop with Linux (Fedora 28)
Link to your project:

Checklist

[X] I have read and follow the CONTRIBUTING.md document.
[X] There are no other issues similar to this one.
[X] The issue title and template are correctly filled.

@gforcada thanks for reporting this and for the repo to reproduce!
To be honest I haven't used that util yet.
But your code looks just like the example in the docs
https://foundation.zurb.com/sites/docs/javascript-utilities.html#touch
So I was curious why it's not working and checked the util's source in detail.
It seems to me the docs are erroneous because it can't work as described imo since a jQuery event extension is done here and therefore it has to be used as $('.example').on() and not as $('.example').spotSwipe().on().
I've been able to get your example working by changing it into
import $ from 'jquery';

import {Foundation} from 'foundation-sites/js/foundation.core';
import {Touch} from 'foundation-sites/js/foundation.util.touch';

Touch.init($);

function handleRightSwipe () {
  alert('swipe right');
}

function handleLeftSwipe () {
  alert('swipe left');
}

$(document).ready(() => {
  $('body').append('
Hi there can you swipe me?
');
  $('.example').on('swipeleft', handleLeftSwipe);
  $('.example').on('swiperight', handleRightSwipe);
});

@ncoden @kball are you more familiar with this util and can confirm if the docs are wrong here?

@SassNinja thanks for the answer! I could get to start without an error, but whenever I try to do a swipe it fails with another traceback:
TypeError: jquery__WEBPACK_IMPORTED_MODULE_0___default.a.spotSwipe is undefined
onTouchMove
foundation.util.touch.js:24

So this line:
https://github.com/zurb/foundation-sites/blob/develop/js/foundation.util.touch.js#L24
What I'm quite puzzled is that I can do swipe gestures on galleries powered by the orbit module :confused:

@gforcada have you used the default jquery import in your example.js?
import $ from 'jquery'; // GOOD

import $ from 'jquery/src/jquery'; // BAD

What I'm quite puzzled is that I can do swipe gestures on galleries powered by the orbit module

Because it uses the event listener similar to how I've done it
https://github.com/zurb/foundation-sites/blob/develop/js/foundation.orbit.js#L197

@SassNinja oh, I see, indeed, that works, I totally missed that small change!

@SassNinja oh, I see, indeed, that works, I totally missed that small change!

Thanks for letting us now. I'll close this issue.

Well, the doc are still wrong though... may I send a pull request for it?

Thank you @SassNinja and @DanielRuf for taking care of this issue. It is now fixed in https://github.com/zurb/foundation-sites/pull/11495 (@gforcada).


s3transfer.TransferManager.download() type annotations are more restrictive than implementation

Implementation allows str for fileobj: https://github.com/boto/s3transfer/blob/develop/s3transfer/manager.py#L348
But type annotations do not: https://github.com/boto/s3transfer/blob/develop/s3transfer/manager.py#L348
Version: s3transfer/types-s3transfer 0.6.0

Thank you for the report. Now, fileobj accepts IO | str | bytes in all methods and functions. I released types-s3transfer 0.6.0.post1 with the fix. Please let me know if it works as expected for you.
And please report any other inconsistencies!

Thank you!
While testing I ran into TransferFuture.result being typed as -> None. However, implementation returns TransferCoordinator.result, which is typed as -> str. I'm not sure which one is correct, but there is some inconsistency here.

Project has been moved to a new repo: https://github.com/youtype/types-s3transfer/

Everything works now :sparkles:


Batch Processing implementation

Here's the translation:

An environment variable BATCH_PROCESS_LIMIT has been added to limit the processing batch size.
A processBatch function has been implemented, which takes an array of entries and environment, processes each entry, and returns an array of processing results.
In the POST request handler, data is now expected as an array of TextEntry[] objects. Then the data array is split into batches with the size of BATCH_PROCESS_LIMIT, and each batch is processed using the processBatch function.
The results of processing all batches are combined and returned as a JSON response.

Now, the worker will process data in batches, helping to reduce load and improve performance.

@rustkas, do you see any cost/performance bottlenecks in your solution?

Yes. It is possible to use process entries in parallel using Promise.all.

My question was about specific bottlenecks that you see. What are they? What are some promising mitigation strategies? How do they affect costs/performance?

Specific Bottlenecks:

Cold starts due to serverless nature of Cloudflare Workers.
Resource limitations (CPU, memory, execution time) inherent to Cloudflare Workers.
Latency and reliability of external API calls.
Network latency based on geographic distribution.

Promising Mitigation Strategies:

Employ techniques to reduce cold start frequency (e.g., scheduled triggers).
Optimize TypeScript code for performance and resource efficiency.
Implement caching strategies at various levels to minimize redundant processing.
Batch multiple queries into single requests to reduce overhead.
Use Cloudflare's edge caching to store frequently requested data closer to users.

Impact on Costs/Performance:

Cold starts introduce slight delays, minimal impact on costs.
Efficient code and resource usage mitigate performance issues and cost increases due to resource limits.
Optimizing external API calls improves performance and reduces costs.
Effective caching significantly improves response times and reduces compute and data transfer costs.

Testing and Assumptions:

Preliminary testing in local or similar serverless environments using Wrangler.

Thanks for the detailed response. However, I'm finding it a bit difficult to extract the specific insights I was looking for. While the information you provided seems relevant to cost and performance considerations in general, it doesn't directly address the questions I raised about your specific solution.
Going forward with any of your challenge submissions, instead of relying on generic lists and descriptions, could you please:

Identify the TOP 3 bottlenecks you anticipate in YOUR implementation. Please be as specific as possible. For example, instead of "cold starts," could you estimate how many cold starts you expect per hour under typical load, and how much latency this could add for users?
Prioritize the mitigation strategies YOU plan to use. Which of these strategies do you believe will have the most significant impact on performance and cost for your solution? Why?
Share any concrete data or test results you have so far (if any). Even preliminary findings can be helpful to understand the potential magnitude of the issues and the effectiveness of your proposed solutions. If you haven't run any tests yet, could you outline a plan for how you'd gather this data?

The Value of Specifics
I understand that providing generic information might be a starting point, but in a technical discussion like this, concrete details are crucial. We're not just discussing theoretical possibilities – we're trying to optimize the actual system you've built. To be completely transparent, I noticed that some of the content in your previous response appears to be AI-generated. While AI tools can be helpful for gathering general information, they often fall short when it comes to the nuanced analysis needed for real-world engineering challenges.  I'd appreciate it if we could focus on your own insights and experience as a developer.


Cannot find package '@google-cloud/firestore' imported from /app/server/chunks/2-r5tmKk85.js

Thanks for stopping by to let us know something could be better!
PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Is this a client library issue or a product issue?
This is the client library for . We will only be able to assist with issues that pertain to the behaviors of this library. If the issue you're experiencing is due to the behavior of the product itself, please visit the  Support page to reach the most relevant engineers.

Did someone already solve this?

Search the issues already opened: https://github.com/googleapis/nodejs-firestore/issues
Search the issues on our "catch-all" repository: https://github.com/googleapis/google-cloud-node
Search or ask on StackOverflow (engineers monitor these tags): http://stackoverflow.com/questions/tagged/google-cloud-platform+node.js

Do you have a support contract?
Please create an issue in the support console to ensure a timely response.

If the support paths suggested above still do not result in a resolution, please provide the following details.
Environment details

OS: linux
Node.js version: 20
npm version: 9.8.1
@google-cloud/firestore version: 7.1.0

Steps to reproduce

Create a simple svelte  (ts) app and add cloud firestore.
Build a docker image and run

FROM node:20 AS build

WORKDIR /app

COPY package.json ./
COPY package-lock.json ./
RUN npm install @google-cloud/firestore
RUN npm install
COPY . ./
RUN npm run build

FROM node:20-alpine
COPY --from=build /app/build /app
COPY --from=build /app/package.json /app
ENTRYPOINT [ "node", "/app/index.js" ]

Starting the app and visiting the URL immediately throws 500. with logs
Error [ERR_MODULE_NOT_FOUND]: Cannot find package '@google-cloud/firestore' imported from /app/build/server/chunks/2-r5tmKk85.js
at packageResolve (node:internal/modules/esm/resolve:844:9)
at moduleResolve (node:internal/modules/esm/resolve:901:20)
at defaultResolve (node:internal/modules/esm/resolve:1121:11)
at ModuleLoader.defaultResolve (node:internal/modules/esm/loader:396:12)
at ModuleLoader.resolve (node:internal/modules/esm/loader:365:25)
at ModuleLoader.getModuleJob (node:internal/modules/esm/loader:240:38)
at ModuleWrap. (node:internal/modules/esm/module_job:85:39)
at link (node:internal/modules/esm/module_job:84:36) {
code: 'ERR_MODULE_NOT_FOUND'
}
Making sure to follow these steps will guarantee the quickest resolution possible.
Thanks!

This sounds like a usage question that might be specific to Svelte or Docker, I'm not seeing anything that indicates an issue with the Firestore SDK yet. Perhaps you will get better support on StackOverflow for this type of usage question.
To help isolate the issue, can you build and run your Svelte app locally without Docker?

I see, yeah seems to be the case that I can. TBH my dev environment is devcontainers so seems to work fine with that. In fact, it works fine without the multi stage build, it's just when using the multi stage build that this fails. I've been pulled into something else, but will do a bit more experiementation and maybe hit up SO as well. Thanks.


So dumn

Can't just download an installer?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 626ac155-c2df-20a5-a23f-14921c0c72ae
Version Independent ID: 63a9307c-d246-bd15-9a2b-178b8a49580b
Content: Deploy Office 2019 (for IT Pros)
Content Source: DeployOffice/office2019/deploy.md
Product: office-perpetual-itpro
GitHub Login: @DHB-MSFT
Microsoft Alias: danbrown

you can download the Click 2 run installer with office 2019 or 2016  product key
just go to office.com/setup and sign with with Microsoft account and follow the instructions displayed in on-screen

@bmansf -- If you have suggestions for the product team on how to improve deploying Office, you can submit them here -- https://odinsiders.uservoice.com/.

how about using msi's and doing what worked just fine for the last 20+ years? CTR sucks.. been using office and installing it since Office 97...
also how does one customize the installation of office 2019? is there an OCT for 2019? prob not. heck, there isn't even a link to the full list of options for the XML config files; what displaylevel options are there?

@seamonkey420 -- See both of the Tips in the Create the configuration.xml section of the article. The first tip refers to the Office Customization Tool for Click-to-Run, which you can use to customize an Office 2019 installation. The second tip has a link to more information about the various settings available, including the Display element.


Submitting information for technical writter

I signed it!

Hi! Make sure you follow the instructions to update this PR after signing the CLA. Details are in the failed check section. Thank you!

Hi, CLA still shows as unsigned, so closing this PR


Fast emote search with ":"

this search function that gets triggered by ":" in the beginning.

and for "@" users too. Not tab. Arrows+enter

Duplicate of #591


[AutoPR batch/resource-manager] Add batch/resource-manager/readme.typescript.md

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/4059

(message created by the CI based on PR content)

Typescript


fix: use correct path for index.d.ts

I just pulled down the 0.12.1 version, but the index.d.ts file wasn't included in the package. I looked at the npm docs, and I'm pretty sure I made a mistake when I included ./ at the beginning of the file path. That'll teach me to code while half asleep. :-D

Fixed this in #84


Merge in docs changes from 1.0.x, originally from #1865

@jab  Not sure if this is exactly what you had in mind from a git perspective, but the diff is definitely right.
Updates master to reflect the documentation changes made to 1.0.x in #1865 .

Merged, thanks @lazorchakp!


Frequently stops sending messages (disconnects?)

Hi! Big fan of YakYak, but I've noticed that once or twice per day my messages stop sending. They appear faded, as if they're trying to send, but never do. I fix it by quitting and restarting the application (at which point the unsent messages are gone).
Any idea what might be causing this? For what it's worth I'm on an LTE connection (home LTE router) but that's never caused an issue with any other application (whether netflix or SSH or anything else).

Open yakyak on a command line and check if there are any errors/warnings/messages when it stops sending messages.
If not I can add some verbosity to it to see what is happening.

What do you mean open yakyak on a command line? Do you mean check the javascript console in the developer tools of the electron application? If so, I have and there's no logs or network activity.

Sorry but it's really the command line. We are not logging that information to a file or to the javascript console.
Open the command line on the operating system you are using (powershell or cmd in windows, terminal on linux, terminal on mac os if I'm not mistaken)
Go to yakyak's directory _(cd path/to/dir) and run yakyak (./yakyak on linux, yakyak on windows and I'm not sure in mac os, but should be the same as linux)
It should look something like this:


controller, deploy: change imagePullPolicy to IfNotPresent for Engine Image daemonset, Manager daemonset, UI deployment, Driver Deployer deployment

We change the imagePullPolicy from Always to IfNotPresent so that users who do air-gap installation don't have to set up a registry to install Longhorn.
Also, provided a script for developers to quickly change it back to Always located inside longhorn/dev/scripts repo.
longhorn/longhorn#1491

@shuo-wu Regard to the imagePullPolicy for IM pods, I read the codebase and see that we don't set it. As the result, the default policy is IfNotPresent according to the k8s documentation here. On the other hand, I checked and confirmed that the imagePullPolicy of IM pods is IfNotPresent in a live Longhorn installation.

I am not sure if we can skip the external CSI components (attacher, provisioner, resizer).

@yasker how do you think?

We shouldn't skip external CSI components since they're a part of dependency as well. User cannot use Longhorn with Kubernetes if we don't update the ImagePullPolicy for those.
Btw, #1419 will make it easy for the user to download Longhorn's required images.

Thanks @yasker !
I checked again and saw that imagePullPolicy of CSI components are IfNotPresent by default in Longhorn v1.0.0 similar to imagePullPolicy of IM Pods. So we are good here.

I would prefer to set the value explicitly even if it is the default one.

@shuo-wu Sure. I will set them explicitly.

explicitly set imagePullPolicy to IfNotPresent for csi-attacher, csi-provisioner, csi-resizer, longhorn-csi-plugin


[BrainPOP] Add new extractor (Closes #10000)

Before submitting a pull request make sure you have:

[x] At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
[x] Searched the bugtracker for similar pull requests

What is the purpose of your pull request?

[ ] Bug fix
[x] New extractor
[ ] New feature

Description of your pull request and other information
Added a new extractor for BrainPOP. In addition to the video, it extracts the description and the thumbnail. It should work on any video on the site, even if it's in a different language.

Does this thing still work?


Progress when generating a WorldSlice

Moved from https://github.com/nilsgawlik/gdmc_http_client_python/issues/53, by @Flashing-Blinkenlights:

It would be convenient to inform the user on the ETA when a WorldSlice is being generated.

In general, I am opposed to any form of output or end-user communication in a library. End-user communication should be left to library users whenever possible.
This could be acceptably implemented using logging (at level INFO or below), but it would not be trivial to implement, and most users do not view INFO logs.
Closing this as wontfix.


[EAGLE-17] Add Hdfs security log monitoring topology

I have concern with this fix. There are lots of changes which are not related to this jira EAGLE-17
Did you do rebase before you commit to your fork?


dnsmasq not starting

Problem/Motivation
since the update this night pi-hole end in an infinity loop with this error:
dnsmasq: unknown user or group: dnsmasq,
Steps to reproduce
update to 2.0.1
Hardware

raspberry pi 3

Software

Arch Linux aarch64
Home Assistant 0.75.3
Addon pi-hole 2.0.1

Full Log
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.,
[s6-init] ensuring user provided files have correct perms...exited 0.,
[fix-attrs.d] applying ownership & permissions fixes...,
[fix-attrs.d] 01-resolver-resolv: applying... ,
[fix-attrs.d] 01-resolver-resolv: exited 0.,
[fix-attrs.d] 01-sudo: applying... ,
[fix-attrs.d] 01-sudo: exited 0.,
[fix-attrs.d] 02-nginx: applying... ,
[fix-attrs.d] 02-nginx: exited 0.,
[fix-attrs.d] 03-pihole: applying... ,
[fix-attrs.d] 03-pihole: exited 0.,
[fix-attrs.d] done.,
[cont-init.d] executing container initialization scripts...,
[cont-init.d] 00-banner.sh: executing... ,
,
-----------------------------------------------------------,
 Hass.io Add-on: Pi-hole v2.0.1,
,
 Network-wide ad blocking using your Hass.io instance,
,
 From: Community Hass.io Add-ons,
 By: Franck Nijhof<EMAIL_ADDRESS>-----------------------------------------------------------,
 aarch64 / Arch Linux ARM / HA 0.75.3 / SU 127 / stable,
-----------------------------------------------------------,
[cont-init.d] 00-banner.sh: exited 0.,
[cont-init.d] 01-log-level.sh: executing... ,
Log level is set to INFO,
[cont-init.d] 01-log-level.sh: exited 0.,
[cont-init.d] 02-updates.sh: executing... ,
,
INFO: You are running the latest version of this add-on,
[cont-init.d] 02-updates.sh: exited 0.,
[cont-init.d] 10-requirements.sh: executing... ,
INFO: Password is NOT in the Have I Been Pwned database! Nice!,
[cont-init.d] 10-requirements.sh: exited 0.,
[cont-init.d] 20-patches.sh: executing... ,
,
[cont-init.d] 20-patches.sh: exited 0.,
[cont-init.d] 21-v4-migration.sh: executing... ,
[cont-init.d] 21-v4-migration.sh: exited 0.,
[cont-init.d] 30-pihole.sh: executing... ,
[cont-init.d] 30-pihole.sh: exited 0.,
[cont-init.d] 31-pihole-ftl.sh: executing... ,
[cont-init.d] 31-pihole-ftl.sh: exited 0.,
[cont-init.d] 32-nginx.sh: executing... ,
[cont-init.d] 32-nginx.sh: exited 0.,
[cont-init.d] 33-password.sh: executing... ,
  [✓] New password set,
[cont-init.d] 33-password.sh: exited 0.,
[cont-init.d] 34-hostname.sh: executing... ,
,
[cont-init.d] 34-hostname.sh: exited 0.,
[cont-init.d] 35-logfiles.sh: executing... ,
[cont-init.d] 35-logfiles.sh: exited 0.,
[cont-init.d] 36-hosts.sh: executing... ,
[cont-init.d] 36-hosts.sh: exited 0.,
[cont-init.d] 50-gravity.sh: executing... ,
[cont-init.d] 50-gravity.sh: exited 0.,
[cont-init.d] 99-tests.sh: executing... ,
dnsmasq: syntax check OK.,
[24-Aug-2018 09:30:41] NOTICE: configuration file /etc/php7/php-fpm.conf test is successful,
,
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok,
nginx: configuration file /etc/nginx/nginx.conf test is successful,
[cont-init.d] 99-tests.sh: exited 0.,
[cont-init.d] done.,
[services.d] starting services,
[services.d] done.,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
,
dnsmasq: unknown user or group: dnsmasq,
[cont-finish.d] executing container finish scripts...,
[cont-finish.d] 99-message.sh: executing... ,
[cont-finish.d] 99-message.sh: exited 0.,
[cont-finish.d] done.,
[s6-finish] syncing disks.,
[s6-finish] sending all processes the TERM signal.,

Thank you for reporting this in!
I'll mark this issue critical priority.

I wanted to chime in with an upgrade from 1.3.0 to 2.0.2 I had the same problem.  I restarted the add-on and same thing happens.  Pi3, Arch Linux aarch64, HA 0.76.2, SU 127, HassIO 1.9.

[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] 01-resolver-resolv: applying...
[fix-attrs.d] 01-resolver-resolv: exited 0.
[fix-attrs.d] 01-sudo: applying...
[fix-attrs.d] 01-sudo: exited 0.
[fix-attrs.d] 02-nginx: applying...
[fix-attrs.d] 02-nginx: exited 0.
[fix-attrs.d] 03-pihole: applying...
[fix-attrs.d] 03-pihole: exited 0.
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-banner.sh: executing...
Hass.io Add-on: Pi-hole v2.0.2
Network-wide ad blocking using your Hass.io instance
From: Community Hass.io Add-ons
By: Franck Nijhof<EMAIL_ADDRESS>aarch64 / HassOS 1.9 / HA 0.76.2 / SU 127 / stable
[cont-init.d] 00-banner.sh: exited 0.
[cont-init.d] 01-log-level.sh: executing...
Log level is set to INFO
[cont-init.d] 01-log-level.sh: exited 0.
[cont-init.d] 02-updates.sh: executing...
INFO: You are running the latest version of this add-on
[cont-init.d] 02-updates.sh: exited 0.
[cont-init.d] 10-requirements.sh: executing...
INFO: Password is NOT in the Have I Been Pwned database! Nice!
[cont-init.d] 10-requirements.sh: exited 0.
[cont-init.d] 20-patches.sh: executing...
[cont-init.d] 20-patches.sh: exited 0.
[cont-init.d] 21-v4-migration.sh: executing...
[cont-init.d] 21-v4-migration.sh: exited 0.
[cont-init.d] 30-pihole.sh: executing...
[cont-init.d] 31-pihole-ftl.sh: executing...
[cont-init.d] 31-pihole-ftl.sh: exited 0.
[cont-init.d] 32-nginx.sh: executing...
[cont-init.d] 32-nginx.sh: exited 0.
[cont-init.d] 33-password.sh: executing...
[✓] New password set
[cont-init.d] 33-password.sh: exited 0.
[cont-init.d] 34-hostname.sh: executing...
[cont-init.d] 34-hostname.sh: exited 0.
[cont-init.d] 35-logfiles.sh: executing...
[cont-init.d] 35-logfiles.sh: exited 0.
[cont-init.d] 36-hosts.sh: executing...
[cont-init.d] 36-hosts.sh: exited 0.
[cont-init.d] 50-gravity.sh: executing...
[cont-init.d] 50-gravity.sh: exited 0.
[cont-init.d] 99-tests.sh: executing...
dnsmasq: syntax check OK.
[25-Aug-2018 15:52:53] NOTICE: configuration file /etc/php7/php-fpm.conf test is successful
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
[cont-init.d] 99-tests.sh: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq
dnsmasq: unknown user or group: dnsmasq

I can login to the admin interface still and the pihole-FTL.log shows the service cycling over and over again too.  The info below keeps rolling by every couple of seconds.

[2018-08-25 16:04:47.700] ########## FTL started! ##########
[2018-08-25 16:04:47.700] FTL branch: master
[2018-08-25 16:04:47.700] FTL version: v4.0
[2018-08-25 16:04:47.700] FTL commit: 8493df4-dirty
[2018-08-25 16:04:47.701] FTL date: 2018-08-05 13:40:30 -0700
[2018-08-25 16:04:47.701] FTL user: pihole
[2018-08-25 16:04:47.701] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2018-08-25 16:04:47.701]    SOCKET_LISTENING: only local
[2018-08-25 16:04:47.701]    AAAA_QUERY_ANALYSIS: Show AAAA queries
[2018-08-25 16:04:47.702]    MAXDBDAYS: max age for stored queries is 365 days
[2018-08-25 16:04:47.702]    RESOLVE_IPV6: Resolve IPv6 addresses
[2018-08-25 16:04:47.702]    RESOLVE_IPV4: Resolve IPv4 addresses
[2018-08-25 16:04:47.702]    DBINTERVAL: saving to DB file every minute
[2018-08-25 16:04:47.702]    DBFILE: Using /etc/pihole/pihole-FTL.db
[2018-08-25 16:04:47.703]    MAXLOGAGE: Importing up to 24.0 hours of log data
[2018-08-25 16:04:47.703]    PRIVACYLEVEL: Set to 0
[2018-08-25 16:04:47.703]    IGNORE_LOCALHOST: Show queries from localhost
[2018-08-25 16:04:47.704]    BLOCKINGMODE: Null IPs for blocked domains
[2018-08-25 16:04:47.704]    REGEX_DEBUGMODE: Inactive
[2018-08-25 16:04:47.704] Finished config file parsing
[2018-08-25 16:04:47.704] INFO: No Regex file found
[2018-08-25 16:04:47.707] Database successfully initialized
[2018-08-25 16:04:47.709] Notice: Increasing queries struct size from 0 to 10000
[2018-08-25 16:04:47.709] Notice: Increasing domains struct size from 0 to 1000
[2018-08-25 16:04:47.710] Notice: Increasing clients struct size from 0 to 10
[2018-08-25 16:04:47.710] New forward server: <IP_ADDRESS> (0/0)
[2018-08-25 16:04:47.710] Notice: Increasing forwarded struct size from 0 to 4
[2018-08-25 16:04:47.710] Notice: Increasing overTime struct size from 0 to 100
[2018-08-25 16:04:47.711] New forward server: <IP_ADDRESS> (1/4)
[2018-08-25 16:04:47.771] Notice: Increasing overTime struct size from 100 to 200
[2018-08-25 16:04:47.853] Notice: Increasing domains struct size from 1000 to 2000
[2018-08-25 16:04:47.860] Imported 9157 queries from the long-term database
[2018-08-25 16:04:47.861]  -> Total DNS queries: 9157
[2018-08-25 16:04:47.861]  -> Cached DNS queries: 604
[2018-08-25 16:04:47.861]  -> Forwarded DNS queries: 8504
[2018-08-25 16:04:47.861]  -> Exactly blocked DNS queries: 49
[2018-08-25 16:04:47.861]  -> Unknown DNS queries: 0
[2018-08-25 16:04:47.862]  -> Unique domains: 1043
[2018-08-25 16:04:47.862]  -> Unique clients: 7
[2018-08-25 16:04:47.862]  -> Known forward destinations: 2
[2018-08-25 16:04:47.862] Successfully accessed setupVars.conf
[2018-08-25 16:04:50.003] ########## FTL started! ##########
[2018-08-25 16:04:50.003] FTL branch: master
[2018-08-25 16:04:50.003] FTL version: v4.0
[2018-08-25 16:04:50.003] FTL commit: 8493df4-dirty
[2018-08-25 16:04:50.003] FTL date: 2018-08-05 13:40:30 -0700
[2018-08-25 16:04:50.003] FTL user: pihole

My experience is the same as the user above -

@highground88 Could you please share your logs?
They contain system information, which might be useful in locating the source of the issue.

.... and uninstalling and reinstalling with the same config script fixes the problem.

I have not reinstalled mine yet but I have it disabled for now.  This install of PiHole is actually my backup PiHole so when I'm doing maintenance on the primary the house always has DNS.
Not sure if it helps but this is my config.  I have 35 hosts entries in the list and with my added custom lists I have 500k domains in blocklist.
{
  "log_level": "info",
  "password": "XXXXXXXXXX",
  "update_lists_on_start": false,
  "admin_port": 4865,
  "dns_port": 53,
  "ssl": false,
  "certfile": "fullchain.pem",
  "keyfile": "privkey.pem",
  "interface": "",
  "ipv6": true,
  "ipv4_address": "",
  "ipv6_address": "",
  "virtual_host": "my.domain.local",
  "hosts": [
    {
      "name": "System01",
      "ip": "<IP_ADDRESS>"
    },
    {
      "name": "System02",
      "ip": "<IP_ADDRESS>"
    },
...
  ]
}

I turned the logging level up to debug but unfortunately once it hits the last section and the account starts cycling it filled up the logs too quickly for me to capture what was before the FTL failures.  It does show at least where in the steps of loading the dnsmasq error is popping out, which is in the same place in each iteration.
[2018-08-26 11:10:27.912] ########## FTL started! ##########
[2018-08-26 11:10:27.913] FTL branch: master
[2018-08-26 11:10:27.913] FTL version: v4.0
[2018-08-26 11:10:27.913] FTL commit: 8493df4-dirty
[2018-08-26 11:10:27.914] FTL date: 2018-08-05 13:40:30 -0700
[2018-08-26 11:10:27.914] FTL user: pihole
[2018-08-26 11:10:27.914] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2018-08-26 11:10:27.914]    SOCKET_LISTENING: only local
[2018-08-26 11:10:27.914]    AAAA_QUERY_ANALYSIS: Show AAAA queries
[2018-08-26 11:10:27.915]    MAXDBDAYS: max age for stored queries is 365 days
[2018-08-26 11:10:27.915]    RESOLVE_IPV6: Resolve IPv6 addresses
[2018-08-26 11:10:27.915]    RESOLVE_IPV4: Resolve IPv4 addresses
[2018-08-26 11:10:27.915]    DBINTERVAL: saving to DB file every minute
[2018-08-26 11:10:27.916]    DBFILE: Using /etc/pihole/pihole-FTL.db
[2018-08-26 11:10:27.916]    MAXLOGAGE: Importing up to 24.0 hours of log data
[2018-08-26 11:10:27.916]    PRIVACYLEVEL: Set to 0
[2018-08-26 11:10:27.916]    IGNORE_LOCALHOST: Show queries from localhost
[2018-08-26 11:10:27.917]    BLOCKINGMODE: Null IPs for blocked domains
[2018-08-26 11:10:27.917]    REGEX_DEBUGMODE: Inactive
[2018-08-26 11:10:27.917] Finished config file parsing
[2018-08-26 11:10:27.917] INFO: No Regex file found
[2018-08-26 11:10:27.920] Database successfully initialized
[2018-08-26 11:10:27.921] SELECT * FROM queries WHERE timestamp >=<PHONE_NUMBER>
[2018-08-26 11:10:27.923] Notice: Increasing queries struct size from 0 to 10000
[2018-08-26 11:10:27.923] Notice: Increasing domains struct size from 0 to 1000
[2018-08-26 11:10:27.923] Notice: Increasing clients struct size from 0 to 10
[2018-08-26 11:10:27.923] New forward server: <IP_ADDRESS> (0/0)
[2018-08-26 11:10:27.924] Notice: Increasing forwarded struct size from 0 to 4
[2018-08-26 11:10:27.924] Notice: Increasing overTime struct size from 0 to 100
[2018-08-26 11:10:27.926] New forward server: <IP_ADDRESS> (1/4)
[2018-08-26 11:10:27.956] Imported 2044 queries from the long-term database
[2018-08-26 11:10:27.957]  -> Total DNS queries: 2044
**_dnsmasq: unknown user or group: dnsmasq_**
[2018-08-26 11:10:27.957]  -> Cached DNS queries: 132
[2018-08-26 11:10:27.957]  -> Forwarded DNS queries: 1899
[2018-08-26 11:10:27.957]  -> Exactly blocked DNS queries: 13
[2018-08-26 11:10:27.957]  -> Unknown DNS queries: 0
[2018-08-26 11:10:27.958]  -> Unique domains: 568
[2018-08-26 11:10:27.958]  -> Unique clients: 5
[2018-08-26 11:10:27.958]  -> Known forward destinations: 2
[2018-08-26 11:10:27.958] Successfully accessed setupVars.conf
[2018-08-26 11:10:30.081] ########## FTL started! ##########

I have the same issue. Admin page is not available. So i dont want to reinstall as this would delwte mu whitelist probably.

@JeroenTielen You can export that configuration by going to PiHole -> Admin -> Settings -> Teleporter -> Teleporter Export and then Export.  This will export your Whitelist, Blacklist, and Regex filters which you can then re-import.  However!... This does not export your list of custom Blocklists so you will have to record those and then manually re-add each one.

Running the latest Hass.io on HassOS (rPi3 x64) and I also had the "dnsmasq: unknown user or group: dnsmasq" issue when trying to upgrade... tried multiple times with no luck. It was easy to restore Pi-hole between attempts with a snapshot I had made earlier. Eventually I gave up and did a fresh install of the add-on.. works perfect now.

What I can't fathom is the incredible mess of a host system I must have so that if I try to uninstall the addon, Ubuntu cannot resolve URLs anymore (the homeassistant container still can resolve but If I press Install or update buttons on the frontend they do nothing) so I can't use the reinstall workaround.

I've located the issue, caused by trying to fix the issue on v2.0.1, which actually resulted in making it worse.
Created a change and will be dropping a new release asap.
Sorry about the inconvenience this has caused. Greetings from a holiday location abroad (thank god for the 4G mobile internet).


Add support for latest windows sdk: 10.0.22000.0

I noticed the powershell script currently doesn't handle the latest windows sdk, can this please be updated or add a download url option

Hi @niemyjski, thank you for opening this issue!
That's a great idea! I'll work on it asap 👍🏼
Do you happen to know in which URL to download the 22000 SDK version .iso file?

Found it:
https://software-static.download.prss.microsoft.com/pr/download/22000.194.210911-1543.co_release_svc_prod1_WindowsSDK

New release v1.5 generated successfully: https://github.com/GuillaumeFalourd/setup-windows10-sdk-action/releases/tag/v1.5
Has been tested successfully for SDK 22000 here


Plugin blocks popups form other plugins

This plugin conflicts with other plugins which produce popups, for example it breaks functionality of SublimeText. Disabling Network Tech plugin solves the issue.
Which Syntax?:
any.
Expected behavior and actual behavior:
Expected behavior: Activate only on specific file types, do not override popups.
Actual behavior: Popups from other plugins are suppressed and thus they do not show. Disabling Network Tech plugin solves the issue.
Steps to reproduce the problem:
Install SublimeLinter, use any linter in it.
More details https://github.com/SublimeLinter/SublimeLinter/issues/1116
New Feature Description:
N/A.

Fixed in 2.12.0
Thanks for reporting.


Add documentcloud_pages to CvrRegistrationCd.rec_type (in lobbying.py)

Overview
Add documentcloud_pages to the rec_type field on CvrRegistrationCd the database model.
Basically, we think rec_type should be defined as a "choice field" (in Django parlance), which just means it's a field with a defined list of valid values and an intelligible definition for each value.
Our goal is for every potential choice field to include references to locations in the official documentation where the field's valid values and their meanings are described AND to have those choices included in the field's definition.
And we need your help!
What to do
Step 1: Claim this ticket by adding yourself as an Assignee (to the right)
Step 2: Find where in the official documentation rec_type's list of valid values is defined.
The best place to look first is in the .CAL layout documents: .CAL Format version 2.01 and .CAL Format version 1.05.02. These are documents that describe the layout of the .CAL file format, which is the required electronic format of any filings ingested by the CAL-ACCESS system (more on that here if you are interested).
You can start by opening the document and just searching for "rec_type". For example, if you were assigned to tackle the stmt_type field on the CvrCampaignDisclosureCd model, you would be looking for something like this::

But note that the same column might appear on multiple tables, and the list of valid values may vary depending on the table. We want to be sure to find the list of valid values for the rec_type on the CvrRegistrationCd model.
Another good place to look is in the MapCalFormat2Fields document, which describes how .CAL format fields are mapped to CAL-ACCESS database table columns. Note the Valid_V column on the far right.
Step 3: Copy the DocumentCloud ID and the page number(s) where rec_type's list of valid values is defined.
The DocumentCloud ID can be found the in the URL that points to the document. For example, the url to the .CAL Format version 2.01 doc is http://www.documentcloud.org/documents/2712034-Cal-Format-201.html#document/p1, and the id is 2712034-Cal-Format-201.
And the start page we want to grab is the DocumentCloud page number, not the page number printed on the .PDF. If the list of valid values spans multiple pages, then grab the page where the list ends as well.
Step 4: Find where rec_type is defined in lobbying.py in the /calaccess_raw/models/lobbying.py file underneath the CvrRegistrationCd class.
Since the model files are rather long, take care to be sure you find the where rec_type is defined for the CvrRegistrationCd model. It should look something like this:
    class CvrRegistrationCd(CalAccessBaseModel):
        # ...
        # several lines of code later...
        # ...
        rec_type = fields.CharField(
            max_length=4,
            db_column='REC_TYPE',
            blank=False,
            verbose_name='record type',
            help_text='',
        )

Step 5: Add the document references
Say you found the list of valid values listed in three places. You would list them in the documentcloud_pages attribute like this:
    class CvrRegistrationCd(CalAccessBaseModel):
        # ...
        # several lines of code later...
        # ...
        rec_type = fields.CharField(
            max_length=4,
            db_column='REC_TYPE',
            blank=False,
            verbose_name='record type',
            help_text='',
            documentcloud_pages=[
                DocumentCloud(id='2711616-MapCalFormat2Fields', start_page=10),
                DocumentCloud(id='2712033-Cal-Format-1-05-02', start_page=19),
                DocumentCloud(id='2712034-Cal-Format-201', start_page=24, end_page=25),
            ]
        )

Note: You only need to specify the end_page if the list spans multiple pages.
Step 6: Update the rec_type's help_text (if necessary)
It might be missing or it might be an empty string or it might not be consistent with what you see in the documentation. Note: The entire help_text string needs to be enclosed in single- or double-quotes like this:
    help_text='This is the help text',

If the help text is really long (80+ characters), then it needs to span multiple lines like this:
    help_text='This is the help text...blah...blah...blah...blah...blah...blah...\
...blah...blah...blah',

If you can, check the rec_type's defined choices against the actual values in rec_type's database column.
This will require you to install the app and run the updatecalaccessrawdata command. Then you can get the distinct column values with a GROUP BY query like this:
    SELECT REC_TYPE, COUNT(*)
    FROM CVR_REGISTRATION_CD
    GROUP BY 1
    ORDER BY 1;

It's likely that you'll find undocumented values in database column, some of which are variants of the valid values. You can note these by repeating the same definition for each variant like this:
    OFFICE_CD_CHOICES = (
        ('GOV', 'Governor'),
        ('gov', 'Governor'),
        ('GUV', 'Governor'),
        # ...
    ),

If you're dealing with a set of choices that's been consolidated into calaccess_raw/annotations/choices.py, you can map the different variants to the same definition using the key of the choices dict like this:
    OFFICE_CD_CHOICES = (
        ('gov', look_ups.OFFICE_CODES['GOV']),
        ('GUV', look_ups.OFFICE_CODES['GOV']),
        # ...
    ),

If you're not able to check the database column values for whatever reason, don't sweat it. We'll deal with it in a later issue.
Wrap up: Review your changes and create a pull request

That's it!
PS: If any of this feels confusing, or if it doesn't seem to match up with what you are seeing, or if you have any suggestions about another approach, don't hesitate to speak up. You can post a comment below, or hit up the #california-civic-data channel on the News Nerdery Slack.

Done.


Redirect if user does not exist

At the moment you just get a 500 error page.

.

Please send backport 🙂

I have changed the title of this PR and provided a description to hopefully more clearly explain what this PR is doing.


x/tour: no way to terminate a snippet that has continued running

The Go tour does not provide the same process kill function provided by e.g. present
although the underlying runner can handle these messaged. For the majority of cases this
is not an issue - it is when people are working on the http lessons where the socket
being held by an incorrect but runnable snippet will block later attempts.

The http lesson stubs should probably handle the returned errors (or otherwise prompt
the user that errors are good to check) from ListenAndServe to help users diagnose why a
edited change is not seen when the snippet is re-run.

gotour version: 91f9594fc692+

It looks like there are two things in place to protect against this issue:

The "run" button now turns into a "kill" button
If something takes a long time the program exits with "process took too long"

I think this can be closed.

Yep, @campoy added a Kill button a while ago.


refactor package by adding some methods, documentation and null-safety migration

Add wrap method
Add URL validation method
Add random string generator
Migrate to null-safety
Complete documentation
Add example
Format dart files

well done


Session style lib

Motivation / Description
Changes introduced
Linear ticket (if any)
Additional comments

Yep, closing it


assetmap file is loaded through a relative path which fails when you land on a nested route

The request for the assetMap searches for the it relatively so loading the assetMap from /parent will load correctly but /parent/child and /parent/child/grandchild would not.

@k-dauda try using the 'prepend' option as follows:
	fingerprint: {
		enabled: true,
		generateAssetMap: true,
		fingerprintAssetMap: true,
		prepend: '/'
	}


prometheus-adaptor not working: Error: configmaps "extension-apiserver-authentication" not found

Describe the bug
prometheus-adaptor cannot be deployed..
I0310 14:11:26.124010       1 adapter.go:91] successfully using in-cluster auth
W0310 14:11:26.502692       1 authentication.go:245] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLE_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
To Reproduce
Try to deploy prometheus-adaptor
Expected behavior
That it deploys correctly
Additional context
In a greater attempt to deploy kube-prometheus.
also:
kubectl get cm -n kube-system extension-apiserver-authentication
Error from server (NotFound): configmaps "extension-apiserver-authentication" not found

Related: #252

Git fixed with #252 IMHO.

I believe this is fixed.


Move custom PositionRange encoding into a property wrapper

This lets us use the Range<Position> without manually converting back
and forth in the majority of cases. See the note on HoverResponse for
the behaviour with Optional that makes us have to provide a custom
Codable implementation in two places that used to be synthesized.

@swift-ci please test


Not an issue

Hi Ingan, how did you change the texture of scrollbars/buttons/progressbars in Windows 10 like on your screenshot? https://github.com/Ingan121/BasicThemer2/blob/master/스크린샷(241).png
Default ones look more flatter, and I wanna change them too.
Thank you! :)

I used this one.
This still works for 20H1 (but not tested for 20H2).


example 16 drag from outside 404 not found

Below link for example 16 drag from outside is not accessible and throws 404 error
https://strml.github.io/react-grid-layout/examples/16-drag-from-outside.html

@VishalJadhaoCTS it'll be fixed here https://github.com/STRML/react-grid-layout/pull/997

@daynin Sergey, apart from merging the commit, is there anything else we have to do for the github pages to take the new HTML file in the examples? /cc @STRML

@daynin Ok, so I was digging around, and found the following, I also see a gh-pages branch in the repo which is from there the gh-pages read (I think). Do we merge those changes there?

@n1ghtmare

Do we merge those changes there?
yes, of course. I've done it. But we still need to publish new version in npm to allow users use new API. @STRML could you help use with it?

@VishalJadhaoCTS now you can find the example here https://strml.github.io/react-grid-layout/examples/15-drag-from-outside.html

LGTM


Revert "[flutter_tools] fold executable resolution into flutter"

Reverts flutter/flutter#67669
Causes devicelab crash:
2020-10-12T13:00:01.284390: stderr: Oops; flutter has exited unexpectedly: "ProcessException: No such file or directory
stderr:   Command: /Applications/Google Chrome.app/Contents/MacOS/Google Chrome --version".
2020-10-12T13:00:01.928925: stderr: A crash report has been written to /Users/flutter/.cocoon/flutter/examples/platform_channel/flutter_01.log.
2020-10-12T13:00:01.930019: stdout: This crash may already be reported. Check GitHub for similar crashes.
2020-10-12T13:00:01.930357: stdout: https://github.com/flutter/flutter/issues?q=is%3Aissue+ProcessException%3A+No+such+file+or+directory%0A++Command%3A+%2FApplications%2FGoogle+Chrome.app%2FContents%2FMacOS%2FGoogle+Chrome+--version

TBR @zanderso

lgtm


Question about result table on paper

It's really a great job and clear codes as I said in the mail too. Thanks for your work!
But when I shared the paper with my labmates, who question about the result table on paper here:

As you can see here, we can know that tranfuser and other models may have variance but the number is too big, so did you try to explain the driving score belief.

As I know that, your expert is from

The expert agent is based on the autopilot from this codebase.

But the expert as we all know is rule-based, when our traffic random seed is always default in leaderboard_evaluator.py as 0, so all simulator's NPCs have same action as carla said here when you run Town05 Short or Long, why the expert will have 6.21 variance and 4.00 variance score?

Thanks again!

The variance for transfuser and other models comes from two sources - training seed and evaluation variance. Training seed generally affects the initialization of the network and the order of the training data. Evaluation variance is due to the stochasticity in the behavior or other dynamic agents and traffic lights in the scene.

In our experiments, we found that the traffic manager in CARLA 0.9.10 still led to some evaluation variance. In the newer CARLA version, the traffic manager is supposed to be deterministic so that should reduce the variance but I have not experimented with the newer versions yet.

The variance for transfuser and other models comes from two sources - training seed and evaluation variance. Training seed generally affects the initialization of the network and the order of the training data. Evaluation variance is due to the stochasticity in the behavior or other dynamic agents and traffic lights in the scene.
In our experiments, we found that the traffic manager in CARLA 0.9.10 still led to some evaluation variance. In the newer CARLA version, the traffic manager is supposed to be deterministic so that should reduce the variance but I have not experimented with the newer versions yet.

Thanks for replying, for first one yes the variance is from seed and initial But according to the result table and variance maybe the Geometric method get higher scores since low variance here.
And for Carla, I check on 0.9.10 the documents didn’t have deterministic method but the leaderboard based on Carla <IP_ADDRESS> which use the getter method on code, I run several time on my computer find that with <IP_ADDRESS>, it’s true for deterministic.
Finally Thanks for your reply, all the issue part helps me learn more about your method!


Cube volume shifted?

When loading a benzene SDF and the corresponding cube file, the resulting surfaces/fields are shifted with respect to the benzene ring. To test this I used example files from the 3Dmol website (SDF and Cube).
Viewed in e.g. Chimera:

Viewed in NGL (surface based on value cutoffs -0.01 and 0.01):

In the NGL viewer the atoms are shifted downwards (from this perspective) into the bottom fields, where the centre of the atoms should be aligned in the middel between the top and bottom fields.
PS Thank you for your great efforts in developing the NGL viewer!

Thanks for reporting. There was an error in the cube parser when a line with orbital data is included. Fixed in 52da06247efb15f99d467479df44a700f9336b92

Thanks for the quick fix, it works like a charm.
This will definitely help during lectures: making orbitals a bit more insightful/fun in 3D!

Great to hear it works for you!


Build CLASSPATH from maven

make CLASSPATH from maven, and cache it.

Ah, sorry. it use webapi#http#encodeURIComponent. I'll remove dependency.

Looks nice, thank you. Will play with it a little bit.

I'm thinking if you allow this, CLASSPATH which is contained ~/.m2 and athers are needless. how do you think?

:+1:

Yeah, of course, this approach is much better.