Moving proposal from Draft to Discussion doesnt create discord alert

fixed https://github.com/nance-eth/nance-ts/commit/0a6e0d10db93b224067049dd9d96a9c78b046388


Spectrum js code from SED Spectrum Lab project

These files are a stripped down version of Alaalden Ibrahim's code at https://waps.cfa.harvard.edu/microobservatory/spectrum/playground.html, used here with permission from Alaalden & Spectrum Lab PI Mary Dussault.
To view:

Load the html file
Click "choose data file to upload txt"
Select the included sample data file (sun_ref_colina96.txt)
Click "Display file"

Ultimately, the "display file" functionality will be tied to the students' galaxy selection in WWT.
The Spectrum Lab has a lot more functionality than we need. I tried to strip away most of what we aren't using, but I did not do this in a very efficient way, so this should be cleaned up further.

@nmearl This is the js to display the galaxy spectra that we will use in the velocity measurement tab. Can you show us how to wrangle this into the ipyvuetify app, please? Thanks!

We think it will be more straightforward to write new python code with the spectrum tool functionality instead of trying to wrap in this additional layer of .js into the ipyvuetify app, so I am closing this for now and will open a new issue to serve as the thread for the python version of this functionality.


Single first-level element is stripped

What is this feature about (expected vs actual behaviour)?
If string contains only one parent element, parser strips this one from the result.
$d = new voku\helper\HtmlDomParser;

$d->loadHtml("
p1

p2
");
echo (string)$d; //
p1

p2
 - correct

$d->loadHtml("

p1

");
echo (string)$d; //
p1
 - incorrect

I don't know if this is an expected behavior, but seems broken for me... Right now I have to manually wrap initial html in a div element and if it contains several root elements this div stays in generated html.

I created a test for PHP 7.0 - 7.4 and can't see this problem: https://travis-ci.org/voku/simple_html_dom/builds/631294151 ? Do you use Windows or Linux?

Hi! Sorry for the waiting...
I'm also sorry for this case. Problem occurs only when using save() method.
My guess is in original class "root" element was created automatically (maybe ) and the final result was generated from "root" innerHtml. https://github.com/samacs/simple_html_dom/blob/master/simple_html_dom.php#L1145

I don't know if a html wrapper or the full html is better [more expected]? What do you think of this: https://github.com/voku/simple_html_dom/commit/284fe404c685989ea333ab5710534a972870f47f

As for me, html() is more expected and it is the original behaviour.
Method save() is supposed to be used for saving the result to a file, so...

Fixed in version 4.7.11


ValueError when running map_ecotopes without xarray[io] installed

When running map_ecotopes() without xarray[io] installed I got the following error:
ValueError: found the following matches with the input file in xarray's IO backends: ['netcdf4', 'h5netcdf']. But their dependencies may not be installed, see:
https://docs.xarray.dev/en/stable/user-guide/io.html
https://docs.xarray.dev/en/stable/getting-started-guide/installing.html

This can be resolved by installing xarray with the optional io package. But this needs to be listed in the requirements.
python -m pip install "xarray[io]"

The requirements and README are updated; thanks for notifying!


default username used for git clones over ssh is not generally correct

This might be a duplicate of #1851 or #2078 but I can't quite tell.  My understanding is that cargo is supposed to use ssh-agent for authentication, but I can't get this to work.
I have a dependency with a git-over-ssh path:
[dependencies.sma_utils]
git = "ssh://gitsrvsim/usr/abaqus60/GITrepo/sma_rust.git"

SSH to this machine is password-less (due to ssh-agent, and not due a .ssh/config file):
$ ssh -o BatchMode=yes gitsrvsim hostname
Permission denied (publickey,gssapi-with-mic,password).
$ ssh-add ~/.ssh/sim_internal
Identity added: /u/users/lxd/.ssh/sim_internal (/u/users/lxd/.ssh/sim_internal)
$ ssh -o BatchMode=yes gitsrvsim hostname
gitsrvsim

But cargo build still fails:
cargo build --verbose
    Updating registry `https://github.com/rust-lang/crates.io-index`
    Updating git repository `ssh://gitsrvsim/usr/abaqus60/GITrepo/sma_rust.git`
Unable to update ssh://gitsrvsim/usr/abaqus60/GITrepo/sma_rust.git

Caused by:
  failed to fetch into /rd/gen/lxd/do_not_delete/multirust/.cargo/git/db/sma_rust-0fec95efab468a0c

Caused by:
  failed to authenticate when downloading repository

Caused by:
  [7/-1] Config value 'credential.helper' was not found

My quick googling suggests that git's credential-helper is primarily used for HTTPS authentication.  No one seems to use it for ssh (likely because git can use ~/.ssh/config).  My git is not new enough to have the credential-helper subsystem.
So I can't really tell where the problem lies.  Currently running `cargo 0.9.0-nightly (4739ba1 2016-02-16)
Thanks!

Yeah I think that this is a dupe, but I'm not 100% sure. Can you try specifying the full URL instead of just gitsrvsim? That .ssh/config alias definitely won't be read by us (or libgit2) I believe

gitsrvsim is not an alias.  It's resolvable when you tack on a suffix from /etc/resolv.conf.   So using the fully qualified domain name in Cargo.toml didn't change anything

Note that we actually don't shell out to git at all, we use libgit2 as a bundled library which implements all the git operations we need. We specifically try a number of authentication strategies here, and I wonder if perhaps SSH_KEY isn't coming through somehow?
Unfortunately there's not a lot of debug logging around there, so I'm curious:

Is there a way for me to reproduce this locally?
Would you be willing to try out some debug builds of Cargo to see if it works?

I would be happy to try out any and all debug builds!
I do believe this can be reproduced (I don't think there is anything unique about this particular machine).  Let me try to put together a repo script.  I'll get back to you on this.

Step 0 (optional) : Configure machine for pubkey authentication only.  Actually, disabling keyboard-interactive is not required to reproduce this, but it can be useful to show that your ssh agent is working.

I'm sure you know how to do this, but for anyone else following along at home, the steps are documented here https://gist.github.com/eminence/93aab78611b9279d8b35

Create a project that will be the dependency.  Add a trivial thing to it, so that it'll be git-cloneable

achin@bigbox ~/tmp/01 $ cargo init mydep
achin@bigbox ~/tmp/01 $ cd mydep/
achin@bigbox ~/tmp/01/mydep $ echo "fn foo() -> u8 { 4 }" > src/lib.rs
achin@bigbox ~/tmp/01/mydep $ git add Cargo.toml src/lib.rs
achin@bigbox ~/tmp/01/mydep $ git commit -m "initial commit"
[master (root-commit) 77cfe74] initial commit
 2 files changed, 7 insertions(+)
 create mode 100644 Cargo.toml
 create mode 100644 src/lib.rs

Create a new project that will depend on mydep.

achin@bigbox ~/tmp/01 $ cargo new --bin myapp
achin@bigbox ~/tmp/01 $ cd myapp/
achin@bigbox ~/tmp/01/myapp $ vim Cargo.toml
achin@bigbox ~/tmp/01/myapp $ cat Cargo.toml

[package]
name = "myapp"
version = "0.1.0"
authors = ["Andrew Chin<EMAIL_ADDRESS>
[dependencies]

[dependencies.mydep]
git = "ssh://localhost/storage/home/achin/tmp/01/mydep"

Now try to build:

achin@bigbox ~/tmp/01/myapp $ cargo build --verbose
    Updating git repository `ssh://localhost/storage/home/achin/tmp/01/mydep`
Unable to update ssh://localhost/storage/home/achin/tmp/01/mydep

Caused by:
  failed to fetch into /storage/home/achin/.multirust/toolchains/nightly/cargo/git/db/mydep-f9f860195307f1db

Caused by:
  failed to authenticate when downloading repository

Caused by:
  [7/-1] Config value 'credential.helper' was not found

Observe that a plain git-clone is successful:

achin@bigbox ~/tmp/01/myapp $ git clone ssh://localhost/storage/home/achin/tmp/01/mydep
Cloning into 'mydep'...
remote: Counting objects: 5, done.
remote: Compressing objects: 100% (3/3), done.
remote: Total 5 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (5/5), done.
Checking connectivity... done.

Awesome, thanks @eminence! There's two issues at play here:

The root cause is the username we attempt to connect with via ssh. Without any extra information we fall back to the username of git, but that's probably the wrong username for you (it was for me)
The error message here is quite bad! I'm working on a PR to fix that.

Ah ha!
Yes, explicitly specifying a username works! However, this is not ideal, since the username that I need to access "localhost" (or "gitsrvsim") is not the username that you need to access "localhost" or ("gitsrvsim").   Perhaps if no username is specified, default to the OS user name (and if that can't be determined, then fallback to git) ?

Hm unfortunately libgit2 provides a kinda wacky interface to interacting with authorizations, but I think we could track something like that, yeah.

I'm now running with this change, but things still are not quite working (but failing in a different way this time!)
lxd@east6sim:/scratch/lxd/00/myapp> cargo build --verbose
    Updating git repository `ssh://localhost/scratch/lxd/00/mydep`
Unable to update ssh://localhost/scratch/lxd/00/mydep

Caused by:
  failed to clone into: /rd/gen/lxd/do_not_delete/multirust/.cargo/git/db/mydep-d4bb305298ecb371

Caused by:
  failed to authenticate when downloading repository

Caused by:
  [23/-1] username does not match previous request

The myapp and mydep crates were set up as described the in comment above.
Using cargo 0.9.0-nightly (582dcb7 2016-02-26)

(Trying to build/clone without an ssh-agent gives the error error authenticating: no auth sock variable which is much better!)
I see the same problem on another system of mine, so I going to re-open this issue.

Hm... weird! I'm not sure how this worked for me locally?

If libgit2 doesn't allow us to change usernames then there may be no recourse here unfortunately.

I don't think anyone else is running into this, so I will take an action item to dig into this to try find the source of this particular error

I finally dug into this.  The situation in with_authentication is as follows:
The first time in here we hit the allowed.contains(git2::USERNAME) block.  Since the URL within Cargo.toml doesn't contain any username, the username parameter is None so we simply return "git".
Second time in here we hit the UsernameAttempt::Arg arm of username_attempt match.  Now the username parameter is Some("git") so we end up returning "git" via the if let Some(name) = name block.
Since ssh authentication with the username of "git" does not  work on my system (I have no user account with that name), we'll then fall back into this callback a third time.  We quickly pass through the UsernameAttempt::CredHelper match arm before landing in the UsernameAttempt::Local arm, where Some("achin").
And so libgit2 doesn't like this because first we said to use the username "git" and now we've just said use the username "achin"
So that's the scenario.  As for the fix, I am going to argue that returning "git" here is not the correct thing to do.
I can envision 3 scenarios:

You have explicitly specified a username in the URL.  In this case, it appears that allowed doesn't contain git2::USERNAME and so we directly go to the UsernameAttempt::Arg arm which is successful, and we are then done without any additional fuss.
You omit the username from the URL, and are relying on your ssh_config file to specify the username.  This simply isn't implemented today, and will continue to not work after my proposed change.
You omit the username from the URL and are assuming that your OS username will be used.  This is my case.  Absent any additional information, we should simply assume that the OS username should be used and not try to recover if that fails.

There might actually be a 4th scenario, when you want to use gitcredentials(7) to do username mapping.  I've kind of ignored this here because 1) I'm not sure how often this is actually used for ssh, 2) I'm not sure it currently worked in cargo today, and 3) I'm not sure how this works at all with plain-old-git.
In order to fully complete this story I need to continue to figure out how gitcredentials work.  I also cannot explain why things seem to work for you in your environment.
That was a very long explaining for something fairly simple, but hopefully it was worth it by making things clear.  With all of this in mind, I have some ideas about how to re-write with_authentication to make it simpler, but I'd like to hear your thoughts first.

Hm we probably can't change the fallback to git without getting other scenarios to work because that's the username which works for private github repositories, for example. If libgit2 doesn't support multiple usernames in one authentication attempt, however, perhaps we could just make multiple authentication attempts?
Basically I'd imagine that we have a set of usernames we want to try if one isn't specified, and we can just try a bunch in an expensive loop (the network is expensive anyway).

Regarding private github repos, how common do you think this is?   It seems like https will be far more common than ssh (I'm not even sure ssh urls would work, since the standard operating procedure for github+ssh is to use a ssh_config file, which cargo doesn't support).  If they have figured out how to get ssh to work, then hard-coding the "git" username into the URL would be a workaround.
I certainly agree that documented and described behavior is the one we want (try a bunch of usernames/credentials until 1 works).  I'll continue to look at this.

I've at least in the past used ssh URLs I think, but I'm not sure how widely it's used in general. I found that the method of informing git of my https credentials was way more work than just using an SSH url (as my key was already in my agent).

@alexcrichton @eminence
I also occurred.
but comment-out this lines on ~/.gitconfig, solved the problem.
I'm usually insteadOf url. Maybe this setting popular.
If cargo command does not support for it, I think that there is a need.
I hope this will help.
[http]
	cookiefile = ~/.config/git/.gitcookies
	sslCAInfo = /usr/local/etc/ssl/certs/curl-ca-bundle.crt

# URL shorthands
[url "git@github.com:"]
	insteadOf = "https://github.com/"
	pushInsteadOf = "github:"
	pushInsteadOf = "git://github.com/"

[url "git://github.com/"]
	insteadOf = "github:"

[url "git@gist.github.com:"]
	insteadOf = "gst:"
	pushInsteadOf = "gist:"
	pushInsteadOf = "git://gist.github.com/"

[url "git://gist.github.com/"]
	insteadOf = "gist:"

I too ran into this issue, using the insteadOf configuration for git. I had used this so that I could run go get for private repos.

Ok, I've attempted a fix for this again at https://github.com/rust-lang/cargo/pull/2584, @eminence could you try that out?

@alexcrichton , I'm sorry for taking so long to test this can get back to you, but I have good news!  It works!   Many thanks for tackling this issue! :tada:

Note that we actually don't shell out to git at all, we use libgit2 as a bundled library which implements all the git operations we need. We specifically try a number of authentication strategies here, and I wonder if perhaps SSH_KEY isn't coming through somehow?

@alexcrichton there is no way that link still is valid years later ... better to have a hash specific


String values in extra and in filter are passed with the quotation marks

My filter:
class ContextInfoFilter(logging.Filter):
    def filter(self, record):
        record.friend="yes"
        record.user = user.id
        return True
logger.addFilter(ContextInfoFilter())
logger.info("hi graylog")

Graylog logs:
{
  user: "u'serge'", //the u' and ' should not be logged
  friend: "'yes'", //the ' surrounding yes should not be logged
  ...
}

Here is a screenshot from Graylog UI showing the issue:

Not sure if this is relevant anymore. I'm closing it but feel free to re-open if you have any updates.


LaPresidente jellyseerr collection is not parsing logs

Hi there, I installed @LePresidente's jellyseerr collection, but it seems like my log isn't being parsed correctly.
Acquisition Metrics:

+----------------------------------------+------------+--------------+----------------+------------------------+
|                 Source                 | Lines read | Lines parsed | Lines unparsed | Lines poured to bucket |
+----------------------------------------+------------+--------------+----------------+------------------------+
| file:/var/log/jellyseerr/overseerr.log | 26         | -            | 26             | -                      |
+----------------------------------------+------------+--------------+----------------+------------------------+

Parser Metrics:

+---------------------------------------+-------+--------+----------+
|                Parsers                | Hits  | Parsed | Unparsed |
+---------------------------------------+-------+--------+----------+
| LePresidente/jellyseerr-logs          | 26    | -      | 26       |
| child-LePresidente/jellyseerr-logs    | 104   | -      | 104      |
+---------------------------------------+-------+--------+----------+

I am running crowdsec and jellyseerr on docker and mounting /var/log/jellyseerr/overseerr.log from the jellyseerr folder to the crowdsec instance, so as not to expose the Docker daemon socket. Then have a acquis.d/jellyseerr.yml to tell it where to find the logs and how to process it:
filenames:
  - /var/log/jellyseerr/overseerr.log
labels:
  type: jellyseerr

The file is mounted correctly, as I can see with docker exec crowdsec cscli metrics above and also by reading the file directly with docker exec crowdsec tail /var/log/jellyseerr/overseerr.log:
2024-01-22T11:40:00.017Z [info][Jobs]: Starting scheduled job: Jellyfin Recently Added Sync
(...)

Is there a way to debug this and figure out what's going on? It seems like it's reading the logs, just not parsing them.
thanks

It only parsers if the regex matches, have you tried entering a bad username/password combination?

It only parsers if the regex matches, have you tried entering a bad username/password combination?

aye, apologies for my ignorance. It does work perfectly then, thanks :)


feat: Add interactive documentation

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 59.73%. Comparing base (9c3fc07) to head (970e8cd).

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #92      +/-   ##
==========================================
+ Coverage   59.70%   59.73%   +0.02%
==========================================
  Files          21       21
  Lines         675      668       -7
==========================================
- Hits          403      399       -4
+ Misses        272      269       -3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Line Layer Overlay blocking tooltip for some polygons

I am adding a polyline shapefile that to indicate boundaries for neighbourhood clusters. It seems some of these polylines are causing tooltips for certain polygons to not appear. I have an arrow on the image below showing one polygon that doesn't work. It doesn't seem to have a consistent interference.

The shape files/style can be found in the link below. I am using .10 Branch, QGIS2.18. Log file included as well.
Files: http://pc.cd/aoQotalK
2017-01-31T10:03:34	0	osHelper Windows
2017-01-31T10:15:56	0	model 2.18.0
2017-01-31T10:15:56	0	model 2.7.5 (default, May 15 2013, 22:44:16) [MSC v.1500 64 bit (AMD64)]
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	winHelper Query registry for HKEY_CURRENT_USER\Software\node.js\InstallPath
2017-01-31T10:15:56	2	winHelper No more data is available: Software\node.js
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	osHelper Windows
2017-01-31T10:15:56	0	winHelper Query registry for HKEY_CURRENT_USER\Software\node.js\InstallPath
2017-01-31T10:15:56	2	winHelper No more data is available: Software\node.js
2017-01-31T10:16:40	0	model EXPORT start ==================================================
2017-01-31T10:16:40	0	model        Title = [Homicides in 2015]
2017-01-31T10:16:40	0	model        Header = [True]
2017-01-31T10:16:40	0	model        Width = [800]
2017-01-31T10:16:40	0	model        Height = [600]
2017-01-31T10:16:40	0	model        Main layer = [Homicide_CT]
2017-01-31T10:16:40	0	model        IDField = [OBJECTID]
2017-01-31T10:16:40	0	model        Projection = [Miller]
2017-01-31T10:16:40	0	model        Simplify = []
2017-01-31T10:16:40	0	model        Output = [G:\DC Policy Center\Crime Incidents\Maps\Homicide]
2017-01-31T10:16:40	0	model        Zoom/Pan = [True]
2017-01-31T10:16:40	0	model        Legend = [True]
2017-01-31T10:16:40	0	model        LegendPos = [Bottom Left]
2017-01-31T10:16:40	0	model        IncExtras = [True]
2017-01-31T10:16:40	0	model        Extras = [Homicide_CT, N_Lines]
2017-01-31T10:16:40	0	model        IncPopup = [True]
2017-01-31T10:16:40	0	model        PopupPos = [Bubble]
2017-01-31T10:16:40	0	model        Popup = [
Homicide_2{Homicide_2}
Homicide_3{Homicide_3}
]
2017-01-31T10:16:40	0	model        IncViz = [False]
2017-01-31T10:16:40	0	model        Chart = [Line Chart]
2017-01-31T10:16:40	0	model        VizWidth = [240]
2017-01-31T10:16:40	0	model        DataRanges = []
2017-01-31T10:16:40	0	model        Labels = []
2017-01-31T10:16:40	0	model EXPORT copying folders and files
2017-01-31T10:16:41	0	model EXPORT Homicide_CT
2017-01-31T10:16:42	0	qgisWrapper Adding field: d3Css
2017-01-31T10:16:42	0	model GRADUATED: attr Homicide_3
			0 - 0::No Homicides::FILL SYMBOL (1 layers) color 166,166,166,255
			0.1 - 1::1::FILL SYMBOL (1 layers) color 254,240,217,255
			1 - 2::2::FILL SYMBOL (1 layers) color 253,216,164,255
			2 - 3::3::FILL SYMBOL (1 layers) color 252,183,121,255
			3 - 4::4::FILL SYMBOL (1 layers) color 252,141,89,255
			4 - 5::5::FILL SYMBOL (1 layers) color 235,96,63,255
			5 - 6::6::FILL SYMBOL (1 layers) color 211,49,33,255
			6 - 7::7::FILL SYMBOL (1 layers) color 179,0,0,255
2017-01-31T10:16:42	0	model setGraduatedSymbol
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 0.0 and "Homicide_3" <= 0.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 0.1 and "Homicide_3" <= 1.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 1.0 and "Homicide_3" <= 2.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 2.0 and "Homicide_3" <= 3.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 3.0 and "Homicide_3" <= 4.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 4.0 and "Homicide_3" <= 5.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 5.0 and "Homicide_3" <= 6.0
2017-01-31T10:16:42	0	model Filter: "Homicide_3" >= 6.0 and "Homicide_3" <= 7.0
2017-01-31T10:16:42	0	model EXPORT N_Lines
2017-01-31T10:16:43	0	qgisWrapper Adding field: d3Css
2017-01-31T10:16:43	0	model SINGLE: LINE SYMBOL (1 layers) color 0,0,0,255
2017-01-31T10:16:43	0	model setSingleSymbol
2017-01-31T10:16:43	0	model Filter:
2017-01-31T10:16:44	0	model EXPORT popup data
2017-01-31T10:16:44	0	model EXPORT complete =========================================================
2017-01-31T10:23:42	0	model 2.18.0
2017-01-31T10:23:42	0	model 2.7.5 (default, May 15 2013, 22:44:16) [MSC v.1500 64 bit (AMD64)]
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:23:42	0	winHelper Query registry for HKEY_CURRENT_USER\Software\node.js\InstallPath
2017-01-31T10:23:42	2	winHelper No more data is available: Software\node.js
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:23:42	0	osHelper Windows
2017-01-31T10:24:02	0	model EXPORT start ==================================================
2017-01-31T10:24:02	0	model        Title = [test]
2017-01-31T10:24:02	0	model        Header = [False]
2017-01-31T10:24:02	0	model        Width = [800]
2017-01-31T10:24:02	0	model        Height = [600]
2017-01-31T10:24:02	0	model        Main layer = [Homicide_CT]
2017-01-31T10:24:02	0	model        IDField = [OBJECTID]
2017-01-31T10:24:02	0	model        Projection = [Miller]
2017-01-31T10:24:02	0	model        Simplify = []
2017-01-31T10:24:02	0	model        Output = [G:\DC Policy Center\Crime Incidents\Maps\Homicide]
2017-01-31T10:24:02	0	model        Zoom/Pan = [True]
2017-01-31T10:24:02	0	model        Legend = [True]
2017-01-31T10:24:02	0	model        LegendPos = [Bottom Left]
2017-01-31T10:24:02	0	model        IncExtras = [True]
2017-01-31T10:24:02	0	model        Extras = [Homicide_CT, N_Lines]
2017-01-31T10:24:02	0	model        IncPopup = [False]
2017-01-31T10:24:02	0	model        PopupPos = [Bubble]
2017-01-31T10:24:02	0	model        Popup = []
2017-01-31T10:24:02	0	model        IncViz = [False]
2017-01-31T10:24:02	0	model        Chart = [Line Chart]
2017-01-31T10:24:02	0	model        VizWidth = [240]
2017-01-31T10:24:02	0	model        DataRanges = []
2017-01-31T10:24:02	0	model        Labels = []
2017-01-31T10:24:02	0	model EXPORT copying folders and files
2017-01-31T10:24:03	0	model EXPORT Homicide_CT
2017-01-31T10:24:03	0	qgisWrapper Adding field: d3Css
2017-01-31T10:24:03	0	model SINGLE: FILL SYMBOL (1 layers) color 166,166,166,255
2017-01-31T10:24:03	0	model setSingleSymbol
2017-01-31T10:24:03	0	model Filter:
2017-01-31T10:24:04	0	model EXPORT N_Lines
2017-01-31T10:24:04	0	qgisWrapper Adding field: d3Css
2017-01-31T10:24:04	0	model SINGLE: LINE SYMBOL (1 layers) color 0,0,0,255
2017-01-31T10:24:04	0	model setSingleSymbol
2017-01-31T10:24:04	0	model Filter:
2017-01-31T10:24:06	0	model EXPORT complete =========================================================

Strange. I don't know why this is happening, as none of the LineStrings are closed into LinearRings and hence becoming polygons. Indeed a working and non-working area fall under the same area that would be affected if a LineString were closed...
Though as it's placed above the data driven layer in the map the simplest thing would be to stop it being clickable and the click event will drop down the top layer to the main layer.
For now, add "pointer-events: none;" to the css class on that layer, and I'll add it to branch asap.


Error pop up twice when moving to next layout encountered an issue

If you create a layout and by mistake the name of the tab doesnt match the name of the layout, the error message is two vague and appears twice.

Fixed message and popup only appears once


IndexError: index 21761 is out of bounds for axis 0 with size 10809 during training

I have process the image using cvs_to_numpy, then when i try to train the following error appears:
Run id: expression_detection
Log directory: /tmp/tflearn_logs/
Training samples: 32427
Validation samples: 9495
Exception in thread Thread-3:
Traceback (most recent call last):
File "E:\AnacondaInstaller\envs\ML_learn\lib\threading.py", line 914, in _bootstrap_inner
self.run()
File "E:\AnacondaInstaller\envs\ML_learn\lib\threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File "E:\AnacondaInstaller\envs\ML_learn\lib\site-packages\tflearn\data_flow.py", line 187, in fill_feed_dict_queue
data = self.retrieve_data(batch_ids)
File "E:\AnacondaInstaller\envs\ML_learn\lib\site-packages\tflearn\data_flow.py", line 222, in retrieve_data
utils.slice_array(self.feed_dict[key], batch_ids)
File "E:\AnacondaInstaller\envs\ML_learn\lib\site-packages\tflearn\utils.py", line 187, in slice_array
return X[start]
IndexError: index 21761 is out of bounds for axis 0 with size 10809
Can someone guide me in this issue?

I have the same problem. Have you solved it？


Japas' improvisation fails on his own

[x] I have checked the known issues and searched Github to ensure this issue has not already been reported.
[x] This is not a feature request, I know those belong on Discord/Github Discussions.

Description of the bug:
When improvising along Japas, the prompt for completing the melody cancels itself immediately.
Can you reproduce? If so please list the steps:

[ ] No, I cannot reproduce this bug
[x] Yes, here are the steps to reproduce the bug:

Go to Zora Hall, and to Japas' room
Pull out the Ocarina (guitar) while standing next to Japas
After Japas plays his part of the melody, the prompt fails instantly

Expected behavior:
The game should let you play the guitar / finish the improvisation
Screenshots or videos:
https://github.com/HarbourMasters/2ship2harkinian/assets/36055140/4b6357f6-e384-46f8-9e70-837df88a3d5b
System Information:

OS: Arch Linux 6.9.3.arch1-1
GFX Backend: OpenGL
Game Version: Rika Bravo 1.0.1
Rom Version: USA 1.0

This seems to only happen on Linux.

How can I workaround this? Only thing I can think of is using my save with the windows version through wine then returning to Linux.

Just ignore it for now. It's not required to get the reward nor 100% the save.

Fix is available in Satoko Charlie 1.1.2


feat: a lowering pass to re-compose ops into aten.linear

Description
A lowering pass to re-compose ops into aten.linear.
A discussion about why we need this lowering pass can be found here: #2296
Fixes #2398
Type of change

New feature (non-breaking change which adds functionality)

Checklist:

[x] My code follows the style guidelines of this project (You can use the linters)
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas and hacks
[ ] I have made corresponding changes to the documentation
[x] I have added tests to verify my fix or my feature
[x] New and existing unit tests pass locally with my changes
[x] I have added the relevant labels to my PR in so that relevant reviewers are notified

@gs-olive Thanks for your review and constructive comments. I have addressed all the issues above. Please take a look when you get the chance. Thanks a lot!

@gs-olive Can we merge into the main branch if everything looks good?

@zewenli98 - this one looks good, but would like to wait until later this week to merge this particular change


Retest HDMI switch

With ne new 64-bit bas OS the LCD driver changes ... check if the HDMI switches are still working.

the switch with the file on the sd card on setup
the switch with the script: /home/admin/config.scripts/blitz.lcd.sh hdmi on

Maybe even consider autodetection with lcdExists=$(sudo ls /dev/fb1 2>/dev/null | grep -c "/dev/fb1") on initial setup

Also putting echo "hdmi_safe=1" >> /boot/config.txt in the build sd card script by default was not working (LCD stayed black) -- but it can make sense when the RaspiBlitz is set into HDMI mode and removed when switched back to LCD. This should be added to the switch script for RC2.

@openoms I am doing heavy refactoring on the LCD/HDMI/headless mode part of the Blitz. I would like to remove some complexity and remove the LCD drivers for alternative platforms right now. Those can work with HDMI or headless. The LCD and especially the touchscreen later should be just for our focus image the RaspiOS 64-bit for now. Would that be OK from your side?

Sure, RPis should use the 64bit image and the rest is not compatible with this driver anyway.

OK I merged the display refactor. The HDMI switch is now to be tested for release.

OK tested adding a file called hdmi to the boot sd card and the RaspiBlitz is the switching from LCD to HDMI.
Test OK .. will be part of v1.7 RC3/final release. Closing issue.


Datetimepicker is no longer localized

Issue Summary
Since the upgrade to jquery.datetimepicker v2.5.19 the widget is no longer being localized to the current language.  That is, the month names and day abbreviations are being displayed in English regardless of the language being selected.
Steps to Reproduce

In any 2.1 version of Wagtail.  Go to the Admin interface | Account settings | Lanuage Preferences.
Select Preferred Language: German
Bearbeiten (Edit) any page (e.g. Home).  Select Einstellungen|Veröffentlicht ab: (Settings|Go live date/time:)
Note how the widget displays English month names and day abbreviations
To change back: Kontoeinstellungen |  Spracheinstellungen | Englisch

My Technical details

Python version: 3.5.4
Django version: 2.0.5
Wagtail version: 2.1
Browser version: Google Chrome Version 63.0.3239.132

Analysis
Wagtail localization of datetimepicker used to work by creating a custom locale ('lang') for each widget and setting the widget to that locale using the lang option.
Option 'lang' in datetimepicker for every widget was removed in https://github.com/xdan/datetimepicker/commit/9090478658a0a678fd0ea48ecfacb373e5ea7708
Explained in this issue https://github.com/xdan/datetimepicker/issues/331
The new way to set the locale is using $.datetimepicker.setLocale().  BUT! this no longer allows custom locales.
So without changes to jquery.datetimepicker, I see two possible ways to fix this issue.
Hijack one of datetimepicker's standard locales and use that as the Wagtail custom locale.
https://github.com/linuxsoftware/wagtail/commit/32b25ce1d9489da72d7220ef6b9750b08ded2075
or
Rely on datetimepicker to do the localization.  (Which means we are limited to their translations.)
https://github.com/linuxsoftware/wagtail/commit/09a1f950d625b4a214675856503ea01e775cd3ee
Neither seems perfect, but let me know if you would like a pull-request for either of them.

@Pomax @thibaudcolas  Any thoughts?
(Bug was introduced with https://github.com/wagtail/wagtail/pull/4337)

no immediate thoughts other than "that's an annoying problem to which I don't have an immediate solution". If I'm reading the linked issues for datepicker localization correctly, datepicker was made "not properly localizable" close to three years ago, so apparently it was bound to happen, but that doesn't make it any less annoying for wagtail users.
Using the datepicker's built in localizations would probably make the most sense from what I understand about how it works.

Thank you for taking the time to track this down and propose solutions @linuxsoftware. Sorry this got introduced in the first place.
I quite like the idea of relying on the widget's built-in translations, but from what I can see there are a few that are missing compared to what Wagtail offers now (see list below). We'd also most likely need to maintain some mapping from Wagtail's locale code to datetimepicker's (eg. fi_FI -> fi). I think it's better for us to keep on defining our own locale to limit rework. I'll see if there is a way to do this that seems less hacky.
Here's the list of Wagtail Transifex locales (only the ones above 50%) and their corresponding built-in datetimepicker locale code. Two are missing in datetimepicker:

100% Chinese (China) – zh
100% Dutch (Netherlands) – nl
100% French – fr
100% German – de
100% Icelandic (Iceland) – not available
100% Italian – it
100% Norwegian Bokmål – no
100% Polish – pl
100% Spanish – es
100% Swedish – se
99.1% Portuguese (Brazil) – pt-BR
97.9% Romanian – ro
96.3% Korean – ko
95.7% Lithuanian – lt
91.4% Russian – ru
91.4% Slovak (Slovakia) – sk
90.6% Persian – fa
90.1% Ukrainian – uk
86.2% Catalan – ca
85% Greek – not available
82.3% Portuguese (Portugal) – pt
81.7% Finnish – fi
78.5% Galician – gl
67.7% Slovenian – sl
63.5% Dutch – nl
63.1% Japanese – ja
53.1% Indonesian (Indonesia) – id
52.7% Latvian – lv

@linuxsoftware could you have a look at #4675? This is based on https://github.com/linuxsoftware/wagtail/commit/32b25ce1d9489da72d7220ef6b9750b08ded2075, except it uses a custom locale.

Looks excellent!  Great that there is a way to still set a custom locale (using $.fn.datetimepicker.defaults).  Thanks.


Bottom Navigation initial state and browser location update

Thank you for putting so much effort into this package.  This really has the potential to make Flutter Nav 2.0 usable.
I have been looking at the examples and the bottom_navigation in particular.  There seem to be some problems with the example to do with the initial states.
Unlike other examples there is no "home" screen with a "/" path, it should either be /articles or /books depending on the initial tab but is in fact blank.
When BottomNavigationBarWidget is created it defaults to the books tab, however the  locationBuilder only chooses the books location if the uri contains 'books' so it chooses "articles". This means there is a mismatch with the books tab selected but the articles list displayed and the initial url in the browser location is "/".
There is an additional problem that clicking the tabs should set the browser url to "/books" or "/articles" but leaves it blank.  Only when you click a book or article does the url update to the "/base/:id" form.  Using the back button in the appbar then updates the url correctly.  But clicking a bottom tab again clears the url.
I am not sure if this is a bug in the example code or in Beamer itself. I have tried to investigate but the Beamer code is too advanced for me to offer any useful information.

@tobylewis thank you for this elaborate feedback!
There's definitely a mistake in example's locationBuilder as you pointed out.
I'm not sure about the source of other errors, it could be both the example and beamer.
Currently I'm working on restructuring the logic for nested navigation so we'll see soon how that goes.
I will definitely check and try to fix this example today and update you here about it.

Hey @tobylewis
Thanks again for pointing out these errors. I fixed them in this commit: https://github.com/slovnicki/beamer/commit/8524dad4cf994496f90a9a8f939332b31f7c7e4a
There were 2 problems in the example:

Initial path was the default /, but now we can override it with setting initialPath on top-most BeamerRouterDelegate
BeamLocations had an empty initial BeamState so that caused the error of empty URL when switching between them initially

Thank you so much! Not only fixed the problem but really helpful in understanding use.


Add German translation

I've translated both Meower-Website and Meower-Svelte to German.

Also, a bit unrelated, would a toki pona translation be accepted?

Also, a bit unrelated, would a toki pona translation be accepted?

yes


fix: several typos in the docs

Hello
I fixed some typos in the docs,
Hope it helps.
Br,
Tudor.

Thanks for the PR! Unfortunately we replaced most of our docs by a new version shortly after you opened this PR so most of these changes are out of date now. Closing this for now, feel free to open a new PR on top of the new docs if you find more typos!


[Bug] Increment version number malformats the json files

As mentioned in #143, the increment version number action (re)formats the json files using the PowerShell ConvertTo-Json.
However, looking into the commit, some characters (e.g. &, ', <, >) are incorrectly converted.

We faced the same in our custom DevOps pipelines and added an extra step after manipulating our json file to reformat them again.
... | ConvertTo-Json -Depth 32 | Format-Json
# Formats JSON in a nicer format than the built-in ConvertTo-Json does.
# https://stackoverflow.com/questions/33145377/how-to-change-tab-width-when-converting-to-json-in-powershell
function Format-Json([Parameter(Mandatory, ValueFromPipeline)][String] $json) {
    $indent = 0;

    # https://stackoverflow.com/questions/69345030/sign-is-converted-into-u0026-through-powershell
    $json = $json -replace '\\u0026', '&' -replace '\\u0027', "'" -replace '\\u003c', '<' -replace '\\u003e', '>'

    ($json -Split "`n" | % {
        if ($_ -match '[\}\]]\s*,?\s*$') {
            # This line ends with ] or }, decrement the indentation level
            $indent--
        }
        $line = ('  ' * $indent) + $($_.TrimStart() -replace '":  (["{[])', '": $1' -replace ':  ', ': ')
        if ($_ -match '[\{\[]\s*$') {
            # This line ends with [ or {, increment the indentation level
            $indent++
        }
        $line
    }) -Join "`n"
}

This makes the commits far more readable.

As a reference:
Sample of a custom 'Create Release' step in our DevOps pipeline.

Are you using self-hosted runners?
Do you have PowerShell 7 installed on the self-hosted runners?
Then it should use PS7 to format the json file, which should solve this issue.
You probably have this text in your log:
WARNING: pwsh (PowerShell 7) not installed, json will be formatted by PowerShell 5.1


Is there a way to load CSharpClientGeneratorSettings from a file?

As the example indicates on https://github.com/RicoSuter/NSwag/wiki/CSharpClientGenerator we can create a generator and provide it settings, this is great as I need to configure custom type naming using ITypeNameGenerator however I would like to keep the majority of the config in the JSON file (we currently run the command line with variables) is there a utility to load the standard nswag.json into the CSharpClientGeneratorSettings ?
An example of what I'm trying to find:
var settings = CSharpClientGeneratorSettings.FromFile("./nswag.json");
var generator = new CSharpClientGenerator(document, settings);
var code = generator.GenerateFile();

The class CSharpClientGeneratorSettings should be serializable with Newtonsoft.Json... this is not supported out-of-the-box

I would like to load the configuration from NSwagStudio into the CSharpClientGenerator.
something like
`var document = await OpenApiDocument.FromFileAsync("openapi.json");
var clientSettings = new CSharpClientGeneratorSettings().FromFile("GenerationSettings.nswag");
var clientGenerator = new CSharpClientGenerator(document, clientSettings);
var code = clientGenerator.GenerateFile();`
Is this possible somehow and im just missing it?

+1

I made this into a thing :)
https://www.nuget.org/packages/NswagStudioSettingsForCSharpClientGenerator/


[Feature] ANSI Color Codes on Windows

Is your feature request related to a problem? Please describe.
ANSI color codes can not be interpreted on windows. We will change our color providing
method to use the Colorama. I believe the original intention was only to keep the imported
modules to a minimum and only add the used codes to the source for the sake of file size,
but this can be easily changed.

Perhaps just use a modified version of gib's colors.py instead. It'd be much lighter weight and not require an external library.

Actually it seems that you basically are doing that? So I have no idea why it's not working on Binbows...

Well so Winblows has a special encoding, and doesn't support ANSI (like the UNIX-like systems do). The colorama module magically detects the proper encoding and does that stuff, but I've kept pushing it off

Probably color.py has the windows encoding too

Nu, I wrote colors.py, it just uses the ANSI sequences...


core: Add validation checks for anchor config

PR Checklist
PR Structure

[x] This PR has reasonably narrow scope (if not, break it down into smaller PRs).
[x] This PR avoids mixing refactoring changes with feature changes (split into two PRs
otherwise).
[x] This PR's title starts with name of package that is most changed in the PR, ex.
paymentservice.stellar, or all or doc if the changes are broad or impact many
packages.

Thoroughness

[x] This PR adds tests for the most critical parts of the new functionality or fixes.

What
Add validation checks for events, circle payment observer, sep 10, 12, and 38.
Why
Validation will help catch misconfigurations.

Reference Server Preview is available here:https://anchor-ref-pr423.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr423.previews.kube001.services.stellar-ops.com/

Reference Server Preview is available here:https://anchor-ref-pr423.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr423.previews.kube001.services.stellar-ops.com/

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Reference Server Preview is available here:https://anchor-ref-pr423.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr423.previews.kube001.services.stellar-ops.com/

Found it!


Incompatible with ClearSkies

https://www.curseforge.com/minecraft/mc-mods/clear-skies

Let me help this issue out a little bit by posting an error log:
https://pastebin.com/9Ktza9bd
This is what I got when I ran Clear Skies, Immersive Portals, and the Fabric API.
I was going to post about this, but you beat me to it.


Print binary and logical expressions in a nicer format

This is a complete rewrite of binary and logical expressions that, if anything, is at least a whole lot more consistent. There may be tweaks to actual output for certain patterns, but before it was somewhat arbitrary what was broken across lines.
Now, if an expression is broken up, it's all or nothing:
var x = reallyLongArg() + reallyLongArg() * reallyLongArg() % reallyLongArg() + reallyLongArg() + reallyLongArg() + reallyLongArg();

Turns into:
  var x = reallyLongArg() +
    reallyLongArg() *
    reallyLongArg() %
    reallyLongArg() +
    reallyLongArg() +
    reallyLongArg() +
    reallyLongArg();

The idea is that we shouldn't touch anything that you could write out by hand without adding parens. The AST makes this a little difficult, but I think the solution ended up elegant. I spent a lot of hours writing 50 lines of code, and it's mostly comments!
If there is an expression that has a difference precedence than the default, that becomes a new sub-group. For example:
var z = 1 + 2 + 3 * (4 * 5 + 3) /<PHONE_NUMBER>00000000 *<PHONE_NUMBER>42374 +<PHONE_NUMBER>239) +<PHONE_NUMBER>342343 + 10000;

This turns into:
var z = 1 +
  2 +
  3 *
  (4 * 5 + 3) /
<PHONE_NUMBER>00000000 *<PHONE_NUMBER>42374 +<PHONE_NUMBER>239) +
<PHONE_NUMBER>342343 +
  10000;

Notice how there are 2 expressions in there that aren't broken; this is because that have difference precedence and become sub-groups. I think this feels natural and looks good. Also parens are always properly kept.
Here's a gist with more examples. This was my test file.
I'm aware that there is a bug with removing parens where it shouldn't which you can see in the tests. I'll fix this tomorrow.

<3
Can't wait to try it on on a real codebase first thing in the morning tomorrow!

In https://github.com/jlongster/prettier/issues/46 @llimllib noted that this could be particularly ugly for certain binary expressions. I sort of agree, although I'm willing to take a little ugliness for automated formatting. However, maybe we can do a little more work here.
For logical expressions, we should always break each one on its own line so that the && and the || are clear and work as separators. But we could do something different for binary expressions which is usually math. In fact, now that we have a lot more control over what's going on, just playing with the grouping I was able to produce this code:
  var z = 1 + 2 + 3 * (4 * 5 + 3) /<PHONE_NUMBER>00000000 *<PHONE_NUMBER>42374 +
<PHONE_NUMBER>239) +<PHONE_NUMBER>342343 + 10000;

Maybe for binary exprs we allow it to flow as much as possible (exprs take up as much as they can on each line). Should we try to force "sub-groups" to break? It could look weird the the parens wrap across lines.

I'll also add more tests to demonstrate the format. Not many current ones changed.

One use case I have in mind where this would output "bad" result is when building html by string concatenation:
var html =
  '
' + escape(title) + '
' +
    '
' +
      '
' + escape(item) + '
' +
    '
' +
  '
';

I would probably have to rewrite it using an array and .join to make it readable

If the user wants to layout string concatenation in a special way that depends on the string contents, we'll never be able to support that. It goes against the goal of this printer which exists to enforce completely consistent syntax across an entire project, so we can't allow a set of binary expressions to differ solely based on the contents of their operands.
A couple options:
var html = '
' + escape(title) + '                                                      ' +
  '
                                                                                ' +
  '
 ' + item + '
'                                                                           ' +
  '
                                                                                '  +
  '
                                                                                ' ;

Not the large amount of space on the right; that would keep each string on its own line. Many editors allow a "replace" mode where anything you type replaces the current characters instead of adding to it, and this would allow you to freely edit the HTML without consistently having to reformat the string concats.
But really, users should use string templates. This project is built in a modern era where we assume basic ES6 constructs are available. That solves the issue completely:
var html = `

 ${escape(title)}

${item}

`;

We should encourage the above if you want to control the format of a string, which allows us to format binary expressions consistently.

I'm so old school, of course, template literals are the way to solve this :)

Maybe for binary exprs we allow it to flow as much as possible

I think that's the best available answer, I don't think parens wrapping across lines is much of a problem.

But like you said, I'm willing to sacrifice perfection for consistency on anything reasonable.

This is the result of running master on nuclide and then master + this diff again on Nuclide. There are some spurious changes due to other bugs but this gives a good idea:
https://gist.github.com/vjeux/9bc3481bd06c9fc40273db9bdf4b8455

It seems to be overly aggressive at splitting things:
-  while (a[a.length - 1 - i] === b[b.length - 1 - i] && i < a.length &&
-    i < b.length) {
+  while (a[a.length - 1 - i] ===
+    b[b.length - 1 - i] &&
+    i <
+    a.length &&
+    i <
+    b.length) {

I would have expected it to be converted to
  while (a[a.length - 1 - i] === b[b.length - 1 - i] &&
    i < a.length &&
    i < b.length) {

We don't need to break on every single < or === as the expression fits in one line.

As you mentioned, it is missing parenthesis:
-      const nanoseconds = (milliseconds - seconds * 1000) * 1000000;
+      const nanoseconds = milliseconds - seconds * 1000 * 1000000;

The directory instanceof\n Directory split looks bad too

       if (
-        mirror.isNumber() && isNaN(mirror.value()) && cached.isNumber() &&
+        mirror.isNumber() &&
+          isNaN(mirror.value()) &&
+          cached.isNumber() &&
           isNaN(cached.value())
       ) {

I'm not sure about the indentation for the second and later. I think they should all be on the same line if they are of the same type. If we start adding || in there, then it makes sense to indent.

I'm not sure about the indentation for the second and later. I think they should all be on the same line if they are of the same type. If we start adding || in there, then it makes sense to indent.

What's difficult this case:
var x = 1 + 2 + 3 + 4 + 5;

I think variable declarations assume that the right-hand side will indent itself. For example, objects print like this:
var x = {
  prop1: 1,
  prop2: 2
};

The object is what adds indentation because it should be there regardless if it's a variable declaration or not. So if we remove the indentation for binary expressions, we would print this:
var x = foo &&
bar &&
baz;

I'm still working on this and have the nuclide codebase to go by. I'll try to find a balance that will work better.

I think that the indent makes sense for + to have an indent. It's nice to see that the second line is part of the same thing.
For your second example, I would expect it to look like
var x =
  foo &&
  bar &&
  baz;

or
var x = (
  foo &&
  bar &&
  baz
);

Thanks for the title change! That definitely is more clear.

Omg, so much better! Thanks for following through this!
As mentioned on gitter, the only thing that I feel uneasy about is the way + is handled. It feels overly aggressive to always split on every single +.
One thing we found is that it's a common pattern to have two string literals that are concatenated togethers meaning that before they were in two lines:
  var injection = '(function (NM) {' +
    'NM.require("module")._load(' + injectorServerPath + ')' +
    '(' + JSON.stringify(options) + ')' +
  '})(NM)';

So, what we should try is to put as many + expressions as a line permits and enforce hard lines between two consecutive string literals.
In this example, we would lose the indentation but at least it would print with the same format.

In this example, we would lose the indentation but at least it would print with the same format.

You could easily regain indentation by putting it in the string: '  NM.require...'
Can you create a followup issue for that? I'll add some tests tomorrow and merge it.

<3 <3 <3

Thank you so much! I think that's a great resolution to a hard problem.


The proper way of combining HMC with batch acquisition strategies for Bayesian Optimization

This issue is meant to ask two questions: (1) Does the combination of Local Penalization and IntegratedHyperparameterAcquisition behave in the expected way, and (1) What's the right way to approach Batch Bayesian Optimization using multiple Hamiltonian Monte-Carlo (HMC) samples for model hyperparameters in EmuKit?
(1) Combining Local Penalization and IntegratedHyperparameterAcquisition
Currently, when doing sequential Bayesian Optimization (BO) in EmuKit, one can wrap the acquisition function in a wrapper – IntegratedHyperParameterAcquisition – and that wrapper remains responsible for generating and marginalizing-out the HMC samples:
acquisition = IntegratedHyperparameterAcquisition(emukit_model, ExpectedImprovement, n_burnin=100, n_samples=20)

When using the IntegratedHyperparameterAcquisition abstraction, the samples are only being marginalised-out when the acquisition function is called:
# All the HMC samples are used to evaluate the one-point acquisition
acquisition.evaluate(x)

But not when any of the model's predict functions are called:
# Only 1 HMC sample is used (whichever one the model happened to be updated with last)
emukit_model.predict(x)

This means that when an  IntegratedHyperParameterAcquisition is passed into a batch point calculator — such as the LocalPenalizaitonPointCalculator — the HMC samples won't necessarily be used in all places during computation of the batch acquisition.

What happens when IntegratedHyperparameterAcquisitionFunction is combined with LocalPenlizationPointCalculator
In the specific case of the LocalPenlizationPointCalculator, this means that HMC samples will be used to evaluate the single-point acquisition function that's being penalized, but only a single arbitrary sample will be used to estimate the Lipschitz constant:
https://github.com/EmuKit/emukit/blob/b7939897ebcff2281d0bb017186fd4ecf059df93/emukit/bayesian_optimization/local_penalization_calculator.py#L68
or to evaluate the penalizer:
https://github.com/EmuKit/emukit/blob/b7939897ebcff2281d0bb017186fd4ecf059df93/emukit/bayesian_optimization/local_penalization_calculator.py#L54
This doesn't seem like the behaviour the user would intend in this case. Using an arbitrary HMC sample for estimation of the Lipschitz constant could lead to undesirable, arbitrary behaviour. Depending on which HMC sample happens to be last in the collection of generated samples, the effect of local penalization will be vastly different. This seems to have a significant effect on performance of Batch BO + HMC.
At the same time, there isn't an obvious way to properly consider all HMC samples in combination with the LocalPenlizationPointCalculator in Emukit, without rewriting that class yourself.

This brings me to another question: where in the hierarchy of abstractions in EmuKIt should generating samples for hyperparameters, and marginalising them out, fit in when doing Batch Bayesian Optimisation? This is an issue not just for the Local Penalization calculator, but also for hypothetical new batch point calculators the user might want to implement:
Combining IntegratedHyperparameterAcquisition with other batch acquisition methods
In another use-case, when someone might want to implement their own batch point calculator. As an example, they might want to use the MultipointExpectedImprovement, but select points for the batch by sequentially optimizing 1-point Expected Improvement (EI), then 2-point EI wrt. the second point, 3-point EI wrt. the third point, etc. (as described in Fast Computation of Expected Improvement).
In such cases, as well as in the case of a locally penalized acquisition function, the acquisition function changes at each iteration of the batch. One could wrap this new acquisition in an IntegratedHyperParameterAcquisition wrapper for every time, but this would require re-running HMC every time. One could also try to construct an  acquisition_generator that returns the right acquisition function at each batch-step, but this seems feels like a complicated work-around. IntegratedHyperparameterAcquisition seems unsuitable for marginalising out hyperparameter samples for Batch Bayesian Optimisation, including for Local Penalization.
This to me hints at the possibility that storing the HMC samples in an abstraction related to the model, rather than the acquisition, might be a more generalisable approach? (I don't have a concrete suggestion for what that might look like at the moment) If there is a relatively simple way to overcome these difficulties with Emukit methods, I'd love to know.

One small possible change would be the cache hyperparameter samples from model.generate_hyperparameter_samples(). This way each new instantiation of IngregratedHyperparameterAcquisition wouldn't regenerate the samples unless the model's been updated.

I can't claim understanding all details of what this issue is talking about. But as far as I can see, you indeed need a custom batch point calculator implementation. It can be based on existing LP implementation, or completely new. That's in line with the general idea of the library - the idea was never to support every possible use case out of the box, but to give people flexibility to twist and bend the library to adapt it to their needs.

I guess the main point was that combining LocalPenlizationPointCalculator and IntegratedHyperParameterAcquisition can lead to unexpected (although logical) and undesirable behaviour, since LocalPenlizationPointCalculator won't marginalise out the samples when computing the Lipschitz constant and the penalizer.
I have failed to realise that myself when first combining the two. I think at the very least it would be great to have a note in the documentation for LocalPenlizationPointCalculator warning that this behaviour might occur.

If the idea is that it's on the user to construct a batch point calculator that marginalises out all HMC samples when computing the penalized acquisition, I was wondering if there might be some preferable way to do so that would be most compatible with the the design and functionality of EmuKit.

Well, it is and it isn't. Emukit is designed in a way that it shall be relatively easy for users to define their own behavior, if something isn't built in the package already.
Hw much of functionality exacly we are talking about? Again, at the moment it seems to be as though you need new acquisition implementation (that's essentially what point calculator is).


[BUG]In windows ,I can not save outlines as.zip archive of ROI files for imajej

GUI_INFO: normalization checked: computing saturation levels (and optionally filtered image)
{'lowhigh': None, 'percentile': [1.0, 99.0], 'normalize': True, 'norm3D': False, 'sharpen_radius': 0, 'smooth_radius': 0, 'tile_norm_blocksize': 0, 'tile_norm_smooth3D': 1, 'invert': False}
[0, 255.0]
(1, 1024, 1024, 1)
GUI_INFO: 4532 masks found
GUI_INFO: creating cellcolors and drawing masks
GUI_INFO: loaded in previous changes
GUI_INFO: saving 4532 ImageJ ROIs to .zip archive.
2024-09-03 17:44:35,645 [WARNING] Multiprocessing is disabled for Windows
Traceback (most recent call last):
File "D:\anaconda\envs\cellpose\lib\site-packages\cellpose\gui\menus.py", line 62, in
parent.saveROIs.triggered.connect(lambda: io._save_rois(parent))
File "D:\anaconda\envs\cellpose\lib\site-packages\cellpose\gui\io.py", line 590, in _save_rois
save_rois(parent.cellpix[0], parent.filename)
File "D:\anaconda\envs\cellpose\lib\site-packages\cellpose\io.py", line 592, in save_rois
rois = [ImagejRoi.frompoints(outline) for outline in outlines]
File "D:\anaconda\envs\cellpose\lib\site-packages\cellpose\io.py", line 592, in
rois = [ImagejRoi.frompoints(outline) for outline in outlines]
File "D:\anaconda\envs\cellpose\lib\site-packages\roifile\roifile.py", line 455, in frompoints
left_top = coords.min(axis=0)
File "D:\anaconda\envs\cellpose\lib\site-packages\numpy\core_methods.py", line 45, in _amin
return umr_minimum(a, axis, None, out, keepdims, initial, where)
ValueError: zero-size array to reduction operation minimum which has no identity
I segment 4532 mask ,but I want get cell area in imajej ,but i can not save it

I think this might be fixed now, try installing the latest version pip install git+https://github.com/mouseland/cellpose.git

closing for now, will reopen if it's not working


split ensure param into separate file/package/service parts

hey @thanandorn we spoke about this some time ago.
basically I would like the flexibility of being able to modify the ensure of the package without interfering with the config files or service (specifically being able to set the package ensure to latest, rather than present for ease of deployment).
I've introduced service_ensure, service_enable and file_ensure instead of basing them off the value of ensure.
In a similar manner, I've introduced package_ensure instead of ensure. Obviously this is a breaking change as ensure no longer exists. I felt that it made more sense to rename it as it only now applies to the package due to the changes I mentioned above. Happy to change that back though.
I haven't updated the changelog yet until you're happy with the changes.
The tests pass and I'm running this change in my infra with the desired effect.

@bsnape it's been fixed by #8


Build(deps-dev): Bump eslint-plugin-react from 7.27.1 to 7.28.0 (#2258)

Pull request opened by the merge tool on behalf of #2258

Merged in 7e9bac15edbd44f7a63eece71930e0b2deab4a7f


Get error at after npm install. (this error is different from last issue)

i am  trying set up this app, and got an error after npm install and run up service.
this is log details.

This one is because your port 8080 is already used by some other process.


Filter module ignores item health state

If you configure the filter module to allow an healthy iron_pickaxes and want to send an nearly broken iron_pickaxe, then the sender chest will not send it over

This isn't an issue, there just isn't a damage filtering module yet.

but then you need an additional slot of the rare module slots :-/


Check list box and text does not align correctly

Looks like the list checkbox and the text doesn't align properly if we use prose class to style the editor, it can be reproduced in editor live playground.

Yes, if prose is used, some additional adjustments are necessary. Not the only instance where this is needed. This is the file where I've done quite a few of those. https://github.com/mdx-editor/site/blob/master/app/globals.css.

Solved.


To add valid input in all Triangle calculator using Vertex

Describe the bug
To add valid input in all Triangle calculator using Vertex
Possible solution

Describe the solution you thought of.

Screenshots

If applicable, add screenshots to help explain your problem.

Hi, I want to work on this issue I will start working on it as soon as I get assigned!! I am a part of GSSoC'21.
Kindly assign this issue to me!
Discord Username : Abhijeet Sinha(P)
Discord Tag: #4018


Upgrade Loop

Brief description of your issue
A number of packages are stuck in an upgrade loop that never seems to go away when the upgrade is installed.
One thing all of these packages have in common is that they all are missing the DisplayVersion registry key and either have the version in DisplayName or they don't have it listed at all.
Below is one such example.
Steps to reproduce
winget install DVDStyler
winget upgrade DVDStyler

Expected behavior
No applicable update found.

Actual behavior
Found DVDStyler [AlexThuering.DVDStyler] Version 3.2.1

Environment
Windows Package Manager v1.2.10271
Copyright (c) Microsoft Corporation. All rights reserved.

Windows: Windows.Desktop v10.0.22000.556
Package: Microsoft.DesktopAppInstaller v1.17.10271.0

This has been addressed with winget upgrade --all.
For individual packages, we aren't able to determine if the latest available package is "newer" than the one installed since the package doesn't report its version to Windows Apps & Features.
What kind of behavior would you want to see in this scenario?

In the case of this specific package, the version is present within the name of the uninstall entry DVDStyler v.3.2.1
Perhaps also checking for version in the name of the entry would be possible if DisplayVersion doesn't exist?

Unfortunately, we can't trust the "displayName" property as it usually contains a "marketing version" rather than a "software build version".

I did submit a PR for the publisher to add the version to ARP - https://sourceforge.net/p/dvdstyler/DVDStyler/merge-requests/3/

Is this issue resolved with the improvements in Windows Package Manager 1.3?


Prevent 'aptly repo add  .' from a folder already belonging to aptly

Last Friday I ran into a very weird behaviour.
I was naively following some (misleading) instructions from a colleague, which recommended me to go to the aptly folder (default I believe is /home/aptly/aptly/public), and run  aptly repo add <my_name> .. It was a live repository, so it already had a few .deb deployed there.
Clearly it is a silly thing to do. As documentation mentions, in case of a folder, aptly will recursively look for .deb and add them to the repo. Weird thing is I didn't receive any errors, but suddenly all the .deb in pool folder became empty (zero bytes). Which took me ages to realise, as apt-get update as working as before, I just was unable to install a package.
While I know it was my fault for not having read the doco upfront, it wasn't a pleasant experience to have my first contact with aptly.
I'm using 0.8, not sure if 0.9 would help here, but I haven't found any issue closed for that.

Yep, fixed in #127, please upgrade to the latest version.


readme: requires Go to build from source

Go 1.5+ is needed to build from source, updates readme to reflect that.

lgtm, thanks


Error in Mantine Vite template environment.

Mantine Vite's template displays an error because of this module.
How to reproduce
git clone https://github.com/mantinedev/vite-template
cd vite-template
yarn
vite

Displayed Errors

A PostCSS plugin did not pass the from option to postcss.parse. This may cause imported assets to be incorrectly transformed. If you've recently added a PostCSS plugin that raised this warning, please contact the package author to fix the issue.

Reference Information
Source code that is emitting the error message
https://github.com/vitejs/vite/blob/main/packages/vite/src/node/plugins/css.ts
Example of postcss plugin that fixes the same error
https://github.com/vitejs/vite/discussions/9339
https://github.com/elchininet/postcss-rtlcss/issues/160
https://github.com/jamonserrano/postcss-plumber/issues/3

It is a warning, you can safely ignore it

Thanks for your reply.
However, the Vite environment produces different css in the development and production environments.
I am thinking that this error is probably the cause of the problem...

What kind of different css?

This is development environments

This is production environments

i have same issue

For additional context, as I mentioned here and here, this seems to be due to the light-dark function exported from this module.
The other functions, rem & em, work fine and do not raise the error when used.

I've created a pull request to fix this issue #8


Grafana dashboard example ?

Do you have a grafana dashboard file example to understand what we need to do to show metrics ?
I seen the link you shared but I'm not sure about what I need to do to create dashboard for metric available with disk_usage_exporter.

I have understand how to create dashboard for this exporter. So it is working good (I have done also a mistake in systemd service config so I think it is the reason why I not find the good way to create dashboard directly).


Add Office/SharePoint development and build tools

Description
Improvement
According to https://social.technet.microsoft.com/wiki/contents/articles/40032.visual-studio-2017-missing-office-sharepoint-template.aspx VS2017 supports SharePoint 2016, SharePoint 2013 and Office 365 if "Office Developer Tools" installed.
According to https://docs.microsoft.com/en-us/visualstudio/install/workload-component-id-vs-enterprise?view=vs-2019#officesharepoint-development "Office Developers Tools" are bundled within workload id=Microsoft.VisualStudio.Workload.Office
Despite the installing this workload not every DLL mentioned in the issue could be found on the image, so another workload with id=Microsoft.VisualStudio.Workload.OfficeBuildTools (see https://docs.microsoft.com/en-us/visualstudio/install/workload-component-id-vs-build-tools?view=vs-2019#officesharepoint-build-tools) is installed as well.
There's no way to confirm the changes solve the client's problem till we have sample build.
Related issue:  https://github.com/actions/virtual-environments/issues/674
Check list

[ x] Related issue / work item is attached
[ -] Changes are tested and related VM images are successfully generated

/azp run windows2016, windows2019

/azp run windows2019


Missing authentication after connecting to socket

When adding this module as a new connection to companion, there are only options for the the ip-address and the polling interval.
Unfortunately I couldn't get this device to work without enabling authentication with an user-id and a password.
Adding 2 additional inputs besides the ip-address and the polling intervall to enter the user-id and the password for configuration.
After connecting to the tcp socket the user-id and the password should be send to the device inside  > socket.on('connect') {} < before > initPolling() < (index.js).
The commands for that are:

"stxUSR:{user-id};" (responds with ACK if ok)
"stxPSS:{password};" (responds with ACK if ok and NACK if fails)

Also "stxQIT;" should be send before closing the socket and ending communication. Otherwise connecting with a diffrent computer to the same device can be challenging, because only 1 connection via tcp is allowed.
I would love to be able to make those little changes myself, but except for knowing a tiny bit about sockets and js, I never worked with github or the companion env in general.
So I would really welcome, if someone can do those changes to make this module work properly.
Thanks :)
Jan

I can add that

Ok, I added it. Obviously, unable to test, I don't have this device. So let me know how that goes. v1.0.1 of the module, I pushed it to the beta repo but those generally don't build except once every 6 hours or so. You can download the repo and run it manually in companion v3 if you like

Thanks a lot. Just one quick note:
Even though the documentation shows ACK and NACK as possible responses for the PSS command, in general I actually never got any response at all right after sending that command. Only after requesting the version (or any other command - but VER doesn't change anything), the socket either responds with the version (correct password) or responding with NACK (incorrect password).
So if your implementation doesn't support that behavior, it would be nice if you could change that too.
Unfortunately I'm not really able to test today, but in the next days there should be some time :)

Ah ok. It relies on receiving ACK after sending password, so I’ll have to change that.

I updated the logic, please try v1.0.2 of this module and let me know how it goes

Thanks a lot, but I think this will not work because initCommunication() is only called when config.uselogin isn't true or an ACK is received. But the "PSS" command seems to responds nothing at all.
So requesting the version should better be done right after initLoginPassword() (line 148) and not from initCommunication().
Then getting the version response and lastReturnedCommand.indexOf('PSS') > -1 should indicate a successful authentication.

I think this will work:
if (pipeline.includes(this.CONTROL_NACK)) {
	this.log('error', `Command ${this.lastReturnedCommand} was not accepted by the device`)
	if (this.lastReturnedCommand.indexOf('PSS') > -1) {
		this.log('error', `The password was probably wrong`);
	}
}
else if (pipeline.includes(this.CONTROL_ACK)) { // ACKs are sent at the end of the stream result, we should have 1 command to 1 ack
	if (this.lastReturnedCommand.indexOf('USR') > -1) { //if the last command was the username command, send the password
		this.initLoginPassword();
		this.sendCommand('VER');
	}
	else {
		//if we got an ACK at all, let's assume we're connected
		this.initCommunication();
	}
}

No need to check if last returned command was PSS, basically any time we get an ACK, we try to init Communication, but if we've already initCommunication, it won't do it again

But neither PSS or VER will respond with ACK.
In know the documentation is diffrent, but I never got any ACK from them.

Ok. Take a look at the latest code and give feedback, please.

This isn't working too, but I think I found the mistakes.

if we check for this.lastReturnedCommand.includes('USR') to send PSS, it wont be true because USR is the very first command and there is no lastReturnedCommand.
initLoginUser() {  this.lastReturnedCommand = 'USR'  this.sendCommand(USR:${this.config.username}); //send username }
Just setting it ti USR inside iniLiginUser solved that for me.

we cant really send VER because your code always waits for any response before sending the next command. But PSS will not respond right away, so VER will never be send.

I found a solution for 2. but it only works when I log this.cmdPipe before and after .shift()

I catch the PSS command and if there are any commands left I send the first one right after PSS.
But strangely without all the console.log() it won't work. Maby you know that behavior? Maybe some async problems...
Also please let me know, if there is a better way to communicate changes etc. I never really used Github and I don't want to make things more difficult than they need to be :)

Can you send me that code please so I can add it here?

Sure...
https://github.com/JaaHann/companion-module-roland-p20hd.git

Let me know when you feel good about it and I can pull it into the main repo and add it to the betas.

I updatet some changes and it should be completely ready now.

Great job! I updated the main repo with your updated code, and included it in the bundled-modules. It should go into the beta builds automatically sometime in the next 6 hours.


Incorrect Answers Subtract Time

Incorrect Answers Subtract Time
User Story
AS A coding boot camp student
I WANT to take a timed quiz on JavaScript fundamentals that stores high scores
SO THAT I can gauge my progress compared to my peers
Acceptance Criteria
GIVEN I am taking a code quiz
WHEN I answer a question incorrectly
THEN time is subtracted from the clock

Incorrect answers subtract 10 seconds from the timer.  This is accomplished through the correctAnswer function's conditional statement that evaluates the question object's true key.


chore: import repository https://github.com/rackspace-org/node-lab.git

this commit will trigger a pipeline to generate the CI/CD configuration which will create a second commit on this Pull Request before it auto merges

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign
You can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


gh-pages branch needs an automatic DCO check

On master we are using Travis CI to do various checks around the DCO line in the commit messages. We need to enable the same functionality for the gh-pages branch as well.

CC @akosthekiss


.github: add more issue templates for different cases

Signed-off-by: André Martins<EMAIL_ADDRESS>

This change is

test-me-please


Lint returns different results than sqlfluff cli

Given this file
with population_rank as (
    select
        country_code,
        country_name,
        value,
        s.year,
        rank() over (
            partition by country_code, country_name order by year desc
        ) as rank_years
    from {{ ref('_airbyte_raw_country_populations') }} as s
    group by 1, 2, 3
)

select
    country_code,
    country_name,
    value,
    year
from population_rank
where
    rank_years = 1
    and year > 2017

using sqlfluff 2.0.0a4
with this .sqlfluff config
[sqlfluff]
verbose = 0
nocolor = False

# Comma separated list of file extensions to lint.
# NB: This config will only apply in the root folder.
sql_file_exts = .sql,.sql.j2,.dml,.ddl

### OPINIONATED DEFAULTS ADJUST AS NECESSARY

dialect = snowflake
templater = dbt

recurse = 0
output_line_length = 80
max_line_length = 14

runaway_limit = 10
ignore = parsing,templating
ignore_templated_areas = True

# Suggested core rules as defined by the SQLFluff team
# L001 - L006
# L008 - L010
# L012 - L026
# L028
# L030
# L033
# L038 - L041
# L045 - L050
# L052
# L054

# Uncomment and adjust as needed
# rules = L001, L002, L003, L004, L005, L006, L007, L008, L009, L010, L011, L012, L013, L014, L015, L016, L017, L018, L019, L020, L021, L022, L023, L024, L025, L026, L027, L028, L029, L030, L032, L033, L036, L037, L038, L039, L040, L041, L042, L043, L044, L046, L047, L048, L049, L050, L051, L053, L054, L055, L058, L060, L061, L063, L064, L065

# Excluded rules
exclude_rules = L031, L034, L035, L051, L052, L054, L056, L057, L059, L062, L045

[sqlfluff:indentation]
tab_space_size = 4
indent_unit = space
indented_joins = False
indented_ctes = true
template_blocks_indent = True

[sqlfluff:templater]
unwrap_wrapped_queries = True

[sqlfluff:templater:dbt]
project_dir = ./

# Some rules can be configured directly from the config common to other rules.
[sqlfluff:rules]
layout:type:comma:line_position = trailing
allow_scalar = True
single_table_references = unqualified
unquoted_identifiers_policy = all

# Some rules have their own specific config.

[sqlfluff:rules:L007]  # Operator before/after new line
layout:type:binary_operator:line_position = leading

[sqlfluff:rules:L010]  # Keywords
capitalisation_policy = lower

[sqlfluff:rules:L011]
aliasing = explicit

[sqlfluff:rules:L012]
aliasing = explicit

[sqlfluff:rules:L013]
allow_scalar = True

[sqlfluff:rules:L014]
extended_capitalisation_policy = lower

[sqlfluff:rules:L016]
ignore_comment_clauses = True
ignore_comment_lines = True
indent_unit = space

[sqlfluff:rules:L019]
ayout:type:comma:line_position = trailing

[sqlfluff:rules:L026]
force_enable = True

[sqlfluff:rules:L028]
force_enable = True
single_table_references = unqualified

[sqlfluff:rules:L029]  # Keyword identifiers
unquoted_identifiers_policy = none

[sqlfluff:rules:L030]  # Function names
capitalisation_policy = lower

[sqlfluff:rules:L038]
select_clause_trailing_comma = forbid

[sqlfluff:rules:L040]  # Null & Boolean Literals
capitalisation_policy = lower

[sqlfluff:rules:L042]
# By default, allow subqueries in from clauses, but not join clauses.

forbid_subquery_in = both

[sqlfluff:rules:L047]  # Consistent syntax to count all rows
prefer_count_0 = False
prefer_count_1 = False

[sqlfluff:rules:L051]
fully_qualify_join_types = both

[sqlfluff:rules:L054]
group_by_and_order_by_style = explicit

[sqlfluff:rules:L063]
extended_capitalisation_policy = lower

[sqlfluff:rules:L064]
preferred_quoted_literal_style = single_quotes

[sqlfluff:rules:L066]
min_alias_length = 7

running this on the command line
 /config/.local/bin/sqlfluff lint --format json --config /config/workspace/transform/.sqlfluff transform/models/L2_bays/country_demographics/current_population.sql
outputs
22:23:30  Unable to do partial parsing because config vars, config profile, or config target have changed
22:23:34  [WARNING]: Did not find matching node for patch with name '_AIRBYTE_RAW_ZIP_COORDINATES' in the 'models' section of file 'models/L1_inlets/loans/_airbyte_raw_zip_coordinates.yml'
[{"filepath": "transform/models/L2_bays/country_demographics/current_population.sql", "violations": [{"line_no": 1, "line_pos": 1, "code": "L016", "description": "Line is too long (25 > 14)."}, {"line_no": 3, "line_pos": 9, "code": "L016", "description": "Line is too long (21 > 14)."}, {"line_no": 4, "line_pos": 9, "code": "L016", "description": "Line is too long (21 > 14)."}, {"line_no": 6, "line_pos": 9, "code": "L016", "description": "Line is too long (15 > 14)."}, {"line_no": 6, "line_pos": 9, "code": "L028", "description": "Qualified reference 's.year' found in single table select."}, {"line_no": 7, "line_pos": 9, "code": "L016", "description": "Line is too long (21 > 14)."}, {"line_no": 8, "line_pos": 13, "code": "L016", "description": "Line is too long (70 > 14)."}, {"line_no": 9, "line_pos": 9, "code": "L016", "description": "Line is too long (23 > 14)."}, {"line_no": 10, "line_pos": 5, "code": "L016", "description": "Line is too long (59 > 14)."}, {"line_no": 10, "line_pos": 59, "code": "L066", "description": "Aliases should be at least 7 character(s) long."}, {"line_no": 11, "line_pos": 5, "code": "L016", "description": "Line is too long (20 > 14)."}, {"line_no": 15, "line_pos": 5, "code": "L016", "description": "Line is too long (17 > 14)."}, {"line_no": 16, "line_pos": 5, "code": "L016", "description": "Line is too long (17 > 14)."}, {"line_no": 19, "line_pos": 1, "code": "L016", "description": "Line is too long (20 > 14)."}, {"line_no": 21, "line_pos": 5, "code": "L016", "description": "Line is too long (18 > 14)."}, {"line_no": 22, "line_pos": 5, "code": "L016", "description": "Line is too long (19 > 14)."}]}]

whereas, running this
 curl -X POST localhost:8581/lint?sql_path=/config/workspace/transform/models/L2_bays/country_demographics/current_population.sql&extra_config_path=/config/workspace/transform/.sqlfluff
returns this
{"result":[{"code":"L028","description":"Qualified reference 's.year' found in single table select.","line_no":6,"line_pos":9},{"code":"L066","description":"Aliases should be at least 7 character(s) long.","line_no":10,"line_pos":59}]}

It works correctly for me:
(sqlfluff-3.10.8) ➜  my-dbt git:(2.0.0a4) ✗ curl -X POST 'localhost:8581/lint?sql_path=/Users/barry/dev/sqlfluff/my-dbt/models/osmosis_issue_44.sql&extra_config_path=/Users/barry/dev/sqlfluff/my-dbt/.sqlfluff'

{"result":[{"code":"L016","description":"Line is too long (25 > 14).","line_no":1,"line_pos":1},{"code":"L016","description":"Line is too long (21 > 14).","line_no":3,"line_pos":9},{"code":"L016","description":"Line is too long (21 > 14).","line_no":4,"line_pos":9},{"code":"L016","description":"Line is too long (15 > 14).","line_no":6,"line_pos":9},{"code":"L028","description":"Qualified reference 's.year' found in single table select.","line_no":6,"line_pos":9},{"code":"L016","description":"Line is too long (21 > 14).","line_no":7,"line_pos":9},{"code":"L016","description":"Line is too long (70 > 14).","line_no":8,"line_pos":13},{"code":"L016","description":"Line is too long (23 > 14).","line_no":9,"line_pos":9},{"code":"L016","description":"Line is too long (54 > 14).","line_no":10,"line_pos":5},{"code":"L066","description":"Aliases should be at least 7 character(s) long.","line_no":10,"line_pos":54},{"code":"L016","description":"Line is too long (20 > 14).","line_no":11,"line_pos":5},{"code":"L016","description":"Line is too long (17 > 14).","line_no":15,"line_pos":5},{"code":"L016","description":"Line is too long (17 > 14).","line_no":16,"line_pos":5},{"code":"L016","description":"Line is too long (20 > 14).","line_no":19,"line_pos":1},{"code":"L016","description":"Line is too long (18 > 14).","line_no":21,"line_pos":5},{"code":"L016","description":"Line is too long (19 > 14).","line_no":22,"line_pos":5},{"code":"L009","description":"Files must end with a single trailing newline.","line_no":23,"line_pos":1}]}%

I suspect the issue lies somewhere in the specifics of the other .sqlfluff file(s) in the environment and how they are interacting. In order to debug this, I need a more detailed scenario to reproduce it, primarily a zipped-up directory (or directories) including:

dbt project containing your .sql file, possibly a .sqlfluff file
Other .sqlfluff files involved

SQLFluff is very flexible and powerful in allowing multiple .sqlfluff files, e.g. one per directory, and the files overlay in particular ways. The downside of this flexibility and power is that it's sometimes unclear which .sqlfluff files are involved when linting, and what the final combined configuration is from those files.

this is due to us using sqlfluff 2.0.0a4 and osmosis being locked to < version 2.


[SPARK-35672][FOLLOWUP][TESTS] Add an exclusion rule to MimaExcludes.scala for Scala 2.13.

What changes were proposed in this pull request?

This PR mitigate an issue that MiMa fails for Scala 2.13 after SPARK-35672 (##34120).
$ dev/change-scala-version.sh 2.13
$ dev/mima
...
[error] spark-core: Failed binary compatibility check against org.apache.spark:spark-core_2.13:3.2.0! Found 8 potential problems (filtered 905)
[error]  * method userClassPath()scala.collection.mutable.ListBuffer in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.userClassPath")
[error]  * method copy(java.lang.String,java.lang.String,java.lang.String,java.lang.String,Int,java.lang.String,scala.Option,scala.collection.mutable.ListBuffer,scala.Option,Int)org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.copy")
[error]  * synthetic method copy$default$10()Int in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.copy$default$10")
[error]  * synthetic method copy$default$8()scala.collection.mutable.ListBuffer in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments has a different result type in current version, where it is scala.Option rather than scala.collection.mutable.ListBuffer
[error]    filter with: ProblemFilters.exclude[IncompatibleResultTypeProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.copy$default$8")
[error]  * synthetic method copy$default$9()scala.Option in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments has a different result type in current version, where it is Int rather than scala.Option
[error]    filter with: ProblemFilters.exclude[IncompatibleResultTypeProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.copy$default$9")
[error]  * method this(java.lang.String,java.lang.String,java.lang.String,java.lang.String,Int,java.lang.String,scala.Option,scala.collection.mutable.ListBuffer,scala.Option,Int)Unit in class org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.this")
[error]  * the type hierarchy of object org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments is different in current version. Missing types {scala.runtime.AbstractFunction10}
[error]    filter with: ProblemFilters.exclude[MissingTypesProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend$Arguments$")
[error]  * method apply(java.lang.String,java.lang.String,java.lang.String,java.lang.String,Int,java.lang.String,scala.Option,scala.collection.mutable.ListBuffer,scala.Option,Int)org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments in object org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.executor.CoarseGrainedExecutorBackend#Arguments.apply")
...

It's funny that the class Arguments is public but it's a member class of CoarseGrainedExecutorBackend which is package private and MiMa doesn't raise error for Scala 2.12, but adding an exclusion rule is one workaround.
Why are the changes needed?

To keep the build stable.
Does this PR introduce any user-facing change?

No.
How was this patch tested?

Confirmed MiMa passed.
$ dev/change-scala-version.sh 2.13
$ dev/mima

Thanks @sarutak for taking care of this.

Test build #145398 has started for PR 34649 at commit 5a60e86.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49871/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49871/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49871/

Thank you @sarutak !

Test build #145398 has finished for PR 34649 at commit 5a60e86.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145398/

Merged to master.

BTW, when I rebased to the master, it seems that there is another issue.

Oh, O.K, I'll check it.


Buffer setting doesn't work

Version: 0.9 (6)
Host: docker fyb3roptik/threadfin:0.9.4
Attempted with all buffer settings with the same result.
Startup:
2022/10/15 14:11:48 [Threadfin] Version:                0.9 Build: 6
2022/10/15 14:11:48 [Threadfin] Database Version:       0.5.0
2022/10/15 14:11:48 [Threadfin] System IP Addresses:    IPv4: 2 | IPv6: 0
2022/10/15 14:11:48 [Threadfin] Hostname:               6099b2db893d
2022/10/15 14:11:48 [Threadfin] System Folder:          /home/threadfin/conf/
For help run: /home/threadfin/bin/threadfin -h

2022/10/15 14:11:48 [Threadfin] Load Settings:          /home/threadfin/conf/settings.json
2022/10/15 14:11:48 [Threadfin] Temporary Folder:       /tmp/threadfin/2022-10-RRNR-D4IG3G/
2022/10/15 14:11:48 [Threadfin] GitHub:                 https://github.com/Threadfin
2022/10/15 14:11:48 [Threadfin] Git Branch:             Beta [Threadfin]
2022/10/15 14:11:48 [Threadfin] SSDP / DLNA:            true
2022/10/15 14:11:48 BRANCH:  Beta
2022/10/15 14:11:48 FILE:  https://github.com/Threadfin/Threadfin/releases/download/0.9.6/Threadfin_linux_amd64?raw=true

Error:
2022/10/15 14:13:51 [Threadfin] Buffer:                 true [ffmpeg]
2022/10/15 14:13:51 [Threadfin] Buffer Size:            1024 KB
2022/10/15 14:13:51 [Threadfin] Channel Name:            Travel
2022/10/15 14:13:51 [Threadfin] Client User-Agent:      Jellyfin-Server/10.8.5
2022/10/15 14:13:51 http: panic serving <IP_ADDRESS>:45168: interface conversion: *osfs.OsFS is not avfs.VolumeManager: missing method VolumeAdd
goroutine 170 [running]:
net/http.(*conn).serve.func1()
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:1825 +0xbf
panic({0x82f8a0, 0xc001fa4de0})
        /opt/hostedtoolcache/go/1.18.6/x64/src/runtime/panic.go:844 +0x258
threadfin/src.checkVFSFolder({0xc01bb0a780, 0x38}, {0xa0b1c0, 0xc0001fc6f0})
        /home/runner/work/Threadfin/Threadfin/src/toolchain.go:63 +0x79
threadfin/src.bufferingStream({0xc007a71c80, 0x14}, {0xc01a85c690, 0x26}, {0x0, 0x0}, {0xc00a624875, 0x7}, {0xa08930, 0xc0003de460}, ...)
        /home/runner/work/Threadfin/Threadfin/src/buffer.go:75 +0x390
threadfin/src.Stream({0xa08930, 0xc0003de460}, 0xc01897a500)
        /home/runner/work/Threadfin/Threadfin/src/webserver.go:183 +0x6ef
net/http.HandlerFunc.ServeHTTP(0x7f08255674d8?, {0xa08930?, 0xc0003de460?}, 0x40efe5?)
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:2084 +0x2f
net/http.(*ServeMux).ServeHTTP(0x0?, {0xa08930, 0xc0003de460}, 0xc01897a500)
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:2462 +0x149
net/http.serverHandler.ServeHTTP({0xc001fa4c00?}, {0xa08930, 0xc0003de460}, 0xc01897a500)
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:2916 +0x43b
net/http.(*conn).serve(0xc0001345a0, {0xa08ca8, 0xc019b68ea0})
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:1966 +0x5d7
created by net/http.(*Server).Serve
        /opt/hostedtoolcache/go/1.18.6/x64/src/net/http/server.go:3071 +0x4db

Make sure “Store Buffer in Ram” is checked otherwise nothing works.

Yep that fixed it- thanks


[Bug]: Twilio not appearing in the filter list in the templates tab.

Is there an existing issue for this?

[X] I have searched the existing issues

Description

Although twillio is added to the datasource list of the template, it isn't appearing in the list of filters.
Steps To Reproduce

Add a new template with twilio as a datasource.
Go to the templates tab and see that the template is present, but the twilio datasource isn't in the filter list.

More context:  https://theappsmith.slack.com/archives/C02RCR2PURZ/p1660912771736459
Public Sample App
No response
Version
Cloud

As informed by @akash-codemonk it is hard to test until a template which has this datasource is there. So closing this as per discussion.


Subtracting mean value before inputting video in the wild?

Hi, @qijiezhao , I am reading and running this repo. I find mean value is defined "self.input_mean=...", but not used. so when use my own video data, is it better to subtract the mean value before inputting into p3d?
By the way, is the input channels of image are RGB instead of BGR？

It's of course better to subtract mean values before inputting.
RGB.


Accept keys with missing key flags on primary key

The crypto-refresh document states:

In particular, a primary key does not need to have 0x01 set in the first octet of Key Flags order to make a valid self-signature.

Currently, PGPainless rejects such keys.

PGPainless now has no problems with such keys.