Doesn't work with custom schematics

Current Behavior
There is no custom workspace generators in the IDE menu (in comparison on NX console Idea project)
How to Reproduce
Make NX project (I used angular-nest preset)
Create generator in the /tools/generators.
Set the same directory in the plugin Custom Schematics settings.
Run nx workspace-generator custom-component "demo-component" to test that cli works
Expected Behavior
workspace-schematic:CustomComponent should be in the IDE menu
but it is not.

Hello. Are you still having this issue?
I did the following:

ran nx generate @nrwl/workspace:workspace-generator --name=custom-component
then searching in the nx toolwindow, I see the new generator below

yea I haven't updated to latest nx features. Do you keep your local generators in different projects within the workspace?

Hmm in my case, I have a library called "tools" under "libs/" and I use it in the entire monorepo. But nothing prevents you from having multiple libraries.. what they call "local plugins" are just special libraries, as far as I understand.
e.g. in the "tools" library I have a file called generators.json which contains the definition of the generators available in that library..
// generators.json
{
  "$schema": "http://json-schema.org/schema",
  "name": "my-tools",
  "version": "0.0.1",
  "generators": {
    "my-tools": {
      "factory": "./src/generators/my-tools/generator",
      "schema": "./src/generators/my-tools/schema.json",
      "description": "my-tools generator"
    },
    "my-component": {
      "factory": "./src/generators/my-component/generator",
      "schema": "./src/generators/my-component/schema.json",
      "description": "my component generator"
    }
  }
}

I assume this is the same format as the "external generators" like @nrwl/react etc... it is even added to the tsconfig.base.json paths


Install failure

PS C:\Users\Kite> nvm install 16.14.2
Downloading node.js version 16.14.2 (64-bit)...
Complete
Creating C:\Users\Kite\AppData\Roaming\nvm\temp
Downloading npm version 8.5.0... Error while downloading https://github.com/npm/cli/archive/v8.5.0.zip - Get https://github.com/npm/cli/archive/v8.5.0.zip: net/http: TLS handshake timeout
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x0 addr=0x20 pc=0x5c6eb0]
goroutine 1 [running]:
/C/Users/corey/Documents/workspace/nvm-windows/src/nvm/web.Download(0x11374000, 0x2d, 0x1123a180, 0x35, 0x113eb390, 0x5, 0x0)
C:/Users/corey/Documents/workspace/nvm-windows/src/nvm/web/web.go:68 +0x240
/C/Users/corey/Documents/workspace/nvm-windows/src/nvm/web.GetNpm(0x11238571, 0x21, 0x113eb390, 0x5, 0x3b)
C:/Users/corey/Documents/workspace/nvm-windows/src/nvm/web/web.go:163 +0x21b
main.install(0x1123e0a8, 0x7, 0x660283, 0x2)
C:/Users/corey/Documents/workspace/nvm-windows/src/nvm.go:268 +0x626
main.main()
C:/Users/corey/Documents/workspace/nvm-windows/src/nvm.go:78 +0x8cd
PS C:\Users\Kite> nvm install 16.14.2
Version 16.14.2 is already installed.
PS C:\Users\Kite> nvm
Running version 1.1.7.
Usage:
nvm arch                     : Show if node is running in 32 or 64 bit mode.
nvm install  [arch] : The version can be a node.js version or "latest" for the latest stable version.
Optionally specify whether to install the 32 or 64 bit version (defaults to system arch).
Set [arch] to "all" to install 32 AND 64 bit versions.
Add --insecure to the end of this command to bypass SSL validation of the remote download server.
nvm list [available]         : List the node.js installations. Type "available" at the end to see what can be installed. Aliased as ls.
nvm on                       : Enable node.js version management.
nvm off                      : Disable node.js version management.
nvm proxy [url]              : Set a proxy to use for downloads. Leave [url] blank to see the current proxy.
Set [url] to "none" to remove the proxy.
nvm node_mirror [url]        : Set the node mirror. Defaults to https://nodejs.org/dist/. Leave [url] blank to use default url.
nvm npm_mirror [url]         : Set the npm mirror. Defaults to https://github.com/npm/cli/archive/. Leave [url] blank to default url.
nvm uninstall       : The version must be a specific version.
nvm use [version] [arch]     : Switch to use the specified version. Optionally specify 32/64bit architecture.
nvm use  will continue using the selected version, but switch to 32/64 bit mode.
nvm root [path]              : Set the directory where nvm should store different versions of node.js.
If  is not set, the current root will be displayed.
nvm version                  : Displays the current running version of nvm for Windows. Aliased as v.
PS C:\Users\Kite> nvm uninstall 16.24.0
node v16.24.0 is not installed. Type "nvm list" to see what is installed.

In the future, please follow the issue template (it's provided for a reason).
The problem is net/http: TLS handshake timeout. This means your internet connection is failing to communicate with Github (https://github.com/npm/cli/archive/v8.5.0.zip). This often happens when using a proxy.
You can bypass some of the TLS requirements using the --insecure flag, as defined in the help message:

In other words, run nvm install --insecure 16.14.2.


[ENH] replace get_train_probs for regressors

Describe the feature or idea you want to propose
classification has replace get_train_preds with fit_predict, would be good to do the same with regression (I think its only implemented for FreshPrinceRegressor).
Describe your proposed solution
redesign regressors for fit_predict
Describe alternatives you've considered, if relevant
No response
Additional context
No response

Hi @AnonymousCodes911, this is currently being resolved in #1200. This implements a method similar to the one in BaseClassifier. We don't really want fit_predict to just simply call each of the methods, as this is generally undesirable and produces biased results which we don't want to encourage.

I see, There was no PR mentioned hence i picked it up!


Fixed get in touch section in home page

please review and merge it

@PriyaGhosal please review and merge it

@AsifQamar Fix these two as they got misplaced

@AsifQamar Fix these two as they got misplaced

That two was misplaced before my changes only, merge this pr I'll create a new or for them

@AsifQamar Fix these two as they got misplaced

OK I'll dot it

@AsifQamar Fix these two as they got misplaced


Show LifeGroup ministry events on the LifeGroup page and hide them on the events page

created a lifegroup winter quarter event.
can someone make this link to lifegroups page instead of to an event page? then hit publish for me!

This is obsolete because the site has been over to SquareSpace.


[idea] Full screen mode like iTerm (doesn't go into it's own workspace).

In iTerm, there's an option so that full screen mode doesn't put the terminal into a new workspace, it's just full screen in the same desktop that it was in. This is super convenient. I don't like having full screen things in different workspaces because it interferes with the way I group windows. I find it Okay for app like Google Chrome when I want to go full screen temporarily, but I usually have my terminals full screen all the time so I can have them grouped in each desktop instead of separated all over the place in a big mess.

:+1:
Apple's full screen is so slow. I love MacVim's instant full-screen mode.


Incorrect image name in kubectl run command

This command is incorrect:
kubectl run gs-spring-boot-docker --image=wingtiptoysregistry.azurecr.io/gs-spring-boot-docker:latest
The image name is called "spring-boot-docker-complete", so the command should be:
kubectl run gs-spring-boot-docker --image=wingtiptoysregistry.azurecr.io/spring-boot-docker-complete:latest
As far as I can tell, the image name is the same as the artifactId of the maven project. And at least in the current version of this project, the pom file for the "complete" module has "spring-boot-docker-complete" as the artifact id. Using this, I got it all working.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 200ae7a0-87fe-9d4d-db79-12495746fbd8
Version Independent ID: 0aaa8a60-4aec-ac05-a9bc-7d9a4883c637
Content: Deploy Spring Boot Application to the Azure Kubernetes Service - Azure Kubernetes Service
Content Source: articles/java/spring-framework/deploy-spring-boot-java-app-on-kubernetes.md
Service: multiple
GitHub Login: @KarlErickson
Microsoft Alias: karler

Hi, @KarlErickson
Could you please assign this issue to me?

Similar with https://github.com/MicrosoftDocs/azure-dev-docs/issues/633.
hi @jihu , thanks for reaching out.
We will update to images name to gs-spring-boot-docker, thanks.

Update merged.


"ValueError: Empty value passed for a required argument" during setup

Might be related to #149, however it happens with elasticsearch-dsl<6.2, even with Elasticsearch 5 (with elasticsearch==5.5.3 and elasticsearch-dsl==5.4.0).
Traceback (most recent call last):
  File "/home/ubuntu/venv/bin/invenio", line 11, in <module>
    sys.exit(cli())
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/flask/cli.py", line 557, in main
    return super(FlaskGroup, self).main(*args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/flask/cli.py", line 412, in decorator
    return __ctx.invoke(f, *args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/invenio_search/cli.py", line 44, in inner
    return f(*args, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/invenio_search/cli.py", line 97, in destroy
    for name, response in bar:
  File "/home/ubuntu/venv/lib/python3.6/site-packages/click/_termui_impl.py", line 285, in generator
    for rv in self.iter:
  File "/home/ubuntu/venv/lib/python3.6/site-packages/invenio_search/ext.py", line 309, in delete
    for result in _delete(self.active_aliases):
  File "/home/ubuntu/venv/lib/python3.6/site-packages/invenio_search/ext.py", line 301, in _delete
    for result in _delete(value, alias=name):
  File "/home/ubuntu/venv/lib/python3.6/site-packages/invenio_search/ext.py", line 295, in _delete
    ignore=ignore,
  File "/home/ubuntu/venv/lib/python3.6/site-packages/elasticsearch/client/utils.py", line 73, in _wrapped
    return func(*args, params=params, **kwargs)
  File "/home/ubuntu/venv/lib/python3.6/site-packages/elasticsearch/client/indices.py", line 432, in delete_alias
    raise ValueError("Empty value passed for a required argument.")
ValueError: Empty value passed for a required argument.

(I'm following those instructions)

How difficult would be to print it out the name of the empty field?


[ci] publish from GitHub actions

What package is this for?

[x] React
[ ] Angular

Describe the bug
We've had a "Publish" GitHub action/workflow configured for a while to test if the build publish would work, and it's been going well. Recent output from the last 2 merges of next -> master have resulted in the version number being correct, the build passing, etc. It also authenticates with npm/github even though it doesn't publish to either.
In addition, Travis is changing their pricing model. We'll hit the build minute limit very quickly.

[x] modify the publish workflow to no longer use --dry-run
[x] ensure the publish runs on next and master branches
[x] delete the .travis.yml
[ ] ensure travis is turned off, env var secrets deleted

:tada: This issue has been resolved in version 2.141.0-next.15 :tada:
The release is available on:

npm package (@next dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This issue has been resolved in version 2.141.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Automated Package Upgrade

:tada: This PR is included in version 7.7.107 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


rust: add hasLibraries and hasIncludes

See https://github.com/numtide/devshell/issues/56#issuecomment-851537203 maybe

@Mic92 it's a copy/paste from https://github.com/numtide/devshell/blob/84f1493776f44960e329f21843ffad1686b6c7a3/extra/language/c.nix btw.

@Mic92 it's a copy/paste from https://github.com/numtide/devshell/blob/84f1493776f44960e329f21843ffad1686b6c7a3/extra/language/c.nix btw.

Ok. Opened issue here: https://github.com/numtide/devshell/issues/120

@Mic92 also said that LD_LIBRARY_PATH means that the binary won't work outside of the devshell if I am not mistaken.

Does it differ from using a "normal" nix-shell with cargo as a Rust dev environment?
With a "normal" nix-shell it can happen that a crate is linked against a lib that gets cleared by the gc. I have no idea if there's a solution for this.

Oops, I just realized that PRs have stacked up. Is this PR still relevant?

This PR is still relevant. Compilation on a rust project actually fails at the moment.
I tried to set up the environment variables in this PR however and it still failed.
There is something done in the hooks that makes darwin compilation work.
I should be able to get a reproducible example for anyone who has darwin. (probably this weekend)

alright, I tested on x86_darwin and couldn't reproduce the problem on a public repo.
On a private repo on aarch64-darwin. I had to
set RUSTFLAGS="-L${pkgs.darwin.apple_sdk.frameworks.CoreFoundation}/Library/Frameworks"
(also had to add the Security and SystemConfiguration)
I also ran into trouble compiling curl-sys library, for that I had to set
CFLAGS="-F ${pkgs.darwin.apple_sdk.frameworks.SystemConfiguration}/Library/Frameworks -I${pkgs.darwin.apple_sdk.libs.libDER}/include"
it took me quite a while to figure those out. I don't know exactly in which hook those are getting set. Inside the rustflags variable are stuff for the linker. So those could have been set into a wrapper for ld. The cflags could have been set in another wrapper. Not sure exactly which wrapper those are.
If anyone has an idea, I'm happy to test things.

Thanks for taking the time and test things. Are there any lessons to integrate back into the module?

I did some testing on linux and had to add glibc to the rustflags (just mentioning).
I quite like the api of this module, however I don't think I would implement it in this way. Let me try to work on this next week and make a PR. We can compare both approaches and discuss what to include and what not to include in the final solution.
basically I would use RUSTFLAGS, CFLAGS, and PKG_CONFIG_PATH which are all the environment variables I needed.

I just hit some linkers error on ubuntu, I see why those LD variables are important.
I had to add librdkafka to the LD_LIBRARY_PATH.
After that it complained about
/lib/x86_64-linux-gnu/libpthread.so.0: version `GLIBC_PRIVATE` not found (required by _nix_path_glibc-2-33-177/lib/librt.so.1)

I tried adding ${pkgs.glibc.dev}/include into the LD_INCLUDE_PATH  but to no avail. I'm not sure how to fix this one. If anyone has an idea, I'm interested to try.
(this is just for ubuntu, for darwin, the previous fixes where enough).

so here is how I understand the situation.
If I add in the rustflags "${pkg.glibc}/lib" then rust compiles against that version of glibc. (I get a compiler error without that variable. However If I add this library to my LD_LIBRARY_PATH then at runtime, the system will need to find that library. I think it's usually done through the RPATH. in nixpkgs, ld has a wrapper to set the rpath. If we link against a library that the system doesn't have by default in it's RPATH (like on ubuntu any nix libs won't be included by default), we need to have a way to set the RPATH.
The previous error I get is the system's library trying to look for nix glibc and failing (I think).
We might have to keep the hooks that govern LD.

I'm not sure what to do next to tackle the linker problem.
I've found a way to make it work on darwin, but I'm sure it's not how nix traditionally does it (I've verified in the normal shell, the rustflags variable is not set).

I have some small updates on this.
using lld_13 and RUSTFLAGS="-C linkg-arg=-fuse-ld=lld" solved all the linker issues I had on darwin.
On ubuntu I still run into a glibc compilation error no matter what I do.
if anyone ever finds a solution to that one, I'm interested.

alright, I've got more news.
what is needed here is the following

LIBRARY_PATH set to $DEVSHELL_DIR/lib
RUSTFLAGS set to -F framework=$DEVSHELL_DIR/Library/Frameworks. The problem with that is that someone needs to be able to set rustflags if they want to. Would doing something with an eval like `eval = "-F framework=$DEVSHELL_DIR/Library/Frameworks:$RUSTFLAGS" work ? (RUSTDOCFLAGS need to be set to the same value)
CFLAGS set to -I $DEVSHELL_DIR/include -iframework $DEVSHELL_DIR/Library/Frameworks. Same here someone might want to set that value, so wondering if the trick with eval would work.

if that would work, I'm happy to make a PR.
PS: the reason why it was working before is that it was using the clang already installed on my computer. As soon as I had clang_13 in my shell everything started breaking down without the above fixes).
The other problem I had was that I had to bring some weird libs that I've never heard of before like darwin.apple_sdk.libs.libDER. This makes me thing that it's not the right way to solve this problem, but at least the issues are fixed.

Thanks for taking the time to untangle this mess.
Yeah, a PR where eval is used on RUSTFLAGS  and CFLAGS sounds good.


Add data_sources attribute to count total testcases

Add data_sources attribute to count total testcases in Testsuites-Management package

As per conversation this pull request will be closed if an alternative solution without change of robotframework core is found.

Hello Thomas,
 I had created the pull-request for Testsuites-Management package to remove the data_sources collection.
 The data_sources object does not need anymore.
 I also revert my commit in this pull-request, now this pull-request only contains Cuong's commit to fix the issue related to "unknow" state.
 So, you can merge this pull-request which contains only the commit of Cuong.

Thank you,
Son


Tests were not passing on Windows - fixed cases where it failed

Failed on the following tests:

TestC: Due to hard coded filepath separators -> now using filepath.Join

TestSelectEach: Rename not allowed before closing tempfile -> now closing tempfile instead of closing at end of fn at deferred call, and checking error

TestRemoveEach: Due to SelectEach being broken

I have same a problem using in Go Programming Blueprints chapter 8.

📝 A commit f11065b9b6bd1a345d2db9141f450abdca40ec5d should be omit 😉


PodaacUtils().list_all_available_extract_granule_dataset_ids() returns None

Within the last year or so, PO.DAAC have updated their Webservice documentation which improves the developer-facing documentation but which I think also introduces a major regression. The regression being that it now now longer lists datasets... meaning that this information would need to be acquired from elsewhere and a data triage task take place if Podaacpy were to provide the PodaacUtils().list_all_available_extract_granule_dataset_ids() utility functionality.
The email I got from a Podaacpy user was as follows

I am Argha from Bangladesh. We are trying to predict Oyster Diseases in our lab. For doing this task we need the Salinity and Temperature data. We are trying to access this dataset “Multi-Mission Optimally Interpolated Sea Surface Salinity Global Dataset V1”.
We will be giving Date, Longitude, Latitude as our inputs and want the salinity output from the dataset. For this purpose I have followed your podaacpy_getting_started_tutorial.ipynb . But the problem I am facing:
I have not found any Persistent ID for the above mentioned dataset
I am getting an error for some specific lines of code but not all. For example:
print(u.list_all_available_extract_granule_dataset_ids()) line gives an error like:
AttributeError: 'NoneType' object has no attribute 'find_all'
But at the same time print(u.list_all_available_granule_search_dataset_ids()) is running perfectly

I have opened a thread at the PO.DAAC Forum to discuss this... more to come.

I'm not able to find the PO.DAAC Forum link.
The "new" forum website doesn't seem to have this topic.


[SPARK-18666][Web UI] Remove the codes checking deprecated config spark.sql.unsafe.enabled

What changes were proposed in this pull request?
spark.sql.unsafe.enabled is deprecated since 1.6. There still are codes in UI to check it. We should remove it and clean the codes.
How was this patch tested?
Changes to related existing unit test.
Please review http://spark.apache.org/contributing.html before opening a pull request.

Test build #69452 has started for PR 16095 at commit 1bf8528.

Test build #69452 has finished for PR 16095 at commit 1bf8528.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69452/
Test PASSed.

Merging in master/branch-2.1.


Speed up CI

Contributor Checklist

[ ] Did you add Scaladoc to every public function/method?
[ ] Did you add at least one test demonstrating the PR?
[ ] Did you delete any extraneous printlns/debugging code?
[ ] Did you specify the type of improvement?
[ ] Did you add appropriate documentation in docs/src?
[ ] Did you state the API impact?
[ ] Did you specify the code generation impact?
[ ] Did you request a desired merge strategy?
[ ] Did you add text to be included in the Release Notes for this change?

Type of Improvement

API Impact

Backend Code Generation Impact

Desired Merge Strategy

Release Notes

Reviewer Checklist (only modified by reviewer)

[ ] Did you add the appropriate labels?
[ ] Did you mark the proper milestone (3.2.x, 3.3.x, 3.4.x, 3.5.0) ?
[ ] Did you review?
[ ] Did you check whether all relevant Contributor checkboxes have been checked?
[ ] Did you mark as Please Merge?

Reopen #2036 due to CI issue.

Test in Mac failed with verilator/verilator#3031
So just gave up Mac CI :(

https://github.com/chipsalliance/chisel3/pull/2043/checks?check_run_id=3358132535#step:13:5720

WTF here?

Wed, 18 Aug 2021 08:54:43 GMT
[info] ImplicitModule directly in a RawModule in an ImplicitModule
6626
Wed, 18 Aug 2021 08:54:43 GMT
Elaborating design...
6627
Wed, 18 Aug 2021 08:54:43 GMT
[info] - should fail
6628
Wed, 18 Aug 2021 09:40:57 GMT
[info] - Infering widths on huge Vecs should not cause a stack overflow
6629
Wed, 18 Aug 2021 09:40:57 GMT
Elaborating design...
6630
Wed, 18 Aug 2021 09:40:57 GMT
Done elaborating.

Replaced by https://github.com/chipsalliance/chisel3/pull/2341


Use more recent java version in Maven@3

Feature
Type: Upgrade Maven task to more updated java version
Enter Task Name: Maven@3 (https://github.com/microsoft/azure-pipelines-tasks/tree/master/Tasks/MavenV3)
Environment

Server - Azure Pipelines

Issue Description
The more updated jdkVersionOption used by task Maven@3 is 11
(#jdkVersionOption: 'default' # Optional. Options: default, 1.11, 1.10, 1.9, 1.8, 1.7, 1.6)
https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/build/maven?view=azure-devops.
I'd like to use more recent versions like java 14 or 16

I've figured out a workaround that's relatively easy enough. You just need an azure blob store where you can store the java version you want to use, then use the JavaToolInstaller to install it, then tell the maven tool to use that version.  See here for how I'm doing it. You can use the windows-2019 vm image to get the latest version of maven (3.8.1).

My workaround was not use Maven@3 :)
I used a container maven with java 16
variables:
  maven_ops: '-Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=WARN -Dorg.slf4j.simpleLogger.showDateTime=true -Dorg.slf4j.simpleLogger.dateTimeFormat=HH:mm:ss,SSS'

trigger:
  - master

pool:
  vmImage: ubuntu-latest

container: maven:3.8.1-openjdk-16-slim

steps:
  - script: mvn ${maven_ops} -B clean verify

I found it
trigger:
  - master

pool:
  vmImage: ubuntu-latest

container: maven:3.8.1-openjdk-16-slim

steps:
  - task: Maven@3
    inputs:
      mavenPomFile: 'pom.xml'
      mavenOptions: '-Xmx1024m'
      javaHomeOption: 'path'
      jdkDirectory: '/usr/local/openjdk-16'
      publishJUnitResults: false
      mavenAuthenticateFeed: true
      effectivePomSkip: true

I'm using maven:3.8.1-openjdk-16-slim container so it needs to set a java home
      javaHomeOption: 'path'
      jdkDirectory: '/usr/local/openjdk-16'

Hi @sfragata thanks for reporting! We created PR with a fix for this https://github.com/microsoft/azure-pipelines-tasks/pull/15021

@sfragata, a related PR was merged. This fix will be available in the next sprint.
I will let you know once these changes are deployed.

thanks @alexander-smolyakov

Any news regarding this issue?
The change hasn't been deployed, and meanwhile, the new LTS "Java 17" has been out for a while now too

Hi any update on this? 17 is an LTS and would be very helpful if at least that one will be included

Hi all, let me provide an update regarding this ticket:
At the moment the Java 17 is still not available on the following virtual images:

Ubuntu 18
Ubuntu 20

However, these images will be updated soon, here is a link to a related ticket:

actions/virtual-environments/issues/4085

Once all virtual images will contain Java 17, we will update the Maven task.

Hi all, let me provide an update regarding this ticket:
At the moment the Java 17 is still not available on the following virtual images:

Ubuntu 18
Ubuntu 20

However, these images will be updated soon, here is a link to a related ticket:

Add JDK 17 actions/virtual-environments#4085

Once all virtual images will contain Java 17, we will update the Maven task.

Hi, just wondering, does it mean that it's available on windows images?
I'm still seeing this warning when trying to use Java 17:
Value is not accepted. Valid values: "default", "1.11", "1.10", "1.9", "1.8", "1.7", "1.6".
`stages:

stage: 'Deploy'
pool:
vmImage: 'windows-latest'
jobs:

job: 'job1'
steps:

task: MavenAuthenticate@0
inputs:
mavenServiceConnections: MvnNexusDependencies, MvnNexusReleases
task: Maven@3
inputs:
mavenPomFile: 'pom.xml'
mavenOptions: '-Xmx3072m'
javaHomeOption: 'JDKVersion'
jdkVersionOption: '1.17'
jdkArchitectureOption: 'x64'
publishJUnitResults: true
testResultsFiles: '**/surefire-reports/TEST-*.xml'
goals: 'package deploy'
failIfCoverageEmpty: true`

@alexander-smolyakov Any update?

@alexander-smolyakov Any update?

@nibexo I have opened a pull request to update the Maven pipeline task (V2/V3). I will update the ticket once the related changes will be merged to master.
Link to related PR:

#15844

Quick update: A related pull request was completed. The related changes for the Maven pipeline task will be available in the 200th sprint release of Azure DevOps. I will update the ticket once these changes will be deployed and available to all Azure DevOps users.

any expected date of awailable?

He never mentioned what sprint they're currently at 🤨

Sprint 200 Patch Notes were released on Monday, and I can now see JDK 17 in the dropdown: https://docs.microsoft.com/en-us/azure/devops/release-notes/2022/sprint-200-update

@ssrm @Brutus5000 @nibexo


Added Korean translation

Thanks!

@HelloKS maybe you want also translate my another module to Korean? https://crowdin.com/project/xinstaller :) Thanks


SizedBox with WidgetSpan renders single line height even when it's height is set to 0

Copied from internal bug b/292502848
Expected: When height passed to _VerticalSpaceSpan is 0.0, no space should render between the TextSpan(s). See TextSpan(s) without spacer in between for expected result.
Actual: TextSpan(s) render with some space between them (equal to single line height?).
Screenshot:

Minimal code to reproduce the bug:
import 'package:flutter/material.dart';

void main() {
  runApp(MyApp());
}

class MyApp extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Scaffold(
        body: MyWidget(),
      ),
    );
  }
}

class MyWidget extends StatelessWidget {
  final spacer = _VerticalSpaceSpan(0.0);
  @override
  Widget build(BuildContext context) {
    return RichText(
      text: TextSpan(children: [
        const TextSpan(
          text: '• Fist Element, with spacer below\n',
        ),
        spacer,
        const TextSpan(
          text: '• 2nd Element, with spacer below\n',
        ),
        spacer,
        const TextSpan(
          text: '• 3rd Element, NO spacer below\n',
        ),
        const TextSpan(
          text: '• 4th Element, NO spacer below\n',
        ),
        const TextSpan(
          text: '• Last Element\n',
        ),
      ]),
    );
  }
}

class _VerticalSpaceSpan extends WidgetSpan {
  _VerticalSpaceSpan(double height)
      : super(child: SizedBox(height: height, width: double.infinity));
}

Reason for prioritization:
Marked as P3, does not block a launch as we managed to find a workaround in current usage, but should be fixed in longer run.

Thank you for the report. I also see this issue on the latest Flutter stable and master channels.
Inspecting SizedBox in Widget Inspector, the height is also 0.0:

flutter doctor -v (stable and master)
[✓] Flutter (Channel stable, 3.10.6, on macOS 13.0.1 22A400 darwin-x64, locale en-VN)
    • Flutter version 3.10.6 on channel stable at /Users/huynq/Documents/GitHub/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision f468f3366c (5 hours ago), 2023-07-12 15:19:05 -0700
    • Engine revision cdbeda788a
    • Dart version 3.0.6
    • DevTools version 2.23.1

[✓] Android toolchain - develop for Android devices (Android SDK version 32.0.0)
    • Android SDK at /Users/huynq/Library/Android/sdk
    • Platform android-33, build-tools 32.0.0
    • ANDROID_HOME = /Users/huynq/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b802.4-9586694)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14E222b
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2022.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b802.4-9586694)

[✓] VS Code (version 1.80.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.68.0

[✓] Connected device (3 available)
    • RMX2001 (mobile) • EUYTFEUSQSRGDA6D • android-arm64  • Android 11 (API 30)
    • macOS (desktop)  • macos            • darwin-x64     • macOS 13.0.1 22A400 darwin-x64
    • Chrome (web)     • chrome           • web-javascript • Google Chrome 114.0.5735.198

[✓] Network resources
    • All expected network resources are available.

• No issues found!

[!] Flutter (Channel master, 3.13.0-9.0.pre.43, on macOS 13.4.1 22F770820d darwin-x64, locale en-VN)
    • Flutter version 3.13.0-9.0.pre.43 on channel master at /Users/huynq/Documents/GitHub/flutter_master
    ! Warning: `flutter` on your path resolves to /Users/huynq/Documents/GitHub/flutter/bin/flutter, which is not inside your current Flutter SDK checkout at /Users/huynq/Documents/GitHub/flutter_master. Consider adding /Users/huynq/Documents/GitHub/flutter_master/bin to the front of your path.
    ! Warning: `dart` on your path resolves to /Users/huynq/Documents/GitHub/flutter/bin/dart, which is not inside your current Flutter SDK checkout at /Users/huynq/Documents/GitHub/flutter_master. Consider adding /Users/huynq/Documents/GitHub/flutter_master/bin to the front of your path.
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 0733c96e7d (4 hours ago), 2023-07-24 21:55:24 -0400
    • Engine revision 9a0192d965
    • Dart version 3.1.0 (build 3.1.0-333.0.dev)
    • DevTools version 2.25.0
    • If those were intentional, you can disregard the above warnings; however it is recommended to use "git" directly to perform update checks and upgrades.

[✓] Android toolchain - develop for Android devices (Android SDK version 32.0.0)
    • Android SDK at /Users/huynq/Library/Android/sdk
    • Platform android-33, build-tools 32.0.0
    • ANDROID_HOME = /Users/huynq/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b802.4-9586694)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14E222b
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2022.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b802.4-9586694)

[✓] VS Code (version 1.80.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.68.0

[✓] Connected device (3 available)
    • RMX2001 (mobile) • EUYTFEUSQSRGDA6D • android-arm64  • Android 11 (API 30)
    • macOS (desktop)  • macos            • darwin-x64     • macOS 13.4.1 22F770820d darwin-x64
    • Chrome (web)     • chrome           • web-javascript • Google Chrome 114.0.5735.198

[✓] Network resources
    • All expected network resources are available.

! Doctor found issues in 1 category.

@kshitizsrivstv, Hello,
I am also facing the same issue with respect to height. Please can you provide the workaround you found?

Hi @ritheshSalyan , our use-case was that we wanted zero spacing. So workaround was simply adding an if condition to not render spacer like this -
class MyWidget extends StatelessWidget {
  final height = 0;
  final spacer = _VerticalSpaceSpan(height);
  @override
  Widget build(BuildContext context) {
    return RichText(
      text: TextSpan(children: [
        const TextSpan(
          text: '• Fist Element\n',
        ),
        if (height != 0) spacer,
        const TextSpan(
          text: '• 2nd Element\n',
        ),
      ]),
    );
  }
}


reorder_arrays = false is ignored if the key is set to the array.

I have the following taplo.toml file:
include = ["**/*.toml"]
[formatting]
reorder_arrays = true

[[rule]]
include = ["bar.toml"]
keys = ["baz"]

[rule.formatting]
reorder_arrays = false

I would assume that the rule listed would prevent the array baz from being re-ordered, but still allow for all other arrays to be sorted.
This is my bar.toml file:
baz = ["foo", "bar", "baz"]

sort_me = ["z", "a"]

However, when running taplo fmt, bar.toml ends up like this:
baz = ["bar", "baz", "foo"]

sort_me = ["a", "z"]

As you can see, all arrays were sorted. When omitting keys, nothing gets formatted, which is not what I want.

I have a similar rule-based formatting issue. The rule works until I add the include property and then it stops being applied. It will work as expected if I use the Taplo cli.

It looks like keys is matching table names, not keys within a table. A rust-toolchain.toml of
[toolchain]
targets = ["zz", "x86_64-unknown-linux-gnu"]

gets targets sorted with
[[rule]]
include = ["rust-toolchain.toml"]
keys = ["toolchain"]

[rule.formatting]
reorder_arrays = true

but not with
keys = ["components", "targets"]

or
keys = ["toolchain.components", "toolchain.targets"]


Semantic highlighting for unsafe union field access

This change adds support for unions in inference and lowering, then extends on that to add the unsafe semantic modifier on field access only. The is_possibly_unsafe function in syntax_highlighting.rs could be extended to support fns and static muts so that their definitions are not highlighted as unsafe, but only their usage.
Also, each commit of this PR updates the tests. By reviewing the files by commit, it's easy to see how the changes in the code affected the tests.

bors r+


Systemd Service Overrides for Ubuntu

The system service overrides file was only used on Debian versions with systemd not Ubuntu. This causes none of the options in /etc/default/docker to work when systemd is used to start the service.
Thanks
Sam

Thanks @cablespaghetti


python38Packages.aiounifi: 28 -> 29

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python38Packages.aiounifi is: "Python library for communicating with Unifi Controller API"
meta.homepage for python38Packages.aiounifi is: "https://github.com/Kane610/aiounifi"
meta.changelog for python38Packages.aiounifi is: ""
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 29 with grep in /nix/store/a4jn4yigsbjrq5v20d0n69m335wnii4r-python3.8-aiounifi-29

found 29 in filename of file in /nix/store/a4jn4yigsbjrq5v20d0n69m335wnii4r-python3.8-aiounifi-29

Rebuild report (if merged into master) (click to expand)

11 total rebuild path(s)

3 package rebuild(s)

3 x86_64-linux rebuild(s)
3 i686-linux rebuild(s)
2 x86_64-darwin rebuild(s)
3 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
home-assistant
python38Packages.aiounifi
python39Packages.aiounifi

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/a4jn4yigsbjrq5v20d0n69m335wnii4r-python3.8-aiounifi-29 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python38Packages.aiounifi https://github.com/r-ryantm/nixpkgs/archive/6e827c3d3e454d10ae412776acb9a886b21e94bc.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/a4jn4yigsbjrq5v20d0n69m335wnii4r-python3.8-aiounifi-29
ls -la /nix/store/a4jn4yigsbjrq5v20d0n69m335wnii4r-python3.8-aiounifi-29/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package failed to build:

home-assistant

2 packages built:

python38Packages.aiounifi
python39Packages.aiounifi

Maintainer pings
cc @peterhoeg for testing.

Duplicate of #143897


Allow adding attachments in Email.new

I missed this one!
@stevedomin

@princemaple please rebase against master and this is good to go!

good catch btw!


disable module(s) in config file

Current state:
I don't find any option to disable module(s) from config file
Wanted state:
Possibility to disable module(s) from config file
I this is already possible maybe write it in the readme
Why the change is sensible:
I think is can be a pretty cool feature. You say in at the end of the readme that it meant to be put in .bashrc (or other, fish config in my case) to have a pretty welcome message at the shell start, but I wanted a more minimalist things than the complete neofetch prompt. In the case where you compile fastfetch, this is not a problem because the src/fastfetch.c is realy simple to edit but if you install it directly (with the AUR on archlinux in my case) you can not modify the source code.
Ps: Sorry about my bad English

You can put --structure <Module you want here>:<another module>

You can get all modules your version supports by running fastfetch --list-modules.
The default structure can be obtained by running fastfetch --print-structure.
Customize it to your liking, like Sam said!

Thanks a lot


Predict GPU memory get wrong answer when context length is not 8192

Describe the bug

Steps to reproduce

Go to 'Deploy model'
deploy a model with context length 32768 by "--ctx-size=32768" for backend parameter.
the memory usage for scheduler is for 8192 only, but not 32768.

Result
Model runs failed

Expected behavior
the gpuparser parameter of ctx-size should be modified by backend parameter if it is existed.
The code related could be here.

Environment

GPUStack version:
OS: Ubuntu 22.04
GPU:

Additional context
Add any other context about the problem here.

Verified on main 27fa7fe


fix encoding issues

@taylankasap could you check if this pull request solve your issue (#60)

Yes, this solves the encoding issue

merged and released as 2.2.1, thanks for your feedback.
close #60


Upgrade to latest Scrapy with Python3 support. Upgrade/add dependencies:

Motivation for this change
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[ ] NixOS
[ ] OS X
[X] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Fits CONTRIBUTING.md.

parsel, pydispatcher, twisted

please have a commit for each package you change

I've applied the changes

Thanks.
In the future, please use the full attribute name for the packages, so pythonPackages.parsel.

Regarding https://github.com/NixOS/nixpkgs/pull/16864#issuecomment-247878531
No, it's quite common that the log size gets too big. You can ignore that result.


AWQ + Marlin Error

I convert model follow AutoAWQ library as follow script.

Quantize with Marlin

from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer

model_path = 'mistralai/Mistral-7B-Instruct-v0.2'
quant_path = 'mistral-instruct-v0.2-awq-marlin'
quant_config = { "zero_point": False, "q_group_size": 128, "w_bit": 4, "version": "Marlin" }

# Load model
model = AutoAWQForCausalLM.from_pretrained(
    model_path, **{"low_cpu_mem_usage": True, "use_cache": False}
)
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)

# Quantize
model.quantize(tokenizer, quant_config=quant_config)

# Save quantized model
model.save_quantized(quant_path)
tokenizer.save_pretrained(quant_path)

print(f'Model is quantized and saved at "{quant_path}"')

Generate

from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer, TextStreamer

quant_path = "./mistral-instruct-v0.2-awq-marlin"

# Load model
model = AutoAWQForCausalLM.from_quantized(quant_path, fuse_layers=False)
tokenizer = AutoTokenizer.from_pretrained(quant_path, trust_remote_code=True)
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)

# Convert prompt to tokens
prompt_template = "[INST] {prompt} [/INST]"

prompt = "You're standing on the surface of the Earth. "\
        "You walk one mile south, one mile west and one mile north. "\
        "You end up exactly where you started. Where are you?"

tokens = tokenizer(
    prompt_template.format(prompt=prompt),
    return_tensors='pt'
).input_ids.cuda()

# Generate output
generation_output = model.generate(
    tokens,
    streamer=streamer,
    max_new_tokens=512
)

2 steps above work perfectly.
But when I using that quantization folder to start serving in vllm with this script.
python services/vllm/api_server.py \
    --host <IP_ADDRESS> \
    --port 8000 \
    --disable-log-requests \
    --model /root/AutoAWQ/mistral-instruct-v0.2-awq-marlin \
    --quantization awq \
    --trust-remote-code \
    --dtype float16 \

The error show that:
  File "/root/vllm/vllm/engine/llm_engine.py", line 101, in __init__
    self.model_executor = executor_class(model_config, cache_config,
  File "/root/vllm/vllm/executor/gpu_executor.py", line 42, in __init__
    self._init_worker()
  File "/root/vllm/vllm/executor/gpu_executor.py", line 77, in _init_worker
    self.driver_worker.load_model()
  File "/root/vllm/vllm/worker/worker.py", line 99, in load_model
    self.model_runner.load_model()
  File "/root/vllm/vllm/worker/model_runner.py", line 89, in load_model
    self.model = get_model(self.model_config,
  File "/root/vllm/vllm/model_executor/utils.py", line 52, in get_model
    return get_model_fn(model_config, device_config, **kwargs)
  File "/root/vllm/vllm/model_executor/model_loader.py", line 86, in get_model
    model.load_weights(model_config.model, model_config.download_dir,
  File "/root/vllm/vllm/model_executor/models/llama.py", line 391, in load_weights
    weight_loader(param, loaded_weight)
  File "/root/vllm/vllm/model_executor/layers/linear.py", line 556, in weight_loader
    loaded_weight = loaded_weight.narrow(input_dim, start_idx,
RuntimeError: start (0) + length (14336) exceeds dimension size (896).

It look like the weight can not load and vllm did not support AWQ with Marlin kernel properly. How can we fix this error.
Thank you.

I also try to turn enforce-eager mode to True, but the error is still the same.

Running AWQ models with Marlin is not currently supported. I was not aware that AWQ models could be converted to Marlin format. I will look into adding support for this
Can you post that model to Hugging Face hub? This would make it easier for me
cc @alexm-nm @simon-mo

@hllj can you post it on the hub?

@hllj
Loading AWQ models saved in Marlin is not currently supported. I was not aware that AWQ models could be converted to Marlin format. I will look into adding support for this
Can you post that model to Hugging Face hub? This would make it easier for me
cc @alexm-nm @simon-mo @mgoin

Here are my weight from the hub.
https://huggingface.co/hllj/mistral-instruct-v0.2-awq-marlin
Quantization script:
from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer

model_path = 'mistralai/Mistral-7B-Instruct-v0.2'
quant_path = 'mistral-instruct-v0.2-awq-marlin'
quant_config = { "zero_point": False, "q_group_size": 128, "w_bit": 4, "version": "Marlin" }

# Load model
model = AutoAWQForCausalLM.from_pretrained(
    model_path, **{"low_cpu_mem_usage": True, "use_cache": False}
)
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)

# Quantize
model.quantize(tokenizer, quant_config=quant_config)

# Save quantized model
model.save_quantized(quant_path)
tokenizer.save_pretrained(quant_path)

print(f'Model is quantized and saved at "{quant_path}"')

You have to install Marlin kernel in this repo.
Generation script
from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer, TextStreamer

quant_path = "hllj/mistral-instruct-v0.2-awq-marlin"

# Load model
model = AutoAWQForCausalLM.from_quantized(quant_path, fuse_layers=False)
tokenizer = AutoTokenizer.from_pretrained(quant_path, trust_remote_code=True)
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)

# Convert prompt to tokens
prompt_template = "[INST] {prompt} [/INST]"

prompt = "You're standing on the surface of the Earth. "\
        "You walk one mile south, one mile west and one mile north. "\
        "You end up exactly where you started. Where are you?"

tokens = tokenizer(
    prompt_template.format(prompt=prompt),
    return_tensors='pt'
).input_ids.cuda()

# Generate output
generation_output = model.generate(
    tokens,
    streamer=streamer,
    max_new_tokens=512
)

Thanks, will take a look at this over the weekend

AWQ has many versions at this point. I would recommend using gemv_fast from AutoAWQ as it’s faster than Marlin and exllamav2 in decoding. However, it’s not implemented yet, although I laid out some ground work in a PR

@casper-hansen Is gemv_fast just for batch 1 decoding?

No, it's just a name. See more details: https://github.com/vllm-project/vllm/pull/3289

@casper-hansen can you point me to the place in AutoAWQ where these are implemented and loaded? I resolved the packing issues related to integrating the Marlin kernels, so I can try to do the same for AWQ

@robertgshaw2-neuralmagic It is implemented as seen below. We create buffers and then accelerate loads the weights for us. If you can help implement the weight loading, it would help me move forward to get the PR ready
https://github.com/casper-hansen/AutoAWQ/blob/main/awq/modules/linear/gemv_fast.py#L72

Got it - so you do the serialization and repacking on the fly (during from_linear) as opposed to serializing the model in the GEMVFast format?

Now we support converting AWQ models to Marlin inside vLLM, closing!

@mgoin How do you convert AWQ models to Marlin inside vLLM? The script in this thread was done outside vLLM and needs a full precision model to convert. Can the model conversion be completed on the fly or does it need to be done before? Also, how much additional VRAM is necessary to perform the conversion.

I have the same problem as above。
vllm==0.6.3
model： Mistral7B + awq + Marlin
File "/root/vllm/vllm/engine/llm_engine.py", line 101, in init
self.model_executor = executor_class(model_config, cache_config,
File "/root/vllm/vllm/executor/gpu_executor.py", line 42, in init
self._init_worker()
File "/root/vllm/vllm/executor/gpu_executor.py", line 77, in _init_worker
self.driver_worker.load_model()
File "/root/vllm/vllm/worker/worker.py", line 99, in load_model
self.model_runner.load_model()
File "/root/vllm/vllm/worker/model_runner.py", line 89, in load_model
self.model = get_model(self.model_config,
File "/root/vllm/vllm/model_executor/utils.py", line 52, in get_model
return get_model_fn(model_config, device_config, **kwargs)
File "/root/vllm/vllm/model_executor/model_loader.py", line 86, in get_model
model.load_weights(model_config.model, model_config.download_dir,
File "/root/vllm/vllm/model_executor/models/llama.py", line 391, in load_weights
weight_loader(param, loaded_weight)
File "/root/vllm/vllm/model_executor/layers/linear.py", line 556, in weight_loader
loaded_weight = loaded_weight.narrow(input_dim, start_idx,
RuntimeError: start (0) + length (14336) exceeds dimension size (896).
The code parameters are as follows:
python3 api_server.py --host <IP_ADDRESS> --port 7807 --model /workspace/liqi1017/chatmodel_1015_marlin_awq/ --trust-remote-code --gpu-memory-utilization 0.9 --enforce-eager --max-model-len 8192 --enable-prefix-caching

I have the same problem as @cabbagetalk
vllm==0.6.3
model： llama3-8b-inst + awq + Marlin


Demo cocli installation issue

Trying to install the CCA Demo on a fresh Ubuntu 22.04.4 machine, got the following error midway through:
intern@intern-vm:~/docs/demo/cca/prov-verif-e2e$ cocli comid create --template=data/templates/comid-cca-ta-endorsements.json \
                    --template=data/templates/comid-cca-mult-refval.json
Command 'cocli' not found, did you mean:
  command 'cxcli' from snap cxcli (1.224.1)
See 'snap info <snapname>' for additional versions.

cocli installation didn't show any errors though, and I followed all previous steps.  Has the documentation for the demo not been update to reflect a newer version?
Thanks, much appreciated.
System Info:

Processor: Intel i9-9900k
OS: Ubuntu 22.04.04 64-bit

Update: Tried using $ go install github.com/veraison/corim/cocli@latest instead, same error.

go installs binaries into $(go env GOPATH)/bin. Make sure you have that location in your PATH.

adding export PATH=$(go env GOPATH)/bin:$PATH to my ~/.bashrc file helped, but I got this when trying to move corim-cca.cbor:
intern@intern-vm:~/docs/demo/cca/prov-verif-e2e$ mv corim-cca.cbor ./ data/cbor
mv: target 'data/cbor' is not a directory

had to manually move it, but thats all the issues from that portion of the demo I ran into.
I'm not sure why go wasn't added, as I followed their instructions to the T, but thank you!


New command not working in cite

Describe the bug
Cite is producing an empty footnote.
Additional information

TeX distribution: MacTeX 2023
Package citation-style-language version: updated today
LaTeX engine: lualatex

JSON
[
    {
        "id": "Wallace1996-GreekG",
        "type": "book",
        "author": [
            {
                "family": "Wallace",
                "given": "Daniel B."
            }
        ],
        "title": "Greek Grammar Beyond the Basics: An Exegetical Syntax of the New Testament",
        "title-short": "Greek Grammar",
        "source": "Accordance",
        "publisher-place": "Grand Rapids, MI",
        "publisher": "Zondervan",
        "issued": {
            "date-parts": [
                [
                    "1996"
                ]
            ]
        }
    }
]

No Problem
% !TEX encoding = UTF-8 Unicode
\documentclass[12pt]{article}

\usepackage{citation-style-language}
\cslsetup{style = turabian-fullnote-bibliography}
\addbibresource{myBib.json}

\newcommand{\myCommandToday}{new command}

\begin{document}

Test.\cite[prefix = {new command word.
}, page = {419}]{Wallace1996-GreekG}

\newpage
\printbibliography
\end{document}

Problem
% !TEX encoding = UTF-8 Unicode
\documentclass[12pt]{article}

\usepackage{citation-style-language}
\cslsetup{style = turabian-fullnote-bibliography}
\addbibresource{myBib.json}

\newcommand{\myCommandToday}{new command}

\begin{document}

Test.\cite[prefix = {\myCommandToday word.
}, page = {419}]{Wallace1996-GreekG}

\newpage
\printbibliography
\end{document}

@nickw2066 Thanks for your feedback!
This bug should be fixed in 17546ae.

Thank you. Has this update been released yet?

Yes, it's in v0.4.0.


Update to MS Graph PowerShell 2.0 for the Emerald branch

🗣 Description

Remove MS Graph PowerShell < version 2.0 module dependencies and replace with the MS Graph PowerShell 2.0 Beta modules.
Updated relevant unit test to pass for the new Beta cmdlets.
Remove unused Graph PowerShell modules leftover from 0.1.0 release.
Updated Uninstall.ps1 to uninstall all of the current beta modules.
Partially fix #505 by adding in the missing Graph Scope SecurityEvents.Read.All.
Fix $MaximumFunctionCount not being set correctly globally by adding an additional script, RaiseFunctionCap.ps1, to process in the ScubaGear.psd1 manifest .

@crutchfield

This is the branch I used to test the how difficult the transition would. It only needed a few more updates to make it merge ready so I went ahead made the changes.
We'll need application service principals used for the automated smoke test will need to be updated for the additional  SecurityEvents.Read.All permission for AAD 7.2.

💭 Motivation and context

Closes #205 for Emerald
Closes #463
Closes #467
🧪 Testing

Tested using Interactive Authentication and Service Principal auth on G3, G5, E5, GCCHigh Tenants.
Tested all products *, just aad, and aad, sharepoint.
✅ Pre-approval checklist

[x] This PR has an informative and human-readable title.
[x] Changes are limited to a single goal - eschew scope creep!
[x] All future TODOs are captured in issues, which are referenced
in code comments. #519
[x] All relevant type-of-change labels have been added.
[x] Tests have been added and/or modified to cover the changes in this PR.
[x] All new and existing tests pass. (see comments on Smoke Test)

✅ Pre-merge checklist

✅ Post-merge checklist

@crutchfield - can you please look into the conflicts so this PR can be merged into emerald. thanks.


⚠ Bofrost.de has degraded performance

In 13bc817, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1163 ms

Resolved: Bofrost.de performance has improved in 1466bc5 after 20 minutes.


Warnings from Python 3.11 during install

I'm getting the following warnings during installation with Python 3.11.
$ python setup.py build
"...\Python\Python311\Lib\site-packages\setuptools\dist.py:160: UserWarning: newlines not allowed and will break in the future
warnings.warn("newlines not allowed and will break in the future")"
$ python setup.py develop
"...Python\Python311\Lib\site-packages\setuptools\command\easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools."
"...Python\Python311\Lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools."
It seems from the two last warnings like the installation method for HDLregression is outdated.

Changed to PIP install method


[wip] Documentation

Summary of the PR
Will be adding/improving documentation for functions in Silk
What version does this PR target?
Documentation will be based on Silk 1.2.1 but will be updated to newer versions if needed.
Further Comments
I am on the Silk Discord as Nova. If you have questions, comments, concerns feel free to message me anytime!

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


add variant support

This allows to get variant support when the item is the base product.

Hi, have you a ASIN for me, i want test it?

B0758FBH5T, B0742L3H1C, are a couple you find the product by getting the ParentASIN of item search.  By default it beings back the variants.

Not sure why there is the conflict, I rebased my branch of master

The conflict is no Problem.
I am try to get a example XML file, take you a item lookup with this asin B0758FBH5T? or item search? can you post a example Code please?

`var response = _amazonClient.GetProducts(CatalogProducts
.Skip(index * 10)
.Take(take)
.Select(x => x.Item.ParentASIN ?? x.Item.ASIN)
.ToList());
if (response?.Items == null)
{
continue;
}
            catalog.AddRange(response.Items.Item.Select(GetAmazonProduct)
                .Where(product => product != null));

product.txt
`

Ok now i have the informations you make a ItemLookup with the following ResponseGroups BrowseNodes, Small, Variations i have optimize the TestUI and check your commit the next days thanks

I have publish a new packages with your changes, thanks


🐸Coqui <> VoiceSmith ?

Hi Tim,
I'm pinging you from 🐸 Coqui.ai and 🐸TTS.
https://github.com/coqui-ai/TTS
I just saw VoiceSmith. It is really impressive work. 🚀
I just wanted to reach out if you want to talk about a possible collaboration.
Let me know if it sounds interesting. You can reach egolge[at]coqui[dot]ai
Best :)
PS. I've tried emailing you but it didn't work.

@dunky11
Hello, amazing work, are you planning to  update this repo? I would like to experiment with tts and this repo sounds very nice to try, I just can't get some things to work.

@snufas Hey thanks! I work full-time in text-to-speech now and developing this repository is way out of scope at the moment, unfortunately. Maybe one day I will update and finish it. I wouldn't use this project at the moment, its pretty buggy.

@dunky11
I am guessing that is Coqui.ai hence this issue...
Not going to speculate any further, but nonetheless I would be really really interested to chat to you more about this.
I tried the notebook you provide, it's very very good I have to say. I'm not that good at this, so I have no clue how to achieve such result with my own voice data set.
No wonder why you got pinged by Coqui.ai...
I am interested in text-to-speech topic particularly because I am blind myself, and I do run podcast and website for blind and visually impaired folks.
Would you mind if I talk to you on email? You can email me at<EMAIL_ADDRESS>I would really appreciate your time and expertise in this.
Natural text-to-speech is a really important topic for blind and vision impaired folks like me.
I am really hoping to talk to you about this topic...

@dunky11 I understand that you don't have the time to manage this repo with ElevenLabs anymore but could you put the dragged models online to be able to use the development version so that other people can maybe advance on their side (on google drive)?
I'm mainly talking about docker v0.2.2 and the new g2p models.


Example 02 schemas

Inspired by a fresh example 01-init-operator I wrote a simple write-and-read-back example for:

Scheme::S3
Scheme::Sled
Scheme::Redis
Scheme::Memory & Scheme::Dashmap

Thank you for submitting your PR! However, I would prefer not to delve into various schemes and their features at this early stage. Additionally, dedicating two chapters solely to initiating tasks does not seem like a productive use of time.
Instead, in chapter 02, I plan on introducing async and OpenDAL's read operation so that users can begin working on practical applications.

@Xuanwo looking forward to it. Maybe I can help with practical examples too - I am building a small app parsing markdown and storing tags in Dashmap or Redis.

Thank you for the pull request. I have added a new example through https://github.com/apache/incubator-opendal/pull/2541. I will now close this PR. Please inform me if you have any further questions.
Thanks again!


Add Solar-Log platform

Description:
Adding Solar-Log platform for Solar-Log (PV monitoring) devices.
Example entry for configuration.yaml (if applicable):
sensor:
  platform: solarlog
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass
[x] There is no commented out code in this PR.
[x] I have followed the [development checklist][dev-checklist]

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[x] [The manifest file][manifest-docs] has all fields filled out correctly. Update and include derived files by running python3 -m script.hassfest.
[x] New or updated dependencies have been added to requirements_all.txt by running python3 -m script.gen_requirements_all.
[x] Untested files have been added to .coveragerc.

Hi @Ernst79,
It seems you haven't yet signed a CLA. Please do so here.
Once you do that we will be able to review and accept this pull request.
Thanks!

Hey Ernst, thanks for your first contribution. Welcome to the Home Assistant community! 🐬

May I suggest that you use a config flow instead of platform configuration? You can do it as follows:
You can do it easily with our new scaffolding tool. From your dev environment, run:
python3 -m script.scaffold config_flow

It will generate a config flow and tests that pretty much match your schema 👍 Then change setup_platform into async_setup_entry.

May I suggest that you use a config flow instead of platform configuration? You can do it as follows:
You can do it easily with our new scaffolding tool. From your dev environment, run:
python3 -m script.scaffold config_flow

It will generate a config flow and tests that pretty much match your schema 👍 Then change setup_platform into async_setup_entry.

Good suggestion. I do like to make this change in the future, but as I'm not a programmer, so I need time to look into this and understand what I'm doing. I would propose that we first implement the current version of the integration and that I will add this in a future update.
I also have issues with the 'git fetch upstream dev' command, so I need to setup my dev environment again. It's complaining about 'unable to find remote helper for https', and all solutions on google don't seem to help me. So that's makes it impossible to update things from my local git.

@Balloob I've updated the code to have both the config flow, as you suggested, and the possibility to use the old fashioned platform configuration (yaml). It was a little bit more work than expected, but it's working now. Github is saying that there is a conflict in the config_flows.py file, but it cannot be resolved by me, I guess. Not sure what I'm doing wrong.

Resolving the conflict was easy, I just pressed the "resolve conflict" button for you 👍
Did you run python3 -m script.scaffold config_flow ? It looks like you have diverted quite a bit from the original template, including the tests are missing.

@balloob I've added the tests. Yes, I've differted a bit from the template, as I like to be able to use the yaml config as well. I've used the cert_expire sensor as a template and moved a part of sensor.py to const.py.
I don't know how to fix the failing codecov test?
And the documentation is not really clear if I need to include solarlog/sensor.py, solarlog/* or nothing in .coverage. What Shoud I use?

@balloob All remarks should be resolved now. Also updated the documentation. Only the remark about query-ing the name from the Solar-Log connection is not possible, I think, see my comment on that question above.


Add the Instagram icon

Is your feature request related to a problem? Please describe.
In the icon section Instagram icon is not there.
Describe the solution you'd like
Add the Instagram icon in the icon section
Describe alternatives you've considered
No response
Additional context
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

I am working on this issue. Please assign it to me.

Are you still working on this issue

Yes

Please ensure to include a screenshot whenever you make any changes on GitHub. This will help provide a visual reference and make it easier for others to understand the modifications you have made. @Parmesh119

@Parmesh119 as mentioned in #311, we are not accepting any more icons


I am having difficulty cloning the project on vercel as it gives me screenshot error

this is the error code about : visit page and take screenshot

I don't use Vercel, and the code has not been made for it.
Ransomware.live is running now on a dedicated server

so for deployment of this project, I would need my dedicated server or can be done through github ?

You can use a VM (any linux with python3).


Fix behavior when number of arguments is more than number of parameters

VS Code Version: 1.26.1
Extension Version: 0.6.1
What's the issue:

createDb in this instance has only 1 parameter so it defines the rest of the arguments with undefined.
Possibly add some error checking that if there is more params than there should be, color the annotation red so you can blatantly tell it is not supposed to be there.

Fixed in c4880b0

pushed in 0.7.0. The marketplace is still down for now but it can be manually installed from here on github: https://github.com/lannonbr/vscode-js-annotations/releases/tag/0.7.0
Here are some instructions on installing a VSIX file: https://code.visualstudio.com/docs/editor/extension-gallery#_install-from-a-vsix


The program not start

The program when I try to open it the CMD comes out for a few seconds and then disappears and CTR Studio does not start. Could you explain the problem to me? Because I have CTGP-7 and I would like to create new characters but with this problem I can't. A thousand thanks

I was having this issue at first, but didn't read the requirements on the main page.
You need to have Net6.0 runtime installed, which you can get here.


Provisioner creates first master vm in a powered off state and promptly fails

Hello again.  I'm running into the below issue when trying to deploy a 3-node test cluster.  Based on some searching, it seems it could be an issue of sorts with with the libvirt terraform provider but I'm really not sure.  Hoping I can get pointed in the right direction again.
The vm test-master-0 gets created and in a powered off state but it throws the following error:
TASK [community.general.terraform] ************************************************************************************************************************************************************************************************************************************
task path: /...libvirt-k8s-provisioner/04_provisioning_vms.yml:26

...

fatal: [r610a]: FAILED! => {
    "changed": false,
    "cmd": "/usr/bin/terraform apply -no-color -input=false -auto-approve -lock=true /tmp/tmpFLko37.tfplan",
    "invocation": {
        "module_args": {
            "backend_config": null,
            "backend_config_files": null,
            "binary_path": null,
            "check_destroy": false,
            "force_init": true,
            "init_reconfigure": false,
            "lock": true,
            "lock_timeout": null,
            "overwrite_init": true,
            "plan_file": null,
            "plugin_paths": null,
            "project_path": "/data/admin/vm/terraform/files/masters",
            "purge_workspace": false,
            "state": "present",
            "state_file": null,
            "targets": [],
            "variables": {
                "cpu": "2",
                "disk_size": "30",
                "domain": "blah.net",
                "hostname": "test-master",
                "libvirt_network": "test",
                "libvirt_pool": "test",
                "memory": "2",
                "os": "ubuntu",
                "os_image_name": "OS-GenericCloud.qcow2",
                "vm_count": "1"
            },
            "variables_files": null,
            "workspace": "default"
        }
    },
    "msg": "\nError: Error defining libvirt domain: operation failed: domain 'test-master-0' already exists with uuid 4c3bc5b8-cbb4-49af-90dc-ac45e200070a\n\n  with libvirt_domain.k8s-master[0],\n  on k8s-master.tf line 51, in resource \"libvirt_domain\" \"k8s-master\":\n  51: resource \"libvirt_domain\" \"k8s-master\" {",
    "rc": 1,
    "stderr": "\nError: Error defining libvirt domain: operation failed: domain 'test-master-0' already exists with uuid 4c3bc5b8-cbb4-49af-90dc-ac45e200070a\n\n  with libvirt_domain.k8s-master[0],\n  on k8s-master.tf line 51, in resource \"libvirt_domain\" \"k8s-master\":\n  51: resource \"libvirt_domain\" \"k8s-master\" {\n\n",
    "stderr_lines": [
        "",
        "Error: Error defining libvirt domain: operation failed: domain 'test-master-0' already exists with uuid 4c3bc5b8-cbb4-49af-90dc-ac45e200070a",
        "",
        "  with libvirt_domain.k8s-master[0],",
        "  on k8s-master.tf line 51, in resource \"libvirt_domain\" \"k8s-master\":",
        "  51: resource \"libvirt_domain\" \"k8s-master\" {",
        ""
    ],
    "stdout": "libvirt_domain.k8s-master[0]: Creating...\n",
    "stdout_lines": [
        "libvirt_domain.k8s-master[0]: Creating..."
    ]
}

virsh list --all
# virsh list --all
 Id   Name            State
--------------------------------
 1    git             running
 -    test-master-0   shut off

virsh dominfo test-master-0
# virsh dominfo test-master-0
Id:             -
Name:           test-master-0
UUID:           4c3bc5b8-cbb4-49af-90dc-ac45e200070a
OS Type:        hvm
State:          shut off
CPU(s):         2
Max memory:     2097152 KiB
Used memory:    2097152 KiB
Persistent:     yes
Autostart:      enable
Managed save:   no
Security model: none
Security DOI:   0

The line in the terraform code it points to is:
resource "libvirt_domain" "k8s-master" {
  autostart = true
  count= var.vm_count
  name = "${var.hostname}-${count.index}"
  memory = var.memory*1024
  vcpu = var.cpu

  disk {
     volume_id = libvirt_volume.os_image_resized[count.index].id
  }

  network_interface {
       network_name = var.libvirt_network
  }

  cloudinit = libvirt_cloudinit_disk.commoninit[count.index].id

  console {
    type        = "pty"
    target_port = "0"
    target_type = "serial"
  }

  graphics {
    type = "spice"
    listen_type = "address"
    autoport = "true"
  }
}

Hey again! Please try running the cleanup playbook (the one numbered 99 :) ) and if that fails, please remove the vm instance using virsh:
virsh undefine test-0-master

Then you can rerun the main playbook!
Please let me know if that works.

Ah, the clean up playbook wasn't destroying the VM for some reason.  I made sure it had deleted the pool and the network but never checked if it deleted the vm.  After running cleanup and manually deleting the VM, it appears to be working.  Thanks!!!


Disentangle / De-Hardcode the data location from the code folder

Currently, it's very tedious to switch from one dataset to a new one, one has to move/replace ~5 folders by hand to do that -- would it be a good idea to have the "data root folder" configurable instead of hard-coded?
We could add a data_root or data_folder argument to the config.yml, and have it default to ., so that the current behaviour isn't changed, but one could quickly switch to a new dataset (e.g. when running inference on a new dataset, or for debugging purposes)

sounds actually lke a good idea, might be a good thing for the next major update (0.6 or 0.7)
We may think about having the option to choose locations manually (override defaults)

Agreed. My suggestion would be to have a configureable data root that defaults to "data/" in the project folder.
Within this directory we can then freely create directories for aux/backup/h5, etc.

introduced --data_dir argument for setup_raw_data.py defaults to "data"
using --config overrides --data_dir

After some testing I think the config.yml is a bit uncomfortable imo.
I rather prefer the --data_dir flag which we can apply in each of the 3/4 steps. when we set a default of "data" the we have a generic structure, but can adapt that. I think having one line in the config file is too "hidden"

fixed with #25


Typos on az cosmosdb --help

Describe the bug

Several subgroups have misspelled Cosmos DB as Comsos DB (harmless mistake but noticeable!), namely:

keys
network-rule
private-endpoint-connection
private-link-resource

To Reproduce
az cosmosdb --help
Expected behavior
All subgroup --help descriptions should say ... Cosmos DB ...
Environment summary
az version
{
  "azure-cli": "2.5.1",
  "azure-cli-command-modules-nspkg": "2.0.3",
  "azure-cli-core": "2.5.1",
  "azure-cli-nspkg": "3.0.4",
  "azure-cli-telemetry": "1.0.4",
  "extensions": {}
}

Thank you for reporting this. I have submitted a fix.

cosmosdb

Fixed in 2.14.0


[Unity] Add support to append relay op attrs in translator

This PR adds an argument to the relay to relax translator to append the relay Op Attrs as function attributes to the generated TIR PrimFuncs
This information is really useful in Relax as the absence of this prevents us from being able schedule efficiently for ops that are heavily sensitive to the attributes.
For example, the groups attribute to conv2d op is needed to differentiate between regular conv2d and depthwise conv2d.

cc @YuchenJin @psrivas2


Nextcloud Photos don't load (SEARCH http method blocked)

Description
Viewing the Gallery of nextcloud does not work, even tough the nextcloud exclusion ruleset is enabled. When opening https://nextcloud.domain.com/apps/photos/ photos won't load because the call is blocked. Probably because of the SEARCH http method.
Audit Logs / Triggered Rule Numbers
---4Y92Ts47---A--
[06/Jul/2020:23:04:16 +0000]<PHONE_NUMBER>44.260733 <IP_ADDRESS> 30882 <IP_ADDRESS> 443
---4Y92Ts47---B--
SEARCH /remote.php/dav/ HTTP/1.1
origin: https://nextcloud.domain.com
depth: infinity
dnt: 1
content-type: text/xml
requesttoken:
accept-encoding: gzip, deflate, br
cookie: xxxxx; oc_sessionPassphrase=xxxx; __Host-nc_sameSiteCookielax=true; __Host-nc_sameSiteCookiestrict=true; nc_username=xxx; nc_token=xxx; nc_session_id=xxx
content-length: 1491
accept-language: en-GB,en;q=0.7,de;q=0.3
te: trailers
accept: text/plain
cache-control: max-age=0
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Firefox/78.0
host: nextcloud.domain.com

---4Y92Ts47---D--

---4Y92Ts47---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---4Y92Ts47---F--
HTTP/1.1 403
Server: nginx
Date: Mon, 06 Jul 2020 23:04:16 GMT
Content-Length: 146
Content-Type: text/html
Connection: keep-alive

---4Y92Ts47---H--
ModSecurity: Warning. Matched "Operator `Within' with parameter `GET HEAD POST OPTIONS PUT PATCH CHECKOUT COPY DELETE LOCK MERGE MKACTIVITY MKCOL MOVE PROPFIND PROPPATCH UNLOCK REPORT TRACE jsonp' against variable `REQUEST_METHOD' (Value: `SEARCH' ) [file "/etc/modsecurity/crs/rules/REQUEST-911-METHOD-ENFORCEMENT.conf"] [line "27"] [id "911100"] [rev ""] [msg "Method is not allowed by policy"] [data "SEARCH"] [severity "2"] [ver "OWASP_CRS/3.3.0"] [maturity "0"] [accuracy "0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-generic"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/210/272/220/274"] [tag "PCI/12.1"] [hostname "<IP_ADDRESS>"] [uri "/remote.php/dav/"] [unique_id "159407665644.260733"] [ref "v0,6"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity/crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "80"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [data ""] [severity "2"] [ver "OWASP_CRS/3.3.0"] [maturity "0"] [accuracy "0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-generic"] [hostname "<IP_ADDRESS>"] [uri "/remote.php/dav/"] [unique_id "159407665644.260733"] [ref ""]
ModSecurity: Warning. Matched "Operator `Ge' with parameter `5' against variable `TX:INBOUND_ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity/crs/rules/RESPONSE-980-CORRELATION.conf"] [line "80"] [id "980130"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Inbound Score: 5 - SQLI=0,XSS=0,RFI=0,LFI=0,RCE=0,PHPI=0,HTTP=0,SESS=0): individual paranoia level scores: 5, 0, 0, 0"] [data ""] [severity "0"] [ver "OWASP_CRS/3.3.0"] [maturity "0"] [accuracy "0"] [tag "event-correlation"] [hostname "<IP_ADDRESS>"] [uri "/remote.php/dav/"] [unique_id "159407665644.260733"] [ref ""]

---4Y92Ts47---I--

---4Y92Ts47---J--

---4Y92Ts47---Z--

Your Environment

CRS version v3.3.0
Paranoia level setting:
ModSecurity version: 3
Web Server and version owasp/modsecurity:3-nginx (docker)
Operating System and version:

Nextcloud version: 19.0.0

Confirmation
[x] I have removed any personal data (email addresses, IP addresses,
passwords, domain names) from any logs posted.

https://github.com/coreruleset/coreruleset/pull/1781

I think I hit the same issue. I browsed the NextCloud pictures and wanted to open one.
Audit Logs / Triggered Rule Numbers
--7ffd9b74-A--
[14/Jul/2020:21:17:09 +0200] Xw4EtQJqeZvT-T6JqJ30nQAAAEk <IP_ADDRESS> 59868 <IP_ADDRESS> 8080
--7ffd9b74-B--
PROPFIND /remote.php/dav/files/user/pictures/image1.jpg HTTP/1.0
Host: nextcloud.example.com
Connection: close
Content-Length: 661
accept: text/plain
requesttoken: xxxxxxxx
depth: 0
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36
content-type: text/plain;charset=UTF-8
origin: https://nextcloud.example.com
sec-fetch-site: same-origin
sec-fetch-mode: cors
sec-fetch-dest: empty
accept-encoding: gzip, deflate, br
accept-language: en-GB,en-US;q=0.9,en;q=0.8,de;q=0.7
cookie: oc_sessionPassphrase=xxxxxxxx; __Host-nc_sameSiteCookielax=true; __Host-nc_sameSiteCookiestrict=true; xxxxxxxx=xxxxxxxx; nc_username=user; nc_token=xxxxxxxx; nc_session_id=xxxxxxxx

--7ffd9b74-C--
<?xml version="1.0"?>
			<d:propfind  xmlns:d="DAV:"
				xmlns:oc="http://owncloud.org/ns"
				xmlns:nc="http://nextcloud.org/ns"
				xmlns:ocs="http://open-collaboration-services.org/ns">
				<d:prop>
					<d:getlastmodified />
					<d:getetag />
					<d:getcontenttype />
					<d:resourcetype />
					<oc:fileid />
					<oc:permissions />
					<oc:size />
					<d:getcontentlength />
					<nc:has-preview />
					<nc:mount-type />
					<nc:is-encrypted />
					<ocs:share-permissions />
					<oc:tags />
					<oc:favorite />
					<oc:comments-unread />
					<oc:owner-id />
					<oc:owner-display-name />
					<oc:share-types />
				</d:prop>
			</d:propfind>
--7ffd9b74-F--
HTTP/1.1 403 Forbidden
Content-Length: 305
Connection: close
Content-Type: text/html; charset=iso-8859-1

--7ffd9b74-E--

--7ffd9b74-H--
Message: Warning. Pattern match "(?:get|post|head|options|connect|put|delete|trace|track|patch|propfind|propatch|mkcol|copy|move|lock|unlock)\\s+(?:\\/|\\w)[^\\s]*(?:\\s+http\\/\\d|[\\r\\n])" at REQUEST_BODY. [file "/etc/httpd/modsecurity.d/activated_rules/REQUEST-921-PROTOCOL-ATTACK.conf"] [line "52"] [id "921110"] [msg "HTTP Request Smuggling Attack"] [data "Matched Data: propfind  xmlns:d=\x22dav:\x22\x0a found within REQUEST_BODY: <?xml version=\x221.0\x22?>\x0a\x09\x09\x09<d:propfind  xmlns:d=\x22dav:\x22\x0a\x09\x09\x09\x09xmlns:oc=\x22http://owncloud.org/ns\x22\x0a\x09\x09\x09\x09xmlns:nc=\x22http://nextcloud.org/ns\x22\x0a\x09\x09\x09\x09xmlns:ocs=\x22http://open-collaboration-services.org/ns\x22>\x0a\x09\x09\x09\x09<d:prop>\x0a\x09\x09\x09\x09\x09<d:getlastmodified />\x0a\x09\x09\x09\x09\x09<d:getetag />\x0a\x09\x09\x09\x09\x09<d:getcontenttype />\x0a..."] [severity "CRITICAL"] [ver "OWASP_CRS/3.3.0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-protocol"] [tag "parano
Message: Access denied with code 403 (phase 2). Operator GE matched 5 at TX:anomaly_score. [file "/etc/httpd/modsecurity.d/activated_rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "93"] [id "949110"] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [severity "CRITICAL"] [ver "OWASP_CRS/3.3.0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-generic"]
Message: Warning. Operator GE matched 5 at TX:inbound_anomaly_score. [file "/etc/httpd/modsecurity.d/activated_rules/RESPONSE-980-CORRELATION.conf"] [line "91"] [id "980130"] [msg "Inbound Anomaly Score Exceeded (Total Inbound Score: 5 - SQLI=0,XSS=0,RFI=0,LFI=0,RCE=0,PHPI=0,HTTP=5,SESS=0): individual paranoia level scores: 5, 0, 0, 0"] [ver "OWASP_CRS/3.3.0"] [tag "event-correlation"]
Apache-Error: [file "apache2_util.c"] [line 273] [level 3] [client <IP_ADDRESS>] ModSecurity: Warning. Pattern match "(?:get|post|head|options|connect|put|delete|trace|track|patch|propfind|propatch|mkcol|copy|move|lock|unlock)\\\\\\\\s+(?:\\\\\\\\/|\\\\\\\\w)[^\\\\\\\\s]*(?:\\\\\\\\s+http\\\\\\\\/\\\\\\\\d|[\\\\\\\\r\\\\\\\\n])" at REQUEST_BODY. [file "/etc/httpd/modsecurity.d/activated_rules/REQUEST-921-PROTOCOL-ATTACK.conf"] [line "52"] [id "921110"] [msg "HTTP Request Smuggling Attack"] [data "Matched Data: propfind  xmlns:d=\\\\x22dav:\\\\x22\\\\x0a found within REQUEST_BODY: <?xml version=\\\\x221.0\\\\x22?>\\\\x0a\\\\x09\\\\x09\\\\x09<d:propfind  xmlns:d=\\\\x22dav:\\\\x22\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09xmlns:oc=\\\\x22http://owncloud.org/ns\\\\x22\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09xmlns:nc=\\\\x22http://nextcloud.org/ns\\\\x22\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09xmlns:ocs=\\\\x22http://open-collaboration-services.org/ns\\\\x22>\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09<d:prop>\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09\\\\x09<d:getlastmodified />\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09\\\\x09<d:getetag />\\\\x0a\\\\x09\\\\x09\\\\x09\\\\x09\\\\x09<d:getcontenttype />\\\\x0a..."] [severity "CRITICAL"] [ver "OWASP_CRS/3.3.0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-protocol"] [tag "parano [hostname "nextcloud.example.com"] [uri "/remote.php/dav/files/user/pictures/image1.jpg"] [unique_id "Xw4EtQJqeZvT-T6JqJ30nQAAAEk"]
Apache-Error: [file "apache2_util.c"] [line 273] [level 3] [client <IP_ADDRESS>] ModSecurity: Access denied with code 403 (phase 2). Operator GE matched 5 at TX:anomaly_score. [file "/etc/httpd/modsecurity.d/activated_rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "93"] [id "949110"] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [severity "CRITICAL"] [ver "OWASP_CRS/3.3.0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-generic"] [hostname "nextcloud.example.com"] [uri "/remote.php/dav/files/user/pictures/image1.jpg"] [unique_id "Xw4EtQJqeZvT-T6JqJ30nQAAAEk"]
Apache-Error: [file "apache2_util.c"] [line 273] [level 3] [client <IP_ADDRESS>] ModSecurity: Warning. Operator GE matched 5 at TX:inbound_anomaly_score. [file "/etc/httpd/modsecurity.d/activated_rules/RESPONSE-980-CORRELATION.conf"] [line "91"] [id "980130"] [msg "Inbound Anomaly Score Exceeded (Total Inbound Score: 5 - SQLI=0,XSS=0,RFI=0,LFI=0,RCE=0,PHPI=0,HTTP=5,SESS=0): individual paranoia level scores: 5, 0, 0, 0"] [ver "OWASP_CRS/3.3.0"] [tag "event-correlation"] [hostname "nextcloud.example.com"] [uri "/remote.php/dav/files/user/pictures/image1.jpg"] [unique_id "Xw4EtQJqeZvT-T6JqJ30nQAAAEk"]
Action: Intercepted (phase 2)
Apache-Handler: proxy-server
Stopwatch:<PHONE_NUMBER>188732 3691 (- - -)
Stopwatch2:<PHONE_NUMBER>188732 3691; combined=3182, p1=492, p2=2549, p3=0, p4=0, p5=141, sr=58, sw=0, l=0, gc=0
Response-Body-Transformed: Dechunked
Producer: ModSecurity for Apache/2.9.2 (http://www.modsecurity.org/); OWASP_CRS/3.3.0.
Server: Apache
Engine-Mode: "ENABLED"

--7ffd9b74-Z--

Your Environment

CRS version: v3.3.0
Paranoia level setting: 1
ModSecurity version: 2.9.2
Web Server and version: apache 2.4.37
Operating System and version: CentOS Linux release 8.2.2004

I enabled the nextcloud exclusion rules:
SecAction \
        "id:900130,\
        phase:1,\
        nolog,\
        pass,\
        t:none,\
        setvar:tx.crs_exclusions_nextcloud=1"

Confirmation
[x] I have removed any personal data (email addresses, IP addresses, passwords, domain names) from any logs posted.

Are you having problem also with newest Nextcloud exclusion rules package?
https://raw.githubusercontent.com/coreruleset/coreruleset/v3.4/dev/rules/REQUEST-903.9003-NEXTCLOUD-EXCLUSION-RULES.conf

Created bug on Nextcloud upstream. Still seeing the same problem on master branch.

Created bug on Nextcloud upstream. Still seeing the same problem on master branch.

Hey @ntime, @azurit, @fzipi: Is this something we need to keep open or can we close this issue?

Looks like a Nextcloud bug to me. @fzipi Can you send a link to your Nextcloud bug report so it's linked here?
Anyway, i think we can close this.

It's up there :)

It is already there, linked.

Sorry, didn't notice it!


Make an abstract type for Trace and have Traces implement the read-only choice map interface

Note that this does not obviate the need for ChoiceMap abstract type, because there are ChoiceMaps that are not traces or derived from traces.

https://github.com/probcomp/Gen/commit/6017f2144fd4fb77b7a7c0abd04f3ed0b59dd256 adds the following method:
	function Base.getindex(trace::Trace, addr)
    get_choices(trace)[addr]
end

Note that traces do not implement the full choice map interface. Instead, the getindex method (which is used by he indexing syntax e.g. trace[addr]) is intended as syntactic sugar for reading the values of specific random choices from a trace in user inference programs. If you need to walk a choice map (like in a modeling DSL implementation) then you need to use get_choices first to obtain an instance of ChoiceMap which implements a bunch of other methods for walking choice maps.


adds fields to comments export

fixes #160

adds article title, article URL, and article locale (language code) in comments export list

👍🏼


First Capstone Project

In this project the following things have been designed:

Home Page of the travel and tour website with personalized content.
About Page of travels and tour website with personalized content.
The format is kept similar to the one provided in the capstone project.
Hovering effect is created on the navbar, mobile menu, and buttons.
The buttons created are made interactive using JavaScript.
The live video link to the presentation of the website is attached in the README file along with the live website link.

Since "DOMContentLoaded" is used as an event listener to load the team using JavaScript, kindly refresh the page when switching from mobile view to desktop view or vice versa for optimum performance.


What's the output of a redis_database?

Hi, as titled. I'd like to get access to the database URL, port and token.

Hi there! Current version of the provider provides the endpoint, which can be converted to the URL by prefixing https://<endpoint> .
For the port and the rest tokens, we expect to release a new version soon.

https://registry.terraform.io/providers/upstash/upstash/1.0.2 has been released with a fix. now all credentials can be received as terraform output
closing the issue for now


Code in Section 2, Chapter 3c contains several files with a .m~ extension

The code for Section 2, Chapter 3c needs a fair amount of work to make it easy to follow and reuse:
https://github.com/MIT-LCP/critical-data-book/tree/master/section2/chapter3c/code
One issue is that the code includes several files with the .m~ extension, which I assume are temporary files. In some cases these were duplicates of other files, so I removed them, but there are still some remaining.
Should the .m~ files be renamed with a .m extension or can they be removed?

.m~ files are automatically generated backup files (same as .asv). Since
we're using github they're redundant and can be removed.
On 7 Jun 2016 15:45, "Tom Pollard"<EMAIL_ADDRESS>wrote:

The code for Section 2, Chapter 3c needs a fair amount of work to make it
easy to follow and reuse:
https://github.com/MIT-LCP/critical-data-book/tree/master/section2/chapter3c/code
One issue is that the code includes several files with the .m~ extension,
which I assume are temporary files. In some cases these were duplicates of
other files, so I removed them, but there are still some remaining.
Should the .m~ files be renamed with a .m extension or can they be removed?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/MIT-LCP/critical-data-book/issues/5, or mute the
thread
https://github.com/notifications/unsubscribe/ABOSdJ03ul0SO63sEtoMQOX2xk4JZZHiks5qJYQmgaJpZM4IwAOt
.

.m~ files are automatically generated backup files (same as .asv). Since we're using github they're redundant and can be removed.

These are new files that I copied from Dropbox and committed to Github. I deleted most of the temporary files before the first commit, but I kept the ones that weren't obviously a duplicate of another file. Just want to check that they are duplicates before deleting them.

yep, so they are all archived versions of files in the parent folder, which is why I missed them:

chapter3c/code/main_missing_data_comparison.m~ => chapter3c/make_histograms.m.

chapter3c/code/main_data_histograms.m~ => chapter3c/main_data_histograms.m

chapter3c/code/make_histograms.m~ => chapter3c/make_histograms.m.


Warning when opening the searcher (multi-line location not supported)

Open IDE, and create a new project. Press Tab to open the sercher.
The following warning appears in the DevTools console:
[WARN] lib\rust\ensogl\component\text\src\component\text.rs:129 Trying to compute coordinates for multi-line location. This is not supported yet.

There should be no warning.

Not reproducible in GUI2


[L] View Site Record

Description:
As a BC Parks Admin user, I would like to view a Site Record so that I can find the information I need.
Acceptance Criteria:
Given that I am a BC Parks Admin User
When I view a Site Record
Then I can see its Legal name and Historical name information
Given that I am a BC Parks Admin User
When I view a Site Record
Then I can see breadcrumbs at the top of the page showing me that this is a subpage of the associated Protected Area
Given that I am a BC Parks Admin User
When I view a Site Record
Then I can see an Edit button
Development Checklist:

[x] Page title will be a combination of the ID and the Legal Site Name. ID should be in bold text.
[x] The system generated details (Type, Status, Last updated) are below the title
[x] The Legal name data are the same data points used for Protected Area Names. the same rules apply.
[x] Historical names for sites work the same as for Protected Areas. That is, Historical Name section is generated when a user goes through the Change Legal name flow and saves changes.
[x] The Edit button, upon clicking, has a dropdown with three options: Minor edit, Legal name, Repeal

Wireframe(s)

https://www.figma.com/file/qdjegD6YHWZPlyFT8dGXvk/Data-Register?type=design&node-id=3299%3A5591&mode=design&t=zk1gqGE2sJkNs6Ea-1

Clickable prototype for Edit dropdown: https://www.figma.com/proto/qdjegD6YHWZPlyFT8dGXvk/Data-Register?type=design&node-id=4361-116757&t=KRBDpucZHEPKgzYq-0&scaling=min-zoom&page-id=4361%3A116641&starting-point-node-id=4361%3A116757

Definition of Ready (Note: If any of these points are not applicable, mark N/A)

[x] User story is included
[x] User role and type are identified
[x] Acceptance criteria are included
[x] Wireframes are included
[x] Design / Solution is accepted by Product Owner
[x] Dependencies are identified (technical, business, regulatory/policy)
[ ] Story has been estimated (under 13 pts)

Definition of Done (Note: If any of these points are not applicable, mark N/A)

In progress:

[ ] Acceptance criteria are tested (Functionality meets the acceptance criteria defined in the ticket)
[ ] UI meets accessibility requirements
[ ] Unit tests are written
[ ] Work is traceable in GitHub
[ ] PR linked to ticket number
[ ] If needed/required - Dev adds flag/label to highlight any migration steps necessary prior to PROD deployment

Code review:

[ ] Code is peer reviewed and has passed CI/CD tests

QA:

[ ] Acceptance criteria are tested (Functionality meets the acceptance criteria defined in the ticket)
[ ] Code is shippable to the production environment
[ ] Functional features have been tested and passed by QA
[ ] UI components tested by designer
[ ] Code is deployed to PROD when moved to 'done' column (unless requested otherwise by PO)

PO Review:

[ ] Acceptance criteria are tested (Functionality meets the acceptance criteria defined in the ticket)
[ ] Reviewed and approved by Product Owner

Notes:

This piece was broken out from the original ticket: https://github.com/bcgov/parks-data-register/issues/124
Questions and Answers captured in Figma:

Dependencies

Blocked by
Blocking

I have updated the ticket description based on the edit dropdown solution update

QA Notes:

Deploy the code to TEST environment (Use the repo: https://github.com/bcgov/parks-data-register)
Link to test environment: https://test-data.bcparks.ca/admin/
Verify the items given in the ticket description.
If passed, please move to PO review and assign to @JLWade

Tested on TEST. No further issues found. Moving to PO Review.

mving to done


Add reason to TenantState::Broken

Reason and backtrace are added to the Broken state. They are shown in debug messages. Backtrace is automatically collected when tenant entered the broken state. API and CLI continue to use existing  format (state as a single string) with help of custom serialization (added tests and checked manually).
Please note that the tenant's broken reason is not persisted on disk so the reason is lost when pageserver is restarted.
Closes #3001

I thought that reasoning was added by @shanyp in #3289

I thought that reasoning was added by @shanyp in #3289

That was for adding a queryable log message, this one is augmenting the reason to the tenant state itself

Hi @theirix! Sorry for a delay. I've rebased this PR on top of current main and opened #3954 with these changes. Thank you for your interest in the project! :)

Hi @LizardWizzard . Thank you for letting me know. I hope some code from this PR will help to diagnose the tenant's state:)

@theirix
Superseded by #3954. The PR is merged now.

I hope some code from this PR will help to diagnose the tenant's state:)

It helps a lot! Thank you for your contribution 🚀


Allow passing arguments to jinja2.Environment() when rendering templates

It seems that with the current test setup we can only create unit tests for operations that check the commands that are being yielded by those operations. I don't see an easy option to create a test to verify that the jinja_env_kwargs passed into the files.template() operation are being passed onto the jinja2 Environment().
If you want to me to write a test for that, you'll have to give me some pointers :)

@Fizzadar what do you need from me in order to merge this PR?


tWAS855 and DayTrader3 end2end working!

Currently the playbook that uses these roles is still IBM Internal...  I'll have to scrub that to see how I can add a main readme that doc's how to use these roles.  I had more work to do for tWAS90 and DayTrader7.


Add id add to list payload

From Klaviyo team:
When adding $id, this would be as part of the properties array.
For example:
curl https://a.klaviyo.com/api/v1/list/[LIST ID]/members
-X POST
-d api_key=[PRIVATE API KEY]
-d<EMAIL_ADDRESS>-d properties='{ "$id" : "ABDC" }'
-d confirm_optin=false
There are several ways to identify profiles in Klaviyo. The order that we check them are $kid, $id, $email and $anonymous. This means we, by default, will lookup by $id and not $email if there is an $id passed.
… adding $id to the "Add to List" request should eliminate the issue [of duplicate profiles] altogether

@hankim813 would one of you take a look at this for me?

LGTM 🚢