uuid_generate_v4() does not exist error

Hi,
I'm trying to use Atlas in my go project.
When i run atlas migrate diff --env gorm  i got this error:
Error: sql/migrate: read migration directory state: sql/migrate: execute: executing statement "CREATE TABLE "tenants" ("created_at" timestamptz,"updated_at" timestamptz,"id" uuid DEFAULT uuid_generate_v4(),"name" text,"description" text,"db_name" text,"domain" text,PRIMARY KEY ("id"));" from version "schema": pq: function uuid_generate_v4() does not exist
I have check, and my database has the extension:
database=# CREATE EXTENSION IF NOT EXISTS "uuid-ossp";
CREATE EXTENSION
database=# select uuid_generate_v4();
uuid_generate_v4
f276d0fb-014f-4735-b892-4c734918ef19
(1 row)
What i'm doing wrong?
Thanks!

Hello @fabiorizzomatos, does the dev database, has the extension as well?
Or maybe, you could use the gen_random_uuid function to avoid having to use extensions.

Hi @crossworth !
I guess not. Just using the default ones.  Would you know how i do this?

I have some (braindead) code as workaround for that.
Please ping me if you are interessted.
Atlas --dev-db thingy doesn't support extensions or init scripts at the moment.  I'm using citus and uuid extensions only.

A simple workaround for this atm, is to spin up a local Postgres container, install there the extensions your schema rely on (e.g., with init script) and use it as a dev-database. The idea here is that this container represents the same production database baseline.
We plan to support extensions in the next version.

I assume you are using something similar to this:
env "gorm" {
  src = data.external_schema.gorm.url
  dev = "docker://postgres/15/dev" # <--- dev database here
  migration {
    dir = "file://migrations"
  }
  format {
    migrate {
      diff = "{{ sql . \"  \" }}"
    }
  }
}

In that case I think there is a easy way to handle it, first is to not use docker (at least, not in this way),  start a local docker and create the extensions needed (a local database works as well), after that use it on the dev part.
@egandro Hi, please, share here with us if possible, this way others can see as well.

Again :) this doesn't fix atlas - this is just >> my << hack.
I don't make it work in "you" world. Just the idea how to poke around
./diffschema.sh "postgres://production:production@<IP_ADDRESS>:5432/production?sslmode=disable&TimeZone=UTC"

./diffschema.sh is
#!/bin/bash

LOCAL_DATABASE="$1"

SCHEMA_FILE="./schema.hcl"

IMAGE=postgres:15.3
CONTAINER_NAME=diffschema
POSTGRES_PASSWORD=diffschema
POSTGRES_USER=diffschema
POSTGRES_PORT=15433
PG_URL="postgres://"${POSTGRES_USER}":"${POSTGRES_PASSWORD}"@<IP_ADDRESS>:"${POSTGRES_PORT}"/"${CONTAINER_NAME}"?sslmode=disable&TimeZone=UTC"

kill_docker_container () {
    echo "stopping container: ${CONTAINER_NAME}"
    docker rm -f "${CONTAINER_NAME}" 2>/dev/null >/dev/null || true
}

trap kill_docker_container EXIT

kill_docker_container

docker run --name "${CONTAINER_NAME}" -p ${POSTGRES_PORT}:5432 \
    -e POSTGRES_PASSWORD="${POSTGRES_PASSWORD}" \
    -e POSTGRES_USER="${POSTGRES_USER}" -d \
    "${IMAGE}"

sleep 2
docker exec -it "${CONTAINER_NAME}" pg_isready
# add whatever SQL you need here for the temp PG database
docker exec -it "${CONTAINER_NAME}" psql -U "${POSTGRES_USER}" "${CONTAINER_NAME}" -c 'CREATE EXTENSION IF NOT EXISTS "uuid-ossp";'

atlas schema diff \
    --from "${LOCAL_DATABASE}" \
    --to "file://${SCHEMA_FILE}" \
    --dev-url "${PG_URL}" \
    --exclude "atlas_schema_revisions"

A simple workaround for this atm, is to spin up a local Postgres container, install there the extensions your schema rely on (e.g., with init script) and use it as a dev-database. The idea here is that this container represents the same production database baseline.
We plan to support extensions in the next version.

Hi @a8m
I did it, but i receive now this message:
Error: sql/migrate: taking database snapshot: sql/migrate: connected database is not clean: found schema "citus"
my atlas.hcl:
data "external_schema" "gorm" {
program = [
"go",
"run",
"-mod=mod",
"./loader",
]
}
env "gorm" {
src = data.external_schema.gorm.url
dev = "postgres://user:user@<IP_ADDRESS>:54322/database?sslmode=disable"
migration {
dir = "file://migrations"
}
format {
migrate {
diff = "{{ sql . "  " }}"
}
}
}

@crossworth Thanks for helping.
I've tried this:
atlas schema apply --env gorm -u "postgres://vindula:vindula@<IP_ADDRESS>:5432/vindula?sslmode=disable&search_path=public"
and still received the error message:
Error: sql/migrate: taking database snapshot: sql/migrate: connected database is not clean: found schema "citus"
Its a database twin, clean, just installed.
Not working using exclude as well.

@fabiorizzomatos  your dev-db is not clean not the vindula db

Alright, I have done a few tests:
Declarative, setting the search_path seems to work:

Versioned, using the migrate diff with search_path seems to works as well:

And apply works too:

Maybe you forgot the search_path on the dev?
  dev = "postgres://user:user@<IP_ADDRESS>:54322/database?sslmode=disable&search_path=public"

Maybe you forgot the search_path on the dev?
  dev = "postgres://user:user@<IP_ADDRESS>:54322/database?sslmode=disable&search_path=public"

Bingo! that was my problem. Fixed and it works! Thanks everyone! @crossworth  @egandro


Scully init ng-add schematic silently fails when there is invalid json in angular.json

🐞 Bug report
Description
As an example, when there is a trailing comma in one of the array's in angular.json the CLI will just work.
However, running ng add @scullyio/init will silently fail. It will exit without an error before its done.

When you have this issue. I did explain how to do a manual installation here

Thanks @SanderElias ,
I had the same kind of problem, but with an error, and not while the installation process. When running npm run scully, I had an error telling that Scully didn't find my project in the angular.json, but it was in. Thanks to this issue, I understood that the reason was a guilty comma in the angular.json file, then the JSON was invalid for Scully. After removing the comma, it was ok...
It's quite important to check if the angular.json file is valid when error or strange behaviour occurs.

Related to #1402
I'm going to close this one, so we can concentrate discussion over there.


haste-task-webpack: reject if webpack fails with compilation errors

Codecov Report

Merging #110 into master will increase coverage by 0.11%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #110      +/-   ##
==========================================
+ Coverage   96.01%   96.13%   +0.11%
==========================================
  Files          18       19       +1
  Lines         201      207       +6
  Branches       20       21       +1
==========================================
+ Hits          193      199       +6
  Misses          8        8

Impacted Files
Coverage Δ

...sk-webpack/test/fixtures/webpack.config.invalid.js
100% <ø> (ø)

...task-webpack/test/fixtures/webpack.config.error.js
100% <100%> (ø)

packages/haste-task-webpack/src/index.js
85.71% <100%> (+5.71%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 60bf01c...18222b8. Read the comment docs.


fix podspec to support react native autolink

autolink did not work with the previous podspec setup
https://github.com/react-native-community/cli/blob/master/docs/autolinking.md

Thoughts on getting this merged? 🤔

@FlorianBergmann @15matias15 any thoughts on getting this merged? I am running on the commit from my fork until this is merged. I'd like get back on the main repo.

@akread Thanks for the pull request and sorry for the late reply. I will merge it and then publish a new version when I am back in the office.
Should be either on the 2nd or 3rd of January.

@akread it should be published now. Sorry that it took so long, it slipped my mind.

No problem. Thank you for publishing.


depend on salva3d/parallel when parallel feature enables

This is needed to get parallel salva working in the examples.

Thanks!


The useAnchoredPosition hook returns generic refs for Element, which always requires a type assertion by the user

Description
The useAnchoredPosition hook will create refs if they are not passed in. However, when it does so, it creates a generic React.RefObject<Element> ref and returns that. Therefore, when it is used on any JSX node, it must be accompanied by a type assertion, e.g. <div ref={floatingElementRef as React.RefObject<HTMLDivElement>.
This can be fixed by doing 2 things:

Update the useAnchoredPosition hook to take optional type parameters, TAnchorElement and TFloatingElement. These type parameters get passed to useProvidedRefOrCreate in order to get back the correctly-typed ref object, and in turn, returned by the useAnchoredPosition hook.
Default the new type parameters to HTMLDivElement. div is likely the most common element type for the floating element, and possibly for anchor as well (the other possibility for anchor would be button).

This will allow consumers to use the refs returned by the hook without adding on a type assertion. See other codebase changes as an example.
It's possible this is a very minor breaking change: If a consumer is using a type assertion to fit a ref to an element other than a div, this change may break them. The downstream fix is to 1) remove the type assertion, and 2) pass the correct type param into useAnchoredPosition.
Steps to reproduce
function MyComponent() {
  const {anchorElementRef, floatingElementRef, position} = useAnchoredPosition();
  return (

        { /* the type assertions below should not be necessary */ }
        <div ref={anchorElementRef as React.RefObject<HTMLDivElement>}>The anchor

        <div ref={floatingElementRef as React.RefObject<HTMLDivElement>}>The floating element

  );
}

Version
latest
Browser
No response

The associated PR for this https://github.com/primer/react/pull/4448 got closed as stale, so closing this accordingly. Please feel free to comment back or reopen the issue if it would be helpful to bring back the change.


Use with BottomNavigationBar

Hi Thomas!
First off, thanks so much for this amazing library.  It works really well so far and I love the simplicity.
Quick question: is there a trick to using this with a BottomNavigationBar?  I tried instantiating a widget in an array of pages for hot-swapping as the body of my main page when the navigation bar selection changes, but I'm getting this error:
watchIt can only be called inside a build function
Thanks!

Figured it out :-)

What was the problem?
Thomas
Am 20. Juni 2023, 03:38 +0200 schrieb Danny Ackerman @.***>:

Closed #2 as completed.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>


Update sbt-mdoc to 2.2.20

Updates org.scalameta:sbt-mdoc from 2.2.16 to 2.2.20.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scalameta", artifactId = "sbt-mdoc" } ]

labels: sbt-plugin-update, semver-patch

Superseded by #271.


kubelet --version shows info log "proto: duplicate proto type registered: pluginregistration...."

Is this a BUG REPORT or FEATURE REQUEST? (choose one):

Kubernetes version (use kubectl version):
root@ubuntu18:~/test-infra/tests/k8s-conformance# kubelet --version
2018/11/15 08:15:21 proto: duplicate proto type registered: pluginregistration.PluginInfo
2018/11/15 08:15:21 proto: duplicate proto type registered: pluginregistration.RegistrationStatus
2018/11/15 08:15:21 proto: duplicate proto type registered: pluginregistration.RegistrationStatusResponse
2018/11/15 08:15:21 proto: duplicate proto type registered: pluginregistration.InfoRequest
Kubernetes v1.14.0-alpha.0.324+843a67b215dcfa
root@ubuntu18:~/test-infra/tests/k8s-conformance#

Environment:

Cloud provider or hardware configuration: KVM Guest

OS (e.g. from /etc/os-release):

root@ubuntu18:~/test-infra/tests/k8s-conformance# cat /etc/os-release
NAME="Ubuntu"
VERSION="18.04.1 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.1 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
root@ubuntu18:~/test-infra/tests/k8s-conformance#

Kernel (e.g. uname -a):

root@ubuntu18:~/test-infra/tests/k8s-conformance# uname -a
Linux ubuntu18.04-icp-node-4 4.15.0-36-generic #39-Ubuntu SMP Mon Sep 24 16:19:09 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
root@ubuntu18:~/test-infra/tests/k8s-conformance#

What happened:
kubeadm init --kubernetes-version ci-cross/latest is failing as the kubelet --version is unable to parse

++ /root/test-infra/tests/k8s-conformance/k8s-e2e/tmp/v1.14.0-alpha.0.324+843a67b215dcfa/kubeadm init --kubernetes-version ci-cross/latest
Running kubeadm init...
[init] Using Kubernetes version: v1.14.0-alpha.0.324+843a67b215dcfa
[preflight] Running pre-flight checks
	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 18.03.1-ce. Latest validated version: 18.06
	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase preflight: [preflight] Some fatal errors occurred:
	[ERROR Swap]: running with swap on is not supported. Please disable swap
	[ERROR KubeletVersion]: couldn't get kubelet version: Unable to parse output from Kubelet: "2018/11/15 08:06:25 proto: duplicate proto type registered: pluginregistration.PluginInfo\n2018/11/15 08:06:25 proto: duplicate proto type registered: pluginregistration.RegistrationStatus\n2018/11/15 08:06:25 proto: duplicate proto type registered: pluginregistration.RegistrationStatusResponse\n2018/11/15 08:06:25 proto: duplicate proto type registered: pluginregistration.InfoRequest\nKubernetes v1.14.0-alpha.0.324+843a67b215dcfa"

What you expected to happen:
kubelet --version should have given only
Kubernetes v1.14.0-alpha.0.324+843a67b215dcfa
How to reproduce it (as minimally and precisely as possible):
get the latest kubelet and run kubelet --version

- curl -sSL https://dl.k8s.io/ci-cross/v1.14.0-alpha.0.324+843a67b215dcfa/bin/linux/amd64/kubelet -o kubelet
- ./kubelet --version

/cc @vladimirvivien

@mkumatag you are suspecting https://github.com/kubernetes/kubernetes/pull/70559 to be causing the issue?

/cc @saad-ali @msau42

@mkumatag you are suspecting kubernetes/kubernetes#70559 to be causing the issue?

not sure but that is the recent change I see with respect to pluginregistration

/priority critical-urgent
/milestone v1.13
/cc @neolit123 @cjwagner

/cc @jberkus @mortent @mariantalla

/assign @RenaudWasTaken @vladimirvivien
To investigate

/sig node

Putting a fix together.  PR coming soon.

The fix for this just merged. Please let us know if this repros. @neolit123 as FYI.

This seems fixed in the kubeadm jobs post the merge https://k8s-testgrid.appspot.com/sig-release-master-blocking#kubeadm-gce-master

This should be closed.

/close


StopIteration Exception when iterating over a concept map

Description
I am printing all the instances of a type in Python. After a while Grakn hangs and it throws up an StopIteration Exception.
Environment

OS: Mac OS 10.14
Grakn version: Grakn Core 2.0.0-alpha
Grakn client-python version: client-python 2.0.0-alpha-4
Python version: 3.9

Reproducible Steps
Steps to create the smallest reproducible scenario:

Run this grakn distribution: https://www.dropbox.com/s/qtoy4igwsw5of3p/grakn-2.0-alpha-tomas-20210110.zip?dl=0
In a terminal run python, and run:

from grakn.client import GraknClient, SessionType, TransactionType
client = GraknClient("localhost:1729")
session = client.session("biograkn_covid_19", SessionType.DATA)
tx = session.transaction(TransactionType.READ)
answer_iterator = tx.query().match("match $x isa gene, has entrez-id $gs; get $gs;")
n = 0
for answer in answer_iterator:
	print(answer.get("gs"))
	n = n + 1

After a while Grakn while will throw this error:

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grakn/rpc/transaction.py", line 136, in _fetch
    response = next(self._response_iterator)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grpc/_channel.py", line 416, in __next__
    return self._next()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grpc/_channel.py", line 801, in _next
    raise StopIteration()
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grakn/rpc/stream.py", line 57, in __next__
    return next(self)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grakn/rpc/stream.py", line 50, in __next__
    res = self._transaction._fetch(self._request_id)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grakn/rpc/transaction.py", line 145, in _fetch
    raise GraknClientException("The transaction has been closed and no further operation is allowed.")
grakn.common.exception.GraknClientException: The transaction has been closed and no further operation is allowed.

The CPU keeps spinning on 100%
I am unable to stop Grakn using control + c and Java throws an OutOfMemoryError (see screenshot below)
I end up killing Grakn with kill -9

Expected Output
I expect to have as an output all the instances of this given type printed in the console.
Actual Output
A StopIteration and a Java OutOfMemory Exception.
Additional information

I could reproduce them in Console too. Given that it happens in both Console and Client Python, it might be a server-side bug.

I could reproduce them in Console too. Given that it happens in both Console and Client Python, it might be a server-side bug.


RadzenDataGrid PageSize and bindSettings not working together

Describe the bug
When setting the PageSize (X) to the RadzenDataGrid and also using bind-Settings, changing the page size in the user interface will eventually lead to the PageSize being reinitialized with the Value X which has been defined.
To Reproduce
Steps to reproduce the behavior:

Open https://blazor.radzen.com/datagrid-pager-api
Set PageSize = 20 in the RadzenDataGrid
Create a DataGridSettings? TheSettings {get; set;} property in the component code
Set @bind-Value=TheSettings in the RadzenDataGrid
Run
-> In the UX, switch from PageSize 20 to 30 -> then switch from PageSize 30 to 10.
-> You will notice that it keeps resetting to PageSize 20 which has been set in the xaml code

Expected behavior
Page Size should be changeable even bind-Settings is used
Desktop (please complete the following information):

OS: Windows
Browser: Chrome
Version: I'd assume its the most recent in https://blazor.radzen.com/datagrid-pager-api

Additional Information:
Not sure if it is related, it's annoying for sure.
After switching from 4.13.X to 4.17.1, creating an instance of a custom RadzenDataGrid fails if it tries to set a PageSize in its constructor due to the PageSize setter using the renderHandler which is not attached during construction.

Just noticed it can easier be reproduced by adding the pagesizeoptions and showpaging summary to this example https://blazor.radzen.com/datagrid-save-settings-loaddata

Hey @andreasmuellergin,
When binding PageSizeOption you should also set PageSize to a variable since otherwise every StateHasChanged() will reset the page size value to what is hardcoded in the razor declaration.


Added RepeatN

Added an option that will benefit they gameplay in some servers. RepeatN spams the macro every "delay" time while holding, and keeps spaming it N times after releasing.

This looks good, thanks!
Before I go ahead and merge this and get this released I'd like to rework the raw config file saving and the config menu in mod menu. I'd like them to be more unique to each macro type. Now with the addition of this macro we have another value alongside delay that is not used by all macro types. I'd like to only have them shown when applicable.
Also I think the name repeatN isn't exactly self explanatory to what the macro, got any other ideas?

Maybe RepeatAfterRelease, since it spams while holding, and N times after

I did merge this and get it implemented into the 1.19 branch if you'd like to check it out. I modified the config so It now only shows the options if they are applicable to that config type
Just to clarify how this works, this macro should be executed n number of times regardless if you are holding the key or not?

1.6.0-1.19 was released with the RunNTimes macro type.


Fix: Type declaration for blendMode

Please do not update the README or Change Log, we will do this when we merge your PR.
This PR (delete as applicable)

Fixes a bug

Describe the changes below:
BlendMode can be either a string or an enum

👍


RDA/RDF data results in TWO values for a BF prop; should (?) be ONE

Floating URI inside provision activity
The formatting for provisionActivity looks pretty good, but it seems like the URI for the agent should be inside the bnode for that Agent:
bf:provisionActivity [ a bf:Publication ;
            bf:agent [ a bf:Agent ;
                    rdfs:label "Albert Whitman & Company, Publishers"@en  ],
                <http://id.loc.gov/rwo/agents/n78059801> ; # 'floating URI' here, makes TWO VALUES for bf:agent
            bf:date "1929" ;
            bf:place [ a bf:Place ;
                    rdfs:label "Chicago"@en ] ] ;

Or, if it's just a coincidence that the label and URI for the publisher here are for the same entity, I think we need two separate [a bf:Agent]

I don't think we can say whether this is an RML error or an error in our source data with looking at the source as well. To confirm, we are talking about:

rml/input/2020_09_18/manifestation/2364b9e2-5c7b-4bb6-81f1-219a045ad614.xml

30176/has name of publisher on L14
IRI for Albert Whitman & Company on L31, as value of has publisher agent

rml/output/2020_09_18/instance/2364b9e2-5c7b-4bb6-81f1-219a045ad614.ttl

See L23 - L29

If yes...
It's an interesting example. We give an IRI value for has publisher agent, but then we provide a literal value for has name of publisher.
The output data is incorrect--converted BF is in effect saying that there are two publisher agents. But given the values in the source data, it sort of makes sense that it is doing so.
(Because our conversion scheme will take the value for has publisher agent and output it as a value for provisionActivity >> Publication > agent*. It will also take the value for has name of publisher and create a bnode value for that same (it appears) provisionActivity >> Publication > agent, and then provide the literal value as an rdfs:label on this bnode.)
This might be the kind of thing that is best solved with guidance for catalogers. For example, if you are providing an IRI value for publisher, you need not make any other statements about the publisher on the manifestation.

Another example

Input here and here, with values for both name of publisher (the literal) and publisher agent (the IRI)

[...]
    rdam:P30176 "Little Brown and Company"@eng ;
    rdam:P30083 <http://id.loc.gov/rwo/agents/n80020835> ;
    [...]

Output here, resulting in two Agents when there should be one

[...]
    bf:provisionActivity [ a bf:Publication ;
        bf:agent [ a bf:Agent ;
            rdfs:label "Little Brown and Company"@en ],
        <http://id.loc.gov/rwo/agents/n80020835> ;
[...]

Is it really incorrect? If I said
http://commentAbove ex:creator [ a ex:Human ; rdfs:label "Ben R" ], http://IRI4Ben.edu .
...what's wrong with that? It's 2 assertions, both correct.
So what's the problem?
CEC says it should be inside the bnode; would that be better as the property of, what, rdf:value? Or is it better as it is, the value of bf:agent?
ries07 says it claims there are two publisher agents -- but is that true? Isn't it the case that there are two assertions about the publisher and that they agree about the identity of the publisher?
I am claiming that this is ok as is. Discuss further?

Most interesting @gerontakos !
...thinking...
But if we have the following values for ex:creator in your example...

An unnamed resource with statements

rdf:type ex:Human
rdfs:label "Ben R"

http://IRI4Ben.edu

...doesn't this leave us with some ambiguity about whether these are really the same resource, or different? Regardless of how well the description of the resource at http://IRI4Ben.edu seems to match with the statements on our unnamed resource??

Isn't it the case that there are two assertions about the publisher and that they agree about the identity of the publisher?

Looking at both this example and the original example above, I don't think we can say that these statements agree.

Ambiguity is the problem I see; the statements don't need to agree I suppose, but I believe we want them to be something like "true" or "accurate." I would say both statements are "true" and "accurate." A better solution is almost always possible; how would you like to see this improved? Above you suggest you would like to approach it by changing catalogers' practice. Crystal wants to see the IRI inside the bnode. Is there a BabyRuth-level way to accommodate this data?

Before moving on to a solution (which we certainly should do) I just want to give one more thought about why the two Agent values seem wonky to me...
It's because there are two of them!
I don't think that the cataloger's intent (returning to the original example at the top of this issue, with source RDA/RDF clarified here) in entering values for both "has publisher agent" and "has name of publisher" was to say that there are two publishers.
So, then, shouldn't there be only one value for bf:agent in the output??

My point on this property is that it's not a big deal and doesn't need to be repaired. It is a bit wonky, and if anyone thinks of a good solution, let's use it. However I think what exists is a pretty good solution. (1) just because you make two assertions using the bf:agent relation doesn't mean there are two agents, it only "means" there are two assertions that use the bf:agent relation. (2) If the data is queried, the "publisher agent" will be much more visible to data consumers if it's the direct value of bf:agent and not buried in a bnode as the value of rdf:value. (3) In the RDA-RDF two assertions exist; although those assertions are distinguished from each other because they use different predicates, this is the way those separate assertions map into BF; it is another case of a many-to-one rdaRelations-to-bibframeRelations situation, demonstrating the inability of BF to accurately accommodate RDA data. Contrary to this, you might ask, how would a cataloger describe this as original BF; I think that's where we would find trouble because this isn't the way it will be done in original BF data. In original BF data we don't need both representations of the same agent -- just to mention one thing. And also Ben is right, original BF wouldn't be so wonky.

This is an interesting problem: should we tirelessly pursue lossless RDA-to-BF? That's been my approach, for two reasons. On the level near theory, I don't want to lose any data; on the practical level, I want to simplify the mapping to help simplify the transformation code.
We could say, let's get lossy -- in the interest of creating BF that looks like bona fide genuine BF. Why not!? Well, because then we'd have to start writing a bunch of conditions in the transformation code: "if there's a rdam:publisherAgent property, use the value of that P; otherwise use the value of rdam:nameOfPublisher and pump it into a bnode." Or, if both Ps exist and we don't want to get lossy, make sure the BF p-v's get combined into the description of a common bnode. You can see the ordeal that creates.
I also advocate for the "wonky" because, I admit it, my derivative BF data is a second class citizen."BFers," I say, "you're lucky we're even providing this." It's arrogant, but deriving bona fide genuine BF from RDA is, among other things, expensive. But if we were really serious about doing this, we'd write the conditions, no? And, therefore, produce Ben's sensible BF. Looking at it from that point of view, Ben and Crystal are serious about this stuff, and Theo is saying, "Lighten up, comrades, this isn't really serious ... yet." But the BF I'm advocating for is a lower quality BF. We could do better.

I agree @gerontakos --it is an interesting problem! And I don't think that there is a right or a wrong at this point in the process. I just think that it is a good and an enriching conversation.
And you make some very good points about the tortuous kinds of conditions we'd need (to ask @mcm104 to put) in our code to get 'sensible' BF output from RDA/RDF input...

I think we've moved on from this issue and since I'm the one who opened it I'm going to close it now. Please reopen if you want to keep talking about it!


Terminal text disappearing on macOS under VMware.

Does this issue occur when all extensions are disabled?: Yes/No
Yes!

VS Code Version: 1.64.1
OS Version: Darwin x64 21.3
VMware 16 Pro v16.2.1 (linux host), vmware-tools Darwin v15+

Steps to Reproduce:

Open vscode
Open a Terminal

The terminal text is either black on black or white on white depending on the theme. Occasionally it flashes to something you can read. But it will not stay that way...
I suspect it has to do with Electron and the VMware drivers. But I have no idea how to debug...

This might have to do with an extension you have installed. Can you try running the extension bisect command?


Update tutorial-net-create-vault-azure-web-app.md

@jlichwa : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Unexpected result when combining POST with gzip encoding.

When using splash as a proxy, and making a POST request with gzip encoding header, it seems the content does not get decoded before taking the screenshot. This does not happen when the method is GET or the encoding is deflate. The render method html is affected too.
For example:

POST request with deflate encoding
curl -x localhost:8051 -X POST -H 'Accept-Encoding: deflate'  -H 'X-Splash-render: png' -H 'X-Splash-wait: 1' http://www.facebook.com

POST request with gzip encoding
curl -x localhost:8051 -X POST -H 'Accept-Encoding: gzip'  -H 'X-Splash-render: png' -H 'X-Splash-wait: 1' http://www.facebook.com

sorry to reply this closed issue, but I have the same problem in Splash 2.1

@laoyur is there a way to reproduce it?


Azure Mgmt DNS does not handle throttling gracefully

https://github.com/Azure/azure-sdk-for-python/blob/e4e8351eb9523bff0e6c4597478d04b9ceb9c14c/sdk/network/azure-mgmt-dns/azure/mgmt/dns/v2018_05_01/operations/_record_sets_operations.py#L1095C1-L1110C49
I believe the client should handle throttling by respecting the Retry-After header, it seems that this section of the code does not, there is no way to prevent this from raising an exception when being throttled, even the RetryPolicy settings don't seem to be respected.
Is there something we can do here?

We do have a lot of records in a single zone. From what I can gather here

60 Requests per minute
I can't find it officially, but I think 1000 records per page
=> 60000 records in any 1 minute (we have more that this)

We tried to implement a long backoff in a RetryPolicy, but this has no effect, I believe the codepath circumvents that

Thanks for the feedback, we’ll investigate asap.

Python SDK already has default retry policy. For further investigation, could you follow https://github.com/Azure/azure-sdk-for-python/wiki/Common-issues-about-Python-SDK#debug-guide to share the detailed logs?

Hi,
I am already using the RetryPolicy, and I don't believe it is taking effect. I suspect the code in the SDK is actually circumventing the RetryPolicy because it is accessing self._client._pipeline
For reference I am using the following RetryPolicy configuration:
    client_retry_policy:
      total_retries: 6
      # backoff_value = 2**(retry_number - 1) * backoff_factor => 20, 40, 80, 160, 320, 640
      backoff_factor: 20
      # min(backoff_max, backoff_value) => E.g min(640, 320) = 320 when retry_number = 5
      backoff_max: 640

@xiangyan99 @msyyc
So I did some further debugging finally I subclassed the RetryPolilcy so I could check that it was working, not all of these overrides are necessary, however I will just past the exact code I used.
class MyRetry(RetryPolicy):
    def is_retry(self, settings, response):
        """Checks if method/status code is retryable.

        Based on whitelists and control variables such as the number of
        total retries to allow, whether to respect the Retry-After header,
        whether this header is present, and whether the returned status
        code is on the list of status codes to be retried upon on the
        presence of the aforementioned header.

        The behavior is:
        -	If status_code < 400: don't retry
        -	Else if Retry-After present: retry
        -	Else: retry based on the safe status code list ([408, 429, 500, 502, 503, 504])

        :param dict settings: The retry settings.
        :param response: The PipelineResponse object
        :type response: ~azure.core.pipeline.PipelineResponse
        :return: True if method/status code is retryable. False if not retryable.
        :rtype: bool
        """
        if response.http_response.status_code < 400:
            return False
        has_retry_after = bool(response.http_response.headers.get("Retry-After"))
        logging.info("has_retry_after: %s", has_retry_after)
        if has_retry_after and self._respect_retry_after_header:
            logging.info("Respecting Retry-After header")
            return True
        if not self._is_method_retryable(
            settings, response.http_request, response=response.http_response
        ):
            logging.info("Method not retryable")
            return False

        is_retryable = (
            settings["total"]
            and response.http_response.status_code in self._retry_on_status_codes
        )

        logging.info("is_retryable: %s", is_retryable)

        return is_retryable

    def sleep(self, settings, transport, response=None):
        """Sleep between retry attempts.

        This method will respect a server's ``Retry-After`` response header
        and sleep the duration of the time requested. If that is not present, it
        will use an exponential backoff. By default, the backoff factor is 0 and
        this method will return immediately.

        :param dict settings: The retry settings.
        :param transport: The HTTP transport type.
        :param response: The PipelineResponse object.
        :type response: ~azure.core.pipeline.PipelineResponse
        """
        if response:
            slept = self._sleep_for_retry(response, transport)
            if slept:
                logging.error(
                    "Used Retry-After header when _respect_retry_after_header is: %s",
                    self._respect_retry_after_header,
                )
                return
        self._sleep_backoff(settings, transport)

    def _sleep_backoff(self, settings, transport):
        """Sleep using exponential backoff. Immediately returns if backoff is 0.

        :param dict settings: The retry settings.
        :param transport: The HTTP transport type.
        """
        backoff = self.get_backoff_time(settings)
        logging.info("backoff: %s", backoff)
        if backoff <= 0:
            return
        transport.sleep(backoff)

The important part of the above is that the sleep method on the policy ALWAYS uses the Retry-After header if it is present. Meaning that regardless of anything else set on the policy, if the API returns a Retry-After then it doesn't matter what you do.
I even set the _respect_retry_after_header attribute to False, it is however also not used in the sleep code path.
This API also always as far as I can tell returns Retry-After: 10
So in my opinion at least, the bug is here:
        if response:
            slept = self._sleep_for_retry(response, transport)
            if slept:
                logging.error(
                    "Used Retry-After header when _respect_retry_after_header is: %s",
                    self._respect_retry_after_header,
                )
                return
        self._sleep_backoff(settings, transport)

And maybe the solution is to sleep for the max(retry_after, backoff) or something like this etc.

Just some more thoughts:
I guess you could argue that always respecting the Retry-After header is the sensible thing to do, but in this case the API endpoint seems to be just setting it to an arbitrary value, which after a few retries, causes the throttling exception to bubble up.
If the API set either, a higher value or, the real time to wait, then that would be fine.

I hope you could share the log of interaction between client and service server by following https://github.com/Azure/azure-sdk-for-python/issues/37002#issuecomment-2309162801. Maybe service doesn't follow retry policy guideline.


Skills config window

how i open the Skills config window? cant find a button

or Ctrl+K shortcut.

ty


Failure to import Bruker TDF timsTof data with mzMine 3.0.11-beta under MacOS 10.14.6

Basic information

My operating system: macOS Mojave 10.14.6
My MZmine version: MzMine 3.0.11-beta

What happened

Raw data import -> Bruker TDF
Selected a .d folder containing data of the Bruker TimsTof Pro, meassured with TIMS on / PASEF mode
2 error messages appeared:
"Failed to open the file /path_to_file/filename.tdf_bin using the Bruker TDF library"
"MacOS is not supported by Bruker Daltonics. Please contact Bruker Daltonics."
mzmine_0_0.log

Hi raimofranke,
as stated in the error message, Bruker does not support mac os with their library. A library compiled for mac is simply not available.
Best regards
Steffen

Hi Steffen,
thanks for the quick reply. Does Bruker support Linux with their library? Or are we still forced to work on Windows machines? That would be too bad. Do you think there is hope for the future regarding support for Mac OS and/or Linux from Bruker?
Thanks and best regards,
Raimo

Yes, Linux is supported.
I don't know if Bruker plans to support macOs, though.


[Bug] Prev/Next Links break on pages with exoctic characters

On a page with a "Æ, Ø or Å" in the URL

Without:

Also spaces

works fine on the latest beta 2


services/ticker: add nested issuer_detail field on assets.json

This PR closes #1541
It aims to add a nested issuer_detail field for each asset on the /assets.json endpoint.
Note: I've opted to add a separate "issuer_detail" field instead of simply using issuer to ensure backwards compatibility, since an "issuer" field was already being used to provide the issuer's public key.

That makes sense!  It definitely isn't too hard, but I'll also probably need to update the scraper to make sure we're fetching / storing those fields in the first place.
Since this involves several changes on the code, I've followed your suggestion and created #1553.


How to inference

How to inference？？ the inference code  you provide is PoseTriplet， i don‘t know how use to our model

Hi, please refer to issue https://github.com/jfzhang95/PoseAug/issues/43.

how to adapt the model file？？

you need to replace the model network file and rename key when save or load model so that they are match.


How to handle errors?

It seems my bot crashes every time I get an error, and I have no idea how to handle errors as it is not listed ANYWHERE in the documentation. pls help

function callback(err, data) {
  if(err) {
      // Handle the error here
      return;
  }
  // Do whatever you wish with the data here
}

thank you luke


Making the repo as a github template project

It's been a while that Github is offering an option to make an existing repository as a template project:
https://docs.github.com/en/free-pro-team@latest/github/creating-cloning-and-archiving-repositories/creating-a-repository-from-a-template
I think that's not a bad idea to enable this option for this repository, I've briefly listed the benefits that it offers:

Start with no history and no reference to this repository.
It's possible to run a Template cleanup workflow to override template-specific configurations, such as the sbt details. You can look at this example Tempate-cleanup
You can choose to include the directory structure and files from only the default/master branch

There are more details here:
https://docs.github.com/en/free-pro-team@latest/github/creating-cloning-and-archiving-repositories/creating-a-repository-from-a-template
Github workflows:
https://docs.github.com/en/free-pro-team@latest/actions/reference/workflow-syntax-for-github-actions

This is a good idea, thanks for all of this information!

Done, see https://github.com/freechipsproject/chisel-template/tree/main which is the new default branch.

Thank you very much @amsharifian for the ideas, this is what we did!


Wrong envPrefix in Astro Integration

Hi, thank you very much for this library.
I'm using the Astro Integration and I discovered that all my PUBLIC_* variables are been ignored after build in my custom service worker.
I tested with the following variables:
PUBLIC_SAMPLE=ASTRO
VITE_SAMPLE=VITE

I saw that the VITE_SAMPLE variable is included but not PUBLIC_SAMPLE.
The default value of envPrefix in Vite is VITE_ but in Astro the prefix is PUBLIC_ for client scripts.
Is there a way to change that?

Only variables starting with VITE_ will be exposed by vite https://vitejs.dev/guide/env-and-mode.html#env-variables-and-modes

That prefix is customized with the envPrefix option.
https://vitejs.dev/config/shared-options.html#envprefix

Yeah, you can change it, but only those env vars starting with the prefix will be available via import.meta.env.

You can configure empty prefix

Read the SECURITY NOTES from you VITE_ link, you can also use define.

Yeah, you can change it, but only those env vars starting with the prefix will be available via import.meta.env.

Yes, that's what I want. I want to make VitePWA to use the same prefix as Astro: PUBLIC_. Because that's the default prefix for client variables in Astro projects.

Oops. Sorry, I thought this was a monorepo. Sorry. I will move this issue to the correct repository.


Admin cookie authentication

NOTE: This is a work in progress. Do not merge yet.
This PR implements cookie-based login/logout and sessions in Aardvark.
TODO

[x] Implement baseline login/logout logic using Foxx sessions with cookies.
[x] Refactor frontend logic to only make the initial API requests when authenticated.
[x] Prettier login form. (@hkernbach?)
[x] Don't apply disableAuthentication to aardvark (C++?)
[x] Implement session cookie auth (with arango-sid-$dbName) in API (C++).
[x] Expose disableAuthentication status to JS (C++).
[x] If disableAuthentication is active, whoAmI should return false as user.
[x] Make _api/collection behave correctly when using cookie auth (@fceller)

Pinging @fceller @mchacki
My work here is done, I think.

+1
Please consider different username/passwords for different databases and an easy way to switch. In the current implementation, browser caches the Basic Auth and some databases are just hidden. To complicate things even more, some Foxx apps might have different credentials, so web "Try me!" should still work.

@razvanphp with this PR you'll be able to logout and switch to any databases available to the same user. I guess user switching would be a nice feature, but this'll at least make it easier.
Once the C++ logic is implemented, this could land in the next release.

This would fix #1262.

We still get the Basic Auth password popup sometimes, with the name "db/_system". Even if I put the correct password, he then redirects me to the new login page. Is this intended? Bug?

Interesting. Can you isolate reproducible steps? I'm guessing it's caused by the logged-in web admin's polling, which hits the API, which will still fall back to Basic Auth if the cookie has been cleared or is expired. There's no obvious solution to fix that AFAICT.

Yes, I think it happens when the session expires, I just get it now all the time when I refresh and not login into the new form. I still have the cookies at this time, but even if I delete them, it behaves the same.
The requests that seem to triggers this:
http://server:8529/_db/_system/_api/collection?_=1434385045202 -> 401 Unauthorized
here I get the basic auth popup (I can get rid of it only if I click cancel)... and then another request appears:
http://server:8529/_db/_system/_admin/aardvark/whoAmI?_=1434385271417
That responds 200 with body {"user":null}

@razvanphp Can you clarify: you're getting the basic auth popup when you refresh and it happens before the login form is shown? That would be a bug in the frontend (a regression, in fact).
OTOH it's expected behaviour that you don't get a cookie if you log in via basic auth. The cookie-based login is controlled by the admin frontend, the basic auth login by the API. Setting a cookie after basic auth would affect the entire API (which otherwise aims to be stateless). You shouldn't see basic auth dialogs in the frontend, however, unless you make API requests after the session expires. There doesn't seem to be a way to intercept 401 popups generated from AJAX requests, but that's a browser issue.

Yes, it happens BEFORE the login form is shown. In fact, it does not appeat until I close the basic auth popup.
As I said, it's the collections API call that is causing this, maybe it's triggered too soon, before the whoAmI call.

Yes, that's not supposed to happen. I'm investigating what caused the regression and how we can avoid it.

Okay, I've tracked it down to this commit: 5cf30c71a59a52965f322fe16054324bd333d2fb
Seems like the client.js in aardvark is a generated file. I'll see whether changing the original source impacts arangosh. Otherwise this should be trivial to fix.

@razvanphp I've fixed it in devel. The logic now behaves correctly in both the browser (lazy init) and arangosh (eager init).


create NLU image should show 'Create' box

Please take a new screenshot of the window where you create the NLU image. It should show the screen where you are about to create the service, and include the Create button.
Replace this:
https://github.com/IBM/watson-document-classifier/raw/master/doc/source/images/bluemix_service_nlu.png
with something similar to this:

Changed the image to include "Create" button

Fixed in 99f9e44bd770a0fbfab0c5d04e594d456fcd0048


hover and select of path just assigned to the last components u call

import Iran from "@react-map/iran";
export default function Map() {
return (
/<Iranmap Color='white' hoverColor='#0E8B09' type='select-single' strokeColor='#666666' //>
);
}
index.js
import Map from ./map
export default function Index () {
[1, 2].map(() => {
return /<Map //>
})
}

Hey, can you please explain the issue in brief what are you facing?

Closing this as no response. You may open this issue if you need assistance


added logo for MSU

For: https://github.com/CDL-Dryad/dryad-product-roadmap/issues/285
Added logo for Montana State University (MSU)

tests failing due to not including the fixes in my other PR. Will rebase ooff master once that PR has been merged

some odd Travis errors on the PR test. All this does is add a logo. Just pushed a corresponding montana-state branch to stash repo to see if maybe its just using the wrong codebase


Unable to Pass Personal Key and OpenBazaar ID generation

Brief Description:
After using the current OS X client, I'm able to get through the first few pieces of the setup, but once we get to this point it seems to hang.
I'm using Little Snitch (outbound firewall app) and I have it in listen only mode, so it's not blocking anything that OpenBazaar is doing, but I'm able to see that it's having regular bursts of traffic to libbitcoin1.openbazaar.org and dozens of bare IP addresses and has done about 3.5MB of traffic down and 2.4MB up after about a half hour. So, it's doing something, but I can't tell you what.
Operating System (OS and version): 10.12.1
OpenBazaar version (shown on About OpenBazaar page in menu): 1.1.10
Hardware: Recent iMac
Reproducible (Always / Almost Always / Sometimes / Rarely / Couldn't Reproduce):
Always

After an hour, quit the program, started it again, skipped through the setup, and looks like we're in business. Go figure.


Suggestion: Type variables in function signature

Search Terms
type variable variables param parameter parameters
Suggestion
Add type variables in function signatures.

Such type variables would not be visible nor controllable by the caller of the function (sort of like private type parameters).
Use Cases

Currently (v.3.5.1) all the type parameters in the function signatures are visible by the user of this function (the one who calls it). In the following example, we have the unnecessary ability to provide typing for the second type parameter Key of the function getEntries:
interface GetEntries {
    <Obj extends object, Key extends keyof Obj = keyof Obj>(object: Obj): Array<[ Key, Obj[Key] ]>;
    // the Key type is really for private usage
    // also notice the repetitiveness of its definition
}

const getEntries: GetEntries = (object) => Object.entries(object);

interface Person {
    name: string;
    age: number;
}

declare const person: Person;

const entries1 = getEntries<Person>(person);
const entries2 = getEntries<Person, "age">(person);

entries1;
// type of entries1 is fine

entries2;
// type of entries2 is not fine,
// since the first item of each touple is not "age" , but "name" | "age"
// also, this is an unintended usage of the second type parameter

The suggested functionality is achievable though in the current version of TypeScript, but it is highly repetitive - notice the usage of keyof Obj type in the following example:
interface GetEntries {
    <Obj extends object>(object: Obj): Array<[ keyof Obj, Obj[keyof Obj] ]>;
}

Examples
The proposed functionality might introduce where .. is .. syntactical construct, more fully described as this:
{return expression} where {identifier} is {type expression} [ , {identifier} is {type expression} ]*

interface GetEntries {
    <Obj extends object>(object: Obj): Array<[ Key, Obj[Key] ]> where Key is keyof Obj;
}

interface GetEntries {
    <Obj extends object>(object: Obj): Array<[ Key, Value ]> where Key is keyof Obj, Value is Obj[Key];
}

Checklist
My suggestion meets these guidelines:

[x] This wouldn't be a breaking change in existing TypeScript/JavaScript code

[x] This wouldn't change the runtime behavior of existing JavaScript code

[x] This could be implemented without emitting different JS based on the types of the expressions

[x] This isn't a runtime feature (e.g. library functionality, non-ECMAScript syntax with JavaScript output, etc.)

[x] This feature would agree with the rest of TypeScript's Design Goals.

This is really the intended design of type parameters - they are parametric. Any time you're trying to use a defaulted type parameter to introduce a new name, something has gone wrong.
For example, you could have written
    <Obj extends object>(object: Obj): Array<[keyof Obj, Obj[keyof Obj] ]>;

to get the desired effect without introducing a second type parameter.
It's important that callers be able to specify type parameters at all times so that they can resolve potential ambiguities

I might have been unclear in my phrasing, forgive me.
Type parameters are fine, but their purpose is to parametrize function, not introduce variables. You've pointed me to that in the comment with an example, but I've also included this exact example in the original post.
The core of the suggestion is described in the Examples section.

Usually for a suggestion we need to start with something that can't be done, or can't be done with adequate fidelity. This doesn't really meet the bar for that.
You might also be interested in local type aliases, #23188

That really looks a lot like what I'm suggesting, thanks


How can I use LVM volume storage for my private CloudStack

How can I use LVM volume storage for my private CloudStack.
Please see my image below
Also please give me any mail address so I have some query for my private server.
many time I got below details for collect mail address, but I am not find out which exact mail address.

Thanks.

there is the users list for these questions. hope that helps.

Closing as this is a not a bug report but question that must be asked on the users ML. Thanks.


[feature] Differentiate between safe and unsafe fixes

This task tracks the work implementing safe and unsafe fixes as described in #1997.
Safe fixes are fixes that don't change the semantics of the program. Unsafe fixes may change the program's semantics; therefore, we advise users to manually review and test the changes.
Tasks

[x] #4182
[x] #4183
[x] #4340
[ ] #4276
[ ] #4184
[ ] #4185
[ ] #4186
[ ] #4187

@MichaReiser You can assign this to me, I'd like to take it to completion!

@MichaReiser You can assign this to me, I'd like to take it to completion if it's open!

Hey @evanrittenhouse. Do you plan to work on all of it or individual sub-tasks?

@zanieb should we close this issue? I'm okay deferring the add "message to fix" for now as it also is somewhat unrelated to the applicability work.


Adding data to match body

Hi
Is there a way to add a configuration option within a rule which can then be added to the match body so it can be used in a Enhancement?
I need to add a field which can be used to determine a value in my Enhancement for my rule.
Any ideas?
Thanks

Enhancements have access to the rule's entire configuration, you don't need to route it through match_body.  https://github.com/Yelp/elastalert/blob/master/elastalert/enhancements.py#L10
class MyEnhancement(BaseEnhancement):
    def process(self, match):
        something = self.rule['some_enhancement_setting']
         ....


@conda-forge-admin, please re-render

@conda-forge-admin, please re-render.

Hi! This is the friendly automated conda-forge-webservice.
I just wanted to let you know that I rerendered the recipe in conda-forge/chrpath-feedstock#2.


add one line diff bar

Codecov Report

Merging #15 (23b8103) into main (ca17533) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main       #15   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            2         3    +1
  Lines          169       194   +25
=========================================
+ Hits           169       194   +25

Impacted Files
Coverage Δ

chunkdup/chunkdiff.py
100.00% <100.00%> (ø)

chunkdup/chunkdup.py
100.00% <100.00%> (ø)

chunkdup/index.py
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Not possible to modify ParseTree

Hi,
I would like to modify the ParseTree leaves but I can't... I can't add an attribute to a leaf or change its value to a dictionnary. How could I do?

stanza now has a python constituency parser which is more accurate and would allow for rearranging the parse trees.  You can also use stanza's corenlp client to get a tree object and manipulate that if you like.


sitemap.xml.gz needs to be split for Google

The sitemap.xml.gz file can only contain 50000 items and be a maximum of 50k. For sites with a lot of content, the current xml is rejected by Google.
Sitemap size limits: All formats limit a single sitemap to 50MB (uncompressed) or 50,000 URLs. If you have a larger file or more URLs, you must break your sitemap into multiple sitemaps. You can optionally create a [sitemap index](https://developers.google.com/search/docs/crawling-indexing/sitemaps/large-sitemaps) file and submit that single index file to Google.

Reference: https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap#:~:text=Sitemap size limits%3A All formats,your sitemap into multiple sitemaps.

I'm working on this, PR in progress until we test it on another site.

Maybe this is interesting for you: https://github.com/collective/collective.splitsitemap

@reebalazs did we implement this feature in Volto core? I have an issue with plone.de where we the sitemap-index.xml is outdated and the sitemap.xml.gz is more recent. Both versions are around and that highly confuses Google.


tabby: init at 0.6.0

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 272948 run on x86_64-linux 1

1 package built:

tabby

Seems to work for me however it shows New version (v0.6.0) available

Good point. I'll try to fix that by getting the builder to know its own version. Thanks for the review. I'll adjust for the other things as well.
Also noting that this build doesn't even attempt to use cuda... It would be handy to reuse the stuff from llama-cpp package but it looks hard to get that wired into the tappy build. I'll leave that for future work.

there is a new 0.7.0 version, if you have time to make the changes, I would be happy to help get this merged.


TypeError when using scrollToAlignment or scrollDirection

So I'm doing a minimal setup of the VirtualList.
When I try to use the scrollToAlignment , like let scrollToAlignment  = 'center';
And subsequently use it in the VirtualList as a property, I get the following error.

Should be fixed by #7


building error with fish and bumblebee

copying path '/nix/store/j760dlcln1vdqxcgbh38sgxl1lm3kswv-source' from 'https://cache.nixos.org'...
building '/nix/store/y2qc432vmn9spfgd24d3p9jg9xa9hinq-hugin-2018.0.0.drv'...
building '/nix/store/fh0bxmkj7vsbb5wmmiyv3s15ywajvdvp-options-db.xml.drv'...
building '/nix/store/p89bkk0p8hgwg6xfrw4x3pbf2nmw3la2-primus-lib-2015-04-28.drv'...
while setting up the build environment: executing '/nix/store/vqq275dnd5lbjfdxffa8864w4mxrinx2-bash-4.4-p23/bin/bash': Exec format error
building '/nix/store/gcg4iiga6812j4cw0vbgvi6nqqc4y35k-pycharm-professional-2018.3.4.drv'...
building '/nix/store/z6a03l628m4gpfbcxp5w06df2p31d9n6-reload-container.drv'...
building '/nix/store/ix2hcsdlcjqrab17m49897vlfgds4dd7-ssh-askpass-wrapper.drv'...
builder for '/nix/store/p89bkk0p8hgwg6xfrw4x3pbf2nmw3la2-primus-lib-2015-04-28.drv' failed with exit code 1
cannot build derivation '/nix/store/091r4kz6gaph6y2wj00jsfaxcmha0hhr-primusrun.drv': 1 dependencies couldn't be built
building '/nix/store/ikqhdcj98fyz24xbx76dpp9inckhr3ig-strace-5.0_fish-completions.drv'...
building '/nix/store/1ijvfhp470dnf3y793a3kdg19yd87ggk-sudo-1.8.27_fish-completions.drv'...
cannot build derivation '/nix/store/qidbrmjr5090qmnbhy260f12cv586d91-primusrun_fish-completions.drv': 1 dependencies couldn't be built

Provide the command you used, and the output of nix-info -m, as the issue template says. I can't reproduce this like that.

system info is here

system: "x86_64-linux"
host os: Linux 5.0.2-hardened, NixOS, 19.09pre173147.03050e9749e (Loris)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.2
channels(root): "nixos-19.09pre173574.69d0c1404c1, nixos_src-19.09pre172515.eb2a26f5c61"
channels(schrodinger): "nixos-19.09pre172943.da1a2b1eeaf, nixos_src-19.09pre173059.ff43f0a7b51"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

I got into this problem when running nix-rebuild boot --upgrade

Then we need your configuration.nix, or at least the relevant parts.

{ config, pkgs, ... }:

{
  imports = [ ./hardware-configuration.nix ];
#  systemd.services.nix-daemon.environment = {
#    https_proxy = "socks5://<IP_ADDRESS>:1080";
#  };
#  unstable = import <unstable> {
#        config = {
#            allowUnfree = true;
#            allowUnsupportedSystem = true;
#            allowBroken = true;
#        };
#  };

  ### Services

  services.fstrim = {
    enable = true;
    interval = "tuesday";
  };

  nix.gc = {
    automatic = true;
    dates = "thursday";
    options = "--delete-older-than 8d";
  };

  powerManagement.powertop.enable = true;

  services.printing.enable = true;

  # Don't start a getty behind my graphical login
<EMAIL_ADDRESS>= false;

  ### Random software

  nixpkgs.overlays = [ (self: super:
    { sarasa-gothic = self.callPackage ./sarasa-gothic.nix {}; }) ];

  environment.systemPackages = with pkgs; [
    fcitx-configtool wget emacs shadowsocks-libev proxychains elixir_1_8 erlangR21 jdk11 dotty fstar gcc8 llvmPackages_latest.clang llvmPackages_latest.stdenv firefox git python37Full sbt scala_2_12 vscode jetbrains.clion jetbrains.idea-ultimate jetbrains.pycharm-professional qt5Full qtcreator julia deepin.deepin-gtk-theme neofetch file lolcat commonsCompress
    # Password manager for KDE
    kdeFrameworks.kwallet
    kdeApplications.kwalletmanager
    kwalletcli

    # Allow automatic unlocking of kwallet if the same password. This seems to
    # work without installing kwallet-pam.
    #kwallet-pam

    # ssh-add prompts a user for a passphrase using KDE. Not sure if it is used
    # by anything? ssh-add just asks passphrase on the console.
    #ksshaskpass

    # Archives (e.g., tar.gz and zip)
    ark

    # GPG manager for KDE
    kgpg
    # This is needed for graphical dialogs used to enter GPG passphrases
    pinentry_qt5

    kdeplasma-addons

    # Screenshots
    kdeApplications.spectacle

    # Bluetooth
    bluedevil

    # Text editor
    kate

    # Torrenting
    ktorrent

    # Connect desktop and phone
    kdeconnect

    # Drop-down terminal
    yakuake

    # Printing and scanning
    kdeApplications.print-manager
    simple-scan

    # Document readers
    okular

    # Browsers
    firefox
    chromium

    # Email
    #kmail
    thunderbird

    # Office suit
    libreoffice

    # Photo/image editor
    gwenview
    gimp
    #gimpPlugins.resynthesizer
    #gimpPlugins.ufraw
    digikam5

    # Media player
    vlc

    # KDE apps
    kdeFrameworks.kconfig
    kdeFrameworks.kconfigwidgets
    konsole
    dolphin
    kdeApplications.dolphin-plugins
];
  programs.mtr.enable = true;

  nix.extraOptions = ''
    keep-outputs = true
    keep-derivations = true
  '';

  programs.ssh = {
    startAgent = true;
  };

  ### Graphical

  services.xserver = {
    enable = true;
    layout = "us";

    libinput.enable = true;

    displayManager.sddm = {
      enable = true;
      extraConfig = ''
        [X11]
        ServerArguments=-nolisten tcp -dpi 200
        MinimumVT=1
      '';
    };

    desktopManager.plasma5.enable = true;

    xkbOptions = "terminate:ctrl_alt_bksp,caps:ctrl_modifier";
  };

  i18n.inputMethod = {
    enabled = "fcitx";
    fcitx.engines = with pkgs.fcitx-engines; [ libpinyin rime ];
  };

  fonts.fonts = with pkgs; [
    sarasa-gothic
  ];

  fonts.enableFontDir = true;

  fonts.fontconfig.defaultFonts = {
    monospace = [ "Sarasa Mono SC" ];
    sansSerif = [ "Sarasa UI SC" ];
    serif = [ "Sarasa UI SC" ];
  };

  ### Boot and kernel
  boot.kernelPackages = pkgs.linuxPackages_latest_hardened;
  boot.loader.systemd-boot.enable = true;
  boot.loader.timeout = 10;
  boot.loader.efi.canTouchEfiVariables = true;
  boot.kernelParams = [ "i915.fastboot=1" "quiet" "acpi_osi=!" "acpi=\"windows2009\""];

  boot.extraModulePackages = [ pkgs.linuxPackages_latest_hardened.nvidia_x11_beta pkgs.linuxPackages_latest_hardened.perf];

  boot.kernel.sysctl = {
    "vm.swappiness" = 5;
    "vm.vfs_cache_pressure" = 50;
  };

  hardware.cpu.intel.updateMicrocode = true;

  ### Networking

  networking.hostName = "***";
  networking.networkmanager.enable = true;

  networking.firewall.allowedTCPPorts = [ 12345 ];
  networking.firewall.logRefusedConnections = false;

  ### Users
  users.defaultUserShell = pkgs.fish;
  users.users.***= {
    isNormalUser = true;
    useDefaultShell = true;
    uid = 1000;
    extraGroups = [ "wheel" "vboxusers" "docker" ];
  };

  ### Misc

  boot.earlyVconsoleSetup = true;

  i18n.consolePackages = [ pkgs.terminus_font ];
  i18n.consoleFont = "ter-132n";
  i18n.consoleKeyMap = "us";
  i18n.defaultLocale = "en_US.UTF-8";

  time.timeZone = "Asia/Shanghai";

  sound.enable = true;
  hardware.pulseaudio.enable = true;

  nix.trustedUsers = [ "root" "schrodinger" ];

  # This value determines the NixOS release with which your system is to be
  # compatible, in order to avoid breaking some software such as database
  # servers. You should change this only after NixOS release notes say you
  # should.
  services.flatpak.enable = true;
  programs.fish.enable = true;
  #programs.zsh.autosuggestions.enable = true;
  hardware.bumblebee.enable = true;
  hardware.bumblebee.connectDisplay = true;
  system.autoUpgrade.enable = true;
  system.autoUpgrade.channel = https://nixos.org/channels/nixos-unstable-small;
  nixpkgs.config.allowUnsupportedSystem = true;
  nixpkgs.config.allowBroken = true;
  nixpkgs.config.allowUnfree = true;
  virtualisation.docker.enable = true;
  services.emacs.install = true;
  services.emacs.enable = true;
  services.emacs.defaultEditor = true;
  #boot.plymouth.enable = true;
  nixpkgs.config.oraclejdk.accept_license = true;
  system.stateVersion = "19.09"; # Did you read the comment?
}

@Infinisil /nix/store/p89bkk0p8hgwg6xfrw4x3pbf2nmw3la2-primus-lib-2015-04-28.drv This thing depends on /nix/store/vqq275dnd5lbjfdxffa8864w4mxrinx2-bash-4.4-p23/bin/bash, while the latter is not executable. It is a 32-bit program.
/nix/store/vqq275dnd5lbjfdxffa8864w4mxrinx2-bash-4.4-p23/bin/bash: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked, interpreter /nix/store/sjsvwd9sqxjflmslnf8xs48aqpkb2sjy-glibc-2.27/lib/ld-linux.so.2, for GNU/Linux 2.6.32, not stripped

This default bash is 64-bit
/nix/store/mcyvp1s45scjkkhyb1m16aqlsb8wr6hs-bash-interactive-4.4-p23/bin/bash: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /nix/store/681354n3k44r8z90m35hm8945vsp95h1-glibc-2.27/lib/ld-linux-x86-64.so.2, for GNU/Linux 2.6.32, not stripped

Hmm, so I can't reproduce this, the failing derivation is /nix/store/p89bkk0p8hgwg6xfrw4x3pbf2nmw3la2-primus-lib-2015-04-28.drv as seen from your logs, which is pkgsi686Linux.primusLib in 07b42ccf2de451342982b550657636d891c4ba35 (latest nixos-unstable), referenced from https://github.com/NixOS/nixpkgs/blob/07b42ccf2de451342982b550657636d891c4ba35/pkgs/top-level/all-packages.nix#L20008-L20013 Building this myself (I'm on x86_64 too) works without problems:

$ nix-build -A pkgsi686Linux.primusLib --check                       remotes/channels/nixos-unstable ✭ ◼
checking outputs of '/nix/store/p89bkk0p8hgwg6xfrw4x3pbf2nmw3la2-primus-lib-2015-04-28.drv'...
unpacking sources
unpacking source archive /nix/store/w9269dhydjdl6q3clzs19pjkxp0a9xhr-source
source root is source
patching sources
applying patch /nix/store/wi0rn8p88nrd00g6pvvm2kh0k319rlvd-2f429e232581c556df4f4bf210aee8a0c99c60b7.patch
patching file libglfork.cpp
configuring
no configure script, doing nothing
building
build flags: SHELL=/nix/store/vqq275dnd5lbjfdxffa8864w4mxrinx2-bash-4.4-p23/bin/bash LIBDIR=\$\(out\)/lib PRIMUS_libGLa=/nix/store/bxjgqcz24cjmw7jarc7w0fp9inn7g86c-libglvnd-1.0.0/lib/libGL.so PRIMUS_libGLd=/nix/store/3dllgjhps0q8w44z3vrlwr8qh4wh8q23-libGL-1.0.0/lib/libGL.so PRIMUS_LOAD_GLOBAL=/nix/store/9a8wml7sg26y3h7wvsyl64yr6srdn484-mesa-noglu-18.3.4/lib/libglapi.so
mkdir -p /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28/lib
g++  -Wall -g -Werror=missing-declarations -Werror=attributes -DBUMBLEBEE_SOCKET='"/var/run/bumblebee.socket"' -DPRIMUS_SYNC='"0"' -DPRIMUS_VERBOSE='"1"' -DPRIMUS_UPLOAD='"0"' -DPRIMUS_SLEEP='"90"' -DPRIMUS_DISPLAY='":8"' -DPRIMUS_LOAD_GLOBAL='"/nix/store/9a8wml7sg26y3h7wvsyl64yr6srdn484-mesa-noglu-18.3.4/lib/libglapi.so"' -DPRIMUS_libGLa='"/nix/store/bxjgqcz24cjmw7jarc7w0fp9inn7g86c-libglvnd-1.0.0/lib/libGL.so"' -DPRIMUS_libGLd='"/nix/store/3dllgjhps0q8w44z3vrlwr8qh4wh8q23-libGL-1.0.0/lib/libGL.so"' -fvisibility=hidden -fPIC -shared -Wl,-Bsymbolic -o /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28/lib/libGL.so.1 libglfork.cpp -lX11 -lpthread -lrt
libglfork.cpp:1024:2: warning: #warning Enabled workarounds for applications demanding more than promised by the OpenGL ABI [-Wcpp]
 #warning Enabled workarounds for applications demanding more than promised by the OpenGL ABI
  ^~~~~~~
libglfork.cpp: In function 'void* readback_work(void*)':
libglfork.cpp:551:29: warning: 'height' may be used uninitialized in this function [-Wmaybe-uninitialized]
     primus.afns.glReadPixels(0, 0, width, height, GL_BGRA, GL_UNSIGNED_BYTE, NULL);
     ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
libglfork.cpp:551:29: warning: 'width' may be used uninitialized in this function [-Wmaybe-uninitialized]
installing
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28
shrinking /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28/lib/libGL.so.1
strip is /nix/store/jnky2ba7kb4rq494g5kgdprhxkrb40l7-binutils-2.31.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28/lib
patching script interpreter paths in /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28
checking for references to /build/ in /nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28...
/nix/store/ya554yqwkx1wxkhbrg271wpcnpnsvf46-primus-lib-2015-04-28

Pinging @abbradar as the main author of the bumblebee and primus stuff

Is there any method to overcome this failure. It has blocked me from upgrading for a long long time.

See #51097

This should be resolved by #82006 - please reopen if there's still a problem.


Relative/line numbers disappears in branch2

so I just did a very default installation of harpoon branch harpoon2 and if I open vim, press ctrl+e to toggle_quick_menu and open the 2 files I have, the first one gets line numbers but the second does not get numbers.
If both files are open already then no issue both have line numbers .. so its only when it has to open the second buffer I get this issue

I'm not able to replicate this with either relative or normal line numbers. Can you try updating harpoon2, and seeing if it persists? If so, it might be a plugin conflict.

you are right, I'm sorry .. its nvimdev/dashboard-nvim that conflicts


Move Siddhi IO WebSocket to Siddhi-io organization

Purpose

$subject

Security checks

Followed secure coding standards in http://wso2.com/technical-reports/wso2-secure-engineering-guidelines? yes
Ran FindSecurityBugs plugin and verified report? yes
Confirmed that this PR doesn't commit any keys, passwords, tokens, usernames, or other secrets? yes

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

The export package name is not changed.


Validate that SMTP Brokerpak handles multi-tenancy

The existing deployment(s) of the SMTP brokerpak mentioned in #2988 were designed for use by single customers who run the Cloud Service Broker as a Supplemental Service Broker, brokering services to one organization only. Our CSB deployment will be available to all customers, so we must make sure the provisioning & binding code creates resources scoped to the tenant that created them.
Acceptance Criteria:

[ ] Validate that binding credentials have access to only one SES identity and document the reasoning or results

Per AWS, a user cannot send to an identity without an IAM policy or Sending Authorization Policy that allows it. The brokerpak implements this with an IAM policy, which includes a Resource constraint with the ARN of their identity and configuration set. This prevents cross-identity, and therefore cross-tenant, access.


Feature request: Detect when user dies so modeline stays accurate

Come on, I don't want my ghost getting confused once it's trapped inside Emacs for eternity. 😞

I was trying to think of a pun related to the kill ring, but I couldn't think of one. Have this instead. ❤


batch endpoint

Sometimes you need to execute a long running query, for example for a analysis, index creation and so on. In those cases the current endpoint fails due timeouts in http layers.
My proposal is to add a new endpoint like
/api/v1/sql_batch?q=update ....

if will return a job_id like
{ job_id: 12345 }

so the user can check the state
/api/v1/sql?q=select state from cdb_jobs where job_id = '....'

The management would work using the table, for example, cancelling a job:
/api/v1/sql?q=delete from cdb_jobs where job_id = '....'

cc @pramsey @rochoa

+1
2015-05-07 14:16 GMT+02:00 javi santana<EMAIL_ADDRESS>
Sometimes you need to execute a long running query, for example for a
analysis, index creation and so on. In those cases the current endpoint
fails due timeouts in http layers.
My proposal is to add a new endpoint like
/api/v1/sql_batch?q=update ....
if will return a job_id like
{ job_id: 12345 }
so the user can check the state
/api/v1/sql?q=select * from cdb_jobs where job_id = '....'
cc @pramsey https://github.com/pramsey @rochoa
https://github.com/rochoa
—
Reply to this email directly or view it on GitHub
https://github.com/CartoDB/CartoDB-SQL-API/issues/218.

--
Daniel Carrión
<EMAIL_ADDRESS>

so the queue is going to be spread out over every single account in the system? (one cdb_jobs table in each account) this seem potentially awful

my approach here is not to think in how cartodb works but how I would implement this in postgres. We already have a system like that (the cache).
In any case, the approach having a single queue would be to make sql_batch a rest endpoint to get/list/update/remove jobs
What would be your approach?

That keeps me wondering things:

What information does "job_id" encapsulate? Postgres' query PID?
Where is it saved? Postgresql itself (I guess that from select state from cdb_jobs...) ?
How do we ensure isolation between users? So if I run a long query and I try to cancel it, it doesn't cancel other users queries?

Those questions are for me also! :dancer:

another desirable thing: provide a way to fetch results for big exports so the results can be obtained somewhow. Also for big outputs obviously

Then user must know when a query is a long running query, right?. Or should SQL-API find it out?

Yes, the expectation is that they'd know the query is long.

@dgaubert I think we can close this, right?

We are about to close it, waiting for the PR, coming soon!


Unable to get it working.

After following the installation instructions, everything looks in place but I keep getting the following error:
PS C:\temp> Convert-Etl2Pcapng .\VideoExample.etl
.\etl2pcapng.exe : The term '.\etl2pcapng.exe' is not recognized as the name of a cmdlet, function, script file, or
operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try
again.
At C:\Program Files\WindowsPowerShell\Modules\Convert-Etl2Pcapng\2020.5.14\Convert-Etl2Pcapng.psm1:416 char:13

        .\etl2pcapng.exe "$($file.FullName)" "$($file.DirectoryNa ...

        ~~~~~~~~~~~~~~~~

CategoryInfo          : ObjectNotFound: (.\etl2pcapng.exe:String) [], CommandNotFoundException
FullyQualifiedErrorId : CommandNotFoundException

I modified the Convert-Etl2Pcapng.psm1 file and removed the '.\' at line 411 and 416 and the conversion would work from Convert-Etl2Pcapng and the right click.

@ToddMaxey, I apologize for just now seeing this. My notification never showed up.
What version of PowerShell are you using? I haven't seen this on Windows PowerShell 5.1 or PowerShell 7+.
Normally, with PowerShell, you need the ".\" to run an EXE that isn't in the system or user PATH. Which makes your behavior very curious.
For example (same error on 5.1 and 7.1.3):
> etl2pcapng -?
etl2pcapng : The term 'etl2pcapng' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ etl2pcapng -?
+ ~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (etl2pcapng:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

Suggestion [3,General]: The command etl2pcapng was not found, but does exist in the current location. Windows PowerShell does not load commands from the current location by default. If you trust this command, instead type: ".\etl2pcapng". See "get-help about_Command_Precedence" for more details.

> etl2pcapng.exe -?
etl2pcapng.exe : The term 'etl2pcapng.exe' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ etl2pcapng.exe -?
+ ~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (etl2pcapng.exe:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

>  .\etl2pcapng.exe -?
etl2pcapng <infile> <outfile>
Converts a packet capture from etl to pcapng format.

I did a rework of the module recently, but haven't touched that part of code. Version 2021.4.7 is the current version. Can you test to see if you get the error with that version?

Will look at on Friday when I get back
Sent from a mobile device.
Expect typographical errors and inevitable miscommunications.
My apologies in advance.
No trees were utilized in the posting of this message. However a enormous number of electrons were terribly inconvenienced.

From: James Kehr @.>
Sent: Wednesday, April 7, 2021 2:08:53 PM
To: microsoft/Convert-Etl2Pcapng @.>
Cc: ToddMaxey @.>; Mention @.>
Subject: Re: [microsoft/Convert-Etl2Pcapng] Unable to get it working. (#3)
@ToddMaxeyhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FToddMaxey&data=04|01||bdb5c2054e404ea4448808d8f9f8962b|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637534193348352573|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=ON4wOkpe6%2BXlAqUNCkglhSBKYXAMY%2F7deUAundhYMLA%3D&reserved=0, I apologize for just now seeing this. My notification never showed up.
What version of PowerShell are you using? I haven't seen this on Windows PowerShell 5.1 or PowerShell 7+.
Normally, with PowerShell, you need the "." to run an EXE that isn't in the system or user PATH. Which makes your behavior very curious.
For example (same error on 5.1 and 7.1.3):

etl2pcapng -?
etl2pcapng : The term 'etl2pcapng' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1

etl2pcapng -?

  + CategoryInfo          : ObjectNotFound: (etl2pcapng:String) [], CommandNotFoundException
  + FullyQualifiedErrorId : CommandNotFoundException

Suggestion [3,General]: The command etl2pcapng was not found, but does exist in the current location. Windows PowerShell does not load commands from the current location by default. If you trust this command, instead type: ".\etl2pcapng". See "get-help about_Command_Precedence" for more details.

etl2pcapng.exe -?
etl2pcapng.exe : The term 'etl2pcapng.exe' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1

etl2pcapng.exe -?

  + CategoryInfo          : ObjectNotFound: (etl2pcapng.exe:String) [], CommandNotFoundException
  + FullyQualifiedErrorId : CommandNotFoundException

.\etl2pcapng.exe -?
etl2pcapng
Converts a packet capture from etl to pcapng format.

I did a rework of the module recently, but haven't touched that part of code. Version 2021.4.7 is the current version. Can you test to see if you get the error with that version?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FConvert-Etl2Pcapng%2Fissues%2F3%23issuecomment-815156861&data=04|01||bdb5c2054e404ea4448808d8f9f8962b|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637534193348362572|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=He2maWg7KccYS5VZ%2FAsDmKVIM3ahp8xSrfIMxt7J0pM%3D&reserved=0, or unsubscribehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAJ66LO32HIRIPHUKXD4FNHDTHSUULANCNFSM4UADPGJA&data=04|01||bdb5c2054e404ea4448808d8f9f8962b|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637534193348372565|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=zw0eO3cZMjHzCInlaZSBLnwyei0qJBjh%2BnbMQ0TKUlo%3D&reserved=0.

I have updated the repro with several fixes. Update the contents of Convert-Etl2Pcapng.psm1 with the code here:
https://raw.githubusercontent.com/microsoft/Convert-Etl2Pcapng/main/Convert-Etl2Pcapng.psm1
You can use this command to find where the module is installed:
(Get-Module -ListAvailable Convert-Etl2Pcapng).Path

Restart PowerShell after updating the code. Run Unregister-Etl2Pcapng and then Register-Etl2Pcapng to update the right-click registration.
If you get an error saying "The 'Convert-Etl2Pcapng' command was found in the module 'Convert-Etl2Pcapng', but the module
could not be loaded." you will need to run Unblock-File against Convert-Etl2pcapng.psm1.
I will update the module on PowerShell Gallery after testing a few more things.

The PowerShell Gallery has been updated with a module version that should resolve this, and a few other, issues.


[CDAP-17473] Checking raw value instead of substituted in GCPConfig if a macro is present

/gcbrun

/gcbrun


Rio user will block rancher user login

If you are using rancher to provision and manage k8s cluster, and install Rio on it, the rio user and rancher user will clash.
To fix simply rename user:

kubectl patch users.management.cattle.io admin --patch '{"username": "rio-admin"}'
use the rancher admin user to login to rancher and rio dashboard

The bug is because we create duplicated username in rio that conflicts with rancher user.
Workaround:
kubectl patch users.management.cattle.io admin --patch '{"username": "rio-admin"}'

@rancher-max should be fixed in master now.

Dashboard is broken and inaccessible in master


Pre-validation queue for transaction pool

Right now when the node starts to produce a block, it competes for I/o (db) resources with the transaction pool if it is receiving a lot of transactions at the same time.
Most of those transactions received in this time frame are going to be revalidated anyway once new (being produced) block imported, against it, so it is useless work which also cripples block production.
So I have an idea that during block production transaction pool should not validate transactions but instead should put them in the queue and start to validate once the block production is over.
Happy to discuss

Right now when the node starts to produce a block, it competes for I/o (db) resources with the transaction pool if it is receiving a lot of transactions at the same time.

Transaction pool and block production will not really compete for I/O. The transaction pool will very likely only use stuff that is already in cache or only will read stuff from the db that will go into the cache afterwards. Block production will use the same cache. So, they probably compete about CPU resources, but probably not I/O.

Maybe, but not necessary, those transaction from network/rpc can hit completely different storage items compared to ones that constitute the block.

Maybe, but not necessary, those transaction from network/rpc can hit completely different storage items compared to ones that constitute the block.

That is right, but only a very limited set of different storage items as the validation is very lightweight.
Do you have observed any problems in your benchmarks that the validation slows down the block production?

I am not yet sure that I can attribute any slowdowns to this, It's rather hard to check.
I will keep this issue updated.


docker requirement check

looks good

Hey, I'm currently setting up some self-hosted agents and ran straight forward into the error message ontainer feature is not supported when agent is already running inside container. Please reference documentation (https://go.microsoft.com/fwlink/?linkid=875268)
Unfortunately I wasn't able to find some information, so I'm free to ask you here.
Will be there in the close feature the possibility to do docker-in-docker?

I'm currently setting up some self-hosted agents and ran straight forward into the error message ontainer feature is not supported when agent is already running inside container. Please reference documentation (https://go.microsoft.com/fwlink/?linkid=875268)
Unfortunately I wasn't able to find some information, so I'm free to ask you here.
Will be there in the close feature the possibility to run docker-in-docker?

@TingluoHuang @ericsciple Any updates on this? I'd love to run self-hosted agents in a container, but the lack of ability to run docker-in-docker is problem

I'm currently setting up some self-hosted agents and ran straight forward into the error message ontainer feature is not supported when agent is already running inside container. Please reference documentation (https://go.microsoft.com/fwlink/?linkid=875268)
Unfortunately I wasn't able to find some information, so I'm free to ask you here.
Will be there in the close feature the possibility to run docker-in-docker?

@TingluoHuang @ericsciple Any updates on this? I'd love to run self-hosted agents in a container, but the lack of ability to run docker-in-docker is a problem

I agree.  I believe any customer sophisticated enough to be creating these pipelines is sophisticated enough to deal with the issues with the work folder obfuscation.  I would really appreciate the ability to use containers during in build pipelines with an agent with an agent that is self-hosted inside a docker container.

@vtbassmatt re feedback

I'm currently setting up some self-hosted agents and ran straight forward into the error message ontainer feature is not supported when agent is already running inside container. Please reference documentation (https://go.microsoft.com/fwlink/?linkid=875268)
Unfortunately I wasn't able to find some information, so I'm free to ask you here.
Will be there in the close feature the possibility to run docker-in-docker?

@TingluoHuang @ericsciple Any updates on this? I'd love to run self-hosted agents in a container, but the lack of ability to run docker-in-docker is a problem

I agree. I believe any customer sophisticated enough to be creating these pipelines is sophisticated enough to deal with the issues with the work folder obfuscation. I would really appreciate the ability to use containers in build pipelines with a self-hosted agent that is itself inside a docker container.

@mrhorvath @davidtom @eisenreich If any of you are still interested in this functionality, I have a not too horrendous workaround, as long as you are fine with running podman (Red Hat service similar to docker) and docker. You can see my comment here (link to issue on this repo) if at all interested.

Would be great if we could do this, i'm fairly confident the way we have it configured would work as long as we could provide it the volume we are using for our work, could pass in that as an argument to the runner & use --volumes-from if needbe?


Add download_plugin.sh for packing WeCross.tar.gz

Codecov Report

Merging #219 into release-rc2 will not change coverage.
The diff coverage is n/a.

@@              Coverage Diff               @@
##             release-rc2     #219   +/-   ##
==============================================
  Coverage          28.34%   28.34%
  Complexity           330      330
==============================================
  Files                110      110
  Lines               3577     3577
  Branches             258      258
==============================================
  Hits                1014     1014
  Misses              2483     2483
  Partials              80       80


A Test ticket

Time Tracking
Developer's time Estimated effort to fix (hours): 4.0
Developer's Actual time spent on fix (hours): 3.0

Description
This is a test ticket. It will be removed.

@J17359 : Just playing with @CharlesAtZelig. What do you think of the presentation of the following example ticket? If you like it, we'll adjust the template accordingly.

@J17359 : BTW, you can see the editing experience by clicking the three dots, and then Edit. We can add such formatting to any existing ticket merely by copying and pasting.

@J17359 : Just playing with @CharlesAtZelig. What do you think of the presentation of the following example ticket? If you like it, we'll adjust the template accordingly.

I like it! That template works for me.

@J17359 : Just playing with @CharlesAtZelig. What do you think of the presentation of the following example ticket? If you like it, we'll adjust the template accordingly.

I like it! That template works for me.

@CharlesAtZelig : Looks like we can use the above as a revised template.

User approved and liked - closing

User approved and liked - closing


UI - Need "Back", "Close" options when navigating between pages.

In general it would be nice to have  "Back", "Close" options when navigating between pages.
Currently the 1 place were I really miss having a Back", "Close" option is in "Edit Assistant" view.
If I am in "Edit Assistant" view and wish to quit this screen , I have to hit "Build" option which is already highlighted to get back to "My Explorer" page from edit view.

A finish button is added in Edit Assistant page.

We now have a Finish button in Edit Assistant page.Would it be better to have an "x" instead to close this page similar to what we have in "Edit Tool" page for consistency ?
@cjellick I wanted to confirm if we are good with the finish button and if there is more we would like to follow up as part of this issue before i close this bug.

We are going to change it slightly. See my most recent UX changes post in Slack.

This is now how i want it - a Back and Reload chat button

We have "Back" and "Refresh Chat" button in Edit assistant page.


[sw] Coverage support for OpenTitan

This PR introduces coverage support for OpenTitan which enables collecting coverage data for on-device tests, or any executable compiled with coverage support. Please see below for a brief description of each commit included in this PR.

[sw] Vendor in llvm_clang_rt_profile
This change adds a vendor.hjson file and a patch to be able to build the LLVM profiling runtime support library for OpenTitan. This library relies heavily on file I/O, which we don't have, and supports multiple platforms that we are not interested in. Thus, the hjson file excludes all files that are irrelevant to OpenTitan while the patch removes the headers that we don't need and adjusts the paths of several headers.

Update llvm_clang_rt_profile to llvm/llvm-project@4fccdd5c85d
Update code from upstream repository https://github.com/llvm/llvm-project.git to revision 4fccdd5c85d05b3b03d029f533762e233259573c

[sw] Modify flash_link.ld for llvm coverage
When code is compiled with coverage enabled, the compiler emits various symbols and sections that are used at runtime to collect coverage data. This change modifies flash_link.ld linker script to preserve these sections.

[sw] Modify flash_crt.S for llvm coverage
When code is compiled with coverage enabled, the compiler emits pointers to functions (in .init_array) that must be called in order to initialize the LLVM profile buffer. This change modifies flash_crt.S to call these functions before the main program is executed.

[sw] Implement test_coverage library
This change:
- Introduces the test_coverage library that provides LLVM profiling runtime support and a function for sending the LLVM profile buffer over UART, and
- Introduces a new meson option named coverage to define the relevant dependencies conditionally.

[sw] Integrate test_coverage into test_main
This change:
- Adds test_coverage library to the dependencies of test_main,  and
- Adds a call to test_coverage_send_buffer at the end of a test.
If coverage is enabled, the actual definition of test_coverage_send_buffer in test_coverage_llvm library gets linked in which sends the LLVM profile buffer over UART. If not, the NOP definition in test_coverage_none gets linked in.

[sw] Write a simple test to test coverage functionality
This change introduces a simple on-device test to test coverage functionality.

[util] Implement a script for extracting profile data from device output
This change introduces a python script that extracts profile data from device output.

Workflow
Please note that this PR already adds coverage support to test_main, so on-device tests only need the collect_coverage dependency to collect coverage data.

Add collect_coverage dependency to the desired libraries.
meson_init.sh -c to enable coverage.
stty -F /dev/ttyUSB0 icanon to make sure that EOT is recognized and cat eventually exits.
cat /dev/ttyUSB0 | util/device_profile_data.py foo.profraw to capture and extract coverage data over UART.
Build and program device. Tests (or other executables) with coverage send the LLVM profile data over UART like this:

LLVM profile data (length: 312, CRC32: 370887ED):
8152666F72706CFF05000000000...8010065D01D0F000000000000

Index raw profile data: llvm-profdata merge -sparse foo.profraw -o foo.profdata
Generate coverage reports, e.g. llvm-cov show OBJECT_FILE -instr-profile=foo.profdata. Sample report for coverage_test.c.

Open Questions

[X] It looks like we have to copy the entire LLVM profile buffer in a single call which means we need a relatively large buffer. We need to understand if we need to worry about this or not and how the size of this buffer scales with number of functions and lines of code.

Size of the profile buffer for sha256_test is 856 bytes when collecting coverage for sha256_test.c, hw_sha256.c, and hmac.c. The total size of the buffer in test_coverage.c is currently 8KB and we have 64KB of RAM.

[X] Linking with multiple static libraries compiled with coverage enabled.

Please see above (sha256_test).

[X] gcc builds fail.

Introduced a new meson option named coverage and a compiler check.

[X] It looks like the profile data does not have any protection, so I thought it would be prudent to add length and CRC32. While I understand that this is not urgently needed, I think it is nice to have.
[X] Changes in flash_link.ld: While I tried to do my best by looking at objdump output and llvm code, please take a close look at my changes. You can find objdump of coverage_test.c.o here to see the sections added by the compiler when coverage is enabled (they all start with __llvm).

Marking this as done since coverage reports for coverage_test and sha256_test look OK, but we can always revisit these changes if we notice any issues.

Remaining tasks are captured in #3155.
References

https://clang.llvm.org/docs/SourceBasedCodeCoverage.html
https://llvm.org/docs/CoverageMappingFormat.html

You'll need to add the vendor directory to the exclusions in util/licence-checker.hjson in order to pass CI. This is correct because we don't want to put lowrisc headers on those files (they're from LLVM).

util/licence-checker.hjson already has the following
 12     # Exclude anything in vendored directories
 13     '*/vendor/*/*',

and according to the CI logs, license check passed but clang-format check failed due to an empty line at the end of a file. I will push the updates and keep an eye on CI. Thanks!

Should this PR contain a check for CI to run the coverage test program and ensure that the coverage matches what was expect?

I plan to add CI support in a separate PR because this PR is already quite large and we will also need some tooling to process the raw profile data.

In the last push (grouped by commit):

[sw] Modify flash_link.ld for llvm coverage

Align the end of .init_array section.

[sw] Modify flash_crt.S for llvm coverage

Call function pointers in .init_array in flash_crt.S.

[sw] Implement test_coverage library

Add false-by-default coverage option to meson, meson_init.sh flag: -c.
Define coverage dependencies based on coverage option, NOP if coverage is false.
Increase size of the buffer in test_coverage_send_buffer to 8KB.
Implement comments.

[sw] Integrate test_coverage into test_main

Add a weak definition for test_coverage_send_buffer in test_main.c.

[sw] Write a simple test to test coverage functionality

Implement comments.

[util] Implement a script for extracting profile data from device output

Ignore utf-8 errors due to device resetting before programming.
Process lines in reverse order.
Run yapf and pylint.

Implemented @mcy's comments.

Addressed @lenary's comments.

Applied CI patch to fix the order of includes in test_coverage_llvm.c.

Thanks, I think I'm happy with this!
@mcy can you leave an approving review if all your comments were addressed? I don't think the include ordering should be a blocker now.

Thanks @lenary!

LG =)

Thanks!