Axioms admit more transitions than intended

The encoding of K rules into Kore axioms admits more transitions than intended.
Notation
∅ is the null Set
{ x₁, x₂, ... } is the Set of elements x₁, x₂, ...
_∪_ is the usual Set union symbol
_∈_ is the Bool-valued Set membership predicate
Problem
Consider the axiom
(A).    ∀ x S.  { x } ∪ S  →∙  φ(S)

where φ(S) is an arbitrary pattern in which S occurs free. This axiom is would be generated by K to represent a transition
(T1).    { a }  →∙  φ(∅)

which we can see by instantiating axiom (A) with x = a  ∧  S = ∅. However, we can also instantiate (A) with x = a  ∧  S = { a } to obtain the transition
(T2).    { a }  →∙  φ({ a })

because _∪_ is idempotent. Although the user intended only transition (T1), the transition system described by (A) also includes (T2).
This problem is not unique to Set, but includes Map and probably any other domain with an idempotent, associative, commutative operator such as _∪_.
Solution
From the backend's perspective, we must produce the correct unifier,
(U1).    ⌈ { x } ∪ S  ∧  { a } ⌉  =  x = a  ∧  (S = ∅  ∨  S = { a })

so that we will simplify other expressions correctly, such as { x } ∪ S  =  { a }. This is not satisfactory to the user, so we suggest adding an appropriate pre-condition to (A) to take the desired transition:
(A1).    ∀ x S.  (x ∉ S = true  ∧  { x } ∪ S) →∙ φ(S)  -- admits only (T1)
(A2).    ∀ x S.  (x ∈ S = true  ∧  { x } ∪ S) →∙ φ(S)  -- admits only (T2)

Unfortunately, this may require some semantics to be modified in order to be compatible with
the Haskell backend. However, most rules of the form of (A) actually do not have S occurring free in φ, so the scope of changes required may be minimal. We also note that, because the Haskell backend supports non-deterministic unification on Set and Map, rules which unify a Set or Map (instead of directly testing membership or lookup) may introduce undesirable redundant branches.

I'd have said that the semantics must be changed in order to be compatible with Matching Logic and the _∪_ semantics, not with the Haskell backend, since the backend just implements ML... Or that the frontend must translate the user intent in proper ML/kore formulas, including the x ∉ S precondition, if that makes more sense.

@virgil-serbanuta I agree with your characterization (the user needs to express their intent more logically), but as a practical matter, this is only an issue for the Haskell backend because none of the other backends support non-deterministic unification.

This was fixed in: #782, #770, #758, #753, #711, and possibly others.


Update README.md

Cleaning up meeting invite

The changes look fine to me, but I think all https://github.com/camaraproject subprojects actually have the existing README structure by default. It sort of keeps consistency between them... Should we change it? For me it is fine either way, it is more of a "cosmetic" thing.

The changes look fine to me, but I think all https://github.com/camaraproject subprojects actually have the existing README structure by default. It sort of keeps consistency between them... Should we change it? For me it is fine either way, it is more of a "cosmetic" thing.

@jpengar it's part of the initiative to consolidate the information, reduce duplication and make the README.md files usable for inclusion within the sub project wiki "front" page. So the idea is to make all README.md consistent to a new format.
@wrathwolf I propose that we first conclude the PR #3 on the template, before a roll-out to the sub projects.

I think writing "CET/CEST" is self-contradicting, because a time is either CET or CEST, right? I can't be both at the same time, because CET is without DST, while CEST is with DST. In winter the time is the same, but the spec is either or, I think I think, the text should be 16:00 CEST, but I am not sure about that.

@AxelNennker The logic is that the timezone in EU countries is either CET or CEST (and never both at the same time), and in both cases the meeting is at 16:00.  The meeting setup is currently anchored in EU, so it will change automatically with the change to DST in EU (hence the remark about the UTC change if in EU is DT).
If this is the right approach for a global project where this impacts most of the world population which does not have DST (anymore) and especially the southern hemisphere is another question which I will raise as an issue for discussion in Governance.

Please comment in https://github.com/camaraproject/Template_Lead_Repository/pull/3 regarding the upcoming structure for the README.md. That should be agreed before we touch/change all repositories.

@wrathwolf @jpengar @AxelNennker with the changes https://github.com/camaraproject/IdentityAndConsentManagement/pull/144/commits/ecab84486736d9aa260a0d58d13455f309bb5d7f I aligned it with Template_Lead_Repository/blob/main/README.md.
Please review and merge if ok.

I had to delete the doubled section with "Release Information".
BTW: feel free to suggest changes to this section if it does not fit for ICM.

I think the following is fitting for API subprojects but not for ICM
"Service APIs for “IdentityAndConsentManagement” (see APIBacklog.md)"
Find it strange to view e.g. OIDC as a service API.

I think the following is fitting for API subprojects but not for ICM "Service APIs for “IdentityAndConsentManagement” (see APIBacklog.md)"
Find it strange to view e.g. OIDC as a service API.

+1. APIBacklog.md link is also broken.
We may need to revise the scope section a bit for ICM. It also mentions "Describe, develop, document and test the APIs".

@AxelNennker @jpengar I corrected the link for APIBacklog.md. But please consider that this PR was opened by @wrathwolf to execute on tps://github.com/camaraproject/Governance/issues/124, not to revise the content. The lines within scope you are commenting on are not even changed by this PR. I kindly ask to approve and merge this PR and then open your own issue/PR to revise the content as needed.


Add implementationProvider capability to lsp server

Proposal
Add the implementationProvider capability to the lsp server.
Use case
Make (probably) most editors work properly with flow. I just configured my Emacs for flow and goto definition stopped working since it is expected that the lsp-server takes cares of that when using lsp.  I'm not sure how you expect it to work now but I can't navigate between files using goto definition inside of my own project atm.
I am also not getting any js code completions for imported symbols, is this supposed to work in parallel with some other lsp-server? How do you integrate with other editors?

go-to-definition is powered by the definition provider. the implementation provider is a different thing, go-to-implementation. it's for jumping from an interface to classes that implement that interface. you're right that Flow doesn't support that yet.
but if you're trying to jump to the definition of an identifier or an object property or something, that is a different thing. if completion isn't working either then it sounds like something is wrong with the setup in general. what extension are you using? does it have a way of logging the LSP traffic?

the implementation provider is a different thing, go-to-implementation. it's for jumping from an interface to classes that implement that interface. you're right that Flow doesn't support that yet.

@mroch Is there another issue tracker for this go to implementation feature? I want to subscribe it and be notified. Thanks in advance.
I seems typescript doesn't support it either. It's a pain when developing.
https://github.com/microsoft/TypeScript/issues/37777
https://github.com/microsoft/TypeScript/issues/6209


Wheel support

http://pythonwheels.com/
Right now, only the tar.gz file is being distributed on PyPI for sendgrid-django, which isn't that much of an issue, but it does add some time to installing the package.
This package should be compatible with the Wheel format, considering it doesn't appear to have any C dependencies and it is compatible with both Python 2 and 3. As a result, you should only need to generate a universal wheel and then everyone (on all systems) will get the ability to install sendgrid-django with just the wheel, without having to do any extra work.

@andriisoldatenko you up for this? Otherwise I'll have a stab at it.

@elbuo8
nope, I'm not working on it now.

@elbuo8: Wheel support is pretty quick. See #42.

(this can be closed with the merge)


Improve Javadoc - first steps

make JavaDoc available e.g. via github pages and potentially use UmlDoclet to generate plantuml diagrams https://github.com/talsma-ict/umldoclet/blob/develop-v1/docs/USAGE.md

There is now a gh-pages branch in dukes to publish javadoc and similare
reports with mvn site.
To enable
https://rc-dukes.github.io/dukes
the following the instructions in:
https://help.github.com/en/articles/configuring-a-publishing-source-for-github-pages
need to be followed
It will take about 10 minutes for the gh-pages page to activate after
you have configured it.

Should be set up now - can you check?

I renamed this to "first steps" and will close it. For further improvements i might open another issue.


[BUGFIXES] removing unnecessary that prevented latest version of the …

…package to upload; other minor changes

Codecov Report

Merging #12 (a655446) into main (634ebc7) will increase coverage by 0.04%.
Report is 1 commits behind head on main.
The diff coverage is 100.00%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the GitHub App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main      #12      +/-   ##
==========================================
+ Coverage   91.13%   91.17%   +0.04%
==========================================
  Files          10       10
  Lines        1410     1417       +7
==========================================
+ Hits         1285     1292       +7
  Misses        125      125

Files Changed
Coverage Δ

refineryframe/detect_unexpected.py
92.43% <ø> (ø)

tests/__init__.py
100.00% <ø> (ø)

refineryframe/__init__.py
100.00% <100.00%> (ø)

refineryframe/other.py
73.46% <100.00%> (+0.55%)
:arrow_up:

refineryframe/refiner.py
88.76% <100.00%> (+0.12%)
:arrow_up:

tests/test_refiner.py
98.48% <100.00%> (+0.03%)
:arrow_up:


userFederationProviders userFederationMappers

It would be nice to be able to define userFederationProviders - userFederationMappers within the realm CR. This is the missing piece that would allow us to streamline a 100% gitops deployment of Keycloak.

@elimaneg  I see these two parameters userFederationProviders, userFederationMappers under RealmRepresentation in API doc.
https://www.keycloak.org/docs-api/22.0.1/rest-api/index.html#RealmRepresentation

Please clarify how to configure them on the keycloak UI. I don't see any settings related to them in the Realm.
Maybe you mean configuring User federation/mapping as it is here?

But it uses a separate API.
https://www.keycloak.org/docs-api/22.0.1/rest-api/index.html#_component
We already have KeycloakComponent CR, which can be configured for this.

Hi @zmotso !
Yes...This is exactly what I meant (User federation/mapping as in your screenshot). I managed to use  KeycloakComponent CR to configure userFederationProviders but I have no idea on how to proceed for the mappers (do you have an example ?)
apiVersion: v1.edp.epam.com/v1 kind: KeycloakRealmComponent metadata:   name: userfederationprovider spec:   name: userfederationprovider   providerId: ldap   providerType: org.keycloak.storage.UserStorageProvider   realmRef:     name: gitops-realm     kind: KeycloakRealm   config:     bindCredential: '["ad-secret:password"]'     bindDn: '["ad-secret:username"]' #      connectionUrl: '["ldaps://xxxxxxxxxxxxxx"]'     customUserSearchFilter: '["memberOf=xxxxxxxxxxx)"]'     editMode: '["READ_ONLY"]'     rdnLDAPAttribute: '["cn"]'     searchScope: '["2"]'     trustEmail: '["true"]'     useTruststoreSpi: '["Always"]'     userObjectClasses: '["person, organizationalPerson, user"]'     usernameLDAPAttribute: '["cn"]'     usersDn: '["OU=Usersxxxxxxxxxxxxxxx"]'     uuidLDAPAttribute: '["objectGUID"]'     vendor: '["ad"]'

@elimaneg  Mapper is the KeycloakRealmComponent with providerType: "org.keycloak.storage.ldap.mappers.LDAPStorageMapper".
parentRef - Your KeycloakRealmComponent userfederationprovider.
Example:
apiVersion: v1.edp.epam.com/v1
kind: KeycloakRealmComponent
metadata:
  name: user-federation-role-mapper
spec:
  realmRef:
    name: keycloakrealm-sample
    kind: KeycloakRealm
  name: user-federation-role-mapper
  providerId: role-ldap-mapper # Mapper type
  providerType: "org.keycloak.storage.ldap.mappers.LDAPStorageMapper"
  parentRef:
    name: userfederationprovider
    kind: KeycloakRealmComponent
  config:
    membership.attribute.type: ["DN"]
    mode: ["LDAP_ONLY"]
    user.roles.retrieve.strategy: ["LOAD_ROLES_BY_MEMBER_ATTRIBUTE"]
    roles.dn: ["test"]
    role.name.ldap.attribute: ["cn"]
    role.object.classes: ["group"]
    membership.ldap.attribute: ["member"]
    membership.user.ldap.attribute: ["cn"]
    roles.ldap.filter: [""]
    memberof.ldap.attribute: ["memberOf"]
    use.realm.roles.mapping: ["true"]

Also, you can create a mapper in the UI and check the network console to get the configuration example.
POST https://<your_url>/admin/realms/realm-sample/components

awesome !


String To Little Endian Shellcode Generator

Usage: python string-to-shellcode.py
The last step ("push esp") is to push the pointer pointing to the created string to the stack, just pop to another registry if temporary storage is needed.
Reference:
https://github.com/tyhk/String-Shellcode-Generator

Thanks for taking the time to submit! Could you add usage/example/why someone would want to use this to the README? Also, it'd be nice if you could run https://github.com/psf/black on it, for formatting.


Testability for threaded examples

Some example apps were difficult to test because they did not terminate their background threads.
This patch adds on_close() handlers or marks threads as daemon=True so that they do not stop their process from terminating.
Now there are no skipped unit tests.

Well done @jjclark1982 !


Add test mode that connects to existing running instance

It would be nice to be able to have the test suite (or parts of it, at least) be able to connect to a running instance (_localdev probably) instead of creating and initializing databases. The running instance would need to have been created with inittestdb, of course
The main advantage that I am looking for is the ability to run some tests even when a pending change has broken database initialization, since it is much easier to debug a failing query than failing DDL.
There could be performance advantages too.

Something close enough to this has been done in two different ways (--use-cache-db and --data-dir)


add business hour indication to sessions graph

can be configured in config
fixes #419

@BryceV Good idea on updating the ini settings! 🧠 💡 Thanks for reminding me!


fix(chai-friendly): adjust conditional operator in Collapse component

This fixes an error thrown by chai-friendly due to a conditional operator in the Collapse component.

Codecov Report

Merging #249 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master   #249   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files          21     21
  Lines         413    415    +2
=====================================
+ Hits          413    415    +2

Impacted Files
Coverage Δ

src/js/components/collapse.js
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5435774...579fdc5. Read the comment docs.


running with --dta did not produce XS tag

Dear , When I ran Hisat2 (version: 2.1.0) with --dta ( --downstream-transcriptome-assembly OR --dta-cufflinks), there was no XS tag in output file.  I did not know how to fix it.
Thank you very much!

This seems very unlikely -- though I guess it's possible to happen if there were no spliced alignments at all (which would be strange). In any case, this seems to be an aligner (or aligner usage) issue (HISAT2), not a StringTie issue..


logo font

more historical version?

The opinion of Tomáš Staudek was exactly to refresh, and avoid the historicizing font, so there is a difference of opinion on this. In any case, it is true that our target audience is also social scientists, not just historians.

I wouldn't go too far with the historical look, just slightly more evocative font, suggestion before/after:

@pondrejk do you also want to change the fill color of the horse? I am probably more in the favor of the historic font, but definitely just my subjective opinion.

Colored horse feels better visually separated from the title. Though we can get back to white or chose a different hue if consensus is against it

@pondrejk Ok, let's start with your suggestion and we will see whether it fits or not. My idea was to use this logo without the application interface also.

Lets probably close it for now


Clarify the benefits of uv.lock over requirements.txt

e.g. as discussed in Discord

Yes, but there are a couple caveats. (1) requirements.txt is not automatically used — you need to manually construct the environment and remember to do so every time you change branches. In contrast, uv run automatically ensures that uv.lock is up-to-date and that all commands are run in a consistent environment. (2) uv.lock uses cross-platform resolution by default, requirements.txt only targets a single platform (though you can use the --universal flag to generate a cross-platform file). The uv.lock format is has more information about requirements in it and is designed to be performant and auditable.

I was just reading over the new docs for uv (which are great by the way!) and am just wondering about the use case for the uv.lock vs. requirements.txt? I understand that the uv.lock captures the current environment, is it not also the job for the requirements.txt to capture this? If so, would it make sense to have something like:
$ uv pip compile uv.lock -o requirements.txt

in order to capture the exact state of the environment, rather than relying on the pyproject.toml for instance? Perhaps I have misunderstood - but a small section in the docs to clarify may be helpful!

uv.lock resolves the dependencies declared in the pyproject.toml — it doesn't capture the current environment. Instead, the project's environment is constructed from the lockfile.
Similarly,requirements.txt can be generated from a pyproject.toml — but it also supports other sources, like a requirements.in file.
In both cases, you'd sync an environment with the lockfile. It's a matter of format. Unfortunately requirements.txt is an unspecified and complex format, which makes it hard to extend. In contrast, uv.lock has a bunch of information that lets us improve the performance of subsequent resolutions andensure that the environment is up-to-date before running commands. We also designed it to precisely track package sources for easy auditing.

uv.lock resolves the dependencies declared in the pyproject.toml — it doesn't capture the current environment. Instead, the project's environment is constructed from the lockfile.
Similarly,requirements.txt can be generated from a pyproject.toml — but it also supports other sources, like a requirements.in file.
In both cases, you'd sync an environment with the lockfile. It's a matter of format. Unfortunately requirements.txt is an unspecified and complex format, which makes it hard to extend. In contrast, uv.lock has a bunch of information that lets us improve the performance of subsequent resolutions andensure that the environment is up-to-date before running commands. We also designed it to precisely track package sources for easy auditing.

Hmm, yet another lockfile format. Not a biggie though, it's just a matter of regenerating it and using uv within your CI/CD instead of pip, etc.

We are engaging heavily in PEP 751 — which defines a standard for lockfiles. Once there's a standard, we plan to use it.

Let me know if this should go into a separate issue, but the one missing link for me with uv.lock is an ability to install from it independent of the project. The main use case on my mind is caching dependency installs with Docker (I note the docs highlight the way to do this with the pip interface, but I can't think of a way to do so with the lockfile at present).
I'm currently just duplicating the workflow by using uv pip compile to create a requirements.txt in addition to the lockfile, but would love to avoid this since it's hard to make sure that this is actually in sync with uv.lock, rather than a new resolution for the dependencies declared. (Plus removing the duplication is a side benefit, though not a huge deal)
Thanks for the fantastic work on uv!

@keatingw thank you! Extensive discussion about that at https://github.com/astral-sh/uv/issues/4028 — we should provide a way to do that soon.

In both cases, you'd sync an environment with the lockfile.

How?

@bjornasm
I'm not quite sure what you're looking for, but uv venv && uv pip sync requirements.txt or uv sync (for uv.lock)

Thanks for the answer @zanieb , I think then it warrants an bugreport from me, because uv sync seemed to overwrite the lockfile with what was in pyproj toml, not the other away as I expected. Will do another test to see if I can reproduce. (In either case I should also propose that this is added explicitly to the documentation, I cant seem to find the exact workflow of this stated anywhere).

uv sync will always re-lock the project, unless you pass --frozen. It's not a bug and it's well-documented.

The lockfile will never be used to update the pyproject.toml, the pyproject.toml is the source of truth of your dependencies. The uv.lock captures exactly which versions of your dependencies will be installed, within their constraints.

Thank you @zanieb and @charliermarsh , sorry for taking over this issue as it is clearly a separate (and individual?) issue with documentation. Since the lockfile was proposed to be added to source control, I inferred that it is the lockfile that should be used when setting up an existing (remote) project locally. But I guess that both the lockfile and pyproject.toml has to be added to source?
It would be great to have some workflow/use case based examples, for us who have not worked with .toml and lockfiles before, I would be glad to open up a separate issue for it, with some suggestions.


Update coursera_courses.go

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@4352e22). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #72   +/-   ##
=========================================
  Coverage          ?   41.23%
=========================================
  Files             ?        3
  Lines             ?      742
  Branches          ?        0
=========================================
  Hits              ?      306
  Misses            ?      400
  Partials          ?       36

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4352e22...85084fd. Read the comment docs.


Starting Hyprland from SDDM leads to frozen start up screen

When starting from SDDM, it will allow me to start Hyprland but it will get stuck on start up.
I'm running it on an arch virtual machine.

I am using SDDM too. Are you using the AUR package? It's currently broken. I should mention that in the wiki.

That would explain it. I am using the AUR packets, so I will try to compile from source and see if that fixes it

This issue is now fixed and should be closed, cc @vaxerski @MNolan147

okay, closing then.


Dev/v1.0.0

PR for ReconPi v1.0.0

Added all of the v0.2.0 projects/milestones

missing one commit


PHOENIX-6194 : Include slf4j-api dependency in phoenix-tools

@stoty could you please take a look?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 30s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

-1 :x:
mvninstall
37m 30s
root in master failed.

+1 :green_heart:
compile
0m 30s
master passed

+1 :green_heart:
javadoc
0m 16s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
40m 28s
the patch passed

+1 :green_heart:
compile
0m 33s
the patch passed

+1 :green_heart:
javac
0m 33s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s
The patch has no ill-formed XML file.

+1 :green_heart:
javadoc
0m 15s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
3m  0s
phoenix-tools in the patch passed.

+1 :green_heart:
asflicense
0m  9s
The patch does not generate ASF License warnings.

83m 50s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-926/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/phoenix/pull/926

Optional Tests
dupname asflicense javac javadoc unit xml compile

uname
Linux f3ad6d8bb78f 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev/phoenix-personality.sh

git revision
master / 1784848

Default Java
Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08

mvninstall
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-926/1/artifact/yetus-general-check/output/branch-mvninstall-root.txt

Test Results
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-926/1/testReport/

Max. process+thread count
579 (vs. ulimit of 30000)

modules
C: phoenix-tools U: phoenix-tools

Console output
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-926/1/console

versions
git=2.7.4 maven=3.3.9

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

mvninstall for patch is +1


Date support for mermaid Gannt charts is missing.

In the editor you could use a small sample gannt like the following.
```mermaid
gantt
dateFormat  YYYY-MM-DD
title Adding GANTT diagram to mermaid
section very
Completed task            :done,    des1, 2014-01-06,2014-01-08
Active task               :active,  des2, 2014-01-09, 3d
Future task               :         des3, after des2, 5d
Future task2              :         des4, after des3, 5d
```

I would expect the dates to be shown along the bottom legend but instead it is using generic week labels. w. 01, w. 02 ....
Is this status by design?

Enviroment
Value

Operating System
Windows 10

Browser
Chrome 68.0.3440.106

Seems axisFormat syntax is not supported.
Mermaid support that.
Hope someone could drop a PR.
See demo

Fixed with v5.14.10.


jsk_visualization: 1.0.34-0 in 'jade/distribution.yaml' [bloom]

Increasing version of package(s) in repository jsk_visualization to 1.0.34-0:

upstream repository: https://github.com/jsk-ros-pkg/jsk_visualization
release repository: https://github.com/tork-a/jsk_visualization-release.git
distro file: jade/distribution.yaml
bloom version: 0.5.22
previous version for package: 1.0.33-0

jsk_interactive

No changes

jsk_interactive_marker

No changes

jsk_interactive_test

No changes

jsk_rqt_plugins

No changes

jsk_rviz_plugins
* Fix for Ogre >= 1.9, which build fail on Jade on 14.10/15.04
* [jsk_rviz_plugins] add offset to footstep_display.h
* [jsk_rviz_plugin] Add rviz button interface for yes/no service request
* Contributors: Kei Okada, Kentaro Wada, Yohei Kakiuchi

jsk_visualization

No changes

This will resolve a problem at http://build.ros.org/view/Jbin_uU64/job/Jbin_uU64__jsk_rviz_plugins__ubuntu_utopic_amd64__binary/


TasitAction.NFT safeTransferFrom test case

Refs:
https://github.com/tasitlabs/TasitSDK/issues/134#issuecomment-456867538
https://github.com/OpenZeppelin/openzeppelin-solidity/blob/master/contracts/token/ERC721/IERC721.sol
Note: First, issue https://github.com/tasitlabs/TasitSDK/issues/155 should be solved.

@marcelomorgado I think we can close this

Yep. Closing.


Introduce GRPC_PROXY EnvVar Support

Introduce the ability to specify a dial context for GRPC connections.

Please take a look @kevinrizza @estroz

/retest

/hold

/unhold

/lgtm

/hold
looks like some related unit tests are failing.

/lgtm
/hold cancel
looks like the unit test may have been on a stale commit

/lgtm

/cherry-pick release-4.9


Bash not starting in current directory for virtual drive

Your Windows build number:  (Type ver at a Windows Command Prompt)
10.0.15063
Ubuntu 16.04.2 LTS

What you're doing and what's happening:  (Copy&paste specific commands and their output, or include screen shots)

C:\Windows\System32>cd \
C:\>bash
user@pc:/mnt/c$ exit
C:\>A:
A:\>bash
user@pc:~$

What's wrong / what should be happening instead:
bash should start in /mnt/a
A is a virtual drive created by veracrypt. It is working fine for D:.
It worked fine in ubuntu 14 before the creators update. Now I use ubuntu 16.

WSL doesn't currently support all kinds of virtual drives.
First of all: The only volumes that are automatically mounted nowadays are fixed ntfs volumes with an assigned drive letter.
All other mounts, including mounts of volumes on empty directories, must be manually set with the mount command in WSL:
This blogpost explains exhaustively all the current supported filesystems.
https://blogs.msdn.microsoft.com/wsl/2017/04/18/file-system-improvements-to-the-windows-subsystem-for-linux/

The drive is auto-mounted. If I type "cd /mnt/a" in bash it is working. The only thing that doesn't work is going there automatically when I start bash in "A:". It was working in ubuntu 14.04 before the creators update.

Weird

Could you take ba trace for us? Instructions are on our readme.

Do you mean the logman command?

@amiram - correct, the logman command to collect .etl traces.  Thanks in advance!

``
etl.zip

Also found this to be the case, but with a subst mounted virtual drive. In my case, subst W: C:\Work and I then mount it in WSL with mount --bind /mnt/c/Work /mnt/w since mount -t drvfs W: /mnt/w doesn't work (wrong fs type).
The above bind mount results in:
$ mount
C: on /c type drvfs (rw,noatime,uid=1000,gid=1000)
C: on /mnt/w type drvfs (rw,noatime,uid=1000,gid=1000)

Then trying to start bash/WSL from a normal command prompt while on the virtual drive doesn't find /mnt/w and just drops into ~.

This is the same issue as #3246, for which a fix is inbound.

I have a solution with the help of busybox "realpath"
The command line like this:
cmd.exe / c pushd "% V" && c:\tools\busybox\bash -c "relp = realpath .; cd $ {relp}; wsl "

Your Windows build number:  (Type ver at a Windows Command Prompt)
10.0.15063
Ubuntu 16.04.2 LTS
What you're doing and what's happening:  (Copy&paste specific commands and their output, or include screen shots)

C:\Windows\System32>cd \
C:\>bash
user@pc:/mnt/c$ exit
C:\>A:
A:\>bash
user@pc:~$

What's wrong / what should be happening instead:
bash should start in /mnt/a
A is a virtual drive created by veracrypt. It is working fine for D:.
It worked fine in ubuntu 14 before the creators update. Now I use ubuntu 16.


Link opening on Safari not App

Can be seen on Muneer’s phone

Please investigate around the app association file -
http://hexawallet.io/apple-app-site-association

@abdulmuneer22

@abdulmuneer22  can you test it on the latest dev app, I think it will fail.
Did the steps I send help or you tried something else>

this issue can be recreated only on very specific phones at this stage we can provide steps to reset the phone as per below section  App specific links are not opening on my iOS device?
on FAQ page - https://hexawallet.io/faq/
added as part of defect - https://github.com/bithyve/hexa/issues/1616

-Verified this on Dev app version 1.3.0(155),Link opening on app.


Bug in atomic operations on aarch64 with multi-threading

There seems to be a bug with atomic operations in multi-threaded mode (-Dpreview_mt) on aarch64.
It was discovered through use of atomic operations in Crystal::SpinLock for guarding Channel access.
This is a reproducible (yet not very minimalized) example that should fail due to invalid memory access:
# build with `crystal build -Dpreview_mt` on aarch64
require "socket"
require "log"

NUMBER_OF_CLIENTS = 100

Log.setup_from_env(default_level: Log::Severity::Info, backend: Log::IOBackend.new(dispatcher: Log::AsyncDispatcher.new(buffer_size: 256)))

def handle_client(client)
  Fiber.current.name = "client #{client.remote_address.to_s}"
  Log.info { "new client connected" }
  loop do
    msg_length = UInt32.from_io(client, IO::ByteFormat::SystemEndian)
    msg = client.read_string(msg_length)
    Log.info { "Got: #{msg}" }
    response_msg = "Ok #{Random.rand}"
    response_msg.bytesize.to_io(client, IO::ByteFormat::SystemEndian)
    client.write_string(response_msg.to_slice)
  end
end

sync = Channel(Nil).new
server_fiber = spawn(name: "server") do
  Log.info { "creating server" }
  TCPServer.open("localhost", 12345) do |listener|
    sync.send nil
    while client = listener.accept?
      spawn handle_client(client)
    end
  end
end

sync.receive

NUMBER_OF_CLIENTS.times do |i|
  spawn do
    TCPSocket.open("localhost", 12345) do |server|
      Fiber.current.name = "server #{i}"
      loop do
        msg = "hello #{Random.rand}"
        msg.bytesize.to_io(server, IO::ByteFormat::SystemEndian)
        server.write_string(msg.to_slice)
        response_length = UInt32.from_io(server, IO::ByteFormat::SystemEndian)
        response_msg = server.read_string(response_length)
        Log.info { "Got: #{response_msg}" }
      end
    end
  end
end

sleep

This bug is confirmed to appear on aarch64-apple-darwin as well as aarch64-unknown-linux-gnu (although I have not been able to reproduce it on linux yet). x86 architectures seem to be unaffected.
As a workaround we can use Thread::Mutex instead of SpinLock for Channel. This has of course an impact on performance.

diff --git i/src/channel.cr w/src/channel.cr
index 74010d9c2..15efda377 100644
--- i/src/channel.cr
+++ w/src/channel.cr
@@ -23,7 +23,11 @@ require "crystal/pointer_linked_list"
 # will be indistinguishable from a closed channel.
 #
 class Channel(T)
-  @lock = Crystal::SpinLock.new
+  {% if flag?(:preview_mt) && flag?(:aarch64) %}
+    @lock = Thread::Mutex.new
+  {% else %}
+    @lock = Crystal::SpinLock.new
+  {% end %}
   @queue : Deque(T)?

   # :nodoc:
diff --git i/src/crystal/system/thread_mutex.cr w/src/crystal/system/thread_mutex.cr
index e3cf9ffeb..1222d7834 100644
--- i/src/crystal/system/thread_mutex.cr
+++ w/src/crystal/system/thread_mutex.cr
@@ -14,6 +14,12 @@ class Thread

     # Locks the mutex, yields to the block and ensures it unlocks afterwards.
     # def synchronize(&block)
+
+    def sync(&)
+      synchronize do
+        yield self
+      end
+    end
   end
 end

A potential angle for a fix could be this: https://www.llvm.org/docs/Atomics.html

Atomic operations are represented in the SelectionDAG with ATOMIC_* opcodes. On architectures which use barrier instructions for all atomic ordering (like ARM), appropriate fences can be emitted by the AtomicExpand Codegen pass if setInsertFencesForAtomic() was used.

However, it's not clear if and what we would need to do for that as it's understood this would be handled implicitly by LLVM.

l = Crystal::SpinLock.new
q = Deque(Int32).new(initial_capacity: 10)

200.times do |i|
  spawn do
    loop do
      l.lock
      if q.size < 10
        q << i
      end
      if q.@capacity > 10
        raise "BUG: q.@capacity=#{q.@capacity}"
      end
      l.unlock
      Fiber.yield
    end
  end
end

spawn do
  loop do
    l.lock
    if i = q.shift?
      puts i
    end
    l.unlock
    Fiber.yield
  end
end
sleep

This also reproduces the bug.

Just to bring it to the protocol: this also affects e.g. Mutex, which is using Atomic and SpinLock internally. It's possible to use a Mutex in the above example to get the same result.

I took a look at this after a conversation with @bcardiff. The atomic implementation is fine from what I understand, but the problem is the compiler does not emit memory barriers at the lock/unlock points. This means the atomic operations are executed correctly and the sequential consistency is maintained for them, but not for the rest of the memory. Since ARM has a weak consistency memory model, there is nothing preventing the CPU from reordering the final write to the Deque object and executing it after the SpinLock was unlocked (thus allowing a second thread to read a stale state for the deque).
Warning: I don't have a ARM processor at hand to try this. All of what I'm saying is inferred from reading the linked LLVM document and these additional two posts and inspecting the assembler output for the given test program. Just saying I may be way off :grin:
A blunt approach to fixing this would be to insert an acquire-release memory barrier right before the unlock. From what I can see that does generate a dmb ARM instruction which should prevent reordering writes and ensure all threads have a consistent view of the Deque.
l = Crystal::SpinLock.new
q = Deque(Int32).new(initial_capacity: 10)

@[Primitive(:fence)]
def fence(ordering : LLVM::AtomicOrdering, singlethread : Bool) : Nil
end

200.times do |i|
  spawn do
    loop do
      l.lock
      if q.size < 10
        q << i
      end
      if q.@capacity > 10
        raise "BUG: q.@capacity=#{q.@capacity}"
      end
      fence :sequentially_consistent, false   # <---- HERE
      l.unlock
      Fiber.yield
    end
  end
end

spawn do
  loop do
    l.lock
    if i = q.shift?
      puts i
    end
    fence :sequentially_consistent, false    # <---- HERE
    l.unlock
    Fiber.yield
  end
end
sleep

A better approach would be to add memory ordering modifiers to the SpinLock class and allow the compiler to emit more fine-grained fences.
I'm not sure if there is anything to be tweaked for the LLVM backend. The emitted assembler looks sound from a semantic point of view regarding the atomic behavior. It uses ldaxr and stlxr instructions which implement more granular memory barriers. I'm sure there are cases when issuing a global memory barrier on each atomic operation is the wrong thing to do.

🎉 it seems to work here. A simpler monkey patch would be
class Crystal::SpinLock
  def unlock
    ::Atomic::Ops.fence :sequentially_consistent, false
    previous_def
  end
end

Anyone else wants to validate?

Nice!
A couple more things to consider:

It may be necessary to also add a memory barrier in SpinLock#lock as well. Using the same reasoning, it should otherwise be possible for the CPU to reorder a read operation that in the code happens inside the synchronized block to happen before it begins. That's another reason to try to use a more granular barrier: an acquire barrier in #lock and a release one in #unlock.
Since the barriers don't seem to be necessary in x86 (I assume due to the non-weak (strong?) memory model), it would be desirable to avoid emitting them for that architecture.
Should Atomic::Ops be exposed more publicly in the stdlib? Maybe wrapped in a slightly higher level API.

It may be necessary to also add a memory barrier in SpinLock#lock as well.

Before the set, right? Or after it?

After obtaining the lock, after the outer while in #lock.

Yeah, I thought about that too. But std::atomic allows you to specify the memory ordering guarantees that you want. That's not something we have in Atomic. There may be instances where you don't need the ordering guarantees and the current semantics of Atomic would be enough. That's the minimalist approach. But I agree we should be careful with making the semantics explicit (in the documentation at least) to avoid pitfalls for people coming from other languages. Either that or we choose different names for the concepts.

I believe all of our atomic operations are already sequentially consistent since that is what we pass to LLVM, the culprit may be the use of Atomic#lazy_get and #lazy_set.

It's true that atomic operations are sequentially consistent. But for ARM at least, that only ensures sequential consistency on the atomic themselves. Memory barriers are required to synchronize the rest of the memory. I don't think the use of Atomic#lazy_set in SpinLock is harmful because it's the release of the lock. If I understand correctly, it could only delay a pending lock a bit.

I'm wondering again if Atomic::Flag shouldn't be safe by default and maybe exposing fences. That's something important for MT on CPUs with weak memory models.
Reading into the linked articles again, I don't understand the requirement for an explicit memory barrier while we already have the explicit sequentially consistent memory order in the atomics...
Both articles talk about MSVC that does put generate explicit memory barriers for AArch64. I built Aarch64 binaries using stdatomic in C11 and std::atomic in C++11 with clang-12 (the one I have on hand) and I don't see explicit memory barriers being written. But this is only for the atomics, what about locks?
Exploring the internals of musl-libc the atomics use the same set of instructions (LDAXR/STLXR/CNBZ) but does set an explicit memory barrier (DMB ISH) in atomic CAS for AArch64.
The SpinLock in the linux kernel for ARM64 explicitly states:

The memory barriers are implicit with the load-acquire and store-release instructions.

The difference is as @HertzDevil is pointing: the #lazy_set in Crystal::SpinLock (and RWLock, ...) which are breaking the atomic contracts.
That being said, it seems we should have a memory barrier on ARM (v6 and v7).


rnaseq_cgl_pipeline.py requires toil_scripts

When I try to run launch_cgl_mesos.sh from toil-master, I get
/usr/bin/python: No module named toil_scripts.rnaseq_cgl
How do I install toil-scripts ?

  The top line in the launch script should be adding toil-scripts/src to the PYTHONPATH
export PYTHONPATH=$(python -c 'from os.path import abspath as a, dirname as d;import sys;print d(d(d(a(sys.argv[1]))))' $0)
I clone the repo, then call the launch script:
./toil-scripts/src/toil_scripts/rnaseq_cgl/launch_cgl_mesos.sh

Why would I want to clone the full repo if I only need two scripts? Is that a new way of doing things?

I git clone to a local directory, then cgcloud ssh the things I need.
I guess ssh to the master, then git clone wouldn't be any harder than what I'm doing.

Why would I want to clone the full repo if I only need two scripts?

So you can import functions from other scripts, common libraries, etc. This is an ongoing effort to minimize the amount of duplicated code that's in every script: https://github.com/BD2KGenomics/toil-scripts/pull/190

Makes sense. Outside the scope of this ticket, but I would like a way to set up a toil cluster with all necessary requirements (s3am, git...)

Either
cgcloud ssh toil-leader git clone https://.../toil-scripts
or
git clone https://.../toil-scripts  && rsync toil-leader -av toil-scripts :

Outside the scope of this ticket, but I would like a way to set up a toil cluster with all necessary requirements (s3am, git...)

I would do this by writing a cgcloud plugin that extends ToilBox (and hence toil-box) with whatever software you need. This is (insufficiently) documented here
https://github.com/BD2KGenomics/cgcloud/blob/master/core/README.rst#customization


Manual upstream sync - Set "minimum" tag in Makefile

Sync from upstream:

https://github.com/open-cluster-management-io/governance-policy-propagator/pull/72

/cherry-pick release-2.6

/cherry-pick release-2.5


Document building Oracle XE docker image

Oracle Express Edition build instructions
The Oracle blog article links to GitHub docker images. For single instance databases the README file says "This project offers sample Dockerfiles for... Oracle Database 18c (18.4.0) Express Edition (XE)"
https://github.com/oracle/docker-images/blob/main/OracleDatabase/SingleInstance/dockerfiles/18.4.0/Dockerfile.xe
Notes:
Oracle Database 18c Express Edition requires a minimum of 1GB of physical memory (RAM).
1GB RAM is also the requirement for building the docker image.
sudo apt update
sudo apt install git

mkdir docker; cd docker

# https://docs.docker.com/engine/install/debian/#install-using-the-convenience-script
curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh

git clone https://github.com/oracle/docker-images.git
cd docker-images/OracleDatabase/SingleInstance/dockerfiles/18.4.0

sudo docker build -t opencdms/oracle:18.4.0-xe -f Dockerfile.xe .
sudo docker login
sudo docker push opencdms/oracle:18.4.0-xe

Start the container and run an interactive terminal in the container. Set the admin password and check you can access the database.
./setPassword.sh admin
sqlplus

opencdms/oracle:18.4.0-xe was built from the official Oracle docker repository but it fails to log in (even when connecting locally from an interactive terminal inside the container using SQLPlus) with the notoriously difficult to debug error: ORA-12547: TNS:lost contact
or...
Listener refused the connection with the following error:
ORA-12514, TNS:listener does not currently know of service requested in connect descriptor

This error is documented here: https://asktom.oracle.com/pls/apex/asktom.search?tag=ora-12547-tns-lost-contact-error-in-oracle-linux-7x
We're switching to using a pre-built image: https://hub.docker.com/r/oracleinanutshell/oracle-xe-11g


Add option to only estimate commands fee without executing them

Which component is your feature related to?
Cast
Feature Request

Commands that require a fee for execution should have an option to estimate the fee without executing the command.

From the CLI, this should be implemented as a boolean flag.

Commands that need this option:

account deploy
deploy
invoke
declare
multicall run

Please check if there are more commands that would benefit from this change.

@cptartur suggested doing something like --dry-run flag with a redirection to an estimation endpoint


Feature/gcs

Hi! Just looking around... :)
If I understood well, now the operator GithubToS3Operator can send a Github object to either S3 or GCS. Maybe it is missing to rename the operator? 💭

Hi @WesleyBatista!
 Wanted to broaden the capabilities so it could be compatible with GCP and now that it is, it deserves a name change. Thanks for catching that!


Contradicting Documentation

This documentation page says to enable Block at First site, the following setting must be enabled:
Cloud-delivered protection: Enable
However, there is another Microsoft documentation page that contradicts this and says it must be set to "Not Configured" - and then in the GitHub closed cases, if it is set to Enabled, that it actually means Cloud-delivered protection is Disabled
"On the Cloud-delivered protection switch, select Not configured"
https://docs.microsoft.com/en-us/windows/security/threat-protection/windows-defender-antivirus/enable-cloud-protection-windows-defender-antivirus
see the GitHub case https://github.com/MicrosoftDocs/windows-itpro-docs/issues/3762
I also raised this question on Twitter to @HeikeRitter here: https://twitter.com/ITguySoCal/status/1199488449562075136

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9bd0fe29-5db5-b752-5bcf-5ac2581baa9a
Version Independent ID: 52b8d4ca-54ea-7345-12b0-df4fdf633083
Content: Enable Block at First Sight to detect malware in seconds
Content Source: windows/security/threat-protection/windows-defender-antivirus/configure-block-at-first-sight-windows-defender-antivirus.md
Product: w10
Technology: windows
GitHub Login: @denisebmsft
Microsoft Alias: deniseb

@itguysocal - I left feedback on the page about the "Disabled" behavior being wrong, and they have since fixed it. Use "Enabled" for this feature to work.

Thank you! We sincerely appreciate your assistance with this.


Lecture Units: Mark as completed not saved.

Describe the bug
When you mark lecture units as completed and you reload the page they are no longer marked as completed.
This must be a server-side bug as the Android app faces the same issue.
To Reproduce
Look above.
Expected behavior
Should be saved instead of forgotten.
Screenshots
No response
Which version of Artemis are you seeing the problem on?
5.12.9
What browsers are you seeing the problem on?
Chrome
Additional context
No response
Relevant log output
No response

this is working in 6.0


Include package-lock.json

It is good practice to include this file, otherwise it gets generated anytime a developer runs npm install in the developement directory of the plugin

Thanks for your feedback!
This project uses yarn 🙌


Enable Travis CI

Current coverage is 82.45% (diff: 100%)

No coverage report found for master at 7056e59.

Powered by Codecov. Last update 7056e59...aef5db0


Review new SF building footprint

Check if this is worthwhile to include in the current import plan.
URL: https://sfgis-svc.sfgov.org/sfgis/San_Francisco_Bldg_withZ_20161028.zip
License:  CC0

One possibility is to conflate OSM footprints with the official footprints for some threshold of agreement (>75% shared area?) and then take the LIDAR max value from that. It seems worth comparing that value to the one we're using.

I've been made aware that the building footprints "...withZ_20161028.zip" do include updates of backyard structures in many residential neighborhoods.  This would have been interpreted from our 2015-06 through 2015-10 orthophoto.  Yes, it actually took five months to get the 2015 ortho completed.  ;^)

The LiDAR-derived height model has 50cm gridding, which provides about 400-600 samples for each typical residence roof in the Sunset and Richmond districts.  The airborne perspective is much more resistant to misinterpreted false fronts of buildings than a StreetView curb-level or Pictometry/Eagle View oblique measure of height.  https://goo.gl/maps/cwpWjTXG8CD2  for example

I reviewed the San_Francisco_Bldg_withZ_20161028.zip data by comparing with the same samples we used previously.  For the purpose of comparison, I used the gnd1st_delta field as the height value.  The overall variance is not very big, the total average is ~1.8 meters and there is good agreement with both samples.

There were edge cases where LiDAR derived heights differ from New SF data, primarily when the building outline is different or slightly offset.  Some examples below (yellow-OSM, purple-SF gov data).
Almost perfect match of geometry and height.
OSM misaligned, SF data height is greater by 2 m.
OSM not properly traced, the higher adjacent building height was included resulting to a height difference of 44 m.
Complex buildings in SF data, simplified trace in OSM.
Open questions

New SF data seems to have a much more accurate height compared to our LiDAR derived heights, but the measurements were based on median values.  Per OSM's convention, we should use the maximum height.  How do we reconcile this?
Although this is rare, some  OSM buildings were poorly traced when compared to SF data and Bing imagery.  As a result, LiDAR derived heights might be wrong.  Should we included geometry  from SF data as part of the import?  This will change our conversion tools and eventually or workflow.

Process of evaluation

Convert SF geodatabase to shapefile and retroject to EPSG:4326.
ogr2ogr -f "ESRI Shapefile" -t_srs EPSG:4326 sf13m_BldgFoot_withZ_20161005_pgz_4326.shp SF_Bldg_201610.gdb "sf13m_BldgFoot_withZ_20161005_pgz"
Load both OSM data and SF data in QGIS.
Compare height results for each sample in this spreadsheet.

Notes

gnd1st_delta - was defined as the "difference of median first return surface - minimum bare earth surface in meters".

@bdon @chtnha @bqb

I'm apprehensive about adding, removing or replacing geometry as this will significantly increase the scope of this project, and also could overwrite mapper's hard work (suppose there are places where the OSM geometry is better or newer than SF?)
Here's a proposal: we keep everything the same as before, but only tag buildings that have a high geometry agreement with the SF gov data. That way we don't tag buildings that potentially wrong height values from being misaligned.
I wonder if we set the threshold at 80% agreement, for example, what % of the current ~150,000 buildings are still valid. Will investigate

The SF buildings contain over 30 zonal statistics to provide options beyond the most robust median.  The values emphasize absolute elevations first, and various estimates for building height can be derived.
The "gnd" ground surface model was natural neighbor interpolated from only ground-classed LiDAR returns.  So every building footprint had no ground returns beneath it, and that model often interpolates from front to back edges of the structure.
Our preferred statistic would be "hgt_Median_m" because that is the median of grid-cell-wise separation between the ground and first-return surfaces.  If better agreement is found with "gnd1st_delta_m" then that might suggest a bias toward greater height makes a better fit.
These sort of areas motivated our selection of input building footprints

The building height model for this area was thus

The OSM footprints that I presume were from Bing roooftop traces fit like this

And the DataSF footprints that had been derived from building masses at the time of LiDAR acquisition fit more closely.

Again, the statistics have been oriented mostly toward placing buildings at absolute heights, and the Z elevation of the 2D polygons has been set to minimum intersected bare-earth elevation.  The median roof elevation from first-return surface is rather robust for most city structures that aren't pyramid-shaped or severely overhung by trees.
If ogr2ogr is used to bring the footprints into WGS84 geographic/4326 there will likely be a systematic ~2 foot horizontal offset relative to the NAD 1983 (2011) reference system used in our 7131 and 7132 systems.  Our city orthos turn out to have been delivered with that GRS since 2014, although we only figured that out a couple of months ago.  The epoch difference (2010 - 1984) of 26 years actually adds up noticeably.

If we limit the buildings we tag to only those with an area threshold match vs. the SFdata footprints:
select f.* from features f, wm84_bldgfoot_withz_20161005_pgz w
	where ST_Intersects(f.geometry, w.wkb_geometry)
	and st_area(st_intersection(f.geometry, w.wkb_geometry)) / st_area(f.geometry) > 0.8
	and st_area(st_intersection(f.geometry, w.wkb_geometry)) / st_area(w.wkb_geometry) > 0.8

Out of a total of 165825 tagged OSM buildings:
0.6: 148435 (90%)
0.7: 142695 (86%)
0.8: 126837 (76%)
0.9: 91926 (55%)

Thoughts on median/max:
If we continue to use the LIDAR value calculated from OSM footprints, the median accuracy is adversely affected by the footprint being misaligned - consider an OSM footprint shifted 2 meters to the east relative to the LIDAR building. The median calculation then includes all those 0 or street level pixels that shouldn't be included

We are now using SF building data median height.


Thank you! 🙏

I want to thank you for this library! It helps a lot in my side-projects! ❤
Keep it up! 💪🏻

That's nice to hear, im using it in my side-projects too! Love to help you out❤


tvOS Compatibility

Missing functionnality
Hi 👋 ,
Looking to please request tvos compatibility to pull in data from our Jamf instance to Apple TV Dashboard.
Platform syntax in podfile:
platform :tvos, '10.0'
pod install returns:
[!] The platform of the target `Dashboard` (tvOS 10.0) is not compatible with `JAMFKit (0.3.0)`, which does not support `tvos`
Thank you! :)
Miscellaneous

Information
Value

Language
Swift

Platform
tvOS

Platform version
10.0

JamfKit version
latest as of March 3rd 2018

Package manager
CocoaPods

Package manager version
1.3.1

XCode version
9.2

Hi @jeffreyjbrown,
Thanks for pointing that missing compatibility. I've started working on adding the tvOS capability, it should be part of the v0.4.0 release.

@jeffreyjbrown the tvOS compatibility has been implemented by #79.


cloudtrail.amazonaws.com works for aws:CalledVia in a bucket policy

The below bucket policy works with aws:CalledVia and cloudtrail.amazonaws.com. Removing the second condition prevents CloudTrail from sending logs to the bucket.
Is there a way to confirm that cloudtrail.amazonaws.com is now supported with aws:CalledVia?
{
            "Sid": "DenyExternalPrincipals",
            "Effect": "Deny",
            "Principal": "*",
            "Action": "s3:*",
            "Resource": [
                "arn:aws:s3:::aws-landing-zone-org-trail-logs-[ACCOUNT ID]-us-east-1",
                "arn:aws:s3:::aws-landing-zone-org-trail-logs-[ACCOUNT ID]-us-east-1/*"
            ],
            "Condition": {
                "StringNotEquals": {
                    "aws:PrincipalOrgID": "[ORG ID]"
                },
                "ForAnyValue:StringNotEquals": {
                    "aws:CalledVia": "cloudtrail.amazonaws.com"
                }
            }
        },

Thanks for your question. I'll check with the IAM team to see if they can confirm that it should work. If it does, I will update the list of supported services in our documentation: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_condition-keys.html#condition-keys-calledvia.

Thanks again for your question. The services listed in the documentation represent the services we support. We do not recommend using the key with any service that is not listed as supported. We will keep the documentation up to date with the list of supported services.


configuration environment issues

Hi,good job!
I have a problem, please help me.
pip install -e torch_fidelity_lib
ERROR: File "setup.py" or "setup.cfg" not found. Directory cannot be installed in editable mode: /media/sdb/wd/test_code/CIPS-3D/torch_fidelity_lib

Duplicated with #6 .


Filtering gives redundant node results in CreateNewNode Dialog

Godot version:

3.2.3, 3.2.4rc3
OS/device including version:

Linux
Issue description:

Filtering gives redundant node results in CreateNewNode Dialog
Steps to reproduce:

Minimal reproduction project:

cc @rcorre

By "redundant" do you just mean "things that don't match the filter string"?
Is the intention of this dialog to "filter" or just to "search"? I'm not actually sure if it is working as intended or not.

Yep there are results that don't match the filter string, like KinematicBody2D, CollisionShape2D when the string is line.
The expected results are Line2D, LineEdit etc that is results which have line.

I think what is happening here is this:

A string matches if it contains the characters you typed in order (but other characters can be between them!)
A node matches if its parent node matches

ColisionObject2D matches, therefore its children like KinematicBody are all shown. I actually think both these behaviors are desireable. For example, I can find KinematicBody by typing kbod. Similarly, I can see all types of ranges by typing Range. What you're seeing is a slightly confusing side-effect of that, which I don't think is too annoying since the dialog typically focuses the best match (e.g. if I type line<enter> real fast I still get a Line2D).

Ok, we see 2 features of node search here:

ColisionObject2D (when typing line) and
Searching in parent classes as well.

I think the main issue is the first one.
Imo this is how search shouldn't work, it's just annoying.
You enter fewer characters, but spend more time choosing from a large number of results.
As for (2) this sometimes makes sense, sometimes you may need it and sometimes not. So I think a proposal could be created like "Add checkbox named Search in parent classes.

Imo this is how search shouldn't work, it's just annoying.

I think that's highly subjective. Some folks probably think like you do, but others like me are really annoyed when we do have to type in the characters in exact sequence.
Other good filtering UX I'm familiar with, such as fzf, youcompleteme, and the blender F3 menu all behave like this. It is also consistent with other filtering UIs within Godot such as the quick-open-scene menu.
A good practical example of where this works well: lets say I want to add a PopupMenu.

In case all that sounded too critical -- I think it is good to challenge these UIs and make them better! Maybe we can improve this one somehow, but I don't want to lose the existing filtering behavior (or complicate it with a variety of different search behaviors you have to choose between).
Also, this might be a "proposal" rather than a bug, since this behavior goes all the way back to Godot2.

IMO this type of filtering works best if exact matches are given a higher precedence than fuzzy matches. So it's cool if pm matches PopupMenu, but line should definitely match Line2D or other nodes with the exact line substring first.

To be clear, typing line does focus Line2D first. It just happens to show other less-obvious matches around it.

I suppose one option would be to work like qutebrowser, which treats whitespace as .*. So line would only match names that contain the characters "line" in sequence, but k bod would match KinematicBody. I would still prefer the current behavior, but this could be a middle-ground.

Ah ok, I was just confused by the screenshot where KinematicBody2D is highlighted. IMO the current behavior is fine as is, but we could maybe do a better job at conveying that it actually does subsequence matching. Maybe highlighting matched characters in results? And/or lowering opacity of non-exact matches?

+1 to lowering opacity of non-exact matches, that would handily solve the problem of "why does it show kinematicBody and not line2d" without getting rid of the utility that fuzzy matches offer to some.

Opacity seems like a good solution. Another option is to highlight matched characters (screenshot from Qutebrowser):

that's a little more work (since you have to pull out regex groups) but it does make it obvious why something matched.

@akien-mga @rcorre This issue is already fixed in master with #40033 by implementing search ranking. Highlighting matched characters is fine, but somewhat unnecessary as you can almost always select the result the user wants after typing 2-3 characters with proper ranking.

What remains confusing is that the selected item will jump around in the search results window as you type new characters. I have found that centering the selected item in the middle of the result window helps a lot (see #40140), especially if you type fast.
More on topic: The issue here is not about filtering, but about ranking. With exact filtering you will still get into situations like this, just less often. It will also prevent people from searching for something like "kin3D" to get a KinematicBody3D node without typing the full length name.
Perhaps it would be good to have add a Quick Create New Node dialog akin to Quick Open with the same results as the regular dialog, but without building up the inheritance tree for each result.

Hmm so the desired result of pm finding PopupMenu and the desired result of finding Line2D when searching line are still very different than the result we are getting which has line found in CollisionObject. It might be useful to only focus on searching, not filtering, then add word separation to the searching. E.g. pm would work because PopupMenu starts with P and M words (capitalization.) but it wouldn't incorrectly find CollisionObject for line but it would pop up with CO because CollisionObject.
Just a thought. This way feels like the best of both worlds while trying to ignore garbage results. I don't think anyone looks at CollisionObject and things "line" but they think ColObj or CoOb or CO. So the focus might be better on thinking what the user is looking for and displaying it like search rather than a pure filter of if these words contain these letters in this order.

That sounds fine to me. That should lower the amount of spurious results significantly, and with the inheritance tree every result adds a lot of visual complexity. I think the benefits outweigh the few instances where these results might be useful. I will take a stab at implementing this soon.

E.g. pm would work because PopupMenu starts with P and M words (capitalization.)

YouCompleteMe implemented this sort of ranking very well, you might peek at their code for reference. It might be more complicated than what we need here, but as a user it felt like magic :)


Parsing hang fix

Change Summary
This PR fixes the problem referenced in #148, and it includes a mild refactor.  This PR changes the run_command method to accept an asynchronous argument and skip error checking / early exit when True.  Then, to assure that the arguments to the self.shell part of the remote command are correct (i.e., uses -lc when not using csh-style shells), the call to remotely launch Jupyter Lab is sent using run_command, to be consistent with all other remote commands used throughout Jupyter Forward.
Related issue number

Closes #148
Checklist

[x] Unit tests for the changes exist
[x] Tests pass on CI
[X] Documentation reflects the changes where applicable

It is my belief that this change is internal and doesn't need additional documentation.
A test of the run_command method should be added to test the asynchronous argument.

Tested it on Windows 10 WSL2, works great -- opens browser tab and everything:
$ jupyter-forward rsignell@denali --launch-command "srun -A woodshole -N 1 -t 00:30:00" --conda-env pangeo --port 8889
************************************************************************************** Authenticating **************************************************************************************
Authenticating user (rsignell) from client (IGSAGIEGLTRSI10) to remote host (denali.cr.usgs.gov)
✅ The client is authenticated successfully
********************************************************************************* Verifying shell location *********************************************************************************
✅ Using shell: /bin/bash
****************************************************************************** Running jupyter sanity checks *******************************************************************************
/bin/bash -lc "source activate pangeo && which jupyter"
/home/rsignell/miniconda3/bin/jupyter
*************************************************************************  Creating log file on denali.cr.usgs.gov *************************************************************************
/bin/bash -lc "printenv TMPDIR"
/bin/bash -lc "printenv HOME"
/home/rsignell
/bin/bash -lc "touch $HOME/foobar && rm -rf $HOME/foobar && echo '$HOME is WRITABLE' || echo '$HOME is NOT WRITABLE'"
/home/rsignell is WRITABLE
/bin/bash -lc "mkdir -p $HOME/.jupyter_forward"
✅ Log directory is set to $HOME/.jupyter_forward
/bin/bash -lc "touch $HOME/.jupyter_forward/log_2022-03-26T07-15-14.txt"
✅ Log file is set to $HOME/.jupyter_forward/log_2022-03-26T07-15-14.txt
******************************************************************************** Preparing Batch Job script ********************************************************************************
/bin/bash -lc "echo -n '#!' > $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14"
/bin/bash -lc "echo /bin/bash -l >> $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14"
/bin/bash -lc "echo 'source activate pangeo && jupyter lab --no-browser --ip=\$(hostname -f) > $HOME/.jupyter_forward/log_2022-03-26T07-15-14.txt 2>&1' >> $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14"
/bin/bash -lc "chmod +x $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14"
✅ Batch Job script resides in $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14
********************************************************************************** Launching Jupyter Lab ***********************************************************************************
/bin/bash -lc "srun -A woodshole -N 1 -t 00:30:00 $HOME/.jupyter_forward/batch_job_script_2022-03-26T07-15-14"
******************************************************************************** Setting up port forwarding ********************************************************************************
remote_host: nid00025, remote_port: 8888, local_port: 8889
************************************************************************ Opening Jupyter Lab interface in a browser ************************************************************************
Jupyter Lab URL: http://localhost:8889
*********************************************************************************************  *********************************************************************************************
/bin/bash -lc "tail -f $HOME/.jupyter_forward/log_2022-03-26T07-15-14.txt"
[I 2022-03-26 06:16:13.500 ServerApp] jupyter_server_proxy | extension was successfully loaded.
[I 2022-03-26 06:16:13.501 LabApp] JupyterLab extension loaded from /home/rsignell/miniconda3/lib/python3.9/site-packages/jupyterlab
[I 2022-03-26 06:16:13.501 LabApp] JupyterLab application directory is /home/rsignell/miniconda3/share/jupyter/lab
[I 2022-03-26 06:16:13.505 ServerApp] jupyterlab | extension was successfully loaded.
[I 2022-03-26 06:16:13.506 ServerApp] Serving notebooks from local directory: /home/rsignell
[I 2022-03-26 06:16:13.506 ServerApp] Jupyter Server 1.13.4 is running at:
[I 2022-03-26 06:16:13.506 ServerApp] http://nid00025:8888/lab
[I 2022-03-26 06:16:13.506 ServerApp]  or http://<IP_ADDRESS>:8888/lab

@kmpaul or @andersy005, could we cut a new release so folks can install from conda-forge?

@rsignell-usgs, the latest version is available on PyPI. it might take a while for it to be available on conda-forge


adds table-layout

Per #187

After this one gets merged up I'll release 0.4.2 and update docs.

:+1:


flaky test -- Error: Text file busy

I've seen a new issue pop up on some of the recently merged commits:

https://github.com/denoland/fresh/actions/runs/6955879237/job/18925570743#step:10:937
https://github.com/denoland/fresh/actions/runs/6942541716/job/18885712146#step:10:915
https://github.com/denoland/fresh/actions/runs/7020837075/job/19101492223?pr=2083#step:10:1245
https://github.com/denoland/fresh/actions/runs/7044513115/job/19172340792?pr=2088#step:10:1279

esbuild snapshot with cwd=Deno.cwd() => ./src/build/esbuild_test.ts:22:6
error: Error: Text file busy (os error 26)
      const child = Deno.run({
                         ^
    at opRun (ext:runtime/40_process.js:49:14)
    at Object.run (ext:runtime/40_process.js:135:15)
    at https://deno.land/x/esbuild@v0.19.4/mod.js:1880:26
    at eventLoopTick (ext:core/01_core.js:178:11)
    at async Module.initialize (https://deno.land/x/esbuild@v0.19.4/mod.js:1768:3)
    at async EsbuildBuilder.build (file:///home/runner/work/fresh/fresh/src/build/esbuild.ts:53:7)
    at async file:///home/runner/work/fresh/fresh/src/build/esbuild_test.ts:35:20

esbuild snapshot with cwd=/ => ./src/build/esbuild_test.ts:39:6
error: Error: Text file busy (os error 26)
      const child = Deno.run({
                         ^
    at opRun (ext:runtime/40_process.js:49:14)
    at Object.run (ext:runtime/40_process.js:135:15)
    at https://deno.land/x/esbuild@v0.19.4/mod.js:1880:26
    at eventLoopTick (ext:core/01_core.js:178:11)
    at async Module.initialize (https://deno.land/x/esbuild@v0.19.4/mod.js:1768:3)
    at async EsbuildBuilder.build (file:///home/runner/work/fresh/fresh/src/build/esbuild.ts:53:7)
    at async file:///home/runner/work/fresh/fresh/src/build/esbuild_test.ts:35:20

Closing as this was an issue in the Fresh 1.x test suite.


Hide "Amendments" entry in menu if disabled

When motions_amendments_enabled=False, the entry Amendments should not be visible in the menu of the motion list.
Can fix this if wanted

Yes please.


fix(price-feeder): fix osmosis timestamp

This brings the osmosis candle timestamp from seconds to milliseconds, which keeps it on par with all the other unix timestamps.

Author Checklist
All items are required. Please add a note to the item if the item is not applicable and
please add links to any relevant follow up issues.
I have...

[ ] included the correct type prefix in the PR title
[ ] added ! to the type prefix if API or client breaking change
[ ] added appropriate labels to the PR
[ ] targeted the correct branch (see PR Targeting)
[ ] provided a link to the relevant issue or specification
[ ] added a changelog entry to CHANGELOG.md
[ ] included comments for documenting Go code
[ ] updated the relevant documentation or specification
[ ] reviewed "Files changed" and left comments if necessary
[ ] confirmed all CI checks have passed

Reviewers Checklist
All items are required. Please add a note if the item is not applicable and please add
your handle next to the items reviewed if you only reviewed selected items.
I have...

[ ] confirmed the correct type prefix in the PR title
[ ] confirmed all author checklist items have been addressed
[ ] reviewed state machine logic
[ ] reviewed API design and naming
[ ] reviewed documentation is accurate
[ ] reviewed tests and test coverage
[ ] manually tested (if applicable)

I'm going to alter this to a utility function that will tell if a provider is reporting in seconds or milliseconds, and converts it to millis

I was going to create a utility function for this which tells whether something is seconds / milliseconds, but there's no good universal way to do this apparently
Open to suggestions :^)

Also, this is returning like the last 5 days of candles, shouldn't we filter that already on collecting this data?

Yeah, we've done that with other providers as well. I can do that here since it's a small PR


Support mobile screens on web

Description:

Currently Voyager doesn't support small screens and imho I think this should be a must on web

100%


command 'code-runner.run' not found

I have a problem he give me command 'code-runner.run' not found
what should i do

Please file this against the code runner extension

This issue is caused by an extension, please file it with the repository (or contact) the extension has linked in its overview in VS Code or the marketplace for VS Code. See also our issue reporting guidelines. If you don't know which extension is causing the problem, you can run Help: Start extension bisect from the command palette (F1) to help identify the problem extension.
Happy Coding!


NuGet packages are missing

Hi
There seems to be an issue with the NuGet packages, none of them are available in NuGet. The search [Microsoft.Quantum] returns zero results >> https://www.nuget.org/packages?q=Microsoft.Quantum
Regards
-Bruno

Looks like you beat me to this. The packages albeit available, were indeed not searchable while we were ironing out some kinks. They are now mark as searchable so they should start appearing on search results soon.
Thanks!


TST: Add appveyor testing

Hello,
xref #522
I've put together appveyor.yml for this.
A few limitations:

The point of this is to write some mssql tests. Haven't started that yet.
I can't get mongodb or mysql to work on appveyor. Going to confess I don't know that much about them however. I can start the service and add them to PATH, but that's about the limit of what I can figure out.
I can't successfully run pip install -e .[ci]. There's a lot that needs to build and it takes a long, long time and some of it (h5py and cryptography especially) just doesn't cooperate. So instead I just pull the pre-compiled binaries from conda.

Here's the test result of this:
https://ci.appveyor.com/project/thequackdaddy/odo
Let me know if there's interest for this.
Thanks.

I'd love to add this, to add CI for MSSQL -- I've set up an AppVeyor project at https://ci.appveyor.com/project/blaze/odo but I'm not sure how to integrate this branch and see the test results...

I'd love to add this, to add CI for MSSQL -- I've set up an AppVeyor project at https://ci.appveyor.com/project/blaze/odo but I'm not sure how to integrate this branch and see the test results...

I re-pushed the commit. Looks like its starting now.

I re-pushed the commit. Looks like its starting now.

This looks great -- tests are passing, well done! Did you want to add the MSSQL testing in this PR or in a follow-up?

This looks great -- tests are passing, well done! Did you want to add the MSSQL testing in this PR or in a follow-up?

I was thinking follow-up.
I've had issues with a lot of the mssql specific datatypes (e.g., bit, money, datetimeoffset) not playing well with python so I need to figure out how to get that to work.

I was thinking follow-up.
I've had issues with a lot of the mssql specific datatypes (e.g., bit, money, datetimeoffset) not playing well with python so I need to figure out how to get that to work.

Awesome, thank you!

Awesome, thank you!


koordlet: revise flaky test in pleg

Ⅰ. Describe what this PR does

Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how to verify it
Ⅳ. Special notes for reviews
V. Checklist

[ ] I have written necessary docs and comments
[ ] I have added necessary unit tests and integration tests
[ ] All checks passed in make test

/lgtm
/approve


Logic Gate Compatibility with Non-Logic Signals bugfix

About the PR
Fixed a bug where B port inputs to logic gates weren't properly reset to Low when a non-logic signal is sent to them.
ie. if you link a Signaller to a Logic Gate's B input, it gets stuck as High forever.
Why / Balance
I just spent a whole round trying to make a thing and only once I hooked up the debugger did I understand ):
Technical details
High -> Low
:)
Media
Very small and nothing really to show
Requirements

[X] I have read and am following the Pull Request and Changelog Guidelines.
[X] I have added media to this PR or it does not require an ingame showcase.

Breaking changes
None
Changelog
:cl:

fix: Fixed a bug where the B input on logic gates would get stuck in a high state

I TOTALLY had this bug happen when trying to make a flip flop. Really good catch I never even realized...

Fixes #33716


Issue building on Fedora 34

Distribution: Fedora 34
RAM: 256GB
Filesystem: ext4
Docker daemon logs:
Aug 11 14:02:15 xunlai dockerd[1478824]: time="2021-08-11T14:02:15.214477433-04:00" level=info msg="API listen on /run/docker.sock"
Aug 11 14:03:22 xunlai dockerd[1478824]: time="2021-08-11T14:03:22.004887490-04:00" level=info msg="parsed scheme: \"\"" module=grpc
Aug 11 14:03:22 xunlai dockerd[1478824]: time="2021-08-11T14:03:22.005157835-04:00" level=info msg="scheme \"\" not registered, fallback to default scheme" module=grpc
Aug 11 14:03:22 xunlai dockerd[1478824]: time="2021-08-11T14:03:22.005191735-04:00" level=info msg="ccResolverWrapper: sending update to cc: {[{localhost  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Aug 11 14:03:22 xunlai dockerd[1478824]: time="2021-08-11T14:03:22.005209626-04:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 11 14:28:53 xunlai dockerd[1478824]: time="2021-08-11T14:28:53.335855127-04:00" level=warning msg="grpc: addrConn.createTransport failed to connect to {localhost  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing only one connection allowed\". Reconnecting..." module=grpc
Aug 11 14:45:25 xunlai dockerd[1478824]: time="2021-08-11T14:45:25.182067596-04:00" level=info msg="parsed scheme: \"\"" module=grpc
Aug 11 14:45:25 xunlai dockerd[1478824]: time="2021-08-11T14:45:25.182139787-04:00" level=info msg="scheme \"\" not registered, fallback to default scheme" module=grpc
Aug 11 14:45:25 xunlai dockerd[1478824]: time="2021-08-11T14:45:25.182166418-04:00" level=info msg="ccResolverWrapper: sending update to cc: {[{localhost  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Aug 11 14:45:25 xunlai dockerd[1478824]: time="2021-08-11T14:45:25.182182378-04:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 11 14:57:14 xunlai dockerd[1478824]: time="2021-08-11T14:57:14.140918264-04:00" level=warning msg="grpc: addrConn.createTransport failed to connect to {localhost  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing only one connection allowed\". Reconnecting..." module=grpc
Aug 11 15:01:49 xunlai dockerd[1478824]: time="2021-08-11T15:01:49.874472402-04:00" level=info msg="parsed scheme: \"\"" module=grpc
Aug 11 15:01:49 xunlai dockerd[1478824]: time="2021-08-11T15:01:49.874529723-04:00" level=info msg="scheme \"\" not registered, fallback to default scheme" module=grpc
Aug 11 15:01:49 xunlai dockerd[1478824]: time="2021-08-11T15:01:49.874548764-04:00" level=info msg="ccResolverWrapper: sending update to cc: {[{localhost  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Aug 11 15:01:49 xunlai dockerd[1478824]: time="2021-08-11T15:01:49.874558974-04:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 11 15:13:42 xunlai dockerd[1478824]: time="2021-08-11T15:13:42.648576909-04:00" level=warning msg="grpc: addrConn.createTransport failed to connect to {localhost  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing only one connection allowed\". Reconnecting..." module=grpc
Aug 11 15:34:10 xunlai dockerd[1478824]: time="2021-08-11T15:34:10.155688124-04:00" level=info msg="parsed scheme: \"\"" module=grpc
Aug 11 15:34:10 xunlai dockerd[1478824]: time="2021-08-11T15:34:10.155764395-04:00" level=info msg="scheme \"\" not registered, fallback to default scheme" module=grpc
Aug 11 15:34:10 xunlai dockerd[1478824]: time="2021-08-11T15:34:10.155796606-04:00" level=info msg="ccResolverWrapper: sending update to cc: {[{localhost  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Aug 11 15:34:10 xunlai dockerd[1478824]: time="2021-08-11T15:34:10.155813416-04:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 11 15:35:59 xunlai dockerd[1478824]: time="2021-08-11T15:35:59.145124719-04:00" level=warning msg="grpc: addrConn.createTransport failed to connect to {localhost  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing only one connection allowed\". Reconnecting..." module=grpc
Aug 11 15:36:07 xunlai dockerd[1478824]: time="2021-08-11T15:36:07.938390885-04:00" level=info msg="parsed scheme: \"\"" module=grpc
Aug 11 15:36:07 xunlai dockerd[1478824]: time="2021-08-11T15:36:07.938467976-04:00" level=info msg="scheme \"\" not registered, fallback to default scheme" module=grpc
Aug 11 15:36:07 xunlai dockerd[1478824]: time="2021-08-11T15:36:07.938496916-04:00" level=info msg="ccResolverWrapper: sending update to cc: {[{localhost  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Aug 11 15:36:07 xunlai dockerd[1478824]: time="2021-08-11T15:36:07.938513307-04:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 11 15:50:44 xunlai dockerd[1478824]: time="2021-08-11T15:50:44.302488744-04:00" level=warning msg="grpc: addrConn.createTransport failed to connect to {localhost  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing only one connection allowed\". Reconnecting..." module=grpc

Additional logs: https://pastebin.com/XeWni5Nj
Issue description: I am having issues building at all on Fedora 34. All logs are above and versions are below. Any help would be appreciated as this failure occurs after ~1400 seconds of compiling.
[bcs@xunlai replica]$ m4 --version
m4 (GNU M4) 1.4.18
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Rene' Seindal.
[bcs@xunlai replica]$ make -v
GNU Make 4.3
Built for x86_64-redhat-linux-gnu
Copyright (C) 1988-2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
[bcs@xunlai replica]$ docker --version
Docker version 20.10.8, build 3967b7d

@bcstinch The issue should now be fixed.
I also use Fedora 34.

I pulled the latest and tried and I still saw the same error. @robimarko
@jpetrina
I tried commenting out *dev-util/bpftool in repos/host/profiles/default/packages and that worked. Here is the output of zcat /proc/config.gz | grep BTF
[bcs@xunlai ~]$ zcat /proc/config.gz | grep BTF
gzip: /proc/config.gz: No such file or directory

@bcstinch after pulling Robert's changes, have you updated repository submodules with git submodule update --init --recursive? I feel this might have been the issue here.
The idea with /proc/config.gz was to check BPF Type Format support in the kernel. It seems Fedora 34 already supports this with CONFIG_DEBUG_INFO_BTF=y which should expose /sys/kernel/btf/vmlinux.
Regardless, @robimarko has updated bpftool; the underlying issue seems to be an old bpftool version not being compatible with new kernel BTF. This should now be fixed so please try building from clean slate.

Confirmed, I am just a git noob. Everything seems to be working now! Feel free to close.


#38 Event Details Page changes

Next/Previous event controls now housed in GNavBar instead of floating buttons

looks really great @khanabdu25 !


Create Blog “2020-06-18-hi-from-leslo360”

Automatically generated by Netlify CMS

Great new contribution


Catch local version missmatch

Building Enzyme locally and changing the julia version will result in segfaults.
We should catch that.
_ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /u/drehwald/.julia/artifacts/c90711842814121dacf839a59bca4c40f573cbff/lib/libLLVM-14jl.so (unknown line)  │~
_ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /h/344/drehwald/.julia/juliaup/julia-1.7.3+0.x64.linux.gnu/bin/../lib/julia/libLLVM-12jl.so (unknown line)

Described the importance of the correct version in updated devdocs: https://github.com/EnzymeAD/Enzyme.jl/pull/1436
I'm not away of a good way to support this otherwise, so closing as unplanned.
Feel free to reopen.


(GH-396) Added Swedish translation

I made a mistake in #400, so I restart with this new PR for the Swedish translation.
I have taken into account the review comments from the old PR.
#396

Awesome work!


[Refactor] Allowing sub-envs to have a different device than the one of ParallelEnv

@Blonck
This was an investigation PR.

[x] We need to swich pipes with Queues in ParallelEnv #1166

One change I made is sort of bc-breaking: now you can pass envs on one device (say CPU) and have the parallel env on GPU. cc @matteobettini what do you think of that? Maybe better to keep all envs with the same device as it is now?
That means that passing data will be done on gpu but execution will be done on CPU.
The situation is currently that all envs must match.

If exacution is on CPU for example, what is the benefit of passing data on GPU?
or the opposite. I think if there is a usecase where this make sense and it is not covered by the current collecotrs env it makes sense

It's less about cpu/gpu but maybe (?) one would like to execute env1 on cuda:0, env2 on cuda:1 and pass data from process to process using cuda:2
It's a bit a mess, and it is not clear what parallel_env.to("cuda:0") would mean (it may be susprising to some that after calling that there are still ops being executed on other devices).
Flexibility always has a high price :)


⚠ ClamAV has degraded performance

In 79c80c2, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 79 ms

Resolved: ClamAV performance has improved in bf3b8dd after 5 minutes.


Backport portable backup ReadFull fix to 1.9

Backport of https://github.com/influxdata/influxdb/pull/21978

Closed by #21993


Handling large amount of data

The main problem in KNN calculation is the amount data that needs to be broadcasted to each node. For instance, if you have 20 M vectors (~1.3TB), it is really hard to broadcast them in memory. How would you handle this situation?
Thank you in advance.

Do you mean foor k-nn graphs in general, or specifically for this project?
Le lun. 15 mai 2017 à 12:02, zhassanbey<EMAIL_ADDRESS>a écrit :

The main problem in KNN calculation is the amount data that needs to be
broadcasted to each node. For instance, if you have 20 M vectors (~1.3TB),
it is really hard to broadcast them in memory. How would you handle this
situation?
Thank you in advance.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/tdebatty/spark-knn-graphs/issues/6, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AA1SDKxRjXoaP3XmfjbXKgNT1C_I3gm3ks5r6CKsgaJpZM4Na64R
.

Hi thank you for reply. I mean specifically for this project. But if you have ideas to share, it would be great.

Hello,
I don't know if you found a solution for your problem? Just thought of this
now: Spark was actually designed for processing datasets that can fit into
the distributed memory. Hence for your kind of problem I would recommend to:

preprocess or filter your data to reduce its size or
use some other processing framework, like Hadoop Map Reduce

Hope this can help...
Best regards,
Le mar. 16 mai 2017 à 05:48, zhassanbey<EMAIL_ADDRESS>a écrit :

Hi thank you for reply. I mean specifically for this project. But if you
have ideas to share, it would be great.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/tdebatty/spark-knn-graphs/issues/6#issuecomment-301667755,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA1SDDsNxhiKc0YxUqYC0cqrzx4fWCphks5r6Rx0gaJpZM4Na64R
.

Hi tdebatty,
Thank you for reply.
I am currently doing it by separating the input into chunks. Well, I first "chunkify" the files, then find knn for each chunk by broadcasting the chunk only. After the knn is calculated for the current chunk of files in iteration, I persist that result with MEMORY_DISK strategy. When all the chunks have processed, I try to merge them. The idea works somehow, but I am seeking for more elegant solution.


Add huge services to load test

This is to add a way of testing the scalability of EndpointSlice objects.
/sig scalability

/assign @wojtek-t

/lgtm
/approve


search select for languages

Is your feature request related to a problem? Please describe.
when you select a language, when you will have tons of them, it will be hard to find your preferred one. so search selection would work.
Describe the solution you'd like
search selection (https://select2.org/searching)
Describe alternatives you've considered
didn't think of it
Additional context
something something
also, am I the only one that when I join the discord it says there are no text channels or something?

Seems cool but #1462

I was working on new language picker but #1462 so I scrapped it.

The feature can be worked on but it just wouldn't be pushed until following the new design's implementation.

also very easy implementation

I was redesigning the picker for twemoji too, so it was going to be custom.

We won't add a search bar inside the LanguageSelector for now


ci: fix coverage reporting

Add "cov" tox factor, which should get used by tox-travis then.

Might not need codecov - initially fixed it because Scrutinizer was failing/erroring due to it.

It was uploaded for Scrutinizer (https://travis-ci.org/neovim/pynvim/jobs/573872712#L526), but it is still pending: https://scrutinizer-ci.com/g/neovim/pynvim/inspections/f60fbc9e-04de-4810-8196-7520f3b83117
Apparently waiting for the upload for master, which is not going to happen.
Therefore I think this is ready, and then should be fixed for future PRs.

@bfredl @justinmk
OK to merge?

looks ok to me.

I don't think we want those codecov comments on PRs. Does this enable those somehow?

@justinmk
They are disabled in the config: https://github.com/neovim/pynvim/pull/408/files#diff-1f7b4b85ed8525c5239f741431a72872R6
Probably not working properly for the initial addition of it etc.
And while it might still happen due to bugs with them (as seen with neovim/neovim sometimes), they should not appear normally.


all: fix race in AddUTF8FontFromBytes

Fixes #37.

Codecov Report
Patch coverage: 100.00% and no project coverage change.

Comparison is base (ed4c0af) 79.22% compared to head (0e23f0a) 79.23%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #38   +/-   ##
=======================================
  Coverage   79.22%   79.23%
=======================================
  Files          32       32
  Lines        5555     5557    +2
=======================================
+ Hits         4401     4403    +2
  Misses        831      831
  Partials      323      323

Impacted Files
Coverage Δ

utf8fontfile.go
84.17% <100.00%> (+0.04%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


On Google Chrome: Ctrl+E does not work after install, only after manually re-bound to Ctrl+E

Fixed by not setting a default keybinding and improving documentation


Messy row alignment due to wrong measurement of virtualizer items

Describe the bug
I have used the same code mentioned in https://react-virtual-v2.tanstack.com/examples/dynamic.  Apart from the code here i have added logic to move a row item up or down.  When i moved a row item up a blank line appeared in the middle. I'm not sure what i'm missing. Please help 🙏
Your minimal, reproducible example
https://react-virtual-v2.tanstack.com/examples/dynamic
Steps to reproduce

Add logic to move row item upwards from it's original position (ie change the data array you pass in)
When you move the row item you will see the blank line

Expected behavior
I wasn't expecting the blank line to appear since we have necessary styles to position items one below the other
How often does this bug happen?
I'm running into this frequently
Screenshots or Videos

Platform
macOS, Chrome
tanstack-virtual version
2.10.4
TypeScript version
No response
Additional context
No response
Terms & Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] I understand that if my bug cannot be reliable reproduced in a debuggable environment, it will probably not be fixed and this issue may even be closed.

I have found out what is happening:

Initially all the rows are measured properly. When i add a new row below the first row  the size of the rows are as follows
row 1  size : 242
row 2 size (newly added row ) : 26
row 3 size: 242
When i move the newly added row upwards, i was expecting the sizes to be :
row 1  size (newly added row ): 26
row 2 size (newly added row ) : 242
row 3 size: 242

Hi @sayo96 looks like you are using v2 that doesn't support observing element for size change, please update to latest beta. Thanks.

Hi @sayo96 looks like you are using v2 that doesn't support observing element for size change, please update to latest beta. Thanks.

Hey @piecyk. Can the latest beta be used on production?

Yes.


unwind: read as little stacked registers as possible

the other registers that were being read are not used in the unwinding process
closes #187
(this doesn't appear to help with unwinding programs that are in a 'stack overflowed' state however)

bors r+


functools.cache only available in python 3.9

Good catch.  I thought it's been around longer than that.
Fix: Replace with @functools.lru_cache(maxsize=None)


[Ranking tile] add ability to render single list ranking tile

add option to show highest and lowest rankings in a single list for the ranking tile

thanks for the review!


⚠ Bofrost.fr has degraded performance

In 7026b99, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1570 ms

Resolved: Bofrost.fr performance has improved in e89ad1e.


Add support for taskcluster

taskcluster is a task execution framework / CI heavily used by Mozilla:
https://docs.taskcluster.net/docs
We are using codecov for (at least) our Android apps and libraries. Currently we are using travis just for codecov. This has become a bottleneck for us and we would like to run codecov on taskcluster directly (multiple parallel tasks).
I'd like to contribute this - however I do not have a full picture on what is needed for that yet.

Environment variables:

Default: https://docs.taskcluster.net/docs/reference/workers/docker-worker/docs/environment
GitHub integration: https://docs.taskcluster.net/docs/reference/integrations/taskcluster-github/docs/taskcluster-yml-v1#transitioning-from-v0

By default this just works with the "git" fallback. However for parallel tasks codecov posts (and updates) the comment on the PR for every task that completed. According to the docs codecov can look at the PR checks status to post the comment once all tasks have been completed. But I'm not sure how codecov does the matching.

@pocmo when require_ci_to_pass is set, Codecov will wait for all non-Codecov checks to pass before posting.
You may be looking for after_n_builds.
I'd be happy to add this, can you please provide an example of how you would construct a Taskcluster build URL?

I'm going to close this out due to age, but if this is still a need, please open a feature-request on our community boards