oauth2 not working with last version of google chrome

Try sample from documentation
https://developers.google.com/identity/protocols/OAuth2UserAgent#example
We could select an account from popup dialog,
but
SignIn don't autorize in Google Chrome version 62.0.3202.94
In my example bilding by this documentation I got the error message with code "popup_closed_by_user"

In Google Chrome version 62.0.3202.94
method
gapi.auth2.getAuthInstance().signIn(options).then(function(resp) {
var auth_code = resp.code;
},
function(resp) {
var auth_code = resp.code;
});
got error response "popup_closed_by_user" and don't autorize user
the same code works fine in oldest chrome version and in other browsers

@makas2 are you calling signIn right after a user click? Do you see the popup opening?
If yes, do you have enabled the setting to block third-party data?

@TMSCH Yes. I'm calling signIn after user click.
Could you clarify where can I find that seeting block third-party data?

Go to chrome://settings/content/cookies, the "Block third-party cookies" setting. gapi.auth2 works fine with my version of Chrome that is also Version 62.0.3202.94 (Official Build) (64-bit).

@TMSCH Thank you.
It's helped

This bug should be fixed. More deatil at https://github.com/google/google-api-javascript-client/issues/405.


add serialization to AeKey

Problem
There is no possibility of serializing an AeKey
Summary of Changes
Add to_bytes and from_bytes to AeKey
Fixes #

Currently, in the zk-token-sdk, we encode/decode types depending on whether they are public or private:

For public types like ElGamalPubkey, ElGamalCiphertext, and AeCiphertext, we have to_bytes and from_bytes functions.
For private types like ElGamalSecretKey, ElGamalKeypair, and AeKey, we implement the trait solana_sdk::signer::EncodableKey to read and write to file.

We did it this way since copies of private types should be difficult to make. @abcalphabet, was there a use-case that you had in mind for adding additional way to serialize AeKey like public types?

@samkim-crypto The basic use case would be secret sharing.
Say I'm creating an ATA and initializing confidential transfers on it from keypair K before transferring ownership over it to multisig M. Since both ElGamalKeypair and AeKey are needed for proof generation when operating on the ATA I'd like to be able to get them as bytes for RSA encryption before sharing them with all members of multisig M.
Using EncodableKey to serde-serialize into a Result<String> just to takes the bytes of it for encryption seems less "clean". Especially since the underlying type is a byte array and the ElGamalKeypair already supports to_bytes.

Codecov Report
Attention: Patch coverage is 96.42857% with 1 lines in your changes are missing coverage. Please review.

Project coverage is 81.9%. Comparing base (a2579d4) to head (37427f4).
Report is 6 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #208   +/-   ##
=======================================
  Coverage    81.9%    81.9%
=======================================
  Files         837      837
  Lines      226805   226832   +27
=======================================
+ Hits       185846   185889   +43
+ Misses      40959    40943   -16


Bump doom-emacs

This PR is trying to bump doom-emacs to a newer commit, after the failure of PR #268 (and any subsequent PR trying to bump doom-emacs input).

So it builds and runs, but something strange is happening:

Not sure where this @ from<EMAIL_ADDRESS>is coming from.

So it builds and runs, but something strange is happening:
Not sure where this @ from<EMAIL_ADDRESS>is coming from.

I see, this @ is coming from the new doom profile feature. Still this looks wrong, we shouldn't be loading the compiled files from ~/.local. Probably something is wrong with my patches.

Well, now it is working. However anything that tries to write in the doom-data-dir is failing right now since this is still pointing to the /nix/store. If I change it to a PATH outside of the /nix/store  it breaks everything.

With commit 4386c5c it should be working with emacsGit. Stable emacs for some reason still doesn't work, and I have no idea why...

For some reason SPC SPC is not working for me with commit 4394f94. However I am not sure if the fault is this PR or just the bump in doom-emacs and something got broken upstream.

For some reason SPC SPC is not working for me with commit 4394f94. However I am not sure if the fault is this PR or just the bump in doom-emacs and something got broken upstream.

So other doom-emacs core functions like SPC h k are not working. This and the fact that the config is not working in vanilla Emacs seems to indicate that I messed up somewhere...

Rebased this branch with master with some adjustments. Still only works for Emacs 29+.

wow, thank you for keeping working on this!
you need any help?

wow, thank you for keeping working on this! you need any help?

Yeah:

Need to figure out why some things are not working (SPC SPC is undefined for example, so it seems that core doomemacs is not loaded)
Make it work in Emacs 28

Hm, looks like SPC p p is now Ctrl-c p p, maybe something got remapped?
Will dig in the doom-emacs log a bit

Hm, looks like SPC p p is now Ctrl-c p p, maybe some things got remapped? Will dig in the doom-emacs log a bit

I don't think it got remapped. I think the module itself is loaded, but the doomemacs customizations are not. This is why it is using the default mappings instead of the ones from doomemacs.

Hm, trying to load doom-start.el manually drops the following:
if: Error in Doom Emacs core: "Doom is in an incomplete state", "run 'doom sync' on the command line to repair it"

Aaand, doom doctor whines as well:

> Checking your Emacs version...
  ! Detected a development version of Emacs (30.0.50)
    This is the bleeding edge of Emacs. Doom does not support it because
    Emacs HEAD is in an especially unstable period of its development. If
    you've found a stable commit, great! But be cautious about updating
    too eagerly!

    Because development builds are prone to random breakage, there will be
    a greater burden on you to investigate and deal with issues. Please
    make extra sure that your issue is reproducible in 28.1 before
    reporting them to Doom's issue tracker!

    If this doesn't phase you, read the "Why does Doom not support Emacs
    HEAD" QnA in Doom's FAQ. It offers some advice for debugging and
    surviving issues on the bleeding edge. Failing that, 28.1 is highly
    recommended and will always be Doom's best supported version of Emacs.
> Checking for Doom's prerequisites...
> Checking for Emacs config conflicts...
> Checking for great Emacs features...
> Checking for private config conflicts...
> Checking for stale elc files...
> Checking for problematic git global settings...
> Checking Doom Emacs...
! Attempt to load DOOM failed
    (Profile init file hasn’t been generated. Did you forgot to run ’doom sync’?)

There are 2 warnings!

https://github.com/doomemacs/doomemacs/blob/master/modules/config/default/config.el#L495-L497
What's probably happening is that :config default is being loaded before :editor evil so +emacs-bindings is loaded instead of +evil-bindings. That explains why SPC p p becomes C-c p p, as the change is from the leader for +evil-bindings to the leader for +emacs-bindings. I'm pretty sure the projectile bindings are otherwise similar.

https://github.com/doomemacs/doomemacs/blob/master/modules/config/default/config.el#L495-L497 What's probably happening is that :config default is being loaded before :editor evil so +emacs-bindings is loaded instead of +evil-bindings. That explains why SPC p p becomes C-c p p, as the change is from the leader for +evil-bindings to the leader for +emacs-bindings. I'm pretty sure the projectile bindings are otherwise similar.

Interesting. Do you have any idea why? Because we are basically doing the same initialization code than doomemacs.

Tried your branch.  doom run works, but just emacs spawn plain emacs.
Also I see a lot of process like /nix/store/l0np48ywa601ravm8k57h97vlm12spyj-emacs-28.2/bin/emacs --batch -l /tmp/emacs-async-comp-magit-process-0GzhgT.el right after doom run. Does something going wrong? (if I read correctly, emacs 29 should be used)

Well, after some testing...  SPC-b-... menu is missing, some other stuff missed as well

@thiagokokada I fix load of evil with follow patch:
diff --git a/modules/config/default/+evil.el b/modules/config/default/+evil.el
index a5ddc3099..35c294a76 100644
--- a/modules/config/default/+evil.el
+++ b/modules/config/default/+evil.el
@@ -1,4 +1,5 @@
 ;;; config/default/+evil.el -*- lexical-binding: t; -*-
+(require 'evil)

 (defun +default-disable-delete-selection-mode-h ()
   (delete-selection-mode -1))
diff --git a/modules/config/default/config.el b/modules/config/default/config.el
index f4a301488..0dd5e438d 100644
--- a/modules/config/default/config.el
+++ b/modules/config/default/config.el
@@ -492,6 +492,6 @@ Continues comments if executed from a commented line. Consults
 ;;
 ;;; Bootstrap configs

-(if (featurep 'evil)
+(if (modulep! :editor evil)
     (load! "+evil")
   (load! "+emacs"))

But that fix symptoms, not a real problem

@thiagokokada Thanks for you work on this!  The problems that I'm running into here are very similar to the ones you report here (SPC only works as a prefix because my config has some general.el keybindings in it).  Some fundamental part of Doom doesn't seem to have gotten loaded, or perhaps it got loaded too late or early.  I'm also in full eye-daggers-black-on-white-theme on startup :|
But... the weird thing for me is:  I'm not even using nix-doom-emacs (yet!).  I got this while migrating to nix-darwin from home-manager.  It makes me wonder if some other elements are at play here.  Have you had a working Doom Emacs with your changes reverted?
I might try getting on nix-doom-emacs just so I'm in sync with this effort.


Crash with DynamicTrees

Sorry for short description of the error.
The game crashes on startup when installing Apotheosis with DynamicTrees:
https://pastebin.com/hNcfzR4U

DynamicTrees/217

The developer of Dynamic Trees is not particularly engaged in solving the problems of this mod. Apparently, I'll have to fix it myself. Sad :c

For whatever reason the garden module effects dynamic trees. If you really want both installed you can disable the garden module in apoth and DT will work alongside it.

Posting Here as the issue is still open and Dynamic Trees does work with Apotheosis and Placebo as long as Optifine isn't installed.
Dynamic Trees Throws
"/ by 0" crash on startup w/ Dynamic Trees & Apotheosis/Placebo

[Follow up.
MC: 1.12.2
Forge: 2836 (Issue encountered on an earlier version, but suggested by mod involved "Apotheosis"
Minimal list of mods to reproduce.
Dynamic Trees 0.9.5
Apotheosis 1.9.4
Placebo 1.6.0 (used by Apotheosis)
Optifine: Encountered w/ "preview_OptiFine_1.12.2_HD_U_E4_pre4"
Additionally tested against "OptiFine_1.12.2_HD_U_E3"
This was tested without VanillaFix for the same outcome, then VanillaFix was added for convenience with the hastebin (link) which replicates the above report.](https://github.com/ferreusveritas/DynamicTrees/issues/254#issuecomment-488570733)

I think I'll close this now.  There's literally nothing I can do about it on my end.  I don't even edit the texture for sugarcane, so it's really weird that it happens at all.


Test ansible/galaxykit#81 fix

ansible/galaxykit#80 causes galaxykit container create ... to error with Cannot parse expected JSON response (http://localhost:8002/api/galaxy/v3/plugin/execution-environments/remotes/) (bad url)
https://github.com/ansible/galaxykit/pull/81 should fix that, testing.

Merging for now, will revert when galaxykit PR gets merged


fix: error while skipping log analysis agent installation

Description
error while skipping log analysis agent installation.
│ Error: Invalid template interpolation value
│
│   on .terraform/modules/observability_cloud_monitoring_agents/main.tf line 26, in locals:
│   26:   log_analysis_host             = var.log_analysis_endpoint_type == "private" ? "logs.private.${var.log_analysis_instance_region}.logging.cloud.ibm.com" : "logs.${var.log_analysis_instance_region}.logging.cloud.ibm.com"
│     ├────────────────
│     │ var.log_analysis_instance_region is null
│
│ The expression result is null. Cannot include a null value in a string
│ template.
╵}

Release required?

[ ] No release
[x] Patch release (x.x.X)
[ ] Minor release (x.X.x)
[ ] Major release (X.x.x)

Release notes content

Run the pipeline
If the CI pipeline doesn't run when you create the PR, the PR requires a user with GitHub collaborators access to run the pipeline.
Run the CI pipeline when the PR is ready for review and you expect tests to pass. Add a comment to the PR with the following text:
/run pipeline

Checklist for reviewers

[ ] If relevant, a test for the change is included or updated with this PR.
[ ] If relevant, documentation for the change is included or updated with this PR.

For mergers

Use a conventional commit message to set the release level. Follow the guidelines.
Include information that users need to know about the PR in the commit message. The commit message becomes part of the GitHub release notes.
Use the Squash and merge option.

/run pipeline

/run pipeline

/run pipeline

:tada: This PR is included in version 1.24.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Is this project dead?

Hi!
Found this project from https://insight.litecore.io/.
I see, that you still use litecoin-0.13.2. Do you plan to update to 0.16 ?

Good you found the project - it certainly isn't dead! We'll be working on updating the public nodes - can't give you an ETA yet though.

@LitecoinTim
Thank you for response!
Maybe I can help you with node patching.
I've already applyed patches for 0.15.1 and 0.16.0 version. You can check the code here:
https://github.com/APshenkin/litecoin/tree/0.15.1-litecore
https://github.com/APshenkin/litecoin/tree/0.16.0-litecore
Here is comparation for 0.15.1 version (usual node and litecore node)
https://github.com/litecoin-project/litecoin/compare/v0.15.1...APshenkin:0.15.1-litecore
and for 0.16.0 version
https://github.com/litecoin-project/litecoin/compare/v0.16.0...APshenkin:0.16.0-litecore
Patches was dumped from satoshilabs (because only them applyed patches to 0.15.1 version for bitcoin https://github.com/satoshilabs/bitcoin/tree/0.15.0)
There are two things that I did not complete:

Testing. Looks like it's working after building, but we need more complex tests
For 0.16.0 version I returned CBitcoinAddressVisitor to base58.cpp because it used in patches. Maybe there is an option to overwrite patches to not do this. Also in would be great to add bech32 format address view support.


feat(apps/prod/tekton/configs): support tag multi-arch image

Signed-off-by: wuhuizuo<EMAIL_ADDRESS>

/approve


Create manifest folder for ART to be able to build operator bundle

Signed-off-by: Mohamed Mahmoud<EMAIL_ADDRESS>

/test unit-test

/override ci/prow/ingress-node-firewall-e2e-metal-ipi


Add Assembly at Runtime #7316

https://github.com/aspnet/Mvc/issues/7316#issue-292684543

Can you share a repro app?

https://github.com/ErcinDedeoglu/Swashbuckle.AspNetCore.Issue1

Seems to be working fine - what exactly is the issue you're seeing?

Hi. We're closing this issue as there's been no response and we have been unable to reproduce it. If you have more details and are encountering this issue please add a new reply and re-open the issue.


W5 tests

More tests

Improve test for internal request message length handling.
Test case that wallet could send if deployed with signature auth disabled, but no extensions.
Cosmetic changes like unused variables and wrapper linting.

Duplicate of #

Pull the request procced fwd.


[Bug]: nginx.conf not found React and Static Build Pack

Is there an existing issue for this?

[X] I have searched the existing issues

Example public repository
coolify
Description
I got this error do we need to provide nginx.conf for React and Static Build Packs
[11:21:39.971] #8 [4/5] COPY /nginx.conf /etc/nginx/nginx.conf
[11:21:39.973] #8 sha256:c298af542369d1b5d9e87a14f735089b5a10eb08e4444fe0768f6e1df535197e
[11:21:39.975] #8 ERROR: failed to calculate checksum of ref moby::8mj6si8lowx6d5jemg4t47akn: "/nginx.conf": not found
[11:21:39.977] ------
[11:21:39.979] > [4/5] COPY /nginx.conf /etc/nginx/nginx.conf:
[11:21:39.982] ------
[11:21:39.984] failed to compute cache key: failed to calculate checksum of ref moby::8mj6si8lowx6d5jemg4t47akn: "/nginx.conf": not found
graphAverages
webhook_commit
RUNNING
3s
graphAverages
manual

Steps To Reproduce
[11:27:44.640] Building production image...
[11:27:44.677] #1 [internal] load .dockerignore
[11:27:44.681] #1 sha256:5efad839e25fe7e0e2321c097babf423009354dc45d47d7e3d0b08166a7743b0
[11:27:44.831] #1 transferring context: 994B done
[11:27:44.833] #1 DONE 0.0s
[11:27:44.836] #2 [internal] load build definition from Dockerfile
[11:27:44.838] #2 sha256:212b0ef511f6ac55b12fff5fdbfdaaf257f295f74e428f9e17c412416b7db8ca
[11:27:44.840] #2 transferring dockerfile: 202B done
[11:27:44.842] #2 DONE 0.0s
[11:27:44.844] #3 [internal] load metadata for docker.io/webdevops/nginx:alpine
[11:27:44.845] #3 sha256:e7794619013d282fa96cd4417da22e90d23ff5a0588f1c62acfcba3a138f4b64
[11:27:46.158] #3 DONE 1.5s
[11:27:46.271] #4 [1/5] FROM docker.io/webdevops/nginx:alpine@sha256:4d29db69d4b8ab711998e89b735a03de8d92f86615026c99367399ff53fecc8f
[11:27:46.277] #4 sha256:9f0141e4c9b5696c09ebe77c0a9d5284ea18fcd52d5527398c503211975493e5
[11:27:46.279] #4 resolve docker.io/webdevops/nginx:alpine@sha256:4d29db69d4b8ab711998e89b735a03de8d92f86615026c99367399ff53fecc8f done
[11:27:46.281] #4 sha256:40cacd017432cdb5524100a22c42dbcf34c432788ecadab24d3f7f0c4e130c43 5.91kB / 5.91kB done
[11:27:46.288] #4 sha256:b5994680f62961a63f484d01cb6eb44946e803cf0f5fab17c9edcdc36f91cfcf 0B / 500.59kB 0.1s
[11:27:46.300] #4 sha256:9e5ea138eebd82a33d9b8c8bc00ccab6f8a1b96eebc2979be6faab8770326664 0B / 2.19MB 0.1s
[11:27:46.304] #4 sha256:4d29db69d4b8ab711998e89b735a03de8d92f86615026c99367399ff53fecc8f 2.00kB / 2.00kB done
[11:27:46.307] #4 sha256:79e9f2f55bf5465a02ee6a6170e66005b20c7aa6b115af6fcd04fad706ea651a 0B / 2.82MB 0.1s
[11:27:46.540] #4 sha256:79e9f2f55bf5465a02ee6a6170e66005b20c7aa6b115af6fcd04fad706ea651a 2.82MB / 2.82MB 0.4s done
[11:27:46.548] #4 extracting sha256:79e9f2f55bf5465a02ee6a6170e66005b20c7aa6b115af6fcd04fad706ea651a
[11:27:46.551] #4 CANCELED
[11:27:46.553] #6 [internal] load build context
[11:27:46.557] #6 sha256:72d24fbc2b2a4ff6d172a458f4980c268a26eb3336baafd843848e85b570b06a
[11:27:46.566] #6 transferring context: 35.55MB 0.4s done
[11:27:46.595] #6 DONE 0.4s
[11:27:46.628] #5 [2/5] WORKDIR /app
[11:27:46.648] #5 sha256:52a202106f97d189c57fbd6dccb3d45652b0fa68218e2babc763774c95bd1b70
[11:27:46.653] #5 CACHED
[11:27:46.655] #7 [3/5] COPY . ./
[11:27:46.658] #7 sha256:d6b586ca38b9ea69389c27a677cd9aa066eec6b79df2b3150f4aca34e26797a1
[11:27:46.660] #7 CACHED
[11:27:46.662] #8 [4/5] COPY /nginx.conf /etc/nginx/nginx.conf
[11:27:46.665] #8 sha256:686c50222d727654670f642e3f63530a8f44c7c9e4f2018ee423413a72c7bb01
[11:27:46.668] #8 ERROR: failed to calculate checksum of ref moby::2kv8ixjvyigo093bvxjyvncmo: "/nginx.conf": not found
[11:27:46.670] ------
[11:27:46.671] > [4/5] COPY /nginx.conf /etc/nginx/nginx.conf:
[11:27:46.673] ------
[11:27:46.674] failed to compute cache key: failed to calculate checksum of ref moby::2kv8ixjvyigo093bvxjyvncmo: "/nginx.conf": not found
graphAverages
webhook_commit
FAILED
a minute ago
Finished in 21.941s
graphAverages
manual
FAILED
Version
3.12.30

Closing this since it eventually it just work


Editor callbacks can't get unregistered, so some methods that re-add themselves accumulate callbacks

I'm finding that FullInspector slows my game down gradually, because it's building up a huge number of callbacks. Anything that uses fiLateBindings.EditorApplication.RemUpdateFunc and AddUpdateFunc suffers from this, and there are some parts of FullInspector that add an update function every 0.3 seconds.
It looks like taking a copy of the Action in fiLateBindingsBinder, instead of storing it as an actual UnityEditor.EditorApplication.CallbackFunction prevents Unity recognising and removing the callbacks - it must be doing an object equality check.
Changing the code to not make a copy fixes this - but means that Unity editor types are exposed in non-editor code, meaning any calls to fiLateBindings.EditorApplication.RemUpdateFunc have to be guarded with #if UNITY_EDITOR. I'll submit a PR shortly; perhaps you can think of a better fix though!

Interesting issue.
There's a problem with using ifdef in this part of the code. It won't support DLL builds.
I don't really know how to workaround this while still retaining your improvements.
Any ideas @jacobdufault?
I recon there's a similar situation (with UNITY_EDITOR ifdef block) in tk.HorizontalGroup.


Update dependencies (dev)

Cherry picked from #425

Crud.    Cherry picked this and pushed directly to dev.


tmp

This change is

Codecov Report

Merging #783 (6fd6937) into gilad/coverage (aeeffb6) will increase coverage by 1.01%.
The diff coverage is n/a.

@@                Coverage Diff                 @@
##           gilad/coverage     #783      +/-   ##
==================================================
+ Coverage           82.15%   83.16%   +1.01%
==================================================
  Files                  58       57       -1
  Lines                8388     8286     -102
==================================================
  Hits                 6891     6891
+ Misses               1497     1395     -102

see 3 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Windows .msi installer reported as unsafe by Edge-Browser download

Description
Try to download windows msi file with Edge, and it doesn't let you download it.
[Note, it's possible to download Headlamp separately (with wget or something) and run the msi installer.]

Impact
Can not download/run windows Headlamp through Edge.
Environment and steps to reproduce
Download Headlamp windows msi from a release on github with Edge browser.
Expected behavior
That you can run installer, and then Headlamp (or just run Headlamp if it's a single file exe).
Additional information
I guess it probably needs to be signed or something.
Additionally, msi is a deprecated installer type.
Here is info page (has stuff about reporting safe links):
https://docs.microsoft.com/en-us/windows/security/threat-protection/microsoft-defender-smartscreen/microsoft-defender-smartscreen-overview

Electron docs on windows code signing
There's a stack overflow Q&A on this showing how we can use a certificate.  The TLDR; is we need a certificate from a CA, and then we can sign the executable from windows or linux.
Electron Windows store guide seems quite dated... but maybe it's still valid.

When downloading the headlamp exe with Chrome on Windows it downloads the headlamp exe (Edge doesn't even do that). But when opening Windows stops the user from installing it with a smartscreen dialog. The dialog can be bypassed more easily than with Edge, but it is still cumbersome to install Headlamp.

This was fixed some time ago by @joaquimrocha


fix: local network and added goerli

What I did
I added goerli to the list of networks
How I did it
How to verify it
ape console -network optimism:goerli
Checklist

should we remove kovan since it is out of date?
link for reference:
https://community.optimism.io/docs/useful-tools/networks/#rpc-endpoints


[xcm] add impl to kusama

add xcm config to kusama
depends on TUR token PR: https://github.com/mangata-finance/mangata-node/pull/304

copy&paste


Fix sys.version_info import

https://github.com/microsoft/pylance-release/issues/4243#issuecomment-1509364152
Replace
if sys.version_info[:2] >= (3, 10):
    from typing import Final, Literal, ParamSpec, TypeAlias
else:
    from typing_extensions import Final, Literal, ParamSpec, TypeAlias

for the standard way (and the pattern that is supported in PEP 484 by static type checkers)
if sys.version_info >= (3, 10):
    from typing import Final, Literal, ParamSpec, TypeAlias
else:
    from typing import Final, Literal

    from typing_extensions import ParamSpec, TypeAlias

Thanks for the PR @Tomperez98
Can you confirm this fixes the issue you're having with VS Code
You can install the latest master, now the PR is merged using,
pip install git+https://github.com/rustedpy/result

If you're able to confirm I'll create a new release of this library and publish it to pypi

Seems fine to me


Add a keyboard workshop post

Just a quickie for a workshop I ran yesterday.

Proselint found issues
_posts/2016-08-31-Keyboard-Shortcuts-workshop.markdown

Line
Message
Severity

  Generated by :no_entry_sign: danger


Publish artifacts for Scala-Native 0.5.0?

Good day,
Scala-Native-0.5.0-RC2 was released, and it requires dedicated artifacts.
Is it possibel to publish it as well?
Thanks.

Meanwhile Scala-Native-0.5.0 was released. E.g. https://github.com/scalapy/scalapy support for Scala-Native-0.5.0 depends on scalatest. I'm looking forward to see Scala-Native-0.5.0 artifacts published. Thanks.

@daenenk see https://github.com/scalatest/scalatest/pull/2318

@cheeseng I had released a few hours ago all public software at https://github.com/kcrypt with support of SN-0.5 which was blocked by scalatests.
Thanks!


Add plug development tutorial for beginners

As a beginner myself, I thought this is the best way I can help at the moment.
For now the tutorial still has a few TODO sections indicating what I'd do next, but I wanted to get some feedback first:

Is this still wanted? (#367)
Is the content ok, or too beginner friendly?
Should it be divided into pages? (I don't really like when tutorials do it)
Are the images OK like this? Should they be somewhere else to keep this repo small?

Wow dzięki (I noticed Polish in your screenshots 😉 )! Thanks for the effort! I'll have a closer look at the copy a bit later, but it'd be great to have some docs on plug development indeed, because it's been rather lacking.

Ok, change of content strategy. Would you mind posting this as a post on our super fresh SB Community instead? In this category? https://community.silverbullet.md/c/guides/6

Moved to Community forum


small docs updates

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (7049d4e) 70.70% compared to head (72c429f) 70.70%.

:exclamation: Current head 72c429f differs from pull request most recent head dea3b85. Consider uploading reports for the commit dea3b85 to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##             main      #65   +/-   ##
=======================================
  Coverage   70.70%   70.70%
=======================================
  Files          22       22
  Lines        2379     2379
=======================================
  Hits         1682     1682
  Misses        697      697

Flag
Coverage Δ

unittests
70.70% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Starting vsoagent interactively yields connect ECONNREFUSED without sending SYN..

Fresh install of Xubuntu 14.04.3 on physical machine.
Followed the README.md literally.
installed curl, nodejs (v0.12.7) and npm (2.11.3).
Used FQDN of Team Foundation Server to startup agent, but it exits with:
Error starting the agent
connect ECONNREFUSED.
Connecting with Firefox to the same server with identical credentials works OK.
Installed Wireshark; shows connection between Firefox and TFS. Shutdown firefox, start vsoagent: no packet shown in Wireshark (no SYN sent....)
What am I doing wrong?
What can I do to debug this?

Is this on-prem TFS or VSO?
What URL are you using?
Can you open the tfs url in a browser from the Ubuntu box?
Any proxies involved?
Ensure IPSec domain.
I recorded a video on how to get an http trace using charles proxy:
https://www.youtube.com/watch?v=PAVG50t_1bw

Its an on-prem TFS.
I use the URL :8080/tfs where  is the FQDN of the on-prem TFS.
I can use Firefox on the ubuntu box to connect to :8080/tfs without any problem. No http proxies are involved. Wireshark on the Ubuntu box shows the TCP connection between firefox and mytfsserver. Wireshark also shows that node agent/vsoagent.js does absolutely nothing on the network (no attempt to connect to mytfsserver).
I will attempt to install charles proxy for Debian...

Nice: I wrote the URLs in such way that it got snipped...
The url is like mytfserver.mydomain.com:8080/tfs

OK - confused - is it working?  By snipped, does it mean you left off the protocol

Got it working!
The URL entered for the vsoagent needs the protocol (http:) and a FQDN of the server e.g.:
http://mytfs.mydomain.com:8080/tfs
We also needed to enable Basic Auth on the TFS as described in http://blogs.teamfoundation.co.za/2015/05/installing-and-configuring-tfs-2015-on.html

Great.  I'm going to re-open and say we should have better error message here.  Shouldn't have to resort to tracing for improper url - we should tell you

I'll fix soon

Since we're hot on the new agent and the issue was addressed by using FQDN, closing this


Kelemen BRDF specular reflection texture is broken

Specular reflection apparently can't use a texture.  I get an error saying all parameters have to be uniform.

That's correct. It's a limitation of the Kelemen BRDF.
The following inputs must be uniform:
specular_reflectance
specular_reflectance_multiplier
roughness

The following inputs accept textures:
matte_reflectance
matte_reflectance_multiplier


running error

some error,

but,

it's normal.
I want to know why?

Looks like you may have solved it, but for future reference:
./bent_pipe ../configuration/planet-050-ns-002/ ../logs/planet-050-ns-002/

./bent_pipe ../configuration/planet-050-ns-002/ ../logs/ works because ../configuration/planet-050-ns-002/ contains the configuration files, while ../configuration/ does not contain the required configuration files


Using ValueTuple with PackageReference on Azure Cloud Services

This is the same problem as described in this closed/abandoned issue. That got closed as being reported the wrong place, that's why I'm trying here.
Please let me know if this is also not the right repo.
I'm trying to convert my C# projects from old to new csproj style, but this breaks my Azure Cloud Service at runtime because the ReferenceAssembly of System.ValueTuple.dll is copied instead of the implementing assembly.
My projects are currently targeting .NET 4.6.1, which doesn't come with System.ValueTuple but should be able to get it by consuming the System.ValueTuple NuGet package.
The problem is "solvable" by targeting .NET 4.7+, as that comes with System.ValueTuple included and hence does not need to reference it as a NuGet package.
I would like to avoid upgrading to .NET 4.7+ if possible, as:
This requires an additional deploy step to install .net 4.7+ runtimes on the worker roles, as they come with .net 4.6.2 installed. https://docs.microsoft.com/en-us/azure/cloud-services/cloud-services-guestos-update-matrix#family-5-releases
This seems as "the easy way out", and I would like to know if the problem can be solved otherwise.
Steps to reproduce
I'll use:

refDLL for: packages\system.valuetuple\4.5.0\ref\net461\System.ValueTuple.dll, and
libDLL for packages\system.valuetuple\4.5.0\lib\net461\System.ValueTuple.dll.
They are easily distinguishable, as refDLL is 40 kb and libDLL is 78 kb.

The code and complete build log file is found here:
AzureCloudService1.zip

WorkerRole1 consumes System.ValueTuple via packages.config
WorkerRole2 consumes System.ValueTuple via PackageReference

After building the cloud service the

WorkerRole1\bin\Debug has libDLL.
WorkerRole2\bin\Debug\net461 has libDLL
AzureCloudService1\obj\Debug\WorkerRole1 has libDLL
but AzureCloudService1\obj\Debug\WorkerRole2 has refDLL

Expected  behavior
AzureCloudService1\obj\Debug\WorkerRole2 should contain libDLL.
Actual behavior
AzureCloudService1\obj\Debug\WorkerRole2 contains refDLL.
Environment data
msbuild /version output:
Microsoft (R) Build Engine version <IP_ADDRESS>344 for .NET Framework
Copyright (C) Microsoft Corporation. All rights reserved.

<IP_ADDRESS>344

Addionational info
From the logs, I noticed the following difference between WorkerRole1 and WorkerRole2.
WorkerRole1:
C:\Users\jonas\source\repos\AzureCloudService1\packages\System.ValueTuple.4.5.0\lib\net461\System.ValueTuple.dll
CopyLocal = true
FusionName = System.ValueTuple, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51
HintPath = ..\packages\System.ValueTuple.4.5.0\lib\net461\System.ValueTuple.dll
ImageRuntime = v4.0.30319
MSBuildSourceProjectFile = C:\Users\jonas\source\repos\AzureCloudService1\WorkerRole1\WorkerRole1.csproj
MSBuildSourceTargetName = BuiltProjectOutputGroupDependencies
OriginalItemSpec = System.ValueTuple, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51, processorArchitecture=MSIL
ReferenceAssembly = C:\Users\jonas\source\repos\AzureCloudService1\packages\System.ValueTuple.4.5.0\lib\net461\System.ValueTuple.dll
ReferenceSourceTarget = ResolveAssemblyReference
ResolvedFrom = {HintPathFromItem}
Version = <IP_ADDRESS>
WorkerRole2:

C:\Users\jonas\.nuget\packages\system.valuetuple\4.5.0\ref\net461\System.ValueTuple.dll
CopyLocal = false
ExternallyResolved = true
FusionName = System.ValueTuple, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51
HintPath = C:\Users\jonas\.nuget\packages\system.valuetuple\4.5.0\ref\net461\System.ValueTuple.dll
ImageRuntime = v4.0.30319
MSBuildSourceProjectFile = C:\Users\jonas\source\repos\AzureCloudService1\WorkerRole2\WorkerRole2.csproj
MSBuildSourceTargetName = BuiltProjectOutputGroupDependencies
NuGetPackageId = System.ValueTuple
NuGetPackageVersion = 4.5.0
NuGetSourceType = Package
OriginalItemSpec = C:\Users\jonas\.nuget\packages\system.valuetuple\4.5.0\ref\net461\System.ValueTuple.dll
Private = false
ReferenceAssembly = C:\Users\jonas\.nuget\packages\system.valuetuple\4.5.0\ref\net461\System.ValueTuple.dll
ReferenceSourceTarget = ResolveAssemblyReference
ResolvedFrom = {HintPathFromItem}
Version = <IP_ADDRESS>

After searching for other related issues on various Microsoft issue trackers, I found this one, which seems related: https://github.com/dotnet/sdk/issues/1738.

I got exactly the same issue, but on some other packages like System.Buffers. The dlls under ref folder was copied, instead of lib folder. Is there any workaround except reverting back to Reference?

@zhaomuzhi I got around the problem in my toy project by re-targeting the projects to .net 4.7.2.
probably related to https://twitter.com/terrajobst/status/1031999730320986112?lang=en
To get that to run in the Cloud Services you either need to:
Update to Guest OS Family 6 has recently been released, which includes .NET Framework 4.7.2.
I haven't tried it out yet, as I'm waiting for the Azure DevOps Build Agents to get Azure SDK 3.0.
https://developercommunity.visualstudio.com/content/problem/443790/the-os-family-6-you-are-trying-to-deploy-is-not-su.html
For Guest OS Family 5, you need to install .net 4.7.2 as part of the deployment process.
https://docs.microsoft.com/en-us/azure/cloud-services/cloud-services-dotnet-install-dotnet

Well, this seems to be behaving as expected actually. Besides that, this does not seem to be an MSBuild issue either.
4.6.2 does not contain the assembly, therefore it needs to be acquired through nuget and distributed with the app. If you want to avoid that, you need to target a TFM where it is supported, net4.7.2, for instance. The system is doing what it is supposed to do.

@livarcocc I've update the issue description to hopefully be more clear.
Short story, I am consuming System.ValueTuple as a nuget package from my 4.6.1 project and it works when using packages.config.
The problem happens when switching from packages.config to <PackageReference> as that causes another dll to be copied to the obj folder of the Cloud Service.

I got the same issue, so I upgraded all projects to target 4.7.2.
After upgrading I ran Update-Package -reinstall in Package Manager Console to reinstall all nuget packages in my solution to target 4.7.2.
On Cloud Services I switched to osfamily = "6".
I am still using Azure Authoring Tools 2.9

This seems like something that NuGet should/could take a look on. I am going to move this issue to NuGet.

This issue was moved to NuGet/Home#8723

FYI I think neither MSBuild nor NuGet nor the Azure SDK for .NET project is the right place for this bug.
I've provided an update together with a workaround in https://github.com/Azure/azure-sdk-for-net/issues/3699#issuecomment-612306965


Neurodata Lab Infrastructure Info

I have some personal notes about things like how to update our neuroglancer fork, or how our documentation websites work. Would these be appropriate for here?

I think so!


Error: File .graphql doesn't match any project

Describe the bug
After following the installation instructions, every graphql reports the following error:

JabRefOnline\api\documents\schema.graphql
0:0  error  Parsing error: File 'JabRefOnline\api\documents\schema.graphql' doesn't match any project

To Reproduce
Install the linter as described in the readme, and run it.
In particular, this is in the eslint config:
  overrides: [
    {
      files: ['*.graphql'],
      parser: '@graphql-eslint/eslint-plugin',
      plugins: ['@graphql-eslint'],
      rules: {
        '@graphql-eslint/known-directives': 'error',
      },
    },
    {
      files: ['*.tsx', '*.ts', '*.jsx', '*.js'],
      processor: '@graphql-eslint/graphql',
    },
  ],

(I also tried to pass the schema using parserOptions with no success)
and the graphql.config is
const config = {
  schema: ['api/**/*.graphql'],
  extensions: {
    codegen: { ... },
  },
}

The full set of changes/code can be found at https://github.com/JabRef/JabRefOnline/pull/166/files.
I investigated this problem a bit and the error is thrown here:
https://github.com/kamilkisiela/graphql-config/blob/89767c8b3dc56a930f42e5e96bcbc43bd5644f41/src/config.ts#L225-L227
However, I don't understand why the project is not found - as you see above I only have one, and this one also doesn't have any include or exclude statements.

Expected behavior
No error, but linting of the graphql file.

Environment:

OS: Win 10
@graphql-eslint/...: 1.0.1
NodeJS: 14.14.37

Additional context

Thanks for the detailed reports!
I'm not adding a lot here but I'm just labeling it according to our new Contribution Guide and issue flow.
It looks like already got it into stage 0! thank you for that!
Now in order to advance to stage 1 we'll need a running reproduction. Please keep in mind to remove unnecessary dependencies, code, packages and so on which are not related to the issue.

I tried it again, and the error disappeared after updating to the latest version (of this plugin, as well as other graphql-related dependencies). So I'll close this issue. Sorry for the noise.


[Feature Request]: Custom content inside table-cell

Requirements before reporting

[X] No duplicated issue reported
[X] I have read the contribution guidelines
[X] I have checked the lastest version if the feature exist there

Type of feature request
Functionality
What is your feature request?
I would like to be able to add custom content inside a table cell in the table component.

Ignore the renaming functionality in the gif, I just want the option to have some sort of action menu inside the last table-cell of every table-row.
Background
I need this feature due to the following use case;
The user should be able to replan the specific activity(the table row) from within the table row. But more than that, the user should also be able to take other actions with the activity, such as removing the activity, view more information about it and such.
Idea
Slot? Or maybe a action-cell prop
Goals and objectives
Fullfilling this usecase:
The user should be able to replan the specific activity(the table row) from within the table row. But more than that, the user should also be able to take other actions with the activity, such as removing the activity, view more information about it and such.
Timeline
No deadline, using other library meanwhile
Resources
No response
Contact information
<EMAIL_ADDRESS>

Closing this due to the fact that im actually able to do just this without any real help for you guys


Playlists don't work

title

Try to run Update.bat first.
If the problem persists you can try opening an issue on https://github.com/ytdl-org/youtube-dl
This is the library that the program uses to download video.


txt2tas function

Hello,
I am trying to make a traffic low. trafgen looks like an option but there is a bug.
In plugins>trafgenclasses.py, txt2tas function uses 1 parameter. However, it is defined by 2 parameters in bluesky>tools>misc.py as txt2tas(txt, h).
This mismatch needs to be fixed.
Also, is there any way to define a simple traffic from point A (created) to point B (deleted)?
Any scenario file will be appreciated.

Hi!
The bug you mentioned is fixed in f603c98. I think the behaviour you are looking for is almost possible with the trafgen plugin, but that would require some edits to the code. Maybe the creator of this plugin can weigh in, @ProfHoekstra ?


Run button is activated after enabling/disabling logging mode

Describe the bug
When logging mode is enabled or disabled, the Run button is activated, but MF is already in Run mode and is running.  Pressing the Run button, actually Stops MF, and another press of Run is necessary to reestablish the Run mode.
Steps To Reproduce
Steps to reproduce the behavior:

MF should be running normally with the sim.
Go to Settings and check Enable logging mode.
Exit Settings
Note Run button is activated, also note MF is running normally with the sim.
Press Run button... note MF stops.
Press Run button again... note MF now runs normally
Same happens when disabling logging mode

Expected behavior
After enabling or disabling logging mode, if MF was running already, Run button should stay deactivated.
Actual behavior
Run button is activated even though MF is already running normally.
Details

MobiFlight Version: 9.0.0
FlightSim: MSFS2020
AddOn: Irrelevant

Additional context
None

This reproduces simply by opening and closing the settings dialog, no need to make a change to the logging setting.

Open dialog
Hit ok

I think I figured this out. Opened a little fix for Seb to look at. It works, but he might have a suggestion for a better way to handle it.


[backport] Fix TypeError during BN deserialization on win64

Backport of #6765

[automatic post] Jenkins, test this please.

Jenkins, test this please.

Jenkins CI test (for commit 6819c25c328bca32e9376c5c40580052beb15e20, target branch v6) succeeded!


Unclear error: secretOrPrivateKey must be an asymmetric key when using RS256

I have tried to use this action with a newly created internal github-app and get this error.
I guess it means my secret is wrong?
Could I have formatted it incorrectly?
Is it likely to be similar to this stackoverflow question? (PEM format, extra whitespace etc)
https://stackoverflow.com/questions/75635389/secretorprivatekey-must-be-an-asymmetric-key-when-using-rs256

I've tried using the app's Client Secret key that I generated (42 char hex string)
I've tried an app private key: SHA256:<base64 string XYZ0123/=>
Tried private key without SHA256: prefix

at module2.exports [as sign] (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:10369:26)
Error: secretOrPrivateKey must be an asymmetric key when using RS256
at getToken (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:10500:27)
at githubAppJwt (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:10516:27)
at getAppAuthentication (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:11822:90)
at hook (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:12115:41)
at newApi (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:30550:36)
at getTokenFromOwner (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:29956:26)
at /home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:29937:71
at RetryOperation._fn (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:29856:30)
at Timeout. (/home/runner/work/_actions/actions/create-github-app-token/v1/dist/main.cjs:12311:14)

ooof, I created a new private key, and down came a .pem!
Copied the contents of that directly into the secret, and it's worked!
(someone else generated my initial private key + secret, and I guess copied the wrong thing - doing it myself was a bit more obvious what the content should be :)

Perhaps still, the docs could be clearer that the key is the contents of the .PEM and not the key displayed in the app.
The error could also be better for users

It must be documented the SECRET_PEM value MUST be the content of the .pem file and not the base64 of the .pem as it documented elsewhere in the GitHub docs.

as it documented elsewhere in the GitHub docs

if you could please point us to where it's documented, we will make sure it gets fixed


899 Improved available_plugins module and added full unit tests for it

Addition of tests to this module required a bit more decoupling of
modules and found a bug where the plugin maps were volatile from
consuming classes so this sets of hanges fixes that and adds tests to
cover majority of the functionality.
What ticket does this PR close?
Connected to #899 but does not finish it (external_plugins still needs tests)
Where should the reviewer start?
go test -v ./internal/plugin/...
What is the status of the manual tests?
Have you run the following manual tests to verify existing functionality continues to function as expected?

[ ] Manually tested Keychain provider
[ ] Manually run the K8s demo (which requires changing the image the demo uses to the local build of Secretless)
[ ] Manually run Kubernetes-Conjur demo with a local Secretless Broker image build of your branch

If this feature does not have any/sufficent automated tests, have you created/updated a folder in test/manual that includes:

[ ] An updated README with instructions on how to manually test this feature
[ ] Utility start and stop scripts to spin up and tear down the test environments
[ ] A test script to run some basic manual tests (optional; if does not exist, the README should have detailed instructions)

Links to open issues for related automated integration and unit tests
Links to open issues for related documentation (in READMEs, docs, etc)
Screenshots (if appropriate)

These are my general notes after looking at what we're trying to do here, and thinking about how unit testing it.  This is just outline so may require some in person discussion to clarify.
Internal Plugins
The current UTs for the internal plugins should be removed imo.
Since we are simply returning a struct, there is a nothing to test.  The
InternalPluginLookupFunc, in particular, serves no purpose here. If one were
to insist on testing something here, it would simply be a test asserting that
the plugins we expect are there are there.  And it would need to updated in
tandem with any additions or deletions to the internal plugins we support.
External Plugins
For the func ExternalPlugins, there are tests to do.  However, they are all
simply tests that our validations are working.  That is, assertions on the
errors  returned for the various error conditions.
Before listing those, some general notes first:

Give it the raw plugins, rather than the func to look them up.
When there are true errors, we should return them and leave it to the
framework to log them.  Which means the only thing we should be using the
logger for in here is issuing warnings. I would consider passing only a
warning function, rather than the full logger, to make this clear.  That
will slightly ease testing the expected warnings as well.
Note that go_plugin.Plugin does not provide you with an interface, so to
mock this you'll need to create one.  It has only the single method Lookup,
so it will be easy.

So what do we need to test here:

Returns appropriate errors for the validations done in parsePluginMetadata
Check that it returns any the expected errors
Check that it issues all the expected warnings
Correctly separates plugins by type

For LoadPluginsFromDir, there's not much to test.  I would probably not bother.
If you were going to test this though, you'd need to inject the os functions
somehow (not hard, but slightly longer discussion).  Then you'd be testing that:

"Plugin directory '%s' not found. Ignoring external plugins..." warning is issued
when appropriate.
That the plugins are verified.  Again, requires injection of
VerifyPluginChecksums.  Also not hard but details are another discussion.

That's it.  There's nothing else to test here.  The actual logic in
VerifyPluginChecksums is tested in those UTs.

@jonahx some thoughts on your comments:

it would simply be a test asserting that
the plugins we expect are there are there. And it would need to updated in
tandem with any additions or deletions to the internal plugins we support.

Sure but that's exactly the idea behind a UT here: we would be verifying that some aspects of internal plugins list is correct (length, type, maybe both?) so that problems here are identified by the tests (even though it's duplication and seems superfluous to some extent).

the only thing we should be using the logger for in here is issuing warnings

Yes and no to an extent? I feel like we should strive to log whatever is valuable and the debug filter should snip out the non warnings if that flag is false otherwise that debugging info won't exist at all. To me it kind of seems like the point of the logger and you dial up/down the level to show more or less of that info.

For the func ExternalPlugins, there are tests to do

So this is the problem - I know what I should test but how to test this seemed overly gnarly to me without a mocking framework. Any way you can do a test or two on this so that I can see what you had in mind?


Add convenience functions for encoding from and decoding to strings

Thank you for your contribution! However, I would prefer to keep the base2048 API ultra-streamlined. These new APIs are simple enough that users can implement them themselves - which would also allow them the option of using encodings other than UTF-8 for their string inputs and outputs. I might consider adding this as example code to the documentation, though.
(It doesn't matter at this point, but I would also have liked to see unit tests, and documentation for the new APIs. And perhaps it would be more efficient to create a single TextEncoder and TextDecoder and reuse them, instead of creating a brand new instance on every encode and decode call.)


constructing a FixedSizeArray from a generator

Regular Arrays can be conveniently constructed using comprehensions:
julia> [(i, j) for i=1:3, j=1:2]
3×2 Matrix{Tuple{Int64, Int64}}:
 (1, 1)  (1, 2)
 (2, 1)  (2, 2)
 (3, 1)  (3, 2)

The above is basically equivalent to constructing a generator and collecting it:
julia> collect((i, j) for i=1:3, j=1:2)
3×2 Matrix{Tuple{Int64, Int64}}:
 (1, 1)  (1, 2)
 (2, 1)  (2, 2)
 (3, 1)  (3, 2)

A proposal exists to have Array constructors behave equivalently to collect here: https://github.com/JuliaLang/julia/issues/16029. We do need some nice way of constructing FixedSizeArrays, so maybe we could have a constructor method that takes a Base.Generator? Or at least a convert method.

A related issue is that constructing FixedSizeArrays from iterators could be more convenient if we could use Julia's type inference, and some packages do use Core.Compiler.return_type, but this is currently not permitted. Perhaps an issue should be created on JuliaLang/julia to try and get an interface for type inference.

xref https://github.com/JuliaLang/julia/issues/54207


pytorch version TAPIR 's training file

can you release train Tapir pytorch .py files?

Sorry, we don't currently have the bandwidth to port our tapir training code over to pytorch and properly test it.  All of our current development is still in JAX.

I will close it now since we are not planning to implement pytorch training for TAPIR so far. We may re-open if there is indeed a version.
We also welcome pytorch implementation of TAPIR training from external world. Thanks.


sx does not behave correctly with Box and Theme

Using "primary.main" in Box component does not use the theme color, instead, it uses the default material UI theme. this issue does not exist in Grid component though

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
does not work and uses the default theme color
      <Box
        sx={{
          height: "100%",
          width: "100%",
          backgroundColor: "primary.main",
          boxShadow: "inset 0px 0px 125px -22px #000000",
        }}
      ></Box>

does work and uses the custom theme color
      <Grid
        sx={{
          height: "100%",
          width: "100%",
          backgroundColor: "primary.main",
          boxShadow: "inset 0px 0px 125px -22px #000000",
        }}
      ></Grid>

Expected Behavior 🤔
Box use the correct theme
Steps to Reproduce 🕹
Steps:

Wrap the app in ThemeProvider
Pass a custom theme with a custom palette colors
Style the Box component and giving it a theme color

Context 🔦
Giving a background color to a div
Your Environment 🌎

`npx @mui/envinfo`
  System:
    OS: Linux 5.10 Manjaro Linux
  Binaries:
    Node: 14.16.0 - /usr/bin/node
    Yarn: 1.22.11 - /usr/bin/yarn
    npm: 7.18.1 - /usr/bin/npm
  Browsers:
    Chrome: 91.0.4472.106 (Official Build) (64-bit)
    Firefox: 89.0.1
  npmPackages:
    @emotion/react: ^11.4.1 => 11.4.1
    @emotion/styled: ^11.3.0 => 11.3.0
    @mui/core:  5.0.0-alpha.50
    @mui/icons-material: ^5.0.3 => 5.0.3
    @mui/material: ^5.0.3 => 5.0.3
    @mui/private-theming:  5.0.1
    @mui/styled-engine:  5.0.1
    @mui/system:  5.0.3
    @mui/types:  7.0.0
    @mui/utils:  5.0.1
    @types/react: ^17.0.0 => 17.0.27
    react: ^17.0.2 => 17.0.2
    react-dom: ^17.0.2 => 17.0.2
    typescript: ^4.1.2 => 4.4.3 ```
</details>

my bad! i was using
import { ThemeProvider } from "@emotion/react";
instead of
import { ThemeProvider } from "@mui/material";


Just doesn't work, stops when gets to uninstalling "YourPhone", doesn't continue, no error messages.

Describe the Bug
When running the debloater, when it uninstalls the default windows apps, when it gets to the YourPhone app, it doesnt continue. It doesnt display an error message, it just pauses.
How can this issue be reproduced?

run debloater

Expected behavior?
this debloater should actually work
Operating System
Windows 11
Operating System Version
22H2
Screenshots
No response
Logs
No response
Additional Info
No response

Sounds like you clicked in the powershell window. Clicking in the window pauses any script. Pressing any key on your keyboard will unpause it.

This could happen while removing this app, I had the same trouble before, but it was before Windows 11.
I ran this script on Windows 10 22H2 and Windows 11 22H2, and can assure you this won't happen anymore.


Consul Catalog constraints does not seem to work

Using latest traefik; and frontend Rules are working; hooked up automatically via tagging as per below via Nomad scheduler.
...
        tags = [
                "traefik.tag=blue",
                "traefik.frontend.rule=Host:www.<IP_ADDRESS>.xip.io;Path:/whoami",
                "traefik.frontend.entryPoints=http"
        ]
...

However, when running with simple constraints; it does not seem to work (everything is pruned).
sudo ./traefik  --constraints="tag==blue" --debug

Debug log:
...
DEBU[2016-12-09T13:01:31Z] Service global-whoami pruned by 'tag==blue' constraint
DEBU[2016-12-09T13:01:31Z] Service global-whoami pruned by 'tag==blue' constraint
DEBU[2016-12-09T13:01:31Z] Service global-whoami pruned by 'tag==blue' constraint
DEBU[2016-12-09T13:01:31Z] Service global-whoami pruned by 'tag==blue' constraint
DEBU[2016-12-09T13:01:31Z] Service global-whoami pruned by 'tag==blue' constraint
...

Try changing  "traefik.tag=blue" to  "traefik.tags=blue"
You can add more tags: "traefik.tag=blue,external,lolcats"

@freefood89 Thanks; it works!  For reference, the below setup works for me:
Only route to containers tagged 'lolcats':
sudo ./traefik  --constraints="tag==lolcats"

Jobs with multiple traefik.tags (including the 'lolcats' tag):
...
        tags = [
                "traefik.tags=blue,lolcats",
                "traefik.frontend.rule=Host:www.<IP_ADDRESS>.xip.io;Path:/whoami",
                "traefik.frontend.entryPoints=http"
        ]
..

@freefood89 from docs it's not very evident that traefik will only parse consul tags that start with traefik.tags=, e.g.
{
    "services": [
        {
            "name": "web-srv",
            "port": 8080,
            "tags": [
                "traefik.tags=trk"
            ]
        }
    ]
}

it will be more user-friendly if traefik consumes ordinary consul tags, e.g
{
    "services": [
        {
            "name": "web-srv",
            "port": 8080,
            "tags": [
                "trk"
            ]
        }
    ]
}

as shown in consul docs


Genotype pages don't need the single/multi-allele label

The labels "Single allele phenotype" and "Multi allele phenotype" are superfluous on the genotype pages. Each genotype has either one allele of interest or more than one, and therefore no genotype page will have both single- and multi-allele phenotypes. (Note that this is disregarding background, even after the lumping described in https://github.com/pombase/website/issues/284#issuecomment-297967038).
tangential note: in "Multi-allele phenotype", "Multi-allele" should be hyphenated, because "multi" is not a word on its own; it's a prefix.

I've changed it to "Annotations for this genotype" for now.  Might need changing when we do https://github.com/pombase/website/issues/284#issuecomment-297967038

"Multi-allele phenotype", "Multi-allele" should be hyphenated

I've changed that in the config and re-released.


Error in roots watch when using roots-wordpress

Hi there,
Been trying out the roots-wordpress plugin today and noticed an issue. I have been following the 'Wordpress and Roots' screencast from the roots.cx site and I have found that when linking up my website to the extension, updating the view to iterate through each post and then run roots watch I am getting the following error:
events.js:72
throw er; // Unhandled 'error' event
^
Error: listen EADDRINUSE
at errnoException (net.js:904:11)
at Server._listen2 (net.js:1042:14)
at listen (net.js:1064:10)
at Server.listen (net.js:1138:5)
at Function.start (/usr/local/lib/node_modules/roots/node_modules/charge/lib/index.js:111:43)
at Server.start (/usr/local/lib/node_modules/roots/lib/local_server.js:56:32)
at Compile. (/usr/local/lib/node_modules/roots/lib/cli/watch.js:57:24)
at tryCatchReject (/usr/local/lib/node_modules/roots/node_modules/when/lib/makePromise.js:845:30)
at runContinuation1 (/usr/local/lib/node_modules/roots/node_modules/when/lib/makePromise.js:804:4)
at Fulfilled.when (/usr/local/lib/node_modules/roots/node_modules/when/lib/makePromise.js:592:4)
at Pending.run (/usr/local/lib/node_modules/roots/node_modules/when/lib/makePromise.js:483:13)
at Scheduler._drain (/usr/local/lib/node_modules/roots/node_modules/when/lib/Scheduler.js:62:19)
at Scheduler.drain (/usr/local/lib/node_modules/roots/node_modules/when/lib/Scheduler.js:27:9)
at process._tickCallback (node.js:419:13)
The page does update, I am seeing the correct content from WordPress but of course this error causes the watcher to pack in which means I have to re run the command every time I update a view etc which is a bit of a pain. As far as I can tell, I've not deviated away from the video so I imagine everything should work as per the screencasts.
I was just wondering if anyone else had come across this issue before and if so is there something missing from the video or is it an issue with the extension?
Cheers!

This means you have another roots project running in another terminal tab. EADDRINUSE is short for "Error, address in use".

Thanks Jeff, sorry for the silly ticket - still getting to grips with it - so far it's awesome though :)


snapshot of new tables in Postgres

Hello!
Previously we described a problem when a new table is created in Postgres - https://github.com/Altinity/clickhouse-sink-connector/issues/438
There is the same problem in the version 2.1.0-lt.
The old issue is closed, but it seems that the situation has not changed.
Is there any news about this?

Did you have the snapshot.mode set to initial?

yes, we use this mode.
Our config:
table.include.list: "public.companies, public.messages"
snapshot.mode: "initial"
offset.flush.interval.ms: 5000
enable.snapshot.ddl: "true"
auto.create.tables: "true"
publication.autocreate.mode: "filtered"

this works well the first time you run the connector
We would like to add several more tables to the table.include.list and so that when the connector is restarted, a snapshot is taken for these tables first, and then replicated.
Is it possible?

Looks like the problem described here https://debezium.io/blog/2021/10/07/incremental-snapshots/

this will be great, thanks!

Hello again.
We are trying to use incremental snapshots from the Debezium documentation. It works, but there are strange things - the connector starts to consume a lot of CPU.
we deploy the connector in k8s and after the start of the incremental snapshot, the container consumes 6-8 vCPU.  there are only 100 thousand rows in the table, but the connector is loaded and cannot copy them.
Perhaps you have some ideas about this?


Consider support for multivariate student-t distribution?

The multivariate student-t distribution is used extensively within academia, science and finance, primarily for its fatter tails (larger kurtosis) when compared to the normal distribution. This yields more rare events (random samples) that would almost never occur when sampling from a multivariate normal distribution.
The multivariate student-t can be expressed in terms of the univariate chi-squared and multivariate normal, or univariate gamma and multivariate normal. While these functions are very short and simple to write from scratch, having to maintain and test the function between different user applications just adds to overhead; in addition, these hand coded functions would not be fully optimized.
Therefore, I feel that scipy support of the multivariate student-t would greatly benefit the community. Thanks :)

Pull requests welcome :-)

Is there anything I need to do to get the PR reviewed or is it simply down to the core maintainers' time? I'm not sure what the typical time for a PR review is, but it's been a month and a half now.

@gwgundersen your PR looks pretty good. It's indeed down to time from a maintainer with stats knowledge. I have added the 1.5.0 milestone, so we're sure not to forget before the next release.

I'm not sure what the typical time for a PR review is, but it's been a month and a half now.

For complex PRs like this one, that's unfortunately not uncommon - SciPy is a complicated beast to maintain in evenings/weekends.

Can anyone in this thread please help me get this PR in a stable state again? I believe the tests fail because the doc build fails because of this inconsistency. In other words, I need to build SciPy locally and commit the updated version file, which will align the version numbers.
Assuming that's the correct issue, I can no longer build SciPy from source. This linker command fails:
(scipy-dev) gwg:scipy gwg$ /usr/bin/gcc -bundle -undefined dynamic_lookup -L/Users/gwg/miniconda3/envs/scipy-dev/lib -arch x86_64 -L/Users/gwg/miniconda3/envs/scipy-dev/lib -arch x86_64 -arch x86_64 build/temp.macosx-10.9-x86_64-3.7/scipy/spatial/src/distance_wrap.o -L/Users/gwg/miniconda3/envs/scipy-dev/lib/python3.7/site-packages/numpy/core/lib -Lbuild/temp.macosx-10.9-x86_64-3.7 -lnpymath -o scipy/spatial/_distance_wrap.cpython-37m-darwin.so

with the following error:
ld: in /Users/gwg/miniconda3/envs/scipy-dev/lib/python3.7/site-packages/numpy/core/lib/libnpymath.a(npy_math.o), could not parse object file /Users/gwg/miniconda3/envs/scipy-dev/lib/python3.7/site-packages/numpy/core/lib/libnpymath.a(npy_math.o): 'Unknown attribute kind (61) (Producer: 'LLVM10.0.0' Reader: 'LLVM APPLE_1_1<IP_ADDRESS>_0')', using libLTO version 'LLVM version 10.0.0, (clang-1<IP_ADDRESS>)' for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

I think the issue is related to the producer compiler being different from the reader compiler, since it says: "Unknown attribute kind (61) (Producer: 'LLVM10.0.0' Reader: 'LLVM APPLE_1_1<IP_ADDRESS>_0')". But I'm not sure how these are specified in the build process. My software versions are:
$ clang --version
Apple LLVM version 10.0.0 (clang-1<IP_ADDRESS>)
Target: x86_64-apple-darwin17.7.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

$ gcc --version
Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Apple LLVM version 10.0.0 (clang-1<IP_ADDRESS>)
Target: x86_64-apple-darwin17.7.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

I'm using macOS High Sierra 10.13.6.


Triangle example using GLFW

GLFW triangle example from #1199

The problem here is minimizing the code duplication with existing code. This PR copies a lot of stuff (code, screenshot, shaders, etc). I wonder if we can have everything as optional code paths inside the same triangle example.

Oh, I thought that was the point. To make the triangle example use glfw, and make it as close to glutin implementation as possible :)
By "optional code paths", do you mean having triangle examples share the same assets?

@Haggus I'm sorry, there is a lot of discussion context between me and @icefoxen that got lost and not expressed in the original issue. I believe there is a solution that would require minimum code/maintenance and would be helpful for anyone choosing GLFW/SDL. This solution is to:

Have the examples to be inside the corresponding window backend folders (src/window/glfw/examples/)
Don't draw anything, just clear the screen. We can have a comment referring to the triangle example for the actual drawing code, it's not going to be any different.

How does this sound to you?

@kvark that sounds good. I don't mind changing it, so if this is how you guys want it, then it's OK with me. I'll submit changes as soon as I can!

@kvark let me know what you think about these changes.
Also, now that I think about it, this example should probably be called "GLFW Example".

Should be good now. Let me know if you'd like any other changes! :)

There is one small fix needed in the root Cargo.toml now to point to gfx_window_glfw 0.15

Should be good now :)

Thanks! 🤞

This looks like a bug :( I can repro it on my machine. cargo test -p gfx_window_glfw doesn't use dev-dependencies section for some reason. I propose to move it into the regular dependencies, but add a //TODO note mentioning the problem. Also, the path should really just be "../../render".

Here is the bug: https://github.com/rust-lang/cargo/issues/860

Thanks @Haggus for finding the issue! I commented on there.


Tagged feature is broken

Describe the bug
A clear and concise description of what the bug is.
I get a traceback error every time I attempt to download a user's tagged posts.
To Reproduce
Steps to reproduce the behavior:
(e.g. Instaloader command line)
instaloader +args.txt
Expected behavior
A clear and concise description of what you expected to happen (even if it seems obvious).
Expected it to work.
Error messages and tracebacks
If applicable, add error messages and tracebacks to help explain your problem.
  File "C:\Users\Chris\AppData\Local\Programs\Python\Python38\Scripts\instaloader-script.py", line 33, in <module>
    sys.exit(load_entry_point('instaloader==4.9.1', 'console_scripts', 'instaloader')())
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\__main__.py", line 471, in main
    _main(loader,
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\__main__.py", line 220, in _main
    instaloader.download_profiles(profiles,
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 1442, in download_profiles
    self.download_tagged(profile, fast_update=fast_update, post_filter=post_filter,
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 1240, in download_tagged
    self.posts_download_loop(tagged_posts,
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 1040, in posts_download_loop
    downloaded = self.download_post(post, target=target)
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 724, in download_post
    downloaded &= self.download_pic(filename=sidecar_filename, url=sidecar_node.display_url,
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 97, in call
    return func(instaloader, *args, **kwargs)
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloader.py", line 356, in download_pic
    self.context.write_raw(resp, filename)
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloadercontext.py", line 494, in write_raw
    self.log(filename, end=' ', flush=True)
  File "c:\users\chris\appdata\local\programs\python\python38\lib\site-packages\instaloader\instaloadercontext.py", line 107, in log
    print(*msg, sep=sep, end=end, flush=flush)
  File "c:\users\chris\appdata\local\programs\python\python38\lib\encodings\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\uff1a' in position 11: character maps to <undefined>

Instaloader version
instaloader --version output.
4.9.1
Additional context
Add any other context about the problem here.
If a tagged directory doesn't exit it creates one. However, it creates a directory named : tagged and I believe what is causing the traceback is that the : character is an invalid character. I believe the directory should be named and created tagged.

To Reproduce
Steps to reproduce the behavior:
(e.g. Instaloader command line)
instaloader +args.txt
Expected behavior
A clear and concise description of what you expected to happen (even if it seems obvious).
Expected it to work.

Not reproducible, incomplete bug description.


Fix ONNX importer (Gemm output name)

Refer to issue #668

Thank you very much, we have already fixed it at https://github.com/sony/nnabla/commit/b9e4ec76c44af5104e03d8863a232e0581275117
, you may obtain the latest NNabla version to avoid it.


Dummy under fs

create a dummy UnderFS so that we can use Tachyon as a pure cache without backing store

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/2866/
Test PASSed.


Decktape/ Phantomjs Issue

Even as root I get to following output:
./phantomjs decktape.js generic --keycode=Space "http://<IP_ADDRESS>:9099/" presentation_template.slides.pdf
bash: ./phantomjs: Permission denied

https://github.com/ariya/phantomjs/issues/11688 (This was my first idea)
Any idea ? (Also tried to install current Decktape-Version 2.4 but had issues with hummus)

Even with sudo?

 phantomjs decktape.js generic --keycode=Space "http://<IP_ADDRESS>:9099/" presentation_template.
SyntaxError: Unexpected token 'const'
Error: Cannot find module 'printer'

After installing Node.js and npm current version


Update Kustomize to the latest

What
We are using an old version of kustomize. We should move to the newest version

https://github.com/Kuadrant/deployments/blob/fbe1995f329f5f12a48ecefa62eccd169f0ea4c4/argocd/argocd-install/config/configManagementPlugins.yaml#L9-L12

This issue is stale because it has been open for 60 days with no activity.

This issue was closed because it has been inactive for 30 days since being marked as stale.

This issue is stale because it has been open for 60 days with no activity.

This issue is stale because it has been open for 60 days with no activity.

This issue was closed because it has been inactive for 30 days since being marked as stale.


[RFC] Add TVMDSOOp to integrate any TVM operator with TensorFlow

Problem
TensorFlow is one of the most popular machine learning libraries and most developers are used to train/inference models with TensorFlow/TensorFlow Serving. TVM is the flexible compiler to run computation efficiently in different devices. Although TensorFlow has implemented some efficient GPU operators, developers can benifit from TVM to get more than 10 times speedup and FPGA support. But TensorFlow and TVM have two different code stacks and runtime APIs to use.
There are two ways to integrated TVM with TensorFlow. The first one is tensorflow-to-tvm which has been support by relay importer. Most TensorFlow operators can be “translated” to TVM operators which is useful if want to run the TVM stack with the model structure from other frameworks.
The second one is tvm-to-tensorflow. This requires to embed TVM operators in TensorFlow graph so that we can use TensorFlow session to run preset operators and TVM-optimized operators. This is really helpful if we want to use TVM to optimize part of the computation graph while developers can use TensorFlow Python API to describe the model and use TensorFlow Serving for inference. Embedding TVM in TensorFlow requires the minimal cost to use TVM optimiztion on existing models and extend TensorFlow functionalities such as FPGA support.
This RFC describes how we design to support tvm-to-tensorflow with TensorFlow custom op API and the detail of implementation.
Considerations
Developers can use TVM stack to build operators without limitation.
Developers can use TVM Python package to import and load TVM operators in TensorFlow graph.
Developers can specify the output_shape/output_dtype/target_device/memory_align for TVM operators.
Proposal
The best way to extends TensorFlow functionality is building the TensorFlow custom op for TVM runtime. We build the operator called TVMDSOOp and it has implemented CPU and GPU kernels to load any TVM dynamic library. We can run TensorFlow graph with this op which invokes TVM inference with zero-copy Tensor data. Here is the walk-through examples.
Developer can implement the TVM operators with TVM Python API. All they need to do is exporting the dynamic libraries to local file system.
n = tvm.var("n")
A = tvm.placeholder((n,), name='A')
B = tvm.compute(A.shape, lambda *i: A(*i) + 1, name='B')
s = tvm.create_schedule(B.op)
fadd_dylib = tvm.build(s, [A, B], "llvm", name="addone")
fadd_dylib.export_library("tvm_addone_dll.so")

bx, tx = s[B].split(B.op.axis[0], factor=64)
s[B].bind(bx, tvm.thread_axis("blockIdx.x"))
s[B].bind(tx, tvm.thread_axis("threadIdx.x"))
fadd_dylib = tvm.build(s, [A, B], "cuda", name="addone")
fadd_dylib.export_library("tvm_addone_cuda_dll.so")

With the code in our pull-request, we will set set(USE_TFOP ON) and use CMake to build the TVM from scratch. It would generate the tvm_dso_op.so file and provide the tvm.contrib.tf_op in Python API. Then we can use TensorFlow and TVM to build the graph with TVM operators and run by TensorFlow session.
import tensorflow as tf
from tvm.contrib import tf_op

def main():
  mod = tf_op.Module("tvm_addone_dll.so")
  addone = mod.func("addone", output_shape=[2])

  with tf.Session() as sess:
    with tf.device("/cpu:0"):
      placeholder = tf.placeholder("float32", shape=[2])
      print(sess.run(addone(placeholder), feed_dict={placeholder: [1.0, 2.0]}))

    with tf.device("/gpu:0"):
      placeholder = tf.placeholder("float32")
      addone_gpu = tf_op.Module("tvm_addone_cuda_dll.so")["addone"]
      print(sess.run(addone_gpu(placeholder), feed_dict={placeholder: [1.0, 2.0]}))

if __name__ == "__main__":
  main()

Since every TensorFlow custom op should has specified input tensors, we wrap TVM Python API to support operators with up to 8 input tensors. Users can pass multiple TensorFlow tensors to TVMDSOOp if we support multiple inputs in TVM operators. The Python API looks the same as single input.
import tensorflow as tf
from tvm.contrib import tf_op

def main():
  left = tf.placeholder("float32", shape=[4])
  right = tf.placeholder("float32", shape=[4])

  feed_dict = {
    left: [1.0, 2.0, 3.0, 4.0],
    right: [5.0, 6.0, 7.0, 8.0]
  }

  module = tf_op.Module("tvm_add_dll.so")
  add = module.func("vector_add", output_shape=tf.shape(left), output_dtype="float")

  with tf.Session() as sess:
    with tf.device("/cpu:0"):
      print(sess.run(add(left, right), feed_dict))

if __name__ == "__main__":
  main()

For more examples, please refer to https://github.com/tobegit3hub/tftvm/tree/master/examples .
All the TVM operators can be embedded into TensorFlow graph with this TVMDSOOp and Python API. We don't need to copy data from TensorFlow(Tensor) to TVM(DLPack) with zero-copy therefore the performance should be great.

The implementation of this proposal has been submit to https://github.com/apache/incubator-tvm/pull/4459 .
Anyone can try to test their TVM operators by re-compiling TVM with set(USE_TFOP ON).

cc @jwfromm @jroesch @soiferj

The motivations of this RFC are extremely similar to those in pytorch-tvm, however the two implementations are very different and it is worth discussing the tradeoffs.

torch-tvm is self contained, it doesn't use any special functions or classes in TVM. Instead it modifies torch script to use existing TVM functions.
torch-tvm uses relay to represent subgraphs and then dynamically builds functions rather than using prebuilt libraries as proposed here.

I understand that the current implementation is the shortest path to getting tvm functions working in TensorFlow and that a torch-tvm approach would be a much larger undertaking. However, I don't think it will be able to scale well. The use of prebuilt libraries means there will be a lot of back and forth between regular tvm and tensorflow-tvm during development, and it seems like developers would be better off just importing their tf model to relay and doing everything within tvm. Contrast this to the torch-tvm approach where all the tvm magic happens transparently, making it very straight forward for pytorch users.
We should also consider where the code belongs. I personally prefer having projects like torch-tvm and tf-tvm being separate from the main tvm repo if possible as it we already are dealing with frontend bloat.
All that said, I think something like tf-tvm is a great idea and something we should work towards. I just want to make sure we make the first step carefully.

Thanks @jwfromm and you're definitely right. This is the fastest way to integrate TVM functions into TensorFlow if we can not convert the whole model to TVM. This may be meaningful for TensorFlow developers if they can to try TVM and leverage the sub-graph optimizaition from TVM.
Actually this project is the TensorFlow custom op with TVM runtime. We originally develop in the standalone project https://github.com/tobegit3hub/tftvm . Since it depends on TVM and TensorFlow to compile, it is okay to be one of the TVM contrib libraries or maintain in the independent project.

That makes sense, you're right that having it in contrib clears up a lot of my concerns. Thanks for those clarifications!

This is a great development, as-is allowing to use TVM in TF models that cannot be fully translated. I have some clarifying questions, also along the lines that jwfromm@ was thinking.
Suppose I want to implement a tool that takes a tf graph as input (be it from a saved model or some other input) and also writes a tf graph as output, where the difference is that the graph has been converted to use TVM for as much of the graph that can be supported, leaving behind only the pieces of TF that could not be converted to TVM. Also, any necessary compiled ops from TVM would be embedded in the output, so that a TF runtime can run it without having any TVM ops shipped with the runtime.
I think the work you've done is partway there to such a tool, allowing to represent TVM subgraphs in TF, leaving some other parts like automatically identifying the pieces of the TF graph that can be converted, and automatically exercising TVM to generate implementations of those subgraphs, and storing those compiled TVM ops alongside the model so that a plain vanilla TF runtime with no TVM ops shipped with it can run the model. Did I get that right?
@jwfromm I understand from the online and your description that pytorch-tvm is closer to enabling such a tool. Is it already such a tool, for PT, or is there still a distance remaining to that? (I didn't spot an ahead-of-time compilation mode)

Hi @tqchen @jwfromm @jroesch @soiferj , do you have any other comment?
We may add more docs about implementation and usage so that everyone can know it works.

The PR has been merged and we will close this issue.

@tobegit3hub Hi guys, i built tvm before and i built tvmsoop separately(not from USE_TF_TVMSOOP=ON) follow this:https://github.com/tobegit3hub/tftvm/tree/master/examples .
After i got libxx.so and link them to my tvm home, i run the test
import tensorflow as tf
from tvm.contrib import tf_op
mod = tf_op.Module("tvm_addone_dll.so")
addone = mod.func("addone", output_shape=[4])
with tf.Session() as sess:
a = tf.constant([10.1, 20.0, 11.2, -30.3])
b = addone(a)
print(sess.run(b))
and i got this error:
Traceback (most recent call last):
File "test_python.py", line 5, in
addone = mod.func("add_one, output_shape=[4]")
File "/opt/cephfs1/asr/users/qizhou.huang/.local/lib/python3.6/site-packages/tvm-0.7.dev1-py3.6-linux-x86_64.egg/tvm/contrib/tf_op/module.py", line 27, in func
return Func(self.lib_path, name, output_dtype, output_shape)
File "/opt/cephfs1/asr/users/qizhou.huang/.local/lib/python3.6/site-packages/tvm-0.7.dev1-py3.6-linux-x86_64.egg/tvm/contrib/tf_op/module.py", line 55, in init
self.module = load_library.load_op_library('tvm_dso_op.so')
File "/opt/cephfs1/asr/users/qizhou.huang/anaconda3/envs/tvm/lib/python3.6/site-packages/tensorflow_core/python/framework/load_library.py", line 61, in load_op_library
lib_handle = py_tf.TF_LoadLibrary(library_filename)
tensorflow.python.framework.errors_impl.NotFoundError: /opt/cephfs1/asr/users/qizhou.huang/qizhou/PycharmProjects/incubator-tvm/build/tvm_dso_op.so: undefined symbol: _ZN10tensorflow12OpDefBuilder4AttrESs
my gcc is 6.4.0,my tensorflow flow is tf-1.15.0 i use bazel build it from source and set -D_GLIBCXX_CXX11_ABI=1.
Btw, i also tried the pip install tensorflow,-1.13.1, same error. Couild you please help me out, thanks

@652994331 You should not tftvm which is deprecated and please rebuild TVM with USE_TF_TVMSOOP=ON.

@tobegit3hub  i tried before, but unfortunately, i had this error:
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'tensorflow'
CMake Error at cmake/modules/contrib/TF_TVMDSOOP.cmake:25 (message):
Fail to get TensorFlow compile flags
Call Stack (most recent call first):
CMakeLists.txt:334 (include)

@tobegit3hub  and here is the entire cmake log:
udo cmake ..
-- The C compiler identification is GNU 6.4.0
-- The CXX compiler identification is GNU 6.4.0
-- Check for working C compiler: /bin/cc
-- Check for working C compiler: /bin/cc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /bin/c++
-- Check for working CXX compiler: /bin/c++ - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Build with RPC support...
-- Build with Graph runtime support...
-- VTA build with VTA_HW_PATH=/opt/cephfs1/asr/users/qizhou.huang/qizhou/PycharmProjects/incubator-tvm/3rdparty/vta-hw
-- Build VTA runtime with target: sim
-- Build with standalone CRT
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda
-- Found CUDA_CUDA_LIBRARY=/usr/local/cuda/targets/x86_64-linux/lib/stubs/libcuda.so
-- Found CUDA_CUDART_LIBRARY=/usr/local/cuda/lib64/libcudart.so
-- Found CUDA_NVRTC_LIBRARY=/usr/local/cuda/lib64/libnvrtc.so
-- Found CUDA_CUDNN_LIBRARY=/usr/lib64/libcudnn.so
-- Found CUDA_CUBLAS_LIBRARY=/usr/local/cuda/lib64/libcublas.so
-- Found CUDA_CUBLASLT_LIBRARY=CUDA_CUBLASLT_LIBRARY-NOTFOUND
-- Build with CUDA support
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp (found version "4.5")
-- Found OpenMP: TRUE (found version "4.5")
-- Build with OpenMP /opt/cephfs1/asr/users/qizhou.huang/qizhou/intel-mkl/lib/intel64/libiomp5.so
-- Use llvm-config=/opt/cephfs1/asr/users/qizhou.huang/qizhou/llvm/bin/llvm-config
-- /opt/cephfs1/asr/users/qizhou.huang/qizhou/llvm/include
-- Found LLVM_INCLUDE_DIRS=/opt/cephfs1/asr/users/qizhou.huang/qizhou/llvm/include
-- Found LLVM_DEFINITIONS= -D_GNU_SOURCE -D_DEBUG -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS
-- Found TVM_LLVM_VERSION=90
-- Build with LLVM
-- Set TVM_LLVM_VERSION=90
-- Use BLAS library /opt/cephfs1/asr/users/qizhou.huang/qizhou/intel-mkl/mkl/lib/intel64/libmkl_rt.so
-- Use MKLDNN library /usr/local/lib64/libdnnl.so
-- Build with contrib.sort
-- Build with contrib.hybriddump
-- Found Python3: /usr/local/bin/python3.6 (found version "3.6.8") found components: Interpreter
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'tensorflow'
CMake Error at cmake/modules/contrib/TF_TVMDSOOP.cmake:25 (message):
Fail to get TensorFlow compile flags
Call Stack (most recent call first):
CMakeLists.txt:334 (include)

@652994331 You need to install tensorflow so that TVMDSOOp could link to TensorFlow libraries.
Here is the error message from your cmake.
ModuleNotFoundError: No module named 'tensorflow'

@tobegit3hub  thanks for the reply, i used pip install and also build tensorflow from source , if i use import tensorflow as tf; tf.version i can find 1.15.0 in my env. i guess there's something wrong with the path?

@tobegit3hub Maybe i should set up the tensorflow path in the config.cmake before i cmake tvm, sorry i am not pretty sure

@tobegit3hub It seems there are some lines about tensorflow path from the cmakelist.txt of tftvm projects(which's deprecated like u said) https://github.com/tobegit3hub/tftvm/blob/master/CMakeLists.txt
but in the cmakelist.txt of incubator-tvm projects(i am using the master branch), i cant find these lines about tensorflow path.
i think this is the problem, am i right using the master branch of incubator-tvm to build tvm with tvmsdoop.
Thanks

@tobegit3hub  Hi, i checked the cmake file again, i think the problem is: the TF_TVMDSOOP.cmake file use findpackages() to find {python3_executable}, the path it found's /usr/local/bin/python, but actually i am using a anaconda3 env and i installed tensorflow in this env. i tried to set python3_executable to my anaconda python path, not worked. Could you please help me about this, thank you!


Various optimizations

These are mostly optimizations from https://github.com/robur-coop/miragevpn/pull/223 but also some new ones since we have encrypt_into etc. functions.
main-bench.exe is built from 6099a4bd4134eedddd16090a083dc58d246eeae1 (unfortunately without --release)

As you can see above there are improvements in execution time, but most notably the number of minor words allocations is almost halved. When testing against an openvpn server I didn't observe much of a difference except, curiously, a slowdown in upload speed (from 826 Mb/s to 757 Mb/s). Why that would I don't know.

When testing against an openvpn server I didn't observe much of a difference except, curiously, a slowdown in upload speed (from 826 Mb/s to 757 Mb/s). Why that would I don't know.

Ah! This was with the UDP configuration. With TCP there is a slight speedup (down: 919 Mb/s -> 1.07 Gb/s, up: 599 Mb/s -> 652 Mb/s)

I accidentally committed and pushed 15ba1eda481228c8560eacd8b7a12e825d271af2 and eba6e587fac9b1756b63e92e13e327f546208e24 to main. They were a fix to the failing e2e test where I observed locally that it failed due to a Data_v1 packet with key id 0 arriving seemingly just after a successful rekey for key id 1. I don't know if it's the correct thing to do, but to me it seems for data packets we could be more lenient and just drop them.

Ah wait the e2e test already fails at the static client configuration. Locally, it initially also failed there for me, but that was due to firewall rules.

looks fine to me, may revert the e2e changes and redirect again to /dev/null

I cleaned up the git history a bit by merging two commits and dropping the CI debugging commit.
It fails on OCaml 5.3~alpha1 due to effect suddenly being a keyword. I'll address this separately.


Remove deprecated values (name, color)

Removed deprecated values from Skills settingsmeta.json (reported in issue #1092).

Looks good, thank you!


prioritize sheet creation (#353)

Do we need to add queue_order_strategy? https://docs.celeryproject.org/en/stable/userguide/routing.html#redis-message-priorities

cry

Do we need to add queue_order_strategy? https://docs.celeryproject.org/en/stable/userguide/routing.html#redis-message-priorities

cry


Support TypeScript 2.0's compiler options baseUrl, paths and rootDirs

I'd appreciate grunt-ts to support compiler options baseUrl, paths and rootDirs of the next TypeScript release.
Currently, it works for me using passThrough but that's a bit cumbersome.

This will be added to grunt-ts vNext as soon as I get the chance to implement it.  Thank you for the report.

Do you know when this enhancement will land?

It's possible to pass any arguments you wish to tsc with grunt-ts.  Please see the documentation for the additionalFlags feature here:
https://github.com/TypeStrong/grunt-ts#additionalflags
Native support for TypeScript flags are generally added to grunt-ts shortly after the official release due to churn/flags getting renamed or pulled, etc.

Hi @nycdotnet thanks for the response, yes you can pass any argument to tsc with the additionalFlags feature unfortunately for paths it would need more integrated support from grunt-ts as you cannot pass the paths argument via the command line only through the tsconfig.json
tsc --paths returns error TS6064: Option 'paths' can only be specified in 'tsconfig.json' file.

I see. If that is the case, it may be difficult to support other than using the passthrough option.  I will have to look into why the TypeScript team decided to not support that option from the command-line.

Indeed. I suspected that it would be difficult to support, I did have a look through the code and issue and didn't find any specific reasoning behind not supporting the option on the command line. perhaps it could be because maps are hard to represent as a command line option.
Yes currently I am using the passThrough options generating a target specific tsconfig.json using the projects tsconfig.json as a base in order to get this to work using paths.

I almost wonder if we need to get into the business of writing out a temporary tsconfig.json file based on the grunt setup, and then essentially always using pass-through.  Do you see a downside there?

Hi there, I face this same problem still. My project needs the --paths pass to tsc, but there is no way to set it. I tried passThrough options, but it still not working. Can someone give a working example of Grunfile.js that works with passThrough options?
Here is my Gruntfile.js:
module.exports = function(grunt) {
  grunt.initConfig({
    ts: {
      default : {
        tsconfig: './tsconfig.json',
        passThrough: true
      }
    }
  });
  grunt.loadNpmTasks("grunt-ts");
  grunt.registerTask("default", ["ts"]);
};

Much thanks!

make tsconfig an object.
‘’’
tsconfig: {
tsconfig: './tsconfig.json’
passThrough: true
}
‘’’

Ah, that works! Thanks @nycdotnet !

You can workaround the limitation as I did: https://github.com/javatlacati/liniobuzz/blob/master/typescryptimplementation/Gruntfile.js


[BUG] resume from checkpoint doesn't continue decaying the learning rate - it stays constant

Hello, I am using a cosine decay learning rate (LR) scheduler. When I resume from a checkpoint (eg like if something crashed before), I noticed the LR doesn't continue with the decay schedule, it stays constant. It does, however, load the correct learning from the last checkpoint - it just stays constant from then on.
What I do know is that the cosine schedule works fine if training from scratch and uninterrupted.
Also, when checking the LR within the AnnealingLR step function (by grabbing it from the optimizer.param_groups), it does print out the correct LR and it decays at each step.
However, outside the LR scheduler, like in the training loop, just before the wandb logging, the LR is constant.
What I suspect is that the optimizer param groups and the lr_scheduler param groups are actually different objects. So the lr_scheduler is updating the lr in the param_groups, but the optimizer isn't actually using those param_groups.
In my debugging, I noticed with deepspeed.initialize, it passes back a model, lr_scheduler and optimizer. The optimizer is wrapped with deepspeed, but the lr_schedule is not wrapped around deepspeed (it's just a regular AnnealingLR object). The deepspeed documentation says the lr_scheduler should be wrapped with a deepspeed wrapper. I can't tell if that's the reason things break.
Is it possible deepspeed is not correctly initializing the lr_scheduler upon resuming?
Has anybody also run into this kind of issue? Thanks ahead of time!
Eric

Hi @exnx could you help us debug this by providing a short reproducer? Perhaps just a simple piece of code that matches how you are training your model so I can confirm that I'm able to replicate the problem. Thanks!

So we're actually using GPT-Neox, which uses DeepSpeed.  We added a patch ourselves outside of DeepSpeed.  The issue could be DeepSpeed, or GPT-Neox.  Sorry if this was put in the wrong place.
But essentially, we just started pretraining on the Pile and saved a checkpoint after 10 steps and stopped.  We then resumed and noticed the learning not changing (it should continue to warmup and then decay).


gdb debug issue: error while loading shared libraries

System information

OS Platform and Distribution (e.g., Linux Ubuntu 14.04):  14.04
Apollo installed from (source or binary): source
Apollo version (1.0, 1.5, 2.0, 2.5, 3.0):3.0

Steps to reproduce the issue:

Please use bullet points and include as much details as possible:
I am using gdb to debug some specific module (prediction and perception module). The question is that when I run gdb bazel-bin/modules/perception/perception. And add a breakpoint using gdb. It will always show the "error while loading shared libraries: libactionlib.so: cannot open shared object file: No such file or directory".

I am really confused about that. I have followed steps in https://github.com/ApolloAuto/apollo/issues/4803. But after I add set args --flagfile=/apollo/modules/perception/conf/perception_lowcost.conf --stderrthreshold=3 --use_navigation_mode. It is still the same problem.
Thank you.
Supporting materials (screenshots, command lines, code/script snippets):

Closed due to inactivity. If the problem persists, pls feel free to reopen it or create a new one and refer to it.