404 template included in every session?

This seems like a bug, but maybe it is expected behavior.
I am using Timber v1.11.0 and Wordpress v5.2.3
I am using Xdebug and qcachegrind to look for bottlenecks and I am seeing the 404.php template file being included in every session. This is causing an extraneous post object to be created in every session.
Just wondering why this template is included by default if the query is not a 404? Seems like a bug to include it before calling is_404. Is this something inherent to Wordpress?

Thanks for the heads-up on this @hamannjames. I did a quick search through the relevant code and didn't see anything that looked like it would call/load the 404 template (if there was going to be such a file it would probably be lib/LocationManager.php). If you run twentysixteen or another similar default WP theme, do you see the same thing occur?

Can be closed in my opnion, stale.


Improve and extend Prometheus metrics

#2547 has introduced Prometheus metrics for weave-net. Some metrics can be improved though. Suggestions include in no particular order:

weave_{packet,bytes}_total: remove the "flow" label.
weave_{packet,bytes}_total: add the "overlay" label.
weave_{packet,bytes}_total{overlay="fastdp"}: restore and change calculation to flushedFlowsTotal + sum(activeFlows) as flows get flushed periodically . flushedFlowsTotal should be updated before flushing flows.
Include residual metrics https://github.com/weaveworks/weave/issues/2535#issuecomment-255731008 as appropriate
Write tests for metrics (?)
Distribute the metrics code (prog/weaver/metrics.go) across parts in the code which metrics are instrumenting (same as logging). Keep only those parts from prog/weave/metrics.go which are necessary for actual serving of metrics to Prometheus. The change helps with debugging. Keep in mind, that it changes the internal metrics collection model from pull to push.
Initialize labeled metrics if all label values are known in advance. That prevents from subtle bugs, e.g. dividing two metrics when one value is missing.
When exposing a metric with bunch of labels, create a static counter with all labels and collect the metric with only a reference label. When querying, you can join two metrics in order to access the labels.
Split up metrics containing a "total" label into two separate metrics, as it simplifies querying and prevents from matching mistakes. E.g. weave_dns_entries{state="local"} / ignoring(state) weave_dns_entries{state="total"} vs weave_local_dns_entries / weave_dns_entries.

Distribute the metrics code (prog/weaver/metrics.go) across parts in the code which metrics are instrumenting (same as logging). Keep only those parts from prog/weave/metrics.go which are necessary for actual serving of metrics to Prometheus. The change helps with debugging. Keep in mind, that it'd change the internal metrics collection model from pull to push.
Initialize labeled metrics if all label values are known in advance. That prevents from subtle bugs, e.g. dividing two metrics when one value is missing.
When exposing a metric with bunch of labels, create a static counter with all labels and collect the metric with only a reference label. When querying, you can join two metrics in order to access the labels.
Split up metrics containing a "total" label into two separate metrics, as it simplifies querying and prevents from matching mistakes. E.g.  weave_dns_entries{state="local"} / ignoring(state) weave_dns_entries{state="total"} vs weave_local_dns_entries / weave_dns_entries.

Additionally, weave_connection_termination_count should be weave_connection_terminations_total.

Additionally, weave_connection_termination_count should be weave_connection_terminations_total.

This is addressed by https://github.com/weaveworks/weave/pull/2568

@brb  @bboreham I am unsure whether I am supposed to open a new issue. This one is quite old and seems to be "resolved" mostly?
Anyways: At KubeCon 2018 in Kopenhagen we spoke briefly about the automatic cleanup (rmpeer) of peers when running inside Kubernetes on nodes that are part of an AWS ASG. It would be very nice if you could add a metric / count of the number of peers which were removed due to this mechanism to actively monitor this. @bboreham you suggested to simply raise an issue to request this feature.

@frittentheke generally it's best to open a new issue; it's easier to deal with accidental duplicates than the other way round.
Since this particular issue is a random set of "stuff" I think that's an even better reason to open a new one.


ci: make tests run in parallel

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@23deab5). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #553   +/-   ##
=======================================
  Coverage        ?   94.88%
=======================================
  Files           ?       50
  Lines           ?     2619
  Branches        ?        0
=======================================
  Hits            ?     2485
  Misses          ?      134
  Partials        ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 23deab5...0584916. Read the comment docs.


Hydrogen + Oxygen to purified water is very weak

I had the idea of recombining the excessive amounts of hydrogen and oxygen slag produces and using it for filtering and electrode cleaning, thinking it would become more power efficient, but it takes more power than plain Hydroplants do, inclusive voiding of salt water, hydrogen and oxygen. Could you maybe buff the recombination recipe, so it uses less power? Buffing just the recipe until it becomes better than hydroplants might look weird because the hydroplant has very low power consumpion, which is the main reason why it is better.
Later it would not be of too much use, because you would have better uses for the hydrogen but early its a nice tweak for power efficiency.

Here is the String for the factory planner for comparison and tweaking:
eNrtWF1v27gS/SuBnyPDdpO26VvqJrvFJkVuE+A+XCwMShpbXFOiLknF1gb57/cMSdlykt5mC2yzAfyQIJnhDM98HVK8G5Q6n92SsVJXgw+D8XA8nBwNDge0rrVxM2gtucGHu8GpNJkRc+cXvRtOsOajdk5RRdkSwtFwDDmk06Kplq3/bf3i4+GYxbBvpLsyOiNrZbXwNkdBp8tSVPmMf6a6+m9DZvaV8lNFgHCtmyq3fvVk+MavrttTa6lMob+SNX2ShjIXAgCMIeOfNsZqc1YVosqopMoFLBMPPChn0008b4YjiD+RyJXOltdOZEsgPNfmtFqQsjExR0+v+ajTbsVJWOGKS2GWSGqMkZ2f5dIB0NpRxbkOFifD8THr1rXSVt7Swdk6E7fCbYvxHurzL2efe9k6l0odXVIIduSdnyu9OkDmnNEKcoQTDFUj88vGOtbH+Mdvofhl+tvnuAF7/BWJb/lXjCOk41eNvvA1t721v13PrvSKTA/Qxc0XlK1MZSUQ4uxS52Qq+Sfl3mw05BAv4H0O4Gfw2boi1J99jnrKKyEr17XGsS/VhV7IL+SmqGO1rcQ4aqyT2Y2BFZastFkG9VvfJpdi/VU4mgqVNYqB+cQcDY84M19EpVPtA3vDSWGIVzJDzT5ppSR1G3Gy/tVA8dlReU3CZAU0k4j7K/uYHL+9kGk3O5BeZ4VQ6rRxWslqSfm0IOt6wIM+zsMvRjd1LxVBiRQ2iq6UCL37yDliriwP6GNzSWj4qbbuZkUC8Vx2O3s1iY/cvTHBRz3RFG2iyyuRLZ8yuCQnejqPpMD+WeNsIrdybyPLWlFXnjADo7BXjYAQWx8whl0sD24KBLIovOK9d3+jc51cyJC5E9SIV/taXy9lfd4obhjKMYe9yfeY/w062IDrjZHwsyzyHNOXIFgjFtQDF9Sp1PUuRb0bjt9t1DVhxLKCSq866asMzWXVGYELxycblS1Jbfr67XDst3NgkCKptCMby8HNkQpLEfMb9p3CMkmFYhozcbRHUX6NGOMgvg9C1VBtMEOJIeQ1dt0oONZw7Umz7fwHKSmQp9FVKFVfUVG5nYToA35l/aAnIZaVJQZje6WFWMnUCNP2+JOFvc7obVd22evL/BzY3b20oQemNeb7kSySVE9k6FaU9a7MUVbsSlbCzIWhnpDrPVeyjtnk2PJ4DCRch1SvySZKizwkYAKWmfQXoSK0ML5Rgz50M91SleTIhZFps+H8QN20FplLYJR2re2FOD1yykV3KjEDc5fMsVibFnkAS5r+OQ7caWzjkf9Xr5IsHBQJznjB7hJE3YXLRFiQKv2QYt+JZ++uZImVi0psth6PJ6w1oI4W8WdCUddxTJyWROrjL7eDEY4Wy+O5Erc0m8v1rnyVlGKd4MgnszB89PsMcfvHWeXsWF2JNTi9QqNbz8oJ+r2hiGvCybIuV5GXjzyP933WuDYk9S6hPalHxGAzOZeU9wpx65aJMKU22F90DRS6/k8yOpnzwYuyz/WGYO6BqElDofxU/eduUImSIVslFgcr6YqDWy1zztThQGbcDncD19a8ROL4gbRnwA6dLMmGrI+hjFTCR5nB4GT+3qbTPzDfYT8wm9MsjH5QFzJCJVY1ObgQCHvBOtPQYbe/D4i3ZGIBv+KuViJRfoeciQ+SlOc8ig+7Pz68O2agup4ptLvq3GYKZITlHdD73w8j0lmn+hxC7v6d4lyOtzw4LAWGZj2bG6IZ52YnnyvBtPiMaDYWYaCSSIU5JY2F0f/x4OvBoDkyDBXfLu4GF8jDw5x3+L2O85fJ2i96WAwuarI9exKcbwiD/xo/iSRDlAvtyXWzlFNTh5QiUbMINkiol8yvAQVWox9x7+x84mjE33NMOP6pcfsD0ftTcjwacdKzIkb4EDwjCASH0ZXuLwGea+wzU7KEXbd3uADt5PLu/lGLxFXfbBKvnmWhEUfbZZcxkHtugR8uEHjJahWI+zvxKompmbcvWaEAQX5jML6J9bUUJ5fGJX7wE0u1iL04+V6wm/tcN/uqxUXmxYq0y0MByw9H8FpK93zy7YXNEfPNqX3pWnkgOIMTvny5vwT7lRVoEynfUpKFsIletwv6Lvk9Zf501XDnsU35M6o2V7ji4yOQb4A/CP/VV69oc6P39fun1y8canVjEGAmnnPbCBYOnybOf6m/FEP6BnseLz4B+ZXNV4jAD1e8hggVTJ/TnVvrF5ssODbPuiA+Cfm1VKslxU8gK2EdJX/TaP2EYr3e0Xr8oR9r9rTH+Gow3urP/df2/VZw3T2rtP1P+u2jCpqhzdT+WWX/rLJ/Vtk/q+yfVfbPKvtnlf2zyj/lw862lSvISrsvzf7Fa/9isn8x2b+Y7F9M9i8m+9H6SS8mv9//Dxwq22Y=

I think I'm okay with how it is sorry. Currently there's a trade off between convenience and space efficiency vs power efficiency.


Works only with local packages?

Obviously not, but i cant make abapgit work with existing packages.
Tried the docs but werent clear for me. I need for example to GITify my existing packages.
I tried with +Offline with a normal package. when i did and and export the .zip file the source was there.
When i made a change in a report in that package, abapgit did not bring the file as changed.
How do i suppose to enable git with my packages? I havent set up SSL yet with gitlab so i am trying with the +Offline method. Local packages work ok.

For online/offline repos both package types work. For offline repos changes can't be recognized by abapGit because it just generates a zip file and isn't linked to a repo (e.g. on your computer) so it can't compare the repo with anything. If you use an offline repo and download the zip file to your computer you have to decompress the file and sync the repo with your git provider yourself via Git Bash, e.g. for Windows https://gitforwindows.org/. There are many tutorials on the internet how to do this, e.g. https://www.atlassian.com/git/tutorials/git-bash.

For online/offline repos both package types work. For offline repos changes can't be recognized by abapGit because it just generates a zip file and isn't linked to a repo (e.g. on your computer) so it can't compare the repo with anything. If you use an offline repo and download the zip file to your computer you have to decompress the file and sync the repo with your git provider yourself via Git Bash, e.g. for Windows https://gitforwindows.org/. There are many tutorials on the internet how to do this, e.g. https://www.atlassian.com/git/tutorials/git-bash.

 You would have to sync it offline....And i could use other branches also but that would mean to maintain the source code on my laptop and do that, Which is something that i will try.
Next is to try the full online way and have everything in order. thank you and sorry for the unneeded question :)

@larshp Can be closed.


[ko] Translate docs/tasks/administer-cluster/enabling-topology-aware-hints.md

This is a Feature Request
Translate content/ko/docs/tasks/administer-cluster/enabling-topology-aware-hints.md in Korean

What would you like to be added

Translate content/ko/docs/tasks/administer-cluster/enabling-topology-aware-hints.md in Korean
Why is this needed

This file is not translated yet.
Comments

https://kubernetes.io/docs/tasks/administer-cluster/enabling-topology-aware-hints/
/language ko

/triage accepted
/assign


All default configurations in config.json should point to kong instead of localhost

This commit https://github.com/Microkubes/microservice-user-profile/commit/902d191e60e6959a08e3feb2c347d8bf660afbb5 has reverted configuration to be centric to a local setup versus a docker/k8s setup, we need to change it so that the default setup is centric to docker/k8s.
This should be default for all microkubes services.

All of the configurations in config file point to kong now.


"This version of the app has been retired"

As of a few days ago, comix has completely stopped working. Trying to obtain a list of owned items returns, "Could not find any book associated with this account..." and attempting to backup any owned comic returns, "This version of the app has been retired".

ComiXology updated their API and also made the authentication method used here obsolete, I'm putting out a fix for it, although acquiring the auth token will be much harder than before. I will not implement Amazon's authentication method, but if someone else wants to, go ahead.


Include glide deps in vendor

Include glide deps in vendor/
Update dependencies to latest masters
Add testify dep

We may still be missing some deps (haven't looked at test failures exhaustively). Next step is to make tests pass in this branch. We may which to peg some deps to specific version (by tag or git hash) in the glide.yaml to leave them untouched by glide up. Ideally we want some dependencies to be upgraded by glide up so let's only lock down moving targets.

I will test this locally to see if we can merge it

AH.... hold on we have implicit submodules, see https://github.com/Masterminds/glide/issues/112

Will have to look into this some more, don't merge

@benjaminbollen fixed the tests on this, I'll make another PR to address the data races I've found

Looks very good.


[ Layer ] Set Property for Conv2D Layer

. parse and set Convolution 2D Property
0. input shape : string

bias zero : bool
activation : string (type)
weight_decay : string (type)
weight_decay_lambda : float
filter : int
kernel_size : ( n , m )
stride : ( n, m )
12, padding : valid | same

Self evaluation:

Build test:	 [X]Passed [ ]Failed [ ]Skipped
Run test:	 [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: jijoong.moon<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.4.20191203. Thank you for submitting PR #124. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://nnsuite.mooo.com/.


--include option not working

Describe the bug
When invoking behavex with --include option followed by a feature file name, the following error occurred:
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
To Reproduce
Steps to reproduce the behavior:

Install behavex
Run the following command:
behavex --include "some_feature_file.feature"
The above said error with stack trace is displayed (see screenshot below)

Expected behavior
Like invoking original behave command, when --include option followed by a feature file name are given, behavex should run the given feature file successfully.
Screenshots

Desktop (please complete the following information):

OS: Windows
Browser: Chrome was used for the feature test, but the error occurred before the test could be run
Version: Windows 10 21H2

Smartphone (please complete the following information):
N/A
Additional context
N/A

Hi @hrcorval, thanks for your work on behavex. It's a useful behave wrapper.
For this --include issue I reported, I've spent some time tracing the code, and found that it seems to relate to the following piece of code in _set_env_variables() of runner.py:

I'm not sure the purpose of the json calls, but if I removed those json calls, it will seem to work fine:

Not sure if these findings are helpful.
Thanks.

Hi @hrcorval , I've tried your 1.5.12 branch and the issue does not occur anymore. Thanks for the quick fix!

BehaveX 1.5.12 released :)


nixos/cabal-install: init

Motivation for this change
cf. https://github.com/NixOS/nixpkgs/pull/85136
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Will add some docs if / when people agree, that this is a good approach.

closing, since this as resolved in https://github.com/NixOS/nixpkgs/commit/643169bbb48126a3b6ec3c4a32bbbe7a815d11c8


use PR number for IVS/MediaLive resource name

fix https://github.com/cloudnativedaysjp/dreamkast/issues/1034

Review app
https://dreamkast-dk-1035.dev.cloudnativedays.jp


Add the cli command line parameters

We have to add the standard commands to the k3a-clitool.
Based on the @harsimranmaan's idea I'd start with two basic commands
k3ai-cli apply <<plugin_name>> or <<plug_group>>
k3ai-cli delete <<plugin_name>> or <<plug_group>>

for the local groups would be:
k3ai-cli apply --local (or -l)<<plugins_group>>
k3ai-cli delete --local (or -l)<<plugins_group>>

Plugins
k3ai-cli plugins list
k3ai-cli describe <<plugin_name>> or <<plugins_group>>

About the k3s installation, we are still thinking about that. For the moment k3ai is bound to k3s, but we are thinking also about kind.
Let's delay a bit the installation decision

This can be closed in favor of #29 and #30


Add HeaderInterceptor to add dapr-api-token

Description
Add a header interceptor usin the UnaryUnaryClientInterceptor.
Referring to the API definition here: https://grpc.github.io/grpc/python/grpc.html#client-side-interceptor
Issue reference
We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.
Please reference the issue this PR will close: #91
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[x] Code compiles correctly
[x] Created/updated tests
[ ] Extended the documentation

Workflow not triggered. Will open a new PR.


Continuous integration and docker auto-build

In the branch ci, I have implemented some initial tests for continuous integration (CI). Basically, each push and pull-request will trigger an automatic build and regression test. This could be done with various tools. Here, I am using GitHub actions and Docker.
It seems that GitHub action cannot cache numerical packages. To avoid installing all the required packages each time, I created a docker image for compiling (docker pull zhucaoxiang/stellopt:compile). When triggered, it will compile the latest code and run testings using the docker image. An example log can be found here. It takes 5 minutes to compile the code.
name: build-test
on: [push, pull_request]

jobs:
  build:
    runs-on: ubuntu-latest
    container: zhucaoxiang/stellopt:compile
    env:
      MACHINE: docker
      STELLOPT_PATH: ${{ github.workspace }}
      OMPI_ALLOW_RUN_AS_ROOT: 1
      OMPI_ALLOW_RUN_AS_ROOT_CONFIRM: 1
    steps:
      - name: checkout sources
        uses: actions/checkout@master
      - name: compile
        run: |
          cd ${STELLOPT_PATH}
          ./build_all 2>&1 | tee log.build
      - name: test
        run: |
          cd ${STELLOPT_PATH}/BENCHMARKS
          make test_vmec_QAS

Here are the things that I would like to discuss.

[ ] Are these the right tools to do CI? Does anyone have other experiences?
[ ] Decide the appropriate triggers. Should we do the test for every push in every branch? Fortunately, we have unlimited building time.
[ ] Complete the regression test. Right now, I have only implemented one simple test compere QAS VMEC case. We should determine a list of regression tests that are representative and fast. Also, we have to update the check script.

I got a side issue when comparing the VMEC outputs. Because of errors in using the dynamic library on docker (see the log),  I am using a python script to compare the wout file with a reference one (see compare_VMEC.py).  The reference wout file was produced on the PPPL cluster with CentOS 6 and GCC in the develop branch. When comparing it with the newly produced wout file in the ci branch, the comparison passed on the PPPL cluster, but failed at others.
Below is the comparison between the produced file on the Eddy cluster and the reference one.
Compare VMEC outputs in wout_QAS.nc and wout_QAS_ref.nc with tolerance  1.00000E-12
======================================
UNMATCHED: b0 , diff= 1.67533E-12
UNMATCHED: rbtor , diff= 1.18616E-12
UNMATCHED: ctor , diff= 2.18279E-09
UNMATCHED: raxis_cc , diff= 2.38362E-12
UNMATCHED: zaxis_cs , diff= 1.79086E-12
UNMATCHED: iotaf , diff= 2.08501E-10
UNMATCHED: q_factor , diff= 1.10495E-09
UNMATCHED: chi , diff= 1.19103E-11
UNMATCHED: chipf , diff= 1.03639E-10
UNMATCHED: jcuru , diff= 9.02457E-04
UNMATCHED: jcurv , diff= 1.23804E-07
UNMATCHED: iotas , diff= 2.08630E-10
UNMATCHED: beta_vol , diff= 1.31091E-12
UNMATCHED: bvco , diff= 5.70251E-12
UNMATCHED: vp , diff= 3.70526E-12
UNMATCHED: specw , diff= 2.00514E-08
UNMATCHED: over_r , diff= 1.30525E-11
UNMATCHED: jdotb , diff= 1.74535E-03
UNMATCHED: bdotb , diff= 1.32924E-10
UNMATCHED: bdotgradv , diff= 5.55480E-11
UNMATCHED: DMerc , diff= 1.07121E-06
UNMATCHED: DShear , diff= 3.17038E-09
UNMATCHED: DWell , diff= 1.33956E-08
UNMATCHED: DCurr , diff= 1.45721E-08
UNMATCHED: DGeod , diff= 1.06125E-06
UNMATCHED: equif , diff= 6.51166E-08
UNMATCHED: rmnc , diff= 3.89256E-10
UNMATCHED: zmns , diff= 4.38073E-10
UNMATCHED: lmns , diff= 4.76656E-09
UNMATCHED: gmnc , diff= 1.37951E-09
UNMATCHED: bmnc , diff= 4.92215E-10
UNMATCHED: bsubumnc , diff= 5.46979E-10
UNMATCHED: bsubvmnc , diff= 6.05400E-10
UNMATCHED: bsubsmns , diff= 1.54010E-09
UNMATCHED: currumnc , diff= 1.31922E-02
UNMATCHED: currvmnc , diff= 1.80030E-03
UNMATCHED: bsupumnc , diff= 8.59530E-09
UNMATCHED: bsupvmnc , diff= 5.19838E-10
  comparison passed: False
======================================
Traceback (most recent call last):
  File "./compare_VMEC.py", line 41, in <module>
    assert match, 'Differences in some elements are larger than the tolerence.'
AssertionError: Differences in some elements are larger than the tolerence.

The jcuru, jdotb, currumnc, currvmnc has a significant difference. The possible reason is the difference of the platform and/or compilers. But still, I am surprised to see the numbers differ so much on different platforms. @lazersos Any thoughts?
This actually brings up difficulties in doing the regression test.

@zhucaoxiang this is very interesting. From my (also not large) experience with CI testing your approach looks fine on first sight. Github actions are the new standard way of doing things and we use it also for pyccel and other stuff now and plan to convert older Travis CI builds to that one.
About the results: one idea would be to switch off all optimization and see if there are still differences. Compiler-optimized SIMD floating-point code will introduce differences in the last digits that may be amplified if some computation is numerically unstable. Still the differences look a bit large. In the end this may point to a bug in the code.

Regarding the vmec problem, I bet the quantities related to J have larger
errors because of mu0. For a 1 Tesla 1 meter configuration, errors in B on
the order of machine precision will have errors in J on the order of
machine precision / mu0.
On Thu, Jun 25, 2020, 2:40 AM Christopher Albert<EMAIL_ADDRESS>wrote:

@zhucaoxiang https://github.com/zhucaoxiang this is very interesting.
From my (also not large) experience with CI testing your approach looks
fine on first sight. Github actions are the new standard way of doing
things and we use it also for pyccel and other stuff now and plan to
convert older Travis CI builds to that one.
About the results: one idea would be to switch off all optimization and
see if there are still differences. Compiler-optimized SIMD floating-point
code will introduce differences in the last digits that may be amplified if
some computation is numerically unstable. Still the differences look a bit
large. In the end this may point to a bug in the code.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/PrincetonUniversity/STELLOPT/issues/70#issuecomment-649263343,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABH4ZAYTWVF6ZQJ67RCT37LRYLWOFANCNFSM4OH2LB2A
.

It is a great idea to set up CI for stellopt - thanks for working on this!
About your remark that "GitHub actions cannot cache numerical packages": one thing that may work for you here is to use apt-get to install pre-built packages. An example can be seen here, and the list of available packages can be found here. Using apt-get may make it easier to add packages (no need to re-build a container), but very new versions of some software may not be available.
Back on the VMEC issue, another reason J-related quantities may have larger errors is that J is a derivative of B, and numerical derivatives magnify noise. For some combination of this reason and 1/mu0, when VMEC is run for vacuum fields it often gives jdotb ~ O(1) in SI units. This value is small compared to typical tokamak currents (MA) so it is not necessarily a bug. Since this jdotB~1 is 100% numerical error, I am not too surprised/worried by a 1e-3 difference in jdotb between different computers.

@landreman Thanks for the replies. I think you are right about why the J terms have such a significant difference. I am trying to compare the debug version with -O 0 option as @krystophny suggested, but get stuck with some bugs. I guess we can skip the J terms or set a different tolerance.
As to use GitHub actions to install numerical packages, I did it for FOCUS. It works, but my concern is that we need so many libraries in STELLOPT. It would take probably over 10 mins to install all the libraries each time. As far as I know, there is no easy way to use cached packages. Building a container actually takes less than 1 min. We could implement both at the testing stage.


FILEUPLOAD-314 - Replace C-style array declaration for java

Coverage remained the same at 78.323% when pulling 15a88fc2e33355de746501c997c419ff613b98dc on arturobernalg:feature/FILEUPLOAD-314 into b8253237867120ec8c99ea34b68ac86c6283dbc3 on apache:master.

Please, complete this PR by adding an entry to the contributors section in pom.xml.

Coverage remained the same at 78.323% when pulling 15a88fc on arturobernalg:feature/FILEUPLOAD-314 into b825323 on apache:master.

HI @jochenw
added
TY

Please, complete this PR by adding an entry to the contributors section in pom.xml.

HI @jochenw
added
TY


Runtime: QA for renaming edge cases

[ ] Check graceful handling of changing a resource while rename is running
[ ] Check reconcilers handle renames gracefully if not yet reconciled (no state set)
[ ] ProjectParser: Check it doesn't attempt renaming to a name that already exists (should be a parse error)
[ ] Check graceful handling of renaming a resource while rename is running
[ ] Check reconcilers don't rely on the value of RenamedFrom – should only rely on state
[ ] Prevent cancelled reconciler for a resource from running at the same time as the rename is running (not caught by DAG or name checks due to rename, must check RenameFrom)

This issue might be alluding to it, so I'll leave this here – I just ran into this error in Rill Developer:

I renamed my_source to my_source_2
I renamed my_source_2 back to my_source
I got this error: "Name my_source is already in use"

It seems waiting 1-2 minutes frees up the name again, but it's not available on the order of seconds.


Add support for email address changes with SAML when attr_permanent_user_id is not email.

Zulip's existing authentication model is that a user's email address is a unique ID; this simplifies the model for supporting several different authentication backends.  However, where this gets messy is some SAML providers, like Shibboleth, are designed to support users changing their email address while having some other key (E.g. a unique user ID) that's unique.
What we'd like to do is store the attr_user_permanent_id field, and then during a SAML authentication, look up users by that unique ID, and if we find one, and the email address is different, change the email address to match the SAML value.
(May need to be an optional server-letting setting, but we can worry about that once we have this prototyped)
We have existing work on the analog of this issue for LDAP here: https://github.com/zulip/zulip/pull/16208.  We'll likely want to reuse most of the logic/strategy, if we can.
See this chat.zulip.org discussion for background.
I've tagged this as difficult because it requires some understanding of SAML.

@zulipbot claim

@zulipbot claim

Hi, @seiwailai :) Do you work on this? Actually, I wanted to try this PR (see linked topic)...

@ro-i Sure, you can make a pull request

I've looked into the issue for several days. From my understanding, the SAMLResponse (as in return for SAML authentication's request) mainly yield result covering attributes like first_name, last_name, email, and others. However, the response doesn't include any persistent user ID, which disallowing us to associate a unique ID (may be user permanent ID stored in SAML providers' database) to zulip user. My thought is that IdP should be able to deliver persistent user IDs attribute before we can set up attr_user_permanent_id. I would like to know if we are able to configure attributes including permanent user ID (which intended to be sent to zulip backend through SAMLResponse) at IdP's level (Okta)? Kindly correct me if I'm misunderstanding anything.
Any fresh perspectives are very much appreciated!

Hm, if I understand it correctly, attr_user_permanent_id is a non-standard extension not guaranteed to be available?

Hi, I'm currently working again on this issue, sorry for the delay :) I'm preparing a suggestion based on https://github.com/zulip/zulip/pull/16208 from @strifel extending the ext_auth_uid dict with a saml field.

@zulipbot claim

In case someone wonders where the discussion about these changes is going on: https://chat.zulip.org/#narrow/stream/3-backend/topic/ext_auth_id.20create_user


Podman 2.0 image load name:tag positional arg is no longer optional

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)
/kind bug
Description
Running podman image load [-i image.tar] without specifying the image name produces Error: requires at least 1 arg(s), only received 0. The help string suggests this argument is supposed to be optional (as it was pre-2.0):
# podman image load --help
...
Usage:
  podman image load [flags] [NAME[:TAG]]

Steps to reproduce the issue:

podman image load --input image.tar

Describe the results you received:
Error: requires at least 1 arg(s), only received 0
Describe the results you expected:
Getting image source signatures
...
Writing manifest to image destination
Storing signatures
Loaded image(s): ...

Additional information you deem important (e.g. issue happens only occasionally):
Output of podman version:
Version:      2.0.0
API Version:  1
Go Version:   go1.13.8
Built:        Thu Jan  1 00:00:00 1970
OS/Arch:      linux/amd64

Output of podman info --debug:
host:
  arch: amd64
  buildahVersion: 1.15.0
  cgroupVersion: v1
  conmon:
    package: 'conmon: /usr/libexec/podman/conmon'
    path: /usr/libexec/podman/conmon
    version: 'conmon version 2.0.18, commit: '
  cpus: 2
  distribution:
    distribution: ubuntu
    version: "20.04"
  eventLogger: file
  hostname: localhost
  idMappings:
    gidmap: null
    uidmap: null
  kernel: 5.4.0-37-generic
  linkmode: dynamic
  memFree:<PHONE_NUMBER>
  memTotal:<PHONE_NUMBER>
  ociRuntime:
    name: runc
    package: 'runc: /usr/sbin/runc'
    path: /usr/sbin/runc
    version: 'runc version spec: 1.0.1-dev'
  os: linux
  remoteSocket:
    path: /run/podman/podman.sock
  rootless: false
  slirp4netns:
    executable: ""
    package: ""
    version: ""
  swapFree: 0
  swapTotal: 0
  uptime: 58m 41.13s
registries:
  search:
  - docker.io
  - quay.io
store:
  configFile: /etc/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions: {}
  graphRoot: /var/lib/containers/storage
  graphStatus:
    Backing Filesystem: extfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
    Using metacopy: "false"
  imageStore:
    number: 1
  runRoot: /var/run/containers/storage
  volumePath: /var/lib/containers/storage/volumes
version:
  APIVersion: 1
  Built: 0
  BuiltTime: Thu Jan  1 00:00:00 1970
  GitCommit: ""
  GoVersion: go1.13.8
  OsArch: linux/amd64
  Version: 2.0.0

Package info (e.g. output of rpm -q podman or apt list podman):
root:~# apt list podman
Listing... Done
podman/unknown,now 2.0.0~1 amd64 [installed]
podman/unknown 2.0.0~1 arm64
podman/unknown 2.0.0~1 armhf
podman/unknown 2.0.0~1 s390x

Additional environment details (AWS, VirtualBox, physical, etc.):
Verified that this works as expected on 1.9.3:
root:~# dpkg -i podman_1.9.3~1_amd64.deb
dpkg: warning: downgrading podman from 2.0.0~1 to 1.9.3~1
(Reading database ... 41048 files and directories currently installed.)
Preparing to unpack podman_1.9.3~1_amd64.deb ...
Unpacking podman (1.9.3~1) over (2.0.0~1) ...
Setting up podman (1.9.3~1) ...
Processing triggers for man-db (2.9.1-1) ...
root:~# podman image load --input /tmp/image.tar
Getting image source signatures
Copying blob 280440e8f2cd skipped: already exists
...

Thanks a lot for the report, @Musi13 !

Opened https://github.com/containers/libpod/pull/6722 to fix the issue.


benchmarks: No way to get reproducible results

Variance between runs is way too high.
I guess we could wrap the function in a for loop and use the lowest measurement, that would certainly improve things.
But I think we better use performance counters instead.
Epiphany isn't affected by this since we already use CTIMERs there.
PAPI seems to have the cross-platform support we need:
http://icl.cs.utk.edu/papi/

@olajep What do you think about timing several runs of the functions? Most of them run in the ns, maybe running them 1000 times (for example) would improve the precision of the measurements. Also, running the benchmark a few times is a good idea to get some statistics. Maybe report minimum, median and maximum run times. What I mean is something like:
for (i = 0; i < 100; i++) {
    item_preface(&data[i], ...);
    for (j = 0; j < 1000; j++) {
        fun()
    }
    item_done(&data[i], ...);
}

PAPI looks cool... Maybe we could take only the ARM/x86 parts (I see they don't support Windows anymore, not sure if that would be an issue).

@lchamon
On 2015-07-22 02:51, Chamon wrote:

@olajep https://github.com/olajep What do you think about timing several runs of the functions? Most of them run in the ns, maybe running them 1000 times (for example) would improve the precision of the measurements.

Yes, that will certainly improve things. I did some testing now and even with 32000 iterations there can be a 20 percent diff between two runs (most are pretty close however). Which is a lot better than before (>100% !). And 32000 iterations takes way too long for several functions. Benchmarking one of the image functions takes almost two minutes.

Also, running the benchmark a few times is a good idea to get some statistics. Maybe report minimum, median and maximum run times.

I'm not so sure about that, we should only care about the lowest measurement. Everything else is noise (e.g., context switches, some other process evicting our data from L2 cache ...).

What I mean is something like:
for (i = 0; i < 100; i++) {
item_preface(&data[i], ...);
for (j = 0; j < 1000; j++) {
fun()
}
item_done(&data[i], ...);
}
Yup, we need the loop, no question about that. The question is how many iterations.
PAPI looks cool... Maybe we could take only the ARM/x86 parts (I see they don't support Windows anymore, not sure if that would be an issue).

I believe that benchmarking using clock cycles instead will give more stable results.
We also need to size the benchmarks so they:
i) fit in cache and (we don't want to benchmark the memory subsystem) and
ii) one function call should be short enough to not always be preempted by the kernel.
I think that should do it.
Cheers,
Ola

@olajep Hmmm... I thought you could maybe limit the time instead of the number of iterations. But it might complicate things more than it solves, don't know. My idea was (in retrospect, maybe not a really good one):
volatile int i = 0; /* So the compiler doesn't optimize the loop */
volatile int j = 0;

item_preface(&data, item);
while (data->end - data->start < MAX_TIME) {
    item->benchmark(&spec);
    item_done(&data, &spec, item->name);
    i++;
}

loop_time = platform_clock();
while (i - j > 0)
    j++;
loop_time -= platform_clock();

data->end -= loop_time;

Maybe clock count is the way to go.

The higher the resolution of the timing, the less measurements you need to make. The Parallella has performance counters, right? And PAPI supports Linux on ARM. So it sounds like the right solution. :+1:

On ARM, PAPI uses the perf subsystem of the Linux kernel. If you want, you can use perf directly. The SUPERCOP benchmark software does this (look in the file supercop-20141124/cpucycles/perfevent.c). But the perf API is not as nice as PAPI.

The Linux/ARM timers from PAPI appears to use clock_gettime or gettimeofday (depending on what's available). Clock cycles are estimated multiplying the time in usec by the clock frequency (viz. linux_timer.c lines 288 and 260). I could be wrong (someone should check), but at least in this case it doesn't seem to help much. Reading the PMU from ARM can't be done from user space. x86 provides assembly time stamp reading (rdtsc) and that's what PAPI uses.
I guess for ARM there is no easy way around gettimeofday/clock_gettime or perf_event. I guess only testing to see if there's a big difference...

I haven't used PAPI yet, but it should be possible to check at run-time if it supports hardware counters by checking if PAPI_num_counters returns a negative or zero. But first you need perf support in the kernel, on Debian you get that with the linux-tools-$(uname -r) package. I'll try it tomorrow.

@eliteraspberries I haven't used it either, take what I say with a grain of salt. I was checking out the source to see how they would be accessing the ARM performance counter from the user space, but it seems they're not (like you said, only compiling and running num_counters to be sure).
To me, perf appears to be the way to go on ARM/Linux (using perf_event_open as per http://web.eece.maine.edu/~vweaver/projects/perf_events/programming.html) and rdtsc inline assembly for x86. I'll see if I can contribute something more concrete, but I'm completely swamped for the next 2 weeks.

I measure my code performance such as speed and the timing is occasionally off.  I believe 10 iteration is minimum and 100 is enough, 1000 is a bit too much.  An average or mean with plus and minus deviation will suffice to have one column of data for speed.  Below is example code in c++ I used to time my code performance:
start = std::clock();
float answer1= erff(w);                                             // standard algorithm here
duration = ( std::clock() - start ) / (double) CLOCKS_PER_SEC;

I have tested an inline assembly solution for x86 processors that have rdtsc. To get some statistics, I timed 3 functions (10 ms, 100 ms, and 1 s) using clock(), rdtsc, and QueryPerformanceCounter() from the Windows API (I'm on Windows, so no gettime()). All statistics are calculated over 200 independent measurements, with compiler flag O3, and are summarized in the table and plots below.
All methods hit the same average measurement (some with more precision than others). For fast functions, the variance is considerably better using rdtsc or QueryPerformanceCounter(), which suggest that maybe using the perf_event_open method on Linux we could avoid the inline assembly altogether. I'll try to get back to you guys in a few weeks with tests on that (if no one has done it before). When functions hit the 1 s mark, though, the measurement variances are basically the same. The precision on sub-microsecond measurements is not great, but I haven't tested tens of microseconds yet.
@olajep I pushed the solution using rdtsc (the method used by PAPI) to a branch on my fork (benchmark.c), but I'm still new to Autotools I have no idea how to use autoconf macros to define the __x86_64__ (64 bits processor), __i386__ (32 bits processor), and CPU_FREQ (CPU clock frequency).

Length
Method
Mean
Variance (ratio to rdtsc)

1000ms
clock()
1.60234500
1.520198e-05 (1.748116)

1000ms
rdtsc
1.60229626
8.696210e-06

1000ms
WinQPC
1.60208964
1.735461e-05 (1.9956522)

100ms
clock()
0.16021000
3.433065e-06 (6.507617)

100ms
rdtsc
0.16018014
5.275457e-07

100ms
WinQPC
0.16020998
6.624749e-07 (1.2557677)

10ms
clock()
0.01605000
4.168342e-06 (37.581361)

10ms
rdtsc
0.01610825
1.109151e-07

10ms
WinQPC
0.01608080
6.404925e-08 (0.5774617)


Cognito Forms

NOTE: Cognito Forms is a Standard connector, not a Premium connector and is 100% hosted in Azure.

When submitting a connector, please make sure that you follow the requirements below, otherwise your PR might be rejected. We want to make you have a well-built connector, a smooth certification experience, and your users are happy :)

[x] I attest that the connector works and I verified by deploying and testing all the operations.
[x] I attest that I have added detailed descriptions for all operations and parameters in the swagger file.
[x] I attest that I have added response schemas to my actions, unless the response schema is dynamic.
[x] I validated the swagger file, apiDefinition.swagger.json, by running paconn validate command.
[x] If this is a certified connector, I confirm that apiProperties.json has a valid brand color and doesn't use an invalid brand color, #007ee5 or #ffffff. If this is an independent publisher connector, I confirm that I am not submitting a connector icon.

If you are an Independent Publisher, you must also attest to the following to ensure a smooth publishing process:

[ ] I have named this PR after the pattern of "Connector Name (Independent Publisher)" ex: HubSpot Marketing (Independent Publisher)
[ ] Within this PR markdown file, I have pasted screenshots that show: 3 unique operations (actions/triggers) working within a Flow. This can be in one flow or part of multiple flows. For each one of those flows, I have pasted in screenshots of the Flow succeeding.
[ ] Within this PR markdown file, I have pasted in a screenshot from the Test operations section within the Custom Connector UI.
[ ] If the connector uses OAuth, I have provided detailed steps on how to create an app in the readme.md.

Please add the certified-connectors label to this PR.

Thank you for the connector submission. We will validate your files and communicate with you within two business days.

Please note that Cognito Forms is a Standard connector, not a Premium connector and is 100% hosted in Azure.

This is an update for our existing connector. We have previously uploaded an icon but have not included it in these files. We can if we need to.


Allow for builtin slots to be overriden

Consider the following program:
class T(object):
   def __repr__(self):
      return "__repr__"

def foo(self):
   return "foo"

a = T()

print a.__repr__
print repr(a)

T.__repr__ = foo

print a.__repr__
print repr(a)

And the following execution of CPython and Grumpy:
$ python --version
Python 2.7.10
$ python bar.py
<bound method T.__repr__ of __repr__>
__repr__
<bound method T.foo of foo>
foo
$ ./tools/grumpc bar.py > bar.go
$ go run bar.go
<bound method T.__repr__ of __repr__>
__repr__
<bound method T.foo of __repr__>
__repr__

CPython allows for the slot method to be overriden at runtime.  For the builtins where this applies (which can be determined from Objects/typeobject.c in the CPython source), Grumpy should lookup the method by name.
That being said, I don't know how common this is in real code.  I noticed it reading the CPython source while implementing __cmp__.

 Comment by trotterdylan
Monday Jan 09, 2017 at 04:49 GMT

Thanks for the report! This is something that I've fretted a bit about. The real trick is that you have to update the slot on all the subclasses. Here's how CPython does it. Unfortunately, whereas CPython holds the GIL while it does all this work, Grumpy must find some other way to synchronize it, or live with poor consistency guarantees around updating types.
Worse is when you assign to a type's __bases__ attribute. This is not something I can ever imagine a reasonable program doing, but CPython jumps through hoops to support it.
Personally I think it's crazy to support this kind of monkey patching and I'm inclined to raise an exception when people try things like this. But maybe there are legitimate use cases that I'm overlooking. Thoughts and opinions are welcome here.

 Comment by ns-cweber
Monday Jan 09, 2017 at 14:58 GMT

I'm all for raising until a reasonable use case presents itself. At least as long as grumpy is in alpha/beta.

 Comment by alanjds
Friday Jan 20, 2017 at 21:10 GMT

I would love to monkeypatch datetime.datetime.now() to be allowed to test time in my billing code...
https://bugs.python.org/issue9528

 Comment by trotterdylan
Friday Jan 20, 2017 at 21:14 GMT

You're right that tests are a potentially valid use case for that. Note that normal functions (ones that reside in type(obj).__dict__) can be monkey patched perfectly well. The issue is just the slot functions that don't work quite right, like __add__.


Eporner

Source name
Eporner
Source link
https://www.eporner.com/
Source language
English
Other details
+18 = yes
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a title with source name.
[X] I have checked that the extension does not already exist on the website extensions list or the app.
[X] I have checked that the extension does not already exist by searching the GitHub repository and verified it does not appear in the code base.
[X] I will fill out all of the requested information in this form.

Due to a dmca takedown, we had to remove almost all of our extensions. It also means we won't make any new ones like this


feat: add filtering in assets api

Added filtering by certain fields in assets api.
Querystring:  "?types=table&services=bigquery&size=30&offset=50&sort=created_at&direction=desc&filter[data.dataset]=booking&filter[data.project]=p-godata-id&q=internal&q_fields=name,urn,description,services",

filter by types : types=topic,table
filter by services: services=kafka,postgres
filter by field in asset.data: filter[data.dataset]=booking&filter[data.project]=p-godata-id"
querying by field ( includes by name , urn): q=internal&q_fields=name,urn,description,services
sort by certain fields : sort=created_at
sorting direction (asc / desc) : direction=desc

@scortier
filter by field in asset.data: config.data[dataset]=booking&config.data[project]=p-godata-id"

If it is for filtering, why not using filter prefix instead?

The nested query params is in the wrong format.
config.data[dataset]=booking&config.data[project]=p-godata-id" ❌
config[data.dataset]=booking&config[data.project]=p-godata-id" ✅
filter[data.dataset]=booking&filter[data.project]=p-godata-id" ✅  ✅
cc @StewartJingga

@mabdh @StewartJingga,  the proto file needs to be updated to pass correct config in GetAllAsset method in v1beta1/asset, due to this reason the test is failing, shall we update the proto file and fix this test or move forward with failing test, as fixing the proto file is in scope of this issue.
WDYT ?

@scortier
filter by field in asset.data: config.data[dataset]=booking&config.data[project]=p-godata-id"

If it is for filtering, why not using filter prefix instead?
The nested query params is in the wrong format. config.data[dataset]=booking&config.data[project]=p-godata-id" ❌ config[data.dataset]=booking&config[data.project]=p-godata-id" ✅ filter[data.dataset]=booking&filter[data.project]=p-godata-id" ✅ ✅
cc @StewartJingga

Why there is config there? We can directly use data[] instead. @scortier

@mabdh @StewartJingga, the proto file needs to be updated to pass correct config in GetAllAsset method in v1beta1/asset, due to this reason the test is failing, shall we update the proto file and fix this test or move forward with failing test, as fixing the proto file is in scope of this issue. WDYT ?

We can just fix the proto in this PR instead, we dont want breaking test on main branch. @scortier

@scortier
filter by field in asset.data: config.data[dataset]=booking&config.data[project]=p-godata-id"

If it is for filtering, why not using filter prefix instead?
The nested query params is in the wrong format. config.data[dataset]=booking&config.data[project]=p-godata-id" ❌ config[data.dataset]=booking&config[data.project]=p-godata-id" ✅ filter[data.dataset]=booking&filter[data.project]=p-godata-id" ✅ ✅
cc @StewartJingga

Why there is config there? We can directly use data[] instead. @scortier

Recently, updated the query param to this format : filter[data.dataset]=booking&filter[data.project]=p-godata-id", should we update it to data[dataset]=booking&data[project]=p-godata-id" ?, but we discuss earlier the format should be of type filter[{fields}].  @mabdh @StewartJingga

For the proto, in that case I think this PR could also covers this issue https://github.com/odpf/columbus/issues/105 @scortier @StewartJingga


Casting a list reference from a subscript when I dont know the subtype

I am asking this question here, because all Stack Overflow questions have remained unanswered on this topic.
Goals
I want to cast a list that I get via a subscript to a list of an unknown type:
let x = someObject[someProperty] as ????
dump(x.first)

Actual Results
It seems that without knowing the subtype I cannot cast to a list or any super class of a list that is useful for usage as a collection.
Version of Realm and Tooling
ProductName:	Mac OS X
ProductVersion:	10.15.4
BuildVersion:	19E266
/Applications/Xcode.app/Contents/Developer
Xcode 11.4
Build version 11E146
/usr/local/bin/pod
1.9.1
Realm (4.4.0)
RealmSwift (4.4.0)
/bin/bash
GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin19)
carthage not found
(not in use here)
/usr/bin/git
git version 2.24.1 (Apple Git-126)

Hey there!
This seems like less of a question about Realm and more about Swift in general. If you want to provide us with more information (a larger code sample would be helpful), we can lend some assistance.


environment_variables.md: BUILDKITE_PULL_REQUEST may be unset

We have noted that BUILDKITE_PULL_REQUEST
may be not set to "false" (but not set at all or set to
am empty string?) when a build is triggered by a
branch push (no PR yet created).

Sorry, this is like to have been a problem on our side.


[zh-cn]fix: download kubectl command

the first command is to download kubectl binary rather than kubectl
checksum file

Thanks. You have to sign the CLA in order for your contribution to be reviewed.
Also please read the contribution guide line, especially the Chinese localization style guide, before making a PR.


Expand ONNX operator support for dynamic batch

Charlie thinks we'll have to create a new Expand operation in Migraphx, similar to what we did for Resize.  Need to confirm that this is necessary and document the reasons why.

Will need to also simplify expand back down to mutlibroadcast in simplify_dyn_ops


Launch VA and DC to launched states

Moves VA and DC to the list of launched states
Next step: after launch, remove "beta" state status in tests/fixtures, follow up on Spanish translations

@datu925 looks like tests are failing because of this test:
        // TODO: remove once City/County incentives have been beta-tested.
        tap.not(incentive.authority_type, AuthorityType.City);
        tap.not(incentive.authority_type, AuthorityType.County);

Is it okay to remove these checks now that VA/DC have been internally beta-tested?

@datu925 looks like tests are failing because of this test:
        // TODO: remove once City/County incentives have been beta-tested.
        tap.not(incentive.authority_type, AuthorityType.City);
        tap.not(incentive.authority_type, AuthorityType.County);

Is it okay to remove these checks now that VA/DC have been internally beta-tested?
If it's helpful, here's the PR where this comment was added: https://github.com/rewiringamerica/api.rewiringamerica.org/pull/272/files#diff-1761174a5be653b788ac071e224ae0111ce6cbabd90dd3da3ddacf8583e7ec9dR202-R204

Yes, I think it's appropriate to remove those now. Thanks for checking.

My concern is we were going to add a disclaimer about possibly-inaccurate local incentive eligibility in the frontend, and we haven't done it yet (I'm not sure we even have a design for it?): https://app.asana.com/0/1206661332626418/1206661332626438
Unless we're close to external deadlines on these states, I'd prefer to have the disclaimer done before launching them. If we have deadlines to hit, then I'd say we can launch, but we should move the disclaimer to top priority in that case.

Discussed offline: we're launching the states and prioritizing the disclaimer.


Invalid Stay Up To Date links

The Subscribe via RSS and Follow via Twitter links on the right do not go anywhere.  It's also unclear if either of these features have been implemented.

Filed upstream https://github.com/python/pythondotorg/issues/568

Fixed upstream with https://github.com/python/pythondotorg/commit/c0ee3aa5276a5d825c748b77aea0ae50c512c297


No cpu/memory usage in cluster explorer from rke2 clusters

While cluster manager displays cpu and memory usage for both rke1 and rke2 clusters, cluster explorer shows cpu/mem usage for particular nodes only for rke1 clusters.

Waiting on @richard-cox's PR to be merged though initial tests look good

Tested on rancher/rancher:master-head 3ae6f43. The cpu/mem usage data are now shown for RKE2 nodes in the cluster explorer. Close.


Changes for using fakeTDL with products

Needed to broaden the range of supported Daffodil versions to work with some of our products.
Also includes an envelope schema for the dfdl-test-harness that includes some basic metadata for measuring performance

Closing this pull request as most of these changes belong outside of this project.


Change Image loading view

Default image loading view is very ugly how can I change. I can modify the and include it as local library.

recentimages/src/main/res/drawable/spinner_black_76.png
replace it with your own custom image.


Install method signature does not include 'filename' parameter in Module typings file

@vukzrito Thank you for your contribution, v2.1.2 has been release on NPM.


There is no install target in the qmake project

qmake has a simple way to define the files that have to be installed when make install is called:
https://doc.qt.io/qt-5/qmake-advanced-usage.html#installing-files
This project just leaves the binary in the build path. I think it should offer also the way to install it in a system wide path.

We can add it, possibly in /usr/local/bin by default?
On Oct 14, 2016 16:52, "Leo Arias"<EMAIL_ADDRESS>wrote:

qmake has a simple way to define the files that have to be installed when
make install is called:
https://doc.qt.io/qt-5/qmake-advanced-usage.html#installing-files
This project just leaves the binary in the build path. I think it should
offer also the way to install it in a system wide path.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/shadowproject/shadow/issues/58, or mute the thread
https://github.com/notifications/unsubscribe-auth/AGl7FRVt3BSQYD9sVr-BzMYf1DiFHICQks5qz5cVgaJpZM4KXGLp
.

I think so. I'll prepare the PR for you to review.

Awesome thank you :)
On Oct 14, 2016 17:02, "Leo Arias"<EMAIL_ADDRESS>wrote:

I think so. I'll prepare the PR for you to review.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/shadowproject/shadow/issues/58#issuecomment-253826657,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGl7FdvdCX59j57vhqk2HAx70gmTNPCWks5qz5mXgaJpZM4KXGLp
.


Using beam search in offline server

Hi,
Do you have any plans to add modified beam search to the offline server? I think it'd be worthwhile to get better offline accuracies than the current greedy search strategy.

Yes, I am adding it. Will finish it today tomorrow.

Ok thank you very much.

@ahazned
You can try https://github.com/k2-fsa/sherpa/pull/32, which requires https://github.com/k2-fsa/k2/pull/983
They are working now but lacking some documentation.
I am adding documentation and will merge them as soon as possible.

@csukuangfj
Thank you very much. I tried it and it works fine.


Direct line POST Invoke sign in Activity returns 400 Status Code error with message "Invalid or missing activities in HTTP body"

Version
Direct Line REST API v3.0
Describe the bug
To implement WebChat SSO, as described in the documentation, you need to send an activity to the bot with TokenExchangeInvokeRequest in the body of the request.
Flow 4th step - https://docs.microsoft.com/en-us/azure/bot-service/bot-builder-concept-sso?view=azure-bot-service-4.0#sso-components-interaction.
But as a result the API returns not 200 OK response with TokenExchangeInvokeResponse in a body. API returns 400 Bad Request with body:
{
    "error": {
        "code": "MissingProperty",
        "message": "Invalid or missing activities in HTTP body"
    }
}

To Reproduce
Steps to reproduce the behavior:

Generate token for WebChat:

POST https://directline.botframework.com/v3/directline/tokens/generate
Authorization: Bearer <WebChat secret>

Send an invoke sign in activity to the bot

POST https://directline.botframework.com/v3/directline/conversations/<conversation id>/activities
Authorization: Bearer <token from previous step>
Content-Type: application/json
[other headers]

{
    "type": "Invoke",
    "name": "signin/tokenExchange",
    "value": {
        "id": "<any unique ID>",
        "connectionName": "<OAuth connection name (from the OAuth Card)>",
        "token": "<exchangeable token>"
    }
}

Expected behavior
Returns 200 OK with TokenExchangeInvokeResponse in body:
{
    "status": "<response code>",
    "body": {
        "id":"<unique ID>",
        "connectionName": "<connection Name on the skill bot (from the OAuth Card)>",
        "failureDetail": "<failure reason if status code is not 200, null otherwise>"
    }
}

Tracking Status
Dotnet SDK TODO

[ ] PR
[ ] Merged

Javascript SDK TODO

[ ] PR
[ ] Merged

Python SDK TODO

[ ] PR
[ ] Merged

Java SDK TODO

[ ] PR
[ ] Merged

Samples TODO

[ ] PR
[ ] Merged

Docs TODO

[ ] PR
[ ] Merged

Tools TODO

[ ] PR
[ ] Merged

@rudoleksa, apologies for the delay and thank you for your patience. Are you still experiencing an issue with this? I attempted a repro with the solution you linked, however I am unable to get it to run. I added values into the two appsettings.json files. To be clear, for the ASP.NET.WebChat.SSO.Web project, I'm assuming that the AzureAD.ClientId and ClientSecret are coming from the OAuth app registration? I used the Application (client) ID located on the Overview blade as well as generating a new secret from the Certificates & secrets blade.
Also, in the Index.cshtml.cs file, I see it is looking for "", "", and "connectionName" variables\properties to be defined. It doesn't appear that these are being pulled from anywhere. Do I need to hard code these values in? What value should be supplied for the resourceUri variable? I think I know what the value should be, but want to be sure since the solution is failing for me.
Are there any other values that I need to supply elsewhere or other details I should know that comes to your mind?


Bug: Renaming in the conflict dialog leaves the copy operation in process.

Description
If I change the name in the conflict dialog when copying a file, the copy itself will be completed, but it will remain in process on the status center, and I will not be able to remove the badge.
Steps To Reproduce

Copy a file to a folder with a file of the same name.
Change the name in the conflict dialog and press Continue.
The copy it self will be completed, but it will remain in process on the status center.

Requirements
The status center should indicate that the copy is complete.
Files Version
<IP_ADDRESS>
Windows Version
10.0.22631.3447
Log File
n/a

Thanks for the report


Update the river config spec for non-continuous data

i.e. stock market data that should only make requests during the period the market is open
Should be helpful for getting #4 up and running

I thought about defining river polling with a crontab instead of just an
interval.

Matt Taylor
OS Community Flag-Bearer
Numenta
On Wed, Jul 15, 2015 at 1:40 PM, Jared Weiss<EMAIL_ADDRESS>wrote:

i.e. stock market data that should only make requests during the period
the market is open
Should be helpful for getting #4
https://github.com/nupic-community/river-view/issues/4 up and running
—
Reply to this email directly or view it on GitHub
https://github.com/nupic-community/river-view/issues/30.

Are there major advantages to doing that other than just having the front end and backend in separate processes? I think it's very convenient to be able to specify the interval within the config.yml. If the frontend/backend separation is the main concern could the data collector and the web server just be separate node programs?

I don't really care about the separation between the data-server and the
frontend. But it might be useful to be able to specify river polling with
more than just an interval. Ideally, I would like to specify something like
"weekdays between 9am - 5PM at 10 minute intervals". I don't think you can
do this with crontab but I'm not sure.

Matt Taylor
OS Community Flag-Bearer
Numenta
On Wed, Jul 15, 2015 at 2:57 PM, Jared Weiss<EMAIL_ADDRESS>wrote:

Are there major advantages to doing that other than just having the front
end and backend in separate processes? I think it's very convenient to be
able to specify the interval within the config.yml. If the
frontend/backend separation is the main concern could the data collector
and the web server just be separate node programs?
—
Reply to this email directly or view it on GitHub
https://github.com/nupic-community/river-view/issues/30#issuecomment-121761760
.


[topic] Proto update - move stat_var_metadata to the category layer

I found that svm definitions were duplicated multiple times across blocks, and specifying overrides for some tiles were cumbersome. This also removes some ambiguity as to which svm is used for tiles like highlight and map which only use the first svm. Eventually, we can centralize all data fetching for a category.
Proof of concept -- let me know what you think! I've only updated one textproto. Will update tests / other configs.
Also moved all typed interfaces for the config proto to a single file that mirrors the proto.

thanks for the review!


nshankar/add customization for openservicemesh extension

This PR adds a "validate_distro" step for the osm-arc add-on to emit a message via the k8s-extension CLI to notify the user whether
their kubernetes cluster distribution is a tested distribution for osm-arc.
This checklist is used to make sure that common guidelines for a pull request are followed.

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your PR is merged into master branch, a new PR will be created to update src/index.json automatically.
The precondition is to put your code inside this repo and upgrade the version in the PR but do not modify src/index.json.

k8s


Is this command a typo error? it causes auto relaunch every time.

https://github.com/NathanaelA/nativescript-liveedit/blob/e28245f0711de65692c7e747f81813ea00839ef6/support/watcher.js#L406
adb shell ps ^| grep '+projectData.nativescript.id

Why not
adb shell ps | grep '+projectData.nativescript.id

Good catch; that is actually for windows which is my primary dev environment.  I totally forgot that Linux/Mac might have a different escape character.

I removed the ^ it works fine on OS X.

Thanks for the info, I'll get a patched version up shortly.

This is fixed in v1.53, thanks for letting me know!


fixing example, added info

fixing issue 1259.  Added missing node in example. Added tip on trailing slashes and link to examples in repository.

Fixes issue #1259


doc request: provide details to allow automatic download of contributors

Hi
First of all congratulations for the project
It would be great to have documented the export to CSV process for automation (including sign-in). A curl based example would be ideal.
Many thanks
  Ulises

thank you for a good proposal!


Anti-Hallucination Score - Switched?

https://github.com/TonicAI/tonic_validate/blob/058ed170d6f3666f15f398a5349732c9f7a80a2f/tonic_validate/utils/llm_calls.py#L90C5-L97C6
Guys -- is it possible that this code has switched the metric value?
So: If the answer contains information that cannot be attributed to the context then respond with true.
This means: When there IS hallucination, the score is "1".
While the metric signifies "anti-hallucination" -- which means high scores are good, low scores are bad.
https://docs.tonic.ai/validate/about-rag-metrics/tonic-validate-rag-metrics-reference
Answer consistency binary
from tonic_validate.metrics import AnswerConsistencyBinaryMetric
Answer consistency binary indicates whether all of the information in the answer is derived from the retrieved context.
If all of the information in the answer comes from the retrieved context, then the answer is consistent with the context, and the value of this metric is 1.
If the answer contains information that is not derived from the context, then the value of this metric is 0.
To calculate answer consistency binary, we ask an LLM whether the RAG system answer contains any information that is not derived from the context.
Answer consistency binary is a binary integer.

https://github.com/TonicAI/tonic_validate/blob/main/tonic_validate/metrics/answer_consistency_binary_metric.py#L11C7-L11C36
Returns
        -------
        int
            0 if there is information in answer not derived from context in context_list
            1 otherwise

https://github.com/TonicAI/tonic_validate/blob/main/tonic_validate/utils/llm_calls.py#L90C5-L97C6
main_message = (
        "Considering the following list of context and then answer, which answers a"
        "user's query using the context, determine whether the answer contains any"
        "information that can not be attributed to the intormation in the list of"
        "context. If the answer contains information that cannot be attributed to the"
        "context then respond with true. Otherwise response with false. Response with"
        "either true or false and no additional text."
    )

@adorosario This is now fixed and released in version 3.0.1. Thanks again for catching this!


list of other frameworks is missing Preact (3kb)

be fair and add Preact to the List -
http://moonjs.ga/docs/overview.html
https://github.com/developit/preact

He's already fair.. and mention that in his blog

I'll add Preact, as it was definitely one of the main inspirations for Moon (as I stated in the article @abshammeri linked).

:thumbsup:


Should profile include time (seconds) per-frame?

e.g. in this profile https://profiler.firefox.com/public/7cq70hq3nhz6dnnzcvb8yw5c0409xn2y8xxjbt0/flame-graph/?globalTrackOrder=0&hiddenLocalTracksByPid=21272-01&profileName=dot (after)&symbolServer=http%3A%2F%2F<IP_ADDRESS>%3A3000%2F2cbhn8l3jjvx3sc28f7x2yz8qgnkxgx5r008d9w&thread=0&v=8
I see 14%, 2018 samples. But it doesn't map that to time (whether CPU time or wall time).

I understand sometimes it's tricky to communicate the difference of CPU-time vs wall-time. But perhaps we could show one? This can help communicate the profiles to an audience that's less familiar with profiling (they'll understand 'seconds' better than 'samples').
I'd probably expect to see, with a sampling profile taken at 100Hz, that each sample should be weighted at about 10ms, so you can add it up and see the total time in the Firefox Profiler UI?

We've gone back and forth on this. Originally we had milliseconds everywhere, computed via sample count times interval. Then we decided it was too misleading and switched to sample counts everywhere. We had lots of profiles where the sampler thread was starved and there were large gaps between samples, so if a function that took 50ms of CPU time only got 2 samples, it showed up as 2ms, and we decided that just displaying "2 samples" in that case was closer to the truth. First and foremost, a profiler should not lie.
By the way, you can see the profiling interval in the Profile Info popup.
I'd like to transfer this issue to https://github.com/firefox-devtools/profiler/issues/ but github can't transfer issues between organizations; could you file it again there?


how to pass the namespace path to a controller

how to pass the namespace path to a controller and action
like this
Macaw::get('/home', 'HomeController@home');

@iceny You probably won't get an answer to that in regards to Macaw router. The Klein library supports this feature using Klein, but Macaw may handle it differently. See https://github.com/noahbuscher/Macaw
See https://github.com/klein/klein.php#route-namespaces for Klein's implementation.

like this?
$klein->respond('GET', '/index',  array('Hozzaq\Controller\IndexController', 'index'));

You can use it like this (for non static methods):
$klein->get('/tests', [new \App\Controllers\TestController(), 'index']);


read_deltalake does not support Unity catalog tables on Azure storage

Describe the bug
When Databricks Unity catalog tables are on Azure storage, the daft.read_deltalake method does not support reading from this storage.
It appears to only work for AWS storage, albeit with io_config passed down if AWS region of the storage is not us-east-1  ( see issue here where the commands to read data from AWS is shown as an example)
On Azure, the io_config is not populated upstream using the unity.load_table method, which is the primary cause of this issue. Following which, the DeltaLakeScanOperator instantiation withindaft.read_deltalake is unable to handle non-s3 io_config objects
Another issue to consider, which is not part of this issue, is to consider whether, for AWS storage, region needs to be passed down when instantiating an object in DeltaLake class, since this possibly can be done without specifying region. Happy to help contribute to explore this further since this would mean that we don't have to deal with having to have the us-east-1 default.
To Reproduce
import daft # Using version 0.3.4
from daft.unity_catalog import UnityCatalog
from databricks.sdk import WorkspaceClient # Using version  0.33.0
import os

DATABRICKS_HOST = os.environ.get('DATABRICKS_HOST') # Databricks Host URL stored in environment variables
PAT_TOKEN_AZURE = os.environ.get('PAT_TOKEN_AZURE') #i.e, the PAT token stored in environment variables . Does not yet support OAuth , as of Daft 0.3.4
METASTORE_ID  = os.environ.get('METASTORE_ID')

This block of code is really not being used and simply mentioned here just in case region is required anywhere
w = WorkspaceClient(host=DATABRICKS_HOST, token=PAT_TOKEN_AZURE)
metastore_summary = w.metastores.summary()
print("Metastore/Storage account cloud is : {}".format(metastore_summary.cloud))
print("Metastore region is : {}".format(metastore_summary.region))

Attempt 1: Passing instance of unity_catalog.UnityCatalogTable to daft.read_deltalake
unity = UnityCatalog(endpoint=DATABRICKS_HOST,token=PAT_TOKEN_AZURE)
unity_table_mngd = unity.load_table("some_catalog.some_schema.some_table")
df_mngd = daft.read_deltalake(unity_table_mngd)

Error:
failed to load region from IMDS err=failed to load IMDS session token: dispatch failure: timeout: error trying to connect: HTTP connect timeout occurred after 1s: HTTP connect timeout occurred after 1s: timed out (FailedToLoadToken(FailedToLoadToken { source: DispatchFailure(DispatchFailure { source: ConnectorError { kind: Timeout, source: hyper::Error(Connect, HttpTimeoutError { kind: "HTTP connect", duration: 1s }), connection: Unknown } }) }))
failed to load region from IMDS err=failed to load IMDS session token: dispatch failure: timeout: error trying to connect: HTTP connect timeout occurred after 1s: HTTP connect timeout occurred after 1s: timed out (FailedToLoadToken(FailedToLoadToken { source: DispatchFailure(DispatchFailure { source: ConnectorError { kind: Timeout, source: hyper::Error(Connect, HttpTimeoutError { kind: "HTTP connect", duration: 1s }), connection: Unknown } }) }))
S3 Credentials not provided or found when making client for us-east-1! Reverting to Anonymous mode. the credential provider was not enabled

OSError: Generic MicrosoftAzure error: Error performing token request: Error after 10 retries in 2.299535584s, max_retries:10, retry_timeout:180s, source:error sending request for url (http://<IP_ADDRESS>/metadata/identity/oauth2/token?api-version=2019-08-01&resource=https%3A%2F%2Fstorage.azure.com)

Attempt 2: Passing table_uri and io_config
unity = UnityCatalog(endpoint=DATABRICKS_HOST,token=PAT_TOKEN_AZURE)
unity_table_mngd = unity.load_table("some_catalog.some_schema.some_table")
df_mngd = daft.read_deltalake(unity_table_mngd.table_uri,io_config=unity_table_mngd.io_config)

Error:
failed to load region from IMDS err=failed to load IMDS session token: dispatch failure: timeout: error trying to connect: HTTP connect timeout occurred after 1s: HTTP connect timeout occurred after 1s: timed out (FailedToLoadToken(FailedToLoadToken { source: DispatchFailure(DispatchFailure { source: ConnectorError { kind: Timeout, source: hyper::Error(Connect, HttpTimeoutError { kind: "HTTP connect", duration: 1s }), connection: Unknown } }) }))
failed to load region from IMDS err=failed to load IMDS session token: dispatch failure: timeout: error trying to connect: HTTP connect timeout occurred after 1s: HTTP connect timeout occurred after 1s: timed out (FailedToLoadToken(FailedToLoadToken { source: DispatchFailure(DispatchFailure { source: ConnectorError { kind: Timeout, source: hyper::Error(Connect, HttpTimeoutError { kind: "HTTP connect", duration: 1s }), connection: Unknown } }) }))
S3 Credentials not provided or found when making client for us-east-1! Reverting to Anonymous mode. the credential provider was not enabled

OSError: Generic MicrosoftAzure error: Error performing token request: Error after 10 retries in 8.117160375s, max_retries:10, retry_timeout:180s, source:error sending request for url (http://<IP_ADDRESS>/metadata/identity/oauth2/token?api-version=2019-08-01&resource=https%3A%2F%2Fstorage.azure.com)

Expected behavior
This is the behavior seen with AWS storage where I can successfully retrieve a table.
unity = UnityCatalog(endpoint=DATABRICKS_HOST,token=PAT_TOKEN_AWS) # AWS Databricks workspace
unity_table_mngd = unity.load_table("some_catalog.some_schema.some_table")
# The metastore region is being passed down to ensure the us-east-1 default is not being applied.
io_config = IOConfig(s3=unity_table_mngd.io_config.s3.replace(region_name=metastore_summary.region))
df_mngd = daft.read_deltalake(unity_table_mngd.table_uri,io_config=io_config)

df_mngd.show()

Output:
Dataframe is displayed without issues.
Component(s)
Python Runner
Additional context
No response

Can confirm, io_config isn't populated at all, it has a value of None when reading from azure databricks using unity.load_table(). Current workaround is to use your own credential to storage directly which bypasses unity's permissions model (and most of my clients have essentially locked down and disabled).

Thanks @jordandakota for confirming this too.
I am working on a fix and will log a PR sometime later this week since I think I have a fair understanding where the fixes need to be applied.

Thanks @anilmenon14 for the really well fleshed out issue! Great to have someone with more databricks knowledge than us working on this.
Here is the logic where we create our io_config from the information provided to us by the Unity table:
https://github.com/Eventual-Inc/Daft/blob/main/daft/unity_catalog/unity_catalog.py#L97-L110
As you can see, it currently only populates AWS credentials (and also does not handle regions, because we could not figure out how Unity would be vending region information given the early nature of the project)

Thank you, @jaychia .
As you rightly pointed out, we will have to fix how the io_config is created in load_table() in the UnityCatalog class.
Apart from that, this block also needs to be fixed to handle Azure storage being passed down in io_config
https://github.com/Eventual-Inc/Daft/blob/main/daft/delta_lake/delta_lake_scan.py#L43-L67
As for the AWS credential vending region, an interesting observation I noticed when I stepped into the DeltaLakeScanOperator code is that even if I didn't pass 'region' in the io_config, I received a valid table object back from deltalake
DeltaTable(table_uri, storage_options=io_config_to_storage_options(io_config, table_uri))

My io_config I used looked something like this for s3, which was region independent in the payload:
temp_table_credentials = unity._client.temporary_table_credentials.create(operation="READ", table_id=table_id)

# To be fixed in code: If scheme is that of Azure, do the following
io_config = IOConfig(
        s3=S3Config(
                    key_id=temp_table_credentials.aws_temp_credentials.access_key_id,
                    access_key=temp_table_credentials.aws_temp_credentials.secret_access_key,
                    session_token=temp_table_credentials.aws_temp_credentials.session_token
                )
    )

I'd certainly love to look further into that and try and contribute on that issue as well :)
For now, I will get the Azure fix as a PR worked on and keep the AWS region fix separate as another PR shortly after to not bring in too many variables with one change.

@jaychia , just a heads up that I have logged PR 3025 for the Azure storage compatibility issue.

I believe this is now resolved with #3025, and will be available in Daft v0.3.9

Cross-posting information, originally mentioned in issue #2903, regarding testing on v0.3.9
The issue is fixed, but it needs a workaround, which I hope we can avoid in the future. I will look into this since it was a bit of an oversight on my part not to test the .show() method, which appears to make API calls that expect the exact name of the storage account.
What works for Azure now on Daft v0.3.9
unity = UnityCatalog(endpoint=DATABRICKS_HOST,token=PAT_TOKEN_AZURE)
unity_table_ext = unity.load_table("some_catalog.some_schema.some_table")

regex_match_az_storage_acc = re.search(r'@([^\.]+)\.', unity_table_ext.table_uri) # Gather storage account name from table URI
if regex_match_az_storage_acc:
    storage_account_parsed = regex_match_az_storage_acc.group(1)
else:
    raise ValueError("{} does not appear to be a valid Azure Storage URI".format(unity_table_ext.table_uri))

io_config = IOConfig(azure=unity_table_ext.io_config.azure.replace(storage_account=storage_account_parsed))
df_ext = daft.read_deltalake(unity_table_ext.table_uri,io_config=io_config)
df_ext.show()

What does not work for Azure:
unity = UnityCatalog(endpoint=DATABRICKS_HOST,token=PAT_TOKEN_AZURE)
unity_table_ext = unity.load_table("some_catalog.some_schema.some_table")
df_ext = daft.read_deltalake(unity_table_ext)
df_ext.show()

Error:
DaftCoreException: DaftError::External Generic AzureBlob error: Azure Storage Account not set and is required.
 Set either `AzureConfig.storage_account` or the `AZURE_STORAGE_ACCOUNT` environment variable.


ci: only run on ready prs

Pull Request Checklist

[ ] New code has 100% test coverage
[ ] (If applicable) The prose documentation has been updated to reflect the changes introduced by this PR
[ ] (If applicable) The reference documentation has been updated to reflect the changes introduced by this PR
[ ] Pre-Commit Checks were ran and passed
[ ] Tests were ran and passed

Description

only run things on ready-state PRs

Close Issue(s)

ahh idk :\

What's the background context for this change?

@peterschutt @guacs  asked :P
https://github.com/litestar-org/litestar/pull/2661#issuecomment-1817352148

@peterschutt @guacs asked :P
#2661 (comment) I was just trying to see if it was easily doable.
It looks like we would have to place, in addition to whats there now, an if pr = not draft on each job under jobs though.. Which would be fine.. but im not sure if anyone relies on these in draft either

Yeah, I was thinking about this. It might be better to leave it as it is currently since it won't be possible to run the tests and some people might rely on the tests running when they're contributing.

#2661 (comment)

Thanks - I'm not really a fan of this idea.
What's the issue with tests running on drafts @guacs?
One can always put [skip ci] in a commit message to stop tests running for a given commit, but as far as I know there'd be no way to do the opposite of that if we make this change and want the tests to run (e.g., to see if anything has broken after merging in changes into a PR from main through the GH UI).

#2661 (comment)

Thanks - I'm not really a fan of this idea.
What's the issue with tests running on drafts @guacs?
One can always put [skip ci] in a commit message to stop tests running for a given commit, but as far as I know there'd be no way to do the opposite of that if we make this change and want the tests to run (e.g., to see if anything has broken after merging in changes into a PR from main through the GH UI).

No issues really. I just saw that the tests ran when merging from main in the draft PR regarding the provide and thought that it was a waste to run the tests and wondered whether it was possible to just disable them.
I agree with you that it's not a good idea.


applied lazy var

As issue #12 mentioned.

Sure. :) Keep awesome work.

Thank you @SheldonWangRJT :)


Child WF fails on signaling a 'not found' WF although the signal was handled

Expected Behavior
The child WF should be completed successfully after signaling
Actual Behavior
As was explained in:  https://temporalio.slack.com/archives/CTT84KXK9/p1677446296370919
We have some weird case with signals:
We have a 'manager' WF that queues and start child WFs. When a child WF ends, it sends a signal back to the manager (in a detached cancellation scope on finally block), and when the manager has nothing in its queue, it exists.
Sometimes we see a case where a child WF signals on end, the signal gets to the manager which handles and exists, but the child WF eventually fails on:
io.temporal.failure.ApplicationFailure: message='SignalExternalWorkflowExecution failed with NOT_FOUND. WorkflowId=, runId=', type='SIGNAL_EXTERNAL_WORKFLOW_EXECUTION_FAILED_CAUSE_EXTERNAL_WORKFLOW_EXECUTION_NOT_FOUND', nonRetryable=false
Can it be that the parent WF manage to complete but somehow the child still didn't handle the signal, although the signal got to the parent?
Steps to Reproduce the Problem
See attached parent and child WF histories
Specifications

Version: 1.18.1

histories.zip

Looking at the history I believe workflow completes before the last child signal is sent. If you can create a reproduction of the issue then we can look futher.

Closing due to lack of activity.


DRILL-7409: Check if BigInt is read correctly with parquet in diction…

…ary encoding.

@Agirish could you please review the PR?

@Agirish I moved test data, please review the changes.


CTS building - changes dedicated for MSVC2017 and Intel Compiler v.19.0

Some patches needed to compile CTS using MSVC2017 and Intel Compiler version 19.0 (available in Intel System Studio 2019):

cmake changes - add compilation flags for long double compilation
changes in compat.h - defines already defined in Intel Compiler
fix assert in test_SVM - strange complicated code for checking OCL version. It has been simplified
bruteforce tests - fix for Intel compiler - signbitl is available in Intel Compiler.
Expect 4 pull requests for each branch.

I have set of additional commits dedicated for  cl12_trunk branch to solve compilation errors for ICC compiler and errors while comparing double precision tests in math_brute_force.

some of changes are similar to changes introduced for branches cl20+
I will propose to upgrade reference_math.c file to be more compatible with cl20+ branches
I noticed many compilation errors because not adding ../../test_common/harness/mt19937.c in function  set_source_files_properties
I noticed compilation error in test_geometrics usage MAKE_HEX_FLOAT instead of MAKE_HEX_DOUBLE like we have on branches cl20+

I hope these changes allow to compile tests using MSVC, double precision tests will not fail.


Add PCMDI Diags to zppy

Issue resolution

Resolves #478
Follow-up to #624, #640.

Select one: This pull request is...

[ ] a bug fix: increment the patch version
[ ] a small improvement: increment the minor version
[ ] an incompatible (non-backwards compatible) API change: increment the major version

1. Does this do what we want it to do?
Objectives:

Objective 1
Objective 2
...
Objective n

Required:

[ ] Product Management: I have confirmed with the stakeholders that the objectives above are correct and complete.
[ ] Testing: I have added or modified at least one "min-case" configuration file to test this change. Every objective above is represented in at least one cfg.
[ ] Testing: I have considered likely and/or severe edge cases and have included them in testing.

If applicable:

[ ] Testing: this pull request introduces an important feature or bug fix that we must test often. I have updated the weekly-test configuration files, not just a "min-case" one.
[ ] Testing: this pull request adds at least one new possible parameter to the cfg. I have tested using this parameter with and without any other parameter that may interact with it.

2. Are the implementation details accurate & efficient?
Required:

[ ] Logic: I have visually inspected the entire pull request myself.
[ ] Logic: I have left GitHub comments highlighting important pieces of code logic. I have had these code blocks reviewed by at least one other team member.

If applicable:

[ ] Dependencies: This pull request introduces a new dependency. I have discussed this requirement with at least one other team member. The dependency is noted in zppy/conda, not just an import statement.

3. Is this well documented?
Required:

[ ] Documentation: by looking at the docs, a new user could easily understand the functionality introduced by this pull request.

4. Is this code clean?
Required:

[ ] Readability: The code is as simple as possible and well-commented, such that a new team member could understand what's happening.
[ ] Pre-commit checks: All the pre-commits checks have passed.

If applicable:

[ ] Software architecture: I have discussed relevant trade-offs in design decisions with at least one other team member. It is unlikely that this pull request will increase tech debt.

How I generated this PR, following up #640:
git remote -v
# Add fork to my list of remotes
git remote add zhangshixuan1987 git@github.com:zhangshixuan1987/zppy.git
git remote -v

# Fetch the branch from https://github.com/E3SM-Project/zppy/pull/640
git fetch zhangshixuan1987 zppy_pcmdi
git checkout -b zppy_pcmdi zhangshixuan1987/zppy_pcmdi

git log
# It looks like alot of "new" commits include commits on `main`
# Let's clean up the commit history,
# so we're only looking at relevant changes in the PR

# The first commit in https://github.com/E3SM-Project/zppy/pull/640/commits is:
# Modify time series processing to include 3D model variables (9e2488cd8f14d4a9b2a016497de14096979ce4f0)
# The last commit before that was: Add PR template (#618) (7c7a8e987fab11ce6ac933e25c2880d5a66c4c6d)
# Rebase off that
git rebase -i 7c7a8e987fab11ce6ac933e25c2880d5a66c4c6d
# Pick (p) the first commit: Modify time series processing to include 3D model variables (9e2488cd8f14d4a9b2a016497de14096979ce4f0)
# Fixup (f) the rest

git log
# commit a4130d3c030b802c2b62359e74a56870472d22bf (HEAD -> zppy_pcmdi)
# Author: ShixuanZhang<EMAIL_ADDRESS># Date:   Mon Sep 16 17:55:18 2024 -0500

#     Modify time series processing to include 3D model variables

#     The modification attemts to interpolate the 3D model level data to
#     standard pressure level specified by vrt_remap_plev19.nc. This is
#     needed by e3sm_to_cmip to convert these variables into cmip type

# commit 7c7a8e987fab11ce6ac933e25c2880d5a66c4c6d
# Author: forsyth2<EMAIL_ADDRESS># Date:   Wed Aug 21 11:09:17 2024 -0700

#     Add PR template (#618)

# Now, we can rebase off the latest `main`
git fetch upstream main
git rebase upstream/main
# We get merge conflicts
git status
# Unmerged paths:
#   (use "git restore --staged <file>..." to unstage)
#   (use "git add/rm <file>..." as appropriate to mark resolution)
# 	both modified:   conda/dev.yml
# 	both modified:   tests/integration/generated/test_min_case_add_dependencies_chrysalis.cfg
# 	both added:      tests/integration/generated/test_min_case_carryover_dependencies_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_depend_on_climo_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_depend_on_climo_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_depend_on_ts_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_depend_on_ts_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_diurnal_cycle_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_diurnal_cycle_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_lat_lon_land_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_streamflow_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_streamflow_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_tc_analysis_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_tc_analysis_mvm_2_chrysalis.cfg
# 	both added:      tests/integration/generated/test_min_case_e3sm_diags_tc_analysis_parallel_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_min_case_e3sm_diags_tropical_subseasonal_mvm_2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_weekly_bundles_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_weekly_comprehensive_v2_chrysalis.cfg
# 	both modified:   tests/integration/generated/test_weekly_comprehensive_v3_chrysalis.cfg
# 	both modified:   tests/integration/template_weekly_comprehensive_v2.cfg
# 	both modified:   tests/integration/test_weekly.py
# 	both modified:   tests/integration/utils.py
# 	both modified:   tests/test_sections.py
# 	both added:      tests/test_zppy_e3sm_diags.py
# 	both added:      tests/test_zppy_global_time_series.py
# 	both added:      tests/test_zppy_ilamb.py
# 	both added:      tests/test_zppy_utils.py
# 	both modified:   zppy/__main__.py
# 	both modified:   zppy/defaults/default.ini
# 	both modified:   zppy/global_time_series.py
# 	deleted by us:   zppy/templates/coupled_global.py
# 	added by them:   zppy/templates/inclusions/e3sm_to_cmip/vrt_remap_plev19.nc
# 	both modified:   zppy/utils.py

# Went through all conflicted files.
# Mostly I resolved conflicts by using "current change" (i.e., what's on `main`, not what's on this PR),
# Because in most cases, the changes from this PR were erronously including the contents from commits outside the PR's scope.
# Cases where "incoming changes" (i.e., changes from the PR) were used:

# zppy/__main__.py:   existing_bundles = pcmdi_diags(config, scriptDir, existing_bundles, job_ids_file)
# => had to change scriptDir to script_dir

# zppy/defaults/default.ini:
# cmip_metadata = string(default="e3sm_to_cmip/default_metadata.json")
# cmip_plevdata = string(default="e3sm_to_cmip/vrt_remap_plev19.nc")
# => had to change to include `inclusions/`

# Check for any remaining conflicts
git grep -n "<<<<<<< HEAD"
# No appearances of "<<<<<<< HEAD", so there are no remaining conflicts
git add -A
git rebase --continue

# Update auto-generated files
python tests/integration/utils.py
git status
# No changes, so we updated everything in the generated/ subdir correctly.

# Let's give the commit a new name
git commit --amend

# Let's push the changes to GitHub
git push upstream zppy_pcmdi

If we do decide on adding a Viewer for PCMDI diags, check out https://github.com/E3SM-Project/zppy-interfaces/pull/9 and https://github.com/E3SM-Project/zppy/pull/648 for seeing how global time series implements the Viewer. Ideally, we can use the same Viewer code for both global time series and PCMDI diags.


[stable/spinnaker] typo issue

Describe the bug
PR introduced a small typo https://github.com/helm/charts/pull/16473 at stable/spinnaker/templates/_helpers.tpl
and breaks helm deployment
Version of Helm and Kubernetes:
Helm 2, k8s 1.13
Which chart:
stable/spinnaker
What happened:
kubeConfig  in values.yaml has been referred as kubeconfig (mind capital C) in stable/spinnaker/templates/_helpers.tpl
How to reproduce it (as minimally and precisely as possible):
Deploy chart version 1.16.0 or 1.19.0
Anything else we need to know:
As workaround, I had to add new set of values:
kubeconfig:   encryptedKubeconfig:

I'll make a pr


NFC Support

I just discovered I can use PIV and openPGP on the built-in nfc reader on my laptop in CCID mode.
The only thing I miss is using the yubioath-desktop on the nfc reader as well.
It would be so cool if it would work :)

Fully agreed that we want to support this, it's on the roadmap. No ETA yet though.

Would love to see this as well!

+1, my laptop can read the yubikey with NFC, and it would be awesome if authenticator recognised it

Experimental support for this is available in version 5.0.0, by specifying an external smart card reader under settings.

Version 5.0.0 is working for me, using the custom CCID settings. However, I had to disable NFC OTP interface on the yubikey to get it to work (using the yubikey manager).
With NFC OTP enabled, windows 10 jumps in with a 'tap to receive content from another device', which then opens up a browser to https://demo.yubico.com/yk/ and the OTP.
I use NFC OTP with Lastpass on mobile, so I can't disable this. Any ideas?

@matthewmb Interesting, will have to investigate this scenario a bit. What reader/laptop are you using?

That's really clumsy. The authenticator should be able to find a OATH-TOTP app on any qualifying smart card on any connected reader, including the builtin virtual USB card reader when plugging the key directly into the computer. It should also not immediately remove the still-valid codes after removal of the device from the NFC reader.
Besides, why has the 5.0 release become unintelligible bloatware? The text is barely readable. These are still desktop apps, no need to get too fancy.

@dagheyman my laptop is a Dell Latitude 7490, the built in NFC reader is Broadcom. The most detailed information I could find is here..
Other relevant info: Yubikey 5 NFC, default configuration. Windows 10 Pro, 1803.


Use a map for Onyx collection keys

Details

This change was proposed, merged and reverted due to a failing test and some misscommunication. I've fixed the initial value of the collection map and that also fixes the tests.
Revert PR
This change also provides an improvements to the ReportScreen optimzations Margelo is currently working on.
Related Issues

https://github.com/Expensify/react-native-onyx/pull/329
Automated Tests

Linked PRs

Could you please add screenshots showing that the App tests are passing with this change and the app builds?

Here are the passing tests

Here is a screenshot of metro and the app running

@tgolen I think your concern is addressed. Wanna hit the button?

Going ahead and ship this since we got all the approvals, thanks!


getArrayOfStringToMixed & findArrayOfStringToMixed methods are needed

There's src/Finder/ArrayOfStringToMixedFinder.php which is used internally. But there's no interface for that in public API clas (Mess)

#6


Be able to display multiple decision tables without DRDs

Tasks

[ ] Be able to edit decision tables if diagram contains no DRD and more than one table (default import, i.e. from Signavio)
[ ] Be able to create DRD from multiple decision tables

Related: SUPPORT-2877

mentioned in SUPPORT-2877

This is entirely possible in the latest version of the Modeler, as all views inside the diagram are accessible via sheet tabs:

Example diagram file: no-diagram.dmn


Cross-platform compilation (including examples) using CMake

Using CMake, it is possible to easily compile the library for Windows, MacOS and Linux.
I have also included a cross-platform socket library (not required for the PSN library itself, only the examples), CppSockets, via a git submodule.
Finally, a root CMakeLists.txt means it is possible to add this whole library to an existing CMake-based project and compile it easily using OS-specific tooling.


Feature Request: Hyperparameter Customization

What happened?
Hello There,
I just wish to know if there is any way to change hyperparameters and then re-train the models. Like changing the number of decoder stacks, embedding sizes, number of heads, etc for a BERT model, adding more trainable weights, etc.
I don't find any related documentation regarding that.
Thank You.
Relevant code
N.A.

Relevant log output
N.A.

tensorflow_hub Version
0.12.0 (latest stable release)
TensorFlow Version
2.8 (latest stable release)
Other libraries
No response
Python Version
3.x
OS
Linux

@abhaskumarsinha,
For BERT model fine tuning and hyper-parameter optimisation, you can refer fine tune BERT tutorial. Also, this kaggle example notebook shows BERT hyperparamter tuning in details.
Kindly let us know if this tutorials help you. Thank you.

Closing this due to inactivity. Please take a look into the answers provided above, feel free to reopen and post your comments(if you still have queries on this). Thank you!


ci: Run cargo-deny on the CI (regularly) and maintain a deny.toml

This will make sure that we don't have duplicate dependencies in different versions, only depend on crates with suitable licenses (i.e. non-copyleft OSI licenses here) and also don't depend on anything that ships with dubious binaries (hello serde-derive).
In gstreamer-rs / gst-plugins-rs I'm already using that since a few years and it's very useful.
I don't know what Github Actions offers here but I guess someone already wrote an extension or even bot (like dependabot) for this.
CC @bilelmoussaoui @GuillaumeGomez

Sounds good to me!