Update pyinstaller docs and hook for use with wheels.

To test, checkout https://github.com/pyinstaller/pyinstaller/pull/1678. Then copy and overwrite the rt hook and the kivy-hook in that pr located under pyinstaller/... with the ones in this pr. Then in the copied kivy-hook uncomment the line with hiddenimports.
The docs explain from the pov that this has been done because that's how it'll look like once that pr is merged and we fix the hooks.

@matham really looking forward to this pr. when do you think this will be done? would love to see a new wheel which i can use to package for windows!


feat: Restart DNS after Pi-hole installation

This issue has been resolved in version 1.1.0 :tada:


wstETH Market Add

Todo:

update borrow and supply caps
update proposal description markdown to reflect this forum post
deploy mToken and JRM contracts
add integration tests

Chainlink Composite Oracle: https://basescan.org/address/0xa5A5892bCfca4642c6bD789Ca75f27774309Dcb7#code
Jump Rate Model: https://basescan.org/address/0x1007100Ffc1aC1e63813Fb983bb3D3a8DF1CC193
MToken: https://basescan.org/address/0x627Fe393Bc6EdDA28e99AE648fD6fF362514304b

For more details view the full report in OpenZeppelin Code

@ElliotFriedman I connected OpenZeppelin Defender up to this repository so it will generate these automated reports based on static analysis. Most of the findings are likely to be false positives, but perhaps we can tune it a bit.

I verified the calldata is the same on my machine.


Configure cluster in kuberntes with HA

Hello,
I've use your chart to deploy a cluster in kubernetes with HA.
But when deploying the SatefulSet
I got this error on pod-0

14:47:20,496 INFO  [org.apache.activemq.artemis.core.server] AMQ221034: Waiting indefinitely to obtain live lock
14:47:20,497 INFO  [org.apache.activemq.artemis.core.server] AMQ221035: Live Server Obtained live lock
14:47:20,655 ERROR [org.apache.activemq.artemis.core.client] AMQ214016: Failed to create netty connection: java.net.UnknownHostException: jms-service-1.jms-service.default.svc.cluster.local
	at java.net.InetAddress.getAllByName0(InetAddress.java:1280) [rt.jar:1.8.0_162]
	at java.net.InetAddress.getAllByName(InetAddress.java:1192) [rt.jar:1.8.0_162]
	at java.net.InetAddress.getAllByName(InetAddress.java:1126) [rt.jar:1.8.0_162]
	at java.net.InetAddress.getByName(InetAddress.java:1076) [rt.jar:1.8.0_162]
	at io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:146) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:143) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.8.0_162]
	at io.netty.util.internal.SocketUtils.addressByName(SocketUtils.java:143) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.resolver.DefaultNameResolver.doResolve(DefaultNameResolver.java:43) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:63) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:55) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.java:57) [netty-all-4.1.16.Final.jar:4.1.16.Final]
	at io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.

Here is my SatetulSet

apiVersion: apps/v1beta1
kind: StatefulSet
metadata:
  name: jms-service
  labels:
     app: jms-service
spec:
 serviceName: jms-service
 replicas: 2
 selector:
    matchLabels:
        app: jms-service
 template:
    metadata:
      labels:
         app: jms-service
    spec:
        containers:
        - name: jms-service
          image: kube-registry:5000/tk/jms-service:2.5
          ports:
            - containerPort: 8161
              name: http
            - containerPort: 61616
              name: core
            - containerPort: 5672
              name: amqp
          env:
            - name: ARTEMIS_USERNAME
              value: admin
            - name: ARTEMIS_PASSWORD
              value: admin
          volumeMounts:
           - name: config-override
             mountPath: /var/lib/artemis/etc-override
           - name: config-override-template
             mountPath: /var/lib/artemis/etc-override-template
          imagePullPolicy: Always
        initContainers:
        - name: init-myservice
          image: kube-registry:5000/tk/jms-service:2.5
          command: ['/bin/bash', '/var/lib/artemis/etc-override-template/configure-cluster.sh']
          volumeMounts:
          - name: data
            mountPath: /var/lib/artemis/data
          - name: config-override
            mountPath: /var/lib/artemis/etc-override
          - name: config-override-template
            mountPath: /var/lib/artemis/etc-override-template

        volumes:
        - name: config-override
          emptyDir: {}
        - name: config-override-template
          configMap:
            name: jms-service-map
        - name: data
          emptyDir: {}

And the Headless Service

apiVersion: v1
kind: Service
metadata:
  name:  jms-service
  annotations:
      # Make sure DNS is resolvable during initialization.
      service.alpha.kubernetes.io/tolerate-unready-endpoints: "true"
spec:
  publishNotReadyAddresses: true
  ports:
    - port: 8161
      name: http
      targetPort: http
    - port: 61616
      name: core
      targetPort: core
    - port: 5672
      name: amqp
      targetPort: amqp
  clusterIP: None
  selector:
    app: jms-service

But if i delete the pod-0 then the pod starts OK, but then this warn  is on pod-1
15:04:37,825 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: AMQ119015: The connection was disconnected because of server shutdown [code=DISCONNECTED]
15:04:37,842 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: AMQ119015: The connection was disconnected because of server shutdown [code=DISCONNECTED]
And when trying to acess the console, i can't login with the username and pass.. Well i can login but with a lot of retries, The login sometime works and sometime don't
Any help ?

Umm sounds like a problem with the time when the hostname is created in the DNS and when the service start, Could you raise a ticket in the kubernetes repo rather than here?


how to train

I want to know how to train with data? There is no "train.py" to use

This repository is for inference only. For training check the original repository.


Allow Range start to equal Range End

Let's say you want to take the 20th row.
In the playground:

If I do take 20 I'll get the first 20 rows, not exactly the 20th.
If I do take 20..20 I get an error "Range end is before its start.".
If I do take 20..21 I'll get rows 20 and 21, then if I do take 1 it will throw me an error

There are workarounds, but I think it would be a nicer API to simply say take 20..20?
This fails because Range start cannot equal Range end. Maybe we could also start to equal end in a Range?

Fixed by @Shuozeli in #946, thank you!


notary verify not responding.

I have created a collection, added a target to the collection and am able to list it or look it up successfully with the commands below.
$ notary init example.com/collection
$ notary add example.com/collection chart1 wordpress-8.0.1.tgz
$ notary list example.com/collection
$ notary lookup example.com/collection chart1

Aprat from that the verify subcommand doesn't seem to be responding properly.
$ notary verify example.com/collection chart1

Upon trying to debug, the command seems to get stuck and not exit. This seems like a bug to me.
$ notary verify example.com/collection chart1  -D
DEBU[0000] Using the following trust directory: /root/.notary

I am guessing this might be because I haven't provided anything to the command to verify the target against but if that is the case the command should exit and I should be getting an error back. From the looks of it, the server is not being called after running this command.

Yeah, one year on and the notary verify subcommand does nothing.


unibern student account

Hello!
what a wonderful script!
Question: what do I need to change in the script to be able to register with my student account of the University of Bern?
many thanks!
Cheers

Hello!
what a wonderful script!
Question: what do I need to change in the script to be able to register with my student account of the University of Bern?
many thanks!
Cheers

Hi @patriciovelasquez please check this function here: https://github.com/zgxsin/asvz_lesson_registration/blob/main/register_for_asvz_lesson.py#L43. You need to adapt this function for the bern university login. Pay attention to this line: https://github.com/zgxsin/asvz_lesson_registration/blob/main/register_for_asvz_lesson.py#L57.


Suggested addition to https://obds-training.github.io/Help/docs/data-management/organise-and-backup/backup/

Speak to Simon about WIMM Keep. May currently be in limited preview, but should probably be mentioned.

Not stale

Not stale

Not stale


ImageNet Trained model

Hi,
Would it be appropriate to ask for the trained distillation model on ImageNet? It would be greatly appreciated and a million help if you could share the trained distillation models on imageNet for download.
thank you!

Hi
I'm sorry but I can't find the ImageNet models in my storage.
It might be removed because of a storage issue.
Sorry

Thank you for your reply, and you don't have to be sorry. :)


[cinder-csi-plugin] Tracking CSIMigration with Topology Support

Is this a BUG REPORT or FEATURE REQUEST?:
/kind bug

Uncomment only one, leave it on its own line:
/kind bug
/kind feature

What happened:
Our CSIMigration tests don't run with topology support enabled. Thanks to @jsafrane for discovering and fixing a missing implementation in csi-translation-lib :) (see https://github.com/kubernetes/kubernetes/pull/98311)
For documentation purposes. This is the error message showing up in container csi-provisioner of pod csi-cinder-controllerplugin-0.
I0201 11:04:31.306297       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"topology-3380", Name:"pvc-pbqb5", UID:"8d14863d-5505-402d-b8e8-748f789b0119", APIVersion:"v1",  ResourceVersion:"85642445", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "topology-3380-cinder-scdbmqm": error generating accessibility requirements: topology map[topology.cinder.csi.openstack.org/zone:es1] from selected node "k8s-node-2" is not in requisite: [map[failure-domain.beta.kubernetes.io/zone:es1]]

What you expected to happen:
Test should pass. Topology labels shoud be translated from in-tree storage class to csi-cinder-style storage class.
How to reproduce it:

Make sure CSIMigration is enabled in your cluster
Enable Topology in container csi-provisioner

kubectl -n kube-system patch --type=json -p '[{"op": "add", "path": "/spec/template/spec/containers/1/args/-", "value": "--feature-gates=Topology=true"}]' statefulset/csi-cinder-controllerplugin

run kubernetes e2e tests like

/root/kubernetes/test/bin/e2e.test \
  -kubeconfig=/etc/kubernetes/admin.conf \
  -provider=openstack \
  -storage.migratedPlugins=kubernetes.io/cinder \
  -report-dir="$log_dir" \
  -ginkgo.noColor \
  -ginkgo.focus="\[sig-storage\]\sIn-tree\sVolumes\s\[Driver:\scinder\]\s\[Testpattern:\sDynamic\sPV\s\(delayed\sbinding\)\]\stopology\sshould\sprovision\sa\svolume\sand\sschedule\sa\spod\swith\sAllowedTopologies"

Anything else we need to know?:
There are pending Backports to supported Kubernetes versions

https://github.com/kubernetes/kubernetes/pull/98608
https://github.com/kubernetes/kubernetes/pull/98609
https://github.com/kubernetes/kubernetes/pull/98610

We need to wait for:

merge of https://github.com/kubernetes/kubernetes/pull/98610
updated version of csi-provisioner

For us to do:

update the csi-provisioner container in pod csi-cinder-controllerplugin to fixed version
enanble topology in csi-cinder-controllerplugin

Environment:

openstack-cloud-controller-manager(or other related binary) version:
OpenStack version:
Others:

Just to give an update. We are still waiting for a release of external-provisioner (https://github.com/kubernetes-csi/external-provisioner/issues/563). In the meanwhile, I created a custom image, including the fix of @jsafrane , and successfully tested CSIMigration+Topology with it.

@chrigl Any update on this?

/remove-lifecycle stale

/remove-lifecycle stale

/remove-lifecycle stale


update support statment reflecting eol for k8s 1.10

Address #1052
heads up regarding k8s 1.10 eol.
@dmcgowan @crosbymichael @estesp @Random-Liu
Signed-off-by: Mike Brown<EMAIL_ADDRESS>

/lgtm


Support SSR?

I'm using a NextJS application with SSR. On build, all client side APIs are undefined of course, but those references break the build. Are there plans to support SSR builds in the future? Thanks

Yes indeed, I haven’t tested it in an SSR environment, I’ll take a look at it.

I released a new version, you can test it 😄

Yes, everything works as expected. Thanks!


Add shell completion for UV in feature

Hey! Thank you for your nice feature for UV in devcontainers!
I was wondering if it would be possible to add the shell completion scripts to your feature, so as per documentation.
That would include running:
# Determine your shell (e.g., with `echo $SHELL`), then run one of:
echo 'eval "$(uv generate-shell-completion bash)"' >> ~/.bashrc
echo 'eval "$(uv generate-shell-completion zsh)"' >> ~/.zshrc
echo 'uv generate-shell-completion fish | source' >> ~/.config/fish/config.fish
echo 'eval (uv generate-shell-completion elvish | slurp)' >> ~/.elvish/rc.elv

# Determine your shell (e.g., with `echo $SHELL`), then run one of:
echo 'eval "$(uvx --generate-shell-completion bash)"' >> ~/.bashrc
echo 'eval "$(uvx --generate-shell-completion zsh)"' >> ~/.zshrc
echo 'uvx --generate-shell-completion fish | source' >> ~/.config/fish/config.fish
echo 'eval (uvx --generate-shell-completion elvish | slurp)' >> ~/.elvish/rc.elv

Hi Lucas,
Thank you for the request, It took a bit longer since I wanted to remove the devcontainer-contrib dependency first, but I implemented it today in 749335c, with the variable "shellautocompletion" set to true Autocompletion should work. For the moment I will default to disabled until I have tested it a week or two myself during day to day.
Best regards
Valentin

Thank you very much! At first sight it seems to work great! I'll let you know if i run into any issues, but so far it seems to work great!


Invalid name: "@ionic/app-generators"

Note: If you are having problems formatting your issue please refer to this article on using markdown in Github:
https://guides.github.com/features/mastering-markdown/
Note: for support questions, please use one of these channels:
https://forum.ionicframework.com/
http://ionicworldwide.herokuapp.com/
Note: for build related issues you can open up an issue on the ionic-app-scripts repo
https://github.com/driftyco/ionic-app-scripts
Short description of the problem:
I tried to update ionic because of an IOS 10 issue and I'm getting the following error:
Darwin 15.6.0
npm ERR! argv "/usr/local/bin/node" "/usr/local/bin/npm" "install" "-g" "ionic"
npm ERR! node v6.6.0
npm ERR! npm  v3.10.3
npm ERR! Invalid name: "@ionic/app-generators"
And Ionic won't install.
What behavior are you expecting?
Steps to reproduce:

sudo npm install -g ionic

insert any relevant code between the above and below backticks

Other information: (e.g. stacktraces, related issues, suggestions how to fix, stackoverflow links, forum links, etc)
Which Ionic Version? 1.x or 2.x
Plunker that shows an example of your issue
For Ionic 1 issues - http://plnkr.co/edit/Xo1QyAUx35ny1Xf9ODHx?p=preview
For Ionic 2 issues - http://plnkr.co/edit/me3Uk0GKWVRhZWU0usad?p=preview
Run ionic info from terminal/cmd prompt: (paste output below)

Not able to replicate this.
The package in question does exist
https://www.npmjs.com/package/@ionic/app-generators
Can you try again?

Strange I tried again and still seeing the same eror. Never had any problems before installing or updating ionic. Anything else I could try?

I'm having the same problem.
$ npm -v
2.14.12
$ sudo npm install -g ionic
npm ERR! unpack Could not read data for<EMAIL_ADDRESS>npm ERR! Darwin 15.6.0
npm ERR! argv "/usr/local/bin/node" "/usr/local/bin/npm" "install" "-g" "ionic"
npm ERR! node v4.2.4
npm ERR! npm  v2.14.12

npm ERR! Invalid name: "@ionic/app-generators"
npm ERR!
npm ERR! If you need help, you may report this error at:
npm ERR!     <https://github.com/npm/npm/issues>

@laurenkyla could you do npm uninstall -g ionic then try to install again.
@menzow same for you. But you need to update your npm and node version. You need npm3

Thanks but uninstall doesn't do anything as it seems to have gotten far enough in the install to remove the version I had so I now have no ionic installed and I can't install it:
$ ionic
-bash: /usr/local/bin/ionic: No such file or directory

I managed to solve the issue by doing the following:
https://docs.npmjs.com/getting-started/fixing-npm-permissions
Thanks

seems to be a bug of specific npm version.
https://github.com/npm/npm/issues/14104
after installation of latest npm it worked for me:
sudo npm install -g npm@latest

jjoe64 solution worked for me

Had the same issue. Changing permissions didn't help. Updating npm as suggested by jjoe64 worked.

sudo npm install -g npm@latest help me!

sudo npm install -g npm@latest was the solution for me. Thanks @appsthatmatter


Add minimal FP test

Summary
This is a minimal test showing a false positives when the DSL mark params as sources but then there is a setter that should override the taint
Example code
  public final void fp1_expected(UserBlob u) {
    u.setF1("Not_tainted");
    Origin.sink(u.getF2());
  }

Testing
Added an e2e test demonstrating the FP

The false positive is caused by the analysis not inferred strong updates and just assuming weak updates. This is a problem for most of our taint analyzers.
I think we cover that problem in this test: https://github.com/facebook/mariana-trench/blob/main/source/tests/integration/end-to-end/code/strong_update/Flow.java
If you still want to add your test, could you add it to that file/folder? Thanks.

The false positive is caused by the analysis not inferred strong updates and just assuming weak updates. This is a problem for most of our taint analyzers.
I think we cover that problem in this test: https://github.com/facebook/mariana-trench/blob/main/source/tests/integration/end-to-end/code/strong_update/Flow.java
If you still want to add your test, could you add it to that file/folder? Thanks.

Thanks for the context! Is there an ETA for fixing this issue? and are there any ways mitigate such FPs until it is fixed?
For context, this does affect many Java framework e.g., Springframework when specifying the arguments as entry points.

I don't think this has been bothering us too much, so we haven't prioritized fixing this.
If you know that the setters only update one field and do nothing else, you could use a model generator that finds those setters and add the strong-write-on-propagation mode.

@arthaud  happy to drop the test if it is not adding new coverage. I think most of the test body is covered also by https://github.com/facebook/mariana-trench/blob/3e8c2ecfa2e9a0e783ac8c0d3ec8ba90b5ebf556/source/tests/integration/end-to-end/code/access_paths/AccessPaths.java#L67-L74
However, I am not sure what. I am doing wrong. I updated the configs and added strong-write-on-propagation but the false positive is still surfaced. Any idea what I might be missing?

@arthaud happy to drop the test if it is not adding new coverage. I think most of the test body is covered also by

I think your test is slightly different so it could be useful to have it.
Since I had to investigate, I merged this test into end-to-end/code/strong_update/Flow.java internally and will be landing this soon.

However, I am not sure what I am doing wrong. I updated the configs and added strong-write-on-propagation but the false positive is still there. Any idea what I might be missing?

Alright, I tested this locally and you are right, this doesn't work.
It's more complicated than it looks. This is a problem caused by analyzing low-level bytecode.
What we see is just an invoke v1, v0, UserBlob.setF1, hence we don't really know that v0 will be a string (without taint) later on, we can't really apply the strong-write-on-propagation.
I don't think there is a work around this, unfortunately.
I also think it might be complex to fix this. I need to think more about this.

I thought more about this. I think this could be solved by using something like inline-as. We currently detect simple getters and inline them. We could do the same for setters.

For the cases you care about, are the setters always trivial, i.e this.field = argument without any extra code?

Sorry for the late reply, I was OTG. Yep most of the setters I care about are just simple setters, take an argument set a field and return.
Can you walk me through how the in-line as work or is that something you can support from your side?

inline_as is something that the analysis infers automatically.
For now, it detects simple getters of the form return this.field.
It can then be used at the call site of getters, to improve precision. Without it, we would assume that the method call returns a new "memory location" that doesn't alias the field.
This allows us to properly find taint for stuff like:
Object x = this.getFoo();
this.foo = source();
sink(x); // We know x and this.foo refer to the same object in memory

This is inferred here: https://github.com/facebook/mariana-trench/blob/main/source/ForwardAliasTransfer.cpp#L331
And use here: https://github.com/facebook/mariana-trench/blob/main/source/TransferCall.cpp#L143
I can try implementing it for setters on my spare time but can't promise anything, as it's not high priority for us.

This should be fixed by 751bafa763cc544c5b05780897350ee08d36c17a
Please re-open in case you are still having false positives :)

This should be fixed by 751bafa Please re-open in case you are still having false positives :)

thanks for fixing this. Let me validate locally and get back to you

Alright, I just checked.
I think this is because your model generator taints u (i.e, Argument(x)) entirely. So even though we call u.setF1("Not_tainted"), u itself is still tainted.
If you update your model generator to only taint f1 (using Argument(x).f1) then the issue goes away.

closing this PR now as it is a no-op


Can we use rspec context description stack for describe responses?

Example
context "when user send not match password do
    it "return some error" do
      post "/login", {password: "password"}

      expect(reponse.body).to eq(" ... some error ...")
    end
  end

It generate description: return some error in openapi.yaml
It would be more convenient to add a description from the entire description stack context.
context "when user ... foo" do
  ...
  context "but not ... bar" do
  ...
     it "return some error" do
  ...

For example, this would generate description: when user ... foo but not ... bar it return some error
Then we will have all the power of the rspec as a BDD in the API description.
Although it is possible use description into the response is not entirely correct, I lack a technical understanding in this matter.

Although it is possible use description into the response is not entirely correct, I lack a technical understanding in this matter.

I took a look at how to support this feature. Let me ask a few things.

Don't you use a describe block? Please include it if you use it in your real example.

context cannot be distinguished from describe. Do you expect to include describe's descriptions as well?

it cannot be distinguished from specify. Therefore we can't reasonably generate "it" in your proposed description.

Therefore the description would be when your ... foo but not ... bar return some error. Are you okay with it?

Yep, I use it to separate tests by methods or by queries for request tests and use context for refinement of behavior context.  I try to follow the rules from http://www.betterspecs.org/

describe Table, type: :request do
  describe "/index" do
    context "when ..." do
      it "return ..." do
      context "but ..." do
        it "return ..."
...
    context "when another..." do
      it "return another ..." do
...
end

Here we are talking about the fact that rspec implies the use of BDD descriptions through describe and context and if we merging which together it, it should ultimately be a complete English sentence describing the behavior in each case. so it would be better to leave it. Can we just simple add it string in the presence of context?

Yep, I use it to separate tests by methods or by queries for request tests and use context for refinement of behavior context. I try to follow the rules from

Because context and describe are the same things, description will need to be:

Table /index when ... return ...
Table /index when ... but ... return ...
Table /index when another ... return another ...

Let me ask this again: are you okay with that? We simply can't remove Table /index part in a reasonable manner.

Can we just simple add it string in the presence of context?

I think it's feasible. Though, as context cannot be distinguished from describe, it will need to be generated in a presence of describe too.

Yes it is really problematic. Maybe cut top level describe with regex, but this seems like an unreliable solution. I think that for this we need to develop some kind of agreement on the description if we want to process it automatically. For example, use only /path in the upper describe, then we can somehow cut it based on regexp.
Table /index when another ... return another ... -> (regexp) -> when another ... return another ...
I agree

Yes it is really problematic. Maybe cut top level describe with regex, but this seems like an unreliable solution. I think that for this we need to develop some kind of agreement on the description if we want to process it automatically. For example, use only /path in the upper describe, then we can somehow cut it based on regexp.
Table /index when another ... return another ... -> (regexp) -> when another ... return another ...

If it requires some agreement on the description, probably it's too specific to your project. So I added some flexibility on the solution for you https://github.com/k0kubun/rspec-openapi/commit/2f36d0d31a4497a943cab8461a26b138146e2a76.
You take a RSpec example, and you traverse a context tree as you like, and yield a description from it:
RSpec::OpenAPI.description_builder = -> (example) do
  contexts = example.example_group.parent_groups.map(&:description).select do |description|
    description.match?(/\Awhen /)
  end
  [*contexts, 'it', example.description].join(' ')
end

I hope you'll find a best way to build a description using the config as you like. Please try v0.3.1.

I would not say that I have a specific use of rspec in the project, I try to follow generally accepted techniques, but you are right that in the end everything becomes specific.
Thanks for the work you've done.


Migration import is not working

Hi there, Firstly thank you for awesome library.
I have successfully created Elastic project by using this library.
But recently decided to update hits information. So firstly,
I run flush command and now i have encountered with issue which
data is not imported as hits even command is saying successfully imported.
Haven't changed any code previously working version.
Data importing steps are:
php artisan elastic:drop-index "App\SMIndexConfigurator"
php artisan elastic:create-index "App\SMIndexConfigurator"
php artisan elastic:migrate "App\Models\SMProduct" sm_products
php artisan scout:flush  "App\Models\SMProduct"
php artisan scout:import "App\Models\SMProduct"
there is not error encountered during these commands entry.
Result is below:

But in Elastic Engine result is:

Assuming artisan queue:work is solution.


Support connecting to IRC via a SOCKS proxy [$15]

There is a $5.00 bounty open on this issue at Bountysource
##

---
There is a **[$15 open bounty](https://www.bountysource.com/issues/682-support-connecting-to-irc-via-a-socks-proxy?utm_campaign=plugin&utm_content=tracker%2F1759&utm_medium=issues&utm_source=github)** on this issue. Add to the bounty at [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F1759&utm_medium=issues&utm_source=github).

Added $10. Please add :kissing:

I'd also like to ask for proxy support in ZNC 👍

+1
The socat example isn't exactly reliable. In response to @Mikaela, Tor is not the only use case for this. I'd like to use Tor to connect to Freenode and OFTC, but I'd still like to go directly to hackint (via dn42) and another network accessible via cjdns, so this would need to be a per server thing.
Looking at how to implement this (hints to prospective developers, I'm not a C++ dev):

ZNC uses the CSocketManager to manage the low-level socket that is the actual connection to the IRC server. It looks like modifications would be required for the Connect() function here to allow for a SOCKS proxy to be specified.
When a SOCKS proxy is specified, for the Tor use case at least, it would be necessary to disable DNS resolution and pass the domain name (which may be a hidden service) through the SOCKS proxy.
It may be a better idea to provide an alternative function such as ConnectSocks() to implement the acquiring of a socket via SOCKS as you're basically rewriting the whole function.

As it has been so long time since anything was said here, I would like to add this comment to notify that I have changed my mind on https://github.com/znc/znc/issues/143#issuecomment-65669460 again and added another set of strikethroughs and written the actual comment there.
Unrelatedly the Bountysource integration in the original post is broken.

I've been trying to get this to work with proxychains essentially socksifies any program that uses tcp sockets, unfortunately its very slow  proxychains4 -f <(echo "[ProxyList]" ; cat /mnt/export/netcrave_docker/srv/proxy_scan/all_uniq.txt | grep -v "[a-z]" | tr ':' ' ' | awk '{print "http " $0}' | shuf ) znc -d /mnt/export/src/oh-my-znc-2.0 but I think its slow because I'm feeding it quite a large list of proxies:
cat /mnt/export/proxy_scan/all_uniq.txt| wc -l
2604

and my znc.conf connects to around ~400 networks:
cat /mnt/export/src/oh-my-znc-2.0/configs/znc.conf | grep Network  | grep -v "/"  | wc -l
439

So maybe this solution would work just fine for somebody who is not me. Here's a list of proxies if anybody else wants to try it: https://termbin.com/8jc9 there's also some other options for the config that are worth checking out.

however you'll probably immediately notice that its working very slowly strace -p $(pgrep znc)

also I agree socat is quite cumbersome if you use it: for this purpose, it ended up becoming two commands when I tried because I couldn't get chaining to work right with SSL:
 socat TCP-L:1$x,reuseaddr,fork PROXY:$proxy:$ircserv,proxyport=$port,retry=10 2> /dev/null &
socat TCP-L:2$x,reuseaddr,fork OPENSSL:localhost:1$x,verify=0,compress=auto,retry=10 2> /dev/null &
Also that compress=auto is imperative iirc. It was for this reason I started experimenting with ways to use HAProxy to manage my proxy lists and destinations, here's the config:
global
    log                         <IP_ADDRESS> local0 notice
    maxconn                     32768
    nbproc                      4
    cpu-map                     1 0
    cpu-map                     2 1
    cpu-map                     3 2
    cpu-map                     4 3
    tune.ssl.default-dh-param   2048
    stats socket                /home/proxy_scan/run/haproxy_admin.sock mode 660 level admin
    server-state-file           /home/proxy_scan/run/haproxy.state
    stats                       timeout 30s bind-process 4
defaults
    load-server-state-from-file global
    log                         global
    mode                        http
    option                      httplog
    option                      dontlognull
    option                      socket-stats
    default-server              check inter 15000 downinter 25000 fastinter 1000 weight 50 slowstart 120s observe layer7 on-error fastinter
    maxconn                     32768
    retries                     3
    timeout                     connect 3000000
    timeout                     client  6600000
    timeout                     server  6600000
listen stats
    bind                        *:9999
    stats                       enable
    stats                       hide-version
    stats                       realm Proxy\ Health
    stats                       uri /
frontend socks4_fe
    maxconn                     25000
    bind                        *:8388
    mode                        tcp
    default_backend             socks4_be
frontend socks5_fe
    maxconn                     25000
    bind                        *:1080
    mode                        tcp
    default_backend             socks5_be
frontend http_connect_fe
    maxconn                     25000
    bind                        *:3128
    mode                        http
    default_backend             http_connect_be
frontend http_and_https_fe
    maxconn                     25000
    bind                        *:8080
    mode                        http
    default_backend             http_and_https_be
backend socks4_be
    balance                     roundrobin
    mode                        tcp
    server-template             socks4-proxy- 1-2000 <IP_ADDRESS> check
backend socks5_be
    balance                     roundrobin
    mode                        tcp
    server-template             socks5-proxy- 1-2000 <IP_ADDRESS> check
backend http_and_https_be
    balance                     roundrobin
    mode                        http
    http-request                set-header Proxy-Connection Keep-Alive
    option                      httpchk GET / "HTTP/1.0\r\nHost: ifconfig.me"
    http-check                  expect rstatus (2|3)[0-9][0-9]
    server-template             http-proxy- 1-2000 <IP_ADDRESS> check
backend http_connect_be
    balance                     roundrobin
    mode                        http
    http-request                set-header Proxy-Connection Keep-Alive
    option                      httpchk GET / "HTTP/1.0\r\nHost: ifconfig.me"
    http-check                  expect rstatus (2|3)[0-9][0-9]
    server-template             http-proxy- 1-2000 <IP_ADDRESS> check

This configuration ensures a control socket which you can use to add and remove the actual proxies to it at run-time, you can do it with bash:
echo "set server backendnodes/${id} addr ${new_host} port ${new_port}" | nc -U /home/proxy_scan/run/haproxy_admin.sock;
However I have recently started re-writing this to fit into a python script and I haven't finished because I haven't wanted to do the work to actually do it right (with weight outs, draining, etc) but I have a start so if anybody else feels like this work needs to be done feel free to take over:
from haproxyadmin import haproxy
from operator import itemgetter, attrgetter
import socket
import math
import fcntl
import asyncio

class HAProxy_Controller:
    hap = haproxy.HAProxy(socket_dir='/home/proxy_scan/run')

    def get_proxies(self):
        f = open('/home/proxy_scan/all_uniq.txt')
        # get exclusive lock on file in case the scanner is already writing or is about to
        fcntl.flock(f, fcntl.LOCK_EX | fcntl.LOCK_NB)
        lines = f.readlines()
        # release lock
        fcntl.flock(f, fcntl.LOCK_UN)
        return lines

    '''
    Configures each proxy from /home/proxy_scan/all_uniq.txt as a backend server
    using the haproxy admin socket.
    '''
    def init_haproxy(self):
        current_servers = self.hap.backend('backendnodes').servers()
        proxies = self.get_proxies()
        existing = [str(x.address) for x in current_servers]
        last = None

        for x in proxies:
            dup = False

            host = x.split(':')[0]
            port = x.split(':')[1]
            resolved = socket.gethostbyname(host)

            for z in existing:
                if z == "{}:{}".format(resolved, port).strip():
                    dup = True
                    break

            if dup == True:
                continue

            if last == None:
                last = 0

            else:
                last = last + 1

            current_servers[last].setaddress("{} port {}".format(resolved, port).strip())

    '''
    backend server cleanup tasks
    '''
    def maintain_failed_servers(self):
        servers = self.hap.backend('backendnodes').servers()
        # this first iteration should address most flapping the more frequently it is run
        [x.setweight(0) for x in servers if x.status == "DOWN"]
        # anything that has been weighted down to 0 is considered SOFT STOPPED for for maintenance
        [x.setstate('drain') for x in servers if x.status == "UP" and x.weight == '0']

    '''
    Sets the weight for each backend server (highest weight for lowest latency)
    '''
    def set_weights_based_health_check_duration(self):
        servers = self.hap.backend('backendnodes').servers()
        stats = [x.stats_per_process()[0][1] for x in servers if x.status == 'UP']
        sorted_stats = sorted(stats, key = lambda s: int(s['check_duration']), reverse=False)
        perc = 100.0

        for i in range(0, len(sorted_stats)):
            cur_weight = math.ceil(100 - i/len(sorted_stats) * 100)
            [x for x in servers if x.name == sorted_stats[i]['svname']][0].setweight(cur_weight)

Also with regards to the haproxy solution id reccomend using something like this
https://github.com/ryanchapman/go-any-proxy along with the necessary iptables rules to masq all tcp outbound except from haproxys uid ..

Just want to say that this feature is still quite relevant :)

Currently the wiki tells Tor users to use MapAddress .onion <lan-address> which adds additional difficulties.
If ZNC supported SOCKS proxies, Tor users could simply enter MapAddress zettel.freenode.net ajnvpgl6prmkb7yktvue6im5wiedlz2w32uhcwaamdiecdrfpwwgnlqd.onion to their torrc and thus avoid the /znc *addfingerprint dance.

https://github.com/freenode/web-7.0/issues/413

Currently this doesn't work, MetaNova and another person tested it with the current proxychains instructions and failed due to "Cant resolved server hostname", which MetaNova thinks is caused by ZNC trying to resolve zettel.freenode.net before the query is sent to Tor which would send it to the onion address.

May I ask, is there a way to connect to an IRC server through an HTTP proxy?

May I ask, is there a way to connect to an IRC server through an HTTP proxy?

HTTP Proxy only speaks HTTP, not IRC.

@teward HTTP CONNECT supports any TCP protocol

@KyokoMiki using proxychains, not natively yet. This is what this bug is about.

@DarthGandalf
I added in support for socks5 pretty quickly, but I don't want to work on maintaining it, so I'll just leave this here. The LOCALE stuff probably is not needed, but I have had weird issues with CString in the past and raw bytes.
Assumes DNS over socks5, should work with IPv6 maybe.
https://github.com/pirx9/znc-socks5

Use proxychains
strict_chain
quiet_mode
proxy_dns
tcp_read_time_out 15000
tcp_connect_time_out 8000
[ProxyList]
socks5 	<IP_ADDRESS> 9050

proxychains znc


CORS issue

Hey,
I am using d3-tip on some of my d3 charts (particularly on codepen) and I am pulling the tip in from http://labratrevenge.com/d3-tip/javascripts/d3.tip.v0.6.3.js. But lately I am getting a CORS error. Any chance that there is a secure link somewhere that I am just not aware of?

Please don't serve d3-tip from my personal website!   Serving it yourself or serving it from a service like https://rawgit.com would be better.  (P.S. the current version is 0.8 alpha)


Update metab

Solves:
Bugs
Remove EC numbers from cross references of genes
Only link to metabolites with data
Solves partially:
Rework data retrieval for metabolite-specific pages

Pull Request Test Coverage Report for Build 1130

31 of 46 (67.39%)  changed or added relevant lines in 2 files are covered.
16 unchanged lines in 5 files lost coverage.
Overall coverage decreased (-3.0%) to 77.034%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/scenes/BiochemicalEntityDetails/Reaction/MetadataSection.js
30
32
93.75%

src/scenes/BiochemicalEntityDetails/Metabolite/ConcentrationDataTable.js
1
14
7.14%

Files with Coverage Reduction
New Missed Lines
%

src/scenes/BiochemicalEntityDetails/DataTable/DataTable.js
1
86.23%

src/scenes/BiochemicalEntityDetails/Reaction/MetadataSection.js
1
84.09%

src/scenes/BiochemicalEntityDetails/NumberFilter.js
2
53.15%

src/scenes/BiochemicalEntityDetails/Metabolite/ConcentrationDataTable.js
5
22.41%

src/scenes/BiochemicalEntityDetails/LinkCellRenderer.js
7
8.33%

Totals

Change from base Build 1117:
-3.0%

Covered Lines:
1278

Relevant Lines:
1560

💛  - Coveralls


"close and comment" should be "comment and close"

I think it would make more sense (as a single action) to comment on an issue then close it. At the moment, the "close and comment" button does exactly that - it closes, then comments. This can be hard to tell if the comment was made AFTER the close, and is suggesting a re-open without actually reading the comment. Whereas, if the comment followed by a close is the last comment, it's easy to see there's no commentary after the close! (0.6.9)

Actually, on my local gogs instance it comments and THEN closes. So perhaps we should just change it to "Comment and reopen/close"

@TheHowl What version are you using?

<IP_ADDRESS>7

Interesting, I wonder if that's been changed between 0.6.9 and 0.6.16
I tried to find something in the issues to no avail

Interesting, I wonder if that's been changed between 0.6.9 and 0.6.16

Yes, behavior was changed.

In that case, let's ignore this then! Thanks

Actually, @TheHowl is right. Maybe the wording should be changed to "Comment And Close"

Yeah, agree.


Help with projector status and rebuilding

Hi Guys,
Firstly, thank you for a great product you have made. Really lucky to have you guys around.
I would like to get some clarification on how it actually works :)
For background, I am using the AccountBalance projector example from the docs.
I have been using it for some time (2064 stored events) and I opted for streaming events by AccountUuid. In the projector_statuses table I have 1103 rows.
I only have one projector.
When I run php artisan event-projector:list I get this

I am thinking of rebuilding it to get everything back to normal (I'm guessing the above output means not everything is as it should be?)
The only thing the account balance projector does is update the accounts table with a balance and I have a resetState method in my account balance projector that truncates the accounts table.
So my questions are:

Should it be ok to rebuild?
Does reset only run the resetState method but not replay events?
I've realised I never had an accountUuid property on all my events the projector received, do I need to update the rows in the stored_events table to include this property?
I have event listeners that listen to the same events as my event projector so will rebuilding fire the actual event and resend notifications etc?

Thanks for any help you can provide.
Roark

Closing this, as we won't support v1 in anymore. In v2 all functionality regarding projector statuses has been removed.


New url https://freekassa.ru

Freekassa has changed api url https://docs.freekassa.ru/
Will you do updates to package?

Hey! Perhaps in the near future. If you need it very urgently, you can issue a merge request.

Yes I need it, but I don't have any merge
Near future is  how close?

I just looked at the new api and I see that simply changing the url will not work. Now there is a completely different api with which this package does not work.
The api version supported by the package is located here https://www.free-kassa.ru/docs/api.php


How to download the annotations with a unique integer for each individual nucleus

Hello,
Thank you for this amazing tool.
I want to have an instance map for my training annotation, eg:  a unique integer for each individual nucleus.
How can I do this ?? or the tool don't this option ??
Thanks in advance

sorry, i'm not sure i totally understand your question, but if you look
here:
https://github.com/choosehappy/PatchSorter/wiki/Frequently-Asked-Questions
i think you'll see that what you're referring to is called an "indexed
mask", and that patchsorter does support these? have you tried using this
functionality?
On Mon, Jul 25, 2022 at 2:16 PM sanomamoudou @.***>
wrote:

Hello,
Thank you for this amazing tool.
I want to have an instance map for my training annotation, eg: a unique
integer for each individual nucleus.
How can I do this ?? or the tool don't this option ??
Thanks in advance
—
Reply to this email directly, view it on GitHub
https://github.com/choosehappy/QuickAnnotator/issues/27, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACJ3XTFGUJRVJHFQTRSAW2LVV2ASPANCNFSM54SCISXQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Hi @choosehappy.
Thank you for your feedback.
Yes, exactly I am talking about "indexed mask".
I thought it was possible to annotate and download our masks in this format with QuickAnnotator.
But I haven't tried yet PatchSorter, I'll test this functionality on PatchSorter.
Thank you!

Ah, sorry, i understand your question better now
Currently, QuickAnnotator doesn't provide direct support for this since i
just realized we don't have a way of differentiating two objects that are
touching each other in the UI.
as a result, the outputs are binary masks, as i'm sure you've noticed
if you want to convert those to indexed images, and if the objects are
separated, you can produce an index image easily with 1 line of python code:
https://scikit-image.org/docs/stable/api/skimage.measure.html#skimage.measure.label
On Fri, Jul 29, 2022 at 10:23 AM sanomamoudou @.***>
wrote:

Hi @choosehappy https://github.com/choosehappy.
Thank you for your feedback.
Yes, exactly I am talking about "indexed mask".
I thought it was possible to annotate and download our masks in this
format with QuickAnnotator.
But I haven't tried yet PatchSorter, I'll test this functionality on
PatchSorter.
Thank you!
—
Reply to this email directly, view it on GitHub
https://github.com/choosehappy/QuickAnnotator/issues/27#issuecomment-1199010608,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACJ3XTDLUYRMHLB7C2ZNIDTVWOIH3ANCNFSM54SCISXQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Ok got it
thank you !


Response not produce null response body

Package
dio
Version
5.3.0
Output of flutter doctor -v
[✓] Flutter (Channel stable, 3.10.6, on macOS 12.6.3 21G419 darwin-x64, locale en-VN)
    • Flutter version 3.10.6 on channel stable at /Users/admin/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision f468f3366c (12 days ago), 2023-07-12 15:19:05 -0700
    • Engine revision cdbeda788a
    • Dart version 3.0.6
    • DevTools version 2.23.1

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.2)
    • Android SDK at /Users/admin/Library/Android/sdk
    • Platform android-33, build-tools 33.0.2
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.15+0-b2043.56-8887301)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.2)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14C18
    • CocoaPods version 1.12.1

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2022.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.15+0-b2043.56-8887301)

[✓] Connected device (4 available)
    • Star 5 (mobile)      • BRB00064261                              • android-arm64  • Android 11 (API 30)
    • Gym iPhone (mobile) • 4a00cbe28e36bde37a76a2eadb4afd946148b613 • ios            • iOS 14.7.1 18G82
    • macOS (desktop)      • macos                                    • darwin-x64     • macOS 12.6.3 21G419 darwin-x64
    • Chrome (web)         • chrome                                   • web-javascript • Google Chrome 114.0.5735.198

[✓] Network resources
    • All expected network resources are available.

• No issues found!

Dart Version
3.0.6
Steps to Reproduce

Set dio.options.responseType = ResponseType.json;
Request to GET data from API

Expected Result
Response produce null result
Actual Result
Response is String with "" value

The response will be null if your content-type is defined as application/json in your response header.

If Response type is application/json - DioError.Response.Data is coming null


Slow energy calculation

In dimod 0.10.7:
In [1]: import numpy
   ...: import dimod
   ...:
   ...: bqm = dimod.generators.anti_crossing_clique(150)
   ...:
   ...: arr = numpy.zeros((50000, len(bqm.variables)), dtype=numpy.int8)
   ...: var = list(bqm.variables)
   ...:
   ...: samples_like = dimod.as_samples((arr, var))
   ...:
   ...: %timeit energies = bqm.energies(samples_like)
   ...:
9.46 s ± 106 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

In dimod 0.9.16:
In [1]: import numpy
   ...: import dimod
   ...:
   ...: bqm = dimod.generators.anti_crossing_clique(150)
   ...:
   ...: arr = numpy.zeros((50000, len(bqm.variables)), dtype=numpy.int8)
   ...: var = list(bqm.variables)
   ...:
   ...: samples_like = dimod.as_samples((arr, var))
   ...:
   ...: %timeit energies = bqm.energies(samples_like)
   ...:
1.15 s ± 17.7 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

For perspective how slow this is, in dimod 0.9/0.10, using AdjVectorBQM:
In [1]: import numpy
   ...: import dimod
   ...:
   ...: bqm = dimod.AdjVectorBQM(dimod.generators.anti_crossing_clique(150))
   ...:
   ...: arr = numpy.zeros((50000, len(bqm.variables)), dtype=numpy.int8)
   ...: var = list(bqm.variables)
   ...:
   ...: samples_like = dimod.as_samples((arr, var))
   ...:
   ...: %timeit energies = bqm.energies(samples_like)
   ...:
368 ms ± 11.5 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

I guess this partially explains https://github.com/dwavesystems/dwave-cloud-client/issues/487 as well.

Indeed, though in that case the python object creation has more of a (constant) effect. E.g.
import time

import dimod
import numpy as np

num_trials = 5

bqm = dimod.generators.anti_crossing_clique(150)

adj = dimod.AdjVectorBQM(bqm)

t = time.perf_counter()
for _ in range(num_trials):
    for _ in adj.iter_quadratic():
        pass
print('adjvector', time.perf_counter() - t)

t = time.perf_counter()
for _ in range(num_trials):
    for _ in bqm.iter_quadratic():
        pass
print('new bqm  ', time.perf_counter() - t)

the difference is
adjvector 0.0030581199999915043
new bqm   0.003743052999993779

not insignificant, but not quite as bad as in energy calculation which is done entirely at the cython level.


Azure 1st Party using Workload Identity get AADSTS700222 Error

we are 1st Party of Azure ,and we have followed the installation guide at the quick start
https://azure.github.io/azure-workload-identity/docs/quick-start.html

we need to use AAD App a workload deployed on East Asia. since EA does not support User Assigned MI , we must use AAD App.
during the quick-start guide we follow the path of creating against AAD App.
once the pod is up and running we can see the following environment variable :

      AZURE_FEDERATED_TOKEN_FILE:  /var/run/secrets/azure/tokens/azure-identity-token
      AZURE_AUTHORITY_HOST:        https://login.microsoftonline.com/

since we know that according to this article if the issuer is *.login.microsoftonline.com
then the scenario is not supported.
we want to know how can we change the AZURE_AUTHORITY_HOSTS as this is not configurable during the quick-start guide.
Steps To Reproduce

follow the quick start guide as 1st Party

Expected behavior

we want to know how can we change the AZURE_AUTHORITY_HOSTS as this is not configurable during the quick-start guide.

Logs
E0330 21:23:35.283457       1 main.go:60] "failed to get secret from keyvault" err=<
        FromAssertion(): http call(https://login.microsoftonline.com/33e01921-4d64-4f8c-a055-5bdaffd5e33d/oauth2/v2.0/token)(POST) error: reply status code was 400:
        {"error":"invalid_request","error_description":"AADSTS700223: Only AAD-issued tokens may be used for first-party application federated identity flows.\r\nTrace ID: 15b62857-4f8b-4501-986d-1c4230750400\r\nCorrelation ID: 5b4fdabf-14c2-4c7b-b401-62c4f8d65d73\r\nTimestamp: 2023-03-30 21:23:35Z","error_codes":[700223],"timestamp":"2023-03-30 21:23:35Z","trace_id":"15b62857-4f8b-4501-986d-1c4230750400","correlation_id":"5b4fdabf-14c2-4c7b-b401-62c4f8d65d73","error_uri":"https://login.microsoftonline.com/error?code=700223"}
 > keyvault="https://vi-prod-map-ea-kv.vault.azure.net/" secretName="HelloSecret"

Environment

Kubernetes version (use kubectl version): 1.25.5
Cloud provider or hardware configuration: Azure / 1st Party Tenant
OS (e.g: cat /etc/os-release): Linux
Network plugin and version (if this is a network-related bug): kubenet
Others: Region : East Asia

Additional context

is there a way during the creation of the AAD App that we can change the Authority Host ?
we simply follow the getting-started guide and it says nothing about how to change this URL
I guess this is inhertied from the Directoy you are assigned to .
if this is true : does it mean that we as 1st Party cannot use this feature with AAD Apps ?

There is no change required in WI here and there is already an internal thread for this. Closing this issue to avoid duplication.


Documentation that contains hyperlinks with different URLs but the same description text all render as the same URL

Despite the fact that the service definitions (for example the SES service definition) contain documentation strings with links where the link name is the same and the URLs are different, those documentation strings render through Sphinx all with the same URL.
Here's an example
In the SES service definition, the documentation string for the CloneReceiptRuleSet method contains this content
"
Creates a receipt rule set by cloning an existing one. All receipt rules and configurations are copied to the new receipt rule set and are completely independent of the source rule set.

For information about setting up rule sets, see the Amazon SES Developer Guide.

This action is throttled at one request per second.
"

Where the link for Amazon SES Developer Guide points to the url http://docs.aws.amazon.com/ses/latest/DeveloperGuide/receiving-email-receipt-rule-set.html
However, when you go and look at the Sphinx rendered documentation for the CloneReceiptRuleSet method, the resulting link doesn't point to http://docs.aws.amazon.com/ses/latest/DeveloperGuide/receiving-email-receipt-rule-set.html but instead to http://docs.aws.amazon.com/ses/latest/DeveloperGuide/easy-dkim-dns-records.html
All links on the page that have a link name of Amazon SES Developer Guide point to http://docs.aws.amazon.com/ses/latest/DeveloperGuide/easy-dkim-dns-records.html despite the fact that throughout the documentation strings in the service definition, the Amazon SES Developer Guide links point to many different URLs.

Thanks for letting us know.  Looks like a bug in our doc generation process.  We're assuming that the link keys are unique.  In the raw rst we have:
    For information about setting up receipt rule sets, see the `Amazon SES Developer Guide`_ .

and then elsewhere in the document:
.. _Amazon SES Developer Guide: http://docs.aws.amazon.com/ses/latest/DeveloperGuide/easy-dkim-dns-records.html

We keep a map of link title -> href, which doesn't work when the same link text is used for multiple links.
We'll get this updated.


scp does not allow for 2 factor authentication

What steps will reproduce the problem?
1. scp into server
2. enter correct password
3. login fails

What is the expected output? What do you see instead?
expected output is for a server prompt box to pop up with the server message
asking how you want to proceed

What version of the product are you using? On what operating system?
<IP_ADDRESS>, windows server 2008 r2

Please provide any additional information below.
login flow:
ssh -> password -> 2factor

output from ssh session:

Using username "username".
Access denied
Using keyboard-interactive authentication.
Duo two-factor login for username

Enter a passcode or select one of the following options:

 1. Duo Push to XXX-XXX-1830
 2. Phone call to XXX-XXX-1830
 3. SMS passcodes to XXX-XXX-1830

Passcode or option (1-3): 1
Success. Logging you in...
Last login: Tue May 28 10:05:41 2013 from vs-remotehost.example.com
Kickstarted on 2012-05-21
[username@vs-hostname ~]$

Attached is a screenshot of how winscp looks during the login process

Original issue reported on code.google.com by<EMAIL_ADDRESS>on 28 May 2013 at 3:24
Attachments:

[initial setup.png](https://storage.googleapis.com/google-code-attachments/superputty/issue-330/comment-0/initial setup.png)
[sanitized server prompt.png](https://storage.googleapis.com/google-code-attachments/superputty/issue-330/comment-0/sanitized server prompt.png)

Closing this issue but all hope is not lost! We still want to help.
See: https://github.com/jimradford/superputty/wiki/Legacy-Imported-Issues on how to help us to help you!


uradar is outside an if statement it isn't getting registered.

input :
ubind(@mega)
uradar(enemy,any,any,true,distance,e)
if e
if e === null
pass
else
if distance < 25
target(e.x, e.y, true)
print("state: attacking,")
end
end
end
result :
ubind @mega
jump 11 notEqual e true
jump 4 notEqual e null
jump 10 always 0 0
jump 10 greaterThanEq distance 25
sensor __tmp7 e @x
sensor __tmp8 e @y
ucontrol target __tmp7 __tmp8 true 0 0
print "state: attacking,"
plus if you put uradar in a if statement it outputs this
uradar enemy any any true distance e __tmp0
jump 12 notEqual __tmp0 true
in uradar adding __tmp0 is invalid.

It was because I didn't enter it right


Question: brew package of goto is out of date

Hi, brew version is old :)
brew info goto
goto: stable 2.0.0

the current version is : goto version 2.1.0
who is maintaining the brew package? @iridakos you? I'm planning to add a sort feature :) using it locally :) and configurable... looking forward to seeing an update on brew
bronxwhq ................... /Users/vigo/Development/BronxWHQ
download-test1 ............. /Users/vigo/DownloadsTest1
download-test2 ............. /Users/vigo/DownloadsTest2
download-test3 ............. /Users/vigo/DownloadsTest3/_new
downloads .................. /Users/vigo/Downloads
dropbox .................... /Users/vigo/Dropbox
go-company1 ................ /Users/vigo/.local/gopackages/src/github.com/company1
go-mod-cache ............... /Users/vigo/.local/gopackages/pkg/mod
go-projectx ................ /Users/vigo/.local/gopackages/src/github.com/projectx
go-src ..................... /Users/vigo/.local/gopackages/src/github.com
go-vigo .................... /Users/vigo/.local/gopackages/src/github.com/vigo
open-source ................ /Users/vigo/Development/OpenSource
projectx ................... /Users/vigo/Development/projectx
textmate-bundles ........... /Users/vigo/Library/Application Support/TextMate/Bundles
textmate-bundles-powertools  /Users/vigo/Library/Application Support/TextMate/Bundles/PowerTools.tmbundle
vbyazilim .................. /Users/vigo/Development/vbyazilim
vbyazilim-website .......... /Users/vigo/Development/vbyazilim/vbyazilim.com
vigo-ugurozy-website ....... /Users/vigo/Development/vigo/ugur.ozyilmazel.com

https://github.com/iridakos/goto/pull/67

https://github.com/iridakos/goto/pull/67


Is this library being maintained or looking for maintainers?

I am using this library at my company and there are a few fixes we will be doing internally, and I would like to know if it is worth it creating PRs since I'm unsure if the current owner is maintaining it.

Also wondering this. If it's not being maintained and you end up forking it and fixing a few of the big issues please direct us to your fork! I really like the style of this lib as shown on the demo page but can't get it working like that with the repo.

Same here, if you end up forking let us know

I just noticed that there was a merge yesterday by @diegodurrod.
@diegodurrod would you be able to answer this issue? I'm currently creating a Gantt lib based on this library, and I would rather have it incorporated here instead of having it split. I'm mainly improving the code and fixing some bugs

Hello @kaiomagalhaes ,
I'm not maintain this library, but, I thought the same as you: I'm creating a custom Gantt chart based on Frappe Gantt and I found some bugs in the code. I forked this library and I created a PR with the bugfixes, the bugfixes was accepted by Frappe team and merged it to master branch.
Cheers


⚠ Bofrost.be has degraded performance

In 48cb618, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1915 ms

Resolved: Bofrost.be performance has improved in aec3fb9.


build: drop support for Node 6

I do have a "TODO" in this change.
I plan to complete all work for dropping Node 6 support by EOD, and plan to release the agent on Monday.

Closing this.
I'm planning to fix current continuous test failures with Node 6, and then I'll remove node 6 kokoro tests more gracefully.


CSS changes for localization fixes

Adds max-width to purple eyebrow offer text on pricing-cards while preserving price and CTA alignment throughout the pricing cards.
Adds left alignment to h2 at top of cards.

Resolves: MWPW-154130
Test URLs Eyebrow Changes:

Before: https://www.stage.adobe.com/fr/express/pricing?country=fr
After: https://pricing-locale--express--adobecom.hlx.page/fr/express/pricing?country=fr

Test URLs Left Alignment Changes

Before: https://www.stage.adobe.com/jp/express/pricing?country=jp&tab=3
After: https://pricing-locale--express--adobecom.hlx.page/jp/express/pricing?country=jp&tab=3

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 38.38%. Comparing base (9809b54) to head (f23a46d).
Report is 326 commits behind head on stage.

Additional details and impacted files
@@            Coverage Diff             @@
##            stage    #1020      +/-   ##
==========================================
+ Coverage   37.29%   38.38%   +1.09%
==========================================
  Files         131      117      -14
  Lines       25879    24891     -988
==========================================
- Hits         9652     9555      -97
+ Misses      16227    15336     -891

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Fixed links on all list views.

Changed code that sets url back to the way it was in erb file, check value of @showlinks to be false explicitly.
Issue #1571
@dclarizio please review/test
check for url to be set in erb file used to be
<% if @showlinks == false %>
<% url = nil %><%# disabling link in grid %>
<% else %>
<% url = view_to_url(view, @parent) %>
<% end  %>
We need to look into these checks more closely when we refactor list views.

Verified fix, awaiting Travis.


Style Guide

We should consider refactoring existing code into a certain style guide, say PEP 8. PyCharm should do this for us in most of the cases.

202cce747c6c687aa9aefbb422ddb8155f6021d4

We also need to improve exception handling and start annotating types.


fix slow boost build in travis

boost build is really slow and times out with xcode8
upgrading to a newer xcode fixes the problem
the previous try to split the boost build/upgrade
into a separate step was not enough #1821

In case this is still slow we could experiment with some options seen here: https://formulae.brew.sh/formula/boost
Maybe --without-single or --without-static would decrease the compile time?

--c++11 flag could also influence the build time.


setup idea missing

Installing ktorbase
Opening project in IntelliJ

--> Missing run configurations in IntelliJ and no script to add them

There is no longer a need for the setup-idea script as intelliJ detects the run-configurations from the .run.xml suffix.


Allow all interp methods in typing

Follow up from #6637.

Was just a typo @headtr1ck right? I'm not missing something?

Was just a typo @headtr1ck right? I'm not missing something?

I was not sure about that when I started the typing additions. I took the ones listed in the docstring.
But if mypy does not complain and the underlying functions support that it should be fine.
Thats the nice thing about typing ;)

@Illviljan you should enable pre-commit hooks :)

pre-commit hooks doesn't play nicely with Github Desktop, so that's why I don't use it.


Add support for Wildcard Routes

Enables you to match an entire subtree to a single function rather than requiring multiple route definitions.  We have a number of services which 'own' everything in a sub tree an have quite a substantial list of routes internally.  By using a wildcard route we can just blindly send everything off to the relevant service, rather than having to have each sub-app's routes defined in both lua and the underlying app.
r:match('GET', '/api/news_feed/*everything', function(params)
  -- proxy everything under /api/news_feed to the news_feed service
  ngx.exec("@news_feed")
end)

@NZKoz this looks great! We definitely want this functionality.
Let me check it it would make sense to introduce another keyword to mount whole subtree over using star. Star could have different meanings like just current routes without slash or something like that. Please push me if I don't respond in few days.

I took the syntax from the rails router and emulated the behaviour we actually need is to route entire subtrees over.  However we could find ourselves needing:
/api/1.0/news_feed/spam/enable => main monolith app
/api/1.0/news_feed/*whatever => news feed service

But for now I'd survive with this as is.  We'll likely roll this branch into production over the next week or two and see how it goes

Rails has also mount which mounts another app to a path. How that would work?
Unfortunately we store every method in own table, so there is no easy way of saying all methods going to this path are using this.
When using the wildcard you would have to copy the route for every method and to me it seems as duplication that should not be there. You dont have this problem?

We do have that problem, but it's pretty minor.  Most of our stuff falls through to a big monolith and it's just the high-load read endpoints (GET) that get routed in lua.
The only way to emulate rails' syntax would be to emulate our implementation, where you store routes as a linear list that's evaluated one at a time (modulo some smarts to skip ahead when there are known prefix-misses).  That'd make some of our cases easier for sure, but was a bigger change than I was prepared to hack up given the relatively minor cost of the dups to us.

@NZKoz makes sense. Let me add a test case to support /path/* and I'll merge it soon.

any news on this?

I'm not working on this or have time to do so. But the change looks good, so mergin!


Implement emoji endpoints

As per https://github.com/hammerandchisel/discord-api-docs/pull/373, it looks like bots will now be able to control guild emojis.

Will implement tomorrow, if I get to it. Else this weekend.

No, don't do that yet. Let's wait until they push them to docs.

It's not in yet? Will wait

this has been merged for a while now

Where?

sorry, i meant the docs.
https://discordapp.com/developers/docs/resources/emoji

@NaamloosDT it is time

Tomorrow c:

@NaamloosDT Nice

"Tomorrow"
Sorry :'(


Outline won't highlight corresponding function entry when clicking inside C function body in editor

Outline won't highlight corresponding function entry when clicking inside C function body in editor, while the status bar at the bottom can show the corresponding function prototype in its C/C++ Navigation.
If vscode can deal with big files and provide both file and project wide outlines (symbol lists) with performance as good as Source Insight, it can replace the later source code editor for lots of people on more operating systems.

VSCode Version: 1.27.2
OS Version: macOS 10.14
Extension: ms-vscode.cpptools

@linuxjh you are talking about the breadcrumb right?

hi @bpasero

is it related to the so called language server protocol implementation?
when will it be completed?


MODE-2401 Added support for handling mixins which have the "noquery" type attribute

Also, updated the code to reflect the differences between the noquery types and the previously existing ModeShape $queryable document attribute which has a different semantic: the first are defined by the JCR spec while the second were introduced internally by ModeShape to avoid indexing entire branches in the system area. After that, their semantics was exposed to the connectors as well.

Looks good.

Question: it seems from looking at the code that a node will not be indexed when either the primary type has noquery set, or one of the mixins has noquery set. Wouldn't it be more complete to not index the node as the type which has noquery set and perhaps exclude the attributes from the mixin. I understand this would be a lot more complex. Also I don't know what the JCR spec says about the noquery attribute.

Wouldn't it be more complete to not index the node as the type which has noquery set and perhaps >exclude the attributes from the mixin. I understand this would be a lot more complex.
I don't understand what you mean. A node is indexed as a whole; you also need to keep in mind that mixins are dynamic - you can add and remove them at runtime and therefore the node has to behave accordingly.

Also I don't know what the JCR spec says about the noquery attribute
The only thing that the spec says is that if noquery is present on a node type, that node type should be queryable

Nevermind, I think the current approach is the way to go. I was thinking the query/noquery attribute could be set differently on different mixins (or primary types), thus preventing a node which has two mixins set, one with and one without noquery to not be found using the query on the node which does not have noquery set.
The noquery attribute is primarily used for performance gain, I'm guessing, so letting noquery take precedence seems like the right approach.

I'm going to add another comment, however this is probably not the right place for the discussion. Currently the attribute noquery implemented in Modeshape is more aptly described as not indexing the node type. This is the behaviour I would like to see and I am very glad with this commit. However, other users might want to have noquery behave like that, in a sense, just to not be able to query that kind of node, but still having it indexed as another node type. However, I don't see any specific use cases for this at the moment. Does anyone know of any benefits other than not indexing a node (and saving resources) when setting noquery?
Thanks.

However, other users might want to have noquery behave like that, in a sense, just to not be able to query that kind of node, but still having it indexed as another node type.
I'm not sure I follow: the semantics of noquery is pretty clearly defined in the JCR spec. ModeShape is a JCR  implementation. The fact that ModeShape 4 chooses to expose different types of indexes, is purely an internal implementation details.

Let's say we have
[mix:a] mixin query
[mix:b] mixin noquery
If I create a node which has both mixins, I would not be able to find it querying [mix:a]. I do not mind this, but perhaps others might?

You should not be using these mixins on the same node in the first place; it doesn't really make sense.
One should design their node schema accordingly...

Good point. :+1:

@hchiorean @rhauch
Could you point me into the right direction on where to document the behavior of noquery in Modeshape. Perhaps in other implementations a situation as I described above will produce results when querying [mix:a], so it is good to have this documented.
The docs.jboss.org website pages seem a little broken by the way. I see Unknown macro: {space-metadata-from} everywhere.

as mentioned previously, noquery is not ModeShape specific but defined by the JCR spec: http://www.day.com/specs/jcr/2.0/25_Appendix.html#25.2 Compact Node Type Definition Notation

/* If 'query' is present then the node type is queryable. If 'noquery' is present then the node type is not queryable. If neither query nor noquery are present then the queryable setting of the node type is a variant. */
Query ::= ('noquery' | 'nq') | ('query' | 'q' )

variant = up to the implementation, not mandated by the spec. In ModeShape's case everything is queryable, unless noquery is defined.

I know this, but it seems like a good idea to document what happens if both are assigned, no?

we can document this, but assigning both at the same time is a clear indication that the client code "doesn't know what it's doing".


Adding fixed events for buildctl

Adding Fixed Advisory GHSA-45x7-px36-x8w8 for buildctl
Adding Fixed Advisory GHSA-7ww5-4wqc-m92c for buildctl
Adding Fixed Advisory GHSA-8pgv-569h-w5rw for buildctl
Adding Fixed Advisory GHSA-2wrh-6pvc-2jm9 for buildctl
Adding Fixed Advisory GHSA-4374-p667-p6c8 for buildctl
Adding Fixed Advisory GHSA-m425-mq94-257g for buildctl
Adding Fixed Advisory GHSA-qppj-fm5r-hxr3 for buildctl

added here https://github.com/wolfi-dev/advisories/pull/1043


Aggregated metrics sometimes are not correct

In some rare cases aggregated metrics are much less then sum() of its components.
This caused when carbon-aggregator sends the same metric/timestamp to carbon-cache more then once with different values (partially collected and then final value), these values queued by carbon-cache, fetched from queue by one pop() call, and stored by one whisper.update_many() call. Whisper sort these datapoints by timestamps, and it's possible that within the same timestamp earlier (partial) aggregated metric will be stored in wsp file instead of final value.
Using branch 0.9.x.
Proposed patch:

--- lib/carbon/cache.py.orig	2013-04-01 07:10:51.000000000 +0000
+++ lib/carbon/cache.py	2013-05-29 03:55:10.000000000 +0000
@@ -64,5 +64,6 @@
     elif not metric and self.method == "sorted":
       metric = self.queue.next()
-    datapoints = (metric, super(_MetricCache, self).pop(metric))
+    # Save only last value for each timestamp
+    datapoints = (metric, sorted(dict(super(_MetricCache, self).pop(metric)).items(), key=lambda x:x[0]))
     return datapoints

Is the the problem brought by @genisd addressed by fix #240? It seems not.

I met another issue, related to this one: I have two sum aggregators, let's say aggregatorA, and aggregatorB, the aggregated result by aggregatorA will be passed to aggregatorB as the input.
And we have 60k metrics per second sent to aggregatorA from 6 nodes, which causes aggregatorA's cpu usage closed to 100%, and the same metric/timestamp will be handled by aggregatorA at different time(I guess this is caused by the 100% cpu usage), so aggregatorA will do several aggregate operations, let's say twice aggregations, the result are: first time, timestamp: t0, value: 10; second time, timestamp t0, value: 15. And we know that 15 the correct result, and it works well if we send the results to carbon-cache, with fix #240 , but the problem comes out when we send the results to aggregatorB, as for aggregatorB, it will receive both these two metrics generated by aggregatorA, and it will sum those two results together as aggregatorB's result, which is 25, in this case, but what we wanted is 15.
The reason why we use two aggregators is that, there are so many metrics received per second, and we have 3 fields need to be aggregated, so we want to aggregate one field first, and only keep the first aggregated result as the input for the second aggregator, so there are much less metrics need to be handled by the second aggregator.
Thanks for any suggestions!

in which version is this fix contained?

@svenmueller - IMO only 0.9.13-pre1 - https://github.com/graphite-project/carbon/releases/tag/0.9.13-pre1


Passive scalar issue with AMR

Hi Folks,
I have an issue that I first noticed in my own problem and have since been able to reproduce (though to a somewhat less extreme extent) in the blast with hydro.
It stems from using adaptive refinement with passive scalars.  I think that when meshblocks are de-refined, their boundaries seem to introduce incorrect values of the scalar concentration.
To reproduce I modified the blast problem by introducing a single passive scalar. I commented the changes to blast.cpp (attached) with "MM": blast_scalar.cpp.txt (rename -> .cpp)
I configure with:

python configure.py --prob blast_scalar --coord spherical_polar --flux hllc -mpi -hdf5 --hdf5_path /opt/local --cxx g++ --nscalars=1

And I run with the following input file, which increases the number of AMR levels and changes the threshold for refinement vs the default.
athinput.blast_sph.txt
(again, remove the .txt)
I read into a python notebook as follows:

import matplotlib.pyplot as plt
import numpy as np
import athena_read as ar
%matplotlib inline
d = ar.athdf("/Users/morganmacleod/DATA/athenaruns/blast/scalar/Blast.out1.00001.athdf")
plt.figure(figsize=(8,8))
th_ind = int(d['rho'].shape[1]/2)
rr,pp = np.meshgrid(d['x1v'],d['x3v'])
plt.pcolormesh(rrnp.cos(pp),rrnp.sin(pp),d['r0'][:,th_ind,:])
plt.colorbar(label='r')
plt.xlabel('x')
plt.ylabel('y')
plt.axis('equal')

To generate the following:

What I see here, is that in the interior of the "bubble" where the mesh has de-refined, along the boundaries there are some artifacts introduced.
When I ran this with my own problem (which unfortunately requires other customizations of athena) I was encountering values of r-> 1e20 ! But I haven't been able to reproduce that extreme behavior in the blast problem -- I thought that this, based on the unmodified public repo, was probably a more useful case.
With a fixed mesh, for example, we see no artifacts in the scalar concentration:

Thanks for the help & insight.
Morgan

Sounds like a bug in the derefinement operator applied to the passive scalars--- to confirm it is not a more general problem, can you try running with a very high derefine_count to effectively disable derefinement?

There may well be an issue, but can we confirm this is not a plotting artifact relating to mesh refinement (static or adaptive)?
For quantities that vary in the direction off the plane of the slice, one generally sees weird things in plots. The problem is the data reader is casting everything onto the finest grid, so the cell that gets plotted will have a distance from the plotting slice that varies depending on refinement level. The highest refinement levels are plotting the cells that are right next to the midplane here, while the lower refinement levels are essentially plotting cell quantities that are volume-averaged over a volume that extends further from the plotting plane.
One way to test this is to cast the data to the lowest refinement level in the read step (level=0).

@felker, @c-white Thanks for both of these thoughts. I need to do a little more experimenting to confirm everything. More soon.

A little bit more progress to report:
Because @c-white 's  point about plotting is well taken I tried two things (in addition to the test that Kyle mentioned) --

Cartesian coordinates
printing values directly (skipping the plotting step)

I was looking at the maximum value of the scalar concentration at t=0.1 in the blast problem (initializing a scalar r=1 within the region of amplified pressure)
Spherical Polar Coords:
Fixed mesh r_max  = 1.0
SMR                         = 1.0
AMR (refine only)  = 1.085
AMR                       = 1.16
Cartesian Coords:
Fixed mesh r_max = 1.0
SMR                        = 1.0
AMR (refine only)  = 1.0013
AMR                        = 1.0046
To me, this suggests a couple of things: the issues I am seeing with artifacts has to do with AMR in spherical polar but not exclusively with derefinement, as I originally was speculating above.
For reference, here's an SMR example of the equivalent of the earlier spherical polar images.

and here is AMR, but with derefine_count = very large

Would definitely appreciate advice on where to go from here.
Thank you!
Morgan

Now that I think about it, I cannot recall if AMR+curvilinear coordinates with passive scalars has actually ever been tested.
There might be a bad assumption in the coupled prolongation/restriction of the mass fluxes and scalar concentration in the presence of curved geometries...

Edit! I just tried cartesian again, and when I make the meshblock smaller (4x4x4), which is identical to what I was doing in spherical polar, I get scalar concentrations ~1.07.
In other words, I'm also getting similar behavior in cartesian coordinates as spherical polar. Here's an image.

Sorry for the false lead above.
Morgan

Does it occur with larger meshblocks?

Yes, the occurrence of scalar concentrations well-above 1.0 (ie not in the the 10th decimal or something) happens with different size meshblocks. With larger meshblocks, the accumulated maximum departure from 1.0 is less, with smaller meshblocks it is further.  Re: my comments above, I had tested cartesian and spherical polar with different size meshblocks originally. It seems that the artifacts have to do with when meshblocks are refined/derefined because they don't arise in SMR, and they are exacerbated by smaller meshblocks which leads to more create/destroy counts over the course of the simulation.

@morganemacleod which reconstruction method and time integrator were you using for this problem?

@dfielding14 can you add the details of your similar problem here?

Hi @felker, from the input file in the first comment it looks like this was with VL2 for time integration and xorder=2 for reconstruction. I am happy to revisit this if there's any more information it would be helpful to provide.
Thank you for checking it out!

@felker @morganemacleod
Around the time when Morgan first raised this issue I was having the same scalar artifacts at grid boundaries when using AMR. I looked at it again recently and found that it was mysteriously no longer an issue. I didn't question why this was and assumed that some new PR had fixed the problem. Then last week it started appearing again when using the same version and an otherwise identical pgen. I realized that the only thing that had changed was I went from VL2 to RK2, so I switched back to VL2 and the problem went away. Kyle and I suspected that maybe you were using RK2, but I guess not. One other empirical finding which may or may not be relevant is that I did not see the artifacts when using 4 or less levels, but when I used 5 or more they appeared.

Ok, I ran @morganemacleod's problem (Cartesian version; problem generator needed a fix in order to compile with the latest development version). Fortunately the violation occurs within the first few timesteps:
➜  bin git:(master) ✗ mpirun -np 4 ./athena -i athinput.blast_sph
### Warning in Mesh::Initialize
The number of MeshBlocks increased more than twice during initialization.
More computing power than you expected may be required.
### Warning in Mesh::Initialize
The number of MeshBlocks increased more than twice during initialization.
More computing power than you expected may be required.
### Warning in Mesh::Initialize
The number of MeshBlocks increased more than twice during initialization.
More computing power than you expected may be required.
### Warning in Mesh::Initialize
The number of MeshBlocks increased more than twice during initialization.
More computing power than you expected may be required.

Setup complete, entering main loop...

cycle=0 time=0.0000000000000000e+00 dt=4.5927932677179836e-04
cycle=1 time=4.5927932677179836e-04 dt=4.3043818542762763e-04
cycle=2 time=8.8971751219942604e-04 dt=4.0912919914355250e-04
Conserved scalar exceeds 1.0; s(0,3,3,4) = 1.0000000002925664e+00
Conserved scalar exceeds 1.0; s(0,3,5,3) = 1.0000000005112657e+00
Conserved scalar exceeds 1.0; s(0,5,5,3) = 1.0000000009720036e+00
Conserved scalar exceeds 1.0; s(0,5,3,5) = 1.0000000025912912e+00

I have now set derefine_count = 5000000. If numlevel=2, no violation occurs (at least in the main flux divergence update). If numlevel=3:
Setup complete, entering main loop...

cycle=0 time=0.0000000000000000e+00 dt=9.1855865354359672e-04
cycle=1 time=9.1855865354359672e-04 dt=8.6049816189081826e-04
cycle=2 time=1.7790568154344151e-03 dt=8.1779806841855989e-04
Conserved scalar exceeds 1.0; s(0,2,2,3) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; s(0,5,2,3) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; s(0,2,3,4) = 1.0000000008763485e+00

Getting closer. I stopped using MPI just to make things easier, and I put traps specific to this problem around the passive scalar variable inversion. The discrepancy starts in the first timestep (specifically during the VL2 corrector stage, but not for RK1, e.g.) for a subset of the 416 MeshBlocks. Specifically, it is detected in the time_integrator.cpp CONS2PRIM task's call of PassiveScalarConservedToPrimitive(), as opposed to the calls in the earlier PROLONG task:
In time_integrator.cpp, about to call PassiveScalarConservedToPrimitive
In W(U): gid, lid = 318,318
Primitive scalar exceeds 1.0; r(0,2,0,5) = 1.0000000000000002e+00
s_n, d, di = 9.1678411858229703e-01, 9.1678411858229691e-01, 1.0907693313300268e+00
In W(U): gid, lid = 318,318
Primitive scalar exceeds 1.0; r(0,3,0,0) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In W(U): gid, lid = 318,318
Primitive scalar exceeds 1.0; r(0,3,0,3) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In W(U): gid, lid = 318,318
Primitive scalar exceeds 1.0; r(0,3,4,4) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In W(U): gid, lid = 318,318
Primitive scalar exceeds 1.0; r(0,3,7,4) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In time_integrator.cpp, after calling PassiveScalarConservedToPrimitive
In time_integrator.cpp, about to call PassiveScalarConservedToPrimitive
In W(U): gid, lid = 319,319
Primitive scalar exceeds 1.0; r(0,2,0,1) = 1.0000000000000002e+00
s_n, d, di = 9.1678411858229703e-01, 9.1678411858229691e-01, 1.0907693313300268e+00
In W(U): gid, lid = 319,319
Primitive scalar exceeds 1.0; r(0,3,4,0) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In W(U): gid, lid = 319,319
Primitive scalar exceeds 1.0; r(0,3,7,0) = 1.0000000000000002e+00
s_n, d, di = 9.5653528244209285e-01, 9.5653528244209274e-01, 1.0454397431602724e+00
In time_integrator.cpp, after calling PassiveScalarConservedToPrimitive

Awesome, thank you @felker for your digging on this!

Ok, I think I am going to have to give up on this soon. Spent a few hours yesterday chasing down a red herring that caused the above deviation from r=1.0 by 1 unit in the last place (ULP). That can be avoided if you change
https://github.com/PrincetonUniversity/athena-public-version/blob/90a6eb956183b257e33d149463996fe569c8ae3d/src/eos/eos_scalars.cpp#L49
to r_n = s_n/w_d. We should probably make this change, since the additional rounding operation from storing di=1.0/w_d can prevent the ratio of conserved scalar to conserved fluid density from being exact.
But, that does not fix the larger violations of the passive scalar maximum with AMR. Those are showing up between cycle=2 and cycle=3 with the provided input file, changing numlevel=3 and compiling for Cartesian coordinates, specifically:
make clean; python configure.py --prob blast_scalar --flux hllc -hdf5 --cxx g++ --nscalars=1 --hdf5_path=/Users/felker/hdf5-serial/ -h5double; make -j

The violation is relatively large:
MeshBlock: gid = 87, LogicalLocation.level = 5
Conserved scalar exceeds 1.0 in add_scalar_flux_divergence.cpp; s(0,5,2,4) = 1.0000000008766579e+00

This problem might also happen with SMR, since I disabled derefinement and commented out the following line in main.cpp:
pmesh->LoadBalancingAndAdaptiveMeshRefinement(pinput);

So all the levels and new MeshBlocks are spawned during Mesh initialization. Although doesnt rule out the possibility that the initial prolongation introduces artifacts that cause the problem in later cycles?
I could give debugging this another try if we had an even simpler reproducer, ideally a 2D problem with only numlevel=2 where a violation can be detected on the first cycle. Thoughts @tomidakn, @morganemacleod, @jmstone, @c-white ?
Also, another hint is that the violations seem to occur in or near the lower ghost cells in x1, x2, x3. Since the MeshBlocks are 4^3, and NGHOST=2, the ghost cells have at least one of the indices i, j, k equal to 0, 1, 6, 7. Here are all the violations detected in between cycle=2 and 3 in the above problem:
Conserved scalar exceeds 1.0; MeshBlock GID=87  level=5  s(0,5,2,4) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=101  level=5  s(0,5,5,4) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=113  level=5  s(0,2,3,4) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=113  level=5  s(0,5,5,3) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=117  level=5  s(0,2,4,3) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=117  level=5  s(0,3,3,3) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=131  level=5  s(0,2,4,4) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=131  level=5  s(0,5,2,3) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=135  level=5  s(0,2,3,3) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=135  level=5  s(0,3,4,3) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=153  level=5  s(0,4,3,3) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=153  level=5  s(0,5,4,3) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=157  level=5  s(0,2,5,3) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=157  level=5  s(0,5,3,4) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=171  level=5  s(0,4,4,3) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=171  level=5  s(0,5,3,3) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=175  level=5  s(0,2,2,3) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=175  level=5  s(0,5,4,4) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=187  level=5  s(0,2,2,4) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=201  level=5  s(0,2,5,4) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=214  level=5  s(0,5,2,3) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=228  level=5  s(0,5,5,3) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=240  level=5  s(0,2,3,3) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=240  level=5  s(0,5,5,4) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=244  level=5  s(0,2,4,4) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=244  level=5  s(0,3,3,4) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=258  level=5  s(0,2,4,3) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=258  level=5  s(0,5,2,4) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=262  level=5  s(0,2,3,4) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=262  level=5  s(0,3,4,4) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=280  level=5  s(0,4,3,4) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=280  level=5  s(0,5,4,4) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=284  level=5  s(0,2,5,4) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=284  level=5  s(0,5,3,3) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=298  level=5  s(0,4,4,4) = 1.0000000009698100e+00
Conserved scalar exceeds 1.0; MeshBlock GID=298  level=5  s(0,5,3,4) = 1.0000000009730714e+00
Conserved scalar exceeds 1.0; MeshBlock GID=302  level=5  s(0,2,2,4) = 1.0000000009361785e+00
Conserved scalar exceeds 1.0; MeshBlock GID=302  level=5  s(0,5,4,3) = 1.0000000008763485e+00
Conserved scalar exceeds 1.0; MeshBlock GID=314  level=5  s(0,2,2,3) = 1.0000000008766579e+00
Conserved scalar exceeds 1.0; MeshBlock GID=328  level=5  s(0,2,5,3) = 1.0000000008766579e+00

athinput.blast_sph_2d.txt
Here is a 2D input file, which generates the following violations between cycle=3 and 4:
Conserved scalar exceeds 1.0; MeshBlock GID=17  level=5  s(0,0,3,5) = 1.0000000000000162e+00
Conserved scalar exceeds 1.0; MeshBlock GID=40  level=5  s(0,0,4,5) = 1.0000000000000162e+00
Conserved scalar exceeds 1.0; MeshBlock GID=47  level=5  s(0,0,3,2) = 1.0000000000000162e+00
Conserved scalar exceeds 1.0; MeshBlock GID=70  level=5  s(0,0,4,2) = 1.0000000000000162e+00


block of dynamic Less gets injected as link stylesheet rather than stylesheet/less

I have

<link rel="stylesheet/less" type="text/less" href="styles/nonCacheable/sprinkler.less" />

it should create

but it creates

which breaks the dynamic less.js
Can you help?

Are you using htmlbuild.preprocess.css? That probably won't work for you. You're going to need to write your own implementation for less.
Read this code to understand how these functions work so you can write your own less-specific version of it:
https://github.com/Janpot/gulp-htmlbuild/blob/master/lib/preprocess/css.js#L19

how do i incorporate my new   blabla.js preporocessor into  your code base?

The same way as in the readme example:
const blablaPreprocessor = require('./blabla.js');

gulp.task('build', function () {
  gulp.src(['./index.html'])
    .pipe(htmlbuild({
      // build blabla with blablaPreprocessor
      blabla: blablaPreprocessor(function (block) {

        // read paths from the [block] stream and build them
        // ...

        // then write the build result path to it
        block.write('buildresult.blabla');
        block.end();

      })
    }))
    .pipe(gulp.dest('./build'));
});

awesome. thanks it worked :)


Try to eliminate the Resolver regexes

By using a delegate type that can contain either a regex or standard parsing function

Sorry, I thought you were referring to issue #4. I wasn't aware this one existed.


fix: restrict system.reactive to 3.1.1 as min but never 4.x series

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
bug fix
What is the current behavior? (You can also link to an open issue here)
Blocked by https://github.com/NuGet/Home/issues/5751
What is the new behavior (if this is a feature change)?
Fixes #1413 by bypassing NuGet issue @ https://github.com/NuGet/Home/issues/5751
What might this PR break?
Please check that I've got the syntax right -> https://docs.microsoft.com/en-us/nuget/reference/package-versioning
Please check if the PR fulfills these requirements

[ ] The commit follows our guidelines: https://github.com/reactiveui/reactiveui#contribute
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

Other information:
System.Reactive v4.x and NuGet.exe needs more time to mature. We can remove these restrictions as a point release at a later point in time. Dynamic data is currently using 3.1.1 as min but is not clamped @RolandPheasant I strongly recommend that you do the same changes. Similar changes will be applied to Akavache, Refit, Punchclock, etc.

@ghuntley,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

Coverage remained the same at 70.424% when pulling 4fbc85599fe957a7727df30816297249e4e42d9a on clamp-pkgref into 8d19db2ace827e5e29555bb4ec8075987b36b3d9 on develop.

From https://docs.microsoft.com/en-us/nuget/reference/package-versioning
<!-- Accepts 1.3.2 up to 1.4.x, but not 1.5 and higher. -->
<PackageReference Include="ExamplePackage" Version="[1.3.2,1.5)" />


TypeError :Error cannot redefine property of model already referenced

How to handle multiple fields referencing same model for example:
export default class HelpDeskIssue extends Model {
    public static modelName = 'HelpDeskIssue'
    public static fields = {
        id: attr({}),
 	Header: attr({}),
	DeveloperUserId: fk({ to: 'SystemUser', as: 'SystemUser', relatedName: 'HelpDeskIssue' }),
        TesterUserId: fk({ to: 'SystemUser', as: 'SystemUser', relatedName: 'HelpDeskIssue' }),
        ResponsibleUserId: fk({ to: 'SystemUser', as: 'SystemUser', relatedName: 'HelpDeskIssue' }),
    }
	public static reducer(action: Action<any>, entity: HelpDeskIssue, dataSession: ISession<IFrontTaskModels>) {
        	switch (action.type) {
	            case "CREATE_HELPDESKISSUE":
		}
	}
}

The HelpDeskModel contains DeveloperUserId referencing the SystemUser model which installs but when installing the TesterUserId i get the error

How to fix this ?

The as and relatedName properties need to differ for each field. Like this:
DeveloperUserId: fk({
    to: 'SystemUser',
    as: 'Developer',
    relatedName: 'HelpDeskIssuesAsDeveloper'
}),
TesterUserId: fk({
    to: 'SystemUser',
    as: 'Tester',
    relatedName: 'HelpDeskIssuesAsTester'
}),
ResponsibleUserId: fk({
    to: 'SystemUser',
    as: 'ResponsibleUser',
    relatedName: 'HelpDeskIssuesAsResponsibleUser'
}),

DeveloperUserId is the field where you put a developer's SystemUser id. If helpDeskIssue is an instance of HelpDeskIssue, then helpDeskIssue.Developer would refer to the issue's developer SystemUser. If user is an instance of SystemUser, then user.HelpDeskIssuesAsDeveloper would get you all HelpDeskIssue instances where the user is the developer.

Hope I could be of help. Closing this due to inactivity.


Remove unecessary using

@ryanbrandenburg please review and merge. Thanks!

Looks good, I'll :shipit: