Network issue with VM running on second host.

ISSUE TYPE

Bug Report

COMPONENT NAME

VPN on newly added hosts.

CLOUDSTACK VERSION

4.17.1

CONFIGURATION

OS / ENVIRONMENT

SUMMARY
I have a Zone on Cloud Stack with network configuration specified above. I also have an isolated network (<IP_ADDRESS>/16) on the Zone. I also have a VM running on Zone connected to the isolated network, via a virtual router running on Host 1.
I added a second host to the Zone as well.
However, VMs connected to the same network running on the second host cannot cannot access the internet.
VMs on the first host does have internet access and works as expected.
STEPS TO REPRODUCE

Fresh Install of Apche CloudStack 4.17.1 on ubuntu 20.04 server
Network configuration on ubuntu server - ([bridge0 -> <IP_ADDRESS>/16] & [bridge1 -> <IP_ADDRESS>/16])
Advance Zone with two Physical Network - ([Network 1 -> VLAN -> Management] & [Network 2 -> GRE -> Guest and Public])
Isolated Network in Zone 1 - <IP_ADDRESS>/16
VM1 - Isolated Network 1 - Host 1
VM2 - Isolated Network  2 - Host 2

Note: Management Server and Host 1 is running on Device A
Host 2 is running on Device B
Device A network configuration
network:
  version: 2
  renderer: networkd
  ethernets:
       enp107s0:
          dhcp4: false
       enp108s0:
          dhcp4: false
  bridges:
      cloudbr0:
          addresses: [<IP_ADDRESS>/16]
          routes:
          - to: <IP_ADDRESS>/0
            via: <IP_ADDRESS>
            metric: 100
          nameservers:
                 addresses: [<IP_ADDRESS>]
          interfaces: [enp107s0]
          dhcp4: false
          dhcp6: false
      cloudbr1:
          addresses:  [<IP_ADDRESS>/16]
          routes:
          - to: <IP_ADDRESS>/0
            via: <IP_ADDRESS>
            metric: 1000
          nameservers:
                  addresses: [<IP_ADDRESS>]
          interfaces: [enp108s0]
          dhcp4: false
          dhcp6: false

Device B network configuration
network:
  version: 2
  renderer: networkd
  ethernets:
       enp107s0:
          dhcp4: false
       enp108s0:
          dhcp4: false
  bridges:
      cloudbr0:
          addresses: [<IP_ADDRESS>/16]
          routes:
          - to: <IP_ADDRESS>/0
            via: <IP_ADDRESS>
            metric: 100
          nameservers:
                 addresses: [<IP_ADDRESS>]
          interfaces: [enp107s0]
          dhcp4: false
          dhcp6: false
      cloudbr1:
          addresses:  [<IP_ADDRESS>/16]
          routes:
          - to: <IP_ADDRESS>/0
            via: <IP_ADDRESS>
            metric: 1000
          nameservers:
                  addresses: [<IP_ADDRESS>]
          interfaces: [enp108s0]
          dhcp4: false
          dhcp6: false

EXPECTED RESULTS
Both VM1 and VM2 should have internet connectivity.

ACTUAL RESULTS

VM1 has internet connectivity, however VM2 does not.

@Atiqul-Islam
since you use GRE as isolation method, have you configured openvswitch correctly ?

@weizhouapache
Really appreciate the response.
We are using Ubuntu Bridges. I wasn't aware that OpenVSwitch is recommended for GRE.
I updated the post with my network configuration for the respective devices.
Based on the article below, it seems like Ubuntu netplan doesnt support OpenVSwitch.
https://www.shapeblue.com/networking-kvm-for-cloudstack-2018-revisit-for-centos7-and-ubuntu-18-04/
I am wondering will any of the other alternatives to GRE work without OpenVSwitch (with ubuntu bridges)?

@weizhouapache Really appreciate the response.
We are using Ubuntu Bridges. I wasn't aware that OpenVSwitch is recommended for GRE.
I updated the post with my network configuration for the respective devices.
Based on the article below, it seems like Ubuntu netplan doesnt support OpenVSwitch. https://www.shapeblue.com/networking-kvm-for-cloudstack-2018-revisit-for-centos7-and-ubuntu-18-04/
I am wondering will any of the other alternatives to GRE work without OpenVSwitch (with ubuntu bridges)?

@Atiqul-Islam
netplan supports openvswitch I think.
You can use vlan or vxlan instead of GRE.

@weizhouapache
Thank you for the response. My apologies for my late response.
Currently the system running the management server and the first host is connected to the switch via two ethernet interfaces A (<IP_ADDRESS>/16) and B (<IP_ADDRESS>/16).
Note: Both interface A and interface B is connected to an untagged port on the switch (we are using 802.1q VLAN on the switch and it only has options for tagged and untagged ports).
The ethernet interface A is used for creating cloudbr0 and the ethernet interface B is being used to created cloudbr1.
cloudbr0 is being used by the Management Network which is using isolation of type VLAN
cloudbr1 is being used by the Guest and Public Network whose isolation type is what we are discussing about.
Provided the scenario, correct me if I am wrong, based on my understanding if I used VLAN as my isolation type for the Public and Guest, I am assuming, I will need to connect ethernet interface B associated to cloudbr1 to a trunk or tagged port on the switch.
I already tried isolation of type VLAN  for the Public and Guest Network and had the same issue where VM on the second host couldn't communicate virtual router on the first host. So I am assuming interface B being connected to an untagged port on the switch was the issue.
However, if I use isolation type of VXLAN, which uses layer 3 UDP packets,  ethernet interface B associated to cloudbr1 can be connected  to an untagged to access port.
Correct me if I am wrong, provided, my assumptions are correct, I am assuming VXLAN is more likely to work with the existing switch configuration   (interface A and interface B being connected to  untagged switch ports)
Additionally, I am wondering, is there any additional configuration I have to do the system running the management server and the host or install any additional software on it.
As I did try isolation type of VXLAN for the Public and the Guest Network with VLAN isolation type for the Management Network. It seemed like, I was having internet connectivity issues on the VMs (regardless of the host they are on). I tried installing Ubuntu 20.04 server, however, the process for fetching updates from the server and downloading was very slow and would eventually crash. I am really confused as to why I was getting such behavior. I checked, the management server log, however, I didnt notice any error messages.

@weizhouapache
Thank you for confirming my assumption. You suggestion aligns with my assumptions.
I don't fully know if I understand, what you mean by the VLAN/VXLAN tag.
The VLAN IP id on the switch associated to interface B (connected to the guest and the public network) is 601
While configuring the advance zone, I left the VLAN id empty and for the public network with an ip range of (<IP_ADDRESS> to <IP_ADDRESS>)
I choose VLAN ID ranging from 100 to 200 for the for the guest network.
Note: Devices on both the <IP_ADDRESS>/16 and <IP_ADDRESS>/16 network uses range (<IP_ADDRESS> to <IP_ADDRESS>) and  (<IP_ADDRESS> to <IP_ADDRESS>) respectively.
Management network - tagged cloudbr1 - isolation type: VLAN
Public and Guest network - tagged cloudbr0 - isolation type: VXLAN
My virtual router is configured to connect <IP_ADDRESS>/16 and <IP_ADDRESS>/16 to the internet via the external network <IP_ADDRESS>/24.
I am able to access internet and ping google com from the Virtual Router in the advance zone and also from the VMs.
The issue I am having:
Trying to install Ubuntu server 20.04 (https://releases.ubuntu.com/20.04.5/ubuntu-20.04.5-live-server-amd64.iso?_ga=2.143809077.1213128030.1678795300-1783458840.1675265647
) from an iso results in all types of connection issue during the installation. In most cases updates fails or download speed is super slow to the point that the installation would crash.
I tried installing the same image on another system and it works fine.
To me it seems like, the issue is occurring due to an unstable internet connectivity, with VXLAN, even though there is internet connectivity, as I am able to ping google.com from another VM running a centos template.
This leads me to suspect, that I am probably not satisfying some prerequisites for VXLAN isolation or maybe something associated to my advance zone configuration is wrong.
Note: I have all egress rule and firewall rule open on the isolated network and the virtual router, but the issue persists.

@weizhouapache
Appreciate the help. Listed below are answers to your questions.

I am able to ping google from the CloudStack Virtual Router.
I am able to ping google from the VM I quickly spun up using the centos template that comes with cloudstack.
One of the KVM host and the Management Server is running on one physical is running on 1 bare metal physical ubuntu system, the second host is running on another baremetal physical ubuntu system.

Additional Tests I performed
Based on what I came across so far, my mtu size for  interface B (the interface associated to the VXLAN isolation) is 1500 same as the other interface which is associated to the VLAN. Do you think the mtu size of 1500 is causing the problem.
I tried configuring the mtu size of cloudbr1 to 1550, that seemed to have resolved the issue on the VM running on the same host as the virtual router, I was able to install Ubuntu there without any issues.
Issues I am having right now:
However, the issue right now is, the ubuntu installation process on the VM running on the other host is unable to connect to the internet and as a result is stuck at the curlin command. I find the behavior really weird and unexplainable as I am able to ping google.com and curl google.com from another VM with centos template running on the same host.
Note:
I am using the same ISO to install Ubuntu on both the VMs. On the VM instance (associated to the host connected to the virtual router the installation process runs fine and updates from the internet as required). In the second VM (on a separate host) the installation process is unable to connect to the internet and gets stuck.
Both the VMs are on the same network.
Something I noticed that even though I didn't explicitly mention storage network, the storage network was added to cloudbr0 along with the management network. This makes me wondering if that is causing any issue as the cloudbr0 is connected to an access or untagged port on the switch. But it seems like cloudbr0 is being used for both the management and the storage network.

@Atiqul-Islam thanks for the update.
see my replies inline.

@weizhouapache
Appreciate the help. Listed below are answers to your questions.

I am able to ping google from the CloudStack Virtual Router.
I am able to ping google from the VM I quickly spun up using the centos template that comes with cloudstack.

from what I understand, the centos template runs on the different host as the CloudStack Virtual Router, right ?

One of the KVM host and the Management Server is running on 1 bare metal physical ubuntu system, the second host is running on another baremetal physical ubuntu system.

Additional Tests I performed
Based on what I came across so far, my mtu size for  interface B (the interface associated to the VXLAN isolation) is 1500 same as the other interface which is associated to the VLAN. Do you think the mtu size of 1500 is causing the problem.

Yes, it is my suspicion. nested environments might have some issues cased by mtu size.
From what you said below, it seems mtu size caused the ubuntu installation to be stuck.

Also what is the recommended mtu size for VXLAN isolation in Cloud Stack
I tried configuring the mtu size of cloudbr1 to 1550, that seemed to have resolved the issue on the VM running on the same host as the virtual router, I was able to install Ubuntu there without any issues. However now I am having issues with VM on the second host.
Issues I am having right now: The ubuntu installation process on the VM running on the host (without the virtual router) is unable to connect to the internet and as a result is stuck at the curlin command. I find the behavior really weird and unexplainable as I am able to ping google.com and curl google.com from another VM with centos template running on the same host.

can you check the virtual router during the ubuntu installation ?

check /var/log/dnsmasq.log to ensure the ubuntu vm gets the correct IP
check if the IP is reachable (by ping)
use tcpdump to see if there are some packets during the process

since the kvm hosts are running on top of ubuntu physical server, have you configured the mtu size of the virtual nics of the kvm hosts on the physical servers ?

Note: I am using the same ISO to install Ubuntu on both the VMs. On the VM instance (associated to the host connected to the virtual router) the installation process runs fine and updates from the internet as required. In the second VM (on the host without the virtual router) the installation process is unable to connect to the internet and gets stuck. Both the VMs are on the same network.
Something I noticed that even though I didn't explicitly mention storage network, the storage network was added to cloudbr0 along with the management network. This makes me wondering if that is causing any issue as the cloudbr0 is connected to an access or untagged port on the switch. But it seems like cloudbr0 is being used for both the management and the storage network.

that's expected. If storage network is not specified, the management network will be used as storage network.

Let me know if you have any more questions, or would like to look at any network details.

@Atiqul-Islam I am closing this isseu. If you feel this is invalid please reopen or create a new one


Add ability to namespace request URLs

Is there a way to namespace request routes generated by Grape::API endpoints?
I am using grape and grape-swagger-rails inside a rails engine and the URLs generated in the swagger UI don't include that namespace.
Ex.
My engine is called BlogManager an my routes file looks like this:
mount GrapeSwaggerRails::Engine, at: "/documentation"
The problem is that in the UI the generated URLs look like these:

/api/v1/tags (GET)
/api/v1/tags (POST)

which don't have the namespace /blog_manager and the try it out button obviously fail.

The URLs should include the namespace. You should bring this up on the Grape mailing list or open an issue with a repro in grape-swagger.


Back-End Connection with Certificate UI

Fixes: #393, Fixes: #322

Replaced getIssuedCertificateByUsername with status to make the transition between 3 states more seemles

The loader is stored in a certificate to check for the current state
useRevalidator ensures that it will display components depending on the status of the certificate

Should solve issue where dns record is populated with _acme records

Demo:
https://user-images.githubusercontent.com/32577022/227579673-cbcefb3c-aa38-4b15-9102-38e01f989998.mp4

@Ririio in future, please don't land 16 separate commits, consolidate them into a single commit first by squashing.  It makes it harder to back things out if they go wrong, or to revert a bug later on.


Reorder twig files

This is the first changes in a larger set of changes that I am going to propose.

Related:

#152
#153
#154
#155
#156
#157
#158
#159
#161

Issue
Since the creation of the starter theme a lot has happened in PHP, WordPress and Timber. I want to make the starter-theme a more modern starting point for custom theme development.
Solution
This particular PR focusses on moving twig files to subdirectories for make a separation between the type of twig files.
Impact
A better, less confusing, start with templating in Timber.
Usage Changes
none
Considerations
-archive.twig is still a bit overkill, maybe we can simplify that as well by removing the parent() function

@gchtr , modified the archive.twig and did some other minor tweaks, see comments.


Export date helper

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

7 of 7 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
139

Relevant Lines:
139

💛  - Coveralls


What is meant by State of Art - Ageing?

If software is a mathematical product how can it age? If a theorem was correct 200 years ago it will be correct now.

To the above statement: There are two, quite distinct, types of software ageing. The first is caused by the failure of the product’s
owners to modify it to meet changing needs; the second is the result of the changes that are made. This
“one-two punch’ can lead to a rapid decline in the value of a software product.

As per connect session on 8th April 2021, State of art ageing i.e time, feature & cost means how a product evolved with time and how did it get better cost-wise as well as feature-wise. Will be continuing with this defination.


New docker flow

The goal is to publish FPC images to accelerate development. To achieve this I suggest the following change of our docker flow.
FPC docker
Use cases
The docker images provided in this repository target different use cases:

Used as FPC dev environment
Provides a complete development environment including Intel SGX compiler, etc...
Useful to develop and test FPC locally without installing FPC dependencies on local dev machine.
This refers to preferred option to getting started with FPC.

Used as CI environment
Based on FPC dev environment and used during Github CI.

Used as runtime environment for FPC components (FPC chaincode and ERCC)
Required to package, deploy, and run FPC chaincode.

Docker Images
FPC comes with the following docker images to build FPC components and the development environment.
All images start with hyperledger/fabric-private-chaincode- prefix.

base-rt: Base image for FPC. Includes all runtime dependencies including SGX runtime services.
ccenv: Chaincode environment image for FPC chaincodes based on base-rt.
base-dev: Base development image. Includes all build tools for FPC including protobuf, SGX SSL, SGX compiler, ...
dev: Development image based on base-dev. Add additional user-defined tools and development dependencies.

These images can be build manually (see Building images section) or pulled from ghcr.io/hyperledger/fabric-private-chaincode (see Pulling images section).
Building images

make build:
creates base-rt, ccenv

make build-dev:
creates base-rt, base-dev

Pulling images

make pull:
pulls base-rt, ccenv

make pull-dev:
pulls base-rt, base-dev

Running FPC dev environment

make run-dev:
creates dev (if not exist) and runs it. Does not create base-dev and base-rt, returns an error if not exists.

Usage
Start docker-based FPC dev environment
Option 1) Pull images and start dev container
cd utils/docker
make pull-dev
make run-dev
## continue inside docker

Option 2) Build images from scratch and start dev container
cd utils/docker
make build-dev
make run-dev
## continue inside docker

CI
If no changes in utils/docker
cd utils/docker
make pull
make run-dev
## continue inside docker

otherwise
cd utils/docker
make build-dev
make run-dev
## continue inside docker

Build docker images for FPC runtime environment
Pull images
cd utils/docker
make pull

or build them
cd utils/docker
make build

Publishing
We publish images for every new release (docker tag = ${FPC_VERSION}) and on PR merged (docker tag = main) through CI.
TBD: Instead of pushing to main, we could also introduce a nightly build?

make publish:
pushing base-rt, ccenv, base-dev to github docker registry

When running the publish target manually (not through CI), docker login on ghcr.io is needed.
See documentation.
Use your github personal access token (PAT) to login.
export CR_PAT=YOUR_TOKEN
echo $CR_PAT | docker login ghcr.io -u USERNAME --password-stdin

TBD: Let's only publish ubuntu 20.04 LTS based images.

@bvavala @munapower @ikegawa-koshi WDYT?

@mbrandenburger
I think it's a very good idea!
It's good that we don't need code build time.


Consider postponing Managed SDK install until actual deploy/run if user cancelled it once

According to the metrics, some users do not need or like having Managed Cloud SDK installed when they start IDE or install the plugin and cancel it. Some seems to cancel it multiple times if they restart/update IDE.
To accommodate for this, how about we keep a flag of "user cancelled installation", and do not attempt to install Managed SDK until actual SDK operation is needed (i.e. deploy or cancel). Users who do not cancel will still have Managed SDK installed at the point of plugin installation.

Seems reasonable.
On Thu, May 17, 2018 at 11:01 AM Ivan Portyankin<EMAIL_ADDRESS>wrote:

According to the metrics, some users do not need or like having Managed
Cloud SDK installed when they start IDE or install the plugin and cancel
it. Some seems to cancel it multiple times if they restart/update IDE.
To accommodate for this, how about we keep a flag of "user cancelled
installation", and do not attempt to install Managed SDK until actual SDK
operation is needed (i.e. deploy or cancel). Users who do not cancel will
still have Managed SDK installed at the point of plugin installation.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/google-cloud-intellij/issues/2113,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHf5HffrTNspZIUxs-tXe1JMh10WuKSmks5tzZC1gaJpZM4UDPW1
.

if we go with your suggestion, would we do the same thing for updates?

For updates, if SDK is not in installed state, it won't do anything so we should be good here.

oh. I meant if the SDK is already installed, but they keep cancelling the updates that occur on IDE load. I guess this is less of a nuisance since its less frequent.

but your original suggestion sgtm

Yes, update is once per week, and they can just disable it with quick popup action (Disable updates)

good point. lets follow the signals.


Bad user experience while searching

The new feature where you can remove searched result from the code (by pressing x) is very annoying, I keep clicking on it accidentally from time to time, and it is creating havoc on my code base, need to be really careful before deploying/commiting anything, as well check that nothing that was added has not been removed.
Hopefully this will get reverted or a way to get rid of it with some setting.
https://imgur.com/a/wWdNOaB

Would "search.actionsPosition": "right" help avoid the accidents?

Not a new feature, but I did just change the default of this setting, you can set that yourself to try it out as well. That should help with this confusion that comes up fairly often.

By the way, that button does not change or delete anything from your code, only the result list.

I've changed the setting, hopefully will be better now. Actually, its not the "pressing x" functionality, its the "pressing replace" button which causes the issue (code gets randomly replaced with emptiness) I was having


Demonstrate scrolling dialogs

WHAT
WHY
HOW
Checklist :clipboard:

[x] Add explicit visibility modifier and explicit return types for public declarations
[x] Run spotless check
[x] Run tests
[x] Update metalava's signature text files

cc @ssancho14

Landing for an offline comparison.


Fix feed.xml to show

Fix feed.xml
remove empty data feed

@adamdjbrett
Need to merge to fix your fecth feed data


[BUG] Crashes

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.

What problem did you encounter?
Roblox crashes when I go to more - settings - account info
https://github.com/pizzaboxer/bloxstrap/assets/164545620/e3ce23f3-2317-4519-b8c0-617abf452bd0

what fps rate did you set for bloxstrap in fastflags? it may be an issue on roblox's side itself due to the grapics card and/or Ram on your computer

i'd also recommend expierimenting with the fps settings on the bloxstrap installation starting with 120 fps

Back then, it was 120 FPS, even when I set it to 60, it still crashed

Reinstall the WebView2 runtime.
You can find the Evergreen installer here.


[SPARK-49745][SS] Add change to read registered timers through state data source reader

What changes were proposed in this pull request?
Add change to read registered timers through state data source reader
Why are the changes needed?
Without this, users cannot read registered timers per grouping key within the transformWithState operator
Does this PR introduce any user-facing change?
Yes
Users can now read registered timers using the following query:
        val stateReaderDf = spark.read
          .format("statestore")
          .option(StateSourceOptions.PATH, <checkpoint_loc>)
          .option(StateSourceOptions.READ_REGISTERED_TIMERS, true)
          .load()

How was this patch tested?
Added unit tests
[info] Run completed in 20 seconds, 834 milliseconds.
[info] Total number of tests run: 4
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 4, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.

Was this patch authored or co-authored using generative AI tooling?
No

cc - @ericm-db @HeartSaVioR - PTAL, thx !

Thanks! Merging to master.


New PR to test SignCLA at 2019-07-08 19:13:18.764526371 -0700 PDT m=+4.868416883

Body of PR

corp-pass-staging: test succeeded


Future of this project comparing to angular cli?

I have been loving this project, but there are few things which I am not clear at the moment:

Angular cli is evolving (still not as mature as it has to be), but will we be needing such starter projects. What is the roadmap comparing to cli based projects?

Not sure about the purpose of following packages. Are these packages tying us to a specific use case?

"@angularclass/conventions-loader": "^1.0.2",
"@angularclass/hmr": "^1.0.1",
"@angularclass/hmr-loader": "^1.0.1",
"@angularclass/request-idle-callback": "^1.0.7",
"@angularclass/webpack-toolkit": "^1.3.3",

Hot module reload (hmr) for developing faster (no full refresh every change). webpack-toolkit stuff I think was for async reload but we're not sure what the status of that is as of now.

@asadsahi
(1) From my experience it is, that most projects are not boilerplate projects, but need a high-level of customization and proprietary solutions. That's when the Starter becomes handy. Because it also captures many of these, either in the code, or in the README.ME.
(2) That is automatically transform Component Metadata to requirestatements, to Hot Module Reloading, and have async components. So, a lot of stuff that is hard to have in the CLI as you have to have a lot of boilerplate code.

(2) That is automatically transform Component Metadata to requirestatements, to Hot Module Reloading, and have async components. So, a lot of stuff that is hard to have in the CLI as you have to have a lot of boilerplate code.

ive removed this as it is not required for development, its just a tool and not a strict requirement.

ya I need to remove these packages until I update their useage
"@angularclass/request-idle-callback": "^1.0.7",
"@angularclass/webpack-toolkit": "^1.3.3",
the starter's goal is to make the development workflow as easy as possible for production. I'm also working with the cli team and webpack. The angularclass starter repos will be one of the first repos to be used for a tool we made that we might show off a bit at AngularConnect

@gdi2290 is that tool a surprise? Are we expecting an announcement like Angular 2 Team does? :)
Really looking forward for DLL usage with webpack because one of my project rebuilds in roughly 150-250 ms compared to angular2-webpack-starter takes roughly 1-1.5 seconds on same machine.

This repo will hopefully include DLL as well.. one day.
Things I would really like to see:

DLL(https://github.com/AngularClass/angular2-webpack-starter/issues/843#issuecomment-242577597)
integrated AOT commands (there are some efforts at this repo https://github.com/qdouble/angular2webpack2-starter)
tidying up of configs and the build system generally, now that it's using webpack2 and you can actually use es6 everywhere... CLI has got pretty nice webpack configs for example(https://github.com/AngularClass/angular2-webpack-starter/issues/910)

@gdi2290 do you use windows ?

@rubenCodeforges  I don't use windows

@asadsahi do you use windows ?

@rubenCodeforges yes I do, is everything ok??? :)

@asadsahi just asking because youve mentioned dll , on unix we dont have them

@rubenCodeforges dll is a concept in webpack too. This is to do with having more performance out of webpack.

@gdi2290 could you reply to this https://github.com/AngularClass/angular2-webpack-starter/issues/968#issuecomment-246180363 ? What's the current situation with this repo now that angular2 is out? Are you busy preparing for conferences or something? Could we do something to help coordinate effort of updating and tidying up this repo? I know it interests a lot of people. :)
Thank you.
cc @DzmitryShylovich

Hello? @katallaxie @gdi2290

Considering becoming an Angular CLI template or using @ngtools/webpack
With the Angular CLI becoming so powerful and central to workflow, it's a good time to consider if this starter makes sense to work as an Angular CLI template. See "App Creation Using Template" in the CLI wiki. Becoming a template would look something like this for a user to get started:
ng new my-ng2-app --template=angular2-webpack-starter
Or adopting @ngtools/webpack to not miss out on any of the innovations happening on the CLI like "code splitting" (see below) and other optimizations.
See the benefits and ability to use @ngtools/webpack standalone from the Angular CLI as presented in Stephen Fluin's Angular CLI talk at Angular Connect 2016:

Compiles SCSS/LESS
TypeScript transpilation
Bundles JavaScript, CSS
Asset optimization
Virtual filesystem for assets
For serving local assets and compile versions.
Live-reload via websockets
Code splitting

Recognizing the use of loadChildren in the router, and bundling those modules separately so that any dependencies of those modules are not going to be loaded as part of your main bundle. These separate bundles will be pulled out of the critical path of your application, making your total application bundle much smaller and loading it much more performant.

The next change to the repo would diverge from the current folder structure and the current style guide with the focus on production apps. The change would also include AoT,  DLL only for dev and SCSS (since it's the most popular one). Anything the CLI has will be included plus more depending on the opinions and style guide of @AngularClass. The only problem right now is finding the weekend to work on it or start training maintainers for future updates. The CLI and starter repos have different goals which is why this repo will always exist.

Any news on this front? I am using this in a large corporate setting and would be willing to maintain and backport some of my enhancements over. I have gone this route because of the blackbox nature of angular-cli being too risky. I have seen the intake of issues and PRs have slowed, for example: #1640, #1637 should have been merged already.
Some enhancements I currently have:

Frontend app config
Commitizen
Standard changelog

Separate IE polyfill and IE stylesheet bundle

Angular 4
Custom includePaths setup with scss so components can consume a common import
Example: https://github.com/angular/angular-cli/pull/2747#issuecomment-268651574
Postcss/autoprefixer
Headless protractor and karma configuration via PhantomJS

updates will be in the same issue here https://github.com/AngularClass/angular-starter/issues/1686


Fix #151: Check return code of vlog

system("svunit_user_feedback.pl") suppresses the return code of vlog when compilation fails. Our CI would report success with 0 test cases in those situations.
I believe this should also fix #154.
I decided to return -2 to be able to differentiate with $build_cmd
I can also add an error message as suggested in #43.

Some things were missing from the PR. I prefer having tests to accompany any changes. The status of vcom, vlib, etc. also had to be checked. Moreover, after changing the behavior of runSVUnit, many other existing tests start failing. I've fixed all of this in #257 and #260.
In any case, thanks for the PR. I wouldn't have thought about the change of ; to && and would have just implemented #257, as I mostly work with xrun which runs a single command.


ci: remove unnecessary release step from upload-xcframework

Closing in favor of https://github.com/bucketeer-io/ios-client-sdk/pull/60


Descending neurons - robot-generated terms

I would like to have this checked as it is rather a lot of terms, with quite a bit of detail.
I made a template and generated the terms for the descending neurons, based on the supplementary spreadsheets.
I will probably manually edit the DNx01 neuron - this one is a bit strange as its soma is not in the brain (it is in the antenna), but wanted to make sure the autogeneration was ok before starting to do these things.

Looks great.  One small thing - I think it's worth adding the short names (e.g. DNa01) as synonyms.
As these are the names used by Janelia (FlyLight) too, I think we should make tag them as official symbols.  This will require adding a synonymtypedef to the OBO file.
e.g. synonymtypedef: official_symbol
=> an new synonymtypedef AP in OWL.
It may not be easy to get to support this type tagging with ROBOT.  If so - tagging should be split out to a separate edit.

Ok, I will look into that.
What I initially thought you were taking about with synonyms was the list of similar neurons provided in a supplementary table. I have added these as comments, e.g. for DNg34:

comment: Namiki et al., 2018 (FBrf0239335), identify this as being morphologically similar to the octopaminergic VPM1 neuron (FBbt:00110149), described by Busch et al., 2009 (FBrf0207458) and the fruitless aDT8 neuron (FBbt:00110543), described by Yu et al., 2010 (FBrf0211884).

Does this seem like a sensible approach rather than synonyms or using the existing term?
I thought they could be merged in future if they turned out to refer to the same thing.

What I initially thought you were taking about with synonyms was the list of similar neurons provided in a supplementary table. I have added these as comments, e.g. for DNg34:

comment: Namiki et al., 2018 (FBrf0239335), identify this as being morphologically similar to the octopaminergic VPM1 neuron (FBbt:00110149), described by Busch et al., 2009 (FBrf0207458) and the fruitless aDT8 neuron (FBbt:00110543), described by Yu et al., 2010 (FBrf0211884).

Does this seem like a sensible approach rather than synonyms or using the existing term?
I thought they could be merged in future if they turned out to refer to the same thing.

I think this is fine for now, but we should probably find a way to formalise this soon as I suspect we'll be seeing more and more of this and will want to be able to create links and track provenance. We need to define an annotation property that can be used to directly refer to potential type mappings.  The axiom could then be annotated further with a comment and a reference indicating why this.  I've had a little chat to Nico and he's not aware of any such property.
I've requested this from IAO:
https://github.com/information-artifact-ontology/IAO/issues/207

Short names are now added as VFB synonyms.
If the new 'may be identical to' annotation will be ready within the next week or so, it is probably best to wait for it rather than retrofit, if not I guess it is best to get the terms in in time for the next release.

If the new 'may be identical to' annotation will be ready within the next week or so, it is probably best to wait for it rather than retrofit, if not I guess it is best to get the terms in in time for the next release.

AP is now in IAO (see linked ticket).  Please just add manually for now & use.  We can work on a standard IAO import later. Can you try to annotate the axioms with an rdfs:comment & an xref?  I think this should be possible using ROBOT.  Please ask for help if you have problems.

Where a term was already in the ontology, I have put the FBbt number in the new IAO:0006011 field, annotated with the FBrf - does this seem like sensible usage? Some of the similar neurons weren't in the ontology (e.g. flycircuit neurons), so I thought it would make sense to leave all the comments as they were (i.e. not attached to IAO:0006011). Do you think this looks ok?


Feedback on deliverable D2 ghg concentrations

Hi @znichollscr ,
Thank you for sharing the first draft of the full suite of ghg concentration dataset. I had a quick look at the global-, hemispheric-means, so providing feedback for the next iteration. My script and plots are here . Also tagging @durack1.

GHG names - a mix of chemical and complex names are used for the species, which itself is not a problem, but creates issues when comparing with CMIP6 data for example. Not a deal-breaker but some consistency in chemical formulas and names for the CMIP6Plus datafiles would be helpful.
Sector - it was actually very helfpul to have this as a dimension name rather than "region" as I suggested before (discussed here and here). CMIP6 files also used sector which made it very easy to compare. I suggest sticking with this dimension name for maintaining backward compatibility but defining it in a better way (CMIP6 example is provided here)
Temporal resolution - just to confirm that your data starts from year 1 and not year 0. CMIP6 started with year 0.
Time dimension - xarray had trouble decoding the time variable but that was also true for CMIP6 files. We are already discussing time here.
Float versus double - this is where there is significant difference between CMIP6 and your files. The precision of the data variable in your files is higher ("double") than in CMIP6 ("float"). Some nearly 0 values show up as very small negative values. Any particular reason you prefer double?
Concentrations - there are small differences in the actual values for the species I looked at. This issue was disucssed for methane here .

Best,
Vaishali

Thanks @vnaik60, super helpful! Going through the points

GHG names

Here I tried to follow the CF standards (https://cfconventions.org/Data/cf-standard-names/current/build/cf-standard-name-table.html). They are a bit all over the shop, but I assume we're a bit limited in what we can do?

Sector

Ok. Given the conversation in #29, I'm pretty sure that sector is the wrong use. I can see the backwards compatibility point though so I'm happy to do either (it doesn't matter too much to me, I would prefer to do region and just provide scripts to help people compare but if we have to maintain backwards-compatibility, that can be done).

Temporal resolution

Yes data starts in year 1. I got rid of year 0 because it doesn't exist in most calendars so it made all sorts of things explode.

Time dimension

Hmm I'm puzzled by why xarray is struggling with this. I will investigate. x-ref #59

Float versus double

Ooops, that's just me not paying attention. I can round back to float

Concentrations

Yep. Some are to be expected but now I need to go back and check more carefully what is going on.


Problem with engine-io

Hi.
I'm having this problem with engine.io-client:
http://i.imgur.com/Kbw6a1l.png
it's on line 214 in the screenshot, seems to return undefined.

I can't reproduce this issue. I'm curious about what version of socket.io-client you're using. Can you post the output of npm ls is from within your project?

I'm afraid my setup is a little complicated;
I am building my gulp setup (including browserify) as a NPM module so that I don't have to repeat the same gulp config in all the projects I use it with. It supports server and client code and is set to be both DRY and configurable... Here are the browserify tasks and the package.json. This version is not released on NPM yet since it's not stable. I'm using npm link to use it in a "full-blown" project to test all the aspects of the setup.

Did you solve the issue? I've been able to reproduce it now.

I didn't solve it yet but it's definitely not a problem with browserify-hmr. It's the way I am trying to split up the bundles into a node_modules.bundle.js and app.bundle.js. There's some stuff going wrong with the bundling so the node_modules doesn't include all code and some modules are pointing to themselves (infinite loop).

Bundle splitting isn't something I've tested with browserify-hmr. If your project works when you disable browserify-hmr, then it's probably browserify-hmr's fault.


New scripts for gh actions deployment to gh pages

adding execa
create github actions workflow instructions
add build and deploy script to be executed by github actions
merge with main and add execa
add more config for github actions deployment script

Still need to add credentials (email and gh username) for gh actions script.


pageextension - The anchoring symbol cannot be an area

I added an Action Group to page 134 after the Action Group IncomingDocument.
After conversion with Txt2Al.exe. In some pageextensions (Pag134,Pag138,Pag140) Visual Studio Code shows the following error.
Seems to me that the conversion takes the caption instead of name, an cuts it after the whitespace .

AL Code:

Delta file:

another screenshot from the dev Client

The fix for this issue has been checked in to the master branch. It will be available in the bcinsider.azurecr.io/bcsandbox-master Docker image starting from platform build number 25690.
If you don’t have access to these images you need to become part of the Ready2Go program: aka.ms/readytogo
For more details on code branches and docker images please read:
https://blogs.msdn.microsoft.com/nav/2018/05/03/al-developer-previews-multiple-releases-and-github/
https://blogs.msdn.microsoft.com/freddyk/2018/04/16/which-docker-image-is-the-right-for-you/


Update pom.xml

use springboot 2.x version from parent pom.xml(current version 1.5.22)

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Gawk error while running translate-shell on Linux

I get an error on my linux desktop, it happens on the second translation, which causes the program to crash.
$> gawk --version
GNU Awk 5.2.0, API 3.2, PMA Avon 7, (GNU MPFR 4.1.0-p13, GNU MP 6.2.1)
Copyright (C) 1989, 1991-2022 Free Software Foundation.

This is how it crashes (I input 1, and then 2):
$> trans
1
1

See also
    1,2-naphthoquinone, 1,4-naphthoquinone
2
gawk: /dev/fd/63:93: fatal: internal error: file interpret.h, line 254: unexpected parameter type Node_val

Additional info:
$> trans -V
Translate Shell       0.9.7-git:3dcc122

platform              Linux
terminal type         xterm-256color
bi-di emulator        [N/A]
gawk (GNU Awk)        5.2.0
fribidi (GNU FriBidi) 1.0.12
audio player          mpv --no-config
terminal pager        less
web browser           xdg-open
user locale           en_US.UTF-8 (English)
host language         en
source language       auto
target language       en
translation engine    auto
proxy                 [NONE]
user-agent            Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36 Edg/104.0.1293.54
ip version            [DEFAULT]
theme                 default
init file             [NONE]

Report bugs to:       https://github.com/soimort/translate-shell/issues

Same error here, though I can't even run trans -V.
I think it's a gawk related issue since executing:
gawk -f <(curl -Ls --compressed https://git.io/translate) -- -shell
causes the same error.

Despite multiple reports here, I'm also on Arch Linux upgraded with gawk 5.2.0-3, and I have not been able to reproduce this error yet. Pretty strange.
More information is welcome if anyone else encountered this issue.

Downgrading gawk worked for me, thanks @0fflineuser.
The weird thing is that I have two computers running arch linux with the same version of gawk 5.2.0-3, and in one computer works but not in the other.

I encountered the same problem with gawk 5.2.0-3 on ArchLinux, and downgrading the gawk also works for me. When I clone the repo and execute the code as follows,
$ ./translate -e bing :zh test
gawk: ./include/Commons.awk:290: fatal: internal error: file interpret.h, line 254: unexpected parameter type Node_val

It seems that the error is raised when executing the function unparameterize(), and the behavior is weird.
You could directly add print typeof(string) at the beginning of the function, and the problem is just gone, though it is not a solution.
Anyway, this is the behavior. Hopefully, the problem can be figured out and fixed!
Translate Shell       0.9.7-git:a3bba39

platform              Linux
terminal type         xterm-256color
bi-di emulator        [N/A]
gawk (GNU Awk)        5.2.0
fribidi (GNU FriBidi) 1.0.12
audio player          mpv --no-config
terminal pager        less
web browser           xdg-open
user locale           en_US.UTF-8 (English)
host language         en
source language       auto
target language       en
translation engine    auto
proxy                 [NONE]
user-agent            Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36 Edg/104.0.1293.54
ip version            [DEFAULT]
theme                 default
init file             [NONE]

Report bugs to:       https://github.com/soimort/translate-shell/issues

i don't think it's a linux or translate shell problem. i'm on macOS, and the gawk 5.2.0 would sometimes randomly give a similar error message, for random stuff i run. but run the exact same code again with no changes then it magically goes through. it's definitely something the gnu team need to take a look


Allow coder to specify BindingFlags in JsonUtil

I want my state to be read-only, but I also need to be able to serialise/deserialise that state using JsonUtil. As they have private setters these properties are not being set.
Please could you add a BindingFlags parameter to the Deserialize() method which will allow me to tell it to set properties with private setters?

We're not going to be adding features to JSONUtil. Our long term plan is to use the new System.Text.Json serializer that's being developed. Newtonsoft.JSON is also available as an option.


IndexError: index is out of bounds for dimension with size 0

During the training process, an error occurred:
...
 ---- batch: 8730 ----
...
Warning: N_pos = 0!
Traceback (most recent call last):
  File "train_granet.py", line 250, in <module>
    train(start_epoch)
  File "train_granet.py", line 235, in train
    train_one_epoch()
  File "train_granet.py", line 148, in train_one_epoch
    end_points = net(batch_data_label)
  File "/home/fr3_pc/research/graspnets/GraNet/env_granet/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/fr3_pc/research/graspnets/GraNet/models/granet_pipeline.py", line 68, in forward
    end_points = self.view_estimator(end_points)
  File "/home/fr3_pc/research/graspnets/GraNet/env_granet/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/fr3_pc/research/graspnets/GraNet/models/granet_pipeline.py", line 30, in forward
    seed_features, seed_xyz, end_points = self.granet_backbone(graphs, end_points)
  File "/home/fr3_pc/research/graspnets/GraNet/env_granet/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/fr3_pc/research/graspnets/GraNet/models/graph_learner.py", line 64, in forward
    g_fps, x_fps, x_clone_fps, end_points = self.ops(g, x, x_clone, end_points)
  File "/home/fr3_pc/research/graspnets/GraNet/env_granet/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/fr3_pc/research/graspnets/GraNet/models/OPS.py", line 106, in forward
    end_points['att1_to_att2_idx'] = idx_mask[idx]
IndexError: index is out of bounds for dimension with size 0

Thanks for pointing this out. This could be caused by the OPS network predicting all the points of a particular scene as background points during training. I modified the code to address the issue.


git-annex loads very slowly when dynamically linked

git-annex has a lot of Haskell dependencies, which makes it really slow to load up when it's dynamically linked.
It takes over 3 seconds to start on my machine, even for just a simple "git-annex version". This constant delay makes git-annex very painful to use in the terminal. Both the official build and a simple static version of the Nix build load nearly instantly.
I put the following override in my config.nix:
cabalStatic = haskellPackages.cabal.override {
  enableStaticLibraries   = true;
  enableSharedLibraries   = false;
  enableSharedExecutables = false;
};

gitAnnexStatic = haskellPackages.gitAnnex.override {
  cabal = cabalStatic;
};

That builds and runs correctly, so git-annex should probably be static by default. I assume this also affects all other Haskell tools, but git-annex is the only big one I use.
(I'm still completely new to Nix (and Haskell), so I have no idea how to further test or profile this. Is there a reason Haskell tools, in particular the ones with giant dependencies, are dynamically linked?)

Switching git-annex over to haskell-ng lost this fix and reintroduced the problem.
(I don't get haskell's arcane build setup, or else I'd've submitted a hopefully trivial patch.)

https://github.com/peti/nixpkgs/commit/f145201b35d731435c9fe1afc79e91bcccffa774 disables shared liking for git-annex again.


netFrameworkVersion always returns a value and it is wrong except one case

Package Name: @azure/arm-appservice
Package Version: 14.0.0
Operating system: Ubuntu 22.04.3 LTS
[x] nodejs

version: v16.20.1

[ ] browser

name/version:

[ ] typescript

version:

Is the bug related to documentation in

[ ] README.md
[x] source code documentation
[x] SDK API docs on https://docs.microsoft.com

Describe the bug
siteConfig.netFrameworkVersion always returns "v4.6" irrespective of windows or linux web app and the stack it is running. It returns the exact same value even if we use other stacks like python node etc.
For windows web app, netFrameworkVersion from .getConfiguration() returns me the right value when I set the stack to .NET but if I have a different stack, it still returns me an arbitrary value. In my understanding it should be null if .NET stack is not in use.
For linux web apps:

siteConfig.linuxFxVersion and linuxFxVersion from .getConfiguration() returns the correct value
siteConfig.netFrameworkVersion and netFrameworkVersion from .getConfiguration() return the incorrect values (null and "")

To Reproduce
Steps to reproduce the behavior:

Create web apps and set the appropriate stack
Check using was cli - az webapp list, az webapp show
try on JS SDK - WebApps - .list(), .get(), .getConfiguration()

Expected behavior
Proper version output should be returned
Screenshots
Additional context

@kazrael2119 Could you help take a look ? Thanks

will check

Hi @akumar-99 ,

siteConfig.netFrameworkVersion always returns "v4.6" irrespective of windows or linux web app and the stack it is running. It returns the exact same value even if we use other stacks like python node etc.>

this is beacuase in swagger it defines a default value "v4.6" in swagger
and sdk is generated by swagger.
so when we call webApps.get() , the siteConfig.netFrameworkVersionin server in null, but our client will set the default value v4.6 instead of null. that's why you always get v4.6.

For windows web app, netFrameworkVersion from .getConfiguration() returns me the right value when I set the stack to .NET but if I have a different stack, it still returns me an arbitrary value. In my understanding it should be null if .NET stack is not in use.>

And for this one, I think it is still a wrong value we get, because it will always return "v4.0". But this is not defined by swagger, it should be defined in server.
And you use linux as your webapp env, no matter which stack you use ,the parameters will only change "linuxFxVersion", others like "phpVersion","nodeVersion" are always be null.
I think all above may be the service issues


mac-26 and mac-23 lost external connection from phone device.

Type of Request
bug
Infrastructure Environment
LUCI, Github, Cocoon scheduler, Autosubmit, etc...
What is happening?
mac-26 and mac-23 lost external connection from phone device.

Steps to reproduce
Step 1:
Step 2:
..
Step n:
Expected results
I expect to see X when Y is finished.

Rebooting both machines above to restore both connections.


Illutrate how docker build with dind service works

Hello,
since version 4.32.0 is out, I've noticed my jobs are taking a looooong time to run with DIND.
Minimal .gitlab-ci.yml illustrating the issue
---

image: docker:20.10.16-dind

services:
  - docker:dind

job:
  script:
    - docker --version

.gitlab-ci-local-env
VOLUME="/var/run/docker.sock:/var/run/docker.sock"

Expected behavior
With gitlab-ci-local 4.31.0:
$ gitlab-ci-local
git remote -v didn't provide valid matches
parsing and downloads finished in 31 ms
job starting docker:20.10.16-dind (test)
job pulled docker:20.10.16-dind in 2.51 s
job pulled docker:dind in 31 ms
job started service image: docker:dind with aliases: docker in 1.12 s
job service image: docker:dind healthcheck passed: docker:2375 in 847 ms
job service image: docker:dind healthcheck passed: docker:2376 in 839 ms
job copied to container in 443 ms
job $ docker --version
job > Docker version 20.10.16, build aa7e414
job finished in 8.76 s

 PASS  job
pipeline finished in 8.83 s

This job takes ~9s to run, it's fine !
With gitlab-ci-local 4.32.0:
$ gitlab-ci-local
git remote -v didn't provide valid matches
parsing and downloads finished in 33 ms
job starting docker:20.10.16-dind (test)
job started service image: docker:dind with aliases: docker in 1.16 s
job > still running...
job > still running...
job > still running...
job service image: docker:dind healthcheck failed: docker:2375 in 31 s
job > still running...
job > still running...
job > still running...
job service image: docker:dind healthcheck failed: docker:2376 in 31 s
job copied to container in 494 ms
job $ docker --version
job > Docker version 20.10.16, build aa7e414
job finished in 1.12 min

 PASS  job
pipeline finished in 1.12 min

Healthchecks are taking a long time.
Host information
Linux Mint 19.1
Docker version 20.10.9
Additional context
Add any other context about the problem here.
Thanks !

Read up on the DIND without TLS quirk

Thanks for your answer !
Maybe it's the problem, I'm checking, I'm just surprised the behavior changed across gitlab-ci-local version :thinking:
Indeed, I have several self hosted gitlab runners and I had to tune  /etc/gitlab-runner/config.toml to have it running.
It would be nice idea to add an example ! :)

Can you elaborate on this? I'm not sure how to get it to work. 4.31.0 will pull images but then reports: Error response from daemon: set shim OOM score. 4.32.0 never manages to healthcheck 2376 (although 2375 works)

I've been racking my brain trying to figure out why I am still having this same issue on the latest version. But then I realized this patch is not included in v4.33.1 😄
Can you create a new release for package managers to get this fix? 🙏

Oh, right :D Yeah, sorry releasing now. @haydenseitz


Autorest Regen Preview to 3.0.0-alpha.20240111.1 by Dapeng Zhang from refs/pull/4124/merge

Triggered from https://github.com/Azure/autorest.csharp/pull/4124

API change check
API changes are not detected in this pull request.


TypeError: None object cannot be quoted

When i execute the "http_api.py" i am getting the following error.The error is like this
$ python http_api.py
Server started on port: 8080
<IP_ADDRESS> - - [17/Apr/2018 19:09:27] "GET /favicon.ico HTTP/1.1" 200 -
Exception happened during processing of request from ('<IP_ADDRESS>', 36776)
Traceback (most recent call last):
File "/usr/lib/python2.7/SocketServer.py", line 596, in process_request_thread
self.finish_request(request, client_address)
File "/usr/lib/python2.7/SocketServer.py", line 331, in finish_request
self.RequestHandlerClass(request, client_address, self)
File "/usr/lib/python2.7/SocketServer.py", line 652, in init
self.handle()
File "/usr/lib/python2.7/BaseHTTPServer.py", line 340, in handle
self.handle_one_request()
File "/usr/lib/python2.7/BaseHTTPServer.py", line 328, in handle_one_request
method()
File "http_api.py", line 61, in do_GET
open_new_tab(liw.authentication.authorization_url)
File "/home/sayali/lib/python2.7/site-packages/linkedin/linkedin.py", line 101, in authorization_url
qsl = ['%s=%s' % (quote(k), quote(v)) for k, v in qd.items()]
File "/usr/lib/python2.7/urllib.py", line 1286, in quote
raise TypeError('None object cannot be quoted')
TypeError: None object cannot be quoted
What is wrong here?

Do you change API_KEY and API_SECRET variable in http_api.py?
If yes do you think to replace environ.get('your key')  by your_key?
I think i had this problem and i solve by this changement but i'm not sure.


Disable malware scanning

This is relates to #117, about the size of files in the airlock import/export process. Files are currently scanned by Defender for Cloud, which has a hard limit of 2 GB for the file size. Files larger than that are automatically failed, so we need to disable Defender for Cloud.
The choice of scanning for malware or not is made at the TRE config level, so it's possible this will result in a significant rebuild of components, depending on how the terraform code responds to a changed configuration variable (enable_airlock_malware_scanning) when it comes to updating stuff. Need to experiment before going live!
@akolensky, let's discuss this and see how best to test it.

Need to validate it throught config file flag too

After discussion with Steven, we're keeping the malware scanning, and living with the 2 GB limit. If anyone wants a bigger file than that, they'll have to split it. If it's much bigger, they should probably be getting it through a different channel, such as the Data Core.
So, closing this ticket.


G value in BLV files

I have some extra question concerning the blv, when we safe it from magpy-gui the G (DDDD.DD) values are not included
001_AAAAAA.AA_BBBBBB.BB_ZZZZZZ.ZZ_SSSSSS.SS_DDDD.DD_mCrLf
So I wrote a small script that reads the iaga files and calculates the daily means of the G value .
data = load_iaga_files()
data.delta_f()
data.get_gaps()
daily_mean = data.dailymeans(keys=['df'])
daily_means = daily_mean.ndarray[1]
After that I just parse the previous created blv and find replace the necessary 888 with the correct value.
I wondered if there was a more elegant way to do with magpy methods.
I tried to read the excisting blv with magpy but wasn't able to add the daily means.

A new "export" window has been included to XMagPy when exporting BLV data. Here you can automatically add appropriate dailymean values provided that you have previously opend a full year of one-minute definitive data. You just selelct this data source as daily mean source and XMagPy  will do the rest for you. Nevertheless, definitive data is indispensible.
Further details: https://github.com/geomagpy/magpy/issues/126#issuecomment-1529485476


Root manifest not found when trying to run carton

Hello, when trying to execute anything with Carton, I'm getting the following error.
Do you have any idea what could be wrong? 🙂
 ✘ jankaltoun@jan-kaltoun  ~/Code/Personal/Swift  carton dev
Polyfill integrity verified: /Users/jankaltoun/.carton/static/dev.js
Inferring basic settings...
- swift executable: /Users/jankaltoun/.carton/sdk/wasm-DEVELOPMENT-SNAPSHOT-2020-06-12-a/usr/bin/swift
Swift version 5.3-dev (LLVM b54b6b832e, Swift 4bb1458ec4)
Target: x86_64-apple-darwin19.5.0
Parsing package manifest: /Users/jankaltoun/.carton/sdk/wasm-DEVELOPMENT-SNAPSHOT-2020-06-12-a/usr/bin/swift package dump-package
Error: Process failed with non-zero exit status and following error output:
error: root manifest not found

Hi @jankaltoun, thanks for reporting this issue. Are you executing carton dev from a directory that has Package.swift in it? Currently carton is only able to build SwiftPM packages with executable products in them, so you have to run its commands from the root package directory, which has a Package.swift file in it that describes such product.

Well, that was easy! The directory was indeed the problem. Thank you! 🙂

No problem at all! I'll keep the issue open until carton is able to detect that Package.swift is missing in the current directory and the error message is improved. 🙂


Patched Media Upload for PostTweet

Twitter's API doesn't like it when the media_category is set on an uploaded media file when that media file is to be used in a tweet.
Made the media_category optional.

@ramikalai @meteochu
Thank you for supporting my miss.
But I think making media_category optional is not a fundamental solution for this issue.
I read the official reference again and fixed the code. How do you think?
https://github.com/mattdonnelly/Swifter/pull/317#issue-461203282

Now that #317 is merged, I don't think we need this one since that one follows the official API guideline. I'm closing this now.


android-tools: 31.0.3p1 -> 33.0.3

Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

After removing the patches, this branch did work :+1:. I've made the changes (including sha256 -> hash) on my branch: https://github.com/bobvanderlinden/nixpkgs/tree/update-android-tools

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/disallow-sri-hashes-in-sha256-attributes/22976/1

Ah oops, this is now pretty much the same as #199212

Ah oops, this is now pretty much the same as #199212

Yes sorry, I'm in need of android-tools > 33.X and wanted to get it upstream as I wasn't sure when you have time to (https://github.com/NixOS/nixpkgs/pull/196144#discussion_r1006074007)

While it should certainly eventually land upstream, you can always use a fork if you need an update immediately.


Improve presentation of Description Lists

Thought the description list could benefit from some CSS Grid powers
Example:

@pmarsceill oops thanks for spotting that whatspace mistake, and thanks for letting me contribute!


Interactive guideline is far away

chart: {
    type: 'lineChart',
    color: ['#4caf50', '#3f51b5', '#ff5722'],
    height: 320,
    x: function ( d, i ) {
        return d.x;
    },
    y: function ( d ) {
        return d.y;
    }
}

I've stripped my chart down considerably (it doesn't always look this raw), but I can't get the tooltip window to appear closer to my guideline. I have tried various gravity settings with no effect, and most of the positional overrides don't seem to be picked up by nvd3. Any thoughts on how I can correct this?

I get this same issue when using multiple charts of the same type in the same window, except the interactive guidelines will only show up over the first charts SVG...

For me, it's the only chart in my DOM.

Which version are you using? I just solved my similar problem by updating to angular-nvd3 version 1.8.2 and d3 version 3.5.16 as well as wrapping each nvd3 html tag inside of a div with position set to be absolute


Return bound-with host items from /bibliographic/:mms_id/holding/:holding_id/availability

child of #573; follow-on to #1179. Originally discussed in #922
A bib record may represent a work that we hold bound with another work. There may or may not also be copies of the work that are "normal" (i.e. bound just by itself).
If a bib record has a bound-with item associated with it, it will have a link to the "bound-with host record" in the 773 |w.
Is there something we need to do in bibdata? Or does this mean the requests app should issue an additional call to the holdings availability endpoint for the host record? I suspect the latter. blocking until we figure this out.

This ticket is not accurate.


Update kubevirt-top-consumers dashboard

Update kubevirt-top-consumers dashboard.
Replace:
kubevirt_vmi_vcpu_wait_seconds -> kubevirt_vmi_vcpu_wait_seconds_total kubevirt_vmi_memory_swap_in_traffic_bytes_total -> kubevirt_vmi_memory_swap_in_traffic_bytes
Since the vCPU Wait by Virtual Machines and Memory Swap Traffic by Virtual Machines graphs are also empty on CNV engineering due to the changes in: https://github.com/kubevirt/kubevirt/pull/9821

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
https://issues.redhat.com/browse/OCPBUGS-33077
Special notes for your reviewer:
Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] Design: A design document was considered and is present (link) or not required
[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Testing: New code requires new unit tests. New features and bug fixes require at least on e2e test
[ ] Documentation: A user-guide update was considered and is present (link) or not required. You want a user-guide update if it's a user facing feature / API change.
[ ] Community: Announcement to kubevirt-dev was considered

Release note:

NONE

/lgtm


Remove duplicate listen on StopSig.

Coverage remained the same at 72.4% when pulling 3c303dbbff2370896c80a70b74303102c357261b on stop_in_setup into 8c49fd840f685f41d28c4e290370c2d01b2de73b on master.


Collection approval workflow UI

https://issues.redhat.com/browse/AAH-2169
What is implemented:
On Certification dashboard page:

When there is more than 1 repository (with pipeline approved), ApproveModal will open and it will allow user to
select multiple repositories to approve.

Rejection operation is now available also for rejected state to handle situation, when rejection failed and system
is in inconsistent state - both rejected and approved repositories. Now, user can click rejection again to continue the
operation.

Rejection can handle multiple repositories. It is calling move in parallel from all approved repos to rejected repo.

Badges for approved, rejected and staging are now implemented differently. If collection repos includes either rejected or staging repo, it will show rejected or staging badge accordingly. For approved, it will search for all repos and check if they are really mared as pipeline approved. If yes, it will show approved badge. For rare inconsistent situation, it will not show any badge (this can happen when collection is not in rejected, staging or any approved repo).

New column with list of collection repositories is shown.

On approval dashboard modal:

User has table with filtering, paging, ordering
User can select repositories to approve
Selected repositories are shown in label list above
Approval API now allows for safe operation that will either succeed or failed everyhing.
In case of inconsistent state (rejection operation can lead to inconsistent state), every repository that is part of the
collection now before approval is now blured and not available for selection (or deselection). This can be also useful if
we wants some reapproval operation, in case when user wants to reapprove to another repositories (this can be
communicated with UX if they want it now).

Before:

After:

(screenshot test failure expected, new column in approvals :+1:)
Works for me (both with modal and directly), looks great :+1:

This is missing the "Select all" logic in the modal
it should use the taskAlert alert for rejection (and approval without modal), otherwise you can get in a state where the collection version is correctly Rejected and the UI looks done, but also showing the old approved repos because that task is still running. (It works correctly, once the task is done and the list reloads the approved repos are gone, so just adding the alert while the task is running is enough.)
closeAlert closes all alerts, use the shared one
things break when there are more approval repos than the defaut page size (see code comments)

but that size is 100 .. so this pretty much works for most realistic use cases (=> not blocking this PR)

But it probably makes sense to fix the pagination issue before merging.
LGTM :+1: let's merge this now, and address the ux issues ^ in a separate PR?

UX was late with the design of select/unselect all. I was tallking to them and we agreed that we can merge this and then repair it later in sepearate PR. Its nothing that will prevent user from using the modal for now. And I have also to solve one cosmetical issue - UX wants to have bottom paging always visible and not part of the scrollable content. I think we should also do this in separate PR.

UX wants to have bottom paging always visible and not part of the scrollable content. I think we should also do this in separate PR.

Don't worry about it too much. The user is selecting the number of items per page, they can always select less, and they won't scroll down if they see pagination on the bottom.
And none of our other screens have sticky pagination - we're not doing UX redesign as part of this effort.


Member data for superuser

I have a superuser which belongs to several tenants. Data such as first_name and last_name are kept in a  separate members table as recommended. I understand your explanations in https://github.com/dsaronin/milia#inviting-additional-usermembers as follows:

I need one user record for this superuser
I need entries in tenants_users to define the membership of this user to the according tenants
And: I need one member record for this user for each tenant this user can access (this is because the members table is tenanted; only the users table isn't tenanted)

However:

your docs say there needs to be a has_one :member relation on the user (and not a has_many).
It doesn't feel clean to replicate the members data (such as first_name and last_name) n times if the user belongs to n companies.

What is the recommended way to do it with milia?

@dsaronin I worked through all of the open issues. This is the last one pending right now (and it has been written by myself). Do you have any suggestions regarding this one?


Push deletions?

I haven't dug in deeply to see if this should be supported or not but I noticed that if I delete a file on the originating side (e.g. a local folder) it doesn't push the deletion the the destination side (e.g. WA blob storage). You might take a look at the Windows Azure Accelerator for Web Roles - I believe it covers this as part of sync'ing to blobs: http://waawebroles.codeplex.com/SourceControl/changeset/view/161c3d52a183

The initial design of this was to push website assets to Windows Azure, with that in mind we wanted to keep 'old' references alive so that an existing website wouldn't be broken. We are thinking that we would like to implement the delete functionality as part of a flag or app.config setting so that it only deletes in a very controlled manner.
Do you have any other thoughts on the deletion?


fix(StoriesGroup): fix click area

Space between PreviewItems were disabled for user clicking and it is impossible to close StoriesGroup by clicking on area of PreviewItems

and by the way
upper right semicircular piece is not clickable too
but it is problem of Modal component

@amje
Maybe we want to add new property for Modal component like modalContentOutsideClickable: boolean ?
If this property is true than Modal will call onClose for clicking on .yc-modal__content.
It will be useful if the Modal content is not in the shape of a rectangle, like on the screen.

@ValeraS


Review and compare translation keys and doclinks usage and migration of translation from old UI

@utchoang cc @svenvogel  can you help do the following:

Review entire Primate codebase and fix any wrong usage of $tr(... translation key usage or code (i.e. fix any incorrect key or check/use an existing key from locales/en.json)
Compare the legacy UI translation file (https://github.com/apache/cloudstack/blob/master/ui/l10n/en.js) against Primate's locales/en.json (may few other languages for sanity checks like de_DE, ja_JP, fr_FR etc) and see if we missed anything
Check and fix or add docHelp keys and paths in the src/router/... section js files for actions, listviews etc. The docHelp allows to add path relative to the docs website http://docs.cloudstack.apache.org/en/latest/

Let me know if anything is not clear, thanks.

Has PR


404 not found message when destroying an OTU

When Destroying an OTU a blank page with the following message apears "404 Not Found"
When I want to destroy an OTU I created myself, I choose the one I want to delete, from the list and open it.
Then I click on the Destroy boton above and a white page with a message "404 Not Found" shows up with the followinf url:
https://sandworm.taxonworks.org/otus/256612

Then I click on the back botton of the navegator twice and it takes me again to a previous page. When I go to the Hub again the message "Otu was succesfully destroyed" cames up.

See why it does not flow correctly and this 404 not found shows up.
It happens to me working on sandworm.taxonworks.org

Thanks @mabecabrera.  To confirm, this is from the OTU list right?  We'll fix the routing.

I experienced it too. The OTU is destroyed, but the page is not redirected, after reload, the address is not found (because OTU is deleted). It only happens when OTU successfully deleted

This is a systematic problem, also happens in Data > Taxon Names, deletion takes you back to show instead of index. I guess this problem is more widespread. When using tasks it is all fine.
redirect_back(fallback_location: (request.referer || root_path) will have to be smarter.

Thanks @mabecabrera. To confirm, this is from the OTU list right? We'll fix the routing.

I select the Otus List from the Data Board, and then, in the TAXON NAME page I use the Destroy Button.

Solved with #2223


Get language components from alizer

Some languages were not being picked up by alizer Analyze. For example, Java was not being found by alizer in https://github.com/konveyor-ecosystem/coolstore. Using detectComponents and then checking for a component seems to resolve it.

Closing for bug fix in https://github.com/devfile/alizer/pull/97


Use bouncy from maven

ref: https://gitlab.com/fdroid/fdroiddata/-/commit/067471133fb52999dfaa7b1e6ee215c68b9edeac

LGTM, thanks 👍


Upgrade to darling 0.20 and syn v2

In order to retrace and understand these changes, I'd basically have to re-do from scratch. The changes look innocent enough and I know you, so I'm just gonna merge it

Yeah, the changes were mostly that syn::NestedMeta got moved into darling, and the attributes got preprocessed in syn instead of just being tokens.


Fix release validation step

Proof of concept at #7416
Fixes main branch check added in #7279 (see failure)
Removes the meaningless "SHA consistency" check (since we literally check out the SHA now)

:) https://github.com/astral-sh/ruff/actions/runs/6202724487/job/16842052746


Remove Kestrel.Https from the baseline

This package has been removed and it is (correctly) causing baseline build warnings.
Is there any way to add exclusions other than purging it from the baseline?

This file is auto generated, so this code is likely to re-appear.
An alternative solution would be to change this line:
https://github.com/aspnet/AspNetCore/blob/0e12274a8ee31983344c1e6e6bb92cbbddf528b9/Directory.Build.targets#L8
To something like this:
<Import Project="eng\Baseline.props" Condition=" '$(IsServicingBuild)' == 'true' " />

That would disable the check for all of Master, no? The check is legitimate, we want to know if dependencies have changed, but it needs a way to acknowledge and exclude known changes.


Added H3C into DC/OS community

Description

Urgency

[ ] Blocker
[v] High
[ ] Medium

Requirements

Test all commands and procedures.
Build content locally and test for formatting/links.
Add redirects to dcos-website/redirect-files.
Change all affected versions (e.g. 1.7, 1.8, and 1.9).
See the contribution guidelines.

@usultrared your build is passing, which is the only thing that should block this PR.
However, there are number of broken links that are unrelated to your PR.
@joel-hamill @judithpatudith see the results of the test (https://jenkins.mesosphere.com/service/jenkins/job/public-dcos-website-prs-validate-links/693/console) for reference to broken links we should probably resolve in another PR.

@ashenden Looks like https://dcos.io/community/ is broken, too many historical Meetups. And H3C pic is not showing up.

@usultrared I'm not seeing what is broken about it except for the new logo; can you be more specific?

I noticed that there's an @ symbol in one of the names of your logo files, could that be causing it not to display?

Nope, I was looking through the file of logos, and it doesn't look like that's it. The other thing I noticed is that all the other logos have .svg files associated with them and I don't see one for the h3c logo. Other than that I'm out of ideas sorry :(


Implement BnsConnection with CosmWasmConnection

Take an address for a deployed name service contract (https://github.com/confio/cosmwasm-examples/tree/master/nameservice) in the constructor.
Add support for extra BnsMethods using the name service contract on the backend.
This lets us then have full iov-wallet demo on testnet

Closing as outdated


hub.module_v2.load() returns a non-callable object

System information

tf version: 2.0.0 gpu
tf_hub version: 0.6
python: 3.7 with Anaconda

model = "https://tfhub.dev/google/imagenet/mobilenet_v2_140_224/feature_vector/3" # MobileNetV2
# both lines below cannot work
layer = hub.KerasLayer(model)
layer = hub.KerasLayer(model, tags="train")

Error messages are long, but those related to the issue are below:
~\anaconda\envs\tf2\lib\site-packages\tensorflow_hub\keras_layer.py in __init__(self, handle, trainable, arguments, **kwargs)
    102       self._func = handle
    103     else:
--> 104       self._func = module_v2.load(handle)
    105       if not callable(self._func):
    106         raise ValueError("Non-callable result from hub.load('%s')" %

ValueError: Importing a SavedModel with tf.saved_model.load requires a 'tags=' argument if there is more than one MetaGraph. Got 'tags=None', but there are 2 MetaGraphs in the SavedModel with tag sets [[], ['train']]. Pass a 'tags=' argument to load this SavedModel.

then I realized if we just directly use hub.KerasLayer(), the 'tags=' argument will not be passed to module_v2.load(), which causes this error.
So then I modified the codes as below:
model = "https://tfhub.dev/google/imagenet/mobilenet_v2_140_224/feature_vector/3"
mod = hub.module_v2.load(model,tags=['train']) # this line works fine
layer = hub.KerasLayer(mod) # error here

Howerver, this won't work, either. The error messages related to the error are:
~\anaconda\envs\tf2\lib\site-packages\tensorflow_hub\keras_layer.py in __init__(self, handle, trainable, arguments, **kwargs)
    102       self._func = handle
    103     else:
--> 104       self._func = module_v2.load(handle)
    105       if not callable(self._func):
    106         raise ValueError("Non-callable result from hub.load('%s')" %

and
AttributeError: 'AutoTrackable' object has no attribute 'startswith'

It seems that it is related to the code in keras_layer.py and specificly codes below:
def __init__(self, handle, trainable=False, arguments=None, **kwargs):
    self._handle = handle
    # Resolve the handle to a callable `func`.
    if callable(handle):
      self._func = handle
    else:
      self._func = module_v2.load(handle)
      if not callable(self._func):
           raise ValueError("Non-callable result from hub.load('%s')" %
                         str(handle))

When I pass the mod object to hub.KerasLayer(), the code in if branch is expected to be executed, but the code in else branch is executed, which means the mod object returned by  module_v2.load() is not callable. That doesn't make sense.
So I wonder maybe it is a bug or there's something wrong with the MobileNet model or it just that the model doesn't fit in TF2.0.

@ifsheldon,
This issue is not related to Tensorflow, but it is related to Tensorflow Hub. Request you to raise an issue in Tensorflow Hub Repo.  Thanks!

@ifsheldon,
This issue is not related to Tensorflow, but it is related to Tensorflow Hub. Request you to raise an issue in Tensorflow Hub Repo. Thanks!

Sorry, and thanks.


KRPC fails after repeated calls for Name across several modules and parts.

Hello,
I have been working with engine cluster configurations, and then found out that KRPC gives up after numerous calls fetching module names. I was trying to cache some modules for re-use later, and to do that I needed to match their string name.
I don't know what's wrong here, other than not doing too many calls, so I need your help to fix the problem.
As usual, I start with importing common modules, and setting up vessels object.
Note that these tests are performed with Realism Overhaul, so I think in vanilla it will last a bit longer (due to less modules per parts)
import KRPC.Interface.SpaceCenter as SC
import KRPC.Interface.SpaceCenter.RemoteTypes as SCR
import KRPC.Interface.SpaceCenter.Helpers as SCH

... (get vessel object)
ves::SCR.Vessel = ...
parts = SCH.Parts(ves) |> SCH.All
part = parts[1]

The error appers when I query for Name call several times across several parts.
# breaks after number 82, or while processing the 4th part.
counter = 0
for p ∈ parts[1:10]
    modules = SCH.Modules(p)
    println("new part")
    for m ∈ modules
        counter += 1
        println(counter)
        SCH.Name(m)
    end
end

Interestingly, doing this on fewer parts does not cause any problem.
# works fine, even though I do this 5 times.
counter = 0
for i = 1:5
    for p ∈ parts[1:3]
        modules = SCH.Modules(p)
        println("new module")
        for m ∈ modules
            counter += 1
            println(counter)
            SCH.Name(m)
        end
    end
end

Note that in this case the script broke during the 4th part, but I don't think there is anything magical about number 4; during my cluster engine test I failed while parsing the 5th engine, (after naming 120-ish modules).
So I am assuming that there might be some kind of total number of "unique" object count or total amount of memory that KRPC.jl can track?
I almost forgot to show the stacktrace. Here are two examples.
# the error I get when running the above example, but with part 1:4. (or 1:10, they stop at the same place)

The KRPC server returned an error.
Service:
Description:
===============
Non-static method requires a target.

Server internal stack trace:
===============

  at System.Reflection.MonoMethod.Invoke (System.Object obj, System.Reflection.BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x0004c] in <9577ac7a62ef43179789031239ba8798>:0
  at System.Reflection.MethodBase.Invoke (System.Object obj, System.Object[] parameters) [0x00000] in <9577ac7a62ef43179789031239ba8798>:0
  at KRPC.Service.ClassMethodHandler.Invoke (System.Object[] arguments) [0x00044] in :0
  at KRPC.Service.Services.ExecuteCall (KRPC.Service.Scanner.ProcedureSignature procedure, System.Object[] arguments) [0x00036] in :0

Stacktrace:
 [1] handle_potential_error(result::KRPC.krpc.schema.Response)
   @ KRPC ~/.julia/dev/KRPC/src/connection.jl:151
 [2] macro expansion
   @ ~/.julia/dev/KRPC/src/message.jl:45 [inlined]
 [3] kerbal(c::KRPC.KRPCConnection, calls::Tuple{KRPC.Interface.SpaceCenter.Module_get_Name})
   @ KRPC ~/.julia/dev/KRPC/src/message.jl:40
 [4] kerbal
   @ ~/.julia/dev/KRPC/src/message.jl:14 [inlined]
 [5] Name
   @ ~/.julia/dev/KRPC/src/generated.jl:13781 [inlined]
 [6] top-level scope
   @ ~/.julia/dev/SpaceLib/prototype/cluster.ipynb:9

# the error I got while testing live code
	"name": "KRPC.KRPCError",
	"message": "The KRPC server returned an error.
	Service:
	Description:
	===============
	Non-static method requires a target.

	Server internal stack trace:
	===============

	  at System.Reflection.MonoMethod.Invoke (System.Object obj, System.Reflection.BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x0004c] in <9577ac7a62ef43179789031239ba8798>:0 \r
	  at System.Reflection.MethodBase.Invoke (System.Object obj, System.Object[] parameters) [0x00000] in <9577ac7a62ef43179789031239ba8798>:0 \r
	  at KRPC.Service.ClassMethodHandler.Invoke (System.Object[] arguments) [0x00044] in <bfca7052818745ee95133536e4da4f10>:0 \r
	  at KRPC.Service.Services.ExecuteCall (KRPC.Service.Scanner.ProcedureSignature procedure, System.Object[] arguments) [0x00036] in <bfca7052818745ee95133536e4da4f10>:0
	",
	"stack": "The KRPC server returned an error.
	Service:
	Description:
	===============
	Non-static method requires a target.

	Server internal stack trace:
	===============

	  at System.Reflection.MonoMethod.Invoke (System.Object obj, System.Reflection.BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x0004c] in <9577ac7a62ef43179789031239ba8798>:0 \r
	  at System.Reflection.MethodBase.Invoke (System.Object obj, System.Object[] parameters) [0x00000] in <9577ac7a62ef43179789031239ba8798>:0 \r
	  at KRPC.Service.ClassMethodHandler.Invoke (System.Object[] arguments) [0x00044] in <bfca7052818745ee95133536e4da4f10>:0 \r
	  at KRPC.Service.Services.ExecuteCall (KRPC.Service.Scanner.ProcedureSignature procedure, System.Object[] arguments) [0x00036] in <bfca7052818745ee95133536e4da4f10>:0

	Stacktrace:
	 [1] handle_potential_error(result::KRPC.krpc.schema.Response)
	   @ KRPC ~/.julia/dev/KRPC/src/connection.jl:151
	 [2] macro expansion
	   @ ~/.julia/dev/KRPC/src/message.jl:45 [inlined]
	 [3] kerbal(c::KRPC.KRPCConnection, calls::Tuple{KRPC.Interface.SpaceCenter.Module_get_Name})
	   @ KRPC ~/.julia/dev/KRPC/src/message.jl:40
	 [4] kerbal
	   @ ~/.julia/dev/KRPC/src/message.jl:14 [inlined]
	 [5] Name
	   @ ~/.julia/dev/KRPC/src/generated.jl:13781 [inlined]
	 [6] getmodule(part::KRPC.Interface.SpaceCenter.RemoteTypes.Part, name::String, idx::Int64)
	   @ SpaceLib.PartModule ~/.julia/dev/SpaceLib/src/partmodule/partmodule.jl:15
	 [7] getmodule
	   @ ~/.julia/dev/SpaceLib/src/partmodule/partmodule.jl:12 [inlined]
	 [8] RealEngine(part::KRPC.Interface.SpaceCenter.RemoteTypes.Part)
	   @ SpaceLib.Engine ~/.julia/dev/SpaceLib/src/partmodule/engine.jl:118
	 [9] top-level scope
	   @ ~/.julia/dev/SpaceLib/prototype/cluster.ipynb:2"

This makes me think that the supposed "limitation on number of objects" might be the reason why I had to restart the KRPC every launch to not get those "mismatched" errors.

I was doubting whether if  this is a bug in KRPC.jl or just kRPC in general, so I tested a similar code with the same spacecraft using the python client, so it is probably a KRPC.jl bug.
import krpc
conn = krpc.connect("Test", "<IP_ADDRESS>")
sc = conn.space_center
ves = sc.active_vessel
for p in ves.parts.all:
    for m in p.modules:
        print(m.name)

this code worked for me.

I found the fix. PR coming in soon.


refactor(buffer): rename buffer to bufferWith

Description: renames the buffer operator to bufferWith and marks buffer as deprecated
Related issue (if exists): #5296

Looks like api_guardian is failing, but I'm not sure how to resolve this. Hoping the owners can point me in the right direction, as I haven't been able to find any documentation around it, and it's not mentioned in COLLABORATORS.md

I think this one is a near-miss, unfortunately.
The ones we are marking "___With" are the operators that have a static creation function counterpart.  concat and concatWith, or merge and mergeWith. Unfortunately, there's no static creation function for buffer.

Thank you so much for your effort, @tylersaunders. It is appreciated!


Release version with improved tag support

Tag is now optional and no longer set to 'logstash' by default.
Fixed issues around interpolation when there's more than one tag.
Added lots of unit tests around tag handling.

This will release #31

@jsvd @robbavey Updated the Changelog (took the oppt to identify other recent breaking changes).
How does this capitalization look? I don't have strong feelings about it, so totally fine with Camel case instead.

@webmat I'm +1 on the change, and the capitalization. Making the breaking changes stand out makes sense

FYI, PR for CONTRIBUTING.md in Logstash


Feature/plugin 170 gcs create

Updated: Provide Service Account as JSON for GCS Bucket Create plugin
Jira Ticket: https://issues.cask.co/browse/PLUGIN-170
Dependent on PR: #308

New PR: https://github.com/data-integrations/google-cloud/pull/357


Extra arguments for Sequential

The documentation for Sequential suggests using a custom module when extra arguments are needed:
  Another restriction is that it is not possible to have extra arguments in the
  :meth:`__call__` method that are passed to the constituents of the module -
  for example, if there is a :class:`BatchNorm` module in :class:`Sequential`
  and the user wishes to switch the ``is_training`` flag. If this is the desired
  use case, the recommended solution is to subclass :class:`Module` and
  implement ``__call__``:

      >>> class CustomModule(hk.Module):
      ...   def __call__(self, x, is_training):
      ...     x = hk.Conv2D(32, 4, 2)(x)
      ...     x = hk.BatchNorm(True, True, 0.9)(x, is_training)
      ...     x = jax.nn.relu(x)
      ...     return x

How does this custom module exactly help with the problem outlined above? It's not like it can be placed inside a Sequential can it? Is this meant to replace Sequential? I think the documentation here could be slightly improved to remove confusion.
One useful use case of Sequntial is dynamically adding layers in a loop. Is the recommended Haiku way to handle that is using is_instance() inside my __call__ to provide is_training when necessary?

Unrelated: is it ok to instantiate stateful Haiku modules inside __call__ like snippet above? I'm assuming transform magic takes care of that and we don't get a new module in every call to __call__?

The example in the docs is intended to replace the sequential, perhaps we should call it MyCustomSequential or something like that?
I think our main point is that for Sequential making the calling convention "do the right thing" (e.g. thread is_training or other kwargs) would make the module quite complex and could potentially be brittle. Our experience from Sonnet 1 and 2 is that it is often more readable to subclass and pass is_training to submodules as needed.
You could implement something on top of Haiku if you prefer to have a more feature rich sequential:
import inspect

import jax
import jax.numpy as jnp
import haiku as hk

class FancySequential(hk.Module):
  def __init__(self, layers, name=None):
    super().__init__(name=name)
    self.layers = tuple(layers)

  def __call__(self, x, is_training):
    for layer in self.layers:
      try:
        x = layer(x, is_training=is_training)
      except TypeError:
        x = layer(x)
    return x

def f(x):
  layers = []
  for _ in range(3):
    layers.append(hk.Conv2D(32, 4, 2))
    layers.append(hk.BatchNorm(True, True, 0.9))
    layers.append(jax.nn.relu)

  x = FancySequential(layers)(x, True)
  return x.sum()

x = jnp.ones([1, 224, 224, 3])
f = hk.transform_with_state(f)
params, state = f.init(jax.random.PRNGKey(42), x)
out, state = f.apply(params, state, None, x)
print(out)

Re creating submodules repeatedly in __call__. Yes this is fine. In Haiku (as with Sonnet 1) all sharing of state is based on module names. These names are established at construction time and take into account the parent module name and current method name.
When you call a method on a module we establish a unique (within the application of the method) name for any submodules you create, these names are discarded when the method returns, as such when you call the method again you will end up getting the same names (assuming that execution of your method is deterministic).
I'd suggest playing with this in a colab to get a better understanding, in particular printing mod.module_name might be useful.
For example:
class MyModule(hk.Module):
  def __call__(self, x):
    l1 = hk.Linear(1)  # module_name: `my_module/linear` (for m1)   OR `my_module_1/linear` (for m2)
    l2 = hk.Linear(1)  # module_name: `my_module/linear_1` (for m1) OR `my_module_1/linear_1` (for m2)
    return l2(jax.nn.relu(l1(x)))

def f(x):
  m1 = MyModule()  # module_name: `my_module`
  m2 = MyModule()  # module_name: `my_module_1`
  x = m2(m1(x))
  x = m2(m1(x))  # Will recreate the Python objects l1/l2 but these will be given the same name by haiku so parameters will be reused.
  return x

If you prefer it is of course fine to use a more traditional Python style and keep modules as object properties assigned in the constructor, this is however a bit more verbose and many researchers prefer the convenience afforded by defining and using their module on the same line(s) of code:
class MyModule(hk.Module):
  def __init__(self, name=None):
    super().__init__(name=name)
    self.l1 = hk.Linear(1)  # module_name: `my_module/~/linear` (for m1)   OR `my_module_1/~/linear` (for m2)
    self.l2 = hk.Linear(1)  # module_name: `my_module/~/linear_1` (for m1) OR `my_module_1/~/linear_1` (for m2)

  def __call__(self, x):
    return self.l2(jax.nn.relu(self.l1(x)))

def f(x):
  m1 = MyModule()  # module_name: `my_module`
  m2 = MyModule()  # module_name: `my_module_1`
  x = m2(m1(x))
  x = m2(m1(x))
  return x

Thanks @tomhennigan for the clear explanation. I think some of this could really go into the official documentation as it helps in establishing a mental model of how things work.


Cannot access JWT provider failed_status_in_metadata in lua response

Title: Cannot access JWT provider failed_status_in_metadata in lua response
Description:
Using recent envoy build:
"version": "1ddf0f5d8fade9c4209a12b34f6959bc7a90e840/1.30.0-dev/Clean/RELEASE/BoringSSL",
When setting failed_status_in_metadata: failed_status in a jwt_authn filter provider and supplying an invalid JWT token in a request, no dynamic metadata is available in envoy.filters.http.jwt_authn.failed_status` within the lua envoy_on_response() function.
Repro steps:
Configure the jwt_authn plugin and lua plugins as follows:
- name: envoy.filters.http.jwt_authn
  typed_config:
    "@type": type.googleapis.com/envoy.extensions.filters.http.jwt_authn.v3.JwtAuthentication
    providers:
      authspa:
        issuer: https://issuer
        remote_jwks:
          http_uri:
            uri: https://jwks_uri
            cluster: authspa_jwks_cluster
            timeout: 1s
          cache_duration:
            seconds: 300
        forward: true
        forward_payload_header: x-jwt
        payload_in_metadata: jwt_payload
        failed_status_in_metadata: failed_status
    rules:
    - match:
        prefix: /
      requires:
        provider_name: authspa
- name: envoy.filters.http.lua
   typed_config:
     "@type": type.googleapis.com/envoy.extensions.filters.http.lua.v3.Lua
   default_source_code:
     inline_string: |
       function envoy_on_response(response_handle)
         local meta = response_handle:streamInfo():dynamicMetadata()
         local jwtMeta = meta:get("envoy.filters.http.jwt_authn")
         if type(jwtMeta) == "nil"
         then
           response_handle:logWarn("envoy.filters.http.jwt_authn dynamic metadata is not available.")
           return
         end

Logs:
[2024-03-10 10:51:40.220][40][debug][jwt] [source/extensions/filters/http/jwt_authn/authenticator.cc:162] authspa: JWT authentication starts (allow_failed=false), tokens size=1
[2024-03-10 10:51:40.220][40][debug][jwt] [source/extensions/filters/http/jwt_authn/authenticator.cc:450] Code: 3 Message: Jwt is expired
[2024-03-10 10:51:40.220][40][debug][http] [source/common/http/filter_manager.cc:1017] [Tags: "ConnectionId":"0","StreamId":"7547608061384460992"] Preparing local reply with details jwt_authn_access_denied{Jwt_is_expired}
[2024-03-10 10:51:40.220][40][debug][http] [source/common/http/filter_manager.cc:1059] [Tags: "ConnectionId":"0","StreamId":"7547608061384460992"] Executing sending local reply.
[2024-03-11 10:34:43.196][37][debug][jwt] [source/extensions/filters/http/jwt_authn/filter.cc:97] Called Filter : decodeHeaders Stop
[2024-03-10 10:51:40.220][40][warning][lua] [source/extensions/filters/http/lua/lua_filter.cc:925] script log: envoy.filters.http.jwt_authn dynamic metadata is not available.

cc @lizan @taoxuy

Noticing similar behavior. Could this be looked into?

The use case we're looking at for this feature is a way to support multiple oauth2 providers using the per-route configuration idea mentioned in #29641.  One oauth2 provider would be accessed via an IdP link to a specific route, while requests arriving at "/" could leverage the failed_status_in_metadata information in a lua filter to redirect users to the oauth2 path for the second IdP.


#1443. create Account address object on Insert

warning
information
issues
Fixes #1443

@njjc  build is running.  ready for review.


Bump Scarb to 2.8.0

At the moment, Foundry uses Scarb 2.7.0 in tool-versions. Upgrading to 2.8.0 causes a lot of runtime errors in tests.
However a standard users' "create - declare - deploy" pipeline works fine.

If you ever decide to bump it to 2.8.0 please unignore this test

Discussed offline, closing for now