Cannot use Path option to load a file from Google Cloud Storage

Sorry for the quick bug report. Essentially the issue is that Picocli options of type Path do not seem to work with https://github.com/googleapis/java-storage-nio.
@CommandLine.Option(
        names = ["--csv"],
        required = true,
        description = [
            "Path to a CSV to parse.",
        ],
    )
    private lateinit var csv: Path

/// ...

csv.readText() // fails

Path.of(URI.create("gs://blah/blah.csv")).readText() // works

Thank you for raising this @reddaly!
I am not sure I understand the issue from the information exception you provided.
Can you provide a failing test, or otherwise more details on how to reproduce the issue?
(What input was provided, what exactly happens when you say "doesn't work"? NullPointerException? Or IOException? Something else?)

I'll try to get a failing test and more details at some point. For now I'm working around the issue with
/**
 * A PicoCLI converter for parsing a [Path]. Unlike the default parser for the [Path] type, this
 * converter will parse "gs://"-style URLs as [Path] objects using
 * https://github.com/googleapis/java-storage-nio. This is a workaround for
 * https://github.com/remkop/picocli/issues/2269.
 */
class PathFlagConverter : CommandLine.ITypeConverter<Path> {
    override fun convert(value: String): Path =
        if (value.startsWith("gs://")) {
            CloudStorageUri(value).path
        } else {
            Path.of(value)
        }
}

Where CloudStorageUri(value).path is essentially equivalent to Path.of(URI.create(value))

Having a custom converter sounds like a perfect solution actually! 👍

It certainly works. It is easy to forget, though. The issue is that it's surprising that a custom converter is needed. Elsewhere Path can be used with these types of URLs without special handling.

If the Path.of(URI.create(String)) invocation works with “normal” local files then perhaps I should change the default type converter for Path to use that invocation.

@reddaly
It looks like it is not feasible to make the Path.of(URI.create(String)) invocation the default for picocli's built-in Path type converter.
For Windows local file paths, a common path like "C:\\Users\\remko\\hello.txt" cannot be used to construct a URI. Attempting to construct a URI with that path results in a java.nio.file.FileSystemNotFoundException: Provider "C" not installed error.
Therefore, the current Path type converter used by picocli (which returns the result of Paths.get(String) to create a Path object, is correct.
Applications that need to construct a URI may be better off declaring the option as an URI instead of as a Path.
For example:
@Command
class MyCommand : Runnable {
    @Option(names = ["--csv"], required = true, description = [ "Path to a CSV to parse." ])
    private lateinit var csv: URI

    override fun run() {
        Path path = Paths.get(csv);
        // do something with the path...
    }
}

However, the above will fail for user input like --csv C:\\something, which may not be desirable.
If you need something that handles both local filesystem locations (like C:\something) as well as URI-based paths like "gs://something", then you will need to do what you did: have a custom Path type converter, or declare the option as a String, and put the logic for converting the user input to a Path object in the business logic.
I like your current solution.


Module parse failed: Unexpected character '#'

I'm trying to build up a React + Webpack basic Cesium application. However I got the following error when running webpack. Is there any good ideas to resolve this?
WARNING in ./node_modules/cesium/index.js
11:35-42 Critical dependency: require function is used in a way in which dependencies cannot be statically extracted
 @ ./node_modules/cesium/index.js
 @ ./src/App.js
 @ ./index.js

ERROR in ./node_modules/requirejs/bin/r.js
Module parse failed: Unexpected character '#' (1:0)
You may need an appropriate loader to handle this file type.
| #!/usr/bin/env node
| /**
|  * @license r.js 2.3.5 Copyright jQuery Foundation and other contributors.
 @ ./node_modules/cesium/index.js 5:16-36
 @ ./src/App.js
 @ ./index.js

Here's my code:
import Cesium from 'cesium';
...
var viewer = new Cesium.Viewer('cesiumContainer');

Resolved:
https://cesiumjs.org/forum/#!msg/cesium-dev/d69RrgOVu9c/RfCoBqrTBAAJ
http://blog.isquaredsoftware.com/2017/03/declarative-earth-part-1-cesium-webpack/

Well, I followed the instruction but still got an error. My code structure is slightly different from the instruction. What could be the reason?
bundle.js:168429 Error constructing CesiumWidget.
Visit http://get.webgl.org to verify that your web browser and hardware support WebGL.  Consider trying a different web browser or updating your video drivers.  Detailed error information is below:
Error: Cannot find module "."
Error: Cannot find module "."
    at webpackMissingModule (bundle.js:29861)
    at buildModuleUrl (bundle.js:29861)
    at new Globe (bundle.js:168694)
    at new CesiumWidget (bundle.js:168075)
    at new Viewer (bundle.js:103299)
    at App.componentDidMount (bundle.js:102847)
    at commitLifeCycles (bundle.js:96015)
    at commitAllLifeCycles (bundle.js:97191)
    at HTMLUnknownElement.callCallback (bundle.js:87787)
    at Object.invokeGuardedCallbackDev (bundle.js:87826)

My $PROJECT/index.js:
import React from 'react';
import ReactDOM from 'react-dom';
import App from './src/App';
import './node_modules/bootstrap/dist/css/bootstrap.min.css';
import "cesium/Source/Widgets/widgets.css";
import buildModuleUrl from "cesium/Source/Core/buildModuleUrl";

buildModuleUrl.setBaseUrl('./cesium/');
console.log(buildModuleUrl)

ReactDOM.render(<App />, document.getElementById('container'));

My $PROJECT/src/app.js:
import React, { Component } from 'react';
import Viewer from "cesium/Source/Widgets/Viewer/Viewer";

class App extends Component {
  componentDidMount() {
    var viewer = new Viewer(this.cesiumContainer);
  }

  render() {
    return (

 this.cesiumContainer = element }/>

          Hello

    );
  }
}

export default App;

Perhaps try removing the . from the module URL call?  Like: buildModuleUrl.setBaseUrl('cesium/');

I just tried that. But it doesn't work and gives the same error.

Hmm.  My next suggestion would be to try following the new Webpack setup instructions in the Cesium docs:  https://cesiumjs.org/tutorials/cesium-and-webpack/

Thanks a lot for the tutorial!
After I put
    amd: {
        // Enable webpack-friendly use of require in Cesium
        toUrlUndefined: true
    },

in my webpack.config.js, it works.

But how does this work? I search around the Webpack documentation but can't find any information. Did Cesium team contribute this special thing to Webpack?

Looks like it's a use of this particular Webpack config option: https://webpack.js.org/configuration/other-options/#amd
In combination with this change to Cesium's code to look for that special value:
https://github.com/AnalyticalGraphicsInc/cesium/pull/5861/commits/9aa2dff707d8073ec278bb9f1addee3e9b4b3bf7#diff-1f2d871223708f3eeff38a7821941b90

Thanks a lot!!


Flink 1994- Add different gain calculation schemes to SGD

Added 5 gain calculation schemes and .setOptimization method which takes an int values 0-5.

Hi @rawkintrevo, thanks for your contribution.
You have some scala style violations in GradientDescent.scala line 46 and 168. The lines mustn't be longer than 100 characters as the maven log output indicates.
Furthermore, could you change the title to the format "[FLINK-1994] [ml] Add different gain calculation schemes to SGD". That way, the JIRA issues will be automatically updated with the what happens on Github.
In Flink, we always rebase our changes on top of the current master branch. Therefore, it would be good if you could revert the last merge commit. If you want to update on the latest master, then do a rebase and a force push to the branch in your repository (here master).

did what you said ( I think ) and opened a new pull request


Add local built K8s images support in conformance test on Kind workflow

At the moment, we have a manual workflow to allow developers to run conformance test against different K8s versions.
https://github.com/antrea-io/antrea/blob/main/.github/workflows/conformance.yml
But it can only run those K8s versions which have been supported in kind repo, in most cases, we'd like to run Antrea with latest K8s versions which can help us to find the compatibility issues ASAP.
According to Kind README, users can build Kind Node images from K8s sources codes with following command,  this allow us to build our own Node images and run the conformance test against the latest K8s version as earlier as possible. So it should be doable to add local built K8s Node image support to run conformance test workflow with a new parameter to specify a K8s commit or version tags.
kind build node-image
kind create cluster --image kindest/node:latest

Resolved by #6399


Weird end portal block behaviour after an immptl portal

According to your testing, does the issue occur with ONLY Immersive Portals mod and Farbic API?
Not yet tested
Describe the issue
Edit: Teleporting to the end via a naturally generated vanilla end portal block after a portal leading to above/near it either makes you invincible in the end until rejoin or drops you off at the portal block's coordinates in the original dimension in the end instead of the obsidian platform. Read down the thread for videos and discussion, etc.
Neither issue occurs without going into the portal block immediately after a portal. Whichever variant happens is very inconsistent and the exact conditionas are not determined yet.
Post the log here
No response

I cannot reproduce this issue on my side. Can you explain how to trigger this issue in detail?

It doesn't appear to appear anymore for me either. If i can't reproduce it right now i'll close the issue

Does passing through portals give you momentary invincibility by chance?

https://user-images.githubusercontent.com/85982640/209426831-fb704b6c-d0e7-4cfe-9b0d-0b0adee2cf6b.mp4
Encountered a surprise when it loaded me off in the portal block's coords instead of the obi platform. This also happens i'd assume

Reproduced original issue. Will try to repdroduce in singleplayer, than with a minimal mod set.

@qouteall sadly i can barely run the integrated server with all the optimization mods, i don't think i'll be able to load into an alternate 3/4 world in vanilla at all. Could you please try and reproduce it yourself because my PC is too potato
In the meantime i'll try messing around with some settings on the server in case one of them helps, and update immptl to latest in case it's not

Apparently, you do need to have passed through that downwards portal for the bug to trigger - going to the end portal without a portal does not trigger any one of the two issues. If you fall into a portal that takes you to right above the end portal, there are two outcomes:

You get loaded off in the same coords in the end as the portal block's coords, in this case it's the middle of the void.
You get loaded off at the obsidian platform, invincible until rejoin.

Case 1 happens if you fall into the portal block quickly and hit the block below the portal block before getting teleported to the end, 2 happens if you fall in slowly without hitting the bottom block.  I'll try with the human origin and report back.

I might have a slight idea of what's going on. The dimension stack border between alternate 3 and 4 is exactly below the portal, and appatently the dimension below not being loaded yet while the player is teleporting may be relevant

Forget everything I said in the last 2 messages, i don't have any idea of what's going on. It's very inconsistent and i don't have the skills to actually determine what's happening in each case. Reproducing it in singleplayer might help a lot, but i literally can't lmao

This might be a bit too comically large but it's accurate

[09:12:29] [Server thread/WARN]: HyperSoop moved too quickly! 0.0,-26.800617295347365,0.0
[09:12:29] [Server thread/ERROR]: Tries to send player pos packet to a removed player
[09:12:29] [Server thread/INFO]: [STDERR]: java.lang.Throwable
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_33563(class_3244.java:2169)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_14363(class_3244.java:1036)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_12063(class_3244.java:946)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828.method_12272(class_2828.java:114)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828$class_2829.method_11054(class_2828.java:42)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2600.method_11072(class_2600.java:22)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3738.run(class_3738.java:18)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_18859(class_1255.java:157)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_4093.method_18859(class_4093.java:23)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_24306(MinecraftServer.java:776)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_18859(MinecraftServer.java:159)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_16075(class_1255.java:131)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_20415(MinecraftServer.java:758)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16075(MinecraftServer.java:752)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_18857(class_1255.java:140)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16208(MinecraftServer.java:737)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.handler$zha000$modifiedRunLoop(MinecraftServer.java:4394)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29741(MinecraftServer.java:644)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29739(MinecraftServer.java:257)
[09:12:29] [Server thread/INFO]: [STDERR]:      at java.base/java.lang.Thread.run(Thread.java:833)
[09:12:29] [Server thread/WARN]: HyperSoop moved too quickly! 0.0,-10.39332350776317,0.0
[09:12:29] [Server thread/ERROR]: Tries to send player pos packet to a removed player
[09:12:29] [Server thread/INFO]: [STDERR]: java.lang.Throwable
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_33563(class_3244.java:2169)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_14363(class_3244.java:1036)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_12063(class_3244.java:946)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828.method_12272(class_2828.java:114)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828$class_2829.method_11054(class_2828.java:42)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2600.method_11072(class_2600.java:22)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3738.run(class_3738.java:18)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_18859(class_1255.java:157)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_4093.method_18859(class_4093.java:23)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_24306(MinecraftServer.java:776)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_18859(MinecraftServer.java:159)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_16075(class_1255.java:131)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_20415(MinecraftServer.java:758)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16075(MinecraftServer.java:752)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_5383(class_1255.java:116)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16208(MinecraftServer.java:736)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.handler$zha000$modifiedRunLoop(MinecraftServer.java:4394)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29741(MinecraftServer.java:644)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29739(MinecraftServer.java:257)
[09:12:29] [Server thread/INFO]: [STDERR]:      at java.base/java.lang.Thread.run(Thread.java:833)
[09:12:29] [Server thread/WARN]: HyperSoop moved too quickly! 0.0,-12.377952030004963,0.0
[09:12:29] [Server thread/ERROR]: Tries to send player pos packet to a removed player
[09:12:29] [Server thread/INFO]: [STDERR]: java.lang.Throwable
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_33563(class_3244.java:2169)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_14363(class_3244.java:1036)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3244.method_12063(class_3244.java:946)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828.method_12272(class_2828.java:114)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2828$class_2829.method_11054(class_2828.java:42)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_2600.method_11072(class_2600.java:22)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_3738.run(class_3738.java:18)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_18859(class_1255.java:157)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_4093.method_18859(class_4093.java:23)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_24306(MinecraftServer.java:776)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_18859(MinecraftServer.java:159)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_16075(class_1255.java:131)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_20415(MinecraftServer.java:758)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16075(MinecraftServer.java:752)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.class_1255.method_5383(class_1255.java:116)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_16208(MinecraftServer.java:736)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.handler$zha000$modifiedRunLoop(MinecraftServer.java:4394)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29741(MinecraftServer.java:644)
[09:12:29] [Server thread/INFO]: [STDERR]:      at net.minecraft.server.MinecraftServer.method_29739(MinecraftServer.java:257)
[09:12:29] [Server thread/INFO]: [STDERR]:      at java.base/java.lang.Thread.run(Thread.java:833)

That was spammed in the server's log when i tried to move around in the invincible state.


Support passing additional args to varnish check

What does this PR do?
Adds support for passing additional parameters to varnishstat and varnishadm in order to support auto discovery.
Motivation
In order to support monitoring a Varnish instance which is running as a Docker container we need to wrap commands (varnishstat, varnishadm) with scripts which perform a docker exec on the running container.  This works fine when running a single container on the host but breaks down when attempting to use the auto discovery feature.  This change allows for passing in additional parameters to the script (i.e. %%host%%) so that the command is properly formatted and the desired container is queried.  The change is backwards compatible so it shouldn't break existing functionality.

Thanks @zippolyte.  I made the requested updates.

Looks good to me, I'll merge


Unsatisfiable side condition not refuted by solver

Quote:

The 2 rules for step will create 3 branches: 2 for each rule + reminder. To eliminate the reminder you have to evaluate the side condition notBool I <Int 1 andBool notBool I ==Int 1 using lemma that is effectively I <Int 2. One term of the side condition evaluated in the context of the lemma and the other term results in false.

See also: https://github.com/kframework/k/pull/1339

Right now, this needs investigation. Is the unsatisfiable side condition sent to the solver? If so, why is it not refuted? Maybe: the simplification lemma is not sent to the solver?

This is the most blocking issue for the verification project.

By the way, if you add [smt-lemma] to the lemma, the result is the same.

I can't reproduce the issue. The spec passes when the smt-lemma attribute is added to the simplification rule.

Yes, that's right. I probably tested on Java backend.
@ttuegel what should we do with the test? I believe we don't have much tests for [smt-lemma].

I think we should add it as a frontend regression test.


Add Go libraries compatibility policy

Changes
This change proposes that breaking changes may be introduced to the Go client libraries,
as long as existing yaml/json CRD definitions remain unaffected.
Breaking changes to the Go client libraries do not affect the Dashboard team, as the Dashboard
team no longer uses these libraries. The CLI team has decided that the impact of such changes
on them is acceptable.
Closes #2748.
/kind misc
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[x] Docs included if any changes are user facing
n/a Tests included if any functionality added or changed
[x] Follows the commit message standard
[x] Meets the Tekton contributor standards (including
functionality, content, code)
[x] Release notes block below has been filled in
(if there are no user facing changes, use release note "NONE")

Release Notes
NONE

/retest

/lgtm

/retest

/retest

/retest

/retest
This was one of the "normal" flakes in pipeline-alpha-integration-tests, not the git-init problem.

/override pull-tekton-pipeline-alpha-integration-tests
So https://tekton-releases.appspot.com/build/tekton-prow/pr-logs/pull/tektoncd_pipeline/4750/pull-tekton-pipeline-alpha-integration-tests/1514290483927453696/ passed but is refusing to admit it's done. I'm gonna be a bad boy and try to override it. =)

/override pull-tekton-pipeline-alpha-integration-tests

/retest

/retest

The dang alpha integration tests finally passed! ...so of course, now they've all gotta be rebuilt since main has changed. Sigh. =)

/retest
shakes fist at flakes


Readme: index by is supported

Support added long time ago: https://github.com/phpstan/phpstan-doctrine/pull/384

Thank you.


Apple Mach-O Linker Error Group

Did you add pod 'DCTAuth', :git => 'https://github.com/danielctull/DCTAuth.git' to your Podfile?

Yea it was added automatically after running react-native link react-native-oauth @Compulsor

My pod file
# Uncomment the next line to define a global platform for your project
# platform :ios, '9.0'

target 'appName' do
  # Uncomment the next line if you're using Swift or would like to use dynamic frameworks
  # use_frameworks!

  # Pods for moov

  target 'appName-tvOSTests' do
    inherit! :search_paths
    # Pods for testing
  end

  target 'appNameTests' do
    inherit! :search_paths
    # Pods for testing
  end

end

target 'appName-tvOS' do
  # Uncomment the next line if you're using Swift or would like to use dynamic frameworks
  # use_frameworks!

  # Pods for appName-tvOS

  target 'appName-tvOSTests' do
    inherit! :search_paths
    # Pods for testing
  end

end
source 'https://github.com/CocoaPods/Specs.git'
platform :ios, '8.0'
use_frameworks!

pod 'DCTAuth', :git => 'https://github.com/danielctull/DCTAuth.git'

Place your pod 'DCTAuth', :git => 'https://github.com/danielctull/DCTAuth.git' here:
`target 'appName' do
Uncomment the next line if you're using Swift or would like to use dynamic frameworks
use_frameworks!
Pods for moov
pod 'DCTAuth', :git => 'https://github.com/danielctull/DCTAuth.git'
target 'appName-tvOSTests' do
inherit! :search_paths
# Pods for testing
end
target 'appNameTests' do
inherit! :search_paths
# Pods for testing
end
end
`


Bump service version from 3.33.1 to 3.34.0

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.001%) to 31.768%

Totals

Change from base Build<PHONE_NUMBER>:
0.001%

Covered Lines:
12968

Relevant Lines:
14672

💛  - Coveralls


imposm: 0.13.2 -> 0.14.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/omniscale/imposm3/releases.
meta.description for imposm is: Imposm imports OpenStreetMap data into PostGIS
meta.homepage for imposm is: https://imposm.org/
meta.changelog for imposm is: https://github.com/omniscale/imposm3/releases/tag/v0.14.0
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.14.0 with grep in /nix/store/6hi0nn4dkl5zxdmcv934jndbfdh8xiwl-imposm-0.14.0
found 0.14.0 in filename of file in /nix/store/6hi0nn4dkl5zxdmcv934jndbfdh8xiwl-imposm-0.14.0

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

imposm

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/6hi0nn4dkl5zxdmcv934jndbfdh8xiwl-imposm-0.14.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A imposm https://github.com/r-ryantm/nixpkgs/archive/c393e12e5b0a0963124b7dc64cf38cb5531450e1.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/c393e12e5b0a0963124b7dc64cf38cb5531450e1#imposm

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/6hi0nn4dkl5zxdmcv934jndbfdh8xiwl-imposm-0.14.0
ls -la /nix/store/6hi0nn4dkl5zxdmcv934jndbfdh8xiwl-imposm-0.14.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

imposm

Maintainer pings
cc @sikmir for testing.

Result of nixpkgs-review pr 329179 run on x86_64-darwin 1

1 package built:

imposm


Initial xspectra parser

I will be pushing some changes tomorrow, then you can review them, and in the meantime I will be working on your suggestions in the OCEAN parser 🙂
Then tomorrow afternoon we can set up the workflow for DFT+CoreHole/BSE

@ladinesa can you please check my changes? I changed myself from reviewer to assignee.

Then tomorrow afternoon we can set up the workflow for DFT+CoreHole/BSE

Please CC me when you have something working for the corehole workflow. I have a lot of core-hole calculations in NOMAD, both from Wien2k (all electrons with full core holes as well as some fractional coreholes) and from OpenMX, so I would be interested in what is needed (on the OpenMX and Wien2k parser side) to get such calculations recognized.

Ok, I pushed some changes.

Then tomorrow afternoon we can set up the workflow for DFT+CoreHole/BSE

Please CC me when you have something working for the corehole workflow. I have a lot of core-hole calculations in NOMAD, both from Wien2k (all electrons with full core holes as well as some fractional coreholes) and from OpenMX, so I would be interested in what is needed (on the OpenMX and Wien2k parser side) to get such calculations recognized.

@ondracka that sounds very nice! Can you write me to my email<EMAIL_ADDRESS>and we discuss the details in there?

@ladinesa ok I tested it, it works good. Please, merge at will.


Use six.moves.http_client instead of httplib

httplib has been renamed to http.client in Python 3.
https://docs.python.org/2/library/httplib.html
six.moves.http_client works for both Python 2 and 3.

certifi removed the .old_where() in https://pypi.org/project/certifi/2018.11.29/, which is needed for old OpenSSL versions. I couldn't locate the exact version of OpenSSL running on the Travis CI build. https://docs.travis-ci.com/user/reference/precise/#libraries
Do you have suggestions for how to proceed? I found this https://bugs.python.org/issue32549, which updates travis.yml install OpenSSL 1.1.0.

Can we just not use old_where and require newer openssl versions?

I think it'll be best to remove the certifi dependency and use httplib2.CA_CERTS. https://github.com/httplib2/httplib2/blob/master/python2/httplib2/certs.py httplib2.CA_CERTS ends up using certifi if available and looks a few other sources for "good" CA certificates.

I'd really rather not.
On Fri, Dec 14, 2018, 12:14 PM James Lynn Wu<EMAIL_ADDRESS>wrote:

I think it'll be best to remove the certifi dependency and use
httplib2.CA_CERTS.
https://github.com/httplib2/httplib2/blob/master/python2/httplib2/certs.py
httplib2.CA_CERTS ends up using certifi if available and looks a few other
sources for "good" CA certificates.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/httplib2shim/pull/13#issuecomment-447441714,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAPUcwf-ZkxkaZvK2FuIIi_bd5QU_8gNks5u5AaPgaJpZM4ZQaoC
.

Can you explain why?

Basically it comes down to trust. certifi has a clear chain of trust and is used by Requests. We should mirror that as much as possible.


add service bus queue trigger

work item: #199

Codecov Report

:exclamation: No coverage uploaded for pull request base (develop@b123003). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             develop     #208   +/-   ##
==========================================
  Coverage           ?   58.61%
==========================================
  Files              ?       50
  Lines              ?     1590
  Branches           ?      176
==========================================
  Hits               ?      932
  Misses             ?      596
  Partials           ?       62

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b123003...07be9d3. Read the comment docs.


ADR 001: Vector store for RAG

What about moving adrs/ at the root folder, with README and the template files, and have a rag/ subfolder?
Apart from that, lgtm

That would probably need org-wide approval and we don't have that. I'll bring it up with the wider team next year to advocate for adoption of the format.

I like the decomposition into Context, Decision, Status, and Consequences. It seems much smoother and more natural than the approach used in https://github.com/instructlab/dev-docs/pull/164 which feels awkward and cumbersome to me.

I'm glad the approach resonates. Within reason, people should take priority over processes and not the other way around. This is a core tenet of the Agile Manifesto which, for better or for worse, has been a solid philosophical framework for ways of working for software teams since 2004:

Individuals and interactions over processes and tools

https://agilemanifesto.org/


How to get StarDist ROIs/Labels from DeepImageJ outputs?

Hi @uschmidt83 , Hi @maweigert,
When using DeepImageJ, the outputs of the StarDist model are the probability maps and the 32 radial distances ( see solution made @esgomezm  here )
# Input
model_paper.keras_model.input[0]

# Output 1: the object probability (normalized euclidean distance to the nearest background point)
model_paper.keras_model.output[0]

# Output 2: 32 radial distances to the boundary of the object
model_paper.keras_model.output[1]

From the StarDist prediction : https://github.com/mpicbg-csbd/stardist/blob/6e7d053bafcf83a6fca47f81469c201b79e993b1/stardist/models/model2d.py#L375
it seems that it would need to get the coord from the distance
https://github.com/mpicbg-csbd/stardist/blob/6e7d053bafcf83a6fca47f81469c201b79e993b1/stardist/models/model2d.py#L380
then get the points , using proba + coord
https://github.com/mpicbg-csbd/stardist/blob/6e7d053bafcf83a6fca47f81469c201b79e993b1/stardist/models/model2d.py#L381
to finally get the labels :
https://github.com/mpicbg-csbd/stardist/blob/6e7d053bafcf83a6fca47f81469c201b79e993b1/stardist/models/model2d.py#L383
The goal is to use StarDist in ImageJ and I am wondering if I am on the right path or I missed something obvious that will give me the labels without having to rewrite these functions in groovy?
Furthermore, in a related issue we were discussing about a StarDist plugin for FIJI. Is it still under development?
(feel free to close/merge this issue if it's too close to the one mentioned above)
Thank you for your inputs,
Romain

Yes, all these steps would need to be recreated and some of them (non_maximum_supression) are pretty involved and need external libraries (polygon intersection). If I remember correctly @uschmidt83 already managed to have a prototype that works, so his input is probably the most useful.

Yes, I have a very rough Fiji plugin that seems to work (2D only).
(It does use CSBDeep to do the network prediction.)
It would probably take me a few weeks (fulltime) to add a GUI, clean it up, and document it. Since I can't work on it fulltime, I don't know how long it is going to take...
Maybe it makes sense to just release the post-processing (including non-maximum suppression) somehow? I'm open to suggestions.
Best,
Uwe

Hi @uschmidt83
If it helps, until you manage to develop the plugin, in DeepImageJ  it is possible to run a post-processing step after the inference. If you release the post-processing script, any user could include it in the workflow.
Esti

Hi @esgomezm, I don't think it's possible to do this is as a simple post-processing script.
We need a separate Java library and ideally multi-threading to make this fast.
PS: I don't think the pre-processing script for StarDist in DeepImageJ is correct, at least when you use it with our pre-trained model. (We do a percentile-based normalization and don't clip values to the 0..1 range.)
Uwe

Hi @uschmidt83 , Hi @esgomezm
My current workaround is to use the postprocessing.txt from DeepImageJ to generate the ROIs.
But it's far from being as good as the StarDist roiset output 😢
Briefly : Find Maximas > Voronois + Threshold > Math + BinaryMorphoy >Analyse Particles = ROIs

I leave here a simple code on gist if someone else needs it!
Best,
Romain

Yes, I have a very rough Fiji plugin that seems to work (2D only).
(It does use CSBDeep to do the network prediction.)
It would probably take me a few weeks (fulltime) to add a GUI, clean it up, and document it. Since I can't work on it fulltime, I don't know how long it is going to take...

We found some time over the holidays to do this: https://imagej.net/StarDist.

Maybe it makes sense to just release the post-processing (including non-maximum suppression) somehow? I'm open to suggestions.

The plugin also allows to just do the postprocessing, which means you can use DeepImageJ for the prediction if you want.
Best,
Uwe


lsquic installation error

Hello, I was trying to install lsquic but I am facing an error at the following command "cmake -DBORINGSSL_DIR=$BORINGSSL ."
What does it mean when it said variables are set to "NOTFOUND".

Thank you

Did you compile BoringSSL and set the BORINGSSL environment variable to the correct value?

I used this command to set the environment variable. BORINGSSL_DIR=$PWD/boringssl

I am not sure where you go wrong, but you probably do somewhere. You can try following the steps in travis.yml because it certainly works.

Thank you for your feedback and I got it working. I have another question. Is it possible to run the example client and server on 2 VM's instead of docker containers?

Yes, it's possible.  You can also use just one VM: both client and server can coexist on a single machine.

For this test, I would like to use two VM's and is an example server an client code available somewhere so I can build from there? Just something basic so I can see how things flow?

Sure.  Just follow the build instructions.

I see information on building scripts but is there any documentation for echo server and client?

There is the online help via the -h command-line option...  All sample programs use share a subset of basic flags.  The echo programs should be easy to figure out how to run.


Issue error 400 not succeful download

I downloaded several videos of my classes from the same group, but when I reach a specific link this error 400 appears and I can't download the video.
Fresh access token dropped into .token_cachen
Parsing video/group urls
Downloading video info, this might take a while...
Trying to launch and connect to aria2c...
Connected to aria2 daemon!
Downloading video no.1
[WARNING] Got HTTP code 400. Retrying request...
[ERROR] Error: Request failed with status code 400
at createError (C:\snapshot\destreamer-aria2c_forRealNow\node_modules\axios\lib\core\createError.js:16:15)
at settle (C:\snapshot\destreamer-aria2c_forRealNow\node_modules\axios\lib\core\settle.js:17:12)
at IncomingMessage.handleStreamEnd (C:\snapshot\destreamer-aria2c_forRealNow\node_modules\axios\lib\adapters\http.js:244:11)
at IncomingMessage.emit (events.js:327:22)
at endReadableNT (_stream_readable.js:1224:12)
at processTicksAndRejections (internal/process/task_queues.js:84:21)
[FATAL ERROR] Unhandled error or uncaught exception!
Please check your download directory/directories and try again.
If this keep happening please report it on github "https://github.com/snobu/destreamer/issues"

The Aria branch you seem to be using is unstable, i would try adding -x to your command line to skip a few experimental features, other than that, if it still doesn't work, clone and compile the master branch instead.

Woww It worked perfectly, thank you very much!


add library-level docs to help with importing

Helps with https://github.com/flutter/flutter/issues/3119

I just followed the previous convention.

I'm encouraging a slow and steady move towards our current recommendation – but not a biggy

Can we land as is and then change all at once in another PR?

Thanks!


Module 10 - distributed system 1

Not a big lift here - just tidied up a little bit. I saw Mitch's comments about the cheesy animations but I like them :) I am putting more time into module 11 - the "REST" lesson will now include web sockets, and will compare/contrast using push vs pull pattern, and include a pointer back to typed emitter pattern for web sockets.

Sounds great!  Do you have any thoughts about relating the REST material to the rest of  module 11?

Sounds great! Do you have any thoughts about relating the REST material to the rest of module 11?

Yes - it becomes an "implementation-level technologies" lesson (and some of the principles, like "stateless" make more sense when you see the alternative of a very stateful web socket)

Remember also that I covered emitters in Module 05, so you can take advantage of that.

lgtm


"Share with" button

Pull Request Description
Closes https://github.com/enso-org/cloud-v2/issues/497

Implements "share with" modal
Invites the user to the organization instead if the email is not found

Important Notes

The design is temporary, and needs to be replaced with a proper design later.
After adding a permission, the row is not updated. This is intentional; it can(/will?) be fixed in the PR allowing updates to individual rows: #6546

Screencast
screen-recorder-thu-jun-22-2023-19-10-07.webm
Checklist
Please ensure that the following checklist has been satisfied before submitting the PR:

[x] The documentation has been updated, if necessary.
[x] Screenshots/screencasts have been attached, if there are any visual changes. For interactive or animated visual changes, a screencast is preferred.
[x] All code follows the
Scala,
Java,
and
Rust
style guides. In case you are using a language not listed above, follow the Rust style guide.
All code has been tested:

[x] Unit tests have been written where possible.
[x] If GUI codebase was changed, the GUI was tested when built using ./run ide build.

Can we do something how it looks like? the + sign is not centered, options are being below permission actions, there is not padding around email text input, + is wandering below the avatars..

When I select a user the share with doesn't not appear until I reload. My email shouldn't be listed

Couple of issues spotted:

When I add multiple users the share with is shrinking:

It should go like in figma:

With on hover the avatar should go in the foreground and when click we should have the same modal pre populated with selected user and be able to update permissions (I will add support for that on backend)

The permission actions should be multiple select (also need backend to support that, you can send action in a list)

A few things here:

It should be possible to easily share that with multiple people. Having to open the share dialog multiple times is a bad UX, it should be possible to do it easily.
Next to every person that I add, there should be a way to assign a person to any of the defined in the Figma states:

I still don't know how to do it nicely visually, but the functionality should be there. I will try to mock something soon.

Read is now View so this is why it throws 400

Minor bug when I open a sharing option for edition

I guess also we should filter out from the email dropdown users the assets was already shared with

nice catches, both fixed

@PabloBuchu what's the holdup here?

@somebody1234 one thing. the share with button should be visible only for the Owners. Currently I shared an asset with my second account for view and I was able to Own it :)

@somebody1234 one small improvement. The selected action shadow is too bright can we make it more visible? or when I select permission to edit no action is selected

@wdanilo would you be able to do a review here? We need your approval since we are not fully code owners (/assets directory).
We still working on multi select for users (so you can share the given asset with multiple people ot once). We improved with selecting multiple permissions actions so you don't need so granulated permissions (like in figma). It feels more descriptive that way.
My idea is to merge this as a first implementation and then do a longer live session working with the whole dashboard (preferably with @sylwiabr @jdunkerley @xvcgreg) and see what could be improved in UX in general. WDYT?
https://github.com/enso-org/enso/assets/2855109/dcb52305-9e6c-4059-aeb5-07efa167292f


Python script dosen't work after 2023.6

Hey guys!
So… i run HA on a Raspberry PI, and since i didn’t like that little fan sound, i figured out how to PWM control my fan using pyscript and pigpio, this was ~2-3 years ago, and i don’t remember where i found the codes i am using. The problem now is that since 2023.6, i dosen’t work anymore! And i figure this has something to do with Python 3.11. But since i don’t know anything about python, i am hoping someone here could help!
So - i have “Pyscript Python scripting” activated, with one script “rpi_cpu_fan_pwm.py”, and after 2023.6 it dosen't work anymore.
Can someone please have a look at my python script, and see what's wrong?
Thank you so much!
This is the py script;
https://pastebin.com/TM3vLrS0

Same here:
I only get this in logs:
2023-06-14 20:31:22.151 WARNING (MainThread) [homeassistant.helpers.frame] Detected integration that restore_state.RestoreStateData.async_get_instance is deprecated, and not intended to be called by custom components; Pleaserefactor your code to use RestoreEntity instead; restore_state.async_get(hass) can be used in the meantime. Please report issue to the custom integration author for pyscript using this method at custom_components/pyscript/init.py, line 83: restore_data = await RestoreStateData.async_get_instance(hass)

@djjoakim - do you get any errors in the log file?  Are you sure pigpio works with Python 3.11 - the last release was 3 years ago?
@olyashok - I need more details; are you just reporting the warning (see #473), or do you scripts fail?  You'll need to provide error messages or debug what is failing.  You should create a new issue if you are reporting more than that warning.

@djjoakim - do you get any errors in the log file? Are you sure pigpio works with Python 3.11 - the last release was 3 years ago?

Oh yeah you are right, maybe it’s pigpio that doesn’t support it.. do you mean errors in HA log, or can I find some logging that pyscript does as well? The log in pigpio doesn’t show any errors. I will check if I can find some log errors

@djjoakim - do you get any errors in the log file? Are you sure pigpio works with Python 3.11 - the last release was 3 years ago?
@olyashok - I need more details; are you just reporting the warning (see #473), or do you scripts fail? You'll need to provide error messages or debug what is failing. You should create a new issue if you are reporting more than that warning.

I just see the warning. pyscript stopped working after 2023.6.1 for me.
i removed al the scripts and pychache. restarted HA and added scripts back and it got working again. so it works with this warning but somehow requires cleanup to run.

@olyashok i tried what you said, and it didn't work for me.
@craigbarratt There is no errors in pigpio logger, but that dosen't mean it's not working.. Maybe the logs below can tell you something.

For some reason, after HA update 2023.6, the CPU temperature location has changed, so the only thing i had to do was to change where the script took the CPU temperature from, and now it works again.
Thank you all for the help anyways

Great - thanks for figuring it out and thanks for updating the issue with the solution.


Path argument for local files does not work on Windows Machines

Describe the bug
We are using dbt loom in our project on both MacOS and Windows computers. For the MacOS computers, everything works perfectly. However, for the Windows machines, we couldn't perform "dbt deps" or "dbt parse", as we always encountered a runtime error. After debugging for a while, we found the error.
Our dbt loom config looks the following:
manifests:
  - name: dbt_project_x
    type: file
    config:
      path: ../../dbt_project_x/target/manifest.json

In the config, we provide a relative local path to another dbt package we want to import
Then, by DBT Loom, it gets converted to an absolute path via the Pathlib
This Path again is converted to a string
The string is split into the individual parts by "urlsplit" -> here, normally path should end up in the path attribute in. However, for windows machines it ends up in the the netloc attribute. The reason for that is that on Windows, when converting the absolute path to a string, the path starts with two 2 forward slashes, which lets urlsplit parse it into the netloc attribute.

To Reproduce
Testing a dbt package import with a dbt loom config like above and on Windows 11.
Expected behavior
For now, we fixed it by patching the function "load_from_local_filesystem" in manifests.py the following way (if the path attribute is empty, it should look for it in the netloc attribute):
    @staticmethod
    def load_from_local_filesystem(config: FileReferenceConfig) -> Dict:
        """Load a manifest dictionary from a local file"""

        path = config.path.path
        if not path:
            path = config.path.netloc

        if not path:
            raise InvalidManifestPath()

        file_path = Path(path)

        if not file_path.exists():
            raise LoomConfigurationError(f"The path `{file_path}` does not exist.")

        if file_path.suffix == ".gz":
            with gzip.open(file_path, "rt") as file:
                return json.load(file)

        return json.load(open(file_path))

This was just a hotfix for us. Ideally, there is a better solution for that.
Screenshots
See code above.

OS: Windows 11
dbt-loom Version: 0.6.0
dbt-core Version: 1.8.7

Let me know if you have any further questions, happy to help/support! :)

Thanks for the detailed bug report @Zeulni!
Alas, Windows is going to be a bit of a gap for the moment -- I don't have any Windows machines to test with! 😅 I'll see if I can get a VM going or something equivalent, so I can test out the hotfix and devise a more robust solution.

Thank you very much, highly appreciated!


p_tqdm support

Love this project and have been using it all the time with any ST apps I build.
just wondering if there's any plan to wrap stqdm on top of the equally amazing p_tqdm

Closing as stale and there are some workaround and a future for this.


Fix params for :create and :update

Closes #43

Not sure if we need description in requestBody
In OpenAPI 3.1 it's not possible yet to overwrite required for the put path (https://stackoverflow.com/a/56902241/680820), so the only way now to show parameters for the put action the right way (without any required fields) is to duplicate the component in schema, which is too much as for me. I'd better wait 3.2 :)
I'm not sure at all if we need the object name in the root, because it should be obvious from the root and documentation what we are sending, so another layer of { "scaffolding_completely_concrete_tangible_thing": {} } looks obsolete (as for me again). Moreover, the responses don't contain this top level object name, so here we have discrepancy between logic of request and response bodies, and those bodies should be unified.

I added pagination headers and query parameters, fixed several bugs including Link header, and checked that every API doc looks as it should.
__Most probably this PR to the core repo should be merged first: https://github.com/bullet-train-co/bullet_train/pull/530 __


Problem compiling when using wrapper types

I am using google provided simple wrapper types that are just a message wrapper over primitive type. Following is how my proto file looks like -
syntax = "proto3";
import "google/protobuf/wrappers.proto";
message MyMessage {
oneof sendRecordThresholdField {
uint64 sendRecordThreshold = 6 [deprecated = true]; // [Deprecated].
google.protobuf.UInt64Value sendRecordThresholdWrapper = 11;
}
}
MyMessage.pb.h and MyMessage.pb.c files get generated fine but when I build a sample app using these files, it fails saying -
In file included from MyMessage.pb.h:8,
from decode.c:9:
/usr/include/google/protobuf/wrappers.pb.h:7:10: fatal error: string: No such file or directory
#include
^~~~~~~~
FYI - it looks like there was a wrappers.proto file in /usr/include/google/protobuf and when the makefile executed protoc on MyMessage.proto file, it generated wrappers.pb.h for wrappers.proto in /usr/include/google/protobuf. Also do you think this problem has anything to do with "#include < string >" being a c++ syntax.
Attached is the wrappers.pb.h file generated by protoc for your reference.
Thanks in advance.
wrappers.pb.h.txt

That file is for Google's C++ protobuf library.
Try compiling wrappers.proto using nanopb generator and arranging the include paths so that it gets included instead of the C++ version. It's a bit annoying that both nanopb and the C++ library use the .pb.h extension so that files sometimes get confused for each other. If necessary, you can change that extension for nanopb by using command line option.

Thanks. It worked.


Can’t connect from local machine to AWS server Wireguard

I can’t connect from my local machine to aws server’s WireGuard to open wgdashboard.
how can I resolve this problem? I didn’t know what kind of IP address I need to enter

Hi, usually you just need to enter your AWS server's public IP and the port: http://<public_ip>:10086. Also you need to open in-coming and out-going traffic on both AWS control panel, and the server's firewall.

Thank u for answer!
But I can connect to my vpn.
I can’t connect to dashboard only… can u tell me step-by-step instruction, how to do it pls. I’m newbie in ubuntu:(

Starting WGDashboard with Gunicorn in the background.    |
Failed to read config file: /home/ubuntu/wgdashboard/src/gunicorn.conf.py
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/gunicorn/app/base.py", line 111, in get_config_from_filename
spec.loader.exec_module(mod)
File "", line 848, in exec_module
File "", line 219, in _call_with_frames_removed
File "/home/ubuntu/wgdashboard/src/gunicorn.conf.py", line 2, in
import dashboard
File "/home/ubuntu/wgdashboard/src/dashboard.py", line 23, in
import ifcfg
ModuleNotFoundError: No module named 'ifcfg'
| Log files is under log/
Is it OKAY?

Hi, did you followed my install instructions on https://github.com/donaldzou/WGDashboard#-install ?

yes, of course

I see, it seems like it didn't install all dependencies correctly.
Could you go into wgdashboard/src and type python3 -m pip install -r requirements.txt? Please let me know how it goes ;)

I do that) Didn't have errors now, but I can't connect to dashboard. Am I should to change wh-dashboard.ini?

I don’t think so. Can you check your system’s firewall to allow port 10086? And also check AWS ‘s security setting to allow that port :)
Get Outlook for iOShttps://aka.ms/o0ukef

From: lavaw @.>
Sent: Friday, March 25, 2022 11:38:32 AM
To: donaldzou/WGDashboard @.>
Cc: Donald Zou @.>; Comment @.>
Subject: Re: [donaldzou/WGDashboard] Can’t connect from local machine to AWS server Wireguard (Issue #163)
I do that) Didn't have errors now, but I can't connect to dashboard. Am I should to change wh-dashboard.ini?
—
Reply to this email directly, view it on GitHubhttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fdonaldzou%2FWGDashboard%2Fissues%2F163%23issuecomment-1079149878&data=04|01||e721390feec944cbca3808da0e7584b2|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637838195145876230|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=lfz7xAygYCYVNvGHfQW6WZcc4qm1CZ%2FpTkiZ9rKOv5M%3D&reserved=0, or unsubscribehttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAGARNUPEZRVMBGFIIWI4C4LVBXMXRANCNFSM5RSYQL3A&data=04|01||e721390feec944cbca3808da0e7584b2|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637838195145876230|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=42y5Ek167ZOTWp%2Bs50LyDty9d%2FomK%2FsQlDsNTCPBNyY%3D&reserved=0.
You are receiving this because you commented.Message ID: @.***>

I have opened all UDP ports in my AWS
May be I can't change port in wg-dashboard?

You need to open TCP port too for the dashboard:) since is using HTTP
Get Outlook for iOShttps://aka.ms/o0ukef

From: lavaw @.>
Sent: Friday, March 25, 2022 11:43:37 AM
To: donaldzou/WGDashboard @.>
Cc: Donald Zou @.>; Comment @.>
Subject: Re: [donaldzou/WGDashboard] Can’t connect from local machine to AWS server Wireguard (Issue #163)
I have perfectly worked VPN, but I need dashboard )
—
Reply to this email directly, view it on GitHubhttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fdonaldzou%2FWGDashboard%2Fissues%2F163%23issuecomment-1079154331&data=04|01||b615f2f44a0b41a8331a08da0e763aee|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637838198222705024|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=mb8cdSWVkdjr%2FEgRdGiPgurzkxwsV8Shha5S1jLR2zk%3D&reserved=0, or unsubscribehttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAGARNUJYDATKHXMMTFJGMPTVBXNKTANCNFSM5RSYQL3A&data=04|01||b615f2f44a0b41a8331a08da0e763aee|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637838198222705024|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=p1aW1lynfLJfofCrPkmugajuTcAeUVrhVdeHtemeIK4%3D&reserved=0.
You are receiving this because you commented.Message ID: @.***>

I have change app_ip to my external AWS ip , isn't true?

After open ports I need to restart system?

I have open all TCP ports in dashboard

I have change app_ip to my external AWS ip , isn't true?

I think you should keep it as <IP_ADDRESS>, and you should be good after you opened all your TCP port

If it's <IP_ADDRESS>, I could connect to my VPN server through external AWS IP address ?

Anyway I can't connect to dashboard(
"Starting WGDashboard with Gunicorn in the background.    |
| Log files is under log/   "

Or could you try run the dashboard with ./wgd.sh debug? instead of start

Starting WGDashboard in the foreground.                  |

Serving Flask app 'WGDashboard' (lazy loading)
Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
Debug mode: off
Running on all addresses.
WARNING: This is a development server. Do not use it in a production deployment.
Running on http://172...*:10086/ (Press CTRL+C to quit)

Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:07] "GET / HTTP/1.1" 500 -
[2022-03-25 18:08:08,048] ERROR in app: Exception on /favicon.ico [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:08] "GET /favicon.ico HTTP/1.1" 500 -
[2022-03-25 18:08:12,365] ERROR in app: Exception on / [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:12] "GET / HTTP/1.1" 500 -
[2022-03-25 18:08:13,371] ERROR in app: Exception on / [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:13] "GET / HTTP/1.1" 500 -
[2022-03-25 18:08:21,892] ERROR in app: Exception on / [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:21] "GET / HTTP/1.1" 500 -
[2022-03-25 18:08:22,007] ERROR in app: Exception on /apple-touch-icon-precomposed.png [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:22] "GET /apple-touch-icon-precomposed.png HTTP/1.1" 500 -
[2022-03-25 18:08:22,018] ERROR in app: Exception on /favicon.ico [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:22] "GET /favicon.ico HTTP/1.1" 500 -
[2022-03-25 18:08:22,093] ERROR in app: Exception on /apple-touch-icon.png [GET]
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1514, in full_dispatch_request
rv = self.preprocess_request()
File "/home/ubuntu/.local/lib/python3.8/site-packages/flask/app.py", line 1857, in preprocess_request
rv = self.ensure_sync(before_func)()
File "dashboard.py", line 638, in auth_req
g.db = connect_db()
File "dashboard.py", line 65, in connect_db
return sqlite3.connect(os.path.join(configuration_path, 'db', 'wgdashboard.db'))
sqlite3.OperationalError: unable to open database file
<IP_ADDRESS> - - [25/Mar/2022 18:08:22] "GET /apple-touch-icon.png HTTP/1.1" 500 -

Help me pls) We so close to resolve this problem

I see what is going on now, you need to run the dashboard with sudo, sudo ./wgd.sh start or sudo ./wgd.sh debug ;)

Done. But doesn't loading page..

What will output when you run sudo ./wgd.sh debug?

CONNECTED!!! BUT ONLY WITH VPN CONNECTION(

Nicee, did you set it back to <IP_ADDRESS> in the wgdashboard.ini?

Yes, but without vpn I haven’t access (

Maybe there are some whitelist of IPs on AWS that preventing you to do it?

In your Security group rules, in the AWS dashboard you need to allow: 80 & 10086 on TCP and the source needs to be <IP_ADDRESS>/0

Anyway can't connect without vpn to dashboard

I had a few of these problems running on an AWS EC2 instance and here's what I had to do:

In the security group used by the EC2 instance add an Ingress for TCP port 10086.

In my case I don't want the dashboard exposed to the internet, only available when you have wireguard connected.  So I limit the source to CIDR block <IP_ADDRESS>/8 (all internal traffic).  Then I connect to the dashboard at my Wireguard Server's internal address at http://10.0.0.X:10086
I'm able to do this because I've already got wireguard up and running and my first peer profile created and working before installing this dashboard.  If you're trying to use the wg dashboard to create all the peers you'll need CIDR block to give the world access <IP_ADDRESS>/0 and you can always go back and change it later.

I followed the install instructions (I think!) and ended up with log/, db/ and __pycache__/ directories owned by root and not my default "ubuntu" user. This caused the db/ folder to not be readable and gave me the unable to open database file sqlite errors.  I fixed it with sudo chown ubuntu:ubuntu db/ log/ __pycache__/

Is this fixed @lavaw


React Native support

This is a weird question, but is there a way to use the Stripe JS SDK inside react-native?
Any technical limitations why react-native would need to use iOS/Android SDK's instead of this one?

Hey @TheRusskiy thanks for the inquiry, react native is not currently supported with the JS SDK and we do strongly suggest if you go the react-native route to interop with the native iOS/Android SDKs. Our list of supported browsers is listed at https://stripe.com/docs/terminal/sdk/js#supported-browsers, but we'll be adding explicit guidance surrounding using our android/ios SDKs when using react native.
The limitations are less technical and more that we cannot guarantee stability in this integration shape as we can via the native android/iOS libraries.

thannk you @jdivock-stripe


How to add a new datasource to AppSync API with override.ts ?

Amplify CLI Version
12.3.0
Question
I'm trying to add a new lambda datasource in my AppSync API. This is my override.ts:
import { AmplifyApiGraphQlResourceStackTemplate, AmplifyProjectInfo } from '@aws-amplify/cli-extensibility-helper';
import * as cdk from 'aws-cdk-lib';

export function override(resources: AmplifyApiGraphQlResourceStackTemplate, amplifyProjectInfo: AmplifyProjectInfo) {
    const DS_NAME = "userLambdaDataSource"

    const lambdaDataSource = new cdk.aws_appsync.CfnDataSource(this, 'userLambdaDataSource', {
        apiId: resources.api.GraphQLAPI.attrApiId,
        description: "A lambda datasource for validating input on createUser",
        lambdaConfig: {
            lambdaFunctionArn: 'lambdaFunctionArn',
        },
        name: DS_NAME,
        serviceRoleArn: "arn:aws:iam::0123456789012:role/Role3a6fdff8",
        type: "AWS_LAMBDA"
    })

    const model = resources.models["User"];
    model.appsyncFunctions["MutationcreateUserpreUpdate0FunctionMutationcreateUserpreUpdate0Function.AppSyncFunction"].dataSourceName = lambdaDataSource.name;
}

When running amplify push I get this error:
Cannot read properties of undefined (reading 'addChild')

Any help would be appreciated!

Hi @ggorge-etiqa, Thank you for raising this. To update the model Datasource, please refer to the samples provided in the documentation linked here.

Hi @AnilMaktala , going further with my researches I found out that the problem here is the creation of a new AppSync Datasource resource within the override.ts.
const lambdaDataSource = new cdk.aws_appsync.CfnDataSource(this, 'userLambdaDataSource', {
[...]
})

Can you confirm that it's not possible to add new resources with that file?
To me it seems that it's not possible so I ended up creating a custom resource for the datasource (and all related stuff like IAM Role and policy) with amplify add custom.
But my approach was leading to a kind of circular dependency, as AppSync API must exists in order to create a new AppSync API Datasource customResource. And the model function Datasource override needs the customResource in order to be created.
Although is possible to achieve this with running amplify push manually without the override.ts file, then add the file and run again amplify push, the same can't be done in a single run.
At the moment I'm using a post-push hook to fix the model function Datasource configuration with aws cli commands, but I'm open to try a more amplify-ish approach.

Hi @ggorge-etiqa yeah the route via custom is the correct one, here's a sample: https://docs.amplify.aws/cli/graphql/custom-business-logic/#vtl-resolver
Separately, we recently brought Amplify's API category to CDK as an L3 construct. If you operate within a CDK environment already, it'll likely offer you a more integrated developer experience for creating additional resolvers and data sources. Here's the walkthrough blog post: https://aws.amazon.com/blogs/mobile/announcing-aws-amplifys-graphql-api-cdk-construct-deploy-real-time-graphql-api-and-data-stack-on-aws

Hey 👋 , This issue is being closed due to inactivity. If you are still experiencing the same problem and need further assistance, please feel free to leave a comment. This will enable us to reopen the issue and provide you with the necessary support.


Add pidfdinfo and SocketFDInfo

I added pidfdinfo and SocketFDInfo.

File size has grown a lot with all the new stuff related to FD info.... could consider adding in a separate file even?
All the code looks good. Let me know if you make any changes as a result of comments, or not. I'm happy to merge as is.

I think the file could be separated to files having a C function like below.
proc_pid.rs -> only export for proc_pid namespace
proc_pidinfo.rs
proc_pidfdinfo.rs
...
Anyway, file structure change is big issue.
I think another PR is rquired for it.
Could you merge this?

OK, merged.
Do you want to take a shot at splitting up into multiple files?
If not, we can create an issue and I can try to get to it sometime.

Thanks!
I don't want it.
I have another PR to add proc_pid_rusage.
Should I wait until file separation complete?


chore: Build with -mmultivalue

Build spidermonkey and the js-compute-runtime with -mmultivalue to improve codegen for 128-bit math.
Interestingly, wasm-opt seems to fail to strip the runtime when it's built with -mmultivalue, and additionally wasm-tools validate -f multi-value indicates that there's a function that does not typecheck.

Closing, as it's not clear if we also need wasi-libc to be built with -mmultivalue for this to work.


Are you a github issue?

I bet I am

commit
file reference
pull request

b5d44b64163827c9bafb1d9f846bd7a83022bf34
none
#1

will not fix


Updated incorrect JSON sample response

Hello,
I noticed that there was an extra bracket in the sample response for GetMessages which made it invalid JSON. This PR removes that bracket and reformats the JSON body.

Docs Build status updates of commit 83c2b87:
:warning: Validation status: warnings

File
Status
Preview URL
Details

office-365-management-api/office-365-service-communications-api-reference.md
:warning:Warning
View
Details

office-365-management-api/office-365-management-apis-overview.md
:warning:Warning
View
Details

office-365-management-api/troubleshooting-the-office-365-management-activity-api.md
:warning:Warning
View
Details

office-365-management-api/get-started-with-office-365-management-apis.md
:warning:Warning
View
Details

office-365-management-api/index.md
:warning:Warning
View
Details

office-365-management-api/office-365-management-activity-api-schema.md
:warning:Warning
View
Details

office-365-management-api/office-365-management-activity-api-reference.md
:warning:Warning
View
Details

office-365-management-api/office-365-management-activity-api-faq.md
:warning:Warning
View
Details

office-365-management-api/office-365-service-communications-api-reference.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.
Line 81, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 142, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 282, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 383, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.

office-365-management-api/office-365-management-apis-overview.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.

office-365-management-api/troubleshooting-the-office-365-management-activity-api.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.

office-365-management-api/get-started-with-office-365-management-apis.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.

office-365-management-api/index.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.

office-365-management-api/office-365-management-activity-api-schema.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.
Line 350, Column 0: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? If so, add &preserve-view=true to the URL: https://docs.microsoft.com/powershell/module/sharepoint-online/index?view=sharepoint-ps NOTE: This Suggestion will become a Warning in early December, 2020.

office-365-management-api/office-365-management-activity-api-reference.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.
Line 122, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 205, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 282, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 498, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.
Line 621, Column 0: [Suggestion-column-header-missing] Column headers are required for tables. Add appropriate header text. NOTE: This Suggestion will become a Warning in late September, 2020.

office-365-management-api/office-365-management-activity-api-faq.md

Line 2, Column 1: [Warning-ms-prod-technology-invalid] Invalid value for 'ms.technology': 'ms.technology' is not valid with 'ms.prod' value 'office365'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

I was following this doc to contribute -- https://docs.microsoft.com/en-us/contribute/
I apologize if this is not the preferred method, please let me know the right method and I am happy to re-submit


contact.stranger() still returns true after adding friends between bot and user

Likewise contact.stranger() still returns false after deleting friends.
Have to restart the bot to get the correct returns.

Thanks for catching this.
In order to solve this, you need to do an await contact.refresh() after request.accept().
I'll make the framework do this job for you in a future commit.


Reduce graceful termination window

Reduce graceful termination window to speed up kube-apiserver roll out

set shutdown-delay-duration to 30s (close to worst case scenario by  which an LB should detect /readyz failure) and react. We are saving 40s (previous value=70s)
consequently, set terminationGracePeriodSeconds to 95 seconds, bit more than 30s (shutdown-delay-duration) + 60s (kube-apiserver graceful termination)

/hold
want to run some tests before we merge it.

/hold cancel
I have run test against an aws cluster. If I reduce ShutDownDelayDuration to 10s I see unexpected EOF error.  With 30s, I see no error as the kube-apiserver rolls out.

I've just come across https://docs.google.com/document/d/1BUmtdTth49V02UZ5EjRvJ92A5vjF8wMJMSdPb1Wz3wQ/edit# which gives some tips for the amount of time a graceful shutdown should take.

waiting for gcp route fix
/hold


arg “--frozen” in train.py make no sense？

Hi，when i tried to re-train the model in this repo, I noticed that "While the strategy using VDC to finetune WPDC achieves the best result." is mentioned in your readme file. So I am curious how did your finetune WPDC model? Did you use arg of "--frozen" to make some layer with no grad? I try to write --frozen=="true" in .sh, but make no sense.
Thanks in advance for your reply.

frozen is a redundancy config. Just using VDC loss function to fine-tune a trained model by WPDC is ok.

thanks


bug: span issue

The below is a minimum reproducible example of an issue when passing a Span to one function. For some reason, it looks like native drops the first value in the Span.
use crate::common::{compare_outputs, DEFAULT_GAS};
use crate::common::{load_cairo, run_native_program, run_vm_program};
use cairo_lang_runner::SierraCasmRunner;
use cairo_lang_sierra::program::Program;
use lazy_static::lazy_static;

lazy_static! {
    static ref SPAN_ISSUE: (String, Program, SierraCasmRunner) = load_cairo! {
        use array::ArrayTrait;
        use traits::TryInto;
        use core::option::OptionTrait;

        impl TryIntoU8 of TryInto<Span<u8>, u8> {
            fn try_into(self: Span<u8>) -> Option<u8> {
                if self.is_empty() {
                    return Option::None;
                }
                Option::Some(*self.at(0))
            }
        }

        fn run_test() -> u8 {
            let numbers = array![0x2, 0xe4].span();
            numbers.try_into().unwrap()
        }
    };
}

#[test]
fn test_span_issue() {
    let program = &SPAN_ISSUE;
    let result_vm = run_vm_program(program, "run_test", &[], Some(DEFAULT_GAS as usize)).unwrap();
    let result_native =
        run_native_program(program, "run_test", &[], Some(DEFAULT_GAS as u128), None);

    compare_outputs(
        &program.1,
        &program.2.find_function("run_test").unwrap().id,
        &result_vm,
        &result_native,
    )
    .unwrap();
}

Expected output as returned by the VM run should be 0x2, but native returns the second value, 0xe4.

Hello, after some investigating I think I've managed to isolate and understand the issue. It is definitely more interesting and obscure than others, thanks for reporting it.
I've managed to reduce the program to the following:
fn main() -> u8 {
    // Span is required (can't reproduce without).
    // Call to is_empty is required (can't reproduce without).
    let x = array![0x02, 0xe4].span();
    let _ = x.is_empty();
    *x.at(0)
}

Looking at this we can see that the problem must be related to the Span<T> type and the is_empty() function. When running on the VM, the span is just a relocatable (or relocatable with length; the point being, it's not an actual clone but a reference). In cairo native though, we don't use segments therefore we can't keep a reference since the data will change, so we clone the data. No big deal there: span clones the data.
Now, as for the is_empty method. The method is implemented as follows in the corelib:
#[inline(always)]
#[must_use]
fn is_empty(self: Span<T>) -> bool {
    let mut snapshot = self.snapshot;
    match array_snapshot_pop_front(ref snapshot) {
        Option::Some(_) => false,
        Option::None => true,
    }
}

We can see that:

Takes self by value.
Pops the first element. If there was a value then it's not empty.

Initially we might think about why this works in the VM (I sure did), until I noticed the following:
impl SpanCopy<T> of Copy<Span<T>>;

Remember the spans in the VM which are pointers? The equivalent in rust would be a slice. Slices un rust are copy, as spans are in Cairo. When running on the VM there is no problem because data is immutable, but when running in native we have a bug:

A span is created, which clones the entire array (realloc + memcpy).
The is_empty method is called on the span. This causes the span to be copied (not cloned) at Sierra level. In other words, there are now two different spans sharing the same pointer.
The is_empty method pops the first element of the span, shifting all the elements in the pointer left once.
When the is_empty method returns, the original span still has the same allocated capacity and length, but now the contents are different. The first element is gone and everything else has been shifted. The last element now is undefined behaviour (well, it should contain a copy of the last value, but that's besides the point).
That's why you're getting the second element instead of the first.

Note to self: Check if we are properly freeing allocated memory in Span<T>. Since the type also implements drop (getting dropped silently) it's probable that we aren't freeing the memory.

Thanks for the explanation! So what would be the solution? Would you have to manually implement Copy for all the core lib types that implement it?

That's one way to do it. I was thinking more about changing the meaning of the internal representation of arrays for snapshots, but I did some testing yesterday and I'm not sure that's possible. If it wasn't possible then I'd need to change both the arrays and array snapshots.

hey @azteca1998 any update on the issue?

Yes, we need to replace both arrays and the spans. I'm rewriting the entire array module. If all goes correctly I should have a fix ready tomorrow or the day after.

An update: I've been battling a bug in the PR. Basically cloning an array generates an invalid internal structure, which causes the program to either crash with a safety assert we've introduced just in case or segfault directly.
The new representation should be roughly equivalent to the following:
struct ArrayRepr {
    ptr: *mut (),
    start_offset: u32,
    end_offset: u32,
    capacity: u32,
}

The following example illustrates the problem:
use array::ArrayTrait;

fn run_test() -> Array<u8> {
    let mut numbers = ArrayTrait::new();
    numbers.clone()
}

Here, an array is created, then cloned and the clone is returned. For some reason there's an inc (increment) instruction executed that increments start_offset when cloning the array. I've made sure it's that instruction by skipping it with the debugger and it passed the test without problems, so I'm pretty sure it's that specific instruction.
As for the MLIR code I've checked multiple times and I haven't found the place where it could generate that instruction. There's some places where the value is incremented (such as pop_front) but the execution shouldn't reach that specific MLIR operation in the example because it only gets executed if the array is not empty.
Of course, the Sierra code doesn't do that either. The clone implementation uses array_append and array_pop_front but again, array_append shouldn't be called when array_pop_front returns None and the implementation for array_pop_front shouldn't increment anything if it has no items.
This leads me to think that it's a bug in either MLIR or LLVM but I haven't been able to confirm that yet.

Thanks for the update! I don't know if I can be of any help here but let me know if I can do anything to try to solve this.

Another update:

It turns out that the bug I found earlier while trying to fix the test wasn't related to the test.
The test ran array_new, array_get, array_pop_front and array_append directly, but the bug wasn't there either. It was in my implementation of snapshot_take, which was added implicitly by the Cairo compiler. It has already been fixed.
I'll continue fixing the remaining failing tests and mark this PR as ready so we're no longer blocking you, then I'll tackle the clone bug again (unless I get a different task with higher priority, of course).

It turns out that the test was failing because we were doing the equivalent to this (in C)
void *src_ptr = ((void *)ptr) + start_offset;
memcpy(dst_ptr, src_ptr, length);

instead of this:
void *src_ptr = ((void *)ptr) + sizeof(elem_ty) * start_offset;
memcpy(dst_ptr, src_ptr, length);


Remote Supabase Install Failed

What you were expecting:
Install of  a remote supabase project
What happened instead:
The remote install script failed since the superbase installed version did not wait for the verification code.  The script had a message that supabase CLI was not the latest, so I performed an npm upgrade on supabase.  The script now waits for the verification code, but it fails with:
Enter your verification code: XXXXXX
Token<EMAIL_ADDRESS>created successfully.
You are now logged in. Happy coding!
? Enter the name of the project: Atomic CRM
? Enter a database password: XXXXXX
file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:62
)[1];
^
TypeError: Cannot read properties of null (reading '1')
at createProject (file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:62:6)
at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
at async file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:16:24
Node.js v23.1.0
make: *** [supabase-remote-init] Error 1
Steps to reproduce:

make supabase-remote-init
Related code:

A link to a GitHub repo with the minimal codebase to reproduce the issue

insert short code snippets here

Other information:

Environment

atomic-crm version: 0.2
Last version that did not exhibit the issue (if applicable): N/A
React version:

├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS><EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>
Browser: Firefox
Stack trace (in case of a JS error):

file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:62
)[1];
^
TypeError: Cannot read properties of null (reading '1')
at createProject (file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:62:6)
at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
at async file:///Users/XXXXXX/WebstormProjects/atomic-crm/scripts/supabase-remote-init.mjs:16:24

A few other data points:   The package.json uses "supabase": "^1.136.3".   That version of supabase CLI did not wait for the verification code.  I upgraded to 1.223.10, and the remote install process now waits for the verification.  However, after entering the verification code, I get the error described above.

Thanks for the report. It seems Supabase has added additional security checks on the admin API. We'll look into it!

Can you try again? We fixed the init script in #76.