Registration issue with an actual TPM

This article discusses registration with a simulated device, how would I extract the endorsement key to register a TPM chip using the actual hardware?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5ad3c33c-2caa-75e0-96a3-ca4a29e814ca
Version Independent ID: 64e42622-8357-26e3-3ce5-1a501db451fc
Content: Provision a simulated TPM device to Azure IoT Hub using Node.js
Content Source: articles/iot-dps/quick-create-simulated-device-tpm-node.md
Service: iot-dps
GitHub Login: @wesmc7777
Microsoft Alias: wesmc

@boiledeggs Have you reviewed the TPM Software Stack (TSS) implementations. It offer support for various languages. There is support for:

Creating a new Endorsement key
Reading the injected endorsement key

@boiledeggs Your might be more interested in the Node.js impelmentation here instead of the lower level CPP implementation I previously posted.
Also, for a Windows 10 Device you could just use the Get-TpmEndorsementKeyInfo cmdlet with PowerShell

It appears that the author has answered the question, so I'm closing this issue. Thanks!


[Feature Request] Lock bot to a server, do not allow inviting to other servers

Describe the solution you'd like
Right now it appears as if anyone can add this bot to their server and use my resources, It's on a very low powered server so I'd like if possible to just selfhost it for myself. Could we add a command in the config to only allow the server to respond on particular server ID's?
Describe the basic flow/steps of using this feature
How this feature would be used:

Enable server-allowlist in config
Enter in server ID

Thanks! Done in discord now.


Build Image is given openSSL Error

ci-builder-3 (out): Build Image error  { [Error: write EPROTO<PHONE_NUMBER>95456:error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate:../deps/openssl/openssl/ssl/s3_pkt.c:1300:SSL alert number 42
ci-builder-3 (out): ] code: 'EPROTO', errno: 'EPROTO', syscall: 'write' }
ci-builder-3 (out): { [Error: write EPROTO<PHONE_NUMBER>95456:error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate:../deps/openssl/openssl/ssl/s3_pkt.c:1300:SSL alert number 42
ci-builder-3 (out): ] code: 'EPROTO', errno: 'EPROTO', syscall: 'write' }
ci-builder-3 (out): 2015-08-09T08:37:01.175Z - warn: [Build Worker] Build failed:
ci-builder-3 (out): 2015-08-09T08:37:01.175Z - warn: [Build Worker]  Error: write EPROTO<PHONE_NUMBER>95456:error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate:../deps/openssl/openssl/ssl/s3_pkt.c:1300:SSL alert number 42

Hi!
Please read this important information about creating issues.
If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
This is an automated, informational response.
Thank you.
For more information about reporting issues, see https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
uname -a:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

@agrawalapoorv I'm sorry, but your description does not have enough information for us to know what steps you took to run into this problem.
If this is an error that occurs during building an image (what I suspect, based on the title), this is probably because your image doesn't have the required certificates installed inside the image. For some hints, see http://serverfault.com/questions/616051/how-to-debug-certificate-chains-with-openssl
Please keep in mind that the GitHub issue tracker is not a general support forum, and only for reporting bugs and feature requests in Docker itself. For other kind of issues, see https://github.com/docker/docker#talking-to-other-docker-users-and-contributors
I'm going to close this issue, but feel free to comment here if you have more information, or think I closed this by mistake


Unnecessary sorting in ASN1Set when generating DER

ASN1Primitive toDERObject() dose not identify properly if it should sort a Set.
Example: signedAttrs of CMS should be constructed in the same order as when it was signed. But now the atributes are sorted so the order is changed, and it is impossible to verify Signature put ont this signed attributes.
The realf life example of the issue, regarding timestamp verification is here https://ec.europa.eu/cefdigital/tracker/browse/DSS-1591
Here is our proposed modification to this part of code:

core/src/main/java/org/bouncycastle/asn1/ASN1Set.java | 21 +--------------------
1 file changed, 1 insertion(+), 20 deletions(-)
diff --git a/core/src/main/java/org/bouncycastle/asn1/ASN1Set.java b/core/src/main/java/org/bouncycastle/asn1/ASN1Set.java
index 9865533..527c7e8 100644
--- a/core/src/main/java/org/bouncycastle/asn1/ASN1Set.java
+++ b/core/src/main/java/org/bouncycastle/asn1/ASN1Set.java
@@ -380,31 +380,12 @@ public int hashCode()
*/
ASN1Primitive toDERObject()
{

   if (isSorted)

   {
       ASN1Set derSet = new DERSet();

       derSet.set = this.set;

       return derSet;

   }

   else

   {

       Vector v = new Vector();

       for (int i = 0; i != set.size(); i++)

       {

           v.addElement(set.elementAt(i));

       }

       ASN1Set derSet = new DERSet();

       derSet.set = v;

       derSet.sort();

       return derSet;

   }

}

There is an explenation for this  here http://bouncy-castle.1462172.n4.nabble.com/SignerInformation-class-returns-the-signed-attributes-indexed-by-the-OID-td4658076.html


SAML SSO for WSO2 IS Management Console is failing

Steps to reproduce:

Configure SAML SSO for WSO2IS Management console
Login to management console.
Redirected to "https://localhost:9443/acs" url with 401 error

This is due to the regression caused by the fix done for the git issue: https://github.com/wso2/product-is/issues/5907
Found in 5.9.0 and public
To fix this issue,
<Resource context="/acs(.*)" secured="false" http-method="all"/> need to be added to identity.xml file

This happens only if we remove the deployment.toml file in the first startup and run the server.
With the proper configs in deployment.toml file, SSO is working.
[admin_console.authenticator.saml_sso_authenticator]
enable = true
login_page = "/carbon/admin/login.jsp"
assertion_consumer_service_url = "https://localhost:9443/acs"
identity_provider_sso_service_url = "https://localhost:9443/samlsso"


use prettier

Coverage increased (+0.04%) to 97.814% when pulling ce7130e4de1d4ee5ee24194a3fefa0a92c14b2a6 on prettier into 0e742af0c8abe7bfef59c9d4b40dcc8aef9ac4b4 on master.


Finding tweet from ID

Does anyone know how I can get a tweet object from the ID only?

Yeah, I found a way around using selenium. Have a look at https://github.com/digitalPlayer1125/twitterUsernamefromUserID

@digitalPlayer1125 thanks man! Been digging for a while for a way.


示例创建错误

执行示例：
panbook book

报错如下：
Error running filter D:/Book/PanBook/extensions/column/fenced_divs_columns.lua:
D:/Book/PanBook/extensions/column/fenced_divs_columns.lua:51: attempt to call a nil value (field 'Doc')
stack traceback:
File frontmatter.tex not found in resource path
sed: can't read /d/Book/mybook/build/mybook-book-ctexbook-pc.tex: No such file or directory
sed: can't read /d/Book/mybook/build/mybook-book-ctexbook-pc.tex: No such file or directory
/d/Book/PanBook/modules/book/book.sh: line 63: latexmk: command not found

找不到frontmatter.tex，请问这是什么原因？

你的 pandoc  是什么版本

执行示例：
panbook book
报错如下：
[~/workspace/DocWorkspace/panbook_demo]$ panbook book
[NOTE] Welcome to PanBook!
[NOTE] use -V device:(pc|mobile|kindle) to produce different size of pdf
[NOTE] use -V cover:(1-60|R|N|filepath) select cover background.R=random,N=no cover,filepath=custom cover file
[NOTE] use -V pagestyle:style to set pagestyle
Error running filter /home/zxw2600/workspace/DocWorkspace/PanBook/extensions/column/fenced_divs_columns.lua:
...kspace/PanBook/extensions/column/fenced_divs_columns.lua:51: attempt to call a nil value (field 'Doc')
stack traceback:
Error running filter /home/zxw2600/workspace/DocWorkspace/PanBook/extensions/column/fenced_divs_columns.lua:
...kspace/PanBook/extensions/column/fenced_divs_columns.lua:51: attempt to call a nil value (field 'Doc')
stack traceback:
File frontmatter.tex not found in resource path
sed: can't read /home/zxw2600/workspace/DocWorkspace/panbook_demo/build/panbook_demo-book-ctexbook-pc.tex: No such file or directory
sed: can't read /home/zxw2600/workspace/DocWorkspace/panbook_demo/build/panbook_demo-book-ctexbook-pc.tex: No such file or directory
Latexmk: This is Latexmk, John Collins, 26 Dec. 2019, version: 4.67.

------------
Latexmk: Could not find file '/home/zxw2600/workspace/DocWorkspace/panbook_demo/build/panbook_demo-book-ctexbook-pc.tex'.
-- Use the -f option to force complete processing.
[ERRO] book Compile status is not 0. Please Check. you may add -d or --trace to see more output

[~/workspace/DocWorkspace/panbook_demo]$ pandoc -v
pandoc <IP_ADDRESS>
Compiled with pandoc-types 1.22.1, texmath 0.12.4, skylighting 0.12.2,
citeproc <IP_ADDRESS>, ipynb 0.2
User data directory: /home/zxw2600/.local/share/pandoc
Copyright (C) 2006-2022 John MacFarlane. Web:  https://pandoc.org
This is free software; see the source for copying conditions. There is no
warranty, not even for merchantability or fitness for a particular purpose.

[~/workspace/DocWorkspace/panbook_demo]$ pandoc-crossref -v
pandoc-crossref v<IP_ADDRESS> git commit UNKNOWN (UNKNOWN) built with Pandoc v<IP_ADDRESS>, pandoc-types v1.22.1 and GHC 8.10.7

经过测试支持的最新版本是 2.14.2，2.15及以上版本还需要一些时间调查。

pandoc是<IP_ADDRESS>，我现在尝试下2.14.2

经过测试支持的最新版本是 2.14.2，2.15及以上版本还需要一些时间调查。

已支持 pandoc <IP_ADDRESS>


Update contentType.schema.tpl.json

Slight changes in the contentType schema according to discussion in PR https://github.com/HumanBrainProject/openMINDS_instances/pull/2

Looks good. Shall I merge? Are you ok with squash merge, to have this appear as a single commit?

@apdavison yes please go ahead and merge. Squash merge is fine, and thanks for the quick review :)


iOS failing to build on Phonegap Build

hello again, I have been testing this on Android for a few weeks now and it works perfectly.
but iOS is failing to build on Phonegap Build.  I included in my config.xml to not do iOS6 (preference name="deployment-target" value="7.0") but it still fails to compile.  error:
cordova-plugin-geofence/GeofencePlugin.swift:20:49: error: use of undeclared type 'CDVPlugin'
full build log here:  https://www.dropbox.com/s/v6codigjsxgfe16/build.txt?dl=0
ps - I am using the npm version (https://www.npmjs.com/package/cordova-plugin-geofence)

Any progress with this?
Would too like to have it working with Phonegap Build :)

not yet.  still works well on Android.

I am having the same issue.  Any progress on your end?

nope, haven't messed with it lately.

I think this should be resolved by 8242ef1.


Fixing ConcatOp when one of the inputs doesn't have gradient

Fixes #1130

@piiswrong seems like github deleted your comment as I updated the PR O.o
Replaced the mask with a vector, and fixed the linter error that I introduced last time.

Hi, guys,
Is there anything blocking from merging it in?

Sorry. Travis has been really slow recently. Merged.

Oops. I probably merged too soon. There is a potential problem: when req[i] = NullOp, the corresponding in_grad blob may not be initialized, so calling get_with_shape on it is not safe. Plus it would be good if you can also handle AddTo.
two suggestions:
There is no need for a mask, just pass in req
Save the dimensions in forward pass. because in backward pass, for NullOp, neither in_data nor in_grad is available.
Could you do the fix and open another PR?

Thanks for the contribution, I have added you to https://github.com/dmlc/mxnet/blob/master/CONTRIBUTORS.md Please feel free to update contents about your self, and help making mxnet better

@piiswrong, note that I do not call get_with_shape if req[i] is kNullOp, I moved it down after check. I only get one dimension of the shape from in_grad. The shape appears to be always initialized (the test I wrote intentionally runs the case with nullop before the case without so that properly initialized memory doesn't appear there by chance, and it seems to pass).
I will apply your suggestions and send a PR. I might not be able to do it this/next week, but in the current state code seems to be not worse than before, so it is unlikely to cause any problems in the meantime.


Update to Bootstrap Icons 1.5.0

Bootstrap Icons 1.5.0 have been released, so this package could be updated accordingly: https://github.com/twbs/icons/releases/tag/v1.5.0

Upgraded, thanks for the report.

Thanks for the update and release. :-)


Vue 3 Script Setup syntax + style tag scoped = bug

Link to minimal reproduction
https://github.com/gde-pass/Vue3-Design-System-Template
Rollup Version
4.12.0
Vue Version
3.4.19
Node Version
18.13.0
Operating System (or Browser)
Chrome
Expected Behaviour
Build without error when i have a vue 3 component using script setup syntax + style tag with scoped property
Actual Behaviour
When i try to build my design system with a component using script setup syntax and with a scoped style tag i get this error:
[!] (plugin rpt2) RollupError: src/components/testworld/TestWorld.vue?vue&type=script&setup=true&lang.ts:4:22 - error TS7006: Parameter 'n' implicitly has an 'any' type.

The error is gone when:

I remove the scoped from style tag
I use DefineComponent syntax (with this syntax i can use scoped)
I setup tsconfig with strict: off ( not a solution )

To be very clear, those 2 following components will NOT generate any error during build time:
<template>

      {{ age }}

</template>

<template>

      {{ age }}

</template>

And this is a component generating the error above:
<template>

      {{ age }}

</template>

System Info
System:
    OS: macOS 14.2.1
    CPU: (10) arm64 Apple M1 Max
    Memory: 32.36 GB / 64.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 18.13.0 - ~/.nvm/versions/node/v18.13.0/bin/node
    Yarn: 1.22.19 - ~/.yarn/bin/yarn
    npm: 8.19.3 - ~/.nvm/versions/node/v18.13.0/bin/npm
  Browsers:
    Brave Browser: <IP_ADDRESS>
    Safari: 17.2.1
  npmPackages:
    vue: ^3.4.19 => 3.4.19

Use Vite.

Use Vite.

Vite use rollup ...

https://github.com/vuejs/rollup-plugin-vue

This is no longer maintained. Use Vite and @vitejs/plugin-vue instead.

As @Shyam-Chen said, you should use @vitejs/plugin-vue instead of rollup-plugin-vue


Unclear how to set environment variables in build & shell

Hi all -- wonderful library!
I'm attempting to use playwright for browser automation on nodejs, but simply installing the library via npmlock2nix fails because it has an install script that will download bundled browsers (naturally, this isn't allowed in a Nix environment).
I can work around the install script by forking npmlock2nix and updating it to pass the --ignore-scripts flag to the npm install command on in internal.nix#L401. However, I'd prefer to use environment variables supported by Playwright to turn off installing browsers.
Outside of Nix I can do that like this:
$ PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD=1 npm i --save playwright
...
Skipping browsers download because `PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD` env variable is set
...

However, I'm struggling with getting this environment variable to take when using npmlock2nix. I tried putting it my shell:
{
  shell = npmlock2nix.shell {
    # No effect as far as I can tell
    PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD = 1;
    preConfigure = ''
      # No effect as far as I can tell
      export PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD=1
    '';
    shellHook = ''
      # Too late, installation has already occurred
      export PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD=1
    '';
  };
}

Most likely this is just my experience, but I'm not seeing how I can set environment variables here that NPM will pick up. Any advice is appreciated!

Actually, setting the environment variable in the shell derivation is working:
{
  shell = npmlock2nix.shell {
    ...
    PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD = 1;
    shellHook = ''
      echo $PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD
    '';
}

Starting a Nix shell with the above code, with install scripts disabled, will print out 1 (or whatever you set the env var to) in the console. So clearly this env variable is around, but it doesn't appear to be taking effect when NPM is running the installation. Is it possible that it isn't propagating from the shell to the internal call to the node_modules function?

Ah! Ok, this is what node_modules_attrs must be for, then:
{
  shell = npmlock2nix.shell {
    node_modules_attrs = { PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD = 1; };
  };
}

This behaves the way I would expect: even without install scripts disabled, this properly skips the browser download.


Grafana changes

Removed unused grafana files and added two files to be used for the v1.0.0 tutorials
grafana-v1.json to be used with Istio v1 telemetry, grafana-v2.json to be used with Istio v2 telemetry. Both assume deployment based iter8 experiments and Kubernetes v1.16 and above.
Tested Telemetry v1 with istio1.4.6 and and telemetry v2 (same as the Kubecon demo file)- tested with Istio 1.6.3

Remove the grafana dashboard json from config folder and move to integrations folder.

Superseded by https://github.com/iter8-tools/iter8/pull/288. Closing.


Add the RegisterRepresentable trait and related functions

This PR adds the RegisterRepresentable trait described in https://github.com/alttch/rmodbus/issues/36.
It also adds:

U32LittleEndian, U32BigEndian, U64LittleEndian and U64BigEndian as implementors of that trait.

Some test code in the tests module
Some module level documentation

RegisterBuffer<const N: usize, T: RegisterRepresentable<N>> which is automatically implemented on buffers that
RegisterRepresentable can be converted to.
A small note in the README.md file about custom types implementing RegisterRepresentable.

This PR is not ready yet, because the README.md has a <todo: insert version number here> spot where it
describes when RegisterRepresentable was added. The Cargo.toml version number also hasn't been updated because I'm not
sure how/if you would like to increase the version numbers now.

Another thing I haven't added is an entry to the changelog. I'm not sure what version number this goes under yet.

seems good! merged


OIDC Provider has inconsistency problems with scope and audiences naming

Environment Details

Helidon Version: 1.0.3

Helidon SE

JDK version:
java version "11.0.2" 2019-01-15 LTS
Java(TM) SE Runtime Environment 18.9 (build 11.0.2+9-LTS)
Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.2+9-LTS, mixed mode)

OS: Windows 10 & Ubuntu 18.04

Docker version (if applicable): N/A

OIDCS Version : 18.4.2-1903181528

Problem Description
Using the oidc-login example and executing the  /jersey Endpoint
Within the JerseyResource.java file the rest method specifies two scopes called "first_scope" and "second_scope"
one would think that set the primary audience to something like "http://localhost:7987" in the application.yaml and the scopes in resources to first_scope and second_scope.
If you set this then the example will fail with the following error before doing the redirect to oidcs for authentication
{"error": "invalid_scope", "error_description": "Invalid scope."}

If you set the audience to have two trailing forward slashes e.g. http://localhsot:7987// then the solution will work and redirect to OIDCS for authentication.
However once authentication has succeeded the redirect back to the original URL fails and goes into infinite loops. I believe this is covered by issue https://github.com/oracle/helidon/issues/644
Problem is reproducible every time
use idcs-login example

Doing some additional debugging
Using the idcs_login example
Within IDCS i have

the primary audience as http://localhost:7987
Scopes as "/first_scope" and "/second_scope"
IDCS Shows the full scope name as http://localhost:7987/first_scope and http://localhost:7987/second_scope

Debugging the code , specifically line266 of OidcProvider.java, I introspected the queryString being generated for OIDCS and I see
(URLDecoded and obvuscated) gives me
client_id=xxxx&response_type=code&redirect_uri=http://localhost:7987/oidc/redirect&scope=openid http://localhost:7987//second_scope http://localhost:7987//first_scope&nonce=xxxx&state=/jersey

Here we can see a double // between the audience and the scope.
This is the issue

workaround : do not have scopes starting with / and ensure audiences end with a /

The fix works as follows:

if scope audience is not configured, the scope is requested without leading slash
if scope audience is defined, the scope is requested as scope audience + / + scope name, ensuring there is exactly one / between audience and name


[BB-09] Integration of downloadable links to the website render + Bonus

YouTrack: BB-09
Integration for the output div is alsmost done. I have to verify with some use cases to see if all works well.
Bonus: history of the conversation not finished yet because there is a bug in the display.

As you can see on this screenshot, when we return 2 resources, the display isn't great (both in the output and the history). I'm on it to debug the problem.

The problem is fixed 😉.
I also created a TS file for the demo purpose where we can add as many links as we like (to be displayed on the website), so that we won't have to juggle between several files to change them.

The problem is fixed 😉.
I also created a TS file for the demo purpose where we can add as many links as we like (to be displayed on the website), so that we won't have to juggle between several files to change them.

Just in case @PyyLog you are not making any other changes ?

For this PR, no anymore.


help....

when i try to add this; git checkout 254b42f067893ce32a10e8a99b2dfbec2149cb54
i get this;  git checkout 254b42f067893ce32a10e8a99b2dfbec2149cb54
Note: switching to '254b42f067893ce32a10e8a99b2dfbec2149cb54'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:
git switch -c
Or undo this operation with:
git switch -
Turn off this advice by setting config variable advice.detachedHead to false
HEAD is now at 254b42f only include config if we have config
what should i do?  linux ubuntu

you posted this issue in the wrong github repo, this error is from a different repo
the video says to use a different repo and the link is in the video description
it links to nebula to credit nebula for the making of the jailbreak
but it says right below to use the other repo to follow the video instructions
this is normal behavior of git clone --recursive https://github.com/tihmstar/libgeneral.git
it is only after that command is done that you continue following the video instruction
cd libgeneral
git checkout 254b42f067893ce32a10e8a99b2dfbec2149cb54
./autogen.sh
sudo rm -f /usr/local/lib/libgeneral*
make clean
sudo make install
ls /usr/local/lib/libgeneral*
cd ..

this will install the libgeneral dependency which is required for the script on that other repo to work
i cut the video right after i hit git clone and cut back after it was done cloning because it took a while
then you must also run pip3 install pyimg4 and continue to follow video instructions
if you could close this issue and reopen it here with the same content on the other repo i think nebula would appreciate it

I'm sorry but my English is not too good just can u tell step by step what should i do?

first, you should only use that fork if you’re on high sierra
second, the readme is pretty in-depth


Fix issues in Testerina code coverage in Jacoco XML

Description:

[ ] Case 1

The line nos 217, 237, 257 are never get covered with unit tests. But the report shows as they are covered.
https://app.codecov.io/gh/ballerina-platform/module-ballerina-oauth2/compare/165/tree/oauth2-ballerina/client_oauth2_provider.bal

[x] Case 2

The coverage still shows as uncovered even when tests are written for the highlighted line. Need to investigate on this.
isolated function externPublish(Client clientObj, string subject, byte[] data,
string? replyTo = ())returns Error? = @java:Method {
https://github.com/ballerina-platform/module-ballerinax-nats/blob/release-1.1.0-alpha8/nats-ballerina/client.bal#L79
Steps to reproduce:
Affected Versions:
OS, DB, other environment details and versions:
Related Issues (optional):

Suggested Labels (optional):

Suggested Assignees (optional):

Case 1 will be tracked in the issue https://github.com/ballerina-platform/ballerina-lang/issues/30550


nixos/duplicati: add port and datafolder options

Motivation for this change
Add some modularity to the duplicati module.
It's now possible to specify the port duplicaty is listening on with services.duplicati.port and the datafolder with services.duplicati.datafolder.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

Having configuration options is always a good idea of course, but isn't the datafolder just used for storing the internal state in which it really doesn't matter where it goes, no?
While you're at it, please make the interface on which it listens configurable instead of the current any. Having it listen on all interfaces seems like a security issue waiting to happen.

@peterhoeg Thanks for the review. You are right the datafolder is only used to store the state of the backups so it could be hardcoded as it would not be a big deal.

In the name of security, how about changing the default interface to localhost and make a note in the description about setting it back to any if needed?

@peterhoeg done !


IPA Dictionary for Italian

Any plans to add Italian IPA dict? Thanks.

@dohliam thanks! I will have a look to find a good dictionary for that.
For the spelling part in IT there are the hunspell dictionaries here: https://github.com/loretoparisi/dictionaries
adapted to HunSpell from LibreOffice dictionaries:
https://github.com/LibreOffice/dictionaries
that have dictionaries for

hunspell - basic spell check using the Hunspell engine
hyphen - words hyphenation
thesaurus - synonyms and acronyms
grammar - grammar check using different frameworks, e.g LanguageTool, Lightproof

while CMUSphinx is a good source for the phonetics dictionaries: https://cmusphinx.github.io/ and they have the Italian Phonetics Dictionary (used to build a Grapheme to Phoneme prediction as well) in the downloads: https://cmusphinx.github.io/wiki/download/ and here: https://sourceforge.net/projects/cmusphinx/files/Acoustic and Language Models/Italian/
as well as other languages.

@dohliam You are welcome, as you said it's a good start! I think it's a good idea to use CMU Sphinx directly to generate a phonetic output using the model provided for the italian (that is the file it.fst), this should handle the problem of out of vocabulary words. Let me have a look at the model. Of course since the training was done on a small dictionary (the 7109 entries) we could also have false positive in the output, but this is something we should check later on.
By the say according to the it model readme for this model we have:
                          EVALUATION RESULTS
----------------------------------------------------------------------
(T)otal tokens in reference: 2528
(M)atches: 2404  (S)ubstitutions: 122  (I)nsertions: 0  (D)eletions: 2
% Correct (M/T)           -- %95.09
% Token ER ((S+I+D)/T)    -- %4.91
% Accuracy 1.0-ER         -- %95.09
       --------------------------------------------------------
(S)equences: 357  (C)orrect sequences: 257  (E)rror sequences: 100
% Sequence ER (E/S)       -- %28.01
% Sequence Acc (1.0-E/S)  -- %71.99
######################################################################

I will try to run the model over the Hunspell dict and we will se how accuracy goes on the test set.
I have put the stuff here as well: https://github.com/loretoparisi/ipa-phonetics-dict/blob/master/it/README

@loretoparisi That's amazing! Sounds like it could be a much better approach, and it will be interesting to see how accurate the results are on the Hunspell list. In the meantime I'll see what I can do about the syllabification issue -- hopefully there are enough clear rules about what constitutes a syllable that we can automate the conversion of stress markers in the final result.

@loretoparisi Just checking in... Have you had any progress with this so far? It would be great to add Italian to the database once it's ready! :smile:

@dohliam I have basically used this one https://github.com/loretoparisi/ipa-phonetics-dict/tree/master/it For the spelling accuracy I have to go back since I did times ago. I will update.

@loretoparisi Excellent, thanks! :+1: I have this version from before but will wait for the update to convert it and add to the database.

I've just discovered your project. Any further progress on adding Italian to the database?

@doolio The links above are the latest progress I am aware of with the Italian IPA list. In case you would like to try working with something in the meantime, there are two options: this list which is not very large and has been auto-generated based on the Italian CMU dictionary, and [this one] which attempts to use a G2P approach to handle out-of-vocabulary words. Neither of these has been manually checked for errors, though, which is why there is currently nothing for Italian yet in the main repo here. All contributions welcome! :smile:
@loretoparisi Have you had the chance to take a look at this recently? It would be great to add Italian to the project if possible.

Thanks. Yes, I had a look at the first list already as it was linked earlier in this discussion. You seemed to have forgotten the link to the second list. I'm trying to learn Italian and in doing so if I improve these lists I will of course contribute them back here.

@doolio Fixed the link, but that page is also linked earlier in this discussion, so you may have seen it already. In both cases, the output needs to be checked by someone to make sure there are no glaring errors in the transcription. My sense is that Italian orthography might be regular enough that there would likely not be more than a few outliers or exceptions for a rule-based transcription, but it would be nice if someone could confirm that and correct the output if needed.


manually fixed the "weather:" in nootmessage

made so you dont have "weather:" always displayed when using the weather command. Modified the NootMessage formatting to be more cleaner

I think your fork is out of sync with mine. Do you mind rebasing your fork to be the same as mine then adding your changes on top of that? I'd prefer to not have to merge in 13 commits.

I think your fork is out of sync with mine. Do you mind rebasing your fork to be the same as mine then adding your changes on top of that? I'd prefer to not have to merge in 13 commits.

Ok ill try again.


fix: aila initialisation without await

Description

The Aila initialisation step does not need to be async/await

I think this is actually a symptom of a bug - this initialise method is async and should be called here, so I will verify and close if so


Add Questionnaire link to Information page

Issue
#77
Overview (Required)
Add link for questionnaire page
This is temporary solution for the questionnaire page.
Links

Screenshot

Before
After

👀

LGTM! 👍 Thanks!

😆


Mistral?

Any particular reason Mistral models aren't mentioned in this list (https://arxiv.org/abs/2310.06825)

it would definitely included in the next update! Thanks for bring this!


Optimize structure value normalization

https://github.com/USACE/go-consequences/blob/a9f63830065e5150dd88ca01ac554c56607ec0ef/structures/structure.go#L113
This whole calculation is repeated for every frequency, but the value would be the same every time for the same structure. Could be a good place to optimize.

we need to consider all uses of go-consequences. Non flood uses like earthquakes which need full valuation, and non frequency based usages.
sometimes sacraficing optimization for consistency in approach across a diverse set of stake holders is warrented.

what's the driver for earthquake damages? is normalization based on the number of floors on a structure as a proxy for its height a good assumption?

it is the only assumption i have right now. once we get the building heights algorithm for the NSI using the 3DEP data, i will be able to drive that with remote sensed data and it will be more reliable.
Shakemap is a driver for earthquake hazards, the drivers for damage are wavelengths and magnitudes and some other parameters, i havent writtten that all yet.

The two parts of that question are tied. So the driver of inundation and wave damages is physical depth, of which the domain is

Yes, it will. But no other multivariate driver functions exist for flood at this point. The closest is erosion.
the real problem is that damage functions need to span the height of a structure, but that is not how the egm curves work.

This discussion is probably more suited for when we have a comprehensive skeleton of the system and people start to complain that it's running too slowly.

agreed


defaultMemoize leak the memory

Hi, since the defaultMemoize will store the memoized data in a closure, it won't ever be collected, even if the original instance is lost and that code won't ever be reached. Would be better to use WeakMap and fallback to closure if it's not supported.

I'm not sure I follow your thinking here. Would you expect this to leak memory?
const createSelector = require('reselect').createSelector

const generate = () => [...Array(100000).keys()]

while(true) {
  const state = { stuff: generate() }
  const mySelector = createSelector(state => state.stuff, stuff => stuff.map(x => x * 2))
  const values = mySelector(state)
}

Closing due to inactivity


ConcatWithoutSpacesFixer - Keep indent

@ see https://github.com/FriendsOfPHP/PHP-CS-Fixer/issues/1589

Does the same bug exist in ConcatWithSpacesFixer?

I would like to hear if people like the idea of have the methods isIndented and ensureSingleWithSpaceAt since that is what this is all about.
I can revert all other changes on the fixers other than the ConcatWithoutSpacesFixer, or even that one and do the Tokens changes first.

btw. this would solve https://github.com/FriendsOfPHP/PHP-CS-Fixer/issues/1354 as well (for a part at least)

?

I longer saw no way to fix this in a proper matter, so I go back to the drawing board with all of this.


[1.x] Exclude properties from partial responses

Please make sure to mark this as ready for review if you need one.

@driesvints just want to get the client PR ready first


After saving and reopening project the camera settings are not preserved

Discord username
No response
What type of issue is this?
Permanent – Ocurring repeatably
Is this issue blocking you from using Enso?

[ ] Yes, I can't use Enso because of this issue.

Is this a regression?

[ ] Yes, previous version of Enso did not have this issue.

What issue are you facing?

Open an existing project.
Pan/zoom the scene.
Close and reopen the project.

Project after reopening has a default zoom and focus, not the last saved one. If the nodes were added - they are there, so the file is updated.
Expected behaviour
Camera settings should be saved with project metadata.
How we can reproduce it?
No response
Screenshots or screencasts
No response
Enso Version
2023.1.1-nightly.2023.4.12
Browser or standalone distribution
Standalone distribution
Browser Version or standalone distribution
standalone
Operating System
MacOS
Operating System Version
No response
Hardware you are using
No response

It should be done after a shortcut for panning back to the graph. Otherwise, the situations where the view jumped far could be hard to manage.

The camera should be stored on client side, not in the project, in something like local storage.


Added more IDS_TAGS

Hey there :) i just realized what you wrote here:

Our mission now is fixing nd adding the right IDS Tags.
We are doing it because we removed the windows app which were used this
strcture IDS_XX_XX string and pull it from the client and this because
we want the client to work as well on Linux & Mac , and while in your
code your dependce on Windows app you can't achieve this goal.

Sorry i haven't seen that. in my opinion we can stick to the string constants, because all the translation would be in one place and in different languages. So it would be much easier for us to translate instead of traveling each file and changing those constants to strings.
About making it work on cross platforms, don't worry about it, it shouldn't be a big trouble getting that table work on cross platforms, because we could take that table and turn it into an XML file that would be loaded and stored into cache once the client started. So we don't get a performance hit that way.
This is how string tables in VS works, it's allocating a place in memory and stores in cache and as soon as you calling a constant string, it loads from the binary with his id and looking for the text in the resource script. It's not like it needs to load the whole table for each string constants. The system is intelligent enough to do those calculation.
Alternative: We could also create a enum List object and simply put all the strings direct in code, but that could be a performance hit, so the best option would be XML or a Table file inside Data and load it once client started.
Btw, i created a localization-translate branch for this purpose in case we going to stick the string table constants so it doesn't affect the master branch code until it's done.
It's good to see people getting interested and willing to contribute! kind of motivates me to dig into KO again even though i barely have time due to work and studies. But i keep reading the commits in this project and trying to follow up you guys :)

Thanks Gilad, you bring up some good points. I honestly don't see up using a different language besides english in the future. One benefit of working with KO so late in its lifetime is that you get to see what people are most interested in. I'd have to day that the english language has been most popular by far. In addition, if we decide to support new languages in the future the real challenge won't be with strings as so much updating GUI textures for all the UI in the game, which I don't see happening. Support for the Turkish language is perhaps the most likely but even then most of the Turkish players in KO are use to the english language, so I'm not sure.
I think for now we'll drop the multi-language support to ease our ability to port between different operating systems. As long as we have the IDs and their corresponding strings (both we can search for via the source code assuming the IDs remain in the source but simply commented out) I think we'll be able to easily revisit this issue in the future. For now I'll revert the commits and continue in this direction but I agree that this is a potential issue. If we had a large community of people on the forums I'd say let's pose the question for multi-language support and let them decide (listing pros and cons), but I'm not sure enough people visit codingbackwards.in at the moment.
PS - You should jump on Skype more! ;P

Actually before I revert this. Could you jump on Skype at some point and let's discuss it. I see you have done a lot here and I want to understand what you had in mind. You, me, and FowerPower should all jump in a Skype call sometime in the next few days.

I should also mention that while creating new branches for this kinda stuff is ideally what you'd want to do, not enough people are using this code live so the master branch is basically our be-all end-all development branch haha

Thanks for the input Stephen :)
You are totally right about that English is the most used language for our case, but having strings directly in code that displays to the client is a bad practice to be honest. It's not a big thing though, but having everything in one place, is always nice to have as long as it doesn't cause any issues to the project of course and makes the project more flexible to modify or extending.
It's even faster to translate that way, imagine in the future you'll want to extend the user interface to have another language, you simply create another string table since we already got a resource file and translate it directly into that table and let the code structure do his job.
I created that  branch in case you would want to revert this so it won't affect the main project. I find branches much easier to work, but of course we can stick to the pull requests GitHub interface.

so the master branch is basically our be-all end-all development branch haha
Haha... sounds like a deal  :P

Let's discuss it in Skype and catch up a bit ;) Probably on the weekend or so if not today.

As a Turkish person, I agree about what Stephen said, most Turkish players prefer to play it in English.If it what they are used to.

As a Turkish person, I agree about what Stephen said, most Turkish players prefer to play it in English.If it what they are used to.

Hey there :) Yea, i totally agree with him too. Though the client have many messages strings that would be good translated to Turkish. When you have tables, you get the flexibility modifying it the way you want and let the user decide in options what language he wants to pick.

Hey there :) Yea, i totally agree with him too. Though the client have many messages strings that would be good translated to Turkish. When you have tables, you get the flexibility modifying it the way you want and let the user decide in options what language he wants to pick.

Don't get wrong, I totally agree with you in that idea, particularly

the best option would be XML or a Table file inside Data and load it once client started.

For the moment let's keep the new branch and revert the master so I can merge Force's commits. Sometime today or tomorrow let's have a Skype call (you're invite too Onurcanbektas if you'd like).
Gilad I sent you a message on Skype, get back to me when you can.

Due to time difference, I don't think I will make it, but when I get home, I will be online in Skype.

This issue was moved to ApexKO/OpenKO#9


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-archive-test-target/pull/124 is merged into live branch.
Auto archive content to https://github.com/OPS-E2E-PPE/docs-archive-test-target.git

Docs Build status updates of commit 0e9cf5f:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error]

Cannot sync git repo to specified commit because branch Archive_master_2019-09-30-17-05-37 has been deleted or has been force pushed: fatal: Couldn't find remote ref Archive_master_2019-09-30-17-05-37

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Remove Page.get_static_site_paths

Wagtail's Page model has a get_static_site_paths method that was originally added because Wagtail had a contrib module for static site generation.
That contrib module was removed years ago so I think we should remove this unused method and its tests
https://github.com/wagtail/wagtail/blob/7d384e70c12f857c1932a18caf1d511c64ef3999/wagtail/models/__init__.py#L1868-L1879

I'll give it a try

Presumably there's a fair chance that third-party packages (e.g. wagtail-bakery) are depending on this? If so, this should probably go through the deprecation process.

fwiw, https://cs.github.com/?q=.get_static_site_paths() doesn't reveal anything of note

fwiw, https://cs.github.com/?q=.get_static_site_paths() doesn't reveal anything of note

It's used in the wagtail bakery tests: https://github.com/wagtail/wagtail-bakery/blob/ff85d6b068a7e7bc2a707fb90df7aef8562f6b9a/tests/models.py#L26

I want to work on this issue. kindly give me permission and access to work on this issue


Update pds4_versions.txt

Added version <IP_ADDRESS>
Summary

Enter summary here
Test Data and/or Report

Enter info here
Related Issues

Enter related issues here

Using the most recent versions of the IngestLDD for CASSINI, CART, and GEOM, these errors are generated:

ERROR Class:0001_NASA_PDS_1.cart.Map_Projection_Lander  Association:geom.Coordinate_Space_Reference  Class:geom.Coordinate_Space_Reference - Missing Component Class
ERROR Association: geom.Coordinate_Space_Reference - Missing Component - Reference Type: component_of
ERROR Class:0001_NASA_PDS_1.cart.Surface_Model_Parameters  Association:geom.Coordinate_Space_Reference  Class:geom.Coordinate_Space_Reference - Missing Component Class
ERROR Association: geom.Coordinate_Space_Reference - Missing Component - Reference Type: component_of

Note that it appears the pds portal is down.

Hmmm.  The new conflict is that I added v<IP_ADDRESS> -- which is the version that Lyle wants.   And, then version <IP_ADDRESS> was added.
Is there a way to generate v<IP_ADDRESS> ?
Then I suspect we will generate version 1.18 and 1.19 ?

@rsjoyner sorry for the runaround here, but I was able to fix this on Lyle’s other branch.
if you drop this branch and create a new one, this should be working.
To get an LDD built with a different version of the IM, add it to the pds4_versions.txt file. 1 per line.


Run Coophive on Mac ARM arch

great work!

dev mode shouldn’t be enabled by default
can you try and run through the instructions on a fresh linode linux with dev mode off and check it still works end to end?
please update the docs with how to install the dependencies on mac, and test the end to end docs instructions on both platforms

please put screenshots on the PR of the above working :)


Provide Migration / Registration / Debugging Utilities in Docker Image

This would allow us remove the bits in the helm chart that download apk packages at runtime. This is a best practice for Docker images and would allow enterprises using the chart / images to use them within their networks where they do not allow for public internet access.
Obviously the chart could simply use different images (however for migrations we take advantage of the fact that the migration are bundled into the firefly image), however I wanted to get the community's feedback on taking the hit in the image size being slightly larger for the sake of operational simplicity.

Codecov Report

Merging #521 (73a4ef7) into main (2ad92fa) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##              main      #521   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files          275       275
  Lines        15812     15812
=========================================
  Hits         15812     15812

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2ad92fa...73a4ef7. Read the comment docs.


Segmentation fault on EDS endpoint priority updates with active health checking

Title: Envoy occasionally crashes after updating endpoint priorities in EDS for clusters configured with active health checking
Description:
Our setup models localities for different zones with different priorities. Hosts are assigned per locality based on selected traffic configuration. E.g. when zonal affinity is selected, control plane sets hosts in the same zone to highest priority, and endpoints in other localities get lower priority to allow spill over as hosts in the same zone become unhealthy. If no zonal affinity is configured, all hosts are in the same locality with equal priorities. We model localities as static groups with pre-assigned priorities, and move hosts based on desired configuration: same-zone: pri 0, other zones: pri 1, all-zones: pri 2
Moving hosts across localities with different priorities works perfectly fine with no active health checking configured. With active health checking, moving hosts to lower priority localities does not seem to take effect, and traffic still goes to the hosts previously in the higher priority locality, which I expect is because they are still seen healthy post EDS removal from the higher priority locality, following Envoy's eventual consistency assumptions for service discovery.
Adding drain_connections_on_host_removal configuration to the cluster should mitigate this issue, but I frequently get segmentation fault errors once added with the stack trace below. Once Envoy restarts with the updated configuration, traffic now goes to hosts in lower priority as expected.
Even with drain_connections_on_host_removal I still occasionally see the issue, but it is more reproducible with connection-draining configured
Relevant Links:
I believe this is related to the issue: https://github.com/envoyproxy/envoy/issues/6282. Stack trace looks similar
Envoy Version: 1.9 release "@ 37bfd8a"
Repro steps:

Configure EDS with two LocalityLbEndpoints representing different localities; locality-1 with some endpoints, and priority 0, and locality-2 with no endpoints, and priority 1
Ensure Cluster has active health checking configured, and drain_connections_on_host_removal set to true
Move endpoints from locality-1 to locality-2.
I usually see the problem right away with drain_connections_on_host_removal but sometimes it triggers in the second or third iteration of moving hosts between localities.

Call Stack:
[2019-03-26 06:41:46.121][000062][debug][upstream] [external/envoy/source/common/config/grpc_mux_impl.cc:193] Received gRPC message for type.googleapis.com/envoy.api.v2.ClusterLoadAssignment at version e08a0993aed2ba7517bb47fe41d080ad
[2019-03-26 06:41:46.123][000062][debug][upstream] [external/envoy/source/common/upstream/eds.cc:158] EDS hosts or locality weights changed for cluster: cluster.clb-target.c1.gcp-us-central1 current hosts 5 priority 0
[2019-03-26 06:41:46.123][000062][critical][assert] [external/envoy/source/common/upstream/health_checker_base_impl.cc:126] assert failure: active_sessions_.end() != session_iter.
[2019-03-26 06:41:46.123][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:125] Caught Aborted, suspect faulting address 0x3e
[2019-03-26 06:41:46.124][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:94] Backtrace thr<0> obj</lib/x86_64-linux-gnu/libc.so.6> (If unsymbolized, use tools/stack_decode.py):
[2019-03-26 06:41:46.124][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:117] thr<0> #0 0x7f7b8cf4ae97 (unknown)
[2019-03-26 06:41:46.124][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:117] thr<0> #1 0x7f7b8cf4c800 (unknown)
[2019-03-26 06:41:46.124][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:104] thr<0> obj</opt/envoy/bin/envoy>
[2019-03-26 06:41:46.141][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #2 0xdea6d7 Envoy::Upstream::HealthCheckerImplBase::onClusterMemberUpdate()
[2019-03-26 06:41:46.156][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #3 0xde8c74 Envoy::Upstream::HealthCheckerImplBase::HealthCheckerImplBase()::{lambda()#1}::operator()()
[2019-03-26 06:41:46.172][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #4 0xdec2c3 std::_Function_handler<>::_M_invoke()
[2019-03-26 06:41:46.187][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #5 0xbc36e6 std::function<>::operator()()
[2019-03-26 06:41:46.203][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #6 0xbbcb38 _ZN5Envoy6Common15CallbackManagerIIjRKSt6vectorISt10shared_ptrINS_8Upstream4HostEESaIS6_EESA_EE12runCallbacksEjSA_SA_
[2019-03-26 06:41:46.218][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #7 0xbb9d54 Envoy::Upstream::PrioritySetImpl::runUpdateCallbacks()
[2019-03-26 06:41:46.233][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #8 0xd76685 Envoy::Upstream::PrioritySetImpl::getOrCreateHostSet()::{lambda()#1}::operator()()
[2019-03-26 06:41:46.249][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #9 0xd82cbb std::_Function_handler<>::_M_invoke()
[2019-03-26 06:41:46.249][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #10 0xbc36e6 std::function<>::operator()()
[2019-03-26 06:41:46.249][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #11 0xbbcb38 _ZN5Envoy6Common15CallbackManagerIIjRKSt6vectorISt10shared_ptrINS_8Upstream4HostEESaIS6_EESA_EE12runCallbacksEjSA_SA_
[2019-03-26 06:41:46.265][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #12 0xc04641 Envoy::Upstream::HostSetImpl::runUpdateCallbacks()
[2019-03-26 06:41:46.280][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #13 0xd757b1 Envoy::Upstream::HostSetImpl::updateHosts()
[2019-03-26 06:41:46.296][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #14 0xd7f467 Envoy::Upstream::PriorityStateManager::updateClusterPrioritySet()
[2019-03-26 06:41:46.311][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #15 0xdaa0c3 Envoy::Upstream::EdsClusterImpl::updateHostsPerLocality()
[2019-03-26 06:41:46.327][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #16 0xda9950 Envoy::Upstream::EdsClusterImpl::onConfigUpdate()
[2019-03-26 06:41:46.342][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #17 0xdafdbe Envoy::Config::GrpcMuxSubscriptionImpl<>::onConfigUpdate()
[2019-03-26 06:41:46.357][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #18 0xdb74a7 Envoy::Config::GrpcMuxImpl::onReceiveMessage()
[2019-03-26 06:41:46.373][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #19 0xdbe049 Envoy::Grpc::TypedAsyncStreamCallbacks<>::onReceiveMessageUntyped()
[2019-03-26 06:41:46.388][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #20 0xe0494e Envoy::Grpc::AsyncStreamImpl::onData()
[2019-03-26 06:41:46.404][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #21 0xe09992 Envoy::Http::AsyncStreamImpl::encodeData()
[2019-03-26 06:41:46.420][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #22 0xe175b1 Envoy::Router::Filter::onUpstreamData()
[2019-03-26 06:41:46.435][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #23 0xe19118 Envoy::Router::Filter::UpstreamRequest::decodeData()
[2019-03-26 06:41:46.451][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #24 0xd600d2 Envoy::Http::StreamDecoderWrapper::decodeData()
[2019-03-26 06:41:46.466][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #25 0xea0980 Envoy::Http::Http2::ConnectionImpl::onFrameReceived()
[2019-03-26 06:41:46.482][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #26 0xea29e6 Envoy::Http::Http2::ConnectionImpl::Http2Callbacks::Http2Callbacks()::{lambda()#6}::operator()()
[2019-03-26 06:41:46.497][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #27 0xea2a16 Envoy::Http::Http2::ConnectionImpl::Http2Callbacks::Http2Callbacks()::{lambda()#6}::_FUN()
[2019-03-26 06:41:46.512][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #28 0xeb5af6 nghttp2_session_on_data_received
[2019-03-26 06:41:46.528][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #29 0xeb9d81 nghttp2_session_mem_recv
[2019-03-26 06:41:46.543][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #30 0xe9fb5b Envoy::Http::Http2::ConnectionImpl::dispatch()
[2019-03-26 06:41:46.559][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #31 0xdf0a54 Envoy::Http::CodecClient::onData()
[2019-03-26 06:41:46.574][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #32 0xdf1477 Envoy::Http::CodecClient::CodecReadFilter::onData()
[2019-03-26 06:41:46.589][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #33 0xb29850 Envoy::Network::FilterManagerImpl::onContinueReading()
[2019-03-26 06:41:46.605][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #34 0xb29964 Envoy::Network::FilterManagerImpl::onRead()
[2019-03-26 06:41:46.620][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #35 0xb20814 Envoy::Network::ConnectionImpl::onRead()
[2019-03-26 06:41:46.636][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #36 0xb21ea1 Envoy::Network::ConnectionImpl::onReadReady()
[2019-03-26 06:41:46.651][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #37 0xb21c42 Envoy::Network::ConnectionImpl::onFileEvent()
[2019-03-26 06:41:46.667][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #38 0xb1e528 Envoy::Network::ConnectionImpl::ConnectionImpl()::{lambda()#3}::operator()()
[2019-03-26 06:41:46.682][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #39 0xb23be5 std::_Function_handler<>::_M_invoke()
[2019-03-26 06:41:46.697][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #40 0xb171d7 std::function<>::operator()()
[2019-03-26 06:41:46.713][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #41 0xb16edc Envoy::Event::FileEventImpl::assignEvents()::{lambda()#1}::operator()()
[2019-03-26 06:41:46.728][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #42 0xb16f5b Envoy::Event::FileEventImpl::assignEvents()::{lambda()#1}::_FUN()
[2019-03-26 06:41:46.744][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #43 0x11759b4 event_process_active_single_queue.isra.29
[2019-03-26 06:41:46.759][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #44 0x11760fe event_process_active
[2019-03-26 06:41:46.774][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #45 0x1178e87 event_base_loop
[2019-03-26 06:41:46.790][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #46 0xb1262b Envoy::Event::DispatcherImpl::run()
[2019-03-26 06:41:46.805][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #47 0xa968c6 Envoy::Server::InstanceImpl::run()
[2019-03-26 06:41:46.821][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #48 0x4d96d1 Envoy::MainCommonBase::run()
[2019-03-26 06:41:46.836][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #49 0x4d7b21 Envoy::MainCommon::run()
[2019-03-26 06:41:46.851][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #50 0x4d75ee main
[2019-03-26 06:41:46.851][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:104] thr<0> obj</lib/x86_64-linux-gnu/libc.so.6>
[2019-03-26 06:41:46.851][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:117] thr<0> #51 0x7f7b8cf2db96 (unknown)
[2019-03-26 06:41:46.851][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:104] thr<0> obj</opt/envoy/bin/envoy>
[2019-03-26 06:41:46.866][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:114] thr<0> #52 0x41c0e8 _start
[2019-03-26 06:41:46.866][000062][critical][backtrace] [bazel-out/k8-fastbuild/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:121] end backtrace thread 0
/opt/envoy/bin/entrypoint.sh: line 68:    62 Aborted                 (core dumped) $ROOT/bin/envoy.sh
+ wait

I just put up a fix for this at #6396

Awesome ! Thanks @snowp


Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en
For changelog. Remove if this is non-significant change.
Category (leave one):

Improvement

Short description (up to few sentences):
As suggested in a comment, now for detect what is the second tld. It's using a perfect hash table generated by gperf with a list generated from this file : https://publicsuffix.org/list/public_suffix_list.dat, who can give a better accuracy for some result (for example, with url who contains the domain ac.uk).
Detailed description (optional):
So here a potential proposal. Would just like to tell few points, it would add gperf as a dependency for the project as the code is generated on the compilation phase with ninja-build.
Also I wasnt' really sure for to things, with two domain from the test, one who have co.yandex and org.рф, I wasn't able to find this domain both on the list and also doing a quick research from Google, so let me know if I should add them on the list too.

Also I wasnt' really sure for to things, with two domain from the test, one who have co.yandex and org.рф, I wasn't able to find this domain both on the list and also doing a quick research from Google, so let me know if I should add them on the list too.

These domains fit to the older logic of this function, but they don't exist actually.
Modified test is Ok.

@YiuRULE You should also add dependency to Dockerfiles in docker directory, whenever appropriate.

@alexey-milovidov Ok thanks for your help, I added the dependency in the builder folder, I think it should be ok now

It's not enough:
https://clickhouse-builds.s3.yandex.net/5030/5c67ecd46d803f97908563b27fc9cf9a95f7b393/build_log_415594408_1555584319.txt
As far as I remember, you should add to packager Dockerfiles.

Thanks, I add gperf dependency both on binary and deb folder.
Otherwise it seem that we still have a problem with the build, it seem that CI fetch the docker image from the one in the [docker hub](https://hub.docker.com/r/yandex/clickhouse-deb-builder right?
Otherwise, I tried running locally the script packager with the command line ./packager  --package-type deb --output-dir build and seem the build went fine :/

@YiuRULE unfortunately in our CI system Docker images have to be pushed by hands. I pushed images containing gperf. Can you merge with master or do any insignificant commit?

@alesapin I've made a commit.

Need to use more loose compiler warning flags for compiling auto-generated file tldLookup.cpp

Performance tests are Ok.

We don't have anymore build problem using Clang, does this fix seem ok ?

Yes.

Thanks, I applied the change.
It seem we got a weird bug with the CI process when tried to build using g++ (both on this branch, and the latest master version).
[7/87] cd /home/guillaume/ClickHouse &...d/dbms/programs/clang/headers/<IP_ADDRESS>
Use one of the following commands:
clickhouse local [args]
clickhouse client [args]
clickhouse benchmark [args]
clickhouse server [args]
clickhouse performance-test [args]
clickhouse extract-from-config [args]
clickhouse compressor [args]
clickhouse format [args]
clickhouse copier [args]
clickhouse obfuscator [args]

Should I do something in particular on this branch or should be ok ?

Any news concerning this PR ? saw some commits who were pushed :)

Merged. Sorry for the delay.

@YiuRULE Can you show how you exactly generate list from  https://publicsuffix.org/list/public_suffix_list.dat ?

@proller I create a simple python script who set the header of the gperf file
%language=C++
%define lookup-function-name is_valid
%define class-name tldLookupHash
%readonly-tables
%includes
%compare-strncmp
%{
#pragma GCC diagnostic push
#pragma GCC diagnostic ignored "-Wimplicit-fallthrough"
#pragma GCC diagnostic ignored "-Wzero-as-null-pointer-constant"
#pragma GCC diagnostic ignored "-Wunused-macros"
%}
# List generated using https://publicsuffix.org/list/public_suffix_list.dat
%%

then the python script take the file as a parameter, remove every comment and empty line
then, it set this as a footer
%%


fix the failing Semgrep test in incorrect-unsigned-comparison

Thanks for the great rules.
One Semgrep test was failing because the ruleid had .yaml in the end.

For example, in c/insecure-api-scanf-etc.c we see
	// ok: raptor-insecure-api-scanf-etc (probably)
	scanf("%d", &number);

This is failing the test because there's no ruleid raptor-insecure-api-scanf-etc (probably). I did not want to remove the comments in case you wanted to do something else with them.
Found rule id mismatch - file=c/insecure-api-scanf-etc.c 'ruleid' annotation with no
YAML rule={'raptor-insecure-api-scanf-etc (probably)'}
Failing due to rule id mismatch. There is a test denoted with
'ruleid: <rule name>' where the rule name does not exist or is not expected in the test file.

You can run the tests all rules by running semgrep --test in the root of the repository.

Hi Parsia, thank you for your feedback and contribution. I've merged your PR and fixed the remaining issues with semgrep --test. All tests are passing now.


what is the TPS speed for writing to hdfs

I test myself with only write to file with buffer size 3153, getting a result of nearly 10000TPS.
Is there any possible way to improve the performance?
Thanks

HDFS data transfer protocol did some optimization to improve write performance since I implemented libhdfs3. But the cost is that new block is not immediately readable without a hdfsSync call.
So it is possible to improve write performance, but I do not have enough time to do such work recently. Would you like to contribute?

Did you ever have some test result for the write and read performance?  Compare to yours, is 10000TPS reasonable?

Additionally, what is the speed you tested for reading from hdfs?

According to the performance test I did two years ago, libhdfs3 read speed is limited to the network bandwidth and the CPU utilization is significantly less than JNI implementation.

Vote to close this issue.


Overcome browser limits on number of open connections for increased performance

Modern browsers limit the number of simultaneous open connections to a single remote host to 6. When we are updating lots of green hint numbers in OPUS, each one requires a separate AJAX call and thus separate connection, and we can quickly get beyond this limit. At that point, the browser waits for previous ones to return, serializing an otherwise parallel process.
The easiest way around this is to have multiple remote hostnames (e.g. tools-001, tools-002) all point to the same IP address. This fools the browser into exceeding its limit without requiring any major changes to the UI or any changes at all to the back end.
See: https://docs.pushtechnology.com/cloud/latest/manual/html/designguide/solution/support/connection_limitations.html

Note: This will probably trigger the cross-domain restrictions and the Django will need to handle that properly.

We might also be able to do this for thumbnail images. We could serve them off tools for better web performance and allow more than 6 images to be fetched at once by rotating the URLs in the dataimages.json return.


Attachment lost, body looks strange

Expected behaviour
See a PDF.
Actual behaviour
No attachment, incomplete quoted-printable decoding (in the body are few "=20").
Google's mailer works with this mail!
Steps to reproduce

Environment
K-9 Mail version:
5.008?
Android version:
4?
Account type (IMAP, POP3, WebDAV/Exchange):
IMAP

Can you provide the message source of such an email?

Well, it's not my phone.
I was looking for the header but neither "User-Agent" nor "X-Mailer" were shown.

Well, then we just assume it's a malformed message.
Even if we wanted to, without a message to reproduce this issue there's no way to create a workaround.


Use new unquoted conn string var in ci tests

as discussed : )

changes were merged as part of PR #295, closing


OpTestSystem: Cleanup and consistency for ssh

Use ssh connections for OS tests where applicable.
Consistency for console and ssh usage,
i.e. use common syntax across testcases.
Signed-off-by: Deb McLemore<EMAIL_ADDRESS>

Now changes are looks good except host_check_command regresses due to invalid format of arguments. I did workaround for that here https://github.com/open-power/op-test-framework/commit/50e491d4017fdc40673af73f0548c1728042810b .


Request: Don't perform temporary directory cleanup at exit

When exiting a python environment that has imported ARMI, ARMI will do some cleanup: closing database files and removing old temporary directories. It looks like ARMI allows the temporary directories to reach two weeks old before removing them. This is nice because you don't have to worry about ARMI creating a backlog of temporary files and some recent files are still kept around.
Until you have a very long running case that exceeds two weeks (lots of burnup, slow compute node), and you use ARMI in a totally unrelated instance and all the in-progress files are summarily removed.
Yes, some of this can be attributed to issues on my own end and better safeguards could be put in place. And two weeks is a long time to have a single job running. But this feels like a side effect that could be avoided with changes to the ARMI experience.
I propose the following recommendations on how ARMI handles cleanup of the temporary directories

The cleanup function registered atexit should check the number of temporary directories, and report the number of directories to the user via a debug statement. Debug over info so that way the message isn't printed if you just want to open a python environment and process some data.
Support  a "dry run" switch with the clean-temps entry point. Here the files that would be removed are printed, and maybe with their date next to them.
Configurable expiry time (2 weeks, 60 days, etc.) in clean-temps
A way for the current ARMI run to know it's main temporary directory created, and only remove those

This is kind of related to some comments in #257, specifically https://github.com/terrapower/armi/issues/257#issuecomment-785302156 and https://github.com/terrapower/armi/issues/257#issuecomment-785376609

First off, 😱

Dang, I'm also sorry to hear that. We had troubles with runs filling up our HPC and this is a residue from that. We will make this kind of 'feature' opt-in rather than opt-out and leave its use up to the app developers rather than having it come with the framework.

@drewejohnson is this quick solution acceptable from your perspective at this point? It basically just turns off the feature by default.

@youngmit @ntouran thank you for the response and fast patch! I've looked over #309  and looks like it'll do the job. Won't know until I run another long sim.
I'm happy if you want to close this issue as it stands. The discussion wall might be a better place to hash out a longer term fix for how ARMI handles atexit.


Adjust to LaxarJS/laxar#447

The createAxI18nMock API has changed. The mock is no longer created from a live axI18n instance, but should instead be passed the available axContext (using the second parameter):
import { createAxI18nMock } from 'laxar/laxar-widget-service-mocks';
// ... get services
createAxI18nMock( {}, services.axContext );

Implemented on master (v2.0.0).


Something wrong with your last sample

On the last sample for dragging event there is something wrong with your syntax right after the ? 'n't'

This is{!dragging ? 'n't' : ''} being dragged over.

Thanks, fixed now


New Pattern: aws-codepipeline-step-functions

Build a new pattern to use AWS Step Functions as an action for AWS CodePipeline stage.
Use Case
Need this feature to invoke AWS Step Functions for AWS Codepipeline stage.
Proposed Solution
Create a CodePipeline, CodePipeline stage, codepipeline action to invoke the step function.

[X] :wave: I may be able to implement this feature request
[ ] :warning: This feature might incur a breaking change

This is a :rocket: Feature Request

Suggest to provide support for adding a Stage to an existing CodePipeline, for use cases when user wants to attach to pipeline created by other construct e.g aws-codecommit-codepipline


Critical structure bsod

After 10-20 minutes of running the driver, I get a bsod
010823-9218-01.zip

As I can see in the BSOD your system detect a modification in the NtAddAtom function (function which get modified temporarily by kdmapper for the driver loading)
if this happens after 10-20 mins, and you didn't run kdmapper any more times and your driver don't keep kdmapper running then maybe Microsoft implemented checking of this kernel area in patch guard

it keep it running bcs i have while loop for readin in driver

That is, the bsod is obtained because of the keep running kdapper?

Probably, kdmapper is designed in the way that you return from driver entry fast as you can, while your code get called in other way or use some kind of thread or execution context

So I have to read the memory and close the driver? And then run it again for reading?
Or is it possible to somehow make the driver stay in the system and kdmapper shut down?

If you check the requirements in the readme it says create a thread and return from your driver fastest as possible, you have to map your driver and create a thread to your code, when you return kdmapper will close and your code will run in your new thread

Thank you very much!
Is there an example of a driver creating a new thread?


Support for Auto migration for sqlite databases like typeorm

Problem
I was using typeorm and sqlite with my electron js app. I used to ship that exe and users download it and it creates a sqlite file in program data with all tables created.
But since i migrated to prisma i am unable to achive this functionality as this newly created db file doesnt have tables created,ill need to run migration.
Because of that, its a blocked for my scenario.
Suggested solution
If there is some kind of migration api or a flag which auto creates table if doesnt exisst,  would fix this issue.

i have the same issue with you, i tray to use prisma, but the db file included in the binary file for each version of the app, this will distroy the previous versions,
what i can do is install a tauri pluging like: https://github.com/Sylvaner/tauri-plugin-sqlite-store
and i make my own class for migration and suery builder to generate a sql script,
the problem is the db file has a different folder and not in the same folder with the executable file,


Add CLI help text

Running natac -h or natac --help should print out unage information and help text

Added in b9210a63b7eec0ebb14f71997686283fb395f628.


Chinese translation of Get Started with Free Code Camp

[x] Learn how Free Code Camp Works
[x] Create a GitHub Account and Join our Chat Rooms
[x] Configure your Code Portfolio
[x] Join a Campsite in Your City
[x] Learn What to Do If You Get Stuck

Proofreaders, please review https://github.com/leonfeng/FreeCodeCamp/commit/b51999e69070c48d2d45a63c5620d36e3c4718e2. Thanks! You can comment on the translation like this:

Closing this issue in favor of moving the conversation over to FreeCodeCamp/TranslationExpansion#2


[jjo] release-1.7 fix: oauth2-proxy >= 6.0.0 and grafana on AKS

Fix #915 (merge from master #916)

oauth2-proxy >= 6.0.0 on AKS doesn't provide
"X-Auth-Request-User" header on AKS, used by grafana
to auto-login users, use "X-Auth-Request-Email" instead

bors merge

f*random cloud issues (gke-1.15 in this case) ->
bors retry

bors merge


Nested queries that are arrays are being returned as single objects in Swift when you call a fetch request

I've been trying to get the orders that are linked to the user object I've created through AppSync in my iOS application with the generated methods. The query tab in the AppSync GUI returns the orders that have a relationship with the user, but the generated API.swift file doesn't seem to be able to retrieve nested data or objects.
Here's the Query that I have
query listOrders{
  listUsers(filter: {
      firstname: {
        contains:"baba"
      }
  }) {
    items {

      firstname
      lastname
      orders {

        items {

          orderID
          pickupDate
          dropoffDate
          deliveryTime
          totalCost

          laundry {
            baskets
            washType
            detergent
          }
        }
      }
    }
  }
}

And its returning this data which is all fine and dandy
{
  "data": {
    "listUsers": {
      "items": [
        {
          "firstname": "baba",
          "lastname": "ganoush",
          "orders": {
            "items": [
              {
                "orderID": "ABC",
                "pickupDate": "4/10/2019",
                "dropoffDate": "4/22/2019",
                "deliveryTime": "14:00",
                "totalCost": 42,
                "laundry": {
                  "baskets": 4,
                  "washType": "Hot",
                  "detergent": "Not Garbage"
                }
              },
              {
                "orderID": "ABC",
                "pickupDate": "4/10/2019",
                "dropoffDate": "4/22/2019",
                "deliveryTime": "14:00",
                "totalCost": 42,
                "laundry": {
                  "baskets": 4,
                  "washType": "Hot",
                  "detergent": "Not Garbage"
                }
              },
              {
                "orderID": "ABC",
                "pickupDate": "4/10/2019",
                "dropoffDate": "4/22/2019",
                "deliveryTime": "14:00",
                "totalCost": 42,
                "laundry": {
                  "baskets": 4,
                  "washType": "Hot",
                  "detergent": "Not Garbage"
                }
              }
            ]
          }
        }
      ]
    }
  }
}

I've filtered for the user, and have gotten the user's first name and last name however I cannot seem to traverse the next values for orders since it is being returned as a single object rather than array.
The output is showing there is an order object being returned, but I'm not sure what this data means". In particular this
Optional(kleenAmp.ListUsersQuery.Data.ListUser.Item.Order(snapshot: ["nextToken": nil, "__typename": Optional("ModelOrderConnection")]))
Not too sure whether I should just take the data type and decode it with the Codable Protocol, but that has a slew of problems returning the correct data type as well.
There should be some kind of method that allows you to query through all the orders assigned to the user or at least return an array instead of an object.

I've tried the codegen option, and have set it up with a max depth of 6 however it doesn't generate those methods. I'm currently looking through these commands and not sure which one to use.
amplify add codegen [--apiId ]
*what exactly is the api id that it's referring to
$ amplify configure codegen
$ amplify codegen [--max-depth ]
Thanks for redirecting me to the right support team! A little confused is all :\

@elorzafe great news! it worked! Used these commands exactly in the cli.
amplify codegen remove
amplify add codegen
amplify codegen statements
amplify codegen
--after amplify codegen change the schema so it updates
amplify push

@elorzafe Xcode wasn't updating the API.swift file or was hanging onto the older API.swift file. Once I opened it up in the finder with Xcode, I saw the orders having an items type and the rest was history! Great job with Amplify btw!


Fix Stripe PaymentIntent handling

Resolve https://github.com/opencollective/opencollective/issues/5773
Should also resolve most of the occurrences for https://sentry.io/organizations/open-collective/issues/3058463744, all those with the title GraphQLError: Internal Payment error (invalid PaymentIntent).

@znarf I'll wait for your feedback on this one when you come back since it's a tricky part of the code you have some experience with.
Also cc @SudharakaP since we discussed this very precise error yesterday; it will surely resolve those tickets you've seen  where the person got an Internal Payment error (invalid PaymentIntent).


improve add disable query and load for be restart

What problem does this PR solve?
add disable query and load for be restart

disable query and load before stop be
enable query and load before start be when the be is not first started

Release note
None
Check List (For Author)

Test

[ ] Regression test
[ ] Unit Test
[ ] Manual test (add detailed scripts or steps below)
[x] No need to test or manual test. Explain why:

[ ] This is a refactor/code format and no logic has been changed.
[ ] Previous test can cover this change.
[ ] No code files have been changed.
[x] Other reason

Behavior changed:

[ ] No.
[x] Yes.

Does this need documentation?

[x] No.
[ ] Yes.

Check List (For Reviewer who merge this PR)

[ ] Confirm the release note
[ ] Confirm test cases
[ ] Confirm document
[ ] Add branch pick label

run buildall

run buildall


KCD renal intercalated cell

This is a "bad smell" - we have one subtype of renal intercalated cell differentiated by region.
An additional comment for KPMP folks it's also not useful to subtype renal intercalated cell by region at all

An additional comment for KPMP folks it's also not useful to subtype renal intercalated cell by region at all

With HuBMAP, several location-specific cell types have been requested and created.

@emquardokus, as the main liaison, do you have any comments on this?
If there is no comment on this ticket within the next few days, I plan to close this ticket.

@bvarner-ebi I was working directly with Sanjay Jain who is both HuBMAP and KPMP so I'm not sure where/who this newest comment came from? Sanjay added the cell types and KPMP usually rigorously discusses every new item.

Thank you for the feedback, @emquardokus. Given your comment and since this ticket was opened in 2018 with no other activity, I will close it.


How to duplicate a line with CodeMirror? Shortcut?

Using codemirror for long, I am still missing the shortcut to duplicate a line. CTRL+D would do it, but it does not work.
What's the reason that there is none?
PS: Please rename the "Commands" section to "Shortcuts" at https://codemirror.net/doc/manual.html#commands - It took me ages to find them.

The default keymap doesn't come with a lot of extra, non-standard functionality. You can find a command for duplicating a line in the Sublime keymap, named duplicateLine and bound to Shift-Ctrl/Cmd-D by that keymap.

non-standard functionality

Meanwhile this is a standard functionality in all editors I know, only codemirror is the exception.
Using the proposed CTRL SHIFT D marks all the li blocks when inside the ul element. Such a shortcut is standard then? And duplicating is not?

The default keymap doesn't come with a lot of extra, non-standard functionality. You can find a command for duplicating a line in the Sublime keymap, named duplicateLine and bound to Shift-Ctrl/Cmd-D by that keymap.

May I know where I could find the duplicateLine . The keymap json doesn't have this option. Thank you!


Prepare release

This PR adds everything necessary to make the first release. This includes 2 minor API additions.
The public API of Navi is defined in src/main.ts. This is the only file that others (right now, only chainner) are allowed to import.
I already prepared a branch for chainner to use the new package. It imports my local package of Navi right now, so I already tested that everything works. I'll make a PR to use the new package as soon as I released it.
I also added a performance optimization as part of the API change to literal. Sorry that this makes the diff noisy.

Do we want to squash PRs for Navi?

Yes.


Table record actions hiddenLabel only works if set as button

Package
filament/filament
Package Version
v3.2.2
Laravel Version
v10.41.0
Livewire Version
v3.3.5
PHP Version
PHP 8.3.2
Problem description
Table record actions still shows label when hiddenLabel() is set, yet when the action is set as a button(), the setting works properly.
Expected behavior
Action label to be hidden, regardless of button() setting.
Steps to reproduce
As is in TestRecordResource.php.
$table
  // …
  ->actions([
      /* Label still showing */
      Tables\Actions\EditAction::make()
          ->hiddenLabel(),

      /* Label is properly hidden */
      Tables\Actions\DeleteAction::make()
          ->hiddenLabel()
          ->button(),
  ])
  // …

Reproduction repository
https://github.com/noquierouser/table-action-label
Relevant log output
No response

Fixed in #11283. But in this case, you should probably use iconButton() instead.


Clicking on label of leaflet-control-layers does not work

var version = "1.5.1+HEAD.2e3e0ff";
leaflet-src.js line 5218
There is: _on(input, 'click', this.onInputClick, this);
Should be: _on(input, 'change', this.onInputClick, this);

Hi, and thanks for taking the time to open a bug report in Leaflet.
Please provide a more effective bug report, and in particular all the information requested in the issue template (provided when you create a new issue), so that we can effectively investigate and hopefully resolve it.
The Layers Control behaves as expected on my Chrome, i.e. layer is switched on/off when clicking on the label instead of the radio/checkbox. Typically testing on Leaflet tutorial page for Layers Control https://leafletjs.com/examples/layers-control/
What OS and browser have you tested on please?

Close due to lack of feedback


fix(codegen): fixed calling order for WithAutoXOrder

This PR moves the call to WithAutoXOrder before we validate and flatten the spec for codegen purpose.

fixes #2949

Other changes:

layout: moved all the spec massaging to a dedicated source
allowed WithAutoXOrder to report about errors rather than panicking

Overall, WithAutoXOrder is simplistic and could be improved a lot:

supporting JSON
supporting remote $refs, circular $refs
removing the dependency to yaml.v2
not producing a temporary file that hangs around
etc

These improvements are beyond the scope of this PR, which is just to fix responses. Perhaps a follow up could bring a more general solution to this problem.

@casualjim  @youyuanwu  I realize that a lot of work about "keeping things ordered" has already been accomplished in swag.
I believe this is the way to solve this issue (and many other unreported ones) for good.
IMHO, the "WithAutoXOrder()" hack in go-swagger should disappear and be replaced by appropriate spec loaders (-> in "loads") that inject the "x-order" when loading each document (local or remote, YAML or JSON).
Working on that now. Looks like there is quite a loaded plate...


🐛 Using runAsync in Frame Processor Produces the Error: Exception in HostFunction: java.lang.ClassNotFoundException: Didn't find class "com.facebook.jni.MapIteratorHelper"

What's happening?
I am using the Dynamsoft frame processor plugins and runAsync in the frame processor function.
Reproduceable Code
runAsync(frame, () => {
    'worklet'
    recognize(frame);
})

Relevant log output
Frame Processor Error: Exception in HostFunction: java.lang.ClassNotFoundException: Didn't find class "com.facebook.jni.MapIteratorHelper" on path: DexPathList[[directory "."],nativeLibraryDirectories=[/system/lib64, /system_ext/lib64, /system/lib64, /system_ext/lib64]], js engine: VisionCamera

Camera Device
{
  "formats": [],
  "sensorOrientation": "landscape-left",
  "hardwareLevel": "full",
  "maxZoom": 10,
  "minZoom": 1,
  "maxExposure": 18,
  "supportsLowLightBoost": false,
  "neutralZoom": 1,
  "physicalDevices": [
    "wide-angle-camera"
  ],
  "supportsFocus": true,
  "supportsRawCapture": true,
  "isMultiCam": false,
  "minFocusDistance": 5,
  "minExposure": -18,
  "name": "BACK (0)",
  "hasFlash": true,
  "hasTorch": true,
  "position": "back",
  "id": "0"
}

Device
OPPO A72 5G
VisionCamera Version
3.9.0
Can you reproduce this issue in the VisionCamera Example app?
I didn't try (⚠ your issue might get ignored & closed if you don't try this)
Additional information

[ ] I am using Expo
[x] I have enabled Frame Processors (react-native-worklets-core)
[X] I have read the Troubleshooting Guide
[X] I agree to follow this project's Code of Conduct
[X] I searched for similar issues in this repository and found none.

This has been fixed in react-native-worklets-core 0.3.0. -> https://github.com/margelo/react-native-worklets-core/releases/tag/v0.3.0


refactor: next big version change

feats
L1

[ ] crates/* workspace member support show specific path
[ ] support rust explorer playground
[ ] extenstion background.js proxy all request and cache data
[ ] deps relative path relation package sub crate
[ ] tests (auto)

L2

[ ] gitlab and gitlab server support

fixs
L1

[ ] sider box style #18

L2

[ ] gitlab all styles

factor
code stack: svelte, typescript, vite (not change)

[ ] compact code
[ ] simplify the build packaging process

crates/* workspace member
🤔 trigger: is workspace member some path has *
about github repo trees
API: https://api.github.com/repos/bevyengine/bevy/git/trees/main?recursive=1

get current repo base link and branch
get repo tree
convert flat tree to nest tree
find workspace like crates/* has * symbol, get this dir lineal children
render workspace sub list in parent crates/*

❗need cache the tree api data, High frequency requests will trigger current limiting of GitHub


Behavior of isBetween

Questions about the behavior of isBetween.
I needed to make a comparison like this:
moment('21:00', format).isBetween (moment('21:00', format), moment('21:30', format))

But moment.js returns me false for that comparison.
I know I can do it like this:
moment('21:00', format).isSameOrAfter(moment('21:00', format)) && moment(moment('21:00', format)).isSameOrBefore(moment('21:30', format))

But I find that somewhat verbose, and prone to errors.
Now my doubts:

Is there any other way to make this comparison? I could not find anything in the documentation to help me.
This is actually the expected behavior of isBetween. At least in my opinion, this comparison should return true.

Meaning you would like the ends of the "range" to be inclusive? Yes:
moment('21:00', format).isBetween(moment('21:00', format), moment('21:30', format), null, '[]')

That '[]' is interval notation. From the docs:
Version 2.13.0 introduces inclusivity. A [ indicates inclusion of a value. A ( indicates exclusion. If the inclusivity parameter is used, both indicators must be passed.

moment('2016-10-30').isBetween('2016-10-30', '2016-12-30', null, '()'); //false
moment('2016-10-30').isBetween('2016-10-30', '2016-12-30', null, '[)'); //true
moment('2016-10-30').isBetween('2016-01-01', '2016-10-30', null, '()'); //false
moment('2016-10-30').isBetween('2016-01-01', '2016-10-30', null, '(]'); //true
moment('2016-10-30').isBetween('2016-10-30', '2016-10-30', null, '[]'); //true
Note that in the event that the from and to parameters are the same, but the inclusivity parameters are different, false will preside.

moment('2016-10-30').isBetween('2016-10-30', '2016-10-30', null, '(]'); //false
If the inclusivity parameter is not specified, Moment will default to ().

Thanks a lot @icambron :smile:


Support Custom Properties in DataFlow Runtime IR

Choose a PR Template
Switch to "Preview" on this description then select one of the choices below.
Click here to open a PR for a Data Plane API.
Click here to open a PR for a Control Plane (ARM) API.

/azp run

Can you please fix the newly added swagger lint diff violations : https://github.com/Azure/azure-rest-api-specs/pull/22907/checks?check_run_id=14904983273

@anjaliOra I have removed the Approved-BreakingChange label because it is obsolete. Your PR will have to be re-approved. Please follow the instructions at https://aka.ms/brch. If you provide the reason why your PR was approved in the first place, this will speed up the process and help the Breaking Change Review Board apply appropriate new label. Apologies for the inconvenience!


Autocomplete unresponsive with large options dataset

Current Behavior
Hello, svelte animate and transition directive are causing autocomplete to be slow and unresponsive when the options dataset is large.
Steps To Reproduce
stackblitz: https://stackblitz.com/edit/skeletonlabs-repl-wjppky?file=src/routes/+page.svelte
with animate and transition directive removed I didn't notice stuttering:
https://github.com/skeletonlabs/skeleton/blob/da5d2999cdfb2dae8b3d89d23d518d40600aeaca/src/lib/components/Autocomplete/Autocomplete.svelte#L117
Anything else?
tested on google chrome 111 & firefox 111 on windows 11 (Intel(R) Core(TM) i7-9750H CPU )

https://user-images.githubusercontent.com/52020637/231642009-8e135e11-0853-4d08-9207-af22844f9efc.mp4
Confirmed on local copy - you can also see some artefacts of the animation towards the end as well

Could it be an idea to conditionally enable disable transitions wether they are inside the autocomplete list viewport using intersection observer? You only need to animate those that are in the viewport (usually a max of 15 items or so).