process.execArgv not being passed to children

process.execArgv not being passed to grunt tasks
CLI command:
sails lift --foo="baz"

Grunt file:
module.exports = function(grunt) {
    console.log("process.execArgv ", process.execArgv); // empty array: []

    console.log("--foo: ", grunt.option('foo')); //undefined

    console.log("process.argv: ", process.argv);
        /*
           [ '/usr/local/bin/node',
             '/Users/bamieh/Bamieh/TheShip/node_modules/sails/lib/hooks/grunt/grunt-wrapper.js',
             'default',
             '--pathToSails=/Users/bamieh/Bamieh/TheShip/node_modules/sails',
             '--gdsrc=/Users/bamieh/Bamieh/TheShip/node_modules/sails/node_modules'
            ]
        */
}

I am unable to capture the execArg in any way, although it should be passed
on line 137 in lib/hooks/grunt/index.js
https://github.com/balderdashy/sails/blob/master/lib/hooks/grunt/index.js#L137
any ideas?

You're misunderstanding how execArgv works here--it's an easy mistake to make.  process.execArgv contains the command-line options of the parent process.  In the case of Sails, that's Node itself.  So if you started your app with:
node --harmony app.js --silly

then process.execArgv would be ['harmony'] (notice the absence of silly).  That's what would then be passed down to the Node executable when it forks Grunt, so that process.execArgv in the Gruntfile would also be ['harmony'].  It has nothing to do with the command-line options that Grunt gets, and there's no way to pass --foo=bar this way, since --foo is not a valid command-line argument for Node.
If you're looking to pass some info along to your Gruntfile, you can use environment variables.  For example:
foo=bar sails lift

will come through in your Gruntfile as process.env.foo.

@sgress454 ahh indeed this is what i am currently doing, however there is no way to get the passed parameters through lifting sails?


Fix typedef int8_t problem

I got an error with MS VC 14.0 compiler (message below) because int8_t typedef was not consistent with stdint.h
It should be 'signed char' instead of 'char'.
Last lines of output of pip install:
    C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\BIN\amd64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -DWIN32=
1 -DHAVE_NUMPY=1 -Inative\common\include -Inative\python\include "-IC:\Program Files\Java\jre1.8.0_65\bin\include" -Inat
ive\jni_include "-Ic:\program files\python35\lib\site-packages\numpy\core\include" "-Ic:\program files\python35\include"
 "-Ic:\program files\python35\include" "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\INCLUDE" "-IC:\Program
Files (x86)\Microsoft Visual Studio 14.0\VC\ATLMFC\INCLUDE" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.10586
.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\inc
lude\10.0.10586.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.10586.0\um" "-IC:\Program Files (x86)\W
indows Kits\10\include\10.0.10586.0\winrt" /EHsc /Tpnative\common\jp_array.cpp /Fobuild\temp.win-amd64-3.5\Release\nativ
e\common\jp_array.obj /EHsc
    jp_array.cpp
    native\jni_include\jni.h(31): error C2371: 'int8_t': redefinition; different basic types
    C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\INCLUDE\stdint.h(17): note: see declaration of 'int8_t'
    error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\amd64\\cl.exe' failed with exit stat
us 2

    ----------------------------------------
Command ""c:\program files\python35\python.exe" -u -c "import setuptools, tokenize;__file__='C:\\Users\\z003husp\\AppDat
a\\Local\\Temp\\pip-build-alq9o0x9\\jpype1\\setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().repl
ace('\r\n', '\n'), __file__, 'exec'))" install --record C:\Users\z003husp\AppData\Local\Temp\pip-is_mdcyq-record\install
-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\z003husp\AppData\Local\T
emp\pip-build-alq9o0x9\jpype1

will re-run this on appveyor as soon #178 is merged.

Facing similar issues while installing Jpype. Using Windows 7, Python 3.5 and VS 2015. Is there any way to map the installation file to compile using VS 2010 compilers?

@jayesef can you please add a "dummy" commit (eg. change some whitespace or so) to re-trigger the build on Appveyor (which is now working again)?

@sinisteraadi I do not know if distutils/setuptools on windows also respects the "CC" environment variable, by setting this on Unix one can choose the compiler to use.

@marscher I've done the dummy commit, AppVeyor succeeded.

Thank you!


Tasks/Integrated Terminal not picking up User Path

VSCode Version: 1.9
OS Version: Windows 7

It seems like VS Code is not inheriting the user level PATH in Windows 7. System level PATH is working fine.
Steps to Reproduce:

Run a shell command from either a task or integrated terminal
If the target is defined in User Path, "* is not recognized as an internal or exsternal command, operable program or batch file."

Anyone else having this behavior? Is it intended? It's been a few weeks since I was actively using VS Code, so I'm not sure exactly when this started happening, but it wasn't an issue before...

I can't reproduce this neither in the terminal nor as a task. I executed the following task:
    {
            "taskName": "Path",
            "command": "echo",
            "args": [
                "%PATH%"
            ],
            "isShellCommand": true
     }

and it prints the correct environment.
@Tyriar any idea what could cause this since it seems to happen in the terminal as well.
@dotnetdan any additional information you can provide? How do you start VS Code?

@dotnetdan you will need to close all instances of VS Code and relaunch of you have only just changed the environment variable, could this be what you're experiencing?

After rebooting my computer, everything went back to normal - I hadn't rebooted in ages and corporate controlled system updates were pending, so maybe the issue was external to VS Code. Sorry for the false alarm.


Is integrated staking on the roadmap?

:link: zboto Link

Do you mean on Ledger Live?

Closing this due to inactivity


Update waypoints.yaml

This should fix
https://github.com/PickNikRobotics/moveit_studio/issues/3662
and
https://github.com/PickNikRobotics/moveit_studio/issues/3661.

Closed in favor of #38


nbdev_nb2md does not take in consideration #hide.

When converting from .ipynb to .md cells with #hide are present in the markdown file.
Notebook:

Markdown file contains:
Title
#print("hello")

Test1
#hide
print("test cell")

test cell

Test2

I'm not able to reproduce this behavior.  Steps I took:

Cloned fastai/nbdev repo
Made sure I am using the latest version of nbdev pip install -e .
navigated to notebook folder cd nbs
ran the following command nbdev_nb2md 06_cli.ipynb
when running tail 06_cli.md the last cell of the corresponding notebook is infact hidden.

Closing this issue, but please do open a new issue that has a reproducible example with a real project & notebook that we can test against.
cc: @jph00
Thanks,

@hamelsmu Thank you for the clarification. It works with Jupyter Notebooks indeed. The problem was that I`ve been using Colab Notebook. As I know in Colab nb there is additional metadata which makes it different from Jupyter nbs. Is nb2md supposed to work with Colab nbs?

Colab adds to the end of some lines \r character.
I created two identical notebooks, one in Jupyter Notebook, another in Colab. If you open them in text editor you will see, that in Jupyter it will look like:
'#hide\n'
and .ipynb from Colab is:
'#hide\r\n'
If you remove '\r' character and run nb2md all works ok.

@IRailean can you please provide a step-by-step way to reliably reproduce this issue please?

@IRailean can you please provide a step-by-step way to reliably reproduce this issue please?

Hi @jph00 .
Here is how I reproduced the problem:
A.
1.Create a new notebook in Google Colab
2. Add
#hide
print("Hello world")

and run it
3. Create second separate Google Colab nb and run:
!git clone https://github.com/fastai/nbdev.git
!pip install -e nbdev

to install nbdev
4. Run:
import json
nb_path = '/content/drive/MyDrive/Colab Notebooks/Untitled7.ipynb'
with open(nb_path) as f:
  data = json.load(f)

print(data)

to get first notebook in json format (Untitled7 is the name of my first nb).
5. In the output find the content of the cell of the first nb.
In my case:

You can see that there are '\r\n' characters at the end of the line where '#hide' is located.
B.
I wanted to check if it is really problem in this extra '\r' and copy pasted some regex functions from nbdev
(I've simplified 3 functions from nbdev, but didnt change theirs core functionality)

And then if you run
remove_hidden(d['cells'][0])

There will be no match (#hide). But, if, first you rstrip the line and then run remove_hidden:
d['cells'][0]['source'] = d['cells'][0]['source'].rstrip('\r\n')
remove_hidden(d['cells'][0])

It fill find #hide in the line.
I've came up with the temporary solution: before running nbdev_nb2md I run:
import json
nb_path = '/content/drive/MyDrive/Colab Notebooks/Untitled7.ipynb'
with open(nb_path) as f:
  data = json.load(f)

for cell in data['cells']:
  for idx, line in enumerate(cell['source']):
    cell['source'][idx] = cell['source'][idx].strip('\r\n') + '\n'

to remove '\r' character at the end of the line. (Yes, sometimes it will add an extra \n if there is no \r\n sequence, but as I am testing #hide functionality, it does not matter)

Hi @jph00 .
Here is how I reproduced the problem:
A.
1.Create a new notebook in Google Colab
2. Add
#hide
print("Hello world")

and run it
3. Create second separate Google Colab nb and run:
!git clone https://github.com/fastai/nbdev.git
!pip install -e nbdev

to install nbdev
4. Run:
import json
nb_path = '/content/drive/MyDrive/Colab Notebooks/Untitled7.ipynb'
with open(nb_path) as f:
  data = json.load(f)

print(data)

to get first notebook in json format (Untitled7 is the name of my first nb).
5. In the output find the content of the cell of the first nb.
In my case:

You can see that there are '\r\n' characters at the end of the line where '#hide' is located.
B.
I wanted to check if it is really problem in this extra '\r' and copy pasted some regex functions from nbdev
(I've simplified 3 functions from nbdev, but didnt change theirs core functionality)

And then if you run
remove_hidden(d['cells'][0])

There will be no match (#hide). But, if, first you rstrip the line and then run remove_hidden:
d['cells'][0]['source'] = d['cells'][0]['source'].rstrip('\r\n')
remove_hidden(d['cells'][0])

It fill find #hide in the line.
I've came up with the temporary solution: before running nbdev_nb2md I run:
import json
nb_path = '/content/drive/MyDrive/Colab Notebooks/Untitled7.ipynb'
with open(nb_path) as f:
  data = json.load(f)

for cell in data['cells']:
  for idx, line in enumerate(cell['source']):
    cell['source'][idx] = cell['source'][idx].strip('\r\n') + '\n'

to remove '\r' character at the end of the line. (Yes, sometimes it will add an extra \n if there is no \r\n sequence, but as I am testing #hide functionality, it does not matter)

@IRailean I am not sure nbdev explicitly supports development in Colab.  @muellerzr has done this but I know he encounters similar issues from time to time.
Pinging @jph00 for his thoughts.

@IRailean I am not sure nbdev explicitly supports development in Colab.  @muellerzr has done this but I know he encounters similar issues from time to time.
Pinging @jph00 for his thoughts.

@hamelsmu I have a related PR here: https://github.com/fastai/nbdev/issues/363 I'll tackle the /r issue as well

@hamelsmu I have a related PR here: https://github.com/fastai/nbdev/issues/363 I'll tackle the /r issue as well

@jph00 reopening for now. It seems that didn't 100% solve the issue, so I'm going to take a different approach to it. I say it didn't solve because the solution doesn't solve https://github.com/fastai/nbdev/issues/365 which has a similar issue (from what I can tell)

@jph00 reopening for now. It seems that didn't 100% solve the issue, so I'm going to take a different approach to it. I say it didn't solve because the solution doesn't solve https://github.com/fastai/nbdev/issues/365 which has a similar issue (from what I can tell)

@muellerzr friendly ping to see if you are still working on this or this can be closed?  Thank you

Hi @muellerzr do you think that your fix in #366 could have caused https://github.com/fastai/nbdev/issues/422 ?

@hamelsmu yeah it should've been closed with that PR. That being said, yeah it caused #422. Will look there and continue it over there


Typo "Postgres version"→"PostgreSQL version"

https://docs.microsoft.com/en-us/azure/postgresql/concepts-supported-versions
https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/postgresql/concepts-supported-versions.md
#PinfMSFTDocs

@hyoshioka0128 : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Add support to update Elasticache ReplicationGroup number of cache clusters

Description of your changes
This PR is a follow up of https://github.com/crossplane/provider-aws/pull/1277 and adds the ability to update the number of cache clusters in an Elasticache Replication group.
I have:

[x] Read and followed Crossplane's [contribution process].
[x] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested
Modified the numCacheClusters field of the following Managed resource and observed changes in the AWS UI:
apiVersion: cache.aws.crossplane.io/v1beta1
kind: ReplicationGroup
metadata:
  name: redis-replication-group
spec:
  forProvider:
    region: us-east-1
    replicationGroupDescription: "A redis replication group"
    applyModificationsImmediately: true
    engine: "redis"
    engineVersion: "5.0.6"
    port: 6379
    cacheSubnetGroupName: borrelli-cache-test
    #cacheSubnetGroupName: default
    numCacheClusters: 2
    cacheParameterGroupName: default.redis5.0
    cacheNodeType: cache.t3.medium
    securityGroupIds:
      - sg-043f36491eff11368 #created by steven 4/7/2022
      #- sg-0e40d33cb65e94352
    automaticFailoverEnabled: true
    #multiAZEnabled: false
    tags:
      - key: Name
        value: redis-replication-group
      - key: Environment
        value: dev
  providerConfigRef:
    name: default

I will need to fix some merge conflicts on this PR.


refactor: cancel unneeded page fetches at the end of seek

We initially prefetch PREFETCH_N pages along the path to any given key. By the time the seek
operation is completed, we may know in advance that several of these page fetches were simply unnecessary.
By canceling these pre-fetches, we allow the page-fetch workers to avoid performing unnecessary I/O.
This effectively clears the workload of the page-fetch workers when the warm-up workers conclude,
leaving them free to work on the next transaction of pre-fetches.

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#158  👈
#157
#151
#149 : 1 other dependent PR (#150 )
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @rphmeier and the rest of your teammates on  Graphite


Fc/code cleanup

Pull Request Test Coverage Report for Build 996940864

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.902%

Totals

Change from base Build 996508571:
0.0%

Covered Lines:
503

Relevant Lines:
508

💛  - Coveralls


Eliminate the Worker State Reconciler

How to categorize this PR?

/area scalability cost
/kind enhancement
What this PR does / why we need it:
This PR drops the Worker state reconciler that currently is auto-added to all Worker controllers. Please see GEP-22 for information about the motivation.
With this PR, the migration flow is adapted as follows:

gardenlet collects machine state and persists it in the ShootState under .spec.gardener[].type=machine-state.
gardenlet shallow-deletes the machine-related resources (this was previously done by the generic Worker actuator).
For a few releases, gardenlet no longer persists the state stored in .status.state of Worker resources (to not duplicate the machine state in the ShootState).

The restoration flow is adapted as follows:

The generic Worker actuator tries to read the machine state directly from the ShootState in the garden cluster (which is now possible since #8001). This alleviates the necessity to let gardenlet read it and populate it somehow to the destination seed for the provider extensions to pick up - they can do it directly.
gardenlet fetches the machine state from the ShootState's .spec.gardener[] field (previously, the machine state was fetched from .spec.extensions[].kind=Worker) and still populates it to the Worker's .status.state field. This is just to preserve backwards-compatibility, because registered extensions might not yet have vendored the newest library, hence they might still rely on this field during restoration. This will be dropped in a future version.

The PR also addresses a TODO leftover task from https://github.com/gardener/gardener/pull/8082 about only persisting the ShootState after all extension resources have been migrated.
Which issue(s) this PR fixes:
Fixes #8488
Special notes for your reviewer:

The version skew policy for extensions was clarified as part of this PR.
github.com/gardener/machine-controller-manager was revendored to 0.50.0 according to #8539. In this version, the legacy provider-specific API types are cleaned up. The revendoring was needed to make the machine.sapcloud.io/v1alpha1 CRDs available for the integration tests.
Accordingly, the no longer needed MachineClass-related methods were dropped from the generic Worker actuator interface.

/cc @plkokanov
Release note:

The `Worker` state reconciler has been dropped, i.e., updated provider extensions will no longer populate the machine state to the `.status.state` field of `Worker` resources. For a few releases, `gardenlet` will no longer persist any still existing data in the `.status.state` field of `Worker` resources during a control plane migration of a `Shoot`, and it will set `.status.state` to `nil` after a successful reconciliation or restore operation.

Provider extensions must now pass the `cluster.Cluster` object for the garden cluster to the `genericactuator.NewActuator` function. See [this](https://github.com/gardener/gardener/blob/8d2f116aa606e5181cd430e5063dd798629bdc78/cmd/gardener-extension-provider-local/app/app.go#L228-L246) for an example how to create such a `cluster.Cluster` object.

The `MachineClassKind()`, `MachineClass()`, and `MachineClassList()` methods have been dropped from the generic `Worker` actuator's interface and do not need to be implemented anymore.

During the `Migrate` phase of a control plane migration of a `Shoot`, the state is now only persisted after all extension resources have been migrated. Consequently, make sure that you have added all state to the `.status.state` field of the respective extension object when running `Migrate()`.

/assign

/assign

/lgtm

/test pull-gardener-unit


feat(OKX and Phantom): New Wallets

Testing: Used tangz-mobile to validate that getWalletAddress worked. Also inserted code to test sendBtc for OKX

What's the process for releasing these changes? Do I have to run npm pack locally and publish to npmjs.com?


Sign in With Apple Not Working

I am trying to use the magic_ext_oauth plugin to sign in using Socials. I am using Google and Apple. The former sign in method works, but the latter doesn't. Upon debugging, realized the return value after logging in with pop-up returns null. Here is the code snippet we are using to sign in:
  final configuration = moauth.OAuthConfiguration(         provider: moauth.OAuthProvider.APPLE,         redirectURI: "link.magic.app://",       );       OAuthResponse response = await magic.oauth.loginWithPopup(configuration);
Trying to get the didToken by reading the idToken from response.magic?.idToken returns null.
I have tried using the sample demo app but Apple Sign in still doesn't work

I want to add more descriptions from @nziokajimkelly, I debug your SDK, in magic_ext_oauth.dart I get this error after the user successfully authenticates with an Apple account.

Thanks @nziokajimkelly  and @wandriputra, we're looking into this, will report back asap.

@nziokajimkelly @wandriputra The error (ie  Failed to retrieve OAuth access token.) only appears when something has gone awry with the way things were setup with the third party OAuth provider, which in this case is Apple.
I suggest you review our documentation under the "Apple Setup" heading to make sure you've supplied the correct credentials to the form on your dashboard.
With regard to our demo app not working, we found a conditional logic error  that prevented the app from navigating to the main screen. That said, we were still able to use Apple to login successfully.
To test yourself, feel free to use the key provided in this demo and compare that to what is returned with your key.

I get this screen while using my private key from the Magic dashboard. seems the configuration is correct.

do you have an example app for flutter so we can do the same? just want to make sure setup for flutter is correct

do you have an example app for flutter so we can do the same? just want to make sure setup for flutter is correct

@wandriputra Yes, feel free to utilize our demo flutter app for testing and report back.

@Ariflo demo api-key works fine but our api-key not working at all same error we get with the above screenshot. so the problem is with the configuration in our Magic Dashboard?
why does the web version work? and flutter version not.

Also be sure your redirectURI is your actual callback url scheme, and remain unchanged for the rest

@Ariflo how do you define the redirectURI for iOS? I can't find it in your documentation tutorial

demo api-key works fine but our api-key not working at all same error we get with the above screenshot. so the problem is with the configuration in our Magic Dashboard?

If you are seeing the same error crop up when you plug-in your api-key to our demo flutter app, but crucially do not see it crop up when using our demo api-key with the same app; then this suggests something is possibly wrong in 2 places:
1 - Your configuration in the Magic Dashboard
OR
2 - Your configuration with the third party (ie. Apple)
Given the fact that you mentioned the web (ie. "test connection" button) works but the Flutter fails, I would investigate # 2 and check your setup with Apple.

how do you best way to define the redirectURI for iOS? I can't find it in your documentation tutorial

The redirectURI should be your app scheme (ie. "appName://"). See here for more details.

You're probably aware of this, so apologies for the repetition, but here is how we've setup Oauth in the demo app.

@wandriputra any updates here?

@Ariflo we have some issues with Apple in our account and our private key for sing-in with Apple. we Solve this by contacting Apple.
Thanks for your help I will close this issue.

Thank you for the followup @wandriputra !
@Ariflo I am closing the issue, thank you!


Hovering on Tooltips and then resizing the browser screen cause scrollbar on the body

This behavior can be seen on the materialize site's tooltips page itself.  To replicate the issue, hover on the tooltips first and then resize screen. Horizontal scrollbar will appear.
https://materializecss.com/tooltips.html

I had this problem in previous version of materialize as well (0.9) and avoided it by using body { overflow: hidden; } but would like to know if this can be resolved.

I can't see resizing the window while opening tooltips as a common issue. If you want you can just dismiss tooltips on resize

I was seeing this issue on a site with navigation between pages of different widths.  { overflow: hidden; } wasn't an option - I had to destroy tooltips prior to navigation and recreate them after to avoid the horizontal scroll bar while allowing tooltips to persist a browser resize/navigation event.

Been experiencing this problem. The problem happens when you load the page in a big screen and resizing to a much smaller screen.
Tooltips retain their original position and will cause the horizontal scrollbar to appear. This breaks the responsiveness of the page.

Yeah I think it would be worth it to add a resize event listener to open tooltips to prevent this

I had a similar problem, and my issue was I had a div with a max height and the window was also scrollable. the tooltip was moving all over the place so this is what I did.
on the "_repositionWithinScreen" in materialize.js
I changed the old
`
key: "_repositionWithinScreen",
value: function _repositionWithinScreen(x, y, width, height) {
var scrollLeft = M.getDocumentScrollLeft();
var scrollTop = M.getDocumentScrollTop();
var newX = x - scrollLeft;
var newY = y - scrollTop;
    var bounding = {
      left: newX,
      top: newY,
      width: width,
      height: height
    };

    var offset = this.options.margin + this.options.transitionMovement;
    var edges = M.checkWithinContainer(document.body, bounding, offset);

    if (edges.left) {
      newX = offset;
    } else if (edges.right) {
      newX -= newX + width - window.innerWidth;
    }

    if (edges.top) {
      newY = offset;
    } else if (edges.bottom) {
      newY -= newY + height - window.innerHeight;
    }

    return {
      x: newX + scrollLeft,
      y: newY + scrollTop
    };
  }

to
key: "_repositionWithinScreen",
value: function _repositionWithinScreen(x, y, width, height) {
var scrollLeft = M.getDocumentScrollLeft();
var scrollTop = M.getDocumentScrollTop();
var origin = this.el;
var tooltip = this.tooltipEl;
var newX = x - scrollLeft;
var newY = y /- scrollTop/;
var targetTop = origin.getBoundingClientRect().top + M.getDocumentScrollTop();
targetTop += origin.offsetHeight / 2 - tooltip.offsetHeight / 2;
    var bounding = {
      left: newX,
      top: newY,
      width: width,
      height: height
    };

    var offset = this.options.margin + this.options.transitionMovement;
    var edges = M.checkWithinContainer(document.body, bounding, offset);

    if (edges.left) {
      newX = offset;
    } else if (edges.right) {
      newX -= newX + width - window.innerWidth;
    }

    if (edges.top) {
      newY = offset + targetTop;
    } else if (edges.bottom) {
      newY -= newY + height - window.innerHeight + targetTop;
    }

    return {
      x: newX + scrollLeft,
      y: newY /*+ scrollTop*/
    };
  }

`


Attempting to run CI with QCEngine 0.21, QCElemental 0.24

Changelog description

Status

[ ] Code base linted
[ ] Ready to go

@bennybp not exactly certain, but in order to use QCEngine 0.21.1, which will include MolSSI/QCEngine#339, I think we'll need to resolve the issues raised by the CI here. Thoughts?

Just a small change needed, and it is now passing. Good to go?

On second thought, maybe we should pin to qcengine >= 0.21 and qcelemental >= 0.24? @loriab says she will be creating a new version of qcengine soon, which wouldn't be pulled in (I think). Or are conda and pip smart enough to pull matching minor versions but different patch levels?

@bennybp just tried out going with qcengine >= 0.21 and qcelemental >= 0.24; looks like all tests pass!


build: tests: make tests run verbose

Add verbose option to the test build so that we can get more info on failed builds.

Codecov Report

Merging #126 (fedecf4) into master (8755731) will decrease coverage by 0.30%.
The diff coverage is n/a.

:exclamation: Current head fedecf4 differs from pull request most recent head a56144b. Consider uploading reports for the commit a56144b to get more accurate results

@@            Coverage Diff             @@
##           master     #126      +/-   ##
==========================================
- Coverage   87.50%   87.20%   -0.30%
==========================================
  Files          10       10
  Lines         256      250       -6
==========================================
- Hits          224      218       -6
  Misses         32       32

Impacted Files
Coverage Δ

dvclive/metrics.py
93.87% <0.00%> (-0.36%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8755731...a56144b. Read the comment docs.


Update PR title allowed words

+parallelize
+isolate

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/4462/
Test PASSed.

alluxio-bot, merge this please


Symbols fly out of the container (design)

Bug Type
Performance
Reproduction steps

Go to the main screen
Enter a very large number (>52 characters) in the first field

Actual result
Characters do not go outside the container. The number of characters was reduced, the container remained intact.
Expected result
Screenshot gets wider, text flies out of container. This violates the visual component. Yes. The container has the flex property, but there is a confrontation of text elements and a block with an element.
Suggested Severity
Low
Device

FireFox/Microsoft Edge/Google Chrome
Nothing, just main page
PC/Web
Windows

Additional Context

Hello, have you checked this bug?

Will you point this bug to me as part of the bounty bug?
Sincerely, Drake

?

Guys, tell me please, will there be a payment for the report or not?
Sincerely, Xarton D.

?


Board games rework

The board game page needs a rework. Based on feedback:

Remove the rating and complexity fields from the UI. Cells should be 1-2 lines when unexpanded.
Add 'best with' values to database. BoardGameGeek.com has these in its API output but current script doesn't capture them; need to modify script that pulls data from BGG, then add fields to Model object and modify Migrations.
Then, add "GameFinder" wizard that asks user how many people want to play and approximate play time. Perhaps include checkbox for kids. Wizard then shows games that match criteria.
Internally the wizard can sort results with a scoring system using rating, avg playtime, ideal # players, and minimum age as scoring inputs.

Game page now has a recommendation wizard. Game cells are a bit tighter now when in the unexpanded state.


It appears that the Docker Hub AutoBuilds system doesn't yet support Windows containers.  Such platform limitations should b added to the 'Limitations' section

File: docker-hub/builds.md, CC @johndmulhausen

There is any plan to support windows containers on Docker Hub AutoBuilds?


CDS new users get previously installed profiles

User Story
New users created in Automate or SAML logins should have all the CDS profiles that have been previously installed. This includes all prior versions.
Demo Script / Repro Steps

As admin install a few profiles
Create a new user
Open the compliance profile page and ensure all the install profiles are available.

no need for this due to requirements change (only installing to current user's profiles)


3 data decryption

Description
Merging will add binary file decryption needed by the frontend for plotting. Encrypted binary is converted into .json files which are then saved for use in the server.

Related Issue: #3
Feature Name: Binary Decryption

Type of Change

[x] New feature (non-breaking change which adds functionality)
[ ] Enhancement (non-breaking improvement to an existing feature)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

How Has This Been Tested?
Please describe the tests that you ran to verify the feature. Provide instructions so others can replicate these tests. Include any relevant details like the test environment, test cases, and scripts.

Tested On:

[x] Local machine
[ ] CI Pipeline
[ ] Staging environment

Test Description:

[ ] Unit tests
[ ] Integration tests
[x] Manual testing

Checklist

[x] My code follows the style guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code where necessary.
[ ] I have added documentation explaining what this feature does and how to use it.
[ ] I have added tests to cover my changes.

[ ] I have checked for any security concerns or performance impacts.

Impacted Areas in the Project
Please specify which areas of the project this feature might affect.

Components/Files Affected: server/decryption folder
Other features or services impacted: none

Additional Information
For now, running the code continously every 10 seconds results in an error trying to get patient's information. This need to be fixed later and checked on MORBERG MONITOR

Reviewer’s Guide:
Please ensure:

Code is clean and properly documented.
The feature works as expected and doesn’t introduce any regressions.

Well done! I tested it locally, and the decryption functionality works well. I encountered an OverflowError from "byte_index_list.append(byte_index_dict[f"{i}"][1] * 256 + byte_index_dict[f"{i}"][0])" in the extract_index_files method of the binary_extraction.py file from the binary-boys project last year. After I tried modifying it, everything ran smoothly. Did you encounter this issue? Or have you made any modifications to this file? Since this file is ignored on GitHub.

Excellent!
Yes we did edit that line, changed 256 to 255. Our mistake on not letting you know.


[Syntax] Represent TokenSyntax as a Syntax node

Previously, users of TokenSyntax would always deal with RC<TokenSyntax>
which is a subclass of RawSyntax. Instead, provide TokenSyntax as a
fully-realized Syntax node, that will always exist as a leaf in the tree.
This hides the implementation detail of RawSyntax and SyntaxData
completely from clients of libSyntax, and paves the way for future
generation of Syntax nodes.

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

This should be the second-to-last sweeping change. Now that the API looks nice, we can start generating.

Thanks for the reviews!


Rewrite as a Svelte/Express app

https://sveltetechnology-ukcvrplota.now.sh
Svelte is mature enough that it makes sense to use it rewrite https://svelte.technology. Apart from testing out the development workflow, this has some tangible benefits:

the code is a lot more organised (much easier to include components in multiple pages, for example)
the site feels faster, because of client-side routing

Still very work-in-progress, lots of outstanding tasks:

[x] Reimplement the REPL
[x] Highlight current guide section on scroll
[ ] Preload data for other routes, for instant navigation
[ ] Loading indicators for the extreme cases when that's necessary
[x] Syntax highlighting in guide (we can probably do this at build time, rather than loading CodeMirror on the client just for that)
[x] 'Open in REPL' links in the guide
[ ] Service worker
[ ] Whatever webpagetest.org recommends
[ ] Update URL in REPL when using a built-in example (including version)
[ ] Load built-in examples asynchronously
[x] Add fallback fonts everywhere
[ ] Curl sometimes doesn't load. WTF?

plus whatever I forgot.
A few notes on developer experience:

The way CSS is generated (creating a component that imports all other components, bundling it with generate: 'ssr' then calling app.renderCss()) is a bit clunky. It means you have to maintain that App.html file as you add new routes, and you have to send all the CSS for the entire app (though maybe that's not a bad thing — dynamically adding CSS is often a CSP violation, and the CSS is tiny).
Because the CSS isn't generated dynamically, editing a component means that the unique hash gets out of date, and server-rendered CSS isn't applied to client-rendered components. Would be nice if there was a good way to generate the CSS dynamically while developing (but still serve the baked version in production) — otherwise you have to keep stopping and starting the npm run dev task
HMR would be nice!
Client-side routing could be a bit more declarative — though the trick is to do that without losing the ability to do things like this, which is hard to do if you go ultra-declarative with your routing setup. (Maybe that particular bit of logic belongs in the component itself, I don't know.)
There's probably some stuff that's unnecessarily duplicated between server-side and client-side routing. For now I like having them separate, but it could eventually seem like a chore, or (worse) bug-prone.

As we gather more of this sort of data on building these kinds of apps, maybe it'll become clearer what can be packaged up somehow in a way that improves the developer experience, in the way that Next.js improved the experience of building universal React apps.

I've deployed this even though there are tasks outstanding, as it's an improvement on the previous site, and it will hopefully mean feedback/bug reports.

I was actually just taking a look at this locally. One thing I saw (besides the missing roadtrip dependency, which I see you fixed) was a weird routing bug on Firefox. Start from a particular anchor on the guide page, then click to the REPL or blog, then press back - the last back doesn't work, I'm staying on whatever the non-guide page was. This works fine on Chrome and works fine if you don't start from an anchor on the guide page.

Huh, that is weird. What version of FF are you using? It seems to be okay for me on FF52 on OS X. Do you see any errors in the console when that happens?

I'm on Firefox 52 on Windows. I am getting a TypeError: t.state is null error when I go back from the non-guide page to the guide with the fragment. I'm also seeing that same error when I click on anchor links from within the guide page, but I guess that doesn't actually cause problems at that moment because the browser just follows it like a regular anchor hyperlink.

Huh, thought I'd fixed that in https://github.com/Rich-Harris/roadtrip/commit/27778faa42ba98d5afae19f334180439625fe229. Is this happening on the deployed site, or locally? Could it be that your dependencies are out of date?

This is on the live deployed site. But taking a look at the minified code in https://svelte.technology/bundle.js I don't see that change.

Ok, now I'm more freaked out that it is working for me! Now that you mention it does seem like something is missing from that code. Perils of trying to fix bugs at the end of the day.

Should this conversation move over to roadtrip?

Probably! And if you know of any alternative routers that use regular <a> tags instead of framework-specific stuff, and handle scroll history etc, then I'm all ears — I don't really want to be in the router business, I just couldn't find anything that either a) did nothing and had no opinions or b) did everything and had all the opinions
https://github.com/Rich-Harris/roadtrip/issues/9

The div.error with the error messages in the CodeMirror component in the REPL are not displaying correctly. They're present in the DOM when they should be, but not visible on the page.

Everything under the src directory can be removed with this rewrite, correct?

Everything under the src directory can be removed with this rewrite, correct?

Yep, am just keeping it around so it's easier to copy and paste stuff if I need to... have updated the task list at the top of the page so we don't forget

So lol oops - just the other day I opened a PR against https://github.com/flagello/awesome-sveltejs to have the link to the REPL there be to https://svelte.technology/repl/?version=1&gist=c80ee9ec68fefa93617dfc40400851f5 instead of a particular version because that would grab the latest 1.x.x version and would redirect/rewrite the version param in the url - but that feature no longer seems to be working! Was that an intended feature before?

Ah, right — that makes sense. We probably just need to add an entry here

Some LESS snuck into the CSS here.

Merging this, will open separate issues for the remaining tasks


Fix +foo/testOnly foo.BarTest

After tracking down the change that caused #4715, I took a stab at trying to fix it.  I may have managed to bring back cross-building a sub-project command again, but I'm not sure if it is correct, or if it breaks other things.
In particular, the change here breaks the ability to cross-build a command alias, which I only noticed because be91300 added a test for it.  There may be a way to make it work, but I couldn't see how.

Closing this in favor of https://github.com/sbt/sbt/pull/5265


Discussion: Needs for symbols (pdb) packages

Do you think debug symbols packages are necessary?

No, they're unnecessary!
Wanna debug symbols - generate your own packages!


Added -AllUsers to Get-PnPAlert

Type

[ ] Bug Fix
[X] New Feature
[ ] Sample

Related Issues?
N/A
What is in this Pull Request ?
Added -AllUsers option to Get-PnPAlert which allows for retrieval of all alerts of all users in the currently connected site

@KoenZomers - can you merge the latest dev branch in this commit ? We have updated MSAL DLL so that's why it is causing pipeline failure

@gautamdsheth Done

Thanks @KoenZomers , merged it !


Missing dependencies for report dialog should be calculated in a thread

Problem Description
Currently a timer is being used to prevent freezing the application while starting. Probably a thread should be used instead to do the call to check for missing dependencies.
Pinging @ccordoba12 just in case

This is already done in the Application plugin.


cli: use npm in case of failed yarn

When checking the code for https://github.com/project-serum/anchor/issues/1805 noticed that if yarn install will fail then npm can not be used as a fallback.

Based on the merge conflicts a simpler alternative to this has already been merged. Thanks though!


KMAC is_locked inverse result

https://github.com/lowRISC/opentitan/blob/cc7d363b4eaf952dd08a79eeacaa4d4d7a58f35a/sw/device/lib/dif/dif_kmac.c#L769-L779
I seem to think that the result is_locked is the inverse of what it should be. What I expect is:

KMAC is locked/busy -> is_locked = True
KMAC is available -> is_locked = False

but the result is the other way around. I am not sure if I this is a bug or I am just thinking too literally about the interpretation of the function's name.
In any case, this is blocking PR #14637, because my update is breaking some KMAC dif unittests.
I attached an example for KMAC below, so that one can see the value of KMAC_CFG_REGWEN_EN_BIT when KMAC is idle.

i feel like your interpretation makes more sense.
@jadephilipoom
@eunchan
@cindychip
are you guys okay with making the change as @ballifatih suggested?

So, IIUC, is_locked in DIF represents the CFG_REG_WEN directly and it should be the inverse of CFG_REG_WEN?
Maybe @jadephilipoom knows better, but I think so. (and waveform also shows CFG_REG_WEN being 0 while KMAC is running.)

So, IIUC, is_locked in DIF represents the CFG_REG_WEN directly and it should be the inverse of CFG_REG_WEN?

Yes, exactly this.
As a side note, I was able to find only these three unit tests calling dif_kmac_config_is_locked. I think these should also be updated because of this meaning change.
https://github.com/lowRISC/opentitan/blob/17a89ad860106aa5ad5d018c80eea27dc2f81c3a/sw/device/lib/dif/dif_kmac_unittest.cc#L590-L610

I also agree with Fatih's suggestion. :+1:

I suggested a fix in PR #15431, I can close this issue if someone can merge it.

Thank you @jadephilipoom, @eunchan, @tjaychen. Closing this because #15431 is merged.


[Avatar] Avatar does not apply colorDefault class when child is 0

The Avatar component does not apply its colorDefault class when its children are a falsey value, including 0

[X] This is not a v0.x issue.
[X] I have searched the issues of this repository and believe that this is not a duplicate.

Expected Behavior 🤔

Avatar should render its defaultColor class with the child 0 the same as it does with "0"

Current Behavior 😯

Avatar relies on the truthiness of its children to determine if the defaultColor class is applied to the component, so falsey values ( 0, "" ) that may be the desired output do not render as expected

Steps to Reproduce 🕹

Link: https://codesandbox.io/s/r7k333zzx4
Context 🔦

N/A
Your Environment 🌎

Tech
Version

Material-UI
v3.3.2

React
v16.3.1

Browser

TypeScript
N/A

etc.

Potential Solution
https://github.com/mui-org/material-ui/blob/master/packages/material-ui/src/Avatar/Avatar.js
Current:
  const className = classNames(
    classes.root,
    {
      [classes.colorDefault]: childrenProp && !src && !srcSet,
    },
    classNameProp,
  );

Suggestion: Rather than rely on truthiness, loose compare against undefined to allow 0 or "" to pass conditions
  const className = classNames(
    classes.root,
    {
      [classes.colorDefault]: childrenProp != undefined && !src && !srcSet,
    },
    classNameProp,
  );

@camilleryr Thank you for opening this issue. It's definitely wrong. I would try to push that one step further:
  const className = classNames(
    classes.root,
    {
-     [classes.colorDefault]: childrenProp && !src && !srcSet,
+     [classes.colorDefault]: !src && !srcSet,
    },
    classNameProp,
  );

The branch logic is present since the first implementation: https://github.com/mui-org/material-ui/commit/ecec90b46d9f150980bdd8142f1721ee6ac3c4f9. I see very use case for it. I believe it would be simpler without.
What do you think of this change? Do you want to submit a pull request? :)

I agree that removing the condition would be a fine move, I will submit a
pull request.
Chris
On Fri, Nov 30, 2018 at 1:54 PM Olivier Tassinari<EMAIL_ADDRESS>wrote:

@camilleryr https://github.com/camilleryr Thank you for opening this
issue. It's definitely wrong. I would try to push that one step further:
const className = classNames(
classes.root,
{-     [classes.colorDefault]: childrenProp && !src && !srcSet,+     [classes.colorDefault]: !src && !srcSet,
},
classNameProp,
);
The branch logic is present since the first implementation: ecec90b
https://github.com/mui-org/material-ui/commit/ecec90b46d9f150980bdd8142f1721ee6ac3c4f9.
I see very use case for it. I believe it would be simpler without.
What do you think of this change? Do you want to submit a pull request? :)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/mui-org/material-ui/issues/13751#issuecomment-443320291,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ae9iwi8ZsgZxfG-nNKcZvYSTSub6DFgCks5u0YztgaJpZM4Y7ho3
.


How to use IP without a domain name office

Welcome!

[X] Yes, I've searched similar issues on GitHub and didn't find any.
[X] Yes, I've searched similar issues on the Traefik community forum and didn't find any.

What did you expect to see?
How to use IP without a domain name office

Thanks for reaching out! To keep the repository focused, we ask that all questions be asked in the community forum. It is pretty active, so you might find that your question has already been answered there.  If not, you can ask and get help from other community members pretty quickly.


Apply Template to Existing Finding

Often times findings from scanners have various finding text. For an existing vulnerability there isn't a way to use any of the finding templates. I'd like to be able to insert template text on an existing finding by tying it to the CWE #. For example in the description portion of the finding I could click an insert template text button that would append the text to the description. At that point I can then edit the finding to my liking.

Hi @aaronweaver, to me this sounds like two parts. Have you had a chance to try the templating? When you create a finding there is an option to select "create template" which then can be used to add a finding using "finding from template". For a unique finding would CVE better than CWE?

I've noticed that over the past few months I have been doing a lot of copy and paste from existing findings to imported findings (i.e. impact, mitigation, etc.) so I thought I'd take a look at this.  The proof-of-concept I have so far allows you to select an "Apply Template to Finding" from the menu options on the finding page, you can then search and select a template to apply, the next step provides the text area fields (i.e. title, description, mitigation, etc.) of the finding with options that allow you to keep the text of the finding, replace the text of the finding with the template text, or Combine the text of the finding and the text of the template, you can then make adjustments to the text as desired.

Hey @jpbowie have you made any progress on this? I am interested in adding this functionality as well if there's anything I can do to help out.

The code is written, I'm just working through some issues integrating it with all of the recent changes to DefectDojo.

Completed via https://github.com/DefectDojo/django-DefectDojo/commit/5706e30d1231a8cc10e3eb9485166cb5d61fcbe4


XAxis ticks screwed up after changing it's category dynamically

Bug
We are changing the xAxis category dynamically based on the user selection. We are using the scrollable feature to implement the scroll. We are passing min and max values to XAxis.
Below is the code -
getXAxis() {
        let salesAxis = [];
        salesAxis = salesAxis.concat(**this.props.data.eventOutliers.data.sales**.map(function(o) {return o.unit + ' ' + o.year}));
        return {
            categories: salesAxis,
            labels:{style: {color: 'black'}},
            min:0,
            max:9
        };
    }
getSalesTrendData() {
        if (typeof this.props.data.eventOutliers === "undefined" || this.props.data.eventOutliers.length === 0) {
            return

;
        }
        let plotOptions = {
            series: {
                fillOpacity: 0.5,
                marker:{
                    enabled: false
                },
                cursor: 'pointer'
            }
        };
        return(
            <HighchartsStockChart plotOptions={plotOptions}>
                <Chart isPureConfig={true} zoomType='X'/>
                <Legend layout="horizontal" align="bottom" verticalAlign="bottom" symbolRadius={0}/>
                <XAxis {...this.getXAxis()} >
                </XAxis>
                <Tooltip shared backgroundColor="white" shadow={false} />
                <YAxis gridLineWidth='0'> <YAxis.Title>{this.getYAxisTitle()}</YAxis.Title>
                    <LineSeries id="salesTrend" name='Sales Trend' data={this.getData()} color='green' />
                </YAxis>
                <Scrollbar enabled={true} liveRedraw={true} minWidth={5} showFull={true}/>
            </HighchartsStockChart>
        )
    }

    render () {

        let graphTitle=  'Sales Trend Event';

        return (

                                        {graphTitle}

                            {this.getSalesTrendData()}

        );
    }

In the code above this.props.data.eventOutliers.data.sales changes based on the user selection.
Any help would be appreciated. Thanks in advance.
Versions

React JSX Highcharts version: using react-jsx-highstock 3.2.1
Highcharts version: 6.1.1
React version: 16.4.1

I am attaching 3 images here to explain the issue more. The first time graph plot well with no issue. Now when we scroll to right and then try to replot the graph based on the user selection the graph is distorted. The 3rd image shows the distorted graph.
Please explain what could be happening here.

It's difficult to say without seeing the data being provided to the graph.
But I would suggest the "Thursday Jan 1st" in the tooltip of the 3rd image implies the dataset set is incomplete? And hence defaulting to 1st Jan 1970?
I would guess this is because you're scrolling to a dataset that ends in the future, and sales data in the future is undefined? Leading to an incomplete dataset.
P.s. the categories you are loading across the bottom are a different format to your XAxis min and max values? Which seems strange?
P.p.s. I'm only making guesses here, would be easier if you could provide example data?

@nrai was any of the above helpful?

Closing due to inactivity


Gem Object Rename & Handle Response Collections

These changes have been tested in production with over 200 successful calls to the API.

The Gem rename meant that the gem could not be required without a require: 'cloud_scrape' in the Gemfile.
Handle collections within response. We were flattening the response due to the double array return. This flattened other collections as well.
Version bumped to 0.2.0

:+1: Nice - looks like the build failures are faulty env vars - I'll fix it up once this is in master.

@hofmeister TravisCI Fix https://github.com/cloudscrape/cloudscrape-client-ruby/pull/5


How to stop the "Using cache"

I try to create a duci-simple-demo project.  I coded in Windows VSCode and pushed the go-project to github in order to deploy the building-result to another centos7 server.
but, sometimes cause of "Using cache", It's not work.

The CI Server is Using Docker.  Run with this
docker run -p 8080:8080 -e GITHUB_API_TOKEN=xxx -v /var/run/docker.sock:/var/run/docker.sock duck8823/duci

Sorry, there is currently no way around the cache.
I recommend using Dockerfile only to define the execution environment (e.g. installation of the necessary tools), and use a task runner such as Makefile.

Thanks for your replies and suggestions.
After I created a linux-crontab to remove the  docker-image,  the caching problem is solved. If I have time later, I will write a duci project document to help everyone use duci  in their projects more conveniently.
Thanks again : )


armadillo: 8.500.0 -> 8.500.1

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools.
This update was made based on information from https://repology.org/metapackage/armadillo/versions.
These checks were done:

built on NixOS

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 8.500.1 with grep in /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1

directory tree listing: https://gist.github.com/6b042c178fafc84e571bb6d2ed67ae65

du listing: https://gist.github.com/32fd420f41d621a7b6b540cabbcf3f53

meta.description for armadillo is: '"C++ linear algebra library"'.
cc @juliendehos @knedlsepp for testing.

Success on x86_64-linux (full log)
Attempted: armadillo
Partial log (click to expand)
-- Installing: /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfig.cmake
-- Installing: /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfigVersion.cmake
-- Installing: /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1/lib/pkgconfig/armadillo.pc
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1
shrinking /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1/lib/libarmadillo.so.8.500.1
strip is /nix/store/j75dgadrff2d1fyc4fczmcgqkid2imdx-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1/lib
patching script interpreter paths in /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1
checking for references to /build in /nix/store/fgj0bi559rzmrmzm0y0fyfr75wljlwzz-armadillo-8.500.1...

Success on x86_64-darwin (full log)
Attempted: armadillo
Partial log (click to expand)
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/lib/libarmadillo.dylib
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloLibraryDepends.cmake
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloLibraryDepends-release.cmake
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfig.cmake
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfigVersion.cmake
-- Installing: /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/lib/pkgconfig/armadillo.pc
post-installation fixup
strip is /nix/store/kdff2gim6417493yha769kh00n63lnrw-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1/lib
patching script interpreter paths in /nix/store/5gfgb36x22lch94x6lk671rbp9d96fvv-armadillo-8.500.1

Success on aarch64-linux (full log)
Attempted: armadillo
Partial log (click to expand)
-- Installing: /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfig.cmake
-- Installing: /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1/share/Armadillo/CMake/ArmadilloConfigVersion.cmake
-- Installing: /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1/lib/pkgconfig/armadillo.pc
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1
shrinking /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1/lib/libarmadillo.so.8.500.1
strip is /nix/store/jk6j4lh9v5mvjdbdc35sj0zffhhf6s56-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1/lib
patching script interpreter paths in /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1
checking for references to /build in /nix/store/r78520gng2n8nnvvlb2qhnb7adm3aqwv-armadillo-8.500.1...


Typescript support

Great Library!
I'm using vue.js and typescript. Is there any typescript version for this library?
Please let me know
Thanks,

push

You can add the line
declare module 'vue-text-highlight';

to your src/shims-vue.d.ts file (or any other src/*.d.ts file in src).
Then the component can be used with Vue + Typescript when registered globally (e.g. in main.ts) like this:
import TextHighlight from 'vue-text-highlight'; // import works now
Vue.component('text-highlight', TextHighlight);

That worked for me at least.


Getting phoneme or IPA

Is there any way to get the Phoneme or IPA from the text input instead of using audio/recording?

@yulin-li is there a supported way to retrieve pronunciation information directly from synthesis with or without producing synthesized audio?
@pikojek, you may have already stumbled across it given the qualification you gave of "instead of using audio," but this is at least crudely possible using temporary audio as an intermediary between synthesis and pronunciation assessment, as per something like:
static async Task<string> GetIpaForTextAsync(string phrase)
{
    var tempAudioPath = Path.GetTempFileName();
    var synthesizer = new SpeechSynthesizer(
        SpeechConfig.FromSubscription(mySpeechKey, mySpeechRegion),
        AudioConfig.FromWavFileOutput(tempAudioPath));
    _ = await synthesizer.SpeakTextAsync(phrase);

    var recognizer = new SpeechRecognizer(
        SpeechConfig.FromSubscription(mySpeechKey, mySpeechRegion),
        AudioConfig.FromWavFileInput(tempAudioPath));
    var pronunciationConfig = new PronunciationAssessmentConfig(phrase)
    {
        PhonemeAlphabet = "IPA",
    };
    pronunciationConfig.ApplyTo(recognizer);
    var recoResult = await recognizer.RecognizeOnceAsync();
    var pronunciationResult = PronunciationAssessmentResult.FromResult(recoResult);

    var pronunciationBuilder = new StringBuilder();
    foreach (var pronouncedWord in pronunciationResult.Words)
    {
        foreach (var pronouncedPhoneme in pronouncedWord.Phonemes)
        {
            pronunciationBuilder.Append(pronouncedPhoneme.Phoneme);
        }
        pronunciationBuilder.Append(' ');
    }
    return pronunciationBuilder.ToString();
}

With calling code like:
static async Task Main(string[] args)
{
    Console.OutputEncoding = Encoding.Unicode;
    var input = "hello world, this is a test";
    Console.WriteLine($"Getting pronunciation for input: {input}");
    var pronunciation = await GetIpaForTextAsync(input);
    Console.WriteLine(pronunciation);
}

That yields the expected output of:
Getting pronunciation for input: hello world, this is a test
hɛloʊ wɝrld ðɪs ɪz ə tɛst

That's a lot of extra work for just retrieving the pronunciation, but it's at least attainable -- given speech-to-text is all about getting recognitions (and metadata like pronunciation) from audio, this indirection may be the best current fit if pronunciation isn't baked into text-to-speech in a directly accessible way.

Hi @pikojek, unfortunately we don't have an API to get the phonemes of input text. As Travis said, you can try to synthesize a temp audio and use pronunciation assessment to get the phoneme.

Hi @pikojek, unfortunately we don't have an API to get the phonemes of input text. As Travis said, you can try to synthesize a temp audio and use pronunciation assessment to get the phoneme.

I see, that's why I cannot find it on the documentation. event using API, noted on this @yulin-li :bow:

@yulin-li is there a supported way to retrieve pronunciation information directly from synthesis with or without producing synthesized audio?
@pikojek, you may have already stumbled across it given the qualification you gave of "instead of using audio," but this is at least crudely possible using temporary audio as an intermediary between synthesis and pronunciation assessment, as per something like:
static async Task<string> GetIpaForTextAsync(string phrase)
{
    var tempAudioPath = Path.GetTempFileName();
    var synthesizer = new SpeechSynthesizer(
        SpeechConfig.FromSubscription(mySpeechKey, mySpeechRegion),
        AudioConfig.FromWavFileOutput(tempAudioPath));
    _ = await synthesizer.SpeakTextAsync(phrase);

    var recognizer = new SpeechRecognizer(
        SpeechConfig.FromSubscription(mySpeechKey, mySpeechRegion),
        AudioConfig.FromWavFileInput(tempAudioPath));
    var pronunciationConfig = new PronunciationAssessmentConfig(phrase)
    {
        PhonemeAlphabet = "IPA",
    };
    pronunciationConfig.ApplyTo(recognizer);
    var recoResult = await recognizer.RecognizeOnceAsync();
    var pronunciationResult = PronunciationAssessmentResult.FromResult(recoResult);

    var pronunciationBuilder = new StringBuilder();
    foreach (var pronouncedWord in pronunciationResult.Words)
    {
        foreach (var pronouncedPhoneme in pronouncedWord.Phonemes)
        {
            pronunciationBuilder.Append(pronouncedPhoneme.Phoneme);
        }
        pronunciationBuilder.Append(' ');
    }
    return pronunciationBuilder.ToString();
}

With calling code like:
static async Task Main(string[] args)
{
    Console.OutputEncoding = Encoding.Unicode;
    var input = "hello world, this is a test";
    Console.WriteLine($"Getting pronunciation for input: {input}");
    var pronunciation = await GetIpaForTextAsync(input);
    Console.WriteLine(pronunciation);
}

That yields the expected output of:
Getting pronunciation for input: hello world, this is a test
hɛloʊ wɝrld ðɪs ɪz ə tɛst

That's a lot of extra work for just retrieving the pronunciation, but it's at least attainable -- given speech-to-text is all about getting recognitions (and metadata like pronunciation) from audio, this indirection may be the best current fit if pronunciation isn't baked into text-to-speech in a directly accessible way.

I see, so basically we mimicking the speech recognizer audio from the synthesizer. ahh great, huge thanks @trrwilson for providing the example as well. I'm going to follow your example :heart:

worked as expected :tada:. hopefully in the future the result from synthesizer also include the IPA text as swell.
thank you guys. I will close this issue


keys is not iterable when starting Autobase

Every now and then I get keys is not iterable error when starting up Autobase. After the error starts showing up, it comes up on every subsequent run, which sounds to me that one of the cores is somehow corrupted and truncate() can't handle it.
The error...
Error: TypeError: keys is not iterable
    at KeyCompressor.truncate (../autobase/lib/compression.js:79:25)
    at Output.truncate (../autobase/lib/output.js:30:21)
    at LinearizedCore._commitUpdate (../autobase/lib/linearize.js:500:27)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async LinearizedCore._rebuild (../autobase/lib/linearize.js:473:7)
    at async LinearizedCore._update (../autobase/lib/linearize.js:534:5)

The issue seems to be that this.bySeq.get() returns null. The underlying core is ready, so should be good to go.
truncate (length) {
    const badSeqs = []
    for (const seq of this.bySeq.keys()) {
      if (seq < length) continue
      badSeqs.push(seq)
    }
    for (const seq of badSeqs) {
      const keys = this.bySeq.get(seq)
      this.bySeq.delete(seq)
      for (const key of keys) {
        this.byKey.delete(b.toString(key, 'hex'))
      }
    }
  }

Are there any side-effects if I add a simple check whether keys is null?

Thanks for the issue @jensenhertz. Wouldn't want to just quickly add that null check, because this indeed sounds like a potential corruption issue, so the check would just be a band-aid fix. If keys is null, that means there's an invalid pointer in one of the nodes.
Do you have any info about your setup? I'm curious about why it's calling truncate after every restart -- that could indicate that Autobase is being passed an invalid output Hypercore.

It was indeed a corruption issue related to a bug with core paths 🙄


Enablement for creating Service Connector plugins

Name of the Epic
Provide a short description of the epic here.
Aha Cards

Enablement for creating Service Connectors

Team

Product Manager: Persons Name (@username)
Product Owner: Persons Name (@username)
Engineering Manager: Persons Name (@username)
Feature Lead: Persons Name (@username)
Engineers:

Persons Name (@username)

Technical Writer: Persons Name (@username)

SDLC Timeline

Stage
Updates
Artifact

Project Initialization

Kickoff

Feature Proposal

Functional Sign-off

Technical D&D

Solution Sign-off

Execution

Acceptance

Stories
List the stories here.

Note for future reference:

Part of this effort should include updates to the documentation for operators of Secretless - how do you use it with external plugins? That should include detailed instructions for providing checksum files to Secretless for verification when loading external plugins. It should also discuss the risks of loading external plugins that are provided without trusted checksum files.
The documentation for external plugin builders should include recommendations on including checksum files with plugin releases, and suggested instructions for how to create them.


Notification security fix

Issue #, if available:
#698
Description of changes:
Added restoring whole user object into thread context, to include backend roles too, so they can be picked up by notification plugin.
CheckList:
[ ] Commits are signed per the DCO using --signoff
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #852 (a6ee703) into main (bcd8988) will increase coverage by 0.42%.
The diff coverage is 89.28%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@             Coverage Diff              @@
##               main     #852      +/-   ##
============================================
+ Coverage     75.29%   75.71%   +0.42%
  Complexity      110      110
============================================
  Files           125      125
  Lines          6885     6893       +8
  Branches       1034     1038       +4
============================================
+ Hits           5184     5219      +35
+ Misses         1171     1141      -30
- Partials        530      533       +3

Impacted Files
Coverage Δ

...rch/alerting/opensearchapi/OpenSearchExtensions.kt
52.94% <83.33%> (+2.94%)
:arrow_up:

.../opensearch/alerting/DocumentLevelMonitorRunner.kt
83.38% <88.88%> (+3.11%)
:arrow_up:

...in/kotlin/org/opensearch/alerting/MonitorRunner.kt
63.75% <100.00%> (+0.45%)
:arrow_up:

... and 10 files with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Dependent on this PR: https://github.com/opensearch-project/common-utils/pull/396


⚠ ClamAV has degraded performance

In ab47ca3, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 501 ms

Resolved: ClamAV performance has improved in c18f848.


Sparse data and fieldnorms

Fieldnorms are a prerequisite for BM25 and currently use one byte per document per field. https://docs.rs/tantivy/latest/tantivy/fieldnorm/index.html
For sparse data, this is is relative expensive.
Access time for Fieldnorms can be performance critical. To avoid regressions, on possible solution would be to have a different encoding when sparse data is detected.

This is not really needed for quickwit (BM25 is usually not useful for us). If someone has a use for this,  please comment.

We do use Tantivy directly and currently base our ranking on the default which is BM25 if I understand things correctly.
What I do not fully understand ATM is whether I need to actively opt-in to using a sparse encoding and whether sparse is meant w.r.t. the range of field (very few values out of all possible values used) or w.r.t. the range of documents (very few documents have a value for the field)? So I do not really know whether this affects us.

Sparse means: do you use BM25 on several fields that appear in less than 50% of the documents?

Sparse here means: do you use BM25 on several fields that appear in less than 50% of the documents?

This would apply to at least two fields for us and we are still building up our schema. They are not part of default fields for queries, but that is also not fixed yet. So I think this would apply to us.


Add weekly contribution intervals

This is the backend work for this frontend ticket https://github.com/opencollective/opencollective-frontend/pull/7109
Work in progress - not ready to be merged yet

This PR has moved to here #6852
This is because I have re-pushed this branch directly to this repository rather than the forked one


outlook.com is blocked from registering new accounts

Describe the bug
It seems that @outlook.com is blocked from registering new accounts.
The following message appears when trying to register a new account on https://pypi.org/account/register:
You can't use an email address from this domain.

Expected behavior
@outlook.com is a widely used and legit domain. Please consider making it available.
Additional context
Registering an account on https://test.pypi.org with an @outlook.com address works without any problems.

This blog post is relevant: https://blog.pypi.org/posts/2024-06-16-prohibiting-msn-emails/

Thanks for the blog post, I totally missed that!
I honestly understand that this is out of your hands and the move was necessary to prevent bots, mass signups, malware and abuse.
But I also want to avoid creating a random, redirected or throwaway email address for account registration, because that would just make the whole thing even more absurd.
Is there any other way to create an account with my primary e-Mail Address? Maybe by creating a ticket or you contacting me personally on social media?
Thanks

Hi @leukipp, sorry you're having trouble registering. Like @cofiem mentioned, we're currently unable to deal with the additional spam/bots that come from outlook and hotmail email addresses. For the time being, we're planning to keep this ban in place and recommend creating an additional email address elsewhere and redirecting to your primary inbox.


Issue 816

createMarket no longer accepts encoded bytes as an argument  but instead accepts the params directly

I cherry-picked this into #876 to catch it in the new deploy.


chore(CPlusPlus): add prefix sum

PR Checklist:

[ ] My submission is formatted according to the guidelines in the contributing guide
[ ] My addition is on refer on the language README.md file
[ ] My addition does not have a spelling problem
[ ] My submission has a proper and user-friendly description of the algorithm
[ ] My submission has the time complexity of the algorithm
[ ] My submission has sample input-output of the program (NOT FOR PYTHON)

What kind of change does this PR introduce? (check at least one)

[ ] Bugfix
[ ] New algorithm
[ ] Optimization in previous algorithms
[ ] Code style update
[ ] Refactor
[ ] Documentation
[ ] Other, please describe:

Briefly describe the changes in this PR

Other information:

Hi @Deeps-01,
Any updates?

Hi @Deeps-01,
This pull request will be closed when making a change please re-open this pull request.


Match first letter of each word, capital letters in PowerToys Run Program plugin

Description of the new feature / enhancement
I'd like the application name matching in the PowerToys Run Program plugin to, in addition to the existing behavior, also match search strings against the first letter of each word and each capital letter in the application name.
Scenario when this would be used?
I think of the application "Visual Studio Code" as "VSCode," and each time I try to launch it by typing vsc or vsco, I'm met with an empty search box. This would also be useful for PowerToys itself; launching the settings could be pt rather than powert (to distinguish it from PowerShell, PowerShell (x86), and PowerPoint).
Supporting information
No response

/dup #20672


Python: if the cluster is already starting up, just wait for it

Description
This should fix the issue where multiple threads try to start the same cluster, and we get an exception saying the cluster is Pending.
Checklist

[x] I have run this code in development and it appears to resolve the stated issue
[x] This PR includes tests, or tests are not required/relevant for this PR
[ ] I have updated the CHANGELOG.md and added information about my change to the "dbt-databricks next" section.

LGTM. This is just wrapping existing code so we can call it from a different place, yes?

It also changes the behavior if the cluster is already starting.  If the cluster was already starting, we would get those pending exceptions.  Now if the state isn't terminated or terminating, it waits until the state is running.  This is important when running with multiple threads because one will start the cluster, then the next will see that its not terminated, so attempt to submit the job.


Using dataset from a different source than ECMWF cloud

The dataset considered for this project is here -
Though the cookiecutter tests are passing, it seems that the required dataset is not exactly loaded instead the default dataset is loaded. Need check on this.

@floriankrb currently this repo is obtained following the cookiecutter guidelines but needs refinement (check if the required dataset is loaded and not the default one) before adding the Pypi functionalities.
Any pointers would be helpful!

The code you wrote before to access data from intake (using intake-xarray), should go into a climetlab source plugin (https://climetlab.readthedocs.io/en/latest/contributing/sources.html). This source plugin, as a pip package, will be re-usable by others.
Then a climetlab dataset plugin (https://climetlab.readthedocs.io/en/latest/contributing/datasets.html) can illustrate the use of a source plugin.


⚠ ClamAV has degraded performance

In 93e65bd, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 462 ms

Resolved: ClamAV performance has improved in d7c065e.


ConvertFrom-CIPolicy: System.OutOfMemoryException

Hi,
I'm trying to convert a denylist from XML to binary, and the conversion fails, either while using the ConvertFrom-CiPolicy or the WDAC Wizard (but from what I understand, it is using the cmdlet under the hood, so that's not unexpected).
The denylist is generated from the LOLDrivers.io project, from the drivers found here: https://github.com/Harvester57/LOLDrivers/tree/main/drivers
I initially generated the denylist with -Level FilePublisher -Fallback Hash parameters for the New-CIPolicyRule cmdlet, but the policy was quite huge (approx. 5000 lines). I then tried to reduce its length by switching to different fallback mechanisms: -Fallback SignedVersion,Publisher,Hash
While the second policy is substantially smaller, I hit a second bug when trying to convert the policy to binary:  several MinimumFileVersion fields had incorrect values detected by the New-CIPolicyRule cmdlet:

As you can see, _1 is appended to these attributes, so the ConvertFrom cmdlet fails with a warning related to the schema 'urn:schemas-microsoft-com:sipolicy:VersionExType'
If I manually fix the version for those attributes, the cmdlet fails again with an OutOfMemory exception.
The two policies can be downloaded as artifacts from the following Github Actions:

Original policy (Hash fallback): https://github.com/Harvester57/LOLDrivers/actions/runs/5689865986
Smaller policy (with MinimumVersion bug): https://github.com/Harvester57/LOLDrivers/actions/runs/5692033105

Internal only I am afraid


How to Validate a template string.

Is the best way to validate a template string to try and compile and then catch exceptions?

With the current implementation that's the only way.

Ok. Tnx.


GN-4723: Addition of table-tooltip component allowing users quick access to table-editing features

Overview
This PR includes several changes leading into the implementation of a table-tooltip component. This component allows users quick access to table-editing features.
Specifically, this PR includes the following changes/features:

Addition of the floating-ui package and implementation of a custom (for now private) floating-ui modifier. Compared to the modifier provided by the ember-velcro package, it includes the following features:

Support for virtual elements (https://floating-ui.com/docs/virtual-elements)
Support for transform positioning (similar to the vue and react implementations of floating-ui: https://floating-ui.com/docs/usefloating#transform). By default the modifier uses transform positioning, but this can be disabled.
Support for fully customizable middleware-pipelines

Addition of a (private) selection-tooltip component. This is a simple tooltip which displays under the current editor selection. It does so by leveraging the floating-ui modifier in combination with usage of virtual elements. A virtual element is used here, as the editor selection does not (always) correspond to a specific element, but rather to a position/series of positions. https://floating-ui.com/docs/virtual-elements contains more information on how to use virtual elements
Addition of a (public) table-tooltip component. A simple tooltip which displays only when inside a table. It provides several table-actions including:

Add row after
Add row before
Add column after
Add column before
Delete row
Delete column
Delete table
This tooltip is implemented to be as non-intrusive as possible: it only displays when clicking; and disappears when typing.

connected issues and PRs:
GN-4723
How to test/reproduce

Open the dummy app on the home page
Insert a table with some content inside
Clicking inside any cell, the table-tooltip should appear
The different actions provided by the table-tooltip should work
When scrolling the viewport, the tooltip should correctly move along with the selection
The tooltip should correctly disappear when the selection is out-of-view. (This is why the contextElement of the virtual-element is needed)
When starting to type in the cell, the tooltip should disappear
Observe that the tooltip element uses transform based positioning and the position: fixed approach.

Challenges/uncertainties

I did not opt into using the ember-velcro package for the implementation of this tooltip as it is missing several needed features. We might be able to upstream some features (such as virtual-element support and transform-based position) in the future.

TODOs/Future work

[x] Add toggle header row and toggle header column actions to tooltip
[x] (Optional) Look into using a grid layout for the table-tooltip
[ ] Look into supporting the arrow middleware (https://floating-ui.com/docs/arrow) (not crucial for this PR)
[ ] Look into supporting a 'headless' version of the floating-ui modifier, in which the user itself has more control over how the styling is set/computed. (see the https://floating-ui.com/docs/vue and https://floating-ui.com/docs/react packages) (not crucial for this PR)
[ ] Replace usages of ember-velcro with our custom floating-ui modifier (not crucial for this PR)
[ ] Apply size modifier to dropdown components => allows for displaying a scrollbar when viewport is too short.

Checks PR readiness

[x] UI: works on smaller screen sizes
[x] UI: feedback for any loading/error states
[x] Check cancel/go-back flows
[x] Check database state correct when deleting/updating (especially regarding relationships)
[x] changelog
[x] npm lint
[x] no new deprecations

small detail: the column resize handle renders above the popup, otherwise nice work!

small detail: the column resize handle renders above the popup, otherwise nice work!

Nice catch, thanks! This should be solved. It seems the z-index css rule of the resize-handle is not really necessary.


range_date fitler: style_class

Hi there,
It would be helpful to have style_class as an available option for range_date filters. This would allow for a more consistent approach to custom styling of elements.
Thanks

Hi there,
yes please do this. i have manually added this to all range filters. We need it to save and set filters. Please make style_class available on all filters in the next version.

fixed in 0.9.2.beta.10


docs(license): update copyright year to 2023

:tada: This PR is included in version 2.3.1 :tada:
The release is available on:

v2.3.1
GitHub release

Your semantic-release bot :package::rocket:


add pr template removal function to page action button

What's this PR do?
Adds the ability to remove an unaltered PR template by clicking the page action button a second time.
Where should the reviewer start?
fillPullBody.js contains all of the changes.
How should this be manually tested?
Pull down and rebuild. Try adding and removing PR template from the PR field. Note: if there existing text when the template is inserted, the extra /n is not removed upon removing the template. These /n will build up over successive additions/removals. I don't think there is a good way to predict whether the /n should be removed or not, so I am leaving that behavior alone.
Any background context you want to provide?
N/A
What are the relevant tickets?
closes #19

Fixed.


docs(common): Added Run Boilerplate ESP #41

Added Run Boilerplate section
What does this PR do?
Added how to run boilerplate page on the tutorials page in Spanish

resolves https://github.com/eoscostarica/full-stack-boilerplate/issues/41

Steps to test

Navigate to https://guias.eoscostarica.io/docs/tutoriales/guia-markdown
Go to "Ejecutar Boilerplate"

CheckList

[ ] Follow proper Markdown format
[ ] The content is adequate
[ ] The content is available in both english and spanish
[ ] I Ran a spell check

How can we complement the readme file with the content thats on here?
If its the same content as the readme we should just improve the project readme files ?


Investigate bash auto-completion

We want two types of auto complete:

Auto complete muxed commands (only new)
Auto complete project names

#/usr/bin/env bash
_muxed_completions()
{

  if [ "$COMP_CWORD" -eq 1 ]; then
    local commands="$(compgen -W "new edit snapshot" "${COMP_WORDS[1]}")"
    local projects="$(compgen -W "$(echo $(ls ~/.muxed/))" "${COMP_WORDS[1]}")"
    COMPREPLY=( $commands $projects )
  elif [ "$COMP_CWORD" -eq 2 ]; then
    local projects="$(compgen -W "$(echo $(ls ~/.muxed/))" "${COMP_WORDS[2]}")"
    COMPREPLY=( $projects )
  fi
}

complete -F _muxed_completions muxed

A simple first pass.
It'll auto complete subcommands, and projects available in the default directory only.
Expand it to autocomplete projects but stripping the .yml (extension) in the filename.
Have it complete in custom directories.

With the ls subcommand this has gotten a bit simpler. Here is my current config
_muxed_completions()
{

  if [ "$COMP_CWORD" -eq 1 ]; then
    local commands="$(compgen -W "new edit snapshot load" "${COMP_WORDS[1]}")"
    local projects="$(compgen -W "$(muxed ls)" "${COMP_WORDS[1]}")"
    COMPREPLY=( $commands $projects )
  elif [ "$COMP_CWORD" -eq 2 ]; then
    local projects="$(compgen -W "$(muxed ls)" "${COMP_WORDS[2]}")"
    COMPREPLY=( $projects )
  fi
}

complete -F _muxed_completions muxed


Modified the routing update. created redirect rule

Ticket 48 - HTTP>HTTPS Redirect.

Modified the default routing rule to only accept https.
Created a step to provision a routing rule for http redirects.

Fixes #48


Lines can't be drawn outside the data provided to the chart

At the moment, if you try to draw a line to the right of the right-most bar or to the left of the left-most bar, FirChart won't let you do that. We should fix that so you can draw lines anywhere.

Hacky workaround: added dummy bars to the left and right side of the chart. Lines can be drawn there.


ES6 Module Support Proposal

Relates to https://github.com/hshoff/vx/issues/143
One way of doing it. I couldn't find a simpler way of changing the modules: false field for two different builds. The idea would be that this format would be applied across all the libraries

Hi @amilajack see https://github.com/hshoff/vx/issues/143
For now, it's recommended to use deep path imports:
import LinePath from '@vx/shape/build/shapes/LinePath';

closing this for now, but will continue tracking in https://github.com/hshoff/vx/issues/143


Updated Byte size label in README

Updated Byte size label to Good first time label in Readme.

@tommyip @timabbott, Please review the commit. Thanks

Merged, thanks @alirizwi!


Instance[ParcelID] and Semantic[Target] questions

Hi @VSainteuf , how is it going?
I have been studying the code related in terms of training with different datasets. And one question that I have faced based on the data that you have used is about the labels created into semantic $TARGET_{}.npy$ and $ParcelIDs_{}.npy$. I have attached a figure of patch 10006:

As you can see, in instance annotation before mapping with semantic channel 0 ($ParcelIDs_{}.npy$), we have a set IDs that isn't related with semantic annotations (in terms of background class, specially). Besides of that, in channel 2 of $TARGET_{}.npy$ we have a set of regions, related with background class, that isn't labelled as in channels 0 and 1.
So, I would like to better understand what was the methodology applied in labelling instances ($ParcelIDs_{}.npy$) and semantic label at channel 2 ($TARGET_{}.npy$).
Thanks a lot!

Hello @VSainteuf , I am doing an analysis of your data set, especially $TARGET_{}.npy$. I performed tests to identify each channel, based on the scripts train_panoptic.py (from src.dataset import PASTIS_Dataset, data_loader) and metrics.py, there is the following function.
def add(self, predictions, target):         (             target_heatmap,             true_instances,             zones,             size,             sem_obj,             sem_pix,         ) = target.split((1, 1, 1, 2, 1, 1), dim=-1)
based on  sem_pix is to equals pixel_semantic_annotation
My questions are:
1  why the two outputs have a size of 2, 128, 128?
2  what happened to the other channel?
3  What do the two output channels refer to (semantic label)?
I attach the output image with the two channels

Could you please provide information on the three $TARGET_{}.npy$ channels, what does each of these refer to?

Hi @GustavoMourao and @jhonjam,
So here are some elements that will hopefully help you:
the 'TARGET_xx.npy' arrays are composed of these 3 channels:
0. The semantic label of each pixel according the 20 class nomenclature of PASTIS.

The unique instance id of each pixel, ranging from 1 to N, with N the number of parcels in the patch.
The fine-grained semantic label of each pixel, according to the nomenclature used by the French subsidy allocating authority that has around 400 classes I think.

So for semantic seg, only the first channel is useful. For panoptic segmentation the second channel is also used as it provides the instance masks of parcels. For example, this second channel is used to compute de ground truth centerness heat maps that are contained in /INSTANCE_ANNOTATIONS.
The third channel of 'TARGET_xx.npy' is not used as of now.
the 'ParcelIDs_xx.npy' array contains the instance ids of each pixel according to the numbering of the French Land Parcel Identification System (LPIS). I kept this array to keep the connection with the vector data of the LPIS but these instance IDs are not used in the experiments. These instance IDs cover the whole French territory so they take very large integer values (in the range of millions) with relatively small difference in value between neighbouring parcels. So on that point @GustavoMourao, plotting them with a default colormap will often make different values look the same ( as in your leftmost figure).

And @GustavoMourao regarding you first question, I think it's a matter of colormaps. I plotted the same patch with a more divergeant colormap and everything seems fine:

There is only one case where there might be differences between ParcelIDs, and instance ids (second channel of TARGET). As detailed in the documentation we considered small or thin parcels as background, such parcels do have an id in ParcelID but are annotated with 0 in TARGET (both for semantic and instance). But the case you raised was not an occurence of this it seems.

Hello @VSainteuf , thanks for the answer.
At this moment, I am doing an analysis of the predictions by CNN based on the script paps.py returns the following dictionary
predictions = dict(             center_mask=center_mask,             saliency=saliency,             heatmap=heatmap,             semantic=sem,             size=size,             confidence=confidence,             centerness=centerness,             instance_masks=instance_masks,             instance_boxes=instance_boxes,             pano_instance=panoptic_instance,             pano_semantic=panoptic_semantic,         )
According to the documentation, pano_semantic returns a tensor with size BxKxHxW. I made the graphs of these tensors (k = 0,...,19) and each created image should contain the pixel predictions of each class, eg, k=1 corresponds to the "meadow" class.
By comparing the ground truth labels of a test image with the predicted pixels, the model predicts a large number of pixels corresponding to the "Sorghum", "Soft winter wheat"  classes. Pixels that are not in the ground truth and thus increasing false positives. The same happens for other test images.
This can be seen in the figure below.

Based on the above, can it be said that the predictions of k= 2, 3, 7, 18 (Soft winter wheat, Corn, Sunflower, Sorghum respectively) are considered false positives? and that's the reason why the RQ metric is low?
In the official article  in Figure 12: Qualitative Panoptic Segmentation Results, an image with the semantic segmentation predictions is shown.

How was this image constructed?
To create this image, the tensor pano_semantic (BxKxHxW) was joined?

could you please provide information about this.
Thanks a lot!

Hi @jhonjam,
yes pixels that belonging to the background and predicted as a parcel of a given class count as false positives in the RQ metric. Just one precision: the RQ is computed at object level and not at pixel level.
Regarding Figure 12, the predictions shown in column (d) are those of a U-TAE semantic segmentation model. To plot the panoptic predictions on column (c) I used the findcountours method of OpenCV on the predicted instance masks contained in pano_instance, and used the predicted class for color coding. The repository does not contain this plotting method yet, but I will include it once I find some time to clean it!

You can now find the plotting method for the panoptic predictions in the visualisations.ipynb notebook in the utae-paps repository.


Add funding data endpoint, support stop limit and market orders

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


Potential inconsistency with hosted dashboard CSS

In the process of looking at TerminusDB that led me to report https://github.com/terminusdb/terminus-dashboard/issues/15, I came across a potential problem. (I didn't find an actual instance of the problem, but I thought you might want to think about it before it becomes a problem.)
This issue is exemplified by this line in index.tpl:
<link rel="stylesheet"
      href="https://terminusdb.github.io/terminus-dashboard/dist/css/theme.css">

I believe this means every local TerminusDB installation will pull down the currently released theme.css as found on the gh-pages branch in the terminus-dashboard repository. If I understand it correctly, this means you will need to be sure the CSS selectors in your HTML and JavaScript will need to be consistent with the ones found at the above link. Since there is no versioning of that link, this may lead to problems with different local installations.
Some possible solutions to this include:

releasing versions of theme.css and tying a server to a particular hosted version or
bundling the theme.css with the server itself.

We now use versioned CSS and JS for terminusdb-console (previously called terminusdb-dashboard).


Add buildx support in github actions to release arm64 and armv7 images

The following file has been created and modified:
Added buildx support in github actions to release arm64 and armv7 images
Signed-off-by: odidev<EMAIL_ADDRESS>

Can you please review this PR and let me know if any changes are required?

Since the whole repo was redesigned, this functionality has been included via Github workflows.


feat(FOROME-1367): made create derived dataset button disabled on empty conditions or too much variants exist

Task
In ControlPanel we check only filters, because it is used only in ws page, which can be opened only if we have less than 3000 variants.

Open ws ds in FR (create disabled)

Open some enum attr and just select some attr (create enabled)

Open xl_PGP3140_wgs_NIST-4_2 in the same page

Add Callers/GATK_HOMOZYGOUS (2112) variants were added

Create disabled

Something is wrong with user scenarios:
WS

Go to filter refiner on WS dataset. Create DS button is disable (OK)
Pick some attribute. The button goes enabled (NOT OK since we didn't make any change to the result yet)
Apply the criterium. The button goes disabled again (NOT OK since it's the very moment we'd like to create a derived DS)

XL

Go to filter refiner on XL dataset. Create DS button is disabled (OK)
Pick some attributes to shrink down the number of variants below 9000. Nothing happens to the button. (it is totally OK, but much different from the same logic on a WS dataset)
Apply the attributes. The button is still disabled (NOT OK)

The same picture we see on decision tree.


Fix code scanning alert - Potentially unsafe external link

Tracking issue for:

[x] https://github.com/chvndler/chvndler.ch/security/code-scanning/11

done


fix: orchard requests taking too long

Description
Closes #1393
Changelog
Changed

SPAR Bec Zones Service to get all codes at once.

How was this tested?

[ ] 🧠 Not needed
[x] 👀 Eyeball
[x] 🤖 Added tests

What gif/image best describes this PR or how it makes you feel?

Thanks for the PR!
Deployments, as required, will be available below:

Frontend
Backend
Oracle-API

Please create PRs in draft mode.  Mark as ready to enable:

Analysis Workflow

After merge, new images are deployed in:

Merge Workflow

API working great!

And there's now only ONE query in the database to get all descriptions:
2024-07-16T17:31:51.932Z  INFO 49 --- [spar-oracle-api] [nio-8090-exec-4] c.b.g.o.service.SparBecCatalogueService  : 617925f3-0975-4f7d-a8f3-0133e68363c4 Begin service request to find the description of a given BEC zone code
2024-07-16T17:31:51.943Z  INFO 49 --- [spar-oracle-api] [nio-8090-exec-4] c.b.g.o.service.SparBecCatalogueService  : 617925f3-0975-4f7d-a8f3-0133e68363c4 Spar BEC Catalogue entity found, returning 4 descriptions found


Review 1 "Throw Errors"

Throw errors

errors should be thrown
-- on empty datasets
-- on datasets containing null values
-- on datasets containing non number values
-- datasets containing only one feature --> Division by zero in get in ParallelPlots.jl ln. 80
-- datasets containing only one sample --> Division by zero in get in ParallelPlots.jl ln. 106

Linked to #8 "Throw Errors"

closed by PR https://github.com/moritz155/ParallelPlots/pull/18


Ensure *Base types have the same members as the main types

System.Web had *Base types that were meant for abstraction. This adds a test to ensure we have the same members on both versions and adds a few that were missing.

@joperezr here's one similar to #487 that is to ensure future additions are consistent and has some tests to validate structure


Drop legacy state management code

We've kept backwards-compatibility with the old state namespace since the change to the new namespace in v0.7.0. We can remove the old code once fleet v0.7.0+ makes it to the CoreOS stable channel.

This is no longer blocked. v0.9.0 has made it to CoreOS Stable.

@bcwaldon Seems the old code can be removed.

@wuqixuan any chance you want to take a swing at this?

@jonboulle , I am reviewing all the ISSUE and PR now one by one.
There are so many ISSUE and PR pending, I hope can help the community to progress. : )
As for this PR, "statePrefix = "/state/"" is only used by legacyUnitStatePath, and the functions using legacyUnitStatePath always call unitStatePath or unitStatesNamespace.
So the code of "statePrefix", "legacyUnitStatePath" can be removed.
And the code currently is stable enough I think.