version 0.0.1-alpha

resolves #3
Implemented basic functionality given in #3
TODO:

Add docstrings
Implement test cases
Add poetry

Questions:

Are we going to use the schema/linkml library that we have talking about in this project? I think that is the case but I wanted to double check. If that is the case I take it we integrate it in later stages, am I right?
Do we plan to get anndata inputs from other sources? I've used local files only.

Are we going to use the schema/linkml library that we have talking about in this project? I think that is the case but I wanted to double check. If that is the case I take it we integrate it in later stages, am I right?

Yep.  Just didn't add to MVP.

Do we plan to get anndata inputs from other sources? I've used local files only.

Local is fine for now.  It may make sense in future to support loading from URL.  Will be easy to add.


Delete an entire metadata entity

As a wrangler I want to "Delete an entire metadata entity" so that I can correct mistakes with (meta)data for a project that is already in the DCP/Archives.

Just want to note one pain point encountered this sprint while archiving new data for Adult_Nonmobilised_PB which this feature will solve.
The contributor has used same hca-util upload area for the additional datafiles for Adult_Nonmobilised_PB dataset. Ami synced this to submission upload area and has uploaded some extra files in the new submission. Empty file metadata were added and stuck in Draft and there was no way to delete them. As a workaround, I created the following script to delete the extra files.
import json
import time

import requests
import subprocess

DRY_RUN = False
TOKEN = ''
SUBMISSION_URL = ''
SUBMISSION_UUID = ''
FILES_TO_DELETE_FILENAME = f'{SUBMISSION_UUID}_files_to_delete.json'

def run(command: str, input: str = None, verbose: bool = True):
    parsed_command = command.split(' ')
    proc = subprocess.Popen(parsed_command,
                            stdin=subprocess.PIPE,
                            stdout=subprocess.PIPE,
                            stderr=subprocess.PIPE,
                            )
    if input:
        stdout, stderr = proc.communicate(input.encode())
    else:
        stdout, stderr = proc.communicate()

    if verbose:
        print('$ ' + command)
        print(stdout.decode())
        print(stderr.decode())

    return proc.returncode, stdout.decode(), stderr.decode()

def remove_file(s3_file_path):
    if DRY_RUN:
        command = f'echo "Removing file {s3_file_path}"'
    else:
        command = f'aws s3 rm {s3_file_path} --profile embl-ebi'

    exit_code, output, error = run(command)

    if exit_code == 0:
        return f'Removed {s3_file_path}'
    else:
        return error

def get_draft_files_in_submission(submission_url):
    api_base = submission_url.split("/")[2]
    draft_url = f"https://{api_base}/files/search/findBySubmissionEnvelopeAndValidationState?envelopeUri={submission_url}&state=DRAFT&size=200"
    r = requests.get(draft_url)
    r.raise_for_status()
    draft_files = r.json()["_embedded"]["files"]
    return draft_files

def generate_input_file(submission_url, filename):
    files_to_delete = get_draft_files_in_submission(submission_url)
    with open(filename, 'w') as outfile:
        print(f'Saving info on files to delete to {filename}')
        json.dump(files_to_delete, outfile, indent=4)

if __name__ == '__main__':
    headers = {
        'Content-type': 'application/json',
        'Authorization': f'Bearer {TOKEN}'
    }
    # 1. Get the list of file resources to be deleted - save them in a file
    generate_input_file(submission_url=SUBMISSION_URL, filename=FILES_TO_DELETE_FILENAME)

    with open(FILES_TO_DELETE_FILENAME, 'r') as infile:
        files_to_delete = json.load(infile)

    # 2. Transition state to Validation then to Valid
    for file in files_to_delete:
        url = file['_links']['validating']['href']
        print(f'transition to validating {url}')
        r = requests.put(url, headers=headers)
        r.raise_for_status()

    time.sleep(5)

    for file in files_to_delete:
        url = file['_links']['validating']['href']
        url = url.replace('validating', 'valid')
        print(f'transition to valid {url}')
        r = requests.put(url, headers=headers)
        r.raise_for_status()

    time.sleep(5)

    # 3. Delete the files in s3
    for file in files_to_delete:
        cloud_url = file['cloudUrl']
        print(f'Removing file in s3 {cloud_url}')
        remove_file(cloud_url)

    time.sleep(5)

    # 4. Delete the files (already valid)
    for file in files_to_delete:
        url = file['_links']['self']['href']
        print(f'Deleting {url}')
        requests.delete(url, headers=headers)

    print('extra files deleted!')

Just want to note one pain point encountered this sprint while archiving new data for Adult_Nonmobilised_PB which this feature will solve.
The contributor has used same hca-util upload area for the additional datafiles for Adult_Nonmobilised_PB dataset. Ami synced this to submission upload area and has uploaded some extra files in the new submission. Empty file metadata were added and stuck in Draft and there was no way to delete them. As a workaround, I created the following script to delete the extra files.
import json
import time

import requests
import subprocess

DRY_RUN = False
TOKEN = ''
SUBMISSION_URL = ''
SUBMISSION_UUID = ''
FILES_TO_DELETE_FILENAME = f'{SUBMISSION_UUID}_files_to_delete.json'

def run(command: str, input: str = None, verbose: bool = True):
    parsed_command = command.split(' ')
    proc = subprocess.Popen(parsed_command,
                            stdin=subprocess.PIPE,
                            stdout=subprocess.PIPE,
                            stderr=subprocess.PIPE,
                            )
    if input:
        stdout, stderr = proc.communicate(input.encode())
    else:
        stdout, stderr = proc.communicate()

    if verbose:
        print('$ ' + command)
        print(stdout.decode())
        print(stderr.decode())

    return proc.returncode, stdout.decode(), stderr.decode()

def remove_file(s3_file_path):
    if DRY_RUN:
        command = f'echo "Removing file {s3_file_path}"'
    else:
        command = f'aws s3 rm {s3_file_path} --profile embl-ebi'

    exit_code, output, error = run(command)

    if exit_code == 0:
        return f'Removed {s3_file_path}'
    else:
        return error

def get_draft_files_in_submission(submission_url):
    api_base = submission_url.split("/")[2]
    draft_url = f"https://{api_base}/files/search/findBySubmissionEnvelopeAndValidationState?envelopeUri={submission_url}&state=DRAFT&size=200"
    r = requests.get(draft_url)
    r.raise_for_status()
    draft_files = r.json()["_embedded"]["files"]
    return draft_files

def generate_input_file(submission_url, filename):
    files_to_delete = get_draft_files_in_submission(submission_url)
    with open(filename, 'w') as outfile:
        print(f'Saving info on files to delete to {filename}')
        json.dump(files_to_delete, outfile, indent=4)

if __name__ == '__main__':
    headers = {
        'Content-type': 'application/json',
        'Authorization': f'Bearer {TOKEN}'
    }
    # 1. Get the list of file resources to be deleted - save them in a file
    generate_input_file(submission_url=SUBMISSION_URL, filename=FILES_TO_DELETE_FILENAME)

    with open(FILES_TO_DELETE_FILENAME, 'r') as infile:
        files_to_delete = json.load(infile)

    # 2. Transition state to Validation then to Valid
    for file in files_to_delete:
        url = file['_links']['validating']['href']
        print(f'transition to validating {url}')
        r = requests.put(url, headers=headers)
        r.raise_for_status()

    time.sleep(5)

    for file in files_to_delete:
        url = file['_links']['validating']['href']
        url = url.replace('validating', 'valid')
        print(f'transition to valid {url}')
        r = requests.put(url, headers=headers)
        r.raise_for_status()

    time.sleep(5)

    # 3. Delete the files in s3
    for file in files_to_delete:
        cloud_url = file['cloudUrl']
        print(f'Removing file in s3 {cloud_url}')
        remove_file(cloud_url)

    time.sleep(5)

    # 4. Delete the files (already valid)
    for file in files_to_delete:
        url = file['_links']['self']['href']
        print(f'Deleting {url}')
        requests.delete(url, headers=headers)

    print('extra files deleted!')


Bug: P1 License detection fails

There is an additional ) in the string for the P1 license
https://github1s.com/maester365/maester/blob/main/powershell/public/Get-MtLicenseInformation.ps1#L30-L30
This causes P1 Tenants to be identified as free and results ine.g.  security defaults to be flagged.

Thanks. Will be fixed in the upcoming release


Oracle.MySQLWorkbench version 8.0.34

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.5 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Published too early, PR requires a working Dependencies feature, what will happen with the 1.6 release.

Automatic Validation ended with:

Installation failed with exit code -1978335226
2023-09-13 09:47:55.379 [CLI ] ShellExecute installer failed: 1603 Property(S): ErrorDialog = SetupErrorDialog
MSI (s) (B4:BC) [09:47:55:062]: Product: MySQL Workbench 8.0 CE -- Installation operation failed.
MSI (s) (B4:BC) [09:47:55:062]: Windows Installer installed the product. Product Name: MySQL Workbench 8.0 CE. Product Version: 8.0.34. Product Language: 1033. Manufacturer: Oracle Corporation. Installation success or error status: 1603.

Yes, 1603 often indicates a missing dependency.

This installs and launches normally in a Windows 10 VM.

@wingetbot waivers Add Validation-Shell-Execute

I applied the waiver in error. I assumed that this PR was updating an extant manifest. We'll be accepting new packages with dependencies soon, after the upcoming 1.6 release.

@wingetbot run


tags workflow wipes out apko.images file

Since #47 , the file apko.images goes missing:
Run cat apko.images | sed 's/$/\n/g' | grep -v '^$' | jq -R -s -c 'split("\n")[:-1]' | jq .
cat: apko.images: No such file or directory
[]
cat: apko.images: No such file or directory

maybe something related to git checkout
cc @priyawadhwa

Thank you @jdolitsky for debugging and fixing this! I checked the other repos to make sure "additional tags" wasn't causing this bug, looks like these repos are all clear (a lot of them actually don't run the tags workflow which I'll try to add in!)

go
python
gcc-glibc
sdk
busybox
gcc-musl
musl-dynamic
static
alpine-base
jdk

good to close?

closing as old/inactive. please re-open if necessary


Remove unnecessary comma in blurb

Remove unnecessary comma.

Wow, this is definitely an embarrassing mistake on my part. Thank you so much for finding and fixing it!!


Slash Commands get cut off

Describe the bug
When using slash commands, the slash commands get cut off and the others don't load in. Also probably not major but the bot icons aren't centered.
To Reproduce
Hit '/' in any server with bot slash commands or just hit '/' in a DM and it does the same effect.
Screenshots
Scrolling down shows me 5-6 commands from dyno and also bounces the scroll bar back to the top, so its very glitchy.


Support as a library and not just as an application.

It'd be nice to have this as an option to be a library.

Remove all non-essential deps?
Well defined API interface for the various modes.
Better error handling.

Not required for beta release.


Show an unmatched title for the 'Create Graph' dialog

Storage Explorer Version: 1.8.0_20190426.3
Platform/OS: Windows 10/macOS High Sierra/Ubuntu 18.04
Architecture: ia32/x64
Regression From: Not a regression
Steps to reproduce:

Select a Graph account ->Right click it and create a new database.
Right click the new database and select 'Create Graph...'.
Check the prompt dialog.

Expected Experience:
Show a correct title for the dialog.
Actual Experience:
Show an unmatched title for the dialog.

Azure Storage Explorer support for Azure Cosmos DB has been discontinued as of v1.24.0. We recommend users to use Azure Cosmos DB’s Data Explorer, which can be found in Azure Portal or as a stand-alone version in http://cosmos.azure.com/ for the best Azure Cosmos DB experience. You can also find additional Azure Cosmos DB tooling here: Azure Cosmos DB Tools


Create Carousel, Pricing, Timeline, Timestamp, Countdown, Card and other new components

Description
Created many new reusable components like - carousel, pricing, timeline, timestamp, countdown, card, spinner, about-us components and improved the team component to also show details of the team-person
Motivation and Context
creating newer components will increase the range of the project
Screenshots (In case of UI changes):

Created the Reusable Carousel Component

Created the Reusable Timeline Component

Created the Reusable Pricing Component

Created the Reusable Timestamp Component

Created the Reusable Card Component

Created the Reusable Countdown Component

Added the show details of team-member function in the Team Component

Created the Reusable About Component
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.

Could you please review this @charithccmc sir and @wdevon99 sir?


TensorFlow 2.12.0 depends on an older Numpy version than TensorFlow 2.11 does

pip install tensorflow==2.11.1 numpy==1.24.2

works fine (as does pip install tensorflow==2.11.0 numpy==1.24.2).
But
pip install tensorflow==2.12.0 numpy==1.24.2

does not:
ERROR: Cannot install numpy==1.24.2 and tensorflow==2.12.0 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested numpy==1.24.2
    tensorflow 2.12.0 depends on numpy<1.24 and >=1.22

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

To me, this looks unintended (I did not find anything in the documentation or release notes about it), so I've opened this issue. In case this behavior actually is intended (and not a bug in the dependency declarations), please just close the issue. (A remark in the docs would be cool though.)

Numpy was pinned to <1.24 since it affected few tests on Ragged Tensors.  Agree that we should fix those tests and remove the upperbound in future releases.

@Dobiasd ,
Thanks for bringing this. The dependencies are already mentioned in setup.py file under REQUIRED_PACKAGES here which has to be followed for now. It might be missed in release notes. But this setup.py file is upto date and correctly listed the dependencies
The latest TF versions might not be compatible for the mentioned reason in above comment and we hope the issue will be resolved soon.
Thanks!

Ok, thanks! :+1:
It would be cool to eliminate this upper bound for the dependency version since any such upper bounds can be annoying.

@Dobiasd ,
The upper bound is due to the reason mentioned above and definitely will be resolved at earliest possible.
Meanwhile if there is any functionality that affected by this limitation, please let us know.It may help us and provides more context for prioritising. Thanks !

Yes, I understood. Thanks. 👍

@Dobiasd ,
Do you want this issue to be open till the upper bound is removed? The reason for this limit has been mentioned in comment-1496598836 and likely to be resolved in Future releases.For current versions required numpy version are mentioned in seyup.py as you aware already.
Please confirm. Thanks!

Thanks for asking! :heart:
Since I learned, the upper bound is not an oversight but intended, and since you're aware, I don't care if we keep this issue open or close it. Do with it whatever makes it simpler for you organization-wise. :relaxed:

Please, keep this issue opened till the upper bound is removed.
Can we hope this will be soon by the way ?

Will be fixed in 2.13.0 release.

Can you give an approximative target date for release 2.13 (may be an rc release) ?

Branch was cut last week, so RC0 should arrive soon. It used to be that RC0 arrived in at most 2 days after branch cut but now there are some delays.

RC0 wheels are now published

Hi @Dobiad,
Now the Upper bound on numpy version is removed in r2.13 version.Please refer the source code here.
Also please refer the gist which downloads numpy version -1.24.2 when installing tensorflow==2.13.0rc0.
Please spare some time in closing the issue as it is resolved now. Thanks!

Thanks a lot; not only for the fix, but also for these great explanations! :heart:

RC0 wheels are now published

Fyi, @mihaimaruseac
I've installed this 2.13.0r0 with Python 3.10 for transformers and got:
RuntimeError: Failed to import transformers.models.distilbert.modeling_tf_distilbert because of the following error (look up to see its traceback):
No module named 'keras.engine'
Now rolling back to 2.12.

The problem still exists with TensorFlow 2.13.0:
pip install tensorflow==2.13.0 numpy==1.25.1

ERROR: Cannot install numpy==1.25.1 and tensorflow==2.13.0 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested numpy==1.25.1
    tensorflow 2.13.0 depends on numpy<=1.24.3 and >=1.22

@SuryanarayanaY So it seems the upper bound has not been removed. :confused:

There was no upper bound for numpy with tensorflow 2.11 but it didn't mean that tensorflow 2.11 is working fine with numpy 1.24 or numpy 1.25,  which were not released when tensorflow 2.11 was released. May be there should have been an upper bound limit for numpy in tensorflow 2.11 !
I think you can't ask for a given tensorflow release to be by default compatible with all numpy releases in the future (they could have breaking changes needing changes in tensorflow...). So it's not abnormal to have an upper bound limit for numpy in tensorflow (it just means that more recent numpy releases (if any) have not been tested yet against tensorflow).
I think this issue should be closed and another one opened asking for tensorflow compatibility with numpy 1.25.
I hope the next release of tensorflow (2.13.1 or more probably 2.14.0) will accept numpy 1.25, which is only about one month old by the way (but maybe not numpy 1.26 !)

Of course another possibilioty is to remove all upper bound limits and let tensorflow users open issues saying "Hi, I tried to use tensorflow 2.13 with numpy 1.25, I encountered this problem..."

Thanks for the explanation. :+1:
However, I understood this comment

Now the Upper bound on numpy version is removed in r2.13 version.

such that the upper bound will be removed completely; maybe only pinning the major version (numpy<2), not the minor one.
But if we believe, numpy will introduce incompatibilities in a minor version change, then it might be unsafe, I agree.
So, I guess the question is: "Do we trust the numpy devs to version correctly, i.e., bump the major version on breaking changes?" Right?

I looked numpy changelogs. There are at least expired deprecations between minor versions.
But I'm just a tensorflow user. So don't take my comments as if they were from the tensorflow team and let them answer about the upper bound on numpy.

Hi @Dobiasd ,
At present TF2.13v setup.py indicates numpy should be 'numpy >= 1.22, <= 1.24.3' as below. Since there would be always some delay in testing TF with latest numpy compatibilities. Engineering team was proactive in that and now we can see there is upper bound for numpy version with TF2.13v.If there would have been no upper bound then that should be addressed which is not the case now.
https://github.com/tensorflow/tensorflow/blob/1cb1a030a62b169d90d34c747ab9b09f332bf905/tensorflow/tools/pip_package/setup.py#L93
Currently Master branch has no upper bound on numpy as mentioned below and its working fine with tf-nightly as per attached gist.
https://github.com/tensorflow/tensorflow/blob/9d6a57027317e673b4d0fea6372fe3aa69cb2714/tensorflow/tools/pip_package/setup.py#L93
Since this is continuous integration process and there will be always need for changes like this. I hope you also agree to that. We need to refer the latest commit always. Thanks for understanding.

Thanks for the explanation. So if I understand correctly, the current master branch version does not have an upper bound for the NumPy version, but that does not mean that the next official release will also not have one. I.e., the upper bound for NumPy might be re-introduced again at some point, right?

@Dobiasd ,
Yes you are right. There may be a chance that the upper versions has to be capped if there are compatibility issues(which we are not sure in advance) with latest versions.

Just to add my 2 cents, the common practice in python, and the recommended one by core python and pypa developers, is to use upper bounds, and, at least in most (well-designed) libraries, on the major version. I think the reason is that if a minor version update of a dependency (say numpy) breaks compatibility, the end user can simply downgrade that dependency version himself. But if tensorflow fixes the numpy dependency more strictly, it may simply not install into a given python environment, and the user can do absolutely nothing about it.


Ollama "There was an error processing your request"

Describe the bug

Cloned the repo
Installed everything needed
Created the modelfile FROM qwen2.5-coder:7b
PARAMETER num_ctx 32768
and run the query on powershell but either i don't see ollama qwen2.5-coder:7b dropdown or i get an error saying There was an error processing your request

Link to the Bolt URL that caused the error
http://localhost:5173/
Steps to reproduce

Cloned the repo
Installed everything needed
Created the modelfile FROM qwen2.5-coder:7b
PARAMETER num_ctx 32768
and run the query on powershell but either i don't see ollama qwen2.5-coder:7b dropdown or i get an error saying There was an error processing your request

Expected behavior
How to fix
Screen Recording / Screenshot
No response
Platform

OS: [Windows]
Browser: [Chrome,]

Additional context
No response

https://github.com/coleam00/bolt.new-any-llm/issues/156#issuecomment-2454475543
This sorts it out. Assuming you are running Ollama in docker?
The instructions for the Modelfile are a little confusing if you have Ollama running in docker though. Im pretty sure you will need to create the Modelfile externally and then copy into the docker container before excecuting
ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b

inside the same directory as the modelfile, inside the Ollama container.
Please correct me if im wrong..

ollama create -f Modelfile qwen2.5-coder:7b
transferring model data
Error: invalid model reference: [qwen2.5-coder:7b]
then i use that command in cmd i get that  error

You need to run
ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b
To create the new model with a different name. The names must be different.

Can you make a loom video how to solve this issue whoever solves?

Describe the bug

Cloned the repo
Installed everything needed
Created the modelfile FROM qwen2.5-coder:7b
PARAMETER num_ctx 32768
and run the query on powershell but either i don't see ollama qwen2.5-coder:7b dropdown or i get an error saying There was an error processing your request

So do you get an error or is it not showing up in the drop-down?

yeah i download that with ollama i added the modelfile into it but then i use the command ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b i get this error transferring model data Error: invalid model reference: [qwen2.5-coder:7b] and it not showing in dropdown menu :/ i can´t select my model :S
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile [qwen2.5-coder:7b] transferring model data Error: invalid model name
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile qwen2.5-coder:7b transferring model data Error: invalid model reference: [qwen2.5-coder:7b]
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b transferring model data Error: invalid model reference: [qwen2.5-coder:7b]
idk after few tries it working now somehow <3

I got the same error, but somehow it got resolved.

yeah i download that with ollama i added the modelfile into it but then i use the command ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b i get this error transferring model data Error: invalid model reference: [qwen2.5-coder:7b] and it not showing in dropdown menu :/ i can´t select my model :S
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile [qwen2.5-coder:7b] transferring model data Error: invalid model name
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile qwen2.5-coder:7b transferring model data Error: invalid model reference: [qwen2.5-coder:7b]
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b transferring model data Error: invalid model reference: [qwen2.5-coder:7b]
idk after few tries it working now somehow <3

I got the same error, but somehow it got resolved.

how did you fix it ?

do you have the [ ] brackets around qwen2.5-coder:7b in your Modelfile?

oh yeah i got it like that
FROM [qwen2.5-coder:7b]
PARAMETER num_ctx 32768
edit it to this like you have now i get
FROM qwen2.5-coder:7b
PARAMETER num_ctx 32768
C:\ottodev\bolt.new-any-llm>ollama create -f Modelfile qwen2.5-coder-extra-ctx:7b
transferring model data
using existing layer sha256:ced7796abcbb47ef96412198ebd31ac1eca21e8bbc831d72a31df69e4a30aad5
using existing layer sha256:66b9ea09bd5b7099cbb4fc820f31b575c0366fa439b08245566692c6784e281e
using existing layer sha256:e94a8ecb9327ded799604a2e478659bc759230fe316c50d686358f932f52776c
using existing layer sha256:832dd9e00a68dd83b3c3fb9f5588dad7dcf337a0db50f7d9483f310cd292e92e
using existing layer sha256:86d2d287e563a140caad6dfb82c3a0a099ab8f1237dcaf28126a63e865771139
using existing layer sha256:87717d0622a778dd04b188979483304ea04ead82932e36e3a9d6529c69fbde3d
writing manifest
success
but i still can´t select it :/

for me this happens if i just submit my chat too fast. After selecting the provider and model give it a second then pass in the command. it'll work then


#64 Wishlist doesn't work in Firefox

Removed .disableSelection() call as this is no longer advised and breaks Firefox as it doesn't allow selection of input type=text elements inside the sortable container
Tested working in Chrome 43, Firefox 38 and IE 11, all on Windows 8
Still needs testing on other OS'es / versions

Testing worked on chrome / firefox / safari on OSX Yosemite.


CASMPET-7104: Fix kyverno running pod test

Summary and Scope
Fixed the k8s_kyverno_pods_running.sh goss test in csm-testing for CSM 1.5
Issues and Related PRs
https://jira-pro.it.hpe.com:8443/browse/CASMPET-7104
https://github.com/Cray-HPE/csm-testing/pull/634
Pull Request Checklist

[x] Version number(s) incremented, if applicable
[x] Copyrights updated
[x] Target branch correct
[x] Testing is appropriate and complete, if applicable

@studenym-hpe This will be merged during next round of release preparation (we actually didn't do releases for 1.5 for long time, but I usually merge promotions for 1.5 at regular basis). Please make sure that https://jira-pro.it.hpe.com:8443/browse/CASMPET-7104 has CASm-Release-Ready label assigned - thus I will know this ticket is ready for release and merge the PR.


Increase Replicas of Deployment

There is only 1 pod active in the namespace, we should increase this to 3 for resiliency

Moving to new repo location.


GPU surfaces on Windows 7?

Is it possible to create a GPU-backed SKSurface on Windows 7? I'm currently getting a DllNotFoundException thrown when calling GRGlInterface.CreateDefaultInterface(): "Unable to load libEGL.dll".
I think libEGL.dll is a part of the Microsoft ANGLE package, which only seems to be available for Windows 10 and beyond?

yes, you can use  GPU-backed SKSurface on Windows 7
I've test it :)
I use libEGL from  this ...
https://github.com/google/angle

@tdenniston This can be done in two ways. CreateDefaultInterface uses the preferred platform engine - on Windows it is DirectX. I haven't yet got the targets in place for it to work out the box.
CreateDefaultInterface is basically a wrapper: CreateNativeAngleInterface() ?? CreateNativeGlInterface(). On non-Windows platforms CreateNativeAngleInterface just returns null, so automatically falls back to OpenGL[ES].
However, OpenGL is working fine: GRGlInterface.CreateNativeGlInterface(). This will work on Windows 7 out the box and is what I use for the GL controls. I need to get the ANGLE bits for Windows Classic and then hook up the DirectX/OpenGL context to WinForms. This is a bit of work, so I haven't had a chance to do it yet.

@mattleibow When I try calling GRGlInterface.CreateNativeGlInterface() it is returning null.

@tdenniston That might be because you don't have an OpenGL context set up?
SkiaSharp does not create an OpenGL context, the "interface" here is basically a set of function pointers to the OpenGL functions (glDrawXXX). In my SkiaSharp.Views, I first set up a context to draw to the control/memory and then in the draw loop, I get the interface.
For the Windows Desktop, I use OpenTK and GLControl (I will be switching eventually to DirectX): https://github.com/mono/SkiaSharp/blob/master/source/SkiaSharp.Views/SkiaSharp.Views.Desktop/SKGLControl.cs
For UWP, I set up my ANGLE/DX context:
https://github.com/mono/SkiaSharp/blob/master/source/SkiaSharp.Views/SkiaSharp.Views.UWP/SKSwapChainPanel.cs

Closing this as this is a combination of a duplicate issue and is also not really the right issue to solve:

GPU is supported for Windows 7
Only OpenGL views are currently implemented (via OpenTK.GLControl)
ANGLE views are not currently implemented (or distributed) #243

To use OpenGL GPU on Windows 7, either use the OpenGL-based view, or you will have to set up your own context. For DirectX GPU, you will have to make use of the AssembleAngleInterface:
https://github.com/mono/SkiaSharp/blob/v1.56.2/binding/Binding/GRGlInterface.cs#L89


separate to two mode, operationId and pathWithMethod

instead of switch the mode, we provide the two by one generation


Load New Document using same variable.

I think I have everything working I wanted to do with one exception.   I probably have a somewhat unique use case where I need to load a document to a global variable so I can make calls from other from other functions but the situation is such that I cannot pass the document as a parameter.   This works fine apart from the fact that I can't load a new file.  It keeps the old one.  Seems odd and I can't find any way to load another file.
Also related, how can I clear the contents from memory.   If someone loads a large file and have finished I would like to clear it.  The answer to the first part will probably answer this one.
Again related and perhaps will also be answered by the first one.   How can I load a document with the preferred settings to a global variable.  It appears I have to do the following to load the document with settings which, of course, creates a local version.   I have, sort of, worked around some of the issue by creating 4 different versions globally and one generic instance and have the user supply an option parameter and based on that use the Load() method and then copy the loaded one to the generic one.  This seems like it shouldn't be that complicated so guessing I am missing something obvious.
rapidcsv::Document doccsv(istringstream(""), rapidcsv::LabelParams(-1, -1),
rapidcsv::SeparatorParams(',' /* pSeparator /,
false / pTrim /,
rapidcsv::sPlatformHasCR / pHasCR /,
false / pQuotedLinebreaks /,
true / pAutoQuote */));
Thank you again.  Hopefully I am not wasting your time as I so blatantly did last time.
Jim

Hi @jtaylorme - I think you've identified a bug in rapidcsv. As for my personal use; I've always created a new Document object for each CSV file I'm working on, so I have not encountered any issues. But looking at the code I see that the Load() functions do not clear the internal data structures before loading. This is likely the issue you are facing. I assume your code is (simplified) something like:
Document doc;
doc.Load("somefile.csv");
// do stuff with doc
doc.Load("someotherfile.csv");
// do stuff with doc

This is not handled correctly by rapidcsv today, so I will prepare some code changes (and a new test!) to address this.
Although this should be fixed in rapidcsv, there is a potential workaround. One could use a global shared_ptr which is reset() to a new Document instance every time loading a new CSV file. Not perfect, but in case you need something quick.
Btw, please let me know if I misunderstood your use-case.

Hi @jtaylorme - Thanks for catching and reporting this bug!
I've committed a fix now, enabling multiple Load() calls on a single Document instance.
Please let me know if you still encounter any issues.

Excellent.   That resolves points one and two.   Thank you.
As far as the third part of the post, is there a way to load a document ( doc.Load() )  and set new parameters.   That is, LabelParam, SeparatorParam, etc.?   I would like to be able to make these an option for the user but that is currently not possible without a LOT of extra coding, as far as I can tell.  Obviously, I could be missing something.
Thanks again.
Jim

Hi Jim - I missed that part, let me take a look at the code on how to best enable that functionality. Unfortunately I won't be able to check today, but hopefully tomorrow or in the next few days.

It is greatly appreciated.  I was just going through the code myself to see if I could somehow update the structure after it was already in place.
Jim

So I'm not at a computer, but I'd imagine we could change the Load functions to something like:
Document::Load(const std::string& pPath = std::string(),
                      const LabelParams& pLabelParams = LabelParams(),
                      const SeparatorParams& pSeparatorParams = SeparatorParams(),
                      const ConverterParams& pConverterParams = ConverterParams())
{
    mLabelParams = pLabelParams;
    // etc, copy the other args

Same for the Load accepting a stringstream.
But we would also need to add corresponding tests.

Yes.   That is what I am in the middle of trying right now.  Just about to test my changes.   The only problem with having the parameters optional is that it sees it the same as the doc.Load(filename) overload if they are not specified in the call.   I will let you know once I do some testing here in a bit.
Jim

The following seems to work as an overload.  I made LabelParams() required to avoid conflicts.  I will adjust once you make a final decision.  Thanks again.
        void Load(const std::string& pPath, const LabelParams& pLabelParams,             const SeparatorParams& pSeparatorParams = SeparatorParams(),             const ConverterParams& pConverterParams = ConverterParams())         {             mPath = pPath;             mLabelParams = pLabelParams;             mSeparatorParams = pSeparatorParams;             mConverterParams = pConverterParams;             ReadCsv();         }

The other thing I might suggest is to have a  doc.Clear() method to free up resources.  I am doing it by doc.Load(istringstream("")) but an explicit method might be useful as you would better know what needs to be cleaned up.  Not a big deal but maybe useful for when one has loaded a LARGE CSV file and is finished with it.
Thanks.
Jim
Jim

Hi Jim,
Thanks a lot for sharing. I'll review and try to incorporate it into rapidcsv.
Yes, a Clear() can be provided. Currently I have added a private Clear function that can be made public.

Hi again,
I've incorporated the suggested changes regarding Load() and Clear() now. Please let me know if you encounter issues relating to those.
I have not had time to look into your suggested functionality for inserting rows and columns yet, but will come to it eventually.
Thanks again for contributing!

Thank you.   I noticed and incorporated the Load() stuff a little bit ago.  Clear() wasn't ready yet as it was still private.  Will go and do that now.  Appreciate all your work.
jim


Activity feed

Here is the bulk of the MVP for the activity feed. The page currently displays all conversations, messages, and registrations. The date stamps still need to be converted into a human readable format and sorted chronologically.

Recapping what we discussed in the meeting:
You'll want to make each of the classes you wish to sort implement Comparable.
Then you'll want to have a method like:
@Override
public int compareTo(Conversation c) {
        return this.creationTime.compareTo(c.creationTime);
}

Then in the jsp or perhaps in the servlet (up to you where you think it would be better to do this) you can do
conversations.sort();


console print error when I use cypress work with webpack.

Version
3.0.0-beta.6
Reproduction link
https://codepen.io/imjoshwong/pen/dmEzmB
Steps to reproduce
when I use vue-cli to create a project, I found the created folder haven't "webpack.config.js" file.I use my webpack config to this project and the project can run successfully. Then, I want to test my project, the console printed some error, I want to know why, so I found the document https://github.com/cypress-io/cypress-webpack-preprocessor, and install a plugin "@cypress/webpack-preprocessor", and add some config in plugins config, but the error is still exist.
// tests/plugins/index.js
const webpack = require('@cypress/webpack-preprocessor')

module.exports = (on, config) => {
  on('file:preprocessor', webpack({
    webpackOptions: require('../../webpack.config.js')
  }))
  return Object.assign({}, config, {
    fixturesFolder: 'tests/fixtures',
    integrationFolder: 'tests/specs',
    screenshotsFolder: 'tests/screenshots',
    videosFolder: 'tests/videos',
    supportFile: 'tests/support/index.js'
  })
}

What is expected?
I want to the progress run successfully as the first time.
What is actually happening?
The error is that the process cannot make out the webpack alias, and recommand me to install the alias, that is error absolutely.

I could be wrong, but I believe the intent with v3.x is to not have a webpack.config.js file per se, and instead use one of documented methods to make webpack modifications.

@dhesche is correct. If you use vue-cli 3, you don't define any webpack.config.js your own.

@Joshwoooooooooooooooooooooooooooooooong you have to define your own config as your example is referencing to a non-existing (in vue-cli 3) webpack.config.js file.
This plugin config is used internally by Cypress, to set preprocessors, aliases for imports, loaders etc. To import project file for unit testing with Cypress it should be the same as the Vue config modified with chainWebpack or   configureWebpack via vue.config.js.
You can see a full example of the Cypress plugin file here:
https://github.com/quasarframework/quasar-cli/issues/83#issuecomment-380783701


Query: WGAN-GP FID SCORE (PyTorch)

Thank you for sharing the implementations of the GAN based models on popular datasets like CelebA.
I have implemented the WGAN-GP model (in PyTorch), the samples are looking closer the reported work (please refer to the attached image). When I try to evaluate the Fréchet inception distance (FID score), I am not able to comprehend the high values of 100+ (best value 113.4). Others have reported lower FID Scores. Authors in the Quality Aware Generative Adversarial Networks compared the vairous FID scores for various GAN models and there Ishaan Gulrajani's official implementation of WGAN-GP got FID score of 12.89.
I request you to guide me.
Regards
Prabhav
I have used the following repositories for reference while implementing the WGAN-GP model and evaluating the FID scores:
LynnHo/DCGAN-LSGAN-WGAN-GP-DRAGAN-Pytorch
CharlesNord/WGAN-GP-DRAGAN-Celeba-Pytorch
eriklindernoren/PyTorch-GAN
hukkelas/pytorch-frechet-inception-distance
mseitzer/pytorch-fid

Hi.
This repository is deprecated and I recommend you to use torch_fidelity instead. https://github.com/toshas/torch-fidelity

Thank you for sharing the implementation of the FID and IS scores.
I wanted to use the code to find the metrics for the samples generated by a GAN model trained on the CelebA dataset, however when I use the command
fidelity --gpu 0 --fid --input1 /images/sample_dir/ --input2 /images/CelebA_DATASET

I am getting the following error (which suggests to use given datasets only)
ValueError: Input descriptor "input" field can be either an instance of Dataset, GenerativeModelBase class, or a string, such as a path to a name of a registered dataset (cifar10-train, cifar10-val, stl10-train, stl10-test, stl10-unlabeled), a directory with file samples, or a path to an ONNX or PTH (JIT) module

I request you to guide me in this regard.
Kind regards
Prabhav

Please file the issue in the torch fidelity repository, as I'm sure the torch-fidelity developers are better suited to answer your question.


Pin circle ci jdk version

Problem:
Circle CI fails 100% of the time due to surefire exiting with an error (snipped)
[ERROR] Process Exit Code: 1
[ERROR] 	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:671)
[ERROR] 	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:533)
[ERROR] 	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:278)

Solution:
Turns out, a lot of people have this problem:

link 1
link 2
link 3
link 4

The temporary solution is to pin the jdk version used to one that works until maven surefire + openjdk play nicely 😅
Result:
Circle CI passes 🤞

I have a fix for this I used in my own builds. I'll submit a PR.

I've submitted the PR and it fixes the Circle-CI issue. However, there are failing unit tests. See #2560


Upgrade to the latest upstream Terraform provider

We need to update the upstream Terraform provider to the latest version.
See the previous PR here: https://github.com/upbound/provider-azuread/pull/10

PR: https://github.com/upbound/provider-azuread/pull/29


Scylla machine Image support GCP e2 instances

@slivne is this for Scylla Cloud as a t2 equivalent?  other?

Since E2 instance type does not have local SSD, our machine image can run Scylla but show following message on login prompt:
To continue startup ScyllaDB on this instance, run 'sudo scylla_io_setup' then 'systemctl start scylla-server'.```
And user need to run scylla_io_setup and start scylla-server manually, just same as T2, T3 instances on AWS EC2.

BTW we have a bug on login prompt for GCP, need to fix https://github.com/scylladb/scylla-machine-image/issues/259

@syuu1228 So we can close this, right?

@yaronkaikov Yes.


sourceMap is not supported

I try to active sourcemaps with your builder.
Here my angular.json file
	"build": {
		"builder": "@linnenschmidt/build-ng-packagr:build",
			"options": {
				"tsConfig": "projects/core/tsconfig.lib.json",
				"project": "projects/core/src/ng-package.json",
				"assets": [
					{
						"glob": "**/*.scss",
						"input": "styles",
						"output": "styles"
					},
					{
						"glob": "**/*",
						"input": "assets",
						"output": "assets"
					}
				]
			},
			"configurations": {
				"production": {},
				"dev": {
					"sourceMap": true
				}
			}
	}

The build with dev configuration fails with :

Schema validation failed with the following errors:
Data path "" should NOT have additional properties(sourceMap).

Any news about this issue ?


dev is broken because sourced-ce no longer reads docker-compose.override

caused by https://github.com/src-d/sourced-ce/pull/262
Since global docker-compose.override.yml is no longer linked in source{d} workdirs
(see sourced-ce#262::factory.go::L119),
it can no longer be read from ~/.sourced/compose-files/__active__/docker-compose.override.yml
(see sourced-ui::Makefile::L13).

originally when proposing to remove override.yml support from srcd-ce I supposed we will change ui makefile as well by putting file into ~/.sourced/workdirs/__active__/ instead of ~/.sourced/compose-files/__active__/.

Putting the override inside of ~/.sourced/workdirs/__active__ may be not enough because it's a link to a directory which does not exist before source{d} has been initialized, so it would require extra steps in certain order to run the dev mode.
I think it could be an initial step, but I think we should consider a better DX in the future.

So at this moment, the flow would required to first run init, so that the directory is there, and then call make set-override that will put inside ~/.sourced/workdirs/__active__. And this should work, right?

I think it could be an initial step, but I think we should consider a better DX in the future.

Yup, it's not very convenient. But I'd first fix the thing and update the doc, and then create another issue to improve it. Unless you guys already have an idea on how to fix this.

I think it should be something like this:
$ make build-dev
$ sourced init local .
$ make dev-prepare
$ sourced restart

But then we should also add a
version: '3.4'
services:
  sourced-ui-celery:
    restart: "no"

into docker-compose.override.yml to avoid a restart loop in sourced-ui-celery after restarting  source{d} in dev mode.

So yes, we can do it, close this issue, and open a new one to enhance the process which is suboptimal.

Also, we should document that it should be done that way ** every time** the user wants to change to a different workdir, because in the past, it was needed to run make dev-prepare only once (the first time)

So yes, we can do it, close this issue, and open a new one to enhance the process which is suboptimal.

But now it doesn't work, right? I won't close this issue then.

Yes, it's currently broken; I meant that I agree with your comment:

_But I'd first fix the thing and update the doc, and then create another issue to improve it. _

We can close after fixing and documenting, and then opening a new one for improving later.


Update drawer from hardcoded media query to tailwind screen size

Hey, thanks for the PR.
But I'm not sure if @media screen(lg) is going to work 🤔


Seperation of run scripts.

Hi
What a great idea.
This is just what I was looking for - Thanks ;O)
I am thinking to use it for my alarm system, sending two pushover messages to my server to run a AlarmON.sh and AlarmOFF.sh scripts to set NVR status etc.
I am trying to run 2 instances of the script at the same time to watch for a ON and OFF signal
For test just run as.
./push-watch watch -p "0" xxxxxx yyyyyyyyyyyyyyyyyy echo "Alarm OFF P=0" &
./push-watch watch -p "1" xxxxxx yyyyyyyyyyyyyyyyyy echo "Alarm ON P=1" &
I get to running PIDs in htop, but only the last running instance react on a new push.
They work individually, but not in unison
How can i separate 2 different pushover massages to run 2 different scripts.
How is that intended to work if not with the only available -P flag?
Perhaps put a use case in the readme ;O)

And..just for info
A few install hit wound gbe great for the common foke
I needed to copy the code to /usr/lib/go-1.15/src/push-watch to compile
on debian 11 in a proxmox CT
apt-get install git
apt-get install golang
cd /usr/lib/go-1.15/src/
git clone https://github.com/hrntknr/push-watch.git
cd push-watch
go build push-watch
;O)

Thanks for the feedback! I have added the information you are looking for to the readme.
By the way, release binaries may be available for x86_64 linux.
https://github.com/hrntknr/push-watch/tags

Thanks for the speedy reply and clarification.
My code on my alarm is set up for one push with one token, and the information about Alarm On/Off is carried within the topic.
So a -T flag to filer on the topic  - to separate "Alarm-ON" and "Alarm-OFF" topic to the different run-scripts would be great ;O)
I understand I need to devices...but they will be under the same "Alarm" delivery group for my Application Token, and both get the same pushover message...just with different topics.
Thanks for the good work.
I may rewrite the code and revert to my MQTT server to solve it with Node-RED.
But this did look rather nice.
And I believe my use-case could be rather common.

Thank you for your help in improving this project.
Just FYI, what do you mean "topic"? There is no topic in pushover like there is in mqtt, I think only users, groups, and devices can be specified as publication destinations. (I don't understand which fields you want to filter with the -T flag.)
https://pushover.net/api

true...I mean title ;O)

The assumption policy is that such programs are simpler and should not be beyond the scope of the pushover protocol.
If the intention is to "create a field that corresponds to a topic by extending a message or other field," then this program should not support such a field. (It should be extended in a shell script using PUSHOVER_MESSAGE, etc.)
On the other hand, if the intent is to "use a field such as title as a topic," I think it is acceptable to support it.

Thank you for your comment.
After having played with it, I realize that every Pushover Group has an individual key, and this ca be used to designate the correct push..separated on the group ...Eg. Group ALARM and Group  ALARM ON/OFF etc.
So i don't need to sort on the Title anyway.
Only issues is now that below sketch for Arduino, does for some reason not work for Group Keys..only primary Keys ;O(
I have made a support case with Push Over.
https://forum.arduino.cc/t/pushover-sketch-to-send-pushover-messages-from-the-arduino/236734


x87: modelling of reading the status word wrong/confusing

Describe the bug
The in_FPUStatusWord variable arrives by magic and it not initialized.
To Reproduce
Steps to reproduce the behavior:

Decompile https://github.com/rfalke/decompiler-subjects/blob/master/from_holdec/i386_x87_fpu/ia32_elf/subject.exe

Expected behavior
Output may look like
uint TOP(void)
{
  return (uint)(__read_FPUStatusWord() >> 0xb) & 7;
}

Or pass it in as a function parameter.
It currently is:
uint TOP(void)

{
  ushort in_FPUStatusWord;   <==== no value

  return (uint)(in_FPUStatusWord >> 0xb) & 7;
}

Environment (please complete the following information):

OS: Linux
Java Version: openjdk version "11.0.5" 2019-10-15
Ghidra Version: 9.1.2_PUBLIC

You should have FINIT instruction which initializes all the fields including TOP, without that the code could not be mapped to C directly anyway as it's platform dependent with all the uninitialized variables which must be mapped somehow by hand latter to the CPU state registers. We cannot violate that rule as no pcode can ovewrite variables which may have valid values and we don't know if it's initialized by FINIT or just left as is. There may be some code which could initialize TOP and scan it later after doing loop with FPU stack manipulation. The following example shows valid usage of TOP (Language ID: x86:LE:64:default, raw binary):
                             *************************************************************
                             *                          FUNCTION
                             *************************************************************
                             ushort FUN_00000000(float10 param_1, float10 param_2)
             ushort            AX:2                <RETURN>
             float10           ST0:10              param_1
             float10           ST1:10              param_2
             undefined1        TOP:1               bVar2                                   XREF[1]:     00000000(W)
             undefined2        CX:2                sVar1                                   XREF[1]:     00000003(W)
                             FUN_00000000
        00000000 9b db e3      FINIT
  0
        00000003 66 b9 10 00   MOV               sVar1,0x10
  0
                             LAB_00000007                                    XREF[1]:     0000000f(j)
        00000007 dd d8         FSTP              ST0
        00000009 66 ff c9      DEC               CX
        0000000c 66 e3 02      JCXZ              LAB_00000011
        0000000f eb f6         JMP               LAB_00000007
                             LAB_00000011                                    XREF[1]:     0000000c(j)
        00000011 9b dd 3c 24   FSTSW             word ptr [RSP]
        00000015 66 8b 04 24   MOV               AX,word ptr [RSP]
        00000019 66 c1 e8 0b   SHR               AX,0xb
        0000001d 66 83 e0 07   AND               AX,0x7
        00000021 c3            RET

Decompilation using this ia.sinc:
ushort FUN_00000000(float10 param_1,float10 param_2) {
  short sVar1;
  byte bVar2;

  bVar2 = 0;
  sVar1 = 0x10;
  do {
    bVar2 += 1;
    sVar1 += -1;
  } while (sVar1 != 0);
  return (ushort)(bVar2 & 7);
}

Here FSTP increments bVar2 (stored in TOP) by 1 and there shouldn't be any register specific reads as it would become unportable.

Closed because the test was not a good one.


Data not replicate

I have deployed one cluster with 2 shards, 2 replicas with following configuration:
apiVersion: "clickhouse.altinity.com/v1"
kind: "ClickHouseInstallation"

metadata:
  name: "clickhouse"

spec:
  defaults:
    templates:
      dataVolumeClaimTemplate: default
      podTemplate: clickhouse:19.6

  configuration:
    zookeeper:
      nodes:
      - host: zookeeper-0.zookeeper-headless.clickhouse.svc.cluster.local
      - host: zookeeper-1.zookeeper-headless.clickhouse.svc.cluster.local
      - host: zookeeper-2.zookeeper-headless.clickhouse.svc.cluster.local
    clusters:
      - name: replicated
        layout:
          shardsCount: 2
          replicasCount: 2

  templates:
    volumeClaimTemplates:
      - name: default
        spec:
          accessModes:
            - ReadWriteOnce
          resources:
            requests:
              storage: 500Mi

But after that I connected with DBEaver, create a database but it affected only to one instance.

@liamnv did you try to CREATE DATABASE IF NOT EXISTS db_name ON CLUSTER 'all-sharded' ?

Also, for data replication make sure you use the replicatedMergetree engine.


[TASK] Inline documentation

Inline code documentation for all crates
Update readme to explain how the circuits work in more detail

Add docs to all circuits
Docs to setups
Docs to gadgets
Example directory with lots of examples


Remove usage of kubectl provisioner

To-do

configure kubectl provider

@gowripadmajas Removing usage of the kubectl provisioner here.

@lawliet89 above TO-DO is not needed right ?

Hmm yea. I'll remove the providers separately and document it.

once this is released, I will switch back the hashicorp/tfc-agent, revert this PR https://github.com/SPHTech/sph-aws-infra/pull/181

@lawliet89 I was following the provider issue on this, shall we implement using kubernetes annotation ( https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/annotations ) ? so there is no need of kubectl provider.
https://github.com/hashicorp/terraform-provider-kubernetes/issues/723#issuecomment-1141833527

Yes. This is new. I'll swap it over.


UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'length' of null (5.47.0)

Bug report
The latest version of webpack (5.47.0) causes our build pipeline to fail due to some missed null check.  Our project has both the backend and frontend built and deployed as a single unit and no frontend changes were made between a backend-exclusive code change successfully merged and deployed yesterday evening and our builds (now failing) this morning.

/cc @sokra

Hello there, we have been experiencing the exactly same issue. What helped was removing devtool: 'source-map' from our webpack config. I have absolutely no idea why this resolved the issue, but it worked!

Should be fixed in 5.47.1.
Could you verify that?

Should be fixed in 5.47.1.
Could you verify that?

npm not available yet?

I released it an hour ago, but npm seem to be really slow propagating that... It also took an hour to get the 3.1.1 version of webpack-source on npm.
You can also update webpack-sources in your lockfile...

I have no chance to reproduce the excpetion from 'streamChunksOfCombinedSourceMap.js' in my project. @modestfake @ryanbraganza could have a try.
but
I've install 5.47.1 throw yarn add webpack/webpack#5.47.1,  still throw 'length' of null in file ReplaceSource.js, may be it is another bug need to be fixed?

may be it is another bug needs to be fixed?

Possible. If you have a repro, I'm happy to fix that.

Possible. If you have a repro, I'm happy to fix that.

Interesting...I copied all files in my project into a new folder to reproduce, after a fresh npm install, it works with 5.47.1...so I guess problem solved...

I'm using Electron Forge with Webpack + Typescript template. I've tried to reproduce it on a fresh build but I can't reproduce, it might be some specific library affecting it. Anyway, I still can reproduce it on my project but it's resolved when I apply this fix. If you want, I can push my project to GitHub private repo and give you access so you can try to reproduce it.
One note, I noticed that I can reproduce the error from streamChunksOfCombinedSourceMap.js when I run npm run make and there's no problems when I run npm start. If you take a look at the Webpack plugin they use https://github.com/electron-userland/electron-forge/tree/master/packages/plugin/webpack, the only difference I can see it that when I run npm start it uses devtool: 'evel-source-map but with npm run make it's source-map and this is where it's reproducible. Here's source https://github.com/electron-userland/electron-forge/blob/master/packages/plugin/webpack/src/WebpackConfig.ts#L52
Let me know if that rings any bell if not, I can try to give you access to a private repo or merge https://github.com/webpack/webpack-sources/pull/121 to fix it (but yeah, it would be great to know why it's failing rather than blindly fix it).

Alright, I was able to reproduce it.
Steps to reproduce:
# 1. https://www.electronforge.io/templates/typescript-+-webpack-template
npx create-electron-app reproduce-webpack-source-error --template=typescript-webpack

cd reproduce-webpack-source-error

npm ls webpack-sources
#<EMAIL_ADDRESS>/Users/dev/repro-webpack-sources-bug
└─┬<EMAIL_ADDRESS>  └─┬<EMAIL_ADDRESS>    └──<EMAIL_ADDRESS>
# This one works fine after the latest fix
npm start

# This one work for now
npm run make

# But let's install electron-store and init it (https://github.com/sindresorhus/electron-store)
npm i electron-store

Open /reproduce-webpack-source-error/src/index.ts
Add
import Store from 'electron-store'

const store = new Store()

# Then run this one more time
npm run make

This time it should fail. I guess it might be related to native_modules but I don't know how it works. Maybe this part of the Electron Forge Webpack config.

Electron Forge with Webpack + Typescript

Actually, I'm also using Electron Forge with Webpack + Typescript, and electron-store, never tried 'npm run make' before.

One note, I noticed that I can reproduce the error from streamChunksOfCombinedSourceMap.js when I run npm run make and there's no problems when I run npm start

Confirm: For 5.47.1, it did fix the 'length of null' error from 'ReplaceSource.js', with 'npm run make', still throw same error from 'streamChunksOfCombinedSourceMap.js',
Also, to fix this bug, I think we can just apply this, after I digg into the code:
originalSourceLines = originalSource? originalSource.match(SPLIT_LINES_REGEX): null;
originalSourceLines is a nullable variable but we missed the null check, that's it, I think.


Bump Caropy dependency

Description
Bump Cartopy. I can't install this package as it's currently specified.
System
OS: Ubuntu 22.04
Python: 3.9.13

Move it to a different branch so that CI pytest run


doc: clean() with examples explaining how to use the arguments

From the current docu of clean() it is not clear to me how to use the several arguments available in that function.
Examples in the docu would help me a lot.
https://github.com/messense/nh3/blob/9d73a463678fe3874d3934a6714d3dbb5ef398e1/src/lib.rs#L8-L46

Sorry no example ATM, PR are welcome!
Note that generated api reference is here: https://nh3.readthedocs.io/en/stable/#nh3.clean


Fix running command line with more than a single word under MSW

Split command line into arguments when passing it to cmd.exe, respecting
quotes (but not anything else for now).
Closes #18.

Sorry for my baby Nim, I'm pretty sure this could be done in some better way, but at least this works for me (in fact, I'm writing this text in Vim, opened from Firefox) and is already an improvement.

Thanks for this.
I'm really reluctant to merge this because I can see loads of edge cases - escaped quotes, nested quotes - that will cause weird behaviour.
I don't think it should be too difficult to do it "properly", e.g. with os.quoteShell or the dumb "prepend command with cmd /c and then do the same as we do in Linux" I suggested.
If we can't do that then, yeah, I agree that this is better than the current situation for users.

Thanks for this.
I'm really reluctant to merge this because I can see loads of edge cases - escaped quotes, nested quotes - that will cause weird behaviour.
I don't think it should be too difficult to do it "properly", e.g. with os.quoteShell or the dumb "prepend command with cmd /c and then do the same as we do in Linux" I suggested.
If we can't do that then, yeah, I agree that this is better than the current situation for users.

I presume this would break with things like somecommand "foo """bar"""". While I think you're just asking to suffer once you start trying to fight cmd's quoting rules, this still wouldn't be backwards compatible with the old messenger, then.
On another note, I did some googling again and I think poEvalCommand doesn't mean "shell" to refer to cmd, but the thing that pre-processes and constructs argv, which has another different set of rules. I think that's what os.quoteShell is meant for and what startProcess directly passes its command to when poEvalCommand is used.
All of this is of course under the assumption that I even understand anything here correctly, which I'm not sure about.

I presume this would break with things like somecommand "foo """bar"""". While I think you're just asking to suffer once you start trying to fight cmd's quoting rules, this still wouldn't be backwards compatible with the old messenger, then.
On another note, I did some googling again and I think poEvalCommand doesn't mean "shell" to refer to cmd, but the thing that pre-processes and constructs argv, which has another different set of rules. I think that's what os.quoteShell is meant for and what startProcess directly passes its command to when poEvalCommand is used.
All of this is of course under the assumption that I even understand anything here correctly, which I'm not sure about.

I'm really reluctant to merge this because I can see loads of edge cases - escaped quotes, nested quotes - that will cause weird behaviour.

I could add support for using backslashes to escape quotes, if it could help.

I don't think it should be too difficult to do it "properly", e.g. with os.quoteShell or the dumb "prepend command with cmd /c and then do the same as we do in Linux" I suggested.

quoteShell() seems to work in the other direction, i.e. it takes a single argument and quotes it if necessary. We need to split a string into arguments here and AFAICS Nim doesn't provide any support for this. As for cmd /c, isn't this what we already do? If not, could you please explain what do you mean?
Anyhow, I'd just like to emphasize that the current version, which passes the entire string of the command as a single elements of args is broken. This string must be split into individual arguments in some way.

I'm really reluctant to merge this because I can see loads of edge cases - escaped quotes, nested quotes - that will cause weird behaviour.

I could add support for using backslashes to escape quotes, if it could help.

I don't think it should be too difficult to do it "properly", e.g. with os.quoteShell or the dumb "prepend command with cmd /c and then do the same as we do in Linux" I suggested.

quoteShell() seems to work in the other direction, i.e. it takes a single argument and quotes it if necessary. We need to split a string into arguments here and AFAICS Nim doesn't provide any support for this. As for cmd /c, isn't this what we already do? If not, could you please explain what do you mean?
Anyhow, I'd just like to emphasize that the current version, which passes the entire string of the command as a single elements of args is broken. This string must be split into individual arguments in some way.

On Linux we use poEvalCommand which doesn't do any escaping. I'm suggesting that we do the same thing on Windows, which is what we did initially, but add cmd /c to the start of the command.
The reason we stopped using it on Windows is because poEvalCommand dumps you in a shell without any built-ins (e.g. which).
With poEvalCommand you give startProcess a single string and don't use the arguments array.
I think you're probably right and quoteshell does the opposite of what we want...
PGP - 2BB8 C36B B504 BFF3 - https://keybase.io/bovine3dom/key.asc
On 24 January 2021 14:58:56 CET, VZ<EMAIL_ADDRESS>wrote:

I'm really reluctant to merge this because I can see loads of edge
cases - escaped quotes, nested quotes - that will cause weird
behaviour.

I could add support for using backslashes to escape quotes, if it could
help.

I don't think it should be too difficult to do it "properly", e.g.
with os.quoteShell or the dumb "prepend command with cmd /c and then
do the same as we do in Linux" I suggested.

quoteShell() seems to work in the other direction, i.e. it takes a
single argument and quotes it if necessary. We need to split a string
into arguments here and AFAICS Nim doesn't provide any support for
this. As for cmd /c, isn't this what we already do? If not, could you
please explain what do you mean?
Anyhow, I'd just like to emphasize that the current version, which
passes the entire string of the command as a single elements of args
is broken. This string must be split into individual arguments in some
way.
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/tridactyl/native_messenger/pull/20#issuecomment-766352447

On Linux we use poEvalCommand which doesn't do any escaping. I'm suggesting that we do the same thing on Windows, which is what we did initially, but add cmd /c to the start of the command.
The reason we stopped using it on Windows is because poEvalCommand dumps you in a shell without any built-ins (e.g. which).
With poEvalCommand you give startProcess a single string and don't use the arguments array.
I think you're probably right and quoteshell does the opposite of what we want...
PGP - 2BB8 C36B B504 BFF3 - https://keybase.io/bovine3dom/key.asc
On 24 January 2021 14:58:56 CET, VZ<EMAIL_ADDRESS>wrote:

I'm really reluctant to merge this because I can see loads of edge
cases - escaped quotes, nested quotes - that will cause weird
behaviour.

I could add support for using backslashes to escape quotes, if it could
help.

I don't think it should be too difficult to do it "properly", e.g.
with os.quoteShell or the dumb "prepend command with cmd /c and then
do the same as we do in Linux" I suggested.

quoteShell() seems to work in the other direction, i.e. it takes a
single argument and quotes it if necessary. We need to split a string
into arguments here and AFAICS Nim doesn't provide any support for
this. As for cmd /c, isn't this what we already do? If not, could you
please explain what do you mean?
Anyhow, I'd just like to emphasize that the current version, which
passes the entire string of the command as a single elements of args
is broken. This string must be split into individual arguments in some
way.
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/tridactyl/native_messenger/pull/20#issuecomment-766352447

If all else fails, we could use _popen or _wpopen – probably the latter, for Unicode support –, but that'd mean more and even uglier platform-specific code.

If all else fails, we could use _popen or _wpopen – probably the latter, for Unicode support –, but that'd mean more and even uglier platform-specific code.

OK, I can confirm that using poEvalCommand works as well, please see #21, thanks for the idea.

OK, I can confirm that using poEvalCommand works as well, please see #21, thanks for the idea.


Fix broken links in AP Getting Started doc

Preview is available here:http://developers-pr890.previews.kube001.services.stellar-ops.com


Update linting

Ignore all node_modules dirs.
Update Makefile.common golangci-lint to match CI pipeline.

This should make it possible to sync the yamllint to promlens. (https://github.com/prometheus/promlens/pull/159)


JSON/JS array format

Looking forward to using this module!
What's missing in the docs (IMO) is the format of the array - there are several different potential array formats.
I can try to figure this out, but it would best if this were explicitly stated, all we need is a couple elements in the array and we will get the idea so it should fit easily in the README.md file, thx

in other words, I am looking for:
 $scope.getArray = function(){

      return [];  // what format is the array supposed to have? :)

    };

so I tried this:
   $scope.getArray = function () {

      return [
        {
          a: 'b',
          c: 'd',
          x: 'e'
        },
        {
          a: 'v',
          c: 'r',
          x: 't'
        }];

    };

and I basically get:
b,d,e
v,r,t
so that seems to work, but I wish the headers would be inferred

if you use the csv-label directive then the keys will be the header row of the csv file.

csv-label: Defines whether or not using keys as csv column value (default is false).


Create Session keyword prints "Argument types are..." in the logs.

The Create Session keyword in printing the following message to Robot logs:
Argument types are:
<type 'unicode'>

Or the below message if max_retries is passed as max_retries=${1}:
Argument types are:
<type 'int'>

This problem does not affect the test result but causes confusion, since the message appears out of context in the logs. The test developer does not know what is the message referring to.
This is happening because in the _create_session method of RequestsKeywords class, the max_retries argument is being converted to integer using another Robot keyword.
max_retries = self.builtin.convert_to_integer(max_retries)
In order to overcome this problem the above instruction can be replaced to use native python method int() as shown below.
max_retries = int(max_retries)
The int() method guarantees that, if a string is sent as parameter it is converted to integer without printing additional messages to the log.

@roimvargas the suggested PR changes are already pushed into master with latest PR, do you have any further comments on this issue?

Hi @vkosuri,
No. The issue is resolved with the PR changes.
Thank you!


Canvas.drawShadow Transformed Incorrectly

As you can see, the shadow as the top is weirdly flipped while the canvas is transformed. You can see how it is supposed to look like here. I do not draw the shadow at all while transforming as a workaround - the idea is that the weird lines are gone.
Steps to Reproduce
The canvas is transformed here:

pushTransform
context.pushTransform(
  needsCompositing,
  offset,
  Matrix4.identity()
    ..translate(size.width / 2, size.height)
    ..multiply(Matrix4.identity()..setEntry(3, 2, 1.7e-3))
    ..translate(-size.width / 2, -size.height)
    ..translate(size.width / 2, size.height)
    ..multiply(Matrix4.rotationX(-pi / 2 * (1 - spinUpAnimation.value)))
    ..translate(-size.width / 2, -size.height),
  _paintChildren,
);

And the shadow is drawn here:

drawShadow
canvas.drawShadow(
  Path.from(travelPath)
    ..addPath(startPath, Offset.zero)
    ..addPath(endPath, Offset.zero),
  _shadowColor,
  size.height / 99,
  false,
);

This issue only happens in native for me (tested Android). On Flutter web, the shadow is transformed correctly (even without the condition from the link).

Flutter doctor
[√] Flutter (Channel master, v1.14.2-pre.51, locale en-US)
    • Flutter version 1.14.2-pre.51
    • Framework revision ec1044a877 (3 days ago), 2020-01-17 19:19:33 -0800
    • Engine revision ecc74c966d
    • Dart version 2.8.0 (build 2.8.0-dev.3.0 f96c48307d)

It occurs on stable as well.

Hi @creativecreatorormaybenot
Are you still experiencing this issue?
If yes, Can you please provide your flutter doctor -v with the latest stable and flutter run --verbose logs, and a minimal complete reproducible code sample
Thank you

Without additional information, we are unfortunately not sure how to resolve this issue.
We are therefore reluctantly going to close this bug for now.
Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.


FSharp.Core 4.3.4 is not found

VS 15.8 pre 3
master
Ctrl+F5
New F# .net 4.6.1 console app
This:

Looks like master is completely broken.

It's not reproduced on VS 15.7

I think this is the usual thing that you have to use master with the latest official VS release (currently 15.7)
Does the dev15.8 branch work with 15.8 pre 3?

I see, thanks. I've not checked dev15.8.


Update cards: HTML

Fixed a typo in the description of adding card headers.

No long needed.
Thanks though!