Autogenerated CLIs, e.g. bst export

2023-02-Sprint special edition.
Addressing the Tooling goal “Command Line Interfaces”.

@bendhouseart could you have a look at the doc fail?

It's failing when exporting the schema json, read the docs is running bst export with a flag, but the error message seems to indicate that the  input arguments should be positional instead.
Failed error is taken from rtd output here
bst -v export --output src/schema.json
usage: bst export [-h] schema_path output
bst export: error: the following arguments are required: output

I don't see bst export in this PR, but I haven't had my coffee or the wherewithal to grep the repo for it yet.

Ah okay, below in readthedocs.yaml just needs to be updated to the new cli:
version: 2

build:
  os: ubuntu-22.04
  tools:
    python: "3.10"
  jobs:
    pre_build:
      - bst -v export --output src/schema.json

mkdocs:
  configuration: mkdocs.yml
  fail_on_warning: true

python:
  install:
    - requirements: requirements.txt

hm, it's still complaining 🤔

hm, it's still complaining 🤔

Well now I'm stumped.....

@effigies what about this one?

@tsalo ?

This looks pretty bad:
$ bst --help
usage: bst [-h] {export,validate} ...

positional arguments:
  {export,validate}
    export           Export BIDS schema to JSON document. Parameters ---------- output : str A path which to write a JSON exported schema to, or `-` if the output is to be
                     written to stdout. schema_path : str or None, optional A path to the schema directory you wish to export to JSON. Examples --------
    validate         Validate paths according to BIDS schema. Parameters ---------- in_paths : str or list of str Paths which to validate, may be individual files or
                     directories. accept_dummy_paths : bool, optional Whether to accept path strings which do not correspond to either files or directories.
                     schema_reference_root : str, optional Path where schema versions are stored, and which contains directories named exactly according to the respective
                     schema version, e.g. "1.7.0". If the path starts with the string "{module_path}" it will be expanded relative to the module path. schema_version : str or
                     None, optional Version of BIDS schema, or path to schema. If a path is given, this will be expanded and used directly, not concatenated with
                     `schema_reference_root`. If the path starts with the string "{module_path}" it will be expanded relative to the module path. If None, the
                     `dataset_description.json` fie will be queried for the dataset schema version. report_path : bool or str, optional If `True` a log will be written using
                     the standard output path of `.write_report()`. If string, the string will be used as the output path. If the variable evaluates as False, no log will be
                     written. schema_min_version : str, optional Minimal working schema version, used by the `bidsschematools.select_schema_dir()` function only if no schema
                     version is found or a lower schema version is specified by the dataset. Returns ------- results : dict A dictionary reporting the target files for
                     validation, the unmatched files and unmatched regexes, and optionally the itemwise comparison results. Keys include "schema_tracking", "path_tracking",
                     "path_listing", "match_listing", and optionally "itemwise" Examples -------- :: from bidsschematools import validator bids_paths =
                     '~/.data2/datalad/000026/rawdata' schema_version='{module_path}/data/schema/' validator.validate_bids(bids_paths, schema_version=schema_version) Notes
                     ----- * Needs to account for inheritance principle, probably somewhere deeper in the logic, might be as simple as pattern parsing and multiplying patterns
                     to which inheritance applies. https://github.com/bids-standard/bids-specification/pull/969#issuecomment-1132119492

options:
  -h, --help         show this help message and exit

I suppose the subcommands are a bit better:
$ bst validate --help
usage: bst validate [-h] [-a] [--schema-reference-root SCHEMA_REFERENCE_ROOT] [--schema-version SCHEMA_VERSION] [-r] [--suppress-errors]
                    [--schema-min-version SCHEMA_MIN_VERSION]
                    in_paths

    Validate paths according to BIDS schema.

    Parameters
    ----------
    in_paths : str or list of str
        Paths which to validate, may be individual files or directories.
    accept_dummy_paths : bool, optional
        Whether to accept path strings which do not correspond to either files or directories.
    schema_reference_root : str, optional
        Path where schema versions are stored, and which contains directories named exactly
        according to the respective schema version, e.g. "1.7.0".
        If the path starts with the string "{module_path}" it will be expanded relative to the
        module path.
    schema_version : str or None, optional
        Version of BIDS schema, or path to schema.
        If a path is given, this will be expanded and used directly, not concatenated with
        `schema_reference_root`.
        If the path starts with the string "{module_path}" it will be expanded relative to the
        module path.
        If None, the `dataset_description.json` fie will be queried for the dataset schema version.
    report_path : bool or str, optional
        If `True` a log will be written using the standard output path of `.write_report()`.
        If string, the string will be used as the output path.
        If the variable evaluates as False, no log will be written.
    schema_min_version : str, optional
        Minimal working schema version, used by the `bidsschematools.select_schema_dir()` function
        only if no schema version is found or a lower schema version is specified by the dataset.

    Returns
    -------
    results : dict
        A dictionary reporting the target files for validation, the unmatched files and unmatched
        regexes, and optionally the itemwise comparison results.
        Keys include "schema_tracking", "path_tracking", "path_listing", "match_listing", and
        optionally "itemwise"

    Examples
    --------

    ::

        from bidsschematools import validator
        bids_paths = '~/.data2/datalad/000026/rawdata'
        schema_version='{module_path}/data/schema/'
        validator.validate_bids(bids_paths, schema_version=schema_version)

    Notes
    -----
    * Needs to account for inheritance principle, probably somewhere deeper in the logic, might be
        as simple as pattern parsing and multiplying patterns to which inheritance applies.
        https://github.com/bids-standard/bids-specification/pull/969#issuecomment-1132119492

positional arguments:
  in_paths              -

options:
  -h, --help            show this help message and exit
  -a, --accept-dummy-paths
                        False
  --schema-reference-root SCHEMA_REFERENCE_ROOT
                        '{module_path}/data/'
  --schema-version SCHEMA_VERSION
                        -
  -r, --report-path     False
  --suppress-errors     False
  --schema-min-version SCHEMA_MIN_VERSION
                        'schema'

$ bst export --help
usage: bst export [-h] [-s SCHEMA_PATH] output

    Export BIDS schema to JSON document.

    Parameters
    ----------
    output : str
        A path which to write a JSON exported schema to, or `-` if the output is to be written
        to stdout.
    schema_path : str or None, optional
        A path to the schema directory you wish to export to JSON.

    Examples
    --------

positional arguments:
  output                -

options:
  -h, --help            show this help message and exit
  -s SCHEMA_PATH, --schema-path SCHEMA_PATH

I feel like I'm not seeing the advantage of this library over one where we actually code up the CLI.

@effigies I fixed the base command help text in the latest commit. Alternatively, if it's too much text, we can remove the help parameter for the base command entirely, so people just get a list of the available subcommands when running bst. I can also add some manual help text, but this is getting to your question — namely what the advantage is.
The advantage is that everything is auto-generated from the function. The interfaces can't go out of sync, there's no additional API to keep track of, and it's fully transparent. See something wrong, it's in the fuction. Fix something in the function, it's in the CLI.

@effigies what about now? :)

ok, so it seems there is currently opposition to this. I'd recommend using https://github.com/TheChymera/bids-cli for a simple auto-cli. I think it's strange that we would end up with a more complex built-in solution and have to require an external wrapper for auto-cli. Ideally it should be the other way around...

@TheChymera I found the thread I was mentioning: https://discuss.python.org/t/argparse-decorator-arguments-via-inspection/25501/
clize might be a good option for usefully working with docstrings, although note that it does not currently support numpy-style strings.

it seems that this effort was never finalized.  I am also a click user, and despite disliking the need for duplication, I think it works fine.  Not sure if this PR would solve any problem.  Should we close it @TheChymera or are you planing to continue on it?

@yarikoptic no, I'm planning to continue it.

@effigies the main issue as I understand it is that the docstring rendering has some issues.
I tried clize but this looks like it's even more poorly rendered:
(mydev) [deco]~/src/bids-specification/tools/schemacode ❱ bst validate
bst validate: Missing required arguments: in-paths
Usage: bst validate in-paths [dummy-paths] [bids-reference-root] [schema-path] [bids-version] [report-path] [suppress-errors] [accept-non-bids-dir] [exclude-files]
(mydev) [deco]~/src/bids-specification/tools/schemacode ❱ bst validate -h
Usage: bst validate in-paths [dummy-paths] [bids-reference-root] [schema-path] [bids-version] [report-path] [suppress-errors] [accept-non-
bids-dir] [exclude-files]

Validate paths according to BIDS schema.

Parameters ---------- in_paths : str or list of str Paths which to validate, may be individual files or directories. dummy_paths : bool,
optional Whether to accept path strings which do not correspond to either files or directories. bids_reference_root : str, optional Path
where schema versions are stored, and which contains directories named exactly according to the respective schema version, e.g. "1.7.0".
Currently this is untested. bids_version : str or None, optional Version of BIDS schema, or path to schema. This supersedes the
specification detected in `dataset_description.json` and is itself superseded if `schema_path` is specified. schema_path : str or None,
optional If a path is given, this will be expanded and used directly, ignoring all other BIDS version specification logic. This is not
relative to `bids_reference_root`. report_path : bool or str, optional If `True` a log will be written using the standard output path of
`.write_report()`. If string, the string will be used as the output path. If the variable evaluates as False, no log will be written.
accept_non_bids_dir : bool, optional exclude_files : str, optional Files which will not be indexed for validation, use this if your data is
in an archive standard which requires the presence of archive-specific files (e.g. DANDI requiring `dandiset.yaml`). Dot files (`.*`) do not
need to be explicitly listed, as these are excluded by default.

Returns ------- results : dict A dictionary reporting the target files for validation, the unmatched files and unmatched regexes, and
optionally the itemwise comparison results. Keys include "schema_tracking", "path_tracking", "path_listing", "match_listing", and optionally
"itemwise"

Examples --------

::

    from bidsschematools import validator
    bids_paths = '~/.data2/datalad/000026/rawdata'
    validator.validate_bids(bids_paths)

Notes ----- * Needs to account for inheritance principle, probably somewhere deeper in the logic, might be as simple as pattern parsing and
multiplying patterns to which inheritance applies. https://github.com/bids-standard/bids-specification/pull/969#issuecomment-1132119492

Arguments:
  in-paths
  dummy-paths            (type: BOOL, default: False)
  bids-reference-root
  schema-path
  bids-version
  report-path            (type: BOOL, default: False)
  suppress-errors        (type: BOOL, default: False)
  accept-non-bids-dir    (type: BOOL, default: False)
  exclude-files

Other actions:
  -h, --help            Show the help

Alternative draft PR here → https://github.com/bids-standard/bids-specification/pull/1804


[v3.1.0] Streamlining an installation command utility for packages

Here you go, sir! @GoodM4ven
(￣^￣ )ゞ

#24  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Haaabeeel and the rest of your teammates on  Graphite

lmao


&sslcert=server-ca.pem in PostgreSQL connection url throw Error opening a TLS connection: One or more parameters passed to a function were not valid.

I created a PostgreSQL instance on Google Cloud
I followed https://github.com/prisma/prisma2/blob/master/docs/core/connectors/postgresql.md#configuring-an-ssl-connection created the .p12 with a password from the certificates downloaded from the Google project
openssl pkcs12 -export -out client-identity.p12 -inkey client-key.pem -in client-cert.pem
my prisma/.env
DATABASE_URL="postgresql://postgres:GDp1zlwDdrOm4GtM@<IP_ADDRESS>:5432/mydb?schema=public&sslmode=require&sslidentity=client-identity.p12&sslpassword=mysecurepass3728508&sslcert=server-ca.pem"

When doing prisma2 introspect
Error: P1011
Error opening a TLS connection: One or more parameters passed to a function were not valid.

When removing &sslcert=server-ca.pem it works without sslcert even with sslmode=require

Sidenote: The error could be more specific to help with which parameter(s) were not valid maybe?

I didn't manage to reproduce this exact error, it could be OSX specific. I'll keep investigating.

@Jolg42 I'm still not able to reproduce this :/ Do you think it is still happening?

I will try again soon then @tomhoule :)

This may be related to postgres user roles/privileges. I had an 'empty database' error that was fixed by adding privileges using GRANT, which you can find in the docs. I hope its the same issue you're facing.

So in the docs some values are missing, is it because they are not supported or that the documentation need to be updated?
In current Prisma doc

https://www.prisma.io/docs/reference/database-connectors/postgresql#configuring-an-ssl-connection
In Postgres doc

See https://jdbc.postgresql.org/documentation/head/ssl-client.html

It looks like it works 🎊
Example
DATABASE_URL="postgresql://postgres:password@<IP_ADDRESS>:5432/mydb?schema=public&sslmode=require&sslidentity=../client-identity.p12&sslpassword=dummypass&sslcert=../server-ca.pem"


Cocoapods

please add Support for cocoapods

Any reason why this issue is closed? CocoaPods now supports Swift. But Alecrim Core Data is not yet listed cocoapods.org. Could you please make this project available via CocoaPods.

CocoaPods is now supported in version 2.1. Can you test to see if it works correctly?

Why the target is iOS 8.2?
Shouldn't iOS 8.0 be OK?

I did not test the framework on iOS 8.0, but I think your are right.
Do you think new a version 2.1.1 should be released only for this change? Or most of the developers are already using as target at least version 8.2 of iOS?

So, for me I'm targeting iOS 8.0 for my Apps...

Updated in the last prerelease. Thank you.


Add CDNJS version badge in README.md

This badge will show the latest library version on CDNJS!

Thanks!


Name Truncate Under Display Options

Normal arc windows have the ability to truncate player names. Display -> max name length.
Would be a great feature to compress the window and place it in a smaller space, thanks!

Thanks for the suggestion, will try to add that next release :)

Took a long time until the next release actually happened, but done now in 146ff72b3f192d3cf5dcf0518c46f64b767b6ea1, released in 2.5rc1 https://github.com/Krappa322/arcdps_healing_stats/releases/tag/v2.5rc1


New tasks.json variable request for re-running tasks.

VSCode Version: 1.8.1
OS Version: Windows 10 pro

Feature request: essentially an additional boolean variable supported in the tasks.json file which when set would stop vscode from prompting you to terminate an existing task (see below) when trying to re-run a task.

Instead running a new task while another still exists would first terminate the existing, then cleanly run the new without presenting a jarring prompt.
Reasoning: I would like to be able to re-run a task without first terminating it, or being forced through this prompt.

Covered by this issue: #32264


Add compression support

Summary of changes
Normalization

Add ability to compress the measurementGroup and send the compressed measurementGroup.
Add way to flag if we are sending a measurement or measurementGroup (set IsMeasurementGroup property)
Add way to flag if we are sending a compressed event payload (set ContentType to application/gzip)
The compression on the normalization side is off by default, since we would like to first support it on the MeasurementToFhir side first

MeasurementToFhir

Detect if event batch contains measurements, measurementGroups, or both
Add ability to process any of the above, or combinations of the above
Add ability to decompress event payload if it is compressed

Changes to use streams instead of byte[] arrays look good.
Only issue is the removal of the <PackageReference Include="Newtonsoft.Json" Version="13.0.1" /> package references in the Test projects. Please add them back in. Please let me know if these were removed for a reason so we can see what options we have. Thanks!

I see. I've added the dependency back so that each test project has a Newtonsoft.Json 13.0.1 version.
There were two cases where there were duplicates, which caused a build error, so I have removed the duplicates in those two cases. All of the test csproj files should have exactly one Newtonsoft.Json now which I believe is the correct approach.
Cases where we had duplicates:
Microsoft.Health.Tests.Common.csproj
https://github.com/microsoft/iomt-fhir/blob/main/test/Microsoft.Health.Tests.Common/Microsoft.Health.Tests.Common.csproj#L30
Microsoft.Health.Fhir.Ingest.UnitTests.csproj
https://github.com/microsoft/iomt-fhir/blob/main/test/Microsoft.Health.Fhir.Ingest.UnitTests/Microsoft.Health.Fhir.Ingest.UnitTests.csproj#L34


Adapt metrics library to use labeled sets canonically instead of names only

To support fully-labeled metrics, the naming and structuring of metrics objects in the NB runtime needs to be canonically based on labels. This change will provide the basis for converting the metrics feeds into a promql compatible form, without the fragile intermediate mapping from graphite to prometheus. The existing graphite->prometheus pipeline has proven fragile when anything other than the simple defaults are used for advanced tests.

Each Metric type, based on the Dropwizard metrics library, must implement set of labels. name interfaces may be used so long as setting a name has the same effect as setting the name label value.
Internally, all metrics objects need to have a canonically correct set of labels that identify which component type and instance the metric pertains to using simple and descriptive fields. This is essentially a label set as described in the prometheus exposition format.
Given that there are several layers to the components in the NB runtime, bolting on labels in a surgical way was overly complex. A better approach is to put labeling support into the NB runtime as a general property on all user-visible components.
To support this, NBNamedElement types which provided a name through a decorator interface are being updated to fully use an NBLabeledElement type which requires rework throughout several subsystems. This is not too invasive, but does change the semantics of named metric access to labeled metric access, whereby a request for a simple name could return multiple metric instances.
All callers of the name-based API before must be reworked to understand the potential for multiple metrics, as well as to qualify when only one metric is expected for valid error checking.
The existing metrics plumbing is not being removed for graphite. However, those interfaces will be changed to use the label-based APIs, with a minimally qualified name request and a clear assertion that only one element is expected to be returned. Otherwise, previous metrics registry and graphite plumbing will remain as-is.
Scripting interfaces will have a potentially breaking change, as the label-based interfaces are much more suitable for general purpose automatons, and leaving the naming-based interface in place would cause more confusion than standardizing on an ecosystem-wide convention of labeled metrics.

Status update:
Most of this has been done up to step 5. The remaining work here is all about shifting the runtime registry logic over to label sets, including supporting scripting as it works now.

@jshook Is step 5 done? Is completing this helpful as a prerequisite for other work?


No "Advanced tab" exists

I suspect a UI change has made this obsolete, but this sentence:
"Click on the Advanced tab at the top of the routing rule configuration pane. Url Rewrite is disabled by default and you should only use this field if you want to narrow the scope of backend-hosted resources that you want to make available. "
is wrong as there is no Advance tab on the routing rule configuration pane

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 42cb8651-4d1d-4031-ad64-93fc7a2c0c6c
Version Independent ID: d2f0f0f6-378b-d3e9-b5de-59ab8ac71c72
Content: Troubleshooting - Troubleshoot issues with your Azure Front Door Service configuration
Content Source: articles/frontdoor/front-door-troubleshoot-routing.md
Service: frontdoor
GitHub Login: @sharad4u
Microsoft Alias: sharadag

@KevinMZiegler Thanks for the feedback! The advanced tab is no longer needed to access these configurations, they should be under the "Update Routing Rule" blade when you select an existing rule.

@KevinMZiegler I apologize for the delay, the changes have been made, and the doc should reflect those changes within 24 hours.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Firebase Hosting ส่งคืนข้อผิดพลาด 503 Onรายการ

Step 0: Are you in the right place?

For issues or feature requests related to the code in this repository
file a Github issue.

If this is a feature request please use the Feature Request template.

For general technical questions, post a question on StackOverflow
with the firebase tag.
For general (non-iOS) Firebase discussion, use the firebase-talk
google group.
For backend issues, console issues, and other non-SDK help that does not fall under one
of the above categories, reach out to
Firebase Support.
Once you've read this section and determined that your issue is appropriate for
this repository, please delete this section.

[REQUIRED] Step 1: Describe your environment

Xcode version: _____
Firebase SDK version: _____
Installation method: CocoaPods | Carthage | Zip file | Swift Package Manager (select one)
Firebase Component: _____ (Auth, Core, Database, Firestore, Messaging, Storage, etc)

[REQUIRED] Step 2: Describe the problem
Steps to reproduce:
What happened? How can we make the problem occur?
This could be a description, log/console output, etc.
If you have a downloadable sample project that reproduces the bug you're reporting, you will
likely receive a faster response on your issue.
Relevant Code:
``amdmsn`azuredevopumicrosoft.com-<EMAIL_ADDRESS>// TODO(you): code here to reproduce the problem

https://httpsworkspacegooglecommarketp.godaddysites.com/apk

<EMAIL_ADDRESS>

<EMAIL_ADDRESS>

<EMAIL_ADDRESS>

https://www.google.co.th/search?ibp=gwp;0,7&q=https://www.google.co.th/business&ludocid=493878471339619304&lsig=AB86z5WoNG0kGOHMchuUxastp1qk#lkt=LocalPoiPhotos

git branch -m main r/กระเพราะคือไคร
git fetch origin
git branch -u<EMAIL_ADDRESS>พิมพ์เล็ก สิทธิ์ฟราม duck 🦆
git remote set-head origin -a


Optional not working with @javax.validation.constraints.Pattern

When using a parameter which schema has a pattern inside like:
post:
   parameters:
        - in: query
          name: version
          required: false
          schema:
            type: string
            minLength: 1
            pattern: '^\d+\.\d+\.\d+$'

the tool resolves it to:
			@javax.validation.constraints.Size(min = 1)
			@javax.annotation.Nonnull
			@io.micronaut.http.annotation.QueryValue(value = "version")
			java.util.Optional<java.lang.String> version

which itself leads to the following exception when called:
HV000030: No validator could be found for constraint 'javax.validation.constraints.Pattern' validating type 'java.util.Optional<java.lang.String>'. Check configuration for 'findServices.versionOptional
even when the tool behaves as expected, the combination of Optional and Pattern don't seem to work

Cannot reproduce with micronaut-validator (see commit 28c0cf8).
IMHO: there is an issue with your hibernate validator setup.


Exposing metrics endpoints while using multiple fluentd workers

Is your feature request related to a problem? Please describe.
I'm musing multiple fluentd workers in each fluentd pod, I need this to handle huge amount of logs from on my GKE cluster with reduced number of fluentd pods (specially on startup statefulset is slow to scale up and few fluentd pods can't handle all the data from fluent-bit daemonset that starts very fast)
Describe the solution you'd like
In case of using multiple workers fluentd.workers: X the operator should expose ports for metrics endpoints in fluentd pods, pseudo code example:
(loop from zero to worker count -1)
    - containerPort: 24231 + <worker_id>
      name: monitor-<worker_id>
      protocol: TCP

Also fluentd monitor service and serviceMonitor should account for those ports
Describe alternatives you've considered
I could't think of any alternative solutions, I guess users can create their own service and service monitor but ports would have to be exposed in the pod
EDIT:
There actually is a way to handle this, fluentd already exposes aggregated_metrics endpoint, for now this setting:
  fluentd:
    metrics:
      path: aggregated_metrics
      serviceMonitor: true

The only thing I do not understand is why standard /metrics endpoint is not available in fluentd pod anymore after applying this settings, should it not just update path in serviceMonitor? Just curious, it's not a major issue.
Additional context
For now when using multiple workers only metrics from worker 0 are exposed:

Hi,
I believe this is already solved in https://github.com/kube-logging/logging-operator/pull/1417 and will be released with version 4.4.0.

Oh, nice. Thank you :+1:


Update otelopscol

Description

Related issue

How has this been tested?

Checklist:

Unit tests

[ ] Unit tests do not apply.
[ ] Unit tests have been added/modified and passed for this PR.

Integration tests

[ ] Integration tests do not apply.
[ ] Integration tests have been added/modified and passed for this PR.

Documentation

[ ] This PR introduces no user visible changes.
[ ] This PR introduces user visible changes and the corresponding documentation change has been made.

Minor version bump

[ ] This PR introduces no new features.
[ ] This PR introduces new features, and there is a separate PR to bump the minor version since the last release already.
[ ] This PR bumps the version.

https://github.com/GoogleCloudPlatform/opentelemetry-operations-collector/pull/189 was just merged, mind repointing to the latest HEAD?


Update kubeadm-certs.md

You have opened four PR for very small (and un-noticeable for current version) sync. Could you merge them into one?

#34406
#34407
#34408
#34409

Futher more, it's better to fix format errors and make sentences more fluent.

Thanks.
/lgtm
/approve


replayer tool hung progress indicator on subsequent runs?

New to replayer tool and trying to understand it's output on subsequent runs on Alma Linux 8.5 with official MariaDB 10.3.34 YUM repo installed server.
Enable slow query log
SLOWLOG=$(mysqladmin var | grep slow_query_log_file | awk '{ print $4}')
echo $SLOWLOG
# set long query time
secs=1; mysql -e "SET GLOBAL long_query_time=$secs; SELECT @@GLOBAL.long_query_time;"
mysql -e "SET GLOBAL log_queries_not_using_indexes=1; SELECT @@GLOBAL.log_queries_not_using_indexes;"

# enable
mysql -e "SET GLOBAL slow_query_log=1; SELECT @@GLOBAL.slow_query_log;"

Using this in my slow query log
/usr/sbin/mysqld, Version: 10.3.34-MariaDB (MariaDB Server). started with:
Tcp port: 3306  Unix socket: /var/lib/mysql/mysql.sock
Time                Id Command  Argument
# Time: 220504 12:46:40
# User@Host: root[root] @ localhost []
# Thread_id: 59  Schema:   QC_hit: No
# Query_time: 0.000563  Lock_time: 0.000137  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
SET timestamp=1651682800;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';

digest output
digest -f $SLOWLOG -k mariadb
INFO[0000] cache found: /var/lib/mysql/slowq.log.cache. Trying to restore it
ERRO[0000] cannot restore cache: hashes does not match, log file must have changed since cache creation
WARN[0000] continuing without cache
INFO[0000] cache will not be used
INFO[0000] log file has 10 lines
INFO[0000] digest duration: 144.643µs
INFO[0000] parsed 1 queries
INFO[0000] found 1 different queries hashs

=-= Server meta =-=

Binary              : /usr/sbin/mysqld
Port                : 3306
Socket              : /var/lib/mysql/mysql.sock
Version             : 10.3.34-MariaDB
Version short       : 10.3.34
Version description : MariaDB Server

Digest duration     : 144.643µs
Real duration       : 0s

Bytes handled       : 85

=-= Queries stats =-=

Sorted by: random, increasing
Showing top 3 queries

Query #1
Calls                  : 1
Hash                   : d329bd02c28b7aed6f1f1bc0936dec9c
Fingerprint            : select from_unixtime(unix_timestamp() - variable_value) as server_start from information_schema.global_status where variable_name = ?;
Schema                 :
Min/Max/Mean time      : 563µs/563µs/563µs
p50/p95                : 563µs/563µs
Concurrency            : +Inf%
Standard deviation     : 0s
Cum Query Time         : 563µs
Cum Lock Time          : 137µs
Cum Bytes sent         : 85
Cum Rows Examined/Sent : 1/1
Cum Killed             : 0

INFO[0000] saving results in cache file
ERRO[0000] cannot save results in cache file: json: unsupported value: +Inf

and replayed 1st run gives
replayer -u $DBUSER -password $DBPASS -h ${DBIP}:${DBPORT} -k mariadb -f $SLOWLOG -db $DBNAME
INFO[0000] getting real execution time
INFO[0000] 100 workers will be created
WARN[0000] replaying with dry run
INFO[0000] replay started on Wed May 4 12:49:09
INFO[0000] estimated time of end: Wed May 4 12:49:09
1 / 1 [▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉] ? p/s 0s 100.00%
INFO[0000] replay ended on Wed May 4 12:49:09

=-= Results =-=

Replay duration:  1.03876ms
Real duration:    0s
Log file:         /var/lib/mysql/slowq.log
Dry run:          true
Workers:          100

Database
  ├─ kind:      mariadb
  ├─ user:      root
  ├─ use pass:  false
  └─ address:   <IP_ADDRESS>:3306

Statistics
  ├─ Queries:                1
  ├─ Errors:                 0
  ├─ Queries success rate:   100.0000%
  ├─ Speed factor:           1.0000
  ├─ Duration difference:    n/a
  └─ Replayer speed:         -+Inf%

Note: the replayer may take a little more time due to the numerous conditions that are verified during the replay.

But on 2nd run, it shows a progress indicator that just sits there doing nothing in a hung state? Look at estimated time of end ~16 mins later? Why taking 16 mins?
replayer -u $DBUSER -password $DBPASS -h ${DBIP}:${DBPORT} -k mariadb -f $SLOWLOG -db $DBNAME
INFO[0000] getting real execution time
INFO[0000] 100 workers will be created
WARN[0000] replaying with dry run
INFO[0000] replay started on Wed May 4 13:06:47
INFO[0000] estimated time of end: Wed May 4 13:22:26
1 / 5 [▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ ............................................................................................................................................................] ? p/s ? 20.00%

Or is this due to my slow query logging settings also logged the replay queries in slow query log so it's going in a loop?
digest -f $SLOWLOG -k mariadb
INFO[0000] cache found: /var/lib/mysql/slowq.log.cache. Trying to restore it
ERRO[0000] cannot restore cache: hashes does not match, log file must have changed since cache creation
WARN[0000] continuing without cache
INFO[0000] cache will not be used
INFO[0000] log file has 39 lines
INFO[0000] digest duration: 369.863µs
INFO[0000] parsed 5 queries
INFO[0000] found 2 different queries hashs

=-= Server meta =-=

Binary              : /usr/sbin/mysqld
Port                : 3306
Socket              : /var/lib/mysql/mysql.sock
Version             : 10.3.34-MariaDB
Version short       : 10.3.34
Version description : MariaDB Server

Digest duration     : 369.863µs
Real duration       : 15m39s

Bytes handled       : 425

=-= Queries stats =-=

Sorted by: random, increasing
Showing top 3 queries

Query #1
Calls                  : 4
Hash                   : d329bd02c28b7aed6f1f1bc0936dec9c
Fingerprint            : select from_unixtime(unix_timestamp() - variable_value) as server_start from information_schema.global_status where variable_name = ?;
Schema                 : replaydb
Min/Max/Mean time      : 383µs/563µs/439µs
p50/p95                : 401µs/486µs
Concurrency            : 0.0002%
Standard deviation     : 72µs
Cum Query Time         : 1.756ms
Cum Lock Time          : 450µs
Cum Bytes sent         : 340
Cum Rows Examined/Sent : 4/4
Cum Killed             : 0

Query #2
Calls                  : 1
Hash                   : d95efba35ea56301bc9a01b3afc88c1c
Fingerprint            : use replaydb;select from_unixtime(unix_timestamp() - variable_value) as server_start from information_schema.global_status where variable_name = ?;
Schema                 : replaydb
Min/Max/Mean time      : 1.654ms/1.654ms/1.654ms
p50/p95                : 1.654ms/1.654ms
Concurrency            : 0.0002%
Standard deviation     : 0s
Cum Query Time         : 1.654ms
Cum Lock Time          : 520µs
Cum Bytes sent         : 85
Cum Rows Examined/Sent : 1/1
Cum Killed             : 0

INFO[0000] saving results in cache file

actual slow query log
/usr/sbin/mysqld, Version: 10.3.34-MariaDB (MariaDB Server). started with:
Tcp port: 3306  Unix socket: /var/lib/mysql/mysql.sock
Time                Id Command  Argument
# Time: 220504 12:46:40
# User@Host: root[root] @ localhost []
# Thread_id: 59  Schema:   QC_hit: No
# Query_time: 0.000563  Lock_time: 0.000137  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
SET timestamp=1651682800;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';
# Time: 220504 13:00:53
# User@Host: root[root] @ localhost [<IP_ADDRESS>]
# Thread_id: 61  Schema: replaydb  QC_hit: No
# Query_time: 0.001654  Lock_time: 0.000520  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
use replaydb;
SET timestamp=1651683653;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';
# Time: 220504 13:01:08
# User@Host: root[root] @ localhost [<IP_ADDRESS>]
# Thread_id: 62  Schema: replaydb  QC_hit: No
# Query_time: 0.000401  Lock_time: 0.000103  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
SET timestamp=1651683668;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';
# Time: 220504 13:01:39
# User@Host: root[root] @ localhost [<IP_ADDRESS>]
# Thread_id: 63  Schema: replaydb  QC_hit: No
# Query_time: 0.000409  Lock_time: 0.000118  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
SET timestamp=1651683699;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';
# Time: 220504 13:02:19
# User@Host: root[root] @ localhost [<IP_ADDRESS>]
# Thread_id: 64  Schema: replaydb  QC_hit: No
# Query_time: 0.000383  Lock_time: 0.000092  Rows_sent: 1  Rows_examined: 1
# Rows_affected: 0  Bytes_sent: 85
SET timestamp=1651683739;
SELECT FROM_UNIXTIME(UNIX_TIMESTAMP() - variable_value) AS server_start FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE variable_name='Uptime';

Guess I should be running replayer against a static slow query log which isn't being written to?

@centminmod thanks for this report !
Yes, replayer won't work with a growing file, since it dies various parsing & calculations to adjust replay speed, etc...
Are you trying to "mirror" queries to another instance ? It should not be hard to create a tool for this.

Yeah it's for replaying queries on a remote server but it doesn't have to be like mirroring. So essentially with your tool I can make a static copy of the slow query log and replay for that.


add not found page

Found this great rubber duck pic that wasn't used anywhere else. Figured a not found page would be a good home for it. 😄
After:

Before:

I approve of this without hesitation. 😆 And kudos for the before and after pics, btw.


Failing to wrap Isaac Gym Preview 4 Environments if No Wrapper Type is Given

Description
When running the getting started tutorial:
import isaacgymenvs

# import the environment wrapper
from skrl.envs.wrappers.torch import wrap_env

# create/load the environment using the easy-to-use API from NVIDIA
env = isaacgymenvs.make(seed=0,
                        task="Cartpole",
                        num_envs=512,
                        sim_device="cuda:0",
                        rl_device="cuda:0",
                        graphics_device_id=0,
                        headless=False)

# wrap the environment
env = wrap_env(env)  # or 'env = wrap_env(env, wrapper="isaacgym-preview4")'

env = wrap_env(env) does not work by default.
What skrl version are you using?
1.2.0
What ML framework/library version are you using?
PyTorch (2.3.1+cu121)
Additional system information
Python 3.8.19 on Linux

Hi @ErcBunny
Fixed in branch toni/update_wrappers to be merge in develop soon
https://github.com/Toni-SM/skrl/blob/d2edbcf0d73b1533a382bb8560869bd1e05f286d/skrl/envs/wrappers/torch/__init__.py#L94-L95

Solved in https://github.com/Toni-SM/skrl/releases/tag/1.3.0


[EA/FA] BilinearFormExtension omitted boundary conditions

I've encountered this issue when using FormSystemMatrix on a Par/BilinearForm using FormSystemMatrix.
The EA/FA extensions fold back to the PA FormSystemMatrix method which does not set properly the boundary conditions on the assembled matrix.
In serial, EliminateVDofs(ess_dofs, Operator::DIAG_KEEP) followed by a Finalize() will add them.
In parallel, https://github.com/mfem/mfem/blob/7e8d8b1d55adecfb46f971300f820bd7e48bdc67/fem/pbilinearform.cpp#L422-L442
would work but it requires to change the extension code path and does not use GPU capabilities.

I'm guessing due to how BilinearForm and LinearForm it wouldn't be possible to emulate how the NonlinearForm handles BCs?
https://github.com/mfem/mfem/blob/7e8d8b1d55adecfb46f971300f820bd7e48bdc67/fem/nonlinearform.cpp#L152-L165
https://github.com/mfem/mfem/blob/7e8d8b1d55adecfb46f971300f820bd7e48bdc67/fem/pnonlinearform.cpp#L89-L94
It's been quite sometime since I looked at how the bilinearform implemented things and trying to figure out why it does what it does, but I know the nonlinearforms should work on the GPU.

@YohannDudouit and @camierjs, is this still an issue?

I believe this has been fixed with https://github.com/mfem/mfem/pull/3056 .

@camierjs, can you confirm ☝

I am still having issues with FormSystemMatrix, the DiagonalPolicy and now EliminateVDofs.
DiagonalPolicy::DIAG_ONE seems to be only supported by FABilinearFormExtension::EliminateBC: only the comment allows to know this and is not checked against the SetDiagonalPolicy of the bilinear form.
EliminateVDofs does not allow to get the same matrices anymore, even with DiagonalPolicy::DIAG_ONE.

We can talk more about it during the PR meeting, but this would require a refactor to take into account the diagonal policy. Here is a temporary fix: https://github.com/mfem/mfem/pull/3127


Current web version seems broken...

We had an issue fixed it now, try it again it should work fine.


All files moved to Hooks

Hi! I have moved to all components to Functional Component with Hooks!

Hello there, @set ,
That is great.
We'll check it a bit later this week and see if we can merge it.
The problem is that there are 258 files changed, and we need to make a thorough check to this PR.
Also, for it to be accepted, you need to point it to the dev-master branch.
Best,
Manu

Hi @EINazare yes that is a problem. I think this is a file system error because there are a lot of files have no different.


4 to 7

➡ Forward port
Port ign-fuel-tools4 (citadel) to ign-fuel-tools7 (fortress)
Branch comparison: https://github.com/gazebosim//compare/<TO_BRANCH>...<FROM_BRANCH>
Note to maintainers: Remember to Merge with commit (not squash-merge or rebase)

CI seems pretty grumpy about this one.  Missing gz-common?

CI seems pretty grumpy about this one. Missing gz-common?

Looks like it needs an ign-common4 release.

@osrf-jenkins run tests.

Looks like it needs an ign-common4 release.

Pretty sure that the one I just got out should have included those headers, we can see what happens with this run of CI.

As discussed in our weekly meeting yesterday, we are still seeing timeouts in the gz_src test and the FuelClient test.
@nkoenig Do you expect those to be resolved with this PR or is there a follow-up coming?

I have moved the models and worlds under test to the openroboticstest organization, and reduced their file size to a few kilobytes. The tests still take an order of magnitude longer on github actions, so I extended the time limit for these test to 500 seconds.


More types

Adds missing atomic types double, float, short & long to YAML along with unit tests.

Is there no new tests to confirm the functionality?
I see a test data file, but not test classes. That is for the JSON support part

Already added in the commit
https://github.com/kb-dk/kb-util/pull/3/commits/0d61d47f716ff8de7cc71787855bc26996dddffb


Show number of data points for each semiology in the table

Rachel suggested this, and I think it's a good idea.
For each semiology, a column can be added to the table showing the raw numbers for each structure.

related to pull request #108 as returns the stats

Hmm I meant showing the data frame returned by semiology.get_df_from_semiologies, i.e. before normalising and combining.

Is this for semiology combinations only? I thought you meant next to the checkboxes

I'll implement it and upload a figure here to show what I mean.

Voilà:

@neurokleos

I'll merge this now, as well as the paediatric filter. We can revert stuff later if necessary.

cool.
just an improvement: don't do this for single semiologies.

Done in 9922a1b.


Change ApplicationServer#environment to #logLevel

Change the ApplicationServer#environment property to #logLevel and specify log level values which are permitted:
https://github.com/kixxauth/kixx/blob/main/framework/core/application-server.js#L38-L40

closing as no longer relevant


setup.py file execution raises an error during python package installation with Jfrog rt pip-install

Describe the bug
We are performing our Continuous Integration on Jenkins and we installed the Jfrog client on our agents (version 1.44).
When we install a python package with Jfrog-cli, the client tries to execute the Setup.py file located at the root folder of the project and that raises an error in our jobs. Is this a bug?
How can download packages without the setup.py file being executed?
Are we using properly jfrog-cli?
If we indicate the modul name with "jfrog rt pip-install --no-cache-dir --force-reinstall requests --module=module-name" it works. Is it the right usage (specify the module name ti pipi)?
Expected behavior
The package installation should complete without having to move the setup.py file from the project root to another folder.
Screenshots
Here is the project tree:
______Jenkinsfile
|
|______setup.py
Here are the steps to download the python packages in the Jenkinsfile. We instantiate a server and we update the version of pip.Tthen we install the “requests” package.

Here are the logs we get when launching the Jenkins job. We created an error in the setup.py file to show that it is executed when downloading the packages. If the error appears in the logs that means the setup.py is executed by the jfrog-cli client. And this is what happens.
2022-01-12 14:11:09  + jfrog rt pip-install --no-cache-dir --force-reinstall requests
2022-01-12 14:11:09  [Info] Running pip Install.
2022-01-12 14:11:10  Looking in indexes: https://:@artifactoryURL
2022-01-12 14:11:10  Collecting requests
2022-01-12 14:11:10    Downloading https://artifactoryURL/requests-2.27.1-py2.py3-none-any.whl (63 kB)
2022-01-12 14:11:10  Collecting idna<4,>=2.5
2022-01-12 14:11:10    Downloading https://artifactoryURL/idna-3.3-py3-none-any.whl (61 kB)
2022-01-12 14:11:10  Collecting charset-normalizer~=2.0.0
2022-01-12 14:11:10    Downloading https://artifactoryURL/charset_normalizer-2.0.10-py3-none-any.whl (39 kB)
2022-01-12 14:11:11  Collecting certifi>=2017.4.17
2022-01-12 14:11:11    Downloading https://artifactoryURL/certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
2022-01-12 14:11:11  Collecting urllib3<1.27,>=1.21.1
2022-01-12 14:11:11    Downloading https://artifactoryURL/urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
2022-01-12 14:11:11  Installing collected packages: urllib3, idna, charset-normalizer, certifi, requests
2022-01-12 14:11:11  Successfully installed certifi-2021.10.8 charset-normalizer-2.0.10 idna-3.3 requests-2.27.1 urllib3-1.26.8
2022-01-12 14:11:12  Traceback (most recent call last):
2022-01-12 14:11:12    File "/srv/jenkins/workspace/usinelogicielle/private/sandbox/Test-TP-Atrifactory/setup.py", line 14, in
2022-01-12 14:11:12      name=set_name("tp-artifactory"), # Nom sous lequel le package sera distribué
2022-01-12 14:11:12    File "/srv/jenkins/workspace/usinelogicielle/private/sandbox/Test-TP-Atrifactory/setup.py", line 8, in set_name
2022-01-12 14:11:12      raise ValueError('JFROG-CLI execute setup.py')
2022-01-12 14:11:12  ValueError: JFROG-CLI execute setup.py
2022-01-12 14:11:12  [Error] Failed determining module-name from 'setup.py' file: exit status 1
Here is the content of setup.py.

Thanks in advance for your help :)

Hi @usinelogicielle,
Thanks for reporting this issue.
Our apologies for the inconvenience caused by this bug.
We believe that the issue was fixed on jfrog-cli - 2.10.0, so feel free to update the cli version to the latest.
Also, the same fix should be released for jfrog-cli V1 soon. (jfrog-cli-core PR) [https://github.com/jfrog/jfrog-cli-core/pull/283].
Looking forward to your feedback on it.

Hi @usinelogicielle,
JFrog CLI 1.53.0 is released and should fix the above issue.
Looking forward to your feedback on it.

Hello,
Thanks for your reply, I will test the new version and give you my feed back as soon as possible :)

With JFrog CLI 1.53.0 (V1) the issue is fixed.
Thank you !


Enable to create embed.

After installing the plugin, I try to create an embed message. After several tests (even with the json provided as an example) I still have these two messages in my debug console.

Node-Red V2.1.4
Node V16

This is my bad for not updating the documentation, sorry! The new version of discord handles embeds a bit different. Instead of the embed being the full message it's something you add to a message. Therefore you can now always have the msg.payload be some kind of text and add embeds to it.
To send an embed now you'll have to set msg.embed to the embed object or an array of objects.

This is my bad for not updating the documentation, sorry! The new version of discord handles embeds a bit different. Instead of the embed being the full message it's something you add to a message. Therefore you can now always have the msg.payload be some kind of text and add embeds to it.
To send an embed now you'll have to set msg.embed to the embed object or an array of objects.


mark tw_error as noreturn?

__attribute__((noreturn)) in gcc/clang. I'm sure there's a similar if not the same syntax in xlc/pgi/icc, but I haven't checked yet. Could always wrap it in a macro that checks against GNUC or clang. Convenient for not having to use placeholder return's in control flows that end in a tw_error, ie
int foo(int bar) {  if (bar < 0) tw_error(TW_LOC, "oh noes!!!"); else return bar+1; }

tw_error() is marked noreturn -- see line 185.
NORETURN is similarly defined in ross.h.
Of course, I don't see support for any other compilers in the macro...

Hmm, so it is - I'll double check how I'm compiling...


It would be good to add a plugin to powertools run that has ai like Copilot Ai.

Description of the new feature / enhancement
It is when you search a question and it says an answer by an AI.
Scenario when this would be used?
When you need to use AI for something quick.
Supporting information
No response

/dup https://github.com/microsoft/PowerToys/issues/23143


Drafts for View

Implement the HTML structure for every page of the social media platform:

[ ] Feed (For you page, show posts)

[ ] Index (Show posts)
[ ] Notifications (Show all notifications)

[ ] Profile

[ ] Show (Display any given user)
[ ] Edit (Edit only the current user)
[ ] Friendlist (Display all friends of a user)

[ ] Account

[ ] Login (Form for login)
[ ] Register (Form for register)

[ ] Chat

[ ] Index (Show all conversations)
[ ] Conversation (Access a specific conversation and chat)

Note: Add more sections or pages as needed!

 Set up all models, controllers, views


SLA/ToU Updates: Clarify expectations and responsibilities

Updates in order of priority:
1- Not manipulating JSON files ✅
2- Clarify timelines for data download
3- Clarify responsibility for PB data transfer ✅
4- Abandoned forms/accounts
https://docs.google.com/document/d/1N53LZ7rEmCdoOdA4wbsY9-_REbR4ZKXRSgISCL4sRpI/edit
Links

Terms of Use
Service-level Agreement
Context

Acceptance criteria:

[x] Content drafted in EN
[x] Reviewed by Policy
[ ] Reviewed by Product
[x] Reviewed by Content
[x] Translated in FR
[x] PR created
[ ] Reviewed by dev and shipped

Updates here: https://github.com/cds-snc/platform-forms-client/pull/3911


Python Samples are not Updated for Python 3. Some dependencies are deprecated.

The samples here are written for python 2 which is deprecated. The samples also depend on the oauth2client library which Google also deprecated.

For context @KevinTydlacka posted a related issue on the google-auth library Issues tracker:
https://github.com/googleapis/google-auth-library-python/issues/456

Hi, Kevin. Thanks for alerting us about this. We're working on rewriting all of our AdSense Management API client library examples, so we'll address these concerns in this rewrite.

The Python examples have been updated to use Python 3, to remove the oauth2client dependency, and to make calls against v2 of the AdSense Management API.
https://github.com/googleads/googleads-adsense-examples/tree/master/v2/python


@Valid constraint not recognised/triggered!

First of all thanks for this bundle, very usefull (it's a time saver :-)).
I have a step form using the "Approach A: One form type for the entire flow" and all works as expected until the validation of the 2° step where I need to validate the RegistrationCompletionDTO:$personalData using the @Valid contraint. But on form submit the error

Expected argument of type "DateTime", "NULL" given

in

at PropertyAccessor ::throwInvalidArgumentException ('Argument 1 passed to My\Bundle\Form\CustomerPersonalDataDTO::setBirthDate() must be an instance of DateTime, null given

tell me that the @Valid constraint annotation was not recognised/triggered (also using the "Default" validation group, instead of "Personal" doesn't resolve the issue).
PS: I posted only the minimal code related to the problem but fell free to ask if you need more.
My RegistrationCompletionFormFlow:
protected function loadStepsConfig()
    {
        $formType = 'My\Bundle\Folder\Form\RegistrationCompletionForm';

        return [
            [
                'label'    => 'data.account_type.label',
                'form_type' => $formType,
                'form_options' => [
                    'validation_groups' => ['AccountType'],
                    'attr' => ['novalidate' => 'novalidate']
                ]
            ],
            [
                'label'     => 'customer.personal_data.label',
                'form_type' => $formType,
                'form_options' => [
                    'validation_groups' => ['Personal', 'MobilePhone'],
                    'attr' => ['novalidate' => 'novalidate']
                ]
            ],
            [
                'label' => 'finish',
            ],
        ];
    }

My RegistrationCompletionForm:
public function buildForm(FormBuilderInterface $builder, array $options)
    {
        switch ($options['flow_step']){
            case 1:
                $builder
                    ->add('accountType', EntityType::class, [
                        'label' => false,
                        'class'         => AccountType::class,
                        'query_builder' => function (EntityRepository $er) {
                            return $er
                                ->createQueryBuilder('a')
                                ->where('a.enabled = :enabled')
                                ->setParameter('enabled', true)
                            ;
                        },
                        'choice_label' => 'getNameByLocale',
                        'expanded'          => true,
                        'multiple'          => false,
                    ]);
            break;
            case 2:
                $builder
                    ->add('personalData', CustomerPersonalDataForm::class, [
                        'label'      => false,
                        'data_class' => CustomerPersonalDataDTO::class
                    ])
                    ->add('phoneMobile', PhoneNumberType::class, [
                        'label'          => 'data.phone_mobile.label',
                        'default_region' => $isoCode2,
                        'format'         => PhoneNumberFormat::NATIONAL
                    ])
                ;
            break;
        }
    }

    public function configureOptions(OptionsResolver $resolver)
    {
        $resolver
            ->setDefaults([
                'data_class'         => RegistrationCompletionDTO::class,
                'translation_domain' => 'app',
                'csrf_protection'    => true,
                'csrf_field_name'    => '_token',
                'csrf_token_id'      => 'registration_completion_form',
                'method'             => 'POST',
            ])
        ;
    }

My RegistrationCompletionDTO:

use Symfony\Component\Validator\Constraints\Valid;

/**
     * @var AccountTypeInterface
     *
     * @NotBlank(
     *     message="global.constraint.not_blank",
     *     groups={"AccountType"}
     * )
     * @AccountTypeField(
     *     message="data.account_type.invalid",
     *     groups={"AccountType"}
     * )
     */
    private $accountType;

    /**
     * @var CustomerPersonalDataDTOInterface
     *
     * @Valid()
     */
    private $personalData;

    /**
     * @var PhoneNumber
     *
     * @NotBlank(
     *     message="global.constraint.not_blank",
     *     groups={"MobilePhone"}
     * )
     * @CustomerPhoneUnique(
     *     message="data.phone_mobile.unique",
     *     groups={"MobilePhone"}
     * )
     */
    private $phoneMobile;

    # getters and setters...

My CustomerPersonalDataDTO:
/**
  * @var string
  *
  * @NotBlank(
  *     message="global.constraint.not_blank",
  *     groups={"Personal"}
  * )
  * @Type(
  *     type="string",
  *     message="global.constraint.type_string",
  *     groups={"Personal"}
  * )
  * @Length(
  *     min=2,
  *     max=30,
  *     minMessage="global.constraint.length_min",
  *     maxMessage="global.constraint.length_max",
  *     groups={"Personal"}
  * )
  */
 private $firstName;

 /**
  * @var \DateTime
  *
  * @NotBlank(
  *     message="global.constraint.not_blank",
  *     groups={"Personal"}
  * )
  * @Date(
  *     message="field.date.invalid",
  *     groups={"Personal"}
  * )
  */
 private $birthDate;

 # other properties...

How can I resolve this issue?
I'm forced to use the "Approach B: One form type per step" because the @Valid constraint it's simply not supported or there is something I've missed?
Thanks for your time.

Just read the docs. 😏

Thanks for the fast reply Craue!
I've already readed it carefully many times in the last 2 days but I was not be able to get the point.
I've used the form_options to add the a specific validation group for each step and I've also tried to use flow_registrationCompletionForm_step2 (obviously changing the DTO's properties) as written in the docs but without success (I never saw where is my error).
PS: I'm not a native english speaker and maybe is for this that I cannot see it. I really would like to find the error myself but I think I need a clue :-)

Could you set up a fork of the Symfony Standard Edition to demonstrate the issue?

As you suggested I've spent other time reading again the "Validation groups" section and the whole documentation (insieme)  to try to find and then trying to use the auto generated validation group for the flow. But the auto generated flow_registrationCompletionForm_step2 validation group added to the properties of the CustomerPersonalDataDTO did not were recognised at all. Same behavior If I use the form_options to add a custom validation group for each step as described by the docs. I really don't understand where is the problem because I followed exactly what described in the docs. I'll appreciate if someone could point me in the right direction to let me see where is the error. PS: I will do the fork tomorrow :-)

Hi @craue ! I've directly created a new project using a fresh new Symfony 3.2.* installation + your bundles. I've added only the files necessary to reproduce the error. You will find the project at CraueFormFlowTest. The same error happens again when you try to submit the 2 step of the form. Let me know if you need something more.

The setter public function setBirthDate(\DateTime $birthDate) must allow a null value as well. The model is first populated with data and validated afterwards. So change this to public function setBirthDate(\DateTime $birthDate = null).

And to think that today, before leaving home, I wanted to do that test. I don't know why I always thought that the validation is performed directly on the data passed by the form without binding it to the model. Sorry!


Circle CI & Update to Swift 1.2

Includes #53

Uh, so this went straight into master, hm?!

Oh, that was not intended. I'll make a release.


Removed be-config

Pull Request Test Coverage Report for Build 993908443

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.552%

Totals

Change from base Build 993881603:
0.0%

Covered Lines:
49

Relevant Lines:
52

💛  - Coveralls


Bump puppet to 8

Adds support for Puppet 8.

Any updates on this?

This has been addressed in https://github.com/puppetlabs/puppetlabs-facts/pull/63


Enable Jenkins coverage and test reports

Line coverage is evaluated incorrectly (includes aspects of branch coverage). We cannot work with this.


Fail on invalid token when checking multiple OR security schemes

Fixes #1767

coverage: 94.236% (-0.001%) from 94.237% when pulling 4711dc241c9551f5d6b1ed83a8ca75d492203b4c on bugfix/or-security into d972eae8642be6a3c1dfb92e1cb091726d1f5225 on main.

I'm not sure whether this prohibits some valid options.
If you have 2 different OAuth2 providers for example (which I believe is valid), both using the Authorization: Bearer header/format, this will no longer be possible.

Hmm interesting, I didn't think of that.

So I'm thinking we need to make it optional to "stop early" in the security checking, e.g. by making a special exception that basically wraps the real exception you want to throw. Then we can catch that specific one and fail early in that case, otherwise we continue and evaluate at the end.

I think we can maybe still generalize it in the following way: "If a known security token is included in the request, it should be valid against at least one of the schemes".
Maybe an implementation like this could work (pseudo):
valid_tokens = {}
invalid_tokens = defaultdict(list)

token_info = NO_VALUE
for func in auth_funcs:
    token_name = auth_func.token_name
    try:
        token_info = func(request)
        while asyncio.iscoroutine(token_info):
            token_info = await token_info
        if token_info is not NO_VALUE:
            valid_tokens[token_name] = token_info
    except Exception as err:
        invalid_tokens[token_name].append(error)

if not valid_tokens:
        logger.info("... No auth provided. Aborting with 401.")
        raise OAuthProblem(detail="No authorization token provided")

for token, errors in invalid_tokens.items():
    if token in valid_tokens:
        continue
    else:
        cls._raise_most_specific(errors)

# TODO: Combine valid token_infos like with multiple AND schemes

That sounds like a valid approach. I don't know how multiple security schemes can be handled properly here though, as the auth_funcs can be a verify_multiple_schemes function, so can be mapped to multiple token names


Crop method throws

Last working version was 1.0.18, but after that version, the following call throws:
const superCropper = new SuperImageCropper()

superCropper.crop({
	cropperInstance: cropper, // ReacterCropper instance
	src: 'https://placehold.co/600x400.png',
	cropperJsOpts: { background: '#fff' },
	gifJsOptions: { transparent: null },
	outputType: 'base64',
	crossOrigin: 'anonymous',
})

Here's a code playground (https://playcode.io/2037874), click the crop button and see the error in the console.
error {
  bubbles: false
  cancelBubble: false
  cancelable: false
  composed: false
  currentTarget: null
  defaultPrevented: false
  eventPhase: 0
  explicitOriginalTarget:
  isTrusted: true
  originalTarget:
  returnValue: true
  srcElement:
  target:
  timeStamp: 6264
  type: "error"
  <get isTrusted()>: function isTrusted()
}

I'll take a look at this issue.

The bug has been fixed, and the fix version is 1.0.22.


First cut at repl

I ended up doing the changes myself, was too enthousiastic and couldn't resist tinkering with it myself.. merging it in now.


Pretrained checkpoint for QG

Hi,
Thank you for sharing your amazing work. The repository is very clean and the instructions are easy to follow.
I see that you have recently uploaded the pretrained checkpoint for QQP. Would it be possible to obtain the pretrained checkpoint for the Quasar-T dataset too?
Thank you!

Hi, link is updated


Uniform Block Names

I'm a bit frustrated that sokol_gfx doesn't have uniform block names listed in the struct sg_shader_uniform_block_desc. This means the only way to get a uniform block's slot is by using the reflection functions, which I had hoped I could avoid.

The optional reflection functions will basically be the only reliable way to lookup 'shader desc slots' by name, while the any 'human readable' reflection information in the shader-desc struct might change as needed.
Strings are only embedded in the shader desc structs when required by a sokol-gfx backend to setup the shader objects (that's mostly the case for the GL backend, but also for D3D11 vertex attribute semantic names), but these details may change, since more modern 3D APIs moved from 'lookup by string' to implicit slot indices.
For instance now that the GLES2 backend has been dropped, sg_shader_attr_desc.name will most likely be removed too at one point.
That's also why uniform block names are not included in the shader desc. D3D11 and Metal don't identify uniform blocks by name, but by slot indices, and in the GL backend, there is no concept of 'uniform blocks' at all, because they are disolved into direct uniforms.

Thank you for the explanation. Caching the slots seems to eliminate the downsides of using the reflection functions in my case.


road map (what features should go into the MVP)

This issue is to track/debate which features will go into the MVP.
We can also decide what to do immediately after releasing the MVP.
@arowM wrote the following https://github.com/arow-oss/goat-guardian/issues/2#issuecomment-402017450:

I have a question.
What do you planing to do just after MVP release?
Just publishing to hackage (and stackage), or also posting to reddit (and/or any service)?
The requirements for MVP is various depending on the perspective.

My response is as follows:
I was definitely planning on publishing goat-guardian to hackage when we have a reasonable feature-set.  I think it would also be a good idea to add a post to the ARoW blog.  I think it might be a good idea to post to reddit because people there might find it interesting.  However, it might make sense to hold off until we have more features.

Thanks for creating the issue.
I think the word "MVP" is similar to "Proof of concept", so it should gather some feed backs by other people.
From this point of view, it is recommended to consider what feed backs should we get.
If it is about vulnerabilities, we might have to implement email auth, e.g., password reset, changing password,..., which I guess easily causes vulnerabilities.

@arowM I was thinking that "MVP" meant goat-guardian would provide a minimum amount of features that would be actually useful.  So it would provide just enough features for us to be able to use it on our next project, but no more.  Ideally it would also be useful for other people as well (not just us).  I was thinking that goat-guardian would still be useful to us (and other people) even if it did not do email-based authentication.
However, if you're thinking it would be a better idea to just do a "proof of concept" in order to get some feedback about potential vulnerabilities, then maybe we should focus on that instead.
If we want to get feedback on potential vulnerabilities, then I think it is worth it to implement email-based authentication before doing other issues.
What do you think?  Should we aim for more of a "proof of concept"?  Or should we continue working towards more of an "MVP"?

I got it.
There are two problems about "MVP".

The next our project does not use twitter auth but facebook auth
(so what we creating is not the "MVP" actually...)
The importance of goat guardian is larger than our next project
(so "MVP" is not as important as "Proof of concept")

So, I guess it is better to think about "Proof of concept" rather than "MVP".
Here is my thoughts about our load map (just an idea):
i. release goat guardian and obtain feed backs
ii. enhance Tonatona
iii. fix goat guardian by feed backs
iv. our next project
v. fix goat guardian by feed backs from our next project

Okay, this sounds good.  I'll go ahead and add a "proof of concept" milestone.
I'll assign things to "proof of concept" vs "MVP" vs "after MVP" as I see fit when creating an issue, but please feel free to change the assignment if you think something should go somewhere else.

In your thought, which order to handle these milestones?
Is "MVP" after "proof of concept"?

I'm sorry, I should have specified that.
I think that the "proof of concept" comes before the "MVP".
I've registered 3 milestones on GitHub.  I think they should be done in this order:

proof of concept
MVP
after MVP

I have basically finished the email authentication code from #2.  It is working well enough for a proof-of-concept (although the error cases and routing are not being handled very well).
With this done, we don't have any more big issues left before the proof-of-concept release.
The only two issues left are the following:

add informative README #13
add a logout handler #8

The logout handler should be very simple to do.
The README will take more time.  We also must decide how much information we want in the README.  I will update #13 with some comments about this.
@arowM, would you be able to take a look at the current code and let me know what you think?  Should we go ahead with the proof-of-concept release?  Or is there more that should be implemented?

One thing I forgot to add:
Should we release goat-guardian to Hackage?  Since goat-guardian uses Tonatona, I guess we should release Tonatona to Hackage before we release goat-guardian.
Is Tonatona in a state where we want to release it to Hackage?  Should I focus on adding more documentation to the Tonatona plugins?

I'll create a library to resolve  an problem that tonatona's default env variables have TT_ prefix..
How about release tonatona and goat-guardian after resolving above tonatona issue?

Goat Guardian should be ready to be released as soon as #28 has been merged in.  There are no other proof-of-concept issues left.


Separate device data generation for JSON paths from get_json_object

Instead of re-generating device data for the same set of JSON paths every time calling get_json_object, we can generate it beforehand, then pass its device pointer(s) into get_json_object, avoiding the overhead of creating the same device data for JSON paths in the long run.

build

build

I spoke with @jlowe and @abellina and I think we have a plan on how to do this for the plugin. I need to talk to @sameerz about priorities/etc.

Close this as it is not practical.


Merger from internal 11/19/2020

Issue #, if available:
Description of changes:
Merger from internal 11/19/2020
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Superseded by #338


Add mobile sdk to price plans

Editor part of https://github.com/CartoDB/cartodb-central/pull/1183
Will split migration in its own PR before merging just in case.

Please CR @juanignaciosl (probably best after the central part)

👍


Launch experiments

Hi,
Thanks for the repo !
I want to reproduce the results of your paper. I see that in main.py you have some hyper-parameters setup depending on the dataset. So in order to reproduce your results (eg on iNaturalist) I just need to run:
python main.py ----dataset Inaturalist

There is no need for other hyper-parameters ?
Do you know how much time each each run take ?
Thanks !

Please take a look at the updated readme. Let me know if there are any additional concerns. Closing for now.

Thanks, I will look into it!


RHIDP-1857: Use the new Events service in the Showcase

Removing references to the deprecated ServiceBroker and importing the new EventsService.
Changes were made based on this documentation: https://github.com/backstage/backstage/tree/master/plugins/events-node

@caponetto as we talked, I removed EventBroker from the orchestrator.

/approve


Inactive delivery services are added to remap.config

Some (maybe all) inactive delivery services (at least ANY_MAP) are added to remap.config. Inactive delivery services should not be in remap.config or any config for that matter.

Moved to: https://issues.apache.org/jira/browse/TC-337


remove bridge pallet since we are not using it

Codecov Report

Merging #203 (2e43f8e) into master (b42a885) will decrease coverage by 1.40%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #203      +/-   ##
==========================================
- Coverage   79.07%   77.67%   -1.41%
==========================================
  Files          60       56       -4
  Lines       17551    16163    -1388
==========================================
- Hits        13878    12554    -1324
+ Misses       3673     3609      -64

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b42a885...2e43f8e. Read the comment docs.


perf: Increase QPS and Burst

Currently, meta controller does not explicitly set  QPS and Burst when it creates its Kube client. The default QPS is 5, this is a bottleneck on deployments where meta controller is serving multiple operators.

@AmitKumarDas can you take a look ?
Ideally it should be configurable but I think it is good as workaround for now.

@omsanchez-iov42 Thanks for the PR.
Can you make it similar to below code?
https://github.com/AmitKumarDas/metac/blob/master/start/start.go#L71-L80
It is about adding two new cli arguments.
I hope to migrate all the new features from metac to this repo so that quick enhancements like these are taken care of during the big migration. cc @grzesuav

:tada: This PR is included in version 0.4.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Unable to run setup.py

I'm getting the following error
`File "./setup.py", line 119
print(str(exc), file=stderr)
SyntaxError: invalid syntax`

Looks like you are using python2 which is no longer supported...
Use python3, such as in:
python3 setup.py
On Sun, Nov 8, 2020 at 12:35, jono20-wq<EMAIL_ADDRESS>wrote:

I'm getting the following error
`File "./setup.py", line 119
print(str(exc), file=stderr)
SyntaxError: invalid syntax`
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.


bug: Ionic2 Phonegap's plugin barcode scanner parameters

Type: bug
Ionic Version: 2.x
Platform: all
I saw in the Phonegab barcode scanner plugin documentation tha tI can set some parameters for the plugin but in the Ionic one i saw nothing.
Is-it possible to set parameters ?
I've tried to do it like in the phonegap's documentation, but keep getting a "Supplied parameters do not match any signature of call target" error so i guess you can't to it like that.
Thank's in advance.
Phonegap's documentation : https://github.com/phonegap/phonegap-plugin-barcodescanner
Ionic 2 documentation : http://ionicframework.com/docs/v2/native/barcode-scanner/

Close and move to ionic-native
Thanks


Authorization: reset password

This is what I expect the reset password endpoint to function. But feel free to add any enhancements if needed.
ResetPassword:
- verify uuid token (if not expired or invalid)
- if not valid send a 403 (Forbidden) status code with “invalid token” message
- update password (hashed password)
- send a 201 status code with “successful” message

How do we know which user to reset the password for if they all have the same username?

ChangePasswordEndpoint

if the user has normal permissions they can only change their own password
if its an admin, they are able to change anybody's password (pass in username and password)


SECURESIGN-842 | Operator's metrics are not consumed by OCP monitor

Testing
To test this, you just need to build and deploy the operator, you should see a new target being created under Observe -> Targets called rhtas-operator-controller-manager-metrics-monitor, you should then be able to query the metrics of the operator.

@osmman @bouskaJ Quick question, I have been thinking about this a bit, like with the ci we needed to install Prometheus prior to installing the operator so it has a definition of the service monitor type, will this cause an issue? I believe it will, as it would fail to install on clusters without an install of Prometheus.
Instead should this be tied to the securesign resource, as in:
spec:
  monitoring:
    enabled: true
  rekor:
    externalAccess:
    ......

then if enabled create the service monitors, service etc ?

/retest

@osmman @bouskaJ Quick question, I have been thinking about this a bit, like with the ci we needed to install Prometheus prior to installing the operator so it has a definition of the service monitor type, will this cause an issue? I believe it will, as it would fail to install on clusters without an install of Prometheus.
Instead should this be tied to the securesign resource, as in:
spec:
  monitoring:
    enabled: true
  rekor:
    externalAccess:
    ......

then if enabled create the service monitors, service etc ?

I think that at this moment we can live with it, for example a lot of operators depends on cert-manager to make their admission webhooks to work correctly. So unfortunatly right not it is prerequisity. Definatly it will be prefered to make it optional.
/lgtm

@osmman Can I get another /lgtm pls :)


Remove the nerf to zak droprate per cl

https://discord.com/channels/342983479501389826/792691343284764693/1094303168277528696
https://discord.com/channels/342983479501389826/792691343284764693/1094302724142669834
3 zaks are needed per player. Maybe zak could get rarer after 3?

Done in next update as discussed


N's don't get removed, trimming read quality

Hi,
I'm just trying out skewer on some 2 x 150bp Nextera Mate pair reads (sequenced on a NextSeq) from a endophyte (fungus), so forgive me if I've setting something wrong.
In one of the raw read files, I found a large number of N sequences.
$ zgrep NNNNNNNNNNNNNNNNNNNNNNN  S1_L001_R1_001.fastq.gz | wc -l
332915

So using mostly default settings, I ran skewer as follows:
ADAPTER_3PRIM="GATCGGAAGAGCACACGTCTGAACTCCAGTCAC"
ADAPTER_5PRIM="GATCGGAAGAGCGTCGTGTAGGGAAAGAGTGT"
ADAPTER_JUNCTION="CTGTCTCTTATACACATCTAGATGTGTATAAGAGACAG"
OPTIONS="-m mp -k 9 -f sanger -Q 20 -n -t 4 -z"

skewer-0.1.123-linux-x86_6 -x ${ADAPTER_3PRIM} -y ${ADAPTER_5PRIM} -j ${ADAPTER_JUNCTION} ${OPTIONS} S1_L001_R1_001.fastq.gz S1_L001_R2_001.fastq.gz -o S1_L001_001_skewer

Checking the log we have:
COMMAND LINE:   skewer-0.1.123-linux-x86_64 -x GATCGGAAGAGCACACGTCTGAACTCCAGTCAC -y GATCGGAAGAGCGTCGTGTAGGGAAAGAGTGT -j CTGTCTCTTATACACATCTAGATGTGTATAAGAGACAG -m mp -k 9 -f sanger -Q 20 -n -t 4 -z S1_L001_R1_001.fastq.gz S1_L001_R2_001.fastq.gz -o S1_L001_001_skewer
Input file:     S1_L001_R1_001.fastq.gz
Paired file:    S1_L001_R2_001.fastq.gz
trimmed:        S1_L001_001_skewer-trimmed-pair1.fastq.gz, S1_L001_001_skewer-trimmed-pair2.fastq.gz

Parameters used:
-- 3' end adapter sequence (-x):        GATCGGAAGAGCACACGTCTGAACTCCAGTCAC
-- paired 3' end adapter sequence (-y): GATCGGAAGAGCGTCGTGTAGGGAAAGAGTGT
-- junction adapter sequence (-j):      CTGTCTCTTATACACATCTAGATGTGTATAAGAGACAG
-- maximum error ratio allowed (-r):    0.100
-- maximum indel error ratio allowed (-d):      0.030
-- mean quality threshold (-Q):         20
-- minimum read length allowed after trimming (-l):     18
-- file format (-f):            Sanger/Illumina 1.8+ FASTQ
-- minimum overlap length for junction adapter detection (-k):  9
-- number of concurrent threads (-t):   4
Thu May  7 09:23:41 2015 >> started

Thu May  7 09:26:44 2015 >> done (183.298s)
5780103 read pairs processed; of these:
  16577 ( 0.29%) degenerative read pairs filtered out
  13690 ( 0.24%) read pairs filtered out by quality control
 106181 ( 1.84%) non-junction read pairs filtered out by contaminant control
  14878 ( 0.26%) short read pairs filtered out after trimming by size control
 221913 ( 3.84%) empty read pairs filtered out after trimming by size control
5406864 (93.54%) read pairs available; of these:
  86780 ( 1.60%) trimmed read pairs available after processing
5320084 (98.40%) untrimmed read pairs available after processing

However, the resulting trimmed file still contains large numbers of NNNN's.
$ zgrep NNNNNNNNNNNNNNNNNNNNNNNNN S1_L001_001_skewer-trimmed-pair1.fastq.gz | wc -l
218901

I've check the documentation and it's no clear as to why there are large runs of N's.
Further, running Fastqc (v 0.11.3) shows there is virtually no difference between the "per base sequence quality" of the raw reads and the trimmed reads (-Q 20), as seen in the raw graph:

Skewer per base quality graph:

Any advice much appreciated.

It seems that the "-Q 20" did not work as expected.
Could you run it again without the parameter "-f sanger"?

Hi Relipmoc,
So I re-run skewer without the "-f sanger" option and there was a major improvement.
$ zgrep NNNNNNNNNNNNNNNNNNNNNNNNN S1_L001_001_skewer-trimmed-pair1.fastq.gz | wc -l
26

The fastqc per-base quality looks better too.

What's the next step?


Angular OnlyOffice Implementation

Hey, I want to implement OnlyOffice into my Angular project but there seems to be no complete implementation on how to use this repo in an application. As the authors, could you please provide me with a well-documented step-by-step implementation guide, either here in the ReadMe or a blog post. Please. Thank you.

There seems to be some documentation here: https://www.npmjs.com/package/@onlyoffice/document-editor-angular but thus far I have been unsuccessful in getting it to work in my project.

Documentation is here
https://github.com/ONLYOFFICE/document-editor-angular-workspace/blob/master/projects/onlyoffice/document-editor-angular/README.md
or here
https://api.onlyoffice.com/editors/angular


update the agent startup script to align with #1474 changes

@rajiesh: Why not use the regular agent startup script itself? That way, it'll grow as needed and will be tested properly. Recently there was a problem that wasn't detected till manual testing, because the regression tests passed and the installers got generated. This was when eval was changed to exec in the agent.sh script.

@arvindsv will do it, have created a issue gocd/functional-tests#4 for the same


Fix/add test-data for local testing UI. Add 5 type of dashboards on gener…

Add test-data for local testing UI. Add 5 type of dashboards on general dashboard. Enable to login as admin on local testing.
All operation are possible only on run UI as 'gulp serve --local true'

Add possibility to open administrator panel and watch all tabs with prepared data.
Add possible ot change theme of application.
Add possible to open 5 type of dashboard from general dashboard. Capone, Caponechatops, Cloud, product-dashboard, splitview
Unlock to use most operations of Hygieia.UI.

@maczernik Thanks for your contribution, Can you confirm if you signed the CLA? You need to sign the CLA for us the accept your changes.

@maczernik Can you fix the LGTM alerts introduced by this PR?

Hi @maczernik it is giving internal errors when navigating through admin access rights.  Also, for administering api tokens, for example, the usernames have special characters, so does not allow editing.  Could you look into this?

@maczernik are you available to make changes for this PR to fix the issues?

I fixed the issues for LGTM but I dot have more time to implement more features for local testing :/ This PR enable to review the UI but there are a lot of work still.

Okay, thanks! I'm going to close the PR for now and you can open it when you are available.


Stuck booting :(

(rebooted after installation)

black screens (not even sending video to my screens) (screen look like to be in sleep mode)

Does your GPU meet the requirements listed here?
https://chimeraos.org/download
On Tue., May 10, 2022, 23:03 Kolhax, @.***> wrote:

black screens (not even sending video to my screens) (screen look like to
be in sleep mode)
—
Reply to this email directly, view it on GitHub
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1123128903,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIWMWAIONZR7JE4DECMDGTVJMPPLANCNFSM5VTM57YQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Does your GPU meet the requirements listed here?
https://chimeraos.org/download
On Tue., May 10, 2022, 23:03 Kolhax, @.***> wrote:

black screens (not even sending video to my screens) (screen look like to
be in sleep mode)
—
Reply to this email directly, view it on GitHub
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1123128903,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIWMWAIONZR7JE4DECMDGTVJMPPLANCNFSM5VTM57YQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Gtx 1060 (6gb)
and tried on: GT 1030 2gb too

both not working

Okay, so the GPU is good.
There have been some reports of the installer failing, but still reporting success.
During the install, does the download process go all the way to 100% and do you see a message about "extracting and installing system image"?

yess

Are you able to access a tty shell with ctrl-alt-f3?
On Wed., May 11, 2022, 08:49 Kolhax, @.***> wrote:

Okay, so the GPU is good.
There have been some reports of the installer failing, but still reporting
success.
During the install, does the download process go all the way to 100% and
do you see a message about "extracting and installing system image"?
yess
—
Reply to this email directly, view it on GitHub
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1123718621,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIWMWC3WVCOVLU2N4RPY4LVJOUFZANCNFSM5VTM57YQ
.
You are receiving this because you commented.Message ID:
@.***>

If you go to our website there is an invitation link to the project
discord. We have a help channel.
On Wed., May 11, 2022, 14:09 Kolhax, @.***> wrote:

cannot test rn, but I'll tell u this in like 4h,add me on dsc: Kepar#0001

Kepar

From: alkazar @.>
Sent: Wednesday, May 11, 2022 1:18:55 PM
To: ChimeraOS/chimeraos @.>
Cc: Kolhax @.>; Author @.>
Subject: Re: [ChimeraOS/chimeraos] Stuck booting :( (Issue #337)
Are you able to access a tty shell with ctrl-alt-f3?
On Wed., May 11, 2022, 08:49 Kolhax, @.***> wrote:

Okay, so the GPU is good.
There have been some reports of the installer failing, but still
reporting
success.
During the install, does the download process go all the way to 100% and
do you see a message about "extracting and installing system image"?
yess
—
Reply to this email directly, view it on GitHub
<
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1123718621
,
or unsubscribe
<
https://github.com/notifications/unsubscribe-auth/AAIWMWC3WVCOVLU2N4RPY4LVJOUFZANCNFSM5VTM57YQ
.
You are receiving this because you commented.Message ID:
@.***>

—
Reply to this email directly, view it on GitHub<
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1124037858>,
or unsubscribe<
https://github.com/notifications/unsubscribe-auth/AWEZWAH6ELXK4ATRRFOM5Z3VJPTX7ANCNFSM5VTM57YQ

.
You are receiving this because you authored the thread.Message ID:
@.***>

—
Reply to this email directly, view it on GitHub
https://github.com/ChimeraOS/chimeraos/issues/337#issuecomment-1124119999,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIWMWE64GPRQRYAUN7ACKLVJPZVBANCNFSM5VTM57YQ
.
You are receiving this because you commented.Message ID:
@.***>


Update event identifier

In the admin of this app, when adding more than one event we were running into an integrity error. In this PR we also fix a setting for sql_mode due to a warning we received when migrating.

@ldko @somexpert This is ready for review.


Fix: typo in the YAML cloudformation template

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Fixing typo in the fields description of YAML files.


Fix loading ABIs built by Truffle

These ABI files will be a map with a contractName and abi field,
rather than an array of type, function and event definitions.
If this is the case, we now load from the abi field, otherwise
we stick to the top level array.

@leodasvacas I've reworked the PR a little. Can you look again?


log_alpha v.s. alpha for entropy loss calculation

Hi,
Thank a lot for your helpful implementation!
After checking several SAC repos, I came into a question:
why log_alpha is used (instead of alpha) for entropy calculation as in line 306 of /code/agent.py ?
I found log_alpha seems to be popular in several other SAC repos. However, it seems that alpha is used in line 256 of https://github.com/rail-berkeley/softlearning/blob/master/softlearning/algorithms/sac.py , as it in the original paper.
I also did some personal re-implementation of SAC, and I found both log_alpha  and alpha work.
Do you have any idea about this?

Hello,
@bluecontra have you managed to get an answer to this mystery, I am also confused as to why most pytorch re-implementations online uses log_alpha but the original softlearning repos (tensorflow) seems to use alpha?


Button's do not support Pointer events

I put this together just to show a workaround, but it may give a clue to a real solution too, perhaps.
https://github.com/PurpleKingdomGames/indigo/commit/f3eba3cf9294c1fd097237738c0eab365b73ff11