SimpleSQLGrammar issue with anti slashes at the end of simple quoted string

Search first

[X] I searched and no similar issues were found
related issue : #5674 and associated PR : #5700

Description
Multiple SQL statements with anti slashes In simple quoted string are not splitted as expected.
Steps To Reproduce
Considering this simple sql file :
insert into MY_TABLE(MY_COLUMN) values('\D:\');insert into MY_TABLE(MY_COLUMN) values('D:\');

and this changeset :
databaseChangeLog:
-  changeSet:
    id:  insert-data
    author:  liquibase-docs
    changes:
    -  sqlFile:
        splitStatements:  true
        path:  data/data.sql
        stripComments:  true

Liquibase won't split the 2 statements. It seems not to be a problem for postgresql but it fails for Oracle : ORA-00933: SQL command not properly ended
Expected/Desired Behavior
Multiple statements splitted correctly
Liquibase Version
4.27.0
Database Vendor & Version
Oracle
Liquibase Integration
cli
Liquibase Extensions
No response
OS and/or Infrastructure Type/Provider
No response
Additional Context
UpdateSQL log shows a block of multiple statements :
-- Changeset data/changelog-data.yaml::insert-data::liquibase-docs
SET SEARCH_PATH TO public, "$user","public";

insert into MY_TABLE(MY_COLUMN) values('\D:\');insert into MY_TABLE(MY_COLUMN) values('D:\');

INSERT INTO public.databasechangelog (ID, AUTHOR, FILENAME, DATEEXECUTED, ORDEREXECUTED, MD5SUM, DESCRIPTION, COMMENTS, EXECTYPE, CONTEXTS, LABELS, LIQUIBASE, DEPLOYMENT_ID) VALUES ('insert-data', 'liquibase-docs', 'data/changelog-data.yaml', NOW(), 2, '9:76d7a3a15fd65a8ee3cc5014971c2d31', 'sqlFile path=data/data.sql', '', 'EXECUTED', NULL, NULL, '4.27.0', '4156402276');

Trying to do some debug, here is the result of the parser :
'insert into MY_TABLE(MY_COLUMN) values('\D:\');insert into MY_TABLE(MY_COLUMN) values('D:\');'
    <S_IDENTIFIER>                  : 'insert'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'into'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'MY_TABLE'
    <SYMBOL>                        : '('
    <S_IDENTIFIER>                  : 'MY_COLUMN'
    <SYMBOL>                        : ')'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'values'
    <SYMBOL>                        : '('
    <S_CHAR_LITERAL>                : ''\D:\');insert into MY_TABLE(MY_COLUMN) values(''
    <S_IDENTIFIER>                  : 'D'
    <SYMBOL>                        : ':'
    <SYMBOL>                        : '\'
    <SYMBOL>                        : '''
    <SYMBOL>                        : ')'
    <SYMBOL>                        : ';'

If I remove one specific anti slash, it's ok :
'insert into MY_TABLE(MY_COLUMN) values('\D:');insert into MY_TABLE(MY_COLUMN) values('D:\');'
    <S_IDENTIFIER>                  : 'insert'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'into'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'MY_TABLE'
    <SYMBOL>                        : '('
    <S_IDENTIFIER>                  : 'MY_COLUMN'
    <SYMBOL>                        : ')'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'values'
    <SYMBOL>                        : '('
    <S_CHAR_LITERAL>                : ''\D:''
    <SYMBOL>                        : ')'
    <SYMBOL>                        : ';'
    <S_IDENTIFIER>                  : 'insert'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'into'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'MY_TABLE'
    <SYMBOL>                        : '('
    <S_IDENTIFIER>                  : 'MY_COLUMN'
    <SYMBOL>                        : ')'
    <WHITESPACE>                    : ' '
    <S_IDENTIFIER>                  : 'values'
    <SYMBOL>                        : '('
    <S_CHAR_LITERAL>                : ''D:\''
    <SYMBOL>                        : ')'
    <SYMBOL>                        : ';'

Are you willing to submit a PR?

[X] I'm willing to submit a PR (Thank you!)

I've got some other things I have to look into and get sorted, but I will try to take a look at this as well.
I'm also having some issues with my setup right now so I can't do this, but it might be worth doing a quick test of chging the definition of ESC_ANY_CHAR in the liquibase-standard/src/main/javacc/liquibase/util/grammar/SimpleSqlGrammar.jj file to escape any character OTHER than a single quote (I think < #ESC_ANY_CHAR: "\\" ~["'"] >) and see if the tests still all pass and if your issue is resolved!

 The grammar was designed to thing \' is an escaped quote because apparently MySQL allows that form of quote escaping. However, since Oracle (and I think most other DBs) do not allow that, you have a changeset with valid quoting for Oracle that is parsing incorrectly. Unfortunately, the system right now just has a single grammar that is used for all databases the same way. While I did the work to fix issues in the issue/pr you mentions (which is why I was quick to jump on this), I think the core Liquibase team will need to get involved here to decide how to handle the situation where we have rules lashing across different databases.
If you need a work around in the meantime @jgarec , you can switch your strings to use the oracle q quoting syntax since it will move the \ character away from the ' character
insert into MY_TABLE(MY_COLUMN) values(q'[\D:\]');insert into MY_TABLE(MY_COLUMN) values(q'[D:\]');

Basically, the first ; is ignored because the grammar believes it is part of a string, and is therefore not considered to be an eligible endDelimiter. By using the q quoting syntax, the \ character is moved away from the ' character so that the grammar does not get confused and think the '`' characters are an escaped quote.
Not ideal having to change your code, but wanted to at least provide a work around if you need one!

Hi @jgarec and @jasonlyle88, thank you for reporting this issue and for the insightful discussion.
I could replicate this bug for Oracle, MySQL, MSSQL and PostgreSQL.
It doesn't affect the execution for MSSQL nor PostgreSQL, but it does for Oracle and MySQL.
For MySQL,  \' is processed as the string value of the simple quote, so the statement is considered part of the text. It can be seen by the colours here:

Inverting the order of the statements doesn't fix the problem.
For Oracle, the error is not with the escaped character, but with the statements not being split. Running the generated insert into MY_TABLE(MY_COLUMN) values('\D:\');insert into MY_TABLE(MY_COLUMN) values('D:\'); will output an error: SQL Error [933] [42000]: ORA-00933: unexpected token at or near ;.
However, running either statement separately works with no issues.
@jgarec I see that you're willing to submit a PR. Feel free to do so, and you can ask any questions you may have to our development team. Please include some test cases to verify that the fix doesn't break for other DBs - the 4 I mentioned above would be enough to begin with.
Thank you!
Tatiana

Hello @tati-qalified, yes I was interested to submit a PR but I think it's too complicated for me to fix this.
Maybe it's necessary to have dedicated grammar depending of the dbms ? Not sure this could be handled with the same grammar

Hey @tati-qalified ,
Unfortunately, the problem is more nuanced than your observations. If you take a look at the liquibase-standard/src/main/javacc/liquibase/util/grammar/SimpleSqlGrammar.jj file, you will see that there is a comment talking about the \' escaping:
/* Valid in Postgres and MySQL (if NO_BACKSLASH_ESCAPES not enabled), NOT valid in Oracle or MSSQL */

So MySQL can accept that as a way to escape a single quote (or not) depending on a setting for the database. Unfortunately syntax highlighting isn't a good indicator here.
And while you are correct that the Oracle error being presented is because the statements are not split correctly, you are actually addressing a symptom (the failure to split the statement correctly), and not the root cause. The root cause here is that the parsing engine is not considering the first ; character a delimiter, even though it should be considered a delimiter in this case. The ; character is not considered a delimiter because the parsers believes it is part of a quoted string.
This can be seen if you add @jgarec 's example to the unit tests in the liquibase-standard/src/test/groovy/liquibase/util/grammar/SimpleSqlGrammarTest.groovy file. When I updated this unit test last, I had it output each part that the grammar identifies and what type the parser identifies it as.
For all of these reasons, this is why I suggested the core liquibase team needs to get involved here to decide on a course of action. While the easiest solution is to say that the \' quote escaping mechanism should not be supported, this could cause regression issues for consumers with changesets that worked before with this type of quote escaping that are no longer working.
The more correct, yet more complicated to implement solution, is a grammar that is DBMS aware as I stated above and @jgarec believes may be necessary as well based on his response. But how should this be implemented? Should it be a generic grammar that has overrides just for specific DBMS systems? or should it be fully defined grammars for each DBMS? Or a generic grammar that is used for all DBMS systems unless a full grammar is specifically created for a given DBMS?
With the grammar being a very core part of liquibase, these decisions can have long standing impacts on the product going forward. And while I have worked on this section of the code previously, I am not comfortable making a decision about what could be potentially such a large impact on the product as a whole.
Because of all these reasons, I'd love for the team to have some discussion here and additionally I don't believe the triaged label is appropriate.
Let me know if there are any further questions or concerns!

@jasonlyle88 thank you for your feedback. Firstly I want to reassure you that the triaged label doesn't mean that we are done with this issue - it's just an internal label. We welcome any further discussion regarding this bug.

And while you are correct that the Oracle error being presented is because the statements are not split correctly, you are actually addressing a symptom (the failure to split the statement correctly), and not the root cause.

Yes, I was presenting the problems with the output, that are caused by the bug, as it is a blocker for Oracle. I've found it's useful to mention what databases are affected and how. I apologize if my comment wasn't clear.
Usually the technical details about the fix are discussed in the submitted PR, though I understand if in this case it should happen before submitting it. Our development team is aware of this issue and willing to discuss it further. Let me know if you have any other questions or concerns.
Thank you,
Tatiana


Renaming podspec files so project is working on case-sensitive filesy…

Motivation
pod install is not working on case-sensitive filesystem.
Causing
[!] No podspec found for `AGSAuth` in `../modules/auth`

Description
renaming files

Thank you for contribution! Awesome change.


feat: v1.0.0

Initial release.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@4fef4f9). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master       #1   +/-   ##
=========================================
  Coverage          ?   98.00%
=========================================
  Files             ?        7
  Lines             ?      250
  Branches          ?        0
=========================================
  Hits              ?      245
  Misses            ?        5
  Partials          ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4fef4f9...3a80d84. Read the comment docs.


Update application-gateway-faq.yml

@greg-lindsay

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#sign-off


python gsutil: 4.6 -> 4.22 (and dependencies)

Motivation for this change
Upstream updates.
Things done

[x] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[x] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

you have another PR with python-gflags


Add fromFlakeRoot option, start processes in $FLAKE_ROOT by default.

Maybe warn if $FLAKE_ROOT wasn't found? Not sure how to implement that warn message

Could you state the real-world use case where you need this? Let me think about the problem first, before getting to the solution.

Is this for #25 (which I didn't entirely understand)?
The problem with this PR is that it will work in some cases (eg: devShell), but not in other cases (eg: nix run). Unless you disable auto wiring (#27), don't add packages.* and say "My process-compose configuration is meant to work only in the devShell"

no, it's not for #25.
The problem I encountered: in monorepo I splitted my flake.nix in different files and placed them in subdirectories. For each project I defined custom processes, and, when suddenly PWD changes, this processes doesn't start, e.g.:
./deno/web/web-deno.nix
let
  cwd = "./deno/web";
in
process-compose."dev:web-deno".settings.processes.web = {
  command = "exec deno run -A --node-modules-dir npm:vite";
  working_dir = cwd;
};

in root flake.nix:
imports = with inputs; [
  flake-root.flakeModule
  devenv.flakeModule
  treefmt-nix.flakeModule
  process-compose-flake.flakeModule
  ./deno/api/api-deno.nix
  ./deno/web/web-deno.nix

  ./node/web/web-node.nix
];

I'm not sure, but maybe in case of nix run it will by default run in place, where flake.nix is located?

So it is a devShell only process?
One way to solve this is to use it in combination with https://github.com/Platonic-Systems/mission-control which does support FLAKE_ROOT (unless cdToProjectRoot is set to false). Eg.: https://github.com/nammayatri/nammayatri/blob/493302e23ca968146eaaf90a7b8908057faab688/Backend/nix/scripts.nix#L40-L76
Is this solution sufficient?

I'm not sure, but maybe in case of nix run it will run by default in place, where flake.nix is located?

You can run nix run github:MrFoxPro/somerepo from anywhere with no source checked out. If there is a flake package or app, in general we would expect it to work without requiring the source tree.

So it is a devShell only process?
One way to solve this is to use it in combination with https://github.com/Platonic-Systems/mission-control which does support FLAKE_ROOT (unless cdToProjectRoot is set to false). Eg.: https://github.com/nammayatri/nammayatri/blob/493302e23ca968146eaaf90a7b8908057faab688/Backend/nix/scripts.nix#L40-L76
Is this solution sufficient?

Not sure, I took process-compose especially to run multiple commands in parallel.

I'm not sure, but maybe in case of nix run it will run by default in place, where flake.nix is located?

You can run nix run github:MrFoxPro/somerepo from anywhere with no source checked out. If there is a flake package or app, in general we would expect it to work at runtime without requiring the source tree.
Yeah, if you mean that running package that is produced by config.process-compose.<name>.outputs.package, I can also add inPureEvalMode, but.... I'm stuck. Maybe I should use composing devshells, but I can't imagine how to do it when devenv is configured in flake.nix

Not sure, I took process-compose especially to run multiple commands in parallel.

It does.
Here's a simple example https://github.com/srid/ema-template/blob/master/flake.nix
Line 55 defines the process-compose group.
        process-compose.run = {
          tui = false;
          settings.processes = {
            haskell.command = "ghcid";
            tailwind.command = "${lib.getExe pkgs.haskellPackages.tailwind} -w -o ./static/tailwind.css './src/**/*.hs'";
          };
        };

Then line 82 uses it from mission-control,
          run = {
            description = "Run the dev server (ghcid + tailwind)";
            exec = config.process-compose.run.outputs.package;
          };

That last part provides , run command in devShell, which you can run from any subdirectory; it will always cd to flake-root.
Let me think about this. Meanwhile, your PR can be improved to directly use the package as well, cf. https://github.com/srid/proc-flake/blob/676b5af467e52c06aa8a9165edb3345c6dbbabde/flake-module.nix#L53-L54

Maybe I should use composing devshells, but I can't imagine how to do it when devenv is configured in flake.nix

Is your flake.nix available somewhere publicly?

Yep, so mission-control could be used together. Nice!
Thanks, I opened here:
https://github.com/MrFoxPro/sferadel/blob/dev/flake.nix
https://github.com/MrFoxPro/sferadel/blob/dev/deno/web/web-deno.nix

Nushell supports this: with-env { PWD: "/home/foxpro/craft/sferadel/next/deno" } { ls }
Not sure how to implement it in other shells

I mean, how it's supposed to work outside of devshell anyway? Does process-compose use $(dirname "$0") or something to locate it current root, and then resolve relative working_dir against that root?

I can do this:
${if !lib.inPureEvalMode && config.fromFlakeRoot then "[[ -n $FLAKE_ROOT ]] && cd \"$FLAKE_ROOT\"" else "echo 'Warning: $FLAKE_ROOT' is not defined, script will start agains you current CWD" }

Let me think about this. Meanwhile, your PR can be improved to directly use the package as well, cf. https://github.com/srid/proc-flake/blob/676b5af467e52c06aa8a9165edb3345c6dbbabde/flake-module.nix#L53-L54

Can't access global flake config from default.nix. config argument in default.nix
:
trace: {
  _module = {
    args = {…};
    check = true;
    freeformType = null;
    specialArgs = {…};
  };
  debug = false;
  fromFlakeRoot = true;
  outputs = {
    check = null;
    package = {…};
    settingsYaml = {…};
    upCommandArgs = " ";
  };
  package = <derivation process-compose-0.51.4>;
  port = null;
  settings = {
    environment = null;
    log_length = null;
    log_level = null;
    log_location = null;
    processes = {…};
    shell = {…};
    version = null;
  };
  testScript = null;
  tui = null;
}

Now there is strange thing:
process-compose."dev:web-node".settings = {
  processes.web = {
    command = "ls; echo $PWD; echo $(pwd)";
    working_dir = "./node/web";
  };
};

foxpro:~/craft/sferadel/next$ dev:web-node
...<shows content of /home/foxpro/craft/sferadel/next/node/web>
[web_1  ] /home/foxpro/craft/sferadel/next <- $PWD
[web_1  ] /home/foxpro/craft/sferadel/next/node/web <- $(pwd)

So it is a devShell only process?
One way to solve this is to use it in combination with https://github.com/Platonic-Systems/mission-control which does support FLAKE_ROOT (unless cdToProjectRoot is set to false). Eg.: https://github.com/nammayatri/nammayatri/blob/493302e23ca968146eaaf90a7b8908057faab688/Backend/nix/scripts.nix#L40-L76
Is this solution sufficient?

Closing per this ^


option_env! -> std::env::var to allow "nightly" check to happen at runtime rather than compile time

Allow --unstable-features to be used in conjunction with setting the CFG_RELEASE_CHANNEL environment variable to nightly.

Closing in favour of #2249


Support 22204 Add validation on GeoreferenceVerificationStatus

Set null for georeferenceAssertion in service on both directions
Add a test for GeoreferenceVerificationStatus.GEOREFERENCING_NOT_POSSIBLE

We be implemented differently.


Coordinates lost with GPM-IMERG file

I'm working with the GPM-IMERG files from NASA. Here's an example
import xarray as xr
import fsspec

url = "https://earthmover-sample-data.s3.us-east-1.amazonaws.com/hdf5/3B-HHR.MS.MRG.3IMERG.19980101-S000000-E002959.0000.V07B.HDF5"
ds_nc = xr.open_dataset(fsspec.open(url).open(), engine="h5netcdf", group="Grid", decode_coords="all")
print(ds)

<xarray.Dataset> Size: 104MB
Dimensions:                         (time: 1, lon: 3600, lat: 1800, nv: 2,
                                     lonv: 2, latv: 2)
Coordinates:
  * time                            (time) object 8B 1998-01-01 00:00:00
  * lon                             (lon) float32 14kB -179.9 -179.9 ... 179.9
  * lat                             (lat) float32 7kB -89.95 -89.85 ... 89.95
    time_bnds                       (time, nv) object 16B ...
    lon_bnds                        (lon, lonv) float32 29kB ...
    lat_bnds                        (lat, latv) float32 14kB ...
Dimensions without coordinates: nv, lonv, latv
Data variables:
    precipitation                   (time, lon, lat) float32 26MB ...
    randomError                     (time, lon, lat) float32 26MB ...
    probabilityLiquidPrecipitation  (time, lon, lat) float32 26MB ...
    precipitationQualityIndex       (time, lon, lat) float32 26MB ...
Attributes:
    GridHeader:  BinMethod=ARITHMETIC_MEAN;\nRegistration=CENTER;\nLatitudeRe...

When opening this dataset virtually, many of the coordinates are lost.
from virtualizarr import open_virtual_dataset

dsv = open_virtual_dataset(url, indexes={}, group="Grid")
print(dsv)

This spits out the following warning
[/srv/conda/envs/notebook/lib/python3.12/site-packages/kerchunk/hdf.py:547](https://hub.openveda.cloud/srv/conda/envs/notebook/lib/python3.12/site-packages/kerchunk/hdf.py#line=546): UserWarning: The following excepion was caught and quashed while traversing HDF5
Can't get fill value (fill value is undefined)
Traceback (most recent call last):
  File "[/srv/conda/envs/notebook/lib/python3.12/site-packages/kerchunk/hdf.py", line 363](https://hub.openveda.cloud/srv/conda/envs/notebook/lib/python3.12/site-packages/kerchunk/hdf.py#line=362), in _translator
    fill = h5obj.fillvalue
           ^^^^^^^^^^^^^^^
  File "h5py[/_objects.pyx", line 54](https://hub.openveda.cloud/_objects.pyx#line=53), in h5py._objects.with_phil.wrapper
  File "h5py[/_objects.pyx", line 55](https://hub.openveda.cloud/_objects.pyx#line=54), in h5py._objects.with_phil.wrapper
  File "[/srv/conda/envs/notebook/lib/python3.12/site-packages/h5py/_hl/dataset.py", line 622](https://hub.openveda.cloud/srv/conda/envs/notebook/lib/python3.12/site-packages/h5py/_hl/dataset.py#line=621), in fillvalue
    self._dcpl.get_fill_value(arr)
  File "h5py[/_objects.pyx", line 54](https://hub.openveda.cloud/_objects.pyx#line=53), in h5py._objects.with_phil.wrapper
RuntimeError: Can't get fill value (fill value is undefined)

  warnings.warn(msg)

and returns a dataset with most of the coordinates missing
<xarray.Dataset> Size: 91MB
Dimensions:                         (time: 1, lon: 3600, lat: 1800, nv: 2)
Coordinates:
    time                            (time) int32 4B ManifestArray<shape=(1,),...
Dimensions without coordinates: lon, lat, nv
Data variables:
    precipitation                   (time, lon, lat) float32 26MB ManifestArr...
    precipitationQualityIndex       (time, lon, lat) float32 26MB ManifestArr...
    probabilityLiquidPrecipitation  (time, lon, lat) int16 13MB ManifestArray...
    randomError                     (time, lon, lat) float32 26MB ManifestArr...
    time_bnds                       (time, nv) int32 8B ManifestArray<shape=(...
Attributes:
    GridHeader:   BinMethod=ARITHMETIC_MEAN;\nRegistration=CENTER;\nLatitudeR...
    coordinates:  time

I also tried with the new kerchunk-free backend and got an error
from virtualizarr.readers.hdf import HDFVirtualBackend

open_virtual_dataset(url, indexes={}, group="Grid", drop_variables=["Intermediate"], backend=HDFVirtualBackend)

File [/srv/conda/envs/notebook/lib/python3.12/site-packages/virtualizarr/readers/hdf/hdf.py:129](https://hub.openveda.cloud/srv/conda/envs/notebook/lib/python3.12/site-packages/virtualizarr/readers/hdf/hdf.py#line=128), in HDFVirtualBackend._dataset_chunk_manifest(path, dataset)
    127 num_chunks = dsid.get_num_chunks()
    128 if num_chunks == 0:
--> 129     raise ValueError("The dataset is chunked but contains no chunks")
    130 shape = tuple(
    131     math.ceil(a [/](https://hub.openveda.cloud/) b) for a, b in zip(dataset.shape, dataset.chunks)
    132 )
    133 paths = np.empty(shape, dtype=np.dtypes.StringDType)  # type: ignore

ValueError: The dataset is chunked but contains no chunks

RuntimeError: Can't get fill value (fill value is undefined)

That's weird but it's an upstream issue in kerchunk.

returns a dataset with most of the coordinates missing

This is almost certainly another symptom of the fact that VirtualiZarr does not yet understand how to decode according to CF conventions in the same way that xarray does. Some of the those variables are present, they are just set as data variables instead of coordinates - that's the exact same bug as in issue #189. Other coordinates (lon_bnds & lat_bnds) are presumably created by xarray from metadata, rather then them actually existing in the file.
I have a in-progress PR to actually call xarray's internal CF decoding logic from within VirtualiZarr in https://github.com/zarr-developers/VirtualiZarr/pull/224.

I also tried with the new kerchunk-free backend and got an error

This rings a bell but I defer to @sharkinsspatial

Also we should probably have some more tests that explicitly check that all the same variables and coordinates are present for a set of different example real-world files, whether opened with virtualizarr or xarray.

This is almost certainly another symptom of the fact that VirtualiZarr does not yet understand how to decode according to CF conventions in the same way that xarray does.... Some of the those variables are present, they are just set as data variables instead of coordinates

I don't think that's the case here. The following variables are present in the underlying HDF5 dataset but don't appear anywhere in the virtualized dataset, either as coordinates or data variables: nv, lonv, latv, lon, lat, time_bnds, lon_bnds, lat_bnds. Here's a dump of the HDF5 variables, their chunk shapes, and the number of initialized chunks.
nv (2,) 0
lonv (2,) 0
latv (2,) 0
time (32,) 1
lon (3600,) 1
lat (1800,) 1
time_bnds (32, 2) 1
lon_bnds (3600, 2) 1
lat_bnds (1800, 2) 1
precipitation (1, 145, 1800) 25
randomError (1, 145, 1800) 25
probabilityLiquidPrecipitation (1, 291, 1800) 13
precipitationQualityIndex (1, 145, 1800) 25

The variables are just being skipped completely.

I made a kerchunk JSON of the file and the missing variables (lon, lat, lon_bnds, lat_bnds) do not even have a corresponding .zarray in the JSON.

That definitely sounds wrong, and would throw virtualizarr's kerchunk translator off completely.
But also this Grid/time should not happen either, it should be time. The group name should never appear in the dimension name like that. So even fsspec isn't reading these kerchunk references back correctly.

FWIW we got this file working fairly well with @sharkinsspatial's HDF-native reader: https://github.com/earth-mover/icechunk-nasa/blob/main/notebooks/write_virtual.ipynb


fix(package.json & releaserc.json): Semantic release, node version bump & gulp release plugin integration

Semantic release bump to 22.0.5 and node to latest, gulp plugin to release notifications on teams

please merge @AsifNawaz-cnic as I still see conflicts where they aren't any longer listed for you.

:tada: This PR is included in version 5.0.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Can not use QtWebEngine QML plugin

Issue description
The following error occurs:
 plugin cannot be loaded for module "QtWebEngine": Cannot load library /nix/store/wzh8v0b1ksl9jq9wjimgwhncs4bfn53p-qtwebengine-5.11.1-bin/lib/qt-5.11/qml/QtWebEngine/libqtwebengineplugin.so: (/nix/store/wzh8v0b1ksl9jq9wjimgwhncs4bfn53p-qtwebengine-5.11.1-bin/lib/qt-5.11/qml/QtWebEngine/libqtwebengineplugin.so: symbol _ZN22QWebEngineQuotaRequest16staticMetaObjectE version Qt_5 not defined in file libQt5WebEngineCore.so.5 with link time reference)

Steps to reproduce
Run a qml file that does import QtWebEngine 1.7
Technical details
Please run nix-shell -p nix-info --run "nix-info -m" and paste the
results.

system: "x86_64-linux"
host os: Linux 4.14.79, NixOS, 18.09.1206.6d6e4e6b558 (Jellyfish)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.1.1
channels(raskolnikov): ""
channels(root): "nixos-18.09.1206.6d6e4e6b558"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

I did changes in my system and can't reproduce anymore. Probably related to not having a globally installed Qt version anymore. (Only nix-shell now)

Please tell me how you resolved that problem in build file am getting same error what you posted


Feature request - command history

Hi,
We've been using moleculer for some time and we would to have a way to persist the command history (arrow up in repl) after a service restart.

Awesome suggestion @icex 👍  https://github.com/moleculerjs/moleculer-repl/pull/64 should add a .moleculer_repl_history to homedir. I've tested on Win10 and things seem to be working. Tomorrow will test on Linux.
Can you please install it from the feature/repl_history and also do a quick test?

Works fine on Mac OS(file in homedir ~/.moleculer_repl_history), should be fine on Linux as well..


revert merge until issue is settled

@pobermei , I suggest reverting this merge until the issue of how to ground the grid is settled.
https://github.com/potassco/asprilo-encodings/pull/9/commits/3cc10ad2964c49eb2a58e19f017b80762c08f1ae

Reverted by 0e2d960


fix URI.escape and URI.encode

ruby 3 removed URI.escape and URI.encode~

@and9000 @bubba going to merge this in; would one of you have the time to write another PR to correct the other instances of this issue? Looks like some of the work was already done here https://github.com/resque/resque-scheduler/pull/710/files


test: mock test of RPC

Overview
This is a draft, mostly for visibility.

Checklist

[ ] New and updated code has appropriate documentation
[ ] New and updated code has new and/or updated testing
[ ] Required CI checks are passing
[ ] Visual proof for any user facing features like CLI or documentation updates
[ ] Linked issues closed with keywords

@Manav-Aggarwal @nashqueue we can review and merge this PR as it is adding REST serialization test and also fixing the commented out TestSubscription


Add Libervia-backend

Closes #87

pytest-twisted started failing in Nixpkgs after I started working on this: https://hydra.nixos.org/build/265306268

Should be good to go now - licensing stuff is resolved, and everything builds on buildbot.

Wow that's great, thanks a lot for your work!
I'm not used to Nix yet, and I would like to test it. How can one test it right now, and when can we expect to see it on https://search.nixos.org ?
Thanks again!

This won't show up on search.nixos.org for now, but we have an overview of NGI-supported projects here: https://ngi-nix.github.io/ngipkgs/
You could try going through the user documentation made by @cleeyv: https://github.com/ngi-nix/ngipkgs/tree/main/deploy (ping me if you have questions)

great, thanks!


Language model issues

Hello, I have started inferring audio calls with the DS2 pre-trained model and the WER is very high, almost no word is detected. However, no language model is applied and the sounds of the transcripted text seem to be okay. I have tried downloading a language model by running download_lm.sh in the scripts folder and I have attached a screenshot of the error that pops up? Could you please explain how to solve this?
Picture: https://pasteboard.co/Ig25rOd.png
EDIT: Basically "generate_trie" should be something executable but no such file exists in the directory
Thank you

Thanks for the question. We are working on improving the code and the documentation. So it'll be more clear soon.
But in short, there are two implementations of beam search decoders with language model rescoring:

TF op (https://github.com/NVIDIA/OpenSeq2Seq/tree/master/ctc_decoder_with_lm). It requires a separate building step (if you are not using NVIDIA TF Docker container). More details here:

https://nvidia.github.io/OpenSeq2Seq/html/installation.html#pre-built-docker-container
https://nvidia.github.io/OpenSeq2Seq/html/installation.html#installation-of-openseq2seq-for-speech-recognition
This step builds libctc_decoder_with_kenlm.so library for TF op and generate_trie executable for preparing TRIE file. TRIE is required for this decoder.

Python wrapper for Baidu C++ decoder. It can be installed with ./scripts/install_decoders.sh script. This decoder doesn't need a trie file. So feel free to skip generate_trie call in download_lm.sh script.

Thank you @vsl9 , so after executing that script how do I specify in the python configuration file the language model to be used?

There is no need to specify a language model in the config file. Just add it as a command-line argument to decode.py script: https://nvidia.github.io/OpenSeq2Seq/html/speech-recognition.html#decoders


Allow users to override default_channel_grouping

Description & motivation
Implementation of adapter.dispatch within the default_channel_grouping macro to allow end-users to override this macro and use their own channel mapping
Checklist

[ ] I have verified that these changes work locally
[ ] I have updated the README.md (if applicable)
[ ] I have added tests & descriptions to my models (and macros if applicable)
[ ] I have run dbt test and python -m pytest . to validate exists tests

Ran into what may be a bug in dbt-core. Not sure. Slack thread and MRE here: https://getdbt.slack.com/archives/CU4MRJ7QB/p1674690798050729?thread_ts=1674654356.581109&cid=CU4MRJ7QB

What was the outcome of that thing about a possible DBT bug?

oh, turned out to just be an ambiguity in the documentation. Users need to override the adapter-specific macro, so in our case default__default_channel_grouping() rather than default_channel_grouping()
It's all set and works as I've tested it.


chore(test): Adding a test for multiple consumers with the pg backend.

This test is to provide a minimal proof that jobs can be consumed by
multiple workers and in a way can only be consumed once. If the
execCount does not match the expected count then this test will fail
because either too many jobs were executed (like one executing twice) or
a job was dropped when it should not have been.

I used a waitgroup for this since I want to make sure multiple jobs complete on their own time and in any order. But a
waitgroup removes any natural timeout handling and instead forces the go test process to handle timeouts instead. This
might not be ideal but would only happen when there was such a significant change to the PG backend that a job does not
get processed for some reason?

I plan on using neoq in an environment where I have multiple workers and multiple producers or enqueuers with a PostgreSQL backend. I didn't see any tests for this exact use case and thought it would be valuable to add some.
There are some more tests that I want to add but figured I'd throw this up first for initial feedback.


Fix invalid github link to post an issue

@Tapchicoma ah, can I ask when there will be new release? as there is a bug that is showing up in every project I want to use ktlint with, and I see that it is already fixed in #628

@GotoFinal can't say exact day, but probably next week


HOSTEDCP-1709: test/e2e: actually wait for guest cluster client

Creating a new client object does not connect to the API server, so if we're trying to wait for a client to work, we really need to send an API request and get a response. The SelfSubjectReview API is simple and we will always have the privilege to do it, so we can use it.
/assign @sjenning

/lgtm
/hold
to check non-zero duration on these checks

    util.go:181: waiting for a successful connection to the guest API server
    eventually.go:99: failed to get *v1.SelfSubjectReview: Post "https://api-example-h9mcl.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-example-h9mcl.service.ci.hypershift.devcluster.openshift.com on <IP_ADDRESS>:53: no such host
    eventually.go:99: failed to get *v1.SelfSubjectReview: Post "https://api-example-h9mcl.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp <IP_ADDRESS>:443: i/o timeout
    util.go:181: Successfully waited for a successful connection to the guest API server in 2m6.1s

/hold cancel


Add HOWTO: Early Stopping

Based on https://github.com/google/flax/pull/711

Copying content from the duplicate #1239:
We recently merged #711, which gives a simple non-(inversion of control) API for early stopping in a user-defined training loop.
It would be good to showcase a HOWTO with side-by-side diffs like in https://flax.readthedocs.io/en/latest/howtos/lr_schedule.html showcasing how this would be integrated into a real (sample) training loop.

Anyone working on this? I can send a PR.

@INF800 not that I know of, want to give it a shot?

@INF800 I assigned it to you, thanks for helping! Feel free to send me the PR once it is done.

Thankyou. Picking up the task now.

@marcvanzee added the docs/howtos/early_stopping.rst file manually. Is it the right way of doing things?

This test (https://github.com/google/flax/pull/1528/checks?check_run_id=3548808026) is failing as I tried to use .. codediff::.

@INF800 -- yes the docs actually run their code to make sure it runs correctly. you can use testsetup:: if you need to initialize things at the top that aren't defined in the code, but we mostly use that for imports. You probably want to get your code in the codediff:: (specifically the right hand side, which is what's tested) to run without failures. You can also run tests locally, see docs/README.md

In your case perhaps you can add a testsetup:: block with num_epochs = 10 to get the code to run...?

@INF800 -- yes the docs actually run their code to make sure it runs correctly. you can use testsetup:: if you need to initialize things at the top that aren't defined in the code, but we mostly use that for imports. You probably want to get your code in the codediff:: (specifically the right hand side, which is what's tested) to run without failures. You can also run tests locally, see docs/README.md

I notices that testsetup:: actually hides it's code contents, so added the variables there along with a dummy training function.
After building the html files, I am not seeing link to my page in left side navigation pannel. Should I make changes somewhere?

Closing this since the PR fixing this does not seem to have any activity (#1528), and we actually have a minimal example in the docstring for early stopping now.


Replace invisible character in network-observability-managed-cli.md

I wonder why U+202f is here.
You must download this file and then find out this is not space. On GitHub Web, both of characters are presenting as space (which is hard to know there is difference behind). But if you copy the command from Microsoft document, it will present as its nature form.

@asudbring
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#sign-off


Rounded cropper is not displayed in IE 11

Hi,
The rounded cropper is not displayed under IE.
https://plnkr.co/edit/V5FvvkkSYnkDYzyWQxJa?p=preview

I am going to download a IE11 VM to test.
Question: do you have any error in the console?

There is no errors, it function well, only the cropper is not transparent:

Ah, thank you very much for the video!
Will try to fix it asap and deploy a new version. Might take few days due to busy schedule.

Removed darken background for rounded cropper due to browser compatibility.

Will be released with 0.6


[Proposal] Unified Client interface

Adds build targets support to Client class and drafts a proposal for unified endpoint/resource handling.
Notes about some decisions:

model properties are described in comment rather than be initialized in a constructor to allow undefined values but still be documented
build_target endpoint is an interesting example because it groups targets by version name but we want to access each build target separately (which would be possible in endpoint V2). So we're normalizing the data and providing the interface which will remain constant even after switching the backing endpoint
this PR also tries to propose Error building/handling pattern that combines our three implementations mentioned in the ClubHouse story

Coverage decreased (-0.5%) to 64.894% when pulling 65de0dbe72ca5d7e91beed1f314fe02298a41b5d on feature/build-targets into 6bd9caa3857f308fb538601a987cb5ba83fa1137 on master.

@busticated this is the stateful Client proposal I mentioned to you yesterday

i moved this back into "draft" state to calm the reminders. i don't see us merging this anytime soon if only b/c it's so out of date but it's a good reference so i'm fine w/ leaving it open as a draft for now.


Technology breakdown by-suburb over time

Like the current overall tallies/chart, but per-suburb.
https://forums.whirlpool.net.au/thread/3nklkn29?p=503#r10058

I think it's a good idea to modify the code such that generating such data is easily possible.
I'm not sure if it's worth storing all this data as it will quickly balloon the size of this repository but I definitely see the value behind it will have a think.

I already write the code, it's a fairly trivial change to the tech-breakdown code:

(yes, there's a bit more code around this to pull the new attribute, and write it to a different file, so the format/size of the current isn't changed;  and updates to the GHA-run script to do the same;  but that's the general idea)

Will have a PR shortly

It's about 1.2Mbyte per week
❯ jq '.["2023-08-01"]' results/breakdown-suburbs.json | wc
   67481<PHONE_NUMBER>430

Hmmm actually possibly we could generate and publish this file using the release function of GitHub solves the repo size issue.

The data (from 23/5 until now) is 20MB.
{
    "2023-05-23": {
        "ACT": {
            "Banks": {
                "FTTN": 1456,
                "FTTC": 428,
                "FTTP": 2
            }
        },
        "NSW": {
            "Liverpool": {
                "FTTP": 12490,
                "HFC": 1227,
                "FTTB": 666,
                "FTTN": 2,
                "FTTC": 60,
                "NULL": 33
            },
            "Wauchope": {
                "FTTN": 3138,
                "FTTP": 178,
                "WIRELESS": 35,
                "FTTC": 33,
                "SATELLITE": 3,
                "NULL": 15
            },

I don't know about that release function, how to run it etc.

One of our existing current geojson files is already 30M, I don't think 20M is a big deal?
❯ find results -name \*.geojson -size +10M | xargs ls -lh
-rw-r--r--@ 1 simonroberts  staff    13M 21 Sep 13:58 results/NSW/sydney.geojson
-rw-r--r--@ 1 simonroberts  staff    30M 27 Sep 12:38 results/VIC/melbourne.geojson
-rw-r--r--@ 1 simonroberts  staff    10M 27 Sep 12:38 results/VIC/southbank.geojson

You can see what I mean about releases here: https://github.com/LukePrior/open-energy-tracker/releases
We could do a weekly release and then always grab the latest for the website.
https://docs.github.com/en/repositories/releasing-projects-on-github/linking-to-releases#linking-to-the-latest-release

(we still have a bunch of open issues to minimise, and/or compress the geojson files)

Yeah I think the file size should be fine either way however.

OK, pushed the json file into the PR.  I'll leave the charting to you :)

Maybe we can use releases to publish sqllite DB :)

I would encourage this. We may be able to answer the question whether the orderable dates announced by NBN are realistic. Some suburbs have slow takeup for economic affordability reasons (closed subscriber wallets), but others due to delays for civil works ? I am basically interested in timelines and progress. Whether the 1.5BN will run out without all sites upgraded in the announced suburbs.

This has been merged in and will be generated going forwards, but it might be a while until I have time to get the website updated to show it.


ng test problem

Please provide us with the following information:

OS?

Mac OSX ( El Capitan?)

Versions.
angular-cli: 1.0.0-beta.16
node: 4.6.0
os: darwin x64
From all of the sudden my ng test  stop working. It is does not start Chrome.  - the only thing it says:
Could not start watchman; falling back to NodeWatcher for file system events.
Visit http://ember-cli.com/user-guide/#watchman for more info.
29 10 2016 10:43:21.619:WARN [karma]: No captured browser, open http://localhost:9876/

WARNING in<EMAIL_ADDRESS>45:15 Critical dependency: the request of a dependency is an expression

WARNING in<EMAIL_ADDRESS>57:15 Critical dependency: the request of a dependency is an expression
29 10 2016 10:43:21.629:INFO [karma]: Karma v1.2.0 server started at http://localhost:9876/
29 10 2016 10:43:21.629:INFO [launcher]: Launching browser Chrome with unlimited concurrency
29 10 2016 10:43:21.633:INFO [launcher]: Starting browser Chrome
29 10 2016 10:43:22.345:INFO [Chrome 54.0.2840 (Mac OS X 10.11.5)]: Connected on socket /#T_PcrcPK9DpzS6oQAAAA with id 53193955
Chrome 54.0.2840 (Mac OS X 10.11.5) ERROR

I am not aware that something changed on my OSX. Chrome work without problem.

I updated to the latest CLI and it seems to launch browser now bu the chrome error is the same. Is there any ways to debug it , what is the real cause behind htis?
29 10 2016 12:33:20.148:DEBUG [web-server]: serving: /projects/MyProject/node_modules/karma/static/karma.js
29 10 2016 12:33:20.252:DEBUG [karma]: A browser has connected on socket /#1Q2XXs4PD2uahicnAAAA
29 10 2016 12:33:20.257:DEBUG [web-server]: upgrade /socket.io/?EIO=3&transport=websocket&sid=1Q2XXs4PD2uahicnAAAA
29 10 2016 12:33:20.271:DEBUG [web-server]: serving: /projects/MyProject/node_modules/karma/static/favicon.ico
29 10 2016 12:33:20.285:INFO [Chrome 54.0.2840 (Mac OS X 10.11.5)]: Connected on socket /#1Q2XXs4PD2uahicnAAAA with id 43534831
29 10 2016 12:33:20.286:DEBUG [launcher]: Chrome (id 43534831) captured in 0.846 secs
29 10 2016 12:33:20.286:DEBUG [karma]: All browsers are ready, executing
29 10 2016 12:33:20.286:DEBUG [karma]: Captured 1 browsers
29 10 2016 12:33:20.295:DEBUG [middleware:karma]: custom files null null
29 10 2016 12:33:20.295:DEBUG [middleware:karma]: Serving static request /context.html
29 10 2016 12:33:20.296:DEBUG [web-server]: serving: /projects/MyProject/node_modules/karma/static/context.html
29 10 2016 12:33:20.305:DEBUG [middleware:source-files]: Requesting /base/node_modules/jasmine-core/lib/jasmine-core/jasmine.js?391e45351df9ee35392d2e5cb623221a969fc009 /
29 10 2016 12:33:20.306:DEBUG [middleware:source-files]: Fetching /projects/MyProject/node_modules/jasmine-core/lib/jasmine-core/jasmine.js
29 10 2016 12:33:20.306:DEBUG [web-server]: serving (cached): /projects/MyProject/node_modules/jasmine-core/lib/jasmine-core/jasmine.js
29 10 2016 12:33:20.307:DEBUG [middleware:source-files]: Requesting /base/node_modules/karma-jasmine/lib/boot.js?945a38bf4e45ad2770eb94868231905a04a0bd3e /
29 10 2016 12:33:20.307:DEBUG [middleware:source-files]: Fetching /projects/MyProject/node_modules/karma-jasmine/lib/boot.js
29 10 2016 12:33:20.307:DEBUG [middleware:source-files]: Requesting /base/node_modules/karma-jasmine/lib/adapter.js?7975a273517f1eb29d7bd018790fd4c7b9a485d5 /
29 10 2016 12:33:20.307:DEBUG [middleware:source-files]: Fetching /projects/MyProject/node_modules/karma-jasmine/lib/adapter.js
29 10 2016 12:33:20.308:DEBUG [middleware:source-files]: Requesting /base/src/test.ts?ce3e11dda1e6690013e6f68087341154010ede28 /
29 10 2016 12:33:20.326:DEBUG [middleware:source-files]: Fetching /projects/MyProject/src/test.ts
29 10 2016 12:33:20.326:DEBUG [web-server]: serving (cached): /projects/MyProject/node_modules/karma-jasmine/lib/boot.js
29 10 2016 12:33:20.327:DEBUG [web-server]: serving (cached): /projects/MyProject/node_modules/karma-jasmine/lib/adapter.js
29 10 2016 12:33:20.327:DEBUG [web-server]: serving (cached): /projects/MyProject/src/test.ts
29 10 2016 12:33:20.432:DEBUG [web-server]: serving: /projects/MyProject/node_modules/karma/static/context.js
29 10 2016 12:33:20.779:DEBUG [middleware:source-files]: Requesting /_karma_webpack_/2.bundle.js /
29 10 2016 12:33:20.779:DEBUG [middleware:source-files]: Fetching /_karma_webpack_/2.bundle.js
Chrome 54.0.2840 (Mac OS X 10.11.5) ERROR

it was my problem I found there was a Injected Service in one of the constructor and I removed this service it it started to work. but no error nothing.


Template - Command / Query Separation

Command has Mapper and UnitOfWork
Query has just Mapper
Commands return same single object
Query returns custom objects

Command Service
Query Service
Separation just like in repos?


add a few compile program tests

I found a way to add a few compile program tests that doesn't seem too bad - please take a look.
The main thing I would consider changing in the implementation itself after writing these tests is the options argument that is passed to the new compile functions.  In the new functions the options is passed as a string.  This is more C++-like, however it differs from the existing compile function that takes a const char*, and it means we cannot pass a NULL or nullptr options string and need to pass the empty string "" instead.  Should we switch this to a const char* for consistency?

As far as my limited understanding goes, these seem fine.


Please insert / mount disc 1(install disc)

i want to install it,but it appear this problem,I like this game and want to paly game with other people.

Did you insert or mount the install cd?

Yes, I inserted the cd

Are you using the English version of the original cds? If you're using a repack or other language version, it might not work.

Did you insert or mount the install cd?

So what if my pc doesn't have disc drive, so i can only mount discs?


Correction for raw affiliation SupAgro Montpellier, UMR IATE, SupAgro Montpellier Bat 32 2 Place Viala Montpellier, France

Correction needed for raw affiliation SupAgro Montpellier, UMR IATE, SupAgro Montpellier Bat 32 2 Place Viala Montpellier, France
raw_affiliation_name: SupAgro Montpellier, UMR IATE, SupAgro Montpellier Bat 32 2 Place Viala Montpellier, France
new_rors: 03rnk6m14;0000n5x09
previous_rors: 03rnk6m14
works_examples: W2063051623
contact: 1d481f8b8bc0a0d72836d065570b7961:9052898fcc95e3825e8a67c16a1704029bca @ inrae.fr

This issue was accepted and ingested by the OpenAlex team on 2024-10-09. The new affiliations should be visible within the next 7 days.


Can't install Rasa core on mac OS due to incompatible packages

Rasa version: latest (can't see the version since the app breaks)
Python version: 3.7.3
Operating system (windows, osx, ...): Mac OS 10.15.5
Issue:
Error happens when I try to install rasa on a clean virtual environment.
Error (including full traceback):
ERROR: tensorflow 2.1.1 has requirement gast==0.2.2, but you'll have gast 0.3.3 which is incompatible.
ERROR: tensorflow 2.1.1 has requirement scipy==1.4.1; python_version >= "3", but you'll have scipy 1.5.1 which is incompatible.

Command or request that led to error:
rasa install

Thanks for the issue, @melindaloubser1 will get back to you about it soon!
You may find help in the docs and the forum, too 🤗

@lfnovo Just confirming you mean you ran pip install rasa not rasa install right?

Sorry, I meant rasa init
It fails to run because of TensorFlow
Traceback (most recent call last):
  File "/System/Volumes/Data/Users/lfnovo/Library/Python/3.7/bin/rasa", line 8, in <module>
    sys.exit(main())
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/rasa/__main__.py", line 82, in main
    set_log_level(log_level)
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/rasa/utils/common.py", line 71, in set_log_level
    update_tensorflow_log_level()
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/rasa/utils/common.py", line 112, in update_tensorflow_log_level
    import tensorflow as tf
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow/__init__.py", line 101, in <module>
    from tensorflow_core import *
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow_core/__init__.py", line 40, in <module>
    from tensorflow.python.tools import module_util as _module_util
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 959, in _find_and_load_unlocked
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow/__init__.py", line 50, in __getattr__
    module = self._load()
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow/__init__.py", line 44, in _load
    module = _importlib.import_module(self.__name__)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow_core/python/__init__.py", line 64, in <module>
    from tensorflow.core.framework.graph_pb2 import *
  File "/Users/lfnovo/Library/Python/3.7/lib/python/site-packages/tensorflow_core/core/framework/graph_pb2.py", line 7, in <module>
    from google.protobuf import descriptor as _descriptor
  File "/Library/Python/3.7/site-packages/google/protobuf/__init__.py", line 37, in <module>
    __import__('pkg_resources').declare_namespace(__name__)
  File "/Library/Python/3.7/site-packages/pkg_resources/__init__.py", line 83, in <module>
    __import__('pkg_resources.extern.packaging.requirements')
  File "/Library/Python/3.7/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in <module>
    from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 668, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 638, in _load_backward_compatible
  File "/Library/Python/3.7/site-packages/pkg_resources/extern/__init__.py", line 43, in load_module
    __import__(extant)
  File "/Library/Python/3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 4756, in <module>
    _escapedPunc = Word( _bslash, r"\[]-*.$+^?()~ ", exact=2 ).setParseAction(lambda s,l,t:t[0][1])
  File "/Library/Python/3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1284, in setParseAction
    self.parseAction = list(map(_trim_arity, list(fns)))
  File "/Library/Python/3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1066, in _trim_arity
    this_line = extract_stack(limit=2)[-1]
  File "/Library/Python/3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1050, in extract_stack
    frame_summary = traceback.extract_stack(limit=-offset+limit-1)[offset]
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/traceback.py", line 211, in extract_stack
    stack = StackSummary.extract(walk_stack(f), limit=limit)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/traceback.py", line 363, in extract
    f.line
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/traceback.py", line 285, in line
    self._line = linecache.getline(self.filename, self.lineno).strip()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/linecache.py", line 16, in getline
    lines = getlines(filename, module_globals)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.7/lib/python3.7/linecache.py", line 48, in getlines
    for mod in sys.modules.values():
RuntimeError: dictionary changed size during iteration

The other three issues here https://github.com/RasaHQ/rasa/search?q=dictionary+changed+size+during+iteration&type=Issues might help - One suggestion is a Python upgrade to 3.7.7;
This does seem to be mac specific, but on my mac (same version) with Python 3.7.4 I don't have this problem.

That fixed it. Thanks!


Multiple API Calls to toolClasses Endpoint on Initial Load

Description

Upon initial load of the ecc-client-elixir-trs-filer component, the same API request to the https://trs-filer-test.rahtiapp.fi/ga4gh/trs/v2/toolClasses endpoint is being sent multiple times. This issue is observed in both the trs-classes and trs-list components, leading to unnecessary network traffic and potential performance degradation.
Steps to Reproduce

Navigate to the component's page.
Monitor the network traffic using the browser's developer tools.
Observe that the GET request to https://trs-filer-test.rahtiapp.fi/ga4gh/trs/v2/toolClasses is made multiple times (exactly 3 times) on the initial load.

Expected Behavior

A single API call should be made to the toolClasses endpoint when the component loads initially.

Actual Behavior

Multiple API calls are made to the toolClasses endpoint on initial load.

Possible solution(s)

A potential solution to this issue could be to centralize the API call within the ecc-trs-filer.ts file and then pass the fetched data as props to both the trs-classes and trs-list components. This approach would ensure that the API call is made once, and the necessary data is distributed efficiently to the components that require it.
Additional context

This issue may lead to increased load times and unnecessary strain on the server due to the duplicated requests. Addressing it could improve the overall performance and user experience of the application.
My contribution
I plan to address this issue and will be working on a fix. Once I have a solution, I will submit a pull request for review. This approach will ensure that the API call is optimized, reducing unnecessary network traffic and improving the application's performance.
upd: here is pull request https://github.com/elixir-cloud-aai/cloud-components/pull/280
I have no permission to link it.

@Abyl10 thanks for the issue but we are depricating trs and filer package in the next PR. I don't think it makes sense fixing these issues are the code will be migrated and majorly rewritten in lit.
@uniqueg @git-anurag-hub @SalihuDickson ?

I suppose that is correct. However, given that @Abyl10 already provided a PR for the issue, maybe it still makes sense to merge it - if you think it will make the migration a little easier/straightforward, or at least doesn't harm the migration?

Yh, if we merge it without verifying that it works as it's supposed to. But since we're planning a full rewrite, it doesn't seem like a proper use of limited time, reviewing the functionality of the PR.

I guess that makes sense.
Apologies, @Abyl10: we still very much appreciate your initiative and hope this doesn't discourage you from further contributions :)


Open Source : 6.24 Explain everything related to Apache HTTP Server

Description 📜
Open Source : 6.24 Explain everything related to Apache HTTP Server
NOTE 👇
Please put your doc 6.Popular_Projects with the name 6.24_Apache_HTTP_Server.md

Domain
Open Source
Type of Contribution
Documentation
Code of Conduct

[X] I follow Contributing Guidelines & Code of conduct of this project.

/assign

I want to work on this

@geeythree  Assigned, Happy learning 🎉🎉


CRAM to BAM fail on large file

Hi,
I have CRAM file of about 35G and I tried to convert it back to BAM. I used 32 cores machine, but it seems that only 1 core is doing a job. After ~20-30 mins there is no CPU activity and it was like that for a day, so I decided to terminate the analysis.
Is there a limited file size of CRAM that I can convert back to BAM? Also, is there a way to utilize more core?
Thanks,
Chai

Please make sure there is enough memory, I'd recommend at least 4gb.
The new version has a new converter:
java -cp cramtools-3.0.jar htsjdk.samtools.cram.paralell.CramToBam
this allows to utilize multiple cores but in practice ~16 cores is enough due to performance saturation.

Thanks, Vadim. Is there a manual for your tool? I only found short description in github.

At the moment only command line help I'm afraid. Let me know if you have questions about usage.

Hi Vadim,
Where could I find the htsjdk.samtools.cram.paralell.CramToBam? It seems that it's not included in your github.

please try running it like this:
java -cp cramtools-3.0.jar htsjdk.samtools.cram.paralell.CramToBam

Thanks Vamin. The speed for parallel version is quite impressive. Do you have the command for BAM to CRAM in parallel running as well?

please try:
java -cp cramtools-3.0.jar htsjdk.samtools.cram.paralell.BamToCram

Hi Vamin,
I got the following error once I run it.

java -cp cramtools/cramtools-3.0.jar htsjdk.samtools.cram.paralell.BamToCram --input-bam-file infile.bam --reference-fasta-file genome.fa --output-cram-file out.cram --capture-tags
Failed to parse parameteres, detailed message below:
7

It seems that -Q and -n are not supported here as well. Is it possible to do lossless compression using htsjdk.samtools.cram.paralell.BamToCram? Also, I wonder if htsjdk.samtools.cram.paralell.BamToCram is part of cramtools or samtools?
Thanks,
Chai

Yes, in this version lossy tags only, quality scores and read names are lossless.
This is part of cramtools for now.

Thanks Vamin. When I used this following command, the process is pausing.  (note that nproc here is 8. I use 8 core machine).
time java -cp cramtools/cramtools-3.0.jar htsjdk.samtools.cram.paralell.BamToCram --threads nproc --input-bam-file infile.bam --reference-fasta-file genome.fa --output-cram-file out2.cram --capture-all-tags
Below here is the screen that I see. These are generated instantly. No progress after that.
INFO    2016-07-27 20:33:01     BamToCram       thread pool size=7, converion threads=4, queues capacity=8
INFO    2016-07-27 20:33:01     BamToCram       Creating thread pool with size 7
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.StreamPump, name: BGZF_UNC_PUMP
INFO    2016-07-27 20:33:01     BamToCram_OBA_Function  converter created
INFO    2016-07-27 20:33:01     BamToCram_OBA_Function  converter created
INFO    2016-07-27 20:33:01     BamToCram_OBA_Function  converter created
INFO    2016-07-27 20:33:01     BamToCram_OBA_Function  converter created
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.SupplierJob, name: BAM_SLICER_SUPPLIER
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_0
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_1
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_2
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_3
INFO    2016-07-27 20:33:01     Job     Starting job: htsjdk.samtools.cram.paralell.ConsumerJob, name: CRAM_BYTE_WRITE_JOB
java.lang.NullPointerException
at htsjdk.samtools.cram.CramContext.(CramContext.java:38)
at htsjdk.samtools.cram.CramSerilization.convert(CramSerilization.java:44)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:67)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:24)
at htsjdk.samtools.cram.paralell.TransformerJob.doRun(TransformerJob.java:28)
at htsjdk.samtools.cram.paralell.Job.run(Job.java:40)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
java.lang.NullPointerException
at htsjdk.samtools.cram.CramContext.(CramContext.java:38)
at htsjdk.samtools.cram.CramSerilization.convert(CramSerilization.java:44)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:67)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:24)
at htsjdk.samtools.cram.paralell.TransformerJob.doRun(TransformerJob.java:28)
at htsjdk.samtools.cram.paralell.Job.run(Job.java:40)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
INFO    2016-07-27 20:33:01     Job     Job done: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_2
java.lang.NullPointerException
at htsjdk.samtools.cram.CramContext.(CramContext.java:38)
at htsjdk.samtools.cram.CramSerilization.convert(CramSerilization.java:44)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:67)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:24)
at htsjdk.samtools.cram.paralell.TransformerJob.doRun(TransformerJob.java:28)
at htsjdk.samtools.cram.paralell.Job.run(Job.java:40)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
java.lang.NullPointerException
at htsjdk.samtools.cram.CramContext.(CramContext.java:38)
at htsjdk.samtools.cram.CramSerilization.convert(CramSerilization.java:44)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:67)
at htsjdk.samtools.cram.paralell.BamToCram_OBA_Function.apply(BamToCram_OBA_Function.java:24)
at htsjdk.samtools.cram.paralell.TransformerJob.doRun(TransformerJob.java:28)
at htsjdk.samtools.cram.paralell.Job.run(Job.java:40)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
INFO    2016-07-27 20:33:01     Job     Job done: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_3
INFO    2016-07-27 20:33:01     Job     Job done: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_1
INFO    2016-07-27 20:33:01     Job     Finished job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_3
INFO    2016-07-27 20:33:01     Job     Finished job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_1
INFO    2016-07-27 20:33:01     Conveyer        close: 3
INFO    2016-07-27 20:33:01     Conveyer        close: 2
INFO    2016-07-27 20:33:01     Job     Finished job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_2
INFO    2016-07-27 20:33:01     Job     Job done: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_0
INFO    2016-07-27 20:33:01     Conveyer        close: 1
INFO    2016-07-27 20:33:01     Job     Finished job: htsjdk.samtools.cram.paralell.TransformerJob, name: BC_CONVERTER_0
INFO    2016-07-27 20:33:01     Conveyer        close: 0
INFO    2016-07-27 20:33:01     Job     Job done: htsjdk.samtools.cram.paralell.ConsumerJob, name: CRAM_BYTE_WRITE_JOB
INFO    2016-07-27 20:33:01     Job     Finished job: htsjdk.samtools.cram.paralell.ConsumerJob, name: CRAM_BYTE_WRITE_JOB

I have pushed a fix, please try again with a fresh jar.


Install-OSRabbitMQ: RabbitMQ sometimes takes more than 5 minutes to initialize

Sometimes RabbitMQ takes more than 300s to initialize

This cmdLet will be removed. We will install rabbit and erlang in the Install-OSServerPreReqs and the configuration of Rabbit will be done by the configuration tool.


toggleable search bar

this could be in the GUI next to the toolbox text, allowing users to sift down their options and find what they need quickly when they start to get lots of entries on their list

added :)


Restructure for Arduino IDE 1.6.4 (Library Manager)

This is to support the new feature for installing libraries using the Library Manager from Arduino IDE 1.6.4.

I think you should rethink

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[BUG] - Date-picker

NextUI Version
2.4.2
Describe the bug
I think this is an issue or missing function.
I dont know where to report it so i report it here.
I want format for date to be yyyy-mm-dd
How do i do that.
Your Example Website or App
No response
Steps to Reproduce the Bug or Issue

Expected behavior
i want to it to be formated as yyyy-mm-dd or other...
Screenshots or Videos
No response
Operating System Version
windows
Browser
Chrome

The date format is based on your locale, which you can configure in your provider. By default it's en-US so it would be mm-dd-yyyy. See locale prop in https://nextui.org/docs/api-references/nextui-provider#props.

import React from "react"
import ReactDOM from "react-dom/client"
import "./index.css"
import "simplebar/dist/simplebar.min.css"
import App from "./App"
import reportWebVitals from "./reportWebVitals"
import { CollapseDrawerProvider } from "./contexts/CollapseDrawerContext"
import { Provider } from "react-redux"
import { HelmetProvider } from "react-helmet-async"
import NotistackProvider from "./components/NotistackProvider"
import { store } from "./app/store"
import { NextUIProvider } from @.***/react"
import { BrowserRouter } from "react-router-dom"
const root = ReactDOM.createRoot(document.getElementById("root"))
root.render(

)
reportWebVitals() This did not work. I want yyyy-mm-dd (2024-11-30)
[Creative-Art-Design-FINAL_Email.png]
Best Regards
CREATIVE ART DESIGN COMPANY
Market and Design Manager, AI and development
Mr. Kamal S.M.M. Ahmad
Phone: +962 78 550 11 25
Located in Jordan
CONFIDENTIAL: This email, including attached files, may contain confidential information and is intended only for the use of the individual and/or entity to which it is addressed. If you are not the intended recipient, disclosure, copying, use, or distribution of the information included in this email is prohibited. Please delete this email immediately and notify us by replying to this email.
On 2024-11-03 06:16:07, աӄա @.> wrote:
The date format is based on your locale, which you can configure in your provider. By default it's en-US so it would be mm-dd-yyyy. See locale prop in https://nextui.org/docs/api-references/nextui-provider#props [https://nextui.org/docs/api-references/nextui-provider#props].
—
Reply to this email directly, view it on GitHub [https://github.com/nextui-org/nextui/issues/3977#issuecomment-2453276509], or unsubscribe [https://github.com/notifications/unsubscribe-auth/ALBKHP24PO5NZICJCX6EKSDZ6WIPNAVCNFSM6AAAAABRCAFSLOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJTGI3TMNJQHE].
You are receiving this because you authored the thread. Message ID: @.>
[e8ffbd63-8214-4f2b-99f9-b0cd4bcc5c37]

please share a minimal reproducible sandbox instead.


Enable Travis and Coveralls for repo

[x] Enable travis for this repo
[x] Enable coveralls for this repo optional

Thanks!

Done.


remove aws_tls_handler_write

Issue #, if available:
https://github.com/awslabs/aws-c-io/issues/624
Description of changes:
remove aws_tls_handler_write because it was never implemented
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (1779683) 80.04% compared to head (7bdf8b2) 80.04%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #628   +/-   ##
=======================================
  Coverage   80.04%   80.04%
=======================================
  Files          28       28
  Lines        5949     5949
=======================================
  Hits         4762     4762
  Misses       1187     1187

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Update virustotal command

Add * option to check all installed apps
Add --global option to check globally installed apps
Add 60+ sec. pause after 4 queries/min to avoid 429/Too Many Requests
Add immediate abort if query limit is exceeded
Add INFO/WARN/ERROR prefixes to messages
Add DarkGray/DarkCyan/DarkRed colors to INFO/WARN/ERROR messages
Add using apikey if stored via: scoop config virustotal_api_key apikey
Change colors to DarkGreen/DarkYellow/Yellow/Red for 0/1/2/3+ hit count
Remove fragment from URL when submitting to virustotal.com
Standardized INFO/WARN/ERROR messages

@rasa & @r15ch13, thank you for carrying this work further!
I didn't see this update and will work on it a bit more.
One thing that already stands out as strange to me is that only installed applications may be checked.  My idea (or use case) is to check, preferrably even before downloading, that the software isn't infected.
If I can do it, I would even try to check dependencies that would be installed, too [e.g. checking youtube-dl should automatically check ffmpeg], again, before they are installed.
I like the idea of using '*' to test all installed apps, but I am not too sure that this is entirely clear for the user: AFAIU, the hashes of the most up to date versions will be checked in VirusTotal, independently of the exact version actually currently installed.  I struggle with how to make this clear (in the documentation or even better in the command output).
I will open a PR with changes/proposals soon (WIP is in https://github.com/pcrama/scoop/tree/virustotal-apikey).

One additional thought. What happens if a user installs a particular version with scoop install<EMAIL_ADDRESS>Do we support that now, and if not, can we?

As far as I know, this is not supported.  I have currently no idea if it can be.

I have submitted #1934 (https://github.com/pcrama/scoop/tree/virustotal-apikey-fixes-20171231), the other branch will be deleted.


Update dependencies on tower-grpc and prost

Codecov Report

Merging #525 into master will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #525      +/-   ##
==========================================
- Coverage    43.3%   43.28%   -0.02%
==========================================
  Files         175      175
  Lines       15422    15422
==========================================
- Hits         6678     6676       -2
- Misses       8744     8746       +2

Impacted Files
Coverage Δ

network-grpc/src/lib.rs
0% <ø> (ø)
:arrow_up:

network-grpc/src/client.rs
0% <ø> (ø)
:arrow_up:

...tocol-tokio/src/network_transport/response_code.rs
54.54% <0%> (-6.07%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 775263a...f4474bc. Read the comment docs.


Crash when re-initializing the sentry subsystem

Environment
How do you use Sentry?
Sentry SaaS (sentry.io)
Which version of the SDK?
Git-URL, 18.0 git hub release for unreal 5.3
Which version of Unreal?
Unreal 5.3.2
Is this happening in Unreal (editor) or on a player like Android, iOS, Windows?
We only use sentry for the windows game target for now.
Steps to Reproduce

Initialize the sentry subsystem with a call to InitWithSettings, Initialize or setting InitAutomatically in USentrySettings to true
Initialize the sentry subsystem again later when having more data by calling InitWithSettings or Initialize again without calling Deinitialize first
Wait for a log message to be printed by unreal

Expected Result
The app should not crash.
Actual Result
The app crashes
Any logs or screenshots
The reason for the crash is that when calling Initialize multiple times the  FSentryOutputDevice instance in OutputDevice gets destroyed without deregistering them first from GLog (see USentrySubsystem::ConfigureOutputDevice() ).
Similar problems might be in USentrySubsystem::ConfigureOutputDeviceError() as the old FSentryOutputDeviceError device is still in GError when it is torn down while being used at the same time as the parent for the newly created device.

Sorry about that, the SDK should definitely not cause a crash.
Initializing the SDK twice is not really an intended or even recommended approach. What is it that you cannot provide during the original init? Maybe there is a way to set this later on.

Hi,
thanks for reacting so quickly. I'm setting "Environment" to "production" or "staging" depending on some config file. I guess I could make it available earlier but I cannot hard code it. Currently I'm doing this in GameInstance::Init but having this as early as possible would be preferrable obviously.
Those are the docs I'm following when settings the environemnt.
https://docs.sentry.io/platforms/unreal/configuration/environments/
At the moment I disabled automatic initialization as a workaround. I guess I could also not use InitializeWithSettings and modify the settings myself even before the automatic initialization kicks in ...

@diekleinekuh You should be able to fix this by calling a Sentry subsystem's 'Close' method before re-initializing it with new the config values. Basically, it takes care of deregistering our custom output devices which apparently are the reason for those crashes described above.

@tustanivsky While you can still rely on the workaround suggested above it's a fair request to handle Sentry re-initialization in way that the plugin doesn't crash. I've made corresponding changes in #594 so the fix should be available in the next plugin release.

Thanks for taking care of the reinitialization @tustanivsky!


Add job init start timeout config

Context
Convert hard-coded constant to a job init start timeout with larger value to compensate SBN job start time lag.
Checklist

[ ] ./gradlew build compiles code correctly
[ ] Added new tests where applicable
[ ] ./gradlew test passes all tests
[ ] Extended README or added javadocs where applicable
[ ] Added copyright headers for new files from CONTRIBUTING.md

thanks for finding this and making the change...


How to write a code snippet generating current time?

VSCode Version: 1.14
OS Version: Ubuntu 14.04

I want to write a code snippet used to write the time when I write the code.
For example, I define a code snippet named timeit, and then when I write timeit, it will generate:

write on 2017.8.4

However, I don't know how to generate the current time. Please give me some advice. Thank you.

Reproduces without extensions: Yes/No

Yea, I'd like to know this as well.

@matt-erhart This extension https://marketplace.visualstudio.com/items?itemName=jsynowiec.vscode-insertdatestring can also insert date and time.
However, both this one and your extension need manual insertions. I wonder if the snippets can support to generate time automatically.
Anyway, thank you.

/duplicate of #10561


update extractor dockercontainers and YAMLs to support mounted fixed metadata

there's now a /sites/ua-mac/sensor-metadata directory on storage condo that will be kept up to date with git master. #497 added support to terrautils to use this local copy from disk.
we need to rebuild extractor docker containers to use the new terrautils 1.2 and update their yamls to include the repo in their mounts at /home/extractor/sites/...
will include PR for admin branch YAMLs:

[x] betydb
[x] bin2tif
[x] canopycover
[x] fieldmosaic
[x] flir2tif
[x] geostreams
[x] globus-receiver
[x] globus-uploader
[x] heightmap
[x] meantemp
[x] nrmac
[x] ply2las
[x] rulechecker
[x] sensorposition
[x] soilmask

and updates to each dockerfile:

[x] betydb
[x] bin2tif
[x] canopycover
[x] fieldmosaic
[x] flir2tif
[x] geostreams
[x] globus-receiver
[x] globus-uploader
[x] heightmap
[x] meantemp
[x] nrmac
[x] ply2las
[x] rulechecker
[x] sensorposition
[x] soilmask

Changes are done and deployed in most repos.
https://github.com/terraref/admin/pull/74
This admin PR needs to be merged and sync'd to wb-master then we delete and recreate the replication controllers and scale back up.

done & merged & deployed.


Udpate fn run doc

Add a section for using imperative and declarative functions at the same time.

Use the docs: prefix on the commit message(s) so we can filter out this from the release notes.

@mortent @frankfarzan Please review.


[Question] How to custom/module on/off with different color?

Below are the code to appear the recording on-air and off-air. Stuck on the off-air part.
For the on-air part, once i trigger the keybinding of the recording, the  On-air  will appear with red color on the waybar (this one working fine).
The only part that cant possible to make it work, is the part  Off-air , if not trigger by the keybinding of the recording. it should stay on the waybar with black color, instead that, it hide from the bar.
Below are the code (config & style.css)
"custom/recorder": {
        "format": " On-air",
        "format-disabled": " Off-air", //An empty format will hide the module.
        "return-type": "json",
        "interval": 1,
        "exec": "echo '{\"class\": \"recording\"}'",
        "exec-if": "pgrep wf-recorder",
    },

#custom-recorder {
    background-color: #FA8BFF;
    background-image: linear-gradient(45deg, #2BD2FF 0%, #2BD2FF 52%, #2BD2FF 90%);
    font-size: 12px;
    color:red;
}

With recording triggering

Without/Stop recording triggering

I was about to come submit a question, but this sounds roughly like what I am trying to do. Custom module which dynamically changes its appearance somehow (I was thinking of whether its possible to change the set of active classes, and then style them differently with css). Will watch this issue with interest.

@hossbeast prefer when toggle with key-binding, the appearance on the waybar (custom module) will change the color or when it format-disable the color will change same like the on used on network.

I see #network and #network.disconnected have different background-color properties. But how does the #network element gain and lose that .disconnected class? Since network is a builtin module, I assume the code for the network module is doing it. But how can a custom module gain and lose classes dynamically? Perhaps in response to a signal?
Keybinding does not work for my case, the change I have in mind is not something initiated by the user (similar to how network connected -> disconnected is not initiated by the user, its just reacting to the state of the system)

@hossbeast your ideal might not work for my case, since i need an input to trigger (custom module) than only it will changing the state from on to off.
Any how, you build it out, and i will tester it, to find out the outcome. :))

@BoomerangNebula will try it out, and will feedback to you. thanks


[BULK UPDATE] DocuTune - Fix build validation issues: docs-link-absolute (part 1)

Global effort to fix build validation errors
The Microsoft Skilling team is fixing build validation errors and specific brand inconsistencies in Microsoft technical documentation for the rest of FY23 Q1. This will help address various accessibility, security, and usability issues. This PR was generated using DocuTune. It includes only targeted fixes and minor formatting adjustments.
DocuTune PRs improve quality of technical content by finding and automatically correcting a broad set of issues only where the correction is suitable. Please review within five business days and merge or comment in the PR with any changes you'd like to see. Thank you!
CorrelationId: 0df9c2d6-63f8-4d1e-8b57-b33611a06514
InitiativeId: docutune-build-validation-issues-2022-05
PointOfContact: Alex Buck

#docutune-draft

Docs Build status updates of commit 1135771:
:bulb: Validation status: suggestions

File
Status
Preview URL
Details

mobile-blazor-bindings/advanced/access-native-controls.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/advanced/custom-components.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/advanced/dependency-injection.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/advanced/references.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/advanced/template-options.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/contribute/nightly-builds.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/index.md
:bulb:Suggestion
View
Details

mobile-blazor-bindings/ui/components-reference.md
:bulb:Suggestion
View
Details

README.md
:white_check_mark:Succeeded

mobile-blazor-bindings/advanced/access-native-controls.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/advanced/custom-components.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/advanced/dependency-injection.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/advanced/references.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/advanced/template-options.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/contribute/nightly-builds.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/index.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

mobile-blazor-bindings/ui/components-reference.md

Line 2, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

#docutune-wait

@lachlanwgordon
Please merge the changes in this PR. For more information, see the description at the top of this PR.
Any pre-existing build validation issues or insufficient Acrolinx scores should be addressed in a separate PR.
#docutune-request-approval


Geometry edition button not disappearing

Context
Certain user actions may produce the geometry edition button to remain on the map, even after clicking on other parts of the screen.
Steps to Reproduce

Create a map
Click on the layer and open POP-UP tab, select a popup template to see the list of columns to be shown
Click on any map feature to see the geometry edition button
Click on a checkbox to activate a column
Click on the text input and drag the cursor from the input to a zone inside the map

In order to reproduce the issue, the key is clicking only in the checkbox and dragging the cursor directly on the map. Any other action will make the button disappear
Current Result
Geometry edition button does not disappear
Expected result
The button should disappear when clicking anywhere on the screen.
cc/ @saleiva

I've been doing some research, and removing this preventDefault() solves the problem, but just for the checkbox, not for the slider for example, which has the same problem.
I'm not sure if the preventDefault is needed in this case, but I don't think that removing it is the best solution.
Let's wait and talk about it with @xavijam.

This is not as easy as it seems, in addition to the elements mentioned above, there are others that prevent the default's event and avoid propagation.

Yeah ^^^. I'd not pay so much attention to this issue right now. Let me remove it to the Kanban for the moment. Let's tackle it when needed.


clean up interface and docs

move Hardware description to docs.
move description of images to docs.

move the rest into docs.

done


Add support for dirFiles in FsMapper

Hello,
Pig commands do not support all commands required by Oozie actions.  We must come up with a better way to implement these tasks.
Thanks,

Does the problem only apply to dir-files or are there more functionalities missing?
In any case, we can just describe it in the README for now and work on supporting it later.


peer deps are out of date.

Peer deps are out of date. We're up to should 13 now.

@rkotze Did you mean published in 2.1.0 instead of 2.10.0? It's listed as current 2.1.0 on npm: https://www.npmjs.com/package/should-enzyme

oops, Yes I mean 2.1.0 👍


Make use of NumPy's array input validation in validate_arguments and shape_from_args

In #2597 , we first implemented this idea of using mock numpy arrays to take advantage of their input validation API. See the example here. This allows us to reduce lines of code and get the exact some error messages as NumPy if there are invalid inputs, thereby reducing some developer burden.
This could be done for many more atoms that have numpy analogs such as vstack, hstack and sum (AxisAtom).
Another side-related issue is that these errors will come from NumPy and could confuse cvxpy users. The ideal situation would be to get the NumPy error message and adapt it to our use-case (maybe just mention that this error was raised from cp.Concatenate for example).

I love this idea!
On Sun, Nov 3, 2024 at 5:14 PM William Zijie Zhang @.***>
wrote:

In #2597 https://github.com/cvxpy/cvxpy/pull/2597 , we first
implemented this idea of using mock numpy arrays to take advantage of their
input validation API. See the example here
https://github.com/cvxpy/cvxpy/pull/2597/files#r1825978426. This allows
us to reduce lines of code and get the exact some error messages as NumPy
if there are invalid inputs, thereby reducing some developer burden.
This could be done for many more atoms that have numpy analogs such as
vstack, hstack and sum (AxisAtom).
Another side-related issue is that these errors will come from NumPy and
could confuse cvxpy users. The ideal situation would be to get the NumPy
error message and adapt it to our use-case (maybe just mention that this
error was raised from cp.Concatenate for example).
—
Reply to this email directly, view it on GitHub
https://github.com/cvxpy/cvxpy/issues/2613, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACRLIFFJZK6NFUA6RQW5N4DZ62G5DAVCNFSM6AAAAABRDEFVZGVHI2DSMVQWIX3LMV43ASLTON2WKOZSGYZTCNJRGMZTAMY
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Could be something like this
# cvxpy/errors.py

class ShapeValidationError(Exception):
    """
    Custom exception for shape validation errors in CVXPY.
    This exception forwards NumPy shape errors while preserving
    the original error message and traceback.
    """

    @classmethod
    def from_numpy_error(cls, numpy_error):
        return cls(str(numpy_error)) from numpy_error

and then
import numpy as np

from cvxpy.errors import ShapeValidationError

class Hstack(AffAtom):
    """ Horizontal concatenation """
    def validate_arguments(self) -> None
        try:
            np.hstack(self.args)
        except ValueError as exc:
            raise ShapeValidationError.from_numpy_error(exc)


HBASE-27506 Optionally disable sorting directories by size in CleanerChore

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 36s
Docker mode activated.