problem with downloading data (t2t-datagen) for English to Spanish ( translate_enes_wmt32k)

Description
Hello! Thanks for adding en-es module and making it available!
I have ran into an issue when I tried to download data using 't2t-datagen' command.
It seems the data for translate_enes_wmt32k is not downloaded when using t2t-datagen command.
It works when i use translate_ende_wmt32k.
Some part of the error message that I get clearly show that spanish module is not part of the available one at the moment.  (there is no enes module appearing where it should be since things seem to be ordered alphabetically.)
I have tried installing through 'pip install tensor2tensor' as well as 'pip install git+https://github.com/tensorflow/tensor2tensor.git' to check if the last changes were not reflected for the official release.
Environment information
OS: Linux

$ pip freeze | grep tensor
mesh-tensorflow==0.0.5
tensor2tensor==1.13.4
tensorboard==1.14.0
tensorflow==1.14.0
tensorflow-datasets==1.1.0
tensorflow-estimator==1.14.0
tensorflow-metadata==0.14.0
tensorflow-probability==0.7.0

$ python -V
Python 3.7.3

### For bugs: reproduction and error logs

Steps to reproduce:

export PROBLEM=translate_enes_wmt32k
t2t-datagen --data_dir=$DATA_DIR --tmp_dir=$TMP_DIR --problem=$PROBLEM

In contrast, it works when I use english to german module for example by doing

export PROBLEM=translate_ende_wmt32k

Error logs:

ValueError: You must specify one of the supported problems to generate data for:
  * algorithmic_addition_binary40
...

  * translate_ende_wmt_clean_pc_clean32k
  * translate_ende_wmt_multi64k
  * translate_ende_wmt_multi64k_packed1k
  * translate_ende_wmt_pc32k
  * translate_ende_wmt_pc_clean32k
  * translate_enet_wmt32k
  * translate_enet_wmt_characters
  * translate_enfr_wmt32k

Hello @voluntadpear!  I have seen that you have trained the spanish part. Thanks !
Could I ask if it worked for you in following manner?
I see that it is added to the master branch, but should I have downloaded a specific branch?
Any comment would be welcomed, thanks in advance!

Hi @iamyihwa I didn't try it that way since I submitted the PR after I was able to use my problem definition for my training purposes.
I don't know the exact details with respect of the t2t releases but since it didn't work even after you used the code from the master branch, maybe there is a build step the maintainers have to make as part of the next release.
What you could do to try the spanish problem definition is copying the translate_enes.py file locally and use the --t2t_usr_dir flag to load the problem:
t2t-datagen --t2t_use_dir=$PROBLEM_DIR --data_dir=$DATA_DIR --tmp_dir=$TMP_DIR --problem=translate_enes_wmt32k

Good luck!

Thanks @voluntadpear for the help!
I just tried in the manner that you suggested.
However I get the same error.
(I have put the code translate_enes.py  in the PROBLEM_DIR, also i have tried both t2t_use_dir and t2t_usr_dir because the link that you reference to, and also your command  had both versions . )

t2t-datagen --t2t_use_dir=$PROBLEM_DIR --data_dir=$DATA_DIR --tmp_dir=$TMP_DIR --problem=translate_enes_wmt32k
t2t-datagen --t2t_usr_dir=$PROBLEM_DIR --data_dir=$DATA_DIR --tmp_dir=$TMP_DIR --problem=translate_enes_wmt32k

If you depend on functionality not listed there, please file an issue.
W0828 10:27:37.527163<PHONE_NUMBER>52384 deprecation_wrapper.py:119] From /home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3./site-packages/tensor2tensor/utils/expert_utils.py:68: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variabl_scope instead.
W0828 10:27:39.088318<PHONE_NUMBER>52384 deprecation_wrapper.py:119] From /home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3./site-packages/tensor2tensor/rl/gym_utils.py:219: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info istead.
W0828 10:27:39.092015<PHONE_NUMBER>52384 deprecation_wrapper.py:119] From /home/ubuntu/anaconda3/envs/SpanishTranslate/bin/t2t-dataen:27: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.
W0828 10:27:39.092154<PHONE_NUMBER>52384 deprecation_wrapper.py:119] From /home/ubuntu/anaconda3/envs/SpanishTranslate/bin/t2t-dataen:27: The name tf.logging.INFO is deprecated. Please use tf.compat.v1.logging.INFO instead.
W0828 10:27:39.092272<PHONE_NUMBER>52384 deprecation_wrapper.py:119] From /home/ubuntu/anaconda3/envs/SpanishTranslate/bin/t2t-dataen:28: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead.
I0828 10:27:39.092669<PHONE_NUMBER>52384 usr_dir.py:43] Importing user module t2t_problem from path /home/ubuntu/SpanishTranslate
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/bin/t2t-datagen", line 28, in
tf.app.run()
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3.7/site-packages/tensorflow/python/platform/app.py", line 40, inrun
_run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef)
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3.7/site-packages/absl/app.py", line 300, in run
_run_main(main, args)
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3.7/site-packages/absl/app.py", line 251, in _run_main
sys.exit(main(argv))
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/bin/t2t-datagen", line 23, in main
t2t_datagen.main(argv)
File "/home/ubuntu/anaconda3/envs/SpanishTranslate/lib/python3.7/site-packages/tensor2tensor/bin/t2t_datagen.py", line 196, inmain
raise ValueError(error_msg)
ValueError: You must specify one of the supported problems to generate data for:

@iamyihwa I think you also need to have a __init__.py file in the PROBLEM_DIR like they show in this example: https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/test_data/example_usr_dir
And PROBLEM_DIR should point to the directory containing the file and not the file itself.


increase upper bound on base

I don't want to bump this to 5.  I made a commit bumping it to 4.11 though.  Thanks for the ping!


Fix: Correct pointer comparison issue in MFRC522Extended.cpp

Fixed an issue in MFRC522Extended.cpp where the code incorrectly compared a pointer (backLen) with an integer.
Modified the conditional statements at lines 824 and 847 to properly check if backLen is not null and its value is greater than zero.
This resolves compilation errors related to ordered comparison of pointers with integers in the MFRC522 library.

Q
A

Bug fix?
yes

New feature?
no

Doc update?
no

BC breaks?
no

Deprecations?
no

Fixed tickets
#...

i have tested it with esp32 , it is working fine.
i am attaching the pic in which after successful compilation its gets uploaded...

Tested with esp32 and works!


Landfastice update

This PR basically swaps the backend for the landfast sea ice endpoint. The endpoint is functionally quite similar, but the geographic and temporal ranges are extended. The possible set of returned values is also a bit different. Check the refreshed template for details. Here's what to look for in this review (some of this was foreshadowed in our tech gardening / show+tell chat):
A new implementation of the DescribeCoverage request

Checkout the new function generate_wcps_describe_coverage_str in the generate_requests module. We're forming a request to describe the coverage using the WCPS describe() operator because we can get a response that is a well-formatted JSON that is far easier to parse than the prior XML/string babble. We'll see how this is used later on.
Next, look at the new generate_describe_coverage_url function in the generate_urls module - this just inserts the previous function's return into a URL so we can make the request.
Now, look at the new describe_via_wcps function in the fetch_data module  - this function is responsible for firing off the awaitable request and receiving the response.
None of these three functions are that much different that what we've been doing already, and some of the other functions could probably have been extended to accomplish the goal of describing coverages via the WCPS describe() operator - but I'm personally in favor of having functions that do one thing and one thing only when possible: this chain of execution where describe_via_wcps() calls generate_wcps_describe_coverage_str() and generate_describe_coverage_url()
has the sole purpose of fetching a coverage description in JSON format.

A new implementation of lat-lon request validation
The JSON-ified coverage description makes it so much easier to determine what spatial bounding box is valid for a coverage. With such bounding boxes, we can validate requests more precisely on a coverage-by-coverage basis, and can leverage the self-describing nature of OGC Coverages. Our current practice is to prescribe ad hoc bounding box prescriptions in config that are decoupled from the coverage they are referencing. So, there are a few new functions in the validate_request module to know about!

First, look at the get_x_y_axes() function - this will just ID and return which axes of the coverage have the spatial (i.e. X and Y) information.
Second, see the construct_latlon_bbox_from_coverage_bounds() function that constructs a lat-lon bounding box from the metadata returned by describe_via_wcps. These bounding boxes are just like those prescribed in our config.py and used in our existing validation scheme. Note that this function just returns the bounding box, and doesn't do any validation.
Third, take a look at the validate_latlon_in_bboxes() function that iterates through a list of bounding boxes and so long as the given lat and lon are within at least one of those boxes a True value is returned, and otherwise a 422 code is thrown. A list of bounding boxes is implemented because the landfast sea ice data is split between two coverages, and we need to know if a query lands in either one.
Next, look at validate_xy_in_coverage_extent() - at first glance this function might seem a bit redundant with the previous function. But this function is specific: it returns a boolean based on whether or not an x-y coordinate is within a single coverage's bounding box. One way to distinguish this function from the previous could be to think of it this way: This asks "Am in the bounding box for this specific coverage?" while the previous function asks "Am in the possible set of bounding boxes encompassed by this endpoint?"
Finally, there is a function called latlon_is_numeric_and_in_geodetic_range() that does the “bad request” part of the validation. This function splits out part of the existing functionality of the validate_lat_lon function, because the validate_lat_lon function actually doing two things: checking the bbox against the config prescription, and ensuring that the lat-lon is numeric and on planet Earth. Observe the repeated code between validate_lat_lon and validate_seaice_lat_lon. The new latlon_is_numeric_and_in_geodetic_range() function is a step toward DRY-ing the request validation, and is the first function in the validation tree for the updated landfast sea ice endpoint. Also, just to avoid confusion, the validate_seaice_lat_lon is not for the landfast sea ice endpoint considered in this PR.

Whew, OK, now to test the endpoint itself:

First, you need to modify the imports in routes/__init__.py to look like this (for details XREF #481):

# from .fire import *
# from .permafrost import *
# from .seaice import *
# from .taspr import *
# from .physiography import *
# from .boundary import *
# from .vectordata import *
# from .recache import *
# from .elevation import *
# from .alfresco import *
# from .degree_days import *
# from .snow import *

from .landfastice import *

# from .beetles import *
# from .eds import *
# from .wet_days_per_year import *
# from .indicators import *
# from .hydrology import *
# from .demographics import *
# from .cmip6 import *

Point the API at Datacubes aka Zeus:

export API_RAS_BASE_URL=https://datacubes.earthmaps.io/rasdaman

Now, try some requests that should not yield a valid data response.

Requests like these should trigger a 400 Bad Request template:

http://localhost:5000/landfastice/point/400/-12345/
http://localhost:5000/landfastice/point/foo/bar/

Requests like these should trigger a 422 and send you to a brand new invalid_latlon_outside_coverage template! Check out this template - what do you think? Suggestions? Also, please look at the code for the template itself closely as I had to lean on AI heavily here to figure out the leaflet JS part.

http://localhost:5000/landfastice/point/65/-145/
http://localhost:5000/landfastice/point/62/-172/

Requests like these should trigger a 404 No Data template.

http://localhost:5000/landfastice/point/71/-134/
http://localhost:5000/landfastice/point/71/-172/

Now, try some requests that should yield a valid data response. Some of these might take a while to complete, so you may need to refresh if it seems like they time out.

http://localhost:5000/landfastice/point/70.6123/-149.8869/
http://localhost:5000/landfastice/point/71.2926/-156.7956?format=csv
And here are some other lat-lons you might try for pixels that are in the ocean, but are near a named community:

Deadhorse: {'latitude': 70.2993, 'longitude': -148.4942}
Kaktovik: {'latitude': 70.1056, 'longitude': -143.6875}
Nuiqsut: {'latitude': 70.3527, 'longitude': -151.1869}
Prudhoe Bay: {'latitude': 70.3028, 'longitude': -148.3779}
Utqiaġvik: {'latitude': 71.2926, 'longitude': -156.7956}
Wainwright: {'latitude': 70.6301, 'longitude': -160.2603}
Candle: {'latitude': 66.0019, 'longitude': -161.933}
Cape Lisburne: {'latitude': 68.8687, 'longitude': -166.2243}
Deering: {'latitude': 66.0759, 'longitude': -162.7157}
Diomede: {'latitude': 65.7769, 'longitude': -168.8938}
Elephant Point: {'latitude': 66.2676, 'longitude': -161.3338}
Kivalina: {'latitude': 67.7282, 'longitude': -164.532}
Kiwalik: {'latitude': 66.0336, 'longitude': -161.8338}
Kotzebue: {'latitude': 66.8995, 'longitude': -162.5982}
Point Hope: {'latitude': 68.3447, 'longitude': -166.7331}
Point Lay: {'latitude': 69.7577, 'longitude': -163.052}
Shishmaref: {'latitude': 66.2569, 'longitude': -166.0729}
Tin City: {'latitude': 65.5707, 'longitude': -168.048}
Wales: {'latitude': 65.6087, 'longitude': -168.0923}

Closes #220
Closes #221

OK thanks for the review Craig! I think I've got it figure out: what I've done is break out the tolerance parameter into four directional components to prevent over-padding the bounding boxes and so that we only pad in the direction of where the distortion at the edge of the projected reference system will occur. I think the unexpected 500 we had earlier was because the coordinate wasn't landing in either of the projected bounding boxes.
I've also deployed the "nullify_with_max_intensity" function to prune the nodata values that were causing blanks in the CSV responses. I had to refresh my memory: this function will prune keys even when the same-level sibling key has data, which is the behavior we want here, vs. the less aggressive pruning that was in place prior.

@cstephen after chatting with @brucecrevensten I'm opting for the self-merge here. I'm reasonably confident that I addressed your comments and we can always iterate more upon this later. Onward!


Clear resourceVersion on errors.

LGTM
I really want to see a test that fails without this change-- I'm willing to try and write one if you're not planning on it


OOM depending on rmm version

Thank you for bringing this fantastic package to the community.
I inadvertently updated rmm and pylibraft-cu12 to version 24.10.0 and found that datasets with ~500k cells that I had previously had no problem running rsc.pp.neighbors on were consistently OOM'ng. When I downgraded those packages back to 24.2.0, I could run the datasets with no problem again. It seems that version 24.8.* also causes this OOM behavior. I am using rapids-single-cell version 0.10.10. Do you have any thoughts on this or suggestions as to which version is preferable in terms of accuracy of nearest neighbor graphs?
Thank you for your help and input!

I haven't really looked at this and personally didn't encounter the issue yet. What GPU are you using? Can you reporduce the issue with the 500k testdataset?


Book build failing

It looks like our JupyterBook is failing on an error with nbconvert. https://github.com/pangeo-data/jupyter-earth/runs/1368344069. @choldgraf: is this one you are familiar with?

Have a Léonie on top of me now so can't get to computer but my guess is that it has to do with the relative ordering of the dependencies in requirements. txt

myst-nb 0.10.1 requires nbconvert~=5.6, but you'll have nbconvert 6.0.7 which is incompatible.

I think then the solution is to make the myst-nb dependency go higher up, because only the first to declare the dependency seem to get its version constraints met.


Git commandline as Lib2git alternative

🚀 Feature Requests
Currently I'm facing some issues with Lib2Git(Sharp). It seems the git implementation differs from the native git implementation. Which results into bad (or not possible) repository interactions, e.g. when a (reverse) proxy is active or ssh-protocoll should be used.
I think it would be a great feature to give the user to possibility to enter the path to the git commandline as parameter in case the lib2git library is not enough
Contextualize the feature
Second implementation of IGitDriver beside LibGit2SharpDriver
additional optional parameter --gitcmdPath, which is null per default
Describe the feature
Implementation of a GitCmdDriver : IGitDriver which can be used as alternative to lib2sharpdriver.
Nukeeper should not ship git cmd, just give the option to use the installed git
Platforms affected (mark all that apply)

[X] :hammer_and_wrench: NuKeeper CLI
[X] :sparkles: GitHub
[X] :robot: AzureDevops
[X] :checkered_flag: Bitbucket
[X] :earth_americas: Gitlab
[X] :tv: Gitea
[] :whale: Docker

started implementation on my fork
3b372111c875a9f4fdb01a508189ede03f162ed7

its crazy the proxy issue immediately disappeared when using git cli

I stumbled over #659. Any information how this is ongoing?

I think this has been merged in. Can we close this issue?

Thanks for the work!


Data Contract - unable to enter bruteforce code

After finding the computer and getting the code It would not let me enter the full bruteforce code into the terminal.
entering "bruteforce <IP_ADDRESS>" and pressing enter would do nothing
however removing the last digit would allow it to be entered but the code would obviously then be wrong and I could not get the password and username from it.
"bruteforce <IP_ADDRESS>" would be enterable.

Pressing enter doing nothing on the terminal

Encountering the same issue. Running version 3.0.2

If you could provide logs which catch the moment you enter the IP address and nothing happening, I would appreciate it.

The cause of this issue is that vanila game removes the dots and tries to turn it into a number.
And since 215... is higher than the maximum possible value with Int32 (214...), it will give an error at casting.
We're looking into a fix for it at the moment.

A possible fix has been commited and will be live in next release.

3.0.4


f16 decoding incorrect.

I have a CBOR encoder/decoder for Lua which uses the canonicalization recommendations from the RFC, specifically that floating point values should be stored in the smallest representation that does not result in loss of information.  This provides a decent saving on structures that have a lot of floating point values many of which are just small integers.  Unfortunately this fails spectacularly for every value except 0.0 with the f16 decoding behaviour in rust-cbor.
An example correct decoding routine is available in Appendix D of the RFC.  The C version focuses on breaking down the f16 and building a new f32 float with ldexp.  The Python version uses bit manipulation to convert the f16 directly into an f32.

I'm not so good at writing Rust yet, but here's another option from Lua which doesn't use ldexp.
local function read_half_float(u16val)
    local neg = u16val & 0x8000
    local val = u16val & 0x7fff

    if val == 0 then return neg == 0 and 0.0 or -0.0 end -- Shortcut common case

    if val < 0x0400 then -- SubNormal
        return (neg == 0 and 0x1p-24 or -0x1p-24) * val
    end

    local single = (neg == 0 and 0x38000000 or 0xb8000000) + (val << 13)
    if val >= 0x7C00 then
        single += 0x38000000 -- Inf and NaN
    end
    return ("f"):unpack(("I4"):pack(single))
end

The unpack and pack step at the end is basically just a transmute.  The 0x1p-24 I'm not sure how to translate into Rust, but is equivalent to 2.0^-24.

Here's where the decoding happens: https://github.com/BurntSushi/rust-cbor/blob/master/src/decoder.rs#L151-L157
According to comments, my past self seems to have thought it was wrong too. :-)

I had a go at putting something together, I don't know enough about Rust design patterns to know if it's good or not, but here it is...
    let f: f32 = match (n&0x8000 != 0,((n&0x7fff) as u32) << 13) {
        (false,0) => 0.0,
        (true, 0) => -0.0,
        (false,x) if x < 0x00800000 => 7.27595761e-12f32 * (x as f32),
        (true, x) if x < 0x00800000 => 7.27595761e-12f32 * (x as f32),
        (false,x) if x < 0x0f800000 => unsafe { transmute (x+0x38000000u32) },
        (true, x) if x < 0x0f800000 => unsafe { transmute (x+0xb8000000u32) },
        (false,x) => unsafe { transmute (x+0x70000000u32) },
        (true, x) => unsafe { transmute (x+0xf0000000u32) },
    };

I wonder whether transmute is the right idea from a Rust safety point of view.  The code I provided is fine so long as you are certain that the floating point is IEEE, but if it is not then probably better to use the example C code and swapping the ldexp(x,y) calls with (x as f32) * (2.0f32).powi(y) or similar so that everything is safe and stable.  I wonder if the compiler/optimiser is smart enough to turn (x as f32) * (2.0f32).powi(y) into a bit-twiddle + transmute anyway.

How about optional https://crates.io/crates/half ?
Here hoping to see it in CBOR one day.


add system install powershell

Description

Add powershell as system install application
Motivation and Context

[x] I have raised an issue to propose this change, which has been given a label of design/approved by a maintainer (required)
Closes #1067

How Has This Been Tested?

Using command sudo ./arkade system install pwsh produced below output
Installing Powershell to /usr/local/bin
Installing version: v7.4.2 for: x64
Downloading from: https://github.com/PowerShell/PowerShell/releases/download/v7.4.2/powershell-7.4.2-linux-x64.tar.gz
67.69 MiB / 67.69 MiB [--------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00%
Downloaded to: /tmp/arkade-3499737583/powershell-7.4.2-linux-x64.tar.gz
Unpacking Powershell to: /usr/local/bin/powershell

If updating or adding a new CLI to arkade get, run:
go build && ./hack/test-tool.sh TOOL_NAME

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Documentation

[ ] I have updated the list of tools in README.md if (required) with ./arkade get --format markdown
[ ] I have updated the list of apps in README.md if (required) with ./arkade install --help

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I've read the CONTRIBUTION guide
[x] I have signed-off my commits with git commit -s

[ ] I have tested this on arm, or have added code to prevent deployment

Retested the command after changes and it produced below output
sudo ./arkade system install pwsh
Installing version: v7.4.2 for: x64
Installing Powershell to /opt/microsoft/powershell/7
Downloading from: https://github.com/PowerShell/PowerShell/releases/download/v7.4.2/powershell-7.4.2-linux-x64.tar.gz
67.69 MiB / 67.69 MiB [--------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00%
Downloaded to: /tmp/arkade-3612803353/powershell-7.4.2-linux-x64.tar.gz
Unpacking Powershell to: /opt/microsoft/powershell/7/powershell
Creating Symbolic link to: /usr/bin/pwsh


ios 8.12, iPad, empty canvas on larger pages

No issues on Android or desktop browsers, but get empty canvas for larger pages on iPad with IOS 8.1.2.  Without setting height and width canvas.toDataUrl() only returns the data header with no base64 value.  However, if I set the height and width to 800X600, it does return a base64 image.  However the image is transparent.
This is an excellent piece of work and I don't want to search for an alternative.  Is there anything I can do to help get this bug fixed?

Read this: http://stackoverflow.com/a/11585939/1518921

Possible duplica from:

https://github.com/niklasvh/html2canvas/issues/394
https://github.com/niklasvh/html2canvas/issues/183
https://github.com/niklasvh/html2canvas/issues/331


[poker] implement exercise

Refs https://github.com/exercism/erlang/issues/196

In reference to #278, please remove the test version related functions from the test, example solution, and module stub.
Instead, at the top of the test file, note the version of the canonical data it implements (1.1.0 at the time of this writing) and a link to the raw view of the canonical data on github, like this:
%% based on canonical data version 1.1.0
%% https://raw.githubusercontent.com/exercism/problem-specifications/master/exercises/poker/canonical-data.json

Otherwise, I'd say it's good :)

Thanks, done!

Thanks :)
Just one more thing, I might have overlooked that in your first commit (sorry): As a convention, the stub functions in the module skeleton should return undefined (your returns []. If you could change that, it's good to go :)

Oh, ok, sure. I guess I was just trying to follow my own spec for the function.

Merged, thanks :)


Still unable to fetch org.scala-sbt:compiler-bridge_2.12:1.0.3

(See the guidelines for contributing, linked above)
steps
Create a sample app with scala 2.12.5 and sbt 1.1.4
sbt compile
problem
Same as https://github.com/sbt/sbt/issues/3684
expectation
SBT should be able to fetch org.scala-sbt#compiler-bridge_2.12;1.0.3 and compile code.
notes
sbt version:1.1.4

in order to upgrade your build to sbt 1.1.4 you need to change the sbt.version in project/build.properties. the fact that it's still referring to 1.0.3 indicates (to me) that it's still using sbt 1.0.3.
try that.

DOH!
When IntelliJ created the SBT project, it put 1.0.3 in there for some reason. project/build.properties is another one of those "out of sight, out of mind" traps.
Thanks for the tip.

Interesting, I've never created an sbt project from within IntelliJ. Perhaps you could give that feedback and maybe they can make the selection more prominent. For sbt itself you can use the about command to get sbt information.


Select don't keep the old value after validation

Each time when is a validation on the page the select old value is reset.
This applies only if the Select is using fromModel or fromQuery as source.

This should be fixed with https://github.com/orchidsoftware/platform/pull/1675


Maintainer nit: please do dev in your own fork :-)

Every time I run git fetch, I get a bunch of remote branches added / removed that aren't really part of the repo proper. Eg, just now:
$ git fetch
remote: Counting objects: 9, done.
remote: Compressing objects: 100% (1/1), done.
remote: Total 9 (delta 8), reused 9 (delta 8), pack-reused 0
Unpacking objects: 100% (9/9), done.
From https://github.com/rust-lang-nursery/rustfmt
 * [new branch]      try-double-indent -> origin/try-double-indent

Since the repo lives under rust-lang-nursery now, I think it'd be better if you did dev in your own GitHub fork and made PRs from there. :heart:

Oh yeah, whoops, I keep forgetting to do this


Having trouble in cancel a upload process

Hi @FGasper
Thank you for your great work,
I am trying to add Zmodem support to electerm, I can manage to upload/download/cancel download, but can not cancel the upload, can you give example of cancel download?

To be honest, I’m not sure that that’s possible in zmodem. I don’t see anything in the protocol documentation about it.
What does sz do if it receives SIGINT while sending the file?

@FGasper Thank you, but I do not know sz process detail.

Hi @FGasper
Thank you for your great work
I am trying to add Zmodem support to xterm, can you give example of cancel upload？

@azuoge Look in xterm.js’s repository history for a plugin that I contributed a couple years ago but is incompatible with their new plugin API.


chore(ci): remove paths-ignore from CI workflow

While "optimal" to have these in place, they end up meaning that the CI workflow doesn't run but it is required for merge -- preventing non-repo-Admins from merging release PRs (mostly notably).

To see the specific tasks where the Asana app for GitHub is being used, see below:

https://app.asana.com/0/0/1208551821723692

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 75.47%. Comparing base (d58baef) to head (f67e062).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #572      +/-   ##
==========================================
- Coverage   75.55%   75.47%   -0.09%
==========================================
  Files          87       87
  Lines        7286     7286
==========================================
- Hits         5505     5499       -6
- Misses       1429     1435       +6
  Partials      352      352

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Update README defaults and config

Fixes #1020. I'm not at all sure about this and really just looking for feedback at this stage.
So I understand that the defaults come from this, but since quite a lot is done through variables and the old default section didn't have any of those I'm not sure what to do. Should I "resolve" those variables so that the true value is written out? This is what I have tried to do now for a few of them, but there are many more and I'm not sure if all of them should be included.
Let me know what you think! :slightly_smiling_face:

@paulfantom any input on this?

Awesome! Thanks! :100:


adding unit test files for the functions

need to write a separate unit test file
add a good amount of test cases

Please assign this to me.

@KuntiPatidar tests are added


🚀 Feature:

🔖 Feature description
You should add https://github.com/github/accessibility-alt-text-bot, or have another way (I'll volunteer!) to add alt-text to your images for accessibility.
🎤 Pitch
Since appwrite/pink is accessibility forward, alt-text on images is imperative to meet compliance standards. If you don't want to add a bot, I volunteer to make pull requests to add alt-text to your images. Accessibility is my thing.
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Can I Also Contribute In It? ! @Emmarie-Ahtunan

@shivanshu814, it's not my issue/feature to assign. I am making a suggestion. Best!

Interesting, didn't knew such an action exists 👀
Go ahead and feel free to contribute it to pink, will be a good guinea pig repo to potentially add it to other repos too.


Angular 11: ɵɵstaticContentQuery was not found

Which platform(s) does your issue occur on?

Android (not checked iOS, but think the same)
iOS/Android versions
emulator or device. What type of device?

Please, provide the following version numbers that your issue occurs with:

CLI: 8.0.1
Cross-platform modules: 8.0.5
Plugin: 4.0.29"

Please, tell us how to recreate the issue in as much detail as possible.
I clone the project and try to start demo-ng (clone git, replace ui-collectionview with npm registry version, run yarn and ns debug android)
Searching for devices...
Preparing project...
File change detected. Starting incremental webpack compilation...

webpack is watching the files…

These blocks are not intercepted by zone.js and will not triggering change detection.
See: https://github.com/angular/zone.js/pull/1140 for more information.
Webpack compilation complete. Watching for file changes.
Webpack build done!
Updating runtime package.json with configuration values...
Project successfully prepared (android)
Successfully transferred runtime.js on device ce07171741465ca00c.
Restarting application on device ce07171741465ca00c...
device: ce07171741465ca00c debug port: 40000

To start debugging, open the following URL in Chrome:
devtools://devtools/bundled/inspector.html?ws=localhost:40000

Successfully synced application org.nativescript.demong on device ce07171741465ca00c.
JS: HMR: Hot Module Replacement Enabled. Waiting for signal.
JS: Angular is running in development mode. Call enableProdMode() to enable production mode.
JS: ERROR Error: Uncaught (in promise): TypeError: Object(...) is not a function
JS: TypeError: Object(...) is not a function
JS:     at Object.CollectionViewComponent_ContentQueries [as contentQueries] (file: node_modules/@nativescript-community/ui-collectionview/angular/fesm2015/nativescript-community-ui-collectionview-angular.js:197:32)
JS:     at executeContentQueries (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:9618:0)
JS:     at Module.ɵɵelementStart (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:14838:0)
JS:     at ItemsComponent_Template (file: src/app/item/items.component.html:5:4)
JS:     at executeTemplate (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:9600:0)
JS:     at renderView (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:9404:0)
JS:     at renderComponent (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:10684:0)
JS:     at renderChildComponents (file: node_modules/@angular/core/__ivy_ngcc__/fesm2015/core.js:9269:0)
JS:     at renderView (file:///data/data/org.nativescript.demong/files/app/...

The same problem in my project. I have updated Angular and NS versions, no changes.

For anyone looking for a temporary fix, this just needs to rebuilt.

Download the repo as zip or clone it.
Run npm i --force in the root of the project to install dependencies.
Run npm run build.all
Navigate to where you need to use this project and run npm i /path/to/repo/packages/collectionview to install it from your local copy.

Idk much about this stuff but I hope this helps

@garsuga just rebuild without deps update? I can make a new release

I didn't do anything to update mine, just tried a build right away.

@garsuga could you try 4.0.30?

That fixed it for me.

Fixed for me as well, thanks


feat(netlify): Netlify functions tracing

:tada: This PR is included in version 1.12.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.12.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Malware Detected

I am trying to implement this in my project but when the kdmapper.exe is always detecting a false malware positive. I know it isn't but that's not what others think as on virustotal it's full of malware.

The problem is that at the end you are loading untrusted stuff on kernel apart that people can use this for different things then antivirus must detect it, you can remove basic detections with code modifications, mutations and packing etc but some antivirus already implement the protocol to detect when it drops the intel driver, load it and call IOCTL on bad ways etc
We can't do nothing about this


Please publish to npm

My bot can't run the new activities because you haven't published the updates to npm yet.
Merge https://github.com/RemyK888/discord-together/pull/49 before publishing please

Hello, the project has been updated, 2 new games are available with version 1.3.3
npm i discord-together@latest


Support for audio and video playback

any roadmap to provide video support also in this player?

Video playing is not supported, this is a music player


Patchcore: the value of nearest neighbor size

Thanks to your efforts,
I've noticed in the code of patchcore doing k nearest neighbor search,
the value of k is set to 9,
can I ask how to determine the value of k?
can I set k=1?

@clarezei, this would be application-dependent, but in our implemenation we tune this based on the mvtec benchmarks. You could potentially use our hyper-parameter search tool.


chore: bump reenableeta branch to current Lean4/mathlib4 master

🚫🤖🔍👀
I wanted to be able to try this out on current PRs, so updated everything. In particular this changes the lean-toolchain to point at a tag on my fork of the Lean4 repository.

Sorry the git diff is terrible.

This is failing on the issue discussed at the last porting meeting, and minimised at https://leanprover.zulipchat.com/#narrow/stream/270676-lean4/topic/Failure.20of.20TC.20search.20in.20.60simp.60.20with.20.60etaExperiment.60.2E

This is failing on the issue discussed at the last porting meeting, and minimised at https://leanprover.zulipchat.com/#narrow/stream/270676-lean4/topic/Failure.20of.20TC.20search.20in.20.60simp.60.20with.20.60etaExperiment.60.2E

And worked around by allowing aesop to use Subsingleton.elim.
This should all be compiling again. I think the relevant diff to look at is not the one github shows for this PR, but instead https://github.com/leanprover-community/mathlib4/compare/master...reenableeta-230503


[WIP] 2017 splash page

This will be the splash page to display until applications are open.
Please make PRs against this branch (feature/splash-2017), which will update this PR, so we can make a big deployment when everything is ready.
@jaredkhan @varkor

Though this is just meant as a blank canvas, might be worth updating the meta tags to include the right date now, just to make sure we don't forget later.

@varkor good point, could you make a PR for that?

Merging this in now...


replace lint workflow

The current bin/lint seemed to not lint at all but instead check for shellcheck vulnerabilities in a set of files.
This PR removes that file and its reference in the .github/workflows/ci.yml, then replacing with the official supported github/super-linter.
This action is not a linter per se, but an umbrella that calls different linters according to the language within each file.
Also note that the flag VALIDATE_ALL_CODEBASE = false means that only new and changed code will be scanned. This is by design due to the huge existing codebase in this repo.

Linting happens on a per-suite basis, we run script/ci-test for each ecosystem and it will lint the files for that test suite: https://github.com/dependabot/dependabot-core/blob/main/bundler/script/ci-test
This uses rubocop for linting which is the preferred linter for our ruby code. I think we'll want to keep this per-suite behavior because it gives us faster feedback on where any violating code lives, and we get to parallelize the work.

I'm going to close this out for now, as I don't think this change is going to do what was intended, but I'm definitely open to improving our linting setup, feel free to open up an issue to discuss it and tag me in it.


[9.x] Allows tls encryption to be used with port different than 465 with starttls

Resolve this issue: https://github.com/laravel/framework/issues/40887

@driesvints
hi man
is this PR accepted ?
cuz i cant see the change in my laravel project
laravel version  : 9.0.2
php version : PHP 8.1.2
my MailManager.php
        $transport = $factory->create(new Dsn(
            ! empty($config['encryption']) && $config['encryption'] === 'tls' ? 'smtps' : '',

@Hesammousavi will be released on Tuesday

For configuration smtp port 25 no encryption it fails with starttls error. Is there a way to solve this so it doesnt need a certificate?


[azure-cli] better default configuration to reduce chances of accidental data leaks

Description
The Azure cli has a tendency to be quite chatty and this can expose secrets stored in Azure in the logs of CI tools that run it.
See:

https://www.paloaltonetworks.com/blog/prisma-cloud/secrets-leakage-user-error-azure-cli/
https://github.com/Azure/azure-cli-extensions/pull/6793/

There are a number of sensible configuration settings that can be applied to greatly reduced the chance of this happening:
core.only_show_errors=true
core.error_recommendation=off
core.collect_telemetry=false
logging.enable_log_file=false

These can either be set using az config or registered as environment variables. The latter being more secure as the AzureCLI@2 task in Azure pipelines ignores the global config by default.
This way command output isn't echo'id to the log by default and also not written to disk where it can easily be intercepted.
Platforms affected

[X] Azure DevOps
[X] GitHub Actions - Standard Runners
[X] GitHub Actions - Larger Runners

Runner images affected

[X] Ubuntu 20.04
[X] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[ ] macOS 13
[X] Windows Server 2019
[X] Windows Server 2022

Image version and build link
N/a
Is it regression?
no
Expected behavior
Azure-cli is configured with sane CI/CD defaults.
There is an extension to Azure cli called init which provides sane automation defaults.
Actual behavior
Azure-cli is configured in standard interactive mode.
Repro steps
https://www.paloaltonetworks.com/blog/prisma-cloud/secrets-leakage-user-error-azure-cli/

Hello, @jessehouwing. Thank you for your suggestion, but we prefer to use default settings since they are common for everyone. If you would like to change some behavior of Azure-cli you can try to do it in runtime.


Uncaught Error: The workspace can only contain one instance of item [object Object]

[Enter steps to reproduce below:]

Open tree panes and load different files
Move around with ALT+- / _
(Optional) When settings window is opened, the symptom becomes even worse. One of the source code content occupies 'Settings' window and the original source code window goes completely blank.

Atom Version: 0.190.0
System: linux 3.13.0-48-generic
Thrown From: last-cursor-position package, v0.8.0
Stack Trace
Uncaught Error: The workspace can only contain one instance of item [object Object]
At /usr/share/atom/resources/app/src/item-registry.js:11

Error: The workspace can only contain one instance of item [object Object]
  at ItemRegistry.module.exports.ItemRegistry.addItem (/usr/share/atom/resources/app/src/item-registry.js:11:15)
  at PaneContainer.module.exports.PaneContainer.addedPaneItem (/usr/share/atom/resources/app/src/pane-container.js:369:25)
  at /usr/share/atom/resources/app/src/pane-container.js:357:26
  at Emitter.module.exports.Emitter.emit (/usr/share/atom/resources/app/node_modules/event-kit/lib/emitter.js:82:11)
  at Pane.module.exports.Pane.addItem (/usr/share/atom/resources/app/src/pane.js:305:20)
  at Pane.module.exports.Pane.activateItem (/usr/share/atom/resources/app/src/pane.js:276:14)
  at Object.module.exports.previous (/ml/Users/MAGICLEAP/jsong/.atom/packages/last-cursor-position/lib/last-cursor-position.coffee:86:39)
  at atom-workspace.disposables.add.atom.commands.add.last-cursor-position:previous (/ml/Users/MAGICLEAP/jsong/.atom/packages/last-cursor-position/lib/last-cursor-position.coffee:59:46)
  at CommandRegistry.module.exports.CommandRegistry.handleCommandEvent (/usr/share/atom/resources/app/src/command-registry.js:242:29)
  at /usr/share/atom/resources/app/src/command-registry.js:3:61
  at KeymapManager.module.exports.KeymapManager.dispatchCommandEvent (/usr/share/atom/resources/app/node_modules/atom-keymap/lib/keymap-manager.js:521:16)
  at KeymapManager.module.exports.KeymapManager.handleKeyboardEvent (/usr/share/atom/resources/app/node_modules/atom-keymap/lib/keymap-manager.js:356:22)
  at HTMLDocument.module.exports.WindowEventHandler.onKeydown (/usr/share/atom/resources/app/src/window-event-handler.js:180:20)

Commands
     -6:01.2 pane:show-next-item (atom-text-editor.editor)
     -5:59.0 pane:show-previous-item (atom-text-editor.editor.is-focused)
     -5:58.5 pane:show-next-item (atom-text-editor.editor)
     -5:58.3 core:close (atom-text-editor.editor.is-focused)
     -5:36.5 core:confirm (atom-text-editor.editor.mini)
  2x -0:50.8 last-cursor-position:previous (atom-text-editor.editor)
  2x -0:49.0 last-cursor-position:next (atom-text-editor.editor)
     -0:41.9 window:decrease-font-size (atom-text-editor.editor)
  5x -0:39.9 last-cursor-position:previous (atom-text-editor.editor)
 12x -0:37.3 last-cursor-position:next (atom-text-editor.editor)
 25x -0:35.0 last-cursor-position:previous (atom-text-editor.editor)
 31x -0:30.9 last-cursor-position:next (atom-text-editor.editor)
     -0:13.1 fuzzy-finder:toggle-file-finder (atom-pane.pane)
     -0:07.3 core:move-down (atom-text-editor.editor.mini)
     -0:07.1 core:confirm (atom-text-editor.editor.mini)
 15x -0:03.7 last-cursor-position:previous (atom-text-editor.editor.is-focused)

Config
{
  "core": {
    "themes": [
      "one-dark-ui",
      "atom-dark-syntax"
    ],
    "disabledPackages": [
      "symbols-view",
      "whitespace"
    ],
    "destroyEmptyPanes": false
  }
}

Installed Packages
# User
atom-ctags, v2.6.1
autocomplete-plus, v2.9.0
last-cursor-position, v0.8.0
project-manager, v1.15.5

# Dev
No dev packages

This is more complicated than I thought it would be. Working on it when I have time, but in the meantime working with panes will probably cause issues with the package.

Can confirm this is still an issue

+1

+1

+1

+1

+1

+1

+1

+1

+1

+1

+1

+1

Need help for this one. Anyone has a clue?

+1


Update Composer dependencies (2022-05-29-00-11)

Visual regression test passed!
View the visual regression test report


transformsWithOnePath NaN

<svg xmlns="http://www.w3.org/2000/svg" width="1000" height="1000" viewBox="0 0 1000 1000"><path d="M791 541H541v250h-82V541H209v-82h250V209h82v250h250v82z"/></svg>

config:
transformsWithOnePath: {
  width: 16,
  height: 16,
}

output:
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 1000 1000" width="16" height="16"><path d="M12.656 8.656HNaN NaNl0 4l-1.312 0VNaN NaNHNaN NaNl0-1.312l4 0VNaN NaNl1.312 0l0 4l4 0l0 1.312z"/></svg>

In addition, viewbox is not resized. https://github.com/svg/svgo/issues/547

Yes, the plugin is a bit outdated since it relies on the fact that paths use only relative commands, which is no true for a long ago.

@TrySound I believe the plugin has been removed so this could be closed too.


PREP: updating pkg data dirs to fix metagenome prepare failures

Hey @misialq, I noticed some test failures in moshpit from last weekend's Prepare PR for metagenome. Looks like some package data was missing - so I've just opened this PR up on a Prepare- branch which will allow me to re-run an actual Prepare (PR here) for metagenome to confirm that this will fix the problem.

/q2ci

closing in favor of the same changes under a Language- branch name (PR here). We updated this with the python 3.9 migration, so these kinds of changes will only be picked up with a Language- branch (vs. a Prepare branch) - although I suspect we should fix this so both are accepted.


Adding DDragon typing

I don't agree with the linter on how it wants to format some of the lines in the champion section. It makes it harder to read. I'm not a lint guru so I'm not sure how to prevent it from doing that, so I just manually removed it. That's not really useful going forward since you would have to do that every time the linter is run. Here is what it wanted to do:
getDataByIdWithParentAsId: () => KaynDDragonRequest<
    dtos.DDragonChampionDTO
>
listDataById: () => KaynDDragonRequest<
    dtos.DDragonChampionListDTO
>
listDataByIdWithParentAsId: () => KaynDDragonRequest<
    dtos.DDragonChampionListDTO
>
listFullDataById: () => KaynDDragonRequest<
    dtos.DDragonChampionDTO
>
listFullDataByIdWithParentAsId: () => KaynDDragonRequest<
    dtos.DDragonChampionDTO
>

sorry, I've been MIA. this is very useful. For the linter thing, that's probably related to prettier. I'll look into it.

No worries, I was downloading the tarball myself and parsing everything out but then remembered that you have DDragon endpoints here and figured I would take a stab at making the interfaces. The only real annoyance is on things like the item or champion endpoints where instead of having an array of items it has a single object with each item being a property. To get that to be typed properly I used this format:
{ [key: string]: T }
You can then use something like Object.keys(obj).map() to iterate over them and pull out the IDs or champion names. If you know the champion name, say you create a function specifically for Akali, you can access her information like this and it is perfectly valid syntax and you will get proper hints for everything before and after the champions name, but sadly not the champion's name itself:
(await kayn.DDragon.Champion.listDataByIdWithParentAsId()).data.Akali.blurb;
This way when Riot adds a new champion, we don't have to modify the interface but we lose the Intellisense being able to see all the champions on the data object.

@raitono
Here is a commit that adds prettier lint configs for both the regular JavaScript code as well as the TypeScript code. The configuration files are mainly the same, but the TypeScript one has an additional printWidth: 140 to allow for more characters to fit in one line. Another option is reducing the tabWidth from 4 to 2, and then reducing the printWidth. However, I think this is fine, since the "code" is more like just "types" and is not an actual program.
yarn lint will run these linters cleanly. :P It'd be cool if I had it in a pre-hook script somehow before git pushes too though haha..

I looked at hooks one time and was disappointed to see that they are local only. Unless you bypassed it somehow, they don't get pushed to the repo. I always thought it would be a nice way to enforce standards for the code base, but there are others who argue against it. Mostly about security and stuff.
I do like the slightly longer line widths here. Prevents it from getting too strange.


Wrong Link in opensource.facebook.com

Broken Link ( Not exactly related to yoga )
Yoga's website link is referring to https://facebook.github.io/watchman/ at https://opensource.facebook.com/#frontend

( Sorry, I don't know where to issue this little problem, so i issued it in here )

The Meta open source webpage is no longer the same as when this issue was filed.


Update http4s-client, http4s-core, ... to 0.21.22

Updates

org.http4s:http4s-client
org.http4s:http4s-core
org.http4s:http4s-dsl

from 0.21.18 to 0.21.22.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.http4s" } ]

labels: library-update, semver-patch

Superseded by #448.


Planetside Arrivals screen no longer shows time for shuttle arrival or departure

Description

The screens at arrivals should show the arrival time of the shuttle and how long till departure.
Reproduction

Spawn in at arrivals
Screenshots

Additional context

I think this was broken in #31823 where the screen network channel was set to wireless
@ScarKy0

@slarticodefast
Yup realized this as soon as I left for school
Will fix when Im home


[BEAM-3972] Translate portable batch pipelines by proto

Note that Flink does not provide a way to make assertions on the output graph shape and we can't yet execute ExecutableStages. The plan is to test translation end-to-end by ValidateRunner tests once the missing pieces are in.

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.

[x] Run ./gradlew build to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Looks like this also needs a rebase.

LGTM. Will wait for builds to finish before approving.

All precommits appear to be passing now. I'm going to go ahead and clean up commit history.

The translator isn't wired and FlinkJobServerDriver isn't in master yet, is there a separate JIRA for that?

Run Dataflow ValidatesRunner

Run Dataflow ValidatesRunner

Run Dataflow ValidatesRunner

Run Dataflow ValidatesRunner


upgrade base image to debian:bookworm

What this PR does / why we need it:
upgrades base image from debian bullseye to bookworm
Resolves following CVEs:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

Steps to reproduce

Does this PR introduce a user-facing change?

Does this PR require documentation?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@devinturner thanks for this. I've pulled these changes into https://github.com/replicatedhq/kots/pull/4122 along with some upgrades of our other KOTS images. Going to close this PR in favor of https://github.com/replicatedhq/kots/pull/4122.


Show suspicious log when error happened

When running yarn devphase contract test, it shows the error below:
  1) "before all" hook in "{root}"
[Test] Global teardown start
[Test] Stopping stack
[Test] Global teardown done

  0 passing (13s)
  1 failing

  1) "before all" hook in "{root}":
     Exception: Timeout
      at Timeout._onTimeout (node_modules/@devphase/service/dist/utils/timeout.js:11:50)
      at listOnTimeout (node:internal/timers:557:17)
      at processTimers (node:internal/timers:500:7)

Without additional explanation or context, it's hard to figure out why it got a timeout. After checking logs/<datetime>/pruntime.log, I found:
Failed to launch API server: Bind(Os { code: 98, kind: AddrInUse, message: "Address already in use" })

which is very helpful to diagnose the problem. Do you think it's possible to show the error the the user when it happens during setting up the stack? Or at least, give a pointer to the log file path so that the user can know where to check. E.g.:
You can find the logs here:
- Pruntime: logs/<datetime>/pruntime.log
- Node: logs/<datetime>/node.log
- ....

Logs are not always saved - it can be modified via config file.
I think it would be good to present few lines from output of failing component.
Done in v0.6.3


Use radix sort to speed up the sorting of deleted terms

Description
Recently, we captured a flame graph in a scene with frequent updates, which showed that sorting deleted terms occupied a high CPU ratio.
In scenarios with many deleted terms, most terms could have the same field name. So a data structure like Map<String, Map<BytesRef, Integer>> instead of Map<Term, Integer> could be better here —— We can avoid field name compare and use MSBRadixSort to sort the bytes for each field.
We can also take advantage of BytesRefHash to implement Map<BytesRef, Integer> to get a more efficient memory layout, and there's already a MSBRadixSort impl in BytesRefHash we can reuse.
Benchmark
We benchmarked the sort logic for 1,000,000 terms, showing 66% took decreasing:

| Baseline | Candidate | Took Diff
-- | -- | -- | --
total took | 692 | 234 | -66.18%

An E2E benchmark that delete document with term 1,000,000 times showing took decreased 43% (with default iw config).

| Baseline | Candidate | Took Diff
-- | -- | -- | --
total took | 1629 | 923 | -43.34%

Thanks @jpountz !


[vault-operator] Make etcd image repositories configurable

Add support for the spec.repository and spec.pod.busyboxImage fields of the EtcdCluster resource created by the vault operator.
This is necessary when you have to pull all images from a private registry.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Could you please sign the CLA @mgruener ?


Tag release for EdDSA support

There are a few projects that I'm following that utilize ssh-streams for SSH tunneling. It would be great to get this functionality tagged for release if possible so they can pull it into their workflow. Trying to switch everything over to EdDSA during migrations.

It's not that simple, there isn't a node release yet that supports the necessary APIs (along with OpenSSL 1.1.1+) to utilize EdDSA. I was just incorporating the code so it will be ready when that time comes. Right now those APIs will be available at least in the upcoming node v12.0.0. I'm not sure if they will be backported to older branches or not yet.

@mscdex GTK. Guess I'll get to hang onto RSA for the time being!


Twitter Bootstrap Customize LESS error : error evaluating function darken: Object # has no method 'toHSL'

{"type":"undefined_method","message":"error evaluating function darken: Object # has no method 'toHSL'","filename":"bootstrap.css","index":4516,"line":163,"column":34,"extract":["@navbarBackgroundHighlight:       #ffffff;","@navbarBackground:                darken(@navbarBackgroundHighlight, 5%);","@navbarBorder:                    darken(@navbarBackground, 12%);"]}
It occurred when I passed 'dimGray' as @navbarBackgroundHighlight's value; using '#696969' works perfectly

I personally had 2 hashes. ##FFFFFF, Was pretty hard to spot as the error location was pretty vague and only occurred in the mixin. No stack trace to see what the caller was.

@glennweb - Thanks! I too had 2 hashes. Didn't see it until I read your comment!

Same thing here! I had ##


Broadcasting rzSliderForceRender in Angular 1.5 components

I'm using this beautiful library in an Angular 1.5 app with components. Thank you very much for your efforts. I need to rzSliderForceRender certain sliders after ng-show. The broadcast functionality isn't available by default on the components in ng 1.5 which makes this example  not too easy to copy. Any ideas how to proceed easily? Cheers and thanks!

With components, you can still inject the $scope object:
function ExampleController($scope, $timeout) {
	var ctrl = this;

	ctrl.refreshSlider = function () {
		$timeout(function () {
			$scope.$broadcast('rzSliderForceRender');
		});
	}
}

angular.module('test').component('testComponent', {
  templateUrl: 'testComponent.html',
  controller: ExampleController
});

@ValentinH : superb, thank you very much for your help. Cheers!


Can we select other files also?

This is a feature enhancement. Instead of selecting only image files from storage can we allow the user to select other files(like pdf, doc).

No, this is react-native-IMAGE-picker.


Deploying an ASP.Net Web API (Core or Not) to IIS on Azure running SendGrid

We already have ASP.Net Web API Core services running on Azure under IIS. The problem is the existing example for IIS configuration (written for IIS 7.5) of SendGrid makes no sense given that Azure 1) doesn't allow creation of an SMTP server, and 2) doesn't run IIS 7.5, but it runs IIS 10.
Can someone post exact steps, if any, to ensure that we can run our SendGrid C# ASP.Net Core API on an Azure virtual machine under IIS on Azure?
I should mention that we're doing this because our client HTML5 web apps, which call our web services, are also running on the same IIS instance and referenced within the same domain.
What we don't want to do is get into the complexity of running a custom Azure API running SendGrid on some other server/cloud instance not sharing the same domain. Though I understand the reason for doing this for some scalability, this is out of scope for what we need to more simply accomplish.
It's already disappointing that we can't directly host SMTP on Azure, but have to use a SendGrid as a third party product to accomplish the same functionality for our user.  Almost every web app on the planet needs to perform SMTP services, and this thus defeats any simplicity of using Azure for Web App hosting.

There are a couple of options for sending mail that are outlined here.

Cool scenario, but doesn’t seem that straightforward to implement. Seems to
have additional closed architecture dependencies such as Azure SQL and
Active Directory authentication. Maybe the latter’s only for the service
accounts which is ok. But what if the solution doesn’t use a Microsoft
RDMS? What if it uses OAUTH2 and not Active Directory for security?
On Tue, May 28, 2019 at 5:47 PM Michael Crump<EMAIL_ADDRESS>wrote:

Closed #18 https://github.com/microsoft/AzureTipsAndTricks/issues/18.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/microsoft/AzureTipsAndTricks/issues/18?email_source=notifications&email_token=ABRVAFJZ747HNU3F2PLYKW3PXWR5NA5CNFSM4HMZGLS2YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGORV2KELY#event-2373231151,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABRVAFPLGUY4GMHMLRLDVULPXWR5NANCNFSM4HMZGLSQ
.

--
David Evan Karasek
<EMAIL_ADDRESS>


sbt 1.4.2 prints control characters for colors with sb.log.noformat=true

steps
In Jenkins, run sbt 1.4.2 with sbt.log.noformat=true.
problem
When running sbt 1.4.2 in Jenkins with sbt.log.noformat=true control characters are printed.
+ sbt -Dsbt.log.noformat=true compile
[info] welcome to sbt 1.4.2 (Private Build Java 1.8.0_272)
[info] loading settings for project global-plugins from build.sbt,metals.sbt ...
[info] loading global plugins from /home/wg01018/.sbt/1.0/plugins
[info] loading project definition from /tmp/project
[info] set current project to tmp (in build file:/tmp/)
[info] Executing in batch mode. For better performance use sbt's shell
[success] Total time: 0 s, completed Nov 2, 2020 7:25:28 PM

expectation
I would have expected similar output as when running with sbt.color=false.
+ sbt -Dsbt.color=false compile
[info] welcome to sbt 1.4.2 (Private Build Java 1.8.0_272)
[info] loading settings for project global-plugins from build.sbt,metals.sbt ...

[info] loading global plugins from /home/wg01018/.sbt/1.0/plugins

[info] loading project definition from /tmp/project
[info] set current project to tmp (in build file:/tmp/)
[info] Executing in batch mode. For better performance use sbt's shell
[success] Total time: 0 s, completed Nov 2, 2020 7:25:37 PM

This was fixed in #6044 by @eatkins


Add CMU_ARCTIC dataset

🚀 Feature
As for now, there is no such dataset in torchaudio.datasets.
More information about it can be found on official website: http://www.festvox.org/cmu_arctic/
List of all available speakers:  http://www.festvox.org/cmu_arctic/packed/
Motivation
This dataset can be useful in some tasks (learning a voice embedding, voice cloning, TTS, STT).
It's rather small, so can be applicable for research purposes.
Pitch
from torchaudio.datasets import CMU_ARCTIC works.
If it's OK, I can work on this next week.

Thanks for suggesting this! Let's take a little bit of time to discuss choice of datasets that would be good to add: #550. Thoughts?

Since we do not yet have too many datasets, I'll say that, if you are willing to open a pull request implementing this dataset following our current templates, I'll be happy to review it. :)

Yes, I'll do it on this weekend.


Align fonts in SVGs

Using 'Avenir Next', 'Inter var', 'Inter', Helvetica, Arial, sans-serif

I think you did that cleanup before, right? Does this happen when I (Windows) open those files and edit them? I thought it would also in that case use the fonts that you had configured. Just trying to avoid reverting your changes by mistake :)


Fix issues running on Julia 0.5.0 by replacing obsolete type signatures

Removes deprecated type signatures (Uint8 becomes UInt8 for example).  Tests failed on Julia 0.5.0 prior to changes, tests pass afterwards.  Built on macOS Sierra.

Coverage increased (+0.4%) to 9.951% when pulling 08212d99d00d80b3416fed4139854dd67ff8ee7a on iramiller:pull-request/08212d99 into 1e0dd2adfc4eec5a2aaacc1a9eead40eb3e02652 on danielsuo:master.

Coverage increased (+0.4%) to 9.951% when pulling dcf5396f67e8fc87f05958ccf67ea9f585aaca6c on iramiller:pull-request/08212d99 into 1e0dd2adfc4eec5a2aaacc1a9eead40eb3e02652 on danielsuo:master.


Add billing URL to PaaS Admin

What
We've broken our pipelines, as we're deploying an application that is
going to fail due to missing environment variable.
This should be addressed in already backlogged story that will enable
tagging for that application.
How to review

See if the changes make sense
I'd say run through pipelines, but it's a blocker for staging. Perhaps unblock the pipeline and test on staging?

Haven't tested, but makes sense and I'll watch staging.


Feature Request: Allow importing / exporting Toolscript from an app

exporting tool script is an action I need to use often when I need to search across the app (both components and raw queries), having it accessible through the CLI would immensely improve the flow.

Hey @amrawadk, very valid request!
I was able to easily add JSON exporting in https://github.com/tryretool/retool-cli/commit/f064de7e033a5aa1c689963ac4adde4db2812165. If you update to the latest version (1.0.26) via npm install -g retool-cli, you should be able to use the new command.

Unfortunately, toolscript exporting is a little trickier, that code is more closely tied to the Retool frontend. Hope JSON exporting is enough for your use case!


please provide complete working code so that newbies would be able to grasp how to use

please provide complete working code so that newbies would be able to grasp how to use

you can point to indian stock market code that woud be more helpful
Thanks

I tried to search working example code but not successful,phew

This project is in a very early stage, not much documentation has been created yet.
Readme is pretty much sufficient for getting started, just read it carefully. You need to load your data and give it to the indicator object. There is nothing required to be specific to Indian markets, this is general purpose, and can be used for candles from any market
This is an open-source project, and if you find problems in this you are free to contribute.


Revert "stack_data"

Reverts friendly-traceback/friendly-traceback#3
In addition to having a failing test with Python 3.10 and the loss of source code in the friendly-console, the removal of the special handling of NameError resulted in losing the underlining of the unknown names (see, for example, how "python" is underline in https://friendly-traceback.github.io/docs/tracebacks_en_3.9.html#custom-name).  Furthermore, the number of lines shown in the traceback (answer to "where()") occasionally varied quite significantly.
Still, I am convinced that using stack_data is the way to go.
I'm going to study what was done an reintroduce changes one at a time

I'm going to study what was done an reintroduce changes one at a time

Now that executing and stuff is sorted, did you end up doing everything in the original PR? I know you did some of it (e.g. https://github.com/friendly-traceback/friendly-traceback/commit/533b75e00cfbe1c61848314a3d7b929e9fc308e2). Run into any problems?

As far as I can remember, I reintroduced everything, and things are working out as well as I could have hoped for.
I (initially) had to do a few additions to "protect" against some problems, such as noted on
https://github.com/friendly-traceback/friendly-traceback/blob/eec78864636865cf9d6259812432929532f4941b/friendly_traceback/core.py#L126
and
https://github.com/friendly-traceback/friendly-traceback/blob/eec78864636865cf9d6259812432929532f4941b/friendly_traceback/core.py#L192
although this last one is likely not needed anymore.
And, I have just noticed that I have a whole bunch of commented-out code in that file which I never removed.

Furthermore, the number of lines shown in the traceback (answer to "where()") occasionally varied quite significantly.

This is expected given the way stack_data divides context into pieces rather than individual lines. Did you end up getting used to it?

So far, everything is fine. I suspect that beginners will not write many long multi-line statements, so this should never be a problem.


Add a new attribute wrapper __no_sanitize_address and use where needed

This PR addes a new attribute wrapper, __no_sanitize_address, to tell address sanitizer (ASAN) that it should not instrument some code; this attribute warper can be applied to functions and global variables.
Further this PR adds __no_sanitize_address to variables placed in a section to prevent instrumentation of the variables by the clang address sanitizer. If the variables would be instrumented with red zones and the code assumes that the variables are back-to-back this would break the code.
For more info see: google/sanitizers#1028

Blocked by pr #19587

@vanwinkeljan do you intend to continue this PR? The blocking issue has been merged.

do you intend to continue this PR? The blocking issue has been merged.

@dleach02 this PR is just waiting for review, the blocking PR was merged on 4 Oct 2019 and the blocking label was removed on 5 Oct 2019


Lingering ThreadLocals after graceful shutdown

After gracefully shutting down all Netty resources (channels, event loop groups, etc.), Netty leaves behind a number of ThreadLocal instances. In some contexts (e.g. servlet containers), this will yield complaints about potential memory leaks. I'm not sure if resources are actually leaking or if the warning is harmless.
Writing a concise, standalone example that detects lingering ThreadLocal instances would be a little dicey, so I've opted to demo this with Tomcat 7. Here's an example listener that minimally reproduces the problem:
@WebListener
public class ContextLifecycleListener implements ServletContextListener {

	private NioEventLoopGroup eventLoopGroup;
	private Channel channel;

	@Override
	public void contextInitialized(final ServletContextEvent context) {
		this.eventLoopGroup = new NioEventLoopGroup();

		final Bootstrap bootstrap = new Bootstrap()
		.group(this.eventLoopGroup)
		.channel(NioSocketChannel.class)
		.handler(new ChannelInitializer<SocketChannel>() {
			@Override
			protected void initChannel(final SocketChannel channel) {}
		});

		final ChannelFuture connectFuture = bootstrap.connect("netty.io", 80);

		try {
			connectFuture.await();
			this.channel = connectFuture.channel();
		} catch (InterruptedException e) {
			throw new RuntimeException(e);
		}
	}

	@Override
	public void contextDestroyed(final ServletContextEvent context) {
		if (this.channel != null) {
			try {
				this.channel.close().await();
			} catch (InterruptedException e) {
				throw new RuntimeException(e);
			}
		}

		if (this.eventLoopGroup != null) {
			try {
				this.eventLoopGroup.shutdownGracefully().await();
			} catch (InterruptedException e) {
				throw new RuntimeException(e);
			}
		}

		try {
			// Sleep to let the GlobalEventExecutor finish up.
			// See https://github.com/netty/netty/issues/2084.
			Thread.sleep(5000);
		} catch (InterruptedException e) {
			throw new RuntimeException(e);
		}
	}
}

Tomcat complains about lingering ThreadLocal instances when the server is shut down:
INFO: Stopping service Catalina
May 31, 2014 12:21:24 PM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
SEVERE: The web application [/NettyThreadLocalTest] created a ThreadLocal with key of type [io.netty.util.Recycler$1] (value [io.netty.util.Recycler$1@61beb1cd]) and a value of type [io.netty.util.Recycler.Stack] (value [io.netty.util.Recycler$Stack@2e8b3bdd]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
May 31, 2014 12:21:24 PM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
SEVERE: The web application [/NettyThreadLocalTest] created a ThreadLocal with key of type [io.netty.channel.ChannelHandlerAdapter$1] (value [io.netty.channel.ChannelHandlerAdapter$1@3707420a]) and a value of type [java.util.WeakHashMap] (value [{class ContextLifecycleListener$1=true}]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
May 31, 2014 12:21:24 PM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
SEVERE: The web application [/NettyThreadLocalTest] created a ThreadLocal with key of type [io.netty.util.internal.ThreadLocalRandom$3] (value [io.netty.util.internal.ThreadLocalRandom$3@6ed33792]) and a value of type [io.netty.util.internal.ThreadLocalRandom] (value [io.netty.util.internal.ThreadLocalRandom@6ce58b15]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.

This seems similar to #2084.
EDIT: This happens with Netty 4.0.19.

Now I'm having the same problem...


fedora:36 peculiarities

In the case there is time/interest in bumping the CI image to fedora:36, it will require a patched GLib to address this issue. Long story short, is that glib-compile-resources will fail until GitHub updates their Docker/libseccomp deployment.
I have a copr setup here that carries such a build of GLib. It could be added to the Dockerfile like so:
FROM registry.fedoraproject.org/fedora:36

# See: https://github.com/andyholmes/copr/tree/main/glib2
RUN dnf install -y 'dnf-command(copr)' && \
    dnf copr -y enable andyholmes/main

# Regular stuff here

Fedora 36 isn't even technically in Beta yet. (Been pushed off for two weeks and counting, so far, though it looks like the Big Board has been cleared so this Thursday's third try will probably succeed...)
Since this was patched a month ago I can't imagine it won't make it into the release. I'd be surprised if it's not in the Beta (or I'd expect to see it on the Big Board).
Point is, we can probably solve this by just doing nothing for a few weeks. My favorite kind of fix!

And, indeed, that patch has already been pushed as an update to Fedora 35, even. For Fedora 36+, BNocera dropped it in as a patch around the same time, but it's no longer there since that was four releases ago and the current packages are up to 2.72.0 already which includes the patch upstream.
The Dockerhub definition for fedora:36 was updated end of last week; if this isn't already fixed something's wrong.

Yeah, I'm not sure if they'll forward-port the EPERM patch again. Richard Hughsie had pushed that since he uses GitHub/Circle CI for fwupd, but I get the feeling Fedora doesn't want to carry that patch as it was causing timeouts in the GNOME GitLab CI's.

Sorry, after re-reading your comment I think I didn't explain very well.
Philip Withnall merged this patch late in the 2.70 cycle for seccomp deployments that return EPERM for close_range() rather than ENOSYS, which resulted in dangling file descriptors (causing many problems in GNOME's GitLab runners).
After it became clear this was breaking a lot of GitHub-based CI's, Richard Hughsie added this patch to the Fedora 35 GLib package, which effectively reverts Philip Withnall's upstream patch.
So far, Richard Hughsie's patch has not been applied to Fedora 36's GLib package though, thus bumping the CI image to fedora:36 will break it. I don't get the feeling Fedora plans on carrying Richard's patch again, like they did for Fedora 35.

@andyholmes
Ah, OK, thanks. I guess I understand better now why it's needed. Well, no, I understand what it's needed for, but I don't at all understand WHY it's needed. Especially with all of the bugs on this being closed and everyone walking around acting as though this is fixed.
Do the Fedora devs know that they're currently working towards a release that will include tools that fail to run in container environments, in a way that those same tools on F35 (by virtue of that patch) and earlier DON'T? I find it hard to believe that this wouldn't be on the radar as a release blocker, but I can't even find any sign that it's being tracked anywhere (as an ongoing, rather than already-solved, problem, I mean).

@ferdnyc
Yeah, my understanding of this stuff is pretty limited. My read is that EPERM is supposed to be returned when you try to do some thing seccomp doesn't allow (ie. hard fail). ENOSYS is returned when syscall is not supported (ie. time to fallback to an older syscall).
So I think the fix merged into GLib makes it correctly handle those error codes, but some existing deployments like GitHub's are still returning EPERM when they should be returning ENOSYS. The practical difference is that GNOME can update their Docker/seccomp deployment on gitlab.gnome.org, while we on GitHub are stuck with a Docker/seccomp that is returning the wrong error code.
That's my read on the situation anyways :)


replay-live lacks tags data

Hey, I have a stream type task that looks similar to:
stream
    |from()
        .database('db')
        .measurement('measurement')
        .where(lambda: someCondition)
        .groupBy('m1', 'm2', 'm3', 'm4')
    |window()
        .period(5m)
        .every(1m)
    |where(lambda: "p50" > threshold)
    |count('p50')
      .as('count')
    |alert()
        .id('SOME_STATIC_NAME/{{ index .Tags "m4"}}/{{index .Tags "m3"}}')
        .message('{{ .ID }} ...')
        .crit(lambda: "count" > 4)
        .stateChangesOnly(5m)
        .slack()

when defined and enabled normally on live data, outputs data to slack in expected format:
SOME_STATIC_NAME/m4_tag_value/m3_tag_value ...

But, for faster feedback loop I wanted to test it using replay-live feature of kapacitor with query
kapacitor replay-live query -task task_id -query 'SELECT * FROM "db"."default"."measurement" WHERE time > now() - 10m'

Messages are sent to slack as expected, but tag placeholders are not replaced with actual data:
SOME_STATIC_NAME// ...

versions:

cli on mac: Kapacitor v1.1.1 (git:  d1e0173df2b9f44c64b7bbf1a120a1bdb3ef683e) installed with Homebrew
server on linux: Kapacitor 1.1.1 (git: master d1e0173df2b9f44c64b7bbf1a120a1bdb3ef683e) installed from .deb package

This is a subtle issue with how queries in InfluxDB work. In short select * from ... returns all fields and tags as fields. If you want to query to preserve tags as tags then add a group by * to the query.

This issue should be closed since the group by * solves this, maybe make it a documentation update task, no point in having idle issues open.


Home page: add fourth option for "Microsoft Employee"

created on wrong repo! closing
(https://github.com/microsoft/dstoolkit-web/issues/54)


Uploading sarif files: instance.runs[0].tool.driver.rules contains duplicate item

Hi guys,
Hope you are all well !
I tried trivy action and I have the following error:
Uploading sarif files: ["trivy-results.sarif"]
Error details: instance.runs[0].tool.driver.rules contains duplicate item

Is there a parameter to set in trivy to avoid duplicates ?
Here is my workflow file:
https://github.com/lucmichalski/prestashop-docker/blob/trivy/.github/workflows/security.yml
Cheers,
Luc Michalski

hi @lucmichalski - I'd like to repro this, is the image you were running this against public? Also would it be possible for you to share the generated SARIF output?
You can do so by running trivy as:
trivy image --format=template<EMAIL_ADDRESS><imageName>

You can find a copy of sarif.tpl here: https://github.com/aquasecurity/trivy/blob/master/contrib/sarif.tpl

Experiencing the same issue with an image scan for Docker-Android:
Run github/codeql-action/upload-sarif@v1
  with:
    sarif_file: trivy-results.sarif
    checkout_path: /home/runner/work/docker-android/docker-android
    token: ***
    matrix: null
  env:
    platforms: linux/amd64
    imageName: ***/android
Uploading sarif files: ["trivy-results.sarif"]
Error details: instance.runs[0].tool.driver.rules contains duplicate item
Error: Unable to upload "trivy-results.sarif" as it is not valid SARIF:
- instance.runs[0].tool.driver.rules contains duplicate item
Error: Unable to upload "trivy-results.sarif" as it is not valid SARIF:
- instance.runs[0].tool.driver.rules contains duplicate item
    at validateSarifFileSchema (/home/runner/work/_actions/github/codeql-action/v1/lib/upload-lib.js:142:15)
    at uploadFiles (/home/runner/work/_actions/github/codeql-action/v1/lib/upload-lib.js:201:9)
    at Object.uploadFromActions (/home/runner/work/_actions/github/codeql-action/v1/lib/upload-lib.js:91:18)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at async run (/home/runner/work/_actions/github/codeql-action/v1/lib/upload-sarif-action.js:34:29)
    at async runWrapper (/home/runner/work/_actions/github/codeql-action/v1/lib/upload-sarif-action.js:46:9)

Build: https://github.com/beevelop/docker-android/pull/29/checks?check_run_id=1891411385

@rahul2393 - can you take a look into this?

The issue is happening because of duplicate ruleID, I am creating patch to append Package Name too in ID

@simar7 help review PR

@lucmichalski https://github.com/aquasecurity/trivy/pull/913 was merged and the next release of Trivy/TrivyAction will support it.

Thank you both 🙏

Is this fix in the latest release of TrivyAction?

Is this fix in the latest release of TrivyAction?

Trivy Action uses the latest released version of Trivy https://github.com/aquasecurity/trivy-action/blob/master/Dockerfile#L1
Trivy recently had a new release which includes this fix so by the virtue of that the new Trivy Action will also have it.

Thanks for the quick response! That's what I thought but for some reason, I'm still seeing this error:
https://github.com/cdr/code-server/pull/3296/checks?check_run_id=2512446010#step:5:158
Any ideas on what we might be doing wrong?

@rahul2393 could you look into this?

Thanks for the quick response! That's what I thought but for some reason, I'm still seeing this error:
https://github.com/cdr/code-server/pull/3296/checks?check_run_id=2512446010#step:5:158
Any ideas on what we might be doing wrong?
Additional context: our ci.yaml pointing at the trivy jobs

Thanks. We'll investigate and get back to you.

@simar7 please help check this https://github.com/aquasecurity/trivy/pull/984

I'm experiencing the same 🐛 on some image
Thanks for the PR @rahul2393

@jsjoeio Update your workflow to use latest commit in master branch I see you are using previous commitID here
https://github.com/cdr/code-server/blob/main/.github/workflows/ci.yaml#L450, the issue should be fixed.

Awesome, we'll go ahead and update that. Thanks for getting a fix out so quickly! We really appreciate it.

@rahul2393 oh no, I'm seeing the same error. See logs.

I updated it to use the latest commit in the master branch here.
Am I missing something else?

Checking

@jsjoeio I just ran the latest fix here in my forked version of your repo https://github.com/rahul2393/code-server/runs/2573437202?check_suite_focus=true, it passed, so we will not do a new release and you can then use it

Thanks for taking a closer look!

it passed, so we will not do a new release and you can then use it

Sorry, this confused me a bit. Are you saying the current version works and I should try again or are you saying you are going to push a new release and then I can use that?

Sorry I did typo in previous message, we are going to push a new version then you can use it, I will inform you.

@jsjoeio can you check this one now?
https://github.com/aquasecurity/trivy-action/releases/tag/0.0.17

@rahul2393 that worked!! Thanks so much 🙌
https://github.com/cdr/code-server/pull/3368/checks?check_run_id=2578181406

@jsjoeio Thanks for your confirmation! We're sorry for the inconvenience 🙏

@lucmichalski please feel free to reopen this if your issue still persists.


Datastore Testing: Wiping data between tests?

I'm migrating from the App Engine Datastore API to the Cloud Datastore API (so that I can connect to Datastore from a VPS). A happy thing about the previous API is that it didn't spin up a separate emulator process (5+ seconds) when helper.setUp() is called. With the Cloud Datastore API, it's a different model, so it's a little slower.
I don't want to have to entirely restart my Datastore emulator between tests, but I want a clean slate. Can I either:

Still have an in-process datastore implementation to test against, which is fast?
Clear the remote emulator datastore, so it doesn't need to be fully restarted?

I've looked through LocalDatastoreHelper, DatastoreOptions and Datastore itself, but I can't find any immediately solutions to my problem.
Note: I can't just @After and delete a set of keys, since some tests involve letting Datastore choose the id of an inserted entity

Fat-fingered ctrl-enter when entering the title, and posted a blank issue. It's all filled out now :)

I get a java.lang.NullPointerException when doing:
curl -X POST http://localhost:8081/reset
I'm with version 2.1.0...
│ Cloud Datastore Emulator                            │         2.1.0 │ 18.4 MiB │

Still null pointer exception without flag --no-store-on-disk. Why can't this be a more clear error message?


Parse date from filename

It would be great if Gutenberg would parse the date from filenames such as 2018-09-03-slug.md (filename starts with the date). If the front matter would also contain a date field, that one would override the date found in the filename.

That's a great idea, as long as we keep it limited to yyyy-mm-dd format and don't allow things like yyyymmdd.
That should be fairly easy to add, just check if the filename starts with 20 and try to get the date from the filename if so.

I would not check for 20, but rather just try to match the filename against ^(\d\d\d\d)-(\d\d)-(\d\d)-. Or better yet: Just run it through the data parser (assuming it works like C's strtol()) and if that comes up with a anything it is a match.

@remexre I noticed you were usign dates as filenames for some of your content - it's probably coming for the next version


Blazor NavigationManager.NagivateTo throwing totally useless error message.

3.0.
The following code in a component:
protected override void OnInitialized ()
{
    NavigationManager.NavigateTo("/login", forceLoad: true);
}

results in:
| Name | Value | Type
-- | -- | -- | --
▶ | $exception | {"Exception of type 'Microsoft.AspNetCore.Components.NavigationException' was thrown."} | Microsoft.AspNetCore.Components.NavigationException
There is no inner exception, no debug information at all. It makes simply no sense because
| Name | Value | Type
-- | -- | -- | --
  | Location | "https://localhost:44342/login" | string
actually IS valid. I can go to this location and get a login mask.
THe error message is exactly one thing: not helpfull at all. It does not provide any context information which is bad given that in the browser AFTER this error message - I get the /login window nicely displaying the login form.

@NetTecture thanks for contacting us.
Are you seeing this during pre-rendering?
If that's the case, this is a first chance exception that is thrown to cause a redirect to happen during pre-rendering and that is caught by MVC. If you turn off first-chance exceptions you won't see this happen.
If this is not the case, let us know and we will re-evaluate.


Create PR template

:tada: This issue has been resolved in version 1.212.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


/v1/update-operation-key service is getting stuck if non-existing operation server uuid is passed as parameter in request body.

Problem Description :
/v1/update-operation-key service is getting stuck if non-existing operation server uuid is passed as parameter in request body.

This issue is duplicate to issue #227


fix: [Fluent Multiselect Unselections] in [Fluent Multi Select]

🐛 Bug Report

💻 Repro or Code Sample
<FluentSelect Items="_opStatus"
              TOption="(string, bool?)"
              OptionText="i => i.Item1"
              OptionValue="i => i.Item2?.ToString()"
              Width="300px"
              Height="200px"
              Multiple="true"
              SelectedOptionsChanged="@(async (e) => await HandleStatusFilters(e, index, operation))"
              SelectedOptions="_selectedStatusFilters.ContainsKey(operation) ? _selectedStatusFilters[operation] : null">

</FluentSelect>

🤔 Expected Behavior
When I deselect the last element, SelectedOptionsChanged should fire and provide me with an empty list.
😯 Current Behavior
When I select one thing or multiple things, the HandleStatusFilters event handler for SelectedOptionsChanged will fire and return me a list where T=>(string, bool?) tuple of size 1 up to n. However, if I start deselecting my elements, the method will still fire with 1 less element in the list up until the last element is deselected.
When the last element is deselected, it is not returning an empty list, but a list with count 1 which contains the last remaining element that was then deselected.
💁 Possible Solution
return an empty list if I deselect everything.
🔦 Context
I have a check for filtering where if I select nothing or if I select everything, I skip over filtering because it is essentially asking for everything so why bother going through the filtering.  It works when everything is selected, but when nothing is selected, it is still giving me a list of 1 element. I would expect an empty list.
🌍 Your Environment
Windows 10, using Edge.
.Net 8.0.404

As can be seen in this example https://www.fluentui-blazor.net/Select#multipleitems, SelectedItems is empty if no more items are selected.
You should change your code to use @bind-SelectedOptions and @bind-SelectedOptions:after

Sure, thank you for the help!

<FluentSelect Items="_opStatus"
TOption="(string, bool?)"
OptionText="i => i.Item1"
OptionValue="i => i.Item2?.ToString()"
Width="300px"
Height="200px"
Multiple="true"
@bind-SelectedOptions="@_selectedStatusFilters[operation]"
@bind-SelectedOptions:after="HandleStatusFilters(index, operation)">

Binding seems to work ok, however, I am getting the error for bind-SelectedOptions:after argument 1: cannot convert from 'system.threading.tasks.task' to 'system.action'

You have not supplied reproduction code we can run. We don't look at issues that we need to supply and Co me up with sample code.

Right, let me try and give more contextual code:
Heres the markup

<FluentSelect Items="_opStatus"
TOption="(string, bool?)"
OptionText="i => i.Item1"
OptionValue="i => i.Item2?.ToString()"
Width="300px"
Height="200px"
Multiple="true"
@onchange="@(async e => {
if (_selectedStatusFilters[operation].Count() == 0)
{
await HandleStatusFilters(index, operation);
}
})"
@bind-SelectedOptions="@_selectedStatusFilters[operation]"
@bind-SelectedOptions:after="async () => await HandleStatusFilters(index, operation)">

@PartStatus(context.Statuses.ToList()[index])

Here's the bound data structure
private Dictionary<string, IEnumerable<(string, bool?)>> _selectedStatusFilters = new();
Here's handleStatusFilters
private async Task HandleStatusFilters(int index, string opName)
{
var selectedItems = _selectedStatusFilters[opName];
if (selectedItems.Count() > 0 && selectedItems.Count() < 3) // if the user wants to filter for 1-2 statuses
{
    // define the delegate
    Func<PartLocation, bool> predicate = (p => selectedItems.Select(x => x.Item2).Contains(p.Statuses.ToList()[index]));

    // if add it to the dictionary
    if (_statusFilters.ContainsKey(opName))
    {
        _statusFilters[opName] = predicate;
    }
    else
    {
        _statusFilters.Add(opName, predicate);
    }
}
else // otherwise it's like they're not filtering so just remove the delegate
{
    if (_statusFilters.ContainsKey(opName))
    {
        _statusFilters.Remove(opName);
    }
}
await _gridRef!.RefreshDataAsync();

}
When I change my selected values, I can see while debugging that it is correctly binding the the entries in my dictionary, in this case lets call each key OPERATION_{N}.  When I select a from a, b, c for column OPERATION_1 for example, the associated entry in the dictionary will have list(a).  When I unselect (a) then I try and set a break point, I can see it is now empty.
But the issue is, in the method HandleStatusFilters, it should be called when I deselect the LAST remaining selected element. It is not it seems. However, it it binding the the dictionary entry an empty list when I DESELECT it. I'm not sure what is going on.
Some more context, I am using a FluentDataGrid using an items provider which is providing me a list of filtering objects from the filtering mechanism from above:
<FluentDataGrid Class="gridReport" @ref=_gridRef TGridItem="PartLocation" ItemsProvider="_partLocationsItemsProvider" Virtualize="true" ItemSize="28" GenerateHeader="GenerateHeaderOption.Sticky" Style="min-width: max-content;">

<FluentTextField type="search" @bind-Value="@_serialNumberFilter" @oninput='(async (e) => await HandleStringFilters(e, "serialNumber"))' Placeholder="Serial Number" />

<PropertyColumn Title="Customer Serial Number" Property="@(c => c.CustomerSerialNumber)" Filtered="!string.IsNullOrWhiteSpace(_customerSerialNumberFilter)">
    <ColumnOptions>

            <FluentTextField type="search" @bind-Value="@_customerSerialNumberFilter" @oninput='(async (e) => await HandleStringFilters(e, "customerSerialNumber"))' Placeholder="Customer Serial Number" />

    </ColumnOptions>
</PropertyColumn>

<PropertyColumn Title="Start Date" Width="190px" Style="margin-top: 2px; padding-top: 0;" Property="@(item => item.StartTime)" Filtered="(_startDateFilter != null)">
    <ColumnOptions>

            <FluentCalendar SelectMode="CalendarSelectMode.Single" @bind-Value="@_startDateFilter" @bind-Value:after='(async () => await HandleDateFilters("startDate"))' />

            <FluentButton @onclick="HandleClearStartDate">Clear Date Filter</FluentButton>

    </ColumnOptions>
</PropertyColumn>

<PropertyColumn Title="Completed Date" Width="180px" Style="margin-top: 2px; padding-top: 0;" Property="@(item => item.CompleteTime)" Filtered="(_completeDateFilter != null)">
    <ColumnOptions>

            <FluentCalendar SelectMode="CalendarSelectMode.Single" @bind-Value="@_completeDateFilter" @bind-Value:after='(() => HandleDateFilters("completedDate"))' />

            <FluentButton @onclick="HandleClearCompleteDate">Clear Date Filter</FluentButton>

    </ColumnOptions>
</PropertyColumn>
@foreach (var (operation, index) in _operations.Select((operation, index) => (operation, index)))
{
    <TemplateColumn Filtered="_selectedStatusFilters[operation].Count() > 0" Title="@operation" <EMAIL_ADDRESS>Width="80px" Style="margin-top: 2px; padding-top: 0;">
        <ColumnOptions>
            <FluentSelect Items="_opStatus"
                          TOption="(string, bool?)"
                          OptionText="i => i.Item1"
                          OptionValue="i => i.Item2?.ToString()"
                          Width="300px"
                          Height="200px"
                          Multiple="true"
                          @onchange="@(async e => {
                          if (_selectedStatusFilters[operation].Count() == 0)
                          {
                            await HandleStatusFilters(index, operation);
                          }
                          })"
                          @bind-SelectedOptions="@_selectedStatusFilters[operation]"
                          @bind-SelectedOptions:after="async () => await HandleStatusFilters(index, operation)">
            </FluentSelect>
        </ColumnOptions>
        <ChildContent>
            @PartStatus(context.Statuses.ToList()[index])
        </ChildContent>
    </TemplateColumn>
}

Sorry, but this is still not ready to run code. Please use properly formatted code (use ``` to start and end code blocks), Also, I only need minimal code needed to reproduce the issue at hand.
From what I am seeing, you are using selects in a datagrid. With how many rows? This seems like a recipe for failure that will lead to a slow page because of all the code generated We have already mentioned a lot of times that a grid is better not used as an Excel like data entry component,

<FluentStack Orientation="Orientation.Horizontal" Style="height: 400px">
    @foreach (var entry in _test.Keys)
    {
        <FluentSelect TOption="SelectOption"
                      Items="_allItems"
                      Multiple="true"
                      Autofocus="true"
                      OptionText="item => item.Text"
                      OptionValue="item => item.Value"
                      @bind-SelectedOptions='_test[entry]'
                      @bind-SelectedOptions:after="() => DoSomething(entry)" />
    }

    <FluentLabel>Options selected @_total</FluentLabel>
</FluentStack>

@code
{

    private Dictionary<string, IEnumerable<SelectOption>?> _test = new() { { "Line01", null }, { "Line02", null } };

    private IEnumerable<SelectOption> _allItems = new List<SelectOption>()
    {
        new() { Text="Line01", Value="1" },
        new() { Text="Line02", Value="2" },
        new() { Text="Line03", Value="3" },
        new() { Text="Line04", Value="4" },
        new() { Text="Line05", Value="5" },
        new() { Text="Line06", Value="6" },
    };

    private void DoSomething(string entry)
    {

        return;
    }

    private IEnumerable<SelectOption>? _selectedItems;

    private int _total;

    private void HandleSelectedOptionsChanged(IEnumerable<SelectOption>? items)
    {
        _test["Line01"] = items;

        _total = items?.Count() ?? 0;
    }

    private class SelectOption
    {
        public string Text { get; set; }
        public string Value { get; set; }
    }
}```

I got a small example working. It looks like it is bound to the correct dictionary entry. However, I did notice, when I select my first entry, the DoSomething() method fires once, but If I select again or select more than 1 it fires twice in succession.  Also happens when deselecting

Sorry, but I have no idea on what you are trying to do with that code. It makes no sense at all. I can only suggest you look at the code example I posted earlier. Multi select is working there as it should.
I already closed this issue so won't be commenting on it anymore.