Release Requirements for 0.18.0

I would like to release 0.18.0 soonish.  This is a biggish release with several changes that will cause friction both for users and for downstream packages.  Here are a few that come to mind:

Deprecation of get= for scheduler=
Creation of the dask.config module and centralization of all downstream packages to use that module
...

This will probably force a timed release for some downstream packages.  It would be good to get to a point where we can happily release a few things at the same time.
What blocking issues exist either in Dask or related packages that we need to prioritize to allow for this release?

Think we should start deprecating the name argument in map_blocks and warning users that token will be renamed to name in the future (1.0.0).
xref: https://github.com/dask/dask/issues/3226#issuecomment-396419864

That seems like a reasonable way to back us out of a jam.  Do you have any interest in submitting this?  I can probably find some time tomorrow if not.  My hope is that it won't take too long.

OK, looking at this now, I actually don't know the right way to gracefully perform this warning and degredation.  My first inclination was to warn for either keyword, but now there is no way for a user to get decent behavior and avoid the warning.  Thoughts?
I'm inclined to switch behavior for name= immediately, and warn on use of token=.

Sorry to be slow here today. Yeah, would be willing to help here.
Generally your proposal sounds fine. Treating name as a prefix for the name shouldn't break any existing use cases that assume it is used as the key/token. Warning that token will be dropped (when set) should be fine for obvious reasons.
FWIW looked through the xarray and hyperspy projects (as example downstream projects) to see where this might affect people. Interestingly did not see any uses of either (though plenty of usages of map_blocks). Of course this is only a sampling of users, but this does support making a breaking change should be ok.

Would it be possible to get this bug fix PR ( https://github.com/dask/dask/pull/3607 ) for to_zarr in? Given to_zarr hasn't yet shown up in a release, would be good to make sure we are happy with its behavior.
Ideally would like to get PR ( https://github.com/dask/dask/pull/3561 ) in as well as that seems generally agreed upon. Though if this PR doesn't make it, that would be ok.

OK.  If there are no objections then I plan to do a release tomorrow.

Copied from Gitter:
Breaking changes

Replaced the get=dask.threaded.get keyword with scheduler='threading'
Centralized configuration, replaced
dask.set_options with dask.config.set
Dropped dask.array.learn
name= in map_blocks
worker_client automatically rejoins
dask.distributed protocol now interprets msgpack arrays as tuples rather than lists

Fun Changes

Orc Support
__array_ufunc__ support for dask dataframe and series
einsum
Pandas 0.23.0 support
gufuncs
rechunk('auto')
QR decomposition improvements
Joblib

simpler startup and global access
keywords
reference cycle
Automatic scattering

Improved web presence, consistent styling on rtd
Serialization families, starting to make client secure to pickle

This looks like a pretty complete list.
Of the things since the 0.17.5 release, would add to_zarr/from_zarr.

Also to/from_json, in that case?

Perhaps I should cut the orc section, and make a small section that lists
all of the new data ingestion formats supported.
On Thu, Jun 14, 2018 at 9:47 AM, Martin Durant<EMAIL_ADDRESS>wrote:

Also to/from_json, in that case?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dask/dask/issues/3592#issuecomment-397301749, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AASszLEys7gdT6-rP4WOzkqqv9X36qxSks5t8mlXgaJpZM4UjbGc
.

The last blog post was for 0.17.2. Here are some things that would be good to add to a new blogpost since then (up to you of course). Does not including anything after 0.17.5.

Dask Dataframe gets an isna method.
Dask Array gets a piecewise function.
Addition of einsum (know it's already there)
Many improvements to topk/argtopk.
Dask Array gets a gradient function.
Significant performance improvements in Dask Array's slicing.
Various bug fixes for map_overlap.

Typically I highlight a few changes that I think most dask users will find
interesting.  I link to our changelog for a more comprehensive list.  I
definitely don't plan on mentioning all of these.  Even the list I posted
before is a set of ideas that will eventually be culled into a few (3-5)
topics.
On Thu, Jun 14, 2018 at 9:58 AM, jakirkham<EMAIL_ADDRESS>wrote:

The last blog post was for 0.17.2. Here are some things that would be good
to add to a new blogpost since then (up to you of course). Does not
including anything after 0.17.5.

Dask Dataframe gets an isna method.
Dask Array gets a piecewise function.
Addition of einsum (know it's already there)
Many improvements to topk/argtopk.
Dask Array gets a gradient function.
Significant performance improvements in Dask Array's slicing.
Various bug fixes for map_overlap.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dask/dask/issues/3592#issuecomment-397305591, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AASszLyAfhpA_XieQvy2_-74kFW-HPJhks5t8mwTgaJpZM4UjbGc
.

That being said, if someone wants to really dive into the changelog and
provide a lot of context on each change uniformly across changes then I
suspect that people would find that interesting to read.
On Thu, Jun 14, 2018 at 10:01 AM, Matthew Rocklin<EMAIL_ADDRESS>wrote:

Typically I highlight a few changes that I think most dask users will find
interesting.  I link to our changelog for a more comprehensive list.  I
definitely don't plan on mentioning all of these.  Even the list I posted
before is a set of ideas that will eventually be culled into a few (3-5)
topics.
On Thu, Jun 14, 2018 at 9:58 AM, jakirkham<EMAIL_ADDRESS>wrote:

The last blog post was for 0.17.2. Here are some things that would be
good to add to a new blogpost since then (up to you of course). Does not
including anything after 0.17.5.

Dask Dataframe gets an isna method.
Dask Array gets a piecewise function.
Addition of einsum (know it's already there)
Many improvements to topk/argtopk.
Dask Array gets a gradient function.
Significant performance improvements in Dask Array's slicing.
Various bug fixes for map_overlap.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dask/dask/issues/3592#issuecomment-397305591, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AASszLyAfhpA_XieQvy2_-74kFW-HPJhks5t8mwTgaJpZM4UjbGc
.

So basically I just went through the changelog and if it something stuck out at me I listed it above. It's probably not worth diving into detail for all of them. Though I thought the blogs use to contain a list of miscellaneous other things that were notable. Many of these might fit there.

Thanks for getting this out, @mrocklin. 🎉 Good to close?


visium_hd: no global coordinate system for image

I am reading spaceranger outputs like this:
spatialdata_io.visium_hd(
    '../../raw_data/240905_VisiumHD_Periportal_Assembloid/spaceranger/Slide1_phh2_normal1/outs/',
    dataset_id='Slide1_phh2_normal1',
    load_all_images=False,
)

output:
SpatialData object
├── Images
│     ├── 'Slide1_phh2_normal1_cytassist_image': DataArray[cyx] (3, 3000, 3200)
│     ├── 'Slide1_phh2_normal1_hires_image': DataArray[cyx] (3, 4997, 6000)
│     └── 'Slide1_phh2_normal1_lowres_image': DataArray[cyx] (3, 500, 600)
├── Shapes
│     ├── 'Slide1_phh2_normal1_square_002um': GeoDataFrame shape: (326064, 1) (2D shapes)
│     ├── 'Slide1_phh2_normal1_square_008um': GeoDataFrame shape: (20379, 1) (2D shapes)
│     └── 'Slide1_phh2_normal1_square_016um': GeoDataFrame shape: (5279, 1) (2D shapes)
└── Tables
      ├── 'square_002um': AnnData (326064, 18094)
      ├── 'square_008um': AnnData (20379, 18094)
      └── 'square_016um': AnnData (5279, 18094)
with coordinate systems:
    ▸ 'downscaled_hires', with elements:
        Slide1_phh2_normal1_hires_image (Images), Slide1_phh2_normal1_square_002um (Shapes), Slide1_phh2_normal1_square_008um (Shapes), Slide1_phh2_normal1_square_016um (Shapes)
    ▸ 'downscaled_lowres', with elements:
        Slide1_phh2_normal1_lowres_image (Images), Slide1_phh2_normal1_square_002um (Shapes), Slide1_phh2_normal1_square_008um (Shapes), Slide1_phh2_normal1_square_016um (Shapes)
    ▸ 'global', with elements:
        Slide1_phh2_normal1_cytassist_image (Images), Slide1_phh2_normal1_square_002um (Shapes), Slide1_phh2_normal1_square_008um (Shapes), Slide1_phh2_normal1_square_016um (Shapes)

I noticed that the "hires" and "lowres" images do not have a global coordinate system. I manually registered these images before to the CytAssist image using landmarks in the loupe browser, also, when I open the cloupe files in loupe browser the hires image is registered.
This is not what I expected from the tutorial https://spatialdata.scverse.org/en/latest/tutorials/notebooks/notebooks/examples/technology_visium_hd.html, there, all images are part of the global coordinate system

(I closed the issue by accident pressing the wrong key)

Thanks! You are right, not sure why I thought hires and lowres would be part of global. I will try with the fullres image as you suggested. I won't have time to do so soon, so will close this issue for now, and I would only reopen if I cannot make it run. Thanks for looking into this!

Sounds great! Please be aware of this other bug that has been reported: https://github.com/scverse/spatialdata-io/issues/216. We are working on it and it does affect only some datasets, so hopefully you will not encounter it.


Vaishaal/revert fsdp loading

Commits make resuming from checkpoint broken. Needed for larger (34B) models, but not now.


fix tox.ini content in README to avoid errors running tox under 2.7

Currently without the indentation for the deps in the tox.ini
example file I was getting the exception below. This identation can be
also seen on the official tox README
Traceback (most recent call last):
  File "/home/.virtualenvs/project-ePKRVxQ0/bin/tox", line 11, in <module>
    sys.exit(run_main())
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/tox/session.py", line 40, in run_main
    main(args)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/tox/session.py", line 45, in main
    config = prepare(args)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/tox/session.py", line 27, in prepare
    config = parseconfig(args)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/tox/config.py", line 271, in parseconfig
    parseini(config, inipath)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/tox/config.py", line 736, in __init__
    self._cfg = py.iniconfig.IniConfig(config.toxinipath)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/py/_vendored_packages/iniconfig.py", line 54, in __init__
    tokens = self._parse(iter(f))
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/py/_vendored_packages/iniconfig.py", line 83, in _parse
    name, data = self._parseline(line, lineno)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/py/_vendored_packages/iniconfig.py", line 133, in _parseline
    self._raise(lineno, 'unexpected line: %r' % line)
  File "/home/.virtualenvs/project-ePKRVxQ0/lib/python2.7/site-packages/py/_vendored_packages/iniconfig.py", line 77, in _raise
    raise ParseError(self.path, lineno, msg)
py._vendored_packages.iniconfig.ParseError: /home/Clients/project/code/project/tox.ini:9: unexpected line: 'pytest'

thanks @AlmogCohen


Issue with k8s.io/docs/tutorials/kubernetes-basics/explore/explore-interactive/

This is a...

[ ] Feature Request
[ ] Bug Report

Problem:
Proposed Solution:
Page to Update:
https://kubernetes.io/...

Could you provide more information, @yangzhih?
/triage needs-information

Since there has been no update on this, I'm closing it.
@yangzhih, feel free to reopen and update or open another issue.
/close


Fix ALPN being set to h2 by default when using TCP

https://github.com/XTLS/Xray-core/issues/242#issuecomment-778889586

Thanks for you work.


TTL for messages from stream-cloud-binder-rabbit

stream-cloud-binder-rabbit seems to create queues which have no consumers, and with RabbitMQ this causes the broker to slow down and crash when the queue size grows too large. In my case, it's the spring-cloud-starter-turbine-stream which causes the massive queues, but the springCloudBus queues seem to have the same behaviour.
Without knowing too much about the implementation details, I think it would probably be a good idea to set a TTL on the messages which are streamed.

This is a known issue that will be resolved soon.
See https://github.com/spring-cloud/spring-cloud-stream/issues/317#issuecomment-182918369 for a workaround

Thanks Gary

Thanks!


[BUG] Errors during caddy bootup

Describe the bug
Seeing error's in log related to paths being used by caddy. Do we need to explicitly add a mount for caddy? App itself is working fine and importing and exporting data fine.
Container is running as non root user and the volume mounted has permissions for the user to write. The data from the import/export etc all has been written to the mounted path.
{"level":"info","ts":1706793467.7766416,"msg":"using provided configuration","config_file":"/opt/config/Caddyfile","config_adapter":""}
{"level":"info","ts":1706793467.7862568,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//localhost:2019","//[::1]:2019","//<IP_ADDRESS>:2019"]}
{"level":"warn","ts":1706793467.7868762,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv0","http_port":8080}
{"level":"info","ts":1706793467.7868898,"logger":"tls.cache.maintenance","msg":"started background certificate maintenance","cache":"0xc00051c500"}
{"level":"info","ts":1706793467.7878015,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}
{"level":"warn","ts":1706793467.787805,"logger":"tls","msg":"unable to get instance ID; storage clean stamps will be incomplete","error":"open /.local/share/caddy/instance.uuid: no such file or directory"}
{"level":"error","ts":1706793467.7880712,"logger":"tls","msg":"could not clean default/global storage","error":"unable to acquire storage_clean lock: creating lock file: open /.local/share/caddy/locks/storage_clean.lock: no such file or directory"}
{"level":"info","ts":1706793467.788092,"logger":"tls","msg":"finished cleaning storage units"}
{"level":"error","ts":1706793467.7881575,"msg":"unable to create folder for config autosave","dir":"/.config/caddy","error":"mkdir /.config: permission denied"}
{"level":"info","ts":1706793467.7881713,"msg":"serving initial configuration"}
Successfully started Caddy (pid=27) - Caddy is running in the background

Basic report
WatchState Version: 20240127-3da1834
PHP Version: 8.2.15
Timezone: America/Chicago
Running in Container? Yes
Data Path: /config
Temp Path: /config
Database Migrated?: Yes
Has .env file? No
Is Tasks Runner working? Yes
Report Generated At: 2024-02-01T13:25:28+00:00

Also is the http server only needed if one is using webhooks?

Hello,
Yes, the http server is only needed to process webhooks events.
The error in question is related to the http server, and it's not critical as you can see the server still runs however without caching. i'll see what i can do to fix it.


Resubmit button does not change its state when clicked

Describe the bug
When clicking the resubmit button of a programming exercise participation as an instructor. The button does not change visually to indicate that the build on the CI agent is currently running. The submission count is also not updated (but the result count is increased, so maybe the testcase is outdated in TestQuality?)
To Reproduce
Here is the related testcase in TestQuality

Create a course with a programming exercise and add a student to the course
Make a submission with the student
Open the participations page of the exercise as instructor
Click the resubmit button and notice that it does not visually indicate that the build on the CI agent is currently running

Expected behavior
When clicking the resubmit button the icon should change and the button should be disabled until the build on the CI agent has finished.
Screenshots

I highlighted the button (I clicked it to trigger a rebuild)
What browsers are you seeing the problem on?
Chrome
Additional context
No error in the console. I also made sure that the build on the CI agent is actually triggered (which it is). I used the develop (5.2.0) branch for testing and tested it on my local setup (jenkins + gitlab) and on TS3 (bamboo + bitbucket).
Relevant log output
No response

Yes, in an earlier version of Artemis a submission could only have one result, so the creation of a new result was expected. The tests need to be updated.

I dont entirely understand your conversation in #4027 @jhainzlschmid & @MaisiKoleni Can this issue be closed or not?

I dont entirely understand your conversation in #4027 @jhainzlschmid & @MaisiKoleni Can this issue be closed or not?

No this issue is still open because the resubmit button does not show an animation or anything to the user


Update Jetty to 9.4.11.v20180605 for swagger-core 2.0.x

Update Jetty to 9.4.11.v20180605 for swagger-core 2.0.x, addressing 4 CVE, per #2879

Closing adn will resubmit together with jackson,version update


I cant get the rebind command to work

When ever it try to rebind a key it just says that it an unknow command dose it need to be in the command line of the game or the chat box and what is the command exactly?

is it work to copy the example to the chat box?
if you get a "unknow command" message with green "SYSTEM" logo, it means a wrong spell. And, red one means others...

I have been copying the example s

yes same it is just unknown command


Add Jinja3 support

In jinja3, contextfunction is renamed to pass_context, so I added this import to _compat.py file, and changed imports in other places. Now project is compatible with new jinja version.

I am also seeing this deprecation warning:
  /my-api/lib/python3.8/site-packages/flask_admin/model/typefmt.py:40: DeprecationWarning: 'jinja2.Markup' is deprecated and will be removed in Jinja 3.1. Import 'markupsafe.Markup' instead.
    return Markup('' % (fa, glyph, glyp

I also changed Markup and escape imports
@cancan101 thanks for noticing that!

Will this be merged? It seems this project is dying :(


Use 7999 as Bitbucket DC default port

What's changed?
Assume 7999 as a default SSH port for Bitbucket and strip it off. This way we can match the origin to the https origin (without port)
What's your motivation?
Currently when using the default port, we need to register 2 origins to make them both work. This can cause conflicts when switching between protocols.
Anyone you would like to review specifically?
@bryceatmoderne  @kmccarp
Have you considered any alternatives or workarounds?
Not doing this
Checklist

[x] I've added unit tests to cover both positive and negative cases
[x] I've read and applied the recipe conventions and best practices
[x] I've used the IntelliJ IDEA auto-formatter on affected files

replaced by https://github.com/openrewrite/rewrite/pull/4429


Re-Write References Link on README

Hello Github Community 👋.
Some References Link isn't pointing to good reference.
example:
https://github.com/shaynlink/tychecker#stringvalidatorconfig
-> Parameter config StringValidatorConfig
Reference StringValidatorConfig is pointing to #stringValidator(config) instead of his #StringValidatorConfig reference.
And I am not good for write a documentation I write this issues and I'm praying for someone to take care of this.

PS: I am not good in english too, so when someone want correct the mistakes in readme or in my code I take too.

I think this package need to completely rewrite readme and documentation.
I'm alone to write on this issue, like twitter 🐦 thread lmao.


Feature: Per device configuration

Disclaimer:
Please go through existing feature requests to avoid creating duplicates. If you found a similar issue please post a comment there. If you are uncertain your issue is related to others then create the issue. Obvious ignorance of this rule might get you blocked from posting new issues. Please tick the box below to show that you have followed the guideline.

[x] I have checked for a similar issue and sure it hasn't been reported before.

Description:
Allow "pairing" a preset (either just EQ or entire app) with a certain device.
So if I switch to my speakers it uses one EQ, and if I switch to my headphones it switches to another (like the AutoEQ profile, for example)
User flow & interface:
Could be implemented like a settings menu, where you can view profiles (like you can see EQ profiles) and select "automatically apply when sound device X is selected"

Sorry even though I appreciate you suggesting this you haven't checked for the same feature being requested on many occasions, mainly this one #231
I will close this issue please refer to the issue mentioned for further updates

@nodeful Sorry about that, I did a search, but that issue is quite old so I must've missed it in all the other issues matching the search terms I tried. Sorry again.

I understand, it's no worries :)


✏ Add descriptive error message when model that has no json encoders gets encoded

It took me hours of debugging to realize my error was not including json_encoders in the Config class of my Model.
Twice.
Changed:

The error TypeError: 'MyModel' object is not iterable becomes TypeError: 'MyModel' object has no json encoder

Hello? Anybody here? Is this gonna get merged??

@tiangolo Can this please be merged? This is a really minimal change.

The problem is that jsonable_encoder is used in a lot more places that don't necessarily have to do with Pydantic models. So, there's no certainty that a TypeError is always for the same reason.
Given that, I'll pass on this, but thanks for your effort @tomgrin10 ! :cake:


[MXNET-413] Fixing the broken links - Week of 5/7

Description
Fixing the second set of broken links in the MXNet site.
Changes

[ x ] Fixing the broken link in the install download page
[ x ] Fixing the scala-packages links

Triggered build again. @anirudh2290 @aaronmarkham should 1.2.0 be listed too?

Yes, may as well add it now. @kpmurali can you add 1.2.0 to the downloads page and resubmit?

@aaronmarkham  Just to confirm, you mean the docs/install/download.html file right?

@szha good point. @kpmurali can you please add the source files from here: https://github.com/apache/incubator-mxnet/releases/tag/1.2.0. Note that we don't have md5 hashes anymore, since they are deprecated for apache releases.

@kpmurali Yes, download.html.

Then should I remove the MD5 download column from all the previous versions in the download page?
http://mxnet.incubator.apache.org/install/download.html

Also, would this mean the current 1.1.0 links have to be made to point to archive links like the other older versions?

@kpmurali since we have sha512 i think its okay to remove md5 column. And you can move 1.1.0 to the archive link.


Support of web platform

First of all thanks for your works
Do you have plans to make this thing work for web platform?

No plans for that.


[account_tx] with non existent account do not return an error.

Request:
{     "method": "account_tx",     "params": [         {             "account": "rH9pnDCtgAbFjozbZQuJWvPM8QHweXgZhj"         }     ] }
Response:
{     "result": {         "account": "rH9pnDCtgAbFjozbZQuJWvPM8QHweXgZhj",         "ledger_index_max": 28952659,         "ledger_index_min": 23333389,         "limit": 0,         "status": "success",         "transactions": [],         "validated": true     } }

rippled seems to return the same empty array as clio for this request. Maybe i'm misinterpreting the issue, please let me know what needs to be done, if anything @mounikakun 👍

Yes rippled do not throw error for non-existent account but Clio throws 'actNotFound' for all the requests with non_existent account. If we are going back and following rippled then there's no need to fix this issue.
@godexsoft if we are matching rippled response, please go ahead and close this issue.

This may have to mimic rippled and not throw the error after all. It's because in rippled it's computationally expensive to find whether an account exists or not. That's also why they are not returning the error in the first place. There is a discussion on rippled's tracker but I think the outcome will be that it's best to leave it as is and mimic on Clio side.

https://github.com/XRPLF/rippled/pull/4619
We decide to keep sync with rippled for this one since it is expensive for rippled.


Cannot find module 'cypress-cucumber-preprocessor' for Sauce Labs execution

Current behavior
I am not able to execute Cypress Specs/Tests in Sauce Labs with Saucectl. This issue is occurring only if I install the Cucumber plugin and configure the Index.js with it.
I have configured the Cucumber-Plugin and executed the Cucumber features, also Mocha Specs successfully in local(through CLI).But, If I try the same through Saucectl then getting an error "Cannot find module 'cypress-cucumber-preprocessor".
Basically its<EMAIL_ADDRESS>I am wondering why its failing only through Saucectl command. Saucectl support execution if Cucumber features for Cypress? or any dependences issue? pls help me to investigate this issue.
Command used to execute the test:  C:\CypressSauce> node_modules.bin\saucectl run
Here is the error:
Sauce Cypress Runner 8.3.0
Preparing npm environment
Your pluginsFile is invalid: D:\sauce-cypress-runner\8.3.0\bundle_project_\cypress\plugins\index.js
It threw an error when required, check the stack trace below:
Error: Cannot find module 'cypress-cucumber-preprocessor'
Require stack:

D:\sauce-cypress-runner\8.3.0\bundle_project_\cypress\plugins\index.js
D:\sauce-cypress-runner\8.3.0\bundle\Cache\9.5.3\Cypress\resources\app\packages\server\lib\plugins\child\run_plugins.js
D:\sauce-cypress-runner\8.3.0\bundle\Cache\9.5.3\Cypress\resources\app\packages\server\lib\plugins\child\index.js

Index.json:
const cucumber = require('cypress-cucumber-preprocessor').default
// // This function is called when a project is opened or re-opened (e.g. due to
// // the project's config changing)
module.exports = (on, config) => {
on('file:preprocessor', cucumber())
//   // on is used to hook into various events Cypress emits
//   // config is the resolved Cypress config
}
Package.json:
{
"name": "cypressautomationcore",
"version": "1.0.0",
"description": "",
"main": "index.js",
"scripts": {
"test": "node_modules\.bin\cypress run",
"headTest": "npm run test -- --headed",
"chromeTest": "npm run test -- --browser chrome",
"recordDashBoardTest": "npm run test -- --record --key fa423514-5a84-42a7-b6a0-b5e7191bba12 --reporter mochawesome",
"GreenKartTest": "npm run test -- --spec "cypress/integration/CyPOC/*""
},
"cypress-cucumber-preprocessor": {
"nonGlobalStepDefinitions": true,
"cucumberJson": {
"generate": true,
"outputFolder": "cypress/cucumber-json",
"filePrefix": "",
"fileSuffix": ".cucumber"
}
},
"author": "",
"license": "ISC",
"devDependencies": {
"cypress": "^9.6.0",
"cypress-cucumber-preprocessor": "^4.3.1",
"mocha": "^10.0.0",
"mochawesome": "^7.1.3",
"multiple-cucumber-html-reporter": "^1.20.0"
},
"dependencies": {
"saucectl": "^0.97.0"
}
}
Desired behavior
Saucectl should work with Cucumber plugin also.
Note: While installing the Saucectl dependency, I got the message "5 moderate severity vulnerabilities".
I tried npm audit fix --force then got the below error, is it causing the issue?
npm WARN using --force Recommended protections disabled.
npm WARN audit No fix available for saucectl@*
up to date, audited 794 packages in 2s
86 packages are looking for funding
run npm fund for details
npm audit report
semver-regex  <3.1.3
Severity: moderate
Regular Expression Denial of Service (ReDOS) - https://github.com/advisories/GHSA-44c6-4v22-4mhx
No fix available
node_modules/semver-regex
find-versions  <=3.2.0
Depends on vulnerable versions of semver-regex
node_modules/find-versions
bin-version  <=4.0.0
Depends on vulnerable versions of find-versions
node_modules/bin-version
bin-version-check  <=4.0.0
Depends on vulnerable versions of bin-version
node_modules/bin-version-check
bin-wrapper  >=0.4.0
Depends on vulnerable versions of bin-version-check
node_modules/bin-wrapper
saucectl  *
Depends on vulnerable versions of bin-wrapper
node_modules/saucectl
6 moderate severity vulnerabilities
Some issues need review, and may require choosing
Versions
Cypress version:9.6.0
Preprocessor version:4.3.1
Node version:v16.14.2
saucectl": "^0.97.0
Sauce Cypress Runner 8.3.0

Have you configured the dependency? https://github.com/saucelabs/saucectl-cypress-example/blob/main/examples/cucumber/.sauce/config.yml#L44

Hi Thanks! I missed to add npm dependency. Its working now after adding below  for config.yml.
“npm:
packages:
"cypress-cucumber-preprocessor": "4.0.3"


kaggle datasets files gives 200 in one machine, 404 in another

I didn't know how else to debug this, so after setting self.debug = True in configuration.py, I'm getting this log line in one machine:
2022-05-26 06:04:13,292 DEBUG https://www.kaggle.com:443 "GET /api/v1/datasets/list/stackoverflow/stacksample HTTP/1.1" 404 0

and this one in another machine:
2022-05-26 06:04:55,972 DEBUG https://www.kaggle.com:443 "GET /api/v1/datasets/list/stackoverflow/stacksample HTTP/1.1" 200 None

with exactly the same authentication (otherwise I'd get a 401).
Do you have the slightest idea of what might be going wrong here?

By the way, it happens with other datasets as well, like yuanyuwendymu/airline-delay-and-cancellation-data-2009-2018.

Still happens, although now I'm getting a 403 instead:
Bad:
kaggle datasets download stackoverflow/stacksample -p /data/stacksample

2022-06-18 07:42:09,930 DEBUG Starting new HTTPS connection (1): www.kaggle.com:443
send: b'GET /api/v1/datasets/download/stackoverflow/stacksample HTTP/1.1\r\nHost: www.kaggle.com\r\nAccept-Encoding: identity\r\nAccept: file\r\nUser-Agent: Swagger-Codegen/1/python\r\nAuthorization: Basic YXN0cm9qdWFubHU6NzJjZmJmNDdlNmJiODMyZjNhMWU3NWY3ZmFjMWNjMWQ=\r\n\r\n'
reply: 'HTTP/1.1 403 Forbidden\r\n'

Good:
$ kaggle datasets download stackoverflow/stacksample -p /tmp/kaggle
2022-06-18 08:43:01,240 DEBUG Starting new HTTPS connection (1): www.kaggle.com:443
send: b'GET /api/v1/datasets/download/stackoverflow/stacksample HTTP/1.1\r\nHost: www.kaggle.com\r\nAccept-Encoding: identity\r\nAccept: file\r\nUser-Agent: Swagger-Codegen/1/python\r\nAuthorization: Basic XXX=\r\n\r\n'
reply: 'HTTP/1.1 302 Found\r\n'

The Authorization: Basic XXX headers are exactly the same in both cases.


new Text plotitem properties #3154

Please test using
https://www.dropbox.com/s/i830o5j3on9zyaf/3154.bkr?dl=0
I used new svg element 'marker' for arrow drawing

i like the use of marker.  but when showPointer: false i still see the arrows.

text needs size property too (see the pdf i sent you).

color is for the text itself, not for the pointer.

the alignment of the pointer and the text is off.  please compare to results in the PDF.
i think you are using the lower-left corner of the text, but it should be the center.

:+1:


Azure CLI 2.51.0 (August 01, 2023) introduces Python UserWarning of cryptography for extensions

Describe the bug
When Azure CLI 2.51.0 (August 01, 2023) is installed, arcappliance extension produces a Python UserWarning:

You are using cryptography on a 32-bit Python on a 64-bit Windows Operating System. Cryptography will be significantly faster if you switch to using a 64-bit Python.

This leads to PowerShell RemoteException which fails Azure Pipelines.
We have tried to uninstall 2.51.0 and install 2.50.0, and the error disappears.
Related command
# az extension add --name arcappliance
az arcappliance validate hci --config-file $configFilePath --only-show-errors
# A non-existent path produces the same error above as well, so just give $configFilePath = "C:\example" if reproduction is desired

Errors

D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\cryptography/hazmat/backends/openssl/backend.py:27: UserWarning: You are using cryptography on a 32-bit Python on a 64-bit Windows Operating System. Cryptography will be significantly faster if you switch to using a 64-bit Python.

Issue script & Debug output
PS> az arcappliance validate hci --config-file $configFilePath --debug
cli.knack.cli: Command arguments: ['arcappliance', 'validate', 'hci', '--config-file', 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml', '--debug']
cli.knack.cli: __init__ debug log:
Enable color in terminal.
Enable VT mode.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x023CA4F0>, <function OutputProducer.on_global_arguments at 0x024CC730>, <function CLIQuery.on_global_arguments at 0x025E8388>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Command index version or cloud profile is invalid or doesn't match the current command.
cli.azure.cli.core: Command index has been invalidated.
cli.azure.cli.core: No module found from index for '['arcappliance', 'validate', 'hci', '--config-file', 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml', '--debug']'
cli.azure.cli.core: Loading all modules and extensions
cli.azure.cli.core: Discovered command modules: ['acr', 'acs', 'advisor', 'ams', 'apim', 'appconfig', 'appservice', 'aro', 'backup', 'batch', 'batchai', 'billing', 'botservice', 'cdn', 'cloud', 'cognitiveservices', 'config', 'configure', 'consumption', 'container', 'cosmosdb', 'databoxedge', 'dla', 'dls', 'dms', 'eventgrid', 'eventhubs', 'extension', 'feedback', 'find', 'hdinsight', 'identity', 'interactive', 'iot', 'keyvault', 'kusto', 'lab', 'managedservices', 'maps', 'marketplaceordering', 'monitor', 'mysql', 'netappfiles', 'network', 'policyinsights', 'privatedns', 'profile', 'rdbms', 'redis', 'relay', 'resource', 'role', 'search', 'security', 'servicebus', 'serviceconnector', 'servicefabric', 'signalr', 'sql', 'sqlvm', 'storage', 'synapse', 'util', 'vm']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name                  Load Time    Groups  Commands
cli.azure.cli.core: acr                       0.139        34       144
cli.azure.cli.core: acs                       0.063         7        54
cli.azure.cli.core: advisor                   0.005         3         6
cli.azure.cli.core: ams                       0.026        22       100
cli.azure.cli.core: apim                      0.019        14        68
cli.azure.cli.core: appconfig                 0.009         9        47
cli.azure.cli.core: appservice                0.151        73       260
cli.azure.cli.core: aro                       0.028         1         9
cli.azure.cli.core: backup                    0.012        16        58
cli.azure.cli.core: batch                     0.069        34       102
cli.azure.cli.core: batchai                   0.008        10        30
cli.azure.cli.core: billing                   0.021        19        52
cli.azure.cli.core: botservice                0.009        12        42
cli.azure.cli.core: cdn                       0.014        39       133
cli.azure.cli.core: cloud                     0.005         1         7
cli.azure.cli.core: cognitiveservices         0.007        10        33
cli.azure.cli.core: config                    0.005         2         7
cli.azure.cli.core: configure                 0.004         2         5
cli.azure.cli.core: consumption               0.012         8         9
cli.azure.cli.core: container                 0.031         1        11
cli.azure.cli.core: cosmosdb                  0.041        58       192
cli.azure.cli.core: databoxedge               0.017         5        27
cli.azure.cli.core: dla                       0.010        23        62
cli.azure.cli.core: dls                       0.009         7        41
cli.azure.cli.core: dms                       0.011         3        22
cli.azure.cli.core: eventgrid                 0.014        25        96
cli.azure.cli.core: eventhubs                 0.057        13        19
cli.azure.cli.core: extension                 0.003         1         7
cli.azure.cli.core: feedback                  0.003         1         2
cli.azure.cli.core: find                      0.004         1         1
cli.azure.cli.core: hdinsight                 0.023         8        39
cli.azure.cli.core: identity                  0.007         2        11
cli.azure.cli.core: interactive               0.002         1         1
cli.azure.cli.core: iot                       0.415        19        82
cli.azure.cli.core: keyvault                  0.019        22       133
cli.azure.cli.core: kusto                     0.007         3        14
cli.azure.cli.core: lab                       0.010        11        34
cli.azure.cli.core: managedservices           0.005         3         8
cli.azure.cli.core: maps                      0.005         5        13
cli.azure.cli.core: marketplaceordering       0.012         1         2
cli.azure.cli.core: monitor                   0.102        26        80
cli.azure.cli.core: mysql                     0.405        13        47
cli.azure.cli.core: netappfiles               0.016        17        94
cli.azure.cli.core: network                   0.697       103       337
cli.azure.cli.core: policyinsights            0.038         9        17
cli.azure.cli.core: privatedns                0.042        14        63
cli.azure.cli.core: profile                   0.005         2         9
cli.azure.cli.core: rdbms                     0.059        44       185
cli.azure.cli.core: redis                     0.007         5        27
cli.azure.cli.core: relay                     0.008        10        37
cli.azure.cli.core: resource                  0.027        51       224
cli.azure.cli.core: role                      0.006        17        61
cli.azure.cli.core: search                    0.007         7        22
cli.azure.cli.core: security                  0.013        48       104
cli.azure.cli.core: servicebus                0.027        12        15
cli.azure.cli.core: serviceconnector          0.199        12       182
cli.azure.cli.core: servicefabric             0.044        27        76
cli.azure.cli.core: signalr                   0.008         8        30
cli.azure.cli.core: sql                       0.037        56       215
cli.azure.cli.core: sqlvm                     0.044         4        20
cli.azure.cli.core: storage                   0.090        58       272
cli.azure.cli.core: synapse                   0.030        54       246
cli.azure.cli.core: util                      0.004         3         7
cli.azure.cli.core: vm                        0.105        57       271
cli.azure.cli.core: Total (64)                3.330      1186      4624
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
cli.azure.cli.core: arcappliance              0.018        11        39  C:\Users\ExampleUser\.azure\cliextensions\arcappliance
cli.azure.cli.core: customlocation            0.049         1         7  C:\Users\ExampleUser\.azure\cliextensions\customlocation
cli.azure.cli.core: hybridaks                 0.050         3        16  C:\Users\ExampleUser\.azure\cliextensions\hybridaks
cli.azure.cli.core: k8s-extension             0.014         2         9  C:\Users\ExampleUser\.azure\cliextensions\k8s-extension
cli.azure.cli.core: Total (4)                 0.131        17        71
cli.azure.cli.core: Loaded 1191 groups, 4695 commands.
cli.azure.cli.core: Updated command index in 0.006 seconds.
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x0478D6A0>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to 'C:\Users\ExampleUser\.azure\commands\2023-08-08.02-40-32.arcappliance_validate_hci.15132.log'.
az_command_data_logger: command args: arcappliance validate hci --config-file {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument.<locals>.add_subscription_parameter at 0x049B0148>]
D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\cryptography/hazmat/backends/openssl/backend.py:27: UserWarning: You are using cryptography on a 32-bit Python on a 64-bit Windows Operating System. Cryptography will be significantly faster if you switch to using a 64-bit Python.
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument.<locals>.add_ids_arguments at 0x049B06A0>, <function register_cache_arguments.<locals>.add_cache_arguments at 0x049B05C8>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs [<function _documentdb_deprecate at 0x057642F8>]
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x024CC778>, <function CLIQuery.handle_query_parameter at 0x025E83D0>, <function register_ids_argument.<locals>.parse_ids_arguments at 0x049B0580>, <function handler at 0x058EF6A0>]
az_command_data_logger: extension name: arcappliance
az_command_data_logger: extension version: 0.2.32
Command group 'arcappliance validate' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=Appliances
cli.azure.cli.core.auth.persistence: build_persistence: location='C:\\Users\\ExampleUser\\.azure\\msal_token_cache.json', encrypt=False
cli.azure.cli.core.auth.binary_cache: load: C:\Users\ExampleUser\.azure\msal_http_cache.bin
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: openid_config = {'token_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/kerberos', 'tenant_region_scope': 'WW', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? False
msrest.universal_http.requests: Configuring retry: max_retries=4, backoff_factor=0.8, max_backoff=90
cli.azure.cli.core.commands.client_factory: Adding custom headers to the client:
cli.azure.cli.core.commands.client_factory:     'x-ms-client-request-id': 'ef8aec93-3594-11ee-a4e8-000000000041'
cli.azure.cli.core.commands.client_factory:     'CommandName': 'arcappliance validate hci'
cli.azure.cli.core.commands.client_factory:     'ParameterSetName': '--config-file --debug'
cli.azext_arcappliance.telemetry_helpers: Subscription fetched from context: 12345678-1234-1234-1234-b8877c7a2a17
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=ResourceManagementClient
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: openid_config = {'token_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/12345678-1234-1234-1234-2d7cd011db47/kerberos', 'tenant_region_scope': 'WW', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled?  False
cli.azext_arcappliance.pkg.errors.error_telemetry: Set telemetry exceptions - exception: , fault_Type: arcappliance-validate-error, summary: Arc Appliance Validate Error: Error loading configuration file: [Errno 2] No such file or directory: 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml'
cli.azext_arcappliance.telemetry_helpers: Custom telemetry: {'context.default.azurecli.appliancedeploymentid': '', 'context.default.azurecli.provider': 'hci', 'context.default.azurecli.portaltraceid': '00000000-0000-0000-0000-000000000000', 'context.default.azurecli.appliancetraceid': '081ffe0a-c858-4aea-aba8-e01eefe8751d', 'context.default.azurecli.appliancecommand': 'ArcApplianceValidateFailure', 'context.default.azurecli.currentdatetime': '2023-08-08T02:40:33Z', 'context.default.azurecli.userazuresubscriptionid': '12345678-1234-1234-1234-b8877c7a2a17', 'context.default.azurecli.appliancefailuremessage': 'Error loading configuration file: [Errno 2] No such file or directory: _C:\\\\ClusterStorage\\\\UserStorage_1\\\\Arc-HCI\\\\WorkingDir\\\\hci-appliance.yaml_ ', 'context.default.azurecli.appliancefailuretype': 'CLIError'}
cli.azure.cli.core.azclierror: Traceback (most recent call last):
  File "C:\Users\ExampleUser\.azure\cliextensions\arcappliance\azext_arcappliance\helpers.py", line 138, in parse_and_validate_config
    with open(config_file, 'r', encoding="utf8") as config:
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 697, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 333, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
  File "C:\Users\ExampleUser\.azure\cliextensions\arcappliance\azext_arcappliance\custom.py", line 85, in validate_appliance
    raise e
  File "C:\Users\ExampleUser\.azure\cliextensions\arcappliance\azext_arcappliance\custom.py", line 60, in validate_appliance
    _, _, infraData = helpers.parse_and_validate_config(cmd, infraData, config_file, resource_group, name, location)
  File "C:\Users\ExampleUser\.azure\cliextensions\arcappliance\azext_arcappliance\helpers.py", line 144, in parse_and_validate_config
    raise CLIError(f"Error loading configuration file: {e} ")
knack.util.CLIError: Error loading configuration file: [Errno 2] No such file or directory: 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml'

cli.azure.cli.core.azclierror: Error loading configuration file: [Errno 2] No such file or directory: 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml'
az_command_data_logger: Error loading configuration file: [Errno 2] No such file or directory: 'C:\\ClusterStorage\\UserStorage_1\\Arc-HCI\\WorkingDir\\hci-appliance.yaml'
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x0478D7C0>]
az_command_data_logger: exit code: 1
cli.__main__: Command ran in 6.282 seconds (init: 1.077, invoke: 5.205)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 12261 in cache
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\Lib\site-packages\azure\cli\telemetry\__init__.pyc C:\Users\ExampleUser\.azure"
telemetry.process: Return from creating process
telemetry.main: Finish creating telemetry upload process.

Expected behavior
No error as 2.50.0.
Environment Summary
azure-cli                         2.51.0

core                              2.51.0
telemetry                          1.1.0

Extensions:
arcappliance                      0.2.32
customlocation                     0.1.3
hybridaks                          0.2.1
k8s-extension                      1.4.2

Dependencies:
msal                            1.24.0b1
azure-mgmt-resource             23.1.0b2

Python location 'C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe'
Extensions directory 'C:\Users\...\.azure\cliextensions'

Python (Windows) 3.10.10 (tags/v3.10.10:aad5f6a, Feb  7 2023, 17:05:00) [MSC v.1929 32 bit (Intel)]

Legal docs and information: aka.ms/AzureCliLegal

Your CLI is up-to-date.

Additional context
https://azcliprod.blob.core.windows.net/msi/azure-cli-2.51.0.msi
https://azcliprod.blob.core.windows.net/msi/azure-cli-2.50.0.msi

Thank you for opening this issue, we will look into it.

This warn info is expected as we bump cryptography to latest version in 2.51.
You can try to install the 64-bit package and migrate to it. see https://review.learn.microsoft.com/en-us/cli/azure/install-azure-cli-windows?branch=pr-en-us-3759&tabs=azure-cli#migrate-to-64-bit-azure-cli

@bebound Thank you very much. I will close this issue as completed.

@bebound Thank you very much. I will close this issue as completed.

If that is expected then please update your documentations also.
There are no info about it here: https://learn.microsoft.com/en-us/cli/azure/install-azure-cli-windows?tabs=azure-cli
You can't expected customer to find a pr branch.

@DanteMustCode can you reopen it until your documentation is updated?

@DanteMustCode can you reopen it until your documentation is updated?

I agree. I work at Fortune 200 who is a client of Microsoft and this has impeded our ability to run any of our Azure Pipelines this morning, when they were working before. I need some documentation on how to best get around this issue.

I agree too. This may be a valid warning. But since it is being written as error, and most of the azure pipeline az cli tasks use "Fail on Standard Error" flag, it results in failure of the azure pipelines. This flag cannot be set to false as it would lead to the "actual/genuine script errors" to be ignored.
It will be hugely appreciated if this behavior can be fixed or provide Azure pipeline tasks the ability to chose older versions of Az cli.

Also I would like to bring to your kind attention the magnitude of this issue is having on the customers. All of the scheduled Production deployments for the Customers who has chosen "Azure Cloud" and running their Azure pipelines on Microsoft Hosted agents, and  using Azure CLI tasks for many deployment scripts are unable to move forward with the scheduled production deployments.

Here is workaround, just downgrade the azure cli version to 2.50.0
Add a command line task at the start of your pipeline and just paste the next script code.
brew uninstall azure-cli
pip3 install azure-cli=2.50.0
Hope this will help you until the real fix 😁

@sugangin @dylanhouston7  I am reopening this issue and checking this further internally.

@sugangin @dylanhouston7 Could you please follow the suggestion and workaround mentioned here.

@sugangin @dylanhouston7 Could you please follow the suggestion and workaround mentioned here.

Changing the "failOnStandardError" flag to false does keep our pipelines going and does unblock us. However, as @sugangin  pointed out, doing this also ignores "actual/genuine" errors.
This actually happened to me yesterday, after we implemented the workaround. When we were trying to deploy some keyvault reference changes with a functions app, we found that the slot failed to start. We found out that we didn't have access policies setup for the app to access the keyvault secrets.
Usually, this step
az deployment group what-if -g "$ResourceGroupName"
would have caught that error before we deployed anything to Azure. But because we did the workaround, we had to go to the deployed Functions app in Azure to see that the deploy slot failed to deploy because of that-- and we were able to view the error there in the Azure portal, but it is always much better to catch errors like this well before anything is deployed to Azure.
My Sev B Azure ticket is being looked at by Microsoft as well.<PHONE_NUMBER>010326
Implemented workaround attached.
azure-workaround.txt

Our workaround was to implement what was described here.
At first we just pinned the cli version, azure-cli==2.51, but that then led to issue #27131.
We ended up adding the following which seems to have done the trick:
steps:
 ...
# Specify python version
- task: UsePythonVersion@0
  inputs:
    versionSpec: '3.x'
    architecture: 'x64'

# Update to latest Azure CLI version
- bash: pip install azure-cli==2.51 azure-core==1.28.0 --extra-index-url https://azurecliprod.blob.core.windows.net/edge
  displayName: 'Upgrade Azure CLI'
...

The downside to this however is two fold:

Need to run it at the beginning of every agent provisioning so any azure CLI tasks via scripts or task: AzureCLI@2 get the update.  So if you provision multiple times in a pipeline, it needs to be done for each.

It is SLOW.  We are seeing an average of 3 to 7 minutes for this mitigation step alone to install the 64bit version.  in areas where this needs to be done multiple times, the pipeline time has now gone way up.

Our workaround was to implement what was described here.
At first we just pinned the cli version, azure-cli==2.51, but that then led to issue #27131.
We ended up adding the following which seems to have done the trick:
steps:
 ...
# Specify python version
- task: UsePythonVersion@0
  inputs:
    versionSpec: '3.x'
    architecture: 'x64'

# Update to latest Azure CLI version
- bash: pip install azure-cli==2.51 azure-core==1.28.0 --extra-index-url https://azurecliprod.blob.core.windows.net/edge
  displayName: 'Upgrade Azure CLI'
...

The downside to this however is two fold:
1. Need to run it at the beginning of every agent provisioning so any azure CLI tasks via scripts or `task: AzureCLI@2` get the update.  So if you provision multiple times in a pipeline, it needs to be done for each.

2. It is _SLOW_.  We are seeing an average of 3 to 7 minutes for this mitigation step alone to install the 64bit version.  in areas where this needs to be done multiple times, the pipeline time has now gone way up.

Thanks for posting this. The first tier MS rep to get back to me suggested a similar workaround, which added 6-7 minutes to our pipeline run time.... which is unacceptable and also SLOW.
This is the workaround that he suggested. Just posting this in case someone is really stuck and needs to release code.
jobs:
- job:
  dependsOn: ${{ parameters.DependsOn }}
  displayName: "${{ parameters.ArmTemplateSubFolder }}/${{ parameters.Environment }}/${{ parameters.Region }}"
  steps:
  - checkout: none
  - download: current
    artifact: ${{ parameters.TemplateFolderPath }}
  - bash: pip install -Iv azure-cli==2.50.0 --extra-index-url https://azurecliprod.blob.core.windows.net/edge
    displayName: 'Use Specific Azure CLI' # 8/10/23 - Using a specific version of the CLI until this issue is resolved https://github.com/Azure/azure-cli/issues/27115
  - task: AzureCLI@2 # this step is required to run bicep deploys that have a module reference to a private repository
    displayName: "Testing Files"
    inputs:
      azureSubscription: ${{ parameters.AzureSubscription }}
      scriptType: pscore
      scriptLocation: inlineScript
      inlineScript: |
        cutting this out for brevity purposes
      azurePowerShellVersion: latestVersion
      errorActionPreference: 'stop' # Optional. Options: stop, continue, silentlyContinue
      failOnStandardError: true # Optional
      pwsh: true

Our workaround was to implement what was described here.
At first we just pinned the cli version, azure-cli==2.51, but that then led to issue #27131.
We ended up adding the following which seems to have done the trick:
steps:
 ...
# Specify python version
- task: UsePythonVersion@0
  inputs:
    versionSpec: '3.x'
    architecture: 'x64'

# Update to latest Azure CLI version
- bash: pip install azure-cli==2.51 azure-core==1.28.0 --extra-index-url https://azurecliprod.blob.core.windows.net/edge
  displayName: 'Upgrade Azure CLI'
...

The downside to this however is two fold:

Need to run it at the beginning of every agent provisioning so any azure CLI tasks via scripts or task: AzureCLI@2 get the update.  So if you provision multiple times in a pipeline, it needs to be done for each.
It is SLOW.  We are seeing an average of 3 to 7 minutes for this mitigation step alone to install the 64bit version.  in areas where this needs to be done multiple times, the pipeline time has now gone way up.

do you have to pip install the specific azure cli version? python x64 seems to already be installed on Microsoft-hosted agents,  and just UsePythonVersion could be enough in that context (I'm not sure if you're on self-hosted agents).

Our workaround was to implement what was described here.
At first we just pinned the cli version, azure-cli==2.51, but that then led to issue #27131.
We ended up adding the following which seems to have done the trick:
steps:
 ...
# Specify python version
- task: UsePythonVersion@0
  inputs:
    versionSpec: '3.x'
    architecture: 'x64'

# Update to latest Azure CLI version
- bash: pip install azure-cli==2.51 azure-core==1.28.0 --extra-index-url https://azurecliprod.blob.core.windows.net/edge
  displayName: 'Upgrade Azure CLI'
...

The downside to this however is two fold:

Need to run it at the beginning of every agent provisioning so any azure CLI tasks via scripts or task: AzureCLI@2 get the update.  So if you provision multiple times in a pipeline, it needs to be done for each.
It is SLOW.  We are seeing an average of 3 to 7 minutes for this mitigation step alone to install the 64bit version.  in areas where this needs to be done multiple times, the pipeline time has now gone way up.

do you have to pip install the specific azure cli version? python x64 seems to already be installed on Microsoft-hosted agents, and just UsePythonVersion could be enough in that context (I'm not sure if you're on self-hosted agents).

answering myself:
the second line ensures the openssl dependency is 64 bit upon installation

Installing with pip such as pip install azure-cli==2.51 is not officially supported.
See https://github.com/Azure/azure-cli/issues/18372#issuecomment-1671014024 for how to handle the exit code of a native command correctly.

We have worked around this by setting failOnStdErr: false (or removing it which is the default) in our Azure Pipelines and updating the PowerShell scripts to check $LASTEXITCODE after each call to a native command like the Azure CLI:
az <insert command here>
if ($LASTEXITCODE -ne 0) {
    Write-Error "az exited with code $LASTEXITCODE"
}

Note that PowerShell 7.3 includes an experimental feature to do this for you: https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_preference_variables?view=powershell-7.3#psnativecommanduseerroractionpreference

@MattJeanes  @jiasli But then, isn't part of the problem here that the UserWarning is changing the exitCode of this native call to 1?

@MattJeanes's solution is correct. This is exactly what I provided in https://github.com/Azure/azure-cli/issues/18372#issuecomment-1671014024.

the UserWarning is changing the exitCode of this native call to 1

UserWarning is merely a message printed to stderr. It never changes the exit code. This can be verified with
> C:\Users\xxx\AppData\Local\Programs\Python\Python310-32\python.exe -c "import cryptography.hazmat.bindings.openssl.binding"
<string>:1: UserWarning: You are using cryptography on a 32-bit Python on a 64-bit Windows Operating System. Cryptography will be significantly faster if you switch to using a 64-bit Python.
> echo $LASTEXITCODE
0

We're also now started seeing this problem with Microsoft's hosted agents which was causing an otherwise working task to suddenly start failing.
If it's a warning, why is it being written to stderr?
Where's the notification that this breaking change was being introduced, and why have the agents been updated to this version if they're not compatible with it?

Standard error (stderr) output is also often used for warnings and even sometimes informational messages which is why I never recommend using failOnStdErr as it will cause problems like this. The only reliable metric for task success / failure is the exit code

Because of this issue we ran into major production issue and had to revert az cli version on all the nodes.
Team introducing these changes should be careful as these changes have wider impact.
As a workaround to avoid future issues We have restricted installation of Az cli on self hosted agents to 2.49.0 and not to latest. but to follow same in MS hosted agents is very difficult.

Regarding the Azure ticket I opened on behalf of the company I work for, a rep got back to me and told me to try my pipeline without the workaround of using a specific Azure CLI version. I did, and it worked today. Anyone else seeing successful results?

Regarding the Azure ticket I opened on behalf of the company I work for, a rep got back to me and told me to try my pipeline without the workaround of using a specific Azure CLI version. I did, and it worked today. Anyone else seeing successful results?

Confirmed. I re-ran my pipelines and they work successfully (without the "workaround'). However, moving forwards I will continue to check the last exit code vs failing on standard error.

Runner-image is using 64-bit CLI by default in https://github.com/actions/runner-images/pull/8096
I think this issue is solved for pipeline users.

Yep, working here too now.  As per above, 64-bit Python seems to now be used on the Microsoft hosted agents, so the warning goes away.

Thanks for verifying all. When I removed the workaround for various other repos that I work with, they all worked this morning as well.
I did not get much detail on what the fix was, other than "...it is a full implementation for the MS hosted agents on the latest version. Your other repos should be fine as long as they run with the latest version of the Microsoft Hosted Agent."
I'm going to have them close the Azure ticket now.

The installation documentation  does not show how to install the 64 bit version using winget (and I can not see such a package available). Is this in progress and if so any ETA?

@martin-bmc x64 version for winget is not in the roadmap yet.
We can't replace the download link to 64-bit as there are some manual steps to migrate to 64bit.
I think we need to keep both 32-bit and 64-bit and add some instructions after installation.

@martin-bmc x64 version for winget is not in the roadmap yet. We can't replace the download link to 64-bit as there are some manual steps to migrate to 64bit. I think we need to keep both 32-bit and 64-bit and add some instructions after installation.

Could you then make sure the version on winget is list as a 32 bit and not 64 bit.
Please add it on the road map so we can continue update azure cli with Winget.

So you are saying that the right hand doesnt know what the left hand is doing over there at Microsoft?  What is going on over there?  Is this a feature?  This is like selling a car with 2 wheels.  Constant issues with VS Code.  Is having a stable command line interface other than DOS on Microsoft's roadmap because I have to tell you, if I got paid to research and fix all of the issues with VS Code and modules in PowerShell and CLI I may not have to work.  Effectively we are doing our jobs and your jobs.

Runner-image is using 64-bit CLI by default in actions/runner-images#8096 I think this issue is solved for pipeline users.

Worked perfectly !


Githika ui home

fixed scroll issue as i have added the show/hide filters. please verify this one and merge

283 let filters = (props.showFilters) ? use const


MAINT: update distribution_version in opensearch sink

Description
This PR updates the doc for opensearch sink in data-prepper
Issues Resolved
Closes #4739
Checklist

[x] By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Will merge on the day of the Data Prepper 2.4 release.

@Naarcha-AWS I had pushed another missing setting dependent on distribution_version and could you please take another look?


Cant connect using .WithTls()

  var options = new ManagedMqttClientOptionsBuilder()
                .WithAutoReconnectDelay(TimeSpan.FromSeconds(5))
                .WithClientOptions(new MqttClientOptionsBuilder()
                    .WithClientId("Client1")
                    .WithTcpServer("broker.hivemq.com")
                    .WithTls()
                    .Build())
                .Build();

            var mqttClient = new MqttFactory().CreateManagedMqttClient();
            mqttClient.Connected +=
                    (s, e) => Console.WriteLine(DateTime.Now.ToShortTimeString() + "connected.");
            mqttClient.Disconnected +=
                (s, e) => Console.WriteLine(DateTime.Now.ToShortTimeString() + "disconnected");
            mqttClient.ApplicationMessageReceived +=
              (s, e) => Console.WriteLine(DateTime.Now.ToShortTimeString() + "received: ");/* + e.ApplicationMessage.ConvertPayloadToString())*/
            await mqttClient.SubscribeAsync(new TopicFilterBuilder().WithTopic("my/topic").Build());
            await mqttClient.StartAsync(options);

            Console.ReadLine();

Error
MQTTnet.Exceptions.MqttCommunicationException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond [::ffff:<IP_ADDRESS>]:8883 ---> System.Net.Sockets.SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond [::ffff:<IP_ADDRESS>]:8883
at System.Net.Sockets.Socket.InternalEndConnect(IAsyncResult asyncResult)
at System.Net.Sockets.Socket.EndConnect(IAsyncResult asyncResult)
at System.Net.Sockets.Socket.<>c.b__317_0(IAsyncResult iar)
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult()
at MQTTnet.Implementations.MqttTcpChannel.d__12.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult()
at MQTTnet.Internal.TaskExtensions.d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult()
at MQTTnet.Adapter.MqttChannelAdapter.d__20.MoveNext()
--- End of inner exception stack trace ---
at MQTTnet.Adapter.MqttChannelAdapter.WrapException(Exception exception)
at MQTTnet.Adapter.MqttChannelAdapter.d__20.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult()
at MQTTnet.Client.MqttClient.d__30.MoveNext()

Hi,
the broker has no encrypted endpoint.
MQTT connection settings
Host: broker.hivemq.com
TCP Port: 1883
Websocket Port: 8000

http://www.mqtt-dashboard.com/
Best regards
Christian


Add documentation on how to install and use the ga4gh_client

Add a section in the Demo documentation on how to install and use the ga4gh_client

Fixed in #1420


Add AC capacity factors as outputs to PV models

Many users want the choice to use either an AC or a DC capacity factor. Should update both pvwatts and pvsamv1 to output both options.

Closed in #736


1.4.0 -> 1.5.0 adds distinct query

Hi five extremely dj khaled voice YOU THA BEST NERMER
http://gph.is/1PpnLYa


Fix kerning wobble in DE/EN

small jump in kerning when one switches from bold to regular. apply opacity 0 :after element hack

1223e5932b335dd60f685ce1feb3c8ec0986827b


node.py: disable commitlog O_DSYNC, preallocation

Commitlog O_DSYNC is intended to make Raft and schema writes durable in the face of power loss. To make O_DSYNC performant, we preallocate the commitlog segments, so that the commitlog writes only change file data and not file metadata (which would require the filesystem to commit its own log).
However, in tests, this causes each ScyllaDB instance to write 384MB of commitlog segments. This overloads the disks and slows everything down.
Fix this by disabling O_DSYNC (and therefore preallocation) during the tests. They can't survive power loss, and run with --unsafe-bypass-fsync anyway.

@avikivity is there are reference to the change in scylla that started doing this preallocation ? (i'm guess it getting blocked by CI failing in some way)

I think someone complained on something similiar - https://groups.google.com/g/scylladb-dev/c/HJSc6RIIQw0/m/yOADFTuKAwAJ?utm_medium=email&utm_source=footer ?


Icons not rendering correctly

VSCode Version: Code 1.12.2 (19222cdc84ce72202478ba1cec5cb557b71163de, 2017-05-10T13:13:11.413Z)
OS Version: Darwin x64 16.6.0
Extensions:

Extension
Author
Version

ng-template
Angular
0.1.3

bracket-pair-colorizer
CoenraadS
0.10.4

EditorConfig
EditorConfig
0.9.3

json2ts
GregorBiswanger
0.0.6

material-icon-theme
PKief
2.0.7

vscode-file-peek
abierbaum
1.0.1

vscode-angular2-files
alexiv
1.3.8

path-intellisense
christian-kohler
1.4.2

gitlens
eamodio
3.5.1

tslint
eg2
0.15.0

angular-essentials
johnpapa
0.1.0

Angular2
johnpapa
2.3.2

debugger-for-chrome
msjsdiag
3.1.2

angular2-inline
natewallace
0.0.17

vscode-icons
robertohuertasm
7.8.1

Material-theme
zhuangtongfa
2.8.1

Steps to Reproduce:

Just open the editor from comando line: code .

Unfortunately, it's happening randomly. When this happened, I've had to completely remove vscode from my computer and everything worked well again. But, right now,  I've just opened and the problem have returned.
See pictures bellow.

See https://code.visualstudio.com/updates/v1_12#_macos-blurry-icons


Igor/feature/ui add edit item

Travis automatic deployment: https://44-pr-ching.surge.sh

@andersonmmi slack doesn't work, so I am writing you here :) Could you please pick any other scene and I will finish this one tomorrow?

Doesn't really important, though, tomorrow I can start the sales report myself, and you can continue here if you want.

Travis automatic deployment: https://44-pr-ching.surge.sh

I didn't know you were having slack problems :wow:
I just finished my last PR, so I can pick up on this one in the morning unless I hear otherwise.

Travis automatic deployment: https://44-pr-ching.surge.sh

Travis automatic deployment: https://44-pr-ching.surge.sh

Travis automatic deployment: https://44-pr-ching.surge.sh

Travis automatic deployment: https://44-pr-ching.surge.sh

Travis automatic deployment: https://44-pr-ching.surge.sh

@pycckuu ETA on making it pretty and making the buttons work?
If you don't have time over the weekend let's just merge it and come back to that scene later.


Leaf boolean / integer plus another attribute

I think L139 should be or if I am interpreting L137 correctly. Is this a bug? Feels like we should be able to set a nonnegative integer variable without a problem.

It's not a bug. Variables can only have one property. See #566. We've had a lot of discussion about this and it's clearly not a popular design choice, but there are internal reasons for doing it this way.


fix: show conflict info properly

Description
ConflictInfo was showing up along side discard button. Moved it to a row of its own.
Fixes #15113
Type of change

Bug fix (non-breaking change which fixes an issue)

Checklist:

[x] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

/ok-to-test sha=e8fe70a

Failing test

Green CI

@Parthvi12 Please test DP for fix.

@IAmAnubhavSaini Tested the dp, and it looks good.


WRLT Station is missing

Hey, you should also add this WRLT station,
operated adult album alternative-formatted FM radio station in the Nashville,
Tennessee market and located at 100.1 MHz.

Sorry, I cannot do this at the moment.
I am working on a way to enable users to add their own stations.
You will receive news about this in adblock radio newsletter.


Restored tutorial text until course module fixed

OPS Build status updates of commit 33faf52:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/get-started-uwp.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


make CompoundIntentMatcher merge the scores when both matchers fail

Hi @rabidgremlin have had a fun bug :)
Basically if both intent matchers fail to match, Compound matcher only returns the scores of the second matcher.
This is a problem because we have a machine learning matcher, then a templated matcher, so the templated matcher was clearing the scores of the machine learning matcher; which broke our label suggester in Concord.
Wasn't an issue prior to v6 because the TemplatedIntentMatcher never use to set any scores in  the debug values (so never overrid any scores).
Have fixed by putting the machine learning matcher last; but putting a fix here which merges the scores.

Maybe better approach is for consumer of CompoundIntentMatcher to specify which matcher is the primary "scorer" and that matcher's scores are used in a "no match scenario" ? Would give the consumer the control and make it obvious what is going to happen ?

@rabidgremlin
for my case, one scorer always has empty scores, so combining the scores doesnt create any problems.
I think you're right, maybe the user should provide their own strategy to merge the scores. E.g. constructor takes BinaryOperator<MatcherScores> noScoreMerger and invoke this if two no matches.
But then concerned about modifying constructor signature....

Maybe could dump all the scores into a MatcherScores and user can just clean up afterwards.

We could have a version of the constructor as is and have it implement a default strategy for merging which can probably be "return no scores" and then detail in the docs.


Dockerfile/docker image to quickly test (initial work provided)

Hello,
First, thanks for your effort!
I wanted to give it a try, and I didn't want to spend too long fiddling, so I thought of doing it in a docker container.
Given the results of the network (that I could afford running) are... not really good, I have not gone further in making this even more accessible. However, let me share what I made:
Starting from the assumption that you have a host computer with an Nvidia card and the drivers installed (e.g. you can call nvidia-smi), you can build a docker image with this Dockerfile:
# minillm (well, pytorch) was build with CUDA 11.6, so we need to match the version
FROM nvidia/cuda:11.6.0-devel-ubuntu20.04

RUN apt-get update && apt-get install -y git python3-pip
RUN git clone https://github.com/kuleshov/minillm
RUN cd minillm && pip3 install -r requirements.txt
# Note: you need to find your GPU CC with: `nvidia-smi --query-gpu=compute_cap --format=csv` (For RTX 3000, it's 8.6)
# This is to avoid: https://github.com/pytorch/extension-cpp/issues/71
# arch_list[-1] += '+PTX'
# IndexError: list index out of range
RUN cd minillm && TORCH_CUDA_ARCH_LIST="8.6+PTX" python3 setup.py install
RUN minillm download --model llama-7b-4bit --weights llama-7b-4bit.pt

Note the TORCH_CUDA_ARCH_LIST needs to have your CUDA compute capability added, depending on your machine. This could be done via a bash script detecting it and using a variable inside of the Dockerfile to replace it.
This image is about 14.6GB. Which is pretty big, 3.6GB are just the weights, which, arguably, could be downloaded on the host instead and mounted as a volume.
To build this docker image, one can do docker build -f Dockerfile -t minillm . (with Dockerfile being the filename of the previous code block). And, once built, this can be run, with the rather long command, that may actually have not-necessary parameters, but I took it from a different project:
docker run \
    -it \
    --rm \
    -v /tmp/.X11-unix:/tmp/.X11-unix \
    --env="DISPLAY=${DISPLAY}" \
    --privileged \
    --net=host \
    -v /dev:/dev \
    --runtime=nvidia \
    --name minillm \
    minillm

And that will drop you in a shell, where you can use minillm.
For example I did:
generate --model llama-7b-4bit --weights llama-7b-4bit.pt --max-length 100 --temperature 1. --top_k 50 --top_p 0.95 --prompt "Make a rhyme that includes the following words: computer, mug, plant, yoga"
Loading LLAMA model
Done
Make a rhyme that includes the following words: computer, mug, plant, yoga
Computer, mug, plant, yoga
Computer, computer, computer!
Washing machines were not that smart!
In the beginning of time, before time, and space,
Before the age of the dinosaur, the mammal was a worm.
And even before the dawn of our planet
We had a plant, but before our species

All the prompts I tried were rather... random. But this was my first try ever, so I'm happy I got to play with it.
Again, thanks for your work. And I thought I better share what I did instead of just leaving it in a forgotten folder in my laptop.

Thank you, this is great. If you want to create this as a separate doc and link it from the README, I'm happy to merge the PR.

On local env, I receive:
minillm generate --model llama-7b-4bit --weights llama-7b-4bit.pt --max-length 100 --temperature 1. --top_k 50 --top_p 0.95 --prompt "Make a rhyme that includes the following words: computer, mug, plant, yoga"
Loading LLAMA model
Done
Make a rhyme that includes the following words: computer, mug, plant, yoga, rug, tag, rug, rug.
You can download this poem in PDF format.

It looks like the model was changed.


Use a rust-toolchain.toml to simplify CI and minimize confusion

Would avoid bug reports like https://github.com/graphprotocol/graph-node/issues/4097 and https://github.com/graphprotocol/graph-node/issues/3230 in the future.

Oh yeah thanks :)


remove XFO from end session callback iframe #1224

@brockallen,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot


merge from konsum-frontend-svelte

package.json

chore(deps): add ^2.9.7 remove ^2.9.6 (devDependencies.vite)

:tada: This PR is included in version 1.31.17 :tada:
The release is available on:

npm package (@latest dist-tag)
v1.31.17
GitHub release

Your semantic-release bot :package::rocket:


ng2-bootstrap carousel stops on selecting a particular slide using bullet

I am facing issue with ng2-bootstrap carousel. If I select a particular slide by clicking on bullet corresponding to that then my carousel gets fixed to that slide and doesn't continue sliding. The same problem is also in the carousel implemented on valor site https://valor-software.com/ng2-bootstrap/#/carousel.Below is my code:
PLEASE NOTE: THIS HAPPENS ONLY IN MOBILE MODE AND NOT IN DESKTOP MODE. TRIED THIS ON VALOR SITE AS WELL.
<carousel [noWrap]="false" [interval]=1000>
        <slide *ngFor="let slide of pdDataObj.product_images;">
          <img [src]="slide" style="margin:auto;" />
        </slide>
</carousel>

I am using 1.1.16-10 version of ng2-bootstrap and 2.4.1 version of angular2. Please help me resolve this.

Yep, it stops when has focus in
and resumes on blur
this is an issue

In the carousel component template,
<div (mouseenter)="pause()" (mouseleave)="play()"  class="carousel slide">
the mouse events can only be used without a cursor.
I added a (mouseup)="play()" , so it can also be used in a mobile mode.

#1433

@felixkubli awesome!

Thanks @felixkubli - but how do I use your latest build? Should I delete node_modules and install ng2-bootstrap again?

I need to merge and publish it, so it will be there later today
most probably as 16-12

fix merged, testing and publishing now .... (should be available in couple of hours)


fluent support

This module doesn't seem to work with the fluent module.
Can fluent support be added? Or is there some kind of workaround available?
It seems to me that the url segment is not translated so the same url redirets to differtent laguages which makes it pretty useless in a multilingual environment.

Seems like there is https://github.com/arillo/silverstripe-fluent-misdirection/ module, works as redirect , but does not collect 404s


[SQL] Delete Edge + Match

OrientDB Version: 3.0.20
Java Version: 1
OS: Windows 10
Is there anyway to combine a delete statement with a match statement? I tried the following:
DELETE EDGE (MATCH {class: Person, where:(id="matan")}.inE("friend"){as:edgeData, where:(status=2)}.outV("Person"){where:(id="bulu")} RETURN expand(edgeData))

But I'm getting an exception:
DELETE EDGE (MATCH ...
                      ^
Encountered " "(" "( "" at line 1, column 13.
Was expecting one of:

Note: the ^ sign points to '('

Hi @matanshukry
That syntax is not supported, you have to re-write the query as follows:
DELETE EDGE WHERE @rid in (MATCH {class: Person, where:(id="matan")}.inE("friend"){as:edgeData, where:(status=2)}.outV("Person"){where:(id="bulu")} RETURN expand(edgeData))

In general, that syntax makes sense, so I'll see if I can support it
Thanks
Luigi

Awesome, works! :)


Make UpdateSource parameter conditional upon UpdateEnabled being 'True'

If UpdateEnabled is 'False', the UpdateSource is still passed to setup.exe. This causes an installation failure if the folder does not exist.

Hi @oWretch, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. Real humans will now evaluate your PR.

TTYL, MSBOT;


Added feature to retrieve repo info using repo id.

Currently, we can retrieve repo info using owner name and repo name. Added support to retrieve repo info using repo id.

Coverage decreased (-0.2%) to 97.666% when pulling 8d52bc6eb9630604c8e8f81718ea36c706db4fad on prasadsurase:get-repo-info-by-using-repo-id into 2632ae380f01f0827180369e23df4dadb24c6693 on piotrmurach:master.

Coverage decreased (-0.2%) to 97.666% when pulling 8d52bc6eb9630604c8e8f81718ea36c706db4fad on prasadsurase:get-repo-info-by-using-repo-id into 2632ae380f01f0827180369e23df4dadb24c6693 on piotrmurach:master.

Coverage decreased (-0.2%) to 97.666% when pulling 8d52bc6eb9630604c8e8f81718ea36c706db4fad on prasadsurase:get-repo-info-by-using-repo-id into 2632ae380f01f0827180369e23df4dadb24c6693 on piotrmurach:master.

Coverage decreased (-0.2%) to 97.666% when pulling 8d52bc6eb9630604c8e8f81718ea36c706db4fad on prasadsurase:get-repo-info-by-using-repo-id into 2632ae380f01f0827180369e23df4dadb24c6693 on piotrmurach:master.

Coverage decreased (-0.2%) to 97.666% when pulling 8d52bc6eb9630604c8e8f81718ea36c706db4fad on prasadsurase:get-repo-info-by-using-repo-id into 2632ae380f01f0827180369e23df4dadb24c6693 on piotrmurach:master.

Thanks, I will soon review and merge.

Thank you!


Add support for user define yanga pipeline step

Is your feature request related to a problem? Please describe.
I have a pipeline stage currently in the directory stages in my project. Yanga has support for user specific pipeline stage if they are located in a file in the project. If I want to use this in another project I have to copy the file to the other project.
Describe the solution you'd like
I would like to develop my custom pipeline stage as a separate Python module and install it as dependency in my project. Yanga shall support custom stages from the project python virtual environment.
Additional context
This is how currently a user pipeline stage is defined in the yanga.yml file:
  build:
    - stage: MyStage
      file: stages/my_stage.py

One could think of defining a custom pipeline stage like this:
  build:
    - stage: MyStage
      module: my_module.my_stages

Fixed by d2a941e


Lack of Documentation

Is there any complete Documentation to cover all features provided by framework?

Unfortunately not. If you have specific questions, I might be able to provide quick answers.

Not specific question.
We are creating an instant messaging app with microservice architecture and i'm just searching for tools which can help us.
But i couldn't find out any usefull documents for microdot.

Note that typically your micro-services are deployed in some data center and communicate with one another directly. Your API gateway will typically accept incoming requests from the outside world and route them to the relevant micro-service. The protocol the API gateway supports (e.g. MTProto) is unrelated to the internal protocol between microservices (e.g. HTTP for Microdot).

Thanks for the Note. So Does any work started for Documentation yet? Because there is no sample for many features which it provide and i have no idea how should i use this framework.

Unfortunately not. We may put more focus on this in 2020, but probably only in the second half. I'm sorry. You're welcome to fly over here and we'll give you the rundown :)


Elasticsearch wrong Auto-Mapping

Describe the bug
When a document is added, a wrong auto mapping from elasticsearch can occur. This can lead to update/insert drops in the future. E.g. when a numeric value is detected as int or long, because the first value is a 1. When a second document is added with a value of e.g. 0.92, it will be rejected, as this would be of type float.
To Reproduce
Steps to reproduce the behavior:

Get a clean instance of elasticsearch
Add a document (e.g. a PDF file resource) with language {"german": 1}
Add a second document with language {"dutch": 0.9}
See error

Expected behavior
Elasticsearch should accept the update/insert.
Your environment(please complete the following information):

DIVA version 2.2.0

Additional context

We could provide a correct mapping before runtime.
We could pre/postfix keys to prevent this kind of error.
We could only store values where we are 100% sure they will be mapped correctly.

@DaTebe
it appears, that ES has a difficulties to index a document that casually have a value for some field represented as integer and float. For example the following document:
{
    "languages": [
        {
            "alpha3": "eng",
            "alpha2": "en",
            "language": "English",
            "score": 1
        },
        {
            "alpha3": "fra",
            "alpha2": "fr",
            "language": "French",
            "score": 0.856154
        }
    ]
}

This applies however only to Dynamic Mapping (fields are not already seen by ES). If the fields already have a mapping specified, the document will be indexed just fine. So we just have to put explicit mapping to our indices!

It's been a long time. We have now implemented a prototype that converts our JSON Schema to a Elasticsearch mapping.
See here: https://github.com/FraunhoferISST/diva/blob/13-optimize-search-experience/core/services/common/loadJsonSchema.js
And here: https://github.com/FraunhoferISST/diva/blob/13-optimize-search-experience/core/services/common/convertJsonSchema.js
It is possible to set a type inside the JSON Schema using our custom _elasticsearch field. It is also possible to set a specific analyser for text fields.
Implementation is specific to our way of using JSON Schemata. It may not work for all possible JSON Schemata.
We try to finish implementation till end of week.

@setaman now I've finished the simple solution: https://github.com/FraunhoferISST/diva/blob/71feaf4c833f08253f45a9479db2bb5079a8dcae/core/services/elasticsearch-connector/Connector.js#L49
Only put mapping when index not exists. This will be the case for the first startup of DIVA.
Now we need to discuss migration logic.