az ml batch-endpoint invoke wants an AccountKey or SasToken for registered Datastores for output

From here https://learn.microsoft.com/en-us/cli/azure/ml/batch-endpoint?view=azure-cli-latest#az-ml-batch-endpoint-invoke
This command works as the output is to the registered internal Azure Machine Learning Default Datastore...
az ml batch-endpoint invoke --name mybatchendpoint --input https://azuremlexampledata.blob.core.windows.net/data/mnist/sample --input-type uri_folder --output-path azureml://datastores/workspaceblobstore/paths/mybatchendpoint --set output_file_name=predictions.csv --query name -o tsv --resource-group myrg --workspace-name myamlworkspace
When I want my output to go to another Storage Account location - I have pre-registered it in AML Studio as follows...(under Data > Datastores)
Datastore name: data_mystorageaccount
Datastore type: Azure Blob Storage
Subscription ID: {redactedmyAzureSub}
Storage account: mystorageaccount
Blob container: output
Save credentials with the datastore for data access - enabled
Authentication type: Account key
Account key: {the account key from the storage account mystorageaccount}
Clicked Create
From looking in the Studio it can browse to that output location - see image - it can see a file already called ServiceTags_Public_20230306.json in the right hand pane...

This proves connection to the Storage Account via the AccountKey as successful.
When I run the following command...
az ml batch-endpoint invoke --name mybatchendpoint --input https://azuremlexampledata.blob.core.windows.net/data/mnist/sample --input-type uri_folder --output-path azureml://datastores/data_mystorageaccount/paths/mybatchendpoint --set output_file_name=predictions.csv --query name -o tsv --resource-group myrg --workspace-name myamlworkspace
...it fails with the following output error Missing AccountKey or SasToken
ERROR: {
  "error": {
    "code": "UserError",
    "severity": null,
    "message": "Missing AccountKey or SasToken",
    "messageFormat": null,
    "messageParameters": null,
    "referenceCode": null,
    "detailsUri": null,
    "target": null,
    "details": [],
    "innerError": null,
    "debugInfo": null,
    "additionalInfo": null
  },
  "correlation": {
    "operation": "{redacted}",
    "request": "{redacted}"
  },
  "environment": "{redacted}",
  "location": "{redacted}",
  "time": "2023-03-16T13:41:12.1918203+00:00",
  "componentName": "managementfrontend"
}

It states on the Datastores screen in AML Studio the following...
Datastores securely connect to a storage service on Azure by storing connection information. With datastores, you no longer need to provide credential information in your scripts to access your data
...so I'm not sure why this invoke command fails? Why does it need a AccountKey or SasToken passed to it as part of the az ml batch-endpoint invoke command?
Even if I did need to pass a AccountKey or SasToken as part of this command, is it supported here? There are no examples listed in the documentation for output types

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 5233a95c-48d7-d49b-3e21-b42c94a31290
Version Independent ID: 60a98b3a-a7b9-ae58-ab5e-4b1d086a7dd0
Content: az ml batch-endpoint
Content Source: latest/docs-ref-autogen/ml/batch-endpoint.yml
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

route to CXP team

Are there any findings on this particular issue? I am seeing this issue in our Azure tenent.

Thanks for reporting this issue to us. We are happy to help. Can you please run the same command but with the flag --debug? That would be:
az ml batch-endpoint invoke --name mybatchendpoint --input https://azuremlexampledata.blob.core.windows.net/data/mnist/sample --input-type uri_folder --output-path azureml://datastores/workspaceblobstore/paths/mybatchendpoint --set output_file_name=predictions.csv --query name -o tsv --resource-group myrg --workspace-name myamlworkspace --debug

Also, it will help to know if thi workspace is under a private VNET?

We are having the same issue.

We have the same issue @santiagxf. It stopped working around October 5th and seems to be an issue with Azure CLI.

Same issue. Both on an API calling AML endpoint using REST and in Azure CLI. Seems like the issue is on AML itself. Ouput (and input) storage are in another VNET with service-endpoint.
Scrubbed Log: aml output auth error.txt

We are investigating this issue. I will provide an update within the day.

@santiagxf Any update here?

This issue is under investigation and we are trying to identify the root of the issue with the logs provided. I will update the thread as soon as we have an update. As a workaround, can you try out on a new created endpoint? I can't reproduce the issue from my side so it may be related with existing ones.

Issue seems to be solved now. We didn't make any changes, so someone on your end has solved it. Both old and new endpoints work.

@yacuzo To be certain - do you mean that going to the default registered AML Studio's "datastore" is working, or that in-fact any other imported "datastore" storage account is working? My original issue was around the latter here so I'm interested to know if this is fixed before anyone starts to close this off as resolved - as I never experienced issues to the default "datastore" - Thanks

Would like to know the cause of this in case it happens again. This is crucial to our solution and causes big problems if it fails.

@neilmca-inc We have a separate linked datastore. Not using the default one. We also have a support ticket on this, and MS has responded that a hotfix has been deployed. I'd consider this closed.

I'll do some testing on this - probably by the end of the week - to see how I get on

We have identified an issue with the service and a hotfix was applied. The rollout is going on as we speak. WestEurope, NorthEurope, and SouthCentralUS regions are already patched and we continue rolling on on more regions as we speak. We apologies for the inconvenient. I will keep this issue opened until completely roll out.

I found this issue back in October, when we started facing this issue.
From 10/26 to 12/1, we were able to successfully invoke our batch endpoint (without making any changes on our side).
However, we started getting this issue again. Is there any chance the outage is still occurring in westus2?
The full error message:
Content: {
  "error": {
    "code": "UserError",
    "severity": null,
    "message": "Missing AccountKey or SasToken",
    "messageFormat": null,
    "messageParameters": null,
    "referenceCode": null,
    "detailsUri": null,
    "target": null,
    "details": [],
    "innerError": null,
    "debugInfo": null,
    "additionalInfo": null
  },
  "correlation": {
    "operation": "76ef1f8efce8236907289f004d0dcc16",
    "request": "1d98980b3884c1ae"
  },
  "environment": "westus2",
  "location": "westus2",
  "time": "2023-12-12T12:20:31.7688103+00:00",
  "componentName": "managementfrontend",
  "statusCode": 400
}

I found this issue back in October, when we started facing this issue. From 10/26 to 12/1, we were able to successfully invoke our batch endpoint (without making any changes on our side). However, we started getting this issue again. Is there any chance the outage is still occurring in westus2?
The full error message:
Content: {
  "error": {
    "code": "UserError",
    "severity": null,
    "message": "Missing AccountKey or SasToken",
    "messageFormat": null,
    "messageParameters": null,
    "referenceCode": null,
    "detailsUri": null,
    "target": null,
    "details": [],
    "innerError": null,
    "debugInfo": null,
    "additionalInfo": null
  },
  "correlation": {
    "operation": "76ef1f8efce8236907289f004d0dcc16",
    "request": "1d98980b3884c1ae"
  },
  "environment": "westus2",
  "location": "westus2",
  "time": "2023-12-12T12:20:31.7688103+00:00",
  "componentName": "managementfrontend",
  "statusCode": 400
}

We were also getting the same issue. The problem is with the permission on your data store. Our batch end point doesn't have permission to write into our custom data store (this has been working until last week). However, it is able to write into default data store workspaceblobstore. As a temporary fix, we changed our output path to default data store workspaceblobstore and it worked.
I hope this helps in finding the permanent fix.

I found this issue back in October, when we started facing this issue. From 10/26 to 12/1, we were able to successfully invoke our batch endpoint (without making any changes on our side). However, we started getting this issue again. Is there any chance the outage is still occurring in westus2?
The full error message:
Content: {
  "error": {
    "code": "UserError",
    "severity": null,
    "message": "Missing AccountKey or SasToken",
    "messageFormat": null,
    "messageParameters": null,
    "referenceCode": null,
    "detailsUri": null,
    "target": null,
    "details": [],
    "innerError": null,
    "debugInfo": null,
    "additionalInfo": null
  },
  "correlation": {
    "operation": "76ef1f8efce8236907289f004d0dcc16",
    "request": "1d98980b3884c1ae"
  },
  "environment": "westus2",
  "location": "westus2",
  "time": "2023-12-12T12:20:31.7688103+00:00",
  "componentName": "managementfrontend",
  "statusCode": 400
}

We were also getting the same issue. The problem is with the permissions on your custom data store. Our batch end point doesn't have permission to write into our custom data store (this has been working until last week). However, it is able to write into default data store workspaceblobstore. As a temporary fix, we changed our output path to default data store workspaceblobstore and it worked.
I hope this helps in finding the permanent fix.

That fix totally worked! Thank you so much for the pointer.
I am wondering if the team can reply on why the issue re-occurred randomly, as it resulted in me spending a few days trying out a host of things as I thought it was user error! 😅
I'm seeing in the docs that any registered datastore should work:

We have the same issue @santiagxf. We are getting the below response for uksouth region since 12-14-2023  -
error: Missing AccountKey or SasToken
Content: {
  "error": {
    "code": "UserError",
    "severity": null,
    "message": "Missing AccountKey or SasToken",
    "messageFormat": null,
    "messageParameters": null,
    "referenceCode": null,
    "detailsUri": null,
    "target": null,
    "details": [],
    "innerError": null,
    "debugInfo": null,
    "additionalInfo": null
  },
  "correlation": {
    "operation": "bc7b28ff667a26cd6b236e2d58239c54",
    "request": "68cea493082c06e6"
  },
  "environment": "uksouth",
  "location": "uksouth",
  "time": "2023-12-15T09:43:59.7361588+00:00",
  "componentName": "managementfrontend",
  "statusCode": 400
}

Update: A permanent fix is being deployed in the service to resolve the issue. We are performing a progressive rollout across the many regions. I will provide an update once completely rollout.

@ms-kashyap we have rolled out the fix on westus2. Please let us know if this solves the issue. We continue rollout in other regions too.

Hi, we have the same issue in uksouth. Was wondering when the patch would be rolled out there?

Hi @jameseedi! We have rolled out the patch to all the regions. Can you please try again with a new deployment and see if the error persist?


listAdminKeys function not recognised

This code works to retrive the AdminKeys for Azure Search, but listAdminKeys is marked red.
"searchAdminKeys": {
    "type": "object",
    "value": "[listAdminKeys(variables('searchServiceName'), '2015-02-28')]"
}

This will be released very soon, sorry for the delay.


Fix persistent-soft make dependency

Add persistent-soft to doom-protected-packages to avoid install failure.

Refreshing the autoloads should probably be added to make install too, because doom/packages-install is a requirement.

Good catch, thanks!


Any way to "seed" the values of a new instance?

I posted this fully over at StackOverflow, but, to summarize here: Is there any way to hand an existing object to link_to_add_association function to pre-seed the HTML generated with the current values of the existing object? Something like this:
link_to_add_association 'Clone', f, :codes, data: {"association-insertion-node" => "tbody.codes", "association-insertion-method" => "append"}, render_options: {locals: {code: code.object}}
I tried looking at the code, but it's so abstracted, I'm having a hard time following whether I can inject a current object such that it will use it's attribute values as data in the fields.

Take a look at the :wrap_object option, it allows to pre-initialize the object, I think you should be able to use it to clone from an existing object as well.
E.g. something like this might work:
- code_to_clone = f.object
= link_to_add_association('Clone', f, :codes,
    wrap_object: Proc.new { |new_code| new_code.name = code_to_clone.name; new_code })

Just copy 1 field for demonstration purposes :)

= link_to_add_association 'Clone', f, :codes, data: {"association-insertion-node" => "tbody.codes", "association-insertion-method" => "append"}, wrap_object: Proc.new {|d| d = code.object.clone; d.id = nil; d}
Brilliant. Cheers!

:+1:


Option to override the maven repo used

It would be helpful if we could override the repo used to download the NewRelic agent.
Describe the Enhancement

The user could specify a repo somehow which would be used in place of the maven central repo currently hardcoded in the Java agent uri.
Possible Solution

An environment variable that could specify the repository base URL would be very nice to have.
I'm not familiar with how multiple build packs interact with each other, but another possibility could be using the repo settings from the maven buildpack https://github.com/paketo-buildpacks/maven

Motivation

Maven Central can experience downtime and many development environments may only have access to a private Maven repo which acts as a mirror to Maven Central.

You can use a Dependency Mirror or you can use a Dependency Mapping. The former will point everything the buildpacks try to install to the mirror, the latter allows you to pick individual dependencies one at a time and point them elsewhere.
If you use the dependency mapping, the binding-tool cli can help create the bindings.
Hope that helps!

I was not aware of that, that does exactly what I wanted.  Thanks @dmikusa !


UIViewController embedded into UINavigationController

This causes an EXC_BAD_ACCESS n parallaxViewScrollHorizontally
Reproducable by embedding a UINavigationController in UIViewController in the storyboard

You should to use a view or tool bar..

What if i need it in UINavigationController?


Addison - Specific comments for delivery

Addison is a customer that would like to be able to go onto the website and add specific comments to the delivery that the driver will be able to see and take note.
Related to #15

Acceptance Criteria

If the customer is able to access the website and easily able to navigate to the comment section.
The Driver is able to see and take note of any comments sent by customer.

Reviewed User Story:
As a customer I want to be able to leave specific comments and notes for the delivery driver, relating to the delivery of the package.

Reviewed Acceptance Criteria:
As a customer I am able to leave specific comments and notes for the delivery driver through accessing the On the Spot website. This can be done either during the initial ordering process or subsequent to this by using the packages unique identifier and amending the order details.


voucher checkout

added custom attributes for icons:

voucherIcon
validVoucherIcon
invalidVoucherIcon

added animations

res/anim/valid.xml (zoom in - zoom out)
res/anim/invalid.xml (shake)

added styles:

VoucherCodeLabel
VoucherCodeEditText
VoucherValidateButton

prepared for release as 0.3.0

@polok, @lkulig CR fixes applied

LGTM :+1:  Rebase&squash it.

@LukaszWiktor I am going to merge this one but in next release we have to improve the animation as it cuts an animated view.


Add Dockerfile

Run this project into a docker container.
To build:
docker build -t hana-esh .
To run, the secret config file must be added at runtime:
docker run -ti -p 8000:8000 --mount type=bind,source=$(pwd)/your_path/to/.config.json,target=/home/appowner/hana-esh-odata/src/.config.json,readonly hana-esh

Is there a chance for this pull request to be accepted ?


Pipeline and per project configuration support

PR contains several improvements to the plugin:

Support for DSL/Pipeline jobs
Per project configuration
Posting to fixed topic
New build step that allows sending arbitrary messages
Automated tests

@butchyyyy: This looks much better! I took a close look at all of the commits and everything LGTM! I do think the documentation (README) may need some improvements here and there but let's do that in another PR after this one gets merged! :) Thanks for working on this!

@eeshangarg: Thanks a lot for taking the time to look at this. Looking back at the README i noticed some typos and i'm sure there are other improvements to be made since i'm not an native english speaker. I'll be happy to improve it once this is merged.


PTVS should use "Inline" in variable presentation for "Protected" variables, same as vscode

In Tools -> Options -> Python -> Debugging, the Protected dropdown should default to Inline, unless the user changes it to something else. Right now, the default is Group.
This will be in parity with vscode

See https://github.com/microsoft/debugpy/issues/1025 for context


i want to use SVM as last layer of CNN any suggestion?

Please make sure that the boxes below are checked before you submit your issue. If your issue is an implementation question, please ask your question on StackOverflow or join the Keras Slack channel and ask there instead of filing a GitHub issue.
Thank you!

[x] Check that you are up-to-date with the master branch of Keras. You can update with:
pip install git+git://github.com/fchollet/keras.git --upgrade --no-deps

[ ] If running on TensorFlow, check that you are up-to-date with the latest version. The installation instructions can be found here.

[ ] If running on Theano, check that you are up-to-date with the master branch of Theano. You can update with:
pip install git+git://github.com/Theano/Theano.git --upgrade --no-deps

[ ] Provide a link to a GitHub Gist of a Python script that can reproduce your issue (or just copy the script here if it is short).

Hello,
Have you tried this ? -> https://github.com/fchollet/keras/issues/2588

@unrealwill   #2588 does not have any information about how to use as SVM last layer of CNN

In #2588 it suggest to end your model with :
model.add(Dense(nb_classes), W_regularizer=l2(0.01))
model.add(Activation('linear'))

model.compile(loss='hinge',
              optimizer='adadelta',
              metrics=['accuracy'])

You can adapt it to CNN by using a kernel size of 1 for conv1d or (1,1) for conv2d, use the appropriate regularizer and adding a flattening layer afterwards and you should be good to go :
(untested not even runned )
model.add(ConvxD(nb_classes,kernel_size=(1,...) '), kernel_regularizer=l2(0.01), bias_regularizer=l2(0.01))
#### model.add(Activation('linear')) Not necessary because by default Conv use linear activation by default
model.add(Flatten())
model.compile(loss='hinge',
              optimizer='adam',
              metrics=['accuracy'])

i want to train a neural network, then select one of the first fully connected one, run the neural network on my dataset, store all the feature vectors, then train an SVM with a different library (e.g sklearn).

Ok, then you might find this useful
https://keras.io/getting-started/faq/#how-can-i-obtain-the-output-of-an-intermediate-layer
Additional hint, you can have two models : one Model for training and one Model for exporting the intermediate layer. As long as the models share their weights, the training will modify the the second model use for prediction of the intermediate layer.

That's what people do a lot in transfer learning including me in this work, take a look on codes. Basically, 1) do what @unrealwill linked, 2) store all of them 3) do SVM using scikit-learn.

Thanks @unrealwill @keunwoochoi
How can i solve this issue
when i try to store features i got error:
get_features = K.function([K.learning_phase(), model.layers[0].input], [model.layers[9].output])
#X is the data of all the input samples
layer_output = get_features([X])[0]
Traceback (most recent call last):
File "", line 3, in
layer_output = get_features([X])[0]
File "C:\Users\user\Anaconda2\lib\site-packages\keras\backend\theano_backend.py", line 959, in call
return self.function(*inputs)
File "C:\Users\user\Anaconda2\lib\site-packages\theano\compile\function_module.py", line 795, in call
allow_downcast=s.allow_downcast)
File "C:\Users\user\Anaconda2\lib\site-packages\theano\tensor\type.py", line 178, in filter
data.shape))
TypeError: Bad input argument to theano function with name "C:\Users\user\Anaconda2\lib\site-packages\keras\backend\theano_backend.py:955" at index 0 (0-based).
Backtrace when that variable is created:
File "C:\Users\user\Anaconda2\lib\site-packages\ipykernel\zmqshell.py", line 501, in run_cell
return super(ZMQInteractiveShell, self).run_cell(*args, **kwargs)
File "C:\Users\user\Anaconda2\lib\site-packages\IPython\core\interactiveshell.py", line 2717, in run_cell
interactivity=interactivity, compiler=compiler, result=result)
File "C:\Users\user\Anaconda2\lib\site-packages\IPython\core\interactiveshell.py", line 2821, in run_ast_nodes
if self.run_code(code, result):
File "C:\Users\user\Anaconda2\lib\site-packages\IPython\core\interactiveshell.py", line 2881, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "", line 7, in
from keras.models import Model
File "C:\Users\user\Anaconda2\lib\site-packages\keras_init_.py", line 2, in
from . import backend
File "C:\Users\user\Anaconda2\lib\site-packages\keras\backend_init_.py", line 64, in
from .theano_backend import *
File "C:\Users\user\Anaconda2\lib\site-packages\keras\backend\theano_backend.py", line 23, in
_LEARNING_PHASE = T.scalar(dtype='uint8', name='keras_learning_phase')  # 0 = test, 1 = train
Wrong number of dimensions: expected 0, got 2 with shape (2515L, 120000L).

Hello @keunwoochoi @unrealwill
data input for CNN
X_train = (2012L, 3L, 200L, 200L)
Y_train = (2012L, 2L)   #label after encoding for CNN
#Store features after CNN training
get_activations = K.function([model.layers[0].input, K.learning_phase()], [model.layers[9].output,])
feature = get_activations([X_train,0])
#Now I have feature vector
#features = float (2012L, 128L)
y_train = (2012L,)
#I want to use this feature vector with SVM anyone can help me?
#currently, I am trying this code
svcClf = SVC(C=1.0,kernel="rbf",cache_size=975)
scaler = MinMaxScaler()  #transform features by scaling each features to a given range
feature = scaler.fit_transform(feature)
svcClf.fit(feature, y_train)
#But I got error
with scaler
ValueError: Found array with dim 3. MinMaxScaler expected <= 2.
Without scaler
ValueError: Found array with dim 3. Estimator expected <= 2.


Add value::to_raw_value

Resolves #654.
I adopted the # Errors doc section from to_value. I can also try coming up with a semi-realistic example of how one would use this.

@dtolnay Is this realistic enough?


[v6.0] Window ext->style_header seems unused?

@kisvegabor
In lv_win.c, ext->style_header is only used in one line, in lv_win_realign:
lv_obj_align(ext->title, NULL, LV_ALIGN_IN_LEFT_MID, ext->style_header->body.padding.left, 0);

Other statements in lv_win_realign use the style which is retrieved using header_style = lv_win_get_style(win, LV_WIN_STYLE_HEADER)
lv_win_set_style modifies the header style via lv_obj_set_style(ext->header, style);.
Is this intended behavior? Or should that single line in lv_win_realign also use header_style which is retrieved using lv_win_get_style and should ext->style_header be removed?

Good catch! It really should be deleted.
See 5e60002


Update House Rule “combat-rules”

Automatically generated by Netlify CMS

👷 Deploy Preview for dynamic-cheesecake-5fbd8b processing.

Name
Link

🔨 Latest commit
0704840bd1f5669802d8b4543d7db36ea1798f73

🔍 Latest deploy log
https://app.netlify.com/sites/dynamic-cheesecake-5fbd8b/deploys/62c9ff68f52321000983886a


Individual launchers for Word/Excel/Powerpoint,...

Hello,
I was wondering if it would be technically feasible to launch individual apps (Excel, Word,...) directly rather than going through Office first and launching them in separate windows?
If so, would it be possible to create additional .desktop files for each app, in particular Word/Excel/Powerpoint so they can be added as shortcut to a taskbar?

This feature would be awesome


Add TALL Stack

https://github.com/blade-ui-kit/awesome-tall-stack
I'd like to submit the Awesome TALL Stack list which features a resources on a full stack solution using libraries built by the Laravel community. On here, developers can find resources specific to the TALL stack (and not the individual libraries) to help them learn, code and built their next app.
I hope I did all the steps correctly! 🤞 🙂

Thanks for making an Awesome list! 🙌
It looks like you didn't read the guidelines closely enough. I noticed multiple things that are not followed. Try going through the list point for point to ensure you follow it. I spent a lot of time creating the guidelines so I wouldn't have to comment on common mistakes, and rather spend my time improving Awesome.

@sindresorhus urgh, I'm so sorry. I indeed missed some obvious things.
I reviewed https://github.com/sindresorhus/awesome/pull/1861 & https://github.com/sindresorhus/awesome/pull/1856
Sorry for wasting your time! Hope I got everything right this time.

unicorn

Hello @driesvints 👋.
Talking about the pull request, I think you have this point wrong:

This pull request has a title in the format Add Name of List.

The pull request title should be "Add Tall Stack" instead of "Add TALL Stack".
Talking about the list itself, I think you have these points wrong:

Includes a succinct description of the project/theme at the top of the readme. (Example)

Your list includes a succinct description, though it's not very descriptive and it's not the same you've written in this repository. It's not written that the succinct description must be the same, but I guess it should so that's why I'm pointing this out.

The heading title of your list should be in title case format: # Awesome Name of List.

The heading should be "Awesome Tall Stack" instead of "Awesome TALL Stack".

Doesn't include an Inspired by awesome-foo or Inspired by the Awesome project kinda link at the top of the readme. The Awesome badge is enough.

You list does includes this. Especifically:

Thanks to the original awesome project and the Awesome Tailwind CSS repository for inpiring this project.

My comments are based according to the guidelines.
🤝

Ran linter and everything is OK, but I disagree with @JoseDeFreitas about the project name in my humble opinion (this is my first review), he could maintain TALL as it stands for Tailwind, Alpine, Laravel and Livewire; We can see other examples on Awesome list where acronyms are used in capital letters, here are some examples:

https://github.com/deephacks/awesome-jvm#readme
https://github.com/sturobson/BEM-resources#readme
https://github.com/wbkd/awesome-d3#readme

@JoseDeFreitas @guifelix thanks for your reviews 👍

The pull request title should be "Add Tall Stack" instead of "Add TALL Stack".
The heading should be "Awesome Tall Stack" instead of "Awesome TALL Stack".

That's the incorrect name.

Your list includes a succinct description, though it's not very descriptive and it's not the same you've written in this repository. It's not written that the succinct description must be the same, but I guess it should so that's why I'm pointing this out.

Updated.

You list does includes this. Especifically:

Good one. Removed.
Thanks! : )

Very well done! Nice mix of GitHub repos and other types of learning resources like blogs and recordings :tada:

TALL stack in The TALL stack is a full stack development solution featuring some should be linkified to https://tallstack.dev/

In the The TALL Stack, add a succinct description to each item.

I think it would be clearer if the Apps & Websites section was named Examples.

@sindresorhus all done. Thanks for the review!

@sindresorhus the changes you requested seem to give some errors with the awesome list linter: https://github.com/blade-ui-kit/awesome-tall-stack/runs/1341905282
I can't link to tallstack.dev twice. Do you want me to remove the link again or remove the list item?

I removed the second link. Should be good now.

Tweet: https://twitter.com/awesome__re/status/1323617629354008577

Thank you so much @sindresorhus! 🥳


array sorted or not.cpp

This program check weather array sorted (in ascending or descending order) or not

TYSM for ur PR💞


clicks on chips trigger an error

When using chips without datas, an error "Cannot read property 'x' of undefined" shows up on the console.
To reproduce the problem, open the browser console then click on jane doe chip on the sample page :
http://materializecss.com/chips.html

We are no longer working on the v0.100.2 branch. This issue is fixed on our 1.0.0 alpha branch if you want to try using that.

My bad I didn't saw the new documentation.
I can't change that easily right now but will do later.
For now I just changed this code :
e.trigger("chip.select",e.data("chips")[t])
to :
e.trigger("chip.select",e.data()?e.data("chips")[t]:null)
To prevent the error.
Thanks,


Fix typos & casing

Fixes some more typos.
Fixes the casing of some variable names to be camel cased.
Changes one field name entirely to be more clear about its purpose.
Also removes UTF-8 BOM from some files.

Thank you :)


Deferred mutation queries

RENDERED
Queries that defer mutation of certain components.

"Defer mutation for better parallelism" is basically the purpose of Command. Can we unify the implementation and/or API with that?

I'm worried that the DeferMut can be easily confused with DerefMut.

I'm worried that the DeferMut can be easily confused with DerefMut.

Yeah, we can bikeshed a better name if we decide to keep the mechanic.

"Defer mutation for better parallelism" is basically the purpose of Command. Can we unify the implementation and/or API with that?

Didn't consider Command, but yes, it seems to do exactly what is needed, assuming the mutations are batched together.
In fact, I think this piece of code would do exactly that:
fn foo(
  mut commands: Commands,
  bars: Query<(Entity, Cow<Bar>)>,
) {
  for (entity, bar) in vars.iter() {
    bar.0 = 0.0; // Copy happens
    commands.entity(entity).insert(bar.to_owned()); // We (re)insert the component
  }
}

2 problems with that would be:

bit boilerplate-y, you need to add commands as argument
order of mutation, with the original idea we'd keep the order the same as system order,
but if it's commands and few of those get batched, what would the order of application be?

Although bit non-obvious, using Commands seems like the way to go here.
I'm closing the request


Syntax Coverage Gap in Constant Expressions

Operators and other things are not scoped in constant expressions.  Example:
	constant C_BUILD_TIME_SLV : std_logic_vector(31 downto 0) :=
		std_logic_vector(to_unsigned(C_BUILD_TIME_YEAR, 16)) &
		std_logic_vector(to_unsigned(C_BUILD_TIME_MONTH, 8)) &
		std_logic_vector(to_unsigned(C_BUILD_TIME_DAY, 8));

the & symbol is not marked as a symbol.

Fixed in 1.7.13.


Add how-to to Readme explaining how to start a timediff block

Hi,
thanks for providing this plugin! It probably seems very basic, but for me it'd have helped to provide a basic sentence telling me that I need to start a block like this:
```timediff
...
```
because for me it was not obvious.
Can do a PR if you want.
Regards,
Johannes

Hi! Thank you for your feedback.
I've added example how to render timediff block, so it should be clearer now.

Thanks so much!


Distribute typing information

Typing is crucial for me!
Currently almost all decorator can be annotated as Callable[[T], T] where T = TypeVar('T', bound=Callable) - because we don't change the function's signature.
So, things to do:

Create annotations (in the source or via pyi)
Create py.typed to mark this code as typed, see PEP561
Check them with mypy and pytest-mypy-plugins

Fully annotated code on the way. MyPy has a lot of questions about our code. For example, for MyPy Callable has no attribute __wrapped__ even in the branch with an explicit hasattr check. That's silly. So, annotations that satisfy MyPy require tons of hooks and type: ignore.

You can try subclass Callable


Portworx deployments are failing

Portworx deployments on IBM Cloud are failing due to a recent change by Portworx.  This scenario can be recreated using our automation, or when clusters & portworx deployments are created manually.  Deploying Portworx onto a brand new cluster results in:

Portworx never becomes available
The cluster workers end up in a "Disk Pressure" state

To recreate:

Create an OpenShift 4.10 VPC cluster. (Have tried both RHEL7 and RHEL8 workers, and the result is the same in both cases).
Create a Portworx Enterprise service instance, pointed at this cluster (use either this module, or create manually using the IBM Cloud catalog.  Select the internal KVDM database option.
The Portworx service shows that it deployed successfully:

However, the Portworx deployment inside of the cluster never becomes healthy.  All pods in the portworx and portworx-api DaemonSets never enter a healthy state, and both events and logs show failures.  It looks like the Portworx deployment tries to self-update, and fails.  This also ends up eating up disk space on the cluster, and sends the workers into a "Disk Pressure" warning state.

Support case created: https://cloud.ibm.com/unifiedsupport/cases?number=CS3084464

The disk pressure status appears to be related to a regression in ROKS, which is separate from the Portworx issue.  Details/discussion on the disk pressure condition in Slack at: https://ibm-cloudplatform.slack.com/archives/CJH0UPN2D/p1666900631736399?thread_ts=1666896501.625019&cid=CJH0UPN2D

Update:

Disk pressure is is resolved by ROKS.
Support case is no help from IBM Support... need to reach out to Portworx support

I started a thread on the Portworx forums here: https://forums.portworx.com/t/portworx-failing-on-openshift-4-10-on-ibm-cloud/1478

I also requested an account on https://pure1.purestorage.com/support so I can create support tickets for Portworx/Pure Storage, but it has to be "approved" before I can submit a ticket.

response on forums:

This implies the kernel is not compatible with the Portworx version. I am assuming you are trying to install Portworx 2.11.4 with Cloud Drives option. We will get PWX version updated (within 48 hours).

Just confirmed Portworx is working again on IBM Cloud, based on update from the Portworx forums thread above.


Use context managers and maybe one file with db connection for all files

https://medium.com/opex-analytics/database-connections-in-python-extensible-reusable-and-secure-56ebcf9c67fe
Maybe Psycopg2 has its own context manager and connection can be established only once, and imported as from my_db import cursor - so we don't have to worry about closing the connection in every file, and about passing the cursor argument between methods and files.

https://stackoverflow.com/questions/72628457/context-managers-to-connect-to-postgre-with-psycopg2

https://codereview.stackexchange.com/questions/64671/sharing-a-database-connection-with-multiple-modules


Update link to Thymeleaf

The current Thymeleaf link returns 404. The intended page has moved to http://www.thymeleaf.org/doc/tutorials/3.0/thymeleafspring.html

Thanks!


master branch fails compilation on Windows

On Windows 7 using Java 8 using the master branch I get the error:
:cyclops-base:compileJava
E:\repositories\cyclops\cyclops-base\src\main\java\com\aol\cyclops\lambda\utils\
Lambda.java:51: error: illegal character: '\u00bb'
        public static <T1,T2,T3,R> Function<T1,Function<T2,Function<T3,R>>> ╬╗3(
Function<T1,Function<T2,Function<T3,R>>> triFunc){
                                                                             ^
E:\repositories\cyclops\cyclops-base\src\main\java\com\aol\cyclops\lambda\utils\
Lambda.java:51: error: ';' expected
        public static <T1,T2,T3,R> Function<T1,Function<T2,Function<T3,R>>> ╬╗3(
Function<T1,Function<T2,Function<T3,R>>> triFunc){

                                                ^
2 errors
:cyclops-base:compileJava FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':cyclops-base:compileJava'.
> Compilation failed; see the compiler error output for details.

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output.

BUILD FAILED

Total time: 4.919 secs

Fixed on https://github.com/aol/cyclops/pull/46

Removed all lambda characters from Master


Header elements are not in sequentially descending order

Reported by Lighthouse in Chrome for https://derekenos.com/
Failing Elements
h4

Filling in missing project.short_description and project.tags fixed this: https://github.com/derekenos/derekenos.com-generator/commit/86a9e63baf2405cca828746176a275a40434ae76

Filling in missing project.short_description and project.tags fixed this: https://github.com/derekenos/derekenos.com-generator/commit/86a9e63baf2405cca828746176a275a40434ae76


Add more functionality and QoL improvements

Fixes #32
Add new functionalities and QoL improvements to various modules in the library.

discmoji/_http.py

Add new methods for handling additional HTTP requests and improved error handling.
Enhance the send_request method to support more HTTP methods and better error handling.
Add methods send_head_request and send_options_request.

discmoji/bot.py

Enhance command registration and execution.
Add new utility methods for bot management, including send_message, edit_message, delete_message, add_reaction, and remove_reaction.

discmoji/channel.py

Add new methods for channel management, including create_channel, delete_channel, edit_channel, set_permissions, and delete_permission.

discmoji/cli/_cli.py

Add new CLI commands and improve argument parsing.
Add methods parse_args, get_parsed_args, add_command, and run.

discmoji/command.py

Enhance command error handling.
Add new decorators for command registration.
Add methods invoke and error.

discmoji/context.py

Add new methods for context management, including edit_message, delete_message, add_reaction, remove_reaction, pin_message, and unpin_message.

discmoji/emoji.py

Add new methods for emoji management, including create_emoji, delete_emoji, and edit_emoji.

discmoji/errors.py

Add new error classes for various error types and warnings.

discmoji/gateway.py

Add methods handle_gateway_event and handle_all_gateway_events.

If you see issues or want something changed leave a comment

hmm.. this could also be pushed to the optimization branch, so i'm going to request some review


[KYUUBI #5674][LICENSE][FOLLOWUP] Update license files

:mag: Description
Issue References 🔗

This pull request is a follow-up of https://github.com/apache/kyuubi/pull/6027, to update the license files as new dependencies are involved.
Describe Your Solution 🔧
Follow the https://infra.apache.org/licensing-howto.html to update the LICENSE and NOTICE files.
Types of changes :bookmark:

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪
It's not a code change, review is required.

Checklist 📝

[x] This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

Thanks, merged to master


Feature for hadoop batch re-ingesion and delta ingestion

This PR implements following features.

Hadoop Batch Re-Ingestion/Re-Indexing
Hadoop Batch "Delta" Ingestion

We implement a "DatasourceInputFormat" and "DatasourcePathSpec"  that can be used to batch re-ingest data back to druid from existing Datasource (something like IngestSegmentFirehose) segments.
Also, provided changes to allow specifying multiple PathSpecs (by using "MultiplePathSpec" ) in the batch ingestion so that you can combine both DatasourcePathSpec and StaticPathSpec (or any other) in the same ingestion to add late arriving data to existing ingested interval (aka "Delta" Ingestion)
original proposal discussion: https://groups.google.com/forum/?utm_medium=email&utm_source=footer#!msg/druid-development/EXYAPcV6pk4/Nu1uRGKEctAJ

The high-level direction seems good.  The biggest question in my mind is do we keep the Writable InputRow or do we adjust the jobs to pull out the key/value and all that now?

@himanshug @cheddar hey guys just wondering what the status of this is

@fjy this is blocked on #1472 getting merged. as soon as that one is merge, I will update this PR and it will be ready to further review [and merge].

@himanshug #1472 is merged

@fjy thanks, I will update this one soon, just doing some testing of the code to make sure that it works.

@fjy @gianm @cheddar @xvrl @drcrallen @nishantmonu51 this PR is ready for review [and merging]. I made some updates to PR title and description too.

@himanshug can we get some docs about using this? It'll be good to have a section in ingestion about reindexing data and delta ingestion

@fjy sure, I wanted to make the PR reviewable and write docs while review progressed.

@fjy updated the doc.

@gian i took care of all the review comments( except the one related to talking to overlord instead of metadata store for getting list of segments) in last 2 commits, pls take a look.

@himanshug, those changes look good to me. Have you had a chance to try them out on an actual hadoop job? And do you have any thoughts on the overlord thing? The only thing that really comes to mind for me is something involving a wrapper interface (that just has a listUsedSegments method) that is provided differently based on whether we're a peon or an overlord.

@gianm yeah, I'm thinking of creating an interface "ListUsedSegments" inside indexing-hadoop and create 2 implementations of it inside indexing-service (one based on overlord action, other based on directly metadata store). We would bind appropriate implementation in CliXXX.java and have DatasourcePathspec ingest ListUsedSegments interface.
I had tested the previous version of code with (unfortunately keeping "name" and "fieldName" same in the aggregators). Once we're ok with code, I will test everything again on hadoop before squashing the commits etc.

ok, have implemented both..

using overlord action vs metadata store for getting used segment list https://github.com/druid-io/druid/commit/e84498ee51a10b4cf995c6b971b36e6b98b4f2ce
differentiating InputRow from existing segments while serialization and using combining aggregators https://github.com/himanshug/druid/commit/344f6b058770b2ae3ac8d799864f34d04c775eaa

@gianm @cheddar pls take a look and let me know if they are ok. I still need to test the new code with these changes, will do that before creating final squashed version.

ok, have implemented both..

using overlord action vs metadata store for getting used segment list https://github.com/druid-io/druid/commit/e0ff9909453b07692cf412298c06ce0eca59c067
differentiating InputRow from existing segments while serialization and using combining aggregators https://github.com/himanshug/druid/commit/344f6b058770b2ae3ac8d799864f34d04c775eaa

@gianm @cheddar pls take a look and let me know if they are ok. I still need to test the new code with these changes, will do that before creating final squashed version.

@himanshug It would be nice if we can also add an integration-test for batch ingestion.

Generally :+1: assuming someone has checked that delta ingestion with metrics that have different regular vs combining aggs does work. It would be nice to have a test for delta ingestion in the same vein as the IndexGeneratorJobTest.

@nishantmonu51  added BatchDeltaIngestionTest very similar to IndexGeneratorJobTest that covers both reindexing and delta ingestion

@gianm I've cleaned up the commit history and now it contains the commits that I want to retain. There is a pseudo-integration test BatchDeltaIngestionTest very similar to IndexGeneratorJobTest. manually tested both hadoop indexer task and standalone hadoop indexer.
had to make some more modifications to get both kind of indexers working, you can see those in https://github.com/himanshug/druid/commit/dbec860d8bc98627736c1c90a6d1faac5734e24e . Its not pretty but I couldn't find a better way either.

@himanshug, can you confirm that delta ingestion is working with -

Sharded partitions
Complex Aggregator like HyperUnique

@nishantmonu51 yes

:+1: after latest changes

@himanshug I do have a concern about concurrency here, if I use delta ingestion but do not have a lock on the interval, then whatever I ingest may or may not be actually representative of the latest data. A simple example is if I run delta ingestion twice at the same time for different input paths to add. (or start a second one before the first has finished).
The indexing service hadoop indexer should be handling locks correctly, and I think such a use race condition should not be able to proceed when the indexing service is used.
But the standalone hadoop indexer could very easily encounter a race. But since we in general do not support accounting for race conditions in the stand alone stuff, that is just how its going to be.
Does that sound correct?

@drcrallen that sounds right to me. The stance on standalone stuff (hadoop & realtime) has always been that you need to think about consistency and concurrency yourself, since Druid only does meaningful locking when you use the indexing service.

@drcrallen wrt concurrency, that is true. But, this PR is not introducing/changing that behavior. The issue you described with standalone hadoop indexer is there even today and not related to this PR really.
FWIW, I am not a fan of standalone hadoop indexer and would rather see it go away. It is generally painful to maintain multiple ways of doing same thing. Also, it confuses users and we see email threads about explaining the differences between 2 kind of hadoop ingestion.

@himanshug / @gianm Cool, I'm good with maintaining existing behavior, and just wanted to make sure our expectations are documented in case anyone ever comes back to this PR's comment thread.

@gianm @drcrallen looks like here is the only option I'm left with.
introduce another task called HadoopReindexTask at the overlord which will be exactly same as HadoopIndexTask but will assume that user must have specified DatasourcePathspec in the inputSpec (or else user should've used HadoopIndexTask) . Then HadoopReindexTask can get the list of segments in its run method, convert it to a json string and pass that down to runTask and onwards to DatasourcePathspec (as @drcrallen suggested in another comment).
what do you guys think?

@gianm @drcrallen @nishantmonu51
I have made the change now so that DatasourcePathSpec gets List of segments instead UsedSegmentLister instance. HadoopIndexTask and CliInternalHadoopIndexer use overlord action and metadata store respectively to get the list of segments and pass down.
Since, we are not playing with setting things at class level anymore , so classloader issues dont creep up.
I did test it both ways (with and without hadoop libs on overlord classpath) and standalone hadoop indexer.
If you would like to just see the related changes made, please see https://github.com/himanshug/druid/commit/22228c2acf8496858ffc388f9ab9a68889ddcaef
I have rebased things, so this is ready to merge (unless someone notices some other problem) :)

I'm :+1: if we can get one other committer to agree with the comment in https://github.com/druid-io/druid/pull/1374#discussion_r37207903

:+1: at a3bab5b7


Trailing Whitespace

Hiya!
Got this set up today and the generated keymap looks wonderful.
I'm curious if there's anything I can do to avoid the trailing whitespace that's being inserted on format?

My layout is:
{
  "name": "LAYOUT_all",
  "layout": [
    "x x x x x _ _ _ x x x x x x",
    "x x x x x _ _ _ x x x x x^x",
    "x^x x x x x _ _ _ x x x x x",
    "_ _ x x x x^x x^x x x x _ _"
  ],
  "comment_preview": {
    "keymap_overrides": {
      "SFT_T%(KC_BSPC%)": "S|BSPC"
    }
  }
}

Thanks!

Hey 😄 glad you're enjoying the plugin
How upsetting is this for you, and what sort of solution might work?
It's kind of non-trivial to trim the whitespace and might take some time, but I could very easily put something in at the end of each row so nothing is trailing. Do you think that would suffice?
Another option might be to have some linter-related tool in your config that just removes trailing whitespace on save in all cases, and not just from the generated part... though I wonder if that might need to know to run after the keymaps are generated 😅

Enjoying the plugin as well but have the same issue. I have to disable other formatters so they don't interfere with the formatting done by qmk.nvim so unfortunately this is not an option for me.

Thanks for raising both. I've added it to the roadmap and I will find a solution when I'm next working on the project 🙂

🤞 should be solved now @Diaoul @dhoizner , please reopen if the issue persists 😄


Add missing replaceDirectory1

There is dropDirectory1 and takeDirectory1, but I'm missing replaceDirectory1.
replaceDirectory1 :: FilePath -> String -> FilePath

replaceDirectory1 "root/file.ext" "/directoy" == "/directory/file.ext"
replaceDirectory1 "root/foo/bar/file.ext" "/directory" == "/directory/foo/bar/file.ext"

What do you think?

Not averse to this - seems like logical extension of what is already there. Is this something you thought about as an obvious logical extension, or did you actually have a need for it?

I actually need it 😛.
I use shake for a blog and I preprocess / optimize all the files:
source/images/icon.png => build/images/icon.png
...

Do you have an implementation already done? If so, want to paste it here (or even a PR, although happy to take it from here). My guess is it's obvious, but always easier to go from tested code.

Added.

Sorry, you were too fast for me =P.
Thanks for implementing it!


monaco toolbox disappears and language service stops working

Scenario:

I am working on a github extension (https://github.com/tballmsft/pxt-tileworld)
The Monaco toolbox and TS language service don't work for editor.ts

The toolbox is only available in main.ts. Not sure about TS language service.


Allow REUSEPORT for listener sockets

We should optionally allow listener sockets to be created on each worker with SO_REUSEPORT. This should probably be the default for UDP listeners and opt-in for TCP listeners?
cc @danzh2010 @euroelessar @antoniovicente

Hi Matt, actually this is part of the plan in https://docs.google.com/document/d/1My-Tssc9d6rW-Xu96y4DdUxvzIKmptP6mm6i_zOXr58/edit?pli=1#. I was about to modify ListenerConfig to provide a listen socket factory interface instead of a socket as the first step of preparation for supporting multiple quic listeners on different worker threads.
What's your plan for this?

What's your plan for this?

To assign this issue to you. ;)
We can use this for tracking.

But one question here, is there any reason why this even needs to be an option for TCP listener? Do we want different TCP listeners on different worker threads to listen on different sockets?

It has been requested previously that we support this for TCP listeners also. In some cases this can lead to better performance in very high CPS use cases with many listening cores. IMO you don't need to implement it for TCP if you don't want to, but it would be nice to do it in such a way that someone could come along and do it for TCP later if they want?

@danzh2010 Considering this issue assigned to you, what's your plane?  :) Are you working on both UDP and TCP change? Or only UDP?
I recently did some LnP tests for HTTP traffic, one finding is: usually Envoy consumes <24 CPUs and occasionally Envoy consumes 46 CPUs(the node has 32 cores with Hyper-thread, that's 64 CPUs). Envoy run with 64 worker threads.
Making this change for TCP is in my task list, just want to confirm if we have any overlapping ;) I'm willing to take the TCP part.

Currently the one and only socket is passed to each listener on workder threads through Network:ListenerConfig. My plan is to change ListenerConfig to carry a socket factory instead of a socket. And create the socket during listener creation via the factory. UDP and TCP factory can have different socket management behavior.
As the first step, I will just refactor the code to pass around socket factory. TCP socket factory always provide the same socket, but UDP socket factory creates a new socket for each listener.

@danzh2010 I did a quick change to make SO_REUSEPORT works for TCP listeners, and run a load test, connections distributed to worker threads every well(checked downstream_cx_total and downstream_cx_active in /stats output).
A draft PR #8884 created, if you have time to do a quick view, that could be every helpful, just want to confirm this change is on correct direction.

I just found that SO_REUSEPORT doesn't behave as expected in Mac OS. Mac doesn't dispatch UDP packets according to network 5 tuple within the SO_REUSEPORT socket group. For connection-oriented UDP traffic, this means we don't have stable connection as packets from the same connection can be sent to different sockets.


Can't drop items

Players can't randomly drop items when this plugin is enabled. I tried to disable all other plugins and leave only CatClearLag but the problem still persists. Also animals doesn't drop any loot when killed in specific chunks.

Disable Per Chunk Limit Enabled


Feature Request: handle missing accounts better

What problem does your feature solve?
It improves robustness
What would you like to see?
Currently when the exporter can't get data from horizon for any accounts it does not return any data.
This can be handled better. It should return data for all accounts it can reach and it should return metrics about error for failed ones.
What alternatives are there?

Improvements are merged!


Hosted agent stuck in "Waiting for available machine" for 1 hour

Troubleshooting
Checkout how to troubleshoot failures and collect debug logs: https://docs.microsoft.com/en-us/vsts/build-release/actions/troubleshooting
Environment
VSTS - KKKIT

Agent - Hosted
Hosted VS2017
Release-180

Issue Description
My release have been stuck in waiting for more then one hour even though i only have one que item!!

Not an issue with a task in this repo (what the issues are tracking).  Please use developer community.


Quick and dirty injection of modifying master envvars before running …

…tests

Testing that the envvar override works correctly.

Going to make idiomatic kibitzes here I encourage you to heartily ignore unless you find them useful.


NPM install error

I get a ENOENT error no such file or directory with packages.json. Anyone got that before?

Can you paste the exact error here or in a gist?

Here is what I get:
npm WARN enoent ENOENT: no such file or directory, open '/Users/username/package.json'
npm WARN username No description
npm WARN username No repository field.
npm WARN username No README data
npm WARN username No license field.

Do these commands work when you clone the project from scratch into a new folder?
git clone git@github.com:openstreetmap/iD.git
cd iD
npm install
npm run test

The first command gives me an error:
Permission denied (publickey).
fatal: Could not read from remote repository.

ok yes, your git clone command might need to use the https link:
git clone https://github.com/openstreetmap/iD.git

I guess my point was - after cloning the repository from scratch, can you run npm install?

It works! Thanks!

👍 you're welcome!


Filter

Adds the option to filter zero counts from a sourcetracker analysis (When both a given sink and source have zero counts)

@wdwvt1 We haven't really discussed this in detail. If this is not appropriate to add to master, we can close the pull request and I can maintain the code in another repo.

Coverage decreased (-3.1%) to 96.484% when pulling f3724a5a7c344422f186981a22768b9b735d9337 on filter into 2927f176891cb743d8ef3c32ab9636263e71f36f on master.

Also I need to write tests for new function still

This is not ready for merge. Thanks to @jkliu for finding a bug. Currently the feature assignments are not formatted correctly when features are filtered

Flake8 errors, will fix soon

Tested branch on a dataset that was previously returning the incorrect columns/features when using filter_zero_counts=True for filtering. Rerunning branch on the same dataset now returns a feature assignment table with a set of columns/features equal to the set of columns/features that went into gibbs()


Implement/use a faster Base58 encoder

The current popular bs58 npm package performs horribly, it takes milliseconds to encode buffer under 1KB.
This resulted in severe perf implication in my load testing. Need to find a better library or implement one.

Won't fix, since Sidetree now uses JWS scheme, base64url is required, thus base58 is no longer applicable.


Improve code quality

Improve code quality by adding tslint rules
Refactor code

@GGGErnest

@YuryDG  I was checking your PR and I noticed that you have done some changes to the ng-ui2qp library under "projects/ng-ui2qp" and those changes belong to the master branch not this one. The gh-pages branch is just for changes related to the gh-pages project under the folder "projects/gh-pages". I recommend you to split the changes and create two pull request to their respectively branches.


Bump google.golang.org/grpc from 1.59.0 to 1.60.0

coverage: 78.364% (-0.04%) from 78.4%
when pulling d90d53613bd5f72e20a37dfb5a6a1cc4fea943e5 on dissoupov
into 1d0a4587ec9d920731f771c9a5c66fba366ed7a9 on main.


Fix for ARVRCamera::project_local_ray_normal not getting called.

Thanks Brian :)

@bzztbomb you might want to make project_ray_normal a virtual as well. Same issue.

@BastiaanOlij Made Camera::project_ray_normal virtual as well!
@akien-mga Thanks for the heads up, I think I've updated my account correctly now.

@akien-mga Done!

Thanks!

Cherry-picked for 3.0.7.


Add a region field so the validator turns region aware

This commit intent to make the validator region aware since it's fail when your are using more than one region

@voelzmo can you review this pull request? I just hit the same bug again =(

Hi @sxd,
Thanks for the PR! region is an optional parameter. As we have multiple of those, and we do not want to overload the validator.template.yml, we decided to create an additional readme for optional values. Now we added a section for the region parameter. We hope that this is a feasible solution which users can easily find. The additional documentation is linked also on the main readme


wapmorgan/php-code-fixer dev-master requires docopt/docopt 1.0.0-rc1 -> no matching package found.

Not work composer installation.
Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - Installation request for wapmorgan/php-code-fixer dev-master -> satisfiable by wapmorgan/php-code-fixer[dev-master].
    - wapmorgan/php-code-fixer dev-master requires docopt/docopt 1.0.0-rc1 -> no matching package found.

Potential causes:
 - A typo in the package name
 - The package is not available in a stable-enough version according to your minimum-stability setting
   see <https://groups.google.com/d/topic/composer-dev/_g3ASeIFlrc/discussion> for more details.

Ok, I fixed readme. You need to specify minimum-stability as dev in composer.json before installation.


Training on different subsets of recount2

Changing the "composition" of the training set
Things to try (using the MetaSRA annotations):

[x] Cancer data only
[x] Tissue only
[x] Cell lines only
[x] Blood only
[x] Everything but blood

Addressed in #45
Sample size
500, 1000, 2000, 4000 ... 32000
Evaluations:
Pathway coverage (and which ones), number of latent variables, proportion of latent variables associated with a pathway

Addressed in #47 #54


SeedSigner GUI

Create a user-friendly GUI to make the SeedSigner software interface more accessible to non-technical users.
Design Goals:
Visual Design: Improve aesthetics and provide visual aids using UI treatments and iconography.
Interaction Design: Increase overall efficiency of user inputs and feedback.
Information Architecture: Improve findability by organizing and surfacing common tasks.
Content Design: Simplify language to make abstract concepts more accessible to the average user.
Proposed Enhancements:

Navigation: Add Navigation Bar for context of location and easier access to global navigation functions
IA: Accessible groupings of features, surface high-traffic actions
Content: Simplify labels for viewport optimization and localization
Visual: Add iconography to reduce cognitive load and aid localization
Visual: Change font (Impact) to a more legible but space-efficient typeface

Other Enhancements:

Pagination system for fitting >4 menu items on screen
'Appearance' settings screen for UI color customization
'About/Info' settings screen for version/system information

I think we're getting closer to starting to implement this vision, need to have some more offline discussions.

Does this deserve to be closed now?

Yes, I think we accomplished it!


Alch Profit tooltip

Would be neat to preview a simple line dialogue in the tooltip indicating the profit or lose when hovering over an item to alch, also includes the value of a nature rune as well btw so it's more clear on the actual profit if alched).
(red gp value = lose, green = gain)
https://i.imgur.com/z4ruYPc.png

Related issues: #1094 #1075

Duplicate


paste custom text

Needed to make a toolbar with frequently used commands
Would be easier with https://github.com/atom/atom/issues/9209 solved

also fixes #45

Thanks Kevin!


postgres_exporter: Explicitly specify the zulip database.

Some of the collectors (e.g. pg_stat_user_tables) don't appear to work with --auto-discover-databases, which is deprecated since version 0.13.0^1.
Explicitly set the database name.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

Merged, thanks @alexmv!


Try to fix datalake restore tests

/azp run java - storage - tests

/azp run java - storage - tests


sdlog2_dump.py CSV generated file missing a lot of data.

When I run sdlog2_dump.py on my data file and compare the plots I generated from the CSV data to mission planner plots I notice that there is a lot of missing data. On mission planner data seem to have frequency of 50Hz while the CSV file that was generated has a max of 4Hz data. Any idea how to fix this?

This file does not support the mission planner format. It is designed for PX4 (if you want to use PX4, use QGroundControl).

But the bin file I have is from a pixhawk. I got it from the sd card that was recorded by pixhawk.

PX4 doesn't record .bin files. You are not running PX4 and hence this is not a PX4 issue.

I am sorry for being a complete newbie on this I am totally new on this stuff. Are you saying the pixhawk can run mission planner or px4. Since I am getting bin files I am running mission planner?

What instructions did you follow to flash firmware onto your Pixhawk?

I didn't, I am using a pixhawk that was preflashed.

It sounds like you must have some version of ArduPilot on it. If you don't want to reflash it with PX4, you can ask on the ArduPilot forums about analyzing the logfile. PX4 logs have the extension ".px4log" and are placed in the SD card in a directory named "log ".
For PX4 documentation look at px4.io, dev.px4.io and discuss.px4.io


improved documentation entry for omnisharp.path

At the moment it is not clear that "omnisharp.path":"latest" opts the user into the beta channel builds.

Thanks!


Remove separate model definition files for each backend and use cudnn.convert

As cudnn.convert https://github.com/soumith/cudnn.torch/pull/76 was merged, separate model definition files are no longer needed. I removed ccn2 because I think it is rarely used these days.

Nice stuff!


Color Issue

Hey, alpha values in color is not working. For example if I put the color #805b47b0 it is not reflecting the color with reduced opacity but only #5b47b0 is shown. Kindly help. Thank you in advance!

@rosanlal26 check #28, maybe it will help
also you can try to build lib from feature/refactor branch, it contains those fix.


No dev option for get_beamline_based_on_environment_variable() in dodal.utils.py

This function looks for the BEAMLINE environment name and then tries to import the associated dodal module. When running in dev mode, the BEAMLINE environment variable isn't set, and there would be no module to import. This means we are currently unable to start hyperion in dev mode. A quick solution would be to default to importing the i03 module if we're running in dev mode.
Acceptance Criteria

Implement a way to get get_beamline_based_on_environment_variable()  in developer mode
Ensure hyperion.sh --skip-startup-connection runs succesfully after doing this change (with no errors in hyperion/tmp/dev/start_log.txt)

also relevant for ViSR aka BL01C aka b01-1

Sorry, I only just saw this for some reason. This ticket was originally for Hyperion's dev mode, but we never got around to fixing it as running Hyperion locally wasn't massively useful anyway

so is it no longer required?

It might still be useful at some point to get hyperion/mx-bluesky working locally, just not very urgent


Preview Page Showing 404

Hi
When I build a page (for example test page) then I click preview button then I get the 404 page (http://local.payloadcms.com:3000/api/preview?url=/test). Is there any configuration required?

@jacobsfletch thanks for you reply. Is there a way we can preview the posts as well and same layouts available in pages can be brought into the posts as well?

@reviewerhub yea posts can do everything that pages can, including preview and layout building. You just need to setup your config for posts to included everything you need.
@adnanawan12  I've recently opened a PR for Next.js App Router draft mode: https://github.com/payloadcms/payload/pull/2718. There's a couple things left to do there yet before it can be merged but feel free to explore the code if needed.

Hey @adnanawan12, was finally able to get this one closed out! If you're still looking to implement this yourself, I put together an official Draft Preview Example which you can look to as well.


Improve perf of unused opens analysis

Attempts to fix https://github.com/Microsoft/visualfsharp/issues/4488, and documents the code a bit more. However this doesn't address the issue https://github.com/fsharp/FSharp.Compiler.Service/issues/830, which is "hard".
Things fixed:

This use of Seq.cache was faulty, since it was returned at the end of a property, meaning the cache was never actually effective

Thing improved:

Use a hash instead of an array for the sub-contents of an opened thing
cleanup

I can't test this properly until https://github.com/Microsoft/visualfsharp/issues/4496 is fixed.

I have manually checked this using F5 from VisualFSharp.sln and the performance is ok.

Editing in IlxGen.fs gives red-squiggly updates in a couple of seconds, which is as good as it gets

So this is ready once green (I need to make sure it continues to pass @vasily-kirichenko's original unussed-open tests)

OK, this is ready

@auduchinok Could you review please?

OK, then this is ready to merge into master (and then will get merged into dev15.7 as normal)

@TIHan can you give this a review? We definitely want to get this into the 15.7 branch and line it up for Preview 3


Microsoft Teams - React-icons missing in WebView

Since a few days, the "react" icons are missing in the webview of microsoft teams, and "reaction" can't be used - the link to react is also missing.
Many of my colleagues have this issue with different OS/Browsers.

thank you for submitting feedback.
I think the best way forward is if you open a service ticket in your tenant so this can get resolved ASAP. Based on the outcome let me know if it is something that can be called out in the docs.
Please follow this link to contact support for business products:https://docs.microsoft.com/office365/admin/contact-support-for-business-products
Please keep us posted here on the resolution so we can feed whatever information you discover into the content.


go.mod

Hi
I am fairly new to golang. I have a question, which I can't seem to find an answer.
I have a go file which dependency is the client-go (and the necessary packages like api, apimachinery, utils). My questions is how do I enforce to a particular version? I tried modifying the go.mod file and give "release-10.0" and "v10.0", but I always got master branch. I would like to know what tag I should use to get the 10.0 version. Also, where I should modify to enforce the version? Do I put the version in the "import" in my go file?
Thanks

require k8s.io/client-go v10.0.0 specifies a particular version. Note that other dependencies must also be required at specific versions prior to client-go v12.0.0 which will add dependency info in a form go can understand
See https://github.com/kubernetes/client-go/blob/master/INSTALL.md#go-modules for details

@liggitt
I have tried that so here is my additional question:
I know I need api 1.13 version for client-go v10. Hence, I included api 1.13. However, it seemed like it was only partially pull from the version I specified.

How can I force all the subdirectory of a project to be on the same version?
How should i find the correct version name for each associated project? I don't mean compatibility. I meant where/what name of the branch in the repo I should use to enforce to a certain version?

In my go.mod:
...
require (
github.com/golang/protobuf v1.3.1
k8s.io/api kubernetes-1.13.5
k8s.io/client-go v10.0.0
...}
user@virt-8876$ go build test/client.go
go: finding k8s.io/api kubernetes-1.13.5
go: finding k8s.io/api/admissionregistration/v1alpha1 latest
go: finding k8s.io/api/admissionregistration latest
go: finding k8s.io/api latest
build command-line-arguments: cannot load k8s.io/api/admissionregistration/v1alpha1: cannot find module providing package k8s.io/api/admissionregistration/v1alpha1

You can use the kubernetes-… tags for all dependencies, like this:
require (
k8s.io/client-go kubernetes-1.13.5
k8s.io/api kubernetes-1.13.5
k8s.io/apimachinery kubernetes-1.13.5
)

@liggitt
I tried per your comment. I saw some errors. It seems like api with the tag it was unable to successfully pull everything from 1.13.5. a part of it is from the latest. Is there anything else I should include to enforce everything under an application would be in the same version ?
In my go.mod:
...
require (
github.com/golang/protobuf v1.3.1
k8s.io/api kubernetes-1.13.5
k8s.io/client-go v10.0.0
...}
However, when I build, I kept getting errors because it's pulling "k8s.io/api/admissionregistration/v1alpha1 latest". I tried adding k8s.io/api/admissionregistration/v1alpha1 kubernetes-1.13.5, but it complained about no go.mod in api/addmissionregistration. Could you tell me how to solve this issue? Is my configuration done incorrectly?
user@virt-8876$ go build test/client.go
go: finding k8s.io/api kubernetes-1.13.5
go: finding k8s.io/api/admissionregistration/v1alpha1 latest
go: finding k8s.io/api/admissionregistration latest
go: finding k8s.io/api latest
build command-line-arguments: cannot load k8s.io/api/admissionregistration/v1alpha1: cannot find module providing package k8s.io/api/admissionregistration/v1alpha1

Can you include your full go.mod file?

`module github.com/myGoProj
go 1.12
require (
github.com/golang/protobuf v1.3.1
k8s.io/utils master
k8s.io/api kubernetes-1.13.5
k8s.io/apimachinery kubernetes-1.13.5
k8s.io/client-go v10.0.0
github.com/google/btree v1.0.0 // indirect
github.com/gregjones/httpcache v0.0.0-20190212212710-3befbb6ad0cc // indirect
github.com/imdario/mergo v0.3.7 // indirect
github.com/peterbourgon/diskv v2.0.1+incompatible // indirect
golang.org/x/crypto v0.0.0-20190424203555-c05e17bb3b2d // indirect
golang.org/x/oauth2 v0.0.0-20190402181905-9f3314589c9a // indirect
golang.org/x/time v0.0.0-20190308202827-9d24e82272b4 // indirect
)
`

@liggitt I don't know what happened, I just tried it again and the error is gone. I was able to compile successfully now. Thank you all the help


Hyprpaper

You should probably add hyprpaper to the list of wallpaper programs

It is tho

But like not exactlt

Its at the top


WIP: add hostname verification to pg8000

Testing if stripping the trailing dot only for hostname has any effect.

Closing this as stale. Will do this as part of https://github.com/GoogleCloudPlatform/alloydb-python-connector/issues/324


Typechecks on input arrays

In GitLab by @Huite on Dec 14, 2020, 12:08
I've recently ran across a case where input was mangled due to integer truncation.
In this case, the user defined an integer array for the conductances, and then entered values < 1.0. In the process, a value like 0.5 (float) is turned into 0 (integer). This is an easy mistake to make, and we could easily warn by requiring floating point or integer types on most (if not all) of the input fields.

In GitLab by @jdelsman on Jan 11, 2021, 15:38
closing as now part of #149

In GitLab by @jdelsman on Jan 11, 2021, 14:30
I ran into another but related issue: when assigning a single (interpreted as integer, as I did not explicitly made it a float) value for parameters in a test model, imod-wq crashed on reading the runfile, missing a explicitly printed floating-point...


Add E2E Test around private registry

We need to add a E2E test which covers the process described in https://docs.k3s.io/installation/private-registry
To avoid messing with a hosts docker images, this test should be deployed via E2E/vagrant framework.
General steps should be:

Deploy a Vagrant Node
Install docker on the node
Deploy a local registry as described in https://docs.docker.com/registry/deploying/#run-a-local-registry
Add a different version of a K3s component from https://github.com/k3s-io/k3s/releases/download/v1.24.4%2Bk3s1/k3s-images.txt
Create a /etc/rancher/k3s/registries.yaml and point it toward the local registry
Deploy a K3s server on the node
Verify that the component added is the version from the private registry

Note that existing E2E testing is now using a LOCAL_REGISTRY on the host and in CI. The test will need to account for that.


Document order of cells returned by ReadRows() within a row.

I cannot find clear documentation of what the "first N" RowFilter actually would skip.  The documentation most likely exist, I just cannot find it.
Obvious it is the first N cells, but what is the order of the cells within a row?  The natural assumption is that cells are returned in the order defined by the column families, and then the column qualifiers within a column family, and then the timestamps within each column.  That is probably true, but I cannot find any docs saying that and it is better if I document that assumption.
This issue is here to find the right documentation (it must exist I just could not find it), link it from here and then update the documentation for the bigtable::Filter creation functions if the assumptions I made were wrong.

@sduskis or @mbrukman before I search for more documentation, can you point me to a doc explaining the order of cells within a row?  Thanks.

I put some thoughts about it here
https://docs.google.com/a/google.com/document/d/1DGoSGBl0_EzdMPy1p3A8pgFVS31jmemQb2DflUsycdI/edit?usp=sharing
.
At a high level, ordering is as follows:

familly (ordered by some internal ID, not lexicographic)
qualifier (lexicographic)
timestamp (reverse order - latest is first)

-Solomon
Solomon Duskis |  Google Cloud Bigtable Tech Lead |<EMAIL_ADDRESS>|
914-462-0531
On Thu, Dec 7, 2017 at 9:44 AM, coryan<EMAIL_ADDRESS>wrote:

@sduskis https://github.com/sduskis or @mbrukman
https://github.com/mbrukman before I search for more documentation, can
you point me to a doc explaining the order of cells within a row? Thanks.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/google-cloud-cpp/issues/82#issuecomment-349987382,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGD6SZl1zYX6S2y4GNQ4dnCuarauqP7ks5s9_nagaJpZM4Q5p3x
.

Thanks @sduskis!  Is the internal ID of the family the same across all rows?

That's an interesting question.  For now, assume that the family ordering may change across rows.


Dice bags do not correctly spawn at start of round

Description

They dump all their contents and the dice bag itself is completely missing
Reproduction

Screenshots

Additional context

I could not reproduce this, using Core as a test I found the dice bag mapped in the bar remains extant on round start. Something I did find though is that Box does not use any dice bags, but instead uses a stack of dice piled on top of each other. Could this be the issue you were having?

ah... that does seem to be the case


Rename flag to set Secure flag on cookie

As mentioned in #57, I've added this as a separate pull request. I think it makes it clearer, but it's a breaking change.

Can you rebase this now that i merged your other PR? I agree that exposing the httponly flag makes the naming for https-only awkward.
It probably makes sense to still handle the cookie-https-only argument but to just mark it as deprecated

picked up in #71


Do not display environments in the list for which running python binary fails

Closes https://github.com/microsoft/vscode-python/issues/15371

Modify interpreter info helper to return whether the executable is valid
Resolver can now send update as undefined to signify env is no longer valid. Such envs won't be reported.

@ericsnowcurrently Closed this in favor of https://github.com/microsoft/vscode-python/pull/15449, which has the minimal changes.


Download Page Redesign

[x] Migrate existing entries in "Other Installation Methods" bullet points.
[x] Move server launcher to same download page under "Other Installation Methods"
[x] Move technic stuff to same download page under "Other Installation Methods"? (not clarified on Discord)
[x] Keep big download button.
[x] Add third party launcher buttons.

This is ready for review.

Third party guides found here

The "Legacy Tools" section has been removed ready for #104


[1.21.1-Fabric] Dark model

Any type of Block I add is always darker then it should be.
Ingame:

Blockbench model:

Probably because you have your block occluding light, so the game thinks it should be dark there
try using noOcclusion in your block properties, or override the allows skylight through method in your block, whatever that's called

Thank you. Adding nonOpaque() to my block settings fixed it.


[WIP] Fixes #6574

Update switch conditionals

Signed-off-by: Jhon Honce<EMAIL_ADDRESS>

@mheon This commit fixes demux'ing the output.  But now messages from conmon appear to be exposed...
$ bin/podman-remote --url $MYSOCK run --name foo1 -d alpine top
f5c4cf63f2e206aa99a12b625c72fa9de4b740e6f02b493abe3eb35f03c3cc11
$ bin/podman-remote --url $MYSOCK exec foo1 date
[conmon:d]: exec with attach is waiting for start message from parent
[conmon:d]: exec with attach got start message from parent

Damn - took me a second to realize, but yeah, this is definitely the fix.
LGTM

@jwhonce Hmmm. When I was testing Exec, those were fd=3...

Do you know what stream they're coming in on?

@mheon fd=1

@jwhonce Even worse, it's not showing the output of date unless I provide -i

The conmon output only happens with --log-level=debug is specified on the server, so I don't know if printing Conmon debug is the worst thing. Not printing the output of date is a serious bug though.

It's specific to exec, podman run works

We're getting an early EOF/dropped connection out of Conmon. Maybe we're not draining the buffer entirely in the exec case?

@jwhonce IMO, we should just merge this, file a bug for the further issue and we'll look into it later.

Please fix the commit message.  This will not work well when someone goes back to look at history in git.

/lgtm


strange bug that appears for our mock catalogs when upgraded to corrfunc v2

When I run it on my mocks, the code fails and says to report a bug:

A minimal working example is contained in this tarball: http://www.astronomy.ohio-state.edu/~wibking.1/corrfunc/mwe.tar
The conditions needed to reproduce it are: compute xi(s) from any mock produced by my HOD code with Corrfunc v2.

@ANSalcedo

At first glance, the input does appear to all be in the expected range, so this does look like a Corrfunc bug of some kind.  I'll try to look at this some more in the next few days.

This is weird. Here are the flags associated with x/y/z
    C_CONTIGUOUS : True
    F_CONTIGUOUS : True
    OWNDATA : False
    WRITEABLE : True
    ALIGNED : True
    UPDATEIFCOPY : False

If the data are C_CONTIGUOUS, then any issue out of different strides should not occur. And I can see that the arrays values are all in [0.0, 720.0).
I can solve the issue by round-tripping
   x = np.array(x.tolist(), dtype=np.float32)

The only difference I see with the initial x.flags and this new array->list->array x.flags is the OWNDATA flag. However, neither x = np.ascontiguousarray(x) or by x = np.require(x, requirements=['C', 'O', 'W']) work.
I do not have a detailed enough understanding of numpy :(

(Also, the requirements I specified spelled 'COW')

This is very weird. C_CONTIGUOUS should be all that is needed to treat
the data like a C array. It's possible the flag is set incorrectly.
Should be testable by iterating through x[i] via cython and passing x[0]
as a pointer to the cython function. This has to be some kind of bug in
h5py or (less likely) numpy...? I don't see how else
x=np.array(x.tolist()) would fix the problem.
On 10/31/17 1:41 AM, Manodeep Sinha wrote:

This is weird. Here are the flags associated with |x/y/z|
C_CONTIGUOUS : True
F_CONTIGUOUS : True
OWNDATA : False
WRITEABLE : True
ALIGNED : True
UPDATEIFCOPY : False

If the data are |C_CONTIGUOUS|, then any issue out of different
|strides| should not occur. And I can see that the arrays values are
all in |[0.0, 720.0)|.
I can solve the issue by round-tripping
x = np.array(x.tolist(), dtype=np.float32)
The only difference I see with the initial |x.flags| and this new
array->list->array |x.flags| is the OWNDATA flag. However, neither
|x = np.ascontiguousarray(x)| or by |x = np.require(x,
requirements=['C', 'O', 'W'])| work.
I do not have a detailed enough understanding of |numpy| :(
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/manodeep/Corrfunc/issues/140#issuecomment-340666015,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABswn_I0S1hIrQTT0njFzEJGxUfC945Cks5sxrMYgaJpZM4QL-RQ.

Think I figured it out.  The position arrays are big-endian:
>>> x.dtype()
dtype('>f4')

but Corrfunc is probably interpreting them as native-endian, which is little-endian in most cases.  Converting the arrays to little-endian with x.byteswap() does the trick, but the correct solution is probably to teach Corrfunc to detect the endianness.  This is easy to do in the Python wrappers, which is probably sufficient, since the only way we can ever detect endianness is if the arrays come from Python anyway (i.e. the C interfaces know nothing about endianness).
HDF5 is supposed to take care of some of these endianness issues, but h5py may simply be preserving the endianness of Numpy array inputs.  In that case, another quick fix is to make sure the arrays are little-endian before they go into the HDF5 files.

Wow, that's amazing. I have no idea how I managed to create big-endian
arrays! Thanks, Lehman. This is very helpful.
On 10/31/17 12:44 PM, Lehman Garrison wrote:

Think I figured it out. The position arrays are big-endian:
|>>> x.dtype() dtype('>f4') |
but Corrfunc is probably interpreting them as native-endian, which is
little-endian in most cases. Converting the arrays to little-endian
with |x.byteswap()| does the trick, but the correct solution is
probably to teach Corrfunc to detect the endianness. This is easy to
do in the Python wrappers, which is probably sufficient, since the
only way we can ever detect endianness is if the arrays come from
Python anyway (i.e. the C interfaces know nothing about endianness).
HDF5 is supposed to take care of some of these endianness issues, but
h5py may simply be preserving the endianness of Numpy array inputs. In
that case, another quick fix is to make sure the arrays are
little-endian before they go into the HDF5 files.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/manodeep/Corrfunc/issues/140#issuecomment-340825002,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABswn2A7bhaFYmNkQ6Sql3Z8BbLy01ruks5sx05rgaJpZM4QL-RQ.

It's not that Corrfunc is expecting little-endian, Corrfunc is expecting everything to be in machine-endian. And the array from the hdf5 file is big-endian while the computer itself is little-endian. If the computer were big-endian, then there would not be any problems.
The fix would be to ensure (in the python wrappers) that all arrays in machine-endian order.

(The biggest reason I don't worry about this particular endian-ness mis-match bug is that Corrfunc will crash. Fixing the endian-ness handling is part of #101 )
@BenWibking Do you mind if we close this particular issue?

Fixing it and saving future graduate students from tearing their hair
out should take just 10 additional lines of code in the python wrapper:
def convert_to_native_endian(array):
  import sys
  system_is_little_endian = (sys.byteorder == 'little')
  array_is_little_endian = (array.dtype.byteorder == '<')
  is_native_endian = (system_is_little_endian and
array_is_little_endian) or (not system_is_little_endian and not
array_is_little_endian) or (array.dtype.byteorder == '=')
  if not is_native_endian:
    return array.byteswap().newbyteorder()
  else:
    return array
x,y,z,weights = [convert_to_native_endian(arr) for arr in [x,y,z,weights]]
On 10/31/17 4:37 PM, Manodeep Sinha wrote:

(The biggest reason I don't worry about this particular endian-ness
mis-match bug is that Corrfunc will crash. Fixing the endian-ness
handling is part of #101
https://github.com/manodeep/Corrfunc/issues/101 )
@BenWibking https://github.com/benwibking Do you mind if we close
this particular issue?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/manodeep/Corrfunc/issues/140#issuecomment-340899043,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABswn2fMJIlyRCN4O3J7IcYuFkRFis03ks5sx4T4gaJpZM4QL-RQ.

@BenWibking You know what I am going to say right? ....PR... :)
I think you can make the if condition slightly concise:

def convert_to_native_endian(array):
    '''
    Returns the supplied array in native endian byte-order

    Parameters
    ------------

    array: A numpy array

    Returns
    --------

    array: A numpy array in native-endian byte-order

    Example
    ----------

    >>> import numpy as np
    >>> create a big-endian array
    >>> and then covert to little-endian
    >>> and make sure that the output dtype is little-endian
    >>> This serves as a doctest
    >>> create a native-endian array
    >>> run through function
    >>> ensure output is the same
    '''

    import sys
    system_is_little_endian = (sys.byteorder == 'little')
    array_is_little_endian = (array.dtype.byteorder == '<')
    if (array_is_little_endian != system_is_little_endian) or (array.dtype.byteorder == '='):
        return array.byteswap().newbyteorder()
    else:
        return array

The docs are left for you :)

Plus, some tests to make sure that the array is indeed a numpy array or returning back None if the input is None

I'm going to politely decline. I'm happy to report bugs, but ultimately
it's your code, not mine.
On 10/31/17 5:33 PM, Manodeep Sinha wrote:

@BenWibking https://github.com/benwibking You know what I am going
to say right? ....PR... :)
I think you can make the |if| condition slightly concise:
def convert_to_native_endian(array):
'''
Returns the supplied array in native endian byte-order
Parameters
array: A numpy array
Returns
array: A numpy array in native-endian byte-order
Example

import numpy as np
create a big-endian array
and then covert to little-endian
and make sure that the output dtype is little-endian
This serves as a doctest
create a native-endian array
run through function
ensure output is the same
'''

import sys
system_is_little_endian = (sys.byteorder == 'little')
array_is_little_endian = (array.dtype.byteorder == '<')
if (array_is_little_endian != system_is_little_endian) or (array.dtype.byteorder == '='):
    return array.byteswap().newbyteorder()
else:
    return array

The docs are left for you :)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/manodeep/Corrfunc/issues/140#issuecomment-340913912,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABswn6RConf4o5lhNzVemyk-gh-gXIiUks5sx5IkgaJpZM4QL-RQ.

I can work on this.


Unable to connect to storage with new version 1.18.0

Is your feature request related to a problem? Please describe.
In the previous version it was easy to attach to azure storage, just and new storage, paste the SAS token and it connected. I have tried every option available and it will not accept the SAS token and connect. I tried via powershell and it works so I know my token is good
Describe the solution you'd like
Go back to the simple connect that worked in the previous version
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Thanks for the feedback. If you don't mind, could you please walk us through the steps you went through to connect? That will help us to understand the issue a bit better.  Thanks.

right mouse on storage account, choose connect to Azure storage/Storage Account/SAS/past in SAS token. Error "The connection string is missing an account hey or SAS token" These same steps work in previous version with same SAS URI.

Error attached.

Are you getting the url from Portal? The url you pasted here points to the Blob service of that storage account. The text box here is expecting the "Connection String" which includes all the service endpoints of the storage account. See the "Connection string" part in the screenshot.

I am getting the URL from an internal site. What option do I need to use for that URL to work in 1.18 as it did in 1.17 and all versions before? This is the option I used to choose that allowed the connection

Unfortunately that option was accidentally removed in 1.18.0. We are working on a hotfix to add it back. At the moment, you can construct a connection string using the SAS url you have to connect to the storage account.
For example, given the SAS url "https://contoso.blob.core.windows.net/?SAS_TOKEN"
The connection string would look like "BlobEndpoint=https://contoso.blob.core.windows.net/;QueueEndpoint=https://contoso.queue.core.windows.net/;FileEndpoint=https://contoso.file.core.windows.net/;TableEndpoint=https://contoso.table.core.windows.net/;SharedAccessSignature=SAS_TOKEN"
Also, does the internal site produce anything else when you got the url? Could you ask the owner of the internal site to make sure their SAS generation experience to align with Azure Portal? We recommend 3rd party tools to be consistent when generating SAS so the generated SAS can be best supported in our tools.

Thank you, I'll pass it along, we are an internal group in Microsoft and it has always worked until the latest update. You can ping me internally for more details, alias jimtr

We have merged fixes for this bug and created a hotfix release candidate. Would you like to try it and see if it fixes your problem?
Windows: windows 1.18.1
macOS: macOS 1.18.1
linux: linux 1.18.1
If they work well for you, they will be the exact bits we release for 1.18.1.

That works, thank you.
From: JasonYeMSFT<EMAIL_ADDRESS>Sent: Wednesday, March 3, 2021 9:55 PM
To: microsoft/AzureStorageExplorer<EMAIL_ADDRESS>Cc: jimtr123<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [microsoft/AzureStorageExplorer] Unable to connect to storage account using SAS URL with new version 1.18.0 (#4149)
We have merged fixes for this bug and created a hotfix release candidate. Would you like to try it and see if it fixes your problem?
Windows: windows 1.18.1https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstorageexplorerpublish.blob.core.windows.net%2Fprivatebuilds%2F1.18.1-hotfix%2FWindows_StorageExplorer.exe%3Fsv%3D2020-04-08%26st%3D2021-03-04T02%253A36%253A45Z%26se%3D2021-03-16T01%253A36%253A00Z%26sr%3Db%26sp%3Dr%26sig%3D7KzP7nB3QYmedpUKQA4xIxQAWPNzgUXaA50cBRGecZE%253D&data=04|01||9bbe591cacbf4138926208d8deb8f02c|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637504233166178900|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=9gCZqSbTMeA46PT6RJnTsHlhRpyTcpLmLO6Q4OqV73c%3D&reserved=0
macOS: macOS 1.18.1https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstorageexplorerpublish.blob.core.windows.net%2Fprivatebuilds%2F1.18.1-hotfix%2FMac_StorageExplorer.zip%3Fsv%3D2020-04-08%26st%3D2021-03-04T02%253A38%253A42Z%26se%3D2021-03-17T01%253A38%253A00Z%26sr%3Db%26sp%3Dr%26sig%3D%252FJwyQ%252F0GZPqOs2MUh%252Bx6LKyY%252FYAVCFiljUJIeDjQxkk%253D&data=04|01||9bbe591cacbf4138926208d8deb8f02c|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637504233166178900|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=m9zyCC2%2FHGS4kixPzDDLRmxYhlmcl1G7s2vBiBQYECc%3D&reserved=0
linux: linux 1.18.1https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstorageexplorerpublish.blob.core.windows.net%2Fprivatebuilds%2F1.18.1-hotfix%2FLinux_StorageExplorer-x64.tar.gz%3Fsv%3D2020-04-08%26st%3D2021-03-04T02%253A39%253A01Z%26se%3D2021-03-17T01%253A39%253A00Z%26sr%3Db%26sp%3Dr%26sig%3D1pPYKQZ04jLvKkIEiZLLgJlzWhbLD4%252BxVoCmnUrJcK4%253D&data=04|01||9bbe591cacbf4138926208d8deb8f02c|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637504233166188900|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=Pv9bHtUXO50iy5oOwfThIdmqtY6vaUTHMfMunQE%2BXIA%3D&reserved=0
If they work well for you, they will be the exact bits we release for 1.18.1.

You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FAzureStorageExplorer%2Fissues%2F4149%23issuecomment-790247986&data=04|01||9bbe591cacbf4138926208d8deb8f02c|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637504233166188900|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=Tr6ynA6Qq5tcmMbmIOkFL0BlqzGelJcL%2F%2BHoZZeTd%2Bs%3D&reserved=0, or unsubscribehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAJVYMIK3QLJ6JXEBEYHTKI3TB3ZBHANCNFSM4YPY4VMQ&data=04|01||9bbe591cacbf4138926208d8deb8f02c|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637504233166198892|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=BHWC2qD7lDv1pwgJ83fY3IqoSiDoKpWCOaD7kOqQhq4%3D&reserved=0.


Adding Docker V2 task - Simplify the task inputs for YAML

Simplify the task inputs for YAML by removing Container registry type and other complex inputs which can be supported using arguments.
Added support for multiple logins/logouts.
Bumping up versions of other tasks dependent on docker-common. Using milestone based versioning. (DockerComposeV0, DockerV0, DockerV1, KubernetesV0, KubernetesV1)

When will this be available for use in Pipelines? Attempts at using it result in the following error:
"An error occurred while loading the YAML build pipeline. wrong number of segments"

It should be available in next 3-4 weeks on Azure Devops.