[BUG]DataLakeFileClient.renameWithResponse operation on Azure storage occasionally fails with 500

Describe the bug
While performing a com.azure.storage.file.datalake.DataLakeFileClient.renameWithResponse call the operation sometimes fails without being able to trace its cause.
FYI The storage account on which we're performing the rename operation has the Hierarchical namespace enabled.
Exception or Stack Trace
Caused by: java.io.IOException: Rename file from<EMAIL_ADDRESS>to<EMAIL_ADDRESS>failed
....
Caused by: com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 500, "{"error":{"code":"InternalError","message":"Server encountered an internal error. Please try again after some time.\nRequestId:efc80591-101f-009e-3bfb-68f320000000\nTime:2024-02-26T21:33:40.3567187Z"}}"
	at java.base/java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:733)
	at com.azure.core.implementation.MethodHandleReflectiveInvoker.invokeWithArguments(MethodHandleReflectiveInvoker.java:35)
	at com.azure.core.implementation.http.rest.ResponseExceptionConstructorCache.invoke(ResponseExceptionConstructorCache.java:51)
	at com.azure.core.implementation.http.rest.RestProxyBase.instantiateUnexpectedException(RestProxyBase.java:356)
	at com.azure.core.implementation.http.rest.AsyncRestProxy.lambda$ensureExpectedStatus$1(AsyncRestProxy.java:128)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:113)
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2400)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.request(FluxMapFuseable.java:171)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.set(Operators.java:2196)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onSubscribe(Operators.java:2070)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onSubscribe(FluxMapFuseable.java:96)
	at reactor.core.publisher.MonoJust.subscribe(MonoJust.java:55)
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:157)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:129)
	at reactor.core.publisher.FluxHide$SuppressFuseableSubscriber.onNext(FluxHide.java:137)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:129)
	at reactor.core.publisher.FluxHide$SuppressFuseableSubscriber.onNext(FluxHide.java:137)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1839)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:249)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.complete(MonoIgnoreThen.java:292)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.onNext(MonoIgnoreThen.java:187)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1839)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:249)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.complete(MonoIgnoreThen.java:292)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.onNext(MonoIgnoreThen.java:187)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1839)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:249)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.complete(MonoIgnoreThen.java:292)
	at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.onNext(MonoIgnoreThen.java:187)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1839)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:151)
	at reactor.core.publisher.FluxDelaySubscription$DelaySubscriptionMainSubscriber.onNext(FluxDelaySubscription.java:189)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:129)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1839)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:151)
	at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:172)
	at com.azure.core.http.okhttp.OkHttpAsyncHttpClient$OkHttpCallback.onResponse(OkHttpAsyncHttpClient.java:270)
	at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)
	... 3 more
	Suppressed: java.lang.Exception: #block terminated with an error
		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:100)
		at reactor.core.publisher.Mono.block(Mono.java:1742)
		at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:147)
		at com.azure.storage.file.datalake.DataLakeFileClient.renameWithResponse(DataLakeFileClient.java:1384)
		at io.trino.filesystem.azure.AzureFileSystem.renameGen2File(AzureFileSystem.java:223)
		at io.trino.filesystem.azure.AzureFileSystem.renameFile(AzureFileSystem.java:209)

To Reproduce
Steps to reproduce the behavior:

Create a temporary file and fill it with data
Rename it to another file within the same directory

Code Snippet
https://github.com/trinodb/trino/blob/eec77b60301a8a483cf9f20a5770f85ebf9f9be5/plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/writer/AzureTransactionLogSynchronizer.java#L50-L55
https://github.com/trinodb/trino/blob/eec77b60301a8a483cf9f20a5770f85ebf9f9be5/lib/trino-filesystem-azure/src/main/java/io/trino/filesystem/azure/AzureFileSystem.java#L210-L232
Expected behavior
I expect the rename operation to complete always successfully
Screenshots
If applicable, add screenshots to help explain your problem.
Setup (please complete the following information):

OS: [e.g. iOS]  Linux
IDE: [e.g. IntelliJ] N/A
Library/Libraries: [e.g. com.azure:azure-core:1.16.0 (groupId:artifactId:version)] com.azure:azure-core:1.45.1
Java version: [e.g. 8] 21
App Server/Environment: [e.g. Tomcat, WildFly, Azure Function, Apache Spark, Databricks, IDE plugin or anything special] Trino
Frameworks: [e.g. Spring Boot, Micronaut, Quarkus, etc] N/A

If you suspect a dependency version mismatch (e.g. you see NoClassDefFoundError, NoSuchMethodError or similar), please check out Troubleshoot dependency version conflict article first. If it doesn't provide solution for the problem, please provide:

verbose dependency tree (mvn dependency:tree -Dverbose)
exception message, full stack trace, and any available logs

Additional context
Add any other context about the problem here.
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[x] Bug Description Added
[x] Repro Steps Added
[x] Setup information Added

@ibrahimrabab @alzimmermsft could you please follow up

Thanks for filing this issue @findinpath, do you know if the SDK attempted retries when this status was returned by the service? 500 status codes are retried by default.
If retries are being attempted and exhausted, I'm not sure there is much the SDK could do in this space as this is the service repeatedly returned a service error status code. Options moving forward in this case would be modifying the retry options to find a set that will handle this as required (ex, more attempts, different backing off strategies, etc).

do you know if the SDK attempted retries when this status was returned by the service?

@alzimmermsft here is the code we used to build the client
https://github.com/trinodb/trino/blob/eec77b60301a8a483cf9f20a5770f85ebf9f9be5/lib/trino-filesystem-azure/src/main/java/io/trino/filesystem/azure/AzureFileSystem.java#L486-L495
By looking into the azure-sdk-for-java code i noticed in https://github.com/Azure/azure-sdk-for-java/blob/21e4d0f0d859ad4564c88b0aec55d6c5bf0bfb02/sdk/storage/azure-storage-common/src/main/java/com/azure/storage/common/implementation/BuilderUtils.java that we use indeed the default retry mechanism:
https://learn.microsoft.com/en-us/azure/storage/blobs/storage-retry-policy#configure-retry-options
The fact that the error coming back is Server encountered an internal error. Please try again after some time. made me assume that we're dealing in fact with a Azure REST API issue.

Options moving forward in this case would be modifying the retry options to find a set that will handle this as required (ex, more attempts, different backing off strategies, etc).

Why don't we have then higher values for the default retry policy in azure-sdk-for-java? I'm not sure what values should a user of Azure REST API is supposed to set.

@findinpath nothing appears wrong in the way the client is configured.
As for the question around default retry values, there are a few levels to this. There are what is called out in the document you linked (which is for the .NET SDKs but the Java SDKs are effectively the same), where there is a baseline backoff, backoff strategy, maximum backoff, and retry count. The backoff time and strategy can be overridden based on a few HTTP headers (Retry-After, retry-after-ms, x-ms-retry-after-ms) if the service returns them, which would align better with expectations of the service. Unfortunately, the backing off strategy is fairly generic by default given the requirement to work with many different services and scenarios, which is why the service returning a backoff is the best choice but not always available.
The retrying options are left easy to override in a service by passing RetryOptions, or in the case of Storage RequestRetryOptions, with more appropriate values for your scenario. And unfortunately, this is another case where I'm not in a good spot to offer options as this is such a variable problem, but I can recommend an initial investigation into either a larger maximum back off or more retries.
@ibrahimrabab could you follow up further by looking into if there are certain reasons a 500 response would come back frequently? Given the amount of integration, performance, and stress testing we do I'd have expected us to see this more frequently but we haven't.


do not build pyjwt, oauthlib

Checklist before submitting

[x] Did you read the contributor guide?
[ ] Did you update any affected documentation?
[ ] Did you write any tests to validate this change?

Description
Fixes # (issue).
Review process to land

All tests and other checks must succeed.
At least one maintainer must review and approve.
If any  maintainer requests changes, they must be addressed.

I'm checking if we can use nlohmann_json from anaconda, as same version is available in defaults channel too.


Show translation in default language

I have a very large translation database and translating it now is quite difficult even with this awesome package. It would be nice if the text that I need to translate is shown in the already available translation, for example the default language of the app (app.locale config).
So if I have my app with default language in English, than I would like to translate it to some other language. But I need to see what the actual text is I need to translate in the default app language, because the key is not self explanatory enough.
It would be really nice if this would be an option.

This is now done by @fergthh and will be released with the next version.
Thank you for the suggestion :)

Great! 👍🏻


Warning for indexing file still displayed

Microsoft PowerToys version
0.55.1
Running as admin

[ ] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce

Even if I did setup my indexing I still have the warning displayed, how can I fix that ?
✔ Expected Behavior
Not having the warning displayed anymore.
❌ Actual Behavior
warning message displayed
Other Software
No response

See if this helped: https://github.com/microsoft/PowerToys/issues/13365#issuecomment-925685290


@varadhbhatnagar change all instances of status.text to status.full_text.  The 'extended' tweet mode returns a different or additional object called full_text (with the entire tweet) but still allows 'text' to work (only returning truncated tweet).  Hope this was helpful, just had this issue a few days back!  see #988

Originally posted by @vism2889 in https://github.com/tweepy/tweepy/issues/935#issuecomment-358145055
I am getting error:
AttributeError: 'Status' object has no attribute 'full_text'

Are you using tweet_mode="extended" if you're using a standard REST API?
See https://developer.twitter.com/en/docs/tweets/tweet-updates and the other comments in that issue.


Fix #430

As stated

THANK YOU SO MUCH OMG. 💖 💖 💖
@kvhnuke Are you serious right now. 30+ days solved one line. You are never going to live this one down. 😂


Add order argument

This approach is similar to #592 but it allows you to use order and ratio together and avoids the need to use a MAXINT flag.

Hi, I'm new to Locust (and to GitHub actually), but I am very interested in this functionality and the approach you took. Is this going to be merged at some point or how does this work?
Thanks!

Hi @ilmesi ! This PR has not been touched in a very long time and now has merge conflicts, so I'm closing it. Feel free to reopen it if you are still interested in changing this!

Hi @cyberw!  I don't why it never was reviewed like #592, since it is clearly much more simple and safer approach and had some interest for some users.


Set Picture Mode via Home Assistant

Apologies if this is the wrong place to ask this but I'd like to set the picture mode via homeassistant automations. I don't need to adjust picture settings necessarily just change between modes that are already configured. Any guidance would be appreciated.

I am trying to achieve the same thing, but it seems that this project is missing something for those endpoints.
I am able to send the picture commands from a standalone installation of bscpylgtv via my system’s terminal and they work as expected (switch from Standard to Cinema, etc.)
However, in Home Assistant w/ aiopylgtv, the endpoint
“com.webos.settingsservice/setSystemSettings”
always fails regardless of its payload with
“aiowebostv.exceptions.WebOsTvServiceNotFoundError: 404 no such service or method”
Its seems that many of the endpoints that begin with “com.webos” are this way.

I am trying to achieve the same thing, but it seems that this project is missing something for those endpoints.
I am able to send the picture commands from a standalone installation of bscpylgtv via my system’s terminal and they work as expected (switch from Standard to Cinema, etc.)
However, in Home Assistant w/ aiopylgtv, the endpoint
“com.webos.settingsservice/setSystemSettings”
always fails regardless of its payload with
“aiowebostv.exceptions.WebOsTvServiceNotFoundError: 404 no such service or method”
Its seems that many of the endpoints that begin with “com.webos” are this way.

Interesting, I wonder if it would be easy enough to slot bscpylgtv into a custom component replacing aiopylgtv.

I am trying to achieve the same thing, but it seems that this project is missing something for those endpoints.
I am able to send the picture commands from a standalone installation of bscpylgtv via my system’s terminal and they work as expected (switch from Standard to Cinema, etc.)
However, in Home Assistant w/ aiopylgtv, the endpoint
“com.webos.settingsservice/setSystemSettings”
always fails regardless of its payload with
“aiowebostv.exceptions.WebOsTvServiceNotFoundError: 404 no such service or method”
Its seems that many of the endpoints that begin with “com.webos” are this way.

Interesting, I wonder if it would be easy enough to slot bscpylgtv into a custom component replacing aiopylgtv.

Also pretty sure it's possible to run CLI commands via HA so could probably just install the package and run those commands via scripts or automations, since it's just picture modes would only need to setup a couple of static commands.

It is. That’s how I solved it. But I’d prefer it to be part of the integration. Now I have to reinstall bscpylgtv manually every time the python environment is updated on my dietPi.

Would you mind providing some details on how you set that up? I think I have some kind of fundamental misunderstanding of how to use python scripts with HA.

It is. That’s how I solved it. But I’d prefer it to be part of the integration. Now I have to reinstall bscpylgtv manually every time the python environment is updated on my dietPi.

Maybe as bscpylgtv as a requirement to a custom component with nothing else in it? Should install itself at startup each time if not present. But yet built in would be better.

I installed bscpylgtv as per instructions, and added this to configuration.yaml:
# lg modes
shell_command:
  set_dark_mode_sdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode expert2 hdmi2 sdr
  set_dark_mode_hdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode hdrCinema hdmi2 hdr
  set_dark_mode_dolby: bscpylgtvcommand <IP_ADDRESS> set_picture_mode dolbyHdrCinema hdmi2 dolbyHdr
  set_light_mode_sdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode expert1 hdmi2 sdr
  set_light_mode_hdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode hdrCinemaBright hdmi2 hdr
  set_light_mode_dolby: bscpylgtvcommand <IP_ADDRESS> set_picture_mode dolbyHdrCinemaBright hdmi2 dolbyHdr
  set_game_mode_sdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode game hdmi2 sdr
  set_game_mode_hdr: bscpylgtvcommand <IP_ADDRESS> set_picture_mode hdrGame hdmi2 hdr
  set_game_mode_dolby: bscpylgtvcommand <IP_ADDRESS> set_picture_mode dolbyHdrGame hdmi2 dolbyHdr

This allows me to call set_dark_mode_sdr as a service in automations.

Again, I feel like I have some kind of fundamental misunderstanding about this.
Are you installing via "pip install bscpylgtv" in the Home Assistant CLI? Because that works for me, and I can issue the commands from the CLI and they work.
But, adding the shell commands to configuration.yaml and calling them from an automation always returns error code 127.
Here is my shell_command entry:
shell_command:
  dolby_standard: bscpylgtvcommand <IP_ADDRESS> set_current_picture_mode dolbyHdrStandard
  dolby_game: bscpylgtvcommand <IP_ADDRESS> set_current_picture_mode dolbyHdrGame
  vol_up: bscpylgtvcommand <IP_ADDRESS> volume_up

Again, these commands work when directly typed into the CLI, but do NOT work when calling a shell command from an automation.

@DeLub Any advice on this?

Before installing you should probably activate the Python environment. On my Pi I do this by
sudo -u homeassistant bash . /home/homeassistant/pyenv-activate.sh
does this help you?

Thanks for the reply 🍻
Unfortunately, that directory doesn’t exist for me, and the find command doesn’t find a pyenv-activate.sh anywhere on the system. There doesn’t appear to be homeassistant user either, just hassio.
I run HAOS in a Hyper-V VM, if that makes any difference.

Sorry, can’t help you with that. I guess bscpylgtv needs to be added to the container. But I don’t know how you should do that.

This is actually a quite funny hack to access the internal "luna" api of webos.. idk if the maintainer of this project would like to implement it: https://github.com/chros73/bscpylgtv/blob/8267636a991bacbb581bca57b6b461adf1df05a2/bscpylgtv/webos_client.py#L1097

This is actually a quite funny hack to access the internal "luna" api of webos.. idk if the maintainer of this project would like to implement it: https://github.com/chros73/bscpylgtv/blob/8267636a991bacbb581bca57b6b461adf1df05a2/bscpylgtv/webos_client.py#L1097

So in theory something like this should do the trick, but it doesn't:
set_picture_mode:
    sequence:
    - service: webostv.command
      target:
        entity_id: media_player.lg_webos_smart_tv
      data:
        command: system.notifications/createAlert
        payload:
          message: " "
          buttons:
          - label: ""
            onClick": luna://com.webos.settingsservice/setSystemSettings
            params":
              category: picture
              settings:
                pictureMode: cinema
          onclose:
            uri: luna://com.webos.settingsservice/setSystemSettings
            params:
              category: picture
              settings:
                pictureMode: cinema
          onfail:
            uri: luna://com.webos.settingsservice/setSystemSettings
            params:
              category: picture
              settings:
                pictureMode: cinema

I am using the linuxserver homeassistant image. As a workaround which is probably not recommended, I have set the PUID and PGID to root as when I tried my own user, I could see permission errors in the logs.

I first made a backup of my homassistant config dir and then install bscpylgtv at container creation with this added as a volume to my docker-compose.yml file.

/path/to/store/custom/scripts/homeassistant:/custom-cont-init.d:ro

Inside the /path/to/store/custom/scripts/homeassistant, I have a simple script that installs bscpylgtv via pip.

#!/bin/bash

echo "**** installing bscpylgtv via pip****"
pip install --no-cache-dir bscpylgtv

Then I had to use the environment variables PGID and PUID for root.

...
environment:
    - PUID=0
    - PGID=0
    - ...
...

After container start, I did see DHCP Discovery error with libpcap but I have not looked into it yet... at least the bscpylgtv shell commands are working for now.

Cannot watch for dhcp packets without a functional packet filter: libpcap is not available. Cannot compile filter !


How to play - speech bubbles over key objects

http://opengameart.org/content/free-keyboard-and-controllers-prompts-pack


Added Chef in Vaccination Queue(JAVA)

CodeChef Starters 13 Division 3 (Rated)
Issue Id you have worked upon -
#67
Briefly explain your program logic -
we are calculating the number of children and adults present before the chef (including him) in the vaccination queue and then we are calculating the total time taken by multiplying the count of children and adults present with the time given in input (x,y).
Screenshots(Attach 2 screenshots of your own input and output) -
Attach here

Checklist:
Eg - If your code follow the below guidelines. Kindly change [] to [x]
All the conditions should be fulfilled for considering your code for merging -
[x] I have mentioned the question as comment in my solution file.
[x] My code follows the guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code.
[x] My code gives the correct output.
[x] I confirm that I have not copied the code from anywhere. In case its found that I have copied I can be banned from the repository.
[x] I affirm that I strictly follow contributing guidelines and code of conduct.

@manvikri22,
I appreciate 👏 the way the solution has been presented, proper coding style and comments.
As an appreciation leveling up your question points from level1 to level2.


Unable to Install 2010 64-bit redistributable on a 64-bit VM in Azure

Expected Behavior
$VcList = Get-VcList | Get-VcRedist -Path "C:\Temp\VcRedist"
Install-VcRedist -VcList $VcList -Release "2010" -Architecture "x64","x86" -Path "C:\Temp\VcRedist" -Verbose

I expect this to install both libraries when executed on a Windows Server 2016 64-bit VM in Azure.
Current Behavior
The above script installs the x86 library, but prints this when attempting to install the x64 library:
VERBOSE: Incompatible architecture: [x64]Visual C++ 2010 Service Pack 1 Redistributable Package MFC Security Update

Failure Information (for bugs)
Please help provide information about the failure if this is a bug by issuing the command using the -Verbose command.
VERBOSE: Filtering releases for platform and architecture.
VERBOSE: Incompatible architecture: [x64]Visual C++ 2010 Service Pack 1 Redistributable Package MFC Security Update
VERBOSE: Install: [x86]Visual C++ 2010 Service Pack 1 Redistributable Package MFC Security Update
VERBOSE: Performing the operation "Install" on target "C:\Users\tdadmin\AppData\Local\Temp\3\VcRedist\2010\x86\SP1\vcredist_x86.exe /passive /norestart'".

If it is not a bug, please remove the rest of this template.
Steps to Reproduce
Please provide detailed steps for reproducing the issue.

Run the commands provided above on a stock Windows Server 2016 Data Center VM in Azure
Look for output that says that the x64 VC Redistributable library did not install because of an incompatible architecture
Look at the Get-Bitness function to see that this method is not returning the correct value of $false when called using Get-Bitness -Architecture 'x86'

Context
Please provide any relevant information about your setup. This is important in case the issue is not reproducible except for under certain conditions.

VcRedist Version: Use Get-Module -ListAvailable VcRedist

ModuleType Version    Name                                ExportedCommands
---------- -------    ----                                ----------------
Script     <IP_ADDRESS>   VcRedist                            {Export-VcXml, Get-InstalledVcRedist, Get-VcList, Get-VcRedist...}

PowerShell Version: Use Get-PSVersion

Name                           Value
----                           -----
PSVersion                      5.1.14393.2636
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.14393.2636
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

Operating System:

Thanks for the bug report. Fixed in commit 2c02bc21052ab085383241be21e64410698a2b8e and version <IP_ADDRESS>.

Awesome, thanks!


tqdm is not imported in prediction.py + request

Dear authors,
First of all, I would like to thank you for publicly offering your implementation version of this method from Zhao et. al (2020) on Github. This material greatly helps me in conducting my master thesis research into unsupervised methods for multivariate time series anomaly detection.
I have one problem I have run into, an error while executing your code for the SMAP dataset. training goes well up until predicting and calculating the anomaly scores from line 167 in train.py onwards. Here the predict_anomalies function on line 118 calls the get_score function from prediction.py, which on line 51 returns "NameError: name 'tqdm' is not defined". This is probably due to the lack of the tqdm import statement at the beginning of the prediction.py file.
I hope this feedback is of value to you.
Apart from mentioning this problem, I have another question. Is it possible to load different datasets into your implementation, or is it hard to do this due to hardcoding practices for example? My intention is to load a custom multivariate time series dataset and evaluate the performance of this method. The dataset comprises several .csv files, each having data of one of multiple IoT sensors where columns constitute the multivariate features and rows the time dimension. In order to transform this data to your data format requirements, I will condense these files into one big file where the multivariate sensor features of all sensors are combined in the columns. Could you recommend a way to load this file into your implementation? I was thinking of adapting the preprocess.py file to do so. Perhaps you could add the option to load custom datasets in the future.
In any case, thank you very much for your efforts.

Hi, thanks for your input.
Regarding the import error, I am not sure how this came to be. Perhaps the import line was deleted during cleanup of the code. Anyway, tanks for lettis us know. Tqdm provides a loading bar, and can be installed using pip, and imported with from tqdm import tqdm
The answer to your second question is yes, it should be quite straight forward to use a custom dataset. However, there are some things you must do. As you say, I suggest you make your own method in preprocess.py, which is loading your data. This method should be called instead of the get_data() method in train.py:
https://github.com/ML4ITS/mtad-gat-pytorch/blob/c7bb82371ad8980e1e2b3f45867a1c5c78f85f59/train.py#L36-L41
Just add another elif-statement with the name of your dataset, and make sure to call train.py using --dataset name-of-your-dataset
Your method should return a training set (x_train) and a test set (x_test), where the testing set also could have corresponding test labels (y_test). x_train/x_test should be a numpy array of shape (n, k), where n is the number of rows, and k is the number of columns. y_test should be a numpy array of length n, with values 0 or 1, where 0 means no anomaly, and 1 means anomaly. If you don't have labels for the test set, you just set y_test to None, and the model will do prediction but not evaluate the model against a ground truth.
You must also provide a line in get_target_dims() in utils.py, where you specify which column you want to model, or None if you want to model every column.
Also, in train.py you should add your dataset in the dictionaries at line 126 and 141.
Hope this helps, and good luck with your master thesis!

Hi Axel,
Thank you very much for your help, this really helps me conduct my master thesis!
Your suggested steps worked like a charm.
When evaluating the the model on my custom multivariate dataset (which unfortunately lacks ground truth labels) visually, in general I was very pleased with the results. I noticed however that some features were really closely fit, while other features were quite badly fit by the model. I am trying to understand why this could be. I presume it has something to do with the patterns being longer than the sliding window size. Attached are two examples, one feature that was fit really well, and one that was not fit well. The window size used is 100, and in the good case comprised multiple patterns, and in the bad case comprised less than pattern sized sections. What potential remedy step would you suggest? Increasing the window size, or perhaps another hyperparameter? I would be happy to hear your input!
Secondly I was wondering why you made the choice to use a GRU-based decoder instead of a VAE as the reconstruction model? Is there a chance that you would add an option to select a VAE in your implementation in the near future? I am trying to stay as close as possible to the original model of Zhao et. all (2020) for evaluation purposes. I would be very grateful if you would decide to incorporate this option.
In any case, thank you for providing this solution as is, you did an awesome job!
Kind regards,
Teun

Hi again, I am glad to hear that my reply was helpful to you!
From what I can see, there is not too much pattern present in the first plot. In case of lacking pattern, the model might just output values near the average value, as it sees no way of improving. In general, you could play around with different hyperparameters, and check if the overall performance increases (window size, embedding dimension, number of layers, and size of GRU layer, FC layer, and Recon layer, etc).
However, seeing as the second plot shows that the model is capable of modeling patterns very accurately, you might not want to change too much. In my opinion, the most important thing is that the model is performing well for features that express clearer temporal patterns. In my experience, real-world data will often have certain features that are hard/impossible to predict, and for those, the best thing might just be to predict an average value (you could also remove them from the target features that are being predicted).
For your second question, I talk about this in #2. Actually, by talking with authors and others, the VAE seems to be somewhat unstable and hard to train, which was one of the reasons why we chose a simpler reconstruction model. We are not really working on this project anymore, so we do not plan to extend it to include the VAE. Maybe you will be the one to take up the challenge? ;-)
Best regards,
Axel

Hello Dear @axeloh
I tried to run the model on my custom dataset that has 17 features. For anomaly purposes for reconstruction exactly, what I should change please given I build custom dataset loader?

@axeloh I tried running on my custom data and followed your changes above. I tested the model on new unseen data but it failed even though I have 0.33 reconstruction loss on the test data during training. Any suggestion please? Also, how to get those figures below as my dataset has 17 features and no anomaly label there. So I set y_test to None as you said. Any help please?


call_py_cy.cy_call_onearg does crash on Python 3.10 (likely also Python 3.9)

When testing Cython on the master branch of Python (future version 3.10), I got the following crash:
Run command: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/venv/bin/python -X dev runtests.py -vv --no-pyregr in /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19

(...)

Doctest: call_py_cy.cy_call_noargs ... ok
cy_call_onearg (call_py_cy)
Doctest: call_py_cy.cy_call_onearg ... python: Objects/unicodeobject.c :2936 : unicode_fromformat_arg:  l'assertion « obj && _PyUnicode_CHECK(obj) » a échoué.
Fatal Python error: Aborted

Thread 0x00007fba480bc700 (most recent call first):
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 2194 in time_stamper
  File "/home/vstinner/python/master/Lib/threading.py", line 888 in run
  File "/home/vstinner/python/master/Lib/threading.py", line 950 in _bootstrap_inner
  File "/home/vstinner/python/master/Lib/threading.py", line 908 in _bootstrap

Current thread 0x00007fba55cc9740 (most recent call first):
  File "<doctest call_py_cy.cy_call_onearg[1]>", line 1 in <module>
  File "/home/vstinner/python/master/Lib/doctest.py", line 1336 in __run
  File "/home/vstinner/python/master/Lib/doctest.py", line 1483 in run
  File "/home/vstinner/python/master/Lib/doctest.py", line 2198 in runTest
  File "/home/vstinner/python/master/Lib/unittest/case.py", line 550 in _callTestMethod
  File "/home/vstinner/python/master/Lib/unittest/case.py", line 593 in run
  File "/home/vstinner/python/master/Lib/unittest/case.py", line 653 in __call__
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 122 in run
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 1280 in run_test
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 1286 in run_forked_test
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 1281 in run_doctests
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 1269 in run_tests
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 1251 in run
  File "/home/vstinner/python/master/Lib/unittest/case.py", line 653 in __call__
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 122 in run
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 84 in __call__
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 122 in run
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 84 in __call__
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 122 in run
  File "/home/vstinner/python/master/Lib/unittest/suite.py", line 84 in __call__
  File "/home/vstinner/python/master/Lib/unittest/runner.py", line 176 in run
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 2477 in runtests
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 2146 in main
  File "/home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19/runtests.py", line 2499 in <module>
Traceback (most recent call last):
  File "/home/vstinner/python/master/Lib/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/vstinner/python/master/Lib/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/vstinner/myprojects/pythonci/pythonci/__main__.py", line 2, in <module>
    CI().main()
  File "/home/vstinner/myprojects/pythonci/pythonci/_ci.py", line 370, in main
    task.run_tests()
  File "/home/vstinner/myprojects/pythonci/pythonci/task/__init__.py", line 47, in run_tests
    self._run_tests()
  File "/home/vstinner/myprojects/pythonci/pythonci/task/cython.py", line 21, in _run_tests
    self.app.run_python(['runtests.py', '-vv', '--no-pyregr'],
  File "/home/vstinner/myprojects/pythonci/pythonci/_ci.py", line 115, in run_python
    return self.run_command(self.python_args + args, **kw)
  File "/home/vstinner/myprojects/pythonci/pythonci/_ci.py", line 109, in run_command
    raise Exception("%s command failed with exit code %s"
Exception: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/venv/bin/python -X dev runtests.py -vv --no-pyregr command failed with exit code -6
Change directory: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19
venv already exists: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/venv
Cython is already installed in: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19
DIRNAME /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19
Run command: /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/venv/bin/python -X dev runtests.py -vv --no-pyregr in /home/vstinner/myprojects/pythonci/work/cpython-3.10.0a0_Cython-0.29.19/Cython-0.29.19

I don't know how to only run this test to debug it. Any idea @scoder ?

There's probably a better way but I'd run the test with runtest.py call_py_cy --no-cleanup (so the so files don't get deleted); change directory to (something like) TEST_TMP/run/c/call_py_cy, run python in gdb, then do:
import doctest
import call_py_cy
doctest.testmod(call_py_cy)

Looks like something that I recently ran into and fixed in a branch somewhere. Let me see.

Very probably in #3611. That branch is not currently testing ok, though.

(#3611 is a big cleanup of the current messy support for type specs and the limited API, which still needs some work to finish up.)

@vstinner I tried it with the latest master of both and couldn't reproduce the crash, but 0.29.x crashes.
As I can see in gdb, PyEval_EvalCodeEx() calls down into _PyEval_EvalCodeWithName() with names set to NULL, and too_many_positional() in ceval.c then eventually calls
4020        _PyErr_Format(tstate, PyExc_TypeError,
4021                      "%U() takes %U positional argument%s but %zd%U %s given",
4022                      qualname,
…

and passes qualname unconditionally, which is still NULL. Looks like a bug in CPython.

... and passes qualname unconditionally, which is still NULL. Looks like a bug in CPython.

Thanks for investigating the issue! I confirm that it's a CPython regression introduced by: https://bugs.python.org/issue40679 I wrote a fix: https://bugs.python.org/issue40679#msg370658


Set default comment markup to 'PlainText' in the database (#741)

Forcing the markup value to 'PlainText' (the default value) when
creating or updating a comment.
Setting this value in the existing DB records
Refactoring the comment/comment_test.go test to make them more
compact yet more readable (IMO)
Fixes #741
Signed-off-by: Xavier Coulon<EMAIL_ADDRESS>

[test]

Codecov Report

Merging #743 into master will increase coverage by 0.02%.

@@            Coverage Diff            @@
##           master    #743      +/-   ##
=========================================
+ Coverage   71.18%   71.2%   +0.02%
=========================================
  Files          80      80
  Lines        4612    4616       +4
=========================================
+ Hits         3283    3287       +4
  Misses       1013    1013
  Partials      316     316

Impacted Files
Coverage Δ

migration/migration.go
50.21% <100%> (+0.21%)
:white_check_mark:

comment/comment.go
73.25% <85.71%> (+0.96%)
:white_check_mark:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f0e5c68...862e3f7. Read the comment docs.


Add remove event to vwc-tag

Is your feature request related to a problem? Please describe.
The removable property removes the tag but doesn't trigger an event
Describe the solution you'd like
Add event to removed tag
Describe alternatives you've considered
Do not remove the tag and just fire the event
Additional context
Add any other context or screenshots about the feature request here.

@YonatanKra


docs: libraries-bom 20.1.0

Fixes #<issue_number_goes_here> (it's a good idea to open an issue first for context and/or discussion)

Problem with sed command?
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.693 s
[INFO] Finished at: 2021-04-19T02:55:19Z
[INFO] ------------------------------------------------------------------------

sed: -e expression #1, char 0: no previous regular expression
cleanup

[ID: 9335674] Build finished after 84 secs, exit value: 1


[xrt] Add "Free all memory" op

System information

TensorFlow version (you are using): nightly
Are you willing to contribute it (Yes/No): N/A

Describe the feature and the current behavior/state.
When a client loses track of xrt-managed state (e.g. because it errors before it could start tracking it) or because it crashes, or because other errors, the allocation stays around on the device side with no way to free it (other than a hard restart of the device). It would be useful to have an xrt op that drops all memory that xrt knows about (perhaps optionally with a preserve list, so the client can say "I know about these, so don't free them").
Will this change the current api? How?
This will likely be a new xrt op.
Who will benefit with this feature?
Users of the xrt API.
Any Other info.
@michaelisard requested to be assigned.

Just to clarify: if you run the ConfigureDistributedTPU Op, does all the memory get freed? I was assuming you were looking for an Op to free memory that is more lightweight than configure. If configure doesn't free memory then that is a different bug.

Configure does not free memory as far as I can tell (it certainly doesn't deregister it from XRT, so I can pass it to another execute and it'll do something - I haven't verified whether the underlying memory sticks around). I do also want a more lightweight Op. While we're at it, I'd also like a more lightweight op to interrupt a running XRTExecute run (our models tend to look like state machines in a while loop on the device, side, so if that gets in a bad state, it can be hard to kill).

OK we will treat 'memory not freed on configure' and 'support free-all-memory without configuring' as separate issues.
I think it's going to be hard to interrupt a running program without resetting all the chips. If you need to be able to recover from a codegen error then you probably need to do a reset. If you want users to be able to recover from their own errors, I fear you will need to add support in your generated code to yield every so often.

There also something broken with the memory overview on OOM:
Tensorflow error: Status: Attempting to allocate 235.02M. That was not possible. There are 446.86M free. Due to fragmentation, the largest contiguous region of free memory is 234.77M.;
HBM capacity 8.00G:
       Top-of-Memory reserved:  528.00M (     553,648,128 bytes)
          Currently allocated:  212.71M (     223,038,464 bytes)
         Requested allocation:  235.02M (     246,431,744 bytes)
                               ------------
      Available after request:    7.05G (   7,566,816,256 bytes)

	 [[{{node XRTExecute}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

Seems like those 7G are actually allocated, but missing from the overview.

Nagging Assignee @michaelisard: It has been 15 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Hi,
Thank you for opening this issue. Since this issue has been open for a long time, the code/debug information for this issue may not be relevant with the current state of the code base.
The Tensorflow team is constantly improving the framework by fixing bugs and adding new features. We suggest you try the latest TensorFlow version with the latest compatible hardware configuration which could potentially resolve the issue. If you are still facing the issue, please create a new GitHub issue with your latest findings, with all the debugging information which could help us investigate.
Please follow the release notes to stay up to date with the latest developments which are happening in the Tensorflow space.


respond to breaking changes

Hey this repo has changed to use conventional commits to automate the changelog between releases for our developers to be able to more easily follow what happened. If you're unfamiliar with conventional comments take a peek at our contribution guide
I suggest to rebase your commits with new commit messages:

370a30f fix(mini-cart): rename modifier_set_name to modifier_list_name
7a8c341 chore(sdk): update sdk to alpha.12
56b79e7 fix(item-list): use square_online_id true
d19a696 fix(money): use new money format

etc
i want to note that i preferred fix over refactor because fix and feat create new versions where the others do not

@bashunaimiroy @kevinlee11 can you guys run npm ci when you have a chance? there are local commit hooks that should lint this for you


Problem receiving push in iOS 11

Hi,
does anyone else recognize problems with receiving push notifications with iOS 11?
Same code on two devices iOS 10 and iOS 11.
On iOS 10 everything works fine but on iOS 11 it asks for the permissions to receive notifications, but afterwards doesn't get the device token from the apns.
Did they change something on the behavior of the push service? I can't find anything about it and it seems that nobody else had problems with the update...

I am too having issues. Registration works fine, but when I get a push notification OnMessageReceived for my listener is never called.

@CR4567 See https://stackoverflow.com/questions/44796613/silent-pushes-not-delivered-to-the-app-on-ios-11/46455236#46455236

thanks for the information.
My problem is not really with the silent push but it seems that were some issues with the new iOS.
For me it seems that some of the services did not start correctly.
After some changes and restarting my device, everything is working again.
So definitely not a problem of this plugin, so I will close this issue.


chore: Add reddit and twitter to release, move website event to pre-release

Summary

Move website event to pre release
Add automation for sending tweet and make reddit post

deffo ready for a review

@Guergeiro you good to review again?


./build/OpenAPI not found

https://github.com/TinkoffCreditSystems/invest-openapi-js-sdk/blob/300808a4919e4df80205f33e77ccd8b8396047e0/index.d.ts#L1
Hello!
Where is ./build ?

Hello!
It's an auto-generated file.
To get it going run npm i & npm run build

Hello!
It's an auto-generated file.
To get it going run npm i & npm run build

Thanks, it helped


Invalid generic default type used with Partial on intersection

TypeScript Version:  2.9.0-dev.20180426
Search Terms: Generic inference partial weak interface
I have come across a weird behavior of the generic inference when use with partial and default types.
The example is a bit convoluted but I have not managed to simplify it further:
Code
interface Base {
    b: number;
}
declare class Model<Param extends Base = Base> {
    constructor(attr: Partial<Param & { a: number; }>);
    bar(a: Param): any;
}

interface Foo extends Base {
    c?: number;
}
declare class FooModel<Param extends Foo = Foo> extends Model<Param> { }

/* TS2345: Argument of type '{ b: number; c: number }' is not assignable to parameter of type 'Partial<Base & { a: number; }>'.
 * Object literal may only specify known properties, and 'c' does not exist in type 'Partial<Base & { a: number; }>'.
 */
const m: Model = new FooModel({ b: 1, c: 1 });

const p: Model = new FooModel<Foo>({ b: 1, c: 1 }); /* ok */
const q: Model = new FooModel({ b: 1, c: 1 } as Foo); /* ok */
const r = new FooModel({ b: 1, c: 1 }); /* ok */

Expected behavior:
The m assignment should compile, the default type for the generic of FooModel is Foo.
Actual behavior:
Does not compile, as shown in the error message, Base is used as the generic type.
Additionally:

Removing & { a: number} from the Partial solves the issue: If we try to compile  const m: Model = new FooModel({ bad: 2 });, the error message shows Foo is used as the generic type.
Removing the bar method solves the issue: idem, Foo is then used as the generic type.
Removing the Partial solves the issue, idem.
Making c non-optional fixes the issue, as does using Typescript 2.3. This seems to indicate that it is related to weak interfaces if I had to guess.

Playground Link:
Playground Link

The really bad inference we draw here is a return type inference - we effectively infer from
type InstantiatedModelInstance = {
    bar(a: Base): any;
}

to
type UninstantiatedFooInstance<Param> = {
    bar(a: Param): any;
}

yielding an inference of RetunType priority for Base -> Param. We then actually get no inference from the constructor, because { b: 1, c: 1 } to Partial<Param & { a: number; }> becomes a mapped type constraint inference to keyof Param | "a" (keyof distribution over intersections is a recent change) and yields no inference (apparently we don't handle intersections of generics within mapped types particularly well when it comes to inference).

I spoke with @ahejlsberg and at least for now, we're calling this a limitation of the inference engine, as we have no great way to draw a good inference for Partial<Param & { a: number; }> from { b: 1, c: 1 } based on how we do mapped type inferences. However in this specific instance, you can just rewrite the argument type as Partial<Param> & { a?: number; } to obviate the checker's confusion. Generally speaking, complex types used as mapped type constraints (like the parameter of Partial) are difficult for us to draw inferences for - it's best if you keep them as bare type parameters, then we can easily draw strong inferences.

Thanks for the explanations. Luckily this bug does not impact us too much. The example was simplified quite a bit so your suggestion might not be really possible, but I'll look into refactoring the code to avoid relying on such mapped types.


Horizontal stack first layer

Causality is not working for first layer.

After some thoughts I've undestood that vertical stack should perform all masking. Switching to cropping will mask context but not colors.
So, i need to fix several things:

[ ] Color channel masking (incorporate MaskedConvolution into Cropped)
[ ] Make sure I perform enough shifting to mask type 'A'


[MINOR] Add logging for EventHubs configs

@prateekm for review

@vjagadish1989 Checkstyle failure:
EventHubConfig.java:104: 'block rcurly' have incorrect indentation level 8, expected level should be 10.

Fix it and ship it.


0.4b: Error during setup of component indego

Get this error after copying the new files to my folder and restarting HA.
Error during setup of component indego
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/setup.py", line 156, in _async_setup_component
    component.setup, hass, processed_config)  # type: ignore
  File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/config/custom_components/indego/__init__.py", line 68, in setup
    IndegoAPI_Instance = IndegoAPI(username=mower_username, password=mower_password, serial=mower_serial)
  File "/config/custom_components/indego/__init__.py", line 177, in __init__
    self.update()
  File "/config/custom_components/indego/__init__.py", line 318, in update
    self.getGenericData()
  File "/config/custom_components/indego/__init__.py", line 526, in getGenericData
    self._alm_name = tmp_json['alm_name']
KeyError: 'alm_name'

Are there any other info about the component before this rows in your log?

nope :-(

If you do another reboot? If you try to delete the pycache in your Indego folder before reboot?

I have tested with a fresh install of hassio 0.96.5 right now. Cant reproduce your error.
Also rnning without error messages in my development environment as well as my "real" Hassio.
So I need more infomration from you in order to solve this.

Tried everything.

rebooted several times.
removed pycache and rebooted several times
removed the whole package, rebooted several times and installed again
installed the old version (0.3) - this works.
tried reinstalling the beta version - same error

Using hassio 0.65.5

I forgot to write, that I also get this error in the frontend:
The following components and platforms could not be set up:

indego
Please check your config.

But I haven't changed my config, so it looks like it now expects something ells from the config - don't see any changes about that in the instruction.

also got error setting it up after the update. Let me know if you need anything

Hmmm, very strange. The only thing I need is the log file. But if it says nothing more than you stated here, then it is not of any use.
@nsimb : What version of Hassio are you running? Or are you running HA?

Home Assistant 0.96.5
Hass.io 170
HassOS 2.12
Reverted to the previous version and it works again, sadly lost the log file.
I can redo the change and get you a new logfile if you need mine

The interesting part is that you got different kind of errors. The error indicates that the json answer doesnt contain the expected values.
I think I have to add some error handling as my component handles the json answers very static.

You have tried the debug log?
logger:
  logs:
    custom_components.indego: debug

If you are comfortable with changing in your component code, please change the following:
@onkelfarmor
__init__.py row 526:
self._alm_name = tmp_json['alm_name']
to
self._alm_name = tmp_json.get('alm_name')
@nsimb
__init__.py row 507:
self._optinapp = tmp_json['optInApp']
to
self._optinapp = tmp_json.get('optInApp')
If you could try this and see if the error moves to another row, that would be of great help to me. If this json string handling is fixing the error, then I could release a new beta that is corrected.

I changed row 526 as described and now get a new error, so yes, it moves to a another row:
Error during setup of component indego
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/setup.py", line 156, in _async_setup_component
    component.setup, hass, processed_config)  # type: ignore
  File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/config/custom_components/indego/__init__.py", line 68, in setup
    IndegoAPI_Instance = IndegoAPI(username=mower_username, password=mower_password, serial=mower_serial)
  File "/config/custom_components/indego/__init__.py", line 177, in __init__
    self.update()
  File "/config/custom_components/indego/__init__.py", line 319, in update
    self.ModelDescription()
  File "/config/custom_components/indego/__init__.py", line 826, in ModelDescription
    return self._model_description
AttributeError: 'IndegoAPI' object has no attribute '_model_description'

Ok, good. My theory works then!
You could try to continue changing all the locations that gives you an error. Or you could wait for an updated beta from me with this error control in all json handling.

Would love to do it myself, but need more guidance :-)
or I just wait for you.
Very happy about your work!

There is another beta tagged as 0.4b2. IT is only the __init__.py' that is updated with the new json handling. So it should be enough to just replace this file, restart and look in the log file...

Updated, I now don't get any errors but don't know how to at what to look for in the log.

See if your sensors are working. Other than that, look for errors in the log.
Are your sensors showing as expected?

After some restarts and some retries, I now get the same warning, that Indego not could be setup and the same error in the log as above. No sensors working.

Found an error in init.py, line 811:
return self._model_description
must be
 return self.model_description
now I get more sensors showing up, but they are not updated with data. However, in the log I see that all data is collected from Bosch, but it is somehow not written to the sensor.

If you are comfortable with changing in your component code, please change the following:
@onkelfarmor
__init__.py row 526:
self._alm_name = tmp_json['alm_name']
to
self._alm_name = tmp_json.get('alm_name')
@nsimb
__init__.py row 507:
self._optinapp = tmp_json['optInApp']
to
self._optinapp = tmp_json.get('optInApp')
If you could try this and see if the error moves to another row, that would be of great help to me. If this json string handling is fixing the error, then I could release a new beta that is corrected.

Looks like I missed allot (sorry was away)
Will try to test the new version this afternoon

did install the new version, did however not do the manual changes @onkelfarmor did (since my setup worked fine with the _ in "return self._model_description"
Looks like this ones are working:
sensor.indego_batt_voltage
sensor.indego_battery
sensor.indego_lawn_mowed
sensor.indego_mower_state
sensor.indego_mowing_mode
sensor.indego_runtime_total
Alerts, update are not available, same as @onkelfarmor missing
not sure if its might to this  in sensor.py:
mower_alert_sensor_name = CONF_MOWER_NAME + ' mower alert'
add_devices([IndegoAlertSensor(mower_alert_sensor_name)])

The alerts was commented out because I was experiencing strange errors with the API-calls. I think it is related to UTF8-encoding as my alerts are in swedish (containing swedish special characters).
I have worked on new code to implement the new PYPI API. I will not add any more time on the beta as it takes time from pushing towards the release of a better coded component.

Closed when 0.5 is released.


Assist: replace anonymous lifetime with a named one

(fixes #4523)

This should probably also handle the case when 'a is already used, like in fn foo<'a>(_: &'_ i32) {}.

bors r+


UITextField setEnabled: fix (isEnabled property set on wrong Xaml control)

:shipit:

@yiyang-msft is added to the review. #Closed

:shipit:

Thanks for your contribution.


Customizable web page login language

@wangzun123 This PR adds support for setting language of the web page used for web login. Please check it when you have time.

@eJamesLin All fixed. It should be ready now!


Updates datacenter recipe with some context for the overloaded_panels stream

Description

New recipe checklist

[ ] Full code validated in Confluent Cloud
[ ] SQL style/syntax consistent to existing recipes
[ ] Validate presentation with python3 -m mkdocs serve
[ ] File structure and content follow template
[ ] Added recipe to navigation
[ ] SQL style consistent to existing recipes
[ ] Spell check, e.g. using aspell

Relates to #87


Establish a place for people to share/store useful queries

I'd like to store the queries that people are starting to use in a vaguely organised way, but in a place that people can easily access and edit them - I'm thinking GH wiki, at least initially.
Could people from ODSC and ILDA let me know perhaps 5 initial examples of answers to the question "What are you trying to do with the data?" so that we can keep some semblance of order to the wiki?
@timgdavies @duncandewhurst @Tim0th1 @yolile @tian2992 @juanpane ^^

Noting this script in a branch, to ensure it isn't lost: https://github.com/open-contracting/ocdsdata/compare/sql-scripts

I already "transformed" some of the queries used to make the structure validation report here: https://docs.google.com/document/d/1zqtBsiC5b-QSjZYwq3rCu7JYpOn5HTtiC7iekv26YaM/edit#heading=h.udasz8n181do

So far (in the context of working on OCDS for Infrastructure) I've been:

Understanding which OCDS fields are in the data
Checking how the releases and records model is used
Searching for contracting processes related to a given project (by title, description etc.)

The doc shared by @yolile gives a good overview of the types of question we ask when reviewing data

@yolile that looks perfect!
In terms of a place to store and share queries that people will be running on the ocdsdata server, is there a need for another place (eg the GH wiki?) or will that doc suffice?

I like the idea of being able to save queries in Redash (given it has features for this). Even if they are not run from there, they can be copied out to run in other tools.

In lieu of Redash being installed on the server and with a view to documenting the Australia data review I'll be carrying out this week, I've been working on converting the data structure feedback methodology into a colaboratory (jupyter) notebook which connects to the ocdsdata server.
I've copied across the queries that @yolile transformed for postgresql and transformed or added queries to:

Return additional fields reported by CoVE
Return validation errors reported by CoVE
Return extensions reported by CoVE
Return extensions declared in the package metadata (for when the check stage of the data load wasn't run)
Return a list of organizations identifier schemes used (for both OCDS 1.0 and 1.1)
Return a list of ocids with multiple releases (to check how releases and records model is used)
Return a list of tags and releases for ocids with multiple releases (to check how releases and records model is used)
Return a list of item classification schemes used

I'll use this as the basis for the australia data review so will add more queries to it as I work on that this week (once the scraper has finished)
@robredpath I created a new key pair to use for the connection from the notebook and added the public key to the ocdsdata server

I don't think there's anything else to do here right now - closing


Use None instead of set() to improve memory allocation performance

Thank you! LGTM!

I give the background of this PR. This PR fixes the slow down issue of the current CuPy master; the main cause was heavy cache misses caused by linear search of the list of sets. This slow down was introduced by #382 that replaced the list of lists with a list of sets. The point is that Python list object is small while set object is large. Linearly searching set objects trigger increment/decrement of the reference counter of each set object which is far apart to each other due to large set object size (note that what is large is set object itself, not the region used for the hash table itself). It causes severe cache misses.
This PR replaces the default value of this list with None. It makes the situation better because most sets were not updated even once. Since all None objects are reused, now the linear search always increment/decrement the same ref count, thus much less cache misses.

perf stat -e instructions,cycles,L1-dcache-load-misses,LLC-load-misses,dTLB-load-misses python examples/imagenet/train_imagenet.py --arch resnet50 --batchsize 128 --epoch 1 --gpu 0 train.txt test.txt
Before:
   380,625,258,947      instructions              #    0.94  insns per cycle
   404,679,391,619      cycles
     7,645,880,085      L1-dcache-load-misses
     2,566,336,262      LLC-load-misses
       198,655,728      dTLB-load-misses

<PHONE_NUMBER>07 seconds time elapsed

After:
   398,933,898,016      instructions              #    1.41  insns per cycle
   283,492,023,279      cycles
     7,727,211,322      L1-dcache-load-misses
       148,083,061      LLC-load-misses
        76,425,543      dTLB-load-misses

      59.625394260 seconds time elapsed

Great 🥇

LGTM!

I am not sure it is related to this commmit, but jenkins CI is failing.

jenkins, test this please

jenkins, test this please

jenkins, test this please

jenkins, test this please

jenkins, test this please.

jenkins, test this please.

jenkins, test this please.

LGTM!


[release/1.3] revert pin vendors by git sha

Continue using git tags to pin vendors when available. This needs needs more discussion on master and was not agreed on to backport. This currently breaks the release tool version comparison logic. Going forward, either the release tool needs to be updated to resolve sha to tag (and vendor checking validating tag comments), or we continue to use git tags to pin vendors.

Codecov Report

Merging #4181 into release/1.3 will not change coverage by %.
The diff coverage is n/a.

@@             Coverage Diff              @@
##           release/1.3    #4181   +/-   ##
============================================
  Coverage        42.39%   42.39%
============================================
  Files              130      130
  Lines            14379    14379
============================================
  Hits              6096     6096
  Misses            7388     7388
  Partials           895      895

Flag
Coverage Δ

#linux
45.87% <ø> (ø)

#windows
37.50% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0e625fc...e9836d9. Read the comment docs.


[AutoDiff] TF-523: Property not Differentiable, Explicit Diff Type Aliases

JIRA ticket.
The problem with the bug was that there is a SIL optimization pass from when you have your SIL generated code, to when you do the differentiation pass. One of these optimization passes removes the getters of stored properties when the struct is declared internal.
The reason why it does this is that it's faster to run struct_extract in the SIL code versus calling the getter function on a property, and since internal structs are fully known and never accessed outside the SIL module, you don't need getters since you will always have access to the properties of a struct.
Added a test case that was used to debug this bug.
Should unblock me on the following Complex Number PR.

Could you please make the same change in VJPEmitter::visitStructElementAddrInst?

@dan-zheng done! 😄

@swift-ci please test tensorflow Linux

This solution makes sense for all normal cases. However, there's one case which I don't think it handles correctly:
If the stored property has a custom VJP (shown below), the custom VJP should be used for differentiating that property instead of going along the fieldwise differentiation route.
struct A : Differentiable & AdditiveArithmetic {
   @differentiable(vjp: vjpPropertyA)
   var a: Float = 1
   typealias TangentVector = A
   typealias AllDifferentiableVariables = A

   func vjpPropertyA() -> (Float, (Float) -> A) {
      (.zero, { _ in .zero })
   }
}

@differentiable
func f(_ x: A) -> Float {
   return x.a * 2
}

// A.a.getter
sil hidden [transparent] [differentiable source 0 wrt 0 jvp @AD__$s4test1AV1aSfvg__jvp_src_0_wrt_0 vjp @$s4test1AV12vjpPropertyASf_ACSfctyF] @$s4test1AV1aSfvg : $@convention(method) (A) -> Float {
// %0                                             // users: %2, %1
bb0(%0 : $A):
  debug_value %0 : $A, let, name "self", argno 1  // id: %1
  %2 = struct_extract %0 : $A, #A.a               // user: %3
  return %2 : $Float                              // id: %3
} // end sil function '$s4test1AV1aSfvg'

I experimented with this code and found out that when the getter has a custom @differentiable attribute, the property getter is not getting removed and thus still exists in the module when it reaches the differentiation pass. And the compiler (as of before this PR) is able to find the getter and differentiate this property using the user-defined VJP.
However, if this PR were merged, the property in the example above would be differentiated incorrectly because the shortcut introduced in this PR makes the compiler not use the user-defined VJP.
So in addition to the existing change, I would suggest adding a check to see whether the property getter decl has a @differentiable attribute already. If the property getter decl does have a @differentiable attribute, we assume that the getter had not been thrown away and thus will flow through the original getter-getting logic. Concretely, it should look like:
auto *getterDecl = seai->getField()->getGetter(); // NOTE: Bring these two lines above the `if`.
assert(getterDecl);
if (!getterDecl->hasAttribute<DifferentiableAttr> &&
    (structDecl->getEffectiveAccess() <= AccessLevel::Internal ||
     structDecl->getAttrs().hasAttribute<FieldwiseDifferentiableAttr>())) {
  ...
}

@rxwei great catch! I'll make this change and also add a test case for this as well.

I think there are existing tests that define a VJP for a stored property.

No not yet! Was going to rerun tests before Chrome Remote Desktop was too much of a pain that I had to push a commit here first so i could access it from home.

Seems as though there are stored property tests in protocol_requirement_autodiff.swift which are now failing. They are simple tests about checking the values of pullbacks, and not testing the type checking. So I will remove them. I'll also go through the rest and see what needs to be updated and removed.

@swift-ci please test tensorflow

@swift-ci please test tensorflow

@swift-ci please test tensorflow

@swift-ci please test tensorflow

Hmmm seems like the code elimination may have broken two tests....I'll investigate this as it was working up to when I eliminated code I think

Actually I was wrong, it seems to have been failing if I look at historical runs of running all the tests 😞

Seems like it's failing on this reproducer:
struct TangentSpace : VectorNumeric {
  let dy: Float // change to `y` and it will work
}

extension TangentSpace : Differentiable {
  typealias TangentVector = TangentSpace
}

struct Space {
  @differentiable
  var y: Float
}

extension Space : Differentiable {
  typealias TangentVector = TangentSpace
  func moved(along: TangentSpace) -> Space {
    return Space(y: y + along.dy)
  }
}

let actualGrad2 = gradient(at: Space(y: 0)) { (point: Space) -> Float in
  return 3 * point.y
}
let expectedGrad2 = TangentSpace(dy: 3)

What seems to be happening is in the field wise differentiation pass, it splits into two cases:

If typealias TangentVector = Self // Self being the struct itself), then the field you are differentiating on is itself the tangent you want to grab
Else, lookup the field in the other TangentVector.

It's failing to find the tangent of the field for when the TangentVector is not itself. What is kind of entertaining about this bug, is that it's looking up a field called y in the struct TangentSpace above. However, there is only a dy. But if you were to change the name of dy to just y, it works like expected!

This is an interesting test case, and I realized I missed one important edge case, which is when the TangentVector is custom-defined and when it does not have a fieldwise correspondence with the original function. I'll think about this more and think about the right solution!

In https://github.com/apple/swift/pull/25151/commits/d0f77e73a8a54b556ac25f0d471afe12811a7dfd, I fixed the issue and further simplified the property differentiation semantics by requiring a name correspondence between fields in T.TangentVector and fields in T, and deprecated the @_fieldwiseProductSpace attribute. From now on, in order to differentiate a property access foo.x, type(of: foo).TangentVector must contain a corresponding property named x. If not, a diagnostic will be emitted. This is easier to reason about than the existing behavior, and is significantly easier for the user to define custom tangent spaces.
Case where a user defined TangentVector makes it possible to differentiate foo.x:
struct Foo: Differentiable {
    var x: Float
    struct TangentVector: Differentiable, AdditiveArithmetic {
        var x: Float
    }
    ...
}

@differentiable
func funcToDiff(_ foo: Foo) -> Float {
    foo.x
}

Case where a user defined TangentVector does not allow differentiating foo.x because it does not have a field named x.
struct Foo: Differentiable {
    var x: Float

    // No field named "x"!
    struct TangentVector: Differentiable, AdditiveArithmetic {
        var y: Float
    }
    ...
}

@differentiable
func funcToDiff(_ foo: Foo) -> Float {
    foo.x
}
// error: function is not differentiable
// note: property cannot be differentiated because 'Foo.TangentVector' does not have a member named 'x'

This fully resolves TF-523 and TF-262. Feel free to reword this comment and make it part of the PR description.

@swift-ci please test tensorflow

@swift-ci please test tensorflow

@swift-ci please test tensorflow

@swift-ci please test tensorflow

I'm a bit confused regarding how this fixes TF-262, and it also seems that all of TF-21's subtasks are done and closed, but Differentiation.cpp has the following:
case AdjointValueKind::Aggregate: {
  // FIXME(TF-21): If `TangentVector` is not marked
  // `@_fieldwiseProductSpace`, call the VJP of the memberwise initializer.
  // for (auto pair : llvm::zip(si->getElements(), av.getAggregateElements()))
  //   addAdjointValue(std::get<0>(pair), std::get<1>(pair));
  llvm_unreachable("Unhandled. Are you trying to differentiate a "
                   "memberwise initializer?");
}

I'm a bit confused regarding how this fixes TF-262, and it also seems that all of TF-21's subtasks are done and closed

TF-262 is about @_fieldwiseProductSpace, which is an earlier name of @_fieldwiseDifferentiable. Now the attribute has been deprecated.

Could we eliminate this as well?

No. This is not directly related to TF-21. Feel free to remove the comment. I'll start a PR to handle this soon.


XML Output formatting

The XML Writer in C# has different spacing and does not terminate with an additional newline at the end of the document--causes failed unit testing when trying to compare documents to verify accuracy.  Woking on new tests to do Element-Level checking to ensure output matches input.

Element-level testing revealed that the source uses different standards for saving similar types. IE, some decimal / float values are stored as strings with 1, 2, or 3 trailing zeros. Further testing in progress to determine how strict the parse function is within the game to determine if output needs to be tailored or can be output according to standards.


Retrieving list of branches from a repository.

Hello @hirakiuc ,
I got requirement in my project to list out all branches from a repository and compare code among them.
I had went through our gem documentation and bitbucket api 2.0 documentation. What I found was they are listing all branches from this type of url:
https://api.bitbucket.org/2.0/repositories/#{<EMAIL_ADDRESS>But I had noticed in our gem you are using ``https://api.bitbucket.org/2.0/repositories/#{<EMAIL_ADDRESS>and there is no functionality for listing out branches. Well I tried to access my bitbucket api by following the way you had used in connection.rb file.
But the result was a forbidden error.
Can you please help me to access the api for get the url specified above for getting the branches list and compare files among them. (I had implemented this with github) or please help me how to use TinyBucket to get list of branches.
Code I had written:
attrs = {
          headers: {
            USER_AGENT: 'test client' # TODO: fix this !
          },
          ssl: { verify: false },
          url: 'https://api.bitbucket.org'
        }

oauth_secrets = {
          consumer_key:    Repository.last.key,
          consumer_secret: Repository.last.secret
        }
        conn = Faraday.new(attrs)
        conn.request :oauth, oauth_secrets
        conn.get("/2.0/repositories/#{Repository.last.owner_name}/#{Repository.last.name}/refs/branches")

Thanks in advance. :)

Hi. ✋

and there is no functionality for listing out branches

Yes.
This gem has some lack of features because this gem does not follow latest Bitbucket REST API spec, just like listing branches, #93, and so on. 😭

Can you please help me to access the API for get the url specified above for getting the branches list and compare files among them. (I had implemented this with github) or please help me how to use TinyBucket to get list of branches.

If you want to write the code to listing branches, please check #94.
The PR will help you, I think. 😄
And I'll try to update this gem to follow the latest Bitbucket REST API spec. 💪
So this gem will have the feature to listing branches in the future. 🙏

Please check #102 if you still have some issue. 😄
NOTE: The listing branches feature will add by #102.


After upgrading from 7.5 to 7.6.0, tests fail because generated resources can't be found

TestNG Version
7.6.0
Expected behavior
It should still continue to find, in this case, the SPI metadata
Actual behavior
java.util.ServiceConfigurationError
Is the issue reproducible on runner?

[ ] Shell
[ ] Maven
[ ] Gradle
[ ] Ant
[ ] Eclipse
[ ] IntelliJ
[ ] NetBeans

Test case sample
https://github.com/MorphiaOrg/critter/
running mvn install in tests/maven/java  (after running install -DskipTests from the root) will show the problem.  It runs just fine with 7.5.  Bumping to 7.6.0 causes those tests to fail.

actually, 7.6.0 might just be better about reporting the failure.  i'll dig in to it and come back.


⚠ Cioos National CKAN Sitemap has degraded performance

In 4dd3135, Cioos National CKAN Sitemap (https://catalogue.cioos.ca/sitemap/sitemap-1.xml) experienced degraded performance:

HTTP code: 200
Response time: 6272 ms

Resolved: Cioos National CKAN Sitemap performance has improved in 0b05c66 after 5 minutes.


Replacement of tutorial icon in navigation drawer

Description
The PR replaces the tutorial icon in the navigation drawer with a help icon. This enhances the UI of the app.
Fixes #1226
Screenshots showing what changed
Before:

After:

Please review :-)
Thanks

Codecov Report

Merging #1227 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master   #1227   +/-   ##
======================================
  Coverage     3.8%    3.8%
======================================
  Files         125     125
  Lines        5827    5827
  Branches      570     570
======================================
  Hits          222     222
  Misses       5590    5590
  Partials       15      15

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 59a6ea5...2b96b03. Read the comment docs.


returning latitude as undefined

Hi, here are the functions, one of them load the geoJson and the other calls a function to return the nearest points.
Functions: http://pastebin.com/65e8yGVd
GeoJSON file: http://pastebin.com/JBDWsrfF
I get the array of points but ltn is undefined.
The html calls the functions and of course have the line

I tryed with nearestLayer function but same result: ltn undefined.
Any ideas? thanks in advance

Closing; never got enough information for this to be fixable.


KeyError: 'METALHOME' error from MMTL_Basics tutorial

When running the 11th cell of the MMTL_Basics tutorial (metal/tutorials/MMTL_Basics.ipynb), I get the following error:
KeyError                                  Traceback (most recent call last)
<ipython-input-11-0b22f6272cd1> in <module>
----> 1 from metal.mmtl.trainer import MultitaskTrainer
      2
      3 trainer = MultitaskTrainer()

~\Anaconda3\lib\site-packages\metal\mmtl\trainer.py in <module>
    109     "writer": None,  # [None, "json", "tensorboard"]
    110     "writer_config": {  # Log (or event) file stored at log_dir/run_dir/run_name
--> 111         "log_dir": f"{os.environ['METALHOME']}/logs",
    112         "run_dir": None,
    113         "run_name": None,

~\Anaconda3\lib\os.py in __getitem__(self, key)
    667         except KeyError:
    668             # raise KeyError with the original key value
--> 669             raise KeyError(key) from None
    670         return self.decodevalue(value)
    671

KeyError: 'METALHOME'

I can solve this by inserting the following code as a cell above it:
import os

os.environ['METALHOME'] = "PATH/WHERE/I/WANT/LOGS/TO/GO"

This approach makes the tutorial code run fine. Just wondering if there will be any complications later/ why this is happening in the first place.
Anyway, awesome bit of software, thanks!

Thanks for reporting the issue! Previously we set that environment variable so the various subpackages of metal could find each other without too many ".." calls. But we no longer require that variable to be set. Fixed in 6d557e0. Thanks!


Menu entry swapper submenu for Construction cape missing new teleport

Type
Incorrect behavior
Operating System
None
OS Version
No response
Bug description
Varlamore part 2 added a new PoH portal in Aldarin, which is on the Construction cape teleport menu but not the submenu.
Screenshots or videos

RuneLite version
RuneLite version <IP_ADDRESS>
Launcher version 2.6.10
Logs
No response

fixed in b7f9c74b91d467fa900a9474d14e470d5e2b1f15


Quicksilver's suggestion pane is detached, unstretchable, and has a totally garbled search...can I uninstall then reinstall without losing my 40 keyboard  command triggers

Before submitting your bug report, please confirm you have completed the following steps

[X] Searched the issue is not already listed in the Issue List (I've searched it)
[X] Searched in the Quicksilver Users' Group for questions relating to tech support.
[X] Downloaded the latest version of Quicksilver for your system and confirmed the issue still persists.

Bug description
Quicksilver's suggestion pane is detached, unstretchable, and has a totally garbled search...can I uninstall then reinstall without losing my 40 keyboard  command triggers
Steps to reproduce

Just basic use of the app....previous keyboard prompts yielded perfect results....seriously worked now

Expected behavior
To work like before....
MacOS Version
Other
Quicksilver Version
Current, just checked for update
Relevant Plugins
No response
Crash Logs or Spindump
No response
Screenshots
No response
Additional info
No response

I have the same problem. It also has some problems with the preferences windows, that disappear from screen.

To be able to help out you need to provide at least:

the Quicksilver version you are using
The version of macOS you are using
A screenshot of the issue.

OS : 14.1.1
Qsilver: 2.4.1
￼

On Dec 1, 2023, at 5:36 AM, Patrick Robertson @.***> wrote:
To be able to help out you need to provide at least:
the Quicksilver version you are using
The version of macOS you are using
A screenshot of the issue.
—
Reply to this email directly, view it on GitHub https://github.com/quicksilver/Quicksilver/issues/2989#issuecomment-1835857853, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACHBK64IQLZ3BTI2XDFT73TYHGXLDAVCNFSM6AAAAAA7HIIFTGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMZVHA2TOOBVGM.
You are receiving this because you authored the thread.

@sambovermont
Quicksilver has several serious bugs on MacOS 14 (Sonoma). Please try the steps here to see if they help, and please report back: https://github.com/quicksilver/Quicksilver/issues/2994 . Thank you!

Disabling "superfluous visual effects" (linked in the previous post #2994) worked for me. I missed the note about it requiring a restart of QS so make sure you do that.

Boom ! Fixed ! Thank you so much !!!

On Dec 6, 2023, at 2:02 PM, sc8tty @.***> wrote:
Disabling "superfluous visual effects" (linked in the previous post #2994 https://github.com/quicksilver/Quicksilver/issues/2994) worked for me. I missed the note about it requiring a restart of QS so make sure you do that.
—
Reply to this email directly, view it on GitHub https://github.com/quicksilver/Quicksilver/issues/2989#issuecomment-1843522657, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACHBK6ZWE3HSIKTG2OXSRTLYIC6N3AVCNFSM6AAAAAA7HIIFTGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBTGUZDENRVG4.
You are receiving this because you were mentioned.

Wasted an hour on this freaking problem before coming here. SO ANNOYED.

Looks like the recommendations worked around the issue for the OP and the newest release forces this behavior at launch-time so will close for now. (In the upcoming version I hope to remove the use of the private APIs which should more fully prevent the issue from cropping up again in the future.)


Memory leak when serialzing huge model to JSON Writer

One of our users is generating a 1GB large JSON data tree to disk. Even though we use the version of the serializer that takes a Writer as parameter, we run out of heap memory. We're using v4.0 of json-simple.

No reply? Is json-simple abandonware?

@davidekholm Sorry had a busy holiday season.

What other fixes have you attempted? Anything that would help me find the issue helps.

I don't know what workarounds to try. I have a really large JSON tree in RAM that I wish to serialize, but it bails out during that process with an out-of-memory condition. Seems to me that the serialization process could be made more RAM efficient.

I was testing with ~10GB files and it worked. Have you tried this:
https://github.com/cliftonlabs/json-simple/issues/22

Heya, @davidekholm. I fiddled around with serializing large JSON content.
Keep in mind the original object is also in memory with the buffer to build the serialized output totalling to roughly 3 copies in memory at the end of serialization. I think this is fairly reasonable for in-memory operations using a bulky format like UTF-16 strings. If you need more memory efficiency I recommend a custom binary format instead of JSON for serialization. If you want to use JSON then I recommend doing something like the example in #22 where you serialize it to disk instead of RAM and deserialize into RAM for operations to reduce copies in RAM (by 1).
The following code generates JSON that serializes to roughly 2GB and works with -Xmx6656m (~6.5GB) in less than 1 minute of run time.
public static void main(final String[] args){
	final JsonArray json = new JsonArray();
	final JsonObject content = new JsonObject();
	for(int i = 0; i < 1000; i++){
		content.put("field" + i, "value" + i);
	}
	System.out.println("Built content");
	for(int i = 0; i < 50000; i++){
		json.add(content);
	}
	System.out.println("Added content.");
	String jsonString = Jsoner.serialize(json);
	System.out.println(jsonString.length());
	System.out.println("Done!");
}

Basic Hardware profile:
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   39 bits physical, 48 bits virtual
CPU(s):                          8
On-line CPU(s) list:             0-7
Thread(s) per core:              2
Core(s) per socket:              4
Socket(s):                       1
NUMA node(s):                    1
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           94
Model name:                      Intel(R) Core(TM) i7-6700HQ CPU @ 2.60GHz
Stepping:                        3
CPU MHz:                         800.023
CPU max MHz:                     3500.0000
CPU min MHz:                     800.0000
BogoMIPS:                        5199.98
L1d cache:                       128 KiB
L1i cache:                       128 KiB
L2 cache:                        1 MiB
L3 cache:                        6 MiB
NUMA node0 CPU(s):               0-7
Vulnerability Itlb multihit:     KVM: Mitigation: VMX unsupported
Vulnerability L1tf:              Mitigation; PTE Inversion
Vulnerability Mds:               Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds:             Vulnerable: No microcode
Vulnerability Tsx async abort:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts
                                 acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art ar
                                 ch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulq
                                 dq dtes64 monitor ds_cpl est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2
                                 apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault ep
                                 b invpcid_single pti fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mp
                                 x rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat
                                  pln pts hwp hwp_notify hwp_act_window hwp_epp
               total                    used        free              shared    buff/cache    available
Mem:        16215292     7612372     5922492      748416     2680428     7532576
Swap:       15625212           0    15625212

Let me know if you need anything else about using Json-Simple.

Thanks for your pointers. I'll revisit the code if our customer bumps into more issues. I've currently recommended a workaround for the customer that seems  to work fine (splitting a huge project into several smaller projects). You don't need to keep this case open.


External diff with file on disk

It would be nice to have the possibility to run an external diff between selected file (in tree view or double tree view) and the version in current working directory.
Or, external diff between two commits of a file in different branches.
Thanks for you great work!

If you select two commits and rightclick on the file you can do an external commit. Is this what you want?

Hi Murmele,
thanks great to know, I never tried this. This is 80% what I want. The rest of 20% is the diff with the version in the current working directory.
Thanks for your work on Gittyup, Christian.

As a workaround you have to commit and then doing the diff :)

Yes, I understand ;-)

Commiting and doing the diff is only possible if I want to have the current changes in my repo. Otherwise I had to crate a separate branch, commit and doing the diff. Hmm...

Yes currently this is the only possibility. I would commit and then reset Mixed to get the workdir changes back


rustdoc all-features

I can't find a way to generate documentation for all features in a crate, it only uses default features.
With crates.io you can do the following in your Cargo.toml:
[package.metadata.docs.rs]
all-features = true
so, maybe support that?

Hi @snaggen, thank you for reporting that. Yes, a.t.m only the default feature is build. I'll keep this as the first feature request  for kellnr.

I'm excited to see kellnr come to life, and also see it including docs :)
My 2c about this:
I believe that over time, the doc-build will at least partially have to replicate docs.rs functionality.
Probably incomplete examples, from the top of my head, would include:

this request here (docs.rs metadata),
crates-build-env for needed c-libraries for your dependencies.
build inside a countainer (probably with rustwide for security (while you probably don't have to care about the source / build-script for your own private packages, you are executing build.rs files locally for each dependency they include, which might leak the private source code of your own packages).

Hi @syphar,
when I build the doc.rs hosting in Kellnr I wanted the most simple solution that works out of the box. For the future, a more sophisticated approach is needed and I don't intend to re-invent the wheel. Using parts of docs.rs in Kellnr would be super cool and keep the docs ecosystem from fragmentation.
If you are interested, a docs.rs + kellnr joint venture would be awesome :)

when I build the doc.rs hosting in Kellnr I wanted the most simple solution that works out of the box. For the future, a more sophisticated approach is needed and I don't intend to re-invent the wheel. Using parts of docs.rs in Kellnr would be super cool and keep the docs ecosystem from fragmentation.

This sounds like a good plan. But keep in mind: there are security implications of the current implementation. As a company, I would want to know this before using kellnr.

If you are interested, a docs.rs + kellnr joint venture would be awesome :)

As many projects we have limited capacity, so our topics are different ones right now. But as described, I'm happy to discuss any design / ideas, and review PRs 😃 .

There is already a big disclaimer in the docs that building docs is basically arbitrary code execution like on any build server.
I would go with multiple steps to incorporate parts from docs.rs.

Replace the raw "rustdoc" call from Kellnr with a library from docs.rs which handles different features and configs for docs.rs
Allow Kellnr to switch from a local Rust install to the usage of Docker or something more secure
Allow custom build steps (not sure if that is needed), e.g. install native libraries or something else that is not handled by a simple "rustdoc" call

What do you think about that? The first step should be straight forward, if you can provide a library which takes the docs.rs specific config from the Cargo.toml and builds the docs.

There is already a big disclaimer in the docs that building docs is basically arbitrary code execution like on any build server.

I missed that one, sorry about that.

I would go with multiple steps to incorporate parts from docs.rs.
1. Replace the raw "rustdoc" call from Kellnr with a library from docs.rs which handles different features and configs for docs.rs

2. Allow Kellnr to switch from a local Rust install to the usage of Docker or something more secure

sounds good

3. Allow custom build steps (not sure if that is needed), e.g. install native libraries or something else that is not handled by a simple "rustdoc" call

The docs.rs strategy for this will be https://github.com/rust-lang/docs.rs/issues/315 (the crate can provide a custom docker image to build with).

What do you think about that? The first step should be straight forward, if you can provide a library which takes the docs.rs specific config from the Cargo.toml and builds the docs.

I'm happy to review any PR to docs.rs that does this, or answer any questions.

I wonder if it would be possible to maybe default to 'all-features' (or add a flag for it) in the short term, since the larger rustdoc rewrite sounds lika a larger thing.

Enabled in latest release.


Fix null pointer error that happens sometimes when reporting errors

Fixes #40522
The fix addresses a simple logical inconsistency where a safety check happened after it was necessary.  If an undefined node is passed for error reporting, a null pointer error happens.

This fix doesn't seem like it's currently going in the right direction, nor does it have a test case associated. Not sure how comfortable I would feel merging this.
If you're interested in fixing this, then please follow the contribution guidelines. Otherwise, these are good guidelines for isolating the problem. As a start, from what I can see, this is happening from syntax checks in a JavaScript file (i.e. .js or .jsx) to ensure that TypeScript-specific syntax isn't being used somewhere. This is indicated by the call getJSSyntacticDiagnosticsForFile.
Like I mentioned in the review, something is going wrong because some caller is lying about its types. There is exactly one call to createDiagnosticForNode that has a type assertion on the node passed in:
                        case SyntaxKind.AsExpression:
                            diagnostics.push(createDiagnosticForNode((node as AsExpression).type, Diagnostics.Type_assertion_expressions_can_only_be_used_in_TypeScript_files));
                            return "skip";

https://github.com/microsoft/TypeScript/blob/57c8938d9e90dd4ece5389d4c78593db1ea22e81/src/compiler/program.ts#L1911-L1912


Authorization: No details on what a condition is or what it can be set to

There is no description of what a condition is and what it's potential values are. Please update the docs and/or add a link to the documentation for role assignment conditions.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2eb250c7-6d78-2a09-3aee-3433cc0e69de
Version Independent ID: 3c077586-9509-8530-1701-15ccd53ad609
Content: RoleAssignment.Condition Property (Microsoft.Azure.Management.Authorization.Models) - Azure for .NET Developers
Content Source: xml/Microsoft.Azure.Management.Authorization.Models/RoleAssignment.xml
Service: azure-resource-manager
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

Thank you for your feedback.  Tagging and routing to the team member best able to assist.

@jsquire service documentation issue

@etaham Apologies for the late reply. We are looking into this issue. The above PR has been filed. It is under Review now. In the meantime, if you have any questions, please feel free to ask.


Pdf file preview

When adding a pdf file to a new note, by dragging and dropping the file on the note, the image inside the pdf file can be seen in the preview box from the note list, but not in the note itself.
It only appears a link that opens the pdf file in the web browser version of evernote.
If the image can be seen in the small note preview, why cannot it be displayed in the note itself? This is the default behaviour with image files (jpeg, png, etc), but not with pdfs.
I use tusk as an image repository to classify different topics, but working with pdf files is not easy with this behaviour.

This is a default behavior engineered by Evernote itself and not by Tusk. If you would like it updated, you should probably address your thoughts at one of their [forums] (https://discussion.evernote.com). Thank you for dropping by and mentioning it : )


Don't append port for unix socket

By appending default port 11211 to unix socket connection we can't connect to memcached server.

Can any of the multiple PRs for this issue finally be merged?  Why would anyone with a sane mind connect to memcached over tcp and not socket?