Simplify multiprocessing logic in DDPSpawn plugins

Proposed refactoring or deprecation
When working on #9987 and the corresponding refactors around the spawn plugins, I realized that the logic around the multiprocessing queue and how results are handled and returned to the trainer is quite outdated and overly complicated. This logic has outlived many changes, but we never saw a way to make it simpler. With this issue I propose several steps towards a clean and easy to follow, easy to debug code path for

spawning processes
moving results from the subprocess back to the main process
returning the result back to the trainer

Motivation
There are several components in the DDPSpawn plugin around spawning processes and handling of results that are obscure and not well documented.
On top of that, result handling bleeds into the TrainingType base class
https://github.com/PyTorchLightning/pytorch-lightning/blob/aa1540410ff55854e050ff117c2d66f22741d182/pytorch_lightning/plugins/training_type/training_type_plugin.py#L38
and also into the trainer:
https://github.com/PyTorchLightning/pytorch-lightning/blob/aa1540410ff55854e050ff117c2d66f22741d182/pytorch_lightning/trainer/trainer.py#L1123-L1125
This is quite confusing to anyone not familiar with the peculiarities of ddp spawn. But it does not have to be that way. The situation can be drastically improved!
Pitch
Step 1
Remove the self.mp_queue attribute from the plugin. It is not required and can be locally created and used within the recently introduced DDPSpawnPlugin.spawn method #10018
Step 2
Instead of adding items like last_path, best_path, or results to the queue one by one, add all data at once as one result tuple to the queue.
This logic
https://github.com/PyTorchLightning/pytorch-lightning/blob/aa1540410ff55854e050ff117c2d66f22741d182/pytorch_lightning/plugins/training_type/ddp_spawn.py#L224-L238
becomes

# inside the spawned processes
def new_process(self, ...):
    # ...
    return best_path, last_path, results

# in spawn wrapper:
def _wrapped_function(...):
    result = function(*args, **kwargs)
    if self.is_global_zero:
        queue.put(move_data_to_device(result, "cpu"))  # the tuple of data

# in main process:
def spawn(self, ...):
    queue = SimpleQueue()
    mp.spawn(self._wrapped_function, args=(function, args, kwargs, mp_queue), nprocs=self.num_processes)
    return mp_queue.get()  # the tuple of data

This allows us to standardize and limit the queue to a single put() and correspondingly a single get. This is less error prone and easier to understand for everyone working with custom plugins. The only really complicated part where a learning curve is steep for the reader is this code snippet above. Everything else will extremely simplify.
Step 3
With 1) and 2) in place, we can directly return the results from the spawned function instead of caching it in the attribute self._results.
Step 4
Finally, we can get rid of dispatch and post dispatch
https://github.com/PyTorchLightning/pytorch-lightning/blob/aa1540410ff55854e050ff117c2d66f22741d182/pytorch_lightning/trainer/trainer.py#L1102-L1107
and combine it into a single plugin.run call or alike:
self.training_type_plugin.run(self.train)  # or whatever other trainer method

This then cleanly generalizes across all plugins. The confusing concept of dispatch and post dispatch is gone.
Nexts steps
A quick and dirty draft is available here in form of a PR: #10034
Additional context
The add_to_queue and get_from_queue methods were recently introduced, initially on the LightningModule and now they are in a deprecation phase. We would need to incorporate them into this design as well. Suggestions welcome.

If you enjoy Lightning, check out our other projects! ⚡

Metrics: Machine learning metrics for distributed, scalable PyTorch applications.

Flash: The fastest way to get a Lightning baseline! A collection of tasks for fast prototyping, baselining, finetuning and solving problems with deep learning

Bolts: Pretrained SOTA Deep Learning models, callbacks and more for research and production with PyTorch Lightning and PyTorch

Lightning Transformers: Flexible interface for high performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.

This looks awesome. Since you worked on the initial plugin/accel revamp, do you know what motivated the structure we have in master today? Why wasn't this proposed structure done that way back then?

When we did the initial revamp a year ago, we didn't question the structure of how processes get called and how results are handled. We also didn't fully understand this part. The origins go all the way back to the beginning of Lightning when Trainer shared the most responsibility that the accelerator has today.


Clumping refactor

This PR explored the possibilities to resolve LD based clumping using a graph based approach relying on the GraphFrames library. It didn't work out. So a more rudimentary solution was implemented: all variants that are explained by other, more significant associations in high LD got the same general message, without any details, which variant is that.
BTW the graph approach worked, but it was not scaling well: the applied pregel algorithm was not converging, and took way more time than it was sensible (on 96 core machine it took 1h). For future reference, the 31cab8de2d0aa206211e578aa0fb701dd5e064b2 commit has the code. Also it has code to install custom jar on the dataproc cluster and install custom python packages which are not available through pip (this problem also raises issues against using GraphFrames in production).
For the record the result of the graph based clumping is here: "gs://ot-team/dsuveges/deconvoluted" (PICS not resolved though)
!! Warning: the code seems alright, but I haven't tried a start to end run.

Codecov Report

Merging #64 (0ddd969) into main (a7210a7) will increase coverage by 2.75%.
The diff coverage is 55.97%.

@@            Coverage Diff             @@
##             main      #64      +/-   ##
==========================================
+ Coverage   53.89%   56.65%   +2.75%
==========================================
  Files          35       41       +6
  Lines         590      759     +169
==========================================
+ Hits          318      430     +112
- Misses        272      329      +57

Impacted Files
Coverage Δ

src/etl/coloc/utils.py
75.00% <ø> (+15.00%)
:arrow_up:

src/etl/common/utils.py
71.42% <ø> (+4.76%)
:arrow_up:

src/etl/v2g/intervals/Liftover.py
35.71% <ø> (-0.96%)
:arrow_down:

src/run_gwas_ingest.py
44.00% <25.00%> (-16.00%)
:arrow_down:

src/run_coloc.py
52.38% <33.33%> (ø)

src/etl/gwas_ingest/study_ingestion.py
40.90% <36.84%> (+3.40%)
:arrow_up:

src/etl/gwas_ingest/ld.py
39.68% <39.68%> (ø)

src/etl/coloc/coloc.py
57.14% <46.15%> (-2.12%)
:arrow_down:

src/etl/gwas_ingest/pics.py
50.90% <50.90%> (ø)

src/etl/gwas_ingest/process_associations.py
52.94% <54.54%> (-5.40%)
:arrow_down:

... and 33 more


v0.34.1 reproducible StorageClass bug: false positive error, misleading error message, and a suggestion

Edit: Migrated to https://github.com/kubernetes-sigs/karpenter/issues/1069,
removing initial message to make the source of truth clear.

This is an awesome write-up, you're right that this has been a bit of a whack-a-mole problem driven by the complexity of storage in kubernetes. Would you mind reopening this in the upstream repo? This is part of Karpenter's scheduling loop and I want to make sure this is visible to the other cloud providers as well, since it doesn't just affect AWS.

Closing after migration, to avoid duplicate.


End to end test: Added before suite setup test

This test installs and deploy the LVM operator, if not already installed and starts the LVM cluster.

Kindly mention what fix for the controller is the second commit referring to?

API was changed, due to which Handler was not defined in the struct literal, so to cope with that i modify the name of variable.

Kindly mention what fix for the controller is the second commit referring to?

API was changed, due to which Handler was not defined in the struct literal, so to cope with that i modify the name of variable.

Thanks, feel free to update the same in the commit description.

Kindly mention what fix for the controller is the second commit referring to?

API was changed, due to which Handler was not defined in the struct literal, so to cope with that i modify the name of variable.

Thanks, feel free to update the same in the commit description.

Updated

it seems third commit should overwrite first commit
we better not deploy lvmclusterCR as part of this PR since we are not checking the presence of topolvm & vgmanager components
overall looks good!

So, should I delete the function for starting LVM Cluster?
Thanks!

@nbalacha quick quesiton,

should this PR contain the code for deploying lvmcluster CR itself?
I believe it should be part of separate PR with validations around it

So, should I delete the function for starting LVM Cluster? Thanks!

pls keept it as is, thanks.

Please add a make target to build and run these tests.

Added "make E2E"

/lgtm
/approve


Mocking framework

Hi,
hope find you well with this cold call.
I am an author of mocking framework for Kotlin
I see you are using mockito-kotlin.
I just want you to be aware that there is solution that fully supports Kotlin and ask to try it in your new/current projects.
I can help you if you answer to this issue.
Thanks and please star it

I will check it out and see. Thanks for the heads up.


Cannot connect to IRC (Failed to setup bind host). Retrying...

When i have established a connection with ZNC in IRSSI and i try to connect then i have this error.
Is it a computer problem?

No, it's your misconfiguration. Why do you need bindhost? /znc clearbindhost will help you.
Also, when opening bugs, please provide more details, at least what bindhost you used and ZNC version.

DarthGandalf wrote:

No, it's your misconfiguration.

incorrect configuration in the computer, znc or irssi? i use irssi in Ubuntu 18.04 and have this error:
15:25 -!- Irssi: Starting query in undernet-znc with *status
15:25 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...
15:26 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...
15:26 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...
15:27 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...
I still tried to install the script hostname.pl, but it didn't help me, when i type, then i see the following::
15:32 -!- - Welcome to ZNC -
15:32 -!- Irssi: Resolving IP addresses...
15:32 -!- 1 <IP_ADDRESS>          user-desktop
but i do not see in this list the host that i bind in the config of znc "<IP_ADDRESS>".
maybe need through iptables to turn traffic to the desired port 113? Using the command:
sudo iptables -t nat -A PREROUTING -p tcp -d <IP_ADDRESS> --dport 113 -j DNAT --to <IP_ADDRESS>:11300
I also edited the file /etc/hosts:
<IP_ADDRESS>       localhost
<IP_ADDRESS>       user-desktop
<IP_ADDRESS> <IP_ADDRESS>
am i doing it right?
i checked my znc version:
znc -version
ZNC 1.6.6+deb1ubuntu0.2 - http://znc.in
IPv6: yes, SSL: yes, DNS: threads, charset: yes
I tried everything i could, but I can't bind the host <IP_ADDRESS> to hide my real ip address/host.
I want to bind the IP address of another country ~<IP_ADDRESS>, but I can't do it, am i doing it right? Where is this error in Ubuntu, znc or irssi?

Why do you need bindhost? /znc clearbindhost will help you.

Did you try the above command that @DarthGandalf suggested? Does it make the error go away?
Your bindhost must be one of the IP addresses of the computer that ZNC is running on. This option only exists to choose which IP to use in case the computer has multiple ones. It cannot hide your IP address.

incorrect configuration in the computer, znc or irssi?

ZNC

I can't bind the host <IP_ADDRESS> to hide my real ip address/host.

Correct. You cannot do that, and that's not what bind means. https://wiki.znc.in/FAQ#What_are_BINDHOSTS_and_why_can.27t_I_make_mine_work.3F

i used the command you suggested and this outputs:
/znc clearbindhost
17:30 <user> clearbindhost
17:30 <*status> Bind host cleared for this network.
17:30 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...
after that i execute:
/connect undernet
/join #demochannel
but this still does not establish a spoofed ip address "<IP_ADDRESS>".
from ZNC FAQ:

then it is likely you have set an IP address or host name that is not available on your computer.

but how to make this fake IP address "<IP_ADDRESS>" available on my computer? Can somehow make changes to resolv.conf? But how can i edit it?
I also do:
/host show
<EMAIL_ADDRESS>And i see this address assigned to me, but how to bind it? Should i use iptables?
and also these 2 commands do nothing:
% host demo.znc.in
% host <IP_ADDRESS>

17:30 <*status> Cannot connect to IRC (Failed to setup bind host). Retrying...

Then use also /znc clearuserbindhost. The other command clears only the network host, not user host.

but how to make this fake IP address "<IP_ADDRESS>" available on my computer?

It's fake. Why do you think it will be available? Even if you add it to your computer, how will other hosts (e.g. IRC server) know where to send packets addressed to <IP_ADDRESS>?

That is, in fact, it turns out that znc is not able to forge IP address/host. But only VPN will do it! And this issue can be considered solved with the help of any VPN?

That is, in fact, it turns out that znc is not able to forge IP address/host.

Yay, you finally have read my response and parts of FAQ I linked

But only VPN will do it!

Now it's time to read the FAQ again: https://wiki.znc.in/FAQ#But_I_want_to_hide_my_IP.21_How_to_do_that.3F

And what kind of host:
/host show
<EMAIL_ADDRESS>When i change for example "<IP_ADDRESS>" and accordingly i change /host show (show=+~sad@v133-130-111-150.a03a.g.tyo1.static.cnode.io). If i expose bindhost for example "<IP_ADDRESS>-<IP_ADDRESS>" then I change /host show accordingly then i have (not<EMAIL_ADDRESS>and already another).
Change bindhost somehow affects on /host show???
when i add network to irssi with <IP_ADDRESS>, i.e:
/server add -auto <IP_ADDRESS> 1027 usernane:password
then me need to somehow set the settings firewall/iptables so that the connection is tied on <IP_ADDRESS> instead <IP_ADDRESS>, i.e:
It will look something like, type..:
/server add -auto <IP_ADDRESS> 113 (or 11300) usernane:password
Along with using the command: sudo iptables -t nat -A PREROUTING -p tcp -d <IP_ADDRESS> --dport 113 -j DNAT --to <IP_ADDRESS>:11300
to clearly identify the incoming traffic on any interface  and indicate it in /etc/hosts.
That is, i am somehow manipulating to change /host show?

Check documentation of your client what exactly /host show is doing.


Lineage pruning REFACTOR

need to lint

Figure 2 looks weird in terms of dimensions.

This one, too.

Sorry, I know we discussed not having gargantuan pull requests but this sort of change necessitated it I think. This removes the deepcopy in lineage pruning saving both space and time in lineage creation. Furthemore, **kwargs are now used in both cell and lineage instantiation, to avoid extremely verbose calls to create them. Now, cells don't always have by default a left and right daughter linkage to Nonetype objects. I also removed the uneccesary underscores in function names and made sure that the variable num_states is called num_states across the code (instead of sometimes numStates). Cells can also now be leaves in one of two ways: being terminal (i.e., being the cells at the very end of the tree (I call these terminal leaves) and being cells whose daughters are both censored. Note that pruned is no longer used anywhere in the code, censored made more sense to me. Lineages now utilize a censor condition which can be 0,1,2, or 3. This made more sense than using string arguments, and I think makes it easier if someone wanted to add more or different ones. By default, the censor condition is 0.

I can focus on the figures in a later branch

sv-pruneSpeed
figure1 is done after 4.444711685180664 seconds.
figure2 is done after<PHONE_NUMBER>980774 seconds.
figure3 is done after<PHONE_NUMBER>9551697 seconds.
figure4 is done after<PHONE_NUMBER>430786 seconds.
figure5 is done after 60.49672508239746 seconds.
figure6 is done after<PHONE_NUMBER>8105164 seconds.
figure7 is done after 85.04389572143555 seconds.
master
figure1 is done after 2.576735734939575 seconds.
figure2 is done after 39.26531362533569 seconds.
figure3 is done after 86.82021522521973 seconds.
figure4 is done after<PHONE_NUMBER>0117798 seconds.
figure5 is done after 80.15113925933838 seconds.
figure6 is done after 90.22808051109314 seconds.
figure7 is done after 45.43596792221069 seconds.
Not sure if this is any faster or not, I'll try comparing the profiles between my branch and master

@aarmey The new profile results are in #227, feel free to go into the code to change anything you think should be faster. I wanna say that the code is more readable now, and possibly easier for you to make changes to.

In figure 5, I zoomed in on the region we were talking about yesterday. Figure 4 looks the same as master for me:
master:

current branch:


feat(ci): Initial test pipeline for CI migration

Summary

Migrate from CircleCI to Github Actions
Ticket Link

https://mattermost.atlassian.net/browse/CLD-4812
Release Note

Migrated from CircleCI to Github Actions

cc @wget in case any of this affects the work you're doing :)

@devinbinnie Great, thanks a lot :) I was just reading how to do this with GitHub Actions.
I propose we merge @toninis's work and I merge my changes upon :)

Looking good so far! One question: are we able to download the builds from the CI build itself like we could on CircleCI?
The scheduling of the nightly build looks good to me. Let me know what help I can provide for the channel notifications, I thought we just needed to hit a webhook on community.

@devinbinnie Let's sync together on this . There is a difference on how Github handles artifacts vs CirlceCI so I would like your input

@devinbinnie Everything is set up from my side . There are some tests that are failing .
Can you take a look there ? For some reason bg.json file is removed and i18n.ts is not updated .
Thanks 😄

/update-branch

Building app in separate branch.

Building app in separate branch.

@devinbinnie Please merge when you are ready and tested everything needed

@devinbinnie Please merge when you are ready and tested everything needed

@toninis Should we not wait for other reviews first?

@devinbinnie Please merge when you are ready and tested everything needed

@toninis Should we not wait for other reviews first?

Yep. My team will also review of course .


Plugin installation refactor

Fixes #609 for proxy.
Please refer to the mentioned issue for a complete description of the refactoring.

Fixes coming soon!

Current coverage is 99.56% (diff: 100%)

Merging #52 into develop will decrease coverage by 0.02%

@@            develop        #52   diff @@
==========================================
  Files            15         14     -1
  Lines           490        463    -27
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits            488        461    -27
  Misses            2          2
  Partials          0          0

Powered by Codecov. Last update 93939ce...b6c4a1b


Added ms-python environment integration

Summary
This PR reworks how Python is called in extension.js so that Python is called from the active Python environment in CS code.
Background
In it's existing form, Python is directly immediately after imports based on architecture, and then in extensions code is generated based on architecture type in compiler.py. This means Python is called based on the system environment, rather than the active environment in VS Code.
What is Changed
This PR grabs the path to the current Python environment from the official Python extension, ms-python. It then replaces the current way that Python is being called with the Python binary associated with the active environment.
Potential Pitfalls
This may be a bad approach for situations where someone designs a fairly code agnostic extension, such as a color theme. For example, if someone installs a color theme designed in vscode-ext but they code in a language other than Python, it's unclear if the active Python environment exists or is even a good option. There may also be an issue if someone doesn't have the official Python extension installed. These should be fixable with a few lines of code, but I think feedback/discussion on this might be useful before additional work is performed.
Notes
I only deleted 6 lines of code and added 3 lines of code at the top of data.py, but git decided to rewrite the whole file ¯_(ツ)_/¯
I was going to try and merge with your rewrite branch, but that looks like it's still pretty premature.
Related to #25

There are some problems with this, we can't guarantee every user using an extension made with vscode-ext has ms-python installed. Also theme support is being removed in the rewrite so we won't have to worry about that. And yes I should mention that all prs should be directed to the rewrite branch.

Ok, I can do some additional work to add proper checks that fallback the original code.
Separate from this, I'll open up a separate PR for the rewrite branch. I was having some issues switching over to that, because it looks like it's missing a lot of functionality. Even the install was problematic because setup.py was referencing missing files. I'm happy to help contribute to this in any way. If you open up a GitHub issue with a well defined task and assign it to me, I'll take a stab at it.
If you want me to approach the current PR differently somehow, let me know and I'll make the necessary changes.

Closing this since the refactor negates this and requires some additional things to be added before this can be implemented.


support querying and setting with partial paths as key identifiers

In addition to functionality for setting keys with absolute identifiers, this pull-request also supports partial paths for keys.
E.g.
$ ovos-config get -k city/name
will now match /location/city/name.
In contrast to that, absolute paths as keys only match the full path. E.g.
$ ovos-config get -k /city/name
would not find /location/city/name, but only the key /city/name if that existed.
For backwards compatibility, each folder name is also matched by substrings. E.g.
$ ovos-config get -k cit/na
would locate /location/city/name. This also allows for completely leaving out levels:
$ ovos-config get -k loc//lat
matches /location/coordinate/latitude
Also setting is supported:
$ ovos-config set -k timezone/name -v Europe/Berlin
Fixes #180

Summary by CodeRabbit
Summary by CodeRabbit

New Features

Introduced a refined search mechanism for enhanced dictionary traversal based on specified keys.
Added functionality to improve path matching for configuration management.

Improvements

Simplified get and set commands for a more intuitive user experience in retrieving and setting configuration values.
Streamlined error handling and output messages for consistency with the new logic.

thanks for the PR! all examples in the initial description and issue are working as intended with this PR


Ambiguous use of service principal ID

"When using a service principal instead of a registered application, add the -ServicePrincipal argument and provide the service principal's ID as the -ApplicationId parameter's value."
Seems a service principal has both an id and an application id. I'd suggest to explicitely write 'and provide the application ID of the service principal'

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4b9d23ff-b2cc-f974-7f4b-2b217efbe53c
Version Independent ID: b814f076-657c-206b-b16e-c7f137bff744
Content: Sign in with Azure PowerShell
Content Source: docs-conceptual/azps-3.5.0/authenticate-azureps.md
GitHub Login: @sptramer
Microsoft Alias: sttramer

@velden Thank you for sharing your feedback, our team will have a further look into this and get back to you at the earliest.

@velden Just to clarify on what you think is confusing, is the Object ID that you are concerned about mixing up when authenticating?

@SamaraSoucy-MSFT Thank you for your quick response.
Yes, when creating the new Service principal with Powershell, or when getting the service principal object, the returned object has both an 'id' property as well as an 'application id' property.
I was indeed confused by the fact that the 'application id' was needed while documentation mentions ' id'. That said, the parameter for the 'Connect-AzAccount' cmdlet is named 'ApplicationId' so it shouldn't take to long to find this out.

Thanks for confirming. I've put in a PR to update the verbiage. If it helps at all for you in the future, you will almost always be using the Application Id to refer to a Service Principal.


Autodiscovery job, not all ECS Fargate clusters discovered

Hi,
Using version 0.24.0-alpha. I have 2 Fargate clusters and when I use the configuration below, i get metrics only for one of the ECS fargate clusters.  am I missing something? Here is how the metric name space looks like in CW. For the awsDimensions property, I tried using just "ClusterName" but that did not work either.
Any help would be appreciated!

---
discovery:
  jobs:
  - type: ecs-containerinsights
    regions:
      - us-east-1
    roleArns:
      - "#####"
    enableMetricData: true
    awsDimensions:
      - ClusterName
      - ServiceName
    metrics:
      - name: CpuReserved
        statistics:
        - Average
        period: 60
        length: 300
        nilToZero: true
      - name: CpuUtilized
        statistics:
        - Average
        period: 60
        length: 300
        nilToZero: true

@pluvio-phile do the other cluster has tags?
see #294, if not add some tags and the exporter will discover them

Closing this. If it is not a tags problem. Feel free to reopen. Thank you.


Set ProxyConfig.ProxyMetadata as envs of pilot-agent.

And on master we shouldn't need this, we can just read the metadata directly where-ever we need it?

ok, let me do more research on how to properly set it in 1.5.


UX: Remove focus from answer button

After clicking on an answer button, the focus stays on that button. The focus should be cleared after a question is answered.

I found that doing something like this in CSS works:
.answers button:focus{
background:white;
outline:0;
}
Is it okay to just override the bootstrap styling like that?

I'm closing this issue because @strangelyblue fixed this issue in PR #14


17.01.5 - network.dsl.ds_snr_offset

LEDE 17.01.5 includes these two commits:
https://git.openwrt.org/?p=openwrt/openwrt.git;a=commitdiff;h=dea8979a81d72eac79321f1f3bf72fb5244275b6
https://git.openwrt.org/?p=openwrt/openwrt.git;a=commitdiff;h=541a1a7ff5ce9ef7a5660e483635ecd0892137dc
Would it be possible to update LuCI so it can manage the 'Downstream SNR offset' in 17.01.5 ?
(This can be managed with LuCI in snapshots and 18.06.0-xx)

Backported with 87a74eedc, 46b9d83d9, 6d349c5f7 and 7bf036750


Any plan to use CMake instead of GYP ?

Android Studio 2.2 was released which mentioned " For new projects, Android Studio uses CMake by default", ref link: https://developer.android.com/studio/projects/add-native-code.html.
I think it might be better idea to use CMake since GYP stopped to support android but CMake is official choice by Google.

Djinni is build-system agnostic, and the support library has build files provided for both.  The example app uses gyp, and I wouldn't be averse to switching it over to CMake if someone wanted to do the work.  We still use gyp internally at Dropbox, though.

I configured a new djinni project by using Android Studio 3.0 Canary and CMake, so it's totally possible

I wrote a djinni sample using Android Studio 3.0 and CMake here.

 (-;


TTS repeated twice in most dialogues

I am using testing version <IP_ADDRESS> and many of the dialogues are read twice. I am using Amazon Polly Neural Engine and its only free for 1 million characters, not sure if repeated speech is counted or not.

I'm also getting this with windows speech engine.  I think I've noticed a pattern, but not positive.  I've had this happen at least a couple times when a single line of dialog carries over to a second chat "page".  I'm not positive that this is 100% the cause, so I'll keep trying to find a commonality.

Linking https://discord.com/channels/581875019861328007/684745859497590843/874124148266381322 for reference, this seems to be the issue

Possible fix coming in this testing release https://github.com/goatcorp/DalamudPlugins/pull/1000

Merged into testing, let me know if it works 👍

Thank you it works.. no more duplicate speech.


Add static utility AI helper class

The orginal addon has a static UtilityAI helper class.
A C# port of it should be added here too.

For now it contains only a ChooseHighest method - new issues will be created for further methods.


Feature/fixes for avalonia

Zoom on mouse pointer (the bug was in the navigator, this also fixes it for uwp).
Get slider to work (with a workaround).
Move info display to the left (not pretty but the map does not move up, I think it is better).
Add tests to samples (they are added and interestingly a transparent background is really transparent in Avalonia, I see visual studio as background).
Remove UWP from namespace (a suggested change).
Fix 'collection was modified' error which occurred during animations. This was a bug that would have affect in other places as well.
Some typos in comments
Resharper warnings and suggestions I ran into

So far I have been working with resharper at work and for private projects but I think editorconfig is the future so lets go for that.


Hardware Status Warnings

We had an ESXi host throw a memory alert due to a bad stick. We replaced the bad hardware, cleared all the warnings in the vSphere Web Client but every day the vCheck report still shows that host with a Memory sensor and Status Yellow. Where is the report pulling this from because from what vSphere says, the host is fine but the report keeps showing the warning.

VMware KB 1037330 may be relevant to this issue.
vSphere ESX/ESXi hardware status sensors return different cached values in API than in vSphere Client (1037330)


glBegin / glEnd changes cause problem

problem with glBegin

ack

Problem introduced by me in b9debce018b3e11481f03c0184af2100edf72b67.
I can restore the previous behavior, but in any way mixing spritebatch with setPixel will crash
g.spriteBatch.draw
g.setPixel
g.spriteBatch.draw <- crash (as before b9debce018b3e11481f03c0184af2100edf72b67).
It will crash because setpixel will change the rendering mode to  t_rendering_mode.SHAPE_POINT.

FPS and logo are no longer rendered correctly because of this change (try any DemoShaderXXX). Sorry

Ooops I missed that :smile:


Github: when ticket with QA/None or dev-automation tickets are closed, move to new column in Zube (QA Verify?)

To help with keeping QA's To Test column clean, if we work on tickets to help QA, when we close tickets with these labels, we can automatically move them to a new Zube column for automation testers to verify them and then move to Done:

QA/None
QA/dev-automation

Need to hash out with @nwmac how the Zube workflow looks first, then we can match Github Actions accordingly.

This has been done


Conditionally switch between using the backport vs the future import

Hey,
I recently ran into this issue where I was trying to use this backport in my python package which currently supports python versions 3.6+.
For versions 3.7+, I'll be using the from __future__ import annotations and for 3.6, I'll need to add the encoding line.
A problem occurs when I try to conditionally add either.
import sys
if sys.version_info >= (3, 7):
    from __future__ import annotations
else:
    import future_annotations
    future_annotations.register()

The problem with the above code is that all __future__ imports are supposed to be at the top of the file (so does the encoding line).
Is there a clean way to conditionally switch between using the backport vs the __future__ import ?

you cannot have code before a true __future__ import and the way this library works is with an encoding cookie which also cannot appear anywhere after the second line (the first line being a shebang)
so the answer is no

Hey @asottile ,
If it's not possible to switch conditionally, the only soln I can think of is to use this backport across all python versions or drop support for python3.6 and completely switch to using the __future__ based import.
The above soln doesn't seem very convincing. Is there a better workaround ?

if there was why do you think it wouldn't be documented?


[Improvement] -Add key info to Concierge to improve the New Expensify customer support experience

Proposal
Include thread and task details when a customer reaches out to Concierge from a threaded message
Problem
As discussed here and here, customers can now reach out to Concierge in task threads; however, Concierge does not have visibility of the tasks the user is writing in from. This means that Concierge lacks the context needed to support the customer; this is resulting in an awkard customer experience because Concierge needs to get clarification on details that the customer would expect us to be able to see.
Solution
When a customer reaches out to Concierge within a thread, make sure the responding agent has visibility of the information they need to assist that customer. This includes:

Showing details of the parent thread and header the customer is reaching out from
Show reactions to messages (e.g. if a customer adds a 👍 to a message, ensure this is shown in Concierge)

Design doc (Detailed portion currently in review)

Proposal taken to WN - plenty of support for this and no pushback - https://expensify.slack.com/archives/CC7NECV4L/p1725492990710679

Ok this is actually going to go through a pre-design. Will start drafting this today

Update Sept 11:
Pre-design is being drafted with this and will be posted in Concierge Development later in the week

Pre-design posted - https://expensify.slack.com/archives/C041MSTR8J1/p1726176871367989

Pre-design has been wrapped up and I will start work finding an engineer to help implement

Is this ready for the label?

As discussed in the Pre-Design, this is what needs to be included in Concierge:
1. Onboarding tasks checklist when the customer replies to Concierge
This refers to the onboarding checklist that the customer sees in the New Expensify chat with Concierge:

This is not currently shown in Concierge:

The list should show the tasks a customer has completed, either through a check or a strikethrough - whichever solution is most simple to implement
2. The parent thread and header when the customer summons Concierge from within an onboarding task thread

When a customer starts a new thread, in Concierge we need to show the details of the message the customer is responding to

For example, this is the parent thread https://www.expensify.com/concierge/#/chat/20623863 with Concierge
I've responded to the Meet your setup specialist task, starting a new thread and a new concierge chat

The new chat that was started in NewDot looks like this:

should look something like this:

3. Reference the main thread chat within the sub thread chat when a customer starts a new chat by replying in thread

When a customer starts a new thread, which will automatically create a new Concierge chat, the parent thread should show a link to the chat created from the  new thread
Likewise, the chat created from the new thread should show a link to the parent thread
This would look similar to what we use today when new people are cc'd into a response (see screenshot)

For example, https://www.expensify.com/concierge/#/chat/20623863 is the main Concierge chat thread for<EMAIL_ADDRESS>This user replied in thread and a new chat was created https://www.expensify.com/concierge/#/chat/20623951
The new/sub chat thread (https://www.expensify.com/concierge/#/chat/20623951) should reference the original/main chat thread (https://www.expensify.com/concierge/#/chat/20623863) and vice-versa
4. Show reactions to Concierge messages
At the moment, if a customer reacts to a Concierge message with an emoji, Concierge does not see this or get notified.

Emoji reactions should be sent to Concierge as a new message, along with the context of the message the customer is reacting to (because to may not be the most recent)
If the chat is closed, the emoji reaction should trigger the chat to be reopened

Chatted to @marcaaron - he's about to go OOO so isn't going to be able to get to this for several weeks. Adding the auto-assigner again

@VictoriaExpensify I've already promised @alexpensify that I would work with him on the technical portion of Vacation Delegates 😬

Well darn!
Ok I'm going to throw a Design Doc together for this anyway. Once that's done and reviewed, maybe Marc will nearly be back from leave or you will nearly be done with the Vacation Delegates project.
If not, I'll spin the wheel again - third time lucky, right? 😅

Ooh might have better luck asking around vs. auto assigning for a Design Doc! I'm just thinking the odds could be high that your auto-assignee is already be working on something big, but it's worth a shot.

Agreed… Asking around is going to be your best bet.

Thanks team! I'm chatting with Chirag about this at the moment 🤞

Not OD, Chirag and I are working on this - https://docs.google.com/document/d/19xghDYgBkMgQUBKkNqO2WeayMgKrsut2yinVxi3y3rg/edit

Working on this. We just posted a predesign discussion here.

Design doc is ready for high level review here - https://docs.google.com/document/d/1pr7rcJKbgwYvQIuUtpobZqxkCeNMi6Gnt_bSnBhEzUs/edit?usp=gmail#heading=h.mnjguil21u0a

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

Timeline and urgency

The limitation in the information Concierge is already having an impact on the support experience our customers are receiving (example)
This is now a critical issue and it should be treated as a top priority

I got assigned to a detailed review, but I see the high-level part of the doc hasn't completely been reviewed yet and there doesn't appear that the detailed part of the doc has been written.

Oh this is my fault! If you were auto-assigned for a detailed review, please ignore this 😬

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

Oh looks like designDocReview was added a second time incorrectly here. @VictoriaExpensify, I'm going to delete the message,

and close out these issues.

As they are incorrect dupes, because we have the above issues and message for high level review.

Done clearing up the recent assignment so that people don't waste time since we already have assignees for the high level review.

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

Detailed portion is ready for review. Woop woop.

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

I have read and reviewed this Design Doc!

@aldo-expensify and @zsgreenwald we're just waiting on your reviews when you have a moment. Thanks!

I have read and reviewed this Design Doc!

Reviews are complete, working on it

In progress, not OD

As above ^^

I have read and reviewed this Design Doc!

Not Overdue, @chiragsalian is making solid progress:
Complete:

[ ] [PHP] Create method syncReportResponsesToChatBot in ChatBot Utils #440661
[ ] [Auth] Add a new auth command - GetReportParentID #440664
[ ] [PHP] Update createChatbotInputFromReportComment to post parent/child notes #440676

From a responder perspective, we are starting to see these improvements which is helping to improve our interactions:

In progress:

[ ] [Auth] Update OpenReport auth to share Concierge threads with Concierge #440663
[ ] [Auth] Updating addEmojiReaction to identify user reactions to Concierge responses #440677
[ ] [PHP] Update addEmojiReaction to post a note for user reaction #440678

On hold:
The following are on hold as the Try New Expensify button has recently been added to product and we need to confirm the new behaviour/routing with that button:

[ ] [Auth][HOLD] New NVP recentlyUsedApp #440679
[ ] [HOLD][PHP] Set supporting source when support in oldDot is clicked #440681
[ ] [HOLD] [PHP] Set chatInput supporting source for incoming user messages #440715
[ ] [HOLD] [PHP] Present the user with a whisper message indicating the focus of support #440722
[ ] [HOLD] [Web] Display recentlyUsedApp in user info and allow it to be modified by agents to better support their customers #440723
[ ] [HOLD] [PHP] New API endpoint ChatBot_User_SetRecentlyUsedApp #440724

I will post a detailed update to #retain tomorrow

@chiragsalian I will start playing around with the "Try New Expensify" button tomorrow and get some logs and NVP behaviour for you

Not overdue, finished all the pieces. The last one got merged today and should go live end of this week or early next week and then we can close out this issue.

Ok so let's run through the changes that have been made here:
1. Showing the Onboarding tasks checklist when the customer sends a reply to the Concierge DM (discussion) 👀
I can't test this because I have a bug which leads to onboarding tasks not being created (posted here), but I have seen this live in Concierge. I will check again tomorrow.
This change was not retroactive so I can't use an existing account to check this
2. Showing details of the threaded message the customer is replying to in the Concierge DM (discussion) - parent chat view ✅
When I started a thread from a task, a note was added to my main Concierge chat with a link to the new threaded chat:

The threaded chat also contains a link to the main Concierge chat:

Confirmed these links routed to the correct chats 👍
3. Reference the main Concierge Chat when the customer starts a new thread in New Expensify (discussion) - child chat view  ✅
When a customer responds to Concierge in thread, a new Concierge chat is created and this chat is now referenced in the main Concierge chat:

The newly created chat also references the main chat:

Confirmed these links routed to the correct chats 👍
4. Show reactions to Concierge messages (discussion1, discussion2)
I think this is the final piece you're working on, is that right @chiragsalian ?

Add a new identifier to differentiate if a user is writing about a query with oldDot or newDot (discussion)

_Solution:
Create another NVP, we’ll call this “recentlyUsedApp”.
This NVP:
Is set to “oldDot”,

When the user logs into Expensify Classic
When the user clicks on Support->Concierge in Expensify Classic_

Testing with<EMAIL_ADDRESS>which is predominantly used with Classic:

Signed into Classic
Reached out to Concierge via Support > Concierge (which redirects me to New Expensify):

This should show that the user is Classic so it isn't working as expected. @chiragsalian before I go ahead with more testing for the NVP, this change should be in place now, correct?

I need to do some more testing on the NVPs, will provide further updates soon

I am removing hot pick from any issues with an internal engineer assigned so other engineers can know it's available.

Thanks Ted

@VictoriaExpensify - is there an update on the testing?

Yeah, there are issues with the NVP for existing Classic users - it only displays NVP: NONE and this doesn't update when switching between New and Classic. Testing details here https://docs.google.com/document/d/1rFUHVSAHWCiMnQJ5x2IYjZiNDc5CSd54bIn-SSCI8EI/edit?tab=t.0
More info to come

The NVP seems to update well when the "Try New Expensify" button is used, so that's a win. But if someone signs into New Expensify directly, it is inaccurate.

We're working on a plan for updated NVPs. More info coming!

I need to post a plan for the updated NVps. Haven't gotten around to it just yet but ill post it hopefully soon.


One big chunk of code

In this Pull Request I:

Add my to-do list files to this repo
Allow my coding partner to review the repository

Thank you @chawkimbarki for the suggested changes, I really appreciate that 😊


bump to ray 2.7.1, remove setproctitle pinning, remove stale comments

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

@conda-forge-admin please rerender

Closes #105

Upstreamed here: https://github.com/ray-project/ray/pull/40289

Thanks


crit: add method to retrieve shared memory size of process

This PR aims to add a method for retrieving the size of shared memory of processes.  The function iterates over the virtual memory areas (VMAs) associated with the process, summing up the sizes of VMAs with the MAP_ANNO flag.
@rst0git PTAL, is this approach accurate ?

In Linux we have two types of shared memory: POSIX and System V shared memory.

With POSIX shared memory, you can use shm_open() to create a shared memory object and mmap() to map the object into the address space of a process.

./zdtm.py run -t zdtm/static/maps01 -f h -k always can be used to create such image files.

With System V,  a shared memory segment can be created with shmget() and attached to the address space of process using shmat().

./zdtm.py run -t zdtm/static/shm -f ns -k always can be used to create image files for testing.

We can identify shared memory in mm-*.img by the use of MAP_SHARED in VMA flags.
sudo crit show mm-46373.img
...
                {
                    "start": "0x7fb90ef70000",
                    "end": "0x7fb90ef73000",
                    "pgoff": 0,
                    "shmid": 3,
                    "prot": "PROT_READ | PROT_WRITE",
                    "flags": "MAP_SHARED",
                    "status": "VMA_AREA_REGULAR | VMA_FILE_SHARED",
                    "fd": -1,
                    "fdflags": "0x2"
                },

sudo crit show mm-56.img
...
                {
                    "start": "0x7f6132b7c000",
                    "end": "0x7f6132b7d000",
                    "pgoff": 81920,
                    "shmid": 3,
                    "prot": "PROT_READ | PROT_WRITE",
                    "flags": "MAP_SHARED",
                    "status": "VMA_AREA_REGULAR | VMA_FILE_SHARED | 0x4000",
                    "fd": -1,
                    "fdflags": "0x2"
                },


Last Result Card showing incorrect grid number

Describe the bug
Miami race result shows Max as grid number 0, his real grid number (9) is also missing in the list
To Reproduce
load the last results card
Expected behavior
expected grid postion to be 9
Screenshots

Desktop (please complete the following information):

OS: Windows 10
Browser: Chrome
Version: Version 113.0.5672.93 (Official Build) (64-bit)

Additional context
type: custom:formulaone-card
card_type: last_result
title: Last Result
f1_font: true
hide_tracklayout: true

Already reported. The API reports the wrong grid starting position. Out of my hands

ah, I'm sorry, didn't check closed issues, my bad.


Confusion with indexes

Documentation could be more clearer about the indexed labels. For example, lets say that I have one service that I want to publish to different domains with minor differences. Its not very clear should i use
- com.df.port=8080
- com.df.servicePath=/
- com.df.serviceDomain.1=example1.com
- com.df.serviceDomain.2=example2.com
or do I have to duplicate port and servicePaths with indexes as well for these cases:
- com.df.port.1=8080
- com.df.port.2=8080
- com.df.servicePath.1=/
- com.df.servicePath.2=/
- com.df.serviceDomain.1=example1.com
- com.df.serviceDomain.2=example2.com
and I think that setReqHeader and other header settings can't be indexed at all? My usecase is really simple, I have 2 domains, from which one requires client certificates. So i need to forward different headers from different domains. Service itself is exacly the same though. And one more confusion with these indexes, is this logic correct?
- com.df.port=8080
- com.df.servicePath=/
- com.df.serviceDomain.1=example1.com
- com.df.serviceDomain.2=example2.com
- com.df.verifyClientSsl.2=true
Theres no com.df.verifyClientSsl.1 label as I presume it will default to false?

Not all parameters can be indexed. Only those that have indexing explicitly mentioned in parameter description or in the text below parameter tables are indexable.
I think there might be two problems in this issue.

Additional parameters should be indexable. Can you open a separate issue for that with the list of parameters you need to have indexes.
Unclear documentation. I'd appreciate any concrete suggestion how to improve it. Even better, it would be great if you could do a PR with docs improvement. They are all in the docs directory.

Ok, can you answer the question about the first example. For example if the srcPort is indexed, do I have to index other parameters as well or it understands that when the servicePath for example is not index that the value has to be applied to both indexes?
And as verifyClientSsl is not indexed, it probably never will be? That would require two separate frontend configurations.

You should index all the indexable parameters. Those that are not indexable apply to all indexes.
We can add the option to index VerifyClientSsl if there is a need for such a thing. No one had such a need so far but if there is a good use case, we can do it.

Ok, so when I index one parameter I have to index all that are indexable. Thats exactly that was confusing. Intuitivive way would have been that I have to index those that are different. Like this:

com.df.port=8080
com.df.servicePath=/
com.df.serviceDomain.1=example1.com
com.df.serviceDomain.2=example2.com

I can give you a very good use case and also implementation for VerifyClientSsl indexing. https://discourse.haproxy.org/t/how-to-set-ssl-verify-client-for-specific-domain-name/1489/3

I changed the code so that indexed values inherit from non-indexed parameters but the changes failed the tests. Seems that it's not as simple as I hoped.
I'll try again next weekend (if not before). If anyone would like to give it a try and discover what I did wrong, please take a look at https://github.com/vfarcic/docker-flow-proxy/commit/f8491d5a364585cf445c447e83e3d90dcf9e0039#diff-c8dd0e04131bc0a67088c8e46b94c56f (only the proxy/types.go file).

@remy-tiitre Can you please try out the tag vfarcic/docker-flow-proxy:18.03.04-115 and let me know if it works as expected?

Closing due to inactivity.


bug: read_csv and german umlaut (ä,ö,ü) in filename

The following code
import pandas
df = pandas.read_csv('C:\\exampleä\\test.csv')

thows an OSError: File b'C:\\example\xc3\xa4\\test.csv' does not exist.
This df = pandas.read_excel('C:\exampleä\test.xlsx', 'test') and this open(r'C:\exampleä\test.csv', newline='') works perfectly.

Can you share pd.show_versions()? This is quite likely to be dependent on whether you're running Python 2 or 3.

@Helgeb try this:
pd.read_csv(u'C:\\exampleä\\test.csv')
I think it's a unicode issue with the actual string being passed in.

@TomAugspurger This is Python 3. Every string is unicode. I don't think this should make a difference...

@Helgeb Does this work?
from urllib.request import urlopen
urlopen('C:\\exampleä\\test.csv').read()

Oops, didn't see that in the version info. That's strange.

I wonder if this is windows specfic.  I cannot reproduce this errant behavior on my linux box with either Python 2 or Python 3 and pandas 0.15.2.

Hi, it works with pandas: 0.14.1, so the bug is already fixed.

I am having this problem in 15.2 with python 2.7.7, so I'm not sure that it has been fixed (at least in 2.7.7)
Is there a workaround?

@jmatejka Please open a new issue and include the output of pd.show_versions().

Ok, have done, #9438


Desired behavior of Overlay extension when using the search bar in npmjs.com

Discussed in https://github.com/os-scar/overlay/discussions/104

Originally posted by rzarviv June  8, 2023
I noticed that when I'm using the search bar in npmjs.com to search for a package, the search result shown in Overlay does not update. For example, when I visit react's page on npm and then I search for @angular/cli using the search bar, Overlay will still show its search result for react.
I guess that since overlay does not have the activeTab permission, it's unable to recognize the URL modification caused by using the search bar, and I wonder whether it needs to be implemented.
Steps to reproduce

Open react's page on npm.
Wait for Overlay to be completely loaded.
Search for another package in the search box.
Select that package.

Expected
The Overlay detailed component must show the current package info/
Actual
The Overlay didn't refresh and shows the previous package (react).

Hi @baruchiro , can you please assign me to solve this issue?

Hey! This task was taken over a few days ago, but nothing has happened since then. Maybe the current contributor can comment on this?

@rzarviv is working on it


Use npm ci instead of npm install

Questions
Answers

Description?
Use npm ci instead of npm install

Type?
improvement

BC breaks?
no

Deprecations?
no

Fixed ticket?
-

Sponsor company
-

How to test?
-

Hello @M0rgan01 what will happen to this PR 😉 ?

@matks PHPStan (Latest) tests do not pass. Not related to PR changes. I have to see why. Before this there was a problem on the Build & Release draft stage.

Now it's good ? :+1:

@matks
The main differences between using npm install and npm ci are:
- The project must have an existing package-lock.json or npm-shrinkwrap.json.
- If dependencies in the package lock do not match those in package.json, npm ci will exit with an error, instead of updating the package lock.
- npm ci can only install entire projects at a time: individual dependencies cannot be added with this command.
- If a node_modules is already present, it will be automatically removed before npm ci begins its install.
- It will never write to package.json or any of the package-locks: installs are essentially frozen.


RTM version of nuget packages

In an example, used pre-released version of packages
Install-Package Microsoft.Azure.Common.Authentication -Pre
Install-Package Microsoft.Azure.Management.HDInsight -Pre
Install-Package Microsoft.Azure.Management.Resources -Pre
2 our of 3 packages not maintained for 2-3 years https://www.nuget.org/packages/Microsoft.Azure.Common.Authentication/1.7.0-preview and https://www.nuget.org/packages/Microsoft.Azure.Management.Resources/2.20.1-preview
For the last package, there is a RTM version https://www.nuget.org/packages/Microsoft.Azure.Management.HDInsight
Could you update the guide (and if needed a source code) to address almost 3 years of azure evolution?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: af51c4dc-b361-fdef-c43f-137cc16ee06b
Version Independent ID: f6886083-d2f9-3d1b-b69b-7cd83ae02583
Content: Create non-interactive authentication .NET applications in Azure HDInsight
Content Source: articles/hdinsight/hdinsight-create-non-interactive-authentication-dotnet-applications.md
Service: hdinsight
GitHub Login: @hrasheed-msft
Microsoft Alias: hrasheed

@SychevIgor
Thanks for the feedback! We are currently investigating and will update you shortly.

@hrasheed-msft you may want to make note of this one for tracking

@SychevIgor thanks for letting us know. I have notified the product group team to provide more updated samples for this example. There is another large scale effort ongoing to update our code samples to be in compliance with the latest HDInsight SDKs. Hopefully we will be able to provide these in the coming months, but at present this code sample and document does not seem to have a specific bug.

#please-close

@SychevIgor We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


feat: render nested metadata as yaml

Hey, I just made a Pull Request!

:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

old:

new:

I saw that the StructuredMetadataTable is also used in the scaffolder in the review step. The use case I showed and tested was mainly focussed on usage the kubernetes plugin.
I do think the readability improvements will probably also hold for the scaffolder review step.
I also have to take a look at the failing tests 😓

LGTM so far!

Tests are green. I had to change some tests since the text formatting is now no longer applied to nested fields. The changes in the tests should show what is changing.

I'd be interested in seeing what this does in the Scaffolder Review step, and does it actually make sense, otherwise it might be worth having this as a prop to toggle the behaviour.

For a simple case, nothing changes:

Arrays looked like this:

and will look like this:

I do spot an issue with non-wrapping text there 😓

IMO ready to review

should I add a prop to toggle this to not impact the scaffolder?

this is very cool 😊
I wonder if this could be applied to the Ingress panel as well.

Hey 👋 I was taking a look at how to fix this bug https://github.com/backstage/backstage/issues/27782 and apparently, the component you are changing is also used inside the ContainerCard
          <Grid item xs={12}>
            <Typography variant="subtitle2">Container health</Typography>
          </Grid>
          <Grid item xs={12}>
            <StructuredMetadataTable
              metadata={getContainerHealthChecks(
                containerSpec,
                containerStatus,
              )}
            />
          </Grid>

especially to build the Container health table

Have you checked what it looks like with the new change?

I can do it with a prop and enable it everywhere in the kubernetes plugin where it makes sense. I will make some time in the coming days for this.

busy times 😓


Multiple issues in Always on Top for Polish

Microsoft PowerToys version
0.53.1
Utility with translation issue
Always on Top
🌐 Language affected
Polish
❌ Actual phrase(s)

Zawsze Na Wierzchu (multiple occurrences)
Zawsze Na Górze/ Zawsze na górze / u góry / z przodu (multiple occurrences, also as parts of longer segments)
Odtwarzanie dźwięku podczas przypinania okna

✔ Expected phrase(s)

Zawsze na wierzchu
Zawsze na wierzchu / na wierzchu
Odtwórz dźwięk podczas przypinania okna

ℹ Why is the current translation wrong

Incorrect capitalization - grammar error
Context error - the feature is about keeping window in top of other windows, not on top of the screen, so the translation of "na górze" is wrong as per MS Language Portal
Consistency error - two different translations of "on top"
Style error, perfective imperative should be used for option translation

https://microsoft.visualstudio.com/OS/_workitems/edit/37677845

We just released 0.55 and looking at the issue, this was fixed.  Can someone please validate /needinfo

Confirmed fixed in 0.55


Issue 27 page 2 update 1

Added Complicated badge. Changed icons and order for Stone Cold, Bone Collector, Plague Carrier, Mask Maker badges.
(Todo: Changed icons for hero accomplishment badges. Negotiator, Spelunker, etc.)

Hi Matt,
I had the i27p2 changes ready to go as well but since you already started, just let me know when you are done and I will add any remaining changes.
Are you on the HC forums? If so, please drop me PM there, my username is AboveTheChemist. Supposedly there are a decent number of badge additions/changes coming in page 3 and I think it would be good to coordinate our efforts here so that we aren't both pre-emptively working on the same changes.
Thanks!
ATC

Whoops! Hah you were way ahead of me, no hard feelings whatsoever. I didn't even know about the badge changes until after they went live.
OK, if there's anything I want to pick up for page 3 I'll send you a forum message. I'm Rigel Kent there.
On Tuesday, April 20, 2021, 10:20:32 AM PDT, AboveTheChemist @.***> wrote:
Hi Matt,
I had the i27p2 changes ready to go as well but since you already started, just let me know when you are done and I will add any remaining changes.
Are you on the HC forums? If so, please drop me PM there, my username is AboveTheChemist. Supposedly there are a decent number of badge additions/changes coming in page 3 and I think it would be good to coordinate our efforts here so that we aren't both pre-emptively working on the same changes.
Thanks!
ATC
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.


Update Test Case for TSJS-lib-generator#183

Update test case for Microsoft/TSJS-lib-generator#183, which fixes #13297

Hi @FranklinWhale, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;

this is stale by now. closing. please reopen with a rebase against master.


[Bug]: AttributeError: 'Qwen2Model' object has no attribute 'rotary_emb'

Your current environment

The output of `python collect_env.py`
Your output of `python collect_env.py` here

Model Input Dumps
from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer
model_path = '/home/root123/workspace/model/qwen2-0-5/'
quant_path = '/home/root123/workspace/model/qwen2-0-5-awq-4/'
quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
Load model
model = AutoAWQForCausalLM.from_pretrained(
model_path, **{"low_cpu_mem_usage": True, "use_cache": False}
)
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
Quantize
model.quantize(tokenizer, quant_config=quant_config)
Save quantized model
model.save_quantized(quant_path)
tokenizer.save_pretrained(quant_path)
print(f'Model is quantized   at "{quant_path}"')
🐛 Describe the bug
在进行awq模型量化时报错
Before submitting a new issue...

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

im getting same thing but i think this is a bug AutoAwq

bro,How did you solve this problem?
------------------ 原始邮件 ------------------
发件人: @.>;
发送时间: 2024年11月30日(星期六) 中午11:18
收件人: @.>;
抄送: @.>; @.>;
主题: Re: [vllm-project/vllm] [Bug]: AttributeError: 'Qwen2Model' object has no attribute 'rotary_emb' (Issue #10773)
im getting same thing but i think this is a bug AutoAwq
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

+1

This issue can now be closed as it has been resolved upstream in huggingface_hub and now autoawq.


Add support for checkpoints and restarts

A running EA should be able to checkpoint (save state) and be able to later restart from that checkpoint.  This is particularly important for HPC contexts where batch job wall time budgets can cause a running job to halt before finishing.

Creating a checkpoint saving operator should be trivial. Pickling is already a necessity to support distributed workloads, so creating pickles of populations should be without conflict.
Loading may be a bit more difficult, but I'd think anywhere init_pop_size is used could have a secondary, exclusive parameter that is a pre-constructed population, say init_pop. That opens it up for more use cases too, like transferring populations between algorithms.

Yes, I think pickling and unpickling for checkpoints and restarts would be the easy part.  The harder bit will be figuring out when to do checkpoints.  (Knowing when to do restarts is obviously easy. ;) )
I can see a couple approaches to this that are not necessarily mutually exclusive.

Have a checkpoint operator that updates a pickle file of the current (or given) population
When a UNIX signal is raised (as happens on Summit 10 minutes before the job ends), do a checkpoint

There is some nuance to consider.  For example, say you're doing hyperparameter optimization for a deep learner where training can take, oh, an hour.  The system sends a signal that job death is eminent, so time to save that work and exit gracefully.  Sure, pickling the current population of already evaluated individuals is straightforward, but maybe you'd like to later restart current running training from the last epoch?  Most deep-learning frameworks have a checkpoint/restart system, so presumably the different training runs can detect external UNIX signals, stop training, and save one last checkpoint.  But since those individuals aren't in the current population because they're literally in the middle of being evaluated, how do you know to resume training upon restart to complete fitness evaluation?  Clearly some bookkeeping needs to happen to track all that.

It may be worthwhile to see how DEAP and other EC frameworks handle checkpoints and restarts, though I imagine they took the path of least resistance and just worry about pickling/unpickling the one population.

DEAP doesn't have an explicit method of checkpointing from their documentation, simply a suggestion to use pickling for it. Their example also just used periodic checkpoints, nothing fancy with detecting signals.

DEAP doesn't have an explicit method of checkpointing from their documentation, simply a suggestion to use pickling for it. Their example also just used periodic checkpoints, nothing fancy with detecting signals.

Wow!  I'm kinda surprised.  Well, this may be an opportunity to whip up something better than just pickling/unpickling populations, particularly with HPC contexts in mind.

Resuming deep learners is a bit finicky. The actual resuming within evaluation I think would be the jurisdiction of the problem class. But retaining the currently evaluating individuals brings along some issues. I think it would be confusing having both an already evaluated initial pop as well as the evaluation queue.
For checkpointing in general, I'm realizing it may be better to create a custom Representation (or initializer?) that loads it up instead, feeding it out as the initial pop. It could hide away much of the complexity fairly easily. Although, I'm still uncertain what the evaluation queue would look like in this context, and we'd need to consider whether / how not to re-evaluate the checkpointed individuals.

The usual process, thinking only of generational for now, is
parents = representation.create_population(pop_size, problem=problem)
generation_counter = util.inc_generation(start_generation=start_generation, context=context)
parents = init_evaluate(parents)

The evaluation is untied to the representation and supplied by the user. We could add an optional parameter to override it fairly easily (ok), have the user fill it in with a dummy (clunky), or create to a new init evaluate function that conditionally evaluates them based on whether they have a fitness (potentially surprising). I'm leaning towards the last, so long as it is well named and documented for this particular use case.

Or, have a restart boolean that, if true, just skips those steps and falls right into the offspring creation cycle.
Another thing I've done in the past is monitor evaluation times.  So, if one knows the wall clock time for when a job ends, and given the average and standard deviation of evaluation times, it's possible to estimate whether there's enough time to evaluate a new individual given the remaining wall clock time --- then the evaluations drain down until the job ends.  If any are still cranking when the job terminates, oh well.


Request - new code table - ctuse_condition

Help us understand your request (check below):

[x] a new term for data entry or management

Describe what you're trying to do
See https://github.com/ArctosDB/dev/issues/122
It is agreed to add a new controlled-vocabulary use_condition to permits. This issue is to work out the definition and details.
Table Definition
(Why does this exist, criteria for @ArctosDB/arctos-code-table-administrators to use when evaluating new value requests, etc.)
@happiah-madson help!
Term requests will likely be coming in before this is finalized, please reference this issue in them.
Table Structure
Proposed structure, please let me know ASAP if anything needs to change:
ctuse_condition
* use_condition varchar(60) not null primary key
* description varchar(4000) not null
* issue_url varchar[]
* documentation_url varchar[]

AWG reviewed this, going to dev

discussed/approved https://docs.google.com/document/d/1820m9g7z3vnBSkAIxi39awJCLX_EEQgVD-_VwjxgGWg/edit?tab=t.0


Setup Automation Manager logging and error alerts for relevant repositories

To avoid cases where an automated action fails and nobody realizes it for a while, we should set up a system for logging performance of automated actions, and develop a means to send alerts to Discord or other locations when builds fail or something else occurs in an unexpected way.
While there are scattered logging and post-to-discord functions located within different scripts, a more sophisticated result would probably be setting up a Jenkins server, for which there are guidelines on how to do so on Digital Ocean. This would enable a centralized user interface with sophisticated logging and scheduling functionality that would reduce the amount of boilerplate code we have to develop and allow us to review and manage tasks in a more user-friendly way.
We may need to upgrade the AM droplet in order to properly do this -- the article above recommends at least 1GB of RAM, while the AM droplet currently only has 512 MB.
Requirements

[x] initial Jenkins setup in DO
[ ] migrate scripts in the automation-manager to jenkins
[ ] migrate remaining scripts with cron jobs

data sources mirror is not done with DA, but by a DO droplet not currently managed with Jenkins
data-source-identification common crawler
automatic-archives update
exceptions

data-sources-app (not the v2 fork) has some tests which are deprecated by v2 anyway
github actions demo; either we leave as-is or turn it into a jenkins demo

[ ] set up a domain name automation.pdap.io

rationale: automation is maybe more clear than am; .io is for "real stuff" we use that affects things, .dev is for stuff we're still building; even though automation is for devs, it's real and affects things.

[ ] wind down original automation manager droplet

Note that I have limited experience with Jenkins and hence there would be a learning curve for me in setting this up.

I set up a test version of Jenkins!

Because I have a little version of @josh-chamberlain That sits on my shoulder and asks me questions about my decisions, allow me to respond to tiny Shoulder Josh and by extension Big Josh:
Why should we use this instead of GitHub Actions?

Jenkins is much more extensible and flexible compared to GH.
Jenkins enables better separation of concerns. Rather than adding additional clutter to various Github Repositories, these are defined in a separate user interface, where we can control jobs deriving from multiple repositories.
Jenkins improves security. User accounts can be created with distinct permissions granted, and control over job construction can be delegated in an environment separate from the Github environment.
Jenkins has a very friendly user interface. Scheduling, job sequencing, log archiving, and so on is defined clearly in the configurations and the results available for easy review.
Jenkins has a large-open source community, with a lot of plentiful documentation.
Jenkins has a large library of plugins which can be utilized to customize our experience, much more easily than GH. For example, if we want to send notifications on failed builds to a Discord Webhook, there's a Plugin for that.
Build control is superior. Triggered builds run much faster than in GitHub actions and can be debugged on a step-by-step basis, making them easier to develop and tweak.
Unlike GitHub Actions, Jenkins builds can persist after running, which reduces the amount of time spent rebuilding jobs.

Nice. I was able to log in and things seem pretty clear.
A few questions:

it appears a user can, within Jenkins, see which repos contain automation by inspecting the logs. That's probably enough re: docs, but I made a stub of a Notion doc. Please feel free to add anything that might be useful.
do you think we should migrate all our recurring github actions now, or wait?
do you think it's still worth prototyping new things in GA, or should we just use Jenkins from the jump?
what else needs to happen before we close this?

Nice. I was able to log in and things seem pretty clear.
A few questions:

it appears a user can, within Jenkins, see which repos contain automation by inspecting the logs. That's probably enough re: docs, but I made a stub of a Notion doc. Please feel free to add anything that might be useful.
do you think we should migrate all our recurring github actions now, or wait?
do you think it's still worth prototyping new things in GA, or should we just use Jenkins from the jump?
what else needs to happen before we close this?

Will do!
I think doing it now for anything that operates off a Cron Job is a good idea. I think the first thing is to migrate the other scripts in the automation manager, and confirm they function properly.
I think using Jenkins from the jump is probably the best option, if only because it's less of a pain to set up jobs in Jenkins compared to GitHub (once you understand how it works, of course).
As of right now, the droplet is accessible by an IP address. I think we should get the domain name registered and have the SSL certificate so we can access it more professionally and securely. I already created a domain name for the droplet in Digital Ocean and had it point to the IP address, but that domain name will need to be registered in whatever manner we do that in.
Then, we'll need to wind down the original automation manager droplet and replace it with this.

@maxachis thanks! I tweaked your parent comment a bit.
our domains are configured with squarespace, but digital ocean manages our nameservers. so, the am.pdap.dev you created seems to simply work! Neat. I think we should do automation.pdap.io as mentioned above.

@josh-chamberlain Done! Ready for the domain to be configured!

@maxachis without any intervention from me, it's up at automation.pdap.io! DO makes it pretty easy, I have to say...

@josh-chamberlain Excellent! I've begun migrating jobs to Jenkins, although I have noted that my migration of the data sources mirror repository has run into some hitches.
To whit, I'm not able to get it to work on Jenkins, I'm not able to manually get it working by triggering it while in root in the original Automation Manager droplet, and because of the absences of logs in the original droplet, I'm not even sure when it last worked at all. The output from Jenkins and running it in the droplet are below:

requests.exceptions.HTTPError: ('403 Client Error: Forbidden for url: https://api.airtable.com/v0/app473MWXVJVaD7Es/Agencies?filterByFormula=DATETIME_DIFF(NOW()%2Cairtable_agency_last_modified%2C'hours')+<+2', "{'type': 'INVALID_PERMISSIONS_OR_MODEL_NOT_FOUND', 'message': 'Invalid permissions, or the requested model was not found. Check that both your user and your token have the required permissions, and that the model names and/or ids are correct.'}")

So that poses a problem.

@josh-chamberlain Additionally, for the Automatic Archives action, I'll need an API key I can use to call the PDAP endpoint to perform the archives action.

@maxachis do you think we should use the same SECRET_KEY as the client (global org secret) or create a new key for automation?

@josh-chamberlain For safety's sake, I think creating a new key for automation is best.
And agreed, we should refactor to hit our internal endpoint. I smell a new issue! 👃

@josh-chamberlain

Airtable-To-Postgres-Database-Mirror is now running on Automation, although I'm not sure how to verify that's working exactly as expected.
I've got a PR up for fixing the automatic archives. Once that's fixed, we should be able to get it running on Jenkins.
For the common crawler, we've had this discussion previously, but I think the it's best if we set up an endpoint to cache common crawler searches and to retrieve a cache for given search parameters if they exist, rather than having them in the repository to commit. If the common crawler runs daily, that means we'll quickly accrue commits rapidly, which will make things difficult for us if we ever have to rollback commits.

@maxachis thank you for all your work on this—it's already much easier to see how automations are working. Like, I don't ever want to have to SSH anywhere.

I'm not really sure either. We mostly just want to be sure that it's running.
Nice, approved! Thought I did that earlier, but I must have got distra
Yes. That said, at this moment, we don't have a reason to run it daily, or close to daily, or automatically. I think it can wait, would you agree?

@josh-chamberlain Automatic Archives is now working as well! Set to run on a daily basis.
In response to 3: Yes, agreed! So perhaps we put that in a separate issue so we can close this one out?


[Schema] Support apollo  federation schema directives

Version: 0.3.4
Version: Insomnia 2021.6.0
Release date: 2021/10/28
OS: Darwin x64 21.1.0
Electron: 11.2.3
Node: 12.18.3
V8: <IP_ADDRESS>-electron.0
Architecture: x64
node-libcurl: libcurl/7.73.0 OpenSSL/1.1.1k zlib/1.2.11 brotli/1.0.9 zstd/1.4.9 libidn2/2.1.1 libssh2/1.9.0 nghttp2/1.42.0

Describe the bug
Graphql schema include @deprecated, @extends  and @external federation directives will prompt Unknown directive<EMAIL_ADDRESS>Expected behavior
Support Apollo Federation Schema.

@Just1nWang Thanks! Any idea which directives are required by apollo federation or if there's documentation on how to support it?
I was thinking about adding the ability to allow custom directives but federation might be a special case that's supported as is 🤔

I think you can just ignore the directives for the purposes of generating a request


[Zip][Portable] New Package: Blinue.Magpie 0.9.1

Resolves #32734

Microsoft Reviewers: Open in CodeFlow

@msftbot zip

Ping-pong @stephengillie

/AzurePipelines run

/AzurePipelines run


Fix example configuration typo

Coverage remained the same at 99.485% when pulling ddfede62a50f33e1d1e29060cc06d13e4619fda3 on regisb:patch-1 into d88fe481647b5ece783a21bde009680d70835bbd on ekmartin:master.

Oops, thanks!


VM service: Document what Message.messageObjectId is

The VM service docs include a public Message.messageObjectId field, but they don't mention what is safe to do with it. I'd guess that it could be passed to getObject, but I'd feel wary doing so unless that's actually documented.

messageObjectId is an id that can be safely passed to getObject. The returned object is the message payload.

What classes of objects can it return? Will it always be an Instance, or can it be other things as well?

It can return anything that can be transmitted as a Dart message to a Dart SendPort/ReceivePort. In other words, Instance.

We need to add "messages" support to LookupHeapObject -- then message ids will be useful for any api, not just getObject.  We should also update the service.md docs.

Documentation has been updated and the behaviour of message objects is now unified with other heap objects.
https://codereview.chromium.org/1339713002/


VSC crashes if the extension window is searched with CTRL+F

Type: Bug

Click Extensions.
Search for something, like “test”, that retrieves multiple results.
Click a result.
In the tab that opens for the extension, search for something with CTRL+F. It should have results.
Click another result in the extensions.
Expected: a new tab opens with the extension clicked.
Actual: VSC closes with no message. I.e., it crashes.

VS Code version: Code 1.89.1 (dc96b837cf6bb4af9cd736aa3af08cf8279f7685, 2024-05-07T05:13:33.891Z)
OS version: Windows_NT x64 10.0.22631
Modes:

Hi @sfsaccone
Thanks for taking time to report on this issue. Sorry to hear you are experiencing VSC crash. It appears to be specific to VS Code editor and tools. It is best to reach out VS Code team at https://github.com/microsoft/vscode/issues for quick action.
Thanks,
VS Marketplace Team


Native Thread CHIP connection fails

resolve<PHONE_NUMBER> 1 fails
OTBR and node up date passes but the device is not detected and the next zclread or other commands fail saying not connected
Setup the OTBR using the github otbr code and setup for etherent
Build the nrfconnect light example
Build the python chip-device-ctrl and then run the same
The following is the error observed
NRF device side log shows no error
: 882399 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 882475 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 884962 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 887468 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 887545 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 890032 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 892538 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 892615 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 895102 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 897608 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 897685 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 900172 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 902678 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 902755 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 905242 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 907747 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 907825 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 910312 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
D: 912817 [DL]Sending notification for CHIPoBLE TX (ConnId 00, len 3)
D: 912895 [DL]Notification for CHIPoBLE TX done (ConnId 0x00)
D: 915381 [DL]Write request received for CHIPoBLE RX (ConnId 0x00)
on the python device controller side when the resolve command is run
[1630317400.796478][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317401.867509][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated
[1630317401.867853][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317401.868171][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated
[1630317401.868377][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317401.868758][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated
[1630317401.868953][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317401.869214][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated
[1630317401.869402][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317401.869658][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated
[1630317401.869841][150244:150252] CHIP:CTL: OperationalDiscoveryComplete for device ID 1
[1630317403.227857][150244:150252] CHIP:SC: CASESession timed out while waiting for a response from the peer. Expected message type was 49
[1630317403.227967][150244:150252] CHIP:CTL: Device connection failed. Error ../../src/protocols/secure_channel/CASESession.cpp:269: CHIP Error 0x00000032: Timeout
Failed to commission: 50
[1630317408.372701][150244:150252] CHIP:DIS: Node ID resolved for 0x0000000000000001 to [2002:c0a8:40d:10:e65f:1ff:fe0f:27d8]:5540
Node address has been updated

Please describe your setup better. It looks like the controller cannot reach the device using the 2002:c0a8:40d:10:e65f:1ff:fe0f:27d8 address, so you must be missing some routing configuration.

Raspberry 1 - running OTBR with ethernet connected and built for ethernet
Raspberry 2 - running Python Device Controller
Nordic nrf devkit acting as Thread Accessory
Raspberry 1 and Raspberry 2 connected via ethernet through a TPLink router

Attaching the latest test ping log and also picture of the thread accessory ip address

ubuntu@ubuntuservercontroller:~/connectedhomeip/out/python_env/bin$
PING fd97:c850:630f:6a66:98eb:2212:f137:ddc5(fd97:c850:630f:6a66:98eb:2212:f137:ddc5) 56 data bytes
^C
--- fd97:c850:630f:6a66:98eb:2212:f137:ddc5 ping statistics ---
8 packets transmitted, 0 received, 100% packet loss, time 7149ms
ubuntu@ubuntuservercontroller:~/connectedhomeip/out/python_env/bin$ ping -6 fd1f:47a7:e70d:2295:0:ff:fe00:4c07
PING fd1f:47a7:e70d:2295:0:ff:fe00:4c07(fd1f:47a7:e70d:2295:0:ff:fe00:4c07) 56 data bytes
^C
--- fd1f:47a7:e70d:2295:0:ff:fe00:4c07 ping statistics ---
8 packets transmitted, 0 received, 100% packet loss, time 7161ms
ubuntu@ubuntuservercontroller:~/connectedhomeip/out/python_env/bin$
PING fd1f:47a7:e70d:2295:90d2:8e80:a8e6:d2ca(fd1f:47a7:e70d:2295:90d2:8e80:a8e6:d2ca) 56 data bytes
^C
--- fd1f:47a7:e70d:2295:90d2:8e80:a8e6:d2ca ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2031ms
ubuntu@ubuntuservercontroller:~/connectedhomeip/out/python_env/bin$ ping -6 fe80:0:0:0:4841:d0e9:d6ee:92f8
PING fe80:0:0:0:4841:d0e9:d6ee:92f8(fe80::4841:d0e9:d6ee:92f8) 56 data bytes
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
ping: sendmsg: Invalid argument
^C
--- fe80:0:0:0:4841:d0e9:d6ee:92f8 ping statistics ---
7 packets transmitted, 0 received, 100% packet loss, time 6138ms

Is this still happening on recent builds?


How to get enzyme to work with react-css-modules?

I'm not sure if this is any issue with karma-typescript,  enzyme or react-css-modules. Or if there's something I need to do with any of those tools to be able to test CSS modules.
Here's a very simple component with tests demonstrating the issue:
Hello.tsx:
import * as React from "react";
import * as ReactCSSModules from "react-css-modules";

import * as helloStyle from "./Hello.css";

@ReactCSSModules(helloStyle)
export default class Hello extends React.Component<any, any> {
    render() {
        return
Hello World
;
     }
}

HelloSpec.tsx:
import * as React from "react";
import * as ReactCSSModules from "react-css-modules";

import * as chai from "chai";
import * as chaiEnzyme from "chai-enzyme"

import { expect } from "chai";
import { shallow } from "enzyme";

import Hello from "./Hello";

describe("Hello", () => {

    chai.use(chaiEnzyme());

    let hello = shallow(<Hello />);

    it("should render correctly", () => {
        expect(hello).to.have.tagName("div");
    });

    it("should have correct prop values", () => {
        expect(hello).to.have.text("Hello World");
    });

});

And this is the error I get:

START:
PhantomJS 2.1.1 (Windows 8 0.0.0) ERROR
Error: "color" CSS module is undefined.
at C:/Users/Amaral/AppData/Local/Temp/karma-typescript-bundle-14232TTFax3aHxeHP.js:7734

This is preventing me from testing anything in my app and I can't find much information about it and how to fix it... Do you think it's anything related to enzyme? If so, how to fix it?

This is actually an issue with karma-typescript: https://github.com/monounity/karma-typescript/issues/66


update: bug fix config.php

update: bug fix relationship between user and promocode_user, change the right key for foreign_pivot_key config param

Thanks! Well done.


TypeError: Instance of 'HttpRequestEventTarget': type 'HttpRequestEventTarget' is not a subtype of type 'HttpRequest'

Package
dio
Version
5.4.1
Operating-System
Web
Adapter
Default Dio
Output of flutter doctor -v
No response
Dart Version
3.3.0
Steps to Reproduce
flutter web
flutter_windows_3.19.4-stable
dio: ^5.4.1
Expected Result
Normal request
Actual Result
request failure
“TypeError: Instance of 'HttpRequestEventTarget': type 'HttpRequestEventTarget' is not a subtype of type 'HttpRequest'”

Please provide a minimal reproducible example.

Please provide a minimal reproducible example.

Just using the official demo will cause it to happen !
import 'package:dio/dio.dart';
final dio = Dio();
void getHttp() async {
final response = await dio.get('https://dart.dev');
print(response);
}

Both classes are provided by the Dart SDK, it should be nothing related to Dio. Please consider asking the Dart team for help.


One or more certificates rejected. Cannot proceed with installation.

Hi,
Trying to build from source and I get this.  Obviously one of the certificates cant be validated but it's not obvious how to fix this:
Installation failed.
One or more certificates rejected. Cannot proceed with installation.

Some system info:
manko@rocketmotor:~/dev/product-is$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 16.04.3 LTS
Release:	16.04
Codename:	xenial
manko@rocketmotor:~/dev/product-is$ java -version
java version "1.8.0_161"
Java(TM) SE Runtime Environment (build 1.8.0_161-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.161-b12, mixed mode)
manko@rocketmotor:~/dev/product-is$ ls /usr/lib/jvm/
java-1.5.0-gcj-5-amd64  java-8-oracle
manko@rocketmotor:~/dev/product-is$ git status
HEAD detached at v5.4.1
nothing to commit, working directory clean

So I worked around this by downloading the jdk from oracle's website, and using the downloaded one (by setting JAVA_HOME) rather than the installed one.  So this can be closed, unless one of you guys wants to improve the error message??


Backup on Google Drive.

Unable to backup on google drive.I did the whole process of cloud backup but it still showed the exclamation mark on the Security Center page and the message on the home screen didn't change.

Now Google Drive backup is not happening in Dev App v2.0.75(468). It is giving cloud backup error.

When going into Recover flow, the wallet is not asking for the email address to recover the wallet from. Thus the user is unable to retrieve his/her wallet from the cloud.
Thus there are atleast 2 issues here. One is unable to BACKUP to the cloud and second is unable to RECOVER from the cloud.
CC: @Pawan2792

Verified this issue on dev app v2.0.75(469)


Python flask deploy

This will allow us to work with the bluemix deploy.
I tried to limit the impact on the existing work with a little refactoring.
There should probably be more refactoring as we work on a style guide, etc.

rebased. new branch.


Aggregator safety

In anticipation of future instances when project admins accidentally enable the Aggregator, two saftey measures proposed/discussed by the community:
https://groups.google.com/forum/#!topic/inaturalist/qo1SAJofIfo

An alert either after checking the Aggregate button or Save on Projects/edit e.g. ''Ok, you are about to aggregate all Spiny Lobster observations from California, is this what you would like to do?'

A 'disaggregate' button which Project admins could use to automatically remove unsuitable project observations. My understanding from Patrick is we'd have to bring some of the node logic into rails. Or we could implement a poor man's version using the node API

#remove non-suitable obs
project_slug = "hawk-week-jan-17-23"
project = Project.where(slug: project_slug).first
url = "http://api.inaturalist.org/observations?not_matching_project_rules_for=#{project_slug}&project_id=#{project_slug}"
uri = URI(url)
response = Net::HTTP.get(uri); nil
dat = JSON.parse(response); nil
pages = dat["total_results"]/dat["per_page"]+1
to_del = []
(1..pages).each do |i|
 puts i
 url = "http://api.inaturalist.org/observations?not_matching_project_rules_for=#{project_slug}&project_id=#{project_slug}&page=#{i}"
 uri = URI(url)
 response = Net::HTTP.get(uri)
 dat = JSON.parse(response)
 dat["results"].each do |a|
   puts a["id"]
   po = ProjectObservation.where(project_id: project.id, observation_id: a["id"]).first
   to_del << po.id
 end
end

to_del.each do |po_id|
 po = ProjectObservation.find_by_id(po_id)
 po.destroy
 puts po_id
end

I have an option for part 1 of this on Staging. If you edit/save a project that is aggregating you'll see the confirm modal

Looking good!

Would it make sense to 'disaggregate' as a final step to aggregation? i.e - do it automatically and make it so "aggregated" projects could gain or lose observations based on changes. Seems like when they enable the aggregator they are giving up control for us to do the right thing, and I think the right thing would be to make sure the project obs are in sync. Thoughts?


Replace Into

Please realize the possibility of rewriting cells and creating tables
REPLACE INTO ...
CREATE TABLE ...

This is a reasonable feature request. I'll do it in a week. And if you know how to implement it, PR is super welcome.

All changes are merged.


mdserver_remote: don't treat random errors as NoCurrentSessionErrors

If the service gives us some other error message when getting the session (as opposed to libkb.NoSessionError), we should retry the connection after a delay using the rpc connection's retry logic.
This also fixes up logging in MDServerRemote to be more consistent with the rest of the package.
Also, it re-vendors client to get the most up-to-date content hashes (previously, we had vendored from an unmerged branch).
Issue: KBFS-2031

Cool, I just made the caller do the logging instead, and added a comment
about it.


git-cliff: 0.7.0 -> 0.8.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/orhun/git-cliff/releases.
meta.description for git-cliff is: "A highly customizable Changelog Generator that follows Conventional Commit specifications"
meta.homepage for git-cliff is: "https://github.com/orhun/git-cliff"
meta.changelog for git-cliff is: ""
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.8.1 with grep in /nix/store/gj62c49wsyx15j7zb07hp9abbf4lr2pj-git-cliff-0.8.1
found 0.8.1 in filename of file in /nix/store/gj62c49wsyx15j7zb07hp9abbf4lr2pj-git-cliff-0.8.1

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
git-cliff

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/gj62c49wsyx15j7zb07hp9abbf4lr2pj-git-cliff-0.8.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A git-cliff https://github.com/r-ryantm/nixpkgs/archive/5f446fe1a3bf5799b09f2860f4a489386a7070e6.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/gj62c49wsyx15j7zb07hp9abbf4lr2pj-git-cliff-0.8.1
ls -la /nix/store/gj62c49wsyx15j7zb07hp9abbf4lr2pj-git-cliff-0.8.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

git-cliff

Maintainer pings
cc @siraben for testing.

Result of nixpkgs-review pr 183301 run on aarch64-darwin 1

1 package built:

git-cliff


Brief description of the bug

Describe the bug
A clear and concise description of what the bug is
New Text in Voice Chat got rolled out and needs the little touch of the minimal cord look, since most Servers tend to actually use this feature instead of the old voice chats we discord admins created
To Reproduce
Steps to reproduce the behavior
Hop in a VC, enable the text chat and it shows in the simple discord grey look
Screenshots
If applicable, add screenshots to help explain your problem
Attached
Infomation (please complete the following information)
Discord channel: PTB
OS: Windows
Mod: BetterDiscord
Discord language: English

Fixed with new forums.