Feature Request: Official Iconify Package for Flutter

Hello,
First of all, thank you for providing such a versatile and comprehensive icon collection through Iconify. It has been incredibly useful for developers across various platforms.
Currently, we rely on directly using SVGs for Flutter, which works well. However, an official Flutter package for Iconify would be a game-changer. It would greatly streamline the process, improve performance, and provide more flexibility for customization, aligning perfectly with Flutter’s widget-driven structure.
Having a dedicated package would not only enhance the developer experience but also bring Iconify closer to being the go-to solution for icons in the Flutter ecosystem. I believe many in the Flutter community would appreciate this addition, and it would help further elevate Iconify’s presence across all platforms.
Thank you for considering this request, and I look forward to seeing the future developments!

I cannot help with that because I'm not using Flutter and not familiar with how it renders icons.

There are few unofficial opensource packages for it, but they are not updated with latest icons. It is capable of rendering icons from svg (which is what I am currently using for my apps)
Ex: https://pub.dev/packages/iconify_flutter
Ex: https://pub.dev/packages/iconify_flutter_plus


credentials: Use cross-platform credentials.toml instead of Unix-specific .env files.

implements #1.

Can now load credentials from a toml file (credentials.toml in the same directory as klonol.exe by default. Can change with command-line option -c).
get_github_credentials() and get_gittea_credentials() have been merged into a single function

important
I've tested the github features and it's working, but as i'm not familiar with gittea i've encountered issues trying to test it.
I created an account at http://gittea.dev and generated an access token, but when i try to use it i get the error The access token is invalid. I'm not sure what the issue is and i think i'll leave that up to you @hungrybluedev to fix, because i have no idea how to fix it.

I've pushed a few commits to your fork, so remember to git pull before changing the code.

Sorry i took so long to get around to this. I've been pretty lazy lately.
the stuff you mentioned should be fixed now, but i'll let you be the judge of that.
I was thinking the toml file should look like this
[github]
username="etc"
base_url="etc"
access_token="etc"

[gittea]
username="etc"
base_url="etc"
access_token="etc

because currently if you wanted gittea and github credentials saved you'll have to have something like this, and just comment out the credentials you don't want to use. It might be annoying if you're frequently running klonol on both github and gittea
USERNAME="etc"
BASE_URL="github.com"
ACCESS_TOKEN="etc"

#USERNAME="etc"
#BASE_URL="gittea.com"
#ACCESS_TOKEN="etc"

I've actually never used klonol before (outside of testing) so i don't know how people would normally use it. I guess you'd be the best judge of that @hungrybluedev

Good idea. Then we can also include the provider info the credentials file and have it be optional as a flag. Then we can choose the section accordingly. Can you make these changes?

Also, we should update the .sample file to be TOML instead of ENV.

Good idea. Then we can also include the provider info the credentials file and have it be optional as a flag. Then we can choose the section accordingly. Can you make these changes?

I could do it, but it might be a while before i get around to doing it. I'd understand if you just want to take over and get it done. Sometimes i just don't feel like coding.

It's alright, there's no rush. I have to finish my assignments over the weekend, anyway. You can take your time with this.
I'll hop in once I get some work done.


Parent-Child Elasticserch

I am trying to use the "go-mysql-elasticsearch" to sync data from mysql to elasticsearch.
I am having issues with the parent-child relationship.
Consider the following tables in MYSQL:
PRODUCTS
+-----------+-------------+---------+----------+-------+
| productID | productCode | name    | quantity | price |
+-----------+-------------+---------+----------+-------+
|      1001 | PEN         | Pen Red |     5000 |  1.23 |
+-----------+-------------+---------+----------+-------+
CHILDPRODUCTS
+-----------+-------------+---------+----------+-------+
| productID | productCode | name    | quantity | price |
+-----------+-------------+---------+----------+-------+
|      1001 | test         | Prrd |     10 | 3 |
+-----------+-------------+---------+----------+-------+
I want to move them to ES and have CHILDPRODUCTS as the child of PRODUCTS.
How should I define the mapping in ES ?
In "river.toml" how should I define the [[rule]] ?
Do you have any example for parent-child relationship ?

if you're using ES 5.x or 6.x, don't use parent-child relation in river.toml.
If you want to see some examples, you can read the README, or you can refer to https://github.com/siddontang/go-mysql-elasticsearch/issues/81,  https://github.com/siddontang/go-mysql-elasticsearch/issues/130

Thank you for the examples !
I am trying to do a MySQL style "join", when sending data from MySQL to ES
5.
This was the reason for using parent-child relation in river.toml
Do you have any suggestions on what else I could use ?
On Tue, 15 May 2018, 18:09 Eagle Chen<EMAIL_ADDRESS>wrote:

if you're using ES 5.x or 6.x, don't use parent-child relation in
river.toml.
If you want to see some examples, you can read the README, or you can
refer to #81
https://github.com/siddontang/go-mysql-elasticsearch/issues/81, #130
https://github.com/siddontang/go-mysql-elasticsearch/issues/130
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/siddontang/go-mysql-elasticsearch/issues/251#issuecomment-389202588,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AMH0CTa8peSe0bh_6sDXpeoQeud4yetPks5tyu-9gaJpZM4T_aiG
.

As mentioned in the official documents, elasticsearch guys don't recommend parent-child relationship in most cases (see: join type).
Maybe you can run several rounds of queries( fetch parent, extract id, fetch children ..) or change the mappings (to include child documents) in elasticsearch.
No silver bullet for all use cases.


PR: Change default cell name to Untitled Cell with number if needed

Description of Changes

[x] Wrote at least one-line docstrings (for any new functions)
[x] Added unit test(s) covering the changes (if testable)
[ ] Included a screenshot (if affecting the UI)

Change default cell name from '' to 'Unnamed cell, line {}'
Issue(s) Resolved

Fixes #9085
Affirmation
By submitting this Pull Request or typing my (user)name below,
I affirm the Developer Certificate of Origin
with respect to all commits and content included in this PR,
and understand I am releasing the same under Spyder's MIT (Expat) license.

I certify the above statement is true and correct:

Copied from @bcolsen https://github.com/spyder-ide/spyder/pull/9014

@impact27 I like the idea of having a default code cell name so much I would like to see this default cell name change pushed into syntaxhighlighters.py so the outline explorer can have a default name for unnamed cells as well. Currently the cells are just empty in the outliner. This would mean reveting all the changes you have made to these file, but I will show you where they can go and also it should mean fewer changes to the code overall.
Also, I agree with @CAM-Gerlach about the format of the current default cell name being not explicit enough. I think the default cell name should be "Unnamed cell, line {}", this would be similar to line numbers in tracebacks.
I think this can be done with a few lines of code placed around here:
spyder/spyder/utils/syntaxhighlighters.py
Line 488 in dd631ac
oedata.def_name = get_code_cell_name(text)
or in the get_code_cell_name function directly:
spyder/spyder/utils/syntaxhighlighters.py
Line 388 in dd631ac
def get_code_cell_name(text):
You should be able to get the code line in the PythonSH class like this:
block_nb = self.currentBlock().blockNumber()
The line number would need to be passed to get_code_cell_name if you make the changes there.
As for a test, I think you can safely remove this code cell name to be an unnamed cell and then change the test so it works with the default name vs MGroup4
spyder/spyder/plugins/outlineexplorer/tests/test_widgets.py
Line 127 in dd631ac
# %%% MGroup4

I would rather see Untitled Cell 1 (then Untitled Cell 2 and 3 as more are found) used here instead of line number. If a new untitled cell is added it would be Untitled Cell 4 in this case regardless of position.
The names will change less often this way, since line number change easily.

Hello @impact27! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file spyder/plugins/editor/panels/classfunctiondropdown.py:

Line 112:29: W291 trailing whitespace

In the file spyder/plugins/outlineexplorer/api.py:

Line 109:9: E306 expected 1 blank line before a nested definition, found 0
Line 141:31: W292 no newline at end of file

This new PR changes the name of the cells so that every cell name is unique, by adding a number at the end of the cell. The numbers are kept up to date when a new cell is added. The highlighter outline explorer data are moved to the block userData. This could be useful to fix the outline explorer at a later point. (The outline explorer should not save the line number as they are prone to change)

@impact27 This looks great! I really like the use of the block's userdata.
I looked over the code and did some functional test, and things are looking good.
Before I do a code review here there is one bug I found. When I change the line number of cells for example adding a line near the beginning  of the file, the outline explorer get a second copy of all the cells that changed lines.
You might not have looked into the tests yet but there are still references to get_outlineexplorer_data in these files:
./spyder/plugins/outlineexplorer/tests/test_outline_explorer.py
./spyder/plugins/outlineexplorer/tests/test_outline_explorer_editor.py
./spyder/plugins/editor/panels/tests/test_classfunctiondropdown.py

Before I do a code review here there is one bug I found. When I change the line number of cells for example adding a line near the beginning of the file, the outline explorer get a second copy of all the cells that changed lines.

I fixed that. As a side effect, #7976 is fixed as well

I am not sure I understand why the tests are failing

@impact27 Try rebasing on the latest master. Otherwise, they may not be related to your PR; on e.g. #9224 , a trivial PR, there are a bunch of random Travis failures for various reasons. I don't see any PRs that explicitly mention this in the queue... @ccordoba12 ?

 Since that's very rarely the case, I didn't think it was important to mention it.
However, the failures here are caused by segfaults in our introspection tests. I'll take a look at that once this is ready.
@impact27, do we need to merge #9219 before this one?

No they are separate

No they are separate

Ok, then please address @CAM-Gerlach's concern

Also, its probably best if you don't keep pushing commit after "fix tests" commit with the same duplicate and uninformative commit message; either make them proper commits with proper commit messages, or amend each into the previous commit

either by squashing your last commits with the same message into a single one or by rewriting your commit messages to be more informative.
After that I'll help you to fix our tests.

The problem I have with the tests are:
pyscripts/spyder/spyder/app/tests/test_mainwindow.py:446: TimeoutError:
pytestqt.exceptions.TimeoutError: Signal lsp_response_signal(QString,PyQt_PyObject) not emitted after 30000 ms
I am not sure I understand why what I changed impacts lsp.
pyscripts/spyder/spyder/plugins/editor/widgets/tests/test_warnings.py:147: AssertionError
Somehow the missing docstring in the module is not detected but all the other warnings are.
Also I am not able to reproduce the segmentation faults.

I gave it another go. I can reproduce the segfault on macos with:
def test_segfault(qtbot, lsp_codeeditor):
    editor, _ = lsp_codeeditor
    editor.set_text(TEXT)

There was a reference loop in the code that prevented the userData objects from being removed. By removing it it somehow creates a segmentation fault. I added an explicit reference loop.

I changed the name of the PR as the unique cell name thing is really just a few lines in spyder/plugins/outlineexplorer/api.py. This PR is now really about using blocks instead of line numbers to identify lines.

By removing it it somehow creates a segmentation fault. I added an explicit reference loop.

Really good that you found the cause of the segfault! Great job!

@impact27, before reviewing with care your PR, I have one general question: do your improvements to the outline explorer depend on the file's language being Python?
I mean, since the addition of the Language Server Protocol allows us to have code completion and linting for languages other than Python, we'd like to (for example) have cells for C++ or Julia files, so users can run those cells in consoles with a C++ or Julia kernel running on them.

@impact27, before reviewing with care your PR, I have one general question: do your improvements to the outline explorer depend on the file's language being Python?

Yes because in the current code oedata are generated in PythonSH. But I don't see a reason why this couldn't be extended to other languages. You would just need to add oedata to the block in xxxxxSH

If the tests pass, this is ready for review.

I'm doing some manual testing and things are looking good. I can even name a cell Unnamed Cell and I don't get in trouble.
Here's a weird one. Currently on master with the recently merged outliner updater, I can type this:
# %% cell group
# %% Nested cell

and then add a % to the second line like this:
# %% cell group
# %%% Nested cell

and the nested cell is nested in the outliner tree as it should be, but with this PR the cell nesting can't be changed without closing and reopening the file.

I'm doing some manual testing and things are looking good. I can even name a cell Unnamed Cell and I don't get in trouble.
Here's a weird one. Currently on master with the recently merged outliner updater, I can type this:
# %% cell group
# %% Nested cell

and then add a % to the second line like this:
# %% cell group
# %%% Nested cell

and the nested cell is nested in the outliner tree as it should be, but with this PR the cell nesting can't be changed without closing and reopening the file.

FIxed

@impact27, this has a conflict with master now. Please fix it.

done

I'll also wait for @bcolsen's approval here.

I will add this as a test:

Could you rerun the failing tests?

Tests seem to be failing now here.

@ccordoba12 If it has something to do with my suggested changes rather than 8890b84a0d, the only thing I can think of that it could possibly be is something really weird with this suggestion or this one as they are the only ones that could potentially have any functional impact that I can see.

rerunning the tests as the failing is for "resources temporary unavailable".

ModuleNotFoundError: No module named 'fcntl'
I don't believe I added an import to this module.

The failure in Windows/Python 3.7 is unrelated to this PR, don't worry about it.

@impact27, this requires now a merge with master to solve the merge conflicts.
@bcolsen, I think this is ready for review again.


⚠ Bofrost.at has degraded performance

In ff05fb9, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1815 ms

Resolved: Bofrost.at performance has improved in 9f11d16 after 7 minutes.


CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 117 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
CUDA SETUP: Something unexpected happened. Please compile from source:
git clone git@github.com:TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=117 make cuda11x
python setup.py install
Traceback (most recent call last):
File "/root/magaoxiang/finetune.py", line 9, in
from peft import get_peft_model, LoraConfig, TaskType
File "/usr/local/lib/python3.9/site-packages/peft/init.py", line 22, in
from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING, PEFT_TYPE_TO_CONFIG_MAPPING, get_peft_config, get_peft_model
File "/usr/local/lib/python3.9/site-packages/peft/mapping.py", line 16, in
from .peft_model import (
File "/usr/local/lib/python3.9/site-packages/peft/peft_model.py", line 31, in
from .tuners import LoraModel, PrefixEncoder, PromptEmbedding, PromptEncoder
File "/usr/local/lib/python3.9/site-packages/peft/tuners/init.py", line 20, in
from .lora import LoraConfig, LoraModel
File "/usr/local/lib/python3.9/site-packages/peft/tuners/lora.py", line 36, in
import bitsandbytes as bnb
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/init.py", line 7, in
from .autograd._functions import (
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/init.py", line 1, in
from ._functions import undo_layout, get_inverse_transform_indices
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/_functions.py", line 9, in
import bitsandbytes.functional as F
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/functional.py", line 17, in
from .cextension import COMPILED_WITH_CUDA, lib
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/cextension.py", line 22, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues

有人遇到过这种问题么

问题不太一样，用另外的方案绕过了

问题不太一样，用另外的方案绕过了

什么方案？

我也遇到了这个问题，请问什么方案可以绕过？

问题不太一样，用另外的方案绕过了

请问什么方案可以绕过？

问题不太一样，用另外的方案绕过了

请问什么方案可以绕过？
我的问题类似，用这个办法解决的：
https://github.com/mymusise/ChatGLM-Tuning/issues/117

你这个117也没解决啊

export LD_LIBRARY_PATH=/mnt/storage/anaconda3/lib:$LD_LIBRARY_PATH
ubuntu在环境中增加这个可解决。路径酌情修改

我觉得问题的核心在这里
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
可以通过更新libstdc++.so.6的版本，来解决上述问题
亲测，可用


Configure Android APK build and release action

We should have a just command to build the APK.
We started with this here https://github.com/get10101/10101/pull/343 but due to re-prioritization it was never finished.
We should configure the APK release as part of the release action in GitHub.
In https://github.com/get10101/10101/pull/497 we deactivate the APK build because the artifact is not showing up in the release at the moment.

I wouldn't release an apk but rather an android app bundle so we can use the analogue of apples TestFlight.


Integrate Emoji One

Beautiful. http://www.emojione.com/

Any news on this?

I got started on it, then ran out of time and energy to work on it. Here's what I've done; it's not much and it doesn't really work. :disappointed:
https://github.com/philtr/emoji/commits/emoji-one

I'm still recovering from the acquisition and the baby, but happy to help if there are any particular questions or issues you guys run into.


SDF output is missing mux timing

The current BEL timing fuzzer is not documenting BEL routing muxes, e.g. [ABCD]OUTMUX.  For example F7A -> AOUT is at bel_d_sm_f7amux_amux.

@kgugala FYI

I can confirm this. The fuzzer uses Vivado's get_bels function to get all the BELs inside the processed site. This function returns only regular BELs (not routing bels)

Dumping all the speed_models in a device gets routing bels models. I need to find a way to correlate speed_models with BELs


Problem install nodejs and npm

Hello,
I would like to use in my computer the Deep playground script for an interactive visualization of neural networks.
I try to run the visualization locally, run.
I my environment is on Pyhton 3.8 with Anaconda 3.
What is the method to run the Deep Playground.
I try to install the package using these command :
npm i to install dependencies
npm run build to compile the app and place it in the dist/ directory
npm run serve to serve from the dist/ directory and open a page on your browser.
But I don't understand why it doesn't work.
Do you have the method to install these package into Anaconda Environment ?
Thanks,
Pierre-François.

This is not a Python program, so your Python environment doesn't matter here. Did you install node on your computer? Do that, then clone this repo, go to the playground directory, and run npm i again.


Authorization via twitter oauth

There is a problem with authorization via twitter in android application imported into Fabric project connected as it is written in the docks, and hung their callbacks to get a token for use on the server. And like all good, even once it worked, but given the same token that has expired, and to them I can no longer use. I tried to remove the app, it is useless all exactly the same outdated token gives me. Here is the code that I'm trying to get the token:
Twitter.getSessionManager().clearActiveSession();
TwitterCore.getInstance().logIn(this, new com.twitter.sdk.android.core.Callback<TwitterSession>() {
	@Override
	public void success(Result<TwitterSession> twitterSessionResult) {
		String token = twitterSessionResult.data.getAuthToken().token;
		if (token != null) {
			authService(token, "twitter");
		} else {
			Toast.makeText(LoginActivity.this,
					"Не удалось установить соеденения с Twitter", Toast.LENGTH_LONG).show();
		}
	}

	@Override
	public void failure(TwitterException e) {
		Toast.makeText(LoginActivity.this,
				"Не удалось установить соеденения с Twitter", Toast.LENGTH_LONG).show();
	}
});

For information on the token I get using:
https://api.twitter.com/oauth/authorize?oauth_token=token
How can I fix it to always return a new token?

Hi there, you might want to ask this question on our developer forums rather than here on the code repo, if you're not reporting an issue with the code itself.

Yes, I think you're right.
Thank you.


feat: optimize maintainer to let sessions be GC'ed instead of deleted

Optimizes the session pool maintainer to:

Let the backend garbage collect sessions instead of explicitly deleting them. This reduces the number of RPCs needed.
Only keep MinSessions + MaxIdleSessions alive in the session pool. Let all other sessions automatically expire and remove these from the pool if they are not being used. This reduces the required number of RPCs to keep sessions alive.

@skuruppu This repo does not need a PR approval before merging. Do we need to change the config?

@olavloite (3) can be reverted, because it turns out SELECT 1 is better.

I see why it doesn't need a PR approval because this is not going to merge into master. Only merging into master requires an approval.

@olavloite (3) can be reverted because it turns out SELECT 1 is better.

Done

I see why it doesn't need a PR approval because this is not going to merge into master. Only merging into master requires an approval.

I based this PR on the PR for batch increasing sessions in the pool, as that PR already includes the dependencies and setup for the benchmarking. It's best to merge that PR first into master, and then rebase this PR on master once that's been done.

Thanks for the changes @olavloite. Please merge if you think it's ready to go. After that, I'll try to cut a release since we haven't done one in a while.


How can I use imnames.cp ?

I downloaded it but don't know how to use or read it

What would you want to use it for?

@taestaes : added sample code here.


vale: 2.9.1 -> 2.10.2

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[x] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 118001 run on x86_64-linux 1

1 package built:

vale

Result of nixpkgs-review pr 118001 run on x86_64-darwin 1

1 package built:

vale


Why FSDP is much slower than normal data Parallel?

❓ Questions and Help
Before asking:

search the issues.
search the docs.

What is your question?
I change the ddp-backend from no_c10d to fully_sharded as it is said to be more efficient. But the training speed is much slower than the origin one. It took 5 minutes to train 100 steps in the origin ddp-backend, but it will take 18 minutes when using FSDP.
Code
In ddp-backend=no_c10d:
2022-06-28 16:11:33 | INFO | train_inner | epoch 001:   5639 / 42117 loss=5.111, nll_loss=3.228, ppl=9.37, wps=156839, ups=0.35, wpb=448862, bsz=20586, num_updates=5600, lr=0.000422577, gnorm=0.188, loss_scale=8, train_wall=276, gb_free=11.6, wall=17835
2022-06-28 16:16:20 | INFO | train_inner | epoch 001:   5739 / 42117 loss=5.105, nll_loss=3.221, ppl=9.32, wps=156115, ups=0.35, wpb=449261, bsz=20598.5, num_updates=5700, lr=0.000418854, gnorm=0.191, loss_scale=8, train_wall=278, gb_free=12.1, wall=18123
2022-06-28 16:21:05 | INFO | train_inner | epoch 001:   5839 / 42117 loss=5.082, nll_loss=3.196, ppl=9.17, wps=157603, ups=0.35, wpb=448412, bsz=20614.2, num_updates=5800, lr=0.000415227, gnorm=0.188, loss_scale=16, train_wall=276, gb_free=12.6, wall=18407

While in ddp-backend=fully_sharded:
2022-07-01 05:53:19 | INFO | train_inner | epoch 001:  41351 / 42117 loss=4.451, nll_loss=2.52, ppl=5.74, wps=41767.9, ups=0.09, wpb=451067, bsz=20620.8, num_updates=1100, lr=0.000137573, gnorm=0.092, loss_scale=16, train_wall=1070, gb_free=21, wall=0
2022-07-01 06:11:27 | INFO | train_inner | epoch 001:  41451 / 42117 loss=4.458, nll_loss=2.528, ppl=5.77, wps=41119.9, ups=0.09, wpb=447612, bsz=20585.2, num_updates=1200, lr=0.00015007, gnorm=0.094, loss_scale=16, train_wall=1079, gb_free=21.2, wall=0
2022-07-01 06:29:30 | INFO | train_inner | epoch 001:  41551 / 42117 loss=4.453, nll_loss=2.523, ppl=5.75, wps=41404.2, ups=0.09, wpb=448513, bsz=20568.7, num_updates=1300, lr=0.000162568, gnorm=0.098, loss_scale=32, train_wall=1074, gb_free=22, wall=0

What have you tried?
What's your environment?

fairseq Version (e.g., 1.0 or main): main
PyTorch Version (e.g., 1.0) 1.10
OS (e.g., Linux):
How you installed fairseq (pip, source):
Build command you used (if compiling from source):
Python version: 3.8
CUDA/cuDNN version: 11.3
GPU models and configuration: A100
Any other relevant information:

How do you conduct the parallel excution?
I am not so sure but it seems that qsub results a slower excution, while qsub makes fsdp and no_c10d the same speed.

How do you conduct the parallel excution?
I am not so sure but it seems that qsub results a slower excution, while qrsh makes fsdp and no_c10d the same speed.

Thanks for your reply.
This is my scripts:

No, it is not this script.
It is one step before this excution.
Since there is a nnodes there, are you using some cloud service for computation?
Then how do you submit your job?
It feels like using openmpi slows down fsdp, while a direct ssh communication will keep fsdp the same speed as no_c10d

No, it is not this script. It is one step before this excution.
Since there is a nnodes there, are you using some cloud service for computation? Then how do you submit your job? How do you link nodes so as to work together? It feels like using openmpi slows down fsdp, while a direct ssh communication will keep fsdp the same speed as no_c10d

Yes, I am using an in-house platform to run the training jobs for deep learning. I need to set how many GPUs and memory I need and give a start script like the above, and parameters like WORLD_SIZE, RANK, and ADDR is set by the platform.
About the openmpi, do you mean OMP_NUM_THREADS=20 will slow down the FSDP?

It is not OMP, openmp is used inside one node. MPI is what used between nodes communication.
How do you submit job to your in-house platform?
Are you connecting to each node by yourself and run torch.distributed.launch ?
or you use a command like "mpirun" to command nodes to excute torch.distributed.launch?
What I experienced is, I used mpirun to call nodes to excute torch.distributed... -> very slow.
Then, I directly ssh each node and excute torchrun -> acceptable speed ( as 80% fast as no_c10d, it also depends on your optimizer, cpu_adam was faster in my case)
A different point, use torchrun --nproc_per_node=$NPROC_PER_NODE --nnodes=$NNODES --master_addr=$MASTER_HOST instead. They are basically the same but torchrun is newer.
--
If what I wrote above does not ring a bell, I am sorry. I would recommend you to email or @ who implemented FSDP and ask them which platform they use to test the code.


paintcode.rb: updated url, app name and changed version to :latest

Reference:
https://github.com/caskroom/homebrew-cask/commit/3780e8a6bb598f75392a0242daa42246dc681403

Updated @vitorgalvao, thanks for the hint.

Thank you. Could you please squash your commits?

Squashed and updated from caskroom/homebrew-cask

Thank you for the contribution. It was merged directly as 4428acedc52b94586f4be2d5c16ddd4a9b801ab7 to keep commit history cleaner. Your contribution is still credited to you.


What's the best way to use this package to get a long list of tweet ids?

Looking to get a list of a couple hundred thousand tweets which I have in a list of IDs, and wasn't sure if there was a better way with this package rather than running individual requests for each ID.

Unfortunately, there is no such method for fetching the details, given a list of Tweet IDs. The only way is to make different requests.
I am willing to work on this feature, but I first need to evaluate the practicality of this, because it's not often that a user has obtained a bunch of Tweet IDs before-hand and is using this library to fetch their details. Are there some examples of it?

Got it.
The best use case I have is for building existing data sets of tweets, legally speaking you're not supposed to publish the tweets themselves, but rather a list of the tweet IDs. So if you're working with Twitter datasets, you need to turn a list of IDs into a dataframe of tweets. I think a lot of people use Hydrator now, but your package has a lot of nice functionality they don't.
If you want to see some of those datasets, I think a lot of academic papers reference them

Okay so functionality that is needed is basically providing a way to fetch the details of a list of tweet id right?

Yup! A major issue with the existing solutions for this kinda thing is they
run into like IP blocks and stuff so if you had a way around that it would
be a big value add. I’d check out retwitt/hydrator for an example.
On Fri, Feb 17, 2023 at 2:20 AM Rishikant Sahu @.***>
wrote:

Okay so functionality that is needed is basically providing a way to fetch
the details of a list of tweet id right?
—
Reply to this email directly, view it on GitHub
https://github.com/Rishikant181/Rettiwt-API/issues/241#issuecomment-1434215357,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUCBE2VZFUC65WITINSQ2L3WX4RFTANCNFSM6AAAAAAUXCGHSQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

Got it.
I'll start working on it. Thanks for the feedback!

Good luck! Great package by the way!
On Fri, Feb 17, 2023 at 2:32 AM Rishikant Sahu @.***>
wrote:

Got it.
I'll start working on it. Thanks for the feedback!
—
Reply to this email directly, view it on GitHub
https://github.com/Rishikant181/Rettiwt-API/issues/241#issuecomment-1434234926,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUCBE2UQDEWEFROIUGUDI7LWX4SPPANCNFSM6AAAAAAUXCGHSQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

Okay so I tried to add functionality to fetch details of multiple Tweet IDs, but the problem is that it doesn't actually do anything better than looping over the method to get details of one tweet. Furthermore, it makes the error handling when fetching details of any single tweet from the list of IDs fails, owing to the absence of the tweet.
The best way to fetch the details of a list of Tweet IDs remains looping over the IDs and calling the method for each ID.


Generalise Translator::translate

Currently, we have translate_int() and translate_bool().  But, in fact, we could have just translate() which returns a Dynamic.

Completed as part of #8


GitHub Error Page on http://pear.magetool.co.uk/channel.xml

http://pear.magetool.co.uk/channel.xml is not available and it's not the port issue this time, the URL returns a GitHub error page:

Page does not exist! Read the Full Documentation
Instructions for setting up username.github.com *
...

Hi,
This seems to be a GitHub issue. I'm looking into it.. If you need the pear package urgently I can email it.
Alistair

Hi,
thanks, that would be nice, unless you can fix the issue immediately. My email: fschmengler (α) sgh-it.eu
Regards,
Fabian


[WIP] Allow parameterized builds

Check for set S1B_KERNEL_VERSION and only fallback to default.

Allows us to trigger builds with e.g.
cat <<EOF | curl -sSL -H "Content-Type: application/json" -d @- "https://circleci.com/api/v1.1/project/github/kinvolk/stage1-builder/tree/master?circle-token=${api_token}"
{
  "build_parameters": {
    "S1B_KERNEL_VERSION": "$1"
  }
}
EOF

Is it too crazy to make it work for a list of versions?

Tested manually with --stage1-name=kinvolk.io/aci/rkt/stage1-kvm:1.23.0,kernelversion=4.9.9, works.

Is it too crazy to make it work for a list of versions?

Not crazy I think :) But would love to merge this as is and do it in a later PR. (Since I need it to test automatically triggered builds when a new kernel was release..)

lgtm


Configurable regexes

It would be nice if the regexes could be configured per-repo.
(So that the tool can adapt to the workflow and not the other way around ;))
Examples of commonly used variants in our repo:
Blocked by: #xxx
Merge after: #yyy
Depends on: #zzz

Hey @ulope  . I was able to build a new GitHub action to replaces this bot.
The new action is more robust and has a few more features like customizing the label, and supporting dependencies from any repository. You can even your own keywords as you requested here :tada:
Please check it out at https://github.com/z0al/dependent-issues
This bot is now deprecated and I will be archiving this repository in the upcoming days. Thanks.

That looks very nice!
Thanks for the heads up.


generate_data_parallel.py hangs with pool.apply_async(), but not when called in the main thread.

By naively following the installation instructions, I'm finding that this line hangs when running with multiprocessing, but not when running in the main thread.
Would it be possible to list the full conda environment you used, by running conda list -e > requirements.txt?
For example, I would be interested to know which versions of python, Open3D and multiprocessing you used.
Any help appreciated :)

Hi, I add the conda environment description here. BTW, I suggest debugging the data generation process with --num-proc 1 argument to set it to single process.

Thanks for sending over! Unfortunately using your conda environment didn't help, and setting --num-proc 1 still causes it to hang. The only way I can get it to run is remove mp.Pool() entirely and call main() explicitly. I'll leave this issue open and further investigate, and then close with the solution once I work out what's going on.

Sorry about that. What script are you running? generate_data_parallel.py or construct_dataset_parallel.py?

generate_data_parallel.py. Could still just be something silly on my end, will post my findings either way!

Multiprocessing issues with Open3D seem relatively common: a, b, c.
I took a look at how Open3D apply parallelism for batch-processing in their own examples, and they use joblib.
Replacing lines 195-202 with:
from joblib import Parallel, delayed
Parallel(n_jobs=parsed_args.num_proc)(delayed(main)(parsed_args, i) for i in range(parsed_args.num_proc))`

Fixed the problem for me. Hopefully this helps others who may get stuck with similar issues.

Hi, I also try python scripts/generate_data_parallel.py --scene pile --object-set pile/train --num-grasps 4000000 --num-proc 40 --save-scene ./data/pile/data_pile_train_random_raw_4M to generate the data, but the terminal show nothing but pybullet build time:……, I also set --num-proc to 1 to debug, but it didn't work. Then I use vscode to debug, find that is maybe caused by multiprocess. I tried @djl11 's solution, but nothing changed. So i reinstall the conda env, The script runs, but gets stuck somewhere after generating some data. May I have your help please?
Thanks for help. @djl11 @Steve-Tod


Is it possible to programatically change step outside of component?

I have a navigation outside of the StepZilla component that corresponds with the steps, but need to control the steps from outside the StepZilla component. I see the jumpToStep utility, but that can only be triggered from inside.
Thanks and great job on the component!

Maybe with jumpToStep() ?

jumpToStep() can only be called inside step component. I do believe this is a limitation of StepZilla, I ran into the same situation, even though I can work around by passing jumpToStep() outside but it's a ugly solution. No official solution so far. This is a very common use case.

Are there some news about this problem/limitation ?

jumpToStep() can only be called inside step component. I do believe this is a limitation of StepZilla, I ran into the same situation, even though I can work around by passing jumpToStep() outside but it's a ugly solution. No official solution so far. This is a very common use case.

how did you manage to do that..  please help! @nttoan26


Set up automated testing on hardware

Over the coming weeks we will come up with a plan for adding automated testing on hardware for this repository, likely as a scheduled workflow.
As the path forward becomes more clear I will continue to update this issue with information and tasks as needed.

[x] Set up a self-hosted runner with the required devices physically connected

[ ] Come up with a full list of required devices and ensure all are connected

[ ] Create a workflow for Github Actions to invoke the testing process

A self-hosted runner has been set up with a number of devices connected to it.

For reference, here is the test suite that esptool is currently using: https://github.com/espressif/esptool/blob/master/test/test_esptool.py

New updates for HIL testing
Test branch - https://github.com/esp-rs/espflash/tree/test/hil
Problem with standard input
Github Actions are designed for non-interactive use and
workflows will not be able to provide input to running commands.
TTY is not allocated for the remote session created by Github Actions,
so there isn't any terminal / device connected to standard input.
When espflash monitor or espflash flash --monitor <IMAGE> commands are executed,
they start listening to the key input from the keyboard:
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

If there is no input connected, it fails immediately with next error:
Error:   × Failed to initialize input reader

You can easily reproduce this error in your terminal by running one of the following commands:
exec 0< /dev/null
exec 0<&-
exec 0>&-

And then run espflash monitor on some port.
script workaround
There is workaround which prepares TTY for Github Actions workflow steps - https://github.com/gfx/example-github-actions-with-tty?tab=readme-ov-file
Related issue - https://github.com/actions/runner/issues/241
Example:
  - name: monitor test
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    shell: 'script -qec "bash {0}"'
    run: timeout 10s espflash_app/espflash monitor

It works fine, but it's still not what we need.
We must reset chip to start monitoring, but it's imposible, because there is no interaction.
* Important note from script command man page:
It is not recommended to run script in non-interactive shells.  The inner shell of script
is always interactive, and this could lead to unexpected results.

Reset solution
New feature with before and after arguments allows to monitor a target without reseting it - https://github.com/esp-rs/espflash/pull/561
Updated workflow step:
  - name: monitor test
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    shell: 'script -qec "bash {0}"'
    run: timeout 10s espflash_app/espflash monitor -b no-reset-no-sync -c ${{ matrix.board }}

Now espflash monitor may give some output after flashing to serial port.
Serial port output is missing
Github Actions doesn't show output from serial port.
So the program is actually running, but there's no way to verify that.
This only happens when running through the commands: espflash monitor and espflash flash --monitor <IMAGE>
Here are some examples:
espflash flash
espflash_app/espflash flash --port /dev/ttyUSB0 espflash/esp32s3_app/hello_world

Expected output:
[2024-02-01T11:10:44Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:10:44Z INFO ] Connecting...
[2024-02-01T11:10:44Z INFO ] Using flash stub
Chip type:         esp32s3 (revision v0.1)
Crystal frequency: 40 MHz
Flash size:        8MB
Features:          WiFi, BLE
MAC address:       f4:12:fa:40:56:ac
App/part. size:    92,432/1,048,576 bytes, 8.82%
[00:00:00] [========================================]      13/13      0x0
[00:00:00] [========================================]       1/1       0x8000
[00:00:00] [========================================]      22/22      0x10000
[2024-02-01T11:10:46Z INFO ] Flashing has completed!

Result:
[2024-02-01T11:10:44Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:10:44Z INFO ] Connecting...
[2024-02-01T11:10:44Z INFO ] Using flash stub
Chip type:         esp32s3 (revision v0.1)
Crystal frequency: 40 MHz
Flash size:        8MB
Features:          WiFi, BLE
MAC address:       f4:12:fa:40:56:ac
App/part. size:    92,432/1,048,576 bytes, 8.82%
[2024-02-01T11:10:46Z INFO ] Flashing has completed!

espflash monitor
espflash_app/espflash monitor -b no-reset-no-sync -c esp32c3 --port /dev/ttyUSB0

Expected output:
[2024-02-01T11:12:56Z WARN ] Pre-connection option 'NoResetNoSync' was selected. Connection may fail if the chip is not in bootloader or flasher stub mode.
[2024-02-01T11:12:56Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:12:56Z INFO ] Connecting...
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

Hello world!
Hello world!
Hello world!
Hello world!
Hello world!

Result:
[2024-02-01T11:12:56Z WARN ] Pre-connection option 'NoResetNoSync' was selected. Connection may fail if the chip is not in bootloader or flasher stub mode.
[2024-02-01T11:12:56Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:12:56Z INFO ] Connecting...
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

cat alternative
However, if we read the contents of the port using the cat command, it will work.
Example:
  - name: cat serial port
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    run: timeout 5s cat ${{ env.ESPFLASH_PORT }}

But this way we can't verify espflash subcommands.

New updates for HIL testing
Test branch - https://github.com/esp-rs/espflash/tree/test/hil
Problem with standard input
Github Actions are designed for non-interactive use and
workflows will not be able to provide input to running commands.
TTY is not allocated for the remote session created by Github Actions,
so there isn't any terminal / device connected to standard input.
When espflash monitor or espflash flash --monitor <IMAGE> commands are executed,
they start listening to the key input from the keyboard:
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

If there is no input connected, it fails immediately with next error:
Error:   × Failed to initialize input reader

You can easily reproduce this error in your terminal by running one of the following commands:
exec 0< /dev/null
exec 0<&-
exec 0>&-

And then run espflash monitor on some port.
script workaround
There is workaround which prepares TTY for Github Actions workflow steps - https://github.com/gfx/example-github-actions-with-tty?tab=readme-ov-file
Related issue - https://github.com/actions/runner/issues/241
Example:
  - name: monitor test
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    shell: 'script -qec "bash {0}"'
    run: timeout 10s espflash_app/espflash monitor

It works fine, but it's still not what we need.
We must reset chip to start monitoring, but it's imposible, because there is no interaction.
* Important note from script command man page:
It is not recommended to run script in non-interactive shells.  The inner shell of script
is always interactive, and this could lead to unexpected results.

Reset solution
New feature with before and after arguments allows to monitor a target without reseting it - https://github.com/esp-rs/espflash/pull/561
Updated workflow step:
  - name: monitor test
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    shell: 'script -qec "bash {0}"'
    run: timeout 10s espflash_app/espflash monitor -b no-reset-no-sync -c ${{ matrix.board }}

Now espflash monitor may give some output after flashing to serial port.
Serial port output is missing
Github Actions doesn't show output from serial port.
So the program is actually running, but there's no way to verify that.
This only happens when running through the commands: espflash monitor and espflash flash --monitor <IMAGE>
Here are some examples:
espflash flash
espflash_app/espflash flash --port /dev/ttyUSB0 espflash/esp32s3_app/hello_world

Expected output:
[2024-02-01T11:10:44Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:10:44Z INFO ] Connecting...
[2024-02-01T11:10:44Z INFO ] Using flash stub
Chip type:         esp32s3 (revision v0.1)
Crystal frequency: 40 MHz
Flash size:        8MB
Features:          WiFi, BLE
MAC address:       f4:12:fa:40:56:ac
App/part. size:    92,432/1,048,576 bytes, 8.82%
[00:00:00] [========================================]      13/13      0x0
[00:00:00] [========================================]       1/1       0x8000
[00:00:00] [========================================]      22/22      0x10000
[2024-02-01T11:10:46Z INFO ] Flashing has completed!

Result:
[2024-02-01T11:10:44Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:10:44Z INFO ] Connecting...
[2024-02-01T11:10:44Z INFO ] Using flash stub
Chip type:         esp32s3 (revision v0.1)
Crystal frequency: 40 MHz
Flash size:        8MB
Features:          WiFi, BLE
MAC address:       f4:12:fa:40:56:ac
App/part. size:    92,432/1,048,576 bytes, 8.82%
[2024-02-01T11:10:46Z INFO ] Flashing has completed!

espflash monitor
espflash_app/espflash monitor -b no-reset-no-sync -c esp32c3 --port /dev/ttyUSB0

Expected output:
[2024-02-01T11:12:56Z WARN ] Pre-connection option 'NoResetNoSync' was selected. Connection may fail if the chip is not in bootloader or flasher stub mode.
[2024-02-01T11:12:56Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:12:56Z INFO ] Connecting...
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

Hello world!
Hello world!
Hello world!
Hello world!
Hello world!

Result:
[2024-02-01T11:12:56Z WARN ] Pre-connection option 'NoResetNoSync' was selected. Connection may fail if the chip is not in bootloader or flasher stub mode.
[2024-02-01T11:12:56Z INFO ] Serial port: '/dev/ttyUSB0'
[2024-02-01T11:12:56Z INFO ] Connecting...
Commands:
    CTRL+R    Reset chip
    CTRL+C    Exit

cat alternative
However, if we read the contents of the port using the cat command, it will work.
Example:
  - name: cat serial port
    env:
      ESPFLASH_PORT: /dev/serial_ports/${{ matrix.board }}
    run: timeout 5s cat ${{ env.ESPFLASH_PORT }}

But this way we can't verify espflash subcommands.


Mixed Precision in LuxLib rules

@penelopeysm discovered in https://github.com/TuringLang/docs/pull/559#discussion_r1857551478 that Mooncake's current rule for matrix-matrix multiplication in LuxLib doesn't successfully handle the case that the two input arrays contain numbers at different precisions.
It really shouldn't be too hard to handle this properly -- we would just need to re-write the current from_rrule implementations of the various variants of matrix-matrix multiplication found around here to have proper Mooncake rules which

define is_primitive for arrays whose elements are subtypes of IEEEFloat, and
define the rrule!s in such a way that ensures the correct element-type is adhered to.
add a method of rrule!! which is a catch-all for all other element types, which always errors with some kind of sensible error message that users can make use of to know how to modify their code.

Note: this is also a great opportunity to ensure excellent performance in Lux.jl -- the current implementations of the rules involve more allocations than are really needed, because we do not increment the gradients in-place.

Hmmm good point. I'll move this there.


Uncaught TypeError: Cannot read property 'jQuery1495146417417' of null

When pressing the "Show redirects" checkbox I get the following error in the javascript console:
DojoDashboardCompatibility.js:1 Uncaught TypeError: Cannot read property 'jQuery1495146417417' of null
at Function.data (DojoDashboardCompatibility.js:1)
at init.delegate (DojoDashboardCompatibility.js:6)
at HTMLFormElement. (DojoDashboardCompatibility.js:7)
at HTMLFormElement.handle (DojoDashboardCompatibility.js:2)
at HTMLFormElement. (DojoDashboardCompatibility.js:1)
using EPiServer.CMS 10.9.1 and BVN.404Handler 10.1.1

I am not able to reproduce this.  Do you have this issue in all your projects or just one?

Closing as no updates on this.


Gene list errors

Always pass case_ids to the template (also after loading gene list)
Adress #93

:+1:


Swap UI fail (getBalance?)

Describe the bug
Seeing a new bug in Swap UI
https://d1h9h37hgxfzvk.cloudfront.net/swap/ETH-on-arbitrum?from=WETH
d1h9h37hgxfzvk.cloudfront.net-1671816680568.log

Looks fixed - closing


Nuxt with netlify-edge preset getting 404 error with no error in logs

Environment
Nuxt 3.3.2, SSR, netlify-edge preset
Reproduction
Clear installation of Nuxt deployed to Netlify with preset: 'netlify-edge'
Describe the bug
Running Nuxt 3.3.2, SSR on Netlify with netlify-edge preset. When opening website URL I got Netlify 404 error. In logs no errors and in Edge Functions part:
11:47:41 AM:   2. Edge Functions bundling
11:47:41 AM: ────────────────────────────────────────────────────────────────
11:47:41 AM:
11:47:41 AM:
11:47:41 AM: (Edge Functions bundling completed in 494ms)

Paths to files are the same as in preset: 'netlify', and this preset is working.
@danielroe Did the same reproduction on one of his performance streams. Localy edge functions are generated, on Netlify nothing.
Additional context
No response
Logs
No response

I get the same error when using netlify-edge preset. What is the fix ? Sorry, was not sure what to make of issue-up response above...

I didn't find solution to that, I think that is a Nitro issue, but there in my case there is no errors in Netlify, so it's hard to debug that. vercel-edge is working.


Update Composer dependencies (2021-11-03-00-03)

Visual regression test passed!
View the visual regression test report


fix(tabs): increased specificity of the mobile css class

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 82.475%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
5178

Relevant Lines:
5829

💛  - Coveralls


[WFLY-14365] Programmatic web authentication (HttpServletRequest.login()) does not trigger sso

As with the PRs to WildFly Elytron and Elytron Web I am submitting this as a draft PR as there is some follow up work required which I will likely complete just after feature freeze but as clustered SSO is a sensitive area of code I would like to get reviews started in case a different strategy is needed.
This PR depends on the following PRs so will not compile without component upgrades:
https://github.com/wildfly-security/wildfly-elytron/pull/1483
https://github.com/wildfly-security/elytron-web/pull/184
The WildFly changes really cover two areas:

Enabling the use of the ProgrammaticSingleSignOnCache to activate SSO for programmatic authentication.
Adding an additional field to the replicated CachedIdentity to track if the identity was created as a result of programmatic authentication.

https://issues.redhat.com/browse/WFLY-14365

I have submitted the following snapshot-ci runs:
The first run attempts to use the topic branches of WildFly and WildFly Elytron against the master branches of WildFly Core and WildFly - this is to check if the component upgrades can be applied cleanly before applying the WildFly changes.
https://github.com/wildfly/snapshot-ci/issues/12
This second run is the same as the first but uses a topic branch for WildFly with the final changes applied.
https://github.com/wildfly/snapshot-ci/issues/16

I have submitted the following snapshot-ci runs:
The first run attempts to use the topic branches of WildFly and WildFly Elytron against the master branches of WildFly Core and WildFly - this is to check if the component upgrades can be applied cleanly before applying the WildFly changes.
https://github.com/wildfly/snapshot-ci/issues/12
This second run is the same as the first but uses a topic branch for WildFly with the final changes applied.
https://github.com/wildfly/snapshot-ci/issues/16

@darranl If you rebase this with master, I can submit a PR to your branch that adjusts the marshalling code accordingly.

Thanks @pferraro I will do that first today.

@pferraro I have cleaned up this PR.
I have fixed up the compilation failures / test failures I was seeing myself in a normal WildFly run, not sure what else is needed.
In the past I think you said there was an SSO test in the clustering testsuite - next week when I get some time I will try and adapt that to add a programmatic scenario.

@pferraro I have added that field, and learnt the hard way all my editors are nicely configured to refuse to use tabs!!


Moving anchors also moves offets

Godot version
4.0
System information
Windows 10  Ryzen 3,   Redeon VEga
Issue description
Expectation:
Clicking this button should only move the anchors and not the offset.

Instead, it moves both the anchor and the offset.

Steps to reproduce
Select the offset button with the anchor mode toggled.
Select another corner.  Notice the control node moves.  It should not.
Minimal reproduction project
You can do this with any control node.

This is expected. Moving anchors only was possible in Godot 3, but it was a seldom used feature.

The functionality for that button is the same regardless of whether the "Anchor" icon is selected or not.  And once the item moves, the "Anchor" icon deselects itself.   I'm inclined to believe this is a bug in that the move Anchor feature simply isn't functional at the moment.

I feel like this issue is due to the act that Layout Presets now no longer allows you to set offsets

In custom you're allowed to define what the offsets are - positive, negative, etc

if you set a preset - that functionality is now outright removed - it just positions to what it feels is appropriate based on the size of the node.
I feel like this behavior is a regression - as if you use full rect with an actual margin, you have to use custom and manually set everything.  Unlike before where Presets gave you a base to work from.
Ie:  A structure like this now has to be fully manually input:

Because I can no longer use Bottom Wide preset, or TopLeft preset because i need an offset
This should probably be an different issue, but I'm mentioning it because this is what has happened to the functionality of Presets


Move release pipeline to a separate file | chore(release)

I moved the release pipeline out because the tests are sometimes flaky but we may not want them to block the scheduled release. I separated the dev and official releases to use different environments so the official releases can be manually reviewed before uploading to pypi.

Shall we still add some tests after publishing wheels? Testing the built wheel can still be useful.

Sure

Just curious: which test is flaky? #567 this issue?

Yes. They are tracked in https://github.com/microsoft/onnx-script/issues/539


Consider taking the ownership of VSCode extensions

Do you want to request a feature or report a bug?
not a bug nor a feature
The vscode extensions for styled-jsx are unmaintained and incomplete. Take a look at 2 of the most used extensions by community:

https://github.com/iFwu/vscode-styled-jsx
https://github.com/Grimones/vscode-styled-jsx-languageserver

Both are not standard, maintainers abandoned the projects, have many open issues.
For example take a look at https://github.com/iFwu/vscode-styled-jsx/issues/6 that is open since 2 years ago.
The problem of writing a vscode extension for template literal languages (with full autocomplete support) is solved a long time ago. Take a look at https://github.com/styled-components/vscode-styled-components and https://github.com/Microsoft/typescript-styled-plugin. So we can easily write a full functioning extension by forking these 2 projects.
I think editor support is an important factor in adopting a new language or library and vscode is of course the most used editor in the community.
Please also take a look at https://github.com/zeit/next.js/issues/8971

@HosseinAgha I don't disagree with your proposal but I am the only maintainer of this repo and I doubt I'd have the time to work on that and maintain it. I would be happy to link to a repo if you want to work on a modern version though!
I am going to close the issue for now :)

Thanks for answering so fast and maintaining this awesome project.
I think adding the help-wanted tag (and changing the issue's title) would be a better approach so somebody (maybe myself) someday finds this issue and tries to develop a better extension :)

Once we add the extension we will have to maintain, people will report bugs and feature requests, and I don't have time for that. That's why I prefer it to be maintained by the community.


Fix flux tests to clone repository in the right path

Issue #, if available:
Description of changes:
Recent changes in refactoring resulted in the clone path to follow the same path as where we edit the cluster config file for the flux tests, causing the tests to fail. Added the option to override the default path that is set so we don't affect the CLI code as well just for e2e test validations.
Testing (if applicable):
Ran e2e test
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

ah man good catch, thanks for finding and fixing that.

/lgtm

/approve


[Bug] New Graphql query is not active.

Describe the bug
When you add new grahql query, you have to click on other and then return to the new one to active it.
To Reproduce
Steps to reproduce the behavior:

Create new request and set type to Graphql
Write one named query, example:

mutation query1 {
  query(id: "ID") {
    id
    name
  }
}

Click send
Add second query

mutation query1 {
  query(id: "ID") {
    id
    name
  }
}

Click send and got following error:

{
  "errors": [
    {
      "message": "operation  not found"
    }
  ],
  "data": null
}

If you click on the first query/mutation and go back to the second. The second one will be correct and will be processed.
Expected behavior
The fresh query/mutation should be ready to use without "deactivating -> activating" flow.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: macOS 10.15.1
App Version 7.0.6 (<IP_ADDRESS>58)

Additional context
Video:
https://imgur.com/a/HvSgg71

Hi
Looks like it is a duplicate of #1856 which was already fixed.

Yep it's fixed but not yet released.


[SCB-401]keep pull strategy always alive whatever watch strategy state

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] Format the pull request title like [SCB-XXX] Fixes bug in ApproximateQuantiles, where you replace SCB-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean install to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

we keep pull stategy always work ,no matter watch switch open or not
@liubao68 @wujimin @weichao666 @WillemJiang

Coverage decreased (-0.001%) to 87.214% when pulling f92a771be0330ce2921e700eef01e18d2420a666 on mt-monster:master into 2231ed6450cfe6cfe58afe6f964be8df1234080b on apache:master.


Add len(PORTS) limit for containers

If provided port range in UI / API is correct, but bigger than 10, it should return an error.
For testing purposes, we checking negative scenarios:
80-89 - accepted
80-90 - should give an error
80,81,82,83,84,85,86,87,88,89,90 - should give an error.

API -Done


unable to call any kpi function due to this bug

https://github.com/HichamJohra/energy_flexibility_kpis/blob/307844ca144a00f8a3498e08d739b42bfb770b9d/energy_flexibility_kpis/variable.py#L446
Getting this error:
TypeError: init() missing 2 required positional arguments: 'primitive_type' and 'value_type'

@ZhelunChen  thanks for catching this. It's been fixed now.


Maximum Area of a Piece of Cake After Horizontal and Vertical Cuts

Aim
To solve the Leetcode problem "Maximum Area of a Piece of Cake After Horizontal and Vertical Cuts" in C++.
Details
You are given a rectangular cake of size h x w and two arrays of integers horizontalCuts and verticalCuts where:
horizontalCuts[i] is the distance from the top of the rectangular cake to the ith horizontal cut and similarly, and
verticalCuts[j] is the distance from the left of the rectangular cake to the jth vertical cut.
Return the maximum area of a piece of cake after you cut at each horizontal and vertical position provided in the arrays horizontalCuts and verticalCuts. Since the answer can be a large number, return this modulo 109 + 7.
Programming language

[ ] C
[ ] C++
[ ] Java
[ ] Python

Admins, Please assign me this issue

@Ayush7614  @Amit366 Kindly merge the pr #1242 .

@admins please look at the pr #1242


upgrade 3.11.6

springboot version 2.1.11.RELEASE,upgrdate 3.11.5to 3.11.6,error
java.lang.NoClassDefFoundError: org/springframework/data/redis/connection/RedisStreamCommands
3.11.6 Can it only support springboot verison 2.2

you need to downgrade to redisson-spring-data-21 dependency


fix: sort types

This PR fixes sortTypes func by considering the package when sorting, in case both types have the same name.
Let's say a type Foo exists in v1 and v2.
If we consider only the name (Foo) we can't decide on the order, it will be random from one run to the other.
In this case, we can additionally consider the package, it becomes obvious that v1 should come before v2 and the order is now predictible.
Fixes #350

@sftim i added a more detailed explanation, is it more clear ?

/approve

🤣


More cleaning up.

Merge conflicts :smh:

Merge conflicts :smh:

I know. I merged like 4 or 5 PRs since this PR has been created. 😭


/.auths route is enabled but not used

The pages served have not been customised.
The pages served make no sense.
We should either:

integrate auth into the site
disable the route entirely

Could be addressed by #

Mix and match approach taken.  Unsupported auths are now disabled.  The rest have been redirected with pretty names.


Fixed months being skipped when splash container crashes

Changes Unknown when pulling 83aeda0afd7c6b39891b9a6168f8551eff097da0 on nice-scrapers-finish-fast into ** on master**.


Update cratecast extension

Description

Updated the @raycast/api to the latest version.
Removed deprecated @raycast/api methods to ensure a clean and up-to-date codebase.
Rewrote the index.tsx file to use the latest @raycast/api methods, improving performance and code readability.
Changed the command name from "crates.io Search" to "Search crates".
Added descriptions and icons to the list of crates, providing additional context and visual cues for improved crate identification.
Improved the formatting of downloads, making them more readable.
Added Sceenshot

Screencast

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Do you mind checking this @gleich

looked over the code and looks good to me! also ran ti locally and it seems like all the core features are still working. as long as this is inline with the new API standards, it looks good to me!

@pernielsentikaer please approve!


Question : how to avoid login each time

Hi,
Is it a way to avoid login each time ? (ConsumerKey + ConsumerSecret login).
For example if user authorise the app once, only ask if token is expired.
Thanks in advance !

You can store the returned access token and access secret into the Keychain; and fetch from keychain when you need to access the accounts.


(InvitingGuests/EmailSearch) Adds ability to search for users by email

This is based on https://github.com/oaeproject/Hilary/pull/1203 so that must be reviewed and merged first.

LGTM, some dumb minor feedback

Followed up. @simong when this looks good to you, you can just close this up, as I have it merged with the oaeproject:inviting-guests-target branch, which contains email-verification, tenant email domains, email search... and I think that's it.
When I submit the final inviting-guests branch for review, I will submit it against inviting-guests target so it can be reviewed independently.

This LGTM, I'm not exactly sure whether this needs to go into master or one of the inviting guests branches though..  Assigning to @mrvisser for merging


proposal: x/sync: Use WithCancelCause for errgroup.WithContext

When using errgroup.WithContext, the first non-nil error encountered will cancel the context and then be returned by the next call to Wait. This works well when you actually call Wait, but if that canceled context prevents you from calling Wait, you just get an unhelpful context canceled error.
I believe the new context.WithCancelCause added in 1.20 would fix this, so I propose we use that instead of this context.WithCancel so we can propagate the error here, here, and here.

Seems to have landed without a proposal acceptance but too late to do anything about that now.


Script for fixing broken networks

In some cases it can happen that one obtains a disconnected network due to a failed edge in the benchmarking process.
We would like to provide a script that benchmarking partners can run to add some additional edges to the network that would fix the network.

This should be re-written to NOT use Konnektor, since installing that package into an existing environment could cause trouble.

Zip the results folder


Custom domains

Whats the safest supported way to use a custom remapable domain for a server instead of an IP? Just mapping a domain name and using it doesn't seem to work.

@philkunz The client does support invites (ss://xxx) with domain names rather than IPs. At some point Outline Manager will have support for this but I'm afraid in the meantime you'll have to manually re-write your ss:// URL to replace the IP with a hostname.
Did you already try this? If not, did the invite work for you?

Yeah it is working fine with rewriting the connection Urls. Since we use 1password to get stuff around to people I can just edit them in 1Password before sharing. Btw. are there any plans for a documented and exposed outline server API, that outline manager uses? It would make it much easier to integrate outline into LDAP systems and also to do stuff like IP replacement on the fly.

@philkunz OK sounds like the original issue is resolved - great.
Regarding an API, we do plan to eventually document the API but I'm afraid all that's available right now is this very short guide - but I hope it helps:
https://github.com/Jigsaw-Code/outline-server/tree/master/src/shadowbox#access-keys-management-api


[Feature]请求支持Kafka数据源

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description
Flink团队开发者，你们好！
我们团队准备使用debezium+kafka+flink，dinky管理台的数据源管理能否支持 配置kafka数据源并管理查看topic情况呢？
感谢！
Use case
No response
Related issues
No response
Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

后续会有相关支持


[WFLY-11179]:  Messaging http-acceptor should expose a capability and use it to control dependencies.

Adding a capability and a requirement on http-upgrade-registry

JIRA: https://issues.jboss.org/browse/WFLY-11179

Should be fine, if CI passes

requires core upgrade

retest this please


Godot 4 not supported

Are you able to update this to godot 4?

I tried, but last time I checked the physics in Godot 4 were not stable enough to support this. Feels like the physics engine is lagged behind in stability compared to the rest of the engine. I will give it another shot soon

I checked with 4.1.1 and managed to make it work. I'm converting the files and will make a Godot 4 version available in the coming days! =]

Updated!


Test

Test

Due to personal reasons, the previous maintainers of this package are stepping down and handing the reigns over to me, a long-time contributor to the project and a user of it myself. This is a responsibility I'm very excited about. Furthermore, I'd like to thank @lgandecki ++ for all the work that they've done so far.
Read more about the transfer of ownership here.
The repository has however moved and all outstanding issues are being closed. This is not a reflection of the perceived importance of your reported issue. However, if after upgrading to the new version, you still find there to be an issue, feel free to open up another ticket or comment brlow. Please make sure to read CONTRIBUTING.md before doing so.


Feature Request: State more clearly when the model was trained

Coding and programming languages change very fast. One of the more frustrating parts of Copilot currently is that it seems to still use training data from 2021.  It would be nice if it could use more up to date information so it gives better advice...but that is a separate request from this. This is more about improving communication as a product.
I think this training data limitation needs to be made more clear on Copilot's marketing and communication strategy. This will prevent a lot of frustration when people start using Copilot and think that it will be giving them advice on newer versions of code. Developers often don't specify which version of code they need, so copilot gives whatever it has...which sometimes gives frustrating results.

Make clear when Copilot's training data was done
State Copilot will not give good advice if it requires information that is newer than the training date
Give advice on how to use Copilot in this situation.
Give some idea or roadmap when Github might update the training data.

I like it but am curious how well the LLM uses that information for baselining its knowledge against a given question. We'll look into it.


Move away from array of jobs and cleanup

Looks like Travis is broken for macOS and Foundation broken for Linux. Will look into system libs for starting a Linux process.

Travis is broken right now... 🤔


fix(HyperlinkModal.js): prevent insertion of links if URL is empty

Signed-off-by: Aman Sharma<EMAIL_ADDRESS>Changes

Add a state blankUrlError to keep track of the URL if valid data is entered in the modal.
If the URL is blank, error is displayed something like this:

For further demonstration, here is a screencast:

Flags

Instead of checking if the URL is empty, we should add RegEx to validate if it is a URL or not.

I don't think this is necessary, what is the argument for adding it?

@Michael-Grover If someone accidentally puts an empty link, and didn't undo, I just thought it would be difficult for them to delete those extra characters since it can't be located.

I don't think this is necessary, what is the argument for adding it?

It doesn't make sense for a user to create a link with no URL. We should prevent that I think.

I don't think this is necessary, what is the argument for adding it?

It doesn't make sense for a user to create a link with no URL. We should prevent that I think.

Or maybe we could just disable the "Apply" button if URL field is blank? @Michael-Grover @algomaster99

@DianaLease That also makes sense. But I think flashing an error is more intuitive to the users.

I think disabling the "Apply" button like Diana suggested is sufficient

@Michael-Grover @DianaLease Sure, I will make the required changes.

@algomaster99 Please make sure the change still allows the component to render an empty link. If the user loads a contract or template written directly in markdown (with a link with an empty URL which is allowed) into the editor it should still work.

@jeromesimeon my changes will prevent the user to add an empty link. I can revert these changes in that case but before I do it, can you tell me such use case when an empty URL can be rendered?

@jeromesimeon my changes will prevent the user to add an empty link. I can revert these changes in that case but before I do it, can you tell me such use case when an empty URL can be rendered?

I understand. I'm saying: what if the link is not added through the UI (but pre-exists in the underlying markdown).

@jeromesimeon Okay, that makes sense. I will test that also before submitting the changes.

@jeromesimeon @algomaster99 Your changes shouldn't affect rendering, but you can double check by adding an empty link to the markdown in the demo code (ie [empty link]()) and making sure it still renders.

@DianaLease sure, thanks for the pointer :)

Looks good! Need to rebase again to be up to date with master and we can get this merged in.


Question: Any reason CompositeSpecimenBuilder.ComposeIfMultiple is internal?

The CompositeSpecimenBuilder.ComposeIfMultiple() helper method is marked as internal (source code.
This method is pretty useful if you are creating your custom behavior. Is there any good reason why it's marked as internal? If not - I'd prefer to make it public via PR.
Thanks.

This method is internal because the only purpose it serves is to make AutoFixture's internal object graph a bit prettier. I don't consider that an essential part of what AutoFixture does in order to provide value, so I didn't want to have to support it.
Most 'user code' ought not need this method, because I don't expect 'user code' to build complex subgraphs for AutoFixture. In the rare case where someone might need to do something like that, it's 4 lines of code, which can be easily reproduced.

Ok, I see, there are two reasons: you don't want to support it and method implementation is straightforward.
Well, I feel fine with approach to create a similar method in my code - no issues with that. The only thing which is still confusing me is that making this method internal creates API incompleteness.
AF provides API to add custom behaviors. However, each time you create custom behavior, you will need to implement this method as well. That's because fixture.Behaviors.Add() method expects that you pass instance of the ISpecimenBuilderNode. Regular ISpecimenBuilderNode.Compose() method implementation is following:
ISpecimenBuilderNode Compose(IEnumerable<ISpecimenBuilder> builders)
{
    var innerBuilder = CompositeSpecimenBuilder.ComposeIfMultiple(builders);
    return new This_Type(innerBuilder);
}

Likely, you will always need to reduce array of builders to single builder. I've checked most of Compose() method implementation and found that all them use CompositeSpecimenBuilder.ComposeIfMultiple() method.
If any time you need to create custom behavior you must re-implement the same internal method, that looks like API is incomplete and method should be public - to avoid the same work.
If you still feel that this is not a strong reason to make this method public - feel free to close this question :)
I'm a novice to AF, so let me know if I overlooked something.

Yes, most internal code in AutoFixture uses ComposeIfMultiple, but they don't have to. They only do that to make the internal object graph prettier, which was mainly a concern for me when I originally developed the current engine - it was a bit easier to look at the graph in a debugger that way.
Whether or not you use ComposeIfMultiple doesn't change the behaviour of AutoFixture, so custom implementers don't have to use that method. The behaviour of new CompositeSpecimenBuilder(builder) is identical to the behaviour of builder.

Thank you for the wide explanation. I overlooked that we can simply create CompositeSpecimenBuilder even if it contains single nested builder - no need to reduce it. Due to some reasons (likely, because I read the examples too much) I thought that there are no other ways :)
Therefore, indeed presence of the ComposeIfMultiple method is not such critical as I thought before.
Question can be closed.


Add 9/16 aspect ratio for mobile view

I was using this library to make good-looking screenshots and I didn't find any problem with the aspect ratios for the horizontal ones, but the only vertical option currently is the 3/4. For me, the most suitable vertical aspect ratio (mostly for mobile) is the 9/16 instead of the 3/4.
I left the 3/4 aspect ratio in as I believe it does serve its purpose and just added the 9/16 ratio.
Maybe even allowing the user to enter their own desired aspect ratio would be a nice feature (or having a slider that can do that).

@all-contributors please add @ericvalcik for code


Library request: box2d and gym

gym and Box2D to build a deep Q-Learning agent the stock market
Checklist

[x] I have completely filled out this template
[x] I have confirmed that this issue exists on the current master branch
[x] I have confirmed that this is not a duplicate issue by searching issues

it looks like gym was moved to https://github.com/Farama-Foundation/Gymnasium .

We've added gym to the next release.
Sadly box2d python port is not maintained; we cannot add at this time. We can review once its maintained.


Multiple problems with policy attributes window

Description:

Cannot update applied policy attribute values as the save button is disabled.

Regex validation does not prevent the policy from save. Still, we can save even though validations are colored in red.

Attribute values that previously passed validation shows invalid after save.

Affected Product Version:
4.1.0-alpha
Environment details (with versions):

OS:
Client:
Env (Docker/K8s):

Optional Fields
Related Issues:

Suggested Labels:

Suggested Assignees:

Since none of the reported issues are reproducible with the latest pack, closing this issue.


Reading single grid cells from a multi-file netcdf dataset?

I have a multifile dataset made up of month-long 8-hourly netcdf datasets over nearly 30 years. The files are available from ftp://ftp.ifremer.fr/ifremer/ww3/HINDCAST/GLOBAL/, and I'm spcifically looking at e.g. 1990_CFSR/hs/ww3.199001_hs.nc for each year and month. Each file is about 45Mb, for about 15Gb total.
I want to calculate some lognormal distribution parameters of the Hs variable at each grid point (actually, only a smallish subset of points, using a mask). However, if I load the data with open_mfdataset and try to read a single lat/lon grid cell, my computer tanks, and python gets killed due to running out of memory (I have 16Gb, but even if I only try to open 1 year of data - ~500Mb, python ends up using 27% of my memory).
Is there a way in xarray/dask to force dask to only read single sub-arrays at a time? I have tried using lat/lon chunking, e.g.
mfdata_glob = '/home/nedcr/cr/data/wave/*1990*.nc'
global_ds = xr.open_mfdataset(
    mfdata_glob,
    chunks={'latitude': 1, 'longitude': 1})

but that doesn't seem to improve things.
Is there any way around this problem? I guess I could try using preprocess= to sub-select grid cells, and loop over that, but that seems like it would require opening and reading each file 317*720 times, which sounds like a recipe for a long wait.

Have you seen #1823? It sounds like you might be having the same issue: xarray loads coordinate information into memory to check alignment is correct, but for many datasets with large coordinate arrays this could be prohibitive.
You know your variables are aligned so you could try the workaround suggested in that thread: give the coordinates to drop_variables, then update them from a single master dataset (because presumably your latitude and longitude don't depend on time!)


[Feature Request]: Options to choose the field of interest from

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
I would like to add a dropdown select feature from where students can choose their field of interest.
Use Case
The website becomes more user friendly on using this feature. It helps filter out internships of interest.
Benefits
No response
Add ScreenShots
No response
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[X] I have starred the repository

assign me this issue under gssoc24

What kind of fields, you planning to add @samarpitadas !

What kind of fields, you planning to add @samarpitadas!
I would like to add fields like Marketing, Accounting, Consulting, Law, Software Engineering, etc that would filter out the internships and help the users choose easily.

Yeah that seems Nice , You can go with that @samarpitadas

Yeah that seems Nice , You can go with that @samarpitadas

Just to clarify, I would like to add just the drop-down menu containing the fields. I am not confident about the new pages that would open on clicking the fields.


Update registration is not interoperable with lwm2m-node-lib server

Hi there,
I tried to implement a wakaama client and a lwm2m-node-lib server.
It seems that the lwm2m-node-lib expects a PUT message on update registration whereas wakaama sends a POST.
The result is a BAD REQUEST from the lwm2m-node-lib server.
I do not know which follows the OMA spec, so actually I post the issue on both projects :D
The logs are here.
A quick patch can fix this, and it works for lwm2m-node-lib and Leshan servers as well.
diff --git a/core/registration.c b/core/registration.c
index 01c5644..a251b70 100644
--- a/core/registration.c
+++ b/core/registration.c
@@ -238,7 +238,7 @@ static int prv_updateRegistration(lwm2m_context_t * contextP,
     uint8_t payload[512];
     int payload_length;

-    transaction = transaction_new(COAP_TYPE_CON, COAP_POST, NULL, NULL, contextP->nextMID++, 4, NULL, ENDPOINT_SERVER, (void *)server);
+    transaction = transaction_new(COAP_TYPE_CON, COAP_PUT, NULL, NULL, contextP->nextMID++, 4, NULL, ENDPOINT_SERVER, (void *)server);
     if (transaction == NULL) return COAP_500_INTERNAL_SERVER_ERROR;

     coap_set_header_uri_path(transaction->message, server->location);

Thank you.

Hi,
The registration update mapping was changed to a CoAP POST recently. Refer to chapter 8.2.3 of the latest LWM2M Technical Specification on the OMA FTP
Regards


Cassandra nodetool drain

Similar to https://github.com/jaegertracing/jaeger-kubernetes/pull/21

@jkandasa or @kevinearls could you please verify this?

It looks fine, but I'd feel more comfortable with a positive confirmation from @jkandasa or @kearls , specially because the continuous integration test has failed.
@jkandasa , @kearls , it would be nice to test this with 3 Cassandra pods, create some data (spans), scale down one Cassandra, check that no data is missing, then scale down again, and check again that no data is missing.
@pavolloffay , did you run it locally ?

Looks like the continuous integration has passed while I was writing the comment above O_o

@pavolloffay @jpkrohling Jenkins-CI has some permission issue, i fixed it. as follows. and works as expected.

@jpkrohling no only k8s version, I defer this to CI or QE team

@jpkrohling @pavolloffay Couple of notes on scaling Cassandra node test with production template from this PR.

I cannot do scaling on GUI of openshift for Cassandra pod. No option available for Scale up and Scale down. on template do we need to specify minReplicas:3 in the place of replicas:3?

I did terminate a cassandra-0 pod manually. Terminated pod recovered/up automatically in few minutes. Jaeger query works as expected.
After 30 minutes from the above operation, I did terminate cassandra-1 pod. Terminated pod recovered/up automatically in few minutes. Jaeger query throws the following exception,

GET https://jaeger-query-jaeger-ci.cloud2.jonqe.lab.eng.bos.redhat.com/api/traces?end=1501143745321000&limit=20&lookback=1h&maxDuration&minDuration&service=from-automation&start=1501140145320000
{"data":null,"total":0,"limit":0,"offset":0,"errors":[{"code":500,"msg":"Cannot achieve consistency level ONE"}]}

from this point jeager-production server goes to not usable state.

NAME                                   READY     STATUS      RESTARTS   AGE
po/cassandra-0                         1/1       Running     0          57m
po/cassandra-1                         1/1       Running     0          19m
po/cassandra-2                         1/1       Running     1          1h

Jaeger query throws the following exception

did the exception disappear after some time?

@pavolloffay Just now I checked throws the same exception.
Cassandra pod status when I check this:
NAME                                   READY     STATUS      RESTARTS   AGE
po/cassandra-0                         1/1       Running     0          1h
po/cassandra-1                         1/1       Running     0          34m
po/cassandra-2                         1/1       Running     1          1h

I think it's not related to this PR, but it's related to master and replication factor

@jkandasa could you please do the same with master/head?

@pavolloffay I see this issue on master/head too.
NAME                                   READY     STATUS      RESTARTS   AGE
po/cassandra-0                         1/1       Running     0          57m
po/cassandra-1                         1/1       Running     0          12m
po/cassandra-2                         1/1       Running     2          1h

@jkandasa thanks. That issue is not related to this change. I think we can merge this and handle that separately.


Need a method to delete things from the object store easily

    Need a method to delete things from the object store easily

Originally posted by @mrghg in https://github.com/openghg/openghg/issues/395#issuecomment-1234246754

See #468

Done with #468


How GCI website display Privly Links

This is a test case about "How GCI (Google Code In) website display Privly Links - as Plain Text Address".

Here it is! It looks like I just needed to keep working up the pull request queue. Thanks!


Adding Fcm notification capabilities to the connector.

This CL adds Fcm notification capabilities to the connector.
i.e the connector can process both XMPP and FCM notifications from GCP server.
Linux command to use fcm notifications:
gcp-cups-connector -gcp-use-fcm
The changes are NoOp unless new flag is passed.
Please Note this is an experiment flag that may be changed in the later releases.

Can you squash these into a single commit? I see four commits in the pull request

lgtm. but someone else needs to take a look.

Looks good. Can you squash this down to a single commit, tho? I don't want all the intermediate commits to go in as-is.