improve instructions for first time users (newbies)

Hi, as a first time user (newbie) I have a some questions that are not answered in the instructions or on the Hugo forum. I suggest to improve the documentation to broaden usage of this great theme.

when changing {{< repo id="peaceiris" name="hugo-theme-iris" >}} in ./content/en/_index.md to another user name and repository on GitHub an error is generated

any objections to changing ./config/_default/config.yaml

I plan to replace the jp to a de section for my own site in the near future. Thanks!

Yes. We need more friendly documentation for customizing. I will work on this.

Much appreciate. Any chance for a very short reply on these two questions? Thanks!

I am updating the README. You will find the answer to the first one.
Changes v0.15.1
Add a script to create a new Hugo project with this theme
mkdir ./homepage
wget https://raw.githubusercontent.com/peaceiris/hugo-theme-iris/master/scripts/setup.sh
bash ./setup.sh ./homepage
cd ./homepage
hugo server

Add a script to fetch your GitHub user data
cd ./homepage
export GH_PAT="github_personal_access_token"
export GH_USER_ID="peaceiris"
bash ./scripts/fetch_data.sh "${GH_PAT}" "${GH_USER_ID}" | jq . > "./data/github/${GH_USER_ID}.json"

Using jq is optional.
For the second question, I added the Customize Theme section to the README and I am going to enhance it.

Excellent! Very nice. Thanks again.

Forgive. I cannot work out how to add an image to my site similar to your homepage. Any change to add an example upstream? I also googled in vain for comment symbols that work...

Do you mean the following circle image?

I just wrote HTML codes as follows.
## About peaceiris

### Profile

OK, I will add a new shortcode for the circle image.

I also googled in vain for comment symbols that work...

What did you mean? A comment symbol for the Hugo template? {{/* comments here */}}

Do you mean the following circle image?

I just wrote HTML codes as follows.
## About peaceiris

### Profile

OK, I will add a new shortcode for the circle image.

Fine. Images work locally on hugo server that looks at ./static but when published to Netlify the image is broken.

I also googled in vain for comment symbols that work...

What did you mean? A comment symbol for the Hugo template? {{/* comments here */}}

Yes, I found that, too. But whatever I do, this very text appears on the homepage.

{{/* comments here */}} This type is for the Hugo template. We can use a comment like <--! comment here --> in a Markdown file as same as a comment in HTML.

{{/* comments here */}} This type is for the Hugo template files. We can use a comment like <--! comment here --> in a Markdown file as same as a comment in HTML.

- - is converted to a long –  and still displayed on the homepage as <–! comment here –>

That seems to be a problem with your editor.

That seems to be a problem with your editor.

<--! comment here --> in /content/en/_index.md turns after a hugo server rebuild into <–! comment here –>  on localhost. I am using the latest VSC.

Sorry in my comment https://github.com/peaceiris/hugo-theme-iris/issues/152#issuecomment-632605927 has an invalid HTML comment. The correct is as follows:

<--! invalid comment here -->

Success!

v0.16.0 has been released and the circle shortcode is available.
If your logo image is located at static/images/logo.jpg.
{{< circle src="/images/logo.jpg" alt="hugo-theme-iris logo" >}}

Thanks. Here a final question before I can get productive:
on the GitHub repository under /themes I have a link hugo-theme-iris @ d8b3aba
when cloning the GitHub repository on another machine
git clone https://github.com/ng0177/theme-iris.git iris
it leaves the /themes/hugo-theme-iris folder empty
git submodule add https://github.com/peaceiris/hugo-theme-iris.git ./themes/hugo-theme-iris
results in an error: 'themes/hugo-theme-iris' already exists in the index
rm -rf themes/hugo-theme-iris
git rm -r themes/hugo-theme-iris

enables submodule add to work.
Is this workflow correct?

How to clone your Hugo project which has a theme as a Git submodule
A correct procedure is as follows:
git clone https://github.com/ng0177/theme-iris.git
cd ./theme-iris
git submodule update --init --recursive

git submodule update --init equals to git submodule init && git submodule update
How to update a theme which is installed as a Git submodule
cd ./themes/hugo-theme-iris
git fetch
git checkout v0.x.x
git branch
# * (HEAD detached at v0.16.0)
cd ../..
git add themes/hugo-theme-iris
git commit -m "deps: bump hugo-theme-iris to v0.16.0"
git push origin master

works like a charm

sharing my site w/ your theme on Telegram looks like that:

I would like to personlize it and changed a few settings in config/_default/config.yaml which seemed to have no effect. Any advice?

I tested your site with Sharing Debugger - Facebook for Developers. It looks good to me.
Maybe, Telegram still read its cache.
Also, here is a result with https://cards-dev.twitter.com/validator

Fine. I deleted Telegram's cache and restarted w/o effect but no problem, if this happens only on Telegram and may go away.

Yes. That is a problem only for the Telegram, I think.

Keybase asks
Please serve the text below exactly as it appears at one of these URL's
Which is the best way of doing so? Thanks.

One more questions concerning Shortcodes. When you create one, is it specific to the theme? Does Hugo have a basic set of Shortcodes that can be extended? Shortcodes look like macros to me.

Sorry to bother again. Any chance to arrange these pictures side-by-side? Thanks.
{{< circle src="/images/peter1of3.jpg" alt="INDIGO" >}}
{{< circle src="/images/peter2of3.jpg" alt="INDIGO" >}}
{{< circle src="/images/peter3of3.jpg" alt="INDIGO" >}}

About Keybase
I put my data at static/keybase.txt and published it https://peaceiris.com/keybase.txt
About Shortcodes
Hugo's built-in shortcodes are here: Shortcodes | Hugo
We can overwrite the templates by this lookup order: Hugo's Lookup Order | Hugo
About Bulma

pictures side-by-side

This theme is based on the Bulma CSS framework. See the documentation for more details about what Bulma can do.

I recommend you read the whole Hugo documentation to know Hugo's basic rules and features before you start to customize your Hugo project.

keybase: works easily

shortcodes: appreciate you pointing me in the right direction

side-by-side: grid system seems great

Hi, i didn't create a new issue, because imo it's still part of "improving instructions for first time users (newbies)"
Here is what i did :
hugo new site my-site
cd my-site
git clone https://github.com/peaceiris/hugo-theme-iris themes/hugo-theme-iris
echo "theme = \"hugo-theme-iris\"" >> config.toml
What i expected :
an empty website using this theme
What i got :
Error: module "github.com/peaceiris/hugo-mod-mathjax" not found; either add it as a Hugo Module or store it in "my-site/themes/".: module does not exist
i tried a few variations of this, even copied a few line from /script/setup.sh but none seems to work
Could you guide me on using this as a theme.
I'm switching from beautiful hugo them where the installation for gitlab/github page was quite clear, but i'm a bit lost with the installation of your theme

@D3m0t3p
Is Go available on your machine? (Does the command which go return a path to golang?) Then follow the instruction. It works well.
mkdir homepage
wget https://raw.githubusercontent.com/peaceiris/hugo-theme-iris/master/scripts/setup.sh
bash ./setup.sh homepage "your_github_id"
cd homepage
hugo server

Hi, how would i go about downloading and using the theme ?  I understand that i can use the script to do most of the work, but if i change some file in the theme, it will be re-downloaded and my changes would be erased during the next build. How can i do to download once and for all the theme, build a website using it and some time to time update the theme if you pushed something new ?

@jorisSchaller Please use the Hugo's Lookup Order | Hugo for customizing a Hugo theme.

This issue has been LOCKED because of it being resolved!
The issue has been fixed and is therefore considered resolved.
If you still encounter this or it has changed, open a new issue instead of responding to solved ones.


Sats stuck in archived vault

Couple releases back in prod release I tried to rotate out a key. The app hadn't responded so I killed and restarted. Then I tried sending sats out. Couldn't. While trying to send sats out, the app glitched and I found the vault archived (from my previous attempt of rotating the keys out). Now sats are stuck in that vault and I'm unable to send them out. Getting insufficient balance message.

The user tried to do a key change (vault change), and it did not work (the app did not allow it); then, later, he tried to send a txn and it ended up being a vault change. So the sats seem to be stuck.
may be there was a transaction somewhere which got sent.
This is an edge case and difficult to replicate. Also the backup is for the user to restore the Archived Vault.

The above behavior is because we have a user flow where we transfer funds from the old vault to the new vault (during key rotation or scheme change) and only after the fund transfer, we create the new vault. This temporary vault is persisted until the transfer is complete. Even after the app restarts and the user lands on the vault that was being rotated, the transfer continues right after we land inside the vault. This behaviour was implemented since the beginning. Please let me know if there is any change to be made in this flow. As of now this is a feature and not a bug.

#4664 Dependent task. Moving it to 33. Will move back if timeline falls in place

Closing as outdated


api.sendMessage is not working now err: 1357005

api.sendMessage is not working now err: 1357005

fixed headers['sec-fetch-site'] = 'same-origin'


feat(global-style): remove GlobalStyle component

Summary
Type

Refactor

Summarise concisely:
The following changes where made:
Remove GlobalStyle component and tests

Also, PR should be a feat to bump the package and indicate a change :)

Storybook seems to fail, I have an error on each page

Forgot to remove <GlobalStyle /> from storybook, added back the css


[Feature]: The links are not visible properly for forget password

this part can be improved

Hi @TheSoumenMondal I appreciate you noticing that. I will add it as part of a quick-fix label.
If you are fixing this in a PR I would have to mark it invalid for hacktoberfest as it would be a one-liner fix which could get it excluded.


Exclusions in a link aren't handled by the .ff format

This is probably a https://github.com/marrink-lab/vermouth-martinize issue, but it's very relevant for the polyply library, and in particular for P3HT. When attempting to move from the .itp to the .ff format for P3HT, having the following exclusion section in the link section:
[ link ]
....
[ exclusions ]
; between nearest-neighbor thiophenes
   S1  +S1  +C2  +C3                    {"comment": "connection"}
   C2  +S1  +C2  +C3                    {"comment": "connection"}
   C3  +S1  +C2  +C3                    {"comment": "connection"}

breaks the polymer generation (the links don't get printed at all). This is the error:
INFO - step - reading input and library files
INFO - step - reading sequence from command
INFO - step - mapping sequence to molecule
INFO - step - applying links between residues
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 1649.19it/s]
--- Logging error ---
Traceback (most recent call last):
  File "/Users/riccardo/miniconda3/envs/polyply/lib/python3.8/logging/__init__.py", line 1081, in emit
    msg = self.format(record)
  File "/Users/riccardo/miniconda3/envs/polyply/lib/python3.8/logging/__init__.py", line 925, in format
    return fmt.format(record)
  File "/Users/riccardo/miniconda3/envs/polyply/lib/python3.8/logging/__init__.py", line 664, in format
    record.message = record.getMessage()
  File "/Users/riccardo/miniconda3/envs/polyply/lib/python3.8/logging/__init__.py", line 367, in getMessage
    msg = str(self.msg)
  File "/Users/riccardo/ric.alessandri/Repos/polyply/vermouth-martinize/vermouth/log_helpers.py", line 36, in __str__
    return self.fmt.format(*self.args, **self.kwargs)
KeyError: ' '
Call stack:
  File "/Users/riccardo/miniconda3/envs/polyply/bin/polyply", line 7, in <module>
    exec(compile(f.read(), __file__, 'exec'))
  File "/Users/riccardo/ric.alessandri/Repos/polyply/polyply_1.0/bin/polyply", line 277, in <module>
    main()
  File "/Users/riccardo/ric.alessandri/Repos/polyply/polyply_1.0/bin/polyply", line 273, in main
    args.func(args)
  File "/Users/riccardo/ric.alessandri/Repos/polyply/polyply_1.0/polyply/src/gen_itp.py", line 90, in gen_itp
    LOGGER.warning(msg, n_components)
  File "/Users/riccardo/miniconda3/envs/polyply/lib/python3.8/logging/__init__.py", line 1800, in warning
    self.log(WARNING, msg, *args, **kwargs)
  File "/Users/riccardo/ric.alessandri/Repos/polyply/vermouth-martinize/vermouth/log_helpers.py", line 113, in log
    super().log(level, Message(msg, args, kwargs), **kwargs)
  File "/Users/riccardo/ric.alessandri/Repos/polyply/vermouth-martinize/vermouth/log_helpers.py", line 96, in log
    self.logger.log(level, msg, *args, **kwargs)
  File "/Users/riccardo/ric.alessandri/Repos/polyply/vermouth-martinize/vermouth/log_helpers.py", line 94, in log
    self.logger._log(level, msg, args, **kwargs)  # pylint: disable=protected-access
Message: "You molecule consists of { } disjoint parts. Perhaps links were not applied correctly.".format(*(12,), **{'extra': {'type': 'general'}})
Arguments: ()

@ricalessandri you'll have to specify the edges, which go with the exclusions. This is the same thing as you need to do for edges. Look at for example this file:

Actually, [exclusions] works as expected. So, I think that's preferable since more intuitive: you need to define them as you would expect you would need to. See 3cfbbeeb52a86fd53a9d7998b67cbdae542d8b84. The only problem - and what was causing the error I posted above - is one can't add the {"comment": "connection"} stuff.

@ricalessandri
I finally figured out what is going on here. For some reason exclusions are parsed differently like virtual-sites. This is a vermouth thing that obviously is not documented anywhere. However, what happens is that exclusion when they have the "{}" syntax are parsed in a funny manner such that "comment" ends up as node attribute. In a normal case it would be stripped from the exclusions.
To fix this you need to use the same syntax as with VS:
[ exclusions ]
1 2 -- {"comment": "random"}

I added a section about this in the wiki tutorial.


Cann't test/infer using inference.py

It seems like that the class HourglassModel in the hourglass_tiny.py  doesn't have attribute 'pred_sigmoid'.But in the predictClass.py, class PredictProcessor call self.HG.pred_sigmoid.
@wbenbihi

version of the your tensorflow may be changed.


Make flexible add more icons

Looking into recent history of Foundation Icons it seems the development has stopped:  https://github.com/zurb/foundation-icons/commits/master
Font Awesome seems to be well maintained and has a much of the recent 'brands' included:
http://fontawesome.io
related:
http://ionicons.com
http://typicons.com
https://mfglabs.github.io/mfglabs-iconset
customize:
https://icomoon.io
http://www.flaticon.com

But why? Are you looking for an icon in particular?

I don't think that this is a thing that we need (and less urgently).
Currently we get a set of commons icons. When an icon make a rebranding then is moment to think to update, but definitely this works and I'm happy to don't update code that is not broken :-)

The motivation of this was, that I miss some of the social networks used in the recent days.

@waja for example? maybe is my fault because I just use twitter :P

For example: mixcloud, soundcloud, slack and xing. Just to name a few.

:+1:

I've looked into them and mfglabs-iconset looks (beside fontawsome) with most social media icons. Xing (for example) is only available there.

Do you think that you can conver this issue into a PR? Steps:

Replace foundation reference for fontawesome.
Map the same icon to the same css class fonts.
Add a set of common icons missing currently.

As I'm not very familiar with HTML/CSS/JS I can't promise anything or that it will fit you quality standards. I'll have a look into it but ... you know. :-)

@Kikobeats Looked into the available icons at font-awesome. Do you think it makes sense to ship the foundation-icons AND font-awesome to not break existing customized installations?

@waja absolutely. We have to map the new icons to the same css class for backward compatibility and add the missing icons

omg, fast click :o

@Kikobeats Hmm ... to be honest I guess that's way above my skills in web frontend development. At least to share the outcome with others.


WIFI connection stability issues

Hello raspberrypi team,
I have here an issue using a mesh router environment, where all the APs are having the same SSID and the connection will be managed by main AP. In this issue in the arduino-pico repo of @earlephilhower he mentioned, that in your API it is not possible to connect to a specific BSSID as the methods for that are not exposed. Also the methods for getting RSSI and BSSID of the currently connected AP are not exposed.  Can you please check if you could provide official access to that features in your API, and check with Cypress, if they see issues using AVM FritzBox 'mesh' WIFI router systems?
Thank you so much in advance!

Duplicate of https://github.com/raspberrypi/pico-sdk/issues/1090?

and check with Cypress
I think you'd get an answer from Infineon as quickly as we would.


What should i do extra effort to certain modify Conversation?

If I changed any line of a_papaya_new.txt Should, i also should changed in vocab.txt.
I want to slighlty modified the conversion in my way where the bot can interact.
Please mention how to make the new rule and make possible to change contents of that file before training.
Let's I change; Dialogue of a_papaya_new.txt as,
Q: What is your name? ----> Q: What is your name?
A: My name is Papaya. ----->A: My name is AI-Chatbot

and several others.
> I am Strange by knowing how every word are linked to vocab.txt and  Tensorflow finds out the pattern between the input and trained datas and it worked.
Also, How can I  papaya, Corpus, Reddit data-set whole used to train my bot.
I deep look on it and not found any ideas on it.
Please ! clarify me.
Thanks in advance.

@sushant097
Yes, whenever you make any changes to any training samples (like modifying a_papaya_new.txt file), you should re-generate vocab.txt by running vocabgenerator.py in Corpus folder.
Concerning your second questions, here is the answer: the input and output of the NMT model are both integers (IDs), or the sequence number in vocab.txt. For example, the first word (line) in the vocab.txt (unk) is ID 0, the second (bos) is ID 1, and so on. Therefore, at the time of training and prediction, you need to maintain the same word to integer mapping, and integer to word mapping.
I could not figure out the meaning of your last question. If you still encounter any other issues, feel free to let me know. Thanks.

@bshao001
Thanks. Is vocab.txt contains the Reddit data-set and Corpus dialogue too .

@sushant097
Yes, the existing vocab.txt was generated using vocabgenerator.py, which reads all files in the three folders: Augment0, Augment1, and Augment2. Check the script of vocabgenerator.py. It is really straightforward. Please let me know if you have other questions.


fix: update image version

Description

How Has This Been Tested?

Merge criteria:

[ ] The commits are squashed in a cohesive manner and have meaningful messages.
[ ] Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
[ ] The developer has manually tested the changes and verified that the changes work

Merging manually as the PR checks are still not adjusted for this repository.


Prepare for Shapely 2.0 - "convert the '.coords' to a numpy array instread"

We get the following warning when using the geometry module:
/opt/conda/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:122: ShapelyDeprecationWarning: The array interface is deprecated and will no longer work in Shapely 2.0. Convert the '.coords' to a numpy array instead.
  arr = construct_1d_object_array_from_listlike(values)

See https://shapely.readthedocs.io/en/latest/migration.html#conversion-of-the-coordinates-to-numpy-arrays for details.
I'm not sure where the problem is. Need to run the test suite with Shapely 1.8 and set to fail on warnings.

The warning occurs on this line in tables.py:
self.df["geometry"] = [transform(loads(ww)) for ww in self.df["wkt"]]

It appears to be caused by setting the dataframe column to a list of shapely objects. It is not clear from the documentation how this should be handled - I will suppressed the warning for now.


realContentHash replace content in user code

Also see https://github.com/webpack/webpack/issues/14058
optimization.realContentHash will use RegExp to replace the contenthash in generated code, it's possible to replace the user code which contains the same content as contenthash. Although the longer the contenthash length, the less likely it is to occur, it is still easy to appear when the contenthash length is very short.
If you want to implement this, we encourage you also contribute this back to webpack.

bump

I will close this and let's track the progress here: https://github.com/web-infra-dev/rspack/issues/8474


[feat] filtering of connectivity datasets in siibra-explorer

new connectivity features in siibra explorer

[ ] better way to query/narrow down the selection
[ ] modality (streamline count etc)/cohort (1000brain vs HCP)/subject id (?)

as per discussion today: Introduce 3-level filter.

modality: Streamline counts, streamline lengths, functional connectrivity
cohort: HCP, UK Biobank, 1000 brains, ...
matrix: average, , ...

In the future, 3. we might further include to restrict age range, gender, ...

fixed in 2.8.0


[DOCFIX] Update Chinese Caching Doc

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10707/
Test PASSed.

Can one of the admins verify this patch?

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10782/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10889/
Test PASSed.

alluxio-bot, merge this please

alluxio-bot, cherry-pick this to branch-2.3 please


为什么文档中异常处理要调用OpenAI？

import openai
from openai import OpenAI
client = OpenAI()
try:
client.fine_tunes.create(
training_file="file-XGinujblHPwGLSztz8cPS8XY",
)
except openai.APIConnectionError as e:
print("The server could not be reached")
print(e.cause)  # an underlying Exception, likely raised within httpx.
except openai.RateLimitError as e:
print("A 429 status code was received; we should back off a bit.")
except openai.APIStatusError as e:
print("Another non-200-range status code was received")
print(e.status_code)
print(e.response)

什么？

readme中存在的openai的调用示例，是由于开发人员的疏忽


crow-translate: init at 2.6.2

Motivation for this change

Crow Translate is a simple and lightweight translator programmed in C++ / Qt that allows to translate and speak text using Google, Yandex and Bing translate API.

Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 105402 run on x86_64-linux 1

1 package built:

crow-translate

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/425

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/425

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 105402 run on x86_64-linux 1

1 package built:

crow-translate

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 105402 run on x86_64-linux 1

1 package built:

crow-translate


:rocket: Route for no rewriting

Setup the app to minimise the amount of route rewriting required. Just at the moment this means the 'home' page is /symptoms/stomach-ache rather than /. I've specifically not made the routes take the symptom as a variable as that can be done as the next symptom is added. And symptom is likely going to need to be variable as it could also be condition.
Fixes #69

The able param determines whether somebody is able to get there by themselves or not and changes the view rendered.
What is the issue about it not being persisted?

Rebased to fix merge conflicts


Label-specific options not applied unless general options set for that element already

import holoviews as hv
hv.extension('bokeh')
l = hv.Curve(([0, 1], [0, 1]), label='a') * hv.Curve(([1, 0], [0, 1]), label='b')
l.opts(
    # opts.Curve(), #need to uncomment this for options to take effect
    opts.Curve('a', color='k'),
    opts.Curve('b', line_dash='dotted')
)

That might also explain https://github.com/pyviz/hvplot/issues/88, which has perplexed the hell out of me.


ZeRO Stage 2 with Offload: Unexpectedly large optimizer state files

I was running Stage 2 training of Llama 3.1 8B model on one 80GB GPU.
Setup Info

OS: Ubuntu 22.04
DeepSpeed: 0.15.1 (installed with DS_BUILD_CPU_ADAM=1)
PyTorch: 2.4.0
Transformers: 4.44.2
CUDA: 12.1
Model: Llama 3.1 8B Instruct
DeepSpeed config: ZeRO Stage 2 with optimizer offloaded to CPU, bf16
GPU: Single 80GB H100 GPU

The global_step[xxx] directory from checkpoints contains very large optimizer state files (> 105 GB):
90G	bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
15G	mp_rank_00_model_states.pt

This is significantly larger than the actual model parameters, which take up about 15GB:
4.7G	pytorch_model-00001-of-00004.bin
4.7G	pytorch_model-00002-of-00004.bin
4.6G	pytorch_model-00003-of-00004.bin
1.1G	pytorch_model-00004-of-00004.bin

I'm surprised by the large size of the optimizer state files, even with Stage 2 and offload. Is this expected behavior, or is there a way to reduce the storage requirements?

DeepSpeed configuration
deepspeed_config = {
    "fp16": {
        "enabled": False,
        "loss_scale": 0,
        "loss_scale_window": 1000,
        "initial_scale_power": 16,
        "hysteresis": 2,
        "min_loss_scale": 1
    },
	"bf16": {
		"enabled": True,
	},
    "optimizer": {
        "type": "AdamW",
        "params": {
            "lr": "auto",
            "betas": "auto",
            "eps": "auto",
	    "weight_decay": 0.01,
        }
    },
    "scheduler": {
        "type": "WarmupLR",
        "params": {
            "warmup_min_lr": "auto",
            "warmup_max_lr": "auto",
            "warmup_num_steps": "auto"
        }
    },
    "zero_optimization": {
        "stage": 2,
        "offload_optimizer": {
            "device": "cpu",
            "pin_memory": True,
        },
        "allgather_partitions": True,
        "allgather_bucket_size": 5e8,
        "overlap_comm": True,
        "reduce_scatter": True,
        "reduce_bucket_size": 5e8,
        "contiguous_gradients": True
    },
    "steps_per_print": 100,
    "gradient_accumulation_steps": "auto",
    "gradient_clipping": "auto",
    "train_batch_size": "auto",
    "train_micro_batch_size_per_gpu": "auto",
    "activation_checkpointing": {
        "partition_activations": True,
        "contiguous_memory_optimization": True
    },
    "wall_clock_breakdown": False
}

TrainingArguments
train_args=transformers.TrainingArguments(
	deepspeed=deepspeed_config,
	per_device_train_batch_size=micro_batch_size,
	per_device_eval_batch_size=micro_batch_size,
	num_train_epochs=_num_epochs,
	learning_rate=learning_rate,
	fp16=deepspeed_config['fp16']['enabled'],
	bf16=deepspeed_config['bf16']['enabled'],
	save_safetensors=False,
	logging_steps=50,
	logging_dir=os.path.join(stage_output_dir, 'logs'),
	# optim="adamw_torch",
	weight_decay=deepspeed_config['optimizer']['params']['weight_decay'],
	evaluation_strategy=eval_strategy if val_set_size > 0 else "no",
	save_strategy=save_strategy,
	eval_steps=eval_steps if val_set_size > 0 else None,
	save_steps=save_steps,
	output_dir=stage_output_dir,
	save_total_limit=1,
	load_best_model_at_end=True if val_set_size > 0 else False,
	group_by_length=group_by_length,
	# save_only_model=True,
)

@joycey97, that is very strange indeed. Optimizer state should roughly be 12X parameter count, so should be ~36GB in this case. Can you please share full repro details so we can take a look? Thanks!

maybe you can refer to https://github.com/hiyouga/LLaMA-Factory/issues/1801, set --save_only_model as True

@ygzhu It is not compatible with argument load_best_model_at_end=True ..


Lookup at pubchem outputs incorrect inchi

I noticed that an Inchi loaded from pubchem was stored as:
'inchi': '"InChI=1S/C12H22O11/c13-1-4-6(16)8(18)9(19)11(21-4)23-12(3-15)10(20)7(17)5(2-14)22-12/h4-11,13-20H,1-3H2/t4-,5-,6-,7-,8+,9-,10+,11-,12+/m1/s1"'
The problem is that there are extra "".  This might cause problems when reading in inchi later by matchms

In the code the following section causes the issue:
for result in results_pubchem:
inchi_pubchem = '"' + result.inchi + '"'
inchikey_pubchem = result.inchikey
smiles_pubchem = result.isomeric_smiles
This seems to be done on purpose, but I am not sure why.
Do you know why this is the case @florian-huber? Or can we just remove the extra ""

No this did not cause any issues, but I encountered it when writing tests and it surprised me and I could imagine it breaking something in matchms.
Since, it does not break anything I think it is ok to leave it like this and only reopen this issue, if this later gives any issues in matchms


docs: Add aad-pod-identity migration information

Description:
With this PR I'm simply adding the information I got from @aramase in this issue (https://github.com/Azure/azure-workload-identity/issues/731), related to the migration from aad-pod-identity.

/azp run Azure Workload Identity CI


Fix Revert to components not adding CL (BSO)

Description:

Reverting Masori/Armadyl/Ancestral/Bandos materials on BSO doesn't add to CL
Not possible to revert Armadyl into plates

Changes:

Adds forceAddToCl on all revert to components
Adds distinguishers on the Armadyl reverts so you can actually revert to plates, and know which you're doing.

Other checks:

[x] I have tested all my changes thoroughly.

Notes:
The Armadylean plates do NOT have forceAddToCL added because that needs to be merged from OSB; so just be mindful when merging OSB => BSO that in case there is a conflict, we need to ensure forceAddToCL is merged to BSO.

Extends/ resolves #4909


#44 Sort is a master only command

SORT redis command is master only, so we need to configure the case class for that command accordingly

Coverage increased (+0.25%) to 91.95% when pulling d15dd3c9d07d8b88e4b2698900c1292a3c66a6f8 on javierarrieta:bugfix/#44 into 790d76411acaca20ebde49e9a6369b1c6ecfceae on etaty:master.

Coverage increased (+0.25%) to 91.95% when pulling d15dd3c9d07d8b88e4b2698900c1292a3c66a6f8 on javierarrieta:bugfix/#44 into 790d76411acaca20ebde49e9a6369b1c6ecfceae on etaty:master.

Hi,
Could you explain why ?
because Sort is read-only, so unless there is a big replication lag for the slave, it should be fine

Hi, it is not read only, it writes the sorted elements in the list. It is surprising that it is not clear in the reference doc, but you can easily reproduce issuing that command against a slave

There is the rediscala sort store command

I have spitted the command, Sort and SortStore
https://github.com/etaty/rediscala/blob/ab29ee24b024b8dced58f618d6a32bb91ba91bf2/src/main/scala/redis/api/Keys.scala#L144-L166

Yeah, I don't understand too much the difference since both are issuing a redis SORT command that will rewrite the list to the key. We are using the sort command, not the sortStore

sortstore will read, then write (store)
sort will only read

you can't store with the rediscala sort
you have to use sortStore

Sorry, but redis sort command writes to the key, as said it is quite easy to reproduce manually. I have been looking in the rediscala tests to see if I could easily make it apparent in those

I have splitted the redis sort command in rediscala
sort (only read) and sortStore (read then write)

And again I don't know how that could be beneficial as SORT command writes to the key
<IP_ADDRESS>:16379> lrange mylist 0 -1
1) "3"
2) "4"
3) "2"
4) "1"
<IP_ADDRESS>:16379> sort mylist
(error) READONLY You can't write against a read only slave.

Oh ok never saw that error before, I will need to check it

Cool, thanks @etaty


total bytes is returning -1 for pdf files

Hi,
I have pdf files stored in google drive and am exporting them. but totalbytes is returning -1 always

I have the same issue files stored on hosting and downloading them with direct download URL. but totalbytes is returning -1 always

Hi @alitamoor65 ,
Since there was no solution for this, i found another good library https://github.com/tonyofrancis/Fetch


Feature request: More search results on nlp.stampy.ai

Someone using nlp.stampy.ai while helping with the distillation fellowship said it would be more useful if it showed more results than 5 at the same time (maybe with radio buttons to select the number of results), like 20 or 100 or something.

This is a duplicate of https://github.com/StampyAI/stampy-nlp/issues/31 which is in the repo where the code needs to be changed. I'm going to close this one.


Email invitations filtered out due to incorrect SPF record

On behalf of an existing user:
We have attempted to invite a number of people to our Influx Cloud account and the invites have not been received.
On investigation with our IT department we have discovered that the invitation email is being filtered out due to an invalid SPF record.
Please see the example below:
For example:
Date   2020-11-12
Time   10:19:54
Message   SPF=FAIL: (header from<EMAIL_ADDRESS>indicates that MTA (<IP_ADDRESS>) is not permitted to send email for influxdata.com
Session ID   0AC9JpeV002695-0AC9JpeX002695
Log ID<PHONE_NUMBER>
From<EMAIL_ADDRESS>To
Subject   You're invited.

@deanasheehan I see a closed support request from the day this issue was opened, describing the same problem. Assuming the SRE fix covered both problems (or that they were the same problem, reported twice) I'm going to close this issue.


CORS * not accepted by my app

Thank you for helping with questions around CORs previously.  I have come back to use the docker version of mockserver for another project, but this time when I enable CORS in my docker-compose.yml, the application does not accept '*' as a value when getting a response back from the mockserver.  I need a way to set the CORS value in the expectation to something like "http://localhost:8080" instead.  Is there a way to do this?  I tried to set the expectation this way, but it doesn't seem to work and just returns * for CORS.
Thanks for any advice.
I can layout more specific details if it is unclear.

Closing as a duplicate of #441

I have closed this as a duplicate of #441 however I will shortly add the ability to override the defaults for all CORS header.


[FEATURE] Change to documentation/wiki for Comet Spear

Is your feature request related to a problem? Please describe.
No, just an addition to documentation.
Describe the solution you'd like
I'm the guy who recently had a question about the Comet Spear's ability. I couldn't find anything in the wiki about the increase in strength of the Grand Skyfall ability based on the Sharpness/Smite level, so I'd like to add something to the Comet Spear's entry. Just something like "The Grand Skyfall ability will scale based on the level of Sharpness/Smite".
I'd be happy to do this and make a PR myself, but I don't know if I can directly make PR's on a wiki.
Thank you for your work by the way! I've been using this on my server for about a week now, and it's been wonderful.

Sure, I've updated the wiki now to state the bonus flight based on enchants (added it for Mjolnir aswell). Thank you for the kind words!

Awesome, thank you, and no problem!


Add DJVI - Cycles (REMIX) by Zoa Ra

Song Name
DJVI - Cycles (REMIX)
Artist Name
Zoa Ra
Source
Youtube
Youtube Link
TIGPbuoUP9M
Direct File Link
No response
Song ID
658135
Start Offset [ms]
0
Extra
Created from Auto Nong.
Created for level: 15965336
Downloaded: No

Reopen


[Bug] Scanner doesn't work with single char barcode

Hi,
Scanner doesn't work with single char barcode
Is it a known issue?
For example:
https://barcode.tec-it.com/en/?data=2

#641 Yeah it's a known issue.
I believe the problem is with ML Kit. I've had to deal with this issue before.
I tested various ML Kit scanners, and they all had the same problem: single char/digit barcodes couldn't be scanned.
Although that has not caused any problems for me because in real life scenario, a barcode will most likely contain more than one character.

@arnabonetraker
Thanks.
The thing is that I do have such a situation and I am currently in a problem :/
So what can I do right now? Is there a solution that will be soon?

@arnabonetraker Thanks. The thing is that I do have such a situation and I am currently in a problem :/
So what can I do right now? Is there a solution that will be soon?

I don't really have proper solution. If possible use QR codes. Otherwise check the scanner packages that utilises Zxing library until a fix come for ML kit.


fix warning (channel id)

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[ ] I am the original author of this code and I am willing to release it under Unlicense
[x] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[x] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Fixed to get channel_id from video_details.
This fixes #20982

Can confirm, this fixes the issue with channel ID.

On Vevo videos like https://www.youtube.com/watch?v=MfQoejFPgc0 and https://www.youtube.com/watch?v=4ohvXEkMiOk, video_details.get('channelId') and the channelId meta tag point to the correct channel with a non-empty upload playlist (UCsbkOzMoqB7LwJClG6d28Lg), while the subscribe button's data-channel-external-id= points to some kind of Vevo meta channel (UCDcyb4c29bZcQkldeQyY_YQ) with an empty upload playlist. I believe this makes the data-channel-external-id= value not particularly reliable for correctness.

OK.  Also experienced this.  Nice that there now is a fix.  Experienced with:  youtube-dl --verbose --write-sub --sub-lang en,sv --format 18 "http://www.youtube.com/watch?v=kq1PbgeBoQ4"
Is from 2008 and has 2,806,445 views.
This is not a serious issue as the film does download OK, but gives the message WARNING: unable to extract channel id; please report this issue on https://yt-dl.org/bug


something wrong with semseg-pt-v3m1-0-base.py

i use ScanNet v2, and run    CUDA_VISIBLE_DEVICES=0 python tools/train.py --config-file /home/lab2325/Pointcept/configs/scannet/semseg-pt-v3m1-0-base.py --num-gpus 1 --options save_path=/home/lab2325/Pointcept/log
return :
RuntimeError: Viewing a tensor as a new dtype with a different number of bytes per element is not supported.
i replace it by ：locs_uint8 = locs.long().reshape((-1, num_dims, 8)).flip(-1).to(torch.uint8)
then
File "/home/lab2325/Pointcept/pointcept/models/utils/serialization/hilbert.py", line 147, in encode
locs_uint8 = locs.long().reshape((-1, num_dims, 8)).flip(-1).to(torch.uint8)
RuntimeError: shape '[-1, 3, 8]' is invalid for input of size 2823306

i use ScanNet v2, and run CUDA_VISIBLE_DEVICES=0 python tools/train.py --config-file /home/lab2325/Pointcept/configs/scannet/semseg-pt-v3m1-0-base.py --num-gpus 1 --options save_path=/home/lab2325/Pointcept/log
return :
File "/home/lab2325/Pointcept/pointcept/models/utils/serialization/hilbert.py", line 145, in encode
locs_uint8 = locs.long().view(torch.uint8).reshape((-1, num_dims, 8)).flip(-1)
RuntimeError: Viewing a tensor as a new dtype with a different number of bytes per element is not supported.
i replace it by ：locs_uint8 = locs.long().reshape((-1, num_dims, 8)).flip(-1).to(torch.uint8)
then
File "/home/lab2325/Pointcept/pointcept/models/utils/serialization/hilbert.py", line 147, in encode locs_uint8 = locs.long().reshape((-1, num_dims, 8)).flip(-1).to(torch.uint8) RuntimeError: shape '[-1, 3, 8]' is invalid for input of size 2823306

I haven't encountered a similar issue before. What about first disabling the Hilbert-related setting for debugging?
Also, most settings in Pointcept request 4 GPUs for best performance.

I met the same problem, it seem that pytorch don't allow viewing a tensor as a new dtype with a different number of bytes.
My pytorch version 1.10.0

I met the same problem. It seems that pytorch don't allow viewing a tensor as a new dtype with a different number of bytes. My pytorch version 1.10.0

I use PyTorch 1.12.x and 2.x for PTv3, just for reference.


Updating readme from branch example

Updates
I updated the readme. Please review and accept.

Thoughts
I probably shouldn't, but okay. :+1:


Regression: Sidecar not found by js-sdk in several cases using final release of 3.3.0

Repro as seen in quickstart steps and failing tests
https://github.com/dapr/quickstarts/issues/998
simple repro:
dapr run --app-id order-processor --resources-path ../../../components/ --app-protocol grpc --dapr-grpc-port 3500 -- node index.js

ℹ  Dapr sidecar is up and running.
ℹ  Updating metadata for appPID: 65932
ℹ  Updating metadata for app command: node index.js
✅  You're up and running! Both Dapr and your app logs will appear here.

== APP == 2024-03-06T18:22:57.243Z INFO [GRPCClient, GRPCClient] Opening connection to localhost:3500
== APP == 2024-03-06T18:22:57.248Z INFO [GRPCClient, GRPCClient] Awaiting Sidecar to be Started
== APP == Could not get config item, err:Error: DAPR_SIDECAR_COULD_NOT_BE_STARTED

@shubham1172   replied in another chat
It is due to this proto change https://github.com/dapr/dapr/commit/4d4c8b937b63fc5303a2a1dc90eb966c500350a5
Strangely the tests did not catch it (which is a repair item), but I will fix this in a few hours.

Verified!
✅  You're up and running! Both Dapr and your app logs will appear here.

== APP == 2024-03-06T21:15:20.250Z INFO [GRPCClient, GRPCClient] Opening connection to localhost:3500
== APP == Configuration for orderId1: {"key":"orderId1","value":"103","version":"","metadata":{}}
== APP == Configuration for orderId2: {"key":"orderId2","value":"104","version":"","metadata":{}}


Fix husky failing

PR #155 broke husky due to version inconsistency. This PR fixes it.

Sorry @bodhish, I'm gonna merge this without asking you :sweat_smile:. Can't work on master due to an error which this PR fixes.


Currently no Timeouts configured and no way to set a default timeout

As per above there is currently not timeout configured when making requests of the API and no way to add a timeout as part of the Commcell object, so if the API does not respond for any reason a script may hang indefinitely until exited by the user. Ideally this would be configurable whilst creating your Commcell object with some sort of default set.

Hi @jammiemil,
By default, we timeout API calls after 10mins. Can you please let us know if you have come across any case where we didn't timeout even after 10mins?
Thanks.

Hi @spakhare,
Thanks for responding. I had a look through the source and i couldn't see any reference to a timeout at all, but perhaps i missed it. However for our use case we are making regular calls to the API for pulling metrics out of the system to display in our monitoring system rather than an orchestration type use case so we were looking to timeout much sooner around the 5-10 second period. If there's at least a default timeout of 10mins then that's great but it would be useful to be able to override this when defining our api connections for different use cases.

Hi @jammiemil,
Thanks for confirming your use case. As of now, we don't have support to set the timeout. I will check if we can get something.
Thanks


Add tests for Allowinsecureredirect parameter in Web cmdlets

PR Summary
Some tests for -AllowInsecureRedirect, they might need some small changes

PR Context
#18902 #18546 #18595

@CarloToso Please look test fails.

@iSazonov fixed tests

@CarloToso Great! Thanks!


Somatic update

Tasks
Tasks extracted from PR #94 :
Based on commit 0a30513f360b82828efeed6835f362df999f776a

[ ] Unify output filenames for Control Freec and CopyWriter.
[ ]  Consolidate GRCh37 and GRCh38.

Based on commit e3be244584549cb2f623e4f4e0112b1643376fc0

[x]  Output both Full and Filtered VCF files for mutect2.
[x] Rename 'common' to 'biallelic' variants - follow GATK convention.

Based on commit 1a451614bf10c840f2e5566463078c7cb40f16c0

[ ] Remove parallel somatic variant annotation.
[x] Catch multiple filter conditions in eb_filter.
[ ] Log conda information used for jannovar wrapper.

Based on commit c2594449df3f9ecff92a04e0b6f975d061cf38ce

[x] Expand list of result expansion files in snappy_pipeline/workflows/somatic_variant_calling/__init__.py - mutect2 related.

Based on commit 18b83627a204e8ec077dd93d4d60a16e4158c91f

[x] Fix log file in wrapper snappy_wrappers/wrappers/mutect2/contamination/wrapper.py
[x] Fix log file in wrapper snappy_wrappers/wrappers/mutect2/filter/wrapper.py

Based on commit c46917387b3552c08113b6fab9e88e88c18c6ebf

[ ] Update cbioportal_export default config.
[ ] Fix wrapper snappy_wrappers/wrappers/cbioportal/case_lists/wrapper.py.
[ ] Fix wrapper snappy_wrappers/wrappers/cbioportal/meta_files/wrapper.py.
[ ] Fix wrapper snappy_wrappers/wrappers/vcf2maf/vcf2maf/wrapper.py.

Based on commit d407f2075ffe387988ae2e72d6b27b23e3746606

[ ] Disable collect target coverage when no target coverage files requested.

Based on commit f062fc5fca06e846eb6189b87476d21c2928ae36

Miscellaneous - hard to pin, probably just debugging.

For 'Unify output filenames for Control Freec and CopyWriter':
one should also consider unifying cnvetti_on_target_postprocess output. Currently using _ to separate the file extension:
output/bwa.cnvetti_on_target_postprocess.P00{i}-T{t}-DNA1-WGS1/out/bwa.cnvetti_on_target_postprocess.P00{i}-T{t}-DNA1-WGS1_{ext}

Line 290 - method CnvettiStepPartBase._get_output_files_postprocess()

I don't  understand the changes to snappy_wrappers/wrappers/control_freec/transform/snappy-convert-control_freec.R:
-> They seem to be the reverse of the changes to the workflow.
--                                   ratios_fn=paste("freec.", sample_name, ".ratio.txt", sep=""),
--                                   log2_fn=paste("freec.", sample_name, ".log2.txt", sep=""),
--                                   call_fn=paste("freec.", sample_name, ".call.txt", sep=""),
--                                   segments_fn=paste("freec.", sample_name, ".segments.txt", sep=""),
+-                                   ratios_fn=paste("freec.", sample_name, "_ratio.txt", sep=""),
+-                                   log2_fn=paste("freec.", sample_name, "_gene_log2.txt", sep=""),
+-                                   call_fn=paste("freec.", sample_name, "_gene_call.txt", sep=""),
+-                                   segments_fn=paste("freec.", sample_name, "_segments.txt", sep=""),

For the function postProcess in snappy_wrappers/wrappers/copywriter/call/snappy-copywriter-call.R:
-> Can't the outputs be an argument, similar to control_freec_write_files, so they don't need to be agnostic towards the rest of the code?
Example:
--                         paste( mapper, ".copywriter.", fullID, "_segments.txt", sep="" ) ),
+-                         paste( mapper, ".copywriter.", fullID, ".segments.txt", sep="" ) ),

Another points about control_freec_write_files, it seems to have default values but the code will stop if files are not accessible. Are defaults really necessary? Can't they just be defined/taken from the wrapper?

I am afraid I have created a monster here. I should have stuck to a naming convention for all CNV steps:

copywriter in somatic_targeted_seq_cnv_calling,
CNVkit in somatic_targeted_seq_cnv_calling & somatic_wgs_cnv_calling,
Control-FREEC in somatic_wgs_cnv_calling
cnvetti (germline)

You are welcome to unify the naming convention.
On a side note, I found that output filenames are configured differently in different places,even within the same step & tool (for example names are constructed with underscore and with dot).
I don't know which is the right way to go. Ideally, I would like to:

merge the somatic_targeted_seq_cnv_calling with the somatic_wgs_cnv_calling (there is no logical need to keep them apart, as the WES & WGS somatic snvs & indel calling are grouped in a single step)
unify using the dot as separator in filenames, the same way that the tools are separated.

This is probably a lot of unnecessary work, but perhaps we should consider moving to dot separation across the somatic CNV steps.

Regarding the control_freec_write_files, I assume you are referring to the Bioconductor packages org.Hs.eg.db, TxDb.Hsapiens.UCSC.hg19.knownGene & BSgenome.Hsapiens.1000genomes.hs37d5.
This is a real problem, because these packages are huge (genome sequence, genome feature annotations, gene ids & functional annotations), and they are only valid for one genome release. If we want to use GRCh38, or mouse data, then we need to use other version of these packages.
The problem comes as the packages are downloaded using the wrapper's conda environment. So the only solution (at the moment) is to put in the conda environment annotation packages for several genome releases
and species.
We discussed with Clemens a way to have a sub-step which creates a sub-directory in $PWD/work in which required packages are installed. This would then be used as supplementary library path for the R scripts, provided by the wrapper. I have a pretty good idea how we could do that, but I need a few days to work on it.

Sorry I misunderstood your comment. You are absolutely right: ratios_fn should be obtained from the wrapper.


Adding marker labels create an error

I want to add a message to a marker but it creates the error "Node.appendChild does not implement interface Node." at line 74836 of the library.
It seems that the element we want to append is not a DOM element.
I just tried with the most simple example with a message :
<openlayers class="col s12" height="400px" zoom="5" ol-center="center"> <ol-marker lat="39.92" lon="116.38" message="Here is Beijing. Dreamful place."></ol-marker> </openlayers>
and this gives this stack trace :
Error: Argument 1 of Node.appendChild does not implement interface Node. ol.Overlay.prototype.handleElementChanged@http://localhost:3000/app/js/ol.js:74836:5 ol.events.bindListener_/boundListener@http://localhost:3000/app/js/ol.js:5793:12 ol.events.EventTarget.prototype.dispatchEvent@http://localhost:3000/app/js/ol.js:6500:11 ol.Object.prototype.notify@http://localhost:3000/app/js/ol.js:6915:1 ol.Object.prototype.set@http://localhost:3000/app/js/ol.js:6935:7 ol.Overlay.prototype.setElement@http://localhost:3000/app/js/ol.js:74908:3 ol.Overlay@http://localhost:3000/app/js/ol.js:74740:5 .createOverlay@http://localhost:3000/app/js/directives/openLayer.js:1890:22 .link/<@http://localhost:3000/app/js/directives/openLayer.js:758:33 qFactory/defer/deferred.promise.then/wrappedCallback@http://localhost:3000/app/js/angular/angular.min.js:11722:31 qFactory/ref/<.then/<@http://localhost:3000/app/js/angular/angular.min.js:11808:26 $RootScopeProvider/this.$get</Scope.prototype.$eval@http://localhost:3000/app/js/angular/angular.min.js:12851:16 $RootScopeProvider/this.$get</Scope.prototype.$digest@http://localhost:3000/app/js/angular/angular.min.js:12663:15 $RootScopeProvider/this.$get</Scope.prototype.$apply@http://localhost:3000/app/js/angular/angular.min.js:12955:13 done@http://localhost:3000/app/js/angular/angular.min.js:8466:34 completeRequest@http://localhost:3000/app/js/angular/angular.min.js:8680:7 createHttpBackend/</xhr.onreadystatechange@http://localhost:3000/app/js/angular/angular.min.js:8619:1
I'm using ol-debug.js and not ol.js
The center works perfectly, and the class of the openlayers is just for css and width.

Hi,
I've just tried your example with ol-debug v3.10.1 and latest version of angular-openlayers-directive,  and it seems to be working. Here is a JSFiddle link: http://jsfiddle.net/anushamc/m8eew4g7/
Perhaps the error is caused by some other part of your code?

@Sehsyha I'm closing this issue. Please feel free to re-open it if it still persists. Also check out our latest version that just got released. Maybe it fixes some of your issues.


Frontend/logo button

:rocket: deployment of connecting-to-services succeeded (http://connecting-to-services-pr-319.dev.beta.nhschoices.net)

:rocket: deployment of connecting-to-services succeeded (http://connecting-to-services-pr-319.dev.beta.nhschoices.net)

:rocket: deployment of connecting-to-services succeeded (http://connecting-to-services-pr-319.dev.beta.nhschoices.net)

:rocket: deployment of connecting-to-services succeeded (http://connecting-to-services-pr-319.dev.beta.nhschoices.net)

@st3v3nhunt wrote:

it would be worth adding the --include-path paths as variables to the script

Agreed, looks much better and easier to manage.

:rocket: deployment of connecting-to-services succeeded (http://connecting-to-services-pr-319.dev.beta.nhschoices.net)


Implementation for minTTL

This PR introduces a minTTL setting which would help address the problem of applications caching DNS response IPs indefinitely. Cluster administrators should be able to configure this value, ideally setting it to be equal to or greater than the maximum TTL value of the application's DNS cache.
This feature is a work towards resolving the issue of indefinite caching of DNS response IPs by certain applications.

/test-all


Draft: Buildkit-based local builds

Background
@mattwynne and I paired on a spike to see what a Docker/Buidkit-based build process would be like
The main focus was local development, so although in this PR I've converted the linux GHA runs, that's mostly for information and has been isolated into a separate commit
This change lets a single command run all code generation, dependency installation, and testing. The only dependency is on a recent buildx, which is now included with Docker [^1]. There are no requirements for any other shell commands to be present on host, including bash or make.
Usage

docker buildx bake generates the code, outputs it to disk, and runs the tests
docker buildx bake codegen generates the code and outputs it to disk
docker buildx bake test generates the code and then runs the tests without outputting it to disk

Execution optimisation
Here's what will be executed when doing some typical developer workflows (after first run assumes you didn't clear buildkit cache):

❌ not run
✅ run for affected language
🌍 run for all languages

Scenario
Pull docker images
Code generation
Dependency installation
Tests

First run
🌍
🌍
🌍
🌍
Mostly bandwidth-limited

No changes
❌
❌
❌
❌
<10s

Modified non-codegen code
❌
❌
❌
✅

Modified dependencies
❌
❌
✅
✅
Tests run if different packages are installed as a result

Modified codegen template
❌
🌍
❌
✅
Langs with same codegen output won't run tests

Modified JSON schema
❌
🌍
❌
🌍

Cachebusting
The only part of the process that is not reproducible from local assets is the dependency installation. Because of this, each language's build has a stage named with-dependencies.
This enables us to run docker buildx bake --set '*.no-cache-filter=with-dependencies to cachebust that stage only and force all the package managers to re-execute.
This could be useful in a nightly build, or a pre-release.
Limitations
The way generated code is output to disk by Buildkit does not support file deletion. This means that for PHP and Java where the generated code is across multiple files, it may make sense to still have a small shell wrapper that deletes the files first.
[^1]: There is also a way we can support arbitrarily old docker clients with a small shell script

Ah we don't have GHA runners: see https://github.com/ciaranmcnulty/messages/pull/2 for the checks

Ah we don't have GHA runners: see ciaranmcnulty#2 for the checks

Can you say more about this? Is there something I can change in the settings to get all the checks to run here?

I like this. I think the only thing we're missing for me is a CONTRIBUTING.md which outlines how you use these commands for typical development tasks, what you need to install etc.

The CONTRIBUTING.md added in https://github.com/cucumber/messages/pull/111 will need updated

@mattwynne you've merged this titled "Draft:" and you comment https://github.com/cucumber/messages/pull/58#issuecomment-1324632439 wasn't addressed. :D


How to visit from another machine?

I can only visit from localhost. How to visit from another machine? Thanks.

I have figured out by this command:
python manage.py runserver <IP_ADDRESS>:8000


getting exception when creating configurable product in case of DB_Prefix

Bug report
Title
getting exception when creating configurable product in case of DB_Prefix
Issue Description
getting exception when creating configurable product in case of DB_Prefix
Preconditions
1. framework Version- master

Steps to reproduce
1. step1- add DB_Prefix in .env file and migrate
2. step2- now create the configurable product

Expected result
the configurable product should be created successfully
Actual result

fixed


Aws backend dcos 1.9 workaround

Workaround for the 1.9 bug described here: DCOS_OSS-847
Due to a bug in < 1.9.7 ip_detect_public_filename has no effect when supplied in the config.yaml.
Another unintended behavior, overwriting ip_detect_public_contents with a functioning ip-detect-public script, can work around this issue until the bug fix is merged into 1.9.8. The workaround also enables us to launch DC/OS < 1.9.7 after the fix was merged. If then the other unintended behavior is fixed someday, and ip_detect_public_contents it may not work anymore, because dcos-launch does not add ip_detect_public_filename automatically with its pre-defined script if ip_detect_public_contents is present. Then we need to take action to differentiate DC/OS versions or remove the workaround and stop supporting < 1.9.7.

Please:

Address my tiny comment
Add a Changelog entry like "The AWS backend now supports DC/OS 1.9".
Confirm that you have tested this on a 1.9 cluster
Wait until AWS tests on CI are done

and thanks!

Tested multiple times with the CI TestRunIntegration tests.
Proof of 1.9.x resilience tests in Teamcity (past cluster start already.)


Remove covalent/core dependency

Feature Request
Remove the dependency on @covalent/core listed in src/platform/http/package.json
What is the motivation / use case for changing the behavior?
In the other sources for the @covalent/http package, there is nothing that explicitly depends on @covalent/core package. For those that are trying to consume @covalent/http standalone and just for the features it offers such as an HttpInterceptorService, npm ends up fetching much heavier dependencies such as angular2-material.

Yeah, you are definitely right, the reason we had core as a dependency, is cause core has all the angular dependencies, but http doesnt need material.
Having said that, before we were forcing the versioning to be fixed (since it was beta/rc), but since angular has gone stable for a while now, we might change this to be a peerDependency.

Done with https://github.com/Teradata/covalent/pull/136


Logs: quick severity filter with "Warning" default

Hi!
just for possible discussion of  https://github.com/opnsense/core/issues/5337#issuecomment-974886511
Clarifications: Under certain circumstances, some processes and services can create quite a lot of noise in the logs. This is great for debugging, but can be annoying for the administrator during normal operation.
Initial idea: since the OPNSense finally completely switches to syslog-ng, RFC5424 support has been added, and even a severity filter has already been added (!  :thumbsup:), it may be worth considering to make the default log representation of the "warning logs" type (do not show by default lines reflecting normal behavior)?
Details: pr by default displays the logs filtered with "Warning" severity (UPD. badly put it: filtered with a level below or equal to "Warning"), the severity filter allows to specify the maximum severity level to fetch and saves the user's choice to localStorage.
thanks!

@AdSchellevis Hi! seems to work. Could you look at it when you have time?)

@kulikov-a will do, thanks!

@kulikov-a This PR looks really nice and useful, as one is very rarely interested in specific levels, but usually only ranges!
I'd like to discuss the "exact severity filter" option a bit further:
I find the toggle box itself a bit misplaced in the UI (top left of the page). I'd recommend putting it below the actual filter elements, as these elements belong contextually to the switch. The help is not needed from my perspective, the name is quite self-explanatory.
Anyway, I cannot imaging any use-case where I'd like to see a precise combination of non-incremental severity levels. The only situation I can imagine is, that a specific like is spamming the log and I'd like to ignore that line for a moment. But even in such a situation, I very likely would loose other interesting logs having the same severity as the spammer... Maybe a negative text-filter would therefore be more useful than a precise selection of severities?

@8191 Ok, maybe I'm complicating it more than needed. I can think of some use-cases when it would be practical to filter only "Informational" when there are a lot of "Notices" as well. @kulikov-a previous version only used max severity, which in hindsight might be better to start with.

apologize for the delay (raid on old adaptec drove me nuts all day).
actually, when I started to prepare an update for this request, I finally seem to understand @AdSchellevis . The exact choice of the severity is sometimes useful (for example, when it is necessary to export strings of a certain severity or, for convenience, necessary to remove especially noisy severities).
@8191 you mean to do something like?

@AdSchellevis what do you think? which option is better (I also think the option with a single switch is more compact. help text can be placed in tooltip)?
first variant:

@kulikov-a The new variant looks pretty nice, doesn't draw more attention then needed, nice :) A tooltip might work indeed, but only explaining the use in the documentation is also an option if it involves more text.

@kulikov-a Thanks for taking my suggestion into account to move the check "box" to the right.
I don't want to be picky, but from a usability point of view, I believe having it exactly above the severity selection would be even better... :hand_over_mouth:

@AdSchellevis thanks! I'll try to come up with a concise tooltip and update the code)
@8191 I would try, but I couldn't come up with an organic look for this. could you give an example please?

the most compact that I could come up with:

@kulikov-a sorry, I didn't have time yet to look at this, but your proposal looks good!

@kulikov-a you're very creative :) To be honest I don't have a strong preference on the subject, the small toggle on the left is likely a bit cleaner, but I can live with both.

@AdSchellevis  thanks)). updated the code

@kulikov-a Your proposal looks good to me! :-)
Just for curiosity I've tried something else:
select.selectpicker({ header: 'Multiselect'});

@8191 looks fun  but i think we will need to (re)bind 'click' each time after bs-select init? not too complex?

@kulikov-a You're right - maybe it's too much hassle to bring this is.
Your proposal is fine anyway, the only thing which I don't like is that from first sight it looks like to turn on/off the complete filter element. What about changing the icon from fa-toggle-on/fa-toggle-off to e.g. fa-bullseye/dot-circle? Like "targeted" or "selected"...
https://user-images.githubusercontent.com/5854959/146633946-57c1d07a-b92e-4cdb-aefd-be0794981e6e.mp4

@8191 in this case, I would try a fa-crosshairs with color switching :wink:

but I thought to stick with the general gui style
I agree to any option that suits @AdSchellevis )

Yes, we should stick to the general GUI style, but I think there is nothing similar existing already. The "switch" symbol is usually used to switch something on/off. But here we are switching between two functions.
Your proposal is also fine 🙂

I don't have a very strong preference, although Manuel's version is clearer at a first sight.

If the current code is functional, I don't mind reviewing and pulling this in and change the layout a bit later by the way.

Yeah, I'm in favor of the two step approach. We can deal with that detail in a separate PR.

I ventured to update the code based on Manuel's idea (in the end, it turned out to be even somewhat shorter). Maybe it will turn out not to return to the question with a separate request )

@kulikov-a Looks great! 👍🏻
One suggestion: keep the selectipicker open after clicking the toggle button. It's a bit tricky, but after some struggle I've accomplished by addClass('open') and a selectpicker('refresh'). This also requires to stop propagating the click event. - See code comments inline.

@AdSchellevis looks like we are ready for review. whenever you have time :smile:

@kulikov-a @8191  works like a charm! thanks!

@AdSchellevis  thanks!!
@8191 thanks again for code review and toggle choice! pleasure to participate in this way


The service doesn't work anymore (-)

Subj.

Thanks - it works again now. There's some kind of memory leak that eventually causes it to stop working, with this error:
Error: spawn ENOMEM
    at errnoException (child_process.js:1001:11)
    at ChildProcess.spawn (child_process.js:948:11)
    at exports.spawn (child_process.js:736:9)
    at Object.exports.execFile (child_process.js:618:15)
    at exports.exec (child_process.js:589:18)
    at Object.Shaaa.certs (/home/shaaaaa/shaaaaa/current/shaaaaa.js:101:5)
    at Object.Shaaa.from (/home/shaaaaa/shaaaaa/current/shaaaaa.js:168:11)
    at /home/shaaaaa/shaaaaa/current/routes.js:22:13
    at Layer.handle [as handle_request] (/home/shaaaaa/shaaaaa/current/node_modules/express/lib/router/layer.js:82:5)
    at next (/home/shaaaaa/shaaaaa/current/node_modules/express/lib/router/route.js:110:13)

And then if I restart the server, it works great...until it doesn't anymore. Help identifying and fixing the problem would be quite welcome!


.NET Framework 4.6.2 compatibility?

Hi,
I have been working with App.Metrics and InfluxDB extension meanwhile Prometheus one was released.
Today, I am trying to install it in the testing project where InfluxDB was, but NuGet says:

Could not install package 'App.Metrics.Formatters.Prometheus 1.1.0'. You are trying to install this package into a project that targets '.NETFramework,Version=v4.6.2', but the package does not contain any assembly references or content files that are compatible with that framework. For more information, contact the package author.

After checking both libraries, It seems that it is because of the lack of .NET Framework dependency in this one:
App.Metrics.Extensions.Reporting.InfluxDB

AppMetrics.Extensions.Prometheus

However, I checked .NET Standard supported platforms table and, nowadays, 4.6.2 does not match 1.6. Besides, the rest of the App.Metrics libraries include the .NET Framework dependency and I have no problems with them.

@mikefonted Try this

Yes!

Successfully installed 'App.Metrics.Formatters.Prometheus 1.1.1-alpha-0042'

Thank you

@mikefonted briefly, why is Prometheus your first choice in a TSDB?  Just curious.

@alhardy briefly, in this case specifically, the pull model fits in better ;)

@mikefonted interesting, yeah I do see pro's and con's in both pull and push approaches. So you don't really have a preference in the DB itself?
@Rurouni can you share anything with your experience with Prometheus?
I see Prometheus has recently done some amazing IO improvements, it's also interesting that Influx is planning to support a pull model.
FYI in the latest release, the /metrics and /metrics-text endpoints both now support custom formatting and also work with the other App Metrics Reporting libraries e.g. InfluxDB, ES, Graphite. Similarly, the Console, Text File and Http Reporters support the same making this all quite flexible:

Log to disk and have an agent read and flush
Pull over http
Push direct to TSDB
Push to a custom HTTP endpoint
Sink from Console

@alhardy I went with Prometheus mostly because of very good Kubernetes support, but my project is not in production yet so I don't have any battle experience to share.

@Rurouni Thanks for sharing. We've been in prod with InfluxDB for almost a year now, no dramas thus far, not plugging InfluxDB just like to know about options :) We are starting to POC containerizing (still on VMs) some of our stuff so that's a useful comment.


[HashiCorp] Preflight's container name test fails for registry/repos with more path components than canonical /:

Bug Description
A partner who's container registry allows more path components than the standard /: for their containers will fail the Red Hat trademark test.
Version and Command Invocation
time="2024-12-10T00:39:40Z" level=info msg="certification library version" version="1.11.0 <commit: e02ce0df45c869cae741020081b6745b13b27959>"
time="2024-12-10T00:39:40Z" level=info msg="target image" image="crt-core-staging-docker-local.artifactory.hashicorp.engineering/quay.io/redhat-isv-containers/62211e0d8bf2cabc69a39c7d:1.10.0-alpha20241205-ubi"

Steps to Reproduce:

Run 'preflight check container' against a container image stored in a registry with a higher number of path components, where one of those components that is not the last one contains the name 'redhat'.

Expected Result
Preflight to not complain about the container name since "redhat" is not found in the last path component (the repo name, commonly used as the container name)
Actual Result
 time="2024-12-10T00:39:40Z" level=info msg="certification library version" version="1.11.0 <commit: e02ce0df45c869cae741020081b6745b13b27959>"
  time="2024-12-10T00:39:40Z" level=info msg="running checks for crt-core-staging-docker-local.artifactory.hashicorp.engineering/quay.io/redhat-isv-containers/62211e0d8bf2cabc69a39c7d:1.10.0-alpha20241205-ubi for platform amd64"
  time="2024-12-10T00:39:40Z" level=info msg="target image" image="crt-core-staging-docker-local.artifactory.hashicorp.engineering/quay.io/redhat-isv-containers/62211e0d8bf2cabc69a39c7d:1.10.0-alpha20241205-ubi"
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=HasLicense result=PASSED
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=HasUniqueTag result=PASSED
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=LayerCountAcceptable result=PASSED
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=HasNoProhibitedPackages result=PASSED
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=HasRequiredLabel result=PASSED
  time="2024-12-10T00:39:46Z" level=info msg="USER 101 specified that is non-root" check=RunAsNonRoot
  time="2024-12-10T00:39:46Z" level=info msg="check completed" check=RunAsNonRoot result=PASSED
  time="2024-12-10T00:39:50Z" level=info msg="check completed" check=HasModifiedFiles result=PASSED
  time="2024-12-10T00:39:52Z" level=info msg="check completed" check=BasedOnUbi result=PASSED
  time="2024-12-10T00:39:52Z" level=info msg="check completed" check=HasProhibitedContainerName result=FAILED
  time="2024-12-10T00:39:52Z" level=info msg="This image's tag 1.10.0-alpha20241205-ubi will be paired with digest sha256:5d01deebab3d33e08811477727c184b0c1ddecf96e4ed2fce9f13188a6a1a61c once this image has been published in accordance with Red Hat Certification policy. You may then add or remove any supplemental tags through your Red Hat Connect portal as you see fit."
  time="2024-12-10T00:39:52Z" level=info msg="Preflight result: FAILED"

Additional Context
(Anything else you think might help us troubleshoot, like your platform, dependency versions, etc).

This was already fixed in main yesterday with the below:

Relates: #1225

I'm adding a test case for this use case.


Implement softplus

@fdwr @huningxin PTAL, thanks.

Oh, I hadn't noticed until now that WebNN's softplus is like PyTorch but differs from ONNX's.
WebNN: ln(exp(steepness * x) + 1) / steepness. ONNX: ln(exp(x) + 1)  PyTorch: log(exp(scale ∗ x)+1) / scale

@fdwr , thanks for the good catching. Do you see any issues here?


2.0 official release?

I know 2.0 has been converted in the 2.0 branch (I'm using it and it's good btw) but will it get an official tag and release?

Wondering the same thing. And great work again :)

+1

There are still a couple of little changes to be made (moving bootstrap/responsive about and vendoring 1.4 so people using  rails_admin can upgrade) which, although minor, I haven't had the time to change and test over the past week.

I propose we move on without vendoring 1.4.
If you can push 2.0 now, I'll upgrade RailsAdmin today (10am here).
I don't know about responsive, but if you can push 2.0.0 without it and 2.0.1 with it, it's all good to me.
Cheers.

Lets roll then.

+1

+1
:shipit::octocat::snowman:
:ok_hand:


SNOW-887971: Set Application property for Python connections

Python version
No response
Platform
No response
What happened
In a previous version of SnowCLI we would add a property to the connection called "application" - this is an identifier that allows us to see and correlate Snowflake connections from specific client apps.  Would be helpful to add this back in so we can correlate better: https://github.com/Snowflake-Labs/snowcli/blob/f65e25f55b2b1b77aefdcdae52111416fe2f4fc5/src/snowcli/snow_connector.py#L43
Console output
No response
How to reproduce
No response

@sfc-gh-jhollan we still have it https://github.com/Snowflake-Labs/snowcli/blob/3d11dba63e5ca2af914437ab0d9452020b19bdae/src/snowcli/snow_connector.py#L46

Ah thank you. Do you know what the actual string looks like? Even casing? I can try to run but was trying to find the correlated connection logs and wasn't sure of string to search for.

We build it from provided command, e.g.
for % snow stage list we will send SNOWCLI.STAGE.LIST
% snow stage create new_stage -> SNOWCLI.STAGE.CREATE
% snow warehouse status -> SNOWCLI.WAREHOUSE.STATUS


Update profile screen for tech preview

You should have a few avatars to pick from in the profile screen. These should be populated from a list stored in a JSON file. The JSON file should also store urls to thumbnails for each avatar. Each url should be an mxc url to an asset stored on the matrix homeserver to avoid uploading/downloading duplicate assets.

On second thought we're probably going to launch with just the X and Y bot avatars being randomly assigned to you when you join the room. We want to take our time to introduce any avatars and work with creators to make sure they meet our quality standards before we go ahead with custom avatars.
So, with this in place and no real way to create custom avatars at this time, I think we should hide the avatar upload in the profile for now.


docs(idempotency): add missing Lambda Context to testing your code se…

Issue number: #1718
Summary
Changes

Please provide a summary of what's being changed

Add missing LambdaContext for Testing your code section, and a note on thread-safety limitation when calling functions decorated with idempotent_function via threading.
User experience

Please share what the user experience looks like before and after this change

Checklist
If your change doesn't seem to apply, please leave them unchecked.

[x] Meet tenets criteria
[x] I have performed a self-review of this change
[ ] Changes have been tested
[x] Changes are documented
[x] PR title follows conventional commit semantics

Is this a breaking change?
RFC issue number:
Checklist:

[ ] Migration process documented
[ ] Implement warnings (if it can live side by side)

Acknowledgment
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

View rendered docs/utilities/idempotency.md

Merging as all other maintainers are unavailable.


Do not access systemconfig if not set

This fixes:
error: The option `programs.nix-data.systemconfig' is used but not defined.

Can you rebase and target the dev branch? Trying to put all breaking changes there

It shouldn't be breaking and the error message will look very similar if programs.nix-data.enable is true and the other options are not set but with this change it will no longer require them to be set if programs.nix-data.enable is false.

Not breaking in the sense of loss of functionality, just means that it will require manual intervention to fix a rebuild from the default SnowflakeOS installation


Fixes broken link

The original declaration files link was dead, and the page it had been pointing to now refers us to the declaration files/Introduction.md. This will fix the issue mentioned in issue #28484 of the main TS repository.

This will fix the issue mentioned in issue #28484 of the main TS repository.

Microsoft/TypeScript#28484

👍  thanks!


Error when changing the height of any item selector

I have a masonry-brick which can change the height of any item selector in this script whenever I click a 'More/Less' button. But when I click this button, it causes some errors of other masonry-brick scripts which is in inside each other, so how can I fix this issue, please help me asap?

I have an issue in which i have a masonry-brick and within i have a ng-show.  when that ng-show is triggered the size changes but the layout is not changed


Bug 723432 (undefined): Allow blankNullUndefined to override

presentation of null and undefined to use '' (empty string)

Moving to https://github.com/campd/gcli/pull/24