OSError: libsndfile is not found!. Use your system package manager to install it (e.g. apt install libsndfile1

Hi, I have a bug when try to run https://github.com/facebookresearch/seamless_communication repo:
$ m4t_predict
Traceback (most recent call last):
  File "/home/myuser/.local/bin/m4t_predict", line 5, in <module>
    from m4t_scripts.predict.predict import main
  File "/home/myuser/.local/lib/python3.8/site-packages/m4t_scripts/predict/predict.py", line 10, in <module>
    from seamless_communication.models.inference import Translator
  File "/home/myuser/.local/lib/python3.8/site-packages/seamless_communication/models/inference/__init__.py", line 6, in <module>
    from seamless_communication.models.inference.translator import Translator as Translator
  File "/home/myuser/.local/lib/python3.8/site-packages/seamless_communication/models/inference/translator.py", line 12, in <module>
    from fairseq2.data import Collater
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2/data/__init__.py", line 7, in <module>
    from fairseq2.data.cstring import CString as CString
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2/data/cstring.py", line 58, in <module>
    from fairseq2n.bindings.data.string import CString as CString
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2n/__init__.py", line 91, in <module>
    _load_sndfile()
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2n/__init__.py", line 81, in _load_sndfile
    raise OSError(
OSError: libsndfile is not found!. Use your system package manager to install it (e.g. `apt install libsndfile1`).

SeamlessM4T installed by instruction in README.md by pip install .
Installation verification of libsndfile1
$ dpkg -L libsndfile1
/.
/usr
/usr/lib
/usr/lib/x86_64-linux-gnu
/usr/lib/x86_64-linux-gnu/libsndfile.so.1.0.28
/usr/share
/usr/share/doc
/usr/share/doc/libsndfile1
/usr/share/doc/libsndfile1/changelog.Debian.gz
/usr/share/doc/libsndfile1/copyright
/usr/lib/x86_64-linux-gnu/libsndfile.so.1

System info:
Linux DD8SXD3 5.15.0-76-generic #83~20.04.1-Ubuntu SMP Wed Jun 21 20:23:31 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
memory         31GiB System memory
processor      Intel(R) Core(TM) i7-10850H CPU @ 2.70GHz
bridge         10th Gen Core Processor Host Bridge/DRAM Registers
display        UHD Graphics

@mdotvasylenchuk I see that you installed libsndfile using apt.  DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/r/notices.json HTTP/1.1" 404 None
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/notices.json HTTP/1.1" 404 None
DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/notices.json HTTP/1.1" 404 None
done
Collecting package metadata (current_repodata.json): - DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443
| DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/noarch/current_repodata.json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/linux-64/current_repodata.json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/r/noarch/current_repodata.json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/r/linux-64/current_repodata.json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/current_repodata.json HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/noarch/current_repodata.json HTTP/1.1" 200 None
done
Solving environment: done

## Package Plan ##

  environment location: /home/myuser/anaconda3

  added / updated specs:
    - libsndfile

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2023.7.22  |       hbcca054_0         146 KB  conda-forge
    certifi-2023.7.22          |     pyhd8ed1ab_0         150 KB  conda-forge
    conda-23.7.3               |  py311h38be061_0         1.3 MB  conda-forge
    cryptography-39.0.1        |  py311h9ce1e76_0         1.4 MB
    gettext-0.21.0             |       hf68c758_0         2.6 MB
    libflac-1.3.4              |       h27087fc_0         474 KB  conda-forge
    libogg-1.3.4               |       h7f98852_1         206 KB  conda-forge
    libopus-1.3.1              |       h7f98852_1         255 KB  conda-forge
    libsndfile-1.0.31          |       h9c3ff4c_1         602 KB  conda-forge
    libvorbis-1.3.7            |       h9c3ff4c_0         280 KB  conda-forge
    openssl-1.1.1v             |       h7f8727e_0         3.7 MB
    python_abi-3.11            |          2_cp311           5 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        11.1 MB

The following NEW packages will be INSTALLED:

  gettext            pkgs/main/linux-64::gettext-0.21.0-hf68c758_0
  libflac            conda-forge/linux-64::libflac-1.3.4-h27087fc_0
  libogg             conda-forge/linux-64::libogg-1.3.4-h7f98852_1
  libopus            conda-forge/linux-64::libopus-1.3.1-h7f98852_1
  libsndfile         conda-forge/linux-64::libsndfile-1.0.31-h9c3ff4c_1
  libvorbis          conda-forge/linux-64::libvorbis-1.3.7-h9c3ff4c_0
  python_abi         conda-forge/linux-64::python_abi-3.11-2_cp311

The following packages will be UPDATED:

  ca-certificates    pkgs/main::ca-certificates-2023.05.30~ --> conda-forge::ca-certificates-2023.7.22-hbcca054_0
  conda              pkgs/main::conda-23.7.2-py311h06a4308~ --> conda-forge::conda-23.7.3-py311h38be061_0
  openssl                                 1.1.1u-h7f8727e_0 --> 1.1.1v-h7f8727e_0

The following packages will be SUPERSEDED by a higher-priority channel:

  certifi            pkgs/main/linux-64::certifi-2023.7.22~ --> conda-forge/noarch::certifi-2023.7.22-pyhd8ed1ab_0

The following packages will be DOWNGRADED:

  cryptography                       41.0.2-py311h774aba0_0 --> 39.0.1-py311h9ce1e76_0

Downloading and Extracting Packages
cryptography-39.0.1  | 1.4 MB    |                                                                                |   0%DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443                                                                                |   0%
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443                                                                                |   0%

                                                                                DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
python_abi-3.11      | 5 KB      |                                                                                |   0%
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
openssl-1.1.1v       | 3.7 MB    |                                                                                |   0%DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/linux-64/openssl-1.1.1v-h7f8727e_0.conda HTTP/1.1"<PHONE_NUMBER>                                          |   0%
DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/linux-64/cryptography-39.0.1-py311h9ce1e76_0.conda HTTP/1.1"<PHONE_NUMBER>
cryptography-39.0.1  | 1.4 MB    | #6                                                                                |   1% DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/python_abi-3.11-2_cp311.tar.bz2 HTTP/1.1" 200 4621                                         |   0%
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): repo.anaconda.com:443                                                                                DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/libsndfile-1.0.31-h9c3ff4c_1.tar.bz2 HTTP/1.1" 200 615959
cryptography-39.0.1  | 1.4 MB    | ###########################6                                                                                |  20% DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/ca-certificates-2023.7.22-hbcca054_0.conda HTTP/1.1" 200 149515########################### | 100%
libsndfile-1.0.31    | 602 KB    | ###7                                                                                |   3%DEBUG:urllib3.connectionpool:https://repo.anaconda.com:443 "GET /pkgs/main/linux-64/gettext-0.21.0-hf68c758_0.conda HTTP/1.1"<PHONE_NUMBER>                                          |   0%
cryptography-39.0.1  | 1.4 MB    | ############################################################2                                                                                |  42%DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443                                                                                |   1%
DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/conda-23.7.3-py311h38be061_0.conda HTTP/1.1"<PHONE_NUMBER>#####3                             |  80%
ca-certificates-2023 | 146 KB    | ###############5                                                                                |  11%DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443                                                                                |   4%
cryptography-39.0.1  | 1.4 MB    | ############################################################################################################################################## | 100%DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/noarch/certifi-2023.7.22-pyhd8ed1ab_0.conda HTTP/1.1" 200 153791                                     |  36%
openssl-1.1.1v       | 3.7 MB    | #########################################################################1                                                                     |  51%DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): conda.anaconda.org:443
DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/libogg-1.3.4-h7f98852_1.tar.bz2 HTTP/1.1" 200 210550###################################### | 100%
                                                                                DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/libvorbis-1.3.7-h9c3ff4c_0.tar.bz2 HTTP/1.1" 200 286280######6                              |  79%
                                                                                DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/libflac-1.3.4-h27087fc_0.tar.bz2 HTTP/1.1" 200 484942
certifi-2023.7.22    | 150 KB    | ###############1                                                                                |  11%DEBUG:urllib3.connectionpool:https://conda.anaconda.org:443 "GET /conda-forge/linux-64/libopus-1.3.1-h7f98852_1.tar.bz2 HTTP/1.1" 200 260658

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

(base) $ m4t_predict 'take it' t2tt ukrainian --src_lang english
Traceback (most recent call last):
  File "/home/myuser/.local/bin/m4t_predict", line 5, in <module>
    from m4t_scripts.predict.predict import main
  File "/home/myuser/.local/lib/python3.8/site-packages/m4t_scripts/predict/predict.py", line 10, in <module>
    from seamless_communication.models.inference import Translator
  File "/home/myuser/.local/lib/python3.8/site-packages/seamless_communication/models/inference/__init__.py", line 6, in <module>
    from seamless_communication.models.inference.translator import Translator as Translator
  File "/home/myuser/.local/lib/python3.8/site-packages/seamless_communication/models/inference/translator.py", line 12, in <module>
    from fairseq2.data import Collater
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2/data/__init__.py", line 7, in <module>
    from fairseq2.data.cstring import CString as CString
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2/data/cstring.py", line 58, in <module>
    from fairseq2n.bindings.data.string import CString as CString
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2n/__init__.py", line 91, in <module>
    _load_sndfile()
  File "/home/myuser/.local/lib/python3.8/site-packages/fairseq2n/__init__.py", line 81, in _load_sndfile
    raise OSError(
OSError: libsndfile is not found!. Use your system package manager to install it (e.g. `apt install libsndfile1`).

@cbalioglu  The same problem occurred when I installed libsndfile using conda

@mdotvasylenchuk @TTTdas I just released v0.1.1 with updated installation instructions in README. Could you please give it another try in a clean environment? Thanks!

@cbalioglu I'm getting this error as well with the v0.1.1.
Here's what I did (I'm using this in seamless_communication)

I installed libsndfile with brew install libsndfile
Then I installed the requirements in seamless_communication
I checked to confirm that fairseq2 is 0.1.1

When I run seamless_communication I get this error.
I also tried different approaches such as those mentioned here https://github.com/ohmtech-rdi/eurorack-blocks/issues/444#issuecomment-1153155080 but can't get it to work.
My machine is Mac M1 Max. Were you able to make it work on your Mac?

@cocktailpeanut What is the specific error message you are receiving with v0.1.1? Are you %100 sure that you are not using a Conda environment (not even "base")? Is Homebrew installed in its default location (i.e. /opt/homebrew on Mac M1)?

@cbalioglu Thanks! It works! Just after I disabled conda completely. It seems that conda environment affected the lib path (even if I changed it)?

Happy to hear that! Closing this issue, but feel free to re-open it (or open a new one) if you face a similar issue in the future.

@cbalioglu Thanks! It works! Just after I disabled conda completely. It seems that conda environment affected the lib path (even if I changed it)?

hi I am also facing the same issue
can you pls elaborate on what you did exactly, it seems i still can't fix the error after disabling the conda env

@zapfruit

@cbalioglu Thanks! It works! Just after I disabled conda completely. It seems that conda environment affected the lib path (even if I changed it)?

hi I am also facing the same issue can you pls elaborate on what you did exactly, it seems i still can't fix the error after disabling the conda env getting this error: UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:109.) return torch._C._cuda_getDeviceCount() > 0 2023-09-19 12:04:44,242 INFO -- m4t_scripts.predict.predict: Running inference on the CPU in torch.float32. Using the cached checkpoint of the model 'seamlessM4T_medium'. Set force=True to download again. Using the cached tokenizer of the model 'seamlessM4T_medium'. Set force=True to download again. Using the cached checkpoint of the model 'vocoder_36langs'. Set force=True to download again. ValueError: File contains data in an unknown format.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):File "/home/User/.local/bin/m4t_predict", line 8, in sys.exit(main()) File "/home/User/.local/lib/python3.8/site-packages/m4t_scripts/predict/predict.py", line 72, in main translated_text, wav, sr = translator.predict( File "/home/User/.local/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/User/.local/lib/python3.8/site-packages/seamless_communication/models/inference/translator.py", line 207, in predict decoded_audio = self.decode_audio(block) ValueError: The input audio cannot be decoded. See nested exception for details.

It seems to be a problem on CUDA. Do you have the cuda vesion that matches the torch version? When the conda environment is disabled, other dependencies need to be installed properly as well (i.e. cuda, cudnn).

@zapfruit

@cbalioglu Thanks! It works! Just after I disabled conda completely. It seems that conda environment affected the lib path (even if I changed it)?

hi I am also facing the same issue can you pls elaborate on what you did exactly, it seems i still can't fix the error after disabling the conda env getting this error: UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:109.) return torch._C._cuda_getDeviceCount() > 0 2023-09-19 12:04:44,242 INFO -- m4t_scripts.predict.predict: Running inference on the CPU in torch.float32. Using the cached checkpoint of the model 'seamlessM4T_medium'. Set force=True to download again. Using the cached tokenizer of the model 'seamlessM4T_medium'. Set force=True to download again. Using the cached checkpoint of the model 'vocoder_36langs'. Set force=True to download again. ValueError: File contains data in an unknown format.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):File "/home/User/.local/bin/m4t_predict", line 8, in sys.exit(main()) File "/home/User/.local/lib/python3.8/site-packages/m4t_scripts/predict/predict.py", line 72, in main translated_text, wav, sr = translator.predict( File "/home/User/.local/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/User/.local/lib/python3.8/site-packages/seamless_communication/models/inference/translator.py", line 207, in predict decoded_audio = self.decode_audio(block) ValueError: The input audio cannot be decoded. See nested exception for details.

It seems to be a problem on CUDA. Do you have the cuda vesion that matches the torch version? When the conda environment is disabled, other dependencies need to be installed properly as well (i.e. cuda, cudnn).

it wasnt a problem with cuda just the wrong file format, seems it works better for .wav files i was using a .mp3 one. But its working now. Thanks a lot!

@cbalioglu I'm getting this error as well with the v0.1.1 on a Mac.
Here's what I did (I'm using this in seamless_communication)

I installed libsndfile with brew install libsndfile
Then I installed the requirements in seamless_communication
I checked to confirm that fairseq2 is 0.1.1

When I run seamless_communication I get this error.
I also tried different approaches such as those mentioned here ohmtech-rdi/eurorack-blocks#444 (comment) but can't get it to work.
My machine is Mac M1 Max. Were you able to make it work on your Mac?

same environment , looking for answer

Mac M1 Max ,as the same


Change the preview of the wav

I want to change the preview content after loading the wavfile. The preview is not showing once the wavfile is uploaded. and if I upload another wavfile, it shows the preview content of previous wavfile.
Please find the attached screenshot

See the watches in the corresponding directive: https://github.com/IPS-LMU/EMU-webApp/blob/master/app/scripts/directives/preview.js


use POST instead of GET for executing flow

because GET has url length limitation, this will cause problem when we have a large flow, and we disable a lot of the job inside, as the disabled jobs list will need to be included in the request param.

Pull Request Test Coverage Report for Build 5516

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.06%) to 41.905%

Totals

Change from base Build 5515:
0.06%

Covered Lines:
14008

Relevant Lines:
33428

💛  - Coveralls

Hi @wilson-lauw when submitting large workflow with a lot of disabled jobs, nothing is happening submit button is not working, could this be reason?

Hi @ismailsimsek , yes it's because of this

cc: @ypadron-in

Thanks for fixing this!


Add CODE_OF_CONDUCT

There should be a Code of Conduct . Which will give guidelines to the conributors .

Assign this issue to me under GSSOC'23.

@parthpathakpp1  Issue has been Assigned you 👍🏻

Merged Closed ⭐


Added in support for DSigSerializer to write RSAKeyValue

Addresses #768.

:shipit: feel free to merge this into dev now, or add to your current PR that expands support in KeyInfo.


Remove redundant code snippets in 05_03_Pipeline_Mnist notebook

Previously we have a workaround for enabling pipeline-runner service account to create resource "virtualservices" in API group "networking.istio.io" in the namespace "kubeflow":

Per upstream PR merged, we'll remove this instruction.

/assign

@PatrickXYS v1.0.2 has been released. We can do some clean up and cut a v1.0.2 release for this repo

Sure, I'll test v1.0.2 compatibility with eks-kubeflow-workshop this week. And meanwhile clean up redundant code snippets / instruction, etc.

@PatrickXYS Excellent!


Issue with python 3.6.2

I'm using your library for developing a project. But there are certain issue with your library.
Can you help me fixing with the bugs?

Sure. Although this library is based on Python 2.7 so it might not be compatible with python 3.X

Can I edit this library for 3.6 with your permission?
On Thu, Sep 28, 2017 at 12:10 PM, Sanchit Sokhey<EMAIL_ADDRESS>wrote:

Sure. Although this library is based on Python 2.7 so it might not be
compatible with python 3.X
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/djsan15/openamazon/issues/1#issuecomment-332742337,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AaFDqeY-oZE0KpWRSuWog_4KT8XjLdNhks5smz9qgaJpZM4PjxFi
.


⚠ Bofrost.be has degraded performance

In a016706, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2590 ms

Resolved: Bofrost.be performance has improved in 0663b20 after 27 minutes.


Fix strided_slice legalization when input_dim % stride != 0

Add padding to round an input dim up to the nearest multiple of the corresponding stride value

Change-Id: I1b9677c80e7ba704897637a3c44545d24cdae892

Hi @rsuderman, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @rdzhabarov, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!

Hi @jpienaar, Can you please review this PR ? Thank you!


3 types of leaderboards: task-based, dataset-based, subdataset-based

The leaderboard is more versatile and flexible now. It can be either task-based, dataset-based, or subdataset-based.
The most direct way of accessing any type of leaderboard is via URL:

task-based: /leaderboards?task=text-classification
dataset-based: /leaderboards?dataset=ethos
subdataset-based: /leaderboards?dataset=ethos&subdataset=binary

For accessing a subdataset-based leaderboard via navigation, I only implemented one entry for now: Click "Datasets" -> each dataset row contains a leaderboard link (image 1). If the row has a subdataset, the linked leaderboard is a subdataset-based leaderboard (image 2), If the row has no subdataset, the linked leaderboard is a dataset-based leaderboard (image 3).
Update:  Dataset split tab is added!

Dataset split tab is added!

Looks really great! I was able to get all the way through submitting multiple systems to the metaphor_qa leaderboard, but got this error when I tried to perform analysis:
Traceback (most recent call last):
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 2095, in __call__
    return self.wsgi_app(environ, start_response)
  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/__main__.py", line 17, in __call__
    return self.app(environ, custom_start_response)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 2080, in wsgi_app
    response = self.handle_exception(e)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 2077, in wsgi_app
    response = self.full_dispatch_request()
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 1525, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 1523, in full_dispatch_request
    rv = self.dispatch_request()
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/flask/app.py", line 1509, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
    response = function(request)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/security/security_handler_factory.py", line 388, in wrapper
    return function(request)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
    response = function(request)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/decorators/validation.py", line 196, in wrapper
    response = function(request)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 112, in wrapper
    response = function(request)
  File "/Users/gneubig/opt/anaconda3/envs/python3.9/lib/python3.9/site-packages/connexion/decorators/parameter.py", line 116, in wrapper
    return function(**kwargs)
  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/controllers/default_controller.py", line 81, in systems_analyses_post
    return default_controllers_impl.systems_analyses_post(body)
  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/impl/default_controllers_impl.py", line 236, in systems_analyses_post
    systems: list[System] = SystemModel.find(
TypeError: find() missing 3 required positional arguments: 'split', 'sort', and 'creator'

Other than that, there are a few small interface things that can be ironed out later I guess.

@neubig Thanks! Could you try git pulling? I think I fixed it right after you started testing haha.


Instance Scheduler not working for Auto Scaling Group

Version: 3.0.3
Region: ap-southeast-2
Was the solution modified from the version published on this repository? no, only memory size of ASGHandler Lambda was increased to test
Have you checked your service quotas for
the services this solution uses? yes, I am running it in a test environment.
Were there any errors in the CloudWatch Logs? no
I am running Instance Scheduler 3.0.3. It is working for EC2 and RDS but not for Auto Scaling Group. I dont see any error in the cloudwatch logs. I have tried increasing the lambda memory to 256 but it didn't help.
It created the log groups for EC2 "Scheduler-ec2-xxxx" and RDS "Scheduler-rds-xxxx" but not for ASG. This is a test environment and we have only 1 ASG running. Can you please advise?

I take it you were able to solve your issue?
For anybody else who sees this, documentation on how the ASG feature works can be found here: https://docs.aws.amazon.com/solutions/latest/instance-scheduler-on-aws/advanced-features.html
I will also note tha ASG schedulin operates independently from the EC2 and RDS Scheduling logic and has a separate log-stream attached directly to the ASGHandler lambda which you can view for any errors related to ASG scheduling

Thanks for your reply.  My value of the  "Schedule" tag is "stopped" .
Instance Scheduler added the "scheduled" tag to my asg and set the value "scheduled
{"schedule": "stopped", "ttl": "2024-09-15T14:48:02.764444+00:00", "min_size": 1, "max_size": 3, "desired_size": 1}
It is not changing the my ASG instances 0-0-0.

what is the configuration of the stopped schedule in your dynamodb table? what you describe implies that instance scheduler has setup the ASG to match the "stopped" schedule to the best of its abilities, but how is that schedule actually implemented?

The attributes of the "stopped" schedule are"
type: schedule
name: stopped
description: Instances stopped
override_status: stopped

the override_status flag is not supported for ASG scheduling as it is impossible to translate the concept to scheduled scaling rules. The first iteration of ASG scheduling is designed to support simple schedules (generally 1 or 2 non-overlapping periods) and weekday/monthday/month fields

It is still not working after changing to "uk-office-hours"
Attributes of uk-office-hour
period: office-hours
timezone: Europe/London
Attributes of period office-hours:
begintime: 09:00
endtime: 17:00
weekdays: mon-fri
the scheduled tag value: {"schedule": "uk-office-hours", "ttl": "2024-09-15T16:48:02.636170+00:00", "min_size": 1, "max_size": 3, "desired_size": 1}
{
"level": "INFO",
"location": "_reconfigure_scheduled_actions_to_match_schedule:423",
"message": "Configuring group test-asg-MyAutoScalingGroup-QM08t76aCz79 with schedule uk-office-hours. Using 1-1-3 as running state",
"timestamp": "2024-08-16T16:48:02.455+00:00",
"service": "asg",
"cold_start": true,
"function_name": "instance-schedule-303-ASGHandler0F6D6751-uADbejgXNHD3",
"function_memory_size": "256",
"function_arn": "arn:aws:lambda:ap-southeast-2:111111111111:function:instance-schedule-303-ASGHandler0F6D6751-uADbejgXNHD3",
"function_request_id": "147804b4-e819-4878-a86a-ba5132bc1bcd",
"correlation_id": "826b0b88-51d4-4079-8751-01005ebdcdb2",
"xray_trace_id": "1-66bf82bd-0489808c5a26f417617aa9f0"
}
{
"level": "INFO",
"location": "schedule_auto_scaling_group:287",
"message": "Skipping group test-asg-MyAutoScalingGroup-QM08t76aCz79 with schedule uk-office-hours: All conditions met, current config valid for schedule uk-office-hours until 2024-09-15T16:48:02.636170+00:00",
"timestamp": "2024-08-16T20:48:00.353+00:00",
"service": "asg",
"cold_start": true,
"function_name": "instance-schedule-303-ASGHandler0F6D6751-uADbejgXNHD3",
"function_memory_size": "1024",
"function_arn": "arn:aws:lambda:ap-southeast-2:111111111111:function:instance-schedule-303-ASGHandler0F6D6751-uADbejgXNHD3",
"function_request_id": "72caeaa4-5268-4b97-9dc1-7d826eca408b",
"correlation_id": "4ca6962b-904e-418e-aec9-de1c886b38ac",
"xray_trace_id": "1-66bfbafd-3354b8486354b9c340c40493"
}

I would recommend checking the scheduled scaling rules on your ASG to confirm whether the rules have been setup correctly.
ASG scheduling functions a little differently compared to EC2/RDS scheduling in that it only interacts with the instance through the scheduled scaling rules (it does this to ensure it plays nicely with any other auto-scaling rules you may have setup). As such, even though these rules might be configured right away, you wont see any change in the ASG instance state until the time comes for one of the rules to kick in

It has set the schedule rule starting "2024 August 20, 02:00:00 AM +10:00". (0-0-0) . thanks for your help.


Use Service/Plan crd

Add contoller for Service
Add contoller for Plan

Pull Request Test Coverage Report for Build 2114

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.146%

Totals

Change from base Build 2091:
0.0%

Covered Lines:
8295

Relevant Lines:
9003

💛  - Coveralls


AttributeError: 'Graph' object has no attribute 'y'

Using the latest version, the program "eval.py" throws an error

Traceback (most recent call last):
  File "eval.py", line 70, in <module>
    eval()
  File "eval.py", line 26, in eval
    g = Graph(is_training=False)
  File "tacotron\train.py", line 35, in __init__
    self.decoder_inputs = shift_by_one(self.y)
AttributeError: 'Graph' object has no attribute 'y'

I am getting the same issue. I trained using
python train_multi_gpus.py

My hyperparmaters.py was modified slightly for 2 x GPUs and more epochs:
diff --git a/hyperparams.py b/hyperparams.py
index 5aaccab..8ac9032 100644
--- a/hyperparams.py
+++ b/hyperparams.py
@@ -35,13 +35,13 @@ class Hyperparams:
     # training scheme
     lr = 0.001 # Paper => Exponential decay
     logdir = "logdir"
-    batch_size = 32
-    num_epochs = 200 # Paper => 2M global steps!
+    batch_size = 64
+    num_epochs = 2000 # Paper => 2M global steps!
     loss_type = "l1" # Or you can test "l2"
     num_samples = 32

     # etc
-    num_gpus = 1 # If you have multiple gpus, adjust this option, and increase the batch size
+    num_gpus = 2 # If you have multiple gpus, adjust this option, and increase the batch size
                  # and run `train_multiple_gpus.py` instead of `train.py`.
     target_zeros_masking = False # If True, we mask zero padding on the target,
                                  # so exclude them from the loss calculation.

Sorry for this. I forgot to change self.decoder_inputs to self.y. Pull now.

Fixed for me.  Thanks!


how to implement Finish to start dependancy in gantt chart

Task B can't start before task A is finished how to  impletement this with dependancy

implement relationship like this   dependencies: task['dependencies']&.map { |dep| { id: dep, relationship: 'finish-to-start' } }


Fix support for repeated enums inclusion check

Generate code for C++ and Go for repeated.items.enum.{in, not_in} validations, and add test cases.
Fixes #329

Thanks for the fix, @akonradi!


Android app, scrolling is super jagged, slow Raster

The app has large selectable rich text spans wrapped in scrollable. Haven't seen the issues on Flutter 2+ and Galaxy Note 10 (Snapdragon), the issue appeared on Flutter 3 and Galaxy S22 (Exynos).
https://user-images.githubusercontent.com/7947027/178160805-7b6f6e87-80af-4986-9b0e-8988941760bb.mp4
Target Platform: Android 12, One UI 4.1, June 1, 2022 Google Play system Updates
Devices: Samsung Galaxy S22, Exynos 2200,  SM-S902B/DS
Logs

Logs
dart_devtools_2022_7_10-1657484036392000.json.zip

[✓] Flutter (Channel stable, 3.0.4, on macOS 12.4 21F79 darwin-arm, locale en-BY)
    • Flutter version 3.0.4 at /private/var/user/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 85684f9300 (10 days ago), 2022-06-30 13:22:47 -0700
    • Engine revision 6ba2af10bb
    • Dart version 2.17.5
    • DevTools version 2.12.2

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
    • Android SDK at /private/var/user/Library/Android/sdk
    • Platform android-33, build-tools 33.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] VS Code (version 1.69.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.44.0

[✓] Connected device (3 available)
    • SM S901B (mobile) • R3CT209M59R • android-arm64  • Android 12 (API 31)
    • macOS (desktop)   • macos       • darwin-arm64   • macOS 12.4 21F79 darwin-arm
    • Chrome (web)      • chrome      • web-javascript • Google Chrome 103.0.5060.114

[✓] HTTP Host Availability
    • All required HTTP hosts are available

Hi @maxim-saplin, please provide a minimal, reproducible example and the output of flutter doctor -v as well as flutter run -v.

Here we go, please find minimal repro case and Dev Tools/Performance export.
bug.zip
dart_devtools_2022_7_11-1657531512725000.json.zip
Please note that there's some inconsistency in stutters, on one occasion you can get little to no lags, in other cases you get plenty of stuttering. You might want to scroll a bit and try launching the app several times. The logs come from the time when scrolling is laggy.

Helo @maxim-saplin. This looks like an optimization issue on your end. You are using a single widget, SelectableText in this case, that is very large and wrapped in a SingleChildScrollView. This is causing Flutter to re-build the entire widget every frame which is causing the lag you see. Try to split the one large widget into multiple widgets. For example: if your requirement is to display a large amount of text, maybe split the text into multiple paragraphs and render each paragraph in a ListView.builder. That way, Flutter can only build what needs to be built and not all the text at once which will fix this issue you are experiencing.
As for it occurring only in Flutter 3, I was unable to re-produce that part. I was able to notice lag in Flutter 2.10.5 as well. All in all, you should try to split your one very large widget into smaller pieces and use a ListView.builder instead of a SingeChildScrollView.
Upon further investigation, this issue (https://github.com/flutter/flutter/issues/59404) seems to highlight the same issue. You can use the solution I suggested above as a workaround until this gets fixed. Closing this issue as a duplicate. You can try to follow up and post your findings on the original issue.

@exaby73 , I don't think that rebuilding widget (UI thread) is the cause of issues, on the contrary Raster thread gets slow and frame take 50+ ms to draw.
ListView.builder, virtual scrolling won't allow text selection across 'invisible' sections of lazily built widgets.
Did you have a chance to check the performance logs?
Speaking of the root cause (Flutter 2 vs Flutter 3 or Snapdragon or Exynos) and whether the issue persisted before... Unfortunately I don't have my Snapdragon device to check, though I'm sure scrolling issues where not present in the app built with Flutter 2.5 when ran on Galaxy Note 10 as I use my app daily and always notice freezes.

@maxim-saplin I see your point there. Though this issue still does seem like a duplicate of https://github.com/flutter/flutter/issues/59404. Maybe posting your findings there might yield better results.


Problem with Safari OSX

Hi,
I followed 2 tutorials on the Gantry site (cause I'm working myself on a gantry template for Joomla) as well as the tutorial on your site, to try and insert headroom.js to my site. But I have a terrible feeling of confusion. Some informations seem to be missing or quite unclear. Sorry, but we're not all "specialists"… what is vendor-prefixes ? Are we supposed to add something there or not ? Same question about @import "dependencies".
When we're working locally, the link to the script is mentionned that way on several tutorials :
<script type="text/javascript" src="{{ url(http://gantry-1927.kxcdn.com'gantry-theme://custom/js/headroom.min.js') }}"></script>

Should'nt it be :
<script type="text/javascript" src="{{ url('gantry-theme://custom/js/headroom.min.js') }}"></script>

?
Are we supposed to add something else to the code you show on your site ? Like -webkit definitions or something ?
Cause here is my problem : in Safari (OSX), whatever the div I target with your script, this div is like sliding form the left FIRST, on each reload of the page. I really don't get it, and I already spent 3 days on this. About to give up… So I did what the tutorials said, over and over again, but I always get this issue. I finally used the simple version of the code, where you have no real (sliding) options, only a fixed menu and I get the same : the div slides from the left at first, really fast, creating some dirty visual effect. Things are OK on my other browsers.
Any idea of what I missed here ?
Many thanks in advance for your help, I'm using my last forces here ! :-)

Hmm i'm afraid i can't help you with gantry-related things - i have no idea what that is :)
But yes you will likely need vendor prefixes e.g. -webkit- for your styles


reduce multiple environment memory footprint

hello, I'm experimenting with mujoco and the first thing I noticed is that this is a memory bound task.
the following graph confirms it:

Allocating 2000 MjData structs for my usecase means 2GB of memory getting allocated so around 1MB per environment but then I thought what if I didn't need 2000 MjData structs but only a big array containing what I think is the necessary data for the global state? so I tried something like this:
while True:
    data.time, data.qpos, data.qvel, data.act = model_data[0]
    mj.mj_step(model, data)
    model_data[0] = (data.time, data.qpos.copy(), data.qvel.copy(), data.act.copy())

    data.time, data.qpos, data.qvel, data.act = model_data[1]
    mj.mj_step(model, data)
    model_data[1] = (data.time, data.qpos.copy(), data.qvel.copy(), data.act.copy())

and it worked!
so are there any contraindications to doing this?

never mind I found all the mjState logic and related documentation, I think I skipped that part :)


README.md and key=value parameters

README.md
The README has as an example:
client = InfluxDBClient('localhost', 8086, 'root', 'root', 'example')
However, this blog uses a key=value syntax:
client = InfluxDBClient(host='localhost', port=8086) , which would be more explicit (if the blog is correct)
Also, the connection via SSL is missing in the README.md . The blog uses
client = InfluxDBClient(host='mydomain.com', port=8086, username='myuser', password='mypass' ssl=True, verify_ssl=True) as an example, which should be
client = InfluxDBClient(host='mydomain.com', port=8086, username='myuser', password='mypass', ssl=True, verify_ssl=True)
I guess ?
If this is correct, this could be added to the README

Python allows you to call non-kwargs functions as if they were kwargs if you want.
The SSL connection isn't "missing". It just isn't presented.
Feel free to open a PR if you want.


Why salesforce packages have build version, and not 'pre-release' like recommended by SemVer?

Is your feature request related to a problem? Please describe.
Recently I was studying SemVer 2.0 and I learned that it does not say anything about a "build" version. Instead, it is a "pre-release" version, which follows this pattern "MAJOR.MINOR.PATCH-[0-9A-Za-z-]", and not this "MAJOR.MINOR.PATCH.BUILD", like specified here. Can't Salesforce follow SemVer? I think it would be appreciated by all the developers.

Sorry, at the end of their doc, it says .build is valid.


As an operator, I want U-DS catalog entries created from a workflow to include, if one is provided, the any workflow labels

If a workflow is given a label, then any products created from that workflow that are ingested into the Unity Shared DAta catalog should contain that metadata (note- the metadata do not need to be included in file metadata, but in the metadata entry stored in U-DS)
many labels can exist for a given workflow execution and all should be stored with the metadata entry


Error thrown when parsing username from replay

In the relay parsers, the following error is thrown on certain replays:
'ascii' codec can't decode byte 0xa5 in position 3: ordinal not in range(128)
Guess: this happens when the username in the replay contains a space.
Example of a failing replay: http://replay.lunarcast.net/replay/th6_ud5071.rpy

This is the exact line that causes the bug:
            self.name = (KaitaiStream.bytes_terminate(self._io.read_bytes(9), 0, False)).decode(u"ASCII")

what if you try to use SJIS instead of ASCII??

that fixes it!

am i remembering correctly that the .py files (like th06.py) aren't 100% generated from the kaitai parsers?

Yeah there's one line in th06.py that the parser puts inside a loop that is manually moved out of the loop

There seems to be another related issue for th10 onwards:
in th_modern.py, the line             self.user_desc = (self._io.read_bytes_term(13, False, True, True)).decode(u"SJIS")
throws 'shift_jis' codec can't decode byte 0xec in position 6: illegal multibyte sequence


Disallow explicit PASE in access control

Problem
Although we never intended to support operational
PASE for v1.0, some plumbing still existed for it.
E.g. the module would still check against explicit
PASE entries, and this was unit tested, even though
the cluster would not allow them to be created in
production. This should be removed/disallowed for
v1.0 in favour of simplicity.
Change overview
We won't have explicit PASE ACL entries for v1.0.
We will enforce that PASE is only during
commissioning, therefore all incoming PASE subjects
will be granted administer privilege.
Past v1.0, if/when we want operational PASE (requires
solving some tricky multi-fabric issues, so may not be
feasible), we'll have to check against explicit PASE
subjects in entries, and also for implicit PASE administer
privilege during commissioning we'll have to verify that
the incoming PASE subject is commissioning (otherwise
it should not get that implicit privilege escalation).
Part of issue #10242
Testing

Unit tests pass (on Linux host)

Unit tests updated to match revised code, should now pass.


Add sql queries to add new date_new field

Questions
Answers

Description?
Add new date_new field on product table, and set its value as the one of date_add field

Type?
improvement

BC breaks?
no

Deprecations?
no

Fixed ticket?

Sponsor company
PrestaShop SA

How to test?
to be tested with https://github.com/PrestaShop/PrestaShop/pull/35645

This PR should not be merged for now.

PR to add feature is closed and note merged I close this one too.


Where is the SmoothMarginInnerProduct layer?

@huangyangyu Hi, your "example/train_val.prototxt" has the "SmoothMarginInnerProduct" layer , but your caffe hasn't it.

I'm sorry to reply so late. It's ok to use MarginInnerProductLayer, the purpose of it is to ignore the label of sequence dataset whose label is negative.


Save signs as well as waymarks?

Would it be possible to also save the current signs on party members? I'd say saving this mark is on player_id would be nice

You can already do this in-game via macro:  Something like the following should work:
/mk ignore1 <1>
/mk bind1 <2>
/mk bind2 <3>
/mk ignore2 <4>
/mk attack1 <5>
/mk attack2 <6>
/mk attack3 <7>
/mk attack4 <8>

The reference for this text command is: https://na.finalfantasyxiv.com/lodestone/playguide/db/text_command/4348eed9de5/
Granted, if you go into a fight as multiple roles, you'll need multiple macros to match your party sort order, but it is what it is.  Saving signs is pretty far out of scope for this plugin though.


Update PolicyGenerator to v1.10.0

Includes the fields for policy ordering.
Refs:

https://github.com/stolostron/backlog/issues/26906

Signed-off-by: Justin Kulikauskas<EMAIL_ADDRESS>

/cc @dhaiducek


megan added a draft tutorial for the core-dataset tutorial

The directions worked well to add a tutorial. Now I need to go back and put some real meat in the tutorial.

thanks @meganmason ! you can see a preview of your changes with the link above. happy to merge this as is if you'd like, or we can keep it open to keep pushing changes to.

Thanks for the preview! We can leave it open since there is a lot more to add. I likely won't be able to generate content for a week or so if that's an issue.

@scottyhq - This branch has still the old gitaction config, where builds fail with broken external links. Can you please merge this one? It takes admin privileges to do that

I just rebased this, @meganmason , I can either merge as is and you can open a new pull request to modify content, or you can run gh pr checkout 22 and continue adding modifications. Preference?


selectValue method isn't safe

so i've discovered that selectValue method isn't safe. If you call it multiple times in a row it will do some asynchroniuos way of setting value for each all which will eventually mess up the visible value (even if you're setting up the same value all the time).
Case of usage:

onCreateView you setlectValue and rotate the screen.
your onCreateView selectValue gets called and default selectValue from restoring state gets called
in result if you wanted to set value 1 in range [0, 10]  your final value will be 2, if it was 2 then final value will be 4

my temporar work around:
public class myFragment extends DialogFragment {
    private boolean initializeValues = true;

    @Override
    public void onConfigurationChanged(Configuration newConfig) {
        super.onConfigurationChanged(newConfig);
        initializeValues = false;
    }

    @Override
    public View onCreateView(LayoutInflater inflater, ViewGroup container,
                             Bundle savedInstanceState) {
          View view = inflater.inflate(R.layout.fragmentX, container, false);
          RulerValuePicker P = view.findViewById(R.id.ruler_picker);
          //do some picker preparation
          if (initializeValues) {
               P.selectValue(<whatever value we wish>);
           }else
               initializeValues = true;
      return view;
    }

and dont forget to add to manifest something like:
android:configChanges="orientation|screenSize"

@SmileHub I found the issue. You can check the solution in bb072520e49a402ad7d981fbf456544299e6af14.

Bug is fixed in 1.1.


If validator runs into problem running forward pass, remove it from db

we can have a max_retries flag that increments when we get no energies back, and when we do get something we stop incrementing. Kill job if 10 retries or something


Design - v2 Data Table component

Summary: Design of the Data Table component.
Design on component branch and push to main Figma file when approved.
Definition of done:

[x] Component Kickoff
[x] Sync with Dev and Design
[x] Research and consulting other design libraries
[x] WCAG Goal can be completed using a screen reader.
[x] WCAG Visual elements observe color contrast requirements.
[ ] WCAG Manual accessibility testing meets WCAG 2.1 AA requirements.
[x] Provides equal service in French and English.
[x] Comparison with official policy, documented reasons for deviation if any
[ ] Design review
[x] Policy review
[x] Design - Different screen sizes
[ ] Design - Short content / long content (text overflow etc.)
[ ] Design - Error state (if applicable)
[ ] Design - Empty state (if applicable)
[ ] Component anatomy
[ ] Handoff from draft dev guidance to documentation author/lead
[ ] Update Figma version

Acceptance Criteria

[x] The table supports sort by column
[x] The table supports sort direction
[x] The table supports filtering
[ ]  The table supports column hiding
[ ]  The table supports column reordering
[ ]  The table supports batch actions via select
[x] The table supports pagination

GAC team has a use case for the data table component - they said they would reach out to our team.


First open on workspace marks files as having errors

When you open the workspace first time, the files are marked with errors for missing definitions.
To fix it, you need to open each file and the error goes away.

this should be fixed in 0.1.28

Tested with 0.1.28


Add option to output blames for T.untyped usages in a JSON file

Motivation

This introduces a couple of configuration options

New build mode: now you can pass --config=untyped-blame in addition to any of the existing build modes (eg: --config=release-linux --config=untyped-blame, which will create a build where blamed symbols for untyped usages are tracked.
--untyped-blame : this flag will make Sorbet spit out a JSON file containing a list of symbols blamed for untyped usages in the format {"path": <path/to/file/with/violation>, "owner" : <namespace::owning::symbol>, "symbol": the_symbol, "count": N }

Test plan

ran locally

build numbers:

$ ./bazel
clean --expunge
INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes.

$ ./bazel build --config=release-linux
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [static-libs]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
WARNING: Usage: bazel build <options> <targets>.
Invoke `bazel help build` for full description of usage and options.
Your request is correct, but requested an empty set of targets. Nothing will be built.
INFO: Analyzed 0 targets (0 packages loaded, 0 targets configured).
INFO: Found 0 targets...
INFO: Elapsed time: 3.326s, Critical Path: 0.03s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action

$ ./bazel build //main:sorbet --config=release-linux
WARNING: The following configs were expanded more than once: [static-libs]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Analyzed target //main:sorbet (154 packages loaded, 3732 targets configured).
INFO: Found 1 target...
Target //main:sorbet up-to-date:
  bazel-bin/main/sorbet
INFO: Elapsed time: 443.907s, Critical Path: 97.81s
INFO: 1764 processes: 404 internal, 1360 local.
INFO: Build completed successfully, 1764 total actions

$ ./bazel build //main:sorbet --config=release-linux --config=untyped-blame
WARNING: The following configs were expanded more than once: [static-libs]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Build option --copt has changed, discarding analysis cache.
INFO: Analyzed target //main:sorbet (1 packages loaded, 3750 targets configured).
INFO: Found 1 target...
Target //main:sorbet up-to-date:
  bazel-bin/main/sorbet
INFO: Elapsed time: 232.479s, Critical Path: 87.06s
INFO: 477 processes: 1 internal, 476 local.
INFO: Build completed successfully, 477 total actions

Made the following changes:

Use a printer now instead of custom file output
Everything follows untypedBlame (i.e., not blameUntyped etc)
error if --track-untyped is not passed with printer
Use TypePtr & instead of SymbolRef
Most of this feature now also runs under --config=dbg to exercise the relevant codepaths when running tests for very rudimentary coverage; developing automated tests for this seems challenging. We should probably do it at some point, but since doesn't affect actual typechecking, probably punt it for now.

I think you’ve got a bug with your new C-style array. other than that i think this change is good


SPI: Driver structs don't derive PartialEq/Eq

Actually, this was closed by https://github.com/esp-rs/esp-hal/pull/2832 - we don't currently want to implement PartialEq/Eq for driver structs.


Set up continuous integration for automatic deployment

The ultimate goal is to have one image that is pulled automatically to the VM from the GitHub Container Registry when changes in the repo are pushed to main.
There are several aspects to think about for this:

Containerising everything that is not already an image pulled from elsewhere for OVE, including:

The dash app
The config files required by the other images (in `/config/)

Ensuring that the correct host machine IP address is present in all the necessary files.

For the development server this should never change
For local development, this will change frequently

I discovered that several of the config files are not read/needed unless using the OVE asset manager. So config/ can be simplified to:
config/
  - default.conf
  - Spaces.json

And everything still works. This means the configure.py script can also be simplified to only edit the docker-compose.yml file.
My plan was to COPY the config directory into the dash service within the Dockerfile, e.g. COPY ./config/ ./config, which in itself works. Then to modify the docker-compose.yml to make each of the two files available to nginx and ovehub-ove-ove by mounting them as shared volumes.
docker-compose build works with the below docker-compose.yml file, but docker-compose up fails with Error response from daemon: source /var/lib/docker/overlay2/<id>/merged/config/default.conf is not directory, which is not a very helpful message.
services:
  dash:
    build: .
    ports:
      - 8050:8050
    volumes:
      - nginx-default-conf:/config/default.conf ## New
      - ove-spaces-conf:/config/Spaces.json   ## New
  nginx:
    depends_on:
      - dash
      - ovehub-ove-ove
      - ovehub-ove-apps
      - ovehub-ove-service-persistence-inmemory
      - ovehub-ove-ui
    image: nginx:alpine
    ports:
      - 8080:8080
    restart: unless-stopped
    volumes:
      - nginx-default-conf:/etc/nginx/conf.d/default.conf:ro ## New
      - ./logs/nginx.log:/etc/nginx/logs/error.log
  openvidu-openvidu-call:
    environment:
      openvidu.publicurl: https://<IP_ADDRESS>:4443
      openvidu.secret: MY_SECRET
    image: openvidu/openvidu-call:2.12.0
    ports:
      - 4443:4443
    restart: unless-stopped
  ovehub-ove-apps:
    depends_on:
      - ovehub-ove-ove
      - ovehub-ove-external-tuoris
      - openvidu-openvidu-call
    environment:
      OPENVIDU_HOST: <IP_ADDRESS>:4443
      OPENVIDU_SECRET: MY_SECRET
      OVE_HOST: <IP_ADDRESS>:8080
      TOURIS_HOST: <IP_ADDRESS>:7080
      TUORIS_HOST: <IP_ADDRESS>:7080
    image: ovehub/ove-apps:0.5.0
    restart: unless-stopped
  ovehub-ove-external-tuoris:
    image: ovehub/ove-external-tuoris:v0.1
    ports:
      - 7080:7080
    restart: unless-stopped
  ovehub-ove-ove:
    depends_on:
      - dash
    image: ovehub/ove:0.5.0
    restart: unless-stopped
    volumes:
      - ove-spaces-conf:/usr/src/app/packages/ove-core/dist/client/Spaces.json ## New
  ovehub-ove-service-persistence-inmemory:
    image: ovehub/ove-service-persistence-inmemory:0.2.1
    restart: unless-stopped
  ovehub-ove-ui:
    depends_on:
      - ovehub-ove-ove
      - ovehub-ove-apps
    environment:
      OVE_HOST: <IP_ADDRESS>:8080
    image: ovehub/ove-ui:0.2.0
    restart: unless-stopped
version: '3.1'
volumes:
  nginx-default-conf:  ## New
  ove-spaces-conf:    ## New

If we can get this working then the containers would be self-sufficient and we could just push new versions of the dash image to the VM. Any ideas welcomed.

I believe the main questions in this have been addressed in #24 and implementing/finalising the changes can wait until development on the vis system is begun in earnest.


no known trigger event, just noticed this

Please describe what you were doing when this error happened.
Specifications

OS: darwin
IPFS Desktop Version: 0.13.2
Electron Version: 9.3.2
Chrome Version: 83.0.4103.122

Error
Error: Command failed: npm install -g ipfs-npm
internal/modules/cjs/loader.js:968
  throw err

nevermind ... this appears to be related to an issue with my version of npm; i have fixed this now and the install did work.


Add Option do Decrease Animated QR Code Frame-rate

High resolution at a high frame-rate result in high bandwidth and a good UX, unless the signer hardware can't keep up with it.
Krux devices can scan even the high resolution QRs, however, due to the high frame-rate, it will skip some frames. The time it takes for Krux to process each frame is higher than the period each frame is exposed on Sparrow. This is not a big deal, since UR has features that deal very well with skipped frames, but other issues can happen:
Depending on device, display, ambient lights, etc camera can adjust its exposure time or even "merge frames". Like when we take a picture in dark environments, it's easier to get a blurred picture.
I noticed some times I get 2 QR code frames merged by the camera on tests, and I believe an option to reduce the frame-rate to, for example, 1Hz, would be very beneficial to some low cost devices.

As of 8baa8e2e, you can change the frame rate on animated QRs by using mouse scroll while the mouse pointer is over the QR image, between a maximum of 2 seconds and a minimum of 100 milliseconds period delay between frames.

This is awesome! Thanks!


Alter Env Variable warning to be correct

👋 Hi @ityonemo,
I've tried to pass env vars to SSH.run and it returned :failure and logged this:
[warn] this is currently unsupported until ERL-1107 is resolved

ERL-1107 was resolved as not a bug. Does it mean the bug is in OpenSSH? Any workarounds?

oops, I need to remove that warning (it was my misunderstanding of SSH).  You need to set your ssh agent to allow the particular environment variables you're trying to send.
https://stackoverflow.com/questions/4409951/can-i-forward-env-variables-over-ssh

changes completed in https://github.com/ityonemo/librarian/commit/5a7000eedcf4cabf2ef9467c97fb161027700830 and now available as 0.1.11 at hex.pm

Thanks!


[CORE-156] Enhance Feature Preview Page Visibility and Usability in Navigation

Jira Ticket: https://broadworkbench.atlassian.net/browse/CORE-156
What

This PR improves the visibility and functionality of the Feature Preview page by:

Adding a new “📰 Platform News” section in the left-hand navigation with links to:

Feature Preview (new, links to https://app.terra.bio/#feature-preview)
Request a Feature (moved from Support)
Release Notes (moved from Support)

Updating the Feature Preview page with:

A clearer top message explaining the purpose of feature previews.
Toggles instead of checkboxes are used to enable/disabling features.
A lock icon and tooltip for private features.
A new “Last Updated” column with feature update dates.

Why

These changes help users learn about and engage with new features before release, promoting early feedback and better feature quality.

Testing strategy

Unit Testing: Updated unit tests to validate changes
Manual Testing

Verify the new “📰 Platform News” section appears in the navigation with working links.
Ensure the Feature Preview page updates (toggles, lock icon, tooltips, and “Last Updated” column) work as intended.

Platform News Menu

Feature Preview Page

Please swap the Platform News and Support sections in the lefthand navigation. Everything else looks great!

Please swap the Platform News and Support sections in the lefthand navigation. Everything else looks great!

Done: da66dcfe8b28c50b284dbed766ccfd9085731c10

When I scanned the feature-preview page with axe devtools, a couple of issues came up that aren't there on production. Could you take a look and see if you could resolve any of them?

Fixed: https://github.com/DataBiosphere/terra-ui/pull/5170/commits/4695ca1309ca8cfbdd4e87d1921b362054e3d388


Assume Role Logic Fails When Running Org Search With XAccount Role For Org Data

Describe the bug
An AWS error is generated when running a search across an AWS Organization while specifying an org xaccount role and specifying an OUID.
To Reproduce
Steps to reproduce the behavior:
❯ ip2cr --ipaddr=<IP_ADDRESS> --org-search --org-search-ou-id=XXXXX --org-search-role-name read-only --org-search-xaccount-role-arn arn:aws:iam::XXXXX:role/read-only --verbose
INFO[0000] starting IP-2-CloudResource
DEBU[0000] generating AWS connection
INFO[0000] searching for IP <IP_ADDRESS> in all service(s)
DEBU[0000] AWS public IP dataset loaded
DEBU[0000] IP prefix set reduced by version successfully
DEBU[0000] basic IP fuzzing failed to determine cloud service
DEBU[0000] starting advanced IP fuzzing
DEBU[0000] reverse DNS lookup for IP [ <IP_ADDRESS> ] resolves to [ [ec2-3-213-225-73.compute-1.amazonaws.com.] ]
DEBU[0000] advanced fuzzing identified the service as [ EC2 ]
INFO[0000] IP fuzzing determined the associated cloud service is: EC2
INFO[0000] starting org account enumeration
DEBU[0000] fetching accounts from specified OU (XXXXX)
FATA[0005] failed to run search :: [ ERR: operation error Organizations: ListAccountsForParent, get identity: get credentials: failed to refresh cached credentials, operation error STS: AssumeRole, get identity: get credentials: failed to refresh cached credentials, no EC2 IMDS role found, operation error ec2imds: GetMetadata, request canceled, context deadline exceeded ]

Expected behavior
Runs as expected by assuming the target roles correctly.
Screenshots
If applicable, add screenshots to help explain your problem.
Environment:

OS: [e.g. Ubuntu 22.04, Mac OS 13/Ventura] Mac OS 13/Ventura
GO version (go version): [e.g. go version go1.20.5 linux/amd64] go version go1.21.4 darwin/amd64
IP2CR version (ip2cr --help]: [e.g. v0.0.1] v1.0.6

Additional context
Add any other context about the problem here.

https://github.com/magneticstain/ip-2-cloudresource/commit/09c77f2ccbcbf0a09f9e4cb7e934ac3548d36f30


Handle DnsResolver direct exception on API 34

Failing on master build https://github.com/square/okhttp/actions/runs/7461208679/job/20300867655
Also seen here https://github.com/Ehviewer-Overhauled/Ehviewer/issues/1311

Can't see an easy way to add a test android.net.DnsResolver is final, and no shadow for robolectric.

Robolectric lets you provide your own shadows if you need one it doesn't provide. Should go into @Config.
https://robolectric.org/extending/#using-a-custom-shadows

Need to make a few more tests

@JakeWharton care to take another look?

I can on Monday


Inko 217

Description
This PR is fix for INKO-217 and INKO-261. Due diligence input data has been updated and a checkbox for Idea client added on due diligence form
Ignore if these details are present on the associated Apache Fineract JIRA ticket.
Checklist
Please make sure these boxes are checked before submitting your pull request - thanks!

[ ] Write the commit message as per https://github.com/apache/fineract/#pull-requests

[ ] Acknowledge that we will not review PRs that are not passing the build ("green") - it is your responsibility to get a proposed PR to pass the build, not primarily the project's maintainers.

[ ] Create/update unit or integration tests for verifying the changes made.

[ ] Follow coding conventions at https://cwiki.apache.org/confluence/display/FINERACT/Coding+Conventions.

[ ] Add required Swagger annotation and update API documentation at fineract-provider/src/main/resources/static/legacy-docs/apiLive.htm with details of any API changes

[ ] Submission is not a "code dump".  (Large changes can be made "in repository" via a branch.  Ask on the developer mailing list for guidance, if required.)

FYI our guidelines for code reviews are at https://cwiki.apache.org/confluence/display/FINERACT/Code+Review+Guide.

Community-app couterpart: https://github.com/fiterafrica/community-app-template/pull/220


Replace Object.values with lodash equivalent

Apparently Object.values was not included in the current polyfill.

tried adding bundled corejs to vendor (didn't remove existing polyfill) and seems that the mathjax error is gone.

If this PR is merged https://github.com/openreview/openreview/pull/2062 then these changes won't really be necessary.

I think we can close this issue, right?

Yes, agreed.


training time cost

Hi @d-li14 ,
Nice work and performance!
Would you please share the training cost here? e.g. GPU detail, training hours.
Since i have only 1080ti and seems like training imagenet from scratch will takes too much time.
Thanks very much!

Typically, I trained on 4 x TITAN Xp, and the whole training process will converge within around 60 hours. As far as I know, 4x1080Ti will not take much longer than that.

Hi @d-li14 ，
Got it!
Thanks very much for your kind help!


faas-flow-tower not monitoring the flows

I am struggling to set up the faas-flow-tower utility.
Let's say what I tried...
I tried setting up a simple flow-test function as follows:
flow-test.yml:
version: 1.0
provider:
  name: openfaas
  gateway: http://<IP_ADDRESS>:9999
functions:
  flow-test:
    lang: faas-flow
    handler: ./flow-test
    image: localhost:5000/flow-test:latest
    labels:
      faas-flow: 1
    annotations:
      faas-flow-desc: "test flow to greet"
    environment_file:
      - flow.yml
    secrets:
      - s3-secret-key
      - s3-access-key

flow.yml:
environment:
  gateway: "gateway.openfaas:8080" # The address of OpenFaaS gateway
  enable_tracing: true # tracing allows to monitor requests
  trace_server: "jaeger-agent.faasflow:5775" # The address of jaeger tracing agent
  consul_url: "consul.faasflow:8500" # The address of consul
  s3_url: "minio.faasflow:9000" # The address of minio

flow-test/handler.go:
package function

import (
	faasflow "github.com/faasflow/lib/openfaas"
)

// Define provide definition of the workflow
func Define(flow *faasflow.Workflow, context *faasflow.Context) (err error) {
	flow.SyncNode().Modify(func(data []byte) ([]byte, error) {
		result := "Hello " + string(data)
		return []byte(result), nil
	})
	return nil
}

// OverrideStateStore provides the override of the default StateStore
func OverrideStateStore() (faasflow.StateStore, error) {
	// NOTE: By default FaaS-Flow use consul as a state-store,
	//       This can be overridden with other synchronous KV store (e.g. ETCD)
	return nil, nil
}

// OverrideDataStore provides the override of the default DataStore
func OverrideDataStore() (faasflow.DataStore, error) {
	// NOTE: By default FaaS-Flow use minio as a data-store,
	//       This can be overridden with other synchronous KV store
	return nil, nil
}

$ faas-cli up -f flow-test.yml
...
Deploying: flow-test.

Deployed. 202 Accepted.
URL: http://<IP_ADDRESS>:9999/function/flow-test
$ echo "Abhishek" | faas-cli invoke flow-test
Hello Abhishek

So far so good.

The problem happens when I try to use faas-flow-tower.
faas-flow-tower/conf.yml:
  environment:
  basic_auth: true
  gateway_public_uri: "http://localhost:9999"
  gateway_url: "http://gateway.openfaas:8080/"
  secret_mount_path: "/var/openfaas/secrets"
  trace_url: "http://jaeger-query.faasflow:16686/"

In the above file I made change to the gateway_public_uri
faas-flow-tower/stack.yml:
provider:
  name: openfaas
  gateway: http://<IP_ADDRESS>:9999

functions:
  # dashboard
  faas-flow-dashboard:
    lang: dockerfile
    handler: ./dashboard
    image: localhost:5000/faas-flow-dashboard:3.0.8
    environment:
      read_debug: true
      write_debug: true
      combine_output: false
    environment_file:
      - conf.yml
    secrets:
      - basic-auth
    labels:
      com.openfaas.scale.zero: "false"

  # list flow functions deployed in openfaas
  list-flow-functions:
    lang: go
    handler: ./list-flow-functions
    image: localhost:5000/list-flow-functions:1.0.1
    environment:
      read_debug: true
      write_debug: true
      combine_output: false
    environment_file:
      - conf.yml
    secrets:
      - basic-auth
    labels:
      com.openfaas.scale.zero: "false"

  # Generate dot graph for faas-flow
  dot-generator:
    lang: go
    handler: ./dot-generator
    image: localhost:5000/dot-generator:1.2.0
    environment_file:
      - conf.yml
    environment:
      read_timeout: 120
      read_debug: true
      write_timeout: 120
      write_debug: true
      combine_output: false
    labels:
      com.openfaas.scale.zero: "false"

  # Collect metrics for faas-flow
  metrics:
    lang: go
    handler: ./metrics
    image: localhost:5000/metrics:1.6.0
    environment_file:
      - conf.yml
    environment:
      read_debug: true
      read_timeout: 120
      write_timeout: 120
      write_debug: true
      combine_output: false
    labels:
      com.openfaas.scale.zero: "false"

Under faas-flow-dashboard I just changed lang: Dockerfile to lang: dockerfile, and added the image local to be saved in local registry.
Before deploying I created a basic-auth secret as follows (I doubt this basic-auth step which I did):
kubectl create secret generic basic-auth --from-literal=username=abhishek --from-literal=password=abhishek --namespace openfaas-fn

And then I deploy faas-flow-tower as:
$ faas-cli up -g http://<IP_ADDRESS>:9999
...
Deploying: dot-generator.

Deployed. 202 Accepted.
URL: http://<IP_ADDRESS>:9999/function/dot-generator

Deploying: metrics.

Deployed. 202 Accepted.
URL: http://<IP_ADDRESS>:9999/function/metrics

Deploying: faas-flow-dashboard.

Deployed. 202 Accepted.
URL: http://<IP_ADDRESS>:9999/function/faas-flow-dashboard

Deploying: list-flow-functions.

Deployed. 202 Accepted.
URL: http://<IP_ADDRESS>:9999/function/list-flow-functions

faas-flow-tower does not monitor anything. Where I am going wrong in my setup? Please can anyone help me?

The issue was with the basic-auth secret attachment step. So that the faas-flow-tower is able to use the function information, we need the credentials of openfaas. So,
$ kubectl get secrets --namespace openfaas
NAME                              TYPE                                  DATA   AGE
basic-auth                        Opaque                                2      4d1h
default-token-c6r6b               kubernetes.io/service-account-token   3      4d1h
openfaas-controller-token-426cl   kubernetes.io/service-account-token   3      4d1h
openfaas-prometheus-token-9fvd6   kubernetes.io/service-account-token   3      4d1h
sh.helm.release.v1.openfaas.v1    helm.sh/release.v1                    1      4d1h

The basic-auth mentioned in the first line is of interest to us. We shall try to create a copy of that in the openfaas-fn namespace.
$ kubectl get secret basic-auth -n openfaas -o yaml > secret.yml

secret.yml:
apiVersion: v1
data:
  basic-auth-password: ZW91Y2ZoMUJ3SzZW
  basic-auth-user: YWRtaW4=
kind: Secret
metadata:
  annotations:
    helm.sh/hook: pre-install
  creationTimestamp: "2023-10-09T04:56:15Z"
  labels:
    app: openfaas
    chart: openfaas-14.1.9
    component: gateway
    heritage: Helm
    release: openfaas
  name: basic-auth
  namespace: openfaas
  resourceVersion: "1414"
  uid: c87d81e5-5160-4624-8ec0-eb4c0d2515b6
type: Opaque

Edit the above yml file to:
apiVersion: v1
data:
  basic-auth-password: ZW91Y2ZoMUJ3SzZW
  basic-auth-user: YWRtaW4=
kind: Secret
metadata:
  name: basic-auth
  namespace: openfaas-fn
type: Opaque

And then create the secret:
$ kubectl create -f secret.yml


Add country type to carbon projects CMS for tracking centroids and isRemoval boolean for methodologies

Description
Add Country type to track centroids since Puro projects only specify country and we still want to map their locations (even if roughly)
Stretch goal would be to show full country boundaries, but lets start with centroids only first

Where do we host these type documentations?

We don't really, they end up as in-line documentation in the Sanity interface like these:

Closed in favor of #2327


Timing of data updates

What is the timing for updating the Condo table? Is it 9 PM on Fridays?
(asking from another NYC Agency that is planning to harvest the data whenever it is updated)

The Department of Finance maintains the condo dataset.  We've removed Department of Finance metadata from this repository.


Error during instantaneous rate matrix generation

Dear Fukushima-sensei,
Thank you so much for writing the CSUBST program and providing such detailed documentation as a part of the paper. I have been trying to run CSUBST on my own data and have encountered an issue.
I initially tested the program on an orthogroup dataset with one gene per species. It worked fine and produced the output. But when I tried it with larger orthogroups (multiple paralogs per species), I am getting the attached error. There seems to be some error with the state matrix during the Instantaneous substitution rate matrix generation step. It's strange because the matrix does get produced, but the program crashes right afterwards.
I have attached the slurm error file, the conda environment list, and slurm script (test with single array) I'm using.
Hoping you can provide some advice.
Thank you.
array_csubst.txt
conda_env.txt
error_slurm_out.txt

Dear sensei,
I went back and performed the analysis in a new fresh directory and still got the same error. I've attached the alignment, gene trees, and foreground file. I didn't include the intermediary iqtree files as they get generated pretty quickly.
foreground.txt
OG0002198_cds_hammer.txt
OG0002198_generax.txt

Internal node and tip labels should be uniquely assigned, but your tree seems to have non-unique internal node names. species_22 appeared three times and potentially other names too. The error should be gone if you could run CSUBST again with unique names or after deleting all internal node names if they are not necessary. NWKIT drop may be useful to remove the labels.
https://github.com/kfuku52/nwkit/wiki/nwkit-drop

Thank you for pointing out the error. It works perfectly now!

I'm glad to hear that it worked :)


Standalone Kotlin Schema Generation

Before this PR Kotlin Schemas were generated for particle connections, which materialized in code as generating the schema for SchemaNode (which is a result of traversing the particle spec). This PR pulls out the Schema generation logic to be entirely standalone, i.e. generateSchema takes schema: Schema and nothing else.
This is needed to generate schemas that don't pertain to any particle, e.g. to generate a type of a handle in the recipe2plan. This PR will unlock fixing a bug causing the store type to be based of the first processed handle connection, instead of the resolved handle type as well as unlock progress with Adapters work.
I'm also adding a some unit tests for Kotlin schema generation to increase coverage in order to decrease dependency on golden files.

/gcbrun

Something that maybe was not clear: This is not new code, this is a refactoring that splits up schema generator from entity generation. All the code that is in this PR is a careful refactoring of the existing stuff, no new logic is added. I am not intending to add any new features here (BigInt, tuple or union fields, or anything else), I am only unblocking adding handle instances explicitly in recipe2plan, so that we can progress with Adapters and fix the issues cause by not representing the handle type in recipe2plan.

Thank you for a careful review Alex!


org root update part 3 adopt

Update the org / root to the V2 specifications  of the figma file. Review the Figma file. This section has a title, four cards, and the browse link.

Reviewing

@Developer3027  is this issue complete? :)

Complete


NAV Bar

User Story:
As a User, I would like to recreate my portfolio site with the navigation bar using bootstrap technology.
Acceptance Criteria:
A navigation menu is at the top. (I can use Bootstrap's navbar or create my own)
Include links that are applicable to my portfolio.
Links should navigate to the appropriate sections.

Bootstrap Navbar added and customized; always on top position set and considered as a permanent change

Links added.
Cosmetics and nav behaviour changed - stays on top when scrolling through jumbotron and folding on about section.


Add support for priority inheritance.

Each thread now has its static priority and the priority that it is boosted to.  The futex wait operation now takes some flags, one of which is for priority inheriting futexes.  If this is used then the futex word is expected to contain the thread ID of the lock owner in the low 16 bits (similar to the Linux PI futex model).  That thread will then inherit the priority of the caller of futex wait, for the duration of the wait (when the wait returns, the priority of the interrupted thread is restored).
This also adds a number of tests, introduces a priority inheriting flag lock, and makes the allocator use it.
This fixes the issue that a low-priority thread that is preempted in the allocator can prevent higher-priority threads from being able to make progress.

Note: this has one known bug that may or may not be worth fixing:

We don't refcount the number of priority boosts that a thread has received (or check if the boost has succeeded) so if a call with a long timeout boosts the priority of a thread and then a call from another thread tries to boost it with a short timeout then the boost will end when the shorter timeout expires.

Some thoughts as shared on Teams but written here for posterity, to which I have no ready solutions, I'm afraid:

We tolerate implicit lock handoff between threads (the thread unlocking need not be the thread that locked), which means that the thread that needs to do work to complete the critical section may not be the thread that originally claimed the lock.  In some kinds of worker-pool models, the original locker may not even be waiting for the thread exercising the critical section.  Having not thought very hard about it, perhaps we need an explicit lock_transfer() method that keeps the lock informed of which thread is acting under the auspices of the lock.

As written, priority boosts are undone only when the boosting thread wakes again, but that may not happen for a while.  Specifically, the call to ->ready() in futex_wait won't conclude that it needs to schedule, because the caller and the waiter have the same (boosted) priority.  The caller will continue to run with boosted priority until preempted.  If, during that time, it blocks on another futex, it can boost the priority of a third thread without real justification.  This seems like the kind of of thing that could be weaponized to preserve boosted priority among a ring of threads.

In general, it seems like we will want to be inheriting the maximum priority of all waiters blocked on any lock held by a given thread (subject to point 1).  This is complicated by threads being able to asynchronously timeout and stop blocking, thereby retracting themselves as potential sources of inherited priority, on any of the locks held.  If the inheriting thread has, itself, blocked, then it may be the cause of further inheritance in need of retraction.

I'm not sure what the first point means.  The API for PI futexes is that the thread that unlocks should be the one that unlocks, it's UB otherwise.  In general, for security, the futex callers should all be in the same compartment and so there is trust between them.  You could, of course, use a PI futex to boost the priority of another arbitrary thread to your priority for a bit (write its thread ID and then block for n ticks).  That might be an argument for making priority inheritance depend on a capability, so only compartments that are trusted for availability may use it.

New version is rebased but does not fix any of the problems yet.

@nwf-msr, I think this is now a version that I'm happy with.  In particular:

It supports a single thread owning multiple priority-inheriting locks and receiving the boost from all of them.  The previous version had a nasty case where releasing an inner lock would drop the priority back to the default, which could then cause priority inversion / deadlock.
The boost is now recalculated for in both return from wait and wake.  This means that a thread loses its priority boost when it notifies others that they should wake, so allows the thread that loaned priority to a lower-priority thread to resume immediately.  Recalculating the boost in the wait return guarantees that you can't elevate priority because the thread that you boost runs only while you are suspended.
Whenever the set of blocking threads changes or the thread that holds the lock releases it, we completely recalculate the priority for the boosted thread.  This is O(n) in terms of the number of threads blocked on a futex (any futex), but since we expect to run a handful of threads, that's fine (I doubt n will be more than 3-4 in most cases - if you have a lot of threads and they're all blocked on futexes, you've probably done something wrong).  This recalculation means that we have a simpler model: any sleeping thread that has noted your thread to receive the boost will be eligible to boost your priority, so awkward corner cases are now simple, at the cost of potentially doing a bit more work.

@microsoft-github-policy-service agree company="Microsoft"


Scala.js 1.0 compat: JSExportDescendentObjects has been removed

seen in Scala 2.12 community build, at https://scala-ci.typesafe.com/job/scala-2.12.x-integrate-community-build/1408/consoleFull:
[utest] [error] /home/jenkins/workspace/scala-2.12.x-integrate-community-build/target-0.9.7-RC1/project-builds/utest-cc7afacd62432b50d1c26899337c946977b17978/utest/shared/src/main/scala/utest/TestSuite.scala:10: object JSExportDescendentObjects is not a member of package scala.scalajs.js.annotation
[utest] [error] import scala.scalajs.js.annotation.JSExportDescendentObjects
[utest] [error]        ^
[utest] [error] /home/jenkins/workspace/scala-2.12.x-integrate-community-build/target-0.9.7-RC1/project-builds/utest-cc7afacd62432b50d1c26899337c946977b17978/utest/shared/src/main/scala/utest/TestSuite.scala:16: not found: type JSExportDescendentObjects
[utest] [error] @JSExportDescendentObjects
[utest] [error]  ^
[utest] [error] /home/jenkins/workspace/scala-2.12.x-integrate-community-build/target-0.9.7-RC1/project-builds/utest-cc7afacd62432b50d1c26899337c946977b17978/utest/shared/src/main/scala/utest/TestSuite.scala:10: object JSExportDescendentObjects is not a member of package scala.scalajs.js.annotation
[utest] [error] import scala.scalajs.js.annotation.JSExportDescendentObjects
[utest] [error]        ^
[utest] [error] /home/jenkins/workspace/scala-2.12.x-integrate-community-build/target-0.9.7-RC1/project-builds/utest-cc7afacd62432b50d1c26899337c946977b17978/utest/shared/src/main/scala/utest/TestSuite.scala:16: not found: type JSExportDescendentObjects
[utest] [error] @JSExportDescendentObjects
[utest] [error]  ^
[utest] [error] two errors found

see https://github.com/scala-js/scala-js/pull/2779

See also the release notes of Scala.js 0.6.15: https://www.scala-js.org/news/2017/03/21/announcing-scalajs-0.6.15/
The fix should be as simple as swapping @JSExportDescendentObjects for @scala.scalajs.reflect.annotation.EnableReflectiveInstantiation.

Fix available in #109.


Revert "add gruvbox colorscheme"

Reverts Yggdroot/LeaderF#85

This patch is dependent on gruvbox colorscheme, I don't want LeaderF to have the dependence.

@Yggdroot I fully understand this. Because the color of gruvbox must be retrieve from functions in gruvbox. That's why the lightline and airline gruvbox colorscheme is place in the gruvbox repo.
But actually it doesn't affect user who don't use gruvbox. It is not necessary to install gruvbox for user who just use LeaderF, though somehow the start time is slowed.
Maybe I should add following line in the color scheme to improve the start time:
if g:colors_name != 'gruvbox'
  finish
endif

Maybe a fork or a stand alone repo is better.


Training Log

Hi, would it be possible to have the training log?

The training log is saved while training in the tensorboard format.

Ah, I understand. I had wanted to check some training details (if a learning rate scheduler is used, convergence rate, etc). Also, I was wondering why you decided to use EMA; is there a significant difference?

When EMA is applied, lr stays the same in the shole training process. In the early stage of our development, EMA is able to promote NDS about 1%, when BEVDepth is stable, no ablation study is conducted.

@yinchimaoliang I also wonder if a learning rate scheduler is used.

From what I can tell during training, the learning rate is constant without warmup either.

Thank you so much for your reply!


Another update to current tags

Fixed link to Slack, Starter Site 1.9.0, Buildkit 3.2.11

Looks good, just gonna test locally.


Pact tests fail after clean clone

Hi there.  I'm not sure if this is an issue with the code, the documentation, or me, but the pact tests are failing for me on the first run.
With setup
Ran nvm use 6
Ran npm install
Ran node provider/provider.js
test:consumer: passes
test:pact:consumer: fails
test:pact:provider: fails
test:pact:consumer
fails with

(node:56245) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): AssertionError: expected { Object (count, date) } to have a property 'count' of 100, but got 0.1

AssertionError: expected { Object (count, date) } to have a property 'date' of '2013-08-16T15:31:20+10:00', but got '2013-08-16T06:31:20+01:00'

passes if I change
          count: like(1000)

to
          count: like(1)

and
          expect(response).to.eventually.have.property('count', 100)
          expect(response).to.eventually.have.property('date', date).notify(done)

to
          expect(response).to.eventually.have.property('count', 100).notify(done)

test:pact:provider
fails with
  1) Uncaught error outside test suite
  Pact Verification
    2) should validate the expectations of Our Little Consumer

  0 passing (8s)
  2 failing

  1)  Uncaught error outside test suite:
     Uncaught Error: listen EADDRINUSE :::8081
      at Object.exports._errnoException (util.js:1018:11)
      at exports._exceptionWithHostPort (util.js:1041:20)
      at Server._listen2 (net.js:1258:14)
      at listen (net.js:1294:10)
      at Server.listen (net.js:1390:5)
      at EventEmitter.listen (node_modules/express/lib/application.js:618:24)
      at Object.<anonymous> (provider/test/providerPact.spec.js:23:8)
      at require (internal/module.js:20:19)
      at Array.forEach (native)
      at run (bootstrap_node.js:390:7)
      at startup (bootstrap_node.js:150:9)
      at bootstrap_node.js:505:3

If you could help with this, I'd really appreciate it.

Ran node provider/provider.js
...
Uncaught Error: listen EADDRINUSE :::8081

Something is running, probably your provider (you don't need to run that for the tests to run), which is conflicting with the port. You'll need to kill that process.
Some of those tests are designed to fail, but not in master. Have you gone through them by checking out step1, step2 etc.?
e.g.
git checkout step1
# read readme
# do things
git checkout step2
...

?


Support defining attributes at the job levels that are added to spans

Feature Request
We want pipeline author to be able to specify in their pipeline definition some attributes/properties that are added to all the spans of the pipeline execution.
Will be particularly interesting when producing reports from metrics derived from pipeline executions.
E.g. define in labels the "team name", "business unit name"
Specification

Job level attributes will be added to spans using io.opentelemetry.api.trace.Span#setAttribute(java.lang.String, java.lang.String)
To specify job level attributes, we can either

Add specific open telemetry attributes
Or use an existing capability of Jenkins to define job level attributes

There don't seem to be generic attributes / labels at the job level in Jenkins Core. Are there popular plugins to solve this problem?

Yes it would be great to have, like New Relic Jenkins plugin supports customAttributes on job config level.
It also would be great to allow to set some vars from Jenkins global ENV variables and/or some internal variables/macros if possible (IINM some of them appear only after pipeline was actually started or checkout happened.)
The goal we are trying to achieve is to co-relate Pipeline failures with shared library/plugins/jenkins core versions  as well as some external systems (like our custom deployment engine version, infra terraform code version) even if pipeline wasn't actually start (e.g. syntax error, git server not reachable etc).
So we want to inject shared libraries commit SHA (and potentially some other info via CaSC) to Jenkins (currently via global Jenkins Env.) and see them as a custom metadata in traces.
Another case is that we have different types of pipelines (we use MPL-based shared library so jenkinsFiles look like: MPLPythonPipeline {...} or MPLNodePipeline{...} ). So we would also set this data in Job attributes to get fancy dashboard per pipelineType not per repo.

Thanks for the feedback @ipleten . Can you please share with us few details please:

Which trace analytics tool do you use?
Do you expect those attributes to be defined on the top-level span, the pipeline span? Or on sub-spans like a stage span?

Could WithSpanAttributeStep be extended to have additional target options to set the attributes on all children of the target span as well? Or add a parameter children to toggle this behavior on the children of the target span?

Could WithSpanAttributeStep be extended to have additional target options to set the attributes on all children of the target span as well? Or add a parameter children to toggle this behavior on the children of the target span?

@christophe-kamphaus-jemmic the idea is very interesting. I guess it will require a bit of work. Contributions are welcome.

I'm working on it. I will share a PR soon.

@cyrille-leclerc Could you review the PR https://github.com/jenkinsci/opentelemetry-plugin/pull/827 ?


update(ci): integrate tests and ci workflow for release branch and tags

What type of PR is this?
/kind cleanup
/kind release
Any specific area of the project related to this PR?
/area CI
What this PR does / why we need it:
Which issue(s) this PR fixes:
Special notes for your reviewer:
Does this PR introduce a user-facing change?:
update(ci): integrate tests and ci workflow for release branch and tags

/milestone 0.36.0

Nice! I'll rebase my #2532 once this is merged!
Thank you @jasondellaluce !

LGTM label has been added.  Git tree hash: 8faa20788d54f86fec58068a18f7c214228aacf2

/hold
/cc @LucaGuerra

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, jasondellaluce, leogr
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,jasondellaluce,leogr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/unhold