Packages not installed on first uv run --extra with conflicting extras

A basic project with 2 conflicting extras (uv 0.5.5 on Ubuntu):
[project]
name = "project"
version = "0.1.0"
requires-python = ">=3.9.0"
dependencies = []

[project.optional-dependencies]
t1 = ["tqdm==4.67.1"]
t2 = ["tqdm==4.67.0"]

[tool.uv]
conflicts = [
  [
    { extra = "t1" },
    { extra = "t2" },
  ],
]

If .venv/ and uv.lock are not present yet, the first execution of uv run --extra t1 python -c "import tqdm" results in ModuleNotFoundError: No module named 'tqdm'. It works the second time or when running e.g. uv lock before. It also works when the extras are not conflicting.

Hmm, this ran without error for me. I copied the pyproject.toml, then:
❯ uv run --extra t1 python -c "import tqdm; print(tqdm.__version__)"
4.67.1

I checked on another machine (Debian 11) and got the same issue:
$ uv run --extra t1 python -c "import tqdm; print(tqdm.__version__)"
Using CPython 3.12.7
Creating virtual environment at: .venv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'tqdm'

$ ls .venv/lib/python3.12/site-packages/
__pycache__  _virtualenv.pth  _virtualenv.py

$ uv run --extra t1 python -c "import tqdm; print(tqdm.__version__)"
⠙ Preparing packages... (0/1)
⠙ Preparing packages... (0/1)
⠙ Preparing packages... (0/1)
⠙ Preparing packages... (0/1)
⠙ Preparing packages... (0/1)
⠙ Preparing packages... (0/1)
░░░░░░░░░░░░░░░░░░░░ [0/1] Installing wheels...
Installed 1 package in 105ms
4.67.1

$ ls .venv/lib/python3.12/site-packages/
__pycache__  _virtualenv.pth  _virtualenv.py  tqdm  tqdm-4.67.1.dist-info

Trying to run this with verbose output actually fails completely:
$ rm .venv/ uv.lock -rdf
$ RUST_BACKTRACE=full uv run -v --extra t1 python -c "import tqdm; print(tqdm.__version__)"
DEBUG uv 0.5.5
DEBUG Found project root: `/home/eginhard/uv-mre`
DEBUG No workspace root found, using project root
DEBUG Discovered project `project` at: /home/eginhard/uv-mre
DEBUG Using Python request `>=3.9.0` from `requires-python` metadata
DEBUG Searching for Python >=3.9.0 in managed installations or search path
DEBUG Searching for managed installations at `/home/eginhard/.local/share/uv/python`
DEBUG Found managed installation `cpython-3.13.0-linux-x86_64-gnu`
DEBUG Found `cpython-3.13.0-linux-x86_64-gnu` at `/home/eginhard/.local/share/uv/python/cpython-3.13.0-linux-x86_64-gnu/bin/python3.13` (managed installations)
Using CPython 3.13.0
Creating virtual environment at: .venv
DEBUG Using request timeout of 30s
DEBUG Found static `pyproject.toml` for: project @ file:///home/eginhard/uv-mre
DEBUG No workspace root found, using project root
DEBUG Solving with installed Python version: 3.13.0
DEBUG Solving with target Python version: >=3.9.0
DEBUG Pre-fork all marker environments took 0.000s
DEBUG Splitting resolution on root==0a0.dev0 over project into 3 resolutions with separate markers
DEBUG Adding direct dependency: project*
DEBUG Adding direct dependency: project*
DEBUG Adding direct dependency: project[t1]*
DEBUG Adding direct dependency: project*
DEBUG Adding direct dependency: project[t2]*
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (*)
DEBUG Adding transitive dependency for project==0.1.0: project==0.1.0
DEBUG Adding transitive dependency for project==0.1.0: project[t2]==0.1.0
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (==0.1.0)
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (==0.1.0)
DEBUG Adding transitive dependency for project==0.1.0: tqdm>=4.67.0, <4.67.0+
DEBUG Found fresh response for: https://pypi.org/simple/tqdm/
DEBUG Searching for a compatible version of tqdm (>=4.67.0, <4.67.0+)
DEBUG Selecting: tqdm==4.67.0 [compatible] (tqdm-4.67.0-py3-none-any.whl)
DEBUG Found fresh response for: https://files.pythonhosted.org/packages/2b/78/57043611a16c655c8350b4c01b8d6abfb38cc2acb475238b62c2146186d7/tqdm-4.67.0-py3-none-any.whl.metadata
DEBUG Adding transitive dependency for tqdm==4.67.0: colorama{platform_system == 'Windows'}*
DEBUG Found fresh response for: https://pypi.org/simple/colorama/
DEBUG Searching for a compatible version of colorama{platform_system == 'Windows'} (*)
DEBUG Selecting: colorama==0.4.6 [compatible] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Adding transitive dependency for colorama==0.4.6: colorama==0.4.6
DEBUG Adding transitive dependency for colorama==0.4.6: colorama{platform_system == 'Windows'}==0.4.6
DEBUG Searching for a compatible version of colorama{platform_system == 'Windows'} (==0.4.6)
DEBUG Selecting: colorama==0.4.6 [compatible] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Found fresh response for: https://files.pythonhosted.org/packages/d1/d6/3965ed04c63042e047cb6a3e6ed1a63a35087b6a609aa3a15ed8ac56c221/colorama-0.4.6-py2.py3-none-any.whl.metadata
DEBUG Searching for a compatible version of colorama (==0.4.6)
DEBUG Selecting: colorama==0.4.6 [compatible] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Tried 3 versions: colorama 1, project 1, tqdm 1
DEBUG all marker environments resolution took 0.003s
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (*)
DEBUG Adding transitive dependency for project==0.1.0: project==0.1.0
DEBUG Adding transitive dependency for project==0.1.0: project[t1]==0.1.0
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (==0.1.0)
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (==0.1.0)
DEBUG Adding transitive dependency for project==0.1.0: tqdm>=4.67.1, <4.67.1+
DEBUG Searching for a compatible version of tqdm (>=4.67.1, <4.67.1+)
DEBUG Selecting: tqdm==4.67.1 [compatible] (tqdm-4.67.1-py3-none-any.whl)
DEBUG Found fresh response for: https://files.pythonhosted.org/packages/d0/30/dc54f88dd4a2b5dc8a0279bdd7270e735851848b762aeb1c1184ed1f6b14/tqdm-4.67.1-py3-none-any.whl.metadata
DEBUG Adding transitive dependency for tqdm==4.67.1: colorama{platform_system == 'Windows'}*
DEBUG Searching for a compatible version of colorama{platform_system == 'Windows'} (*)
DEBUG Selecting: colorama==0.4.6 [preference] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Adding transitive dependency for colorama==0.4.6: colorama==0.4.6
DEBUG Adding transitive dependency for colorama==0.4.6: colorama{platform_system == 'Windows'}==0.4.6
DEBUG Searching for a compatible version of colorama{platform_system == 'Windows'} (==0.4.6)
DEBUG Selecting: colorama==0.4.6 [preference] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Searching for a compatible version of colorama (==0.4.6)
DEBUG Selecting: colorama==0.4.6 [preference] (colorama-0.4.6-py2.py3-none-any.whl)
DEBUG Tried 6 versions: colorama 2, project 2, tqdm 2
DEBUG all marker environments resolution took 0.001s
DEBUG Searching for a compatible version of project @ file:///home/eginhard/uv-mre (*)
thread 'uv-resolver' panicked at crates/uv-resolver/src/resolver/batch_prefetch.rs:267:53:
IndexSet: index out of bounds
stack backtrace:
   0:     0x5833ab14e3aa - <unknown>
   1:     0x5833aad9a9ab - <unknown>
   2:     0x5833ab10f062 - <unknown>
   3:     0x5833ab151bf7 - <unknown>
   4:     0x5833ab152e4c - <unknown>
   5:     0x5833ab152695 - <unknown>
   6:     0x5833ab1525f9 - <unknown>
   7:     0x5833ab1525e4 - <unknown>
   8:     0x5833aaa6e382 - <unknown>
   9:     0x5833aaa6e97a - <unknown>
  10:     0x5833abfffe42 - <unknown>
  11:     0x5833ab64ff24 - <unknown>
  12:     0x5833ab4d68f1 - <unknown>
  13:     0x5833ab4d67cd - <unknown>
  14:     0x5833ab1561cb - <unknown>
  15:     0x70dd7c69ca94 - start_thread
                               at ./nptl/pthread_create.c:447:8
  16:     0x70dd7c729c3c - __GI___clone3
                               at ./misc/../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
  17:                0x0 - <unknown>
error: The channel closed unexpectedly

I was able to reproduce!


metaflow CLI doesn't work with most recent versions of click (click>=8.0)

Since click==8.0 (changelog), click's autocompletion argument has been renamed to shell_complete. This breaks the Metaflow CLI:
$ metaflow configure show
Traceback (most recent call last):
  File "/usr/local/bin/metaflow", line 5, in <module>
    from metaflow.main_cli import main
  File "/usr/local/lib/python3.8/site-packages/metaflow/main_cli.py", line 245, in <module>
    def info(episode):
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 287, in decorator
    _param_memo(f, ArgumentClass(param_decls, **attrs))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 2947, in __init__
    super().__init__(param_decls, required=required, **attrs)
TypeError: __init__() got an unexpected keyword argument 'autocompletion'

$ python -c "import click; print(click.__version__)"
8.1.1

I see that Metaflow is vendoring click==7.1.2, but the Metaflow CLI doesn't seem to be using the vendored version of click.

What is the version of Metaflow that you are using?

No worries - glad we could resolve this.


chore: remove unnecessary SDK dep

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 5112126c8b45b4256de6fc630baf43f16555472e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


Do not fail when gen_protos cannot be imported

R: @robertwb

Coverage increased (+0.04%) to 70.698% when pulling 930a1e3d1e61d32308fc1b0c723ae94d962d71a8 on aaltay:lnt into 63bcd3916578d5042442271e4c1a3e150577e9c9 on apache:master.

When would we expect this to happen?

It happens, if the sdk is packaged without the egg_info. In that case pip install, triggers python setup.py egg_info. Even though this cmd does not requires protos, it fails because packaged SDK does not contain the gen_protos.py.

How about in that case wrapping the commands with classes that raise an error? This way we never silently fail to generate the protos when we need them.

Alternatively, move the import into the run method.

Would not it be the same problem, if we move the import into the run method? Then it will fail when run is called.

But in that case it would only fail for the commands that require the
generated protos. egg_info would be just fine.
On Fri, Jun 2, 2017 at 10:39 AM, Ahmet Altay<EMAIL_ADDRESS>wrote:

Would not it be the same problem, if we move the import into the run
method? Then it will fail when run is called.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/beam/pull/3279#issuecomment-305861599, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAdqgZXGjMrB3vmV-7rJtddE7_3udcT1ks5sAEjOgaJpZM4NtXob
.

@robertwb Maybe I am missing something, but moving the import into the run method fails the same way. Because egg_info, triggers running of build_py. (That was the reason for original failure, egg_info did indeed caused a call to generate_protos_first and that returns a wrapped cmd.)

Ah, I wasn't aware that egg_info called build_py.
LGTM.

Thank you, merging.


Parallel datasets

Hi,
I am trying to create a POC using CodeGen to translate code written in vb to Java and vice-versa.
I downloaded the training data for vb and java using Google BigQuery. Also, I have completed the preprocessing step using commands:

python -m codegen_sources.preprocessing.preprocess /content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1  --langs vb java --mode=monolingual_functions --local=True --bpe_mode=fast --train_splits=10 --percent_test_valid=10
python -m codegen_sources.preprocessing.preprocess /content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1  --langs vb java --mode=monolingual --local=True --bpe_mode=fast --train_splits=10 --percent_test_valid=10

As a result, the following files were created inside the folder XLM-syml:

test.[java_cl|java_monolingual|java_sa|vb_cl|vb_monoligual|vb_sa].pth
train.[java_cl|java_monolingual|java_sa|vb_cl|vb_monoligual|vb_sa [0-9]].pth
valid.[java_cl|java_monolingual|java_sa|vb_cl|vb_monoligual|vb_sa].pth

Post that, I trained the MLM model using the following command:
python codegen_sources/model/train.py --exp_name mlm_vb_java_fast_mono_updated_v0 --dump_path '/content/Facebook_CodeGen/dumpPath_fast_mono_updated' --data_path '/content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1/XLM-syml' --mlm_steps 'vb_sa,java_sa' --add_eof_to_stream true --word_mask_keep_rand '0.8,0.1,0.1' --word_pred '0.15' --encoder_only true --n_layers 6  --emb_dim 1024  --n_heads 8  --lgs 'vb_sa-java_sa' --max_vocab 64000 --gelu_activation false --roberta_mode false --amp 2  --fp16 true  --batch_size 16 --bptt 512 --epoch_size 200 --max_epoch 100000 --split_data_accross_gpu global --optimizer 'adam_inverse_sqrt,warmup_updates=10000,lr=0.0001,weight_decay=0.01' --save_periodic 0 --validation_metrics _valid_mlm_ppl --stopping_criterion '_valid_mlm_ppl,10'
However, when I am trying to train transcoder model using following command, I am getting AssertionError: /content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1/XLM-syml/valid.java_sa-vb_sa.java_sa.0.pth error.
Command:
python codegen_sources/model/train.py --exp_name transcoder_vb_java_updated_v1 --dump_path '/content/drive/MyDrive/dumpPath_updated_transcoder_v0' --data_path '/content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1/XLM-syml' --split_data_accross_gpu local --bt_steps 'vb_sa-java_sa-vb_sa,java_sa-vb_sa-java_sa' --ae_steps 'vb_sa,java_sa'  --lambda_ae '0:1,30000:0.1,100000:0'  --word_shuffle 3  --word_dropout '0.1' --word_blank '0.3'  --encoder_only False --n_layers 0  --n_layers_encoder 6 --n_layers_decoder 6 --emb_dim 1024  --n_heads 8  --lgs 'java_sa-vb_sa'  --max_vocab 64000 --gelu_activation false --roberta_mode false   --reload_model '/content/Facebook_CodeGen/dumpPath_fast_mono_updated/mlm_vb_java_fast_mono_updated_v1/fkmc1busqw/checkpoint.pth,/content/Facebook_CodeGen/dumpPath_fast_mono_updated/mlm_vb_java_fast_mono_updated_v1/fkmc1busqw/checkpoint.pth'  --reload_encoder_for_decoder true  --amp 2  --fp16 true  --tokens_per_batch 3000  --group_by_size true --max_batch_size 128 --epoch_size 100  --max_epoch 10000000  --split_data_accross_gpu global --optimizer 'adam_inverse_sqrt,warmup_updates=10000,lr=0.0001,weight_decay=0.01' --eval_bleu true --eval_computation true --has_sentences_ids true --generate_hypothesis true --save_periodic 1 --validation_metrics 'valid_vb_-java_mt_comp_acc' --lgs_mapping 'vb_sa:vb,java_sa:java'
Could you please help me as to how do I get these parallel datasets?
Also, is there something/some step that I am missing or doing incorrectly?

It's mostly fine assuming you are training on 10 GPUs (because --train_splits=10).
There are just a few things you may want to change:

We trained the MLM model on the full monolingual data instead of only the _sa data. It could work as well but if you train this way you only need to create the monolingual_functions dataset. Also you shouldn't set --lgs_mapping 'vb_sa:vb,java_sa:java' since the MLM model was trained on vb_sa,java_sa.
10% for validation and testing seems like a lot if you have millions of training examples. Note that you can modify the n_sentences_eval parameter which limits the number of examples used for validation (1500 by default) to avoid the evaluation taking too long. In practice the variance should be low enough with a few thousands of examples.

Thank you for the suggestions. Just for clarification:

Then name of the path '/content/Facebook_CodeGen/fastTrainingData_monoFunc_updated_v1/XLM-syml' is a bit misleading. It actually contains data processed in both monolingual as well as monolingual_functions mode.
Since I am using small training data for POC purposes (around 1500  in both the json files), that is why I used 10% for validation and testing.

I hope these things are fine.

your mlm steps being 'vb_sa,java_sa', you will train the MLM on standalone functions only
I expect you to be able to learn to translate from 1500 monolingual examples in each language. I'm not sure what your goal is exactly but I would try to get  bigger monolingual datasets (in the hundreds of thousands of files) to train an unsupervised model.

I have changed the MLM step from vb_sa,java_sa to vb_monolingual,java_monolingual, so that should make my MLM model train on a monolingual dataset
I am using smaller files for now, just for POC purposes. For actual training, I will use a bigger dataset.

Hi!
The vocab for monolingual (standalone)functions and the parallel dataset (standalone functions) should be the same. Right?
Also, should the data from the parallel dataset be included in the preprocessing of monolingual functions?

Hi! Another question.
Why do we have the following condition? https://github.com/facebookresearch/CodeGen/blob/48df64838709e92ed5766dab464386479227f0db/codegen_sources/preprocessing/dataset_modes/dataset_mode.py#L250
Aren't there such cases where an entire program might have all standalone or all class functions, and not both? In such cases, the number of errors will increase significantly, thus reducing the size of our data.

Hi
Yes the vocab and BPE codes should be the same for all the languages/types of inputs you are training on.
You can include the data from the parallel dataset in the preprocessing of the monolingual functions if you want to, but it's probably fine if you learn the BPE codes on the monolingual dataset and just give the right BPE codes and vocab path to the preprocessing pipeline (those learned for the monolingual dataset) when preprocessing your parallel data. It's probably fine because there shouldn't be many tokens that are often present in the parallel dataset and not in the monolingual dataset.
The monolingual_func dataset is not parallel and this line won't be executed. It should be executed when the dataset is parallel, for instance for DOBF where we create a parallel obfuscated code // corresponding dictionary dataset. In that case, the parallel sample is not valid if any of the elements is not present. Does that make sense?

So, will it be fine if I perform the following steps?

Preprocess the data in monolingual mode(for MLM)
Preprocess the data in the monolingual function mode
Preprocess the parallel codes in the monolingual function mode and use the vocab and codes generated in step 2 as arguments for preprocessing

Yeah. It sort of does. So, for the parallel dataset, all I need to do is, preprocess them using the pipeline and create symlinks after making sure that the resultant files are truly parallel. Right?

use the vocab and codes of step 1 (preprocessing in monolingual mode) for step 2 and 3.
yes

Oh Okay. Thank you so much:)

Hi!
I preprocessed the data as mentioned above. I first preprocessed the data in monolingual mode and then used the vocab and codes as generated by this step to preprocess the same data in monolingual_functions mode and later to preprocess the parallel codes.
Also, I made sure that the vb.valid.sa.bpe and java.valid.sa.bpe have parallel data. Also, vb.test.sa.bpe and java.test.sa.bpe are parallel files. Post this, I created the symlinks for parallel data as mentioned above.
Post-training the MLM model, I tried to train the transcoder model but I got an error while loading Evaluator at line https://github.com/facebookresearch/CodeGen/blob/9720a8bdba18552cc499975e1f1fb6a7eca74612/codegen_sources/model/src/data/dataset.py#L208

As per my understanding, here we are trying to create batches of sentences using the index of '|' from the loaded binarized data(which the the bpe file?). And since the code couldn't find the location of this index in the sentences, hence this error occurred.
I checked the bpe files and they don't contain the data in the form of <function_id>|. Rather it contains only the tokenized functions. So, what is the need to splitting sentences based on the position of '|'? Or is it trying to create batches from the tok files?
So, could you please help me figuring out the root of this error?

If you are evaluating with unit tests organized like ours, you need to add a function ID at the beginning of the test and validation sequences (we use it in the evaluation code to find the evaluation script corresponding to the sample from the valid/test set). The format is ID | code.
If you are not testing with unit tests, you can just set --has_sentence_id false and --eval_computation false and you won't need to have sentence ids in your eval/test sets.

Okay. Thank you!

Hi @prnk04 @brozi ,
Just to be sure is it true that test.java_cl-java_sa.java_cl.pth file is nothing but a symbolic link to java.test.cl.bpe.pth file ?


change: resolve fetch text to response.data

Proposed solution for #40
I've been rolling with this version a bit and it seems correct so far.

It’s only correct for non binary data. For example, it’ll break when fetching an image asset.
This needs a full body detector, like in worktop, or to expose the raw response (consistently), since here you do get the response for your text-based response and can call .text() yourself

Ah yeah, I see what you mean. In the Node version the concat works even on binary data. I'll close this PR then.


chore(key-value): convert command to dao

SUMMARY
This PR converts the Key Value commands to a DAO, which gives the caller much more control over when commits/rollbacks happen, and what to do about expired entries. Other changes:

Update all code that uses the KV commands to use the new DAO, making sure flushes/commits happen outside the DAO. In particular, this covers the following major components:

Explore permalinks
Dashboard permalinks
Distributed lock. During the refactor, the distributed lock was moved under a module of its own + break out the stateful logic into commands that use the new DAO.
Metastore cache. I considered breaking out the logic into commands, but it felt more sensible to keep the code as-is under a single python file, as it's under extensions. In addition, this doesn't use the new transaction decorator, as we need to adhere to the Flask-Caching API.

The old KV command integration tests are converted into functionally equivalent unit tests

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Required feature flags:
[ ] Changes UI
[ ] Includes DB Migration (follow approval process in SIP-59)

[ ] Migration is atomic, supports rollback & is backwards-compatible
[ ] Confirm DB migration upgrade and downgrade tested
[ ] Runtime estimates and downtime expectations provided

[ ] Introduces new feature or API
[ ] Removes existing feature or API

I can't pinpoint why but something in this PR has caused local dev builds to fail with a flask app_context error. Also observed by Joe Li at Preset.
2024-07-01 17:47:46,317:ERROR:superset.app:Failed to create app
Traceback (most recent call last):
  File "/Users/user/superset/app.py", line 40, in create_app
    app_initializer.init_app()
  File "/Users/user/superset/initialization/__init__.py", line 479, in init_app
    self.configure_cache()
  File "/Users/user/superset/initialization/__init__.py", line 511, in configure_cache
    cache_manager.init_app(self.superset_app)
  File "/Users/user/superset/utils/cache_manager.py", line 93, in init_app
    self._init_cache(
  File "/Users/user/superset/utils/cache_manager.py", line 87, in _init_cache
    cache.init_app(app, cache_config)
  File "/Users/user/site-packages/flask_caching/__init__.py", line 145, in init_app
    self._set_cache(app, config)
  File "/Users/user/site-packages/flask_caching/__init__.py", line 155, in _set_cache
    cache_factory = import_string(import_me)
  File "/Users/user/site-packages/werkzeug/utils.py", line 596, in import_string
    __import__(import_name)
  File "/Users/user/superset/extensions/metastore_cache.py", line 27, in <module>
    from superset.daos.key_value import KeyValueDAO
  File "/Users/user/superset/daos/key_value.py", line 32, in <module>
    from superset.key_value.models import KeyValueEntry
  File "/Users/user/superset/key_value/models.py", line 24, in <module>
    from superset.models.helpers import AuditMixinNullable, ImportExportMixin
  File "/Users/user/superset/models/__init__.py", line 17, in <module>
    from . import core, dynamic_plugins, sql_lab, user_attributes  # noqa: F401
  File "/Users/user/superset/models/core.py", line 74, in <module>
    from superset.models.helpers import AuditMixinNullable, ImportExportMixin
  File "/Users/user/superset/models/helpers.py", line 107, in <module>
    config = app.config
  File "/Users/user/site-packages/werkzeug/local.py", line 318, in __get__
    obj = instance._get_current_object()
  File "/Users/user/site-packages/werkzeug/local.py", line 519, in _get_current_object
    raise RuntimeError(unbound_message) from None
RuntimeError: Working outside of application context.

This typically means that you attempted to use functionality that needed
the current application. To solve this, set up an application context
with app.app_context(). See the documentation for more information.

Followed by this
Traceback (most recent call last):
  File "/Users/user/bin/superset", line 8, in <module>
    sys.exit(superset())
  File "/Users/user/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/Users/user/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/Users/user/lib/python3.10/site-packages/click/core.py", line 1685, in invoke
    super().invoke(ctx)
  File "/Users/user/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/user/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/Users/user/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/user/lib/python3.10/site-packages/flask/cli.py", line 355, in decorator
    app = __ctx.ensure_object(ScriptInfo).load_app()
  File "/Users/user/lib/python3.10/site-packages/flask/cli.py", line 309, in load_app
    app = locate_app(import_name, name)
  File "/Users/user/lib/python3.10/site-packages/flask/cli.py", line 238, in locate_app
    return find_app_by_string(module, app_name)
  File "/Users/user/lib/python3.10/site-packages/flask/cli.py", line 166, in find_app_by_string
    app = attr(*args, **kwargs)
  File "/Users/user/superset/app.py", line 40, in create_app
    app_initializer.init_app()
  File "/Users/user/superset/initialization/__init__.py", line 479, in init_app
    self.configure_cache()
  File "/Users/user/superset/initialization/__init__.py", line 511, in configure_cache
    cache_manager.init_app(self.superset_app)
  File "/Users/user/superset/utils/cache_manager.py", line 93, in init_app
    self._init_cache(
  File "/Users/user/superset/utils/cache_manager.py", line 87, in _init_cache
    cache.init_app(app, cache_config)
  File "/Users/user/lib/python3.10/site-packages/flask_caching/__init__.py", line 145, in init_app
    self._set_cache(app, config)
  File "/Users/user/lib/python3.10/site-packages/flask_caching/__init__.py", line 155, in _set_cache
    cache_factory = import_string(import_me)
  File "/Users/user/lib/python3.10/site-packages/werkzeug/utils.py", line 596, in import_string
    __import__(import_name)
  File "/Users/user/superset/extensions/metastore_cache.py", line 27, in <module>
    from superset.daos.key_value import KeyValueDAO
  File "/Users/user/superset/daos/key_value.py", line 32, in <module>
    from superset.key_value.models import KeyValueEntry
  File "/Users/user/superset/key_value/models.py", line 24, in <module>
    from superset.models.helpers import AuditMixinNullable, ImportExportMixin
  File "/Users/user/superset/models/__init__.py", line 17, in <module>
    from . import core, dynamic_plugins, sql_lab, user_attributes  # noqa: F401
  File "/Users/user/superset/models/core.py", line 74, in <module>
    from superset.models.helpers import AuditMixinNullable, ImportExportMixin
  File "/Users/user/superset/models/helpers.py", line 107, in <module>
    config = app.config
  File "/Users/user/lib/python3.10/site-packages/werkzeug/local.py", line 318, in __get__
    obj = instance._get_current_object()
  File "/Users/user/lib/python3.10/site-packages/werkzeug/local.py", line 519, in _get_current_object
    raise RuntimeError(unbound_message) from None
RuntimeError: Working outside of application context.

This typically means that you attempted to use functionality that needed
the current application. To solve this, set up an application context
with app.app_context(). See the documentation for more information.

@rtexelm I was able to reproduce, it was due to a last second cleanup where I moved imports to the top level from the methods. I'll open up a fix shortly after doing some more testing.


fix bug when loading versions from the DB

Description
closes #8118
closes #8119
The proverbial can of worms
It is very likely the method 'get_resources_in_latest_version' was always intended to return only released version.
It's only use I can find is in lsm to find all resources that are required by a service.
lifecycle_transfer_resources = await self.resource_service.get_resources_in_latest_version(
                environment=env,
                resource_type="lsm::LifecycleTransfer",
                attributes={"instance_id": str(service_id)},
                connection=con,
            )

In this context,

it makes little sense to take into account unreleased version (it does make a little sense, because if all versions are produced by lsm, the last version, released or not, best reflects the latest inventory state)
it is absolutely whack to pull every lsm::LifecycleTransfer out of the DB to do what is essentially a match on the primary key.

I propose to make a ticket to

remove the usage of this method from lsm and just do a query. (it is probably a remnant from the time where we expect a need to run lsm on a separate DB)
drop the additional argument and make the behavior needed here the default

Self Check:
Strike through any lines that are not applicable (~~line~~) then check the box

[x] Attached issue to pull request
[x] Changelog entry
[x] Type annotations are present
[x] Code is clear and sufficiently documented
[x] No (preventable) type errors (check using make mypy or make mypy-diff)
[x] Sufficient test cases (reproduces the bug/tests the requested feature)
[x] Correct, in line with design
[ ] End user documentation is included or an issue is created for end-user documentation (add ref to issue here: )
[ ] If this PR fixes a race condition in the test suite, also push the fix to the relevant stable branche(s) (see test-fixes for more info)

Processing this pull request

Pull request rejected by merge tool. The tests for this branch did not succeed.

Processing this pull request

Pull request rejected by merge tool. The tests for this branch did not succeed.

Processing this pull request

Merged into branches master in edce4184621fd37921aa9025bf3691da2b0b33b1


Understand Shaka Player documentation

Have you read the Tutorials?
Yes
Have you read the FAQ and checked for duplicate open issues?
Yes
If the question is related to FairPlay, have you read the tutorial?

What version of Shaka Player are you using?
v4.11.7
What browser and OS are you using?
Firefox on Debian 12
Please ask your question
I don't understand how the parameters in your documentation are reflected in the configuration of Shaka Player.
For example, I'm trying (but this is not the only case I've encountered) to correct the streaming.liveSync has been deprecated and will be removed in v5.0 . We are currently at version v4.11 . Additional information: Please Use streaming.liveSync.enabled instead. warning message linked to the liveSync: true parameter. I've found the documentation page on the subject, but I can't integrate it into my configuration (copied from the Internet):
player.configure({
        preferredTextLanguage: 'fr',
        streaming: {
            lowLatencyMode: true,
            liveSync: true,
            inaccurateManifestTolerance: 0,
            rebufferingGoal: 0.01,
            segmentPrefetchLimit: 2,
            updateIntervalSeconds: 0.1,
            maxDisabledTime: 1,
            retryParameters: {
              baseDelay: 100,
            },
        },
...

How do you get from your table to a Json structure understood by the software? All my attempts have failed. I don't understand how we're supposed to interpret your documentation to configure the software.
Parameters seem to be able to be passed as player.configure('streaming.liveSync.enabled', true); but this is not practical with many parameters. I'd like to pass everything as a Json tree.
If you can tell me how to convert the documentation into a usable configuration, that would be great.
Thank you.

Hi! Here you can find that one of properties is liveSync which should be LiveSyncConfiguration object you've linked before.
So, in your example, you should call configure() method like that (replace liveSync from boolean to object):
player.configure({
  preferredTextLanguage: 'fr',
  streaming: {
    lowLatencyMode: true,
    liveSync: {
      enabled: true,
    },
    inaccurateManifestTolerance: 0,
    rebufferingGoal: 0.01,
    segmentPrefetchLimit: 2,
    updateIntervalSeconds: 0.1,
    maxDisabledTime: 1,
    retryParameters: {
      baseDelay: 100,
    },
  },
});

You can find more info how shaka configuration works here.

In general, the string syntax is just a path through the object syntax.  So, for example:
player.configure('streaming.liveSync.enabled', true);

Is equivalent to:
player.configure({
  streaming: {
    liveSync: {
      enabled: true,
    },
  },
});

Does this help?
I would appreciate a docs PR if you want to suggest a better way to explain it in the docs.  Whatever would have helped you understand the first time is a welcome improvement!

Hello,
Thank you both for your answers, it was helpful!
I'll see if I understand the logic when I get back on this subject.

I would appreciate a docs PR if you want to suggest a better way to explain it in the docs. Whatever would have helped you understand the first time is a welcome improvement!

I'm not promising anything, but I'll see what I can do, because it's not easy to understand, and I'd be happy to help make it more accessible.
Documentation is no mean feat...
Best regards.


Add h6-tag for titles

Current Behavior
Footer has a non correct hierarchical structure title of the list is a h5 and also all items insite the list. It is not possible to set h6 with visual level h5. h6 will be rendered as undefined.
Expected Behavior
hierarchical structure should be respected by adding the correct h-size
Steps to Reproduce
inspect footer on https://www.baloise.ch/de/privatkunden.html
Version
13.2.0
Browsers
No response
Device
No response
Code Reproduction URL
No response
Additional Information
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Think about it twice, will change title to h4 and leave the listtitles as h5 :)


[5.2] Add method Application::bootstrapPath()

Bootstrap directory is currently hardcoded, hence this PR allowing to relocate it just like others paths.

What was your use case for re-locating it?

I'm working on a project for some car manufacturer named volkswagen. Under some circumstances they want the application to perform better (faster cloud servers, less ads, etc.). The best approach is to bootstrap to a different application which use the same codebase except for ahem, just a few tweaks.

@taylorotwell Would you accept a backport of this addition to 5.1? It's 100% backward-compatible and would help me for some projects. Thanks in advance for considering this.

We strictly only backport bug fixes.

I know, but I just saw this change and I thought, maybe... Would be appreciated still.

That was a minor fix to allow us to make the laravel preset on StyleCI contain all the PSR-2 fixers out of the box. The key thing, is that it was a fix. This PR is a feature, and is potentially breaking too, so I don't see it getting backported, sorry.

No worries. Although this PR can't be breaking, I understand your points.
I guess we'll have to update to 5.2, then soon 5.3...

Would symlinking the bootstrap folder to your actual location work in the short term?

Symlinks are hell, avoiding them the most possible. The goal is simplification, not the reverse ;)


输出结果的长度小于设置的max_new_tokens

用示例代码测试，将max_new_tokens设置为4096，输出结果远小于这个数值，只有 565 个token

用示例代码测试，将max_new_tokens设置为4096，输出结果远小于这个数值，只有 565 个token

Please adjust the hyperparameters. This is because truncated character is generated during the inference process. You can remove do_sample=True and modify it to:
outputs_id = model.generate(inputs, max_new_tokens=4096)
Alternatively, try different hyperparameters more carefully to meet the needs of different scenarios.
Since the training corpus of the model contains less Chinese text compared to English, it is advisable to avoid setting a large max_new_tokens value in Chinese scenarios.


Francisco

Hice un par de cambios al diagrama de clases que planteamos ayer y le agregue cosas al diagrama de secuencia.

Codecov Report

Merging #2 (7fc8812) into master (932b9fb) will increase coverage by 50.31%.
The diff coverage is 93.18%.

@@              Coverage Diff              @@
##             master       #2       +/-   ##
=============================================
+ Coverage     20.00%   70.31%   +50.31%
- Complexity        2       25       +23
=============================================
  Files             4        6        +2
  Lines            20       64       +44
  Branches          0        3        +3
=============================================
+ Hits              4       45       +41
- Misses           16       18        +2
- Partials          0        1        +1

Impacted Files
Coverage Δ

...in/java/edu/fiuba/algo3/PrimeraIteracion/Pais.java
88.46% <88.46%> (ø)

...in/java/edu/fiuba/algo3/PrimeraIteracion/Dado.java
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 932b9fb...7fc8812. Read the comment docs.

mergeo con los diagramas en la carpeta Diagramas


Allow to configure task handler

Previously, every task was sent as AWS event, which caused error for
local environment setup.
Now, there is possibility to set different handler, e.g. one that prints
every task to stdout and nothing more.

Example output for TASKS_BASE_HANDLER=common.tasks.TaskPrinter:
$ docker-compose run --rm backend python manage.py createsuperuser
Starting aws-boilerplate_mailcatcher_1 ... done
Starting aws-boilerplate_localstack_1  ... done
Starting aws-boilerplate_db_1          ... done
Email address<EMAIL_ADDRESS>Password:
Password (again):
This password is too common.
Bypass password validation and create user anyway? [y/N]: y
Put events: entries=[{'Time': datetime.datetime(2020, 7, 17, 13, 39, 23, 558740), 'Source': 'backend.email', 'DetailType': 'WelcomeEmail', 'Detail': '{"type": "WelcomeEmail", "to"<EMAIL_ADDRESS>"name"<EMAIL_ADDRESS>'EventBusName': 'local-workers'}]
Superuser created successfully.


global: review sprint week 1 changes

Review all merged PRs from first week of sprint in demo site.

Make full install following the installation guide and running guide. You may need to make development installations of the corresponding modules.
Check every issue in DONE column. a) Have it been properly fixed (as in does it work for an enduser in the just installed demo site)?
Check if all modules have been released - if not make PRs for releases.

🐒 checking the app-ils installation:

Run the installation guide
invenio users create<EMAIL_ADDRESS>-a --password=123456
invenio run check the page
Make a search
Click facets option and see if the results are correct
Check if range facet exists
Do a query with special characters to see the response (shouldn't see 500 error)
Do a query with regular expressions (shouldn't see any 500 error )
Login
Check if the "Linked Accounts" link from the menu (shouldn't be there)
Go to /admin
Check "User Management" has the changes
Check "OAI-PMH" has the changes
Logout
Try to login from the /search you should redirect back to it
Click Sign up for a new user, (shouldn't see any error)
Go to /login and "hack" the form with <input type="checkbox" name="remember" checked/> and click "Login" check your Cookies shouldn't have remember Cookie
Close your browser and open again app-ils you should be still logged in
Open Console and check for any CSP errors (shouldn't have)
Check you terminal for warning, should only the following, which is norma;:

--------------------------------------------------------------------------------
/Users/user/.virtualenvs/invenio-first-week/src/invenio-oaiserver/invenio_oaiserver/ext.py:150: UserWarning: Please specify the OAISERVER_ID_PREFIX configuration.default value is: oai:drjova-macbook:recid/
  app.config.get('OAISERVER_ID_PREFIX')))

--------------------------------------------------------------------------------
WARNING in ext [/Users/user/.virtualenvs/invenio-first-week/src/invenio-jsonschemas/invenio_jsonschemas/ext.py:239]:
JSONSCHEMAS_HOST is set to localhost
--------------------------------------------------------------------------------

TBC


Linux binary 64bit latest release

Hello andywalden,
Your tool really works like a charm and I thank you for that.
However, I am currently using your "Linux binary" version 0.0.4 for some project (can't do otherwise). I wondered if you could upload the Linux binary with the latest version, 0.0.6, or give the procedure (or a link) that could allow me to package it ? The version 0.0.4 works well but I miss the additional options on the latest version !
Thanks.

Sorry about that. I just posted another update including new binaries.
https://github.com/andywalden/esmcheckds2/releases/tag/v0.0.7


Margin disappear

I've tableview with left and right margin and using this library for the first VC the margin appear but once I change the margin disappear for the next VC.

shit happens...

might be related to https://github.com/sdac/XLPagerTabStrip/commit/572d975be2fc48103f6dc319c8db6fef61d4273f
try
pod 'XLPagerTabStrip', :git => 'https://github.com/sdac/XLPagerTabStrip'

@monoqlo It seems that the issue was already fixed, could you check master branch code?


Implement ppc64le for installation script and jenkins builds

@corbin-coleman
Overview
Support for the distributions that we support needs to be added to the SUPPORT_MAP variable here:
https://github.com/docker/docker-install/blob/716f7ca3446de70b40952075352dcf9e7d3dc0de/install.sh#L48-L51
Also we should be testing against power as well which should be included like so:
https://github.com/docker/docker-install/blob/716f7ca3446de70b40952075352dcf9e7d3dc0de/Jenkinsfile#L26-L29

Closed with #35


features request

Hi. tool's awesome.
it might be useful to be able to:

define a custom table layout (you have just one layout possible).
being able to retrieve template from an attribute of a lookup field

Hi @luca0071,
thanks for your feedback.
I will add your feature requests to my todo list.
Kind Regards,
Florian

Hey @luca0071,
thanks again for your input.
Your feature requests have been implemented in Release v3.0.1.
Kind Regards,
Florian

Hi Florian, thank you very much for your implementation. we'll go thru it and give feedback to you soon, and maybe some new nice features request.
grazie


Issue with w_diffuser_inner in sed_tank_dict_test

In the return statement of this function, the numpy statement that tries to use u.inch throws an error about not being able to compare Quantity with numpy.ndarray

Fixed the two functions w_diffuser_inner_min and w_diffuser_inner


chore(main): release 1.3.0

:robot: I have created a release beep boop
1.3.0 (2024-06-26)
Features

add auto update command (5c9f2db)
add custom mrburns config (581bdf3)
add mr title and description configs (5e1ce9d)
add mrburns config file (1f4fc94)

Bug Fixes

default description template (025894b)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v1.3.0
:sunflower:


fix(api): show most recent date for FullStack cert

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] All the files I changed are in the same world language, for example: only English changes, or only Chinese changes, etc.

Related to https://github.com/freeCodeCamp/freeCodeCamp/issues/18128#issuecomment-623877965

I am passing the test with the previous .sort((a, b) => a.completedDate < b.completedDate)[0].completedDate;

tested locally on @moT01 it works well. the current solution sorts more accurately.


Update Relayer To Support Polygon

Placeholder for larger project in Umbra relayer repo

Closed by https://github.com/ScopeLift/umbra-protocol/pull/251


Change Python one-time grpc_init/grpc_shutdown to per-object-lifetime grpc_init/grpc_shutdown

Init - Shutdown parity for all objects

Also from the failing Windows test log:
+ python tools/run_tests/run_tests.py -t -l python -c dbg -x report.xml -j 2 --force_default_poller
Traceback (most recent call last):
  File "tools/run_tests/run_tests.py", line 1044, in <module>
    l.configure(run_config, args)
  File "tools/run_tests/run_tests.py", line 429, in configure
    self.pythons = self._get_pythons(self.args)
  File "tools/run_tests/run_tests.py", line 519, in _get_pythons
    pypy27_config = pypy_config_generator(name='pypy', major='2')
  File "tools/run_tests/run_tests.py", line 512, in <lambda>
    + [name] + venv_relative_python + toolchain,
NameError: free variable 'pypy_pattern_function' referenced before assignment in enclosing scope
+ TESTS_FAILED=true

.

@ctiller: please advise if this change is what you'd expect we'd have to do to support PyPy, a terrible idea, completely neutral, or something else entirely?

@ctiller and I chatted about this this morning; he is on board with this change.

Luhguhtum; merge with passing tests.

@ctiller @soltanmm @nathanielmanistaatgoogle
To clarify, was the decision that it is ok to simply not call grpc_shutdown()  As I suspected, grpc_shutdown is not getting called with this solution:
kpayson@kpayson0:~/grpc/examples/python/helloworld$ gdb --args ~/grpc/pypy/bin/python greeter_client.py
GNU gdb (GDB) 7.9-gg19
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-grtev4-linux-gnu".
Type "show configuration" for configuration details.

<http://go/gdb-home FAQ: http://go/gdb-faq Email: c-toolchain-team IRC: gdb>
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word".
Reading symbols from /usr/local/google/home/kpayson/grpc/pypy/bin/python...done.

WARNING: no debugging symbols found in /usr/local/google/home/kpayson/grpc/pypy/bin/python.
Either the binary was compiled without debugging information
or the debugging information was removed (e.g., with strip or strip -g).
Debugger capabilities will be very limited.
For further information: http://go/gdb#No_debugging_symbols_found

Unable to determine compiler version.
Skipping loading of libstdc++ pretty-printers for now.
Non-google3 binary detected.
(gdb) break grpc_init
Function "grpc_init" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (grpc_init) pending.
(gdb) break grpc_shutdown
Function "grpc_shutdown" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 2 (grpc_shutdown) pending.
(gdb) run
Starting program: /usr/local/google/home/kpayson/grpc/pypy/bin/python greeter_client.py
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/usr/grte/v4/lib64/libthread_db.so.1".

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.

Breakpoint 1, 0x00007fffefcce210 in grpc_init ()
   from /usr/local/google/home/kpayson/grpc/pypy/site-packages/grpc/_cython/cygrpc.pypy-41.so
(gdb) c
Continuing.
[New Thread 0x7fffef1e9700 (LWP 9744)]
[Thread 0x7fffef1e9700 (LWP 9744) exited]
Greeter client received: Hello, you!
[Inferior 1 (process 9740) exited normally]

@kpayson64 The grpc_shutdown() is not getting called because __dealloc__(...) is not being called unless it is constricted by memory in PyPy. Judging by the behaviour of tests as well as the behaviour of the example programs, the behaviour of the core upon sudden termination is not "dangerous". While this does not guarantee the support of PyPy, it is an incremental step towards making it happen.

@thunderboltsid
With this solution, (and assuming your assumption is correct,) the only case in which grpc_shutdown() with g_initializations == 0 will be called is if a garbage collection was called immediately prior to exit, which is unlikely unless we force it to do so.
Essentially,  the same thing could be accomplished by adding some kind of case:
if(not running with pypy):
  register grpc_shutdown()

Which I think would be a better approach.
That being said, all this is doing is covering up any potential memory leaks, and I am very much against it.
If the general consensus is that this is ok, then we can do it.  I just want to make sure everyone is fully aware why this approach seems to solve pypy memory leaks.

@kpayson64: this approach isn't just okay, it's warranted: @ctiller has stated that these paired-calls-associated-with-object-lifetimes are what C++ does and how he expects correct use of the core with a nondeterministic garbage collector to be implemented. As for exiting quickly without cleaning anything up: apparently that's fine.

I still strongly disagree with this approach, but if we decided not calling grpc_shutdown() on exit is OK, then I'm at least convinced that what is occurring here was thoroughly discussed.
I would make one last appeal to do the following instead:
if(not running with pypy):
  register grpc_shutdown()

Given that we can almost be sure grpc_shutdown() withg_initializations == 0 will not happen with pypy.  The reason I prefer this approach is because we have deterministic memory management with CPython, and now if we introduce some cyclic memory leak, we can't rely on grpc_shutdown() catching it for us anymore.
If you guys disagree, feel free to add the ready to merge label, and this change can go in.

We didn't decide that it is safe - we were told that it is safe.
What's more attractive to me about this approach is that it works for all interpreters without having to know anything specific about how interpreters identify themselves. If we were to put in some specific logic about PyPy, the code would fail when we tried to run it with Stackless right? And then IronPython, and then Jython, and on down the line, unless we knew and stated in the code either all the Python interpreters with deterministic reference-counting garbage collectors or all the Python interpreters with nondeterministic garbage collectors.
While grpc_shutdown currently has the effect of telling us what memory has been leaked, it isn't actually warranted to have such an effect, and thus we shouldn't rely on it.

To Jenkins: test this please

test this please


LEB128 question

here is my test code
(module
  (func (result i32)
    (i32.add (i32.const 624485) (i32.const 2))))

LEB of 624485 should be 0xE58E26
But from the prototype if get
; function 0

....

0000014: 0a                                         ; OPCODE_I32_CONST
0000015: 6587 0900                                  ; u32 literal
....

how is 0x65870900 derived?

constant literals are not stored as LEB128, so that is just 624485 in hex (0x98765).

thanks @binji! What is getting encoded in LEB128 then?

Currently, in the v8-native binary format, just section item counts and indexes. Search for out_leb128 in wasm-gen.c for the full list.

awesome thanks!


Add test input notification & enable the filtering of URLs on OONI Explorer

Currently, OONI Explorer is only "smart enough" to filter domains (e.g. anonymouse.org), and does not filter URLs (e.g. http://anonymouse.org).
I have the following two suggestions:

Enable users to filter BOTH domains and URLs in the "Test input" section of OONI Explorer.

It may not be obvious/clear to users that they can only filter measurements based on the domain.

Add a notification that pops-up when the user adds a domain that does not filter any measurements.

A user, for example, might accidentally type anonymouse.com instead of anonymouse.org. In this case, OONI Explorer does not show any measurements below at all. This can be quite confusing for the user, as it is unclear whether OONI Explorer is not filtering any measurements because (a) the domain in question has never been tested in that country, or (b) the domain has been tested, but it's mis-typed.
To avoid leaving our users in the dark, it might be useful to add a notification that automatically appears when (a) a user has typed a domain or URL that hasn't been tested in that country, and/or when (b) that domain or URL does not match with the domains/URLs tested (i.e. when it has been mis-typed). The notification could include the following type of message:
"Oops! It looks like we can't filter your domain/URL. Please check if you have typed the full domain/URL correctly and if it has been tested by ooniprobe users in this country (link to global and country test lists)".
cc' @hellais

This is a fairly major change to the UI (adding popus, notifications and changing how the filtering is done). It also requires OONI API changes.
This should be deferred to future work.


[BUG]: The tutorial on https://snyk.io/blog/best-practices-create-modern-npm-package/ has not working repo link

Is there an existing issue for this?

[X] I have searched the existing issues

Description of the bug
There is info on the website https://snyk.io/blog/best-practices-create-modern-npm-package/ to clone this https://github.com/snyk-labs/simple-npm-package.git repo, but such repo doesn't exists, instead this one exists https://github.com/snyk-labs/modern-npm-package.git.
I think that this can be a bug 😉
Steps To Reproduce
Try to: git clone https://github.com/snyk-labs/simple-npm-package.git
Additional Information
No response

This does exist here: https://github.com/snyk-labs/simple-npm-package. Could you double check you can see it and let me know?

Looks to me like there are two repos in existence:

https://github.com/snyk-snippets/modern-npm-package - snippets, modern
https://github.com/snyk-labs/simple-npm-package - labs, simple

And this is screenshot from the blog post:  snippets, simple

Thanks for the blog post BTW, found it very helpful.

@fuho thanks for your patience on this. I've added the repo under that organization now here: https://github.com/snyk-labs/simple-npm-package

This should be addressed now and closing the issue as a result. If you find there is something still off regarding the links please open a new issue.


Update scala-library to 2.12.18

About this PR
📦 Updates org.scala-lang:scala-library from 2.12.17 to 2.12.18
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang", artifactId = "scala-library" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scala-lang", artifactId = "scala-library" }
}]

❗ Note that the Scala Steward config file `.scala-steward.conf` wasn't parsed correctly
cron4s.InvalidCron: Either DayOfMonth and DayOfWeek must have a ? expression: DownField(frequency),DownField(pullRequests)

labels: library-update, early-semver-patch, semver-spec-patch, commit-count:1

Superseded by #457.


Default state of mascot image doesn't throw a npe anymore

There was an odd edge case where a npe was getting thrown in the console if you don't have a cached theme. This fixes that.

:+1:


Run hubot on windows

Is this something that would be useful to people?
I'd like to give it a go next week if noone is already working on it.

This is totally possible once the "binary" dependencies which require gcc are removed from the core, i.e only deps being optparse, scoped-http-client and coffee-script, it would totally be possible.

Yeah, the 2.0 version could probably run on windows.  It's a week or two away though.

This is an old thread, but if you're seeing the 'coffee' is not recognized error, try installing coffee globally.
npm install -g coffee-script
You don't need to manually compile to JavaScript, and you shouldn't be going to the hubot folder in node_modules to run hubot.


Memory usage

Presently the process consumes 413M (VIRT) 333M (RES) of memory.  Perhaps loading the words into a database could reduce memory usage.
Current workaround: comment out command "lexicon" and only load the CSW dictionary.

SQLite an option for a db that could be packaged with the bot?

Looking at PySQLite.  Might give it a try to see how well that works

Looks like APSW would be better than PySQLite

Ah, cool.  This is a low-priority issue since presently I'm only loading CSW, but other players using cloud-hosted instances with limited memory might care.  But maybe next holiday I'll try APSW.

it doesn't seem that using a database would help reduce memory usage.
here are some ideas to reduce memory usage:

use mmap. it's ok to close the file, just keep the mmap open. with open('csw.dat', 'rb') as f: m = mmap.mmap(f.fileno(), 0, access=mmap.ACCESS_READ), then outside the with just use m. pages are read and cached as needed by the OS. (note: empty files need special-casing.)
work with bytes, not strings, wherever possible. 'a'.encode() and b'a'.decode() to convert between them.
load only the words, don't load definitions.
a word found in both csw and nwl should be stored in memory just once.
store each unique word once in a sorted list. refer to them by index everywhere else. (because word[i] < word[j] implies i < j, sorting/searching can be done without comparing the words.)
use typed arrays (array.array) to remove per-element overhead.
for each lexicon and each word, remember the file position (use m.tell() before m.readline()). to iterate lines do for l in iter(m.readline, b''): a=l.rstrip().split(b'\t'). (specifically, make two typed arrays for each lexicon, one giving the index to the word in the combined list, and the other giving the byte position of the detailed line within the file.)
definitions, hooks, probabilities can be reread as needed, just seek and readline the mmap. m.seek(known_file_position); a=m.readline().rstrip().split(b'\t').
octothorps can be implied by checking if a word is in the other lexicon. that same functionality can support luved$ too. so csw# need not be a separate thing from csw. (use bisect.bisect_left and find the word index in the other lexicon's typed array of valid word indexes, see the def index in the bisect documentation.)
generally instead of dict, consider using sorted lists. use bisect to do lookups. dicts tend to use more memory and they're slower to iterate.
most queries can break early instead of first building a full array of all matches only to report the first few.

some data structures are needed to support anagram queries. memory for this may become available when the above optimizations are applied:

consider building a dawg (this would make anagrams fast, almost obviate hooks, enable subanagrams/steals, etc).
alternatively, build a trie mapping alphagrams to a list of matching words. (this larger structure only supports anagram.) to stably keep the first few alphabetical matches, use heapq.

hope that makes sense 😄

Nice, I'll try mmap.  My goal is being able to host both my discord bot and my twitch bot from a low-cost, non-AWS cloud (e.g. OVH) so anyone could do the same, so I would be surprised if a database (which both bots could connect to) would increase memory usage... but mmap is far easier to code.

I did wonder about this... that makes sense (if you have multiple dictionaries loaded):

octothorps can be implied by checking if a word is in the other lexicon. that same functionality can support luved$ too. so csw# need not be a separate thing from csw. (use bisect.bisect_left and find the word index in the other lexicon's typed array of valid word indexes, see the def index in the bisect documentation.)

@ddugovic added you as a collaborator so you can just merge changes yourself if you like

Latest master now uses mmap so it no longer consumes 1GB of memory.  Thanks all for the suggestions.


Add default box-shadow to Spark theme

The default box-shadow is missing from our Spark theme
see here -> https://sparkui.vercel.app/viewer/#Shadows

After investigation, it was found that the box-shadow default token was not missing.
Instead, the problem was that this token was in all uppercase, and the theme token keys that were also in all uppercase were not being handled properly. Consequently, they were not displaying correctly on our Tailwind Config Viewer website.


Deprecated getAttributes()

With last Twig version (1.28) I'm getting a deprecation warning:
Calling "getattributes" on template "knp_menu.html.twig" from template "foo.html.twig" is deprecated since version 1.28 and won't be supported anymore in 2.0.

this is the offending line in my foo.html.twig file:
{{ macros.attributes(attributes) }}
{# macros is from {%- import "knp_menu.html.twig" as macros -%} #}

See https://github.com/symfony/symfony/issues/20568

The templates being in KnpMenu always import macros in places using them, so they should not trigger this deprecation.
This deprecation happens when you call a macro in a template while relying on an import statement done in the parent template instead of importing them in your template.
Please check your own templates which may be using our macro

Sorry @stof I got lost. What is the proposed solution? Should I redefine the macro in my template or what else?

no, you should not define the macro. you should import the macro (instead of relying on the implementation detail exposing you the macro imported by the parent template in some cases)

Well, maybe I need to to give more details on my template. Here it is:
{% extends 'knp_menu.html.twig' %}
{% block item %}
    {% import "knp_menu.html.twig" as macros %}
    <li{{ macros.attributes(attributes) }}></li>
{% endblock %}

What should I do?

Well, I resolved removing {% import "knp_menu.html.twig" as macros %} and re-defining the macro from knp_menu.html.twig in my template. It looks like a workaround, but at least it works.
If you can suggest a better solution, it would be much appreciated. Otherwise, feel free to close.
Thanks

@garak I did experience the same issue. If you're using overwritten KNP menu templates it's highly possible that you overwrite more than one block. As the macros are being used in several blocks, you need to import the macros ({% import "knp_menu.html.twig" as macros %}) in every block they are being used. Formerly it did work without those imports because of the reasons @stof mentioned.
I'm overwriting the {% block item %} block as well as the {% block linkElement %} block and I had to add the macro import {% import "knp_menu.html.twig" as macros %} to both blocks to get rid of the deprecation message.

Closing this issue is not in KnpMenu and the solution for people's template is nicely explained by @sgehrig


Update version of ffmpeg on newtube, recommend ffmpeg 3+

Original .mp4 video:
https://1drv.ms/v/s!AlhdwNvcY7spgvY01ykAzC_pJZVAfA
Uploaded .mp4 video (temporary):
https://newtube.app/user/testing/7IcFEiV
Display issues in the publish above (instances in time):
00:42
01:03
01:13
01:37
02:28
03:11
04:11
05:05 (bottom of the display)
(basically this happens in almost all beginnings of power point slides - i used the power point export tool to make the video, but as you see the original video has no issues)
.avi version published on newtube:
https://newtube.app/user/fucksystem/5FtoBj1

Yeah this doesn't happen for me on OS X but does with Ubuntu so I'm guessing something is up with Ubuntu's version of ffmpeg. We'll see but that's what it looks like.

Was an old version of ffmpeg, this is the long-term fix: https://github.com/mayeaux/nodetube/issues/255


kubectl --validate --dry-run does not check for kubernetes-syntax

Neither --validate nor --dry-run makes a full syntax check with kubectl apply against the server. So, there is no real dry-run and no real validate
However, kubectl diff does so:
$ cat ${Build}/* | ssh root@${MASTER} kubectl --namespace ${Namespace} diff -f - || true
The Service "myproject" is invalid: spec.type: Unsupported value: "loadBalancer": supported values: "ClusterIP", "ExternalName", "LoadBalancer", "NodePort"

$ cat ${Build}/* | ssh root@${MASTER} kubectl --namespace ${Namespace} apply --dry-run --validate -f -
ingressroute.traefik.containo.us/http configured (dry run)
ingressroute.traefik.containo.us/https configured (dry run)
service/myproject created (dry run)
service/headless-not-used configured (dry run)
statefulset.apps/myproject configured (dry run)
configmap/nginx-conf-d configured (dry run)

expected:
$ cat ${Build}/* | ssh root@${MASTER} kubectl --namespace ${Namespace} apply --dry-run --validate -f -
ingressroute.traefik.containo.us/http configured (dry run)
ingressroute.traefik.containo.us/https configured (dry run)
The Service "myproject" is invalid: spec.type: Unsupported value: "loadBalancer": supported values: "ClusterIP", "ExternalName", "LoadBalancer", "NodePort"

# kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.1", GitCommit:"d224476cd0730baca2b6e357d144171ed74192d6", GitTreeState:"clean", BuildDate:"2020-01-14T21:04:32Z", GoVersion:"go1.13.5", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.1", GitCommit:"d224476cd0730baca2b6e357d144171ed74192d6", GitTreeState:"clean", BuildDate:"2020-01-14T20:56:50Z", GoVersion:"go1.13.5", Compiler:"gc", Platform:"linux/amd64"}

Based on the previous commenting I'm closing this.
/close

@apelisse Thanks! Already using this in my CI

Awesome @rdxmb, let us know if there's anything else we can do to improve it!


Bug: Archive size is not updated at the creation

Description
When creating an archive, the size of the archive is not displayed correctly in the view. Refreshing the page displays the correct size.
Steps To Reproduce
1- Create an archive with at least one item.
2- See that the size is not correctly displayed.
3- Refresh the page to see the size correctly displayed.

Steps to fix

Display the correct size when creating

Files Version
Version 2.4.40 Dev
Windows Version
W10 Home 22H2 19045.2251
Log file
Irrelevant.

Hi! :-) May I kindly ask you if I can work on this issue?

Hey, of course, go ahead! It'd be with pleasure we'd see it fixed! :)

Hey @Sferratore, are u still working on it?

Hey @Sferratore, are u still working on it?

Hi, unfortunately I'm having problems with my devices lately. I need to wait a couple days before being able to work again. If you want to take on this issue, feel free to start!

ok then I will try to figure it out

Hey @Sferratore, are u still working on it?

Hi, unfortunately I'm having problems with my devices lately. I need to wait a couple days before being able to work again. If you want to take on this issue, feel free to start!

ok then I will try to figure it out

Are you still working on this? I tried to reproduce the scenario, but it was working properly.

Hey @Sferratore, are u still working on it?

Hi, unfortunately I'm having problems with my devices lately. I need to wait a couple days before being able to work again. If you want to take on this issue, feel free to start!

ok then I will try to figure it out

Are you still working on this? I tried to reproduce the scenario, but it was working properly.

Then the issue should be closed

Are you still working on this? I tried to reproduce the scenario, but it was working properly.

No, this issue has not been fixed.

@QuaintMako @hishitetsu I can look into this, however the video replicating the issue doesn’t show the steps used to create the archive. This is important to make sure I can replicate and then confirm the fix.

Nope, not reproducible now.

I can still reproduce this on 2.5.21. Are you following the steps to reproduces

I can still reproduce this on 2.5.21. Are you following the steps to reproduce

It seems this only happens when creating .zip archives and not with .7z

Hi. I'm looking for my first issue to fix. I was able to reproduce the issue with zip archive. It is not clear if anybody is working on it at the moment.
If it is available, could you please assign it to me and give me any hints or code entry points?

@SerhiiHarashchenko this issue is available if you want to work on it. Please let us know if you have any specific questions and we'll try to help.

Hi. I was trying to replicate this error and now it happens both in zip and 7z compression, could someone verify?
Also in debugging i found out when the file is added to the filesAndFolders list is with size 0B. I suppose that the file compression hasn't finnished and is waiting for Size changed event trigger when compression is completed as @ferrariofilippo mentioned. Also could you pinpoint where this trigger happens

I see this issue in File Explorer as well.

In theory, we can wait a second or two and fetch the updated property.


Provide macOS arm64 or universal build of capa binary

Right now the build only provides an x86 capa binary. Is it possible to actually create an arm64 build of it? I know there are several blockers:

The GitHub hosted runners only have x86 macs. Not sure how convenient to "cross-compile" one
Does PyInstaller support arm64 macOS at all?

In the best case we should provide a universal build of capa that comes with both x86 and arm64 support in one executable (the standard approach these days), but that is not as useful as having an arm64 native build.
Related to https://github.com/mandiant/capa/issues/683

I have an M1 mac mini that I could use to manual build and upload the executable, if necessary. It's not awesome, but it's better than not providing such a version.
I don't have a lot of experience with macOS yet so I'm not sure what the build process looks like.

then again, i'd probably also have to build any dependencies, too, such as python-flirt. again, feasible but not awesome.


Shortcut [Ctrl + `] can't show terminal

When i shutdown Atom, and restart it, and i using shortcut [Ctrl + `], but terminal can't showing.
I must uninstall and install IDE Terminal to using it.

Please retest with pplatformio-atom-ide-terminal 2.9.0


convert status to int

closes #229

Can you add a comment somewhere, possibly in the tsv file parsing code, what 0 and 1 actually mean?

Good point.
I'm pretty sure it's explained in the TSV documentation, but it will not hurt to have it in the code as well

Thanks!


RedirectFinisher does redirect after rendering

Scenario:
I use the Form-Framework via FormBuilder inside a Neos project. We have node based form with 2 finishers:

EMail-Finisher (sends a mail to an admin-mailbox)
Redirect-Finisher (redirects to a thankyou-document-node)

Expected behaviour:
After submitting the form (when validation does not complain), the users gets redirected to the thankyou-document-uri.
Actual behavirour:
The redirect is working, but before it happens, the document of the form is rendered and visible for 1-2s and then the redirct happens.
Can we achive that the redirect happens without the "intermediate rendering" of the form?

I knew I had seen this before somewhere: https://github.com/neos/neos-development-collection/pull/16


Gin-Mongo & Mux-SQL

[x] Gin-mongo Updated
[x] Mux-SQL Updated

Gin-Mongo
EVERY THING IS RUNNING PROPERLY

Mux-SQL Updated
EVERY THING IS WORKING PROPERLY

@Sonichigo @re-Tick i have reviewed this pr. everything is working properly


Customize Ribbon Load Balancing Strategy with Zuul/Eureka

We are facing issues with requests being routed to down services from Zuul.
I understand that Zuul uses Ribbon to load balance and route requests after fetching instance info from Eureka using the serviceId.
I want to know what is the default load balancing strategy used when using Ribbon with Zuul/Eureka.
Also,Is there any way we can fine tune/change to a different ribbon strategy in Zuul to route requests.
We are currently using Spring Cloud Dalston.SR1 release and Spring Boot 1.5.4.

Ribbon client name used with Zuul is the service id that you have set. You can customize Ribbon using this client name - http://cloud.spring.io/spring-cloud-static/Dalston.SR1/#spring-cloud-ribbon

@bijukunjummen Thanks for your response. Let me check on them.
What is the default ribbon load balancing strategy when using with Zuul/Eureka.
Is there a way to set customize rules , using spring boot , application properties rather than writing custom configuration classes and customising the loadbalancing rules.

It is round robin by default

Closing due to age of the question. If you would like us to look at this issue, please comment and we will look at re-opening the issue.


error message "The terminal process terminated with exit code: 2

VSCode Version: 1.45.1
OS Version: Windows 10

Steps to Reproduce:

in my vs code i have just added the bash command as my default terminal as below
"terminal.integrated.shell.windows": "C:\Program Files\Git\bin\bash.exe"
and opening the terminal by command cntrl+,

Terminal pops up and closes immediately with prompting this error at bottom right corner.

Does this issue occur when all extensions are disabled?: Yes

Do you have anti-virus software that could be blocking the terminal? If so try following the instructions in https://code.visualstudio.com/docs/editor/integrated-terminal#_how-do-i-fix-the-errors-connectnamedpipe-failed-windows-error-232-or-terminal-exited-with-code-x-on-windows
Also does that file exist? Can you run it in an external cmd window?
/label "needs more info" integrated-terminal


[CVE-2018-19762] heap-based buffer overflow at fromsixel.c (function: image_buffer_resize)

Re-posting this here to make sure you are aware.
https://nvd.nist.gov/vuln/detail/CVE-2018-19762
https://bugzilla.redhat.com/show_bug.cgi?id=1649199

@saitoha  You should really take the project down or find a new owner.

@nluedtke Sorry for long time no reply. Fix for this problem #92 is merged into v1.8.3. Thanks.


× invalid turbo json  Error:   × No "extends" key found if ./ is specified in the pnpm-workspace packages

Verify canary release

[X] I verified that the issue exists in the latest Turborepo canary release.

Link to code that reproduces this issue
https://github.com/aminya/temp-turbo-pnpm-bug
What package manager are you using / does the bug impact?
pnpm
What operating system are you using?
Linux
Which canary version will you have in your reproduction?
2.0.14
Describe the Bug
When ./ is specified in the packages list in pnpm-workspace.yaml, turbo gives this error.
This is very confusing and doesn't provide any info on what the issue is. From the pnpm perspective, ./ is a valid package, but even if turbo doesn't accept this, it should provide a better error message.
turbo 2.0.14

  × invalid turbo json

Error:   × No "extends" key found
    ╭─[turbo.json:1:1]
  1 │ ╭─▶ {
  2 │ │     "$schema": "https://turbo.build/schema.json",
  3 │ │     "tasks": {
  4 │ │       "build": {
  5 │ │         "dependsOn": [
  6 │ │           "prebuild",
  7 │ │           "^build"
  8 │ │         ],
  9 │ │         "outputs": [
 10 │ │           "output-file.txt",
 11 │ │           "dist/**"
 12 │ │         ]
 13 │ │       },
 14 │ │       "prebuild": {},
 15 │ │       "lint": {},
 16 │ │       "type-check": {}
 17 │ │     }
 18 │ ├─▶ }
    · ╰──── add extends key here
    ╰────

Expected Behavior
Work without issues or provide a better error
To Reproduce
pnpm i
pnpm exec turbo build

Additional context
No response

I'm almost positive this is the same bug as reported in https://github.com/vercel/turborepo/issues/8599
We do want to fix this, but it currently isn't a high priority as the workaround is removing the leading ./ from the workspace globs.

Thank you for the report. This is the same issue as https://github.com/vercel/turborepo/issues/8599 so I will be closing this in favor of that.
TL;DR our workspace globbing codepath differs slightly from our "am I in this workspace" check in a way that isn't super easy to resolve.
Closing in favor of https://github.com/vercel/turborepo/issues/8599

Is there a workaround? Thank you


Unable to make it works for subdomains like groups.google.com

Because it seems permissions are restricted to push my branch, I'm trying to provide a solution for subdomains:
instead of:
OUTAGES_COUNT="$(ls "${TMP_DIR}/"*.ko | wc -l)"

we need:
OUTAGES_COUNT="$(find "${TMP_DIR}" -type f -name '*.ko' | wc -l)"

Replaced ls with find in the script to handle file counting.
This change ensures that .ko files are correctly counted even if TMP_DIR contains directories with subdomains in their names.

This resolves issues with counting files when TMP_DIR paths include subdomains.

Because it seems permissions are restricted to push my branch

Weird, pull requests are open.

This resolves issues with counting files when TMP_DIR paths include subdomains.

After checking, it seems that there are no problems with sub-domains.
There may be a problem if the check name contains a /, but there's no trivial solution for this case.


skip 'generateLockfiles' for add-to-app project.

No need to run task:'generateLockfiles' for add-to-app project.
closed #90321
closed #90490
#90321 #90490
Pre-launch Checklist

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] I read the Tree Hygiene wiki page, which explains my responsibilities.
[x] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[x] I signed the CLA.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[x] I added new tests to check the change I am making, or this PR is test-exempt.
[x] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel on Discord.

@blasten can you review this (and maybe give a hint on how to test this)?


Some corrections to the alerts' runbook files

Some corrections according to the BZ: https://bugzilla.redhat.com/show_bug.cgi?id=2265492

This is for RH BZ#2265492. Minor corrections in runbooks markdown files. Can we please review (and merge) these changes?
Thanks


Exporting .pth to coreml model

When trying to convert RWKV("RWKV-4-Pile-169M-20220807-8023.pth")
receiving this error
   3178 index = inputs[2].val
   3180 assert dim.shape == ()
-> 3181 assert index.shape == ()
   3183 # NOTE:
   3184 # Each index in @begin_array/@end_array corresponds to a dimension of @_input
   3185 # Each val of those arrays corresponds to the start/end index to slice in that dimension
   3186 rank = _input.rank

AttributeError: 'NoneType' object has no attribute 'shape'

the coreml option is currently a stub, I dont have an apple machine to test it on, so it is not fully implemented. If you or anybody is able to get it working, please submit a pull request


CMSIS-Pack Gap Analysis

The following items are collected from the discussions of the Shadowfax Componentization WG:
Component Discovery

search for components within all available packs

today's tools search within installed packs

filter components by Vendor, Device, Board, Middleware, API, Cclass

today's tools unconditionally filter by device, processor, tool-chain, enabled processor feature

separate component identification from classification

Cclass/Cbundle/Cgroup/...

extend component classification using predefined feature enumeration for semantic sorting/filtering

Component Description

add support for source type specific include paths specification FileCategory

for all sourceAsm new enumeration values includeAsm and headerAsm paths shall be applied
for all sourceC new enumeration values includeC and headerC paths shall be applied
for all sourceCpp new enumeration values includeCpp and headerCpp paths shall be applied
the existing include and header categories are applied to all file categories Asm, C and CPP for backward compatibility.

Note: all include directories are applied globally (in contrast Cmake has the concept of public and private include paths)
Component Configuration
Currently limited to single dimensional "Cvariant" selection

add component configuration parameters that impact:

file and include path selection
the condition (dependency)

add component characteristics (e.g. Heap / Stack / Clock requirements)

Component Licenses

one or more licenses for one or multiple components
click through optional
spdx license reference
display title

Change Log

associated with one or multiple components outside of releases section

Description Structure

specify component condition within the scope of a component
separate filter condition from dependencies (undecided)
separate  from  ID (undecided)
taxonomy and grouping levels need more flexibility
specify further "extension points" to the description format for "vendor's customization" (further discussion needed)

currently: device subsection <environment name="MyVendor"> ... </environment>

Description Syntax

condition syntax is hard to read and write (use boolean expressions)
add description of peripherals to a device to be used by conditions

Description Scope

add the ability to describe quality metrics, test results and coverage
add the ability to describe tests for automated testing
add the ability to describe and access "data files" required by "other tools" / e.g. generators/configuration tools
add a description for specifying a list of pack versions forming a consistent set of components = Software Development Kit (SDK)

Pack description development and validation
PackChk does not:

validate that a component with resolved dependencies builds without missing modules and include paths
have an option to check that each file of the zip archive is referenced at least once in the description
identify header files accessible through component include paths that are not directly or indirectly referenced.
provide a cookbook for developing a component and package description
generate component dependencies from source code analysis
Pack generation does not add "digital signature" / Pack installation does not validate "digital signature"
We are lacking tools for easily adding components to pack descriptions
description within vendor extensions <environment ...> are neither validated by PACK.xsd nor PackChk

End User Workflows
Today's implementations work under the assumption that at each time the user has selected a device.
Investigation focuses on migrating a project across different boards/devices easily.
Gap: Consider a workflow where the user starts from application and middleware and in the end can choose from HW that supports this.

Joachim, thanks for this good recap of the Shadowfax componentization WG discussion.
I come back to one point of the ST feedback shared during last week meeting: the spec should allow vendors to add their differentiators to a common corpus of  spec adding hooks possibly from every nodes and accepted as such I.e extension by a pack-checker tool.
I think this point is underlying a few points you have captured but it may be interesting to add it explicitly possibly in the "pack description development and validation.

@iomint I have added the "extension" topic explicitly above.

Reinhard,
The  extension point is definitively something interesting and also noticed by maxime in the discussion #5 , one question is whether it is applicable to other elements than
I do agree with your comment on  and I would like to copy here a short slides presented in June by ST in the shadowdax context showing  some needs around the components taxonomy depth.
ShadowFax ST inputs Components depth.pdf

I am missing differentiation between various include path types in pdsc. I am recommending following types:

asm
c
cpp

I am missing differentiation between various include path types in pdsc. I am recommending following types:
* asm
* c
* cpp

Added section Component Description above.

I am missing differentiation between various include path types in pdsc. I am recommending following types:

asm
c
cpp

C/CPP header files are somewhat inter-changeable (extern "C") and to my knowledge, assembler source files are pre-processed and translated with the C/C++ compiler.  Is it really a requirement to specify different include path types given the fact that include files can be generic?  Why is this a requirement?

Hi @ReinhardKeil,
Yes, this is requirement from NXP side.
Reasons are:

IDEs are typically offering separated forms for C/C++ and asm include paths (MDK included). We are creating data for data driven tools, if tools offering differentiation of include paths, meta data should also offer same capability.
Include files can be generic, but once there is dedicated form in GUI for particular set of include paths (C/C++, asm), it should contain only necessary, related paths and not others.
We are differentiating such types internally in MCUXpresso SDK.

About :

specify further "extension points" to the description format for "vendor's customization" (further discussion needed)

currently: device subsection  ...

The question was asked where exactly we think it could help to add extension points (goal is to avoid to many add-ons in the corresponding schema )
We think that below are placements that would / could be useful:

at the root (same level as  or  so that environment specific information can be added if needed)
under component and components, in case of specific components where special "work-around" might be needed
under condition and conditions (depending on the outcome of discussions around   or "features" discussions)
under generators and generator as this may be very toolset specific and extra specific info might be useful
under files and file, in case specific file format of information, or even environment specific files that wouldn't be meaningful for other environments

Note: the use of environment extension points should be as limited as possible and any GAP that cannot be implemented with the standard should be discussed in open-cmsis-pack forum to find a standard way to address it. Nevertheless adding this possibility may provide vendors and pack providers enough freedom to temporarily implement work-arounds and achieve project deadlines while the standard evolutions are discussed.

Please review a draft version of the PACK.xsd attached.
PACK.xsd.txt
I did not add extension to <file> as this should be handled on the files level if this is environment specific files/filetypes.

Hi. Here is another topic I'd like to propose for discussion as a GAP.
In ST deliveries we have template files that need to be adapted by users for their project needs, like stm32u5xx_hal_conf_template.h in
https://github.com/STMicroelectronics/STM32CubeU5/tree/main/Drivers/STM32U5xx_HAL_Driver/Inc
This file is named as stm32u5xx_hal_conf_template.h and it is documented that user should renamed it stm32u5xx_hal_conf.h in his project.
With the template attribute of CMSIS Pack:
https://www.keil.com/pack/doc/CMSIS/Pack/html/pdsc_components_pg.html#FileAttributeEnum
In our example, the stm32u5xx_hal_conf_template.h template file can be listed but it would not be renamed as desired.
That would be useful to be able to optionally specify the target name different from the original name.
Also that would be appreciated that the user file can be moved to another target folder path than the default RTE folder, like the project root for instance, or relative to the project root.

@LMESTM I would like to better understand why you consider the stm32u5xx_hal_conf_template.h file a template rather than a configuration file.
see: https://arm-software.github.io/CMSIS_5/latest/Pack/html/pdsc_components_pg.html#FileAttributeEnum
As far as I understand this file is mandatory to be present in a project rather than optional. As such it is a configuration file to me rather than a template. If you specify it as such it will be copied into the project for you and the version being tracked. I don't see a reason for needing different names in the pack than in the project you just ensure that it is not located in a directory that is used as include path.

@jkrech - Actually you're probably right, it can be considered a configuration file. The same requirement actually applies for a configuration file and a template:

we'd like the file to be renamed to stm32u5xx_hal_conf.h during the process of copy
we'd like that the file can be copied somewhere else than RTE folder

@LMESTM, I hoped we would discuss further during yesterday's project meeting but since you were not able to attend I suggest we continue here.
@DavidJurajdaNXP  has agreed to describe NXPs view on template/config files
The only reason I can see for needing to rename a 'config' is backward compatibility with today's repository directory structure, but I would rather think twice before using this as an argument for extending the pack specification.
I also believe that it is not a good idea to place a config file into a general include folder (Drivers/STM32U5xx_HAL_Driver/Inc) as it would be picked up if the include folder would be set for the compiler command line.
I am not sure I understand why the location of a configuration file matters to

@LMESTM, I hoped we would discuss further during yesterday's project meeting but since you were not able to attend I suggest we continue here. @DavidJurajdaNXP has agreed to describe NXPs view on template/config files

I guess you mean last week ? yes sorry that I could not make it.

The only reason I can see for needing to rename a 'config' is backward compatibility with today's repository directory structure, but I would rather think twice before using this as an argument for extending the pack specification. I also believe that it is not a good idea to place a config file into a general include folder (Drivers/STM32U5xx_HAL_Driver/Inc) as it would be picked up if the include folder would be set for the compiler command line. I am not sure I understand why the location of a configuration file matters or makes a difference.

First I think CMSIS PACK should allow to distribute existing software, and that it should be flexible enough for that. If distribution through CMSIS packs requires rework of the software structure, then it will lower adoption level.
In the discussion, I am considering both cases of files of attribute config and templates. In our solution, we're providing the config file as a template: cubeMX will generate it by default, if user does not use cubeMX, he will have to create the configuration file based on the template that is provided with _template suffix.  This file is named with _template suffix to make it clear this is a user file . Because of suffix (or thanks to it) , it is not an issue that the file is placed inside the include folder because other files will not include it ...  but it requires renaming.
We are thinking about other use cases as well.

for instance, our cubeMX generator can "generate" files from templates, and we would like to be able to offer configurable names and locations for different SW layers to avoid having all the generated files in a single hard coded place. Typically it allows to generate i2c.c file in a $Project/User/Core folder and we would like to be able to cope with this kind of case.
One other possible use case is multiple instances of a single template (.c or .h files) - different target folders and/or different target names would open for this possibility.  In the case above, some users may prefer to generate i2c1.c for instance 1 and i2c3.c for instance 3 of I2C.


[SDK] Add host, wsPort, and wssPort configurations

Description
This pull request introduces the ability to configure host, wsPort, and wssPort for Android, aligning it with the existing functionality in iOS. Additionally, these configurations are now exposed via JavaScript.

Parameter
Android
iOS

host
✅
✅

wsPort
✅
✅

wssPort
✅
✅

CHANGELOG

[CHANGED] Add host, wsPort, and wssPort options for Android.
[CHANGED] Update README.md with the new options.
[CHANGED] Update the example app with the new changes.

I created a patch-package patch for this change, including types that were not changed.
npm i patch-package
add "postinstall": "patch-package" to the scripts section of your package.json
@pusher+pusher-websocket-react-native+1.3.1.patch
npm install and you are done. Just remember to let cluster empty when using host and wsPort(wssPort)
have fun


WIP test reproducer Maven red hat download issue

the test is passing locally for me despite i checked settings.xml to not have the red hat maven repoitory and remove the org.apache/camel folder from my .m2 so maybe another specific part is failing?
relates to https://github.com/KaotoIO/kaoto/issues/1597

I think the reason it works with the test and not from command-line is that camel-yaml-dsl artifact is part of the test dependencies, consequently the schema/camelYamlDsl.json is always picked from this one and not from what is loaded dynamically

io.kaoto.camelcatalog.maven.CamelCatalogVersionLoader.configureRepositories(String) is called too late for Camel Yaml DSL loading. it is called when loading Camel Catalogs.
Quick and dirty fix: switch order of loading catalog and camel yaml dsl in io.kaoto.camelcatalog.generator.CatalogGenerator.generate()
better: configuring repositories sooner, or ensuring each of the loader are loading the repositories if they need it

io.kaoto.camelcatalog.maven.CamelCatalogVersionLoader.configureRepositories(String)
is called too late for Camel Yaml DSL loading. it is called when loading
Camel Catalogs.
Quickfix provided: calling the CamelCatalog which is configuring the
repositories at first
not perfect as note all versions are aligned and some others might need
it but should be enough to unblock current situation
note that the provided is not efficient because the camel-yaml-dsl test
dependency is leaking in the other tests, thus even without the fix the
test is passing... I guess it would require to create a separate module
for the test or to ensure a specific version is picked (see also next
paragraph)
Another note: when several catalog are generated at same time, I'm not
sure that we can ensure that it picks the exact correct version of the
camel-yaml-dsl, it might be the first one found, whatever version it is;
To be checked. In practice I think that most of the time there are no
differences.

When running
./mvnw package; java -jar ./target/catalog-generator-0.0.1-SNAPSHOT.jar -o ./dist/camel-catalog -k 4.6.0 -m 4.4.0.redhat-00045 -n "Default Catalog"

I got