requirements.txt does not include packages needed to run ./1_run_website.sh

I have installed the packages in requirements.txt, but additional packages needed are django, djaa_list_filter, and others. Please update your requirements.txt file to match what is needed to run all respective packages.

I don't think we need django really. Turkle (which we clone internally) needs it but Turkle should bring in its own dependencies and requirements.txt. If that's not the case, feel free to elaborate (or even better, send a PR).

As a user, I am unable to run ./1_run_website.sh as specified in the README for setup. A minimal setup for the project to get things running would be appreciated. I wish to understand how this project works by running it.

Thanks! We'll look into this. CC: @klxu03

@devinat1 my apologies, I haven't fully updated all the packages in requirements.txt! If you use poetry, the pyproject.toml should be fully updated

@devinat1 did you initially pip install, and then cd into src before running 1_run_website.sh? It's important that you run the script in /src, instead of running the script /src/1_run_website.sh?

Yes, I am running within src. My commands are as follows:
starting from root directory:
python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
cd src
./1_run_website.sh
Then I get the following:
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ ./1_run_website.sh
Using poetry and python3
Directory Turkle exists, running pre-existing server
Exception in thread django-main-thread:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/bond/.local/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/.local/lib/python3.10/site-packages/django/core/management/commands/runserver.py", line 125, in inner_run
    autoreload.raise_last_exception()
  File "/home/bond/.local/lib/python3.10/site-packages/django/utils/autoreload.py", line 87, in raise_last_exception
    raise _exception[1]
  File "/home/bond/.local/lib/python3.10/site-packages/django/core/management/__init__.py", line 398, in execute
    autoreload.check_errors(django.setup)()
  File "/home/bond/.local/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/.local/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/.local/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/.local/lib/python3.10/site-packages/django/apps/config.py", line 228, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'guardian'

My theory is that it is because I am doing a pip install within a venv.

I can confirm now that I am getting the same error with or without a venv.

@devinat1 can you try rm -rf Turkle and and re-running the script?
"Directory Turkle exists, running pre-existing server"
shouldn't be seen on an initial install

When I delete Turkle and rerun, now I get:
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ ./1_run_website.sh & sleep 30
[2] 12630
Using poetry and python3
Directory Turkle exists, running pre-existing server
Exception in thread django-main-thread:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/commands/runserver.py", line 125, in inner_run
    autoreload.raise_last_exception()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 87, in raise_last_exception
    raise _exception[1]
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 394, in execute
    autoreload.check_errors(django.setup)()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ ls
1_ia1_run_website.sh       4_run_evaluation.py  __init__.py         evaluate_model.py                   offline_baselines.py  utils
1_rockfish_run_website.sh  5_dump_features.py   amt                 evaluation                          run_single.py
1_run_website.sh           TAP_tests.py         cleanup.py          evaluation_class.py                 screenshots
2_generate_input_csv.py    TAP_tests_random.py  default_definition  img                                 test_ollama.py
3_upload_tasks.py          Turkle               dump_partition.py   lunch_test_tasks_on_amt_sandbox.py  tests.py
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ rm -rf Turkle/
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$  ./1_run_website.sh & sleep 30
[3] 13223
Using poetry and python3
Cloning into 'Turkle'...
remote: Enumerating objects: 5447, done.
remote: Counting objects: 100% (869/869), done.
remote: Compressing objects: 100% (383/383), done.
remote: Total 5447 (delta 554), reused 756 (delta 471), pack-reused 4578
Receiving objects: 100% (5447/5447), 8.40 MiB | 5.54 MiB/s, done.
Resolving deltas: 100% (3511/3511), done.
/home/bond/cs590/web_agent_datasets/turking-bench/venv/bin/python3: can't open file 'manage.py': [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/home/bond/cs590/web_agent_datasets/turking-bench/src/Turkle/manage.py", line 34, in <module>
    execute_from_command_line(sys.argv)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 416, in execute
    django.setup()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'djaa_list_filter'
Traceback (most recent call last):
  File "/home/bond/cs590/web_agent_datasets/turking-bench/src/Turkle/manage.py", line 34, in <module>
    execute_from_command_line(sys.argv)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 416, in execute
    django.setup()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'djaa_list_filter'
/home/bond/cs590/web_agent_datasets/turking-bench/venv/bin/python3: can't open file 'manage.py': [Errno 2] No such file or directory
Exception in thread django-main-thread:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/commands/runserver.py", line 125, in inner_run
    autoreload.raise_last_exception()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 87, in raise_last_exception
    raise _exception[1]
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 394, in execute
    autoreload.check_errors(django.setup)()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'djaa_list_filter'

[1]   Done                    ./1_run_website.sh
[2]-  Done                    ./1_run_website.sh

Here is the full log:
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$  ./1_run_website.sh & sleep 30
[3] 13223
Using poetry and python3
Cloning into 'Turkle'...
remote: Enumerating objects: 5447, done.
remote: Counting objects: 100% (869/869), done.
remote: Compressing objects: 100% (383/383), done.
remote: Total 5447 (delta 554), reused 756 (delta 471), pack-reused 4578
Receiving objects: 100% (5447/5447), 8.40 MiB | 5.54 MiB/s, done.
Resolving deltas: 100% (3511/3511), done.
/home/bond/cs590/web_agent_datasets/turking-bench/venv/bin/python3: can't open file 'manage.py': [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/home/bond/cs590/web_agent_datasets/turking-bench/src/Turkle/manage.py", line 34, in <module>
    execute_from_command_line(sys.argv)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 416, in execute
    django.setup()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'djaa_list_filter'
Traceback (most recent call last):
  File "/home/bond/cs590/web_agent_datasets/turking-bench/src/Turkle/manage.py", line 34, in <module>
    execute_from_command_line(sys.argv)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 416, in execute
    django.setup()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/apps/config.py", line 193, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'djaa_list_filter'
/home/bond/cs590/web_agent_datasets/turking-bench/venv/bin/python3: can't open file 'manage.py': [Errno 2] No such file or directory
Exception in thread django-main-thread:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/core/management/commands/runserver.py", line 125, in inner_run
    autoreload.raise_last_exception()
  File "/home/bond/cs590/web_agent_datasets/turking-bench/venv/lib/python3.10/site-packages/django/utils/autoreload.py", line 87, in raise_last_exception
    raise _exception[1]
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ ls
1_ia1_run_website.sh       4_run_evaluation.py  __init__.py         evaluate_model.py                   offline_baselines.py  utils
1_rockfish_run_website.sh  5_dump_features.py   amt                 evaluation                          run_single.py
1_run_website.sh           TAP_tests.py         cleanup.py          evaluation_class.py                 screenshots
2_generate_input_csv.py    TAP_tests_random.py  default_definition  img                                 test_ollama.py
3_upload_tasks.py          Turkle               dump_partition.py   lunch_test_tasks_on_amt_sandbox.py  tests.py
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ python3 2_generate_input_csv.py
 ** Reading: ../tasks/Clarifiction/batch.csv
 ** Reading: ../tasks/Neurologic Recipe Eval/batch.csv
 ** Reading: ../tasks/Scalar Adjective Ordering/batch.csv
 ** Reading: ../tasks/Evaluate Questions Defeasibility/batch.csv
 ** Reading: ../tasks/Elicitation subj/batch.csv
 ** Reading: ../tasks/Question Gen/batch.csv
 ** Reading: ../tasks/Rewrite sentences (+ context)/batch.csv
 ** Reading: ../tasks/ATOMIC - NL Rephrase/batch.csv
 ** Reading: ../tasks/Ethics_sbic Dialogue/batch.csv
 ** Reading: ../tasks/Wiki103_Quality/batch.csv
 ** Reading: ../tasks/Essentian Terms in Questions/batch.csv
 ** Reading: ../tasks/Ethical rule-of-thumb quality/batch.csv
 ** Reading: ../tasks/ToTTo Evals/batch.csv
 ** Reading: ../tasks/ATOMIC - Event Sequences/batch.csv
 ** Reading: ../tasks/Annotate WaNLI/batch.csv
 ** Reading: ../tasks/ATOMIC Validate GL/batch.csv
 ** Reading: ../tasks/TuringAdvice/batch.csv
 ** Reading: ../tasks/Passive voice Parents 1st-2nd Person Persuasiveness Comparison/batch.csv
 ** Reading: ../tasks/Missing Adjective/batch.csv
 ** Reading: ../tasks/Triple Quality Eval/batch.csv
 ** Reading: ../tasks/Dialog Human Evaluation/batch.csv
 ** Reading: ../tasks/BiSECT Human Evaluation/batch.csv
 ** Reading: ../tasks/Story Eval [Quality]/batch.csv
 ** Reading: ../tasks/Spanish Word Alignment/batch.csv
 ** Reading: ../tasks/Visual Comet Multiple Choice Test Verify/batch.csv
 ** Reading: ../tasks/ATOMIC Neg Discriminator Eval/batch.csv
 ** Reading: ../tasks/Elicitation obj/batch.csv
 ** Reading: ../tasks/TrecQA/batch.csv
 ** Reading: ../tasks/DI Rationale Gen. evaluation/batch.csv
 ** Reading: ../tasks/PSTS-Lexsub/batch.csv
 ** Reading: ../tasks/Goal Distractor - ATOMIC base events 1/batch.csv
 ** Reading: ../tasks/IMDB Sentiment Completions/batch.csv
 ** Reading: ../tasks/Pseudoword Dataset Creation PPDB/batch.csv
 ** Reading: ../tasks/Rule-of-Thumb/batch.csv
 ** Reading: ../tasks/Opinion Mining of Spanish Customer Comments/batch.csv
 ** Reading: ../tasks/Event effect/batch.csv
 ** Reading: ../tasks/CommonsenseQA_Eval/batch.csv
 ** Reading: ../tasks/Generics Embodiment/batch.csv
 ** Reading: ../tasks/Style adaptation, pairwise, complex-simple/batch.csv
 ** Reading: ../tasks/Paraphrase Evaluation/batch.csv
 ** Reading: ../tasks/VQA Rationale Generation/batch.csv
 ** Reading: ../tasks/Automatic Detection of Generated Text/batch.csv
 ** Reading: ../tasks/Social Chem Eval/batch.csv
 ** Reading: ../tasks/Simplification-Meaning-Grammar-Simplicity/batch.csv
 ** Reading: ../tasks/Commonsense Morality - Verify Action Comprehensible/batch.csv
 ** Reading: ../tasks/ATOMIC - NL Rephrase Eval/batch.csv
 ** Reading: ../tasks/Rationale Generation/batch.csv
 ** Reading: ../tasks/Mauve human eval/batch.csv
 ** Reading: ../tasks/Typicality Judgements for Objects -disagreement run-/batch.csv
 ** Reading: ../tasks/Step 5 human performance/batch.csv
 ** Reading: ../tasks/Commonsense Morality - Class Label Collect/batch.csv
 ** Reading: ../tasks/Reddit In-group Analysis/batch.csv
 ** Reading: ../tasks/RocStories 1/batch.csv
 ** Reading: ../tasks/Dialogue rot annotation/batch.csv
 ** Reading: ../tasks/MinimalChangeInconsistentMiddles/batch.csv
 ** Reading: ../tasks/Style Adaptaion - Subjective-Objective/batch.csv
 ** Reading: ../tasks/NLI for GenGen/batch.csv
 ** Reading: ../tasks/ATOMIC - Object Rationale/batch.csv
 ** Reading: ../tasks/Scalar Adjectives Identification/batch.csv
 ** Reading: ../tasks/Mars human eval (a-b testing)/batch.csv
 ** Reading: ../tasks/Formalize sentence/batch.csv
 ** Reading: ../tasks/Recreation of the Dan Johnson/batch.csv
 ** Reading: ../tasks/Relative CommonsenseQA Explanation Pairwise Judgements Collection 3/batch.csv
 ** Reading: ../tasks/Chatbot Response Quality Evaluation/batch.csv
 ** Reading: ../tasks/O+S_Eval/batch.csv
 ** Reading: ../tasks/Evaluate Questions/batch.csv
 ** Reading: ../tasks/Generics Eval - Soft - all dataset eval/batch.csv
 ** Reading: ../tasks/Winogrande (object)/batch.csv
 ** Reading: ../tasks/neural-pop (PLAN evaluation) t5-human-test b/batch.csv
 ** Reading: ../tasks/Multimodal Prompt Caption Eval/batch.csv
 ** Reading: ../tasks/VisualCOMET Selection test/batch.csv
 ** Reading: ../tasks/Congressional Bills/batch.csv
 ** Reading: ../tasks/Full sentence style annotations/batch.csv
 ** Reading: ../tasks/Aductive Pairwise Eval/batch.csv
 ** Reading: ../tasks/PerSenT/batch.csv
 ** Reading: ../tasks/Compile list of area chairs/batch.csv
 ** Reading: ../tasks/JJ-NN HIT/batch.csv
 ** Reading: ../tasks/Generics Categories (Definitional)/batch.csv
 ** Reading: ../tasks/Lattice/batch.csv
 ** Reading: ../tasks/ANES 2008 open-ended survey/batch.csv
 ** Reading: ../tasks/Advice Gen/batch.csv
 ** Reading: ../tasks/Step 1 Generating Multi-Sentence Questions (science)/batch.csv
 ** Reading: ../tasks/COMET2020 ATOMIC Prag Neg Pilot/batch.csv
 ** Reading: ../tasks/Evaluate_e2e/batch.csv
 ** Reading: ../tasks/PSTS-Pivot/batch.csv
 ** Reading: ../tasks/Sentence Compression/batch.csv
 ** Reading: ../tasks/Commonsense Misinformation Tracking Pilot [cancer data setup]/batch.csv
 ** Reading: ../tasks/Polite versus rude/batch.csv
 ** Reading: ../tasks/Sentiment_Negative/batch.csv
 ** Reading: ../tasks/WikiHow Goal Membership/batch.csv
 ** Reading: ../tasks/Image captioning/batch.csv
 ** Reading: ../tasks/Human evaluation - gentle vs canary/batch.csv
 ** Reading: ../tasks/Science Questions test without any answers dropped/batch.csv
 ** Reading: ../tasks/Commonsense Morality - Text Label Validate-Collect/batch.csv
 ** Reading: ../tasks/Creating Sentence Paraphrases/batch.csv
 ** Reading: ../tasks/HTER/batch.csv
 ** Reading: ../tasks/Question Typing/batch.csv
 ** Reading: ../tasks/Spheres of Alturism/batch.csv
 ** Reading: ../tasks/WikiHow Step Membership/batch.csv
 ** Reading: ../tasks/BiSECT Multilingual Evaluation/batch.csv
 ** Reading: ../tasks/ESNLI Rationale Generation/batch.csv
 ** Reading: ../tasks/Step 4 Selecting good - bad answers to questions (short)/batch.csv
 ** Reading: ../tasks/HTER - longer sentences/batch.csv
 ** Reading: ../tasks/ATOMIC - Required Objects/batch.csv
 ** Reading: ../tasks/Newyorker_joke_explain_pairwise/batch.csv
 ** Reading: ../tasks/COMET2020 ATOMIC Inference Vp/batch.csv
 ** Reading: ../tasks/Essential Terms in Questions 2/batch.csv
 ** Reading: ../tasks/Evaluate the Quality of Explanations (Relative CommonsenseQA)/batch.csv
 ** Reading: ../tasks/Style adaptation, pairwise, subjective-objective/batch.csv
 ** Reading: ../tasks/Sherlock Four Sent Choice mixed/batch.csv
 ** Reading: ../tasks/Evaluate the Quality of Explanations (Relative NLI)/batch.csv
 ** Reading: ../tasks/Moral Judgement/batch.csv
 ** Reading: ../tasks/MCN - Multiple Choice testset/batch.csv
 ** Reading: ../tasks/Summarization/batch.csv
 ** Reading: ../tasks/Contextual Similarity -- Paraphrase Round/batch.csv
 ** Reading: ../tasks/Associate countries and languages with Ethnologue/batch.csv
 ** Reading: ../tasks/Generics Eval - Soft/batch.csv
 ** Reading: ../tasks/Commongen Evals (RLUE)/batch.csv
 ** Reading: ../tasks/Paraphrase Clustering with Merge/batch.csv
 ** Reading: ../tasks/Annotation subj_obj/batch.csv
 ** Reading: ../tasks/Annotation Rating/batch.csv
 ** Reading: ../tasks/PSTS-psts.c2v/batch.csv
 ** Reading: ../tasks/Text Game Eval/batch.csv
 ** Reading: ../tasks/Story Relations/batch.csv
 ** Reading: ../tasks/Reading Comprehension/batch.csv
 ** Reading: ../tasks/QuestionKeyPhrases/batch.csv
 ** Reading: ../tasks/DnD Identify Guidance/batch.csv
 ** Reading: ../tasks/Coherence Evaluation/batch.csv
 ** Reading: ../tasks/ATOMIC KB Completion/batch.csv
 ** Reading: ../tasks/Gun violence structured extraction/batch.csv
 ** Reading: ../tasks/ANLI Generation/batch.csv
 ** Reading: ../tasks/What breaks the flow - no categories/batch.csv
 ** Reading: ../tasks/InconsistentMiddles/batch.csv
 ** Reading: ../tasks/Generics Eval - Comparatives/batch.csv
 ** Reading: ../tasks/Evaluate the Quality of Explanations (Singular Acceptability NLI)/batch.csv
 ** Reading: ../tasks/Step 1 Generating Multi-Sentence Questions (CNN)/batch.csv
 ** Reading: ../tasks/Sentence Summarization/batch.csv
 ** Reading: ../tasks/NER - Scruples/batch.csv
 ** Reading: ../tasks/Winogrande plausiblity/batch.csv
 ** Reading: ../tasks/Photo Collection GVDB/batch.csv
 ** Reading: ../tasks/Script KD eval/batch.csv
 ** Reading: ../tasks/Opinion Mining of Spanish Customer Comments2/batch.csv
 ** Reading: ../tasks/Duration Range Evaluation 10_07/batch.csv
 ** Reading: ../tasks/Number of sense/batch.csv
 ** Reading: ../tasks/Commonsense Morality - Validate Instances/batch.csv
 ** Reading: ../tasks/Radiology Sentence Classification/batch.csv
 ** Reading: ../tasks/ATOMIC - Required Objects (Sequence)/batch.csv
 ** Reading: ../tasks/Evaluate free-text rationales/batch.csv
 ** Reading: ../tasks/Defeasible inference/batch.csv
 ** Reading: ../tasks/Detox/batch.csv
 ** Reading: ../tasks/Commonsense Morality-Text Label Validate-Collect-Extended/batch.csv
 ** Reading: ../tasks/Word Formality Annotation/batch.csv
 ** Reading: ../tasks/Abductive Reasoning/batch.csv
 ** Reading: ../tasks/Newyorker_joke_explain_quality/batch.csv
 ** Reading: ../tasks/Intuitive physics/batch.csv
(venv) bond@razer:~/cs590/web_agent_datasets/turking-bench/src$ python3 3_upload_tasks.py
 -> Clarifiction
Error: failed to contact site
 -> Neurologic Recipe Eval
Error: failed to contact site
 -> Scalar Adjective Ordering
Error: failed to contact site
 -> Evaluate Questions Defeasibility
Error: failed to contact site
 -> Elicitation subj
Error: failed to contact site
 -> Question Gen
Error: failed to contact site
 -> Rewrite sentences (+ context)
Error: failed to contact site
 -> ATOMIC - NL Rephrase
Error: failed to contact site
 -> Ethics_sbic Dialogue
Error: failed to contact site
 -> Wiki103_Quality
Error: failed to contact site
 -> Essentian Terms in Questions
Error: failed to contact site
 -> Ethical rule-of-thumb quality
Error: failed to contact site
 -> ToTTo Evals
Error: failed to contact site
 -> ATOMIC - Event Sequences
Error: failed to contact site
 -> Annotate WaNLI
Error: failed to contact site
 -> ATOMIC Validate GL
Error: failed to contact site
 -> TuringAdvice
Error: failed to contact site
 -> Passive voice Parents 1st-2nd Person Persuasiveness Comparison
Error: failed to contact site
 -> Missing Adjective
Error: failed to contact site
 -> Triple Quality Eval
Error: failed to contact site
 -> Dialog Human Evaluation
Error: failed to contact site
 -> BiSECT Human Evaluation
Error: failed to contact site
 -> Story Eval [Quality]
Error: failed to contact site
 -> Spanish Word Alignment
Error: failed to contact site
 -> Visual Comet Multiple Choice Test Verify
Error: failed to contact site
 -> ATOMIC Neg Discriminator Eval
Error: failed to contact site
 -> Elicitation obj
Error: failed to contact site
 -> TrecQA
Error: failed to contact site
 -> DI Rationale Gen. evaluation
Error: failed to contact site
 -> PSTS-Lexsub
Error: failed to contact site
 -> Goal Distractor - ATOMIC base events 1
Error: failed to contact site
 -> IMDB Sentiment Completions
Error: failed to contact site
 -> Pseudoword Dataset Creation PPDB
Error: failed to contact site
 -> Rule-of-Thumb
Error: failed to contact site
 -> Opinion Mining of Spanish Customer Comments
Error: failed to contact site
 -> Event effect
Error: failed to contact site
 -> CommonsenseQA_Eval
Error: failed to contact site
 -> Generics Embodiment
Error: failed to contact site
 -> Style adaptation, pairwise, complex-simple
Error: failed to contact site
 -> Paraphrase Evaluation
Error: failed to contact site
 -> VQA Rationale Generation
Error: failed to contact site
 -> Automatic Detection of Generated Text
Error: failed to contact site
 -> Social Chem Eval
Error: failed to contact site
 -> Simplification-Meaning-Grammar-Simplicity
Error: failed to contact site
 -> Commonsense Morality - Verify Action Comprehensible
Error: failed to contact site
 -> ATOMIC - NL Rephrase Eval
Error: failed to contact site
 -> Rationale Generation
Error: failed to contact site
 -> Mauve human eval
Error: failed to contact site
 -> Typicality Judgements for Objects -disagreement run-
Error: failed to contact site
 -> Step 5 human performance
Error: failed to contact site
 -> Commonsense Morality - Class Label Collect
Error: failed to contact site
 -> Reddit In-group Analysis
Error: failed to contact site
 -> RocStories 1
Error: failed to contact site
 -> Dialogue rot annotation
Error: failed to contact site
 -> MinimalChangeInconsistentMiddles
Error: failed to contact site
 -> Style Adaptaion - Subjective-Objective
Error: failed to contact site
 -> NLI for GenGen
Error: failed to contact site
 -> ATOMIC - Object Rationale
Error: failed to contact site
 -> Scalar Adjectives Identification
Error: failed to contact site
 -> Mars human eval (a-b testing)
Error: failed to contact site
 -> Formalize sentence
Error: failed to contact site
 -> Recreation of the Dan Johnson
Error: failed to contact site
 -> Relative CommonsenseQA Explanation Pairwise Judgements Collection 3
Error: failed to contact site
 -> Chatbot Response Quality Evaluation
Error: failed to contact site
 -> O+S_Eval
Error: failed to contact site
 -> Evaluate Questions
Error: failed to contact site
 -> Generics Eval - Soft - all dataset eval
Error: failed to contact site
 -> Winogrande (object)
Error: failed to contact site
 -> neural-pop (PLAN evaluation) t5-human-test b
Error: failed to contact site
 -> Multimodal Prompt Caption Eval
Error: failed to contact site
 -> VisualCOMET Selection test
Error: failed to contact site
 -> Congressional Bills
Error: failed to contact site
 -> Full sentence style annotations
Error: failed to contact site
 -> Aductive Pairwise Eval
Error: failed to contact site
 -> PerSenT
Error: failed to contact site
 -> Compile list of area chairs
Error: failed to contact site
 -> JJ-NN HIT
Error: failed to contact site
 -> Generics Categories (Definitional)
Error: failed to contact site
 -> Lattice
Error: failed to contact site
 -> ANES 2008 open-ended survey
Error: failed to contact site
 -> Advice Gen
Error: failed to contact site
 -> Step 1 Generating Multi-Sentence Questions (science)
Error: failed to contact site
 -> COMET2020 ATOMIC Prag Neg Pilot
Error: failed to contact site
 -> Evaluate_e2e
Error: failed to contact site
 -> PSTS-Pivot
Error: failed to contact site
 -> Sentence Compression
Error: failed to contact site
 -> Commonsense Misinformation Tracking Pilot [cancer data setup]
Error: failed to contact site
 -> Polite versus rude
Error: failed to contact site
 -> Sentiment_Negative
Error: failed to contact site
 -> WikiHow Goal Membership
Error: failed to contact site
 -> Image captioning
Error: failed to contact site
 -> Human evaluation - gentle vs canary
Error: failed to contact site
 -> Science Questions test without any answers dropped
Error: failed to contact site
 -> Commonsense Morality - Text Label Validate-Collect
Error: failed to contact site
 -> Creating Sentence Paraphrases
Error: failed to contact site
 -> HTER
Error: failed to contact site
 -> Question Typing
Error: failed to contact site
 -> Spheres of Alturism
Error: failed to contact site
 -> WikiHow Step Membership
Error: failed to contact site
 -> BiSECT Multilingual Evaluation
Error: failed to contact site
 -> ESNLI Rationale Generation
Error: failed to contact site
 -> Step 4 Selecting good - bad answers to questions (short)
Error: failed to contact site
 -> HTER - longer sentences
Error: failed to contact site
 -> ATOMIC - Required Objects
Error: failed to contact site
 -> Newyorker_joke_explain_pairwise
Error: failed to contact site
 -> COMET2020 ATOMIC Inference Vp
Error: failed to contact site
 -> Essential Terms in Questions 2
Error: failed to contact site
 -> Evaluate the Quality of Explanations (Relative CommonsenseQA)
Error: failed to contact site
 -> Style adaptation, pairwise, subjective-objective
Error: failed to contact site
 -> Sherlock Four Sent Choice mixed
Error: failed to contact site
 -> Evaluate the Quality of Explanations (Relative NLI)
Error: failed to contact site
 -> Moral Judgement
Error: failed to contact site
 -> MCN - Multiple Choice testset
Error: failed to contact site
 -> Summarization
Error: failed to contact site
 -> Contextual Similarity -- Paraphrase Round
Error: failed to contact site
 -> Associate countries and languages with Ethnologue
Error: failed to contact site
 -> Generics Eval - Soft
Error: failed to contact site
 -> Commongen Evals (RLUE)
Error: failed to contact site
 -> Paraphrase Clustering with Merge
Error: failed to contact site
 -> Annotation subj_obj
Error: failed to contact site
 -> Annotation Rating
Error: failed to contact site
 -> PSTS-psts.c2v
Error: failed to contact site
 -> Text Game Eval
Error: failed to contact site
 -> Story Relations
Error: failed to contact site
 -> Reading Comprehension
Error: failed to contact site
 -> QuestionKeyPhrases
Error: failed to contact site
 -> DnD Identify Guidance
Error: failed to contact site
 -> Coherence Evaluation
Error: failed to contact site
 -> ATOMIC KB Completion
Error: failed to contact site
 -> Gun violence structured extraction
Error: failed to contact site
 -> ANLI Generation
Error: failed to contact site
 -> What breaks the flow - no categories
Error: failed to contact site
 -> InconsistentMiddles
Error: failed to contact site
 -> Generics Eval - Comparatives
Error: failed to contact site
 -> Evaluate the Quality of Explanations (Singular Acceptability NLI)
Error: failed to contact site
 -> Step 1 Generating Multi-Sentence Questions (CNN)
Error: failed to contact site
 -> Sentence Summarization
Error: failed to contact site
 -> NER - Scruples
Error: failed to contact site
 -> Winogrande plausiblity
Error: failed to contact site
 -> Photo Collection GVDB
Error: failed to contact site
 -> Script KD eval
Error: failed to contact site
 -> Opinion Mining of Spanish Customer Comments2
Error: failed to contact site
 -> Duration Range Evaluation 10_07
Error: failed to contact site
 -> Number of sense
Error: failed to contact site
 -> Commonsense Morality - Validate Instances
Error: failed to contact site
 -> Radiology Sentence Classification
Error: failed to contact site
 -> ATOMIC - Required Objects (Sequence)
Error: failed to contact site
 -> Evaluate free-text rationales
Error: failed to contact site
 -> Defeasible inference
Error: failed to contact site
 -> Detox
Error: failed to contact site
 -> Commonsense Morality-Text Label Validate-Collect-Extended
Error: failed to contact site
 -> Word Formality Annotation
Error: failed to contact site
 -> Abductive Reasoning
Error: failed to contact site
 -> Newyorker_joke_explain_quality
Error: failed to contact site
 -> Intuitive physics
Error: failed to contact site

Were you all able to run the entire script locally (and not using Github Actions)?

I was able to run successfully ./1_run_website.sh  after running poetry install.


Allow syncing each article to a separate page

This issue makes a lot of sense, when we have few articles it works well on a single page, but when we use a lot of omnivore keeping everything on a single page (as it is today) I think it is not the best practice to use Logseq

Hi @avelino I think most people ignore the big page and see their articles as linked references in the journal, but if some people are trying to read on the full page we definitely need another solution as it will become unmanageable.

Hey @avelino , v1.12.5 has been released to address this issue.
Please refer to this part in the document: https://docs.omnivore.app/integrations/logseq.html#sync-articles-into-a-specific-logseq-page


MobileNetV2Mid doesn't load

I can load regular MobileNetV2 by referencing the folder containing the json and shard files, but can't with v2Mid. I can load it with the .min.js method and then save it to IndexedDB, but when trying to load from IndexedDB it throws the same error as it does when trying to load it from path. I tried loading with and without { size: 299 } and saving with and without it.
Output is too many characters, view here:
https://pastebin.com/E04VhTYM
Starts with:  Error: layer: Improper config format
Ends with 'className' and 'config' must set.

That error tends to happen when you try to load a graph model with a layers model call, or a layers model call with a graph model.
Maybe try { type: "graph" }?

That error tends to happen when you try to load a graph model with a layers model call, or a layers model call with a graph model.
Maybe try { type: "graph" }?

This worked. Admittedly, this is something I should've tried but didn't because the docs were a bit unclear in this regard, making it seem as though MobileNetV2Mid didn't need to be loaded with the type specified and making it seem as though the type is saved when you save the model to IndexedDB. Below are the sections referenced here.
"Model MobileNetV2Mid - [299x299]
const model = nsfwjs.load("/path/to/different/model/", { size: 299 });"
"Model InceptionV3 - [Graph]
const model = nsfwjs.load("/path/to/different/model/", { type: "graph" });"
"Parameters:
optional URL to the model.json folder.
optional object with size property that your model expects."

would LOVE a rewrite PR of the docs that's more clear!
Please feel free to be added as a contributor with a lil Readme magic!


Integration with react-dev-tools Chrome extension

Hi, this is just an idea and feel free to ignore it, but if Dio.js was able to integrate to react-dev-tools in development mode that could add a boost to the developer's productivity. Inferno.js does provide a package to perform this integration which you could inspect here to evaluate whether it would worth creating something similar for Dio.js:
https://github.com/infernojs/inferno/blob/master/packages/inferno-devtools/src/bridge.ts

Sure, do you want to try porting that and see how it goes?

I'd certainly love to try that but I had to just pass an oportunity to get some good money writing some articles because of the current project I'm working on. I don't think I'll have time to work on this at least for the next 6 months as we're in a very early stage and on a small budget so I'm trying to deliver as much as possible to see if we can get some clients which would allow me some more free time hopefully. I'll let you know once I get some free time to try integrating with react-dev-tools but it won't be any time soon so feel free to close this issue for now and I'll reopen it with a pull request when I find some time to work on it. Thanks.


Added support for loading migrations from embedded jar

Implementation is not golden, but tests pass:)
Fixes #36

@hugebdu - maybe this will save you from adding anything to fw - I know this is a poor-mans impl, but it might just be sufficient for 99% of cases.
Will not merge it today, as I'm having day-off tomorrow, so don't want a ci storm:)


Fix 'helm template' to also print invalid yaml

Signed-off-by: Reinhard Naegele<EMAIL_ADDRESS>

As mentioned in https://github.com/helm/helm/pull/7094#issuecomment-583562707, this is an alternative solution for #7094.

Over on #7094 it was suggested by @bacongobbler that this should be behind the --debug flag. Any thoughts on that?

Yeah, same feedback as @mattfarina provided. The code looks good, but I'm interested in the CLI design. Would users want the full template output displayed when a rendering error occurs, or should it only be displayed when --debug is provided?
My concern is that if we display the full template output, the error message will be lost in the noise. For example, CI/CD pipelines probably don't want their templates rendered out in the log. By placing this under the --debug flag, users can opt into that functionality to gain a better understanding why their templates failed.

The way I implemented it basically follows what Helm 2 does. Was YAML parsing introduced on purpose here or is this just an unintentional side effect of the refactoring? Anyways I'm open to placing it under the --debug flag. Might be the better option but I don't really have a strong opinion on that.

+1 for the --debug flag

So I went ahead and placed it under the --debug flag.


Split dependencies, late-import bits

This PR allows installing this repository without having to install as many dependencies.
Namely, doing pip install -r requirements-infer.txt -r requirements-en.txt will be enough to install inference dependencies for English. (I tried this out with a fresh venv on my laptop.)
Trying to do zh inference, or training, with this set of requirements installed, will fail with an ImportError sooner or later.
pip install -r requirements.txt should still work as before.
Thank you for your work, the results are impressive!

Thanks a lot for your careful consideration and we appreciate your recognition of our efforts~
We have not received much feedback regarding installation failures, so we would like to maintain the current installation process as simple for main branch.
If you have any questions, welcome to open an issue~

Hi, thank you for the reply.
This does not change the default installation instructions at all. You can still install requirements with pip install -r requirements.txt, just as before. It will install approximately 165 packages on Python 3.12.
Installing the inference requirements only, pip install -r requirements-infer.txt -r requirements-en.txt, installs 104 packages.

Hi @akx, we just split some eval pkgs from requirements.txt to requirements_eval.txt
Hope it would be better that doesn't install all packages or split many txt files


Updated ICM-20948 to cover some faqs.

Hopefully this will better cover some the faqs on the ICM-20948.

@ThreadOfFate Please check and consider the suggested changes.
2 minor fixes and wording changes for better readability and to correct the sentences.


feat(trie): trie nodes

Adds various node types used in MPT.

🤖 Generated by Copilot at 791b15b
Summary
🌳🔑🧪

This pull request implements the trie data structure and its RLP encoding and hashing for the reth project. It adds a new crate trie with dependencies on reth-primitives, reth-rlp, and hex. It defines three types of nodes: BranchNode, ExtensionNode, and LeafNode, and their methods for encoding and creating them. It also provides some helper functions and tests for the node module.

trie crate grows nodes
branch, extension, and leaf
autumn of RLP

Walkthrough

Add dependencies and module declaration for trie crate (link, link)
Define and implement different types of nodes for the trie (link, link, link, link)

Create BranchNode struct and methods in branch.rs (link)
Create ExtensionNode struct and methods in extension.rs (link)
Create LeafNode struct and methods in leaf.rs (link)
Re-export node types and define helper functions for encoding and hashing in mod.rs (link)

Codecov Report

Merging #2174 (6f6e5af) into main (c9af8a2) will decrease coverage by 55.14%.
The diff coverage is 0.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@             Coverage Diff             @@
##             main    #2174       +/-   ##
===========================================
- Coverage   72.00%   16.86%   -55.14%
===========================================
  Files         448      452        +4
  Lines       54481    54609      +128
===========================================
- Hits        39228     9209    -30019
- Misses      15253    45400    +30147

Flag
Coverage Δ

integration-tests
16.86% <0.00%> (-2.29%)
:arrow_down:

unit-tests
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

crates/trie/src/lib.rs
0.00% <ø> (-100.00%)
:arrow_down:

crates/trie/src/nodes/branch.rs
0.00% <0.00%> (ø)

crates/trie/src/nodes/extension.rs
0.00% <0.00%> (ø)

crates/trie/src/nodes/leaf.rs
0.00% <0.00%> (ø)

crates/trie/src/nodes/mod.rs
0.00% <0.00%> (ø)

... and 321 files with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


c++ use multiple threads but much slower than python

I use ParallelFor as https://github.com/nmslib/hnswlib/blob/7cc0ecbd43723418f43b8e73a46debbbc3940346/python_bindings/bindings.cpp#L239
// c++ code, add 10000 points, addPoint cost 7580ms
// compile flags:  -std=c++11 -g -pipe -W -Wall -fPIC -pthread -Ofast -fwrapv
int d = 256;
hnswlib::labeltype n = 10000;

std::vector<float> data(n * d);
std::mt19937 rng;
rng.seed(47);
std::uniform_real_distribution<> distrib;

for (hnswlib::labeltype i = 0; i < n * d; ++i) {
    data[i] = distrib(rng);
}

hnswlib::L2Space space(d);
hnswlib::AlgorithmInterface<float>* alg_hnsw = new hnswlib::HierarchicalNSW<float>(&space, 2 * n);
int num_threads = std::thread::hardware_concurrency();
ParallelFor(0, n, num_threads, [&](size_t row, size_t threadId) {
                    alg_hnsw->addPoint((void *) data.data() + d * row, (size_t) row);
});

# python code, add 10000 points, add_items cost 310ms
import numpy as np
import hnswlib
import time
dim = 256
num_elements = 10000
data = np.float32(np.random.random((num_elements, dim)))
ids = np.arange(num_elements)
p = hnswlib.Index(space = 'ip', dim = dim)
p.init_index(max_elements = num_elements, ef_construction = 200, M = 16)
start=time.time();p.add_items(data, ids);end=time.time();

Is there anything i missed in c++ code? Why c++ is mush slower?

Hi @bluemandora. One thing that might be missing is that the first element should be added before the parallel segment (this is done to avoid another global lock).
I can also imagine the hyperparameters like ef_construction and M might be different.

Hello all,
Some questions about the parallel_for section. It is parallelized at each query level right, meaning if I have only one data point to add to the the existing hnsw index, it does not benefit from the parallel_for. Same question for search. Also, addPoint() in the parallel_for scenario, is essentially not thread safe right, or there're some writing blocks while each thread is synchronizing the hnsw index.
Thanks,
Jianshu

Hi @jianshu93,
Yes, the parallelization is external to individual queries. There are ways to parallelize the search for a query, but, as for my understanding, it is not as efficient in terms of usage of compute resources.
The insertion (addPoint) has locks, so insertion/updates are thread-safe.


no menus in the app

optional merge = if someone needs to disable all the menus

@mxdpeep there could be an option for that, but as you say, it's not something everybody would want. Closing.


Bump hm-rega to 4.0.0

update confirmed by @GermanBluefox at 6.11.2023 by telegram

4.0.0 created 04.09.2023
1500 user
OK


feat: add detected object feature remover

Related Issue(required)
#1
Description(required)
Add detected object feature remover from https://github.com/tier4/AutowareArchitectureProposal.iv
Review Procedure(required)
Check the following item
Readme
Launch file
Related PR(optional)
Older PR #66

TODO: change commit name
Pull request has only one commit and it's not semantic; this may lead to a non-semantic commit in the base branch (see https://github.community/t/how-to-change-the-default-squash-merge-commit-message/1155). Amend the commit message to match the pull request title, or add another commit.

TODO: change commit name
Pull request has only one commit and it's not semantic; this may lead to a non-semantic commit in the base branch (see https://github.community/t/how-to-change-the-default-squash-merge-commit-message/1155). Amend the commit message to match the pull request title, or add another commit.

I'm done


For CODE_OF_CONDUCT etc, do we want them for the template too?

@samcunliffe suggests that this could be added #205

Closing in favour of #205


Make host display answer screen able to fit more players

https://github.com/hto-projects/friendpardy/pull/188


Broken %PATH% for the regular cmd environment

After running the installation all the %PATH% values are gone on the regular cmd shell.
- name: Debug PATH before Swift installation
  shell: pwsh
  run: |
    Write-Host "PATH before Swift installation:"
    Write-Host $env:PATH
- name: Debug PATH in cmd shell
  shell: cmd
  run: |
    echo %PATH%
- name: Install Swift toolchain
  uses: compnerd/gha-setup-swift@main
  with:
    branch: swift-${{ env.SWIFT_VERSOIN }}-release
    tag: ${{ env.SWIFT_VERSOIN }}-RELEASE
- name: Debug PATH after Swift installation
  shell: pwsh
  run: |
    Write-Host "PATH after Swift installation:"
    Write-Host $env:PATH
- name: Debug PATH in cmd shell
  shell: cmd
  run: |
    echo %PATH%

The pwsh works as expected, but the cmd %PATH% is empty after running the swift installation.

Interesting. Would you be able to run a quick test of set and path instead of echo %Path%?

echo %PATH% //shows empty
set PATH //shows correct paths
path //shows empty path=

set PATH working properly indicates that the environment is properly configured. echo %PATH% not matching is really odd.


Dependency bytemuck v1.16.0 Yanked by Developer

On commit 2334907 it seems that dependency bytemuck-1.16.0 has been yanked from crates.io by its developer.  Will this cause problems in the future?

It shouldn't be an issue since there is a new patch release 1.16.3 but just created a PR updating the dep

I understand!  Thank you!


offload_dir error on Colab

This error seems to be due to accelerate , curious if you have any solution?
Traceback (most recent call last):
  File "/content/alpaca-lora/generate.py", line 36, in <module>
    model = PeftModel.from_pretrained(
  File "/usr/local/lib/python3.9/dist-packages/peft/peft_model.py", line 177, in from_pretrained
    model = dispatch_model(model, device_map=device_map)
  File "/usr/local/lib/python3.9/dist-packages/accelerate/big_modeling.py", line 342, in dispatch_model
    raise ValueError(
ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.27, base_model.model.model.layers.28, base_model.model.model.layers.29, base_model.model.model.layers.30, base_model.model.model.layers.31, base_model.model.model.norm, base_model.model.lm_head.

Increasing the memory works for me.

Did you try this on Google Colab?

Did you try this on Google Colab?

no, I tried on my own gpu server.

Strangely this error seems to occur on Colab, not sure if it's because it's a 16 gig RAM @tloen Any thoughts?

I also face the same error, using Colab !

I also face the same error, using Colab !

Managed to address it by using a custom vm (using GCP) :)

ror seems to occur on Colab, not sure if it's because it's a 16 gig

Yes it is the memory I believe, Once I plugged in a custom vm with 30gigs it worked fine.

i only can run correctly on my without Gpu server


Doesn't control client

I've just set this up with docker, but I'm having an issue. It seems to recognize the playing media just find, and also find the intro end timestamp.. But the client doesn't skip to the end. Am I missing something?
2020-02-17 00:34:32,708 :: bw_plex :: DEBUG :: plex.py:1191 :: Found Dexter.s03e07 theme start 01:42, theme end 03:14, ffmpeg_end 03:18 progress 00:00 fake_progress 00:10 best_time 03:14 credits_start 00:00 credits_end 00:00
2020-02-17 00:34:39,414 :: bw_plex :: DEBUG :: plex.py:1191 :: Found Dexter.s03e07 theme start 01:42, theme end 03:14, ffmpeg_end 03:18 progress 00:06 fake_progress 00:16 best_time 03:14 credits_start 00:00 credits_end 00:00
2020-02-17 00:34:49,413 :: bw_plex :: DEBUG :: plex.py:1191 :: Found Dexter.s03e07 theme start 01:42, theme end 03:14, ffmpeg_end 03:18 progress 00:16 fake_progress 00:26 best_time 03:14 credits_start 00:00 credits_end 00:00
2020-02-17 00:34:59,410 :: bw_plex :: DEBUG :: plex.py:1191 :: Found Dexter.s03e07 theme start 01:42, theme end 03:14, ffmpeg_end 03:18 progress 00:26 fake_progress 00:36 best_time 03:14 credits_start 00:00 credits_end 00:00

Here's my docker command: docker run --rm --name=bw_plex -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e url=http://IP_ADDRESS:32400/ -e token=TOKEN -v /opt/bw_plex:/config -v /gmedia:/mnt/unionfs/ Media hellowlol/bw_plex

I dont know the reason. I need the entire log not just a snippet. The only think i can guess based on the log you provided is that the playback hadn’t reached the point where the client seeks to the end of the intro. The file will play as normal until the start of theme music then seek to the end. It also requires that the client is controllable (on same local network)

You were on the right track. The intro didn't start yet. Now I'll set it up to skip previously as well.
When using the Plex app for Windows 10, bw_plex times out when trying to skip the intro. I am guessing it's due to firewall. Is there any info on what ports need to be open in order for it to work?

🤷♂ the client support are flaky. I’m using this on iOS mainly. If plexapi supports the client it should work. If you know some python you could write a test script that just tests the seek command to try to debug it. So see the wiki for clients support.

I'm a C# veteran, but I don't rly have any python experience.
I've tested with Plex app on Android TV (Nvidia SHIELD). I've also tested with Plex app on my Android phone. Both worked great, so I guess you can add those to your supported list.
I also tested on Chromecast which also worked great. I was casting from Android phone if that makes any difference.
Getting it working on Windows Plex app is not a high priority for me, but I guess for the sake of functionality of bw_plex it'd be worth checking out. I'm willing to help in any way you need.
From the Plex app on my Android phone, I am able to connect to the Windows plex app and remote control it. So it does support remote control of some sort. I'm pretty sure it's related to this setting:

Basically, it looks pretty much like it's just a wrapper of the web app. The web app also have this same setting, so I also tested it here, and bw_plex doesn't work here either. I guess it's worth noting that remote controlling web app from Android App doesn't seem to work properly either (although I have seen it working before a long time go, maybe it's because I've just remote controlled Plex app on same machine).


Ores should return predictions for available models even if requested together with missing models

Currently, there is a "revert" model for a ptwiki:
http://ores.wmflabs.org/scores/ptwiki/?models=reverted&revids=41338880|41339445
{
  "41338880": {
    "reverted": {
      "prediction": true,
      "probability": {
        "false": 0.2614995893827041,
        "true": 0.7385004106172957
      }
    }
  },
  "41339445": {
    "reverted": {
      "prediction": false,
      "probability": {
        "false": 0.8541050428468395,
        "true": 0.14589495715316042
      }
    }
  }
}

but the modules "goodfaith" and "damaging" are not available yet. This should not make the following request to fail completely:
http://ores.wmflabs.org/scores/ptwiki/?models=reverted|damaging|goodfaith&revids=41338880|41339445
{
  "error": {
    "code": "bad request",
    "message": "Models '['goodfaith', 'damaging']' not available for ptwiki."
  }
}

I expected a response which would contain the predictions for the available modules, and error messages for the others. E.g.:
{
  "error": {
    "code": "bad request",
    "message": "Models '['goodfaith', 'damaging']' not available for ptwiki."
  }
  "41338880": {
    "reverted": {
      "prediction": ...
    }
  },
  "41339445": {
    "reverted": {
      "prediction": ...
    }
  }
}

or even a more verbose output like
{
  "41338880": {
    "reverted": {
      "prediction": ...
    },
    "goodfaith": {
      "error": ...
    },
    "damaging": {
      "error": ...
    }
  },
  "41339445": {
    "reverted": {
      "prediction": ...
    },
    "goodfaith": {
      "error": ...
    },
    "damaging": {
      "error": ...
    }
  }
}

I'm not sure I agree.  Imagine how many bits we would waste if a service was requesting a set of models and handling the error silently.  I think it's best to error when there is anything wrong with the request and require our users to get it right.

Closing wontfix


[SSG] When switching languages, the URL does not change correspondingly to the prefix.

Environment
Nuxt project info:                                                                                18:03:03

------------------------------
- Operating System: `Linux`
- Node Version:     `v16.16.0`
- Nuxt Version:     `3.3.1`
- Nitro Version:    `2.3.1`
- Package Manager<EMAIL_ADDRESS>- Builder:          `vite`
- User Config:      `telemetry`, `ssr`, `app`, `css`, `runtimeConfig`, `nitro`, `modules`, `i18n`, `experimental`, `vite`
- Runtime Modules:  `<EMAIL_ADDRESS>- Build Modules:    `-`
------------------------------

👉 Report an issue: https://github.com/nuxt/nuxt/issues/new                                                       18:03:03

👉 Suggest an improvement: https://github.com/nuxt/nuxt/discussions/new

👉 Read documentation: https://nuxt.com

Reproduction
no need, see below
Describe the bug
I have found this: https://github.com/nuxt-modules/i18n/blob/7c8dc6ec3e2a0d4af1834f80ebe49f0df5eed7eb/src/runtime/utils.ts#L355-L365
In SSG mode, the URL does not change when switching languages. However, if a user simply reloads the webpage, the language will revert to the previous one.
So, I'm thinking that by using replaceState() instead of location.assign, we might be able to solve it elegantly(without breaking history).
Additional context
No response
Logs
No response

Thank you for your reporting!
I backed from short vacation!
I think we might be able to fix the issue by fixing the areas you pointed out.
But, we should confirm at the facts with minimal reproduction, and then we will bug fix it.
Can you gjve us with your minimal reproduction?
I believe your reproduction will also be useful as a nuxt i18n regression :)

I've faced in this PR.
So, I'll fix this issue.


Salesforce migration

Summary

The Salesforce source was moved from viadot version 1. The source was moved along with the unit tests. The structure of the source has undergone the following changes compared to viadot 1:

Added class attribute config_key
Updated how secrets are retrieved. After the change, it looks the same as in other sources, e.g. exchange_rates.

Importance

Marge It is needed to use source in prefect-viadot container
Checklist

This PR:

[x ] adds new tests (if appropriate)
[ x] updates docstrings for any new functions or function arguments (if appropriate)
[ x] updates CHANGELOG.md with a summary of the changes

Advanced Communities optimized the way non-profits interact with donors, volunteers, members, and constituents. They can help your non-profit organization make a measurable impact on the world around us. Give your customers the choice to pay online or offline with secure debit and credit card payments. Track all transactions easily with Stripe and native support of FinDock payments and donations integrations. Check this Salesforce e-commerce solution https://advancedcommunities.com/products/ac-ecommerce-for-non-profits/

I made some minor corrections, the code is now ready for review

I decided to change the test structure by looking at the advice from 1:1 on Thursday.

I have added a bulk upsert test

Each test is self-contained, i.e. rows are created and deleted in each individual test

At the end of the session, it is checked whether any row remains in the database and is deleted if found

In an upsert/bulk_upsert test the insert is performed first and then the update is checked in the same test

I added a get_tested_records function which returns the result of the query. I added it because very often I had to call the same qyery to validate the tests

✅ Added bulk upsert test and refeactored tests

The DE team has created a new version of this PR.

New PR: https://github.com/dyvenia/viadot/pull/708


"measure" vs "measurement"

Hello,
I'm not sure if this is really an issue, but I noticed that MeasurePulse class in the config module creates "measure", not "measurement" value for "operation" key as shown below. I don't see any error in running a qua program, so I image both are probably allowed, but the clarification would be appreciated.
        "readout_pulse_r0": {             "operation": "measure",             "length": 5000,             "waveforms": {                 "I": "readout_I_wf_r0",                 "Q": "readout_Q_wf_r0"             },
Thanks,
Jaseung

Hi @JaseungKu,
Thanks for reporting the issue!
I believe that this was already fixed in 0.12.0, see these release notes:
https://github.com/qua-platform/py-qua-tools/releases
Can you please confirm?
Cheers,
Yoav

Hi @yomach,
Thanks for letting me know. You are right;  it got fixed in 0.12.0. I was using the 0.11.2 version and after upgrading to 0.12.0, I can see the "measurement" correctly.
Best,
Jaseung


Enable self-shading for one-axis tracking systems with backtracking

Since NREL/ssc#280 added diffuse shading to multiple self-shading scenarios, the "Shading and Layout" page in the UI needs to be updated to allow for self-shading when single axis backtracking systems are selected. This selection applies only diffuse shading, since there is no beam shading for a backtracking system. There will be no difference between "thin film (linear)" and "standard (non-linear)" options in a backtrack system, since only diffuse shading applies and non-linear shading is from beam shading.

Tested on Linux Ubuntu 18.04.3 LTS

Revised description in Help for Fall 2022 release. (We forgot to revise Help for the SAM 2020.2.29 release when this change was made.)


ng new app failing with 'npm ERR! cb() never called!' error

🐞 Bug report
Command

[x] new
[ ] build
[ ] serve
[ ] test
[ ] e2e

Description
ng new my-first-project is failing with below error:
npm WARN deprecated<EMAIL_ADDRESS>TSLint has been deprecated in favor of ESLint. Please see https://github.com/palantir/tslint/issues/4534 for more information.
npm WARN deprecated<EMAIL_ADDRESS>Chokidar 2 will break on node v14+. Upgrade to chokidar 3 with 15x less dependencies.
npm WARN deprecated<EMAIL_ADDRESS>request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated<EMAIL_ADDRESS>fsevents 1 will break on node v14+ and could be using insecure binaries. Upgrade to fsevents 2.
npm WARN deprecated<EMAIL_ADDRESS>this library is no longer supported
npm WARN deprecated<EMAIL_ADDRESS>Please see https://github.com/lydell/urix#deprecated
npm WARN deprecated<EMAIL_ADDRESS>https://github.com/lydell/resolve-url#deprecated
npm ERR! cb() never called!
npm ERR! This is an error with npm itself. Please report this error at:
npm ERR!     https://npm.community
npm ERR!      C:\Users\AppData\Roaming\npm-cache_logs\2021-03-03T19_24_37_504Z-debug.log
🔬 Minimal Reproduction
Try creating a new project using latest angular cli on Node 14.16.0 and NPM 6.14.11
🔥 Exception or Error

npm ERR! cb() never called!
npm ERR! This is an error with npm itself. Please report this error at:
npm ERR!

🌍 Your Environment

Angular CLI: 11.2.2
Node: 14.16.0
OS: win32 x64

Angular:
...
Ivy Workspace:

Package                      Version
------------------------------------------------------
@angular-devkit/architect    0.1102.2 (cli-only)
@angular-devkit/core         11.2.2 (cli-only)
@angular-devkit/schematics   11.2.2 (cli-only)
@schematics/angular          11.2.2 (cli-only)
@schematics/update           0.1102.2 (cli-only)

As indicated by the error message this seems like a problem with NPM and not with Angular CLI.
Please have a look at https://npm.community/t/npm-err-cb-never-called/486
I suggest to downgrade/upgrade NPM or use an alternative package manage.

Ok upgrading NPM to 7.6.0 fixed this issue for me. But I hope NPM team permanently fixes this issue for everyone.


Graph shutdown

Hello,
I am starting with orientDB and I want to delete all vertices in my data base; I am using  Graph API.
I have a method to addData vertices and edges . I have a method to printData in the text console .
I have a dropData methode to remove vertices and edges.
AddData and printData work find. I can used them when I want but after a call to dropData (data are droped, cheked with studio), I cannot used again addData,  printData or dropData, I have this error ==>
Database 'plocal:C:/orientdb-community/orientdb-community-2.1.16/databases/Test' is closed
I call a new graph at the beggining of each method from the factory  (myGraphTx = myFactory.getTx()) and  I used graph.shutdown() at the end of  each method.
what I didn't understand to have this error .
thanks for your help.

more informations
Before to call DropDatabase I called myServerAdmin.existsDatabase() ...so if I removed this step, my problem disapears ...any suggestion to understand ?

Hi @stfanbrg
Can you post some code? My feeling is that you are dropping the db and it's not correctly recreated.
Thanks
Luigi

on click button call =
`    if (isConnected()) {
  try {
    //if (odbConnection.isDataBaseExists()) {

    try {
      if (odb != null) {
        odb.dropData();
        println("data deleted");
      }
    } catch (Exception exception) {
      LOGGER.log(Level.SEVERE, "MyGui error", exception);
    }
    //}
  } catch (Exception exception) {
    LOGGER.log(Level.SEVERE, "MyGui error", exception);
  }
}`

DropData of the odb object ask for a graph from the factory  and delete the vertices (edges are automatically deleted ...)
the graph is shutdown with shutdown().
`public void dropData() {
//TODO régler le problème de database fermée sur OrientGraphBase avec une première utilisation. le code est mis en commentaire
setGraph();
for (Vertex v : myGraph.getVertices()) {
  myGraph.removeVertex(v);
}

shutdownGraphWithComit();

}`


Keyboard doesn't appear after presentation from UIHostingController

Steps to reproduce:

run the code below
focus text field
click show button
hide the presentation view

Now keyboard won't appear.
I tried using the id modifier - it solves the problem when applied to the BasicHosting parent view, but in real app these two places are widely separated.
Switching BasicHosting to UIViewControllerRepresentable solves the problem, but I can't do that in my use case for two reasons:

I need the _overrideSizeThatFits method to size the view properly.
Using it with collection view cell configuration gives the following error:

UIViewControllerRepresentable is not supported inside of UIHostingConfiguration.

struct App: View {
    @State var isPresented = false

    var body: some View {
        VStack {
            TextField("placeholder", text: .constant(""))

            BasicHosting {
                Button("show") {
                    isPresented = true
                }
                .presentation(transition: .default, isPresented: $isPresented) {
                    Text("Fullscreen")
                        .background(Color.gray)
                }
            }
        }
    }
}

struct BasicHosting<Content: View>: UIViewRepresentable {
    @ViewBuilder let content: () -> Content

    func makeUIView(context: Context) -> UIView {
        let controller = UIHostingController(rootView: content())
        context.coordinator.parentController = controller
        return controller.view
    }

    func updateUIView(_ uiView: UIView, context: Context) {
        context.coordinator.parentController.rootView = content()
    }

    class Coordinator: NSObject {
        var parentController: UIHostingController<Content>!
    }

    func makeCoordinator() -> Coordinator {
        Coordinator()
    }
}

https://github.com/nathantannar4/Transmission/assets/6103621/c8bb8828-1c96-49d3-8b62-20bbca9018de

We use it to make a custom long press menu with UIContextMenuInteraction
I should have tested with sheet, now I see that it's happening with it too.

Presenting view controller  from detached view controller is not supported, and may result in incorrect safe area insets and a corrupt root presentation. Make sure is in the view controller hierarchy before presenting from it. Will become a hard exception in a future release.

I guess I'll have to switch to using UIViewControllerRepresentable and sizing it somehow - I failed when I first tried it, but maybe there's a way.

I see so you have a BasicHosting but really thats for a UIContextMenuInteraction? What you should do in that case is move the presentation modifier to outside.
struct App: View {
    @State var isPresented = false

    var body: some View {
        VStack {
            TextField("placeholder", text: .constant(""))

            BasicHosting {
                Button("show") {
                    isPresented = true
                }
            }
            .presentation(transition: .default, isPresented: $isPresented) {
                Text("Fullscreen")
            }
        }
    }
}

thanks, maybe I'll do it. it's not that simple since it's deep in the view tree, but may still be easier than using UIViewControllerRepresentable


Missing information for Local setup

Missing information for setup the project locally
Issues faced

While running the project locally, I faced a cors issue. I was able to resolve it by following the steps mentioned in the Avoiding CORS during development document. I think this should be mentioned in the README.md file of the project.
And also, I think the information related to TDD should be mentioned in the README.md file of the project as well , which testing library is being used and how to run the tests.

Hey There @ankushdharkar @vinayak-trivedi @vvaibhavdesai Should this be taken forward?
I was just about to start the local setup for RDS website and was probably wondering, If it is meant to be taken forward, then I could possibly take this up!


Remove MethodAccess from API whitelist

https://github.com/MovingBlocks/Terasology/blob/09670727a1fc5f0c9ffeabc46a7eb7092b7dc914/engine/src/main/java/org/terasology/engine/module/ExternalApiWhitelist.java#L82
Guess I don't need to implement any TCP API after all, I just need to MethodAccess everything!
(MethodAccess has a factory method which, if I'm right, should be able to call anything. It does take a Class, but it should be possible to create arbitrary Class instances with it, and thus escape the sandbox.)

Found the main and probably only user: @MarcinSc's computer system, guessing his language definition in https://github.com/Terasology/ModularComputers/tree/master/src/main/java/com/gempukku/lang
The system supports in-game computers a la OpenComputers and such. I don't know how critical that class is, or how easy it would be to use a different tactic, but I think this is why it is there.
Maybe interesting to @engiValk since he likes trying to exploit security loopholes
Curious if we might end up with activity in the area that might refactor / replace affected things, at which point we could take that class off the whitelist.


Never call dealloc

I tried your demo and found that the view controller never call dealloc function.
You are using "self" instance in some block methods.

Hi,
Our demo project is just contains chat controller, why do you expect it to dealloc?
Although we found crash in demo project in a latest QMChatViewController, fix will for it will be available in the next release, for now use this method in viewDidLoad (if you are already using 0.3.2):
[self insertMessagesToTheBottomAnimated:@[message1, message2, message3, message4]];

instead of:
[self updateDataSourceWithMessages:@[message1, message2, message3, message4]];

Thank @Raikerian . I'm trying to install new version but currently can not.


don't include the libs on linux

This should be a fix for https://github.com/revery-ui/revery/issues/527
Not sure if it is ok like this?

@tcoopman - looks great! In Linux, we can expect those libs to be around.

I've played with this a bit and the strange thing is that I can fix the issue also when I move the flags after extraflags
so this works as well on my machine:
    @ extraFlags
    @ ccopt ("-L" ^ (Sys.getenv "FREETYPE2_LIB_PATH"))
    @ ccopt ("-L" ^ (Sys.getenv "HARFBUZZ_LIB_PATH"))

This doesn't work:
    @ ccopt ("-L" ^ (Sys.getenv "FREETYPE2_LIB_PATH"))
    @ ccopt ("-L" ^ (Sys.getenv "HARFBUZZ_LIB_PATH"))
    @ extraFlags

Interesting... the linker is sensitive to ordering (it uses the ordering to decide precedence)... I think putting them later in the order decreases the precedence, and it must be enough to have it pick up the system libs instead


except

I use lazy on cached to avoid creating the HashSet unless we actually process anything (i.e. if our input is empty we shouldn't have to generate a HashSet). I did a little bit of testing comparing it to if I set cached to null initially and then initializing it after running ProcessNext and it seems to make little difference.

Looks good.
Pretty confusing original implementation I think as it does a distinct as well - that would have definitely caught me off the first time I would have used it! Hmmm anyway it's not like you've changed that.

Hmm now that you say it yea it does do a distinct after initializing the HashSet with values. Maybe we can have Distinct be an Except that is passed an empty Array or something.... I wonder if that would be slower at all...


<div class="deep-chat-temporary-message"> render problem

https://github.com/OvidijusParsiunas/deep-chat/blob/252f5e7d6d554aa62e5b5b7e252ed3fc1b438774/website/docs/docs/messages/HTML.mdx#L455
i cant view whats inside the div with that class (the first item that render auto hide itself i think)
i copied the exact example from https://deepchat.dev/docs/messages/HTML#customElements

Hi @TheLime1.
I am a little confused which example you have used because the first part of the message points towards the use of "deep-chat-temporary-message" class and the second one is for a customElements section. Could you paste the exact code you have used in your configuration so I can try to replicate it locally.
Thankyou!

i meant this part

there is no link for that part

Hi @TheLime1. Thankyou for sharing your example. Can you elaborate what you mean by cant view whats inside the div with that class.
The message bubble with "deep-chat-temporary-message" will be re-rendered once a new message has appeared (in this case when either of the buttons are clicked), hence it will no longer be available.

Since there has been no activity in this issue I will close it.


Atmos gas filters need a logical inverse.

Description

With atmos pipestacking changes, it takes a much larger profile and more metal to invert an atmos filter to only output a specific gas in a direction.
Screenshots

Flipped filters do exist. I'm like 99% sure you can craft them too

if you're talking about filter mirroring, that wasn't what i was trying to describe
if you're talking about logically inversed filters, then i haven't seen a way to obtain them ingame

it actually costs the same amount of steel

just design your setup better

it actually costs the same amount of steel

the increased profile might not be suitable for smaller stations if you dont want pipes running into eachother

just design your setup better

mirror... it's really annoying sometimes even with good setups


Add relationship links

Looking over the specification your meant to be able to add relationships with links, as shown below in relationships, is there a way to do this with this library that I'm missing? Thanks.
"data": [{
"type": "articles",
"id": "1",
"attributes": {
"title": "JSON API paints my bikeshed!"
},
"relationships": {
"author": {
"links": {
"self": "http://example.com/articles/1/relationships/author",
"related": "http://example.com/articles/1/author"
},
"data": { "type": "people", "id": "9" }
},
"comments": {
"links": {
"self": "http://example.com/articles/1/relationships/comments",
"related": "http://example.com/articles/1/comments"
},
"data": [
{ "type": "comments", "id": "5" },
{ "type": "comments", "id": "12" }
]
}
},
"links": {
"self": "http://example.com/articles/1"
}
}],

Looks like this is related to #84 sorry for the noise.


Update parallel-processing-expansion.md

update zh doc

@jiaj12 Thanks for the contribution. Please do read the https://kubernetes.io/zh/docs/contribute/localization_zh/

pls squash commits

@tengqm already squashed

/approve

/lgtm


test(gui-client): fix missed mutations

I added unit tests for these pure or mostly-pure functions that cargo-mutants said were not covered.
It also picked up a lot of I/O-performing functions that I ignored for now. (They're hard to test)

Not super important - Just marking ready for review to clear out my backlog of PRs.


[bug] dialog function will be triggered twice when in a global shortcut callback function

Describe the bug
hey, I use tauri2 and vue3 to create a app, I wanna register a global shortcut, when the keys are pressed, a message box will be show, but the message box show twice. the code is as bellow.
`async function initApp() {
const app = createApp(App)
app.use(naive)
app.use(createPinia())
app.use(router)
app.mount('#app')
const registered = await isRegistered('ctrl+shift+y')
if (!registered) {
    register('ctrl+shift+y', async ()=>{
        console.log("Shortcut triggered")
        router.push('/about')
        await message("short key pressed", "Message")
    })
}

}
initApp()
`
Reproduction
No response
Expected behavior
the shortcut callback function should execute once.
Full tauri info output
[✔] Environment
    - OS: Windows 10.0.22631 x86_64 (X64)
    ✔ WebView2: 129.0.2792.89
    ✔ MSVC: Visual Studio 生成工具 2022
    ✔ rustc: 1.81.0 (eeb90cda1 2024-09-04)
    ✔ cargo: 1.81.0 (2dbb1af80 2024-08-20)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-x86_64-pc-windows-msvc (default)
    - node: 20.15.1
    - pnpm: 9.12.1
    - npm: 10.7.0

[-] Packages
    - tauri 🦀: 2.0.2
    - tauri-build 🦀: 2.0.1
    - wry 🦀: 0.44.1
    - tao 🦀: 0.30.3
    - @tauri-apps/api : 2.0.2
    - @tauri-apps/cli : 2.0.2 (outdated, latest: 2.0.3)

[-] Plugins
    - tauri-plugin-global-shortcut 🦀: 2.0.1
    - @tauri-apps/plugin-global-shortcut : 2.0.0
    - tauri-plugin-fs 🦀: 2.0.1
    - @tauri-apps/plugin-fs : 2.0.0
    - tauri-plugin-shell 🦀: 2.0.1
    - @tauri-apps/plugin-shell : 2.0.0
    - tauri-plugin-os 🦀: 2.0.1
    - @tauri-apps/plugin-os : 2.0.0
    - tauri-plugin-store 🦀: 2.0.1
    - @tauri-apps/plugin-store : 2.0.0
    - tauri-plugin-notification 🦀: 2.0.1
    - @tauri-apps/plugin-notification : 2.0.0
    - tauri-plugin-dialog 🦀: 2.0.1
    - @tauri-apps/plugin-dialog : 2.0.0

[-] App
    - build-type: bundle
    - CSP: unset
    - frontendDist: ../dist
    - devUrl: http://localhost:1420/
    - framework: Vue.js
    - bundler: Vite

Stack trace
No response
Additional context
No response

This is because the handler for a shortcut is triggered once for pressing, and another time for releasing the shortcut, you need to check the event passed to the handler:
await register('CommandOrControl+Shift+C', (event) => {
  if (event.state === 'Pressed') {
    console.log('Shortcut triggered')
  }
})

This is because the handler for a shortcut is triggered once for pressing, and another time for releasing the shortcut, you need to check the event passed to the handler:
await register('CommandOrControl+Shift+C', (event) => {
  if (event.state === 'Pressed') {
    console.log('Shortcut triggered')
  }
})

It works, thank you very much 👍


Create Command Manager Slice

Create the command manager slice according to #38 .
Add basic structure for directories and files and methods signatures.
Acceptance criteria
1 - Updated code


unable to run customized image

Description of the problem
I am trying to run a modified PostgreSQL (with customized executors and so on) inside an enclave. Hence, I pulled the ubuntu18.04 image from dockerhub, built the modified PostgreSQL inside the ubuntu docker, and then docker commit the modified image.
After I have signed the modified image, it failed to load and get error code 6 when I hit docker run.
System information
My system configuration:
Ubuntu 18.04 with kernel 5.9.0
Docker version 20.10.16, build aa7e414
gramine built on branch v1.1
Steps to reproduce

I pulled the ubuntu18.04 image from dockerhub
built it inside the ubuntu docker and then docker committed the modified image.
Sign the image
I've modified my config.yaml file with

SGXDriver:
    Repository: "https://github.com/intel/linux-sgx-driver.git"
    Branch:     "sgx_driver_2.11"

Then I createad the gsc-signed image using:
./gsc build --insecure-args myImage test/generic.manifest
./gsc sign-image myImage  enclave-key.pem
./gsc info-image gsc-myImage

and I got output from gsc info-image as
mr_enclave = "2454c58cafad79b1ded05a276bef96ccff8b77dbca61071928da014e6183d4e9"
mr_signer = "5416a28ebb3a9ebd0bef05431b2c4ea9eccaec008d7691ef772fa12c2d045bec"
isv_prod_id = 0
isv_svn = 0
date = "2022-05-20"
flags = "0400000000000000"
xfrms = "0300000000000000"
misc_select = "00000000"
debug = false

Run the signed container

docker run --device=/dev/isgx \
   -v /var/run/aesmd/aesm.socket:/var/run/aesmd/aesm.socket \
   -it gsc-myImage

Expected results
enter the container successfully with everything protected by SGX
Actual results
++ find /gramine/meson_build_output/lib -type d -path '*/site-packages'
+ export PYTHONPATH=:/gramine/meson_build_output/lib/python3.6/site-packages
+ PYTHONPATH=:/gramine/meson_build_output/lib/python3.6/site-packages
++ find /gramine/meson_build_output/lib -type d -path '*/pkgconfig'
+ export PKG_CONFIG_PATH=:/gramine/meson_build_output/lib/x86_64-linux-gnu/pkgconfig
+ PKG_CONFIG_PATH=:/gramine/meson_build_output/lib/x86_64-linux-gnu/pkgconfig
+ '[' -z '' ']'
+ gramine-sgx-get-token --sig /entrypoint.sig --output /entrypoint.token
Attributes:
    mr_enclave:  2454c58cafad79b1ded05a276bef96ccff8b77dbca61071928da014e6183d4e9
    mr_signer:   5416a28ebb3a9ebd0bef05431b2c4ea9eccaec008d7691ef772fa12c2d045bec
    isv_prod_id: 0
    isv_svn:     0
    attr.flags:<PHONE_NUMBER>000004
    attr.xfrm:<PHONE_NUMBER>000007
    mask.flags:  ffffffffffffffff
    mask.xfrm:   fffffffffff9ff1b
    misc_select: 00000000
    misc_mask:   ffffffff
    modulus:     63b8dd6ab325beb315c5828b811f983e...
    exponent:    3
    signature:   f4459c545e01a11c46f7f4a7c50b8dd0...
    date:        2022-05-20
Traceback (most recent call last):
  File "/gramine/meson_build_output/bin/gramine-sgx-get-token", line 20, in <module>
    main() # pylint: disable=no-value-for-parameter
  File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/gramine/meson_build_output/bin/gramine-sgx-get-token", line 16, in main
    token = get_token(sig, verbose=verbose)
  File "/gramine/meson_build_output/lib/python3.6/site-packages/graminelibos/sgx_get_token.py", line 151, in get_token
    token = connect_aesmd(sig['enclave_hash'], sig['modulus'], sig['attribute_flags'], xfrms)
  File "/gramine/meson_build_output/lib/python3.6/site-packages/graminelibos/sgx_get_token.py", line 88, in connect_aesmd
    raise Exception(f'Failed. (Error Code = {ret_msg.ret.error})')
Exception: Failed. (Error Code = 6)

Please check if discussions in these similar issues help you:

https://github.com/gramineproject/examples/issues/22
https://github.com/gramineproject/gsc/issues/42

I've added -d flag during ./gsc build, now when I docker run the debug docker, I get
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/usr/local/sbin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/usr/local/bin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/usr/sbin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/usr/bin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/sbin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(AT_FDCWD, "/bin/", 0xca798940, 0) = 0x0
[P1:T1:bash] trace: ---- shim_newfstatat(2, "", 0xca798310, 4096) = 0x0
[P1:T1:bash] trace: ---- shim_ioctl(2, TCGETS, 0xca798280) ...
[P1:T1:bash] trace: ---- return from shim_ioctl(...) = -38
[P1:T1:bash] trace: ---- shim_write(2, 0xcc53b530, 0x22) ...
bash: : No such file or directory
[P1:T1:bash] trace: ---- return from shim_write(...) = 0x22
[P1:T1:bash] debug: ---- shim_exit_group (returning 127)
[P1:T1:bash] debug: clearing POSIX locks for pid 1
[P1:T1:bash] debug: sync client shutdown: closing handles
[P1:T1:bash] debug: sync client shutdown: waiting for confirmation
[P1:T1:bash] debug: sync client shutdown: finished
[P1:shim] debug: IPC worker: exiting worker thread
[P1:T1:bash] debug: process 1 exited with status 127
debug: DkProcessExit: Returning exit code 127

Well, something tries to open the "" (empty) path, which obviously fails. Looks like you have some bash script in your Postgres workload? Are you sure the bash script is written correctly?
Anyway, the AESM error seems to be resolved.

Yeah... Tks for your help.
Just one little question: can gsc run in an interactive manner?

Tks a lot for your timely response!!!!

I'm not sure what you mean by "interactive manner", but after you created a "graminized" Docker image (the one with the gsc- prefix), you can do whatever you want with this Docker image. Including running a corresponding Docker container interactively. See Step 8 in https://gramine.readthedocs.io/projects/gsc/en/latest/#example.

Sorry to reopen this issue again. Something weird happened.
I tried to add -it --entrypoint /bin/bash in docker run, and then I performed several experiments to measure the additional overhead caused by GSC. However, I observed that there was nearly no performance drop compared to experiments ran outside of GSC (i.e. without protection from sgx). Intuitively, as the entire PostgreSQL is ran inside the enclave, there must be some noticeable performance drop but sadly I failed to find any.
I think those experiments are not performed inside the enclave so I'm wondering whether there's something wrong with my setup.
To help you understand this better, here's my entire workflow:

Pull a ubuntu image from the docker hub, run the image and build my customized PostgreSQL inside.
docker commit the modified image
Use GSC to build & sign the image with the generic manifest.

loader.pal_internal_mem_size = "128M"

sgx.enclave_size = "4G"
sgx.thread_num = 8

sgx.trusted_files = [
  "file:/entrypoint.manifest",  # unused entry, only to test merging of manifests
]

run the image with

docker run --device=/dev/isgx \
   -v /var/run/aesmd/aesm.socket:/var/run/aesmd/aesm.socket \
   -it --entrypoint /bin/bash gsc-myImage

Use the command-line interface to issue SQL queries for PostgreSQL to run.

Could you please kindly point out the problem?

tried to add -it --entrypoint /bin/bash in docker run, and then I performed several experiments to measure the additional overhead caused by GSC.

So at this point you enter the "graminized" Docker container based on the image gsc-myImage.
Then you run your experiments.  (I have a suspicion that you run native applications instead of gramine-sgx <your app>).

You are right... I did run those native applications instead of graminized ones.
However, there're many command-line applications related to PostgreSQL (pg_ctl, initdb, psql, createdb, etc.). So shall I write manifest files for them separately or shall I just use a docker file for all the experiments and then use gsc to sign it?

However, there're many command-line applications related to PostgreSQL (pg_ctl, initdb, psql, createdb, etc.).

Ideally, you would write manifest files for each one of them -- well, only for those that need to run inside the SGX enclaves. But this would also mean that GSC doesn't suit your purpose -- GSC is not tailored to run several applications in the same Docker image. GSC wraps only one application in the Docker image.
However, many users of GSC do a trick: they write a Bash/Python script that chooses which application to invoke, based on the command line argument or environment variable. Then this Bash/Python script is marked as the ENTRYPOINT in the Docker image. Thus, GSC wraps this Bash/Python script and all the applications that this script invokes.
I suggest you to use this trick.

Thanks for your reply. Just a silly question: suppose I put those native commands in the bash script, mark it as the entrypoint inside dockerfile, build & sign the image, run the "graminized" container, and then all native commands are running inside an enclave right?
Do please correct me if I am wrong.

Yes, you are absolutely right.
Think of it this way: Gramine just needs an "entry" program as a hint. Then Gramine starts this entry program inside the SGX enclave, and all child programs that this entry program spawns are also automatically started by Gramine inside SGX enclaves.
If it helps, make an analogy with Docker containers: Docker runtime just needs an ENTRYPOINT in the Docker image -- this entrypoint is a hint from program to run inside the Docker container, and all child programs that this entrypoint program spawns are also running in the same Docker container. Same with Gramine.

Tks a lot. I am now trying to run all those experiments in a bash script and mark it as the entry point of my image. This bash script consists of several parts in this order:

initdb -d db_directory to initialize a folder for database cluster
pg_ctl -D db_directory start to start a database server, which will invoke serveral processes for server backend
createdb db_name to create a new database instance
several psql dbname -f xxx.sql commands to load data and run experiment

However, when I run the docker, all psql dbname -f xxx.sql commands failed to connect to the server initialized by the previous command. Normally it's caused by an uninitialized server or improper socket settings. But in GSC, I am not able to determine which one caused this problem. Based on the output in terminal, initdb, pg_ctl, createdb get exit code 1 and psql commands get exit code 2. Could you please tell me the meaning of those exit codes? Also, is there any restriction from GSC on socket communication within the docker?

Could you please tell me the meaning of those exit codes?

These are the exit codes reported by these PostgreSQL commands. These exit codes have nothing to do with Gramine (at least I think so). Please enable debug info, to get more logs from Gramine (for this, rebuild your Docker image with ./gsc build --debug ...) and analyze these logs.

Also, is there any restriction from GSC on socket communication within the docker?

No, GSC poses no restrictions on socket communication.

As I got many warning: shim_socket: unknown socket domain 16 during execution.

16 is the AF_NETLINK type of sockets. These kinds of sockets are not implemented in Gramine. I'm unsure if PostgreSQL really wants to use NETLINK sockets, or PostgreSQL just probes them and falls back to other sockets when NETLINK is not found.
Could you please take a deeper look at the debug logs of Gramine? Analyzing them may give you a better understanding of what exactly is failing. Also, do Postgres programs themselves print any information?

As those commands are required to be issued be non-root user, they are wrapped by su - postgres -c .

You meant "to be issues by non-root user"? For this, we have the special manifest options: https://gramine.readthedocs.io/en/latest/manifest-syntax.html#user-id-and-group-id. By default, Gramine uses uid = gid = 0, so the application inside Gramine thinks it is a root. You can change this behavior by changing these manifest options. But also looks like you changes Postgres behavior by an explicit Postgres command-line switch -c, so maybe this is not needed.

warning: Disallowing access to file '/lib/x86_64-linux-gnu/security/pam_xxxx.so'; file is not trusted or allowed. where xxxx can be umask, limits, mail, etc.

This looks very serious. For some reason, GSC didn't mark these files as trusted. I don't know why -- are you installing some packages after GSC generated the final graminized Docker image? Why would GSC not include these files as trusted? It's surprising to me.
Anyway, you can mark these files as sgx.trusted_files = ["/lib/x86_64-linux-gnu/security/"] in your manifest file. Then GSC/Gramine will surely mark them as trusted.

warning: DkVirtualMemoryProtect is unimplemented in Linux-SGX PAL

You can ignore this. It is harmless.

warning: Disallowing access to file '/var/log/btmp'; file is not trusted or allowed. But I've included /var/log in my dockerfile VOLUME configuration and I think it should be included in trusted files.

You also need to include it in your manifest file. The easiest is to add sgx.allowed_files = ["/var/log/"].

The System error is not an error from Gramine. This is something from Postgres, I guess.


is it possible to make user top bar taller to fit a bigger logo?

Hi i would like to make the top bar menu taller to fit a larger Logo  and larger font to navigate easier, is it possible?   Thanks

Hi !
I think you may have got it wrong (or maybe it's me).
Don't make a Pull Request to ask question. This is when you want to suggest modification of our code base.
For help, make a "issue".
Thanks

i got it wrong, i'm sorry, thanks for your advise
ในวันที่ พฤ. 29 พ.ย. 2018 เวลา 19:44 Polyna-Maude R.-Summerside <
<EMAIL_ADDRESS>เขียนว่า:

Hi !
I think you may have got it wrong (or maybe it's me).
Don't make a Pull Request to ask question. This is when you want to
suggest modification of our code base.
For help, make a "issue".
Thanks
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pH7Software/pH7-Social-Dating-CMS/pull/378#issuecomment-442820629,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ASpeaUZyMiUTagM9F7q0xHFKR5W7Sb0_ks5uz9bKgaJpZM4Y5k7e
.

Thanks for your help @polynamaude! :) Really appreciate it.
I will close this invalid PR by now.
Cheers,
Pierre

Hi @pH-7
He opened an issue. I answered my best but didn't had time to find the exact place for the top bar size in the templates.


build(deps-dev): bump esbuild from 0.17.15 to 0.17.18

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
172

Relevant Lines:
172

💛  - Coveralls


Fix HELO/rDNS issue while using multiple outbound ip #1114

new option mx.bind_helo

Ok - looks good.   Can you update the documentation to reflect the new variables.


Update dependencies with security fixes

Proposed Changes

Update dependencies with security fixes (setuptools<69.0.0)
Unpin pipenv in dockerfiles
update devcontainer images to the latest version
minor fix in tests
Pin pipenv in dockerfile
use unprivileged user in prod images
Combine scripts and fix script running even when a command exited with status code 1

Merge Checklist

[ ] Tests added/fixed
[ ] Update docs in /docs
[ ] Linting Complete
[ ] Any other necessary step

Only PR's with test cases included and passing lint and test pipelines will be reviewed
@ohcnetwork/care-backend-maintainers @ohcnetwork/care-backend-admins

Summary by CodeRabbit
Release Notes

New Features

Updated Docker image to a newer Python version for enhanced performance.
Added port 4566 to the list of forwarded ports for better service accessibility.
Introduced new scripts for checking database and Redis server availability before executing operations.

Bug Fixes

Improved password reset test scenarios to ensure accurate email validation and configuration handling.

Chores

Upgraded various package versions for improved functionality and security.
Streamlined Dockerfile configurations for better organization and efficiency.
Updated pre-commit hook configurations for improved execution.

@coderabbitai summary


Fix type-checking booleans

Fixes #4342
The fix is inherited through the https://github.com/pulumi/pulumi-terraform-bridge/commit/e4682154f1735880a1376774ccb593b4523410fe commit
This change bypasses our normal process of waiting for the next pulumi-terraform-bridge release to accelerate landing the fix. The changes between 3.89.0 and e4682154f1735880a1376774ccb593b4523410fe appear to be low-risk:

https://github.com/pulumi/pulumi-terraform-bridge/pull/2306
https://github.com/pulumi/pulumi-terraform-bridge/pull/2292

/release patch


General fixes to stability.

I haven't explored the performance implications much, but is there a way to batch add children?
Not yet, but I think we can add this. 👍


Lockable

Need to add a lockout feature after a configurable number of attempts to login to a user account.
Reference: http://rubydoc.info/github/plataformatec/devise/master/Devise/Models/Lockable

This is available for careful testing in the features/lockable_and_plug branch.