Errors and Failures in 'make test'

Dear researchers,
When I tried to set up, everything from 52 to the end of 'make test' either had error or failed.
I am new to this. I tried to follow instructions in 'Setup', my computer reported 'no command python3.7' so I used 'conda create'. The 'pip install -e .' for train and test was successful.
Could you please help me with this issue?

Here is the message:
[gw31] [ 52%] ERROR smarts/env/tests/test_hiway_env.py::test_hiway_env
[gw11] [ 53%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios0-agent_and_agent_type0]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios0-agent_and_agent_type1]
[gw7] [ 54%] ERROR smarts/core/tests/test_boids.py::test_boids
[gw16] [ 55%] ERROR smarts/core/tests/test_observations.py::test_observations
[gw0] [ 56%] FAILED envision/tests/test_data_replay.py::test_data_replay
[gw1] [ 57%] ERROR smarts/contrib/malib/tests/test_malib_env.py::test_malib_env
[gw2] [ 58%] ERROR smarts/contrib/pymarl/tests/test_pymarl_env.py::test_pymarl_env
[gw27] [ 60%] ERROR smarts/core/tests/test_trap_manager.py::test_capture_vehicle
smarts/core/tests/test_trap_manager.py::test_emit_on_default
[gw32] [ 61%] FAILED smarts/env/tests/test_shutdown.py::test_graceful_shutdown
smarts/env/tests/test_shutdown.py::test_graceful_interrupt
[gw22] [ 62%] ERROR smarts/core/tests/test_smarts_reset.py::test_only_agents_reset_if_scenario_does_not_change
[gw30] [ 63%] FAILED smarts/env/tests/test_determinism.py::test_short_determinism
[gw8] [ 64%] ERROR smarts/core/tests/test_bubble_manager.py::test_bubble_manager_state_change
smarts/core/tests/test_bubble_manager.py::test_bubble_manager_limit[bubble0]
[gw36] [ 65%] FAILED tests/test_examples.py::test_examples[egoless]
tests/test_examples.py::test_examples[single_agent]
[gw33] [ 66%] ERROR smarts/env/tests/test_social_agent.py::test_social_agents
[gw9] [ 67%] ERROR smarts/core/tests/test_bubble_hijacking.py::test_bubble_hijacking
[gw21] [ 68%] ERROR smarts/core/tests/test_smarts.py::test_smarts_doesnt_leak_tasks_after_reset
[gw23] [ 70%] ERROR smarts/core/tests/test_traffic_simulation.py::test_traffic_sim_with_multi_client
[gw10] [ 71%] ERROR smarts/core/tests/test_collision.py::test_sim_level_collision (pid=3193063) Error in atexit._run_exitfuncs:
(pid=3193063) Traceback (most recent call last):
(pid=3193063)   File "/home/zywang/anaconda3/envs/py37smarts/lib/python3.7/site-packages/direct/showbase/ShowBase.py", line 82, in exitfunc
(pid=3193063)     builtins.base.destroy()
(pid=3193063)   File "/home/zywang/SMARTS/smarts/core/smarts.py", line 456, in destroy
(pid=3193063)     self.teardown()
(pid=3193063)   File "/home/zywang/SMARTS/smarts/core/smarts.py", line 431, in teardown
(pid=3193063)     self._agent_manager.teardown()
(pid=3193063) AttributeError: 'SMARTS' object has no attribute '_agent_manager'
[gw34] [ 72%] FAILED smarts/env/tests/test_rllib_hiway_env.py::test_rllib_hiway_env
[gw11] [ 73%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios0-agent_and_agent_type1]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios0-agent_and_agent_type2]
[gw27] [ 74%] ERROR smarts/core/tests/test_trap_manager.py::test_emit_on_default
smarts/core/tests/test_trap_manager.py::test_no_recapture_agent
[gw32] [ 75%] FAILED smarts/env/tests/test_shutdown.py::test_graceful_interrupt
[gw8] [ 76%] ERROR smarts/core/tests/test_bubble_manager.py::test_bubble_manager_limit[bubble0]
smarts/core/tests/test_bubble_manager.py::test_vehicle_spawned_in_bubble_is_not_captured
[gw36] [ 77%] FAILED tests/test_examples.py::test_examples[single_agent]
tests/test_examples.py::test_examples[multi_agent]
[gw17] [ 78%] FAILED smarts/core/tests/test_notebook.py::test_notebook1
[gw11] [ 80%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios0-agent_and_agent_type2]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type0]
[gw27] [ 81%] ERROR smarts/core/tests/test_trap_manager.py::test_no_recapture_agent
[gw8] [ 82%] ERROR smarts/core/tests/test_bubble_manager.py::test_vehicle_spawned_in_bubble_is_not_captured
smarts/core/tests/test_bubble_manager.py::test_vehicle_spawned_outside_bubble_is_captured
[gw36] [ 83%] FAILED tests/test_examples.py::test_examples[multi_agent]
tests/test_examples.py::test_multi_instance_example
[gw11] [ 84%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type0]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type1]
[gw8] [ 85%] ERROR smarts/core/tests/test_bubble_manager.py::test_vehicle_spawned_outside_bubble_is_captured
[gw36] [ 86%] PASSED tests/test_examples.py::test_multi_instance_example
tests/test_examples.py::test_rllib_example
[gw11] [ 87%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type1]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type2]
[gw11] [ 88%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios1-agent_and_agent_type2]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type0]
[gw11] [ 90%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type0]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type1]
[gw11] [ 91%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type1]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type2]
[gw11] [ 92%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios2-agent_and_agent_type2]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type0]
[gw36] [ 93%] FAILED tests/test_examples.py::test_rllib_example
[gw11] [ 94%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type0]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type1]
[gw11] [ 95%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type1]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type2]
[gw11] [ 96%] ERROR smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios3-agent_and_agent_type2]
smarts/core/tests/test_controller_lane.py::test_lane_following_controller[scenarios4-agent_and_agent_type0]

@wang1351 Hello, thank you for reaching out.
What you have supplied here is not enough to get to the root of the problem however the log suggests that SMARTS failed to initialise:
(pid=3193063) Error in atexit._run_exitfuncs:
(pid=3193063) Traceback (most recent call last):
(pid=3193063) File "/home/zywang/anaconda3/envs/py37smarts/lib/python3.7/site-packages/direct/showbase/ShowBase.py", line 82, in exitfunc
(pid=3193063) builtins.base.destroy()
(pid=3193063) File "/home/zywang/SMARTS/smarts/core/smarts.py", line 456, in destroy
(pid=3193063) self.teardown()
(pid=3193063) File "/home/zywang/SMARTS/smarts/core/smarts.py", line 431, in teardown
(pid=3193063) self._agent_manager.teardown()
(pid=3193063) AttributeError: 'SMARTS' object has no attribute '_agent_manager'

Could you run pytest -vv smarts/env/tests/test_hiway_env.py?

@Gamenot Thank you for your reply! Should I start all over again or run this command in the current environment?

@wang1351 It looks make test is properly calling into python3.7. I assume that the other previous 51% of tests are working so I would suggest running it with your current environment.

@Gamenot
Thank you for your patience. I updated my pip again and try 'make test'. I noticed that there's an error message:
ERROR: Could not find a version that satisfies the requirement rl-agent==0.1.1
ERROR: No matching distribution found for rl-agent==0.1.1
I find the package should be 'rl-agents'. I'm not sure whether this is the cause.
Now only two lines of errer (instead of everything from 52%):
[gw31] [ 45%] FAILED smarts/env/tests/test_rllib_hiway_env.py::test_rllib_hiway_env
[gw36] [ 97%] FAILED tests/test_examples.py::test_rllib_example
Then I do 'pytest -v smarts/env/tests/test_hiway_env.py', here's the result, status is 'passed':
platform linux -- Python 3.7.0, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /home/zywang/SMARTS/.venv/bin/python3.7
cachedir: .pytest_cache
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/zywang/SMARTS
plugins: notebook-0.6.1, benchmark-3.2.3, xdist-2.2.1, cov-2.11.1, forked-1.3.0
collected 1 item
smarts/env/tests/test_hiway_env.py::test_hiway_env PASSED                                      [100%]
========================================== warnings summary
.venv/lib/python3.7/site-packages/scipy/fft/init.py:97
/home/zywang/SMARTS/.venv/lib/python3.7/site-packages/scipy/fft/init.py:97: DeprecationWarning: The module numpy.dual is deprecated.  Instead of using dual, use the functions directly from numpy or scipy.
from numpy.dual import register_func
.venv/lib/python3.7/site-packages/scipy/special/orthogonal.py:81
.venv/lib/python3.7/site-packages/scipy/special/orthogonal.py:81
/home/zywang/SMARTS/.venv/lib/python3.7/site-packages/scipy/special/orthogonal.py:81: DeprecationWarning: np.int is a deprecated alias for the builtin int. To silence this warning, use int by itself. Doing this will not modify any behavior and is safe. When replacing np.int, you may wish to use e.g. np.int64 or np.int32 to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
from numpy import (exp, inf, pi, sqrt, floor, sin, cos, around, int,
smarts/env/tests/test_hiway_env.py: 50 warnings
/home/zywang/SMARTS/.venv/lib/python3.7/site-packages/scipy/linalg/decomp_qr.py:20: DeprecationWarning: np.int is a deprecated alias for the builtin int. To silence this warning, use int by itself. Doing this will not modify any behavior and is safe. When replacing np.int, you may wish to use e.g. np.int64 or np.int32 to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
kwargs['lwork'] = ret[-2][0].real.astype(numpy.int)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================== 1 passed, 53 warnings in 25.33s

@Gamenot
Hi, I managed to pass all the 'make test', but the issue of 'rl-agent' remains.
Then I tried to run 'scl scenario build --clean scenarios/loop' and then 'supervisord', I got a new error:
ERROR:Client:Connection to Envision terminated with: 15
What could be the cause of the error?
Thanks a lot!

@wang1351 Hello I am happy to hear that you were able to get it working.

ERROR: Could not find a version that satisfies the requirement rl-agent==0.1.1
ERROR: No matching distribution found for rl-agent==0.1.1
I find the package should be 'rl-agents'. I'm not sure whether this is the cause.

rl-agent can be found at: zoo/rl-agent/rl_agent-0.1.1-py3-none-any.whl, however it is currently a neglected dependency that needs to be updated https://github.com/huawei-noah/SMARTS/issues/211. This is fine though since rl-agent is not a core dependency.

ERROR:Client:Connection to Envision terminated with: 15
This error is just the result of thread being cleaned up through timeout when the simulation is exiting. It is a handled error so it is not a problem but I have addressed it in https://github.com/huawei-noah/SMARTS/pull/643 .

@Gamenot Thank you very much!

Hello @Gamenot
I am also facing this error while running the make test command. When I ran this command: pytest -v smarts/env/tests/test_hiway_env.py. I got the following output:
E               FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/share/sumo/bin/sumo': '/usr/local/share/sumo/bin/sumo'
/usr/lib/python3.7/subprocess.py:1551: FileNotFoundError
----------------------------- Captured stdout call -----------------------------
╭────────────────────┬────────────────────┬────────────────────┬────────────────────┬────────────────────┬────────────────────┬────────────────────┬────────────────────╮
│            Episode │     Sim T / Wall T │        Total Steps │        Steps / Sec │       Scenario Map │    Scenario Routes │     Mission (Hash) │             Scores │
├────────────────────┼────────────────────┼────────────────────┼────────────────────┼────────────────────┼────────────────────┼────────────────────┼────────────────────┤
╰────────────────────┴────────────────────┴────────────────────┴────────────────────┴────────────────────┴────────────────────┴────────────────────┴────────────────────╯
=========================== short test summary info ============================
FAILED smarts/env/tests/test_hiway_env.py::test_hiway_env - FileNotFoundError...
============================== 1 failed in 4.72s ===============================
Also, my PC freezes at [40%] make always. I have tried a lot of times. can you please help me out in this?

@Dikshuy reopened

@Dikshuy Thank you for the question.

Hello @Gamenot
I am also facing this error while running the make test command. When I ran this command: pytest -v smarts/env/tests/test_hiway_env.py. I got the following output:
E FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/share/sumo/bin/sumo': '/usr/local/share/sumo/bin/sumo'
/usr/lib/python3.7/subprocess.py:1551: FileNotFoundError

This error comes from the $SUMO_HOME environment variable. Could you check to see if sumo is at /usr/local/share/sumo/? The contents should look like:

If the directory is not at that location it might also be at /usr/share/sumo/ and you will need to set it to that location.

Also, my PC freezes at [40%] make always. I have tried a lot of times. can you please help me out in this?

I will do what I can to help. I think to start this off I would suggest running both of these commands and looking at the log files they put out:
PYTHONHASHSEED=42 pytest -v \
		--cov=smarts \
		--forked \
		--dist=loadscope \
		-n `nproc --ignore 1` \
		./smarts/core \
		--ignore=./smarts/core/tests/test_smarts_memory_growth.py \
                > core_test.log

and
PYTHONHASHSEED=42 pytest -v \
		--cov=smarts \
		--forked \
		--dist=loadscope \
		-n `nproc --ignore 1` \
		 ./smarts/env \
		--ignore=./smarts/env/tests/test_benchmark.py \
		--ignore=./smarts/env/tests/test_learning.py \
                -k 'not test_long_determinism' \
                > env_test.log

my SUMO also lies in the same folders as yours. But isn't this location /usr/share/sumo/. I have set this as my environment variable in .bashrc using export SUMO_HOME=/usr/share/sumo. After rerunning the pytest -v smarts/env/tests/test_hiway_env.py, I again got the same error:  FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/share/sumo/bin/sumo': '/usr/local/share/sumo/bin/sumo'

While trying make test again, I still got few errors. I have attached some snapshots of them.

I interrupted the run in between, so at the end, I got sth like this:

@Dikshuy Sorry I was not able to get to your response yesterday, it is hard to tell what the problem is without a stack trace could you run:
PYTHONHASHSEED=42 pytest -v smarts/core/tests/test_bubble_hijacking.py
The stack trace from that test should give me enough information.

`============================= test session starts ==============================
platform linux -- Python 3.7.10, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /home/dikshant/github/SMARTS/.venv/bin/python3.7
cachedir: .pytest_cache
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/dikshant/github/SMARTS
plugins: benchmark-3.2.3, notebook-0.6.1, cov-2.11.1, forked-1.3.0, xdist-2.2.1
collected 1 item
smarts/core/tests/test_bubble_hijacking.py::test_bubble_hijacking PASSED [100%]
============================== 1 passed in 50.98s ==============================`
here's what I got after running this

@Dikshuy Hi sorry, I thought that would have crashed I think it would be best to check the earliest failing test:
PYTHONHASHSEED=42 pytest -v smarts/core/tests/test_bubble_manager.py

@Gamenot
the first test succeeded. but in the second test, it throws this error, and then it stopped.
3003 -> wrong number of parameters: 75 != 76

@Dikshuy Hi I would suggest not worrying so much about passing make test, test_rllib_example and test_rllib_hiway_env tend to use up a lot of cpus so there is the possibility that they will time out when running make test.
If you are intending to do training I could suggest providing the error logs from:
scl scenario build scenarios/loop --clean
PYTHONHASHSEED=42 pytest -v ./tests/test_examples.py::test_rllib_example

If there is an error you will see somewhere in the console history something like:
Number of trials: 1/1 (1 ERROR)
+-------------------------------+----------+-------+
| Trial name                    | status   | loc   |
|-------------------------------+----------+-------|
| PPO_RLlibHiWayEnv_77287_00000 | ERROR    |       |
+-------------------------------+----------+-------+
Number of errored trials: 1
+-------------------------------+--------------+----------------------------------------------------------------------------------------------------------------------------+
| Trial name                    |   # failures | error file                                                                                |
|-------------------------------+--------------+----------------------------------------------------------------------------------------------------------------------------|
| PPO_RLlibHiWayEnv_77287_00000 |            1 | /home/dev/.smarts/smarts_rllib_smoke_test/RLlibHiWayEnv test/PPO_RLlibHiWayEnv_77287_00000_0_2021-03-13_15-19-51/error.txt |
+-------------------------------+--------------+----------------------------------------------------------------------------------------------------------------------------+

------------------------------------------------------------------------ Captured stderr call -------------------------------------------------------------------------

If it crashes you will want to look at that error.txt file.

@Gamenot Hi, sorry to reopen this again. I tried to install latest version of SMARTS and got stuck at 'make test' again.
The error is
(pid=3840539)   File "/home/zywang/smarts/lib/python3.7/site-packages/direct/showbase/ShowBase.py", line 82, in exitfunc
(pid=3840539)     builtins.base.destroy()
(pid=3840539)   File "/home/zywang/SMARTS/smarts/core/smarts.py", line 459, in destroy
(pid=3840539)     self.teardown()
(pid=3840539)   File "/home/zywang/SMARTS/smarts/core/smarts.py", line 431, in teardown
(pid=3840539)     if self._agent_manager is not None:
(pid=3840539) AttributeError: 'SMARTS' object has no attribute '_agent_manager'
is there any solution?
Thanks.

@Gamenot Hi, sorry to reopen this again. I tried to install latest version of SMARTS and got stuck at 'make test' again.
The error is
(pid=3840539) File "/home/zywang/smarts/lib/python3.7/site-packages/direct/showbase/ShowBase.py", line 82, in exitfunc
(pid=3840539) builtins.base.destroy()
(pid=3840539) File "/home/zywang/SMARTS/smarts/core/smarts.py", line 459, in destroy
(pid=3840539) self.teardown()
(pid=3840539) File "/home/zywang/SMARTS/smarts/core/smarts.py", line 431, in teardown
(pid=3840539) if self._agent_manager is not None:
(pid=3840539) AttributeError: 'SMARTS' object has no attribute '_agent_manager'
is there any solution?
Thanks.

@wang1351 Thank you for reaching out again, I tried to reproduce this bug but was unable to. I believe the way this bug would occur is if the SMARTS instance threw an exception earlier in instantiation and could have a large range of causes.
If you are not using RLlibHiWayEnv I could suggest ignoring this failure. Otherwise, please run pytest -vv tests/test_examples.py::test_rllib_example > rllib_example_log.txt and, if the test fails, supply the output log.

@Gamenot
The pytest did not return anything. I can't pass the make test. I will contact you again when I restart to set up SMARTS. Thanks.

@mansur007 Thank you for the question. We have found that those two tests are failing for SMARTS v0.4.15 in part due to not locking down the dependencies. It is not a problem if those two tests fail.
The next version of SMARTS will be removing the instructions to run make test.

thank you for your prompt reply, I pulled the newest version and ran make sanity-test  and it passes all 8 tests


[PE-D][Tester A] Person address field may be unnecessary

For the add p command, the user may be confused at how knowing your recruiter's address is helpful in the context of applying for internships, so you might want to elaborate on why these fields are present in the UG, or omit it from Person.

Labels: severity.Low type.FeatureFlaw
original: J-hta-n/ped#3

Check if we can change address to description


tutanota: Update autoupdate

Relates to #9577
...my fault

[x] I have read the Contributing Guide.

oh wow, my bad. I did not know they had checksums in their repository.


Colab import pyepo error

I attempted to run the jupyter-notebook example using Colab, but encountered an error during import pyepo. Could you please advise on how to resolve this issue?
Thank you in advance!
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
[<ipython-input-16-9aebf8cb754e>](https://localhost:8080/#) in <cell line: 3>()
      1 import time
      2 import random
----> 3 import pyepo
      4 import torch
      5 from torch import nn

6 frames
[/usr/local/lib/python3.10/dist-packages/pyomo/common/dependencies.py](https://localhost:8080/#) in find_spec(self, fullname, path, target)
    525         # the module is coming from: file system, registry, etc.)
    526         for finder in sys.meta_path[sys.meta_path.index(self) + 1 :]:
--> 527             spec = finder.find_spec(fullname, path, target)
    528             if spec is not None:
    529                 break

AttributeError: '_PyDrive2ImportHook' object has no attribute 'find_spec'

We’re aware that this issue stems from environmental hooks in Colab. While this is not directly a pyepo bug, we’ll consider doing something to help users who run into this. We will also keep an eye on changes to pyomo or PyDrive2 that might address the underlying incompatibility.
The error seems to be caused by a compatibility conflict between pyomo (a dependency of pyepo) and the PyDrive2 import hook in the Google Colab environment.
Google Colab sets up some custom import hooks such as (_PyDrive2ImportHook) to integrate with Google Drive. Still, this hook does not implement find_spec as expected by Python’s newer import machinery, which pyomo relies on.
You can temporarily remove the problematic hook with:
import sys
sys.meta_path = [hook for hook in sys.meta_path if not any(keyword in str(hook) for keyword in ["google.colab"])]

Thank you for your patience, and please let us know if you have any further difficulties.


Resolve upgradle issues

Update osgi plugin to 0.0.6, which is Gradle 7 compatible.
Rename runtimeOnly to runtimeElements.
Set duplicateStrategy to WARN.

Merged. Thanks!


Finished generic pileup module

Coverage decreased (-5.8%) to 71.934% when pulling 41869e5b403e67ab81a8641dcbcc811d6ca9970a on akmorrow13:mango-viz-pileup-rebased into f6ec8c20ab537d31ab9e036a3151c59455e5404d on bigdatagenomics:master.

Coverage decreased (-5.8%) to 71.934% when pulling 41869e5b403e67ab81a8641dcbcc811d6ca9970a on akmorrow13:mango-viz-pileup-rebased into f6ec8c20ab537d31ab9e036a3151c59455e5404d on bigdatagenomics:master.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/706/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/707/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/708/
Test PASSed.

Jenkins, retest this please.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/719/
Test PASSed.


Breaking Issues: Various Actor Error Messages

Breaking Issues
I should highlight that these are breaking issues:
Adversary OCTANE PANDA missing field first_activity_date.
The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias
WARNING  processor/thread_3   Adversary DEMON SPIDER missing field first_activity_date.
 WARNING  processor/thread_3   Adversary DEMON SPIDER missing field last_activity_date.

[2023-04-04 21:22:32,016] WARNING  processor/thread_3   Could not add or tag event ADV-203346 DEMON SPIDER (eCrime). Will retry in 0.3 seconds.
day is out of range for month: 0

[2023-04-04 21:22:32,425] WARNING  pymisp/thread_10     The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias

python3 misp_import.py --fullmonty -d -v
[2023-04-04 21:22:25,471] INFO     misp_tools
[2023-04-04 21:22:25,471] INFO     misp_tools    '##::::'##:'####::'######::'########:::::'########::'#######:::'#######::'##::::::::'######::
[2023-04-04 21:22:25,472] INFO     misp_tools     ###::'###:. ##::'##... ##: ##.... ##::::... ##..::'##.... ##:'##.... ##: ##:::::::'##... ##:
[2023-04-04 21:22:25,472] INFO     misp_tools     ####'####:: ##:: ##:::..:: ##:::: ##::::::: ##:::: ##:::: ##: ##:::: ##: ##::::::: ##:::..::
[2023-04-04 21:22:25,472] INFO     misp_tools     ## ### ##:: ##::. ######:: ########:::::::: ##:::: ##:::: ##: ##:::: ##: ##:::::::. ######::
[2023-04-04 21:22:25,472] INFO     misp_tools     ##. #: ##:: ##:::..... ##: ##.....::::::::: ##:::: ##:::: ##: ##:::: ##: ##::::::::..... ##:
[2023-04-04 21:22:25,472] INFO     misp_tools     ##:.:: ##:: ##::'##::: ##: ##:::::::::::::: ##:::: ##:::: ##: ##:::: ##: ##:::::::'##::: ##:
[2023-04-04 21:22:25,472] INFO     misp_tools     ##:::: ##:'####:. ######:: ##:::::::::::::: ##::::. #######::. #######:: ########:. ######::
[2023-04-04 21:22:25,472] INFO     misp_tools    ..:::::..::....:::......:::..:::::::::::::::..::::::.......::::.......:::........:::......:::
[2023-04-04 21:22:25,472] INFO     misp_tools               _____
[2023-04-04 21:22:25,472] INFO     misp_tools                /  '
[2023-04-04 21:22:25,472] INFO     misp_tools             ,-/-,__ __
[2023-04-04 21:22:25,472] INFO     misp_tools            (/  ()/ (_
[2023-04-04 21:22:25,472] INFO     misp_tools                         _______                        __ _______ __        __ __
[2023-04-04 21:22:25,472] INFO     misp_tools                        |   _   .----.-----.--.--.--.--|  |   _   |  |.----||  |--.-----.
[2023-04-04 21:22:25,472] INFO     misp_tools                        |.  1|   |  _  |  |  |  |  _  |   1__|   |   |  |    <|  -|
[2023-04-04 21:22:25,472] INFO     misp_tools                        |.  ||| ||||___   ||| |||||
[2023-04-04 21:22:25,472] INFO     misp_tools                        |:  1   |                         |:  1   |
[2023-04-04 21:22:25,472] INFO     misp_tools                        |::.. . |                         |::.. . |  Threat Intelligence v0.6.8
[2023-04-04 21:22:25,472] INFO     misp_tools                        -------'                         -------'
[2023-04-04 21:22:25,472] INFO     misp_tools
[2023-04-04 21:22:25,472] INFO     config
[2023-04-04 21:22:25,472] INFO     config  _______ _     _ _______ _______ _     _      _______  _____  __   _ _______ _____  ______
[2023-04-04 21:22:25,472] INFO     config  |       || |__ |       |/       |       |     | | \  | |__   |   |  ____
[2023-04-04 21:22:25,472] INFO     config  |_____  |     | |______ |_____  |    _      |_____  || |  _| |       | ||
[2023-04-04 21:22:25,472] INFO     config
[2023-04-04 21:22:25,473] DEBUG    config  client_id                                   value redacted, check config file
[2023-04-04 21:22:25,473] DEBUG    config  client_secret                               value redacted, check config file
[2023-04-04 21:22:25,473] DEBUG    config  crowdstrike_url                             US1
[2023-04-04 21:22:25,473] DEBUG    config  api_request_max                             5000
[2023-04-04 21:22:25,473] DEBUG    config  api_enable_ssl                              True
[2023-04-04 21:22:25,473] DEBUG    config  reports_timestamp_filename                  lastReportsUpdate.dat
[2023-04-04 21:22:25,473] DEBUG    config  indicators_timestamp_filename               lastIndicatorsUpdate.dat
[2023-04-04 21:22:25,473] DEBUG    config  actors_timestamp_filename                   lastActorsUpdate.dat
[2023-04-04 21:22:25,473] DEBUG    config  init_reports_days_before                    365
[2023-04-04 21:22:25,473] DEBUG    config  init_indicators_minutes_before              20220
[2023-04-04 21:22:25,473] DEBUG    config  init_actors_days_before                     730
[2023-04-04 21:22:25,473] DEBUG    config  reports_unique_tag                          CrowdStrike: REPORT
[2023-04-04 21:22:25,473] DEBUG    config  indicators_unique_tag                       CrowdStrike: INDICATOR
[2023-04-04 21:22:25,473] DEBUG    config  actors_unique_tag                           CrowdStrike: ADVERSARY
[2023-04-04 21:22:25,474] DEBUG    config  reports_tags                                att:source="Crowdstrike.Report"
[2023-04-04 21:22:25,474] DEBUG    config  indicators_tags                             att:source="Crowdstrike.Indicators"
[2023-04-04 21:22:25,474] DEBUG    config  actors_tags                                 att:source="Crowdstrike.Actors"
[2023-04-04 21:22:25,474] DEBUG    config  unknown_mapping                             CrowdStrike:indicator:galaxy: UNATTRIBUTED
[2023-04-04 21:22:25,474] DEBUG    config  unattributed_title                          Unattributed indicators:
[2023-04-04 21:22:25,474] DEBUG    config  indicator_type_title                        Indicator Type:
[2023-04-04 21:22:25,474] DEBUG    config  malware_family_title                        Malware Family:
[2023-04-04 21:22:25,474] DEBUG    config  log_duplicates_as_sightings                 True
[2023-04-04 21:22:25,474] DEBUG    config  misp_url                                    https://3samisp
[2023-04-04 21:22:25,474] DEBUG    config  misp_auth_key                               value redacted, check config file
[2023-04-04 21:22:25,474] DEBUG    config  crowdstrike_org_uuid                        ca4f4b5d-db04-4a5e-a6de-e60636dc01be
[2023-04-04 21:22:25,474] DEBUG    config  misp_enable_ssl                             False
[2023-04-04 21:22:25,474] WARNING  config  misp_enable_ssl                             SSL is disabled for MISP API requests
[2023-04-04 21:22:25,474] DEBUG    config  ind_attribute_batch_size                    2500
[2023-04-04 21:22:25,474] DEBUG    config  event_save_memory_refresh_interval          180
[2023-04-04 21:22:25,474] DEBUG    config  max_threads                                 16
[2023-04-04 21:22:25,474] DEBUG    config  miss_track_file                             no_galaxy_mapping.log
[2023-04-04 21:22:25,474] DEBUG    config  galaxies_map_file                           galaxy.ini
[2023-04-04 21:22:25,474] DEBUG    config  tag_unknown_galaxy_maps                     True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_kill-chain                        True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_information-security-data-source  True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_type                              True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_iep                               False
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_iep2                              True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_iep2_version                      False
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_tlp                               True
[2023-04-04 21:22:25,474] DEBUG    config  taxonomic_workflow                          True
[2023-04-04 21:22:26,401] INFO     config  No configuration errors found (1 warning)
[2023-04-04 21:22:26,401] INFO     config
[2023-04-04 21:22:26,401] INFO     config  ____ _  _ ____ ____ _  _ ____    ___  ____ ____ ____ ____ ___
[2023-04-04 21:22:26,401] INFO     config  |    || |_ |    |/  [__     |] || [__  [__  |__ |
[2023-04-04 21:22:26,401] INFO     config  |___ |  | |___ |___ | _ ]    |    |  | ] ] | |/
[2023-04-04 21:22:26,401] INFO     config
[2023-04-04 21:22:27,480] INFO     processor/main
[2023-04-04 21:22:27,480] INFO     processor/main       _____ _______  _____   _____   ______ _______
[2023-04-04 21:22:27,480] INFO     processor/main         |   |  |  | |] |     | |/    |
[2023-04-04 21:22:27,480] INFO     processor/main       | |  |  | |       |_| |    _    |
[2023-04-04 21:22:27,480] INFO     processor/main
[2023-04-04 21:22:27,480] INFO     processor/main
[2023-04-04 21:22:27,480] INFO     processor/main         ____  ___    __ __    ___  ____    _____  ____  ____   ____    ___  _____
[2023-04-04 21:22:27,480] INFO     processor/main        /    T|   \  |  T  |  /  _]|    \  / ___/ /    T|    \ l    j  /  ]/ /
[2023-04-04 21:22:27,480] INFO     processor/main       Y  o  ||    \ |  |  | /  [ |  D  )(   _ Y  o  ||  D  ) |  T  /  [(   _
[2023-04-04 21:22:27,480] INFO     processor/main       |     ||  D  Y|  |  |Y    ]|    /  _  T|     ||    /  |  | Y    ]_  T
[2023-04-04 21:22:27,480] INFO     processor/main       |  _  ||     |l  :  !|   [ |    \  /  \ ||  _  ||    \  |  | |   [ /  \ |
[2023-04-04 21:22:27,480] INFO     processor/main       |  |  ||     | \   / |     T|  .  Y \    ||  |  ||  .  Y j  l |     T\    |
[2023-04-04 21:22:27,480] INFO     processor/main       l__j__jl_____j  _/  l_____jl__j_j  ___jl__j__jl__j_j|____jl_____j ___j
[2023-04-04 21:22:27,480] INFO     processor/main
[2023-04-04 21:22:27,480] INFO     processor/main       Start importing CrowdStrike Adversaries as events into MISP (past 730 days).
[2023-04-04 21:22:27,480] INFO     processor/main       Retrieving all adversaries.
[2023-04-04 21:22:28,514] INFO     processor/main       Got 55 adversaries from the Crowdstrike Intel API.
[2023-04-04 21:22:29,832] WARNING  processor/thread_0   Adversary OCTANE PANDA missing field first_activity_date.
[2023-04-04 21:22:29,858] DEBUG    processor/thread_10  Created adversary event for SCATTERED SPIDER
[2023-04-04 21:22:29,862] DEBUG    processor/thread_7   Created adversary event for OUTBREAK SPIDER
[2023-04-04 21:22:29,863] DEBUG    processor/thread_11  Created adversary event for HOLIDAY SPIDER
[2023-04-04 21:22:29,865] DEBUG    processor/thread_1   Created adversary event for FERAL SPIDER
[2023-04-04 21:22:29,873] DEBUG    processor/thread_13  Created adversary event for SHINING SPIDER
[2023-04-04 21:22:29,874] DEBUG    processor/thread_8   Created adversary event for HIDDEN SPIDER
[2023-04-04 21:22:29,881] DEBUG    processor/thread_14  Created adversary event for CHRONO KITTEN
[2023-04-04 21:22:29,886] DEBUG    processor/thread_15  Created adversary event for HAYWIRE KITTEN
[2023-04-04 21:22:29,888] DEBUG    processor/thread_0   Created adversary event for OCTANE PANDA
[2023-04-04 21:22:29,890] DEBUG    processor/thread_2   Created adversary event for SPECTRAL KITTEN
[2023-04-04 21:22:29,891] DEBUG    processor/thread_3   Created adversary event for SHATTERED PANDA
[2023-04-04 21:22:29,893] DEBUG    processor/thread_9   Created adversary event for SLIPPY SPIDER
[2023-04-04 21:22:29,896] DEBUG    processor/thread_6   Created adversary event for COMPASS SPIDER
[2023-04-04 21:22:29,897] DEBUG    processor/thread_12  Created adversary event for SAMBA SPIDER
[2023-04-04 21:22:29,902] DEBUG    processor/thread_4   Created adversary event for CYBORG SPIDER
[2023-04-04 21:22:29,916] DEBUG    processor/thread_5   Created adversary event for ALCHEMIST SPIDER
[2023-04-04 21:22:30,445] DEBUG    processor/thread_10  Created adversary event for COSMIC WOLF
[2023-04-04 21:22:30,456] DEBUG    processor/thread_12  Created adversary event for PARTISAN JACKAL
[2023-04-04 21:22:30,476] DEBUG    processor/thread_11  Created adversary event for LILY SPIDER
[2023-04-04 21:22:30,489] DEBUG    processor/thread_1   Created adversary event for VAPOR PANDA
[2023-04-04 21:22:30,499] DEBUG    processor/thread_7   Created adversary event for EMBER BEAR
[2023-04-04 21:22:30,506] DEBUG    processor/thread_13  Created adversary event for CHARIOT SPIDER
[2023-04-04 21:22:30,526] DEBUG    processor/thread_8   Created adversary event for WANDERING SPIDER
[2023-04-04 21:22:30,766] DEBUG    processor/thread_6   Created adversary event for VICE SPIDER
[2023-04-04 21:22:30,869] DEBUG    processor/thread_9   Created adversary event for ALPHA SPIDER
[2023-04-04 21:22:30,879] DEBUG    processor/thread_5   Created adversary event for RECESS SPIDER
[2023-04-04 21:22:30,894] DEBUG    processor/thread_11  Created adversary event for HIVE SPIDER
[2023-04-04 21:22:30,920] DEBUG    processor/thread_4   Created adversary event for DEADEYE HAWK
[2023-04-04 21:22:31,122] DEBUG    processor/thread_15  Created adversary event for GALACTIC OCELOT
[2023-04-04 21:22:31,161] DEBUG    processor/thread_13  Created adversary event for VERTIGO PANDA
[2023-04-04 21:22:31,208] DEBUG    processor/thread_6   Created adversary event for BLIND SPIDER
[2023-04-04 21:22:31,222] WARNING  pymisp/thread_8      The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias
[2023-04-04 21:22:31,223] DEBUG    processor/thread_8   Created adversary event for VENGEFUL KITTEN
[2023-04-04 21:22:31,253] DEBUG    processor/thread_3   Created adversary event for CHAOTIC SPIDER
[2023-04-04 21:22:31,324] DEBUG    processor/thread_0   Created adversary event for AQUATIC PANDA
[2023-04-04 21:22:31,429] DEBUG    processor/thread_5   Created adversary event for BRAIN SPIDER
[2023-04-04 21:22:31,467] DEBUG    processor/thread_9   Created adversary event for AVIATOR SPIDER
[2023-04-04 21:22:31,535] DEBUG    processor/thread_11  Created adversary event for FRINGE LEOPARD
[2023-04-04 21:22:31,549] DEBUG    processor/thread_12  Created adversary event for HAZY TIGER
[2023-04-04 21:22:31,616] DEBUG    processor/thread_14  Created adversary event for MIRAGE TIGER
[2023-04-04 21:22:31,728] DEBUG    processor/thread_6   Created adversary event for VETO SPIDER
[2023-04-04 21:22:31,761] WARNING  processor/thread_3   Adversary DEMON SPIDER missing field first_activity_date.
[2023-04-04 21:22:31,761] WARNING  processor/thread_3   Adversary DEMON SPIDER missing field last_activity_date.
[2023-04-04 21:22:31,762] DEBUG    processor/thread_3   Created adversary event for DEMON SPIDER
[2023-04-04 21:22:31,856] DEBUG    processor/thread_5   Created adversary event for BANISHED KITTEN
[2023-04-04 21:22:31,994] DEBUG    processor/thread_2   Created adversary event for ROYAL SPIDER
[2023-04-04 21:22:32,011] DEBUG    processor/thread_9   Created adversary event for BITWISE SPIDER
[2023-04-04 21:22:32,016] WARNING  processor/thread_3   Could not add or tag event ADV-203346 DEMON SPIDER (eCrime). Will retry in 0.3 seconds.
day is out of range for month: 0
[2023-04-04 21:22:32,120] DEBUG    processor/thread_7   Created adversary event for GOSSAMER BEAR
[2023-04-04 21:22:32,152] DEBUG    processor/thread_6   Created adversary event for REGAL JACKAL
[2023-04-04 21:22:32,173] WARNING  processor/thread_1   Adversary INTREPID JACKAL missing field first_activity_date.
[2023-04-04 21:22:32,173] WARNING  processor/thread_1   Adversary INTREPID JACKAL missing field last_activity_date.
[2023-04-04 21:22:32,174] DEBUG    processor/thread_1   Created adversary event for INTREPID JACKAL
[2023-04-04 21:22:32,389] DEBUG    processor/thread_2   Created adversary event for OUTRIDER TIGER
[2023-04-04 21:22:32,417] WARNING  processor/thread_10  Adversary VAMPIRE SPIDER missing field last_activity_date.
[2023-04-04 21:22:32,425] WARNING  pymisp/thread_10     The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias
[2023-04-04 21:22:32,424] DEBUG    processor/thread_3   Created adversary event for NEMESIS KITTEN
[2023-04-04 21:22:32,426] DEBUG    processor/thread_10  Created adversary event for VAMPIRE SPIDER
[2023-04-04 21:22:32,431] DEBUG    processor/thread_4   Created adversary event for ETHEREAL PANDA
[2023-04-04 21:22:32,607] DEBUG    processor/thread_13  Created adversary event for QUANTUM SPIDER
[2023-04-04 21:22:32,657] DEBUG    processor/thread_8   Created adversary event for SUNRISE PANDA
[2023-04-04 21:22:32,693] DEBUG    processor/thread_9   Created adversary event for HERMIT SPIDER
[2023-04-04 21:22:32,867] DEBUG    processor/thread_10  Created adversary event for JACKPOT PANDA
[2023-04-04 21:22:33,724] WARNING  processor/thread_1   Could not add or tag event ADV-137920 INTREPID JACKAL (Hacktivist). Will retry in 0.3 seconds.
day is out of range for month: 0
[2023-04-04 21:22:34,424] INFO     processor/main       Completed import of 55 CrowdStrike adversaries into MISP.
[2023-04-04 21:22:34,424] INFO     processor/main       Finished importing CrowdStrike Adversaries as events into MISP.
[2023-04-04 21:22:34,425] INFO     processor/main       Completed import of adversaries into MISP in 6.95 seconds
[2023-04-04 21:22:34,426] INFO     processor/main
[2023-04-04 21:22:34,426] INFO     processor/main        ____     ___  ____    ___   ____  ______  _____
[2023-04-04 21:22:34,426] INFO     processor/main       |    \   /  _]|    \  /   \ |    |      T/ /
[2023-04-04 21:22:34,426] INFO     processor/main       |  D  ) /  [ |  o  )Y     Y|  D  )      (   _
[2023-04-04 21:22:34,426] INFO     processor/main       |    / Y    ]|   / |  O  ||    /l_j  l_j_  T
[2023-04-04 21:22:34,426] INFO     processor/main       |    \ |   [ |  |   |     ||    \  |  |  /  \ |
[2023-04-04 21:22:34,426] INFO     processor/main       |  .  Y|     T|  |   l     !|  .  Y |  |  \    |
[2023-04-04 21:22:34,426] INFO     processor/main       l__j_jl_____jl__j    _/ l__j_j l__j   ___j
[2023-04-04 21:22:34,426] INFO     processor/main
[2023-04-04 21:22:34,426] INFO     processor/main       Starting import of CrowdStrike Threat Intelligence reports as events (past 365 days).
[2023-04-04 21:22:34,426] INFO     processor/main       Retrieving all available report types.

python3 misp_import.py -f -nb -d -a
[2023-04-05 15:39:21,012] INFO     misp_tools    MISP Import for CrowdStrike Threat Intelligence v0.6.8
[2023-04-05 15:39:21,013] INFO     config  CHECK CONFIG
[2023-04-05 15:39:21,014] DEBUG    config  client_id                                   value redacted, check config file
[2023-04-05 15:39:21,014] DEBUG    config  client_secret                               value redacted, check config file
[2023-04-05 15:39:21,014] DEBUG    config  crowdstrike_url                             US1
[2023-04-05 15:39:21,014] DEBUG    config  api_request_max                             5000
[2023-04-05 15:39:21,014] DEBUG    config  api_enable_ssl                              True
[2023-04-05 15:39:21,014] DEBUG    config  reports_timestamp_filename                  lastReportsUpdate.dat
[2023-04-05 15:39:21,014] DEBUG    config  indicators_timestamp_filename               lastIndicatorsUpdate.dat
[2023-04-05 15:39:21,014] DEBUG    config  actors_timestamp_filename                   lastActorsUpdate.dat
[2023-04-05 15:39:21,014] DEBUG    config  init_reports_days_before                    365
[2023-04-05 15:39:21,014] DEBUG    config  init_indicators_minutes_before              20220
[2023-04-05 15:39:21,014] DEBUG    config  init_actors_days_before                     730
[2023-04-05 15:39:21,014] DEBUG    config  reports_unique_tag                          att:source="Crowdstrike.Report"
[2023-04-05 15:39:21,014] DEBUG    config  indicators_unique_tag                       att:source="Crowdstrike.Indicators"
[2023-04-05 15:39:21,014] DEBUG    config  actors_unique_tag                           att:source="Crowdstrike.Actors"
[2023-04-05 15:39:21,014] DEBUG    config  reports_tags                                att:source="Crowdstrike.Report"
[2023-04-05 15:39:21,014] DEBUG    config  indicators_tags                             att:source="Crowdstrike.Indicators"
[2023-04-05 15:39:21,014] DEBUG    config  actors_tags                                 att:source="Crowdstrike.Actors"
[2023-04-05 15:39:21,014] DEBUG    config  unknown_mapping                             CrowdStrike:indicator:galaxy: UNATTRIBUTED
[2023-04-05 15:39:21,014] DEBUG    config  unattributed_title                          CrowdStrike Unattributed indicators:
[2023-04-05 15:39:21,014] DEBUG    config  indicator_type_title                        Indicator Type:
[2023-04-05 15:39:21,014] DEBUG    config  malware_family_title                        Malware Family:
[2023-04-05 15:39:21,014] DEBUG    config  log_duplicates_as_sightings                 True
[2023-04-05 15:39:21,014] DEBUG    config  misp_url                                    https://3samisp
[2023-04-05 15:39:21,014] DEBUG    config  misp_auth_key                               value redacted, check config file
[2023-04-05 15:39:21,014] DEBUG    config  crowdstrike_org_uuid                        ca4f4b5d-db04-4a5e-a6de-e60636dc01be
[2023-04-05 15:39:21,014] DEBUG    config  misp_enable_ssl                             False
[2023-04-05 15:39:21,014] WARNING  config  misp_enable_ssl                             SSL is disabled for MISP API requests
[2023-04-05 15:39:21,014] DEBUG    config  ind_attribute_batch_size                    2500
[2023-04-05 15:39:21,014] DEBUG    config  event_save_memory_refresh_interval          180
[2023-04-05 15:39:21,014] DEBUG    config  max_threads                                 16
[2023-04-05 15:39:21,015] DEBUG    config  miss_track_file                             no_galaxy_mapping.log
[2023-04-05 15:39:21,015] DEBUG    config  galaxies_map_file                           galaxy.ini
[2023-04-05 15:39:21,015] DEBUG    config  tag_unknown_galaxy_maps                     True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_kill-chain                        True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_information-security-data-source  True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_type                              True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_iep                               False
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_iep2                              True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_iep2_version                      False
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_tlp                               True
[2023-04-05 15:39:21,015] DEBUG    config  taxonomic_workflow                          True
[2023-04-05 15:39:21,597] INFO     config  No configuration errors found (1 warning)
[2023-04-05 15:39:21,597] INFO     config
[2023-04-05 15:39:21,597] INFO     config  ____ _  _ ____ ____ _  _ ____    ___  ____ ____ ____ ____ ___
[2023-04-05 15:39:21,597] INFO     config  |    |__| |___ |    |_/  [__     |__] |__| [__  [__  |___ |  \
[2023-04-05 15:39:21,597] INFO     config  |___ |  | |___ |___ | \_ ___]    |    |  | ___] ___] |___ |__/
[2023-04-05 15:39:21,597] INFO     config
[2023-04-05 15:39:22,439] INFO     processor/main       BEGIN ADVERSARIES IMPORT
[2023-04-05 15:39:22,440] INFO     processor/main       Start importing CrowdStrike Adversaries as events into MISP (past 730 days).
[2023-04-05 15:39:22,440] INFO     processor/main       Retrieving all adversaries.
[2023-04-05 15:39:23,565] INFO     processor/main       Got 55 adversaries from the Crowdstrike Intel API.
[2023-04-05 15:39:25,734] WARNING  processor/thread_0   Adversary OCTANE PANDA missing field first_activity_date.
[2023-04-05 15:39:25,759] DEBUG    processor/thread_8   Created adversary event for HIDDEN SPIDER
[2023-04-05 15:39:25,762] DEBUG    processor/thread_7   Created adversary event for OUTBREAK SPIDER
[2023-04-05 15:39:25,766] DEBUG    processor/thread_10  Created adversary event for SCATTERED SPIDER
[2023-04-05 15:39:25,768] DEBUG    processor/thread_3   Created adversary event for SHATTERED PANDA
[2023-04-05 15:39:25,771] DEBUG    processor/thread_9   Created adversary event for SLIPPY SPIDER
[2023-04-05 15:39:25,772] DEBUG    processor/thread_0   Created adversary event for OCTANE PANDA
[2023-04-05 15:39:25,775] DEBUG    processor/thread_5   Created adversary event for ALCHEMIST SPIDER
[2023-04-05 15:39:25,779] DEBUG    processor/thread_12  Created adversary event for SAMBA SPIDER
[2023-04-05 15:39:25,783] DEBUG    processor/thread_6   Created adversary event for COMPASS SPIDER
[2023-04-05 15:39:25,785] DEBUG    processor/thread_11  Created adversary event for HOLIDAY SPIDER
[2023-04-05 15:39:25,788] DEBUG    processor/thread_2   Created adversary event for SPECTRAL KITTEN
[2023-04-05 15:39:25,795] DEBUG    processor/thread_13  Created adversary event for SHINING SPIDER
[2023-04-05 15:39:25,804] DEBUG    processor/thread_14  Created adversary event for CHRONO KITTEN
[2023-04-05 15:39:25,810] DEBUG    processor/thread_4   Created adversary event for CYBORG SPIDER
[2023-04-05 15:39:25,816] DEBUG    processor/thread_15  Created adversary event for HAYWIRE KITTEN
[2023-04-05 15:39:25,821] DEBUG    processor/thread_1   Created adversary event for FERAL SPIDER
[2023-04-05 15:39:26,370] DEBUG    processor/thread_8   Created adversary event for COSMIC WOLF
[2023-04-05 15:39:26,381] DEBUG    processor/thread_10  Created adversary event for PARTISAN JACKAL
[2023-04-05 15:39:26,473] DEBUG    processor/thread_11  Created adversary event for LILY SPIDER
[2023-04-05 15:39:26,651] DEBUG    processor/thread_9   Created adversary event for VAPOR PANDA
[2023-04-05 15:39:26,681] DEBUG    processor/thread_7   Created adversary event for CHARIOT SPIDER
[2023-04-05 15:39:26,907] DEBUG    processor/thread_12  Created adversary event for WANDERING SPIDER
[2023-04-05 15:39:26,916] DEBUG    processor/thread_5   Created adversary event for VICE SPIDER
[2023-04-05 15:39:26,957] DEBUG    processor/thread_1   Created adversary event for ALPHA SPIDER
[2023-04-05 15:39:26,967] DEBUG    processor/thread_11  Created adversary event for RECESS SPIDER
[2023-04-05 15:39:27,132] DEBUG    processor/thread_13  Created adversary event for HIVE SPIDER
[2023-04-05 15:39:27,167] DEBUG    processor/thread_7   Created adversary event for DEADEYE HAWK
[2023-04-05 15:39:27,180] DEBUG    processor/thread_3   Created adversary event for GALACTIC OCELOT
[2023-04-05 15:39:27,217] DEBUG    processor/thread_15  Created adversary event for VERTIGO PANDA
[2023-04-05 15:39:27,335] DEBUG    processor/thread_6   Created adversary event for BLIND SPIDER
[2023-04-05 15:39:27,571] WARNING  pymisp/thread_0      The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias
[2023-04-05 15:39:27,574] DEBUG    processor/thread_0   Created adversary event for CHAOTIC SPIDER
[2023-04-05 15:39:27,730] DEBUG    processor/thread_4   Created adversary event for AQUATIC PANDA
[2023-04-05 15:39:27,842] DEBUG    processor/thread_5   Created adversary event for BRAIN SPIDER
[2023-04-05 15:39:27,946] DEBUG    processor/thread_6   Created adversary event for AVIATOR SPIDER
[2023-04-05 15:39:27,988] DEBUG    processor/thread_10  Created adversary event for FRINGE LEOPARD
[2023-04-05 15:39:28,109] DEBUG    processor/thread_11  Created adversary event for HAZY TIGER
[2023-04-05 15:39:28,197] DEBUG    processor/thread_12  Created adversary event for MIRAGE TIGER
[2023-04-05 15:39:28,313] DEBUG    processor/thread_13  Created adversary event for VETO SPIDER
[2023-04-05 15:39:28,353] WARNING  processor/thread_0   Adversary DEMON SPIDER missing field first_activity_date.
[2023-04-05 15:39:28,353] WARNING  processor/thread_0   Adversary DEMON SPIDER missing field last_activity_date.
[2023-04-05 15:39:28,354] DEBUG    processor/thread_0   Created adversary event for DEMON SPIDER
[2023-04-05 15:39:28,437] DEBUG    processor/thread_2   Created adversary event for BANISHED KITTEN
[2023-04-05 15:39:28,487] DEBUG    processor/thread_14  Created adversary event for ROYAL SPIDER
[2023-04-05 15:39:28,517] DEBUG    processor/thread_6   Created adversary event for BITWISE SPIDER
[2023-04-05 15:39:28,635] DEBUG    processor/thread_1   Created adversary event for GOSSAMER BEAR
[2023-04-05 15:39:28,665] DEBUG    processor/thread_9   Created adversary event for REGAL JACKAL
[2023-04-05 15:39:28,671] WARNING  processor/thread_0   Could not add or tag event ADV-203346 DEMON SPIDER (eCrime). Will retry in 0.3 seconds.
day is out of range for month: 0
[2023-04-05 15:39:28,704] WARNING  processor/thread_5   Adversary INTREPID JACKAL missing field first_activity_date.
[2023-04-05 15:39:28,704] WARNING  processor/thread_5   Adversary INTREPID JACKAL missing field last_activity_date.
[2023-04-05 15:39:28,705] DEBUG    processor/thread_5   Created adversary event for INTREPID JACKAL
[2023-04-05 15:39:28,797] DEBUG    processor/thread_15  Created adversary event for OUTRIDER TIGER
[2023-04-05 15:39:29,024] WARNING  processor/thread_8   Adversary VAMPIRE SPIDER missing field last_activity_date.
[2023-04-05 15:39:29,025] WARNING  pymisp/thread_8      The value of the attribute you're trying to add is an empty string, skipping it. Object relation: alias
[2023-04-05 15:39:29,035] DEBUG    processor/thread_8   Created adversary event for NEMESIS KITTEN
[2023-04-05 15:39:29,070] DEBUG    processor/thread_0   Created adversary event for ETHEREAL PANDA
[2023-04-05 15:39:29,079] DEBUG    processor/thread_7   Created adversary event for QUANTUM SPIDER
[2023-04-05 15:39:29,397] DEBUG    processor/thread_13  Created adversary event for SUNRISE PANDA
[2023-04-05 15:39:29,734] DEBUG    processor/thread_14  Created adversary event for HERMIT SPIDER
[2023-04-05 15:39:29,775] DEBUG    processor/thread_12  Created adversary event for JACKPOT PANDA
[2023-04-05 15:39:29,863] DEBUG    processor/thread_10  Created adversary event for EMBER BEAR
[2023-04-05 15:39:30,571] WARNING  processor/thread_5   Could not add or tag event ADV-137920 INTREPID JACKAL (Hacktivist). Will retry in 0.3 seconds.
day is out of range for month: 0
Traceback (most recent call last):
  File "misp_import.py", line 377, in <module>
    main()
  File "misp_import.py", line 356, in main
    importer.import_from_crowdstrike(int(settings["CrowdStrike"]["init_reports_days_before"]),
  File "/home/rx118r/src/crowdstrike/MISP-tools-main/cs_misp_import/importer.py", line 303, in import_from_crowdstrike
    self.actors_importer.process_actors(actors_days_before, self.event_ids)
  File "/home/rx118r/src/crowdstrike/MISP-tools-main/cs_misp_import/actors.py", line 153, in process_actors
    if fut.result():
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/concurrent/futures/_base.py", line 437, in result
    return self.__get_result()
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/opt/rh/rh-python38/root/usr/lib64/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/rx118r/src/crowdstrike/MISP-tools-main/cs_misp_import/actors.py", line 66, in batch_import_actors
    event: MISPEvent = self.create_event_from_actor(act, act_det)
  File "/home/rx118r/src/crowdstrike/MISP-tools-main/cs_misp_import/actors.py", line 372, in create_event_from_actor
    kao.add_tag(f"CrowdStrike:adversary:branch: {actor_branch}")
AttributeError: 'NoneType' object has no attribute 'add_tag'

This looks to be a data issue with a couple of the adversaries.  We should be able to adjust to handle this on adversary ingest.


Fixing index creation: CASESENSITIVE preceeds SORTABLE

CASESENSITIVE label should be declared before SORTABLE:
<IP_ADDRESS>:6379>  FT.CREATE ft-info-fields-test ON HASH PREFIX 1 ft-info-fields-test: SCHEMA t as tag TAG SEPARATOR "." SORTABLE CASESENSITIVE
(error) Field `CASESENSITIVE` does not have a type
<IP_ADDRESS>:6379>  FT.CREATE ft-info-fields-test ON HASH PREFIX 1 ft-info-fields-test: SCHEMA t as tag TAG SEPARATOR "." CASESENSITIVE SORTABLE
OK

@chayim


Guide How to Use spylang

Hello, very cool project.
I Hope this spylang can be python subset that prune and make the language more strict, also make it fast :)
Is there any documentation to use/build spylang in local machine (linux Ubuntu). I try to use it, but stuck when build the libspy.
Thankyou

Hello!
Sorry for the late answer, had too many things going on.
I'm totally aware that doc is lacking, and I'd actually like some help with it :).
On linux, the prerequisite are:

python >=3.10 (I'm testing with 3.10 but should work also with more recent versions)
emscripten should be installed and emcc should be available

Then the basic setup should be something like this:
$ python -m venv venv --prompt spy
$ . venv/bin/activate
$ pip install -r requirements.txt
# make sure that the zig binary is available
$ ln -s $(realpath venv/lib/python3.*/site-packages/ziglang/zig) venv/bin/
$ make -C spy/libspy

Then, you should be good to go:
# execute the script in interpreted mode
$ ./spy.sh --run examples/hello.spy
Hello world!

# compile to an executable
$ ./spy.sh -t native  examples/hello.spy
$ ./examples/hello
Hello world!

# see what happens after redshifting
$ ./spy.sh --redshift --no-pretty examples/hello.spy
def main() -> `builtins::void`:
    `builtins::print_str`('Hello world!')

# run tests
$ pytest

This should be enough to get you started.
In case you are interesting in contributing, there are many small areas to improve which should be good as first time issues:

ideally the zig ln dance should not be needed and the makefile should be able to find zig by itself
currently emcc is a hard requirement but it shouldn't. If you don't want to target emscripten, it should not be necessary to have it installed
spy/tests/test_cbuild.py::TestToolchain::test_c2wasm[clang] currently fails if clang is not installed, but it should just be skipped in that case

I just realized that PR #76 contains a small guide to get started, so it might be what you are looking for.
Still, it would be nice to have "proper docs"

Thanks for the answer,
Unfortunately, I don't have experience on build system and compiler.
But, I can help with documentation PR #78 address.


Library load bug in 3.0.0-alpha.2

If HELICS v3.0.0-alpha.2 was built and installed with the C++ library active, the logic in _build.py responsible for library loading will accidentally bind and load the C++ shared library instead of the C shared library, breaking some bindings.
The responsible line appears to be if "libhelics" in file: on MacOS (other operating systems may share similar bug after shared library renames).
Modifying the line as follows resolved the issue on MacOS, however this may not be the desired solution: if "libhelics" in file and not "cpp" in file:

This should be resolved in the latest version.


adding action permissions

closes #752
This pulls the deployment of doc into a separate phase with write privs

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (94ce98c) 90.25% compared to head (59912f6) 90.25%.

:exclamation: Current head 59912f6 differs from pull request most recent head 07db7cf. Consider uploading reports for the commit 07db7cf to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #753   +/-   ##
=======================================
  Coverage   90.25%   90.25%
=======================================
  Files          80       80
  Lines        4677     4677
  Branches      856      856
=======================================
  Hits         4221     4221
  Misses        259      259
  Partials      197      197

Flag
Coverage Δ

unittests
90.25% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


KAFKA-6718 / Rack aware standby task assignor

This PR is part of KIP-708 and adds rack aware standby task assignment logic.
Rack aware standby task assignment won't be functional until all parts of this KIP gets merged.
Splitting PRs into three smaller PRs to make the review process easier to follow. Overall plan is the following:
👉  Rack aware standby task assignment logic.
⏭  Protocol change, add clientTags to SubscriptionInfoData https://github.com/apache/kafka/pull/10802
⏭  Add required configurations to StreamsConfig (public API change, at this point we should have full functionality)
This PR implements first point of the above mentioned plan.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Call for review @cadonna @vvcephei @ableegoldman

gentle nudge @cadonna @vvcephei @ableegoldman

@lkokhreidze Sorry for the long silence! Some other tasks got in my way. I plan to review this PR tomorrow.

Thanks @cadonna for the feedback.
I've replied/addressed all of your comments.

Thanks @cadonna for the valuable feedback 🙇
I've replied/addressed your comments.

@lkokhreidze FYI: I will be offline the next two weeks. I am sorry that I haven't had time to review this PR this week.

Hi @cadonna !
Thanks for the feedback. I will address your comments this week.

Hi @cadonna
Thank you for valuable feedback.
I've addressed your comments. Please have a look once you got time.

Thanks for the feedback @cadonna , I've pushed the new changes.

The general thought on the implementation.
As of now, we choose concrete StandbyTaskAssignor implementation based on passed AssignmentConfigs value.
Instead, an alternative approach would be to have a chained standby task assignment based on multiple implementations. For instance, when have required client tag configuration is present, we can try to assign the standby tasks based on List.of(new ClientTagAwareStandbyTaskAssignor(), new DefaultStandbyTaskAssignor()). This way, ClientTagAwareStandbyTaskAssignor can try to distribute the standby tasks based on tags dimensions. If there are no more client tag dimensions available, and we still have any(tasksToRemainingStandbys) > 0, the next implementation in the chain (in this case DefaultStandbyTaskAssignor) will be called. With this, DefaultStandbyTaskAssignor can default to assigning the remaining standbys to the least loaded clients. The benefit of this approach is that, right now, ClientTagAwareStandbyTaskAssignor does both assignments based on available dimensions and fallback to the least loaded if there are no enough tag dimensions. Current implementation leads to more complex code. While with the approach above, we can clearly separate the implementations without duplication (there's no code duplication, rather "logic" duplication).
For now, I've chosen to go with the simplest approach - having two independent implementations and selecting an appropriate one based on passed AssignmentConfigs. Still, I wanted to share this idea here, just in case.

Hi @cadonna,
I've addressed/replied to your comments. Thanks for the feedback.
FYI - I'll be offline from next week for 2 weeks.

Hi @cadonna is it possible to continue pushing this PR forward? I'm back from my holidays.

Welcome back @lkokhreidze! Sorry for the silence around this PR. I got side-tracked by other tasks. I will try to review this PR this week.

Thanks for the feedback @cadonna
I will review and address your comments this week.

Hi @cadonna
Very sorry for disappearing, didn't find time to deal with this PR.
I've addressed your comments. Please have another look when you got time.

Hi @cadonna ,
Will you have time to look at this PR again?

@lkokhreidze I am really sorry that I haven't found the time to look at your updated PR. I will put it on my list for next week.

@cadonna no worries and thank you.

Hi @cadonna thanks for the feedback.
I'll address your comments shortly.

Hi @cadonna small update from my side.
I cam back from holidays a week ago so will continue working on this PR this week.
Sorry for the delay.

Hi @cadonna,
I've address your comments with the latest commit.
Please have a look when you got time.
Thanks.

The latest commit (be3dcff4dc463fd8d23998537e36f852b99ec083) has a few changes.

There's explicit fallback to fallback to DefaultStandbyTaskAssignor logic if rack aware standby task assignment fails to assign standby tasks.
Rack aware standby task assignment logic takes into account client capacity when assigning the standby task. If client has reached the capacity, algorithm won't assign standby task to it. When that happens, we will fallback to the least loaded clients. I believe this is better approach, as we will avoid overloading the clients. There will be a warning log, to inform the user.

Looking forward hearing your thoughts, @cadonna

Hi @cadonna ,
Sorry for the ping. Any chance we could review PR this week?
Thanks

@lkokhreidze , thanks for the PR. I'll take a look next week. Thanks.

@lkokhreidze I will try to review this Friday. Sorry for the delay but I was sick for the last two weeks.

Hi @showuon, @cadonna
Thanks for the valuable feedback. I've addressed your comments and pushed the changes. I also resolved conversations feel free to unresolve them if you think I haven't addressed your comments.
Looking forward hearing your thoughts.

Hi @showuon Thanks for the feedback.
I've addressed your comments.

Thanks @showuon for the valuable feedback.
I've addressed your comments, please have a look when you got time.

Hi @cadonna @showuon
I've addressed your comments. Please have a look.
Thank you!

Hi @cadonna
Mind having another look? Hoping to finalise this PR as soon as possible :)
Thanks

@lkokhreidze I will try to have a look this week. I would also like to get this PR merged as soon as possible. Since @showuon  has already approved it. If I will not manage to have a look, @showuon can merge it.

Thanks @cadonna, appreciate it.
@showuon please also note that next PR, the protocol change, is also ready to be reviewed. https://github.com/apache/kafka/pull/10802
Whenever it's possible, please have a look at that too.

@lkokhreidze Let me know if you want to address my minor comments in this PR. After that @showuon or I can merge this PR.
Nice work!

Failed tests are unrelated and also failed in trunk build.
Build / ARM / org.apache.kafka.streams.integration.NamedTopologyIntegrationTest.shouldRemoveOneNamedTopologyWhileAnotherContinuesProcessing
Build / JDK 11 and Scala 2.13 / kafka.server.DynamicBrokerReconfigurationTest.testThreadPoolResize()
Build / JDK 11 and Scala 2.13 / kafka.server.DynamicBrokerReconfigurationTest.testThreadPoolResize()
Build / JDK 11 and Scala 2.13 / org.apache.kafka.streams.integration.NamedTopologyIntegrationTest.shouldRemoveOneNamedTopologyWhileAnotherContinuesProcessing
Build / JDK 17 and Scala 2.13 / kafka.server.DynamicBrokerReconfigurationTest.testThreadPoolResize()
Build / JDK 17 and Scala 2.13 / kafka.server.DynamicBrokerReconfigurationTest.testThreadPoolResize()
Build / JDK 17 and Scala 2.13 / org.apache.kafka.streams.integration.NamedTopologyIntegrationTest.shouldRemoveOneNamedTopologyWhileAnotherContinuesProcessing
Build / JDK 8 and Scala 2.12 / org.apache.kafka.connect.integration.RebalanceSourceConnectorsIntegrationTest.testDeleteConnector
Build / JDK 8 and Scala 2.12 / org.apache.kafka.connect.integration.RebalanceSourceConnectorsIntegrationTest.testDeleteConnector
Build / JDK 8 and Scala 2.12 / org.apache.kafka.streams.integration.NamedTopologyIntegrationTest.shouldRemoveOneNamedTopologyWhileAnotherContinuesProcessing

🥳


Merge tags selectbox is hidden below text toolbox

Tried rn on https://email.maocanhua.cn/editor and after clicking on merge tags the selection is below the text toolbox so it's impossible to click on certain values.

Cannot be reproduced.

@m-Ryan ok, took me a while to find it again lol
Trying to do it on Chromium 106.something, so really up to date browser.
Steps to reproduce on blank template:

Add text block
Go back to blocks (Back arrow button next to "Configuration")
Click into text block to get text toolbar again
Click on merge tags

Thanks. Please update<EMAIL_ADDRESS>yarn add easy-email-extensions@latest

@m-Ryan thanks, seems like it's resolved! gj


Module breaks CSS HMR when an arbitrary value class with whitespace is used

Version
@nuxtjs/tailwindcss: 6.11.4
nuxt: 3.10.3
Reproduction Link
https://stackblitz.com/edit/github-4um3z1
Steps to reproduce
I'm not sure if this bug should be addressed in Nuxt or this module itself so I thought I would start the bug report here (I was not able to reproduce this bug with npm create vue@latest so the problem is likely from Nuxt or this module).
When an arbitrary value Tailwind class with whitespace is used (e.g. font-['Times_New_Roman']), CSS HMR will throw an error on subsequent hard refreshes.

Install this module, and use an arbitrary value Tailwind class with whitespace somewhere in the project.
Create and import a custom CSS file (in the repro, this is @/assets/custom.css) to trigger CSS HMRs.
Edit the custom CSS file (e.g. change color: aqua; to color: magenta;) and save it.
Hard refresh the page.

What is Expected?
No error should appear.
What is actually happening?
The following error is thrown.
 ERROR  Internal server error: Parse error /home/projects/github-4um3z1/node_modules/tailwindcss/tailwind.css?direct:489:32                                 7:22:34 PM
      at parse$e (/home/projects/github-4um3z1/node_modules/vite/dist/node/chunks/dep-jDlpJiMN.js:16225:355)
      at handleModuleSoftInvalidation (/home/projects/github-4um3z1/node_modules/vite/dist/node/chunks/dep-jDlpJiMN.js:53757:27)
      at async getCachedTransformResult (/home/projects/github-4um3z1/node_modules/vite/dist/node/chunks/dep-jDlpJiMN.js:53562:10)
      at async doTransform (/home/projects/github-4um3z1/node_modules/vite/dist/node/chunks/dep-jDlpJiMN.js:53535:24)
      at async viteTransformMiddleware (/home/projects/github-4um3z1/node_modules/vite/dist/node/chunks/dep-jDlpJiMN.js:63458:32)

Thanks for opening and reporting an issue on this repository. Sorry it took me a while to get to this.
I tried this without the module on a vanilla installation of Tailwind CSS as well, and the issue seems to be persisting (so it's likely not the module); I wouldn't say it's Nuxt core either, but possibly something with Vite.
For now, I can tell you these workarounds:

The @/assets/custom.css can be added to css in your Nuxt config.
Put the arbitrary classes away from <template> but rather in

<template>

Test Page

</template>

Apologies for this issue - let me see what I can do from my end, meanwhile if you'd like to report on Nuxt/Vite repositories, please feel free to do so!

Hi @miosenpai - doing a check/followup if a module/Nuxt/Vue/Vite/package update may have fixed this issue overtime?

@ineshbose Tested with a fresh npx nuxi@latest init today and the issue is still present, another user reported a similar error in Nuxt issue as well.

Thanks for confirming. I wonder if it's okay I close this issue and we track in https://github.com/nuxt/nuxt/issues/26454 as we confirmed its not a module (or Nuxt) issue as this happens it with a vanilla install too (perhaps we also try to reproduce this with a Vite + TailwindCSS app).

Closing this in favour of tracking in https://github.com/nuxt/nuxt/issues/26454 as that has more visibility of Vite and Nuxt core, and has gotten more traction.. 🙂


fix a typo

"the next thing to do it to check" -> "the next thing to do is to check"
Changes

Implementation details

How to read this PR

Screenshots

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


doc/setup.rst: Remove references to now defunct clean_module script

FIX
Remove reference to a script that does not exist anymore.

The tool actually still exists


Is it possible to modify and save the assets?

I am trying to implement a better asset manager to move assets around and fix the dependencies.
I need to move a big folder which is losing more than 100 soft references.

Currently there's no support for saving assets, but it is possible to use the code as a starting point to implement that. It's something I'd be willing to include & support if you decided to pursue that!

I started working on it yesterday and I am facing a problem with CustomVersions. I realized you only support if it's enumerated as Optimized. Do you have any idea how I can detect the other two formats?

I will continue working on it until Monday. If I can't get it working, I will have to drop the effort.
My plan is to:

Directly look for the known asset references FStrings in the file and change then.
As a consequence of 1., I need to update the offsets in the header and recalculate the header size.

I also faced another issue which the cause is still unknown:
I used UE to edit a reference (adding one more character to the FString). I expected to see only 2 more bytes in the file ('cause the asset path has this /Game/Content/BP_FileC.BP_FileC repetition), but the file size increased a bit more than 100 bytes and it also affected the header size. Do you have any idea why it happened?

Responding to:

I started working on it yesterday and I am facing a problem with CustomVersions. I realized you only support if it's "enumerated" as Optimized. Do you have any idea how I can detect the other two formats?

We can get the enum out of the legacy version like this:
https://github.com/EpicGames/UnrealEngine/blob/fbead6f0990207c6022b6d1ec49f14b16f39c270/Engine/Source/Runtime/CoreUObject/Private/UObject/PackageFileSummary.cpp#L14

I used UE to edit a reference (adding one more character to the FString). I expected to see only 2 more bytes in the file ('cause the asset path has this /Game/Content/BP_File.BP_File_C repetition), but the file size increased a bit more than 100 bytes and it also affected the header size. Do you have any idea why it happened?

I don't know the reasons for this -- I know that the saves tend to be non-deterministics, but I didn't realize there would be as significant changes like that. I'd have to dig into the behavior to see what might be causing it,


FR: more informative error messages

Situation
npx knip
Analyzing workspace ....
Error loading app/cypress.config.ts
Reason: Invalid or unexpected token

with debug it showed exactly the right file (in my case, it was broken installation of bluebird as cypress dependency, with one file replaced with a png image)
Proposal
I wish if knip returned cause part (or full loader error) for such cases, something like this
LoaderError:
[cause]: /app/node_modules/bluebird/js/release/finally.js:1
  �PNG

Is this still an issue? Feel free to re-open if necessary :)


Added RT conflict

Per request

The error shown makes no sense to me.  Theonly change was adding the conflict to RT.
If I made a mistake, please explain it to me.
Thanks

Closing as duplicate of #2460.


Data Science with Python : Elbow Method In KMeans Clustering

Welcome to 'DSWP' Team, good to see you here
With this issue, readers will get introduced with core information to Elbow Method In KMeans Clustering along with sample code completely in a effective way.
To get assigned to this issue, add your serial numbers mentioned in the spreadsheet of "Data Science with Python", the approach one would follow and choice you prefer (Documentation, Audio, Video). You can go with all three or any number of options you're interested to work on.
If you had referred any resources, add them up in "DS Resources". Similarly if you had used datasets, include them in "DS Datasets".
Domain : Machine Learning
Mentors Assigned : Dhruv Bajaj / Yash Goel
Points to Note :
The issues will be assigned on a first come first serve basis, 1 Issue == 1 PR.
"Issue Title" and "PR Title should be the same. Include issue number along with it.
Changes should be made inside the Datascience_With_Python/ directory & Datascience_With_Python branch.
Follow Contributing Guidelines & Code of Conduct before start Contributing.
This issue is only for 'GWOC' contributors of 'DSWP' domain.
All the best. Enjoy your open source journey ahead. 😎

Approach: Taking Exemplary dataset to make understand the concept
Format: documentation
Serial no:253

Issue assigned to @ayushijindal for documentation

Hello, could you assign this to me.
Name: Shubham Patel
Serial No. 104
Approach: What is elbow method and why it is used.
Type: Video

Issue assigned to @ShubhamPatel01 for video contribution

Hello, I am Deepthi M with serial number:172, Batch-5. I would like to do audio on this issue.
My approach: a detailed explanation

Issue assigned to @deepthi1107 for audio contribution


Move the Mxximize functions to Rexl.Solve

This moves the Maximize and Minimize functions to be in the Rexl.Solve project.
Also refactors the test support functionality to allow bind-level testing in multiple test projects.

Module.Maximize(With(r:{P:3}, M=>(r)=>(r)), S)

Remove these.

Refers to: src/Test/Baseline/Bind/Binder/With/ReducePull.txt:588 in 009a761. [](commit_id = 009a761599547f2fa960e4f0960ff93c662839a7, deletion_comment = False)


Setting a custom user id doesn't work

Environment
How do you use Sentry?
Sentry SaaS (sentry.io)
Which version of the SDK?
How did you install the package?
https://github.com/getsentry/sentry-unreal/releases/download/0.18.0/sentry-unreal-0.18.0-engine5.3-github.zip
Which version of Unreal?
5.3.2
Is this happening in Unreal (editor) or on a player like Android, iOS, Windows?
Windows Game build in Test config
Steps to Reproduce

Use automatic SDK initialization
Put this code into a custom game instance

void UMyGameInstance::Init()
{
	if (USentrySubsystem* SentrySubsystem = GEngine->GetEngineSubsystem< USentrySubsystem>())
	{
		FString MyCustomGuid = TEXT("something-random");
		USentryUser* User = NewObject<USentryUser>();
		User->SetId(MyCustomGuid);
		User->SetUsername(TEXT("myusername"));
		TMap<FString, FString> ExtraData;
		ExtraData.Add(TEXT("MyCustomId"), MyCustomGuid);
		User->SetData(ExtraData);
		SentrySubsystem->SetUser(User);
	}
	Super::Init()
}

Compile the app and upload stripped debug info
Crash the app
observe the crash report in sentry

Expected Result
Seeing an event on sentry.io having user.id="something-random"
Actual Result
I'm seeing an event on sentry.io that has a different user.id. It seems to be set to the same value as the login_id field of the unreal context where the crash report is written to. But I can see the MyCustomId field in ExtraData being set to "something-random" and I can also see my "myusername" being present in the event on sentry.
Any logs or screenshots

@diekleinekuh I've experimented with this a bit on my end and figured out that this issue occurs only when using the default Crash Reporter tool for crash capturing instead of the plugin's native integration. Currently it looks like Sentry processes such event reports differently and at some point user.id gets overwritten by Unreal's login_id value. I'll keep looking into that and let you know if anything new comes up.

@tustanivsky So if I'm setting EnableAutoCrashCapturing=true it would work? I had that on my list of things to check out anyway.

Yes, it will allow you to switch the default UE crash capturing mechanism to Sentry's and in this case user.id value should be the one you've set as in example above.

I can confirm that switching to Sentry's crash capturing mechanism by setting EnableAutoCrashCapturing=true makes the user.id show up as desired. For now this is fine for me. I don't really miss the epic crash reporter.

Thanks for the update, I'm closing this for now since after some research the original issue doesn't relate to UE plugin itself but rather to how Sentry processes CRC reports on the server side.

Alright, we've managed to confirm that the User ID overwriting happens on a server side of things and has nothing to do with plugin itself.


Always get back to the previous branch when deploying.

Is your feature request related to a problem? Please describe.
I am struggling with a bug when running ./bin/deploy --user but not sure how to fix it.
The issue that I have faced is that after I add a new publication into papers.bib and run ./bin/deploy --user, I always end up having the previous version of papers.bib file without any update. Some times, the update is working fine but sometimes I always get back to the previously built version.
Does anyone have a similar experience or have a solution to it? Thank you so much in advance.

Do you commit the changes before running deploy? Uncommitted changes are not being saved by the deploy script.

Yes, I "add" and "commit" the changes before running deploy...

@yongwanlim You should add the year of your publication to the years list in https://github.com/alshedivat/al-folio/blob/master/_pages/publications.md if you haven't

@saeed1262, thanks for your comment. Yes, I did.
I have the issue in general. The publication was one example. I am not able to update anything from the previous version. It used to work and this time not... Thanks for your comment!

Interesting and strange it doesn't work. To better understand this, is it correct that you add a new commit to the source branch, then you run ./bin/deploy --user, and it somehow erases the commit from source after deployment? I'm surprised it does something like that, because the script simply switches between source and master, without editing your commit history... Could you post your git history (use git log) before and after running the deploy script?

@alshedivat Thank you for your comment.  After adding a commit to the source and running ./bin/deploy --user, everything works normal. Thank you for looking into this and providing the feedback!


[csm] impl remove_data

Changes
Added method to remove assigned data from the graph.
Related Issues
Closes #644
Checks

[x] updated CHANGELOG.rst
[x] updated tests
[x] updated doc/
[ ] update example/tutorial notebooks
[ ] update manifest file

@vhirtham Now the data is also deleted for subsystems. Do I understand correctly, that subsystems are created exclusively by deleting and merging CSMs?

@vhirtham Now the data is also deleted for subsystems. Do I understand correctly, that subsystems are created exclusively by deleting and merging CSMs?

Basically yes. The disassembly is also most relevant for the asdf serialization. In practice, we probably only use the merge function.

good to have this option 👍


Translate generated pgsql error locations to input text

When a user writes some error-ful query into psql, we are currently returning
errors in terms of the generated query. This is unsightly and hard to follow:
edgedb=# select 1 + 'goo';
ERROR:  invalid input syntax for type integer: "goo"
LINE 2:     (1 + 'goo')
                 ^
QUERY:  SELECT/*<pg.SelectStmt at 0x1213e37c0>*/
    (1 + 'goo')

Instead, return error locations against the input query. This yields:
edgedb=# select 1 + 'goo';
ERROR:  invalid input syntax for type integer: "goo"
LINE 1: select 1 + 'goo';
                   ^
QUERY:  select 1 + 'goo';

Much better.

Updated for extended queries. Would like @fantix to take another look to make sure I'm not crazy


tokenBucket: incorrect count of issued when refill

https://github.com/reugn/equalizer/blob/d5d1ad141fc658bfb6bd994ebf5cfcd09d351dc5/token_bucket.go#L66-L79
A token can be issued between line 68 and 69 and then it will lead to a incorrect issued count and decrease the bucket real capacity.
Example:
refill() and Ask() executes concurrently then:
line 68 executes
line 77 and 78 executes
line 69 and 70 executes
Solution:
issued := atomic.SwapInt32(&tb.issued, 0)

@rschio thanks.

@rschio thanks.


python311Packages.wktutils: 1.1.6 -> 2.0.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python311Packages.wktutils is: Collection of tools for handling WKTs
meta.homepage for python311Packages.wktutils is: https://github.com/asfadmin/Discovery-WKTUtils
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.0.0 in filename of file in /nix/store/pqxyjs09khf2r8yiv5pq69ha8frjsghm-python3.11-wktutils-2.0.0

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

3 package rebuild(s)

First fifty rebuilds by attrpath

python311Packages.wktutils
python312Packages.wktutils

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/pqxyjs09khf2r8yiv5pq69ha8frjsghm-python3.11-wktutils-2.0.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python311Packages.wktutils https://github.com/r-ryantm/nixpkgs/archive/00fc2d271cfd25b03990c72b20e93c6f96c7f7ab.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/00fc2d271cfd25b03990c72b20e93c6f96c7f7ab#python311Packages.wktutils

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/pqxyjs09khf2r8yiv5pq69ha8frjsghm-python3.11-wktutils-2.0.0
ls -la /nix/store/pqxyjs09khf2r8yiv5pq69ha8frjsghm-python3.11-wktutils-2.0.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

4 packages built:

python311Packages.wktutils
python311Packages.wktutils.dist
python312Packages.wktutils
python312Packages.wktutils.dist

Maintainer pings
cc @fabaff for testing.

Result of nixpkgs-review pr 307919 run on x86_64-linux 1

4 packages built:

python311Packages.wktutils
python311Packages.wktutils.dist
python312Packages.wktutils
python312Packages.wktutils.dist


entt::internal::group_handler::swap_elements affects storages that are not owned by the group

When a partial-owning group relies on components owned by another group which relies on other components, sparse_set may fail to index entity because of swap_elements.
This works fine before v3.12.0, but it gives an error here currently.
namespace my_namespace
{
    struct Position
    {
        float x;
        float y;
    };

    struct Name
    {
        std::string name;
    };

    struct Health
    {
        int health;
    };

    void print_on_destroy(entt::registry& registry, entt::entity entity)
    {
        std::cout << "Component of Entity(" << entt::to_integral(entity) << ") destroyed" << std::endl;
    }
}

int main(int argc, char* argv[])
{
    auto registry = entt::registry{};
    auto name_group_with_pos = registry.group<my_namespace::Name>(entt::get<my_namespace::Position>);
    auto pos_group_with_health = registry.group<my_namespace::Position>(entt::get<my_namespace::Health>);

    auto entity_with_pos_health = registry.create();
    registry.emplace<my_namespace::Position>(entity_with_pos_health, 1.0f, 2.0f);
    registry.emplace<my_namespace::Health>(entity_with_pos_health, 100);

    auto entity_with_name_pos = registry.create();
    registry.emplace<my_namespace::Name>(entity_with_name_pos, "Entity with name and pos");
    registry.emplace<my_namespace::Position>(entity_with_name_pos, 3.0f, 4.0f);

    name_group_with_pos.each([](auto entity, auto& name, auto& position)
        {
            std::cout << "Entity(" << entt::to_integral(entity) << ") has name(" << name.name << ") and position(" << position.x << ", " << position.y << ")" << std::endl;
        });

    pos_group_with_health.each([](auto entity, auto& position, auto& health)
        {
            std::cout << "Entity(" << entt::to_integral(entity) << ") has position(" << position.x << ", " << position.y << ") and health(" << health.health << ")" << std::endl;
        });

    return 0;
}

Maybe a picture would explain what happened better:

Sorry for the late reply. You know, holiday break. 🙂
Can I ask you why you said that may fail to index entity because of swap_elements in your original message?
I don't get where swap_elements enters the game in your reasoning below. Thanks.

In the example above, when calling the each method on pos_group_with_health, entity will be retrieved from the pool of Position (through this code). At this point, an entity with a value of 1 will be retrieved. Entt will then try to use this entity to retrieve Health, which obviously cannot succeed.

Bug confirmed. I'll push a fix upstream soon too. I'd say it's eligible for the first v3.13 patch release probably. 👍

Just tried it out and it looks like it works fine for me. Well done.

Also fixes the issue for me, thank you! 👍 (I had reported it on Discord with this test case: https://godbolt.org/z/joov57173)

Fixed with version 3.13.1, thanks for pointing this out.


Date formatting

I updated the date formatting in the post generation to use the date_format variable from Hexo's config and to use the moment.js library to do the formatting, allowing the dates to format like any dates uses elsewhere in a user's site.
I also corrected the spelling of "avatar" everywhere it was misspelled as "avator." This is a breaking change to existing templates that used this misspelling, so I updated the version number in package.json to 2.0.0.
All substantial changes are in generator.js.

@churchs19
Thank you for your advice :D I merged immediately .

Sure thing! Great job on the plugin!


replace mojibar with insomnia

mojibar is not actively maintained, so let's remove it to make space for something new.
https://insomnia.rest/

😸


canonical-nthu-thesis:0.2.0

I am submitting

[ ] a new package
[x] an update for a package
[x] ensured that my package is licensed such that users can use and distribute the contents of its template directory without restriction, after modifying them through normal use.

Update canonical-nthu-thesis from 0.1.0 to 0.2.0.
Changes:

Fix horizontal overflow of headings.
Bake the transparency directly into the watermark SVG file.
Add functionality to add draft watermarks.
Make fonts, outline pages, page margins, and cover row heights customizable.
Justify and hyphenate paragraphs by default.

Thank you!


Optimized retainAll removeIf and forEach for array backed List and Set

Added optimized methods "retainAll", "removeIf" and "forEach" based on the optimized method
"removeAll" for arrays.
Added test to cover those 4 methods in the IntArrayListTest and IntArraySetTest

Did you benchmark the two implementations? I have no idea of the overhead of having contains passed by pointer.

Hello, this was a long time ago :)
At that time i micro benched with JMH this code and a version with specialized code for each function and if i remember correctly the performance was the same (I simply preferred this cleaner version).
But if you need some evidences of this, i can write the bench again.

No, it's OK. Are the unit tests covering all the code? And I'll need your real name if you wanna be thanked in the CHANGES.

Yes the tests cover each case of the added methods

OK, please confirm you don't want your name in.

You can add my name. It is DOS SANTOS JERONIMO Leonel
Do you need me to push a correction for the comment i did or can you fix it ?

Ouch, ReferenceArraySet does not compile :(.

Ok, so i'll try to setup the build today and check what is happening

Argh, I think I've been too quick. There are numerous problem with this pull request. Here
return removeIf((java.util.function.IntPredicate) c::contains);
the method is deprecated and Eclipse warns that the conversion is unlikely. Does this work?

In general, i have warnings for boxing/unboxing, deprecation, etc. and I expect the code to be completely clean of those.

I fixed part of the problems (unqualified Arrays calls, missing cast for arrays) but I'm a bit wary at this point.

No problem, as i said since this has been made some time ago, if you suspect something, i will check the build and rework the pull request if needed. I don't have my laptop now, as soon as i can i'll do it.

If the problem if only on c::contains my wild guess is that eclipse does not like to transform the method reference as an IntPredicate. Replacing c::contains with "v -> c.contains(v)" should be fine.


How to handle a modal isOpen event?

Hello! I tried to use a modals on my website. I need to resize nested div's after modal will open. But there is no any guide or example. Only "if you want you can use leanModal's ready option". But why I cant find any guide for simple method isOpen? Or this is such easy as don't need any documentation? Thanks!

Sounds like you need to use the onOpenEnd option when you initialize the modal


Standalone mode documentation is incomplete

Some details and a proposed solution are outlined in #11 but no official solution was offered, which is why I'm opening this issue.
Adding import _ "ariga.io/atlas-provider-gorm/gormschema" to your models package (e.g. model/model.go) and then running go mod tidy will solve the problem by adding the dependency to your go modules. However, this adds atlas as a direct dependency in your project and thus is no longer really a standalone solution. Am I wrong here?
Is this a bug, an oversight, or am I missing something obvious here?

Hi,
Thanks for pointing out this gap in the documentation.
I've updated the docs to include the Go team's recommendation on how to pin versions of tool dependencies.
The provider relies on the Go compiler and GORM dependencies of your project to work so it is highly recommended to use it this way and not compile it as a fully standalone binary which may or may not work depending on many factors.
Closing this, feel free to re-open if needed.

👍🏼 Thank you.