RoundTrip Tokenization Errors

Created a test that "roundtrips" strings through tokenization. This reveals some flaws with certain characters.

Investigation Notes:

Using this test string: 철수라는
In UTF8 bytes that is: [ 236, 178, 160, 236, 136, 152, 235, 157, 188, 235, 138, 148 ], (each triplet of bytes is one character)
Using this tool that should be these tokens: [1, 29871, 239, 181, 163, 30970, 31197, 31081].

LLamaSharp does generates the correct tokens.
Note that the tool linked above also generates broken characters!
So does this other tool!

The character 철 maps to multiple tokens: [29871, 239, 181, 163]

The LLamaSharp tokenizer assumes that there is a one to many relationship between tokens and characters; i.e. one token can become multiple characters. However in this case it is many to one; i.e. multiple tokens are becoming one character!

Fix Notes:

We have TokenToString methods - those seem to be broken conceptually since we now know a single token doesn't always map to a valid string.

I've made a start on fixing this, but it's going to require a bit of a rework of how we handle some detokenization stuff.

Latest commit remove all TokenToString methods. This is a breaking change, but I think it's needed here. Since we now know that a single character may require several tokens it would never be correct to use the TokenToString methods.

@sinusinu this should fix the issue you reported in #203, as long as you use the StatelessExecutor. There's still work needed to fix the other executors.
Would you mind testing it to confirm if it works for you?

Well, except for the output being a little wacky, looks like StatelessModeExecute example is working fine with Korean output!

except for the output being a little wacky

Is this a significantly different response than it generates without this PR? This should only affect character encoding and antiprompt detection, but other than that it shouldn't change the output!

Output text is being...accumulated? Full text is repeatedly printed each time instead of just new tokens. Same thing happens with English.
Without PR:

With PR:

Aha ok, I'll have a look into that later. I'm surprised my unit tests didn't pick that up!

@sinusinu It should be fixed now.

Yes, now it works as expected. Very nice!


Don't trigger beforeSave when logging in with a provider

Currently beforeSave is called while logging in with a provider such as facebook which feels strange as the user is never modified. It is also a difference from api.parse.com. Logging in with a provider sends a create request which currently is short circuited in RestWrite.js if the user has already signed up. This PR moves that short circuiting code before the triggering of the beforeSave which means it will no longer be called on logins. More info can be found in #623. I closed that PR as I thought the issue was fixed, but turns out I was wrong. Also added a test for it in this PR.

Looks good to me... :+1:


traceprof: a new trace-oriented profiler for LuaJIT

This is a new profiler designed to help understand LuaJIT trace behavior and performance.
You can test it with snabb snsh -jtprof ... combined with -p (run a program) or -t (run a selftest) or -e (run a Lua expression) or directly on a script file.
This is similar to our enhanced -jp=v support (#621) but seems to give more accurate results. Specifically when "back testing" on lukego/blog#8 the information from traceprof is consistent with the analysis:
traceprof report (recorded 10583/10583 samples):
 62% TRACE   3               counter2.lua:5
 26% TRACE   4      (3/5)    counter2.lua:9
 10% TRACE   3:LOOP          counter2.lua:5

while the jit.p result is completely misleading:
100%  TRACE   3          ->loop     counter2.lua:5

which seems to be due to limitations with the method that jit.p uses to collect samples. I don't fully understand this method and after studying it for a while I decided to try writing a simpler one instead.
(With traceprof I did have to increase the number of iterations on that test case to 10e9 to see the last trace reported. That is surprising but could be consistent with CPU out-of-order execution. Even with this many iterations I only see one trace reported from jit.p.)
More from the comments in traceprof.lua:
traceprof.lua: Low-level trace profiler
Traceprof analyzes the time spent in JIT-compiled traces.  It is an
alternative to 'jit.p' with fewer features and based on a simpler
and (hopefully) more accurate sampling method.
API:

start(): Start profiling.
stop():  Stop profiling and print a report.

... and start() has some undocumented optional parameters too.
Here is an example report:
traceprof report (recorded 659/659 samples):
 50% TRACE  20      (14/4)   rate_limiter.lua:82
 13% TRACE  12:LOOP          basic_apps.lua:26
 10% TRACE  14               rate_limiter.lua:73
  3% TRACE  14:LOOP          rate_limiter.lua:73
  2% TRACE  18:LOOP          basic_apps.lua:82
  1% TRACE  22      (12/13)  basic_apps.lua:25
  1% TRACE  25      (20/5)   link.lua:70

The report includes some useful information:

Which traces are hotspots? (Cross reference with -jdump)
Where does each trace begin? (Source code line)
How to traces connect? Side traces show (PARENT/EXIT).
How much time is spent in the "LOOP" part of a trace vs outside?

Traceprof uses an interval timer to periodically write the CPU
Instruction Pointer value to a log (array). The timer fires every 1
millisecond (default) and invokes a tiny C signal handler to write
the next value.
This log is analyzed after measurement in a separate reporting
step. The logged Instruction Pointer values are compared with the
machine code addresses of all compiled traces (and their loop offsets).
Traceprof was originally written due to confusion about
interpreting the results of 'jit.p' and not understanding exactly
how its sampling method works.
Future work:

Handle JIT "flush" event when existing traces are dropped.
Dump annotated IR/mcode for hot traces (like -jdump).
Fix warning introduced in LuaJIT change.

cc @alexandergall @kbara

I pushed a fix that includes the linkage between traces now too. Report looks like this on lukego/blog#8 example:
traceprof report (recorded 10572/10572 samples):
 63% TRACE   3               ->loop    counter2.lua:5
 25% TRACE   4      (3/5)    ->3       counter2.lua:9
 11% TRACE   3:LOOP          ->loop    counter2.lua:5

I am really happy with how closely that matches the analysis that I did by hand. Could be that the next time I have this situation I can diagnose the problem by looking at traceprof output and without opening the JIT dump file.

I had a somewhat epic Twitter discussion with a couple of LuaJIT internals gurus about this.
Overall this has reinforced my feeling that it makes sense to maintain traceprof. The problem I want to solve is making the trace-level compilation behavior made by LuaJIT transparent to the application programmer. The JIT behavior to observe is very subtle and complex and in my mind this calls for a very predictable and simple tool. Traceprof is such a tool: it simply logs the instruction pointer at regular intervals and then summarizes those values in terms of traces.
The standard jit.p uses a more complex method of sampling: it dynamically instruments the bytecode/IR to cause trace exits that call into the profiler. The exact points of these exits are a bit subtle and it can happen that many profiler events are coalesced together because execution did not reach an exit to the profiler in a reasonable timeframe. (That seems to be the reason that even with 10 billion loop iterations jit.p is only seeing one of the traces in the example above.)
This may also be the reason that upstream LuaJIT jit.p module does not offer per-trace reports. The code we are using for this was written by Mike but I don't believe he ever actually adopted it himself. This could be because he understood that it was not necessarily well matched for the sampling method that is being used.
I do still see jit.p as the right solution for basic source-level profiling and especially when you want to see call trees. However, I prefer the traceprof approach for more low-level trace-oriented profiling like in #612 and lukego/blog#8.
Incidentally in the tweet stream there is also a reference to ll_prof.py which is a tool that the V8 (Google/Javascript) developers use. They are using perftools as the backend to record data and then writing tools to analyze the raw dumps afterwards. This is an interesting idea. For now I prefer the method of doing everything from first principles (e.g. lib.pmu) and within our own process (with access to all internal data structres e.g. bytecode/IR/mcode). However, maybe the trade-offs will look different in the future e.g. if we want to support many CPU architectures with different PMU hardware.


fix: Argument must be passed by reference, value given issue

This should fix #83
@WalterWoshid

Damn, you're fast, good job. Let me create a test for it and I'll update it :)

LGTM 👍


update localsettings

Will wait for HQ changes to be deployed before doing this.
#102

@TylerSheffels :white_check_mark:

@snopoke Does this need a localsettings update on all environments as well?

Yes, but its not urgent. I'll do that tomorrow or next week


[Sema] Requestify pattern resolution

Add a cached request to perform pattern resolution. This is needed to prevent the constraint system from resolving the same pattern multiple times along different solver paths, which could result in creating different pattern nodes for each path. Once pattern resolution is moved to pre-checking we ought to be able to make this uncached.
rdar://128661960

@swift-ci please test source compatibility

@swift-ci please SourceKit stress test

@swift-ci please SourceKit stress test

@swift-ci please test

@swift-ci please test source compatibility


Rule proposal: File must not contain more lines than

new rule that is close to  SP2103 (FileMustNotContainMoreLinesThan) in stylecop+.
restrict number of lines per file with configurable option for this restriction.

I'm against this rule for two reasons:

There is no value for which one can reasonably say "a file less than this is OK, but a file more than this is not". I try to always vote no on rules for which one cannot take a specific side while claiming to be objective.
If an otherwise small change to the body of a method caused the file length to increase beyond the hard limit, it could force that small change to become a small change buried within a large refactoring. In other words, the negative side effects of attempting to resolve a violation of the proposed rule are more likely to introduce a problem (missed item in code review, or unintentional mistake during refactoring) than just keeping the long file itself.

1.There is no value for which one can reasonably say "a file less than this is OK,
This is the reason why this option should be configurable. So each team or group of developers will decide what is the good max length for them

If an otherwise small change to the body of a method caused the file length to increase beyond the hard limit, it could force that small change to become a small change buried within a large refactoring.

Actually, this is the idea of this rule. If you exceed file size, it is mean that you don't follow single responsibility and other design principles, so your file and class is too big. So yes, you need huge refactoring, this rule enforce you to write code of a good quality. It is like a litmus for a developer. Because today you need small change in the method. Tomorrow you need again small change. then another developer need one small if else inside a method. After several small changes it becomes mess. This rule will stop you from "small changes". Small change is not a term that engineers should use.

I worked once in a big multinational project where this was initialy a requirement - Later this requirement got dropped because the initial number of lines was to low.
But a simple refactoring to satisfy the requirement is to use partial Classes so that every partial class satisfies this, then the refactoring is not so big of a change.

I miss almost all stylecop++ rules in my .net core project so much!

I'm with @sharwell on this, 👎 , for the reasons he gave. In most cases, what happens when something complains about a max line limit on a file, is you bump up the line limit rather than refactor. Any limit on file size is not a really a style issue, but either a specification issue or a code review issue, where either the specification for what should be written was done poorly, or is a warning that there should be a code review. Neither of these is a style issue.


docs(api): add --watch-options-stdin and --no-watch-options-stdin

add --watch-options-stdin and --no-watch-options-stdin

Do we reach an agreement on adding s or not? From what I can tell, webpack core contains both forms:

I would prefer the no s version because it's simple, and it's correct as well.

Do we reach an agreement on adding s or not? From what I can tell, webpack core contains both forms:

I would prefer the no s version because it's simple, and it's correct as well.

I would prefer the no s version because it's simple, and it's correct as well.

Not yet hence I'm here only adding --watch-options-stdin and --no-watch-options-stdin.
Can you create a specific issue about it?

I would prefer the no s version because it's simple, and it's correct as well.

Not yet hence I'm here only adding --watch-options-stdin and --no-watch-options-stdin.
Can you create a specific issue about it?


OLS-86: Info how to get API key to LLM

Description
Info how to get API key to LLM
Type of change

[ ] Refactor
[ ] New feature
[ ] Bug fix
[ ] CVE fix
[ ] Optimization
[x] Documentation Update
[ ] Configuration Update
[ ] Bump-up dependent library
[ ] Bump-up library or tool used for development (does not change the final image)
[ ] CI configuration change
[ ] Konflux configuration change

Related Tickets & Documents

Related Issue #OLS-86
Closes #

/approve
/override "Red Hat Konflux / lightspeed-service-on-pull-request"

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.88%. Comparing base (32b78e7) to head (37a5747).
Report is 53 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1655      +/-   ##
==========================================
- Coverage   94.89%   94.88%   -0.01%
==========================================
  Files          60       60
  Lines        2685     2681       -4
==========================================
- Hits         2548     2544       -4
  Misses        137      137

Flag
Coverage Δ

94.88% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

/lgtm


undefined symbol: mkl_sparse_z_bsr_ng_avx521_sp_mv_i4

Hi authors,
Thanks for sharing the code, you really did an excellent job!
But when I execute sh scripts/kitti_finetune.sh, an error ouputs:
Traceback (most recent call last):
File "main.py", line 12, in
from dataset import build_data_loader
File "/workspace/michael/data/stereo-transformer/dataset/init.py", line 7, in
from dataset.kitti import KITTI2015Dataset, KITTI2012Dataset, KITTIDataset
File "/workspace/michael/data/stereo-transformer/dataset/kitti.py", line 10, in
from albumentations import Compose
File "/opt/conda/envs/sttr/lib/python3.6/site-packages/albumentations/init.py", line 5, in
from .augmentations import *
File "/opt/conda/envs/sttr/lib/python3.6/site-packages/albumentations/augmentations/init.py", line 2, in
from .blur.functional import *
File "/opt/conda/envs/sttr/lib/python3.6/site-packages/albumentations/augmentations/blur/init.py", line 1, in
from .functional import *
File "/opt/conda/envs/sttr/lib/python3.6/site-packages/albumentations/augmentations/blur/functional.py", line 5, in
import cv2
File "/root/.local/lib/python3.6/site-packages/cv2/init.py", line 181, in
bootstrap()
File "/root/.local/lib/python3.6/site-packages/cv2/init.py", line 153, in bootstrap
native_module = importlib.import_module("cv2")
File "/opt/conda/envs/sttr/lib/python3.6/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ImportError: /usr/local/lib/libmkl_sequential.so.1: undefined symbol: mkl_sparse_z_bsr_ng_avx521_sp_mv_i4
So, how to fix this problem?
Thanks in advance.

ok, the problem has been fixed, just replacing another version of cv2...
By the way, how to get occ_left from SCARED dataset?


Fix a pipe char in the table formatting

Set the proper escaping for a pipe char inside of a cell text in Markdown.

@diev,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by Microsoft. We will now review your pull request.
Thanks,
Microsoft Pull Request Bot


Fix keepalived vip readme nginx broken link

change nginx-alpha to nginx

This change is

/lgtm

/approve no-issue


Feature/mobile browse

Giving the mobile site a face-lift.
To Test:

Run through the site in desktop and mobile and make sure the browse sections still works as expected.

Looks great! While you're at it though, the directions list in the create recipe page doesn't collapse soon enough on small windows. As opposed to the ingredients list that do.

@hermzz, The direction list should be more readable now. Let me know what you think.


[BUG] Object Detection AutoTrain Error: iteration over a 0-d tensor

Prerequisites

[X] I have read the documentation.
[X] I have checked other issues for similar problems.

Backend
Hugging Face Space/Endpoints
Interface Used
UI
CLI Command
No response
UI Screenshots & Parameters

Error Logs
100%|██████████| 13/13 [00:10<00:00,  1.51it/s]/app/env/lib/python3.10/site-packages/autotrain/trainers/object_detection/utils.py:158: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at /opt/conda/conda-bld/pytorch_1712608935911/work/torch/csrc/utils/tensor_new.cpp:274.)
batch_image_sizes = torch.tensor([x["orig_size"] for x in batch])
INFO:     <IP_ADDRESS>:64413 - "GET /ui/accelerators HTTP/1.1" 200 OK
INFO:     <IP_ADDRESS>:51108 - "GET /ui/is_model_training HTTP/1.1" 200 OK
ERROR    | 2024-05-24 14:09:32 | autotrain.trainers.common:wrapper:120 - train has failed due to an exception: Traceback (most recent call last):
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/common.py", line 117, in wrapper
return func(*args, **kwargs)
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/object_detection/main.py", line 199, in train
trainer.train()
File "/app/env/lib/python3.10/site-packages/transformers/trainer.py", line 1885, in train
return inner_training_loop(
File "/app/env/lib/python3.10/site-packages/transformers/trainer.py", line 2311, in _inner_training_loop
self._maybe_log_save_evaluate(tr_loss, grad_norm, model, trial, epoch, ignore_keys_for_eval)
File "/app/env/lib/python3.10/site-packages/transformers/trainer.py", line 2721, in _maybe_log_save_evaluate
metrics = self.evaluate(ignore_keys=ignore_keys_for_eval)
File "/app/env/lib/python3.10/site-packages/transformers/trainer.py", line 3572, in evaluate
output = eval_loop(
File "/app/env/lib/python3.10/site-packages/transformers/trainer.py", line 3854, in evaluation_loop
metrics = self.compute_metrics(EvalPrediction(predictions=all_preds, label_ids=all_labels))
File "/app/env/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/object_detection/utils.py", line 188, in object_detection_metrics
for class_id, class_map, class_mar in zip(classes, map_per_class, mar_100_per_class):
File "/app/env/lib/python3.10/site-packages/torch/_tensor.py", line 1047, in iter
raise TypeError("iteration over a 0-d tensor")
TypeError: iteration over a 0-d tensor
ERROR    | 2024-05-24 14:09:32 | autotrain.trainers.common:wrapper:121 - iteration over a 0-d tensor
INFO     | 2024-05-24 14:09:32 | autotrain.trainers.common:pause_space:77 - Pausing space...
33%|███▎      | 100/300 [01:32<03:04,  1.08it/s]
Additional Information
The training is able to start and make some progress, but it seems that after the first epoch of training is completed the training fails with this error.

did you also upload validation data or just training data?

I only uploaded training data, it looked like it automatically did the train/val split. I did find an image that was listed in my metadata twice, so I am wondering if maybe it one of those entries ended up in validation and one in training, causing the image to not be found in the validation set. I fixed this and I am trying again. I can also try manually splitting and uploading my validation data. I will let you know if that fixes the error.

it does auto splitting. that shouldnt be an issue.

I did find an image that was listed in my metadata twice, so I am wondering if maybe it one of those entries ended up in validation and one in training, causing the image to not be found in the validation set. I fixed this and I am trying again

please let me know. this case should be caught earlier

@abhishekkrthakur I tried removing the duplicated image record from metadata.jsonl and I still got the same error.

okay. so the issue is happening for datasets that have a single class. im fixing the issue and will update here asap.
i really hope it works for you end to end now. and deep apologies.

@abhishekkrthakur Sounds good, thanks! And no problem, I'm glad I can help test a new feature.

just pushed a fix and tried on my own please make sure you are on v0.7.110 or above.

please let me know if you still face issues

It seems that the training has worked, thanks! I am just facing issues now with the Serverless Inference API, but I think that is separate from this repo. So I think this issue is solved now!

@rileybolen thank you very much for helping debugging this and apologies for the inconveniences. As a gratitude, we have added a $25 credit to your hugging face account that you can use for spaces, inference endpoints, autotrain or other huggingface services.

fixed


[Fonts] Icon request: currency_bitcoin

Hi @elankovan-amepay, the currency_bitcoin icon already exists in flutter stable 2.10.3 under the name currency_bitcoin. The material icon site just hasn't been updated yet. Closing this issue as the icon is already available in stable 2.10.3. Thank you


Can we play it with 3090 or 4090 24G?

Can we play it with 3090 or 4090 24G?

For your reference, in our experiments, the 3B 4B and 9B model require 16G 24G 48G in evaluation.


Card Mode Text too wide on some displays

When Card Mode is set to display 7 cards, it may be too wide for some displays and awkwardly wrap the text

Also occurs in Dice Mode occasionally


Add "save image" button

Add a button to the bar that saves the currently displayed image.

This solves #27


Permission denied for public-resolvers.md and relays.md

Hi.
I have running dnscrypt-proxy with mapped volume to store dnscrypt-proxy.toml configuration file and I'm getting permission denied for both files at docker logs.
[WARNING] /config/public-resolvers.md: open sf-psizzome646u2elx.tmp: permission denied
Both files appeared at mapped volume first time I run, but why is it now showing permission denied? Both files have same user:group like configuration file.
Any way to not have those permission denied?
Thanks.

Maybe the permissions on the directory are not good?
In such a scenario, I'd just chmod 777 (yeah, I know) the directory, start the container and see what user the files were created as in order to then set proper permissions on the directory.

Recently the I changed the runtime user from nonroot to nobody:nogroup so perhaps your existing configuration files still have the old permissions?
If your host OS is Linux, can you share the permissions on your config directory and files?
$ ls -al /path/to/config/

Also, @jedisct1's suggestion could work so I would try that as well.

@klutchell The files where not created/owned by nobody:nogroup so almost 99% was it, even that I tried to chmod 777, from @jedisct1 comment, the folder and deleting previous files and now the files have correct user and groups and seems that it is working great with no WARNINGs.

Excellent! I'll add a note to the readme that the files in the configuration volume should be either readable by world, or owned by nobody:nogroup.
Can we close this issue?

Agree to close!

I would like to say, at least for the future, that on the raspbian version up to date with the dnscrypt-proxy from the official repos from raspbian :
mars 14 20:08:39 redacted sudo[3298]: pam_unix(sudo:session): session closed for user root
mars 14 20:08:39 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:39] [NOTICE] Source [/var/cache/dnscrypt-proxy/public-resolvers.md] loaded
mars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [WARNING] /etc/dnscrypt-proxy/relays.md: open sf-t6o45zek5ewbhi45.tmp: permission denied
mars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [WARNING] /etc/dnscrypt-proxy/relays.md.minisig: open sf-mvw7i6ykum2va3jp.tmp: permission dmars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [NOTICE] Source [relays.md] loaded
mars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [ERROR] Invalid or unsupported stamp: [sdns://gQ01MS4xNTguMTY2Ljk3]
mars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [CRITICAL] Unable to use source [relays]: [Unsupported stamp version or protocol]
mars 14 20:08:40 redacted dnscrypt-proxy[3301]: [2021-03-14 20:08:40] [NOTICE] dnscrypt-proxy 2.0.19

I've followed the advice of @jedisct1 to put 777 and the user is dnscrypt-proxy group nogroup . Problem process from official repo is in root. So I don't know who is maintaining this repo but that would be nice to put a notice to them ?
Thanks in advance


Error loading model when use qwen gguf model

it's a qwen base model download form hf, can inferencing with llama.cpp(latest version) but can't inferencing on latest version of neural-speed
run_qwen shows error:
Loading the bin file with GGUF format...
error loading model: unrecognized tensor type 13

@kunger97 Hi, we have known this issue. Please install the Neural Speed from the source code and try again~~

@Zhenzhong1
Hello, I tested the following with the latest version of the neural-speed build

install the latest version of llama.cpp
pull the latest Qwen 14B model from HF repository Qwen/Qwen-14B-Chat
Use the python script convert-hf-to-gguf.py in llama.cpp to perform the conversion.

python convert-hf-to-gguf.py ~/Models/Qwen-14B-Chat/ --outtype f16

quantize using the quantize program built in llama.cpp

./quantize ~/Models/Qwen-14B-Chat/ggml-model-f16.gguf 15 #Q4_K

perform inference using the run_qwen program from neural-speed

./run_qwen -m ~/Models/Qwen-14B-Chat/ggml-model-Q4_K.gguf -p "你好。"

The program still indicates an error and exits (Segmentation fault (core dumped))
(neural-speed) u22f390a763ad8fc99b0d55cf8c167d0@idc-beta-batch-pvc-node-17:~$ ./run_qwen -m ~/Models/Qwen-14B-Chat/ggml-model-Q4_K.gguf -p "nihao"
Welcome to use the qwen on the ITREX!
main: seed  =<PHONE_NUMBER>
AVX:1 AVX2:1 AVX512F:1 AVX_VNNI:1 AVX512_VNNI:1 AMX_INT8:1 AMX_BF16:1 AVX512_BF16:1 AVX512_FP16:1
model.cpp: loading model from /home/u22f390a763ad8fc99b0d55cf8c167d0/Models/Qwen-14B-Chat/ggml-model-Q4_K.gguf
Loading the bin file with GGUF format...
error loading model: unrecognized tensor type 13

model_init_from_file: failed to load model
Segmentation fault (core dumped)

@kunger97 Hi~ This error means you don't use the latest Neural Speed branch.

install the latest version of llama.cpp

Please reinstall the Nerual Speed from the source code. Not llama.cpp~
pip list | grep neural-speed

pip uninstall neural-speed   # please make sure you have uninstalled all neural-speed libs.
Then python setup.py install in the neural speed root directory.

@kunger97 Thanks for your help!
This error means you don't use the latest Neural Speed branch.

install the latest version of llama.cpp

Please reinstall the Nerual Speed from the source code. Not llama.cpp~
pip list | grep neural-speed

pip uninstall neural-speed   # please make sure you have uninstalled all neural-speed libs.
Then python setup.py install in the neural speed root directory and try other models again if you want.
But for QWEN, it may not be supported currently supported models. When Neural Speed enabled the GGUF feature, there were no general GGUF QWEN model before. I will update this model in the Neural Speed as soon as possible.
Thank you again!

Hi @Zhenzhong1 i get the same error:
error loading model: unrecognized tensor type 12
model_init_from_file: failed to load model

OS : WSL2 - Linux DESKTOP-PNBMAG8 <IP_ADDRESS>-microsoft-standard-WSL2 https://github.com/intel/neural-speed/pull/1 SMP Thu Oct 5 21:02:42 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Python: Python 3.10.12
I tried:
pip uninstall neural-speed

git pull

pip list | grep neural-speed
neural-speed                  0.2.dev9+ge2d3652

python3 scripts/inference.py --model_name llama -m /home/dario-reply/neural-speed-tutorial/llama-2-7b.Q4_K_M.gguf -c 512 -b 1024 -n 256 -t 10 --color -p "She opened the door and see"

The same error.

Thanks you @Zhenzhong1! Works!

By the way, QWEN has been supported. https://github.com/intel/neural-speed/pull/127


TailwindCSS 2

What is the plan to support Tailwind CSS 2?

https://tailwindcss.com/docs/upgrading-to-v2

For a new project, it would be great to see the latest Tailwind CSS 2 being used to avoid a later migration effort.

I'm sorry it took a while because of some dependencies stuck in PostCSS 7. Everything should work fine now.


Toggling the Service on a Galaxy Tab S8 Ultra causes inability to interact with top and bottom menus

Preparation

[ ] I tested the latest release
[X] I looked at other issues (even the closed ones)
[X] I read the Troubleshooting Guide

FGO server
NA
FGA build number
0.22.1
Describe the bug
When turning on FGA, it blocks access to the menu/home/back button and the top bar dropdown, so I cannot switch apps or close FGA. I have had to use a bluetooth keyboard to access the power buttons to restart the device to get around this.
Video
Because it stops me from accessing any other programs, I am unable to take a video of the issue.
Device model
Samsung Galaxy Tab S8 Ultra
Android version
12
Screen size
1848 x 2960
RAM
12GB

Correct, that's the PlayStore version which is around a year old.


Add sub-byte emulation support to llvm-cpu and vulkan backend.

Based off of https://github.com/openxla/iree/commit/ea49d2b1531f1c7855ec2c65d7d9f97e5458d2ae
Fixes #14481

I haven't reviewed in detail yet. @hanhanW I'll review later tonight

Ah, I see it is merged. I'll leave comments anyway for post submit fixup

oops, sorry about that, I can address comments as follow-ups. Please take a look when you're available.


[KAFKA-10718][Kafka Connect]add config settting, skip record when enc…

…ountering null value
More detailed description of your change,
if necessary. The PR title and PR message become
the squashed commit message, so use a separate
comment to ping reviewers.
Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.
Committer Checklist (excluded from commit message)

[x] Verify design and implementation
[x] Verify test coverage and CI build status
[x] Verify documentation (including upgrade notes)

This proposed a public API change so this requires a KIP: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals
Considering the age of this PR, I'll close it for now. Feel free to open a KIP if you still want this feature.


Providers not respecting order defined

Bug Report

Q
A

BC Break
no

Version
1.3.1

Summary
I'm setting providers: [FeatureFlagLocalProvider(), FirebaseRemoteProvider()]. for this property
default: True
localProvider: True
firebase: False
Current behavior
The flag resolves as false, somehow deciding to choose firebase over the localProvider
How to reproduce
unsure, it seems like it should just work if you do [localProvider, firebaseProvider]
Expected behavior
the flag should resolve as True, respecting the local provider over the firebase provider

Hi, Are you previously initialized Firebase?

we run
FirebaseApp.configure()

separately, yes. is that not recommended? we also use firebase to send up analytics events

i believe this is happening after just the first few seconds after launch. i was seeing that case i mention above in the feature flag browser UI.
but as i'm trying to reproduce this issue, it doesn't seem to come up again. it seems to be using the value from the local provider correctly, even when it's different than what's in firebase. if i see it again, i'll re-open this with more detail


Seg fault on unicode external of string type

When we compile a match object with a string external, and then give that external a unicode value on match, we cause a seg fault.
Tested with:
yara-python==3.8.1
Python 2.7.15 (default, Jun  7 2018, 14:26:47)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux2
Sample code from  ipython:
In [1]: import yara
...: rule = yara.compile(source='rule foo: bar {condition: cat contains "abc"
...: }', externals={'cat': 'abc'})
...: rule.match(data='abcdefgjiklmnoprstuvwxyz', externals={'cat': u'A unicode \u018e string \xf1'})
Segmentation fault (core dumped)

Oops sorry meant to put on yara-python repo


No method overload found if the argument type is Enumeration object

I have an "enum" class(InterfaceRoleType) in java which implements "Enumerator" class.
There is another class named Interface which have method called "setRole(InterfaceRoleType agrObj)" which takes enum object as an argument.
Now, while using the Interface class via "jpype 1.3.0" to set the Role(setRole) i am passing an object of InterfaceRoleType(obviously), but jpype could not able to find the overload method in Interface class(which actually exist) and also jpype is throwing the "TypeError: No matching overload found" and also printing the options as the same method which is required and present (To be more clear below is stacktrace: )
 JPMethodDispatch::findOverload: EXCEPTION THROWN 0x854e60 No matching overloads found for com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType), options are:
	public void com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType)
      JPMethodDispatch::findOverload: EXCEPTION FROM:  native/common/jp_methoddispatch.cpp 184
      JPMethodDispatch::findOverload: EXCEPTION FROM:  native/common/jp_methoddispatch.cpp 195

Could you please help in pointing how i can resolve this issue, or any newer version in which we dont have the same problem.

I have no idea why this particular case is failing as we have tests for this in the test bench.  Perhaps the type information is not public for the interface type or something else wrong in the jar file.  I would need more details such as the signatures for all of the types so that I can replicate the issue locally.   You have to give me more to work with than an exception.
I cannot replicate it using a simple test.
Example:
TestEnum.java
public enum TestEnum
{
        VALUE;
}

TestCall.java
public class TestCall
{
        public void call(TestEnum v)
        {
                System.out.println(v);
        }
}

callit.py
import jpype
jpype.startJVM(classpath='.')

TestEnum = jpype.JClass('TestEnum')
TestCall = jpype.JClass('TestCall')

tc = TestCall()
tc.call(TestEnum.VALUE)  # prints "VALUE"

Thank you very much for looking into the issue.
Below I tried to copy all the important parts of the code, if the below info is not enough then I will try to construct a minimal example but it can take some time because most parts of the code are generated by EMF (Eclipse Modeling Framework).
public enum InterfaceRoleType implements Enumerator {
	MASTER(0, "Master", "Master"),
	SLAVE(1, "Slave", "Slave")
}

package org.eclipse.emf.common.util;
public interface Enumerator
{
  String getName();
  int getValue();
  String getLiteral();
}

The above two classes are there in java and we are trying to call these classes using jpype:
self.interface = root.addInterface()
self.role = JPackage("com.model").InterfaceRoleType.valueOf("SLAVE")
self.interface.setRole(self.role)

Description of setRole method in Interface class:
@Override
public void setRole(InterfaceRoleType newRole) {
    .....
    this.role = newRole;
}

Below is the strack trace from jpype 1.3.0:
> PyJPMethod_call
  PyJPMethod_call: setRole
  > JPMethodDispatch::invoke
    > JPMethodDispatch::findOverload
      JPMethodDispatch::findOverload: Checking overload setRole
      JPMethodDispatch::findOverload: Got overloads to check 1
      JPMethodDispatch::findOverload: Trying to match public void com.infineon.essence.model.impl.InterfaceImpl.setRole(com.infineon.essence.model.InterfaceRoleType)
      > JPTypeManager::populateMethod
        JPTypeManager::populateMethod: Method 0x2aeee50
        > JPTypeFactory_defineObjectClass
          JPTypeFactory_defineObjectClass: com.infineon.essence.model.InterfaceRoleType
        < JPTypeFactory_defineObjectClass
        > JPTypeFactory_populateMethod
        < JPTypeFactory_populateMethod
      < JPTypeManager::populateMethod
      > JPMethod::matches
        JPMethod::matches: Flags 0 1 1
        JPMethod::matches: arguments length 2
        JPMethod::matches: types length 2
        JPMethod::matches: Take this
        JPMethod::matches: Match args
        > JPClass::findJavaConversion
          > JPConversionNull::matches
          < JPConversionNull::matches
          > JPConversionObject::matches
          < JPConversionObject::matches
        < JPClass::findJavaConversion
        JPMethod::matches: Result 3
        > JPClass::findJavaConversion
          > JPConversionNull::matches
          < JPConversionNull::matches
          > JPConversionObject::matches
            JPConversionObject::matches: assignable 0 com.infineon.essence.model.InterfaceRoleType com.infineon.essence.model.InterfaceRoleType
          < JPConversionObject::matches
        < JPClass::findJavaConversion
        JPMethod::matches: Result 0
      < JPMethod::matches
      JPMethodDispatch::findOverload:   match ended 0
      JPMethodDispatch::findOverload: EXCEPTION THROWN 0x854e60 No matching overloads found for com.infineon.essence.model.impl.InterfaceImpl.setRole(com.infineon.essence.model.InterfaceRoleType), options are:
	public void com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType)

      JPMethodDispatch::findOverload: EXCEPTION FROM:  native/common/jp_methoddispatch.cpp 184
      JPMethodDispatch::findOverload: EXCEPTION FROM:  native/common/jp_methoddispatch.cpp 195
    EXCEPTION! JPMethodDispatch::findOverload
    JPMethodDispatch::invoke: EXCEPTION FROM:  native/common/jp_methoddispatch.cpp 204
  EXCEPTION! JPMethodDispatch::invoke
  > PyJPModule_rethrow
    PyJPModule_rethrow: native/python/pyjp_method.cpp 110
    PyJPModule_rethrow: EXCEPTION FROM:  native/python/pyjp_method.cpp 110
    > JPypeException::toPython
      > JPypeException::getMessage
        JPypeException::getMessage: No matching overloads found for com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType), options are:
	public void com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType)

      < JPypeException::getMessage
      JPypeException::toPython: 0x854e60
      JPypeException::toPython: No matching overloads found for com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType), options are:
	public void com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType)

      JPypeException::toPython: type
    < JPypeException::toPython
  < PyJPModule_rethrow
< PyJPMethod_call
> PyJPMethod_dealloc
< PyJPMethod_dealloc
TypeError: No matching overloads found for com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType), options are:
	public void com.model.impl.InterfaceImpl.setRole(com.model.InterfaceRoleType)

Did you able to reproduce the above issue?


RAWGraphs version in interface

RAWGraphs version in no more visible through the interface, but we're asking to the users to tell it us in order to open new issues. Is it planned to re-add it? Otherwise we must update the issue template

duplicate of #274


errors occurred during "npm i"

E:\mastering-angular-starter>npm i
npm WARN deprecated<EMAIL_ADDRESS>ReDoS vulnerability parsing Set-Cookie https://nodesecurity.io/advisories/130
npm WARN deprecated<EMAIL_ADDRESS>Use uuid module instead

<EMAIL_ADDRESS>install E:\mastering-angular-starter\node_modules\phantomjs-prebuilt
node install.js

PhantomJS not found on PATH
Download already available at C:\Users\livnat_d\AppData\Local\Temp\phantomjs\phantomjs-2.1.1-windows.zip
Verified checksum of previously downloaded file
Extracting zip contents
Removing E:\mastering-angular-starter\node_modules\phantomjs-prebuilt\lib\phantom
Copying extracted folder C:\Users\livnat_d\AppData\Local\Temp\phantomjs\phantomjs-2.1.1-windows.zip-extract-1503487576408\phantomjs-2.1.1-windows -> E:\mastering-angular-starter\node_modu
les\phantomjs-prebuilt\lib\phantom
Writing location.js file
Done. Phantomjs binary available at E:\mastering-angular-starter\node_modules\phantomjs-prebuilt\lib\phantom\bin\phantomjs.exe

<EMAIL_ADDRESS>install E:\mastering-angular-starter\node_modules\node-sass
node scripts/install.js

Downloading binary from https://github.com/sass/node-sass/releases/download/v4.5.0/win32-x64-57_binding.node
Cannot download "https://github.com/sass/node-sass/releases/download/v4.5.0/win32-x64-57_binding.node":
HTTP error 404 Not Found
Hint: If github.com is not accessible in your location
try setting a proxy via HTTP_PROXY, e.g.
  export HTTP_PROXY=http://example.com:1234

or configure npm proxy via
  npm config set proxy http://example.com:8080

<EMAIL_ADDRESS>postinstall E:\mastering-angular-starter\node_modules\node-sass
node scripts/build.js

Building: C:\Program Files\nodejs\node.exe E:\mastering-angular-starter\node_modules\node-gyp\bin\node-gyp.js rebuild --verbose --libsass_ext= --libsass_cflags= --libsass_ldflags= --libsa
ss_library=
gyp info it worked if it ends with ok
gyp verb cli [ 'C:\Program Files\nodejs\node.exe',
gyp verb cli   'E:\mastering-angular-starter\node_modules\node-gyp\bin\node-gyp.js',
gyp verb cli   'rebuild',
gyp verb cli   '--verbose',
gyp verb cli   '--libsass_ext=',
gyp verb cli   '--libsass_cflags=',
gyp verb cli   '--libsass_ldflags=',
gyp verb cli   '--libsass_library=' ]
gyp info using<EMAIL_ADDRESS>gyp info using<EMAIL_ADDRESS>| win32 | x64
gyp verb command rebuild []
gyp verb command clean []
gyp verb clean removing "build" directory
gyp verb command configure []
gyp verb check python checking for Python executable "python2" in the PATH
gyp verb which failed Error: not found: python2
gyp verb which failed     at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)
gyp verb which failed     at F (E:\mastering-angular-starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)
gyp verb which failed     at E:\mastering-angular-starter\node_modules\which\which.js:89:16
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed  python2 { Error: not found: python2
gyp verb which failed     at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)
gyp verb which failed     at F (E:\mastering-angular-starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)
gyp verb which failed     at E:\mastering-angular-starter\node_modules\which\which.js:89:16
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed   stack: 'Error: not found: python2\n    at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)\n    at F (E:\mastering-angular-
starter\node_modules\which\which.js:68:19)\n    at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)\n    at E:\mastering-angular-starter\node_modules\which\wh
ich.js:89:16\n    at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5\n    at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5\n    at FSReqWrap.oncomp
lete (fs.js:152:21)',
gyp verb which failed   code: 'ENOENT' }
gyp verb check python checking for Python executable "python" in the PATH
gyp verb which failed Error: not found: python
gyp verb which failed     at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)
gyp verb which failed     at F (E:\mastering-angular-starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)
gyp verb which failed     at E:\mastering-angular-starter\node_modules\which\which.js:89:16
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed  python { Error: not found: python
gyp verb which failed     at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)
gyp verb which failed     at F (E:\mastering-angular-starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)
gyp verb which failed     at E:\mastering-angular-starter\node_modules\which\which.js:89:16
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed   stack: 'Error: not found: python\n    at getNotFoundError (E:\mastering-angular-starter\node_modules\which\which.js:13:12)\n    at F (E:\mastering-angular-s
tarter\node_modules\which\which.js:68:19)\n    at E (E:\mastering-angular-starter\node_modules\which\which.js:80:29)\n    at E:\mastering-angular-starter\node_modules\which\whi
ch.js:89:16\n    at E:\mastering-angular-starter\node_modules\isexe\index.js:42:5\n    at E:\mastering-angular-starter\node_modules\isexe\windows.js:36:5\n    at FSReqWrap.oncompl
ete (fs.js:152:21)',
gyp verb which failed   code: 'ENOENT' }
gyp verb could not find "python". checking python launcher
gyp verb could not find "python". guessing location
gyp verb ensuring that file exists: C:\Python27\python.exe
gyp ERR! configure error
gyp ERR! stack Error: Can't find Python executable "python", you can set the PYTHON env variable.
gyp ERR! stack     at PythonFinder.failNoPython (E:\mastering-angular-starter\node_modules\node-gyp\lib\configure.js:483:19)
gyp ERR! stack     at PythonFinder. (E:\mastering-angular-starter\node_modules\node-gyp\lib\configure.js:508:16)
gyp ERR! stack     at E:\mastering-angular-starter\node_modules\graceful-fs\polyfills.js:284:29
gyp ERR! stack     at FSReqWrap.oncomplete (fs.js:152:21)
gyp ERR! System Windows_NT 10.0.15063
gyp ERR! command "C:\Program Files\nodejs\node.exe" "E:\mastering-angular-starter\node_modules\node-gyp\bin\node-gyp.js" "rebuild" "--verbose" "--libsass_ext=" "--libsass_cflags="
"--libsass_ldflags=" "--libsass_library="
gyp ERR! cwd E:\mastering-angular-starter\node_modules\node-sass
gyp ERR! node -v v8.4.0
gyp ERR! node-gyp -v v3.6.2
gyp ERR! not ok
Build failed with error code: 1
npm WARN The package tslint is included as both a dev and production dependency.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules\fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for<EMAIL_ADDRESS>wanted {"os":"darwin","arch":"any"} (current: {"os":"win32","arch":"x64"})
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>postinstall: node scripts/build.js
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>postinstall script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR!      C:\Users\livnat_d\AppData\Roaming\npm-cache_logs\2017-08-23T11_26_22_311Z-debug.log

You need to install Python 2.7 so that NodeGyp can build the appropriate NodeSass binary for you. Thanks!

did what you say and still....
C:\Users\livnat damari\Documents\Mastering-Angular-Starter>npm i
npm WARN deprecated<EMAIL_ADDRESS>ReDoS vulnerability parsing Set-Cookie https://nodesecurity.io/advisories/130
npm WARN deprecated<EMAIL_ADDRESS>Use uuid module instead

<EMAIL_ADDRESS>install C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\phantomjs-prebuilt
node install.js

PhantomJS not found on PATH
Downloading https://github.com/Medium/phantomjs/releases/download/v2.1.1//phantomjs-2.1.1-windows.zip
Saving to C:\Users\LIVNAT~1\AppData\Local\Temp\phantomjs\phantomjs-2.1.1-windows.zip
Receiving...
[=======================================-] 99%
Received 17767K total.
Extracting zip contents
Removing C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\phantomjs-prebuilt\lib\phantom
Copying extracted folder C:\Users\LIVNAT~1\AppData\Local\Temp\phantomjs\phantomjs-2.1.1-windows.zip-extract-1503564919957\phantomjs-2.
1.1-windows -> C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\phantomjs-prebuilt\lib\phantom
Writing location.js file
Done. Phantomjs binary available at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\phantomjs-prebuilt\lib\pha
ntom\bin\phantomjs.exe

<EMAIL_ADDRESS>install C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
node scripts/install.js

Downloading binary from https://github.com/sass/node-sass/releases/download/v4.5.0/win32-x64-57_binding.node
Cannot download "https://github.com/sass/node-sass/releases/download/v4.5.0/win32-x64-57_binding.node":
HTTP error 404 Not Found
Hint: If github.com is not accessible in your location
try setting a proxy via HTTP_PROXY, e.g.
  export HTTP_PROXY=http://example.com:1234

or configure npm proxy via
  npm config set proxy http://example.com:8080

<EMAIL_ADDRESS>postinstall C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
node scripts/build.js

Building: C:\Program Files\nodejs\node.exe C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-gyp\bin\node-g
yp.js rebuild --verbose --libsass_ext= --libsass_cflags= --libsass_ldflags= --libsass_library=
gyp info it worked if it ends with ok
gyp verb cli [ 'C:\Program Files\nodejs\node.exe',
gyp verb cli   'C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-gyp\bin\node-gyp.js',
gyp verb cli   'rebuild',
gyp verb cli   '--verbose',
gyp verb cli   '--libsass_ext=',
gyp verb cli   '--libsass_cflags=',
gyp verb cli   '--libsass_ldflags=',
gyp verb cli   '--libsass_library=' ]
gyp info using<EMAIL_ADDRESS>gyp info using<EMAIL_ADDRESS>| win32 | x64
gyp verb command rebuild []
gyp verb command clean []
gyp verb clean removing "build" directory
gyp verb command configure []
gyp verb check python checking for Python executable "python2" in the PATH
gyp verb which failed Error: not found: python2
gyp verb which failed     at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.j
s:13:12)
gyp verb which failed     at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:80:29)
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed  python2 { Error: not found: python2
gyp verb which failed     at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.j
s:13:12)
gyp verb which failed     at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:80:29)
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed   stack: 'Error: not found: python2\n    at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-A
ngular-Starter\node_modules\which\which.js:13:12)\n    at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_m
odules\which\which.js:68:19)\n    at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.j
s:80:29)\n    at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16\n    at C:\Users
\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5\n    at C:\Users\livnat damari\Documents
\Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5\n    at FSReqWrap.oncomplete (fs.js:152:21)',
gyp verb which failed   code: 'ENOENT' }
gyp verb check python checking for Python executable "python" in the PATH
gyp verb which failed Error: not found: python
gyp verb which failed     at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.j
s:13:12)
gyp verb which failed     at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:80:29)
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed  python { Error: not found: python
gyp verb which failed     at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.j
s:13:12)
gyp verb which failed     at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:68:19)
gyp verb which failed     at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:80:29)
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5
gyp verb which failed     at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5
gyp verb which failed     at FSReqWrap.oncomplete (fs.js:152:21)
gyp verb which failed   stack: 'Error: not found: python\n    at getNotFoundError (C:\Users\livnat damari\Documents\Mastering-An
gular-Starter\node_modules\which\which.js:13:12)\n    at F (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_mo
dules\which\which.js:68:19)\n    at E (C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js
:80:29)\n    at C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\which\which.js:89:16\n    at C:\Users
\livnat damari\Documents\Mastering-Angular-Starter\node_modules\isexe\index.js:42:5\n    at C:\Users\livnat damari\Documents\
Mastering-Angular-Starter\node_modules\isexe\windows.js:36:5\n    at FSReqWrap.oncomplete (fs.js:152:21)',
gyp verb which failed   code: 'ENOENT' }
gyp verb could not find "python". checking python launcher
gyp verb could not find "python". guessing location
gyp verb ensuring that file exists: C:\Python27\python.exe
gyp verb check python version C:\Python27\python.exe -c "import platform; print(platform.python_version());" returned: "2.7.13\r\n"
gyp verb get node dir no --target version specified, falling back to host node version: 8.4.0
gyp verb command install [ '8.4.0' ]
gyp verb install input version string "8.4.0"
gyp verb install installing version: 8.4.0
gyp verb install --ensure was passed, so won't reinstall if already installed
gyp verb install version not already installed, continuing with install 8.4.0
gyp verb ensuring nodedir is created C:\Users\livnat damari.node-gyp\8.4.0
gyp verb created nodedir C:\Users\livnat damari.node-gyp
gyp http GET https://nodejs.org/download/release/v8.4.0/node-v8.4.0-headers.tar.gz
gyp http 200 https://nodejs.org/download/release/v8.4.0/node-v8.4.0-headers.tar.gz
gyp verb extracted file from tarball include\node\android-ifaddrs.h
gyp verb extracted file from tarball include\node\common.gypi
gyp verb extracted file from tarball include\node\config.gypi
gyp verb extracted file from tarball include\node\node.h
gyp verb extracted file from tarball include\node\node_api.h
gyp verb extracted file from tarball include\node\node_api_types.h
gyp verb extracted file from tarball include\node\node_buffer.h
gyp verb extracted file from tarball include\node\node_object_wrap.h
gyp verb extracted file from tarball include\node\node_version.h
gyp verb extracted file from tarball include\node\pthread-barrier.h
gyp verb extracted file from tarball include\node\stdint-msvc2008.h
gyp verb extracted file from tarball include\node\tree.h
gyp verb extracted file from tarball include\node\uv-aix.h
gyp verb extracted file from tarball include\node\uv-bsd.h
gyp verb extracted file from tarball include\node\uv-darwin.h
gyp verb extracted file from tarball include\node\uv-errno.h
gyp verb extracted file from tarball include\node\uv-linux.h
gyp verb extracted file from tarball include\node\uv-os390.h
gyp verb extracted file from tarball include\node\uv-posix.h
gyp verb extracted file from tarball include\node\uv-sunos.h
gyp verb extracted file from tarball include\node\uv-threadpool.h
gyp verb extracted file from tarball include\node\uv-unix.h
gyp verb extracted file from tarball include\node\uv-version.h
gyp verb extracted file from tarball include\node\uv-win.h
gyp verb extracted file from tarball include\node\uv.h
gyp verb extracted file from tarball include\node\v8-debug.h
gyp verb extracted file from tarball include\node\v8-inspector-protocol.h
gyp verb extracted file from tarball include\node\v8-inspector.h
gyp verb extracted file from tarball include\node\v8-platform.h
gyp verb extracted file from tarball include\node\v8-profiler.h
gyp verb extracted file from tarball include\node\v8-testing.h
gyp verb extracted file from tarball include\node\v8-util.h
gyp verb extracted file from tarball include\node\v8-value-serializer-version.h
gyp verb extracted file from tarball include\node\v8-version-string.h
gyp verb extracted file from tarball include\node\v8-version.h
gyp verb extracted file from tarball include\node\v8.h
gyp verb extracted file from tarball include\node\v8config.h
gyp verb extracted file from tarball include\node\zconf.h
gyp verb extracted file from tarball include\node\zlib.h
gyp verb extracted file from tarball include\node\openssl\aes.h
gyp verb extracted file from tarball include\node\openssl\asn1.h
gyp verb extracted file from tarball include\node\openssl\asn1_mac.h
gyp verb extracted file from tarball include\node\openssl\asn1t.h
gyp verb extracted file from tarball include\node\openssl\bio.h
gyp verb extracted file from tarball include\node\openssl\blowfish.h
gyp verb extracted file from tarball include\node\openssl\bn.h
gyp verb extracted file from tarball include\node\openssl\buffer.h
gyp verb extracted file from tarball include\node\openssl\camellia.h
gyp verb extracted file from tarball include\node\openssl\cast.h
gyp verb extracted file from tarball include\node\openssl\cmac.h
gyp verb extracted file from tarball include\node\openssl\cms.h
gyp verb extracted file from tarball include\node\openssl\comp.h
gyp verb extracted file from tarball include\node\openssl\conf.h
gyp verb extracted file from tarball include\node\openssl\conf_api.h
gyp verb extracted file from tarball include\node\openssl\crypto.h
gyp verb extracted file from tarball include\node\openssl\des.h
gyp verb extracted file from tarball include\node\openssl\des_old.h
gyp verb extracted file from tarball include\node\openssl\dh.h
gyp verb extracted file from tarball include\node\openssl\dsa.h
gyp verb extracted file from tarball include\node\openssl\dso.h
gyp verb extracted file from tarball include\node\openssl\dtls1.h
gyp verb extracted file from tarball include\node\openssl\e_os2.h
gyp verb extracted file from tarball include\node\openssl\ebcdic.h
gyp verb extracted file from tarball include\node\openssl\ec.h
gyp verb extracted file from tarball include\node\openssl\ecdh.h
gyp verb extracted file from tarball include\node\openssl\ecdsa.h
gyp verb extracted file from tarball include\node\openssl\engine.h
gyp verb extracted file from tarball include\node\openssl\err.h
gyp verb extracted file from tarball include\node\openssl\evp.h
gyp verb extracted file from tarball include\node\openssl\hmac.h
gyp verb extracted file from tarball include\node\openssl\idea.h
gyp verb extracted file from tarball include\node\openssl\krb5_asn.h
gyp verb extracted file from tarball include\node\openssl\kssl.h
gyp verb extracted file from tarball include\node\openssl\lhash.h
gyp verb content checksum node-v8.4.0-headers.tar.gz 724d091c6610255ece8c310e7e3924f0e675d1486d63bca34e7ac0c8c8e07497
gyp verb extracted file from tarball include\node\openssl\md4.h
gyp verb extracted file from tarball include\node\openssl\md5.h
gyp verb extracted file from tarball include\node\openssl\mdc2.h
gyp verb extracted file from tarball include\node\openssl\modes.h
gyp verb extracted file from tarball include\node\openssl\obj_mac.h
gyp verb extracted file from tarball include\node\openssl\objects.h
gyp verb extracted file from tarball include\node\openssl\ocsp.h
gyp verb extracted file from tarball include\node\openssl\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\opensslv.h
gyp verb extracted file from tarball include\node\openssl\ossl_typ.h
gyp verb extracted file from tarball include\node\openssl\pem.h
gyp verb extracted file from tarball include\node\openssl\pem2.h
gyp verb extracted file from tarball include\node\openssl\pkcs12.h
gyp verb extracted file from tarball include\node\openssl\pkcs7.h
gyp verb extracted file from tarball include\node\openssl\pqueue.h
gyp verb extracted file from tarball include\node\openssl\rand.h
gyp verb extracted file from tarball include\node\openssl\rc2.h
gyp verb extracted file from tarball include\node\openssl\rc4.h
gyp verb extracted file from tarball include\node\openssl\ripemd.h
gyp verb extracted file from tarball include\node\openssl\rsa.h
gyp verb extracted file from tarball include\node\openssl\safestack.h
gyp verb extracted file from tarball include\node\openssl\seed.h
gyp verb extracted file from tarball include\node\openssl\sha.h
gyp verb extracted file from tarball include\node\openssl\srp.h
gyp verb extracted file from tarball include\node\openssl\srtp.h
gyp verb extracted file from tarball include\node\openssl\ssl.h
gyp verb extracted file from tarball include\node\openssl\ssl2.h
gyp verb extracted file from tarball include\node\openssl\ssl23.h
gyp verb extracted file from tarball include\node\openssl\ssl3.h
gyp verb extracted file from tarball include\node\openssl\stack.h
gyp verb extracted file from tarball include\node\openssl\symhacks.h
gyp verb extracted file from tarball include\node\openssl\tls1.h
gyp verb extracted file from tarball include\node\openssl\ts.h
gyp verb extracted file from tarball include\node\openssl\txt_db.h
gyp verb extracted file from tarball include\node\openssl\ui.h
gyp verb extracted file from tarball include\node\openssl\ui_compat.h
gyp verb extracted file from tarball include\node\openssl\whrlpool.h
gyp verb extracted file from tarball include\node\openssl\x509.h
gyp verb extracted file from tarball include\node\openssl\x509_vfy.h
gyp verb extracted file from tarball include\node\openssl\x509v3.h
gyp verb extracted file from tarball include\node\openssl\archs\VC-WIN64A\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\VC-WIN32\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\solaris64-x86_64-gcc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\solaris-x86-gcc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux64-s390x\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux32-s390x\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-x86_64\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-x32\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-ppc64\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-ppc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-elf\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-armv4\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\linux-aarch64\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\darwin64-x86_64-cc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\darwin-i386-cc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\BSD-x86_64\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\BSD-x86\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\aix64-gcc\opensslconf.h
gyp verb extracted file from tarball include\node\openssl\archs\aix-gcc\opensslconf.h
gyp verb extracted file from tarball include\node\libplatform\libplatform-export.h
gyp verb extracted file from tarball include\node\libplatform\libplatform.h
gyp verb extracted file from tarball include\node\libplatform\v8-tracing.h
gyp verb tarball done parsing tarball
gyp verb on Windows; need to download node.lib...
gyp verb 32-bit node.lib dir C:\Users\livnat damari.node-gyp\8.4.0\ia32
gyp verb 64-bit node.lib dir C:\Users\livnat damari.node-gyp\8.4.0\x64
gyp verb node.lib 32-bit url https://nodejs.org/download/release/v8.4.0/win-x86/node.lib
gyp verb node.lib 64-bit url https://nodejs.org/download/release/v8.4.0/win-x64/node.lib
gyp verb check download content checksum, need to download SHASUMS256.txt...
gyp verb checksum url https://nodejs.org/download/release/v8.4.0/SHASUMS256.txt
gyp http GET https://nodejs.org/download/release/v8.4.0/SHASUMS256.txt
gyp verb streaming 32-bit node.lib to: C:\Users\livnat damari.node-gyp\8.4.0\ia32\node.lib
gyp http GET https://nodejs.org/download/release/v8.4.0/win-x86/node.lib
gyp verb streaming 64-bit node.lib to: C:\Users\livnat damari.node-gyp\8.4.0\x64\node.lib
gyp http GET https://nodejs.org/download/release/v8.4.0/win-x64/node.lib
gyp http 200 https://nodejs.org/download/release/v8.4.0/SHASUMS256.txt
gyp verb checksum data {"node-v8.4.0-aix-ppc64.tar.gz":"9007e961fc9a2a8badb656ebaab52077347113d7618806e7aa502a71eab3f5aa","node-v8.4.0
-darwin-x64.tar.gz":"cc10ffbd11586bd27a7cc5e6e2d03fd3e0b341368387a03ee9a0117a0288599d","node-v8.4.0-darwin-x64.tar.xz":"e88e41ff5566f1
e79f88d116bcc0013ac423741e85bd40d91775ca8f4e5141a1","node-v8.4.0-headers.tar.gz":"724d091c6610255ece8c310e7e3924f0e675d1486d63bca34e7a
c0c8c8e07497","node-v8.4.0-headers.tar.xz":"bd56ece5c3f66492c178f3affb9a9dc0dfbf121dd21b52c9e04071dc2e9b8b61","node-v8.4.0-linux-arm64
.tar.gz":"a85225930dadf0b8161f95fe7e0e81e8840a8e20623cb5a7b5c61fced10ed7f0","node-v8.4.0-linux-arm64.tar.xz":"0a811bbe4905fc879f3cbfc9
76e5a37cca05bbd609774abe4332b29fea75f073","node-v8.4.0-linux-armv6l.tar.gz":"c8812b7cdce2de297d320145dab11e521a6734d0a3f42e67f86f80b1b
b5984a0","node-v8.4.0-linux-armv6l.tar.xz":"b11309baa172bbd6b6ffaf0338f9529adcf27fb64e53de65763936b9f1ff924e","node-v8.4.0-linux-armv7
l.tar.gz":"11c4e8831c967d152ed098602eaae6fcb0e30ba1f24a9e5781a71c4e7d2314ad","node-v8.4.0-linux-armv7l.tar.xz":"a7e79224d98b0f419bd3af
0b751f3e369b12a9fb4405b970fc31e552233ae768","node-v8.4.0-linux-ppc64le.tar.gz":"951a95beb22ccb18543d7ecfe3e81f7f8dfe384dd582789d080d8d
56847437a0","node-v8.4.0-linux-ppc64le.tar.xz":"e3fa79996878e340ce6fc39cde5704658bde4315ae1ccd11d34100a9d2637838","node-v8.4.0-linux-p
pc64.tar.gz":"038c79f078bbbfa873fe89b6c81f791fb7b82960f55d096dbc0e46a3ead84371","node-v8.4.0-linux-ppc64.tar.xz":"9e32ed12e2abc2a32452
37929674c1b91a7e296bb7cb656c31c364e8f3df1613","node-v8.4.0-linux-s390x.tar.gz":"b6a9e13501b94319e133f6726cc75d9a4c50588ce2db4f1b2e0153
1694b0d7bb","node-v8.4.0-linux-s390x.tar.xz":"5bb1a98dbd9376b7b605450f478de32027afa10e591d0384ba8bab6603ff12f5","node-v8.4.0-linux-x64
.tar.gz":"d12bf2389a6b57341528a33de62561edd7ef25c23fbf258d48758fbe3d1d8578","node-v8.4.0-linux-x64.tar.xz":"7fd86abad06f96cb2f889c2a0e
25686a3de3e9a078ad946ded91ee4f28d8218a","node-v8.4.0-linux-x86.tar.gz":"9880c5d4c0dc460643fdc5ac1e3092223a3d659e3528842572d75df8565c22
fe","node-v8.4.0-linux-x86.tar.xz":"2c5568156e69eca245886c1c583aaab6c26803bc42508aff7271bbcf51710cef","node-v8.4.0.pkg":"d9565d5fa3388
e2c62404a0d661a5071ba004c7a2e606dae72680b6c8d9a2c02","node-v8.4.0-sunos-x64.tar.gz":"995de5082fb9ea56c2ab8e2be41d93c283c92efdd2cf73561
6608a736e2adcb3","node-v8.4.0-sunos-x64.tar.xz":"bc9acc06db8c3f683a29028426d7ffb25570a3f2519d05c16f6991b6994b95e4","node-v8.4.0-sunos-
x86.tar.gz":"3e5f462c579beaa0a6685812a663b7d557a1d3e75dd4314d620e7b1e609b8447","node-v8.4.0-sunos-x86.tar.xz":"fd3e432564857ae02f92fb8
befe5107435b3a51c0bd92ecf76b936ee066a30aa","node-v8.4.0.tar.gz":"641a15fa822710ef2dc99793fec48d2a8ef75de0040b86568563d4ab296137ef","no
de-v8.4.0.tar.xz":"5d5aa2a101dcc617231a475812eb8ed87cac21491f1dcc7997b9dd463563f361","node-v8.4.0-win-x64.7z":"09f46de9e0dcfc89a2ed9a6
7a33a40091125f00779198f4cc8df7876abf743f3","node-v8.4.0-win-x64.zip":"0f60c99479f74d75c7239795c90698826ba8252019d4c23e82ed0d72ceb8974f
","node-v8.4.0-win-x86.7z":"cdf4bf3136e2d3a68186297869121a610e26028ade8d6b403f85ba0fe306a341","node-v8.4.0-win-x86.zip":"1769297605118
2b402943f44458b9f9a433c3405deaa033c6c3b5fd7d43434a8","node-v8.4.0-x64.msi":"8efbd1b94ff8338bd36a1c30a86aba4fae3b80b61e265401fa97e7a4c5
478ab2","node-v8.4.0-x86.msi":"6724defb5e3cab388d6777f7d999db979d817f51537309b67adaf06569af198f","win-x64/node.exe":"a1d79afe335d0a8cf
f2e72100cdadaf6f91f59fcd5a8186da1b99bead9bcd601","win-x64/node.lib":"d714da87f8bb03248cbe4e9891cdfb28ec8fd7ed84fc77a1ea16e38f061fc19c"
,"win-x64/node_pdb.7z":"5d00c65a03e4ae48d3720919bd181ad5aea6f33ebc0f75c485122b84f9ca4fdb","win-x64/node_pdb.zip":"49fb81d624e8e34b0689
7a0336b3830671c34a867c47a90686fe1006aa9248e9","win-x86/node.exe":"ea9399e1f9eafaf6be6608f1401ebb84cf7444ffadabf0b80ba2c186cf7028fa","w
in-x86/node.lib":"28b8412ede7f9ab889680cb5819896e852a466ea176b6d06bba612b39ebfb272","win-x86/node_pdb.7z":"454b4baa220e4980613345ce057
474f311fd6bce91cc6322cf66ac535c44d4ce","win-x86/node_pdb.zip":"21cf63479cb6c781a9cbda87f7dbc5abafb815abc3bd59deb4c0755e23190659"}
gyp http 200 https://nodejs.org/download/release/v8.4.0/win-x64/node.lib
gyp http 200 https://nodejs.org/download/release/v8.4.0/win-x86/node.lib
gyp verb content checksum win-x86/node.lib 28b8412ede7f9ab889680cb5819896e852a466ea176b6d06bba612b39ebfb272
gyp verb content checksum win-x64/node.lib d714da87f8bb03248cbe4e9891cdfb28ec8fd7ed84fc77a1ea16e38f061fc19c
gyp verb download contents checksum {"node-v8.4.0-headers.tar.gz":"724d091c6610255ece8c310e7e3924f0e675d1486d63bca34e7ac0c8c8e07497","
win-x86/node.lib":"28b8412ede7f9ab889680cb5819896e852a466ea176b6d06bba612b39ebfb272","win-x64/node.lib":"d714da87f8bb03248cbe4e9891cdf
b28ec8fd7ed84fc77a1ea16e38f061fc19c"}
gyp verb validating download checksum for node-v8.4.0-headers.tar.gz (724d091c6610255ece8c310e7e3924f0e675d1486d63bca34e7ac0c8c8e07497
== 724d091c6610255ece8c310e7e3924f0e675d1486d63bca34e7ac0c8c8e07497)
gyp verb validating download checksum for win-x86/node.lib (28b8412ede7f9ab889680cb5819896e852a466ea176b6d06bba612b39ebfb272 == 28b841
2ede7f9ab889680cb5819896e852a466ea176b6d06bba612b39ebfb272)
gyp verb validating download checksum for win-x64/node.lib (d714da87f8bb03248cbe4e9891cdfb28ec8fd7ed84fc77a1ea16e38f061fc19c == d714da
87f8bb03248cbe4e9891cdfb28ec8fd7ed84fc77a1ea16e38f061fc19c)
gyp verb get node dir target node version installed: 8.4.0
gyp verb build dir attempting to create "build" dir: C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
\build
gyp verb build dir "build" dir needed to be created? C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
\build
gyp verb find vs2017 Found installation at: C:\Program Files (x86)\Microsoft Visual Studio\2017\Community
gyp verb find vs2017   - Missing Visual Studio C++ core features (Microsoft.VisualStudio.VC.MSBuild.Base)
gyp verb find vs2017   - Missing VC++ 2017 v141 toolset (x86,x64) (Microsoft.VisualStudio.Component.VC.Tools.x86.x64)
gyp verb find vs2017   - Missing a Windows SDK (Microsoft.VisualStudio.Component.Windows10SDK.* or Microsoft.VisualStudio.Component.Wi
ndows81SDK)
gyp verb find vs2017   - Some required components are missing, not using this installation
gyp verb Not using VS2017: No usable installation of VS2017 found
gyp verb build/config.gypi creating config file
gyp verb build/config.gypi writing out config file: C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
build\config.gypi
gyp verb config.gypi checking for gypi file: C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\config.
gypi
gyp verb common.gypi checking for gypi file: C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\common.
gypi
gyp verb gyp gyp format was not specified; forcing "msvs"
gyp info spawn C:\Python27\python.exe
gyp info spawn args [ 'C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-gyp\gyp\gyp_main.py',
gyp info spawn args   'binding.gyp',
gyp info spawn args   '-f',
gyp info spawn args   'msvs',
gyp info spawn args   '-G',
gyp info spawn args   'msvs_version=auto',
gyp info spawn args   '-I',
gyp info spawn args   'C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build\config.gypi',
gyp info spawn args   '-I',
gyp info spawn args   'C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-gyp\addon.gypi',
gyp info spawn args   '-I',
gyp info spawn args   'C:\Users\livnat damari\.node-gyp\8.4.0\include\node\common.gypi',
gyp info spawn args   '-Dlibrary=shared_library',
gyp info spawn args   '-Dvisibility=default',
gyp info spawn args   '-Dnode_root_dir=C:\Users\livnat damari\.node-gyp\8.4.0',
gyp info spawn args   '-Dnode_gyp_dir=C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-gyp',
gyp info spawn args   '-Dnode_lib_file=C:\Users\livnat damari\.node-gyp\8.4.0\<(target_arch)\node.lib',
gyp info spawn args   '-Dmodule_root_dir=C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass',
gyp info spawn args   '-Dnode_engine=v8',
gyp info spawn args   '--depth=.',
gyp info spawn args   '--no-parallel',
gyp info spawn args   '--generator-output',
gyp info spawn args   'C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build',
gyp info spawn args   '-Goutput_dir=.' ]
gyp verb command build []
gyp verb build type Release
gyp verb architecture x64
gyp verb node dev dir C:\Users\livnat damari.node-gyp\8.4.0
gyp verb found first Solution file build/binding.sln
gyp verb could not find "msbuild.exe" in PATH - finding location in registry
gyp info spawn C:\Windows\Microsoft.NET\Framework\v4.0.30319\msbuild.exe
gyp info spawn args [ 'build/binding.sln',
gyp info spawn args   '/nologo',
gyp info spawn args   '/p:Configuration=Release;Platform=x64' ]
Building the projects in this solution one at a time. To enable parallel build, please add the "/m" switch.
Build started 24/08/2017 11:55:39.
Project "C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build\binding.sln" on node 1 (default targ
ets).
ValidateSolutionConfiguration:
Building solution configuration "Release|x64".
MSBUILD : error MSB3428: Could not load the Visual C++ component "VCBuild.exe". To fix this, 1) install the .NET Framework 2.0 SDK, 2
) install Microsoft Visual Studio 2005 or 3) add the location of the component to the system path if it is installed elsewhere.  [C:
Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build\binding.sln]
Done Building Project "C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build\binding.sln" (default
targets) -- FAILED.
Build FAILED.
"C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass\build\binding.sln" (default target) (1) ->
(src\libsass target) ->
MSBUILD : error MSB3428: Could not load the Visual C++ component "VCBuild.exe". To fix this, 1) install the .NET Framework 2.0 SDK,
2) install Microsoft Visual Studio 2005 or 3) add the location of the component to the system path if it is installed elsewhere.   System Windows_NT 10.0.15063
gyp ERR! command "C:\Program Files\nodejs\node.exe" "C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\
node-gyp\bin\node-gyp.js" "rebuild" "--verbose" "--libsass_ext=" "--libsass_cflags=" "--libsass_ldflags=" "--libsass_library="
gyp ERR! cwd C:\Users\livnat damari\Documents\Mastering-Angular-Starter\node_modules\node-sass
gyp ERR! node -v v8.4.0
gyp ERR! node-gyp -v v3.6.2
gyp ERR! not ok
Build failed with error code: 1
npm WARN The package tslint is included as both a dev and production dependency.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules\fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for<EMAIL_ADDRESS>wanted {"os":"darwin","arch":"any"} (current: {
"os":"win32","arch":"x64"})
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>postinstall: node scripts/build.js
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>postinstall script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR!      C:\Users\livnat damari\AppData\Roaming\npm-cache_logs\2017-08-24T08_55_46_172Z-debug.log

really want to learn :-(

The problem is your machine needs to build some native modules with NodeGYP. NodeGYP cannot find the needed tools to do this such as Python 2 and regular Visual Studio. I would suggest using an earlier version of Node.js so binaries do not need to be built. Have you tried Node.js 7? I would downgrade to that first and try again. Thanks!
From: Livnat Damari<EMAIL_ADDRESS>Reply-To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Date: Thursday, August 24, 2017 at 05:08
To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Cc: "Eric W. Greene"<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [training4developers/mastering-angular-starter] errors occurred during "npm i" (#2)
really want to learn :-(
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

It's working :-)
Thank you very much.
I appreciate the quick response
You're awesome

Thank you!  I am glad it’s working! Have fun!
From: Livnat Damari<EMAIL_ADDRESS>Reply-To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Date: Thursday, August 24, 2017 at 07:40
To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Cc: "Eric W. Greene"<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [training4developers/mastering-angular-starter] errors occurred during "npm i" (#2)
It's working :-)
Thank you very much.
I appreciate the quick response
You're awesome
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

"You need to install Python". I really don’t want to...
"I would suggest using an earlier version of Node.js so binaries do not need to be built. Have you tried Node.js 7?"
Won't this impact other Angular stuff on my computer?

There are several tools to help switch Node.js versions. On Mac, a popular tool is NVM. For Windows, you can change Node.js installs very easily, or download the Node.js executable directly from nodejs.org. The Node platform is two executables, node.exe and npm.exe.
Concerning Python and NodeGYP those are required for platforms which do not have a precompiled binary for native packages. When using the latest Node.js it’s possible that binaries have not be created yet, and you will need not only Python but a C++ compiler to produce the package. This is a Node.js thing, not an Angular thing.
In modern JavaScript there are lots of moving parts, and as stuff gets updated constantly it’s good to learn the workings of the Node.js platform and it’s build system for native modules. These videos were originally created with Node.js 7, and this started project works with Node.js 8 (I have tested it) but the NodeSASS modules (last time I tested it) were not available for Node.js 8 so they have to be compiled locally as part of the NPM install process. This compilation is handled via NodeGYP for you automatically. If you install Python 2.7 and Visual Studio Community Edition with the C++ compiler, then you should be good to go.
From: Zex<EMAIL_ADDRESS>Reply-To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Date: Monday, August 28, 2017 at 09:52
To: training4developers/mastering-angular-starter<EMAIL_ADDRESS>Cc: "Eric W. Greene"<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [training4developers/mastering-angular-starter] errors occurred during "npm i" (#2)
"You need to install Python". I really don’t want to...
"I would suggest using an earlier version of Node.js so binaries do not need to be built. Have you tried Node.js 7?"
Won't this impact other Angular stuff on my computer?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.


Lxc file pull doesn't pull the correct symlink file in container

Required information

Distribution: ubuntu
Distribution version: 16.04
The output of "lxc info" or if that fails:

Kernel version: 4.10.0-42-generic
LXC version: 3.0.0
LXD version: 3.0.0
Storage backend in use: zfs

Issue description
I am trying to pull a symlink file in container to local machine. However, lxc file pull doesn't seem to be pulling the correct file from container like previously.
Steps to reproduce

lxc launch ubuntu:x test
lxc exec test -- sudo --login --user ubuntu

echo 'testing 123' | tee dummy.txt

ln -s dummy.txt ./dummy1.txt

exit

lxc file pull test/home/ubuntu/dummy1.txt .
cat dummmy1.txt
cat: dummy1.txt: No such file or directory

Information to attach

[ ] Any relevant kernel output (dmesg)
[ ] Container log (lxc info NAME --show-log)
[ ] Container configuration (lxc config show NAME --expanded)
[ ] Main daemon log (at /var/log/lxd/lxd.log or /var/snap/lxd/common/lxd/logs/lxd.log)
[ ] Output of the client with --debug
[ ] Output of the daemon with --debug (alternatively output of lxc monitor while reproducing the issue)

Actually, I think lxc file pull is doing exactly what you asked it to do in this case, it's just the error looking a bit confusing:
stgraber@castiana:~/data/code/lxc/lxd (stgraber/master)$ lxc exec test -- sudo --login --user ubuntu
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.

ubuntu@test:~$ echo 'testing 123' | tee dummy.txt
testing 123
ubuntu@test:~$ ln -s dummy.txt ./dummy1.txt
ubuntu@test:~$ ls -lh
total 1.0K
-rw-r--r-- 1 ubuntu ubuntu 12 Apr  5 21:52 dummy.txt
lrwxrwxrwx 1 ubuntu ubuntu  9 Apr  5 21:52 dummy1.txt -> dummy.txt
ubuntu@test:~$ logout
stgraber@castiana:~/data/code/lxc/lxd (stgraber/master)$ lxc file pull test/home/ubuntu/dummy1.txt .
stgraber@castiana:~/data/code/lxc/lxd (stgraber/master)$ ls -lh dummy1.txt
lrwxrwxrwx 1 stgraber domain admins 9 Apr  5 17:52 dummy1.txt -> dummy.txt

So whereas as it would mistakenly follow symlinks before, now it transfers the symlink properly.

I think what we should do is allow for "-r" to mean in such cases that you want to follow the symlink.
So:

"lxc file pull test/home/ubuntu/dummy1.txt ." would download the symlink
"lxc file pull -r test/home/ubuntu/dummy1.txt ." would attempt to download the target (I say attempt because the symlink could be broken)


Effort vs accomplishment

Letters for women are more likely to highlight effort (she is hard-working) instead of highlighting accomplishments (her research is groundbreaking).
Goal: Develop code that can read text for effort statements. If the text includes more effort statements, than accomplishment statements; return a summary that directs the author to add statements related to accomplishment.

Started work on this issue by creating two wordlists and a driver program to count words that fall in either category.

Grindstone adjectives (Trix & Psenka, 2003):

‘hardworking’, ‘conscientious’, ‘dependable’, ‘meticulous’, ‘thorough’, ‘diligent’, ‘dedicated’, and ‘careful’.

Occur in 34% letters for women, vs 23% letters for men

Several of these words are included in our female-coded word list.  I'll double check it and add in additional words.  Several articles highlight the fact that one of the big differences between letters form women vs. men is that letters for women describe effort or luck, while letters for men link success to intelligence and leadership.

Since this issue is still open, I'll add my comments here. @molliem or @j6k4m8 , let me know if you'd like me to make a separate issue instead.
The existing detector flags grindstone words even if I am not describing the candidate, but my own actions or beliefs as the writer. It seems like this should be possible to address with a little more sophisticated NLP.
The sentences in this screenshot are taken from an actual letter I wrote recently.

Yes we definitely should be leaning on some heftier NLP to solve this. (I want to replace ALL of our detectors that are simple word-detectors, for that matter.) The above is an excellent example.
I'd love to start collecting a list of test-documents (perhaps contrived, single-sentence examples like these?) that we can use in order to expect certain results. Feelings on that?
I'll try out a fix for this in an upcoming PR unless you'd like a student to tackle it?

Thanks for asking, @j6k4m8. I think we'll be entirely focused on the web interface for the next week, if not two.
@molliem and I spoke about this issue before I wrote about it here. She encouraged me to post a screenshot with a minimal example. I wonder whether these simple examples should go in complete example letters, or in pending test cases.


Literals as variables

In the code that @GeorgeR227 presented today, it looked like there was var"1.4" = 1.4 in the generated output. We should probably just propagate the constant into the generated AST everywhere.

@olynch, if we want to have literals in decapodes, then we should either relax the type constraint that variables have a variable name that is type symbol, or introduce a new table for literals. How relaxed can we go with a column type without breaking intertypes compatibility? For example, Union{Symbol, Number} should be fine. We can't do Union{Symbol, Float64} because with autodiff, the parameters be dual numbers, or for wave functions, they are complex.


Splatfacto in the wild

Implimentation of splatfacto in the wild and 2d background model for splatfacto.
https://kevinxu02.github.io/gsw.github.io/

This PR needs gsplat==1.0.0 or gsplat==0.1.12?

Currently it uses gsplat==0.1.12. I'll update it to gsplat==1.0.0 when I got time.

I think it is better If your PR pin specific gsplat and nerfstudio since the latest commit nerfstudio, it already pin gsplat==1.0.0.
When it merged to main nerfstudio repo, so it will use gsplat==1.0.0.
My idea, pinned your repo with nerfstudio==1.1.0 and gsplat==0.1.12

I think it is better If your PR pin specific gsplat and nerfstudio since the latest commit nerfstudio, it already pin gsplat==1.0.0.
When it merges to main nerfstudio repo, so it will use gsplat==1.0.0.
My idea, pinned your repo with nerfstudio==1.1.0 and gsplat==0.1.12

Thank you for your advice! I guess update this to gsplat==1.0.0 won't be super hard. 1.0 version of gsplat reduced the gram usage a lot thus making this new method can be ran on more devices. And the bg model could also be useful for newer version of nerfstudio.

Good luck 👍

Good luck 👍
BTW, why the default --steps-per-eval-all-images and --steps-per-eval-image' are set to 1000000` ?
Is there any problem if I lower it?

Good luck 👍
BTW, why the default --steps-per-eval-all-images and --steps-per-eval-image are set to 1000000 ?
Is there any problem if I lower it?

Because the eval for nerf in the wild uses left half eval images for training and another half for eval. I need to sort of hack the dataloader to make it work and it's ugly. It won't be a problem if you lower it, but it will always uses 0th image's appearance embedding for output.

I got error when I exported the splat
>>> ns-export gaussian-splat --load-config outputs/unnamed/splatfacto-w/2024-06-10_092617/config.yml --output-dir renders/MY_DATASET_SPLATWILD/

WARNING: Using slower TCNN CutlassMLP instead of TCNN FullyFusedMLP
Use layer width of 16, 32, 64, or 128 to use the faster TCNN FullyFusedMLP.

Loading latest checkpoint from load_dir
✅ Done loading checkpoint from outputs/unnamed/splatfacto-w/2024-06-10_092617/nerfstudio_models/step-000064999.ckpt
Traceback (most recent call last):
  File "/usr/local/bin/ns-export", line 8, in <module>
    sys.exit(entrypoint())
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 638, in entrypoint
    tyro.cli(Commands).main()
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 550, in main
    assert isinstance(pipeline.model, SplatfactoModel)
AssertionError

additional information
RTX A6000 48 GB
Ubuntu 22.04.3 LTS
python 3.10.12
torch 2.0.1+cu118
https://github.com/KevinXu02/nerfstudio/tree/splatfactow@eb9ee7a0aa7ac31ad768b5a5ac1b7eeae4af10ef
gsplat==0.1.12

I got error when I exported the splat
>>> ns-export gaussian-splat --load-config outputs/unnamed/splatfacto-w/2024-06-10_092617/config.yml --output-dir renders/MY_DATASET_SPLATWILD/

WARNING: Using slower TCNN CutlassMLP instead of TCNN FullyFusedMLP
Use layer width of 16, 32, 64, or 128 to use the faster TCNN FullyFusedMLP.

Loading latest checkpoint from load_dir
✅ Done loading checkpoint from outputs/unnamed/splatfacto-w/2024-06-10_092617/nerfstudio_models/step-000064999.ckpt
Traceback (most recent call last):
  File "/usr/local/bin/ns-export", line 8, in <module>
    sys.exit(entrypoint())
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 638, in entrypoint
    tyro.cli(Commands).main()
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 550, in main
    assert isinstance(pipeline.model, SplatfactoModel)
AssertionError

additional information
RTX A6000 48 GB
Ubuntu 22.04.3 LTS
python 3.10.12
torch 2.0.1+cu118
https://github.com/KevinXu02/nerfstudio/tree/splatfactow@eb9ee7a0aa7ac31ad768b5a5ac1b7eeae4af10ef
gsplat==0.1.12

I got error when I exported the splat
>>> ns-export gaussian-splat --load-config outputs/unnamed/splatfacto-w/2024-06-10_092617/config.yml --output-dir renders/MY_DATASET_SPLATWILD/

WARNING: Using slower TCNN CutlassMLP instead of TCNN FullyFusedMLP
Use layer width of 16, 32, 64, or 128 to use the faster TCNN FullyFusedMLP.

Loading latest checkpoint from load_dir
✅ Done loading checkpoint from outputs/unnamed/splatfacto-w/2024-06-10_092617/nerfstudio_models/step-000064999.ckpt
Traceback (most recent call last):
  File "/usr/local/bin/ns-export", line 8, in <module>
    sys.exit(entrypoint())
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 638, in entrypoint
    tyro.cli(Commands).main()
  File "/workspace/NERFSTUDIO_SPLATWILD/nerfstudio/nerfstudio/scripts/exporter.py", line 550, in main
    assert isinstance(pipeline.model, SplatfactoModel)
AssertionError

additional information
RTX A6000 48 GB
Ubuntu 22.04.3 LTS
python 3.10.12
torch 2.0.1+cu118
https://github.com/KevinXu02/nerfstudio/tree/splatfactow@eb9ee7a0aa7ac31ad768b5a5ac1b7eeae4af10ef
gsplat==0.1.12

I haven't added support for the export yet bc both the gs colors and the background are implicit and need to be specially handled when exporting. But you should be able to view the result in ns-viewer.
And for splatfacto the gaussians should can be correctly exported but the background should be lost if you enables it. I'm planning to export it as a sky box but the current viewer doesn't support rendering sky boxes.
Thank you for telling me this issue!

I think you can create splat for background scene which is shaped like sphere. The color is the interpolation of boundary of current splat. This idea is inspired from Luma AI.
Here is the outside of the sphere

Here is the inside of the sphere. I take this scene on (almost) the top of a mountain.

It supports gsplat 1.0 now and I keep the cull to bigs as the result would looks better.
This also includes a refined background logic.

Closing this since @KevinXu02  is planning on making a template repo!


Use chain builder tools to cleanup benchmarks

What is wrong?
The current benchmarks use an impromptu API to create the chains that are used for benchmarking.
How can it be fixed
We now have some more solid builder tools to create chains. These tools allow the creation of chains using a declarative, fluent API which we do use already in several tests.
https://github.com/ethereum/py-evm/blob/3061a48d112b2ae7d94adec89000372dd4bcac2c/tests/core/chain-object/test_chain_reorganization.py#L9-L17
We should be able to use the same tools to either use them in each benchmark directly and get rid of chain_plumbing.py altogether or, if that still turns out too boilerplatey, at least cleanup chain_plumbing.py to use the builder tools underneath.

@cburgdorf I have modified the chain_plumbing module by using builder tools. Please take a look at the PR #1364

One more thing to notice is that none of the functions of eth/tools/builder/chain in the builder tools have been typed. This is causing a pylint error. Should I type the functions?

Ok, looks like we should tackle #1366 first before we can move this forward

@Bhargavasomu The typing issue could be resolved by importing the functions individually.
Closing as this landed with https://github.com/ethereum/py-evm/pull/1364


[Improvement][Task] DataX Node doesn't Support Clickhouse as datasource (#5180)

Purpose of the pull request
This closes #5180, closes #5241

Codecov Report

Merging #5243 (50a849e) into dev (f3195fc) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##                dev    #5243      +/-   ##
============================================
- Coverage     47.42%   47.39%   -0.03%
+ Complexity     3750     3747       -3
============================================
  Files           570      570
  Lines         24116    24120       +4
  Branches       2806     2807       +1
============================================
- Hits          11437    11432       -5
- Misses        11616    11621       +5
- Partials       1063     1067       +4

Impacted Files
Coverage Δ
Complexity Δ

...ache/dolphinscheduler/server/utils/DataxUtils.java
76.92% <0.00%> (-9.57%)
22.00 <0.00> (ø)

...nscheduler/server/worker/task/datax/DataxTask.java
1.76% <0.00%> (-0.02%)
1.00 <0.00> (ø)

...er/master/dispatch/host/assign/RandomSelector.java
77.77% <0.00%> (-5.56%)
3.00% <0.00%> (-1.00%)

...er/server/worker/task/AbstractCommandExecutor.java
21.00% <0.00%> (-0.92%)
13.00% <0.00%> (-2.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f3195fc...50a849e. Read the comment docs.

please add ut verify

@ruanwenjun Could you Improve the Coverage on New Code to 33.3% at least? Thanks so much!