feat: add forced assistant

Description
This PR permits you to force the output of the assistant for some given inputs. Since providing message examples is more powerful than the system prompt, this feature is indispensable.
By clicking on the crossed out robot button, you enter "forced assistant" mode. In that mode, inputs become user/assistant pairs. You can enter any number of examples, then press the button again to query the model as usual.
In the screenshot above, I provided the first two assistant answers. In messages that follow, it does its best to follow along.
This feature is inspired by the ChatGPT playground.
Linked Issues
I wasn't able to find any (at least in English).
Additional context
The robot icon comes from the same source the clear icon came from.

Hi QuickRocket, thanks for your advice and contribution!
I like this feature and I think it would be useful for debugging. However, I don't think the flow of the operation is easy enough to understand. It took me a while to understand how to provide message examples.
I prefer the flow of OpenAI's playground. The button to add a conversation is placed together with the chat message. I can think more naturally about adding a conversation here.

In combination, I sketched what I had in mind:

As you can see, first I would like to have the input box fixed at the bottom. If you don't mind, I will take up this PR after I make this UI change.
Hope you understand and thanks for your support and contribution!

Hi QuickRocket, thanks for your advice and contribution!
I like this feature and I think it would be useful for debugging. However, I don't think the flow of the operation is easy enough to understand. It took me a while to understand how to provide message examples.
I prefer the flow of OpenAI's playground. The button to add a conversation is placed together with the chat message. I can think more naturally about adding a conversation here.

In combination, I sketched what I had in mind:

As you can see, first I would like to have the input box fixed at the bottom. If you don't mind, I will take up this PR after I make this UI change.
Hope you understand and thanks again for your support and contribution!

I want to know what software is used to draw the ui diagram of this example

I want to know what software is used to draw the ui diagram of this example

tldraw.

Hi Diu, thank you for considering this PR.
I'm pretty sure OpenAI's ChatGPT playground UI changed overnight. I came up with a custom flow of interaction because I wasn't satisfied with yesterday's version. I agree that the new one you posted above is very pleasant and more intuitive (save the fact that it might not be entirely evident you can toggle between user and assistant by clicking on the bubble).
I look forward to the UI redesign so that we can add this feature afterwards 😉


Events can now be received at both /events or /events/<channel-name> endpoints

Fixes #39

looks ok so far. Perhaps you could use mux routing capabilities to register the route for both, path and query, so the code inside the handler has no special handling. It will just use the mux.Vars map. https://github.com/gorilla/mux?tab=readme-ov-file#registered-urls
Another things that would be nice is giving some deprecation notice. Not sure where this could be. Probably in the logs and or as response to the webhook event. In that case we probably do need some special handling to know wether or not to emit the notice.


Improving performance for frequently changing elements

Hi,
I've been working with react-konva for a while now and I can't make it as smooth as I need it to be.
I guess my problem is that I'm re-drawing 7 complex elements (rectangles with text inside) about 300 times in a few seconds (I'm creating a timeline that moves horizontally. those are the same rectangles with a different X position).
I was wondering if it's possible to avoid re-drawing the entire element and only move it (or is it the same?).
I tried separating my timeline to different layers, some has hitGraphEnabled={false} if no interactions are needed.
Is there anyway I can draw 300 elements in about 4 seconds and see it render smoothly?
Thanks!

@adamtal3 did you try caching? Usually, it is the best performance trick.

@lavrton - I tried adding caching but I can't spot any difference, still the same glitches.
I'll try to isolate the problem. There might be something else that affects the performance.
Thanks for your fast response.


Jaxws-spring jar is mentioned as vulnerable in recent scans

We are using org.jvnet.jax-ws-commons.spring» jaxws-spring in our project and we see this jar is detected as vulnerable for multiple CVE's. The list of CVE's mentioned by the OWASP dependency check is mentioned below.
CVE-2023-20861
CVE-2022-22971
CVE-2022-22970
CVE-2022-22968
CVE-2022-22965
CVE-2022-22950
CVE-2018-15756
CVE-2018-1275
CVE-2018-1272
CVE-2018-1271
CVE-2018-1270
CVE-2018-1257
CVE-2016-9878
CVE-2016-5007
CVE-2015-5211
CVE-2015-3192
CVE-2011-2730
CVE-2009-1190.
While analyzing all the CVE's ,its related to the spring framework related jars and not the jaxws-spring. The last version for this jar is 1.9 version which is released in 2013 after that there is no new version available.
Is it really a vulnerable one or its false positive? It would be helpful if some knows some details about this jaxws-spring.

They're all false positives, yes. The jar has been incorrectly assigned a CPE for spring-framework, which is what you'll need to suppress.
jaxws-spring seems to be pretty old and obsolete. spring-ws has existed since 2007 and is in active development. jaxws-spring may be full of vulnerabilities you're not aware of.

They're all false positives, yes. The jar has been incorrectly assigned a CPE for spring-framework, which is what you'll need to suppress.
jaxws-spring seems to be pretty old and obsolete. spring-ws has existed since 2007 and is in active development. jaxws-spring may be full of vulnerabilities you're not aware of.

Which library can replace jaxws-spring?

Which library can replace jaxws-spring?

spring-ws. But if you're using jaxws-spring you must be on Spring 4 or older, which is also unsupported and full of vulnerabilities.

Which library can replace jaxws-spring?

spring-ws.
But if you're using jaxws-spring you must be on Spring 4 or older, which is also unsupported and full of vulnerabilities.

Yes, I want to completely replace jaxws-spring because org.jvnet.jax-ws-commons.spring:jaxws-spring stopped supporting 11 years ago. Currently jaxws-spring version 1.9 cannot work with Spring 6. But migrating from jaxws-spring to spring-ws is not easy.


fix: is_dataframe_like compatibility with pandas.DataFrame v1.1

Closes #346
Fixed checking of DataFrame for pandas 1.1+.

The https://github.com/python-streamz/streamz/blob/de166a40babc9690be17d1b92dcd64fa5e149362/streamz/dataframe/tests/test_dataframes.py#L782 should be updated, because currently is not compatible with panda.DataFrame v1.1

should be updated

Do you intend to do this?

Nope, I tried it but it is over my capabilities :(

Fix was merged in #348 , including for series and index. OK to close here?

Yes, thanks for Fix.


fix build with nix 2.16

This is a draft because this may not be desired by all people (this doesn't work with earlier versions and breaks again in later versions). Is there maybe a nix version macro? Worst case it can be specified in build.rs

It's acceptable to just make it work with the latest version and we start pinning nix in the builds.

Included in https://github.com/nix-community/harmonia/pull/127


allowing for compression of all tables

Right now really only hourly_emissions_epacems is set up to be stored as a compressed file in the datapackages. This is done in the load step and is a special case that is only used for this table.
If we were to generalize it, I can imagine putting compression information inside of the datapackage settings in the yml file that generates the bundle of datapackages. Right now the load step does not need any of the datapackaging settings, so we'd need to pass those through. I'd imagine we could add a compression dictionary to either the dataset specific info or the datapackage. It would be good to include compression into the parameter validation  process to double check if the tables you include in the settings for compression are included in the settings. We'd probably want the compression to work like the partitions work so we'd want something like pudl.load.metadata.compile_partitions and whenever a table needs to be compressed... we compress it in the load step.

No longer relevant with removal of datapackage outputs.


REPORT request return multi-status 207 even there is no personal-space-id in space dav-path-version endpoint

Describe the bug
When making a report request without having personal-spaces-id on the endpoint, it returns a response of multi-status 207 result.
This bug also occurs while sharee do report request and there is no sharee-personal-space-id at the endpoint. That also returns multi-status 207.
Steps to reproduce
Steps to reproduce the behavior:

As einstein, created a file file.txt
As einstein, search resources using file through API

curl -kv -XREPORT https://localhost:9200/dav/spaces/ \
-u einstein:relativity \
-d "<?xml version='1.0' encoding='utf-8' ?>
<oc:search-files xmlns:a='DAV:' xmlns:oc='http://owncloud.org/ns' >
<oc:search>
<oc:pattern>file</oc:pattern>
</oc:search>
</oc:search-files>" | xmllint --format -

Expected behavior

There should be a return 404 status code
< HTTP/1.1 404 Not Found
. . .
<
{ [19 bytes data]
100   200  100    19  100   181    363   3466 --:--:-- --:--:-- --:--:--  3846
* Connection #0 to host localhost left intact
-:1: parser error : Start tag expected, '<' not found
404 page not found
^

Actual behavior

without einstein-personal-space-id in the endpoint
< HTTP/1.1 207 Multi-Status
. . .
<?xml version="1.0"?>
<d:multistatus xmlns:s="http://sabredav.org/ns" xmlns:d="DAV:" xmlns:oc="http://owncloud.org/ns">
  <d:response>
    <d:href>/remote.php/dav/spaces/2b17cd6e-5ce0-468c-b474-b382c0f79e30$4c510ada-c86b-4815-8820-42cdf82c3d51/file11.txt</d:href>
    <d:propstat>
      <d:prop>
        <oc:fileid>2b17cd6e-5ce0-468c-b474-b382c0f79e30$4c510ada-c86b-4815-8820-42cdf82c3d51!ac323d5a-8bbe-4362-b481-393024d5a3db</oc:fileid>
        <oc:file-parent>2b17cd6e-5ce0-468c-b474-b382c0f79e30$4c510ada-c86b-4815-8820-42cdf82c3d51!4c510ada-c86b-4815-8820-42cdf82c3d51</oc:file-parent>
        <oc:name>file11.txt</oc:name>
        <d:getlastmodified>2023-08-23T05:55:55Z</d:getlastmodified>
        <d:getcontenttype>text/plain</d:getcontenttype>
        <oc:permissions>RDNVW</oc:permissions>
        <oc:highlights/>
        <oc:tags/>
        <d:getetag/>
        <d:resourcetype/>
        <d:getcontentlength>0</d:getcontentlength>
        <oc:score>1.4402849674224854</oc:score>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
</d:multistatus>

I think, this is the expected behavior. Web also makes use of this.

CC @ScharfViktor

CC @ScharfViktor

Yes, that expected. -XREPORT https://localhost:9200/dav/spaces/ and -XREPORT https://localhost:9200/dav/spaces/spaceUUID behave the same way.
Question: do we need adapt test for that?

It depends whether we want to have tests with .../dav/spaces/ or .../dav/spaces/<personal-space-id>

Also, I noticed that there is no difference in using
.../dav/spaces/<personal-space-id>
and
.../dav/spaces/<project-space-id>
both gives same result.
was it expected? similar issue https://github.com/owncloud/ocis/issues/7096

both gives same result.

If using spaces id gives same result then I think we have to refactor it in the tests also.

That is mess  :sob:
using REPORT https://localhost:9200/remote.php/dav/spaces/ without spaceUUID seams logic.
we set location:

for REPORT request in body.
for PROPFIND request in url.

so the developers cut off everything beyond /remote.php/dav/spaces/ in the REPORT request https://github.com/owncloud/ocis/issues/7096

My suggestion:
accept it as it is and close issue:

https://github.com/owncloud/ocis/issues/7104
https://github.com/owncloud/ocis/issues/7096
https://github.com/owncloud/ocis/issues/7060
https://github.com/owncloud/ocis/issues/6954

change api test for using REPORT https://localhost:9200/remote.php/dav/spaces/ request without spaceUUID


Can't seem to specify inference.py and requirements.txt with TrainingPipeline - only model_fn

Is there a way to specify inference.py and requirements.txt with TrainingPipeline for the deploy step?
I only see a model_fn() mentioned, but I need to perform request-level transformations.  And, actually, how is model_fn() enough?  What is the format of the data coming in?
I haven't actually tested the end-to-end PyTorch/MNIST example, but I don't understand how model_fn() would work, now that I look at the example closer.  Can you help me understand?
I pulled down the deployed model.tar.gz inference code but i don't see the equivalent of an inference.py in the bundle.
And are there any TensorFlow examples?  I only see PyTorch at the moment.
Thanks!

Hi Chris,
model_fn is explained here.

Before a model can be served, it must be loaded. The SageMaker Scikit-learn model server loads your model by invoking a model_fn function that you must provide in your script. The model_fn should have the following signature:

We have an example in the integration test for PyTorch, but it should be the same for TensorFlow.
https://github.com/aws/aws-step-functions-data-science-sdk-python/blob/21d6aa19b6aa73bb6a25490e1cdf0257ac44f815/tests/data/pytorch_mnist/mnist.py

Good info @shunjd .  I understand model_fn().   my question is more around the request-level functions like input_fn(), output_fn() as described here
How do we specify those?  And how do the existing samples work without specifying input_fn() and output_fn().  I assume they're just convert lists of floats into numpy arrays.  However, if i want to do more-complex transformations on my requests/responses - where would i do those?

I think you are right, if you provide input_fn() and output_fn() in the script, then sagemaker endpoint will use your script to transform the intput/output.

And also, sagemaker has a new processing job which is a separate process to allow you put your feature transformation logic. (This is not integrated with the data science SDK yet.)

ok, i'll try input_fn() and output_fn() and update you.
and yes, i'm very much waiting for the ProcessingJobs integration per this issue https://github.com/aws/aws-step-functions-data-science-sdk-python/issues/20


C_CPP Data Structures : Floyd's Algorithm - Video

Description
Implement and explain Floyd's Algorithm in order to detect cycle in any singly linked list.
Domain
C/CPP
Type of Contribution
Video
Code of Conduct

[X] I follow Contributing Guidelines & Code of conduct of this project.

/assign


Handling multipart/form-data

This is actually needed for file uploads and multipart forms.
Currently we don't have any multipart form parsers for Crystal. Thinking of writing this as a seperate shard and then making a plugin for Kemal.

:+1:

:+1:

Parsing multipart/form-data is kind of hell to implement with state-machine. Too many cases to handle, doesn't seem easy to me.
Someone should bind libmultipartparser.

I'll give this a shot soon, multipart seems pretty simple as it seems to just be a simple state machine, w/ C you could use computed goto's but that's probably overkill for something like this.

@nwmcsween any update on this?

Waiting on https://github.com/crystal-lang/crystal/pull/2967 to get merged to upstream.

Excited to see this on Kemal soon!

Finally https://github.com/sdogruyol/kemal/pull/216


Strange blink effect

I like this great component, works fine. I just have a little issue with a strange "blink-like" effect. After one second of appearance the main text gets brighter, so as if it would be re-written. I have attached a little GIF which shows the effect. Hope you can watch it. The quality is not that good

This is probably related to the css translate, on some browsers. Which browser?

@juliancwirko Firefox 61.0.1 and Chrome 67.0.3396.99, both 64 bit on Mac OS (others not tested), not on Safari. The effect is better visible, if the font-weight is altered, e.g.
body {
    font-family: 'HelveticaNeue-Light', 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;
    font-weight: 300
}


GMUStaticCluster missing from library header

Clustering library header file, GMUMarkerClustering.h, is missing a header entry for GMUStaticCluster.h, preventing callers from accessing the protocol. I was able to resolve it by adding an import for this file specifically.
Library Version: 2.0.0, via Cocoapods

Could you please create a Pull Request against this project with your fix? Thanks!

Done! I submitted a CLA as well, let me know if there's a problem.

Thanks for your PR!


Webstorm extension?

Webstorm support would be great.

or for all IntelliJ IDEA based IDE

The only way this would be possible is a third party building the plugin. I don’t use them

GhostText is the one solution for editing leetcode in an actual editor. (Also the one supporting Vim).
It would be great to support Intellij lightedit mode - https://www.jetbrains.com/help/idea/lightedit-mode.html


Struggling to find networking view of how Pod CIDR is carved up and routed

Infrastructure Admins are asking for diagrams of how Calico is assigning sections of the Pod CIDR block across hosts, and how Pod-to-Pod networking is accomplished.  I'm not finding the type of view they are asking for on http://docs.projectcalico.org/ or in more general searches either.
Expected Behavior
These Admins have pointed out some diagrams they are seeing for Flannel, and asking to see a similar view of Calico:  https://image.slidesharecdn.com/dockernetworking201-141219121503-conversion-gate02/95/tutorial-on-using-coreos-flannel-for-docker-networking-5-638.jpg?cb=1426786746
Current Behavior
I see some material along these lines at the following location:  http://docs.projectcalico.org/v1.6/reference/without-docker-networking/docker-container-lifecycle
However, they don't show the flow of the request to the level of detail I am being asked for.

@engelr1974 It's still a work in progress, but I think this covers what you are looking for:
https://github.com/projectcalico/calico/pull/760/files

Yes, I agree that is on the right path to making the container networking clearer, and I'll grab a download of that diagram for now, while this continues to be matured.  Thanks.


Does it works with cpu too?

Hi, has anyone ever tried to train with cpu?
i know it will be super slow but im tried for the fun of it
i currently disabled my gpu by setting this line in image_train_stable.py
torch.cuda.is_available = lambda : False

Traceback (most recent call last):
File "scripts\image_train_stable.py", line 157, in
main()
File "scripts\image_train_stable.py", line 85, in main
TrainLoop(
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\train_util.py", line 194, in run_loop
self.run_step(batch, cond)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\train_util.py", line 208, in run_step
self.forward_backward(batch, cond)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\train_util.py", line 236, in forward_backward
losses = compute_losses()
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\respace.py", line 96, in training_losses
return super().training_losses(self._wrap_model(model), *args, **kwargs)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\gaussian_diffusion.py", line 1137, in training_losses
model_output = model(x_t, self._scale_timesteps(t), **model_kwargs)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\respace.py", line 133, in call
return self.model(x, new_ts, **kwargs)
File "C:\Users\andre\anaconda3\envs\ldm\lib\site-packages\torch\nn\modules\module.py", line 1110, in _call_impl
return forward_call(*input, **kwargs)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\unet.py", line 880, in forward
h = module(h, emb, context)
File "C:\Users\andre\anaconda3\envs\ldm\lib\site-packages\torch\nn\modules\module.py", line 1110, in _call_impl
return forward_call(*input, **kwargs)
File "c:\users\andre\desktop\ml\glid-3\guided_diffusion\unet.py", line 217, in forward
x = layer(x)
File "C:\Users\andre\anaconda3\envs\ldm\lib\site-packages\torch\nn\modules\module.py", line 1110, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\andre\anaconda3\envs\ldm\lib\site-packages\torch\nn\modules\conv.py", line 447, in forward
return self._conv_forward(input, self.weight, self.bias)
File "C:\Users\andre\anaconda3\envs\ldm\lib\site-packages\torch\nn\modules\conv.py", line 443, in _conv_forward
return F.conv2d(input, weight, bias, self.stride,
RuntimeError: "slow_conv2d_cpu" not implemented for 'Half'

sorry for bothering with useless question but am i doing something wrong?
thanks
edit:
nevermind
i removed both .half() from the image_train_stable.py and deleted --use_fp16 from the training arguments
this way i was able to train on cpu

@andreae293 can you please provide more details?
I tried:
export CUDA_VISIBLE_DEVICES=-1
MODEL_FLAGS="--actual_image_size 512 --lr_warmup_steps 10000 --ema_rate 0.9999 --attention_resolutions 64,32,16 --class_cond False --diffusion_steps 1000 --image_size 64 --learn_sigma False --noise_schedule linear --num_channels 320 --num_heads 8 --num_res_blocks 2 --resblock_updown False --use_fp16 False --use_scale_shift_norm False "
TRAIN_FLAGS="--lr 5e-5 --batch_size 32 --log_interval 10 --save_interval 5000 --kl_model kl.pt --resume_checkpoint diffusion.pt"
export OPENAI_LOGDIR=./logs/
python scripts/image_train_stable.py --data_dir /path/to/image-and-text-files $MODEL_FLAGS $TRAIN_FLAGS

where I change the default from README from --use_fp16 True to --use_fp16 False (and IIUC no need to remove .half() from the image_train_stable.py with this flag), but it gives:
RuntimeError: CUDA out of memory. Tried to allocate 4.00 GiB (GPU 0; 15.78 GiB total capacity; 10.52 GiB already allocated; 3.86 GiB free; 10.77 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
ie, still seems to use gpu instead of cpu

Stable Diffusion requires CUDA to run the AI, as it is the language for communicating with the GPU and preforming the necessary  calculations. Using with the CPU would require a complete rewrite or virtualization which requires more RAM and money than it would take to go and buy a supported CUDA GPU. Although if anyone who is reading this is willing, would it be possible to utilize a TPU from Kaggle or Google Collab instead? I feel like it might be more efficient than a GPU or CPU, as it is meant for processing Tensors directly.

@timotheecour4 sorry for the late response
if you dont have enough RAM you have to dedicate a lot of GB to the virtual memory (paging file or swap memory)
i dont know the minimum required by this repo,but i did dedicate 100 GB of virtual memory
also if you are trying to finetune i suggest you to look for dreambooth for stable diffusion
@TheRealUnBot stable diffusion does not necessarily requires CUDA-supporting hardware to run
since its based on pytorch you can run just fine in CPU with the downside of being x50 slower


Is there an error on training Gaussian Naive Bayes for product categorization?

First of all, amazing library, really appreciate what you are doing for the php ecosystem. Keep it up!
I was wondering, I have the following model:
        $dataset = new Labeled($samples, $labels);
        $estimator = new PersistentModel(
            new Pipeline([
                new TextNormalizer(),
                new StopWordFilter(StopWords::$words),
                new WordCountVectorizer(10000, 1, new NGram(1, 2)),
                new TfIdfTransformer(),
                new ZScaleStandardizer(),
            ], new GaussianNB()),
            new Filesystem($this->path.'/categorization.model', true)
        );

        $estimator->train($dataset);
        $estimator->save();

which trains on 20000+ product titles ($samples) that correspond to their assigned categories ($lables).
After I train it, given a new product title that may or may not have all the words in that original training data vocabulary, I want to make a prediction on which category it bests fits.
The code is the following:
        $persister = new Filesystem($this->path.'/categorization.model');
        $estimator = $persister->load();

        $prod = ProductVariant::select('title')->find($id);
        $samples[] = [Stemmer::stem(strtolower($prod->title))];
        $dataset = new Unlabeled($samples);
        dump($estimator->predict($dataset));

but I always get the following error after I run $estimator->predict($dataset)
vendor\rubix\ml\src\Transformers\WordCountVectorizer.php:190
ErrorException
Undefined offset: 1

corresponding to the following code:
 $tokens = $this->tokenizer->tokenize($sample[$column]);
Is there a problem with my approach to solving this?
I think there might be something wrong with the way that I have configured the pipeline but I can't seem to figure it out. Any help would be much appreciated. Thank you.

Hi @cioroianudenis thanks for the question!
It appears that your code is correct but the dataset used to train the estimator may have different features, different ordering of features, and/or a different number of feature columns. I suspect this because the fitted Word Count Vectorizer is looking for a feature column with offset 1, however, it looks like your dataset for inference only has a single text blob column.
Can you confirm that the training and test/inference sets both have the same dimensionality and features are ordered the same?
Also, I noticed you are using a stemmer, we offer a Word Stemmer tokenizer as part of the Extras package if you wanted to use that along with the NGram tokenizer.
Example
use Rubix\ML\Transformers\WordCountVectorizer;
use Rubix\ML\Other\Tokenizers\NGram;
use Rubix\ML\Other\Tokenizers\WordStemmer;

$transformer = new WordCountVectorizer(10000, 3, new NGram(1, 2, new WordStemmer('english')));

@andrewdalpino thank you for the quick response!
I have edited my above answer a little bit showing more of the training code that I use to train then model.
The only difference I can think of between the training data which uses the Labeled class and the test data which uses the Unlabeled class is that the training contains multiple product titles(in the number of thousands) associated with the corresponding category that I manually set, while the test data only contains the title of one product with no category associated, but both get preprocessed by the same transformer classes.
I think the problem might be the testing data that should be processed differently in order to obtain the same amount of columns/rows needed in the predicting phase?
I don't exactly know where to put this code $training->numColumns() === $testing->numColumns(); in order to test that.
Also I noticed that a Stemmer is included in the package but I didn't get the chance to try it out yet, the one that I have is from an old code that I wrote, but I will most definitely switch to the one included in the package.

Word Count Vectorizer will create a vocabulary for each categorical feature column of the dataset. If you have multiple titles for each training sample, you can either break it into multiple samples with the same label or concatenate the titles into just one feature column. This way you only build one vocabulary (only one is needed) and your input dimensionalities match.
In this example, $training is the training dataset and $testing is the unlabeled unknown/testing set. You would instantiate both datasets and use the following to check if they have the same number of columns.
$training->numColumns() === $testing->numColumns();

@andrewdalpino dude, you simply rock! It works like a charm! Exactly that was the problem! Thank you so much!

Likewise @cioroianudenis! Glad I can help
I'm wondering if we should add some 'dimensionality' checks somewhere in the pipeline
That would probably have been helpful to you in this case no?

@andrewdalpino yeah, I can see that would help with this sort of problems.


bin centers are no longer returned ... bin ranges are now returned

Update ReadMe

was looking at old version


The type of tagMap should be object instead of string

Choose a PR Template
Switch to "Preview" on this description then select one of the choices below.
Click here to open a PR for a Data Plane API.
Click here to open a PR for a Control Plane (ARM) API.

@htippanaboya Would you double confirm whether it is a bug of the swagger.


Chemical Substance (PUBCHEM.COMPOUND:3672, PUBCHEM.COMPOUND:1983) - related_to - DiseaseOrPhenotypicFeature

This issue has been created to address https://github.com/NCATSTranslator/testing/issues/86.

Followed up https://github.com/NCATSTranslator/testing/issues/86#issuecomment-881486330.


Compiler Error C7595 with VS 2019 16.10 Preview 2.0

Environment
toml++ version and/or commit hash:  2.3.0 / 4face4d5bf16326aca0da1fb33876dbca63b6e2f

Compiler:  VS 2019 16.10 Preview 2.0

C++ standard mode (e.g. 17, 20, 'latest'):  C++20

Target arch (e.g. x64):  x64

Library configuration overrides:  None

Relevant compilation flags: /c++latest

Describe the bug
VS errors on compilation with the message:
include\toml++\toml_parser.hpp(478,41): error C7595: 'toml::v2::operator ""_sz': call to immediate function is not a constant expression

Steps to reproduce (or a small repro code sample)
I'm no language expert, but you can see from this simplified godbolt example that GCC and MSVC currently disagree over whether this is valid or not.

Additional information
Here's the offending line:
https://github.com/marzer/tomlplusplus/blob/7a4993029e3f49ea42a12cea252755b440c530f8/include/toml%2B%2B/toml_parser.hpp#L478
And the custom operator. Note that it defers to consteval. MSVC would happily compile this if you used constexpr instead.
https://github.com/marzer/tomlplusplus/blob/7a4993029e3f49ea42a12cea252755b440c530f8/include/toml%2B%2B/toml_common.h#L692

That operator is probably the most elementary example of a trivially-consteval function I can think of. This is almost certainly a bug in the new MSVC. Thanks for letting me know!

@Ryan-rsm-McKenzie I've pushed a fix for this in master. Since this is very likely a bug specific to the preview version's implementation of consteval I've fixed it for this very specific _MSC_FULL_VER in the hopes that it is fixed by the time VS 16.10.0 comes out of preview.
I've filed a compiler bug report here, consider upvoting it to help it along!

I can confirm this fixed my build error.


False updates with new version == current version showing on the installed packages package tags

Discussed in https://github.com/marticliment/UniGetUI/discussions/2972

Originally posted by Eniki November 14, 2024
I'm new to UniGetUI - looks very useful and I updated quite a few packages successfully!
But when I switchd to the "installed packages" vew I would a number of packages with a overlay icon (blue circle with an unidentifiable symbol in it) next to the package name. When I hover with the mouse over the name I get a pop up with text like "this package can be updated to Version x.y" - but the installed version in the Version column lists exactly the same version x.y. See attachment for an example.
So how should I read this icon and the associated message?
In the "Software update view" the same package is not listed - which is OK, as there is no later update available.

Thanks in advance for any insights.

Fixed on 53069bfb7cbc3a24c567430008ad0a1c3e7efe97


Expand the returned VMs' fields from VM List Call

As the title asks.
Some VM fields (e.g., vm.Properties.InstanceView.OSName; vm.Properties.InstanceView.OSVersion; vm.Properties.NetworkProfile; vm.Tags) are nil when they are returned from this list call. I have to fetch the missing field values through a Get call for each single VM.
The list option does not have expand field for us neither.
https://github.com/Azure/azure-sdk-for-go/blob/9adda3e39ec3fea73c0a66390ae88f13ec7e6859/sdk/resourcemanager/compute/armcompute/zz_generated_virtualmachines_client.go#L764

@tadelesh, could you help to follow up on this? Thanks.

@xqi-aviatrix Thanks for your feedback. According to my test, at least Tags of the virtual machine can be both returned by list and get method. Could you please paste the HTTP log for the two options? You could refer this doc to config log options.

Thanks for testing it locally. I can confirm that when I remove the list option StatusOnly: to.Ptr("statusOnly") from my list call. Then I can get non-nil tags.
But the vm.Properties.InstanceView related fields (like OSName, OSVersion, NetworkProfile, Statuses) are still nil. It would be helpful to have a list option to expand instance view.
I have not issue with the get method.

I would like to provide http log. I made the calls from visual code, are there any instructions to get the http logs from visual code?

I'll let service team to have a look.

@xqi-aviatrix Apologies for the late reply. Thanks for reaching out to us and reporting this issue. We are looking into this issue and we will provide an update.

@xqi-aviatrix I am yet to look into this. But before that I wanted to check if you have tested using the below sample and confirm if that helps ?
package main

import (
	"context"
	"log"
	"github.com/Azure/azure-sdk-for-go/sdk/azidentity"
	"github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute"
)

var (
	subscriptionID    string
	server            string
	location          = "MyLocation"
	resourceGroupName = "myRgName"
	apiVersion        = "2021-02-01"
	vmName            = "myVMName"
)

func main() {
	subscriptionID = "b83c1ed3-c5b6-44fb-b5ba-2b83a074c23f"
	if len(subscriptionID) == 0 {
		log.Fatal("AZURE_SUBSCRIPTION_ID is not set.")
	}
	cred, err := azidentity.NewDefaultAzureCredential(nil)
	if err != nil {
		// handle error
	}
	client, err := armcompute.NewVirtualMachinesClient(subscriptionID, cred, nil)
	if err != nil {
		// handle error
	}
	ctx := context.Background()
	res, err := client.Get(ctx,
		resourceGroupName,
		vmName,
		nil)
	if err != nil {
		log.Fatal(err)
	}
	log.Printf(*res.VirtualMachine.Properties.InstanceView.OSName)
	log.Printf(*res.VirtualMachine.Properties.InstanceView.OSVersion)
	log.Printf(*res.VirtualMachine.Properties.InstanceView.VMHealth.Status.DisplayStatus)
}

Awaiting your reply.

Thanks @navba-MSFT.
The issue I face is to reduce the number of calls to azure. The lack of expand option in the vm list call that forces me to use the vm get call you wrote above to fetch vm instanceview for each vmId returned from the vm list call.
suppose I have 200 vms under a subscription and vm list call returns 100 vms per page. I need 202 calls  (2 list calls + 200 get calls) to get all the info I need. If there are necessary expand option for the list call, I would just need 2 list calls

@xqi-aviatrix Thanks for your reply. I am adding the Service Team to look into this issue.

@Drewm3 can you please look into this VM issue?

This is by design currently. The reason is that the instance view for a machine changes minute-by-minute which means that each instance must be queried directly to get the current status. We therefore require a query per instance to make this check. We are moving to a pub/sub model internally that will enable more instance status details in a single API call like this, but we are not ready to roll-out this functionality yet.

Reopening and closing for this to pickup in the MSFT tracking system.


[feat-request]: add support for beforeDrop (for cancelling drop)

Hey. Thanks for the awesome library.
I have a requirement where I have to cancel drop based on what index the item is being dropped to.
A beforeDrop hook with same arguments as onDrop would fit seamlessly in the already awesome API.
Return value of beforeDrop hook will determine if drop will happen or not.
Hope you reply.

@kutlugsahin Hi. Any plans on considering the feature?
Thanks :)


merge master into v2 branch

weird, integration tests pass without error locally 🤔

https://app.bitrise.io/build/7ad2c9fb-3ebd-4250-a5f9-44b90108a9ee
Hmm, it passed successfully on master, and there should be no diff between master and v2 branches.
So CI setup issue?

OK it seems like AndroidTest which should run on PR is not running and the one that should run only on master is running, as I created PR from master branch

thanks!


DBT ZTL: Cleanup

Just a few things I missed in review

final model is "zoningtaxlots-db" - dash should be an underscore. Apparently our bash utils don't catch a non-existent table, simply export it as an empty csv
int__limited_height and int__inwoodrezoning should pull from int__valid_dtm rather than stg__dof_dtm for consistency
drop unused dcp_specialpurposesubdistrict both from _sources.yml and recipe.yml

Correction - not int__limitedheight but int__inzonechange


[URGENT] How to bold sub label/title?

What I wanna achieve is to make the 2nd label (sub-label/sub-title) bold.
...
labels: [
     ["Main Label", "This is a sub-label" /* i wanna make this sub label to be bold */ ], ...
],
...

The closest solution I could find online, but it's inactive: https://stackoverflow.com/questions/46221425/chart-js-make-part-of-labels-bold
also tried https://jsfiddle.net/Leelenaleee/3d50fkL9/26/
But none of them is working, so I'm here asking for help, thanks in advance

@enkr1 the fiddle you linked is your best option. I'm not sure why it's not working exactly, but @LeeLenaleee might have some ideas since he created it.

Seems to be working fine, improved a bit by adding padding at bottom so text doesnt get cut off, also instead of drawing white box make default text transparent.
https://jsfiddle.net/Leelenaleee/3d50fkL9/30/

Seems to be working fine, improved a bit by adding padding at bottom so text doesnt get cut off, also instead of drawing white box make default text transparent. Depending on your subTitle text length you might need to also add some padding on the right.
To make it bold did you replace the italic to bold in the fontStringSubTitle option?
https://jsfiddle.net/Leelenaleee/3d50fkL9/30/

Thank you so much I think I can close this now, your fiddle's solution works for me!
Cheers

Now im having another issue. @LeeLenaleee Do u hv any idea?
thanks in advance

Solution:
instead of setting white, i set to transparent.
                        ticks: {
                            color: 'transparent',
                        },


better clearDatabase()

test this please

test this please

test this please

test this please

test this please

test this please

Phew, that took a while. All yours, @koshalt...

Nice!


feat: when adding dask_histgram.boost.Histograms delay creation of task graph, use multi-fill

Closes #126  (supercedes, github was stuck)
Refer to that PR for justification.

@martindurant OK there was a little bit of cleanup to do - it's good to go now.

split_every -> split-every in histogram.yaml to be congruent with dask-awkward's formatting choices.

@martindurant Have now made it so that multifill is used for all the various input types... There are two red tests I need to figure out and then I think I've addressed your comments.

Ran into a minor problem - couldn't add histograms any more if they have different partitions! The solution is to use the multi-source tree reduction I had cooked up before. This also helpfully gets rid of some of the new multi-fill routines.

I am going to xfail those tests and add a corresponding error.
The functionality this is trying to cover is best done on the client side anyway.

+1


Fix for Auth::user() returning the Eloquent model

Return the Eloquent model instead of LdapUser when using Auth::user()

Hmm. The Eloquent model will be returned if a Model exists.
Can you explain in which situation you don't get the eloquent model?

You're right, i think the problem is that the user wasn't in the database. I'm now wondering if a "auto create user" option might be useful so that if the user correctly authenticates it adds the user to the table?

Yeah, that would be a great feature. Will looking into that!

+1 for an auto-create option. :)

+1


Account for possibility of pyc extension in TFLite check.

Closes https://github.com/tensorflow/tensorflow/issues/41352
This PR fixes the runtime check for whether TFLite is running as a separate library or as a part of the full TensorFlow package.

@MeghnaNatraj, it seems I'm not able to add reviewers to this PR myself so I'm flagging this manually for you to take a look. Thanks!

I approve the changes in this PR. @rthadur Is it possible to merge this?

There are two tests failing but when I look at them I haven't figured out how they're related to the change in this PR. The only message is exited with error code 2, both on //tensorflow/compiler/xla/tests:convolution_test_1d_cpu.

I approve the changes in this PR. @rthadur Is it possible to merge this?

sure working on it , thank you


esp_hal: Try to fix espflash command not found in HIL CI

Thank you for your contribution!
We appreciate the time and effort you've put into this pull request.
To help us review it efficiently, please ensure you've gone through the following checklist:
Submission Checklist 📝

[ ] I have updated existing examples or added new ones (if applicable).
[ ] I have used cargo xtask fmt-packages command to ensure that all changed code is formatted correctly.
[ ] My changes were added to the CHANGELOG.md in the proper section.
[ ] My changes are in accordance to the esp-rs API guidelines

Extra:

[ ] I have read the CONTRIBUTING.md guide and followed its instructions.

Pull Request Details 📖
Testing
espflash is installed on all runners.
No idea how to test, manual trigger doesn't pick my branch.
This is fine and expected: https://github.com/esp-rs/esp-hal/actions/runs/10055905092/job/27793593075#step:3:21
However, this is weird https://github.com/esp-rs/esp-hal/actions/runs/10055905092/job/27793789788#step:2:20
I tried to explicitly point to my repo: https://github.com/esp-rs/esp-hal/compare/main...JurajSadel:esp-hal:ci/espflash#diff-3f888d600c3bcb11dd1c4600c03a6249d5741149bbcb7d04bf3e7b037f5cc693R124-R128
But I still can't see that export step here: https://github.com/esp-rs/esp-hal/actions/runs/10056365902/job/27795198164#step:5:1
So I'm not sure how to test if my "fix" is working or not other than adding it to the merge queue
NOTE: I was testing with other branch because it is a mess, main thing here is the export PATH=$PATH:/home/espressif/.cargo/bin before espflash erase-flash
closes #1842

Could you run a HIL work flow on your fork to see that it works?

Hmm, it seems non interactive mode is only for monitoring, we should specify the port instead then I think

Hmm, it seems non interactive mode is only for monitoring, we should specify the port instead then I think

We can try to set ESPFLASH_PORT env variable on the runner. Do we want to do that for S3 for now?

Closed in favour of https://github.com/esp-rs/esp-hal/pull/1848


GraalVM

Hi, Any plans of Tomcat with GraalVM 21 ?

There are no plans to add graalvm variants (this would be the same as https://github.com/docker-library/tomcat/pull/299). But also, there isn't a graalvm Docker Official Image to base it on as the upstream was not interested (https://github.com/docker-library/official-images/pull/10936 and https://github.com/graalvm/container/issues/22).

Sad, there are some serious optimizations in graalvm, can blow performance at times


throw error "Request body larger than maxBodyLength limit" when put object larger then 10MB

I came across the same problem

I came across the same problem

fix this shit with this code

const config = new Config({
  access_key_id: 'ACCESS_KEY_ID_EXAMPLE',
  secret_access_key: 'SECRET_ACCESS_KEY_EXAMPLE',
  getAxiosConfig: () => ({ maxContentLength: Infinity, maxBodyLength: Infinity })
});

great, could you please create a PR to set the axios default?

fixed in #99 , thanks for your issue.

我都服了你了 package main 入口错了


On startup when state is set to minimized, app still shows in task switcher.

Open spdif-ka and click on settings.
Select both check boxes.
Close spdif-ka
Launch spdif-ka.  It should now be running and minimized.
Using keyboard, press alt + tab
Notice it shows in the task switching UI when it should not.  If you restore the state of the GUI and then minimize it, this issue resolve itself.

Hi @handruin, just letting you know that everything works fine! You've written a great app. You may want to close this issue. Cheers!

This issue happens to me as well (Windows 10), so it should not be closed. I don't have the time right now to check this though...
In any case, nice little utility, thank you!

Thanks for the feedback!  I checked and I'm also seeing the issue on Win 10 64-bit.  I'll work on fixing this and post the changes.

I know this is long overdue but I've finally addressed this issue.  Please let me know if you have any problems with this new release.  Thanks for your patience with this fix.

Thank you, it's fixed!


Incorrect wrangler.toml's "browser" schema

Existing documentation URL(s)
https://developers.cloudflare.com/workers/wrangler/configuration/#browser-rendering
What changes are you suggesting?
https://github.com/cloudflare/cloudflare-docs/blob/c070a71340de9ccaea5fa50297e79f7d0893efe6/content/workers/wrangler/configuration.md?plain=1#L424
In this part, the schema of the “browser" is an object, so this syntax causes an error in wrangler run deploy.
- [[broser]]
+ [broser]

Additional information
https://github.com/cloudflare/cloudflare-docs/assets/80559385/24ccad22-7f49-4b5e-b4f7-d85ca17d0bfe

https://github.com/cloudflare/cloudflare-docs/blob/8b3002d09f93694d69d2d69fbceb2c9e931d4fad/content/workers/wrangler/configuration.md?plain=1#L940
I found one more mistake. Maybe this is the correct one.
- analytics_engine_datasets = { binding = "<BINDING_NAME>", dataset = "<DATASET_NAME>" }
+ analytics_engine_datasets = [{ binding = "<BINDING_NAME>", dataset = "<DATASET_NAME>" }]


Post cantina

Contains:

#100

Missing interface for AdaptiveCurveIrm

#103

Overly complex use of deployment immutables over constants

#107

Incorrect naming of MathLib.wMulDown & MathLib.wDivDown regarding their round-to-zero behavior in the integer space (#127)

#108

Incorrect documentation of the behavior of the speed between updates of the stateful IRM (#139)

#105

Insanely large maximum APR & APY calculated by the stateful IRM, potentially leading to large share deflation & slippage (#450)
Misleading comments and definitions of constants

@Rubilmax @Jean-Grimal can you create a PR to resolve conflicts please?

#111 is what you're looking for

already edited my comment haha

I think that you can remove using MorphoMathLib for uint256; from AdaptiveCurveIrm
https://github.com/morpho-org/morpho-blue-irm/pull/106/files#diff-a05758836d08a2a735bb478d93a10a8b2dacd40fb639d4c59104a6169552df79R23
The only op from MorphoMathLib (math lib from morpho blue) is
        int256 utilization = int256(
            market.totalSupplyAssets > 0 ? market.totalBorrowAssets.wDivDown(market.totalSupplyAssets) : 0
        );

But both of them are uint128 and not uint256.
At this point, I'm wondering what are the consequences if one of the types (external to the IRM) changes, and you can't apply anymore the MathLib. Does it revert directly?

Looks good


zulip admin bot permissions fork

Permissions in zulip prevent admin bot from deleting messages. Look into what it would take for admin bot to be able to delete or edit any message.
Members having a discussion, one posts spam.  We'd like to be able to delete the spam message for moderation.  zulip does not allow our bot to delete.
Success would be that our admin bot account can delete messages as needed.

Alternative sounds like subscribing bot to every channel.  This sounds more easy to achieve than managing a fork of zulip.
@stanislavkhatko what are the reasons we can't just add the bot to every channel as it is created?  I'm sure there's a limit to the number of channels, but will we hit it in the next 3 months?


User repository

Usually, in my machine, i have a folder with all my git projects on it.
I think it would be nice to provide this directory to Iceberg, for checking on this directory for each project or related project to be loaded.
Like this I can have only one working copy for all my images, and drop the changes always on the same place.

@sbragagnolo I think this is a very good idea ... having a well-known location for git projects means that non-code artefacts can be easily accessed by code running in an image ...

I think this is important for the usability of Iceberg.

Hey, I am finally getting to this. Do you have any proposals for a default location for that directory?

Maybe this should be asked on the ML.
Maybe at  StartupPreferencesLoader preferencesGeneralFolder?

Added a setting:

@npasserini I was kinda thinking that having a FileLocator alias would be pretty convenient ... if you had something like FileLocator sharedGitRepos and FileLocator imageGitRepos that tied into your settings and had reasonable defaults, then you'd be golden ... I'd think


Error in MWPhoto.m

Hello, I found an error in MWPhoto.m
When you load an image with local file url, you expect it enter in the if branch
} else if ([_photoURL isFileReferenceURL]) {
.....
}
but [... isFileReferenceURL] is the wrong method of NSURL Class and it will NEVER enter in this if branch.
the correct method is [_photoURL isFileURL].
I noticed it because in my project happen to have a temporary photo. The picture changes but the local file URL remains the same.
With the current configuration it ever goes in the if statement with SDWebImageManage and it re-proposed the same first image (cache) instead of the image updated.
I hope it is helpfull
Claudio

Bump - This issue is still outstanding.

if you use [_photoURL isFileURL] the gif image do not view animation ....

@marinotws if you use isFileReferenceURL the gif image animates?

yes !

The issue was closed as well as #337, but the actual code was NOT changed!
https://github.com/mwaterfall/MWPhotoBrowser/blob/master/MWPhotoBrowser/Classes/MWPhoto.m


Add detailed rule structs from the dev-old branch

I want to get make current generic ones production ready before moving on.

I can also add methods to create a rule programmatically.


[CARBONDATA-3442] Fix creating mv datamap with column name having length more than 128

[ ] Any interfaces changed?

[ ] Any backward compatibility impacted?

[ ] Document update required?

[ ] Testing done

[ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3583/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11857/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3789/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3589/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11864/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3796/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3602/

Build Failed  with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11876/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3810/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3607/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3815/

Build Failed  with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11881/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3612/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3820/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11886/

LGTM

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3618/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11892/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3825/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3665/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3874/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11938/

if #3298 is merged before this PR, need to update this PR, in Navigator.scala @Indhumathi27 please keep track

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3673/

Build Failed  with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11946/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3882/

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder2.1/3675/

Build Success with Spark 2.3.2, Please check CI http://<IP_ADDRESS>:8080/job/carbondataprbuilder2.3/11948/

Build Success with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/3884/

LGTM


Conversation sampler

[x] implementation
[x] docs
[ ] tests

@alecristia I made the High-vol sampler more "generic" by replace 'cvc', 'awc' and 'ctc' with 'vocs', 'words' and 'turns'.
Basically you can do as much as before but you get to choose the speakers to target for each metric.
Is this fine with you?

@alecristia I made the High-vol sampler more "generic" by replace 'cvc', 'awc' and 'ctc' with 'vocs', 'words' and 'turns'. Basically you can do as much as before but you get to choose the speakers to target for each metric. Is this fine with you?

YES! let me take a quick look...


Xnxx

Addon Manifest URL
https://m.youtube.com/manifest.json
Addon Description
No response
Language of Content
English (en-GB)
Choose Labels

[ ] anime
[ ] asian drama
[ ] bollywood
[ ] cartoons
[ ] debrid support
[ ] http streams
[ ] live tv
[ ] metadata
[ ] misc
[x] movies
[ ] music
[ ] nsfw
[ ] podcasts
[ ] radios
[ ] subtitles
[ ] torrents
[x] tv shows
[ ] video games

Addon Manifest URL
https://m.youtube.com//manifest.json
Addon Description
No response
Language of Content
English (en-GB)
Choose Labels

[ ]  anime
[ ]  asian drama
[ ]  bollywood
[ ]  cartoons
[ ]  debrid support
[ ]  http streams
[ ]  live tv
[ ]  metadata
[ ]  misc
[ ]  movies
[ ]  music
[x]  nsfw
[ ]  podcasts
[ ]  radios
[ ]  subtitles
[ ]  torrents
[ ]  tv shows
[ ]  video games

i don't know what that is, but it's not a new addon, so i'm closing this


[WIZnet] Added WIZwiki platform ( WIZwiki-W7500, WIZwiki-W7500P, WIZwiki-W7500ECO )

Added WIZnet platform to DAP Link

Hi @kaizen8501, please rebase this commit

Hi @c1728p9.  So I have some mistake and I'm sorry about that make you feel annoyed.
I have done rebase. Is it right?

Hi @kaizen8501, you merged master into your branch, which is similar to a rebase and will allow me to merge this PR, so that is good. No need to be sorry. There is a first for everyone :smile:.
Before I can test this PR you'll need to add these new projects to the supported configuration list found here. If you want these boards to be included in the next DAPLink release, you'll need to add them to the release list found here
Finally, before I can merge this PR you'll need to sign the contributors agreement:
https://developer.mbed.org/contributor_agreement/

@mbed-bot: TEST

@mbed-bot: TEST


Add constructor to Set declaration

Fixes https://github.com/facebook/flow/issues/2665

Sweet! Thanks! I'll get this merged ASAP!


CSS

CSS
User Story
As a bootcamp student
I want the prework notes to be structured on a webpage
So that I can easily find and read the information
Acceptance Criteria
GIVEN a prework study guide web site
WHEN I view the study guide
THEN I see a dark blue header and footer, and four boxes with a shadow

completed css

completed css


[BUG] UnicodeEncodeError during evaluation

Describe the bug
I create a flow to do RAG using Azure AI Search, but I got this following error during an evaluation:
SystemError: Unexpected error occurred while executing the batch run. Error: (UnicodeEncodeError) 'utf-8' codec can't encode characters in position 171-172: surrogates not allowed.

This error appeared two weeks ago and before that my evaluation using the exact same flow (just some prompt change) were working. The thing is that now the evaluation is working without any change on my side, but the same issue with a flow that do the RAG using langchain connector to Azure AI Search appear.
SystemError: Unexpected error occurred while executing the batch run. Error: (UnicodeEncodeError) 'utf-8' codec can't encode characters in position 37-38: surrogates not allowed.

The two flow were created using the RAG template of Azure AI Studio.
Running Information(please complete the following information):

Promptflow Package Version using pf -v: 1.10.1
Operating System: Windows 11
Python Version using python --version: 3.11.7

Hi, which tool is raising this unicode error? Is there any details for us to reproduce the bug?

Hi, I don't now if this is a tool issue because it happens when I run an evaluation using the Azure AI Studio with as parameter:
evaluation with context -> my RAG flow, a dataset -> metrics coherence, relevance, groundedness.
The evaluation run gives me the log:
BulkTest run ... has a dependent run .. terminated unexpectedly. Mark it as canceled.

and when I check the batch run from the flow that I try to evaluate, all the line are marked as completed with all the field of output well filled but the status of the run is failed with the error that I mention previously.
To reproduce the bug you can try to create a RAG flow using the playground with a connection to an Azure AI Search index, but I see that this flow has change so the old one. After that run an evaluation on it.
As I say in my first message the bug seems to appear and disappear without any explanation, so maybe you can't reproduce it but give me some research ideas.
please not that I describe the bug when I use the Azure AI Studio but it also happen when I clone the two flow (RAG and evaluation) and try to run the evaluation using vsCode.

@tkonao I'm not so sure what happened as the detail not enough. Given the message that the bugs seems to appear and disappear, if there's a period of time between the error appear and disappear, it might be some bugs in an old runtime version and fixed in a newer runtime version, I'm sorry that I can't give more clues based on current situation.

If you are using automatic runtime, it will pick the newest runtime image each time when you start it.

Hi, the problem seems solved.
I restart with an automatic runtime, so maybe the problem was here.
Thanks for your help.


chore: fail NuGet publish step when there are errors

the dotnet nuget push command gets the symbol packages, creates a PUT
request and then a response.
The response was not being parsed and includes a message indicating
"Your package was pushed." when successful. When there are errors,
they are prefixed with error:
i.e. error: Response status code does not indicate success: 403 ...
This change checks the log file for errors and fails the publish step.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: e36c22396edce85d5ac7806ca9a5140bc57c6a65
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 1c4f0139a0993ab56b7987a4b281224f8a051266
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: ad4f7b75fa4338250fa338d3b2183c72cb71e25e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: e69118bc5a0253a2f3cef4bfa42637185eb0908b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 66d1f41b4609a0ac13fdf68d55ca8cbe009a0507
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 9543a377e2f4ddd51fcbed84c377fe23b7ad77fd
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 00c1c3364f9d398c39c54e740058ddee039cae6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 00c1c3364f9d398c39c54e740058ddee039cae6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 00c1c3364f9d398c39c54e740058ddee039cae6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 00c1c3364f9d398c39c54e740058ddee039cae6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 1cb50a1bb6c601f32287ce34fec505892259d074
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: GitHubPipelineAutoBuildProj-eNGjrh4O6eRH
Commit ID: 1cb50a1bb6c601f32287ce34fec505892259d074
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


Rules do not work update 11212024

Update 11212024
Only in true DHCP without a router might there be problems
Note
I am in DHCP mode, my ISP says its DHCP and IP subject to change
Well it doesnt, maybe if they had a problem and had to reassign IPs
I am in DHCP mode in opnsense
I put my DHCP IP which doesnt change, in opnsense at
Intrusion Detection > Administration > settings > Home Networks box
Still in DHCP mode, and the rules work, did short testing, will do some more
Also if behind a router and in DHCP could put a router Lan IP or IP range here
Even if in true DHCP mode, could put IP range here and rules would work
Did not know what the box was for, being its name thought it was something with Lan
I do not have to change $HOME_NET to any in the rulesets anymore
Unless my IP changes which I would see in the dashboard and would be a quick fix
Unless I am misusing that box for its purpose which I will try to find out more on
Thank you everyone

another update final
that box appears to be for a client and not wan dhcp address
also the interfaces-wan-alias ipv4 address box appears to be for lan client and not a wan address
Need a wan dhcp address box that links to the suricata rules $HOME_NET
It should be right there at the DHCP box setup I would think, just like the static address does
For a IP or range or multi range(networkind) circumstances
$HOME_NET accepts that
thanks and thanks again


Fix bar chart and node view to display when view is loaded

When switching to these views no visual is initially shown until the tree is selected.

@johnmhoran:

How is the root node created from a scan with no root node?

This is where we create the root node.
https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/renderer.js#L617-L618

How is the Table View populated on load as if the root node had been selected?

Whenever the DataTable is first created, the first thing it's going to do is try is load some data. The DataTable ajax option defines how the DataTable gets its data. https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/aboutCodeDataTables.js#L159-L160  In our case, it just calls the query function. https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/aboutCodeDataTables.js#L45-L47 This is the query we are trying to build: https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/aboutCodeDataTables.js#L54-L65
Filtering on the jstree is essentially this line:
https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/aboutCodeDataTables.js#L57
When a file is first loaded, the columnSearch for the path column is empty, so no filtering is done (which means all rows are shown) https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/aboutCodeDataTables.js#L79

Where are the corresponding hooks for the Node and Chart Views?

Changing the node view and the chart view to display data when nothing is selected in the jstree is one way to fix this, but I think it would be better to just select the root element in the jstree when a file is first loaded. The reason I think this would be better is because we can reuse the same logic that is applied when the user selects the jstree.
https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/renderer.js#L91-L98 Also, I think it’s more intuitive to show the data that is selected by the jstree rather than showing default data when nothing is selected.
I think what you want to focus on is selecting the first element in the jstree whenever the jstree is updated. In our code, this happens by refreshing the jstree in renderer.js here:
https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/renderer.js#L521-L522
Therefore, you can listen for jstree refresh events
https://www.jstree.com/api/#/?q=.jstree Event&f=refresh.jstree
And try to select the first jstree element in that callback, similar to how we handle other events:
https://github.com/nexB/aboutcode-manager/blob/e15d2023b4400cecef6aac2e6b711618a867db3f/assets/js/renderer.js#L91-L98

Thanks very much, @jdaguil !


Kubernetes 1.23 compatibility

Acceptance criteria:

[x] Compatibility matrix for KIC 2.0 includes k8s 1.23
[ ] Our automated tests run against k8s 1.23
[x] Changes in k8s 1.23 changelog assessed for potential impact on KIC

#2072 is unrelated to KIC supporting k8s 1.23, but it describes the (non-trivial) work needed to bump the k8s libraries we use in KIC.

Main takeaways are that we may want to configure IPv4/v6 dual-stack test environments and should look at migrating from PodSecurityPolicy to PodSecurity in the future, but nothing that we'd immediately need to account for.

FlexVolume deprecation doesn't matter, we don't use it.
klog deprecations affect 1.x but not 2.x, which longer accepts the klog flags for any remaining code still using klog.
GA IPv4/IPv6 dual stack maybe affects us, but not in any knowable way. L3 should largely be handled for us, so we shouldn't have obvious IPv6 concerns. We can use a dual-stack test cluster if we wish to confirm further.
HorizontalPodAutoscaler v2 graduates to GA does not affect us, as the chart uses v1, which is not deprecated.
Generic Ephemeral Volume feature graduates to GA does not affect us, as we do not deal with storage drivers.
Skip Volume Ownership change graduates to GA ditto.
Allow CSI drivers to opt-in to volume ownership and permission change graduates to GA ditto.
PodSecurity graduates to Beta will eventually need changes in the chart, but this is still a beta.
Container Runtime Interface (CRI) v1 is default doesn't affect us, we aren't a container runtime.
Structured logging graduate to Beta does not affect us, it is for cluster admins.
Simplified Multi-point plugin configuration for scheduler is for cluster admins.
CSI Migration updates relates to storage drivers and does not affect us.

We already use 1.23 client libraries, so there are no API changes that we need to account for.
Dispatch jobs can now run against 1.23 in a CI environment, do we think we need to keep this open until the regular jobs run against them as well, or just update those as usual (bump versions as part of the release process) once they become available in GKE?

GA IPv4/IPv6 dual stack maybe affects us, but not in any knowable way. L3 should largely be handled for us, so we shouldn't have obvious IPv6 concerns. We can use a dual-stack test cluster if we wish to confirm further.

It does occur to me that we should have an E2E test which is deploying dual-stack enabled and verifying IPv6 configurations and traffic as a litmus test.

Dispatch jobs can now run against 1.23 in a CI environment, do we think we need to keep this open until the regular jobs run against them as well, or just update those as usual (bump versions as part of the release process) once they become available in GKE?

Our measure of compatibility is currently that all E2E tests pass on the version. Given the PR you have open where we can optionally run the integration tests, I think if we just make those integration tests default to on instead of off once they pass we can consider this complete, and otherwise update the defaults for day-to-day integration test runs over time as you suggested.

https://github.com/Kong/kubernetes-ingress-controller/actions/runs/1753133776 is with the integration tests also.


Ditch setup.sh/build.sh and move to a single script parameter approach?

In the very near future I'll have everything completed to move us from Bash scripts for setup to Python. I discuss the motivations for this change in issue #128.
What I've done so far is I've replaced the existing shell scripts, but I've left build.sh and setup.sh in place. The only thing is those two scripts now just call a Python script rather than doing setup/building on their own.
I propose that we ditch those two scripts as well, and instead have all NTRT operations (starting a build, running setup, and a few others I'll discuss shortly) called from a single file called runner.py.
If we make that change, building and setup will be done as follows
python runner.py setup <-- runs setup
python runner.py build <-- does a build.
Any args that need to be passed to the script can be included after the command, e.g. python runner.py setup --verbose would pass a single argument (--verbose) to setup.py
When I introduce the Python changes, I'll also be adding in code cleanup tools. We'll have three tools:
Uncrustify
Flint
A custom tool which checks project specific requirements (copyright and doxygen header, for instance).
We can use each of those commands either against the whole project, just on a single dir, a single file, etc.
If we use a shell script for each of those tasks as well, we're going to have a lot of scripts. We'll also need to have different scripts for Windows once I return Windows support, so we'll have setup.sh and setup.bat, etc.
If we go with the runner.py approach, we have a single script that is the entry point to all project operations. It's sort of like make except a single call can only reference a single operation which will enable us to make an operation call and include parameters.
Another benefit with this approach is that you could alias the path to runner.py and then run any command from anywhere in NTRT. For example, right now if you want to build you need to cd into bin/build and then run build.sh. If you alias runner.py to, say, 'run' you would be able to do any operation in any directory. E.g. Calling 'run build' from anywhere within NTRT would cause a build to occur.

I like it.  I think though that instead of calling it "runner.py" we could call it "NTRT.py"
vytas
On Feb 13, 2015, at 5:15 AM, Perry Bhandal<EMAIL_ADDRESS>wrote:

In the very near future I'll have everything completed to move us from Bash scripts for setup to Python. I discuss the motivations for this change in issue #128.
What I've done so far is I've replaced the existing shell scripts, but I've left build.sh and setup.sh in place. The only thing is those two scripts now just call a Python script rather than doing setup/building on their own.
I propose that we ditch those two scripts as well, and instead have all NTRT operations (starting a build, running setup, and a few others I'll discuss shortly) called from a single file called runner.py.
If we make that change, building and setup will be done as follows
python runner.py setup <-- runs setup
python runner.py build <-- does a build.
Any args that need to be passed to the script can be included after the command, e.g. python runner.py setup --verbose would pass a single argument (--verbose) to setup.py
When I introduce the Python changes, I'll also be adding in code cleanup tools. We'll have three tools:
Uncrustify
Flint
A custom tool which checks project specific requirements (copyright and doxygen header, for instance).
We can use each of those commands either against the whole project, just on a single dir, a single file, etc.
If we use a shell script for each of those tasks as well, we're going to have a lot of scripts. We'll also need to have different scripts for Windows once I return Windows support, so we'll have setup.sh and setup.bat, etc.
If we go with the runner.py approach, we have a single script that is the entry point to all project operations. It's sort of like make except a single call can only reference a single operation which will enable us to make an operation call and include parameters.
Another benefit with this approach is that you could alias the path to runner.py and then run any command from anywhere in NTRT. For example, right now if you want to build you need to cd into bin/build and then run build.sh. If you alias runner.py to, say, 'run' you would be able to do any operation in any directory. E.g. Calling 'run build' from anywhere within NTRT would cause a build to occur.
—
Reply to this email directly or view it on GitHub.

Vytas SunSpiral
Dynamic Tensegrity Robotics Lab
cell-<PHONE_NUMBER>
Office:<PHONE_NUMBER>
N269     Rm. 100
Stinger Ghaffarian Technologies
Intelligent Robotics Group
NASA Ames Research Center
I will not tiptoe cautiously through life only to
arrive safely at death.

NTRT.py sounds good!

It's not really my call, but did you guys look into python setuptools?
https://pypi.python.org/pypi/setuptools
It's the standard way to install things in python and it's also compatible
with pip etc.
The syntax is pretty much exactly what Perry proposed:
python setup.py install
2015-02-13 9:54 GMT-08:00 Perry Bhandal<EMAIL_ADDRESS>
NTRT.py sounds good!
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74296043
.

My impression was that setuptools is supposed to be used for installing, uninstalling, etc, a Python package. In this case we want the ability to add any arbitrary NTRT operation to it (e.g. we want to be able to call ntrt flint to have flint run on the entire repo, or ntrt flint -r . to run flint in the pwd and for all sub folders.
Am I mistaken in my assumption that setuptools isn't suitable for that use case?

That sounds good to me!
An alternative would be to have it just be 'ntrt' (no extension). If you
put '#!/env/bin python' at the top and set it as executable you can just
call it directly.
Then you could do things like "#> ntrt setup --verbose" or "#> ntrt build
/src/dev/radams"
Thoughts?
On Fri, Feb 13, 2015 at 9:54 AM, Perry Bhandal<EMAIL_ADDRESS>wrote:

NTRT.py sounds good!
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74296043
.

I haven't tried it myself, but customizing setuptools doesn't appear too
difficult.
See for example:
http://ziade.org/2007/09/30/extending-setuptools-adding-a-new-command/
That being said, pick the tool (or custom code) that you think works best
(I haven't used NTRT myself in a while).
I just wanted to make sure that you had considered setuptools, when I read
the examples in your email ("python runner.py setup").
Have a great weekend,
Ken
2015-02-13 10:19 GMT-08:00 Perry Bhandal<EMAIL_ADDRESS>
My impression was that setuptools is supposed to be used for installing,
uninstalling, etc, a Python package. In this case we want the ability to
add any arbitrary NTRT operation to it (e.g. we want to be able to call
ntrt flint to have flint run on the entire repo, or ntrt flint -r . to run
flint in the pwd and for all sub folders.
Am I mistaken in my assumption that setuptools isn't suitable for that use
case?
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74300173
.

Ryan, my only concern with the header shebang approach is we wouldn't be able to use it with NTRT's virtualenv install. Is there any way to do that? (Come to think of it, how can we ensure the virtualenv is activated if they simply call python with an absolute path to the NTRT.py script? I'm not sure if that's possible with my proposed approach.)

Even better!

Vytas SunSpiral
PI - Dynamic Tensegrity Robotics Lab
cell-<PHONE_NUMBER>
Office:<PHONE_NUMBER>
N269     Rm. 100
Stinger Ghaffarian Technologies
Intelligent Robotics Group
NASA Ames Research Center
I will not tiptoe cautiously through life only to arrive safely at death.

On Feb 13, 2015, at 7:27 PM, ryan1248<EMAIL_ADDRESS>wrote:
That sounds good to me!
An alternative would be to have it just be 'ntrt' (no extension). If you
put '#!/env/bin python' at the top and set it as executable you can just
call it directly.
Then you could do things like "#> ntrt setup --verbose" or "#> ntrt build
/src/dev/radams"
Thoughts?
On Fri, Feb 13, 2015 at 9:54 AM, Perry Bhandal<EMAIL_ADDRESS>wrote:

NTRT.py sounds good!
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74296043
.

—
Reply to this email directly or view it on GitHub.

I'm a big fan of using existing standard tools, rather than home brewing our own solutions. This looks promising.

Vytas SunSpiral
PI - Dynamic Tensegrity Robotics Lab
cell-<PHONE_NUMBER>
Office:<PHONE_NUMBER>
N269     Rm. 100
Stinger Ghaffarian Technologies
Intelligent Robotics Group
NASA Ames Research Center
I will not tiptoe cautiously through life only to arrive safely at death.

On Feb 13, 2015, at 7:28 PM, kcaluwae<EMAIL_ADDRESS>wrote:
I haven't tried it myself, but customizing setuptools doesn't appear too
difficult.
See for example:
http://ziade.org/2007/09/30/extending-setuptools-adding-a-new-command/
That being said, pick the tool (or custom code) that you think works best
(I haven't used NTRT myself in a while).
I just wanted to make sure that you had considered setuptools, when I read
the examples in your email ("python runner.py setup").
Have a great weekend,
Ken
2015-02-13 10:19 GMT-08:00 Perry Bhandal<EMAIL_ADDRESS>
My impression was that setuptools is supposed to be used for installing,
uninstalling, etc, a Python package. In this case we want the ability to
add any arbitrary NTRT operation to it (e.g. we want to be able to call
ntrt flint to have flint run on the entire repo, or ntrt flint -r . to run
flint in the pwd and for all sub folders.
Am I mistaken in my assumption that setuptools isn't suitable for that use
case?
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74300173
.

—
Reply to this email directly or view it on GitHub.

My only concern with setuptools is that I want command autocompletion for all project operations. It looks like this Python library can help with that:
https://pypi.python.org/pypi/argcomplete/0.8.4
What I'll do is try to modify setuptools to include argcomplete and see if that can satisfy our needs. If it can't, we can discuss a custom solution. It'll be great if setuptools does the job though, that way we won't have to bother with processing command line arguments, creating our own --help arg, etc.

Glad you're thinking in the virtualenv direction! Fortunately the shebang
will work with virtualenv (if you use the correct shebang, which I didn't
above...  :-)
You can test with this:
-- test_shebang.py ---
#!/usr/bin/env python
import sys
print sys.executable
chmod +x test_shebang.py
./test_shebang.py  # Should output the system python executable
source path/to/NTRTsim/env/venv/bin/activate  # activate your virtualenv
./test_shebang.py  # Should output the venv python executable
The way it works:

Activating virtualenv changes some environment variables such that the
'python' command is remapped to your virtualenv's python
The shebang calls '/usr/bin/env', then calls python. /usr/bin/env pulls
up the latest environment variables, then calls whatever python executable
is defined in your environment variables
If you have not activated a virtualenv, the environment variable will
point to system python. If you have activated it, the environment variable
will point to your virtualenv python.

Hope this helps,
Ryan
On Fri, Feb 13, 2015 at 7:37 PM, Perry Bhandal<EMAIL_ADDRESS>wrote:

Ryan, my only concern with the header shebang approach is we wouldn't be
able to use it with NTRT's virtualenv install. Is there any way to do that?
(Come to think of it, how can we ensure the virtualenv is activated if they
simply call python with an absolute path to the NTRT.py script? I'm not
sure if that's possible with my proposed approach.)
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74359771
.

That is awesome! That will make this quite easy -- I'll get it finished and committed shortly.
Thanks Ryan.

Another thought -- it might be a good idea to have shell scripts for
different operating systems that first creates the virtualenv, switches to
it, and runs the rest of the setup.
For instance:
-- setup.sh ---
#!/bin/bash
Note: the following two commands will use the system python
python [script to set up the env directory].py
python [script to set up the virtualenv under env].py  # should download
and install the virtualenv
activate the virtualenv
source env/venv/bin/activate
Now we're in our virtualenv
python [script that handles the rest of the setup]
-- setup.bat ---
@ECHO OFF
CALL python [script to set up the env directory].py
CALL python [script to set up the virtualenv under env].py
activate the virtualenv
CALL env\venv\Scripts\activate
CALL python [script that handles the rest of the setup].py
What do you think?
-Ryan
On Sat, Feb 14, 2015 at 9:00 AM, Perry Bhandal<EMAIL_ADDRESS>wrote:

That is awesome! That will make this quite easy -- I'll get it finished
and committed shortly.
Thanks Ryan.
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74382741
.

For the other scripts we use which use addons from virtualenv, how will we go about activating it? Should we just use the virtualenv shebang you posted earlier? or

Oh, wait, even with the header shebang we still need to activate it. Hmm.
I'm actually not sure how best to resolve that. We could have some script called init_venv.sh which initializes/activates the venv on the first run, then activates it on subsequent runs. Then when people alias the NTRT.py script they can put a call to init_venv.sh prior to it. There must be a cleaner way to accomplish this though.

One possible approach is to have ntrt.sh and ntrt.bat in the main dir. When it's called, it first activates the virtualenv if necessary, then it passes its args onto ntrt.py.

I think there a few options for ntrt.py:

The approach you outlined (having shell scripts that run ntrt.py)
Having ntrt.py check to see if it is running under a virtualenv (import
sys; if hasattr(sys, 'real_prefix') then we're in a virtualenv) and if not
then
a) exit and display a message like "virtualenv must be activated before
running ntrt -- use 'source env/venv/bin/activate' and then run ntrt again"
b) spawn a subprocess that runs ntrt.py in the virtualenv
call the virtualenv's python directly from the NTRT scripts when
invoking other scripts (e.g. instead of 'python setup_bullet.py' we would
call 'env/venv/bin/python setup_bullet.py')

I'm leaning toward option #2a or option #1. #2b seems like it could get
messy. #3 could work but we'd need to remember to use it in all of the
scripts. Thoughts?
Some code notes:
-- ensure_virtualenv.py ---
#!/usr/bin/env python
if not hasattr(sys, 'real_prefix'):
print "You must activate the virtualenv before running this script ..."
exit()
-Ryan
On Sat, Feb 14, 2015 at 10:13 AM, Perry Bhandal<EMAIL_ADDRESS>wrote:

One possible approach is to have ntrt.sh and ntrt.bat in the main dir.
When it's called, it first activates the virtualenv if necessary, then it
passes its args onto ntrt.py.
—
Reply to this email directly or view it on GitHub
https://github.com/NASA-Tensegrity-Robotics-Toolkit/NTRTsim/issues/134#issuecomment-74385640
.

I like option one myself. It seems to be the most simple.


chore(starknet_api): move transaction constants to snapi

This change is

#2106
#2105
#2104  👈 (View in Graphite)
main

This stack of pull requests is managed by Graphite. Learn more about stacking.


Fix SVG bug

The bug:

fileType will sometimes preemptively detect svg files as application/xml before isSvg is called.  We want it to be more specific.
isSvg requires inspecting the entire file contents, while fileType only requires the first chunk.

The solution:

isSvg is more specific, so move it above the fileType call.
Use the end event rather than data event for the file stream.

Sorry that no one ever took a look at this 😢
This was addressed in #103


I did a simple utf-8 to windows-1232 conversion routine

Hello guys,
I wrote a simple package to do this charset translation, to avoid creating extra font maps. Not sure if this will help anyone, in any case, here it is.
https://github.com/gilmarpalega/cp1232

Hi @gilmarpalega
In fact, gofpdf does something like this already -- see UnicodeTranslator and the codepage example. Your solution is easier to use, but assumes the Windows Latin 1 codepage and is limited to selected runes. The internal solution is more general but requires a code page descriptor file to function.
Thanks for your interest!


force /utf-8 for MSVC compiler

The source code is already in utf-8;
but in non-English windows (like mine CP936), it will report warning C4819.
warning C4819: The file contains a character that cannot be represented in the current code page
Now in Build.cmake, force utf-8 for MSVC compilers in non-utf8_windows_locale.

👍  thanks for the contribution


Don't pass loop if not defined

Fix https://github.com/Azure/azure-sdk-for-python/issues/23196

API changes have been detected in azure-cosmos. You can review API changes here

/azp run python - tables - ci

/azp run python - tables - ci


Separate docker builds for kubescape and kubescape-cli

Overview

@dwertent for some reasons it fails after retrieving artifacts https://github.com/matthyx/kubescape/actions/runs/6121845093/job/16616435781
... and I don't know how to make this working as a standalone build-image action

and I need your help to create the second action for ks microservice

reopening on master


Convert main.workflow into YAML syntax

actions/migrate: Converts GitHub Actions main.workflow files into the new .yml syntax
Migrating GitHub Actions from HCL syntax to YAML syntax - GitHub Help
Configuring a workflow - GitHub Help
Color stdout and Emoji

Closed by #63


Sign now button fix: Check to see if the form ref is still in the body

Apparently the ref still existed when the input elements were conditionally hidden.
https://developer.mozilla.org/en-US/docs/Web/API/Node/contains
Fixes #435

Also I had country instead of address1


Build Error in Mac Sonoma

Generating upb protos for :httpbody_proto failed: (Exit 1): protoc.exe failed: error executing command (from target @com_google_googleapis//google/api:httpbody_proto) bazel-out/darwin_arm64-opt-exec-2B5CBBC6/bin/external/com_google_protobuf_protoc_osx_aarch_64/protoc.exe '--upbdefs_out=bazel-out/darwin_arm64-fastbuild/bin/external/com_google_googleapis/' ... (remaining 3 arguments skipped)
Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
dyld[1559]: symbol not found in flat namespace '_CFRelease'
--upbdefs_out: protoc-gen-upbdefs: Plugin killed by signal 6.
Target //source/exe:envoy-static failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 0.745s, Critical Path: 0.33s
INFO: 9 processes: 9 internal.
Has any one seen this error on Mac Sonoma(14.1.1) ?

@ggreenway

Builds for me; not sure what the issue is.

what protoc and xcode version s are you using?

@keith @phlax do you have idea by any chance?

Nevermind. Upgrading Xcode fixed the issue.


Add can/map/define to default can require

This adds can/map/define by default when someone loads the can module with a module loader. Closes #2040

Shouldn't this be done in can/map itself?

I was thinking about that, too but I think it should stay its own plugin (and you can't load it in can/map because they would depend on each other).
When we put everything into their own modules it might live with can/map and be included by default (but also give the option to require them separately).

Yes, it should.
Sent from my iPhone

On Oct 29, 2015, at 12:55 PM, Matthew Phillips<EMAIL_ADDRESS>wrote:
Shouldn't this be done in can/map itself?
—
Reply to this email directly or view it on GitHub.


Issue-154

Added the implementation of the FAST Algorithm and Updated the readme as of the file.
closes #154

Amazing work @noviicee.

Amazing work @noviicee.

Thanks a lot! :)

Amazing work @noviicee.

Thanks a lot! :)


[1.3.0-RC2] Missing assets with binaries for download

andriy@notebook:~$ curl https://github.com/sbt/sbt/releases/download/v1.3.0-RC2/sbt-1.3.0-RC2.zip
Not Found

@eed3si9n this also is true for 1.3.0-RC3. It would be great to get these up.

There's manual work involved to create the installers, so I don't always create them for RCs.


Add support for double under the Number primitive.

The Number primitive needs support for double:

[x] Implement IEquatable<double>.
[ ] Implement IComparable<double>.
[ ] Implement IBinaryFloatingPointIeee754<double>.
[ ] Implement IBinaryFloatParseAndFormatInfo<double>.
[ ] Implement IMinMaxValue<double>.
[ ] Unit test coverage for the implementations.

Note: The unit test coverage for the IEquatable implementation will be contributed by the repo owner.

This issue needs information on which interfaces are implemented by the BCL types to ensure consistency with .NET runtime.

Currently being discussed in #43 .

Currently being discussed in #43 .

This issue is ready for work.


Migrate from RELEASE-NOTES.md to NEWS.md

NEWS.md seems to be the convention used by many Julia packages.

Completed.


Added support for // comments in expressions

This PR adds a workaround for the lack of support for inter-attribute comments in XML by allowing C++-style trailing // comments inside expressions. This is useful both for documentation purposes, but also for quickly commenting out an attribute during development.
For example, we'd like to be able to do this:
<UIView
    <!-- backgroundColor="red" -->
    left="20"
/>

But that's not permitted in XML, so instead we can now do this:
<UIView
    backgroundColor="// red"
    left="20"
/>

A slightly rough edge is for String expressions. Since the body of a string expression is treated as a literal, you cannot simply add // or that will be treated as a part of the literal string. Instead you must first add { ... } around the string body, then add the //:
<UILabel
    text="{ // Lorem ipsum }"
/>

The PR is split into two commits - the first adds support for comments in expressions. The second makes it possible to have empty expressions, which were previously an error (this is necessary to support commenting-out an expression, though it also allows comment-less expressions to be empty as a side-effect, which should maybe still be an error)

@nicklockwood Is there anything that concerns you regarding this change?

@mkarp not really - I thought I'd put it up as a PR just so people could post feedback in case there are any issues I didn't consider, since it's a fairly big (and irreversible) syntax change.


[p5js - HI] Translation of 3D pages to hindi

Hi, i have completed the 3D pages translation in hindi. @TanviKumar @Divyansh013 can you please review this PR and let me know the changes if any.
Thanks !

Hi @jaiakash @Divyansh013 @TanviKumar, could you fix this PR so it could pass the checks? Thanks!

Hi @Qianqianye, the checks are passed now. Can you please merge now.
Thanks

Looks great, thank you all!


Split contiv etcd and etcd-proxy into two daemonsets

Putting contiv etcd and etcd-proxy into the same daemonset and manage
the difference by a env file is not good for scaling (adding nodes).
This commit split them into two daemonsets so that when adding nodes,
k8s could automatically starting a etcd-proxy on new nodes without need
to run related play that putting env file.

ci check this

could one of admin trigger CI on this ?

ci check this

looks like the CI failed on a weave deployment ?

could admin review it ?

@mattymo do you mind review it ?

got 2 +1 , anyone like to click the button ?


Error while running main script

I get the following error while running the main script as
python src/main.py testcases output

Traceback (most recent call last):
  File "src/main.py", line 255, in <module>
    main(args.inputfolder, args.outputfolder)
  File "src/main.py", line 243, in main
    imgs_with_staff, imgs_spacing, imgs_rows)
  File "src/main.py", line 120, in recognize
    labels = predict(saved_img)
  File "/home/napulen/Mozart/src/fit.py", line 11, in predict
    train('NN', 'hog', 'nn_trained_model_hog')
  File "/home/napulen/Mozart/src/train.py", line 118, in train
    model, accuracy = run_experiment(model_name, feature_name, dir_names)
  File "/home/napulen/Mozart/src/train.py", line 104, in run_experiment
    features, labels, test_size=0.2, random_state=random_seed)
  File "/home/napulen/miniconda3/envs/mozart2/lib/python3.7/site-packages/sklearn/model_selection/_split.py", line 2131, in train_test_split
    default_test_size=0.25)
  File "/home/napulen/miniconda3/envs/mozart2/lib/python3.7/site-packages/sklearn/model_selection/_split.py", line 1814, in _validate_shuffle_split
    train_size)
ValueError: With n_samples=0, test_size=0.2 and train_size=None, the resulting train set will be empty. Adjust any of the aforementioned parameters.

Any idea what's going on?

I had the same issue at first. You have to run it directly in the main dir. So instead of python src/main.py testcases output run python main.py ..\testcases ..\output . Else it wont find the trained models, and therefore tries to train instead of analysing, I think.

You are right. Now it is working. Thanks!


Error when "next build"

next build

info  - Linting and checking validity of types
info  - Disabled SWC as replacement for Babel because of custom Babel configuration ".babelrc" https://nextjs.org/docs/messages/swc-disabled
info  - Using external babel configuration from <source_path>.babelrc
info  - Creating an optimized production build
info  - Compiled successfully
info  - Collecting page data
[    ] info  - Generating static pages (0/6)
Error occurred prerendering page "/builder". Read more: https://nextjs.org/docs/messages/prerender-error
Error: ENOENT: no such file or directory, scandir '<source_path>\data'
at Object.readdirSync (node:fs:1527:3)
at readdirRecursive (<source_path>\node_modules\destack\build\server\index.js:1887:26)
at loadAllData (<source_path>\node_modules\destack\build\server\index.js:1949:17)
at getStaticProps (<source_path>\node_modules\destack\build\server\index.js:2040:24)
at renderToHTML (<source_path>\node_modules\next\dist\server\render.js:386:26)
at async <source_path>\node_modules\next\dist\export\worker.js:304:36
at async Span.traceAsyncFn (<source_path>\node_modules\next\dist\trace\trace.js:79:20)
info  - Generating static pages (6/6)
The builder.js page is like as below:
import { ContentProviderGrapes } from 'destack'
import 'grapesjs/dist/css/grapes.min.css'
import MiniHeader from '../components/Layout/MiniHeader'

export { getStaticProps } from 'destack/build/server'

const Builder = (props) => {
    return (
        <div style={{height: '100%'}}>
            <MiniHeader />
            <ContentProviderGrapes {...props}/>
        </div>
    );
};

export default Builder;

I resolved it myself by adding the directory, "data", in the project folder.


iOS issue while calling Init()

Hi,
I downloaded the latest BarCodes version (3.0.8) using Nuget and I added BarCodes.Init() call in the AppDelegate class.
The call says the method is obsolete - You must call the Init() method from the platform project, not this PCL version.
It seems it doesn't recognize my iOS project as it should. It is a regular iOS universal project added with Xamarin.Forms template. Build symbols were MOBILE and IOS, which doesn't include the one I see in the source - UNIFIED. I tried later adding UNIFIED to the projects conditional compilation symbols but without success (i guess this should have nothing to do with the nuget worklfow anyway).
Any ideas?
Thanks

You can't just install the Nuget package into the pcl.  You have to install them into the iOS project as well.

Of course, I added the nuget package to the iOS project. It seems as it doesn't recognize the project because it labels it as a PCL

Are you using a classic ios project?  I only release support for unified.