Question: Is it possible to change the schema without re-importing all the data?

As time passes by, we may find our previous designed schema out of date. We may need sometimes add more fields to the cell. And possibly, but rarely, delete some fields.
I added a new field (type string) to one of the cells defined in .tsl file. Then recompiled the source code and called Global.CloudStorage.LoadStorage() to load the previous saved storage. However, I got an error

[ INFO    ] Loading cell type signatures.
[ ERROR   ] Inconsistent cell type signature for type #0.
[ ERROR   ] Expecting: {List<{string|List<{long|int|int}>|string}>}.
[ ERROR   ] Got: {List<{string|List<{long|int|int}>}>}.

And I failed to add value to the newly added field.
Is it possible to change the schema a little bit without reloading all the data? Or how to design the schema so that it is scalable and can thus avoid this problem.

As far as I tested, we could only append the definition of new cell to the .tsl file. (A waning will be prompted, but programmers will always ignore the warning, 233). Inserting the definition above other existing cells will also result in error.
Besides, we cannot change the existing cells' fields/schema even the order. Any changes will result in error. If you do want to change the schema, reimporting is needed. I think this significantly limits the usage scenarios. :(
Is there some other methods to alleviate the issue?

There's an option in LoadStorage to ignore the schema mismatch, but you have to be very careful to access the mismatched cell type.
For example if you have {List<{string|List<{long|int|int}>|string}>} and later would like to change to {List<{string|List<{long|int|int}>}>}, the new accessor will not take into account of the last string in a list, with the direct consequence that the length of the string will be interpreted as the length of the next string (surprise!).
Our typical approach to this problem is to create a new type {List<{string|List<{long|int|int}>}>}.
This will allow you to incrementally migrate the entities of the old type to the new one. A high-level ICell adapter can do the mapping for you, so that the change can be transparent to the upper layer of your application. 64K types should keep this going sustainable, just make sure to eventually migrate all the data so the type system is not exhausted.

btw great question! I'd definitely put this into a tutorial!

Thanks very much for your reply! This is a feasible approach. After all, we do not change the schema very often.
You mentioned "high-level ICell adapter". Is there some reference to it?

@bingzhangdai there you go: https://github.com/Microsoft/GraphEngine/blob/master/samples/freebase-likq/freebase-likq/FreebaseAdapter.cs

@bingzhangdai please check out the availability branch, we've got schema evolution working and you'll have immutable types and composite extensions now!

@yatli Great! I have seen lots of changes 👍. It is a little bit hard to read the source code diff directly. Once the docs are updated, I will try new features immediately and step into the lib to see how it works. Thanks!
btw, could you provide some brief instructions about how to read the source code? Maybe the code structure. It would definitely help me better understand the mechanism. If your are too busy, I can do it myself :)

@bingzhangdai it depends on which part do you want to get started with first:
Trinity.C is the memory management and native networking routines.
Trinity.Core is the upper part for a better user experience (yeah I know this is vague...)

TSL type system
Various extension points
Configuration
CommunicationInstance, modules, etc.
message passing endpoints
Trinity.TSL is codegen for generating cell types, data accessor and rpc stubs

closing the issue now. will have an example on storage schema evolution.

@yatli Seems that there will be lots of new features 👍 Looking forward.


Indoor supports for Google Map (android/ios)

Does any other open PR do the same thing?
PR #1288 , currently inactive since conflicts have not been resolved.
What issue is this PR fixing?

Added new events onIndoorBuildingFocused, onIndoorLevelActivated.
Added command setIndoorActiveLevelIndex
Added new example for Indoor Map.

How did you test this PR?

All new features are for Google Map.
Tested on Android emulator (Nexus 5), iOS Simulator (iPhone 6, 8), real Android device (OnePlus 2), real iOS device (iPhone 6S) by running example.

Replaced by https://github.com/react-native-community/react-native-maps/pull/2448


v1.21.6+rke2r1 RKE2 cluster is stuck in provisioning state on a Rancher server upgrade when a worker node is stuck in Nodeconditionsfailed state

Rancher Server Setup

Rancher version: 2.6.2 to 2.6-head commit id: 77392a6
Installation option (Docker install/Helm Chart): docker install

Information about the Cluster

Kubernetes version: v1.21.6+rke2r1 RKE2 cluster EC2 node driver
Cluster Type (Local/Downstream): Downstream

Describe the bug
v1.21.6+rke2r1 RKE2 cluster is stuck in provisioning state on a Rancher server upgrade
To Reproduce

Deploy a 2 node RKE2 cluster - 1 all roles, 2 worker nodes
Upgrade rancher from 2.6.2 to 2.6-head
Cluster goes into provisioning state  - logged bug - https://github.com/rancher/rancher/issues/35821
Worker node is stuck in Nodeconditionsfailed state
And the cluster is stuck in provisioning state

Expected Result:
On an Upgrade, worker node should not get stuck in Nodeconditionsfailed state
Maybe related to: https://github.com/rancher/rancher/issues/35714
Note:
Cluster seems to have recovered in ~30 mins

Root cause
The root cause of this issue was a race condition in the controllers for Rancher and for CAPI.
What was fixed, or what changes have occurred
The caches used in CAPI for the Rancher objects were started if the weren't already started.
Areas or cases that should be tested
RKE2/K3S provisioning:

Single node all roles.
3 nodes, one role each
1 control plane, 1 etcd and multiple worker nodes

What areas could experience regressions?
Provisioning and editing
Are the repro steps accurate/minimal?
Yes.

On 2.6-head commit id: f904267
RKE2 provisioning and edit usecases for the following have been tested

Single node all roles.
3 nodes, one role each
1 control plane, 1 etcd and multiple worker nodes

Issue was reopened by zube bot.


Cannot find module 'fs-promise'

module.js:472
throw err;
^
Error: Cannot find module 'fs-promise'
at Function.Module._resolveFilename (module.js:470:15)
at Function.Module._load (module.js:418:25)
at Module.require (module.js:498:17)
at require (internal/module.js:20:19)
at Object. (/Users/evilemon/work/ream/lib/index.js:4:12)
at Module._compile (module.js:571:32)
at Object.Module._extensions..js (module.js:580:10)
at Module.load (module.js:488:32)
at tryModuleLoad (module.js:447:12)
at Function.Module._load (module.js:439:3)
I encounter this problem in many examples,i wonder which verion of npm  or node?

node ≥ 6, npm ≥ 3

node 7.7.1  npm 4.1.2

no idea how this would happen, it's listed in package.json anyway https://github.com/ream/ream/blob/dev/package.json#L77 maybe provide the steps to reproduce this?

@evilemon are you installed ream with global? i had some same issue with other package
when yes: remove the global one and install ream in the project itself

@cannap I actually think it's ok to install ream globally.


[SDK] Train API

What this PR does / why we need it:

This pr contains the train api function which will be called by the user to run the training job.
Constants have been added to access them at multiple places.

Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):
Partially Fixes #1945
Checklist:

[ ] Docs included if any changes are user facing

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.02%) to 42.895%

Totals

Change from base Build<PHONE_NUMBER>:
0.02%

Covered Lines:
3755

Relevant Lines:
8754

💛  - Coveralls

/hold cancel

/assign @andreyvelich
@deepanker13 Please can you rebase this PR ?

/assign @andreyvelich
@deepanker13 Please can you rebase this PR ?
done

@andreyvelich I have a reason to keep the download dir field, as there will be a single place where we define the default value and that same value will be passed through the code flow, else we will have to verify the values are same or not through the entire code flow.

I think, we are ready to merge this PR.
Thanks again @deepanker13 for all of this work!
/lgtm
/assign @johnugeorge @tenzen-y for the final review.

@andreyvelich @johnugeorge @tenzen-y thanks for all the help

Awesome work @deepanker13
/lgtm
/approve


Fix doc errors

requirements.txt only available after checking out develop branch

need libdb-dev or else wormtable complains (at least with python setup.py install --user -- forgot to uninstall libdb-dev before testing this version of the instructions where we checkout develop branch first)
_wormtablemodule.c:22:16: fatal error: db.h: No such file or directory
#include <db.h>
^
compilation terminated.

Let me know if I should go through the full fork-PR process on the docs -- just did this in-browser quickly, before running off to bus to nyc

There must be something wrong here @nouyang-curoverse --- we got rid of the wormtable dependency ages ago, so we shouldn't need libdb at all.
I'm sure we'll sort it out tomorrow.

Closing this... this is apparently what happens when one tries to run on the master branch from a long time ago!


Add visualisation of the ball in NUsight localisation view

This PR adds ball visualisation to the localisation view. This PR also updates the field space transform of both field line points and ball to be computed property.

Nice one! LGTM — not sure whats going on with the build though.

Not sure either, @TrentHouliston any ideas?

We've been seeing it a bit, I'm not sure since node-gyp is definitely in that image

For more context:

It seems like something in the Node 18 image we use in CI has changed such that yarn can no longer find a globally installed node-gyp to build native dependencies.
It tries to install it on the fly but fails.

The temporary fix that worked for us is to add a workflow step before "Install dependencies" to install node-gyp. Something like:
      # Install node-gyp to build native addons
      - name: Install node-gyp
        run: yarn global add node-gyp

Or as part of the "Install dependencies" step:
      - name: Install Dependencies
        working-directory: nusight2
        run: yarn global add node-gyp && yarn --prefer-offline


implemented vitality totem, spider tank

ran specs and flake8

Coverage increased (+0.0%) when pulling b81fca858c3e88dc70a925d2ff9bd9de3e867eaa on zetsubo:add_new_cards into 299c568b8e0026f4b3e1434186bf2a491cabff0c on danielyule:master.


Release/1.19.0

1.19.0 - 2021-10-05
Fixed

Adding dataset to space. Space list on dataset page would be empty. #274
Typos "success" when returning status from API and "occurred" when logging to console.
If a dataset had multiple folders the layout would be wrong.

Added

Mime type for geojson
"when" parameter in a few GET API endpoints to enable pagination #266
Show space statistics (bytes, users. etc) #119
"id" in GET metadata.jsonld endpoints #278

Make sure to add to the CHANGELOG that a migration is needed for the counting of the bytes, and in case of a large clowder instance this could take up to an hour.


Expose base field type

Expose a type for the base field. It would reduce confusion- https://github.com/ingonyama-zk/icicle/issues/538
Describe the changes
This PR...
Linked Issues
Resolves #

Already exposed via point_field_t in https://github.com/ingonyama-zk/icicle/blob/main/icicle/include/curves/macro.h#L9


Update Content Safety sample1 analyze text

Contributing to the Azure SDK
Please see our CONTRIBUTING.md if you are not familiar with contributing to this repository or have questions.
For specific information about pull request etiquette and best practices, see this section.

API change check
API changes are not detected in this pull request.


Don't collapse optional positional arguments into [ARGS] in the usage string

Rust Version
rustc 1.15.0-nightly (daf8c1dfc 2016-12-05)
Affected Version of clap
2.19.1
Expected Behavior Summary
If I have one required and two optional positional arguments, I expect the usage string to say:
USAGE:
    clap-test <FILE> [<WIDTH> [<HEIGHT>]]

to properly represent the order in which the arguments need to be given.
Actual Behavior Summary
The optional positional arguments are collapsed into a single [ARGS] placeholder, and I have to look at the ARGS block and know it tells me the required order.
USAGE:
    clap-test <FILE> [ARGS]

FLAGS:
        --help       Prints help information
    -V, --version    Prints version information

ARGS:
    <FILE>      the configuration file
    <WIDTH>     texture width [default: 512]
    <HEIGHT>    texture height [default: 512]

Steps to Reproduce the issue
Run the program with --help.
Sample Code or Link to Sample Code
extern crate clap;
use clap::{Arg, App};

fn main() {
    let matches = App::new("My  app")
        .version("0.1")
        .author("Me<EMAIL_ADDRESS>        .about("Does stuff")
        .arg(Arg::with_name("config")
             .value_name("FILE")
             .help("the configuration file")
             .required(true)
             .takes_value(true)
             .index(1))
        .arg(Arg::with_name("width")
             .value_name("WIDTH")
             .help("texture width")
             .takes_value(true)
             .default_value("512")
             .index(2))
        .arg(Arg::with_name("height")
             .value_name("HEIGHT")
             .help("texture height")
             .takes_value(true)
             .default_value("512")
             .index(3))
        .get_matches();
}

I do agree, but at the same time I worry about applications that have lots of positional arguments. I'd like to get some others opinions on this issue before merging.
One point I'd like to change from your proposal though is the $ prog <required> [<optional1> <optional2>]
I'd prefer that go to $ prog <required> [optional1] [optional2]. This is personal preference but I much dislike the CLIs that give me a usage string like $ prog <opt> [[<req>|[-e <some>]] | [other]] It gests difficult to parse (mentally) very quickly.

Oh, I meant to mention that I'd be fine with not nesting the square brackets. Not sure what the best option is for handling lots of optional positional arguments, but the same problem already exists for required positional arguments, so a common solution would be nice.

So we already don't collapse them down if it's only 2 positional arguments (I believe...I can't remember :stuck_out_tongue_winking_eye: ). So it's entirely possible that we only collapse them after only after a [higher] certain number (perhaps up the number to...5?).

There collapsed to [ARGS] if there are two or more. I guess I could live with collapsing only if there are more than X items, or even just an option that allows me to just disable it altogether.

Adding an option to just disable the collapsing is easy, and I think the route I'll go since that won't mess with current usage strings (i.e. it's an opt-in feature).


GPM is not working for multi-cluster

Hello, we are using GPM where it's working for single cluster and when i set config to true i was facing below error in dashboard. and i even could see the context field in the web-page and can select the clusters .
Error
Can't connect to cluster due to an invalid kubeconfig file
Please verify your kubeconfig file and location
config looks like this:
     kind: Config
    preferences: {}
    users:
    - name: cluster_name
      user:
        exec:
          apiVersion: client.authentication.k8s.io/v1beta1
          args:
            - --region
            - region_name
            - eks
            - get-token
            - --cluster-name
            - cluster_name
          command: aws
          env: null
          interactiveMode: IfAvailable
          provideClusterInfo: false

Hi @Prasanna-543
It seems that you are using aws-based authentication, have you followed the instructions in the readme to use aws auth?
https://github.com/sighupio/gatekeeper-policy-manager#aws-iam-authentication

i haven't tried with aws-iam-authentication, do we just need this part:
FROM curlimages/curl:7.81.0 as downloader
RUN curl https://github.com/kubernetes-sigs/aws-iam-authenticator/releases/download/v0.5.5/aws-iam-authenticator_0.5.5_linux_amd64 --output /tmp/aws-iam-authenticator
RUN chmod +x /tmp/aws-iam-authenticator
FROM quay.io/sighup/gatekeeper-policy-manager:v1.0.3
COPY --from=downloader --chown=root:root /tmp/aws-iam-authenticator /usr/local/bin/
or should we need this need to be added to original image

do we need to add aws-cli too?

Correct.
From the kubeconfig you pasted it seems that it is configured to use the aws command to authenticate, so you will need the aws cli for authenticating instead of the aws-iam-authenticator.
in other words, you will need to build your own image starting from gpm's image and including the aws cli binary. Another option would be modifying the kubeconfig to use another auth mechanism, but I don't know if that will be possible in your environment.

The following Dockerfile should work:
FROM quay.io/sighup/gatekeeper-policy-manager:v1.0.3

# Add awscli to GPM image
USER root
ADD "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" /tmp
WORKDIR /tmp
RUN apt-get update && apt-get install -y unzip
RUN unzip awscli-exe-linux-x86_64.zip && aws/install && rm -rf /var/lib/apt/lists/*

# Go back to the original image settings
WORKDIR /app
USER gpm

Hey @Prasanna-543 were you able to make the custom image? Is it GPM working?
Regards,

Is there a possibility that building an image may change with different Architecture?

Sorry, I don't think I understand the question. The image will be different from the "official" one because you are adding stuff to it.
Could you please elaborate a little more?

Hi @ralgozino , I can build the image but facing below error
Error: container has runAsNonRoot and image has non-numeric user (gpm), cannot verify user is non-root (pod: "gatekeeper-policy-manager-ui-d59d54b7f-bs6dg_gatekeeper-system(31e6a428-44c8-4d85-a999-252f1a5fe815)", container: gatekeeper)

Hi @Prasanna-543 , change the line:
USER gpm

to
USER 999

yeah trying

I have tried with new image, i checked the pod and logs too there no errors but UI is showing same

It seems that you have no selected context, see the dropdown at the top right? try choosing one context.

i have edited above reply!

You should see some logs on the GPM pods about what is going on. If you still no see logs try the following 2 things please:

Open the browser console (F12) and you should see a request in red with a 500 error (or similar), check what is the response to that request.
Put the backend in debug mode, by setting the Environment Variable GPM_LOG_LEVEL to DEBUG, you should see more detailed logs in the pod with this change.

Can you try the same curl commands but add the -L flag? i.e.:
curl -L http://GPM_host/api/v1/contexts/

and
curl -L http://GPM_host/api/v1/constraints/

Let's see if you still get the CORS error with curl.
A workaround to see if you get it to work is to disable the CORS check in the backend, to do that add an environment variable APP_ENV with the value development.

yes i'm using company's laptop and needs vpn connection always! and many restrictions will be there!

                                    Page Expired, please close your browser and start a new request.

                        </div>
                    </div>
                </div> <!-- .ping-body-container -->

in both curl's having same

Some questions:

Are you using OIDC?

Can you tell me what you see if you click on this request?

Is this request that has CORS problems being done to GPM or to another host? I don't remember GPM doing requests like that:

OIDC was enabled in the values file but the service account included in deployment has iam role annotation where its has OIDC eks service

all other hosts are working fine, only GPM

Interesting
Please go to the Network tab, then click on the request with error 500 and then on the Preview tab, see:

OK, but the request that starts with auhtorize?... to what host / URL is being done?

i don't see a preview tab here and when i open one of the 500 request code i found this:
{"action":"Please verify your kubeconfig file and location","description":"Invalid kube-config file. Expected object with name arn:aws:eks:us-east-1:iacc_d:cluster in /home/gpm/.kube/config/contexts list","error":"Can't connect to cluster due to an invalid kubeconfig file"}

This is much better, the actual error is this:
Invalid kube-config file. Expected object with name arn:aws: eks:us-east-1:840891909344:cluster in /home/gpm/.kube/config/contexts list'

I believe is caused by this bug in the Python Kubernetes client library: https://github.com/kubernetes-client/python/issues/1193
Could please:

Confirm that the kubeconfig that you are using does not have a current context set? you can check with kubectl config current-contexts or just inspect the file.
If it is empty, set it to one of the available contexts

@ralgozino

@ralgozino
and can you remove 84******** number in the above comment, because i don't want it to be public!

done

and do u think this will have any effect
https://github.com/sighupio/gatekeeper-policy-manager/blob/ad6259d757d6e57920cbeaac9579a221f4ab5132/chart/values.yaml#L110

I don't think that is relevant to the problem.
Have you tried setting the env var APP_ENV to development? I'm going out of ideas.

not tried, i will try and let u know

this time error details was an extra part!

Yes!, we improved the error messages in the frontend a few days ago 😃
It keeps saying though that there's something wrong with the kubeconfig file. Are you 100% sure that the kubeconfig works? can you test it somehow?
The very last test we can do, is using the development version of GPM that changes the Python backend for a Go backend, we can discard issues with the Python library this way. To do so, change the FROM line like before to use this image instead: FROM quay.io/sighup/gatekeeper-policy-manager:20751b146c9093e7ca191b770671f7db869bf62d
If the Go backend has the same issue, I would not know what else to try 😞

Yes the kubeconfig works, because we are using locally the same one in (/.kube/config). I just copy pasted the cluster details and conttexts.

Is there a way that we can use local config file?

Yes the kubeconfig works, because we are using locally the same one in (/.kube/config). I just copy pasted the cluster details and conttexts.

What do you mean by this? Did you edit the kubeconfig file manually? please try with the same copy that you are using locally.
I forgot that the docker image for the Go version is starting from scratch (there's no OS) so that is why it is failing to build. For testing the go version of GPM with the aws binary you can use the following Dockerfile:
FROM public.ecr.aws/amazonlinux/amazonlinux:2
ARG EXE_FILENAME=awscli-exe-linux-x86_64.zip
ADD "https://awscli.amazonaws.com/$EXE_FILENAME" /tmp
# COPY $EXE_FILENAME .
RUN yum update -y \
  && yum install -y unzip \
  && unzip /tmp/$EXE_FILENAME \
  && ./aws/install

COPY --from=quay.io/sighup/gatekeeper-policy-manager:20751b146c9093e7ca191b770671f7db869bf62d /app /app
WORKDIR /app
ENTRYPOINT ["./gpm"]

i have same issue, but i could make it work when i rename the context with kubectl
bash-4.2$ kubectl config rename-context arn:aws:eks:abcd:123456:cluster/cluster1
Context "arn:aws:eks:abcd:123456:cluster/cluster1" renamed to "cluster1".

so the url was looks like http://localhost:8080/constraints/arn:aws:eks:abcd:123456:cluster/cluster1 (Not found) and after rename it with kubectl it will become http://localhost:8080/constraints/cluster1 and it become accessible, seems the url with arn is not working correctly.

thank you @kecebon9 ! this is great feedback. I think that URL-encoding the context name (or at least escaping the forward slashes /) should fix the issue. I will do some tests.


How to keep some of the layers of a Keras model, and save as a new model?

For example, I trained a siamese network. Now I want to abandon Embedding layer, what should I do?
I tried code as following:
model = load_model(model_path)
input_a = Input(shape=[None, 30, 256], dtype='int32') # Keep the shape the same as following layer
input_b = Input(shape=[None, 30, 256], dtype='int32') # Keep the shape the same as following layer
non_embed_model = Model(input=[input_a, input_b], output=model.output)

but it doesn't work. So anyone knows how to do this? Thanks a lot!

You should connect those input layers to the loaded model first.

@Vijayabhaskar96 Thanks for replying, but can you please give some more detailed explanations? Still quite confused. Thank you

Well, Load the model, get the layers(if you don't know the exact layer names,print the model summary) that are connected to the embedding layers, assign the input_a and input_b as the input of those layers, For example,if layerX1 and layerX2 are the successive layers of embedding layers 1 and 2, then assign
model.get_layer("layerX1").input=input_a
model.get_layer("layerX2").input=input_b
then,  non_embed_model = Model(input=[input_a, input_b], output=model.output)

@Vijayabhaskar96 solution raised the following error for me:
    model.get_layer('fc1').input = meta_input
AttributeError: can't set attribute

@Derekkk I had this very problem once. My Siamese model's legs were InceptionV3 networks and It was getting pretty difficult to fit everything in memory with an acceptable batch_size. I haven't found easy solutions for this and I don't think they exist: simply replacing the inputs would violate the immutability principle common in functional paradigm in which tensorflow/keras are built.
The way I solved this: I rebuilt the shared part of the network, layer by layer. For example, let's say your siamese model looks like this:
from keras import Input, Model
from keras.layers import Dense, merge
from keras.applications import InceptionV3

a, b = Input(shape=(299, 299, 3)), Input(shape=(299, 299, 3))
base = InceptionV3(weights='imagenet')
ya, yb = base(a), base(b)
y = merge([ya, yb], mode='concat', name='joint')
y = Dense(4096, activation='relu', name='fc1')(y)
y = Dense(4096, activation='relu', name='fc2')(y)
y = Dense(4096, activation='softmax', name='predictions')(y)
model = Model(inputs=[a, b], outputs=y)

So what you need to do is find the first layer that would receive your new inputs (joint, in my example) and re-call each layer one by one:
ya, yb = Input(shape=(2048,)), Input(shape=(2048,))  # new inputs.
y = x = [ya, yb]

shared_starts_at = model.layers.indexof(model.get_layer('joint'))
for layer in model.layers[shared_starts_at:]:
    y = layer(y)
model = Model(inputs=x, outputs=y)

This can become a mess if you have multiple outputs too, but it's still doable.

The right solution is in the documentation https://keras.io/applications/
from keras.applications.vgg19 import VGG19
from keras.preprocessing import image
from keras.applications.vgg19 import preprocess_input
from keras.models import Model
import numpy as np

base_model = VGG19(weights='imagenet')
model = Model(inputs=base_model.input, outputs=base_model.get_layer('block4_pool').output)

img_path = 'elephant.jpg'
img = image.load_img(img_path, target_size=(224, 224))
x = image.img_to_array(img)
x = np.expand_dims(x, axis=0)
x = preprocess_input(x)

block4_pool_features = model.predict(x)

You can get the layer by index too by doing model.layers[10].output for example.

@Vijayabhaskar96 Yea, I got the same error as @lucasdavid said. The solution provided by Lucas seems tricky for me, I'll give a try.

@gabrieldemarmiesse Thanks for replaying, but I think the code you provided is about how to get the outputs of the intermediate layer. What I want to ask is how to abandon the Embedding layer and change the Input. For example, the model is trained by an embedding layer, but when I call the model, I want to abandon embedding layer and write the embedding on my own. I tried to define an Input layer and connect it to the layer after embedding, but it doesn't work. So I wonder if there is any other ways to solve this. Massive thanks for replying tho.

Sorry, I didn't understand the question. As inputs to keras models must be Input layers, it seems impossible to do it automatically at the moment. So your best bet is to do it manually. It's sad because the function run_internal_graph in keras.engine.topology.py would do exactly what you want, but if it's impossible to create a model, it's impossible to use this function. Maybe a PR would solve this.

@gabrieldemarmiesse I think this would be a very useful addition.

I can't really do it right now. Maybe someone from the keras team could put a label on this issue 'contributions welcome'?

@gabrieldemarmiesse Intuitively I feel like it should work. The saved model contains graph and weights. So I think as long as I can feed the vectors with the same shape to some intermediate layer, it should work. But I haven't read the source code of this part so this is just a guess. But as @lucasdavid mentioned, this should be a very useful function.


Trouble with Keystores

Hi!
I love wslite. I am not trying to connect to a keystone that requires client authentication and when I specify sslKeystoreFile etc and whether or not I send it in on the send() call with a map or use System.setProperty(), I keep getting the following error:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
I am using Grails 1.3.7 and running on amazon elastic beanstalk but this error is actually happening on my development machine.
Would you have any ideas about how to fix/where to put the .jks files (preferably somewhere in the war file so I can upload into the EBS and not have to rebuild my site's environment using a custom image.)
THANKS!

When you say "client authentication" do you mean the server requires the client to have a valid cert?  The sslTrustStoreFile and System properties listed on the readme only pertain to the client trusting server side certs and not client.
For the server, if the cert is not self-signed you may need to add the intermediate CA's from the Certification Path to your jks file.
My guess with Grails is that the best place to put the jks file would be in the grails-app/conf directory so that it copies into the WEB-INF/classes during deployment.  Then you can use something like this.class.getResource('/my.jks') to find the full path.

Hi John:
Thanks for the speed answer. That was great. I actually did put it in there and the code now has a different error but I think it is finding it. Maybe it is now having the problem with the signing.
java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty
at java.security.cert.PKIXParameters.setTrustAnchors(PKIXParameters.java:183)
at java.security.cert.PKIXParameters.<init>(PKIXParameters.java:103)
at java.security.cert.PKIXBuilderParameters.<init>(PKIXBuilderParameters.java:87)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.getValidator(X509TrustManagerImpl.java:108)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:204)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:249)
at com.sun.net.ssl.internal.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1185)
at com.sun.net.ssl.internal.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:136)
at com.sun.net.ssl.internal.ssl.Handshaker.processLoop(Handshaker.java:593)
at com.sun.net.ssl.internal.ssl.Handshaker.process_record(Handshaker.java:529)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:925)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1170)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1197)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1181)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:379)
at wslite.http.HTTPClient.buildResponse(HTTPClient.groovy:146)
at wslite.http.HTTPClient.this$2$buildResponse(HTTPClient.groovy)
at wslite.http.HTTPClient$this$2$buildResponse.callCurrent(Unknown Source)
at wslite.http.HTTPClient$this$2$buildResponse.callCurrent(Unknown Source)
at wslite.http.HTTPClient.execute(HTTPClient.groovy:55)
at wslite.http.HTTPClient$execute.call(Unknown Source)
at wslite.soap.SOAPClient.send(SOAPClient.groovy:57)
at wslite.soap.SOAPClient$send.callCurrent(Unknown Source)
at wslite.soap.SOAPClient.send(SOAPClient.groovy:48)
at wslite.soap.SOAPClient.send(SOAPClient.groovy)
at iramarket.CompanyController$_closure17.doCall(CompanyController.groovy:676)
at iramarket.CompanyController$_closure17.doCall(CompanyController.groovy)
at grails.plugin.springcache.web.GrailsFragmentCachingFilter.buildPage(GrailsFragmentCachingFilter.groovy:152)
at grails.plugin.springcache.web.GrailsFragmentCachingFilter.buildPageInfo(GrailsFragmentCachingFilter.groovy:93)
at grails.plugin.springcache.web.GrailsFragmentCachingFilter.doFilter(GrailsFragmentCachingFilter.groovy:62)
at net.sf.ehcache.constructs.web.filter.Filter.doFilter(Filter.java:86)
at net.bull.javamelody.JspWrapper.invoke(JspWrapper.java:117)
at net.bull.javamelody.JdbcWrapper$DelegatingInvocationHandler.invoke(JdbcWrapper.java:277)
at $Proxy27.forward(Unknown Source)
at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:157)
at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:131)
at java.lang.Thread.run(Thread.java:680)

Sorry, I just reread this and I forgot to answer your question about which endpoint is requiring the authentication.
In this case, the server requires the client to authenticate using a certificate.

Hi @azesch
Currently groovy-wslite doesn't provide any direct support for client keys.  However, you might try using the following System properties.
javax.net.ssl.keyStore
javax.net.ssl.keyStorePassword

Another option would be to provide your own custom [HTTPConnectionFactory] (https://github.com/jwagenleitner/groovy-wslite/blob/master/src/main/groovy/wslite/http/HTTPConnectionFactory.groovy) to the HTTPClient.

Hi @jwagenleitner
Definitely using the System.setProperty("javax.net.ssl.keyStore") to specify my custom keystone file. I am not currently seeing that call stack anymore. I think it is getting out to the endpoint and having an error on that side. I think the error is that we're not transmitting anything for the key. I'll let you know.
Thanks for all the ideas. It was awesome.
Do you know of any other grails plug-in that supports this method of authentication?
THANKS!
Alex

Unfortunately, I don't have anything to test client side SSL auth with.  You might want to look at the following Grails plugins, I believe both are built on top of apache httpclient so there are probably some examples of doing this out there.
http://grails.org/plugin/rest
http://grails.org/plugin/cxf-client

Just to update you... I actually got to use System.setProperty("javax.net.debug", "ssl") and found out how my client key store was not loading properly. I fixed that store and wslite works awesome now.
Definitely helps if you just use a pkcs12 type keystore. Converting to that type of cert really did the trick. The other thing to note is that I didn't use the wslite sslTrustStoreFile and sslTrustStorePassword. I just used the System.setProperty("javax.net.ssl.trustStore") and System.setProperty("javax.net.ssl.trustStorePassword") and everything works great.
Thanks again for your help on this. I love wslite even more now.
Alex

Very glad to hear you got it all sorted out and that groovy-wslite is still working for you.
John

Hi, azesch!
Can you explain me how did you do to make it work wslite with SSL client certificate.
I need to know how to configurate a ketystore as pkcs12 type and then set javax.net.ssl.trustStore, and javax.net.ssl.trustStorePassword properties.
If you send me an example will be marvelous.
Thanks in advance.
Facundo


Crashed on map load

6.7-20230417-095608-29856-32884.zip
This may not be needed but I figure I would add it in.

closing, it is not needed anymore.

I would check this to be sure that the crash is at least resolved, however, I am not 100% sure that it is fixed. I had this crash last week or so.


Final files format? .java?.jsh?

Hello:) Just want to check for final do we create a .jsh file for each question?

I think we'll get files for each question with the correct extensions like the mock paper

I think we'll get files for each question with the correct extensions like the mock paper

Thanks for replying! so the files are provided to us. make sense.


Global switch for dev mode

Hey! Is there a way to disable all mocks in a single call? I had a look at the global options, but couldn't find anything. Basically I need an option like fallbackToNetwork that always falls back irregardless of whether there is a matcher defined. The use case for this is migrating from local stubs to the real API.

There isn't i'm afraid. If you want a hacky way to do so you could set
fetchMock.config.fallbackToNetwork = true;
fetchMock.addRoute = function () {
   this.routes = [];
}

... that should do the job.
A PR to do this properly would be most welcome. Something like accepting always as a value for fallbackToNetwork, and this skips routing entirely

Maybe you could smth like this, this just an idea...
const mockedInstance = fetchMock.createInstance()

// enable mocks function
mockedInstance.enable = () => {
    // mockedInstance.mock(...)
    // mockedInstance.mock(...)
}

mockedInstance.config.fallbackToNetwork = true

export {mockedInstance as default}

Thanks! Monkeypatching addRoute on the instance is working fine for me. Since this is a bit hacky, I created a PR based on @wheresrhys suggestion.


Object of class Corcel\PostBuilder could not be converted to string

Hi, I encounter some error,
this is my Post model:
`namespace App;
use Corcel\Post as Corcel;
class Post extends Corcel
{
protected $connection = 'wordpress';
public function scopeUpdateAffiliateData($post_id, $affiliate_link)
{
	$post = Post::find($post_id);
	$post->meta->affiliate_link = $affiliate_link;
	$post->save();
}

}
`
call it by:
$update = Post::UpdateAffiliateData($product->wp_post_id,$aff_link);
$product->wp_post_id is an integer, and $aff_link is string.
can someone enlight me? thank you

i got error : Object of class Corcel\PostBuilder could not be converted to string


Fixes KeyError when TypeError is raised in merge_args_and_kwargs

What was wrong?
When merge_args_and_kwargs is passed an incorrect argument count, it raises a KeyError instead of TypeError because of a typo: there is no 'input' in function_abi.
How was it fixed?
Fixed the typo.
Cute Animal Picture

Thanks.  THis is now available in 2.7.1 on pypi.


Notarize id returned by Apple

Hi,
when working from command line, the notarizing command (xcrun altool --notarize-app ... ) is returning an id like this:
[2020-04-09 16:42:37] [INFO   ] No errors uploading 'zip-archive-name'
RequestUUID = 0808dd63-4f76-41b3-b2ba-727ee740edbc
Based on that id I can query about the notarizing status (xcrun altool --notarization-history ... | grep 'uuid'). The result contain keywords like this: "in progress", "success", "invalid" (possible some other values - but you get the idea).
So, is there any way I can get the uuid returned by the notarize process when submitting the app (zip archive) to apple website?
Thank you

Closing? Maybe an explanation would be usefull.
Thank you


New package: MaximumIndependentSet v0.1.0

Registering package: MaximumIndependentSet
Repository: https://github.com/claud10cv/MaximumIndependentSet.jl
Created by: @claud10cv
Version: v0.1.0
Commit: a396959c2729794cecd90a7cf7426fd8e53ee8e3
Reviewed by: @claud10cv
Reference: https://github.com/claud10cv/MaximumIndependentSet.jl/commit/a396959c2729794cecd90a7cf7426fd8e53ee8e3#commitcomment-140158406
Description: Julia wrapper for the maximum independent set method

[noblock]
Congrats on the package! Since it implements one specific algorithm and not a generic toolbox to solve MIS, maybe a more specific name would be appropriate?

I did modifs according to your comments and submitted another PR. However, it seems like registrator is taking it as a new package

@gdalle I did something wrong and created a newer PR (#103491) to implement your changes (and install Tagbot + CompatHelper actions). May you please discard and close this one?

It's okay this one will not get merged

Closing in favor of https://github.com/JuliaRegistries/General/pull/103491

I did something wrong and created a newer PR

If you don't change the version number, it will update the existing PR instead of creating a new one


Errors when ensemble using Pre-trained checkpoints

I tried to reproduce the test ensemble result in task Emotion-6. When I load Emotion ensemble Pre-trained checkpoints that you give, there comes RuntimeError.
Traceback (most recent call last):
File "ensembling.py", line 76, in
net.load_state_dict(state_dict)
File "/usr/local/lib64/python3.6/site-packages/torch/nn/modules/module.py", line 845, in load_state_dict
self.class.name, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for Model_LA:
Missing key(s) in state_dict: "lstm_y.weight_ih_l0", "lstm_y.weight_hh_l0", "lstm_y.bias_ih_l0", "lstm_y.bias_hh_l0".
Unexpected key(s) in state_dict: "adapter.weight", "adapter.bias".

Take a look at Line https://github.com/jbdel/MOSEI_UMONS/blob/master/model_LA.py#L290
It is possible you need to use the self.adapter instead of self.lstm_y.
I'll check the code.

I changed self.lstm_y to self.adapter, it comes another error. It seems adapter is a FC layer, not LSTM?
Traceback (most recent call last):
File "ensembling.py", line 76, in
net.load_state_dict(state_dict)
File "/usr/local/lib64/python3.6/site-packages/torch/nn/modules/module.py", line 845, in load_state_dict
self.class.name, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for Model_LA:
Missing key(s) in state_dict: "adapter.weight_ih_l0", "adapter.weight_hh_l0", "adapter.bias_ih_l0", "adapter.bias_hh_l0".
Unexpected key(s) in state_dict: "adapter.weight", "adapter.bias".

Adapter is there
https://github.com/jbdel/MOSEI_UMONS/blob/master/model_LA.py#L298
dont forget to also modify forward.

Thanks. I tried the checkpoints and got the test ensemble acc 82.26 in Sentiment-2 task. Is there any way to reproduce 82.4 in your paper?


Create HTML page for Wilson (#6309)

Changelog category

Not for changelog (changelog entry is not required)

Closed in #6571


 If we combine this with killing updated when going onroad it should fix https://github.com/commaai/openpilot/issues/23879. We can also run an aggressive gc, but not sure if we want to change that behavior.
(disabled jenkins for now to not change the config permanently on those devices in case we don't merge it)

LGTM. I would also disable gc.autoDetach explicitly and cloudlog the gc start and duration.
FYI, this shouldn't have permanently changed anything about jenkins. We make an ephemeral copy of the repo that the tests are run in.

Shall we also set pack.windowMemory and pack.threads to something reasonable? Maybe 512M and 4 threads?

Takes about 40s on master and 4 seconds on release3. Think it's fine to run this every time (and not use git gc --auto).


GitHub Actions for Lithops PRs and nightly builds - restore the missing functionality

Some of the recent commits had broken nightly builds support and enablement to use different buckets for CF and CE
Here are some comments that @Cohen-J-Omer provided:

I’ve noticed my 2 config files were swapped with a single one and a few flags during runtime. The reason behind the separate config files for CE and CF was to assign a different bucket for each git-hub job, as I’ve noticed quite a bit of issues involving race conditions, due to simultaneous reads/writes on the same bucket.

The nightly build workflow was completely removed. Indeed, currently the two workflows share a lot of code, but the nightly build was supposed to run more extensive checks in the future and send alerts to a slack channel. moreover, it was configured to run once every 24H, while the current one does not.

@Cohen-J-Omer is there anything else?
@erezh16 @JosepSampe

I’ve noticed my 2 config files were swapped with a single one and a few flags during runtime. The reason behind the separate config files for CE and CF was to assign a different bucket for each git-hub job, as I’ve noticed quite a bit of issues involving race conditions, due to simultaneous reads/writes on the same bucket.

Race conditions are produced if you run lithops clean command from multiple places while there is another job running in another places. Now lithops clean is only executed once at the end of the 2 tests, so there is no need to configure multiple buckets

The nightly build workflow was completely removed. Indeed, currently the two workflows share a lot of code, but the nightly build was supposed to run more extensive checks in the future and send alerts to a slack channel. moreover, it was configured to run once every 24H, while the current one does not.

IMO there is no need to run the tests every 24 hours. We don't have anything critical in the project that needs to be tested every 24 hours. the code only changes on a PR, so run the test then is enough (I think). Moreover seems that this nightly build workflow is automatically activated on all forks, and me and others started to receive these emails:

if in the future you plan to add more tests or critical tests, we can enable it, but for now, i think we don't need to activate this nightly build workflow (IMO).

Hey @JosepSampe, good morning.

Race conditions are produced if you run lithops clean command from multiple places while there is another job running in another places. Now lithops clean is only executed once at the end of the 2 tests, so there is no need to configure multiple buckets

My original idea was to make the git-action feature exclusive for the lithops source repository,
and the local test environment for the contributors.
(which is why I left constants, that later would be swapped with the constants of the premium accounts).

As of right now, where users are given access to these features, I believe running lithops clean before starting to
run any other git-hub step is mandatory, since users might have previously stored runtimes on the bucket
(from previous jobs).

If you believe the only time a race condition on a bucket can occur when running lithops clean while another job is
running, and you'd like to avoid creating a second bucket, I suggest reinstating the preliminary job you removed,
where the bucket will be cleaned. Also, make all other jobs dependable upon said job (i.e., wait for its completion).

IMO there is no need to run the tests every 24 hours. We don't have anything critical in the project that needs to be tested every 24 hours. the code only changes on a PR, so run the test then is enough (I think).

You make a lot of sense, perhaps the nightly workflow could have been issued on a separate PR once a use for it was found,
I agree. The thing is, the idea to start a test-run of the nightly build as soon as possible, was already decided in a
meeting, so we probably needed to forward your opinion before pulling the trigger on the change.

Moreover, seems that this nightly build workflow is automatically activated on all forks, and me and others started to receive these emails:

I'm familiar with the matter. Once the git-hub workflow was to be operational (given the premium accounts)
I would add documentation, that among other things, would state that all forked repositories must either disable
git-actions or allow only for select actions (through the repositories' settings).

An issue I'd like to address:
I understand the faults in having a list of runnable jobs stored in a file (jobs_to_run.txt), that upon every change would
have to be re-committed, but I believe the current solution isn't future-proof to say the least:

Currently, each time you'd like to omit a job from running you'd have to delete and re-create a rather
long secret, which functions as a configuration file, that simply doesn't contain a specific segment (e.g. CE).
In the future, you wouldn't be able to disable a configurations in that way. For example, lets say you'd like to disable CE-REDIS, but you'd like to run both CE-COS and CF-REDIS.
You'd have to keep all segments of the configuration files intact, which will signal CE-REDIS to run.

I suggest reinstating the preliminary job in such a way that it will not only clean the bucket (as mentioned above),
but will also read which jobs to run from a list of job names, perhaps residing in a new secret.
As a side note, you missed an 'n' spelling 'code_engine' in main.yaml.

As of right now, where users are given access to these features, I believe running lithops clean before starting to
run any other git-hub step is mandatory, since users might have previously stored runtimes on the bucket
(from previous jobs).

There is no need to run lithops clean at the beginning of each job, if you run it at the end of all jobs in a workflow is enough, everything in the storage will be cleaned. Regarding the runtimes, I added 2 new steps that explicitly deletes the runtimes used in the execution of the workflow: here and here. So in the next workflow execution everything is cleaned.
Basically I deleted the nightly-build workflow because for now it had the exact same code of the PR workflow, and to avoid those errors emails to users. IMO receive those error messages every 24 hours is not good for the project and bad user experience. And if for now they don't provide any value, better deleted.

Currently, each time you'd like to omit a job from running you'd have to delete and re-create a rather
long secret, which functions as a configuration file, that simply doesn't contain a specific segment (e.g. CE).
In the future, you wouldn't be able to disable a configurations in that way. For example, lets say you'd like to disable CE-REDIS, but you'd like to run both CE-COS and CF-REDIS.
You'd have to keep all segments of the configuration files intact, which will signal CE-REDIS to run

This is not like this. The main intention of allow avoid introducing some credentials in a long secret was not to enable/disable jobs trough the config, but allow the workflow run successfully if for some reason it is not possible to introduce some credentials of a specific service in the config. In my case, as a developer, it can be interesting having this workflow configured to run in my dev branch while I'm doing envelopment, so for example, if I don't want to run the code_engine job, I can now avoid introduce the credentials in my GITHUB secret without having to edit the source code of the workflow (yaml).
Regarding this jobs_to_run.txt, Why do you need it? I found it a bit messy. You created a script file located in another part of the project that reads this file located in another part of the project to decide which jobs to run. You can do exactly the same in the yaml itself without these 2 extra files. If you want to enable or disable jobs, just edit the workflow yaml file. This will be less messy, and easily understandable for others. In those yaml files you can do everything you want, there are thousands of options to use. For example, you can set env vars at the begging of the project to decide which jobs to run. Take a look to what Ray guys do, everything is put in the same yaml.


Add A Simple Bert Embedding Test

Add Bert embedding test for comparison:

Add a new directory bert-cache to dump temporary pretrained weights files
Add a new mode in BertHandler dataset class as well as some logic changes in embedding_cnn.py when testing bert embedding
Check updates in README.md and requirements.txt for running up details

Why the requirements.txt is a binary file?

The requirements.txt initially generated by pip is encoded with UTF-16 LE, which git can't recognize it. Now it's changed to UTF-8 and verified.😀


Provide ability to use specific ip:port for Foxx applications instead of the standard API port

While it is possible to do port forwarding to accomplish this, it would be practical to be able to provide the ability to define an ip address and/or port for a FOXX application to listen to.
It is good to have this, in case one builds an API in ArangoDB for external users to directly connect to.
It's better to use standard ports like 80/443 instead of 8529, as non-standard ports are sometimes blocked by proxies.
Also, it would be cleaner to have a separation of such external facing API's and the standard ArangoDB port 8529 API for management purposes.
What do you guys think?

I'm closing this issue because we have decided that this use case is out of scope for the project itself. There are plenty of good reverse proxy solutions that provide this capability, as described in this cookbook recipe.
ArangoDB 3.0 will further improve support for reverse proxies by supporting the X-Forwarded-* series of headers (which is opt-in for security reasons), i.e. if the service is configured to trust proxies, it will transparently apply the X-Forwarded-Host header instead of the Host header to derive req.hostname: https://github.com/arangodb/arangodb/blob/devel/js/server/modules/%40arangodb/foxx/router/request.js#L198
You can find further information on configuring Apache and nginx as reverse proxies at e.g. http://citadel.org/doku.php/faq:installation:apacheproxy


Unable to connect to local MPD server

Hey! I just found this app looking for a good MPD player on Windows (I too have used that old version of Cantata all this time) but it doesn't seem to be able to connect to my locally hosted MPD server, while Cantata and other clients can. Tested on MPD 0.22 and 0.21 Windows binaries.

If your MPD server is locally hosted, you're probably running into the issue where UWP apps can't access localhost.
(See https://stackoverflow.com/questions/33259763/uwp-enable-local-network-loopback/33263253#33263253 for a summary.)
There is a workaround you can use with checknetisolation which should work:
checknetisolation loopbackexempt -a -n="13459Difegue.Stylophone_zd7bwy3j4yjfy"

That worked! Though now I'm having another issue, should I open up a separate GH issue for this?

A separate issue would be good yeah, thanks.
I suspect I'll have to try with a windows build on my end to try and repro the issue.

Unfortunately, that workaround doesn't seem to work for me. Did the App container name change recently? I am running Windows 11 22H2 if that helps.


[VS Code] .gitignore files do not show in the File Explorer

Logs.zip
Product and Version [VS/VSCode]: VSCode
OS Version [macOS/Windows]: macOS
Live Share Extension Version: 0.3.735
Target Platform or Language [e.g. Node.js]: MacOS for the language Go
Scenario:
Any files that are inside of .gitignore does not show in the file explorer on the left.
Steps to Reproduce:

Have the host create a .gitignore file ignoring / hiding directories and files. Include a file with a valid public / exported Go method (with a documentation comment)
Have the host create a new LiveShare session
Have the participant open the LiveShare session
Notice how none of the files that were in the .gitignore show in the explorer
However, notice that if you have a valid Go object (example: a public method) and you try to use that public method in code, IntelliSense successfully identifies it and gives you full method comment and parameter info for that method that exists in the hidden file.

@jpopadak, this is by design: any files matched by .gitignore are automatically hidden from the guest file tree. As you point out, code and language services may still reference the hidden files. And guests can even open hidden files by means other than the file explorer, such as following the host, go-to-definition, step-into in a debugging session, find text results, or go-to-file.
If you want to change this behavior, you can add a .vsls.json file to the project and specify a value for the "gitignore" setting:

none - .gitignore contents are visible to guests in the file tree (assuming they are not filtered by a guest editor setting).
hide - The default. Globs inside .gitignore are hidden from the guest file tree but accessible to guests in other ways.
exclude - Globs inside .gitignore cannot be accessed by guests in any way.

For more details refer to the reference doc: https://docs.microsoft.com/en-us/visualstudio/liveshare/reference/security#controlling-file-access-and-visibility

Thank you for this information, very detailed.
I looked through the documentation, but I apparently missed this entire section...
Thanks again!

@jpopadak Does this always require its own JSON file to configure?  There's roughly 30 settings for live share that can be modified directly in VS Code's own settings file(s).

https://docs.microsoft.com/en-us/visualstudio/liveshare/reference/security#controlling-file-access-and-visibility


Develop first iteration of ESI Cluster Orchestrator

One use case of ESI is creating a small bare metal cluster. Doing so using OpenStack commands is painstaking, time consuming, and a little intimidating. An orchestration commands that takes in a single configuration may help here, especially since that configuration can be shared from user to user making initial orchestration a breeze.

@joachimweyl I don't see this on the zenhub board anymore - did it disappear somehow?

I migrated it from esi repo to this repo and this repo needed to be added to ZenHub to show up on the workspace. I have added this repo to our ZenHub Workspace.


Sidebar with Navbar keeps overlay even when closed

Hi, congrats for the awesome framework!
I was trying the example https://flowbite.com/docs/components/sidebar/#sidebar-with-navbar
I just copy-pasted the code within a react component, replaced class with className.
Everything was rendered just fine, but when I close the sidebar on the mobile screen it seems that it maintains the overlay over the main content. Showing the behaviour I am noticing:

Any help would be greatly appreciated!

Just following up on this, it seems for some reason there are 2 drawer-backdrop divs created:

Have the same issue here

Have the same issue too

I have found a possible cause and solution. The cause is that you are possibly initializing flowbite twice. Perhaps in a framework that uses components, you initialize flowbite (or the drawers) on two or more components, which are being rendered as the same time.
If it is initialized only once, in the layout for example, everything will work fine.

I have the same issue

I get this same issue in rails 7 application using esbuild.
The documentation suggest that including turbo import should handle the double load issue with turbo, however I don't think it does.
https://flowbite.com/docs/getting-started/rails/#esbuild

has anyone figured this out? im having the same issue in nuxt 3. weirdly it seems to work fine in dev mode, but once its deployed im experiencing the same issue.  i tried to make sure im not initializing flowbite twice anywhere like @RafaElZgz suggested, but it still doing the same thing.

We have the same issue when using Laravel, turns out we initialized it in app.js (NPM) & resources/views/layouts/app.blade.php (CDN).
How we found it:

Inspect the page.
Open the network tab, and select JS to filter the network.
Look for flowbite.js.

has anyone figured this out? im having the same issue in nuxt 3. weirdly it seems to work fine in dev mode, but once its deployed im experiencing the same issue. i tried to make sure im not initializing flowbite twice anywhere like @RafaElZgz suggested, but it still doing the same thing.

I think I've got it fixed on 1.8.1, the issue seemed to be I had initflowbite() initializing on 2 places. One on a default template that was on every page to open and close the side bar drawer and a 2nd on an admin page to use the tabs functionality. The solution was to just use initDrawers() on the default page and initTabs() on the admin page instead of initflowbite() in both places.
There is also the latest version 2.0.0 that I think also solves this even if just using intiflowbite() everywhere.  But I was having some weird issues witj it where the sidebar wouldn't open consistently. Not sure if that was a 2.0.0 issue or what, but reverting back to 1.8.1 and breaking out the functions works I believe.

Hey everyone,
Fixed the double overlay issue in v2.1.0: https://github.com/themesberg/flowbite/releases/tag/v2.1.0
Basically, a newly added instance with the same id will override the previous instance.
Old event listeners will be removed while the new ones will be added - tested this on a local Ruby on Rails 7 project.
Would help if some of you would also cross test this!
Cheers,
Zoltan


Trouble displaying static front page and blog post page

Hi Tania
Firstly thank you for creating your wonderful website I've learned a lot browsing through your articles. I particularly liked your Oblate theme so I decided to have a play about with it.
Basically, with the default "display latest posts" set the static homepage shows up as it should but I can't get the blog page to work under this setting. I tried to change the settings from "show latest posts" to a custom front page and blog page. I can set the blog page to a page I created named blog but I can't find a way to display the static front page as the homepage. Any ideas?
Kind Regards
Jus
@sassigeek

I think I've done it, maybe not the correct way but it works.
I created a page called blog and assigned it as the blog page under settings > reading. So /blog now shows all the blog posts
I then created a page called home and assigned the front-page.php to the newly created /home page and then set this to the front page under settings > reading. So it works now, not sure if this is the correct way but it's definitely working.

Yep, that's the right way! Or at least how I do it. Sorry I missed this.


[Bug] Freshness test in email_event source table

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue
The src_hubspot.yml for this package contains a freshness test to one table only email_event. Even if I disable the table in dbt_project.yml the freshness check will be in place when running dbt source freshness. Is this the expected behavior?

Plugins:
  - snowflake: 1.1.0 - Up to date!

Additional Context
No response
Are you willing to open a PR to help address this issue?

[ ] Yes.
[ ] Yes, but I will need assistance and will schedule time during our office hours for guidance
[X] No.

Hi @gabriel-inventa! Thanks for raising this issue. We've applied changes to a branch, once it passes testing and PR review we'll go ahead and merge it!


Support for additional fields

First, this library is awesome. I spent hours looking for a Twitter v2 Streaming library, and this worked perfectly on my first try.
Twitter supports adding extra fields to streams by adding parameters to the /2/tweets/search/stream request. It would be cool if there was a way to enable this using this library.
If you're busy, I'd be happy to make a PR to do so. In the meantime, it was easy to modify the library locally to hard-code this functionality :-)

Hi @aaronjanse
Creating structs for /2/tweets/search/stream responses is on my todo-list as a requirement for the v1 release. I have not started this work yet, however, now that I see there is interest in this library, we should prioritize it.
I would love to see your idea! When you create a PR, can you tag me on it? Maybe we can work on this feature together.

Hi @aaronjanse
Creating structs for /2/tweets/search/stream responses is on my todo-list as a requirement for the v1 release. I have not started this work yet, however, now that I see there is interest in this library, we should prioritize it.
I would love to see your idea! When you create a PR, can you tag me on it? Maybe we can work on this feature together.

Sounds good! I'll update to v0.2.0 then start working on a PR :-)

Sounds good! I'll update to v0.2.0 then start working on a PR :-)

@aaronjanse I took a pass at this and came up with another idea. What do you think about this idea:
Instead of maintaining a struct with all possible fields returned by Twitter, we leave it up the consumer of the library unmarshal the []byte into their struct. The burden of managing all possible return values is greater than the value of creating the type EveryPossibleFieldFromTwitter struct {...}
Additionally, more value could be delivered by enabling developers to curate their query params for the GET v2/tweets/search/streem. These could be arguments passed into the StartStream method. The possible query parameters we can use for this endpoint can be found here: https://developer.twitter.com/en/docs/twitter-api/tweets/filtered-stream/api-reference/get-tweets-search-stream
I have a work in progress branch here: https://github.com/Fallenstedt/twitter-stream/pull/11

@aaronjanse I took a pass at this and came up with another idea. What do you think about this idea:
Instead of maintaining a struct with all possible fields returned by Twitter, we leave it up the consumer of the library unmarshal the []byte into their struct. The burden of managing all possible return values is greater than the value of creating the type EveryPossibleFieldFromTwitter struct {...}
Additionally, more value could be delivered by enabling developers to curate their query params for the GET v2/tweets/search/streem. These could be arguments passed into the StartStream method. The possible query parameters we can use for this endpoint can be found here: https://developer.twitter.com/en/docs/twitter-api/tweets/filtered-stream/api-reference/get-tweets-search-stream
I have a work in progress branch here: https://github.com/Fallenstedt/twitter-stream/pull/11

I think that's reasonable! As a user, it should be very straightforward to deserialize into custom structs.
I must admit that I've been sidetracked from making a PR, and I probably won't be able to contribute new features within the near future. But I'll upstream as a PR any changes I make locally if I happen to find a bug :-)
Thanks again for your work on this library!

I think that's reasonable! As a user, it should be very straightforward to deserialize into custom structs.
I must admit that I've been sidetracked from making a PR, and I probably won't be able to contribute new features within the near future. But I'll upstream as a PR any changes I make locally if I happen to find a bug :-)
Thanks again for your work on this library!

Fixed in: https://github.com/Fallenstedt/twitter-stream/pull/12
Will be available in v0.3.0 soon.


Template.Dialog is not found in registered script list!

Seeking some help of what am i doing wrong.
I have SereneCore project template in Visual Studio 2017 Community.
When i start it from VS everything work perfect.
Then i do publish in Custom Folder, deploy its on IIS hosting and start site.
When i open site in browser i log in and everything seems fine BUT when i hit "New Customer" or another " New ..." button or click on some row in table nothing happens.
All i can get is from browser inspector mode:
Uncaught Error: Script data Template.SupplierDialog is not found in registered script list! at u (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:233) at Object.c "ure (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:233) at Object.d "Template (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:233) at r.i.getTemplate (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:234) at r.i "structor (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:234) at r.i "structor (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:234) at r.q "structor (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:239) at new r (Bundle.Site.js?v=h2TVaHEmao8rL4ieFY_ZUw:48) at Function.e.create (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:234) at i.createEntityDialog (Bundle.Libs.js?v=x1qWJe2-Z0sxqSb86aLLFA:244)
Help please, what i miss or do wrong.
Thank you.

does the dialog show or not? I'd start by checking that there are no typo's in the script tags such as the FormScript(). Then I'd also check that when you published to the live folder, that the dialog files were properly published

To  sayuga. Thank for your participation.
Dialog doesnt show.
If there was typo it wouldnt work when i run it from VS i think.

Then I'd also check that when you published to the live folder, that the dialog files were properly published
There is the problem i think, but i dont know which files and where should be.

Found it.
This html templates property "Copy to Output Directory" by default was set to "Do not Copy".


Geth Errors Mapping

Implement error mapping functions, taking clue from errors.go
Implemented error mapping tests

Codecov Report

Merging #176 (51581db) into main (c251619) will increase coverage by 1.50%.
The diff coverage is 28.87%.

@@            Coverage Diff             @@
##             main     #176      +/-   ##
==========================================
+ Coverage   19.69%   21.20%   +1.50%
==========================================
  Files          12       13       +1
  Lines        1599     1844     +245
==========================================
+ Hits          315      391      +76
- Misses       1253     1421     +168
- Partials       31       32       +1

Impacted Files
Coverage Δ

client/errors.go
28.87% <28.87%> (ø)

client/ethereum.go
0.00% <0.00%> (ø)

client/blockchain.go
0.00% <0.00%> (ø)

client/chainlink_models.go
0.00% <0.00%> (ø)

client/chainlink.go
61.02% <0.00%> (+0.63%)
:arrow_up:

config/config.go
66.97% <0.00%> (+1.25%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c251619...51581db. Read the comment docs.


Serial Port / WiFi Provisioning Improvement for DIY

At the moment we use a Hardcoded Whitelist for the Serial.
In Discord we had a discussion about how to improve:
https://discord.com/channels/817184208525983775/948579740225261598/1141842153161642124
Summary:

In the WiFi windows: Warn if it is not a known DeviceType, and ask if it is a Tracker plugged in.

If yes then add the PID/VID temporary to the allowed list, and allow to automatically connect

In the Serial Monitor do not use the Whitelist for the Selection but add a Blacklist

Improvement Black and Whitelist in a file that can be exchanged whiteout rebuild. (Config or Install File)

Blacklist Candidate:

Valve Index ( VID_28DE&PID_2102 ) Maybe the full VID_28DE range. To not interfere with them.

The commits below changed the behavior a lot.
#756
#823
Could be closed?


Changing cursor changes icons, unable to change icons back afterwards

Greetings. First of all, I'd like to thank you for this very useful software.
I am using nwg-look to change the look of gtk on hyprland. I was using breeze-dark icons and cursor, when I decided to change the cursor to Catppuccin-Mocha-Dark from the AUR. In selecting a different cursor, all icons changed to adwaita (i noticed this on thunar, which is the main gtk program i use), and all my attempts to set a different icon set were for naught, as I seem to be unable to change the icons using nwg-look. I have had to install kde-plasma and make the change there in order to be able to have my old icons with the new cursor.
I'm attaching a video showcasing the issue as well as a log file of the output of nwg-look.
https://user-images.githubusercontent.com/89081503/233036291-57f6e182-517c-4030-9a31-bb4c7fc85274.mp4
nwg-look.log

I've just installed the catppuccin-mocha-dark-cursors AUR package. Everything works well on my side, and changing the cursor theme does not affect the icon theme. This must be something about your environment. I noticed you use some exotic keys in /home/david/.config/gtk-3.0/settings.ini. Do you use a script to apply these settings? Possibly it overwrites what nwg-look applies directly. No better idea at the moment.

Can't reproduce it on my side. Does it happen on sway as well? May I see your hyprland.conf?

Also: maybe something is wrong with you breeze icon theme? I couldn't install any, always ended up in errors.

I have installed another icon theme to see if I had better luck, and I could not apply that one either, so it doesn't seem like the breeze icon theme is at fault. I have also tried using a laptop that has never had kde installed onto it, only hyprland. And the issue also happens on it, so it doesn't seem like it was kde's fault either. I'll try to setup sway and test, in the meantime, here is my hyprland.conf.
hyprland.conf.txt

Still no clue. It will be very difficult to diagnose.

I have installed sway on the laptop and the results are the same, I cannot change the icon theme either. If I can provide more information, please ask.

I can only shoot blindly. Below you see dependencies of nwg-shell, which nwg-look was written for. You could randomly try installing GTK-related stuff out of them, which is currently missing from your system. I would start from gnome-themes-extra.
depends=('foot' 'gnome-themes-extra' 'grim' 'imagemagick' 'jq'
         'libappindicator-gtk3' 'light' 'ttf-dejavu'
         'network-manager-applet' 'pacman-contrib'
         'papirus-icon-theme' 'playerctl' 'polkit-gnome'
         'python-geopy' 'python-yaml' 'slurp' 'swappy' 'sway' 'swayidle'
         'swaylock' 'swaybg' 'wl-clipboard' 'xorg-xwayland' 'wlsunset'
         'azote' 'gopsuinfo' 'nwg-bar-bin' 'nwg-dock-bin' 'nwg-drawer-bin'
         'nwg-menu-bin' 'nwg-look-bin' 'nwg-panel' 'nwg-shell-config'
         'nwg-shell-wallpapers' 'nwg-displays' 'python-dasbus' 'swaync' 'gtklock'
         'gtklock-userinfo-module' 'gtklock-powerbar-module' 'gtklock-playerctl-module')

One more thing: are you on GTK3? Nwg-look does not support GTK4.

I am using gtk3, it's the only gtk I currently have installed. Weirdly enough it may end up being the breeze icon theme, I guess the other one I downloaded to test presents the same issue, because now I have downloaded gnome-themes-extra as per your recommendation, which has added the HighContrast icon theme, which I can set without issue. I have also tried with the pop os icon theme and it also works. It's only when trying to set breeze that adwaita is set (I guess because it is the default).

Weirdly enough it may end up being the breeze icon theme

I do hope so. The latest release had almost 3500 downloads since March, 7th. Someone would've reported earlier, if it was a common issue.

Good morning.
After doing further testing I have realised something that all themes that work have in common, and it is the fact that their name is a single word, while all themes that don't work have a space in their name.
Both pop OS' theme and HighContrast theme (which work), are a single word which is written into .config/gtk-3.0/settings.ini in the following manner:
gtk-icon-theme-name=Pop
gtk-icon-theme-name=HighContrast
While breeze dark and tela black, which do not work, are written into settings.ini in the following manner:
gtk-icon-theme-name=Breeze Dark
gtk-icon-theme-name=Tela black
I have tested to see how the plasma settings deal with this, since setting the icon using that works, the setting for Tela dark and breeze dark are set by the plasma settings in the following manner:
gtk-icon-theme-name=Tela-black
gtk-icon-theme-name=breeze-dark
This being the cause of the problem is further corroborated by the fact that base Tela (which is also only one word), is the only Tela theme that works.

Thank you for the software and for being so responsive. Good luck in finding a solution.

Sorry for making you wait that long. I was busy on another project and forgot about this problem a bit. I think I found a fix.

Hey. Sorry I didn't see your reply before. No worries man, thank you for fixing the problem.

Thanks for reporting. This was quite a serious bug.


bash.exe: warning: could not find /tmp, please create! error for AWSshellscript task when using microsoft hosted agent windows

Thank you for your feedback!
The issues in this repo are for documentation feedback.
If you are submitting your documentation feedback issue directly through GitHub, please provide the URL of the article so we can route the feedback to the correct author.
Please report Azure DevOps or TFS software bugs, feedback, or questions in the Azure DevOps Developer Community.

@prasanthbangs2016 -- thank you for your feedback.  Are you following a particular docs.microsoft.com article?  Meanwhile, please consider these resources:

Azure DevOps Services
Azure DevOps on Stack Overflow

I apologize for posting this here, but I'm not sure where else I could post/ask this...
I'd like to set up notifications so that I get an email (or some kind of notification) anytime this page on "Microsoft Hosted Agents" gets updated (it's the MacOS version we're concerned about): https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops&tabs=yaml
Same for a page in Github like this one: https://github.com/actions/virtual-environments/blob/main/images/macos/macos-11-Readme.md#xcode
Right now the best I have is an email notification for this entire "MicrosoftDocs" repo, with an email filter removing anything that doesn't say "hosted"...but this isn't very helpful, as there are a lot of comments/issues raised where "hosted" is in there (but not an update to the actual documentation).

@michael-j-hilde -- Michael, no problem!  This page seems relevant to your question:

https://docs.github.com/en/account-and-profile/managing-subscriptions-and-notifications-on-github/setting-up-notifications/configuring-notifications#configuring-your-watch-settings-for-an-individual-repository

It appears that GitHub only has notifications per-repo, and not per-file.

yep, I was afraid of that. Thanks anyways for the response, I appreciate it. I figured if there WAS a way to do this, the smart folks of this community would know! :)

@prasanthbangs2016 -- thank you for your feedback. Are you following a particular docs.microsoft.com article? Meanwhile, please consider these resources:

Azure DevOps Services
Azure DevOps on Stack Overflow

this didn't help me. please do the needful.

@prasanthbangs2016 -- thank you for your followup.  This repo is solely for documentation issues, and this appears to be implementation-related.


Floating point reset fails

I have a design that is failing reset. It seems to occur during state.resetCircuit()
So far, it seems that fp_pointwise passes with fp_add or fp_mul; conv_3_3 works with int operators; however, fp_conv_3_3 fails during this step.
The failure is due to some value being filled with 'x's in extendBFloat, but I haven't figured out why one of the inputs of the floating point operator would have 'x's. Do you have any ideas on what is happening?
Below are the test design and simulation call (run_coreir_on_interpreter).
coreir_interpret.cpp.txt
fp_conv_3_3_design_top.json.txt

@jeffsetter I have no idea why resetCircuit would fail because of a floating point op.
How did you figure out that the failure is caused by 'x's in extendBFloat? Could you send a trace of what happens in the simulator?

Below is a trace from gdb:
Note that I uncommented
https://github.com/rdaly525/coreir/blob/dev/src/simulator/interpret.cpp#L31
https://github.com/rdaly525/coreir/blob/dev/src/simulator/interpret.cpp#L58
Starting program: /nobackup/setter/h2h/float_tests/Halide-to-Hardware_float/apps/hardware_benchmarks/tests/fp_conv_3_3/bin/process run coreir input.png
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
/nobackup/setter/h2h/float_tests/coreir/src/passes/transform/rungenerators.cpp:10 In Run Generators
/nobackup/setter/h2h/float_tests/coreir/src/passes/transform/rungenerators.cpp:26 Done running generators
Found raddr
Found raddr
Starting topological sort
topo_order.size() = 183
numVertices(g)    = 183
generated simulated coreir design
reset clock self.clk
reset self.in_arg_0_0_0 with size 16
reset self.reset with size 1
image is using output valid
starting coreir simulation
bfloat =<PHONE_NUMBER>000000
Extension result =<PHONE_NUMBER>0000000000000000000000
bfloat =<PHONE_NUMBER>111001
Extension result =<PHONE_NUMBER>1110010000000000000000
bfloat = xxxxxxxxxxxxxxxx
Extension result = 0xxxxxxxxxxxxxxx0000000000000000
bfloat =<PHONE_NUMBER>000000
Extension result =<PHONE_NUMBER>0000000000000000000000
process: ../../../../../coreir/include/coreir/ir/dynamic_bit_vector.h:123: unsigned char bsim::quad_value::binary_value() const: Assertion `(value == 1) || (value == 0)' failed.
Program received signal SIGABRT, Aborted.
0x00007ffff584c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
54  ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0  0x00007ffff584c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ffff584e02a in __GI_abort () at abort.c:89
#2  0x00007ffff5844bd7 in __assert_fail_base (fmt=, assertion=assertion@entry=0x53c766 "(value == 1) || (value == 0)",
file=file@entry=0x53c4c0 "../../../../../coreir/include/coreir/ir/dynamic_bit_vector.h", line=line@entry=123,
function=function@entry=0x53cec0 <bsim::quad_value::binary_value() const::PRETTY_FUNCTION> "unsigned char bsim::quad_value::binary_value() const") at assert.c:92
#3  0x00007ffff5844c82 in __GI___assert_fail (assertion=0x53c766 "(value == 1) || (value == 0)", file=0x53c4c0 "../../../../../coreir/include/coreir/ir/dynamic_bit_vector.h", line=123,
function=0x53cec0 <bsim::quad_value::binary_value() const::PRETTY_FUNCTION> "unsigned char bsim::quad_value::binary_value() const") at assert.c:101
#4  0x0000000000517b29 in bsim::quad_value::binary_value() const ()
#5  0x0000000000521512 in int bsim::quad_value_bit_vector::to_type() const ()
#6  0x00007ffff69ee791 in CoreIR::SimulatorState::updateNodeValues(int)::{lambda(bsim::quad_value_bit_vector const&, bsim::quad_value_bit_vector const&)#22}::operator()(bsim::quad_value_bit_vector cons$
#7  0x00007ffff69ee936 in CoreIR::SimulatorState::updateNodeValues(int)::{lambda(bsim::quad_value_bit_vector const&, bsim::quad_value_bit_vector const&)#22}::_FUN(bsim::quad_value_bit_vector const&, bs$
#8  0x00007ffff69eb4a1 in CoreIR::SimulatorState::updateBitVecBinop(int, bsim::quad_value_bit_vector (*)(bsim::quad_value_bit_vector const&, bsim::quad_value_bit_vector const&)) ()
from ../../../../../coreir/lib/libcoreirsim.so
#9  0x00007ffff69f0b43 in CoreIR::SimulatorState::updateNodeValues(int) () from ../../../../../coreir/lib/libcoreirsim.so
#10 0x00007ffff69f32f5 in CoreIR::SimulatorState::exeCombinational() () from ../../../../../coreir/lib/libcoreirsim.so
#11 0x00007ffff69f2e84 in CoreIR::SimulatorState::resetCircuit() () from ../../../../../coreir/lib/libcoreirsim.so
#12 0x0000000000519e22 in void run_coreir_on_interpreter(std::__cxx11::basic_string<char, std::char_traits, std::allocator >, Halide::Runtime::Buffer<unsigned short, 4>, Hal$
#13 0x0000000000418867 in main::{lambda()#2}::operator()() const ()
#14 0x0000000000435fb6 in std::function<void ()>::operator()() const ()
#15 0x000000000042e86e in OneInOneOut_ProcessController::make_run_def(std::vector<std::cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::$
#16 0x000000000042e0a5 in ProcessController::process_command(int, char**) ()
#17 0x0000000000417f33 in main ()

Looking at this trace I think I understand the issue. The calls to float ops use casting of BitVector -> int in their implementation (so that they can then cast the int to a  float and use the CPUs floating point to emulate bfloats). This casting routine does not handle 'x's.
I will add a check for x values and return x if any float value contains an 'x'.

Do I want any 'x's though? During reset, I wasn't expecting any 'x's to be present in my design.

My understanding is that without x's on wires the moment before reset we will not be able to match Verilog simulation semantics, so having them is important.
What is your concern with having 'x' values on wires?

Aso I just pushed an update to #748 that should fix this casting issue.

Everything seems to be fixed based on https://github.com/rdaly525/coreir/pull/748


Remove #[Exclude] from TaskCommand

Problem
Currently, Castor\Console\Command\TaskCommand class is marked with #[Exclude] attribute which prevents it from being included in the generated stubs. However, this class is required for proper type-hinting in public event classes like Castor\Event\BeforeExecuteTaskEvent and Castor\Event\AfterExecuteTaskEvent.
Proposal change
Remove the #[Exclude] attribute from TaskCommand while keeping the @internal PHPDoc annotation:
This would

Keep indicating that the class is not meant for direct usage (@internal)
Allow proper type-hinting in IDEs for events
Maintain type safety when working with events
Improve developer experience with better autocompletion

Hello,
Which version of Castor are you using? Because TaskCommand is now included in the stubs since v0.19.
And as a side note, Exclude attribute is only used to configure Castor's internal DIC, it has nothing to do with stubs 😉
Thanks

Hello
I had trouble with the last version and reverted back to v0.18.2, using the last version this is working as expected thanks !


Genbi fails silently on CLI

We want to call Genbi.exe automatically, using the CLI. Unfortunately, errors are silently caught and $? is True, even if the GUI shows an error dialog and no tests have been generated.
Additionally, some log output about the error would be nice to help with debugging.

Thanks for the help, @FuegoArtificial! The main problem is that we can get Genbi.exe to work locally, but not on our agent. So at least the input seems good enough, but even there, we can't be sure.
However, we had a look at Genbi's source and found the right place to at least change the return code: In PlayMacroCommand
        public void ExecuteQuiet(string filename)
        {
            try
            {
                var generator = new TestSuiteGenerator();
                generator.Load(filename);
                generator.Execute();
            }
            catch
            {
                return;
            }
        }

There, errors are silently caught and dropped. Instead, something like Environment.Exit(9) would help.
Additionally, we could think about writing the error to a log file, or to include logging of some sort. But I'd like to have @Seddryck's opinion before I'd start implementing something.

Yes surely, it's the right place to fix the issue. If you want to write to a log file I would create a new IMacroOutput interface witha method AppendText that the MacroWindow would be implementing but also a new FileLogOutput class.
All pull requests are welcome!

Hi All,
as I faced the same issue I though about a workaround for this.
I put everything into this PR -
https://github.com/Seddryck/NBi/pull/702
Hope it helps :)

Improvements part of 1.24 with PR #710


validate_inclusion() may produce huge error values

https://github.com/elixir-ecto/ecto/pull/2992 introduced a forced conversion of enum values in some validation functions to lists when an error is reported. That change works poorly in cases like this one:
|> validate_inclusion(highway_mpg, 0..200)

If that validation fails, the resulting changeset will look like this
#Ecto.Changeset<
  action: nil,
  changes: %{highway_mpg: 250},
  errors: [
    highway_mpg: {"is invalid",
     [
       validation: :inclusion,
       enum: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18,
        19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36,
        37, 38, 39, 40, 41, ...]
     ]}
  ],
  data: #DummyChangeset<>,
  valid?: false
>

Other examples I've seen in a real code base used in production:
    |> validate_inclusion(:model_year, 1900..2100)
    |> validate_inclusion(:price, 0..999_999)
    |> validate_inclusion(:trade_in_mileage, 0..2_147_483_647)
    |> validate_inclusion(:down_payment, 0..2_147_483_647)

The fact that a failed validation may produce huge values will likely be surprising to anyone writing code like that, and it may go unnoticed in many cases. However, If the resulting changeset is logged, the log message will be truncated and the stack trace will be lost from it.
It would less of a problem if Ecto itself didn't use a similar example in the function documentation:
  ## Examples

      validate_inclusion(changeset, :gender, ["man", "woman", "other", "prefer not to say"])
      validate_inclusion(changeset, :age, 0..99)  # <--

Improvement suggestions:

handle ranges explicitly in the code to avoid converting them to lists
call out this behaviour in the documentation
remove the example that calls validate_inclusion(changeset, :age, 0..99), mention that validate_number should be used instead to validate numeric ranges

Pinging @lpil.
I think it is probably best for Ecto to keep the value as is. We will have to figure out how to transform the value on Phoenix side of things.

This has reintroduced the problem where Phoenix calls to_string on the enumerable, however not all enumerables (i.e. sets) implement the String.Chars protocol so it crashes.

We will have to figure out how to transform the value on Phoenix side of things.

Is there an issue for this? I can't find one in the Phoenix project

Is this a Phoenix.HTML issue or Gettext issue? Can you please open up an
issue on the relevant project and CC me?
José Valimwww.plataformatec.com.br
http://www.plataformatec.com.br/Founder and Director of R&D

I believe the problem was with translate_error, errors_on and similiar functions that created by generators in earlier Phoenix versions.

Are we trying to interpolate the enum by default in the error message
generated by Phoenix? Or is this a custom message? Would it be reasonable
to say to pass a custom message when calling validate_inclusion?
José Valimwww.plataformatec.com.br
http://www.plataformatec.com.br/Founder and Director of R&D

Here you go: https://github.com/phoenixframework/phoenix/issues/3587
I had problems with DataCase.errors_on, but I could imagine it being a problem elsewhere too


Close Stale Issues GitHub Action

Objective
Configure the close stale issues and PRs GitHub action to automatically close issues that have become stale.

This can be done per repo


OpenShift Project setup

Describe the task
Implement an OpenShift project and supporting resources for the bceid-proxy
Acceptance Criteria

[ ] delete everything except the api
[ ] deploy default api and be able to call it from the internet (OpenShift routing works, basically hello world)
[ ] DEV/TEST/PROD deployed (PROD will have fake creds)
[ ] deployment management  -separate git repo setup
[ ] change enablement --pipeline works

Additional context

https://github.com/bcgov/quickstart-openshift
Proposed name for github repo: 'bcgov/nr-fam-lookup-proxy'. We decided to use 'bcgov/nr-fam-idim-lookup-proxy'.

SonarCloud project requested.
https://github.com/BCDevOps/devops-requests/issues/1516

Thanks to Derek! We have initial repo here: https://github.com/bcgov/nr-fam-idim-lookup-proxy

The new pipeline for PR #6: https://github.com/bcgov/nr-fam-idim-lookup-proxy/actions/runs/5314741054 run successfully.
Hello-World API deployed:
Test: https://nr-fam-idim-lookup-proxy-test-backend.apps.silver.devops.gov.bc.ca/api
Prod: https://nr-fam-idim-lookup-proxy-prod-backend.apps.silver.devops.gov.bc.ca/api
Interestingly, the pipeline go straight from TEST to PROD and no gate for approval. Not sure if we want a gated prod approval pipeline.

@ianliuwk1019 That's a crutch.  Ideally we'll go straight to PROD every time with as many small changes as possible, which is beneficial for stability and (inevitable) troubleshooting.  What we should be doing is to add checks between TEST and PROD.


COALESCE doesn't appear to work within a CTE

Version
1.26.0
What happened?
When creating WITH statements in SQL, I've noticed that if I was to use COALESCE within a WITH that updates data, that it would result in sqlc generate saying that the column does not exist even though it does exist within the table using psql.
Relevant log output
# package queries
sql/collections.sql:30:9: column "updated_at" does not exist

Database schema
id | user_id | name | description | created_at | updated_at

SQL queries
-- name: CollectionUpdate :one
WITH updated_collection AS (
    UPDATE user_collections
    SET
        collection_name = COALESCE(sqlc.narg(collection_name), collection_name),
        collection_description = COALESCE(sqlc.narg(collection_description), collection_description),
        is_public = COALESCE(sqlc.narg(is_public), is_public),
        updated_at = COALESCE(sqlc.narg(updated_at), CURRENT_TIMESTAMP)
    WHERE id = sqlc.arg(id)
    RETURNING id
), deleted_characters AS (
    DELETE FROM collection_characters
    WHERE collection_id = (SELECT id FROM updated_collection) AND character_id != ALL(sqlc.narg('character_ids')::uuid[])
    RETURNING *
)

INSERT INTO collection_characters (character_id, collection_id)
SELECT UNNEST(sqlc.narg('character_ids')::uuid[]), (SELECT id FROM updated_collection)
ON CONFLICT DO NOTHING
RETURNING *;

Configuration
version: "2"
sql:
  - schema: "./migrate/migrations/"
    queries: "./sql/"
    engine: "postgresql"
    gen:
      go:
        emit_interface: true
        package: "queries"
        out: "queries"
overrides:
  go: null
plugins: []
rules: []

Playground URL
No response
What operating system are you using?
Linux
What database engines are you using?
PostgreSQL
What type of code are you generating?
Go

Facing the same issue. did you find a solution/workaround?

Can this be reproduced in the playground: https://play.sqlc.dev/ ?


Add bpf_conformance test to CI/CD and create rbpf_plugin

bpf_conformance requires a plugin that accepts BPF byte code as stdin along with optional memory and expects the value of r0 as stdout.
Signed-off-by: Alan Jowett<EMAIL_ADDRESS>

I will update the CI/CD once I figure out why the test suite chokes on this plugin.

Sorry for the additional work, but would you mind rebasing please? I should have addressed #62, so the exit-not-last can hopefully be removed now.


I believe the symmetric difference test is broken.

Challenge http://www.freecodecamp.com/challenges/bonfire-symmetric-difference has an issue. Please describe how to reproduce it, and include links to screen shots if possible.
I believe the symmetric difference autotest test is broken. Just to be sure I ran terakilobyte's solution to this problem which he did on April 18th, 2015 and his results did not pass the test with the following error;
expected [3, 4, 5] to deeply equal [3, 5, 4]
Screenshot link:
https://www.dropbox.com/s/0r056t5coxowts4/Screenshot 2015-06-14 22.54.14.png?dl=0
I would suggest running terakilobyte's solution
http://www.freecodecamp.com/terakilobyte
Thanks for your help.
-dave

Thank you for your help! We've now fixed this in production!


Expose the trace context from the worker

As best I can tell, this update will simply allow typed/known access to values that already exist but aren't yet exposed.
Having access to these values is very helpful for tracing instrumentation.
References:
https://github.com/Azure/azure-functions-python-worker/blob/main/azure_functions_worker/bindings/context.py
https://github.com/Azure/azure-functions-python-worker/blob/698c524db03b70b13fb42d17e7b986ea8f744b6d/azure_functions_worker/bindings/tracecontext.py
https://github.com/Azure/azure-functions-python-worker/pull/545/files#diff-4b26101cf19d671ade506a5f9623a651bd389240b020b6176061abca184b2b6e

@vrdmr  @AnatoliB Anything I can do to move this forward?

This effort seems to have been duplicated by @gavin-aguiar some 4 months later on #96
If you don't accept PRs from the public, you should probably turn that off.

Hello @allenhumphreys, we apologize for the miss on our side. It wasn't our intention to not merge your PR.  Hazhzeng left the team and some of the context was missed during the transition.

@stefanushinardi thanks you for the apology and explanation 🙏🏼. Knowledge transfer can be super tricky!
Glad to have these properties fully support either way!


2.6-rc1: Hook helpers call genesis instead of $GENESIS_CALLBACK_BIN

Had old genesis in my path, which didn't know about ui-describe, so got a bunch of error each time.

FindBin::Script is a dirty rotten liar:
The following code:
$ENV{GENESIS_CALLBACK_BIN} = $FindBin::Script;
print STDERR "GENESIS_CALLBACK_BIN: $ENV{GENESIS_CALLBACK_BIN}";

results in:
GENESIS_CALLBACK_BIN: genesis

FindBin::Script:  genesis
FindBin::RealBin: /Users/dbell/.geese
FindBin::Bin      /Users/dbell/.geese
__FILE__:         /Users/dbell/.geese/genesis
$0:               /Users/dbell/.geese/genesis
abs_path($0):     /Users/dbell/.geese/genesis

After setting it in the wrapper, packing it, and adding a default if we call the .geese version directly, we get the following:
$ g2 check dbell-lab.yml
(inflating genesis runtime...)
GENESIS_CALLBACK_BIN: /Users/dbell/bin/g2

$ (export PERL5LIB=/Users/dbell/.geese/lib; ~/.geese/genesis check dbell-lab.yml)
GENESIS_CALLBACK_BIN: /Users/dbell/.geese/genesis

Fixed in refactor branch