How to use pre-train cnn model with tensorflow-go

Hi all,
I had train a cnn model with python, it has 57 inputs, one hidden layer with 12nodes, 3 output, and save the model as follow:
        builder = tf.saved_model.builder.SavedModelBuilder('shield')
        builder.add_meta_graph_and_variables(self.sess, ['login3'])
        builder.save()

then load it:
	model, err := tf.LoadSavedModel("shield", []string{"login3"}, nil)

but I got error like:
2018-07-03 18:23:14.476427: I tensorflow/cc/saved_model/loader.cc:242] Loading SavedModel with tags: { login3 }; from: shield
2018-07-03 18:23:14.481530: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.2 AVX AVX2 FMA
2018-07-03 18:23:14.486676: I tensorflow/cc/saved_model/loader.cc:161] Restoring SavedModel bundle.
2018-07-03 18:23:14.500925: I tensorflow/cc/saved_model/loader.cc:196] Running LegacyInitOp on SavedModel bundle.
2018-07-03 18:23:14.501650: I tensorflow/cc/saved_model/loader.cc:291] SavedModel load for tags { login3 }; Status: success. Took 25441 microseconds.
2 In[0] is not a matrix
	 [[Node: MatMul = MatMul[T=DT_FLOAT, _output_shapes=[[?,12]], transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_input_0_0, Variable/read)]]

How to make it work?
here is my all code:
import os
import sys
import tensorflow as tf
import pandas as pd
import numpy as np

class NeturalNetwork:

    def __init__(self, model_path, input_nodes, hidden_layer_nodes, output_nodes, learning_rate):
        self.input_nodes = input_nodes
        self.hidden_layer_nodes = hidden_layer_nodes
        self.output_nodes = output_nodes
        self.learning_rate = learning_rate
        self.model_path = model_path
        self.x_data = tf.placeholder(shape=[None, input_nodes], dtype=tf.float32, name="input")
        self.y_target = tf.placeholder(shape=[None, output_nodes], dtype=tf.float32, name="target")

        l1 = add_layer(self.x_data, input_nodes, self.hidden_layer_nodes, activation_function=tf.nn.relu)
        self.prediction = add_layer(l1, self.hidden_layer_nodes, output_nodes, activation_function=tf.nn.softmax)

        y_clipped = tf.clip_by_value(self.prediction, 1e-10, 1)
        self.loss = -tf.reduce_mean(tf.reduce_sum(self.y_target * tf.log(y_clipped), axis=1))

        self.optimizer = tf.train.GradientDescentOptimizer(learning_rate=self.learning_rate).minimize(self.loss)

        # GO
        infer = tf.argmax(self.prediction, 1, name="infer")
        correct_prediction = tf.equal(infer, tf.argmax(self.y_target, 1))
        self.accuracy = tf.reduce_mean(tf.cast(correct_prediction, tf.float32))

        self.saver = tf.train.Saver()

        self.sess = tf.Session()
        init = tf.global_variables_initializer()
        self.sess.run(init)

        meta_path = model_path + '/shield.nn.meta'
        if os.path.exists(meta_path):
            nn_path = model_path + '/shield.nn'
            self.saver.restore(self.sess, nn_path)
        else:
            print 'ERROR: no model or restore model fail'

    def Train(self, epoch, filenames):
        interval = 5

        x, y = load_dataset(filenames, 'ShieldResult')
        x_values, y_values = shuffle(x, y)

        x_train = x_values
        y_train = y_values

        test_size  = 10000
        x_test = x_values[-test_size:]
        y_test = y_values[-test_size:]

        print('Training the model...', len(x_train))
        for i in range(1, (epoch + 1)):
            self.sess.run(self.optimizer, feed_dict={self.x_data: x_train, self.y_target: y_train})
            if i % interval == 0:
                print('Epoch', i, '|', 'Loss:', self.sess.run(self.loss, feed_dict={self.x_data: x_train, self.y_target: y_train}))

        print(self.sess.run(self.accuracy, feed_dict={self.x_data: x_test, self.y_target: y_test}))

        builder = tf.saved_model.builder.SavedModelBuilder('shield')
        builder.add_meta_graph_and_variables(self.sess, ['login3'])
        builder.save()

        self.saver.save(self.sess, self.model_path + '/shield.nn')

    def Predict(self, filenames):
        x, y = load_dataset(filenames, 'ShieldResult')
        x_values, y_values = shuffle(x, y)

        test_size  = 10000
        x_test = x_values[-test_size:]
        y_test = y_values[-test_size:]

        yes = 0
        for i in range(len(x_test)):
            pred = np.rint(self.sess.run(self.prediction, feed_dict={self.x_data: [x_test[i]]}))
            if (y_test[i] == pred[0]).all():
                print('=== Actual:', y_test[i], 'Predicted:', pred[0])
                yes = yes + 1
            else:
                print('!!! Actual:', y_test[i], 'Predicted:', pred[0])

        print(yes)
        print(yes / (len(x_test) * 1.0))

def random_seed():
    seed = 1234
    np.random.seed(seed)
    tf.set_random_seed(seed)

def load_dataset(filenames, resultField):
    dataset = pd.read_csv(filenames[0])
    dataset = pd.get_dummies(dataset, columns=[resultField]) # One Hot Encoding
    values = list(dataset.columns.values)

    for i in range(len(filenames)):
        if i == 0:
            continue

        tmpdataset = pd.read_csv(filenames[i])
        tmpdataset = pd.get_dummies(tmpdataset, columns=[resultField]) # One Hot Encoding
        dataset = dataset.append(tmpdataset)

    y = dataset[values[-3:]]
    x = dataset[values[0:-3]]

    return np.array(x, dtype='float32'), np.array(y, dtype='float32')

def shuffle(x, y):
    indices = np.random.choice(len(x), len(x), replace=False)

    return x[indices], y[indices]

def add_layer(inputs, in_size, out_size, activation_function=None):
    weights = tf.Variable(tf.random_normal(shape = [in_size, out_size]))
    biases = tf.Variable(tf.random_normal(shape = [out_size]))

    w_plus_b = tf.matmul(inputs, weights) + biases

    if activation_function is None:
        outputs = w_plus_b
    else:
        outputs = activation_function(w_plus_b)

    return outputs

if __name__ == "__main__":
    epoch = int(sys.argv[1])
    node = int(sys.argv[2])
    rate = float(sys.argv[3])
    csv_num = sys.argv[4]

    print(epoch)
    print(node)
    print(rate)
    print(csv_num)

    random_seed()

    ann = NeturalNetwork('./shield-ai-engine', 57, node, 3, rate)
    csvs = [
        '../data/deal/11_' + csv_num + '.csv',
        '../data/deal/12_' + csv_num + '.csv',
    ]

    ann.Train(epoch, csvs)

package main

import (
	"fmt"

	tf "github.com/tensorflow/tensorflow/tensorflow/go"
)

func main() {
	model, err := tf.LoadSavedModel("shield", []string{"login3"}, nil)
	if err != nil {
		fmt.Println(1, err)
		return
	}

	defer model.Session.Close()

	output := tf.Output{
		Op:    model.Graph.Operation("input"),
		Index: 0,
	}

	tensor, err := tf.NewTensor([]float32{
		12, 41, 41, 41, 41, 41, 70, 137, 259, 305, 344, 81, 148, 271, 370, 397, 81, 148, 271, 370, 397, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 64, 122, 233, 295, 391, 1, 58, 195, 1, 6, 4, 195, 1, 6, 4, 165, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,
	})

	target, err := tf.NewTensor([]float32{})

	if err != nil {
		fmt.Println(3, err)
	}

	feeds := map[tf.Output]*tf.Tensor{
		output: tensor,
		model.Graph.Operation("target").Output(0): target,
	}

	fetches := []tf.Output{
		{
			Op:    model.Graph.Operation("infer"),
			Index: 0,
		},
	}

	result, err := model.Session.Run(
		feeds,
		fetches,
		nil,
	)

	if err != nil {
		fmt.Println(2, err)
		return
	}

	fmt.Println(result[0].Value())
}

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

@tensorflowbutler  OK, thanks for  your reply.
my env:
OS: mac 10.11.6
python version: python2.7
tensorflow install base on https://www.tensorflow.org/install/install_go
tensorflow-go version: v1.9.0-rc2
go version: go1.9.2 darwin/amd64
command to reproduce:
python ann.py 500 12 0.02 12

to train and save model
go run main.go

to use save in go.
my dataset like:
Event,DeviceIDPer5Min,DeviceIDPer10Min,DeviceIDPer20Min,DeviceIDPerHour,DeviceIDPerDay,IPPer5Min,IPPer10Min,IPPer20Min,IPPerHour,IPPerDay,AccountPer5Min,AccountPer10Min,AccountPer20Min,AccountPerHour,AccountPerDay,UserIDPer5Min,UserIDPer10Min,UserIDPer20Min,UserIDPerHour,UserIDPerDay,MobilePer5Min,MobilePer10Min,MobilePer20Min,MobilePerHour,MobilePerDay,EmailPer5Min,EmailPer10Min,EmailPer20Min,EmailPerHour,EmailPerDay,FingerprintPer5Min,FingerprintPer10Min,FingerprintPer20Min,FingerprintPerHour,FingerprintPerDay,DeviceIDIPs,IPDeviceIDs,AccountDeviceIDs,DeviceIDAccounts,AccountIPs,IPAccounts,UserIDDeviceIDs,DeviceIDUserID,UserIDIPs,IPUserIDs,FingerprintExistSeconds,MobileRiskScore,ReviewPassed,IsCommonDevice,IsDeviceIDLocked,IsIPLocked,IsLeakedAccount,IsUserIDLocked,IsForeignIP,IsMobileLocked,IsRiskAccount,ShieldResult
12,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
12,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0,0,0,0
12,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,0,0,0,0,0,0,0,0,0,0,5,5,5,5,5,1,1,2,1,2,1,2,1,2,1,323008,0,1,0,0,0,1,0,0,0,0,0
12,1,1,1,3,10,1,1,1,3,11,1,1,1,1,2,1,1,1,1,2,0,0,0,0,0,0,0,0,0,0,1,1,1,3,13,1,3,2,5,1,5,2,5,1,5,173913,0,0,0,0,0,0,0,0,0,0,0
12,1,1,1,1,1,7,45,45,45,45,2,2,2,2,2,2,2,2,2,2,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,27,2,1,2,27,3,1,3,27,3,0,0,0,0,0,0,0,0,0,0,0
12,1,1,1,1,1,1,1,1,1,135,1,1,1,1,8,1,1,1,1,8,0,0,0,0,0,0,0,0,0,0,3,4,11,32,1040,1,225,31,1,3,16,31,1,3,16,20,0,0,0,0,0,0,0,0,0,0,0
12,11,11,11,11,11,13,41,96,514,5507,13,41,96,514,3112,13,41,96,514,3112,0,0,0,0,0,0,0,0,0,0,11,33,73,401,4922,1,620,295,1,1,9,295,1,1,8,32,0,0,0,0,0,0,0,1,0,0,2
12,12,12,12,12,12,14,42,97,515,5508,14,42,97,515,3113,14,42,97,515,3113,0,0,0,0,0,0,0,0,0,0,12,34,74,402,4923,1,620,295,1,1,9,295,1,1,8,32,0,0,0,0,0,0,0,1,0,0,2
12,1,1,1,1,1,8,46,46,46,46,1,1,1,1,1,1,1,1,1,1,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,28,1,1,1,28,1,1,1,28,3,0,0,0,0,0,1,0,0,0,0,1
12,1,1,1,1,1,9,47,47,47,47,3,3,3,3,3,3,3,3,3,3,0,0,0,0,0,0,0,0,0,0,1,1,1,1,1,1,29,2,1,2,29,2,1,2,29,4,0,0,0,0,0,1,0,0,0,0,1

is there any detail doc for go using pre-train model?

The general idea you have (of creating a SavedModel in Python and then using that in Go) seems right.
The error message is trying to say that it expected a matrix (a 2D tensor) to be provided to the MatMul operation, but it received something else.
From a cursory look at the provided code, the Python code is written so that input is a 2-D tensor (with shape [None, input_nodes]), but the Go code is feeding a 1D tensor ([]float32, which can be seen also by fmt.Println(len(tensor.Shape())).
I suspect things will work out fine if tensor in Go is a 2D tensor (a [][input_nodes]float32)
Let us know if that works. Thanks.

@asimshankar Thanks!
I had change:
	tensor, err := tf.NewTensor([]float32{
		12, 41, 41, 41, 41, 41, 70, 137, 259, 305, 344, 81, 148, 271, 370, 397, 81, 148, 271, 370, 397, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 64, 122, 233, 295, 391, 1, 58, 195, 1, 6, 4, 195, 1, 6, 4, 165, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,
	})

	target, err := tf.NewTensor([]float32{})

to
	tensor, err := tf.NewTensor([][]float32{{
		12, 41, 41, 41, 41, 41, 70, 137, 259, 305, 344, 81, 148, 271, 370, 397, 81, 148, 271, 370, 397, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 64, 122, 233, 295, 391, 1, 58, 195, 1, 6, 4, 195, 1, 6, 4, 165, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,
	}})

	target, err := tf.NewTensor([][]float32{})

it works.

@qianlnk : Great, closing this out then.


Add support for SQLite

I was looking to use your plugin but with SQLite. You weren't passing the storage parameter required by SQLite though.
Let me know if this works, can be added! Not sure what other tests would be need to be added as well.

The node 0.11 test is failing for some reason here
Completes here fine though :confused:

npm install (here) seems to fail with 0.11 FYI.

Any ideas regarding this PR/weird failing test?

no longer an issue with v3


feat:  shaderData add getProperties ability

Please check if the PR fulfills these requirements

[x] The commit message follows our guidelines
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

ShaderData add  getProperties(out: ShaderProperty[]): void function, developer can get all shaderProperties to do something they want.
example:
  const properties = new Array<ShaderProperty>();
  shaderData.getProperties(properties);
  for (let i = 0, n = properties.length; i < n; i++) {
    const property = properties[i];
    switch (property.type) {
      case ShaderPropertyType.Float:
        const floatValue= shaderData.getFloat(property);
        console.log(floatValue);
        break;
      case ShaderPropertyType.Texture:
        .......
        break;
     ........
    }
  }

Codecov Report

Merging #1030 (66901d5) into dev/0.9 (269ab02) will increase coverage by 0.00%.
The diff coverage is 34.61%.

@@           Coverage Diff            @@
##           dev/0.9    #1030   +/-   ##
========================================
  Coverage    29.52%   29.52%
========================================
  Files          331      332    +1
  Lines        14704    14716   +12
  Branches      2251     2253    +2
========================================
+ Hits          4341     4345    +4
- Misses        9849     9856    +7
- Partials       514      515    +1

Impacted Files
Coverage Δ

packages/core/src/shader/ShaderProgram.ts
0.44% <0.00%> (ø)

packages/core/src/shader/ShaderProperty.ts
80.00% <0.00%> (-20.00%)
:arrow_down:

packages/core/src/shader/ShaderData.ts
51.81% <33.33%> (-2.64%)
:arrow_down:

packages/core/src/shader/Shader.ts
40.54% <100.00%> (+0.81%)
:arrow_up:

...ckages/core/src/shader/enums/ShaderPropertyType.ts
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Add Unit Test for new API getShaderProperties


error handling on forms inputs

Description
This is something that is not included in the current kit, but it is nice to have. There should be error handling in any form and currently, there is none. There are a lot of forms in the application, so this ticket involves quite a bit of work.

we have added a very simple error-handling logic in our form, the focus of this ticket should be the fact that since we are using server-side forms we are not currently able to clear form errors when we close and re-open the form modal

regarding the warning on server I found this open issue, probably the new version of next redirect  breaks something on undici
https://github.com/nodejs/undici/issues/2046


Enhancing temporal aspects

[x] Modify all thematic functions to enable the generation of more than one timestep.
[ ] Modify UTK to load multiple timesteps. UTK should understand one timesteps and multiple timesteps
[ ] If the user makes a reference to _abstract for a knot with multiple timesteps a selection menu will appear
[ ] The user shouldn't need to specify each timestep in the vega abstract0, abstract1, abstract2
[ ] Modify utk-ts to handle multiple timesteps
[ ] Include multiple timesteps into the plots
[ ] Include multiple timesteps into the map (slider)

Future

[ ] deal with footprint and surface plot with multiple timesteps (currently just showing the first one) (getAbstractValues)


Gluon trainer updates: add learning_rate and lr_scheduler properties and add setter for learning rate

All tests passed except R GPU, @thirdwing is fixing this in #7686.

The unit test patch is in a separate pr as suggested by @piiswrong
#7693

Closing this PR due to new PR at #7760


OCPBUGS-34077: Always Disable Default Rolebindings Controller

With OCPBUILD-7, default namespace rolebindings for the Image Registry, DeploymentConfig, and Builds are handled by separate controllers. The initial refactor in OCPBUILD-8 kept the default rolebindings controller in place to allow upgrade from 4.15 -> 4.16. However, the corresponding operator change in OCPBUILD-9 forgot to disable the default rolebindings controller. This leads to the following side effects:

On clusters with no capabilities, the default role bindings are created and reconciled.
On a standard installation, there is potential for race conditions and server-side conflicts as two or more controllers fight to reconcile a resource. At scale, this can lead to excessive load on the apiserver.

This change ensures that the default rolebindings controller is always disabled. As a follow-up, the code for the default rolebindings controller can be safely removed in OCP 4.17.

/assign @apoorvajagtap
/cc @ingvagabund

/retest

@adambkaplan thanks for taking care of this!
I tried testing it via a CI cluster, but the default-rolebindings controller was still not disabled. It seems operator.disableControllers just "syncs" the controller states.
I believe, we need to append the controller details in the controller.disabledControllers as well.
func ObserveControllers(genericListers configobserver.Listers, recorder events.Recorder, existingConfig map[string]interface{}) (map[string]interface{}, []error) {
...
        // compile list of controllers to disable
	var disabledControllers []openshiftcontrolplanev1.OpenShiftControllerName

>>	// openshift.io/default-rolebindings controller shall be always disabled:
>>	disabledControllers = append(disabledControllers, openshiftcontrolplanev1.OpenShiftDefaultRoleBindingsController)
...

/label qe-approved
@apoorvajagtap tested this on a no-capabilities cluster, then enabled Build, Image Registry, and DeploymentConfig one by one.

/label docs-approved
Documentation via release note in JIRA.

/label px-approved
No change to product experience - admin workflow to enable a capability is not changing.

/label qe-approved
@apoorvajagtap tested this on a no-capabilities cluster, then enabled Build, Image Registry, and DeploymentConfig one by one.

The default-rolebindings controller was disabled by default for a no-caps cluster. Adding the config cm for reference:
"controllers":["-openshift.io/build","-openshift.io/build-config-change","-openshift.io/builder-rolebindings",
"-openshift.io/builder-serviceaccount","-openshift.io/default-rolebindings","-openshift.io/deployer",
"-openshift.io/deployer-rolebindings","-openshift.io/deployer-serviceaccount",
"-openshift.io/deploymentconfig","openshift.io/image-import","-openshift.io/image-puller-rolebindings",
"openshift.io/image-signature-import","openshift.io/image-trigger","openshift.io/ingress-ip",
"openshift.io/ingress-to-route","openshift.io/origin-namespace","openshift.io/serviceaccount",
"-openshift.io/serviceaccount-pull-secrets","openshift.io/templateinstance",
"openshift.io/templateinstancefinalizer","openshift.io/unidling"]

/lgtm


Polybuild breaks @apply rules

After running the dist target with PSK, it seems that any @apply mixins get broken. polymer#1.2.3
Below is an example:
Running with gulp serve

Running with gulp serve:dist

This issue was moved to PolymerLabs/polybuild#22


bug fix to the service extensions API

bug fix to the service extensions API (context: https://groups.google.com/a/dartlang.org/forum/#!topic/observatory-discuss/D9RIiAe5cFI)
rev the package version to capture the bug fix
some minor changes to the generator to capture ws changes

@danrubel

LGTM


Under 'Alerts for Resource Manager' column name "Alert (alertype)" should be "Alert (alert type)"

Under 'Alerts for Resource Manager' column name "Alert (alertype)" should be "Alert (alert type)"

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: a2eb1ae9-1cfc-0dd0-a055-79ae32b62a6d
Version Independent ID: 66ce0f69-16aa-c1f8-5163-7cc5392a3399
Content: Reference table for all security alerts - Microsoft Defender for Cloud
Content Source: articles/defender-for-cloud/alerts-reference.md
Service: defender-for-cloud
GitHub Login: @dcurwin
Microsoft Alias: dacurwin

@tungsec
Thanks for your feedback! We will investigate and update as appropriate.

@tungsec
Thanks for reporting this! We have created a PR for this issue and the changes should go live soon.


Add support for tagging WAFV2 WebACLs

https://github.com/mpostument/awstaghelper/releases/tag/0.21.0


backport: ansible: shorten default control_path

Default ansible control_path option is too long, so we shorten it by
changing the ansible.cfg file.
For more info see: https://github.com/ansible/ansible/issues/11536
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1447569
Signed-off-by: Sébastien Han<EMAIL_ADDRESS>(cherry picked from commit 0e931d2bce1030fcec9121a8dba70009cff83403)
Signed-off-by: Sébastien Han<EMAIL_ADDRESS>

bz: https://bugzilla.redhat.com/show_bug.cgi?id=1447569

Failures unrelated, the playbook will fail early and all of them will fail if something goes wrong with this one. It's an Ansible thing.
So merging.


auto-destroy on bag full

an option to auto-destroy the least valuable junk item on bag full would be nice

Blizzard broke auto-destroy long ago. So, this is not possible unfortunately.

Rested XP actually does it and that works today


There are no more endpoints available from the endpoint mapper

I opened 3_all_dnsredir_hardcore.cmd and I got an error.

EPT_S_NOT_REGISTERED | 1753 | This error occurs when the Base Filtering Engine service has been disabled.

https://www.reqrypt.org/windivert-doc-1.4.html


Create a CLI (mariactl) to abstract backup and restore commands

Instead of creating commands by manipulating strings in the backupcmd pkg, create a CLI to better abstract them without needing to rely on bash at all.
Requirements:

spf13/cobra
Multi-arch image based on alpine

I usually prefer kubeconfig plugin because they get namespaced.  Would you consider this?

Hey @Trojan295 ! Thanks a lot for your interest in contributing to mariadb-operator 🦭 ❤
Unfortunately, we recently dropped the mariabackup support for now, as we were having a lot of issues with our newest HA support. We are planning to support it back, but a few refactors need to be done first, see this for more detail:

https://github.com/mariadb-operator/mariadb-operator/pull/97

Regarding the CLI, we have decided to de-prioritize this item (see the new ROADMAP.md) since there isn't too much to abstract now and the CRDs APIs might change during the refactor I've mentioned. In any case, I still see the value of a CLI from the user experience perspective, it's something that other operators do and that cloud native end users would expected.
I would suggest you stay tuned, as this or other features will require new contributiors at some point. 🚀

We have recently introduced a glued CLI for internal use:
https://github.com/mariadb-operator/mariadb-operator/tree/main/cmd
Closing!


fix(deps): update images to latest

This PR contains the following updates:

Package
Type
Update
Change

icr.io/ibm-iac-charts/sysdig-deploy
helm_release
minor
1.34.4 -> 1.37.1

icr.io/ibm-iac/agent-kmodule

minor
12.18.0 -> 12.19.0

icr.io/ibm-iac/agent-slim

minor
12.18.0 -> 12.19.0

icr.io/ibm-iac/kspm-analyzer

minor
1.38.0 -> 1.39.0

icr.io/ibm-iac/kspm-collector

minor
1.36.0 -> 1.37.0

icr.io/ibm-iac/vuln-host-scanner

minor
0.6.8 -> 0.7.2

icr.io/ibm-iac/vuln-runtime-scanner

patch
1.6.6 -> 1.6.7

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

/run pipeline

/run pipeline

:tada: This PR is included in version 1.0.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Add rerun in Grinder link in test page

On the test page, we already have Artifactory link and Jenkins link (for example). It would be nice to add the rerun in Grinder link:

@momanmalik could you take a look at this one? Thanks


Parameterize the test name hex in both model and testbench

The model and TB are both hardcoded to read the instructions from a file named as "instr_hex" and the corresponding PC values from "pc_values_hex". Both the model and TB should allow the user to read the test name from the command line. I was thinking we can follow the following convention -
<test_name>.hex
<test_name>_pc.hex
On the command line the user can just provide the test name and the rest should be taken care of.

I will take care of updating the TB.
@dhruvbehl can you check the same for the ISS?

I have added the support in the TB and the run.pl script as well.
Fix in 0b6e052

Added the required support in the model as well.
Closing.

@raulbehl  It should be good to retain all the labels even after the bug is fixed.


Two versions of apktool in linux

I am using kali linux.
I already had an apktool of version 2.2.0 preinstalled in it. I installed Fatrat. I think it tried to update apktool.
Everytime, i run apktool d apkname.apk and apktool b apkname It uses apktool version 2.2.0
Now, the problem is:
everytime i try to update apktool by running command sudo apt-get install apktool or sudo apt-get upgrade apktool
It says, the apktool version is 2.3.0 and is already the latest version.

I have no control sadly over the packages that kali uses and not sure how installing fatrat has anything to do with an OS package. This is a support issue regarding unix and running software. I am going to close this as it is not a bug.

@iBotPeaches Ok, Sorry. I thought its related to this package. And there is a guide for it.

This is Apktool, but I have nothing to do with the Apktool package in kali.

@iBotPeaches BTW i am trying this to fix this issue https://github.com/iBotPeaches/Apktool/issues/1157
Is the latest version still have this issue?


Code not working on build

Started a separate thread for this. I am using unity 2018.3, and the program runs fine in debug mode. However, upon running the build, I am getting a blank screen with skybox. Upon further investigation - I realize that the problem is something to do with the shader? Here's the relevant error log I get in the build mode.

Saw window: desktopBitBlt1
(Filename: C:\buildslave\unity\build\Runtime/Export/Debug.bindings.h Line: 45)
ArgumentNullException: Value cannot be null.
Parameter name: shader
at (wrapper managed-to-native) UnityEngine.Material.CreateWithShader(UnityEngine.Material,UnityEngine.Shader)
at UnityEngine.Material..ctor (UnityEngine.Shader shader) [0x00007] in :0
at ExampleUsage_v2.OnAddWindow (WinCapture.WindowCapture window) [0x0004e] in <37f9a7fb9b9240bb96abce547ef8d13b>:0
at WinCapture.WindowCaptureManager.Poll () [0x00032] in <37f9a7fb9b9240bb96abce547ef8d13b>:0
at ExampleUsage_v2.Update () [0x000ff] in <37f9a7fb9b9240bb96abce547ef8d13b>:0

Any ideas on how to fix this?
Thanks :)

Looks like we need to include the shaders while building. This solved my issue :)


dependency cleanup with grails-bom

This PR uses Gradle Release Flag instead of Java Toolchain to provide more control over the version of Java. sourceCompatibility is deprecated and marked for removal in Gradle 9. https://docs.gradle.org/current/userguide/building_java_projects.html#sec:compiling_with_release
    compileJava {
        options.release = 17
    }

bumps Gradle down to 8.6 in the project and the generated Grails app until there is a resolution for https://github.com/grails/grails-testing-support/issues/443
implementation platform has to be applied to buildSrc also until https://github.com/grails/grails-forge/issues/406
geb-spock needed to added:  https://repo.grails.org/ui/api/v1/download/contentBrowsing/core/org/grails/plugins/geb/5.0.0-SNAPSHOT/geb-5.0.0-20241023.135416-10.pom?isNativeBrowsing=true is now optional=true, possibly due to https://github.com/grails/geb/blob/5.0.x/build.gradle#L41

This PR addresses the current breakage on Grails apps generated on https://start.grails.org/


Default to text selectors for Playwright

Is it technically feasible to default to something like button:has-text("Log In") instead of incredibly long, unmaintainable selectors? Some way of defaulting to the shortest text-based selector when possible? I'd love to be able to use this extension while also following Playwright's best practices of using text in all possible cases.

With pull request https://github.com/checkly/headless-recorder/pull/178 it is possible to set a custom resolver. In the pull request, you can also find code that you have to set as custom resolver

I

The


Fastnlight: Watch statuschecksrd.co.za

Fastnlight requests the watch of the watch_keyword statuschecksrd\.co\.za. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

Approved by Jeff Schaller in Charcoal HQ

statuschecksrd\.co\.za has been seen in 2 true positives, 0 false positives, and 0 NAAs.


Create LICENSE

Add the Unlicense license from unlicense.org to clarify that this project is in the public domain.
You state here that you would like vJoy to be in the public domain. This change would allow you to clarify that fact in the source. Please accept only if you would like to enable other developers to use vJoy as public domain.

Just for the records, GPL doesn't disallow commercial purposes.

I have about two or three requests for clarification a year. I send the requester a clear statement. I think this is good enough.

I have about two or three requests for clarification a year. I send the requester a clear statement. I think this is good enough.

If you are getting multiple requests a year, that means there are probably hundreds who have the question but are not willing to go out of their way and ask. Adding a license is an easy thing for you to do to ease that confusion.

I'm likely one of many who cannot use your library because it's unlicensed, which is disappointing because it was very useful and easy to work with.
From Github help: "without a license, the default copyright laws apply, meaning that you retain all rights to your source code and no one may reproduce, distribute, or create derivative works from your work"
If you reconsider and would like to add a license yourself, Github has instructions here: https://help.github.com/articles/adding-a-license-to-a-repository/
Thanks for your work!

"I don't give a fuck", seems the very legal definition of the WTFPL

MIT License. OK? Done.


Git URL not properly resolved

I had another instance of this issue https://github.com/Microsoft/vscode-tslint/issues/271. Please see the screen shot and explanation over there.
The git URL resolves to a package.json, but the contents of the package.son shown when opening the URL is the contents of the Changelog.md. This then triggers a JSON validation for a markdown file.

It happens when I open the files in this sequence

@egamma I can't reproduce. I even tried installing TSLint and checking whether this would surface due to it.
I am pretty sure this is the only code path in which I create git URIs; and those are always perfectly constructed: the uri path matches the path within the query parameters. I did a code review on the git extension and there's no URI-magic happening (eg: uri.with({ path: 'something' })).
So this URI must be generated somewhere else. What extensions do you have installed?
@dbaeumer @aeschli Is the language server/client doing any URI-magic, like taking an existing URI and changing its path (eg: uri.with({ path: 'something' }))?

@joaomoreno there is support to do that but it is off by default. Usually the URI go over the wire using Uri.toString().

What does that support look like? Do you know if someone uses it?

If someone does that he passes converter functions to the LanguageClient using the LanguageClientOptions. May be we can use @sandy081 tool to see if this is the case in one of the extensions.
I am not aware of an extension doing this and usually it is not necessary.

I see this when I have changes in the package.json and the CHANGELOG.md:

Reload window
Open diff editor for CHANGELOG.md
Error about package.json shows up in problems panel
Click on error in problems panel
'package.json' with CHANGELOG.md content opens

Doesn't the git: URI showing the wrong content imply that the document provider for that scheme got it wrong?

Excellent @chrmarti huge thanks for the repro steps, I could repro there too.

This comes from this magic here:
https://github.com/Microsoft/vscode/blob/32bebd313efc979c9dd9d34d87c0671fe5ba4022/extensions/extension-editing/src/extensionLinter.ts#L138-L144
That code is running for any open documents. It should only run for file scheme documents.
Assigning to you @chrmarti since it seems you were the last person in here.

@joaomoreno It would seem wrong to only run on 'file' URIs, after all with the file system providers files can have any scheme. I think the 'git' document provider should either provide the correct content for the git:.../package.json URI or bail out. Currently it returns the CHANGELOG.md content, which is unexpected.

Unfortunately, git relies heavily on case sensitivity. I was forced to not use the path component of a URI, because it is case insensitive. The git extension gets the actual file path from the query component, which is case sensitive.
https://github.com/Microsoft/vscode/blob/master/extensions/git/src/uri.ts
At best, the git extension could throw an error if it detects path does not match the expected value from query, but I'm not so sure this would fix anything. You'd just get an error.

Verified by running from source.


Support for Two Factor Authentication

Look at adding support for Two Factor Authentication via an app such as Google Authenticator.
https://medium.com/@richb_/easy-two-factor-authentication-2fa-with-google-authenticator-php-108388a1ea23

Hey @dpi209 , could you take a look at what I've done in 94-support-for-two-factor-authentication when you have a moment? Basically, I've put hooks in at various points to support actually adding the 2FA stuff in the next step. More support is needed to build the form for when 2FA is being set up (e.g., display the QR code, confirm it works, etc.).
If I've done it right, if/when this is merged, it won't break anything, but I'm don't want to create the pull request, just yet.
Many thanks in advance!


wasm-pack test is unreliable

See: https://github.com/charliermarsh/ruff/actions/runs/3794761527/jobs/6453331265.

What I don't understand - and I noticed that in multiple runs - is why the operation is being canceled. Many times the tests succeeded.
running 3 tests

test ruff::lib_wasm::test::empty_config ... ok
test ruff::lib_wasm::test::partial_config ... ok
test ruff::lib_wasm::test::partial_nested_config ... ok

test result: ok. 3 passed; 0 failed; 0 ignored

Error: The operation was canceled.

Yeah, trying to find any relevant issues etc. but not seeing anything.

I don't know if this is just a symptom of a different failure, but when it fails in this way, we never see the other test suites skip execution:

I'll try setting --lib for now... I dunno.

I'm also seeing this.. which isn't that helpful. I was thinking that maybe it's just being canceled because a new workflow was scheduled, but that doesn't seem to be the case.
I would also kinda rule out memory issues, we're not even running headless browsers for testing..
2022-12-28T15:22:07.1731677Z running 3 tests
2022-12-28T15:22:07.1831067Z
2022-12-28T15:22:07.2165473Z test ruff::lib_wasm::test::empty_config ... ok
2022-12-28T15:22:07.2217990Z test ruff::lib_wasm::test::partial_config ... ok
2022-12-28T15:22:07.2433964Z test ruff::lib_wasm::test::partial_nested_config ... ok
2022-12-28T15:22:07.2457576Z
2022-12-28T15:22:07.2459785Z test result: ok. 3 passed; 0 failed; 0 ignored
2022-12-28T15:22:07.2460027Z
2022-12-28T15:22:41.4902290Z ##[error]Process completed with exit code 143.
2022-12-28T15:22:41.4984194Z ##[error]The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

Well, actually.. when you start searching for the "shutdown signal" thing, numerous issues popup about people's jobs being canceled. Most often due to resource limits.
For example: https://github.com/actions/runner-images/issues/6680
One response: https://github.com/actions/runner-images/issues/6680#issuecomment-1335778010

I don't remember having seen this in months.


Tags mode input?

Like Bootstrap Tags Input (not maintained since October 2013), or like Select2 (no Bootstrap styling).

Note to self: also add option to keep current format, but group selected options at the top of the menu.


add an action to validate updates to hub config files

this would make me feel better about things when i'm making updates to config files

I can give this a shot. I had initially thought this was completed in https://github.com/hubverse-org/hubverse-actions/commit/b59f6bc121540a99de2f2bfbeaefcdc9a14ec89f, but now I understand that doesn't validate the config files, so this action would be, in a sense, validating the validators.
I'm going to implement an action that will use hubValidations::check_config_hub_valid() to validate the config files because it looks like it wraps the validations from hubAdmin
As a side note: I believe a workflow like this would have prevented the config errors I was getting in https://github.com/hubverse-org/hubDocs/issues/152

🤔 Validating config files

👍🏽 installed hubAdmin package
🤔 validate_hub_config() fails for metadata schema because some elements need to be arrays

Sorry I should have added more detail in the request!
Yes the config is checked during submission validation but that's only triggered when model metadata files are submitted.
It would be nice to have a workflow that is triggered by changes to the config.
The hubValidations check function actually only wraps a hubAdmin function specifically hubAdmin::validate_hub_config(). So we only need to run this function.
This returns TRUE or FALSE so we want the workflow to fail if it returns FALSE. If FALSE, and errors table is also attached as an attribute.
There's also function hubAdmin:: view_config_val_errors() that presents any validation errors in a nicely formates gt table. Would be amazing to post that as a comment but not sure how straight forward it will be. If not just printing the errors attribute would be useful instead.

currently testing things out in https://github.com/zkamvar/example-simple-forecast-hub/actions/runs/10201766462/job/28224400302?pr=1

Okay, I've got something working here:
https://github.com/zkamvar/example-complex-forecast-hub/pull/1
(because I'm going to delete my fork, it looks like this:)
:x: Invalid Configuration
The schema in hub-config/ appear to be invalid. Details about the exact locations of the errors can be found in the table below.

hubUtils config validation error report

Report for directory /home/runner/work/example-complex-forecast-hub/example-complex-forecast-hub/hub-config using
schema version v3.0.0

Error location

Schema details

Config

fileName
instancePath
schemaPath
keyword
message
schema
data

admin.json
contact
└name
properties
└contact
└─properties
└──name
└───type
type
❌ must be string
string
Maintainer!!!?, name?>??

For more information, please consult the
hubDocs documentation.


nix-collect-garabage causes recompile of emacs24

Have the following entries in environment.systemPackages:
emacs
(emacs.override { gtk = pkgs.gtk3; })
doing:
nix-collect-garbage
then:
nixos-rebuild test/switch
causes emacs24 to be compiled every time.
I'm guessing this is something to do with .elc files needing to be compiled on install (before hashing) ?
If someone can point me in the right direction will try and write a patch.
Thanks!

Probably not happening any more. I suggest to close @domenkozar


Google Tag Manager

I want to track clicks on certain links in various riverscapes web sites (GCD, RAVE etc). To do this I need to add some Google Tag Manager JavaScript to both the head and body tags of each site. I believe I can do this once for all riverscapes sites and then use separate tag IDs for individual links.
Please get in touch the next time you're working on the theme and let's add this JavaScript together.

@philipbaileynar I want to revisit this as A higher priority. We need to start tracking analytics on who is looking at what.

I'm working on this now but it seems like there's still some discussion to be had on what it is we want to track and whether or not that's going to be possible.

My original request was for a count of clicks on specific links in the web sites. Namely, the download button on GCD and RAVE etc. That's why the ticket explicitly mentions the tag manager.
overall site Google Analytics is obviously a bigger topic. Hopefully that is as a simple as flipping a switch on each riverscapes site. I don't want to get bogged down in hours and hours of web maintenance.


Multi streamers

This allows the front end to switch between streams at will using the drop down menu in settings.
I also added a small hint to the front end when you connect to a signalling server with multiple streamers so it doesn't feel like an error.

With https://github.com/EpicGames/PixelStreamingInfrastructure/commit/4fc43bcf2936af9c7e5bbff16f35cb466d4aec82 landed should this be closed now?


Excess white space below site capture

When capturing some sites excess white space is added below the website capture.
Example link:
https://msto.startrack.com.au/track-trace/?id=MVMZ00118468
Capture result, the actual white space is much longer on the actual reference image

Adjusting the delay does not seem to change the amount of white space that is added.

Hi @bradhawkins85 - so the reason this occurs is because the image comparison package needs images to be the same width & height in order to detect any changes. You can set this parameter in your .env file.
CAPTURE_IMAGE_HEIGHT=5000
CAPTURE_IMAGE_WIDTH=1024
Ultimately this should really be moved from a global parameter to be user selectable for each job.


Creator and modifier data are missing

创建人和修改人数据缺失

https://github.com/masastack/MASA.Framework/pull/585


What are the requirements for the motherboard in this project？

hello，I happened to find this project，and the readme.md has declared the firmware of 3.34 . But I'd like to know more about this projet to determin if I can use it in my voron2.4.
THE QUESTION I WANT TO KNOW MOST IS： is this project replaced the ERCF-easy-brd, and the dirver should be privite by duet board.
If it is this ,  I think i'd better get a extention board.
My english may not very well
Looking forward to your relpay

Duetwifi + duex5
Or any duet3 plus expansion boards as necessary to have enough drivers
The easybrd is not supported. However expansions such as https://github.com/gixxerfast/Canned-ERCF-board would be a possibility on duet3

THANK YOU VERY MUCH!


add baxter_base.xacro  rethink_electric_gripper.xacro baxter.urdf.xacro ...

...baxter_electric_gripper.urdf.xacro

Hi
Is there anything we have to consider before merging? Since APC has started so it's nice for all participants to use this feature very soon.
See #64 for previous discussion

Thanks again for all your help, @k-okada. It was a great starting point for gripper development. This PR is superseded by #71

greate! thanks for all of your work on putting everything together!!!


Bad optimization code by Arduino on reading value

Optimization in Arduino code create reverse order of reading 16 bits values as two 8 bits value (like Big/Little Endian error)
Need a temp value to correct this order
// ___________________________________________ STATIC PRIVATE MEMBER FUNCTIONS
/// Request and receive data from most-recent A/D conversion from device.
/// \param address device address (0..3)
/// \return 16-bit zero-padded word (12 data bits D11..D0)
uint16_t ADS7828::read(uint8_t address)
{
uint8_t tempa;
Wire.requestFrom(BASE_ADDRESS_ | (address & 0x03), 2);
tempa = Wire.read();
return word(tempa, Wire.read());
//  return word(Wire.read(), Wire.read()); // doesn't work on some configuration
}

It might be worth starting a new implementation of this library. Seems like the project has been abandoned


fix: language change

:tada: This PR is included in version 0.121.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Way to use post-plugins?

I clicked on the link for GPT plugins and it says:
"We are no longer accepting new Plugins, builders can now create Actions inside of a GPT."
Is there still a way to use LeanDojoChatGPT?

It looks like OpenAI has retired the ChatGPT Plugins API in favor of GPTs. It shouldn't be hard to adapt to the new APIs. We won't have the capacity to do it in the near future, but community contributions are welcome.

It looks like there's even a GPT for creating actions out of plugins:
https://chat.openai.com/g/g-TYEliDU6A-actionsgpt
I asked it to convert LeanDojoChatGPT to an action, but it needs a URL under "servers" and I don't know whether the current approach will work. I'll pursue this further, but suggestions are welcome.

截至今日，我仍无法在gpt4上使用leandojo，可以提供一个具体教程吗，非常感谢

Hi @EliottMeng,
The ChatGPT plugin no longer works because OpenAI has changed its APIs. Due to limited bandwidth, we do not plan to update this repo to keep up with OpenAI. However, it should be fairly straightforward for anyone familiar with OpenAI's API to integrate it with LeanDojo in a way similar to this repo.
Best,


GetAllResourcesFromSelector to retrieve resources of all kinds

with specific labels (to be used by "odo list" and "odo delete component")
What type of PR is this:
/kind feature
What does this PR do / why we need it:
This PR adds a GetAllResourcesFromSelector, function thats searches all recources of any kind in the cluster
This function is intended to be used at least in odo list and odo delete component
The code comes 99% from https://github.com/ahmetb/kubectl-tree

/approve

/lgtm


Fix auto_sync_test to also succeed when run after other tests

Clear modified storages at start of test_auto_sync_storage
This should fix currently failing GPU CI.

bors try

bors try-
bors try

bors try-
bors try


ReadyApp framework does not detect failed deployment

Following issue #2069, that was closed suggesting usage of ReadyApp framework would solve the case, it unfortunately does not, after testing it.
When using this API (declaring true and calling weblogic.application.ready.ReadyLifecycleManager.getInstance().ready() in some Web Listener for instance), the startup does as following:

Weblogic server initializes, and is then ready to serve HTTP requests
At this stage, /weblogic/ready returns HTTP 200
We trigger a deployment of a webapp (using ReadyApp framework) - via command line, for this experiment
As expected, while webapp is initializing, /weblogic/ready now returns HTTP 503
At some point in the loading process, we interrupt the deployment via throwing an exception (hence, ReadyLifecycleManager.getInstance().ready() is never called)
Nevertheless, /weblogic/ready now returns HTTP 200, which makes the related pod to be used by the respective ingress object (and returning HTTP 404 on the expected webapp context path), and the replica set to never recreate a new replica to attempt a new startup.

This behavior probably comes from the fact the "applicationId" is unregistered from the ReadyApp framework, but, still, it means this API cannot be used to detect failed deployments.
I read that K8S startup probe is not used because the Weblogic K8S operator makes usage of the ReadyApp framework for fine control on deployment startup, but I'm afraid there are no proper ways for this operator to detect (and trigger creation of a new pod) of Weblogic managed server with failed deployment(s).

We use the ready app framework and the WebLogic server handle if all the registered application is ready.   I assumed you have set up the WebLogic deployment descriptor to register to the framework.
wls:ready-registrationtrue</wls:ready-registration>
For this to work, it must be successfully registered and initialized before you can call the ready() method to tell the server that this app is ready, if your application failed to initialize before then the framework will not be able to tell.   Is it something that you are trying to simulate?

Hi @jshum2479!
Yes, I've tried different scenarios, but in all of them, the true</wls:ready-registration> is defined at weblogic-application.xml (if not, anyway the ReadyLifecycleManager.getInstance().ready() crashes with an IllegalStateException, as documented)
However, even if it is defined, whenever the webapp crashes at deployment time, the ReadyApp framework /weblogic/ready endpoint changes from HTTP 503 (server not ready) to HTTP 200 (server ready) - while it just faced a webapp deployment crash.
I could understand this behavior, because, in a way, an failed deployment does not exactly mean the server is not "ready", but it this also means we cannot rely on this framework to detect managed server with improper state (= with expected webapp that failed to start).

@lastnico You are going to need to file a Support case with WebLogic Server support.  This has nothing to do with the operator.

Thanks. I indeed wondered where is the boundary between:

the Kubernetes weblogic operator to exactly identify if the containerised Weblogic server fits the enduser needs (including if the underlying webapps are properly started up) - because I read elsewhere that the Kubernetes startupProbe (that allows defining an HTTP endpoint to poll) was not supported by the Weblogic K8S operator, since the ReadyApp framework (at Weblogic level) was meant for such fine tuning.
the ReadyApp framework, which, as such, only defines ready / not ready statuses, and nothing in between like "will never be ready", when a webapp deployment fails.

I can (and will) open a Support ticket to the Weblogic support, but I'm just afraid they'll redirect me here, asking for the K8S weblogic operator to offer ways to identify when the Weblogic server is in an incorrect state (from deployment perspective)
Thanks again!

@lastnico Feel free to give the Oracle Support people my name and mention that I said it has nothing to do with WKO.  They know me and should reach out to me if they have issues.

Thanks for the advice.
About your last sentence, according to K8S operator doc:
https://oracle.github.io/weblogic-kubernetes-operator/managing-domains/domain-lifecycle/liveness-readiness-probe-customization/

Here are the options for customizing the readiness probe and its tuning:
By default, the readiness probe is configured to use the WebLogic Server ReadyApp framework. The ReadyApp > framework allows fine customization of the readiness probe by the application’s participation in the framework. For more > details, see [Using the ReadyApp Framework](https://docs.oracle.com/en/middleware/fusion-middleware/weblogic-> server/<IP_ADDRESS>/depgd/managing.html#GUID-C98443B1-D368-4CA4-A7A4-97B86FFD3C28). The readiness probe is used to >determine if the server is ready to accept user requests. The readiness is used to determine when a server should be >included in a load balancer’s endpoints, in the case of a rolling restart, when a restarted server is fully started, and for > various other purposes.

And the 5 properties under "readinessProbe"
https://github.com/oracle/weblogic-kubernetes-operator/blob/release/4.1/documentation/domains/Cluster.md#probe-tuning

failureThreshold
initialDelaySeconds
periodSeconds
successThreshold
timeoutSeconds

I don't find how we could assign another endpoint for readinessProbe. This is actually the reason why I started to investigate on the ReadyApp framework, which, in the end, does not fit detection of failed deployments.

We do not allow configuration of a different probe path just the tuning parameters.

My mistake.
@rjeberhard The domain spec looks like this should be supported so why is it being prevented.
% kubectl explain domain.spec.serverPod.containers.readinessProbe
GROUP:      weblogic.oracle
KIND:       Domain
VERSION:    v9

FIELD: readinessProbe <Object>

DESCRIPTION:
    <empty>
FIELDS:
  exec	<Object>
    <no description>

  failureThreshold	<integer>
    <no description>

  grpc	<Object>
    <no description>

  httpGet	<Object>
    <no description>

  initialDelaySeconds	<integer>
    <no description>

  periodSeconds	<integer>
    <no description>

  successThreshold	<integer>
    <no description>

  tcpSocket	<Object>
    <no description>

  terminationGracePeriodSeconds	<integer>
    <no description>

  timeoutSeconds	<integer>
    <no description>

It has never been supported to override the liveness or readiness probes generated for the container running the WebLogic instance. The schema above is for the sidecar containers, if any, added to the pods. This is why there is validation to ensure that this functionality isn't used to try and add a sidecar container with the same name as the main container ("weblogic-server").
The only supported customizations are to timing-related fields, as described here: https://oracle.github.io/weblogic-kubernetes-operator/managing-domains/domain-lifecycle/liveness-readiness-probe-customization/#readiness-probe-customization
We could certainly look at an enhancement to support overriding more fields of the probes. @lastnico, was your idea that you would provide some other application endpoint that consulted the MBeans?

Or maybe something more basic such as exposing an endpoint in the app to ensure that the app is properly deployed.  This is what WebLogic customers did prior to 12.2.1 being released (release that introduced ReadyApp).

@robertpatrick I initially thought of this, yes: A new httpGet property under readinessProbe, to allow overriding /weblogic/ready URL polling
Though, when multiple webapps are deployed on the same server, it'd mean multiple endpoints to poll, so, in this case, relying on the ReadyApp API calls on each webapp would probably be simpler.
However, returning HTTP 503 for failed deployed webapps at ReadyApp means it'll require to change how it behaves currently, so there's maybe lower chances this gets supported.

@lastnico let us know once you file a Support ticket with a reproducer and I will take a look.  Note that your test case should not use Kubernetes…

@robertpatrick Sorry for asking, do you mean a Support case to WebLogic Server support regarding ReadyApp framework, or also/both regarding the K8S weblogic operator, to possibly get a new httpGet property to override readinessProbe?

do you mean a Support case to WebLogic Server support regarding ReadyApp framework

Yes

@robertpatrick It took a while, but the issue was finally submitted to Oracle Weblogic Support under
https://support.oracle.com/epmos/faces/SrDetail?srNumber=3-35814160481
Thanks!


Where are the comments when adding new functions etc?

I see a bunch of new functions etc that have been added here and there over time and no comments!
For instance, what do the following functions return? meters, mm, cm, km, float 0-1, ... ?

float getDistanceAt(int x, int y);
float getDistanceAt(const ofPoint & p);

Sure, "self documented code" and all that, but in this case we need to know what we are getting back.
It dosen't take very much time to comment your work and helps the rest of us out. More and more people are using this addon and, so far, the headers are their only source of documentation.
As far as I'm concerned, an update isn't finished until its been commented and tested. Also, I find having to explain an addition in a sentence or 2 is a good usability test.

We are finally fixing this ...


UI/Shop Detail for reservation approval

A view for shop detail in approve reservation process

Duplicated with #117


[SINT-1180] Index Allowlist

See https://datadoghq.atlassian.net/browse/SINT-1180

@fridex should be all done


ESET Detection

Hi all,
I love your script, and I think it saved me before. But since I have daily crashes again since the latest patch, I've discovered a problem.
The script detects ESET on my PC, but I never had ESET installed.
Can you tell me what this could be about?
Thank you very much an have a nice Weekend.

TL;DR, you're probably fine. If you're crashing alot now, and you're using the SPEAR, that may be the explantion.
Why You're Fine:
Do you have a program that has the letters "eset" in the name? For example: a program with the name Ready, Reset! would get detected as ESET.
 The risk of course is in what is happening to you (false positives).
There's the relevant line of code. You can see I do a wild card match so it's looking for anything that's ESET which means that it could detect ANYTHING with eset in it.

Addressed with a information message in Commit: 207899eaa3029c4f64073a8d093f70b60ed42453


Create Hanoi Tower.cpp

Hey! The code already exists. Could you come up with another one? 😄 :

Please merge . I have deleted the previous one which was duplicate


bazel build TensorFlow Lite 2.7.0 with Select TensorFlow operators for iOS failed

Click to expand!
Issue Type
Bug
Source
source
Tensorflow Version
tf 2.7
Custom Code
No
OS Platform and Distribution
macOS 12.3.1
Mobile device
iPhone
Python version
3.9.10
Bazel version
3.7.2
GCC/Compiler version
Apple clang version 13.1.6
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
bazel build TensorFlow Lite 2.7.0 with Select TensorFlow operators for iOS successfully.

Standalone code to reproduce the issue
bazel build -c opt --config=ios --ios_multi_cpus=armv7,arm64 //tensorflow/lite/ios:TensorFlowLiteSelectTfOps_framework

Relevant log output
ERROR: Skipping '//tensorflow/lite/ios:TensorFlowLiteSelectTfOps_framework': no such package 'tensorflow/lite/ios': BUILD file not found in any of the following directories. Add a BUILD file to a directory to mark it as a package.
 - /Users/andyueng/samba/workspace_TensorFlow2/tensorflow-2.7.0_selops_ios/tensorflow/lite/ios
WARNING: Target pattern parsing failed.
ERROR: no such package 'tensorflow/lite/ios': BUILD file not found in any of the following directories. Add a BUILD file to a directory to mark it as a package.
 - /Users/andyueng/samba/workspace_TensorFlow2/tensorflow-2.7.0_selops_ios/tensorflow/lite/ios
INFO: Elapsed time: 0.284s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)

I have solved BUILD file not found issue as follows.
Run the ./configure script in the root TensorFlow checkout directory, and answer "Yes" when the script asks if you wish to build TensorFlow with iOS support.

Ok @snowuyl ! Glad to see it resolved . Could we move this to closed status then?


Cordova not available on browser console

Browser console has few warnings and HTTP operations are not working please advise.
Native: tried calling SplashScreen.hide, but Cordova is not available. Make sure to include cordova.js or run in a device/simulator

There is nothing wrong in HTTP calls. I have just initiated the package and trying to invoke.
If there is anything wrong in the HTTP call method, an error will be different but the errors I am getting is Cordova not available. Not sure if this is a problem something related to version conflict between packages. Ionic version

cordova will be available on mobile device  only. You should build app for iphone or android and then run app on device or simulator and then you will see that error "Cordova not available" will disappear. cordova namespace available only on device, you can't use cordova methods inside your desktop browser.

no. you can't get it in browser. You must run xcode or android studio emulator  to get access cordova methods

Will follow the same and thanks for the advice. Good day!


ParseExceptions from hasNext not caught and handled properly

FilteringCloseableInputRowIterator is the chokepoint where all calls to parseExceptionHandler.handle get made when they come from issues in parsing the original input. It has logic to catch and handle parse exceptions from next() of the underlying Iterator, but it doesn't catch exceptions in hasNext().
I noticed this when debugging the error below. Something in the way the iterator was constructed caused hasNext() to throw an exception. This is totally valid, and it's hard for FilteringCloseableInputRowIterator to handle properly, because what should it do if hasNext() throws an error? Just blindly call next()? That doesn't seem like a good idea, since it's outside of the general contract of Iterator.
IMO, the best solution is not to use an Iterator<InputRow> here. Maybe an Iterator<Pair<ParseException, InputRow>> so we don't need to mess about with catching exceptions during iteration. Or maybe a new interface.
org.apache.druid.java.util.common.parsers.ParseException: Unable to parse row [<deleted>]
        at org.apache.druid.java.util.common.parsers.JSONPathParser.parseToMap(JSONPathParser.java:74) ~[druid-core-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.data.input.impl.StringInputRowParser.parseString(StringInputRowParser.java:155) ~[druid-core-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.data.input.impl.StringInputRowParser.buildStringKeyMap(StringInputRowParser.java:119) ~[druid-core-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.data.input.impl.StringInputRowParser.parseBatch(StringInputRowParser.java:80) ~[druid-core-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.segment.transform.TransformingStringInputRowParser.parseBatch(TransformingStringInputRowParser.java:50) ~[druid-processing-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.segment.transform.TransformingStringInputRowParser.parseBatch(TransformingStringInputRowParser.java:31) ~[druid-processing-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.seekablestream.StreamChunkParser.lambda$parseWithParser$0(StreamChunkParser.java:111) ~[druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at com.google.common.collect.Iterators$8.transform(Iterators.java:794) ~[guava-16.0.1.jar:?]
        at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48) ~[guava-16.0.1.jar:?]
        at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48) ~[guava-16.0.1.jar:?]
        at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543) ~[guava-16.0.1.jar:?]
        at org.apache.druid.java.util.common.CloseableIterators$1.hasNext(CloseableIterators.java:71) ~[druid-core-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.common.task.FilteringCloseableInputRowIterator.hasNext(FilteringCloseableInputRowIterator.java:62) ~[druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at com.google.common.collect.Iterators.addAll(Iterators.java:356) ~[guava-16.0.1.jar:?]
        at com.google.common.collect.Lists.newArrayList(Lists.java:147) ~[guava-16.0.1.jar:?]
        at org.apache.druid.indexing.seekablestream.StreamChunkParser.parseWithParser(StreamChunkParser.java:119) ~[druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.seekablestream.StreamChunkParser.parse(StreamChunkParser.java:102) ~[druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.runInternal(SeekableStreamIndexTaskRunner.java:625) ~[druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.run(SeekableStreamIndexTaskRunner.java:268) [druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTask.run(SeekableStreamIndexTask.java:146) [druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:211) [druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:151) [druid-indexing-service-0.21.0-SNAPSHOT.jar:0.21.0-SNAPSHOT]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
        at java.lang.Thread.run(Thread.java:834) [?:?]

Does this happen with InputFormat as well? IntermediateRowParsingReader should handle exceptions thrown in hasNext() via ExceptionThrowingIterator. I am just saying this is what it does with InputFormat and agree that there could be a better interface.

Does this happen with InputFormat as well? IntermediateRowParsingReader should handle exceptions thrown in hasNext() via ExceptionThrowingIterator. I am just saying this is what it does with InputFormat and agree that there could be a better interface.

I'm not sure since I haven't done a full analysis. But in this case, the task used a legacy parser, not an inputFormat.

I'm not sure since I haven't done a full analysis. But in this case, the task used a legacy parser, not an inputFormat.

Yeah, I'm curious if this problem happens only with legacy parsers. If so, an easy workaround would be using inputFormat.

Yeah, I'm curious if this problem happens only with legacy parsers. If so, an easy workaround would be using inputFormat.

@gianm @jihoonson I see a similar issue with #7690


Fix scraping of abstracts that are split up into sections.

Current approach gets confused / doesn't extract all the data, if the abstract is presented in multiple sections. Scraping approach needs to deal with multiple tags.
Note: issue discovered and solved by @wdfox - code just adding in here.

This is addressed by updating to use LISC (#2).

This is addressed by updating to use LISC (#2).


Use yii2 DI in rest module

Right now in rest actions like CreateAction model is created with:
$model = new $this->modelClass([             'scenario' => $this->scenario,         ]);
I believe more appropriate will be if the yii tool for initialization of objects (\Yii::createObject) is used.
Regards

Would you please elaborate about your use case? Thanks.

My case is a RESTful API where I have some models defined in config - > container - > definitions, to include some behaviors with 'as ....' directive, but apparently CreateAction does not use the DI and instantiates the models directly with "new". So I was wondering wether this is on purpose and if not, wouldn't it be nice to adjust it. I see this as an improvement to be done

Is there a mistake or models are, in fact, are in container as services?


Laravel 5.4 , Minimum Stability Issue

Hi,
I'm using Laravel 5.4, I'm unable to install this package. I keep getting minimum stability error. Is this because the current package requires
"require": {
"php": ">=5.4.0",
"illuminate/support": "5.1.|5.2.|5.3.*"
},
these configurations? , Is there a work around?. Can you please help resolve this issue.

Hi,
I'll test the package with 5.4 before publishing an update.

Package now supports Laravel 5.4

sorry got some error in 5.4
  [InvalidArgumentException]
  Could not find package igonics/disqus-sso at any version for your minimum-s
  tability (stable). Check the package spelling or your minimum-stability

Hi @rebornishard , try composer require igonics/laravel-disqus-sso. You may have had a typo
Official Packagist Link

@gggordon it's not just me who typo, see readme.md :)
thanks

@gggordon send pull request 👍


OOMKilled na execução do plugin popeye

Description
sometimes the scan pod has outfomemory
Expected Behavior
Pod state Completed

Thanks for reporting this issue.
It happens because the default resource limits is not enough for your target cluster.
For now you can edit the popeye plugin (kubectl edit plugin popeye -n zora-system) to increase the limit.

TODO: popeye resources as helm chart parameters.
Example: https://github.com/undistro/zora/blob/main/charts/zora/values.yaml#L89


fixes issue #29 and cleans up some negation/inversion handling

also, changes output for equality operators to the idiomatic is and isnt operators

Nice, never knew you can invert instanceof with not.


Fix: Tx Success image path

What changed? Why?

fixed the path for the tx success image

Notes to reviewers
How has it been tested?

🟡 Heimdall Review Status

Requirement
Status
More Info

Reviews

🟡
0/1

Denominator calculation

Show calculation

1 if user is bot
0

1 if user is external
0

From .codeflow.yml

1

Additional review requirements

Show calculation

Max
0

0

From CODEOWNERS

0

Global minimum
0

Max

1

1

1 if commit is unverified
0

Sum
1


Translate April 24 covid report to Dutch

Hello @nextstrain/dutch!
The situation report from 2020-04-24 is ready to be translated to Dutch. The report focuses on Africa. We chose this region this week as the outbreaks in African nations are very important to understand and do not seem to be getting a lot of press. Please translate the Twitter post below! It is a bummer when the translation is great, but people do not know that because I used Google translate for the Twitter post.
Branch to translate on: sit-rep_nl
File to translate: https://github.com/nextstrain/translations/blob/sit-rep_nl/narratives/translations_ncov_sit-rep_nl_2020-04-24.md You can translate directly in this file, but please remember to push often as other people may be working on the translation!
Link to preview: https://nextstrain.org/community/narratives/nextstrain/translations@sit-rep_nl/ncov/sit-rep/nl/2020-04-24
Twitter post to translate:
“We focus on Africa this week in our #COVID19 situation report. The report is now available in Dutch. Thank you @, @, and @ for the rapid translation."
Logistics
Please update the translations board as you work on the translation: https://github.com/orgs/nextstrain/projects/7
Please assign yourself to the translation if you’re working on it this week.
When a translation is ready for publication -- at minimum meaning two people have worked on it and both agree that it’s ready -- please create a pull request to merge to master and tag me and the issue in it!
Discussion board for your team is here: https://github.com/orgs/nextstrain/teams/dutch
Standard rules for translation:
Note that the file to translate is in Markdown. In general, it is important not to change any formatting or links. (Although it is okay to update Wikipedia or CDC links to the appropriate language version.) Comments to help with translation are noted in comment symbols like <! -- Comment -->.
Please add your name under translators: with new line, tab, and dash, formatted just like authors are. Please also add a link to your professional page (can use Twitter) under translatorLinks:.
Note: You may know of other great resources available in Dutch; please don’t add them to the situation report. We need to keep content the same across all translations, so we can be confident in the accuracy of what we publish. Thanks for understanding.
At minimum, I require two sets of eyes on every translation; one of those people should have a background in phylogenetics. Although if you have more, that’s fine too.
Feel free to use a live, online editor like hackmd (sign in with GitHub) to translate together.
Thank you all so, so much! :)

I've made a start! But am going to enjoy some sunlight now :)
Twitter post translation:
"We richten ons op Afrika deze week in ons #COVID19 situatie rapport. Het rapport is nu beschikbaar in het Nederlands. Met dank aan @, @ en @ voor de snelle vertaling."

I'm having a go at the 2nd half now.

Only one real struggle today:
On slide 10, the English text has: "we can't yet say which -- if any -- of these sparks resulted into local outbreaks" . Can't think of a good dutch translation for 'if any' here, I've settled for 'eventueel' but it's not quite the same.
Good luck to the reviewer(s) ! And apologies for any grammatical errors.

Just checking in -- can anyone review this? @nextstrain/dutch Thanks!

Yes, I'll have a bit of time at 11.30 this morning.

I think it's done!

Published and tweeted: https://nextstrain.org/narratives/ncov/sit-rep/nl/2020-04-24
Thank you, Jana & Jisca!


Added cve vulnerability in API scan display

Coverage decreased (-0.03%) to 40.202% when pulling 8ecb923f3225a31e4704d11963521bf0c3c628d1 on BlBana:origin/develop into 7ddc31e91208ae70247baf7dabff705d985108f7 on wufeifei:develop.


No access to mui built-in classes through styled api

When using the styled api, it appears to be impossible to override nested built-in classes of mui components.

[ x] The issue is present in the latest release.
[ x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯

Can't seem to override built-in nested classes with jss objects using the styled api like I can in withStyles or makeStyles.
Expected Behavior 🤔

A way to override built-in nested classes
Steps to Reproduce 🕹

https://codesandbox.io/s/material-demo-forked-h5xv6
Context 🔦

Using the styled api to override styles in built-in MUI components
Your Environment 🌎
https://codesandbox.io/s/material-demo-forked-h5xv6

Tech
Version

Material-UI
v5.?.?

React

Browser

TypeScript

etc.

Tip: use the global class names & .MuiButton-label.

If I'm migrating from non-styled components, is there documentation that tells me what global class name to used based on the given built-in class?

@mcchong The API page document the global classnames


Add support for multiple env files

Hi
We want to share some variables between the different environments and not repeat them (e.g. VERSION).
This PR treats ENVFILE as a comma delimited list of paths so we can specify EVNFILE=common,dev react-native run-android etc.
I've looked into the iOS implementation but seems it assumes a single .env file or a single /tmp/envfile, i.e. there is ENVFILE.
Would love your feedback, especially for iOS

HI @barakcoh! Thanks for the pull, this is interesting stuff.
Can you elaborate a bit on the examples? Any other variables you'd want shared?
I think this is a good addition if we don't make things any more complex/confusing. For instance, what happens if one of the files doesn't exist? Can you still specify just one file? What order they're applied? What happens when a variable is set on both files?
There is probably a good and consistent way to answer these questions, but it might take us some time to get there. This is why I suspect npm's dotenv doesn't support/recommend multiple env files.
Ruby's dotenv on the other hand does take overrides; it loads .env, then .env.staging (or prod/whatever), replacing any vars previously set. So essentially it still works with a single custom env file, but you can add shared stuff to .env. I like this approach, but will probably cause confusion/errors for people using rn config the way it is now.

Hi @pedro thanks for the feedback!
First and foremost, my change is backwards compatible so existing users should have no problem when upgrading in the future. The simple use-case of a single file remains exactly the same so no added complexity there.
Now, you've raised some excellent questions, allow to me to address them one by one:

What happens if one of the files doesn't exist?
You'd get an exception, much like if you now use a single file that doesn't exist. This is consistent w/ current behavior.

Can you still specify just one file?
Absolutely! use the exact same syntax of ENVFILE=myenvfile

What order they're applied?
The same order you've specified them which seems natural to me

What happens when a variable is set on both files?
Last file wins, which seems sensible but should be documented

I've worked with Ruby's dotenv in the past, and found the support for multiple files an absolute must. Repetition is a sure way to introduce bugs with bad Copy-Pasting and I'd love for everyone to enjoy the best experience working with react-native-config

ping?

Such a pity this wasn't accepted 🙁

Such a pity this wasn't accepted 🙁

Agreed, can we revive this?


How to configure the converter in laravel

Hi, i see you have a good html to pdf converter here,but cant really use it with Laravel. i installit well, but on use iget :PDFException in PDF.php line 146: PDF could not be created: "The system cannot find the path specified.\r\n" how so i configure executable path, and how doi even install it....no tutorial for this. Please Help<EMAIL_ADDRESS>

#13


RBAC authorization for non-admins

What happened:
I'm having issues with RBAC, granting the same access to my developers group I can only execute argo commands if using an admin account. Using a developer account, I have this problem:
argo submit --serviceaccount argo --namespace argo https://raw.githubusercontent.com/argoproj/argo/master/examples/artifact-passing.yaml
2018/02/08 15:47:05 Workflow manifest https://raw.githubusercontent.com/argoproj/argo/master/examples/artifact-passing.yaml failed submission: workflows.argoproj.io is forbidden: User "developers-staging" cannot create workflows.argoproj.io in the namespace "argo"
Couldn't find what kind of permissions I need to grant to my developers group. They can create/patch/update/get pods on the argo namespace. Tried a buch of different rules and still the same issue.
What you expected to happen:
This is what happens when I run the same command using an admin account.
argo submit --serviceaccount argo --namespace argo https://raw.githubusercontent.com/argoproj/argo/master/examples/artifact-passing.yaml
Name:             artifact-passing-4qx6v
Namespace:        argo
ServiceAccount:   argo
Status:           Pending
Created:          Thu Feb 08 15:51:55 -0800 (now)
How to reproduce it (as minimally and precisely as possible):
I created a separeted namespace called argo and service account argo, as I didn't want to grant too much permissions to default.
Everything works fine when I run commands as an administrator, but if I change my kubectl context to developers, no matter what permissions I grant, it still can't submit.
Environment:

Argo version:
argo: v2.0.0
BuildDate: 2018-02-06T21:39:43Z
GitCommit: 0978b9c61cb7435d31ef8d252b80e03708a70adc
GitTreeState: clean
GitTag: v2.0.0
GoVersion: go1.9.1
Compiler: gc
Platform: linux/amd64

Kubernetes version :
gitVersion: v1.8.4
goVersion: go1.8.3

CRDs permissions are no different than regular kubernetes resource and you will need to edit the RBAC rules for that role binding appropriately to create/delete/update/patch/etc... resources of type workflows.argoproj.io.

That was it. Perfectly

apiGroups: ["argoproj.io"]
resources: ["workflows"]
verbs: ["get", "list", "watch", "create", "update", "patch", "delete"]
Just added it to my role and it works now. I spent hours researching it I didn't see or notice how I could use it. Thank you so much @jessesuen

This helped me, too, thanks @nelsonfassis @jessesuen!


nixos installer tests fail

Describe the bug
https://hydra.nixos.org/build/125901359
To Reproduce
$ nix-build nixos/release-small.nix -A nixos.tests.installer.simple

machine: output:
Test "Perform the installation" failed with error: "command `nixos-install < /dev/null >&2` failed (exit code 1)"
error:
Traceback (most recent call last):
  File "/nix/store/bdfalnsmc6f6i8rm97j0rfk1wwgl6501-nixos-test-driver/bin/.nixos-test-driver-wrapped", line 897, in run_tests
    exec(tests, globals())
  File "<string>", line 1, in <module>
  File "<string>", line 50, in <module>
  File "/nix/store/bdfalnsmc6f6i8rm97j0rfk1wwgl6501-nixos-test-driver/bin/.nixos-test-driver-wrapped", line 421, in succeed
    raise Exception(
Exception: command `nixos-install < /dev/null >&2` failed (exit code 1)
cleaning up
killing machine (pid 6)
(0.00 seconds)

machine # building '/nix/store/7x9q5qdd27aljvvrnrvabb6h6b0sh082-01-fix-ftbfs-with-glibc-2.28.patch.drv'...
machine # warning: unable to download 'https://sources.debian.org/data/main/m/m4/1.4.18-2/debian/patches/01-fix-ftbfs-with-glibc-2.28.patch': Couldn't resolve host name (6); retrying in 323 ms
machine # warning: unable to download 'https://sources.debian.org/data/main/m/m4/1.4.18-2/debian/patches/01-fix-ftbfs-with-glibc-2.28.patch': Couldn't resolve host name (6); retrying in 575 ms
machine # warning: unable to download 'https://sources.debian.org/data/main/m/m4/1.4.18-2/debian/patches/01-fix-ftbfs-with-glibc-2.28.patch': Couldn't resolve host name (6); retrying in 1109 ms
machine # warning: unable to download 'https://sources.debian.org/data/main/m/m4/1.4.18-2/debian/patches/01-fix-ftbfs-with-glibc-2.28.patch': Couldn't resolve host name (6); retrying in 2442 ms
machine # error: unable to download 'https://sources.debian.org/data/main/m/m4/1.4.18-2/debian/patches/01-fix-ftbfs-with-glibc-2.28.patch': Couldn't resolve host name (6)
machine # builder for '/nix/store/7x9q5qdd27aljvvrnrvabb6h6b0sh082-01-fix-ftbfs-with-glibc-2.28.patch.drv' failed with exit code 1

the test does not have network access

The VM not having network access is not the real problem.  We occasionally get these errors on changes, but I can't remember the usual solution (how we ensure that the necessary dependencies are in store beforehand).

See https://github.com/Emantor/nixpkgs/commit/901de1173247b916f3575eb5ce1af5c417eda381.
Suppose the issue started already in 820a197b5fee32f946f7cfba2010ce28c8d07a4f.
Not being able to fetch patches because an installer test depends on it is not very convenient.

Note that installer shouldn't need the patch.  It should have binary gnum4 already (if it needs it).

Yes, looking at the discussion in https://github.com/NixOS/nixpkgs/commit/43e30b1eadac5f86fe6f91b13ebcace88bf8a597, we'll need to find the necessary extraDepenencies for the installer VM.

By looking at the log, I expect we're missing lvm2.override { udev = null; }

By looking at the log, I expect we're missing lvm2.override { udev = null; }

Bingo, I'll create a PR.

Thanks.  I now also tried the other two failed unstable-small tests, successfully.


Added an optional css class to the x/y axes

This is my first PR! 🙂
Related. https://github.com/observablehq/plot/issues/6
This PR introduces optional CSS classes for the x and y axes.
Plot.plot({
    x: {
      axisClass: true
    },
    y: {
      axisClass: true
});

If axisClass is not defined or is false, then no CSS classes get added to the plot. I kind of like the current clean tree of attributes that Plot creates by default. So I considered maintaining this and only adding CSS classes for axes if specifically opted in.
If axisClass has been defined then it inserts the following classes. Note: Only the classes for the y-axis are shown below, but it's exactly the same for the x-axis if CSS classes are enabled.
<g class="y-axis" aria-label="y-axis" aria-description="↑ Close" transform="translate(40,0)" fill="none" text-anchor="end" font-variant="tabular-nums">
  <g class="tick" opacity="1" transform="translate(0,358.4133255882662)"><line stroke="currentColor" x2="-6"></line><line stroke="currentColor" x2="580" stroke-opacity="0.1"></line><text fill="currentColor" x="-9" dy="0.32em">60</text></g>

  ...

  <text class="y-axis-label" fill="currentColor" font-variant="normal" transform="translate(-40,20)" dy="-1em" text-anchor="start">↑ Close</text>
</g>

FYI - I've not added any docs for this PR yet. If it looks like it will be accepted then I'll update it of course.

Thanks for the contribution. I'm closing because we're probably going to revisit axes to change them to marks (see #1000), and we're also thinking about a generic className option that one could use on any mark (see #253, which would have to be rewritten as a "common option"). These two large generic changes would end up solving this.


Docs: Add google tag manager

Description

Added the cookies management using TarteAuCitron
Added the custom scripts and custom CSS
Added a page in the doc to handle the cookies once the first interaction is made.
Generated the hash using https://www.srihash.org/

What needs to be reviewed at least

[x] The Cookies panel is visible (make sure to not use Firefox)
[x] Make sure the cookies are fine
[x] The Panel can be accessed from somewhere inside the website
[x] Define what to put inside the Cookies page
[x] Make sure the changes in main.html aren't breaking
[x] Make sure there no reference to ods-android

Apart from the formatting of docs/_includes/tarteaucitron.html, this PR LGTM! Good job @louismaximepiton. The content is the same as the one validated in ODS Android. I let the maintainers give you more info about the CI error with GitLeaks which seems to be a configuration error (upstream or maybe to do in your fork 🤷)

Indeed I defined a GItleaks action so as to look for secrets leaks in PR and repository. This feature is absed on a licence for organisations like ours. It seems the check is run in the fork side, not ours, that is the reason why it failed because of missing license.
After code review, nothing found, LGTM.
For text time, you should create a dedicated issue to as to trace these contributions.


added space to separate 2 words that otherwise appear joined

Error message 222147 does not have a space between the word "queue" and the actual queue name. this simple PR fixes that.
I noticed other small opportunities for improvement with the messages:

there are 3(!) spellings of cannot/can not/can't. none of then wrong, just inconsistent;
some message are a full sentence and still do not start with a capital;
the last sentence does not always end with '.' when there are multiple sentences in the message. (and how should a single sentence end?);
a few messages have multiple consecutive spaces;
some messages have leading/trailing spaces.

shall I change (some/all) of these in a next PR?

thanks!


Video Play Count

While using media_info_v1 we get a view_count but is it possible to also get the play_count ? It is the count visible on all reels to users on Instagram.

@skords added to 1.16.32


[Misc] Logging in as a local user when federated login is enabled

In our first deployment of SW we used local users only. We then added Google as an IdP and redeployed SW. When I navigate to the CloudFront URL I now see a "Login" button which takes me to the Google login flow (previously there was a username and password box). My question is - with an IdP configured is it still possible to login as local user? I want to be able to login to SW as a local user so I can add federated users, but this is not currently possible. Am I missing something?

Release Version installed [e.g. v4.0.2]

Hi @liamcoatman, after adding an IdP, the internal auth will be available at this URL: <cloudfront URL>/internal.

Thanks for the suggestion, but <cloudfront URL>/internal and indeed <cloudfront URL>/any string all redirect me to the same screen with the "Login" button that starts the IdP login flow.

Hi @liamcoatman, the correct URL to visit internal login page is this: <cloudfront URL>/?internal (notice the question mark)

Thanks @SanketD92. This solves my problem.


possible race condition: (sqlite3.IntegrityError) UNIQUE constraint failed: tokens.repo

DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): api.github.com:443
DEBUG:urllib3.connectionpool:https://api.github.com:443 "POST /app/installations/11261676/access_tokens HTTP/1.1" 201 229
ERROR:tokman.app:Exception on /api/admdev8/tickgit [GET]
Traceback (most recent call last):
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context
    self.dialect.do_execute(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)

sqlite3.IntegrityError: UNIQUE constraint failed: tokens.repo
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/flask/app.py", line 1820, in full_dispatch_request
    rv = self.dispatch_request()
File "/usr/lib/python3.11/site-packages/flask/app.py", line 1796, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
File "/usr/lib/python3.11/site-packages/flask_restx/api.py", line 405, in wrapper
    resp = resource(*args, **kwargs)
File "/usr/lib/python3.11/site-packages/flask/views.py", line 107, in view
    return current_app.ensure_sync(self.dispatch_request)(**kwargs)
File "/usr/lib/python3.11/site-packages/flask_restx/resource.py", line 46, in dispatch_request
    resp = meth(*args, **kwargs)
File "/tokman/tokman/app.py", line 118, in get
    db.session.commit()
File "<string>", line 2, in commit
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 1451, in commit
    self._transaction.commit(_to_root=self.future)
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 829, in commit
    self._prepare_impl()
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl
    self.session.flush()
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 3444, in flush
    self._flush(objects)
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 3583, in _flush
    with util.safe_reraise():
File "/usr/lib64/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__
    compat.raise_(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/session.py", line 3544, in _flush
    flush_context.execute()
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute
    rec.execute(self)
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute
    util.preloaded.orm_persistence.save_obj(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj
    _emit_insert_statements(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements
    result = connection._execute_20(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20
    return meth(self, args_10style, kwargs_10style, execution_options)
File "/usr/lib64/python3.11/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection
    return connection._execute_clauseelement(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement
    ret = self._execute_context(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context
    self._handle_dbapi_exception(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 2124, in _handle_dbapi_exception
    util.raise_(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context
    self.dialect.do_execute(
File "/usr/lib64/python3.11/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)

sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) UNIQUE constraint failed: tokens.repo
[SQL: INSERT INTO tokens (repo, token, expires_at) VALUES (?, ?, ?)]
[parameters: ('admdev8/tickgit', 'ghs_XXXXXXXXX', '2023-02-25 01:46:20.000000')]

https://red-hat-it.sentry.io/issues/3556205037/?query=is%3Aunresolved&referrer=issue-stream
https://red-hat-it.sentry.io/issues/3952931168/?query=is%3Aunresolved&referrer=issue-stream

:facepalm:
Thanks! Nice catch! This means it can and will happen... I guess I'll need to reconfigure tokman to use a single worker. Any better idea?

Could we in theory utilize SQL transactions and make it work with 2 workers?

We already do that, I think... but even that wouldn't help. The error is triggered, b/c the repo name is expected to be unique in the DB so that we don't allow duplicate to tokens. The issue is that by the time this error occurred a new token was already requested, and the previous one is invalidated by this—at least this is how it worked in the past. I could check if GitHub changed behaviour since then.

Hm, interesting. Could we also make the repo name not unique and return the latest issued token?

We could, but than there would be very little benefit in running tokman, as workers could still end up trying to use invalid tokens, and ending up with failed GitHub requests.

Adding discuss label so we can come up with next steps here. Scaling down to a single worker sounds like the best short term solution.

It turns out that the GitHub API behaviour tokman was ment to work around is no longer a thing :smile: Tokens seems to stay valid, even after a new token was requested for the same installation.
So yeah, let's discuss what to do with this.

whaaaaaat, very nice!


add maintainer to travis-yml plugin

hello I am adding myself to get maintaining and push permissions for the travis-yml plugin , @masaki is on the loop, and I have been already added as contributor on his repository

@masaki Could you please confirm? Thanks.

This looks like the wrong repo, it even links to the jenkinsci one in the description…?

what do you mean with the wrong repo?

@daniel-beck
I confirmed, co-maint with @kanekotic the travis-yml-plugin.
And, correct repo is https://github.com/jenkinsci/travis-yml-plugin ?
Thanks.

@masaki Thanks.
We strongly prefer plugins be maintained in the jenkinsci organization so we can provide continuity in the case of maintainers moving on. See e.g.:
https://wiki.jenkins-ci.org/display/JENKINS/Governance+Document#GovernanceDocument-Plugins
https://wiki.jenkins-ci.org/display/JENKINS/Pull+Request+to+Repositories
Note that we've since become a bit stricter wrt granting commit access to anyone who asks, and e.g. require that maintainers be directly contacted (and we wait for longer than a week).

ok so in the case now that I will help maintain the project, do I have the rights to accepts PR and close issues on the jenkins ci repo? (https://github.com/jenkinsci/travis-yml-plugin)
or how should I request that?

@kanekotic You just did, and you should have an invitation into the jenkinsci organization in your email inbox.

thanks a lot @daniel-beck

@daniel-beck @kanekotic Thanks a lot!


Confusion over embedded statement difference between C/C++ and C#

[Enter feedback here]
Referring to this article:
https://docs.microsoft.com/en-us/dotnet/csharp/misc/cs1023
A suggested resolution to the problem is missing. For example:
bool myBool = true;
if (myBool)
int myInt = 3;
CS1023 can be resolved by adding braces (there may be other solutions):
bool myBool = false;
if (myBool)
{
int myInt = 3;
}
Optionally, a link to some rational behind why C# is different to C/C++ in this case would be interesting/helpful. In Visual 2019 Pro, targeting C++ 17, the following both work in C++, but both generate CS1023 in C#:
// Works in C++
bool myBool = false;
if (myBool)
int myInt = 3;
// Also works in C++
bool myBool = false;
int i = 0;
if (myBool)
xx : i++;

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 48795ddf-4f37-4701-d472-c685f8c8ca18
Version Independent ID: e37f6a77-3727-f165-c311-2a2d20fc58cb
Content: Compiler Error CS1023
Content Source: docs/csharp/misc/cs1023.md
Product: dotnet-csharp
Technology: csharp-diagnostics
GitHub Login: @BillWagner
Microsoft Alias: wiwagn

That's a good comment @abdekker
I'll keep this open to consider when we update the compiler warnings and errors section.


Enable skipped celery test again

Problem Statement
During refactoring of our test suite to run it in parallel on all cpu cores, one test could not run. So I deactivated the test test_redis_backend_trace_propagation.
Solution Brainstorm
Reactivate the test and make it run in the new test suite.

Tests are ok now, so I am closing this for now.


past_key_values=past_key_values

Hi, I found in the official huggingface documentation that this “past_key_values=past_key_values” parameter is only useful for accelerating precompute. Can you please explain which is p-tuning v2, prefix or prompt?
Why do I think Deep Prompt Tuning is --prompt instead of --prefix?
Thank you for your code contributions.

Hi,
You need to understand how past_key_values really functions in the attention computation, which is an implementation trick we inherit from prefix tuning. --prefix does refer to deep prompt tuning, and --prompt refer to prompt tuning.


Index property management

A lot of breaking changes here:

Changes DeclaredPropertyManager to DeclaredProperties
Prevents users from setting both an exact index and unique constraint. It covers options given to properties as well as the index and constraint methods and combinations thereof.
Removes the optional arguments to index that would allow you to use that method to set constraints.
Replaces all calls to on_session_available with on_next_session_available, per change in Neo4j-core.

Non-breaking changes:

Some convenience methods to get your hands on declared property information. MyModel.declared_properties[key], .declared_properties.each, and a few others.
DeclaredProperty instances have a few methods to get and set indexing/constraint info. Note that these methods do not actually set properties in the database, you should use the class methods on the ActiveNode models for that.
I moved all of ActiveNode's index-related code into an Indexing module.

Fixes:

Properties are now properly declared when inheriting. MySubclass.declared_properties will include properties from the parent.

To-do:

This could use some DRY help. I'm still in my "just-make-it-work" first round.
I might rework Neo4j-core's Label class. The API for index and constraints is more complicated than it needs to be, which leads to a lot of the complication in our Indexing module. The methods to add or remove indexes and constraints should be able to share code but the Neo4j-core APIs are juuuust different enough that they can't.

Travis will fail until https://github.com/neo4jrb/neo4j-core/pull/226 is merged in. This branch references my local paths at the moment and is not ready for merge.

This is mostly good but I want to write a few more tests to cover the new APIs directly. I also want to run it through its paces with some of my local apps. There might be a bug, too... It's still possible to set an index through an option to property and then call the constraint class method. Just need to add a check to prevent that.
I'm happy with this overall, though. It removes a lot of responsibility from ActiveNode.