[SYSTEMML-1563] Adding a distributed synchronous SGD MNIST LeNet example.

In order to exploit a multi-GPU setup, this implements synchronous
distributed SGD.  More specifically, this (1) sets the degree of
parallelism (hardcoded for now), (2) adjusts the inner for loop
(previously for iterations) to extract out groups of mini-batches,
where the number of mini-batches is equal to the degree of parallelism,
(3) adds an inner parfor to parallelize the computation of gradients
over a group of mini-batches (i.e. one mini-batch per GPU) and store
the gradients, and (4) updates the model after the parfor loop using
the aggregated (averaged) gradients.
To run, follow the instructions here.
Reference:

https://arxiv.org/abs/1604.00981

cc @nakul02

cc @nakul02 I updated these scripts based on some API changes I made.  You'll need the updated nn library as well, which this PR branch contains.

cc @nakul02 I renamed the new files to reflect that they are not necessarily tied to GPUs, but rather are tied any distributed runtime.

I'll update my scripts accordingly.
Is the plan to merge these in or to keep them in this PR?

Well, I'm thinking about merging them in once we have a rough idea of whether or not it's properly exploiting a distributed runtime.  For now, I'll leave them in this PR though.

Build failed, see build log for details

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder//job/SystemML-PullRequestBuilder/1370/

@akchinSTC I see the link is going to https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder//job/SystemML-PullRequestBuilder/1370/ instead of https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1370/

Build successful

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1371/

@nakul02 I've added a new mnist_lenet_distrib_sgd-train-dummy-data.dml training file that uses generated dummy data.  Please see the comments at the top of the file for the info, but essentially you can control the number of examples (train, val, test), image size (height, width, channels), number of target labels, batch size, number of parallel batches (i.e. number of GPUs), number of and epochs (i.e. full passes over the entire dataset).  They all have sensible defaults.
It can be run from within the examples folder with the following command:
spark-submit --master local[*] --driver-memory 10G --conf spark.driver.maxResultSize=0 --conf spark.rpc.message.maxSize=128 $SYSTEMML_HOME/target/SystemML.jar -f mnist_lenet_distrib_sgd-train-dummy-data.dml -nvargs N=1024 Nval=512 Ntest=512 C=1 Hin=28 Win=28 K=10 batch_size=32 parallel_batches=8 epochs=10 out_dir=model/mnist_lenet

Thanks @dusenberrymw, will try this out for testing of the GPU parfor.

@nakul02 I've rebased the code onto master and made a few updates.  Can you please try this?

Build successful

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1385/

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1388/

Build successful

@akchinSTC  could we please disable these redundant build messages or restrict them to a single comment for failed builds?

@akchinSTC @mboehm7 I really like having the build results displayed (for both passing and failing) on the PR page. But perhaps the two messages "Build successful" and "Refer to this link..." could be consolidated into a single message.

@nakul02 Have you been able to successfully run this?  It would be good to merge if it is able to target multi-GPU.

It seems to be a bit unstable with GPU. Let me debug these and let you know.

Is it unstable only with GPU, or on the cluster as well?

It's just slow on the cluster, and doesn't always invoke an actual remote parfor.  I think it would be good to go ahead and merge this and use it as an example while we're pushing the engine forward.

LGTM :+1:


Only the hz=125 is suitable for the /joint_speed

when I use the /joint_speed to control the robot, if I set the hz=125, it works well.
However, hz=125 is a such high frequency, and it is easy to lead to unstable if my program need do many works with many threads.
I think hz=20 is enough, but how can I adjust the frequency with the ur_modern_driver?
I have tried to replace the arguments in the files (replace 125 with 20, and replace 0.008 with 0.05), but it seems not work.

#!/usr/bin/env python

import rospy
from std_msgs.msg import String

from trajectory_msgs.msg import JointTrajectory
from trajectory_msgs.msg import JointTrajectoryPoint

import numpy as np

def talker():
    pub = rospy.Publisher('/ur_driver/joint_speed', JointTrajectory, queue_size=10)

    rospy.init_node('talker_hz125', anonymous=True)
    rate = rospy.Rate(125)

    qvel = [0, 0, 0, 0, 0, 0]

    i_seq = 0

    while not rospy.is_shutdown():

        for i in range(6):
            qvel[i] += (np.random.rand()-0.5)*2* 0.01

        trajectory = JointTrajectory()
        trajectory.joint_names = ['elbow_joint', 'shoulder_lift_joint', 'shoulder_pan_joint', 'wrist_1_joint', 'wrist_2_joint', 'wrist_3_joint']

        current_time = rospy.Time.now()
        trajectory.header.seq = i_seq
        i_seq += 1

        trajectory.header.stamp = current_time
        trajectory.points = [JointTrajectoryPoint(velocities=qvel)]
        pub.publish(trajectory)

        rate.sleep()

if __name__ == '__main__':
    try:
        talker()
    except rospy.ROSInterruptException:
        pass

Can you say something about how you resolved this?

I have solved this problem with the help of multi process.
Here are my codes:
#!/usr/bin/env python

from multiprocessing import Process, Queue
import os, time, random

import rospy
from std_msgs.msg import String

import numpy as np

from trajectory_msgs.msg import JointTrajectory
from trajectory_msgs.msg import JointTrajectoryPoint

import threading
import time

import numpy as np

qvel_global = [0, 0, 0, 0, 0, 0]
mutex = threading.Lock()

def talker_4():

    try:

        pub = rospy.Publisher('/ur_driver/joint_speed', JointTrajectory, queue_size=10)

        rate = rospy.Rate(125)

        qvel = [0, 0, 0, 0, 0, 0]

        i_seq = 0

        global qvel_global, mutex

        trajectory = JointTrajectory()

        trajectory.joint_names = ['elbow_joint', 'shoulder_lift_joint', 'shoulder_pan_joint', 'wrist_1_joint', 'wrist_2_joint', 'wrist_3_joint']

        while not rospy.is_shutdown():

            if mutex.acquire():
                qvel = qvel_global
                mutex.release()

            trajectory.header.seq = i_seq
            i_seq += 1

            current_time = rospy.Time.now()
            trajectory.header.stamp = current_time

            trajectory.points = [JointTrajectoryPoint(velocities=qvel)]
            pub.publish(trajectory)

            rate.sleep()

    except rospy.ROSInterruptException:
        pass

def talker_4_process(q):

    global qvel_global, mutex

    rospy.init_node('talker_4_process', anonymous=True)
    threading.Thread( target = talker_4 ).start()

    try:

        rate = rospy.Rate(20)

        while not rospy.is_shutdown():

            qvel_data = q.get(True)

            if mutex.acquire():
                qvel_global = qvel_data
                mutex.release()

            rate.sleep()

    except rospy.ROSInterruptException:
        pass

def ink_control(q):

    rospy.init_node('ink_control', anonymous=True)

    rate = rospy.Rate(10)

    qvel_data = [0]*6

    while 1:

        ink = 0
        for i in range(1000):
            ink += 1

        for i in range(6):
            qvel_data[i] += (np.random.rand()-0.5)*2* 0.01

        q.put( qvel_data )

        rate.sleep()

if __name__=='__main__':
    q = Queue()
    p_talker_4 = Process(target=talker_4_process, args=(q,))
    p_ink_control = Process(target=ink_control, args=(q,))
    p_talker_4.start()
    p_ink_control.start()


Is it possible to run the Custom OP on CPU with TFLite?

Coral team, thank you for the great example.
We are working on an open source project that allows users to take advantage of EdgeTPU when available. Otherwise inference falls back to the CPU.
The README for this PoseNet example states that the CustomOP is embedded in the graph itself. Does that mean EdgeTPU knows how to resolve the CustomOp reference in the graph and execute it?
Trying to run the graph on TFLite on CPU without EdgeTPU produces the following error, which is a known limitation of TFLite:
def AllocateTensors(self):
>       return _interpreter_wrapper.InterpreterWrapper_AllocateTensors(self)
E       RuntimeError: Encountered unresolved custom op: PosenetDecoderOp.Node number 32 (PosenetDecoderOp) failed to prepare.

Is there a way to help TFLite resolve the CustomOp reference in the graph or that's an EdgeTPU feature only?
Looks like one way to inform TFLite of custom ops is to rebuild it from source. However that requires the CustomOp implementation to be available at build time.
Any guidance would be appreciated.
Thank you,
Ivelin

@ivelin I have gone through precisely this a while back and am trying to update the implementation currently. I will do my best to provide what I did.

Does that mean EdgeTPU knows how to resolve the CustomOp reference in the graph and execute it?

Not quite, at least not as far as I can tell. It appears to be provided by the EdgeTPU library.

Is there a way to help TFLite resolve the CustomOp reference in the graph or that's an EdgeTPU feature only?

I was previously unable to find a way.

Looks like one way to inform TFLite of custom ops is to rebuild it from source. However that requires the CustomOp implementation to be available at build time.

Correct. Fortunately, it is. As I mentioned above, it appears to be part of the Edge TPU library. I simply build this code into my binary. You can find the op here: https://github.com/google-coral/edgetpu/blob/master/src/cpp/posenet/posenet_decoder_op.cc
Related code that is likely to be needed as well is available there as well. I have successfully used this in CPU only on Linux. I am working on a build for Windows. I am not fond of the Bazel build system, particularly because for whatever reason tensorflow does not use up to date versions of Bazel and building on Windows is not easy. Frankly neither is building on Linux but there is at least the Docker image available there.

@jwoolston thank you for sharing your experience so far. It will help with our fall detection PR.
And thanks for the pointer to the customop source. I was hoping we can avoid building tflite from scratch and can just reference the customop binary. Just like you said, building with Bazel is an adventure. I've contributed to TFIO some time ago and went through the whole immersive build experience :)
Maybe we can get some guidance from the TFLite team on a way to implement runtime customop resolution.
In the meanwhile I will keep an eye for your updates. You may also have already noticed these [1 , 2] alternative implementations that don't use customop but are probably not as computationally efficient.

I had not seen those. In my case I specifically need access via the Java API (either full TF or Lite). Since I find the bazel build of tensorflow to basically be impossible outside there docker image, I am working on a minimal CMake project that can build it as part of my JNI library. I am however extremely interested in option 1 you presented as I spent a lot of time the first time around trying to find a way to use the JS models since most of the published hub models are for JS. My understanding was that there was no tool to do that but it seems based on that repo that assessment was either incorrect or outdated. Have you had any success there?

@ivelin I should add, I dont believe computational efficiency has anything to do with it. The custom op in question here is decoding the output tensor of the network into the "pose" data. For whatever reason the edge TPU version defines an operation for it while the Android TFLite, Python and JS versions of the models I found all seem to output the raw data directly to be interpreted by the consumer. I presume you are familiar with https://medium.com/tensorflow/real-time-human-pose-estimation-in-the-browser-with-tensorflow-js-7dd0bc881cd5. The custom op is essentially responsible for parsing the network output and doing the heatmap/offset/vector calculations to find the keypoints. Note that some of the terminology varies between implementations but the previously linked C++ implementation appears to follow the paper's nomenclature.

@jwoolston

Have you had any success there?
Not yet. Still working on adapting the code to tflite runtime.

computational efficiency

You may be correct. I was referring to @rwightman 's comments in his readme that decoding speed impacts significantly (10x) overall performance. He says:

I first adapted the JS code more or less verbatim and found the performance was low so made some vectorized numpy/scipy version of a few key functions (named _fast).

The base MobileNet models have a throughput of 200-300 fps on a GTX 1080 Ti (or better)
The multi-pose post processing code brings this rate down significantly. With a fast CPU and a GTX 1080+:
A literal translation of the JS post processing code dropped performance to approx 30fps
My 'fast' post processing results in 90-110fps

@ivelin Thanks for the info. Unfortunately for me the Java API's method of resolving a custom op requires it to be implemented in native code. The interface literally defines a method to get a native object. I suppose since TF is C++ at the end of the day, regardless of the API used, that this is unavoidable. If you are able to adapt that to tflite It might provide a way to avoid the C++ because it would be invoking the built in ops directly while also using the JS model which brings some other benefits as well. For that matter, the whole process opens up a new avenue that I had presumed was closed. Please let me know how the porting goes.

@ivelin I have gone through precisely this a while back and am trying to update the implementation currently. I will do my best to provide what I did.

Does that mean EdgeTPU knows how to resolve the CustomOp reference in the graph and execute it?

Not quite, at least not as far as I can tell. It appears to be provided by the EdgeTPU library.

Is there a way to help TFLite resolve the CustomOp reference in the graph or that's an EdgeTPU feature only?

I was previously unable to find a way.

Looks like one way to inform TFLite of custom ops is to rebuild it from source. However that requires the CustomOp implementation to be available at build time.

Correct. Fortunately, it is. As I mentioned above, it appears to be part of the Edge TPU library. I simply build this code into my binary. You can find the op here: https://github.com/google-coral/edgetpu/blob/master/src/cpp/posenet/posenet_decoder_op.cc
Related code that is likely to be needed as well is available there as well. I have successfully used this in CPU only on Linux. I am working on a build for Windows. I am not fond of the Bazel build system, particularly because for whatever reason tensorflow does not use up to date versions of Bazel and building on Windows is not easy. Frankly neither is building on Linux but there is at least the Docker image available there.

Hello jwoolston! I'm trying to do the same right now but I'm facing the next problem:
AttributeError: 'Delegate' object has no attribute '_library' (decoder) [ec2-user@ip-172-31-5-112 mobilenet]$ vim run_model.py (decoder) [ec2-user@ip-172-31-5-112 mobilenet]$ python run_model.py }Traceback (most recent call last):   File "run_model.py", line 3, in <module>     tpu= tflite.load_delegate('libedgetpu.so.1')   File "/home/ec2-user/decoder/lib/python3.7/site-packages/tflite_runtime/interpreter.py", line 166, in load_delegate     delegate = Delegate(library, options)   File "/home/ec2-user/decoder/lib/python3.7/site-packages/tflite_runtime/interpreter.py", line 90, in __init__     self._library = ctypes.pydll.LoadLibrary(library)   File "/usr/local/lib/python3.7/ctypes/__init__.py", line 442, in LoadLibrary     return self._dlltype(name)   File "/usr/local/lib/python3.7/ctypes/__init__.py", line 364, in __init__     self._handle = _dlopen(self._name, mode) OSError: libedgetpu.so.1: cannot open shared object file: No such file or directory Exception ignored in: <function Delegate.__del__ at 0x7fa6194d70e0> Traceback (most recent call last):   File "/home/ec2-user/decoder/lib/python3.7/site-packages/tflite_runtime/interpreter.py", line 125, in __del__     if self._library is not None: AttributeError: 'Delegate' object has no attribute '_library'


Mainwindow app

towards an extensible mainwindow application base.  next steps will be to use this base to implement the drake-visualizer and director applications.


Contributing in cpp codechef "The Block Game". Please assign it to me

Please assign this task to me. As I am a 5 star coder at codechef - Userhandle(yati1103). I can do it for sure.


Support enabling other Alloy components which mount files

I'm set up with k8s-monitoring in Grafana Cloud and it's working well, great job team 👐. Next I'd like to use other components from the Alloy deployed by this chart, so I don't have to manage a separate instance.
Is that something you support / recommend? If not, stop here and close this issue. 😁
Ok!
For that I was thinking I'd use this config settting
https://github.com/grafana/k8s-monitoring-helm/blob/388adca46e3fa8ff5ebcd90888549349ff07673a/charts/k8s-monitoring/values.yaml#L1974-L1979
The component I'm interested in right now is prometheus.exporter.snmp. As you can see on those docs, I need to supply a path to a config file. I can't find a way to do this in the chart as it stands now.
Would you consider providing a way for me to give either file contents / path pairs inline, which get mounted into the pod, or perhaps references to config maps which get volume mounted?

Yes totally. They seem to essentially be the same case but with different paths.

I'm facing the same situation. I need to load a yaml file for blackbox exporter for monitor websites but I don't find How i can mount a config map in the helm chart


Convert JS to TS (commits 7-13 of PR435) - attempt#2

Supersedes #557. Added a commit that should fix bug in disputes.

The bugs should be fixed now, but I haven't tested.

Hola@webwarrior-ws @Mersho Cuando el administrador va a tomar una disputa aparece este error en los registros:
[2024-09-04T10:09:59.680-04:00] error: Community was not found in DB Error: Community was not found in DB
    at /home/catry/bot/bot/validations.js:208:27
    at step (/home/catry/bot/bot/validations.js:56:23)
    at Object.next (/home/catry/bot/bot/validations.js:37:53)
    at fulfilled (/home/catry/bot/bot/validations.js:28:58)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

This error has already been solved

Al enviar una factura para recibir, siempre devuelve este error al comprador:Invoice expiry is too short

@webwarrior-ws @Mersho That error is still there, it always says Invoice expiry is too short but if I change to or any other branch and put the same invoice it accepts it without problem

I tried with my test setup and could not reproduce this bug.

Added some debug logging. Maybe that will help with identifying the problem.

Added some debug logging. Maybe that will help with identifying the problem.

Well, the bot did not show the wizard_add_invoice_init message and this error appeared:
[2024-09-09T09:49:10.191-04:00] error: All promises were rejected AggregateError: All promises were rejected
But I knew it was 500 sats so I put the invoice and this appears:
Date(invoice.expires_at) = Mon Sep 09 2024 10:49:28 GMT-0400 (hora de verano de Cuba)
latestDate = Mon Sep 09 2024 10:49:47 GMT-0400 (hora de verano de Cuba)
INVOICE_EXPIRATION_WINDOW = 3600000

I don't see any bug in lnp2pBot code here. Invoice expires less than INVOICE_EXPIRATION_WINDOW (1 hour) from time of running, and that results in error.
I don't know why main branch doesn't result in error in the same scenario. Maybe this code never worked as intended? I noticed that in original code, Date is compared to string.

Maybe this code never worked as intended? I noticed that in original code, Date is compared to string.

Looks like we need @grunch's input here?

@grunch I have tried to reproduce the bug, but I can't take a dispute - when I click on "Take dispute" button I get a message "You have been banned!". As I only have 2 telegram accounts, solver user is one of the participants, maybe that's the issue?

Me and @knocte managed to take and resolve dispute in community. That error looks like contents of some variable is not escaped properly. I've seen a commit in main that adds escaping. I rebased this branch. Maybe this will also solve the bug. If not, I added a commit that dumps contents of the problematic message into console.

@grunch I have tried to reproduce the bug, but I can't take a dispute - when I click on "Take dispute" button I get a message "You have been banned!". As I only have 2 telegram accounts, solver user is one of the participants, maybe that's the issue?

Yes, we ban users after being involved on n disputes, I think that restriction is not useful and we should remove it in the future, but to continue just remove the ban on the document for that user, change field banned to false, then try again

change field banned to false, then try again

Francisco, that is old info. After webwarrior wrote that message, I assisted him in his testing, being the 3rd user in his setup (the solver, in particular), and he couldn't reproduce the issue. See https://github.com/lnp2pBot/bot/pull/585#issuecomment-2346186472 , and test again with the new logs added please.

@grunch I have tried to reproduce the bug, but I can't take a dispute - when I click on "Take dispute" button I get a message "You have been banned!". As I only have 2 telegram accounts, solver user is one of the participants, maybe that's the issue?

Hi @webwarrior-ws sorry for the delay, are you able to run the bot in this branch? I'm testing and I'm getting this errors
[2024-09-16T17:22:26.672-03:00] error: ResubcribeInvoice catch: 503,UnexpectedGetInvoicesError,[object Object]
[2024-09-16T17:23:00.027-03:00] error: 503,FailedToConnectToDaemon
[2024-09-16T17:23:00.028-03:00] error: node info catch error: TypeError: Cannot read properties of undefined (reading 'is_synced_to_chain')
[2024-09-16T17:24:00.022-03:00] error: 503,FailedToConnectToDaemon
[2024-09-16T17:24:00.022-03:00] error: node info catch error: TypeError: Cannot read properties of undefined (reading 'is_synced_to_chain')

I that we are having conflics, can you solve them and we can try again?

@grunch I've rebased PR branch and there are no merge conflicts now. I've also tested it with standard sell/buy procedure and got no 503 errors that you have mentioned.

@grunch applied your patch, updated locales and disputes test

@grunch applied your patch, updated locales and disputes test

great job, thanks for this contribution, as we are receiving some donations we want to give back some sats to our contributors, it's more of a symbolic gesture of gratitude 😃
Please add as a comment a lightning invoice with amount of 200,000 sats

lnbc2m1pn0dtz0pp5ru28d55mfjw2aypjvsu7xnd5uj7363mz095slnwmca05mcequ9nscqpjsp5vuprh07ze5nk2k6rhx7zjy67axfqmsej9gmt6a7zudhsy7ej8zas9q7sqqqqqqqqqqqqqqqqqqqsqqqqqysgqdqqmqz9gxqyjw5qrzjqwryaup9lh50kkranzgcdnn2fgvx390wgj5jd07rwr3vxeje0glcll6lyxlsu4fuhqqqqqlgqqqqqeqqjqu7s52ap9967fnyvqc9nphcccsqpl3txa679zpzw2f0h6gwqhex7qwf5y2eywlmd5wyjx9e7k5ckn2luml34c304mtyuze87zy5mkfdgpmqngrw

lnbc2m1pn0dtz0pp5ru28d55mfjw2aypjvsu7xnd5uj7363mz095slnwmca05mcequ9nscqpjsp5vuprh07ze5nk2k6rhx7zjy67axfqmsej9gmt6a7zudhsy7ej8zas9q7sqqqqqqqqqqqqqqqqqqqsqqqqqysgqdqqmqz9gxqyjw5qrzjqwryaup9lh50kkranzgcdnn2fgvx390wgj5jd07rwr3vxeje0glcll6lyxlsu4fuhqqqqqlgqqqqqeqqjqu7s52ap9967fnyvqc9nphcccsqpl3txa679zpzw2f0h6gwqhex7qwf5y2eywlmd5wyjx9e7k5ckn2luml34c304mtyuze87zy5mkfdgpmqngrw

Payment hash:   1f1476d29b4c9cae90326439e34db4e4bd1d476279690fcddbc75f4de320e167
Payment status: SUCCEEDED, preimage: ed4600e227269b6d29068d1b7eb51e8bd77f9137b94e334e6bcb561b5ffcc7cf


Typescript declarations

Hi. I want to write typescript types declarations for this library and could you please help me to plan how to do it. Does it's worth to cover version 1.4 or wait for version 2.0 and make types for its?

We've spoken about that in #250: we're not users of typescript ourselves and couldn't maintain these declarations.
I advise you to focus on next, and write the types as standalone files.

Thanks. I'll start writing types for next and post them in DefinitelyTyped

Hi @in19farkt, did you start writing types file or not yet ? I didn't see types package for this project on DefinitelyTyped

Yes, I started writing types, but it's hard and time-consuming. The draft version can be viewed here. I did not make changes for a long time, because I copied these types into the project so that it was easier to change them.

I think you started to use typescript, right @fzaninotto ?
Are you planning to ship types for react-admin now?

We'll ship them when they are ready and complete.

@fzaninotto Please re-open this issue. There are multiple issues about TypeScript definitions, but none are open (that I could find). One should be open until the issue is actually resolved, otherwise people will keep opening new ones. So I suggest you reopen this one so that we may continue to discuss this topic here.
I'd like to explain a bit TS history, has you stated you're not familiar with it (in 2018).
DefinitelyTyped is the reference of TS typings, and it doesn't matter who adds them there. Anybody can. It's used as a fallback solution by developers when a library doesn't include/release its own typings.
The most preferred solution nowadays is to include typings from the lib itself, it's keeps things centralised and works well with new releases. This process is automated when the project itself uses TypeScript.
I'm starting with react-admin today in 2020 and there are still no typings, or quite a few:

declare module 'ra-data-graphql' {
  export const QUERY_TYPES: string[];
  type graphQLDataProvider = (
    fetchType: string,
    resource: string,
    params: { [key: string]: any }
  ) => Promise<any>;
  const buildDataProvider: (options: any) => Promise<graphQLDataProvider>;

  export default buildDataProvider;
}
declare module 'react-admin' {
  export const GET_LIST: string;
  export const GET_ONE: string;
  export const GET_MANY: string;
  export const GET_MANY_REFERENCE: string;
  export const CREATE: string;
  export const UPDATE: string;
  export const DELETE: string;
  export const DELETE_MANY: string;
  export const UPDATE_MANY: string;
}

It lacks the most important things, like component props and such. (that's what the toughest to figure out, I couldn't find a list of props from the doc, eventually found https://github.com/marmelab/react-admin/blob/master/packages/ra-core/src/types.ts which looks much better)
I see some work has been done through https://github.com/marmelab/react-admin/pull/3805 but was eventually closed and moved to https://github.com/marmelab/react-admin/pull/4375 which seems stuck, awaiting some feedback from you. But so far, nothing actionable/usable has happened, as far as I can tell (respectfully).
Also, I've noticed you've migrated most of your codebase to TS. Maybe the situation has changed and you intend to release typings yourself, bundled with react-admin library? Could you share with us what you see happening regarding TS typings, short-term? Thanks.

I've explained our strategy multiple times. Let me rephrase it here.

We definitely want to migrate react-admin to TypeScript and release scripts within the library
We've started a migration effort a year ago. As of writing, 70% of the codebase is in TypeScript. We've released the types for ra-core publicly.
We're working on adding types to ra-ui-material-ui and the demo example. Migrating the demo should be the priority, as it allows us to validate our types internally before publishing them.
It's a long and tedious job. It's not our priority. Your help is welcome.

@fzaninotto great to hear 🙏. As for @Vadorequest , I did not came across such a clear statement before.
@fzaninotto I'm +1 on @Vadorequest  's request to keep one typescript-related issue opened with this clear statement and a small progress report

It would also be very usefull to provide usefull pointers and snippets to help users mitigate typings absence meanwhile in this issue (link to where to find props definitions, or user-made snippets)
a call to contributions would possibly help bring contributors on this

Thanks @fzaninotto for the clarification, it really helps when things are clearly stated as such, for better collaboration.

What's the status of https://github.com/marmelab/react-admin/pull/4375? Is it planned to be merged, or has it deviated too much from the main branch? What's needed/blocking?

Roadmap:

Focus on https://github.com/marmelab/react-admin/tree/master/packages/ra-ui-materialui (add missing types) (is there any open PR/branch to start from?)
Focus on https://github.com/marmelab/react-admin/tree/master/examples/demo (use updated ra-ui-materialui) to test if types work as expected (is there any open PR/branch to start from?)
Release types officially

Is that correct?
Workaround:

It looks like integrating https://github.com/marmelab/react-admin/blob/master/packages/ra-core/src/types.ts types right into our project is the best workaround until types are officially released. (could use a short explanation about how to do that)

We should re-open the issue now that the "what needs to be done" is clearer, and reference this roadmap in any duplicated issue.

No, the roadmap is:

Focus on https://github.com/marmelab/react-admin/tree/master/examples/demo (use updated ra-ui-materialui) to test if types work as expected - Start from the https://github.com/marmelab/react-admin/tree/next branch
Focus on https://github.com/marmelab/react-admin/tree/master/packages/ra-ui-materialui (add missing types) - Start from the https://github.com/marmelab/react-admin/tree/next branch. Publish ra-ui-material-ui types
Convert the rest of react-admin dependencies, publish their types
Emit the types from react-admin in development. Test the demo, test on as many existing TS apps as possible. Once all the types are checked, and only then,
Release react-admin types officially

As for how to circumvent the absence of types in the meantime, I'll let the community figure our recommendations - this is not something we want to work on.
I'll open and pin another issue to explain this.

Opened issue #4505 on that subject


Add conformance test for .spec.Priority field in ANP

This commit adds tests that check if the
.spec.Priority field is respected and works
as expected.
Note that we use Pods field to express
Subject and Peers so that we test that aspect
unlike the rest of the tests so far which
have always used Namespaces aspect.

/test network-policy-api-crd-e2e

/lgtm
/approve


server: fix the path registration for user APIs at non-root URLs

closes #557

cc @sym3tri @chancez

Works for me!


Honeypot field not preserved on submit

Field name can change on post back as it's random, review logic and pull fieldname out of request for rendering back to client.
As it stands, honeypot field check only works on first submit.

15e714313b07bd31563601f574902e722132804f


CLI usage statement doesn't include manifest and validator_info (Version: 1.5.0-rc1)

Issue Description
The usage statement does list the manifest and validator_info commands, added by #3197.
Steps to Reproduce
Print the usage statement:
rippled -h

Expected Result
The result should list all supported commands.
Actual Result
The usage statement does not list either manifest or validator_info.
Environment
Arch Linux, x86_64, self-compiled v1.5.0-rc1.
Supporting Files
The commands portion of the usage statement is in printHelp() of Main.cpp.
It might be possible to make the usage statement dynamic. Much of the necessary info is in Handler.cpp although some of the parameter parsing isn't.

was this issue fixed? if not id gladly like to work on it


build-script: Run lldb tests for Swift support per-commit

Use CMake to build lldb

Side-step code signing issues by using the system debug server

Skip testing categories that add minimal coverage-per-unit-time

Only enable testing from the whitelisted swiftpr category

rdar://35534424

Once https://github.com/apple/swift-lldb/pull/296 lands, this can go in.

@swift-ci smoke test and merge

@swift-ci Please smoke test

Ouch, LLDB_BUILD_FRAMEWORK is not supported on CMake < 3.7.

@swift-ci Please smoke test


RFC: no_std

#62
the only thing that actually requires std is Cursor in src/resolvers/default.rs    CipherChaChaPoly
and getrandom, which is an upstream issue in rand
both don't seem a big problem to me, since embedded users need a different resolver anyway now that hacl is gone

Great! Makes sense to do this change now. I'll check it out more once it passes CI.
I'm down for re-adding HACL*, I removed it because we had an issue right before the 0.6 release and I wanted to be safe and re-integrate it after further inspection.

Hello, Jake and Arvid
I was wondering if you have plans to integrate this change and enable no_std support. I would love to use your library in our project that runs inside of the TEEs.
Please let me know what you think.
Cheers!


Default null to empty string ("") in curriculum visualiser

Description
Fix for unselected radio button when first displayed.
Issue(s)
Fixes CUR-1032
How to test

Go to https://deploy-preview-2958--oak-web-application.netlify.thenational.academy
Navigate to curriculum visualiser
Check threads are defaulting to "none"
Check for regressions

:tada: This PR is included in version 1.621.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Can we set max_ev_time different for each binary?

This'll be a question for @katiebreivik.
I'm currently evolving every binary in COSMIC for 13.7 billion years - this is not correct given that they each have different birth times. We should account for this. Either:

Maybe there's a method in COSMIC to just set the max_ev_time individually 🤞🏻
Or, we do something sneaky like force bcm to include a timestep of an exact time for each binary perhaps?

I thought that if I were to update the values of tphys for each of the initial binaries this might solve it but this seems to make it so that only one line of output is given in bpp rather than one for each kstar...

Ahhhhh -- ok! so the population sampler (i.e. here) assigns tphysf by setting SF_start and SF_duration. I think you should be able to just recast tphysf with the true ages (and do the same thing with the metallicity as well by recasting metallicity) in the initialbinaries DataFrame.

Okay so I think this is approximately what I tried but it gave me strange results (bpp only having one line per binary). I set the metallicities here and I test changing tpyhs here with a toggle for comparing


Users/rok/telemtry in m123 for older version

Make sure you run a CDP with your change before check-in.


ScrollSync programmatically seems to sync breaks up

Hi,
I am facing an issue in ScrollSync doesn't seem to sync correctly. When scrolling programmatically due to an outside event the sync breaks up. How can you fix this? any help is appreciated. Thanks !
  useEffect(() => {
    scrollRef.current = scrollRef.current.slice(0, visits.length);
    scrollRef?.current[visits.length - 1]?.scrollIntoView({ block: 'nearest', inline: 'nearest' });
  }, [visits]);

Any update on this issue ?


New package: InterProcessCommunication v0.1.0

Registering package: InterProcessCommunication
Repository: https://github.com/emmt/InterProcessCommunication.jl
Created by: @emmt
Version: v0.1.0
Commit: d6198cbc22ca986f61b3c3fae5e329bdcf31cbc8
Git reference: master
Release notes:

This is the first release of a Julia package for inter-process communications.

TagBot tag
OK I think that this should work now...

My fault, I forgot to register the repository at https://github.com/apps/julia-tagbot
TagBot tag


Serve static files for remote access

I could not find a way to serve static files. I save the files in appDir and wish to serve static files like images or videos.
Tried use convertFileSrc but if access the http://localhost:{port} from browser it does not working because not resolves correctly for remote access. I'm trying to develop a light presentation app that can be viewed on local network using accesses through smartphone browsers or smart tv browsers.
How can I get the 'public' dir to save files there and serve to remote access?

Answered here


Type discrimination between data and error doesn't work

Description
A simple if-statement on dataRes.data fails to correctly discriminate data and error, which results in the error type being never:
const dataRes = await GET('/');

if (dataRes.data) {
  expectTypeOf(dataRes.data).toEqualTypeOf({
    objects: [{ id: '', name: '' }],
  });
} else {
  expectTypeOf(dataRes.data).toBeUndefined();
  expectTypeOf(dataRes.error).toEqualTypeOf({ errors: { body: [''] } });
}

The OpenAPI spec used for this example
openapi: 3.0.1
info:
  title: Test API
  version: 1.0.0

paths:
  /:
    get:
      description: List objects
      operationId: GetObjects
      responses:
        '200':
          $ref: '#/components/responses/ObjectsResponse'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/GenericError'

components:
  schemas:
    Object:
      required:
        - id
        - name
      type: object
      properties:
        id:
          type: string
        name:
          type: string
    GenericErrorModel:
      required:
        - errors
      type: object
      properties:
        errors:
          required:
            - body
          type: object
          properties:
            body:
              type: array
              items:
                type: string
  responses:
    ObjectsResponse:
      description: Objects
      content:
        application/json:
          schema:
            required:
              - objects
            type: object
            properties:
              objects:
                type: array
                items:
                  $ref: '#/components/schemas/Object'
    Unauthorized:
      description: Unauthorized
      content: {}
    GenericError:
      description: Unexpected error
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/GenericErrorModel'

Reproduction
https://stackblitz.com/edit/vitejs-vite-vnadlg?file=README.md&view=editor
Expected result
It should allow checking dataRes.data or dataRes.error and choosing either the success type or the error type
Checklist

[x] I’m willing to open a PR (see CONTRIBUTING.md)

I investigated this issue further, turns out that the problem is in the FilterKeys utility type and its filtering by MIME type. When there are several error responses and they have non-overlapping content types, instead of filtering those out, it's reducing the type to never. Here's a minimal TypeScript snippet that demonstrates the issue:
type FilterKeys<Obj, Matchers> = Obj[keyof Obj & Matchers];

type Responses = {
  200: { "application/json": string; };
  401: {}
  422: { "application/json": number };
}

// this is `never`
type Result = FilterKeys<FilterKeys<Responses, ErrorStatus>, "application/json">

Ah great investigation. I hadn’t dug into it yet, but that’s currently an untested code path and I could see that causing errors. Thanks for opening a PR!

I came here due to #1723.
Something like this seems to do a bit better, although I'm not confident making the change for a type that is being used as much as FilterKeys :sweat_smile:
type FilterKeys<Obj, Matchers> = Obj extends Obj[keyof Obj & Matchers] ? Obj[keyof Obj & Matchers] : Obj[keyof Obj & Matchers] | never;

type OkResponseCodes = 200
type ErrorResponseCodes = 401 | 422 | 500;

type Responses = {
  200: { "application/json": Record<string, string>; "text/html": string };
  401: {}
  422: { "application/json": number };
  500: { "text/html": string }
}

type OkResponses = FilterKeys<Responses, OkResponseCodes>
   //^? { "application/json": Record<string, string>; "text/html": string; }

type JSONOkResponses = FilterKeys<OkResponses, "application/json">
   //^? Record<string, string>

type HTMLOkResponses = FilterKeys<OkResponses, "text/html">
   //^? string

type ErrorResponses = FilterKeys<Responses, ErrorResponseCodes>
   //^? {} | { "application/json": string; } | { "text/html": string; }

type AnyErrorResponses = FilterKeys<ErrorResponses, `${string}/${string}`>
   //^? string | number

type JSONErrorResponses = FilterKeys<ErrorResponses, "application/json">
   //^? number

type HTMLErrorResponses = FilterKeys<ErrorResponses, "text/html">
   //^? string


📝 HTML: should preserve at most one newline trivia between elements

Environment information
playground

Configuration
No response
Playground link
https://biomejs.dev/playground?files.main.html=PABkAGkAdgA%2BAAoAPABwAD4ATABvAHIAZQBtADwALwBwAD4ACgAKADwAcAA%2BAE4AdQBuAGMAPAAvAHAAPgAKAAoACgAKAAoAPABwAD4ATgBhAG0APAAvAHAAPgAKADwALwBkAGkAdgA%2BAA%3D%3D
Code of Conduct

[X] I agree to follow Biome's Code of Conduct

Note that HTML doesn't work in the playground without #3967 and biomejs/website#1089


[FRONTEND] Correct the debug syntax

If TRITON_DEBUG=True, all triton functions will be compiled in the debug mode.
Otherwise, a triton function f's debug flag is either True, False or None (default).

If True, f is compiled in the debug mode.
If False, f is compiled in the normal mode.
If None, f is compiled based on its caller's debug flag. The root (kernel) function's debug flag can also be set through the compile function.

cc @ngimel , @Chillee

https://github.com/openai/triton/issues/1704


[Feature Request]: Support table schema field addition with Storage Write API autoSchemaUpdate

What would you like to happen?
Auto-schema updates allow Storage API writes to adapt to BigQuery schema changes (e.g. required field relaxes to nullable). However, currently it doesn't support schema field additions (ie. a new column being added). Best to explain with an example:
Say we are writing to a table with schema 1: {field1, field2}
and while we are writing, the table updates to schema 2: {field1, field2, field3}
If we start writing TableRows that match schema 2, they will fail and go to the PCollection's DLQ. This fails not at the data insertion step, but when we convert the TableRows to proto prior to that using StorageApiDynamicDestinationsTableRow. This dynamic destinations object contains a MessageConverter that is instantiated once for each destination. The destination table's schema is fetched in the constructor of this MessageConverter object and is never updated later:
https://github.com/apache/beam/blob/843e7fdb239e0a61b47e39ce635c37221cd09f4e/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiDynamicDestinationsTableRow.java#L93-L123
There should be a way to update the schema when appropriate.
Issue Priority
Priority: 3 (nice-to-have improvement)
Issue Components

[ ] Component: Python SDK
[X] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[X] Component: IO connector
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

This feature is already supported, closing.

There should be a way to update the schema when appropriate.

This feature is already supported, closing.

I ran into this issue recently, is there any way to update the schema without restarting the pipeline?

@ahmedabu98 having same issue as @lucasnoetzold, since ignoreUnknownValues is required when using withAutoSchemaUpdate, adding new column doesn't refresh the schema and value is always null


Bump buf hashes again

To make tests pass and have green CI.

@rdimitrov PTAL, this is to fix our CI and unblock the PRs that @staceypotter submitted

coverage: 70.112% (-0.1%) from 70.225%
when pulling ee95eb1d77ef6d848111c9a04308b88c94e82591 on jhrozek:bump-test-hashes
into b75f7203be14817103082b160e8427e856a47a31 on stacklok:main.

I'll give it a try tomorrow to see what we can do to move away from these references and use some of our own that should not change.


Call seeder classes in a specific order

Hello, is there a way to specify in what order call the seeder classes, i have feature folder structure and each folder has its own seeder class, I have problem with foreign keys that's why I need to call the classes in particular order.
I tried naming the classes with Seed002, Seed003 but didn't have effect. It seems it goes in the order of the folders.
Or is there a different approach?
I'm using this TYPEORM_SEEDING_SEEDS=**/*.seed.ts

At the moment we do not have a way to set the order of execution.
However you could do something like this. https://github.com/w3tecch/typeorm-seeding/issues/91#issuecomment-685904757

Thanks, I guess I'll to have the files in the same folder to work.
I tried putting an index.ts with a list of export * from to each seed file but the seeder is not picking up the classes doing it that way.

Just have to have them all in the same folder for it to work.
Anything else just doesn't work. I might look into dependency for seeders. Laravel has a system for this that works great and would fit your use-case


Fix issue #19575

Looks already fixed by, https://github.com/tensorflow/tensorflow/pull/19574#pullrequestreview-124077982
Thanks though


Added a link to the CAFE publication

Request from Paul K.
See it working at http://enssand-01.internal.sanger.ac.uk:9073/Homo_sapiens/Gene/SpeciesTree?db=core;g=ENSG00000139618;gtr=order;r=13:32315474-32400266

Hi Matthieu
Do you want this to go on the branch release/85 only ?
if you want it to go both on master and release branch, can you please do the pull request on postreleasefix/85
Ridwan

There was no postreleasefix branch when I checked: only master and release/85 and they were pointing at the same commit

Ok sorry thought it was the webcode, i am going to merge it now.

super, thank you !

The changes have been pushed to the live server. Can you please check your changes on the live site to make sure nothing is broken. let me know if there is any problem.

Yes, I checked and it worked. Thank you !


Package

Hi DezzardHD,
this logic node is exactly what I was looking for!
Would you be open to publish a .zip package that can be imported into GPA?
Many thanks in advance and best regards:
Chris

Hi Frank,
I‘ve puplished the logic-node in a KNX-Forum.
http://service.knx-user-forum.de/?comm=download&id=20000080
Feel free the sign up and download it from there. ^^
If this is not possible for you, I will consider uploading a .zip to GitHub.
Best regards
Moritz

Hallo Moritz,
vielen Dank - hat funktioniert!
Viele Grüsse aus Köln,
Chris

From: Moritz Franz @.***>
Sent: Monday, January 10, 2022 5:09 PM
To: DezzardHD/InfluxDBv2Writer_GiraX1
Cc: Christian Frank; Author
Subject: Re: [DezzardHD/InfluxDBv2Writer_GiraX1] Package (Issue #1)
Hi Frank,
I‘ve puplished the logic-node in a KNX-Forum.
http://service.knx-user-forum.de/?comm=download&id=20000080
Feel free the sign up and download it from there. ^^
If this is not possible for you, I will consider uploading a .zip to GitHub.
Best regards
Moritz
—
Reply to this email directly, view it on GitHubhttps://github.com/DezzardHD/InfluxDBv2Writer_GiraX1/issues/1#issuecomment-1009032445, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKFZ3MXMCPCML4Y4RPTXPXTUVMADJANCNFSM5LTXRZTQ.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID: @.***>


handle l4 proxy err : lb: service emojivoto.emoji-svc has no instances

What happened:
I tried to deploy emojivoto to test edgemesh. First, I modified the emojivoto yaml file because edgemesh does not support grpc:
apiVersion: v1
kind: Service
metadata:
  name: emoji-svc
  namespace: emojivoto
spec:
  selector:
    app: emoji-svc
  ports:
  - name: grpc    ---->  change grpc to tcp-0
    port: 8080
    targetPort: 8080
  - name: prom    ---->  change prom to tcp-1
    port: 8801
    targetPort: 8801

(As same as voting-svc)
Then I try to access this emoji-svc but failed:
[root@k8s-node1 ~]# telnet <IP_ADDRESS> 8801
Trying <IP_ADDRESS>...
Connected to <IP_ADDRESS>.
Escape character is '^]'.
^]
telnet> Connection closed.

Anything else we need to know?:
edgemesh-agent log:
......
I0907 08:48:04.272090       1 proxy.go:37] clusterIP: <IP_ADDRESS>, servicePort: 8080
W0907 08:48:04.272147       1 util.go:21] DestinationRule "emojivoto.emoji-svc" not found, use default strategy [RoundRobin] from config file
I0907 08:48:04.272160       1 log.go:181] DEBUG: add [2] handlers for chain [tcp]
I0907 08:48:04.272191       1 log.go:181] ERROR: Lb err: [service emojivoto.emoji-svc has no instances]
E0907 08:48:04.272194       1 tcp.go:64] handle l4 proxy err : lb: service emojivoto.emoji-svc has no instances
......

I guess the problem is here(https://github.com/kubeedge/edgemesh/blob/main/agent/pkg/chassis/registry/registry.go):

	// gen MicroServiceInstances
	for _, subset := range eps.Subsets {
		if len(subset.Ports) > 0 && subset.Ports[0].Port == int32(targetPort) {
			for _, addr := range subset.Addresses {
				if addr.NodeName == nil {
					// Each backend(Address) must have a nodeName, so we do not support custom Endpoints now.
					// This means that external services cannot be used.
					continue
				}
				microServiceInstances = append(microServiceInstances, &registry.MicroServiceInstance{
					InstanceID:   fmt.Sprintf("%s.%s|%s.%d", namespace, name, addr.IP, targetPort),
					ServiceID:    fmt.Sprintf("%s#%s#%s", namespace, name, addr.IP),
					HostName:     "",
					EndpointsMap: map[string]string{proto: fmt.Sprintf("%s:%s:%d", *addr.NodeName, addr.IP, targetPort)},
				})
			}
		}
	}

	// no instances found
	if len(microServiceInstances) == 0 {
		return nil, fmt.Errorf("service %s.%s has no instances", namespace, name)
	}

targetPort is 8080 but subset.Ports[0].Port is 8801, so the loop is skipped.


L5 compatibilty

Hi,
what's the status on compatibility with Laravel 5?
I just tried to integrate your package into a Laravel 5 app. Setting a translated field fails:
Psy Shell v0.3.3 (PHP 5.6.3-1+deb.sury.org~trusty+1 — cli) by Justin Hileman
>>> $article = new App\Models\Article();
=> <App\Models\Article #0000000065c2d1f30000000009016c5c> {
       translatedAttributes: [
           "name",
           "text",
           "url"
       ],
       incrementing: true,
       timestamps: true,
       exists: false,
       snakeAttributes: true,
       manyMethods: [
           "belongsToMany",
           "morphToMany",
           "morphedByMany"
       ]
   }
>>> $article->translate('en')->name = 'test';
PHP warning:  Creating default object from empty value on line 1

Could this warning have something to do with the fact that my models are namespaced?

With version 4.5+ of Laravel Translatable, when there is no translation, translate() return null in place of an empty object. So before calling $article->translate('en'), you should check with $article->hasTranslation('en)

@sdebacker you're right, there is no translation for a new article in my example above. It's not clear to me how a new translation should be created in version 4.5+ of Translatable. Can you give me a hint
Psy Shell v0.3.3 (PHP 5.6.3-1+deb.sury.org~trusty+1 — cli) by Justin Hileman
>>> $article = App\Models\Article::create([]);
=> <App\Models\Article #000000004738352e00000000517fe60c> {
       translatedAttributes: [
           "name",
           "text",
           "url"
       ],
       incrementing: true,
       timestamps: true,
       exists: true,
       snakeAttributes: true,
       manyMethods: [
           "belongsToMany",
           "morphToMany",
           "morphedByMany"
       ]
   }
>>> $article->hasTranslation('nl');
=> false
>>> $article->translate('nl')->name = 'test';
PHP warning:  Creating default object from empty value on line 1

$data = [
    'nl' => [
        'title' => 'Titel'
    ],
    'fr' => [
        'title' => 'Titre'
    ],
]

then
$article->fill($data);

Thanks for your suggestion, unfortunately another warning appears...
Psy Shell v0.3.3 (PHP 5.6.3-1+deb.sury.org~trusty+1 — cli) by Justin Hileman
>>> $article = App\Models\Article::create([])
=> <App\Models\Article #000000004fa443ed0000000062ca65bb> {
       translatedAttributes: [
           "name",
           "text",
           "url"
       ],
       incrementing: true,
       timestamps: true,
       exists: true,
       snakeAttributes: true,
       manyMethods: [
           "belongsToMany",
           "morphToMany",
           "morphedByMany"
       ]
   }
>>> $data = ['nl' => ['name' => 'Titel'],'fr' => ['name' => 'Titre']];
=> [
       "nl" => [
           "name" => "Titel"
       ],
       "fr" => [
           "name" => "Titre"
       ]
   ]
>>> $article->fill($data)->save();
PHP warning:  preg_replace(): Parameter mismatch, pattern is a string while replacement is an array in /home/vagrant/laravel5.spatie.be/vendor/laravel/framework/src/Illuminate/Support/helpers.php on line 686

@freekmurze it is easy to help you with just these dumps. Paste some nicely formatted code if you want to help us help you.
The package (v5 was just released) is 100% tested with L5. Maybe checking the tests will help you sort things out.

@dimsav Check at the test was certainly very helpfull. Looking at them I discovered that new translations should be saved with the translateOrNew-method eg.:
$article->translateOrNew('en')->name = 'new english article'
It might be helpfull to add an example of this method in README of the package.

PR are welcome :)

I was dealing with the same issue, @freekmurze solution with translateOrNewworked out perfectly!
Also think it might be helpful to include the method in the README.
Awesome package BTW!

The readme was updated with translateOrNew in v5.1


ascii codec issue

Image ID (32340486): 'ascii' codec can't encode character u'\ub144' in position 4: ordinal not in range(128)
I can not download it T^T

Ok in my pc, can you set the the pixiv website language to either english or japanese, then remove the cookie value from config.ini, and retry.

I solved it. Thanks!
The god of masturbation will be with you!


[INLONG-10886][SDK] Transform support ACOS function

Fixes #10886
Motivation

Add a function class: AcosFunction and its unit test.

ACOS(numeric)
Returns the arc cosine of numeric.

Modifications

Verifying this change
(Please pick either of the following options)

[ ] This change is a trivial rework/code cleanup without any test coverage.

[x] This change is already covered by existing tests, such as:
(please describe tests)

[ ] This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end deployment with large payloads (10MB)
Extended integration test for recovery after broker failure

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation

plz rebase the master to resolve the conflict

plz rebase the master to resolve the conflict

OK. Rebase completely.


how to install this sdk with cocoapods

@cadaverousblue it does not support cocoapods right now. It would be very helpful to make a PR for it


android: cpython: fix stdenv.cc.cc.libllvm

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

In the future please elaborate in the commit message why a change is needed.

@FRidh Do you know what this stdenv.cc.cc.libllvm.out is about?


Are terminal word link hovers too aggressive?

If everything in the terminal can be a link will the tooltip get annoying?
One idea is to only show underlines and tooltips when ctrl/cmd is not down when the match is "high quality" (web or validated local).

To verify ensure that "search workspace" links do not show underlines when mousing over them.


Suggestions prompted by Delete/Backspace impede workflow

Whenever a Delete or Backspace key is pressed anywhere in Python code, a pop-up with useless suggestions comes up, full of things like and, assert, etc. The only way out is Esc, which needs to be done every time a line is deleted or similar action is taken. Sometimes, when typing/deleting, a quick Enter inserts one of those nonsensical "suggestions" into the code and more needs to be deleted.

Ref https://github.com/microsoft/PTVS/issues/7594

Closing it as a duplicate of the discussion at https://github.com/microsoft/PTVS/discussions/7334

No. This is not a duplicate. #7334 is about shutting down autocomplete, this one is about non-sensical completions in a specific case.
If one hits backspace in pos 2 these are the utterly worthless suggestions that are being made:

To add insult to injury, you can hit backspace in pos 3 for the same suggestions to be entered in then pos 2. It is illegal to have code beginning at that position in python.
Or does Microsoft imply forcing the user to hit Esc after using delete/backspace is by design?
An ensuing nuisance which is not mentioned is that if one does not pay attention imports for weird symbols are inserted for whacky autocompletions which do not get removed when the whacky stuff is deleted. Which if unnoticed leads to confusion in code reviews.
The chap in 7594 is spot on - please fix these obvious bugs. Especially the broken workflow in his last point is :facepalm:

Thanks for clarifying. I will reopen it:)

Some findings that may be related to the issue:

Pylance provides suggestion(completionItem.sortText) on how data is supposed to be sorted. but client may not follow it.
Client seems to send completion request by deletion (e.g. Backspace or Delete keys), which is inconsistent with what vscode does.

One example request client sends when user hits backspace:
 "params": {
    "context": {
      "_vs_invokeKind": 2,
      "triggerKind": 1,
      "triggerCharacter": " "
    }

In Version 17.7.0 Preview 2.0 Backspace does not remove an indent level but one character. E.g. to remove a tab one has to hit Backspace 4 times... Could this please be changed to align with industry standards?

Sent a PR on the pylance side to fix the issue, waiting for it to go through.

Should be fixed after pylance releases the next stable version that includes this change, which might be a few weeks from now.


[vSphere] 2 clusters having a node with the same name, leads to concurrency issues

On all providers the controller uses the machine UID as tag/label on the cloud provider instance to securely identify the correct instance.
On vSphere there's no such mechanism, thus having 2 clusters with each 1 node called node-1 will lead to issues in the controller.

This requires a migration to take over nodes without pre-existing UID tag.


Refactor OrderId and OrderIndex when fetching slab data

Move OrderIndex into the OrderBase class because can be derived when decoding OOA and decoded from Slab structures
When decoding the Slab structures, SlabLeafNode contains a 16 byte key which is actually the OrderId

Closed by #49


Improve decimal related errors

Purpose
This PR improves error messages which are shown when the decimal is too large.
Resolves #3699

@nadeeshaan Can you please check, whether this PR has an impact on LS side. ?

:white_check_mark: Build ballerina-lang 109 completed (commit https://github.com/ballerina-platform/ballerina-lang/commit/f7998486de by @Shan1024)


Broken site rtve.es

Checklist

[X] I'm reporting a broken site
[X] I've verified that I'm running yt-dlp version 2<IP_ADDRESS> (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
Spain
Description
Hi. Doesn't work with rtve.es videos like: https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/
Thank you very much.
Verbose log
C:\youtube-dlp>yt-dlp.exe -vU https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/
[debug] Command-line config: ['-vU', 'https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, err utf-8, pref cp1252
[debug] yt-dlp version 2<IP_ADDRESS> [c0c2c57] (win_exe)
[debug] Python version 3.8.10 (CPython 64bit) - Windows-10-10.0.19042-SP0
[debug] exe versions: ffmpeg N-105642-g538be75a69-20220215 (setts), ffprobe N-105642-g538be75a69-20220215
[debug] Optional libraries: brotli, Cryptodome, mutagen, sqlite, websockets
[debug] Proxy map: {}
Latest version: 2<IP_ADDRESS>, Current version: 2<IP_ADDRESS>
yt-dlp is up to date (2<IP_ADDRESS>)
[debug] [generic] Extracting URL: https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/
[generic] 6437558: Requesting header
WARNING: [generic] Falling back on generic information extractor.
[generic] 6437558: Downloading webpage
[generic] 6437558: Extracting information
[debug] Looking for video embeds
WARNING: [generic] 6437558: Failed to parse JSON Invalid control character at: line 13 column 275 (char 827)
ERROR: Unsupported URL: https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/
Traceback (most recent call last):
  File "yt_dlp\YoutubeDL.py", line 1389, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1459, in __extract_info
  File "yt_dlp\extractor\common.py", line 617, in extract
  File "yt_dlp\extractor\generic.py", line 3985, in _real_extract
yt_dlp.utils.UnsupportedError: Unsupported URL: https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/

See #1346.
Also https://github.com/ytdl-org/youtube-dl/pull/29816.

It's not working again.

I can confirm the video posted (https://www.rtve.es/play/videos/cachitos-de-hierro-y-cromo/bis/6437558/) works with https://github.com/ytdl-org/youtube-dl/pull/31241 applied (from a spanish IP).

I don't know how you apply this to your script codes but I found a manual way of extract rtve.es/play content on Celluloid player;
example content: https://www.rtve.es/play/videos/carlos-rey-emperador/carlos-rey-emperador-capitulo-1/3312421/

While playing the media, goto devtools (F12) > Network tab and search for ".m3u8"
there will be two results:
https://rtvehlsvodlote7.rtve.es/mediavodv2/resources/TE_SCARLOS/mp4/5/9/1641318615695.mp4/video.m3u8?hls_no_audio_only=true&idasset=3312421
https://rtvehlsvodlote7.rtve.es/mediavodv2/resources/TE_SCARLOS/mp4/5/9/1641318615695.mp4/1641318615695-audio=192975-video=2759000.m3u8?idasset=3312421
take either one and remove the part after .mp4
change the URL's "https://rtvehlsvodlote7.rtve.es/mediavodv2/" part to "https://mediavod-lvlt.rtve.es/" resulting the final working URL: https://mediavod-lvlt.rtve.es/resources/TE_SCARLOS/mp4/5/9/1641318615695.mp4
Now the subtitles. As in step (1) this time search for ".vtt" and directly copy the link "https://www.rtve.es/resources/vtt/0/3/1648225256930.vtt" (you don't have to download it)
add both links to your .m3u playlist (e.g. play.m3u)
When you open Celluloid player it only plays .mp4 file. And you can copy the .vtt link address from the next and open it wiht Ctrl + L shortcut. This will activate subtitles too.
This may seem a bit player specific in the and but at least I found a way to retrieve both video and subs.
But manually it takes too long. I don't want to download the content, I just want to watch them without using the browser. I would be very grateful if you find a way to apply above steps to a yt-dlp update and allow us to watch shows directly from the visible URLs like https://www.rtve.es/play/videos/blah-blah/blah-blah-capitulo-1/1234567/
thank you.


Add email section in footer to let user message

Description

Please assign me this issue.
@Agarwalvidu
Screenshots
No response
Checklist

[X] I have checked the existing issues.
[X] I have read the Contributing Guidelines
[X] I have read the Code Of Conduct
[X] The changes don't break the code

Go ahead!


How to delete item by drag?

I have a special area, where when I drag there ghost, I remove it, so there's no more draggable item. It was on 0.5.2, but now after update I get "Uncaught TypeError: undefined is not a function" in _dispatchEvent, line rootEl.dispatchEvent(evt); because there' no rootEl.
So - is there a safe way to delete an item by drag, especially on touch devices?
Thanks in advance

Nice example. I took a slightly different approach where items are deleted on dragging items outside the sortable list.
Here's the working code I ended up with:
http://jsbin.com/yajigagali/1/edit?html,css,js,console,output

@oniisaki Very nice work.


About nginx reverse proxying to a secondary directory.

⚠ Please verify that this bug has NOT been raised before.

[X] I checked and didn't find similar issue

🛡 Security Policy

[X] I agree to have read this project Security Policy

📝 Describe your problem
I want to reverse proxy Uptime kuma through nginx to a secondary directory, for example, I deploy uptime kuma to status.abc.com, but I want to proxy it to abc.com/status.
📝 Error Message(s) or Log
No response
🐻 Uptime-Kuma Version
1.23.7
💻 Operating System and Arch
ubutu 20.04
🌐 Browser
Google Chrome
🐋 Docker Version
No response
🟩 NodeJS Version
No response

Refer to this website

Currently, subdirectory deployments are not possible. Please refer ot https://github.com/louislam/uptime-kuma/pull/1092 for additional details

I think this is the only viable solution in the foreseeable future, so it's actually quite reasonable to recommend. We might need to mention the environment variable UPTIME_KUMA_DISABLE_FRAME_SAMEORIGIN.


Adds eslint dependencies and preliminary rules

Extending jshint, includes angular specific best practices and check as well.
I know everyone is busy, but ideally this is more of a conversation than a pr @himdel (if you have a sec) or anyone in general :)
It is known that we are using airbnb eslint elsewhere: https://github.com/ManageIQ/manageiq/blob/62186766366eae2e93ba1300abe85fc3d8377482/package.json  so the question has to be asked, are we ok doing something different here? (semi rhetorical question I believe yes, because architecturally this is a different beast)
#121 is one bullet closer to complete with this pr

@Fryguy any issues here?

@himdel any thoughts / issues here?

@AllenBW Am I correct in my understanding that this would be more handy in the future when we upgrade to Angular 2 and as a result we would be coding more in es6?

@AparnaKarve heeeeeeeey you noticed that :P yeah es6 is one of the style envs we're targeting with this, the thought being that the forward leaning will be of great benefit the future.  In general though the move to using eslint, stronger code style checks is of great benefit now.  To no single persons fault ( 👊 collective) ssui is wee bit messy.

I'd be definitely for keeping this eslint and manageiq's eslint config similar, or as close to similar as makes sense. But you're right this is a different beast, so.. :)


[Feature] docs generate - retrieve column descriptions from DB when available - for Sources

Is this your first time submitting a feature request?

[X] I have read the expectations for open source contributors
[X] I have searched the existing issues, and I could not find an existing issue for this feature
[X] I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature
I am requesting an enhancement to the dbt docs generate command to automatically retrieve column descriptions for sources from the database (e.g., BigQuery) when they are not provided in the YAML files. This functionality is already partially in place as dbt docs generate accesses the database to retrieve metadata for building the catalog.json. Extending this capability to fetch column descriptions would streamline the documentation process, especially for sources managed by external teams.
Describe alternatives you've considered
1.	Manually maintaining column descriptions in YAML files for all sources.
2.	Developing custom scripts to extract and merge database column descriptions into the dbt project.

Both alternatives add significant manual overhead and are prone to errors and inconsistencies.
Who will this benefit?
This feature will benefit dbt users who manage projects with external data sources, particularly in environments where:
•	Sources are managed by other teams.
•	Column descriptions are maintained within the database itself.
•	Consistent and up-to-date documentation is critical.

Example use case: A data engineering team using BigQuery with tables owned by different departments. Automatically retrieving column descriptions will ensure accurate and current documentation without duplicating efforts across teams.
Are you interested in contributing this feature?
Not really, but I'd love to help if needed
Anything else?
•	dbt docs generate documentation
This feature will leverage the existing infrastructure in dbt docs generate to enhance the documentation capabilities, providing a more seamless and integrated experience for users.

that would be super useful!

Any update?


Simplified implementation of map for acsets

The map function now is not generated, which means that it will do some more work every time, but is much less janky, and also potentially will have faster compile times.

This PR is reported to fix #735.


Add basic CORS support

I have found your elevation service very handy!  Do you have any interest in adding CORS support to it?
I did not update package-lock.json because npm install rolls back your security fix commit (1a8021e9b9f616a139b912f93c56a2210b8d94b7).  Is there a way to update package.json to lock in the right version of the package with the security vulnerability?

Hi, and thanks for taking the time to submit this!
I am a bit reluctant to merge this, since it seems to me that this kind of functionality, like auth, CORS handling and so on, is better by separating the concerns and splitting them out into a middleware.
I have not used it myself, but looking quickly I found https://github.com/possibilities/micro-cors, which looks promising. For my own needs, I have just configured the web server to add the Access-Allow-Origin header.
In the same spirit, I implemented and use https://github.com/perliedman/utoken for simple token authentication with elevation-service, and it works great.

No worries.  I wasn't sure whether you considered this an application or a library.  Sounds like it is a library!
I already have a wrapper around elevation-service, so I can easily put this CORS code there.


Colored assembly code in clipboard

Is your feature request related to a problem? Please describe.
Can Ghidra copy a snippet of assembly code with highlighting, colors, and formatting like other text editors? I have tried formatting it, but there are no colors showing.
Describe the solution you'd like
The code after paste is look as good as it in the ghidra's Listing window.

A workaround for now is to simply use a screen grab to capture small snippets.
We are trying to better understand how you will use this feature.   How do you intend to use the colored copied text?

Hi dragonmacher,
Thanks for your reply. I am trying to use this code snippet in my paper's figure. If it can be copied using HTML, it will be great.
There are many code beautification tools on the network, but they do not support the code style of Ghidra. Furthermore, none of them support the ARM assembly code.  If Ghidra can be copied into HTML in the clipboard, it will be great. Thanks.
Thanks,
Dingisoul

Will not fix


Experiment with feature-biased color selection

Preserving edges would be nice, so here's the idea?

optionally downscale the image some. 1/2 or 1/4, maybe, to save compute and memory.
edge deteciton (wikipedia: Canny Edge Detection)
optionally slightly blur the edge-image so we can get some colours around the edge? experiment here.
consider colours only on the edge. if we blurred then perhaps we can use the grey value to further bias our selection. we could compute some kind of score where we sum the gray values where the colour is (normalized 0-1).

i don't know how this'll work it's just an idea.

On that last one, the area-biased selection, this can be a CLI thing. Originally, we didn't think there was a way to make this clean, but there's been some thought on it.
Something like bias-region=center-center or center-left where the first argument is vertical, second horizontal. So it can be top-left, center-right, bottom-center, etc. Instead of the image being divided into thirds, it should be smarter. Taking just the center-left third seems strange. Perhaps we make it half and the arguments just shift the box around?
There can also be like bias-size=50% or something. perhaps 0.5 to mean 50%? To shrink or grow the bias area (be sure not to overflow the bounds of the image.


(git*) Fix update script to use API

Description
This commit updates the handling of how git packages
are being checked, to use the GitHub API when
we try to download/check for the files for the current
release.
Motivation and Context
To have the package git, git.install and git.portable up to date.
How Has this Been Tested?
Tested by running .\update_all.ps1 Git* (There will be failing packages not related to the three packages intended for this update).
Screenshot (if appropriate, usually isn't needed):
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package has been migrated from another repository)

Checklist:

[x] My code follows the code style of this repository.
[ ] My change requires a change to documentation (this usually means the notes in the description of a package).
[ ] I have updated the documentation accordingly (this usually means the notes in the description of a package).
[ ] I have updated the package description and it is less than 4000 characters.
[x] All files are up to date with the latest Contributing Guidelines
[ ] The added/modified package passed install/uninstall in the chocolatey test environment (Not tested as no changes to the package itself is made).
[x] The changes only affect a single package (not including meta package) (And portable package).

:white_check_mark: Package verification completed without issues. PR is now pending human review


Update the source information

Type: Missing
Summary:
Update the source information
Details:
With the rise in supply chain attacks and OSS dependencies being used as a attack vector, Microsoft is working with our ecosystem partners, such as the Linux Foundation's OpenSSF, to enable OSS consumers to track packages back to their public sources.
Resolution:
This PR was created to add this value, ensuring future releases will include this provenance information.
Published NPM packages with repository information:
* react-modal-video
Affected definitions:

react-modal-video 1.2.3

Author has other packages with source links that point to this GitHub user account. Approved.


PubkyClient: Re-send HTTP requests after Pkarr cache update.

By default, Pkarr resolves the first response, which could be an outdated packet, either normally or maliciously sent by a peer trying to disrupt resolution of a given address. But in the background, more recent packets should be resolved, so after a failing HTTP request (with appropriate codes) the PubkyClient should check if the Pkarr cache has relevant updates that points to a different servers (Endpoint), and if so, retry calling that instead.
There should also be a limit for that to avoid the very.. very unlikely loop if someone keeps publishing new packets!

We should instead use Endpoints from Pkarr, and retries using Reqwest


Prestashop Metrics issue with icons

Hello! I upgraded my prestashop from 7.4 version to 8.1.2 and after the upgrade all the icons in the back office seem to be gone except for when i am on the main page of the back office (i am including the screenshots)

Interesting thing, if i turn off the module, then the icons are missing in the main page of the back office too.
Also i've been reading about an error with accessing orders and twig issue. When i have a ets_ordermanager module on , i get this error and some people on some pages wrote that this is ps_mbo that is causing this issue

When i change the code to the path to be @Prestashop instead of Prestashop bundle like the error shows i get an internal server error after a long loadtime and nothing in the logs of var/logs that could show me what could be the error

Hello @MRemeikis ,
Thank you for your feedback.
Not sure this is directly linked to ps_metrics.
Have you tried to :

Rebuild assets ?
Empty PrestaShop cache (delete everything under var/cache)
Clear/empty browser cache ?

For the ets_ordermanager and order listing bug, I'm curious, never heard about it.
I just tried to install it, and everything seems to work well.
Here again, maybe, clearing the PrestaShop cache may be the solution.
If not, let me know, I'll try to help you further.
Thanks

i did try to empty all cache, browser and in the server under var/cache but it didn't help. Mind me asking where i could find the function to rebuild assets? I might have done it, but since at the moment, my prestashop is in different language, i might need your guidance where to find it :D
As for ets_ordermanager, it is a module by prestahero that was bought a long time ago by my company, and at the moment i am the newest member of the website maintenance and the only one at it. As far as I noticed when I upgraded at first to 8.1.7 it had the same errors and crashes, then I rollbacked, and upgraded to the version that module at it's current version could support, which was 8.1.2, and it has many errors (i can link another git ticket i opnened on prestashop for more info)
https://github.com/PrestaShop/PrestaShop/issues/37175

@MRemeikis to rebuild the assets, you can do as mentioned here.
TLDR : you need an ssh access to the machine, node14 installed on it. Go to the root folder, and make admin to rebuild assets for back office. If not working properly, follow the more detailed way in the doc given.
For your others problems I'm quite curious, I'm working on a PR #781 to simplify some things, and I think the module ps_mbo will be less heavy to run after that, but not sure this can help you.
Do you have access to the logs (under var/logs and dev.log or prod.log) and check if you have others critical issues before/around the one displayed ? (you can copy some of the lines, just be sure to remove sensitive info before).

well i have many issues with modules and etc after upgrading to a prestashop 8.1.2 , like i cannot even use a checkout at the moment from the front store, sais issues with controllers. I think i will just log this issue to the other git. As for mbo i think i mistook the modules and mbo module != ps_metrics lol , my bad if i logged it into the wrong place

@MRemeikis don't worry about that, we're happy to help if we can.
If you have logs about the problem on ps_metrics, you can still post them here if you want, and we'll try to see with the dedicated team to check.
Hope you'll find solutions to your bugs !
Feel free to reopen the issue, or open a new one if you encounter any trouble.


docs(README): Updated the "Install Solo" section.

Description
This pull request changes the following:
Removed the following as per the comments on #999 & #998:
* Run `npm clean install` or `npm ci`
* Run `npm run build`

Related Issues

Follows up from #998 & #999.

:tada: This PR is included in version 0.32.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[Enhancement] Jakarta EE9+ without classifiers

Search before asking

[X] I had searched in the issues and found no similar issues.

Enhancement Request
At the moment Shiro uses the jakarta classifier for jars that have been transformed to the Jakarta EE namespace. This makes it hard to get the dependencies correct, because these jars share their dependencies with the non-Jakarta variants.
Describe the solution you'd like
Many projects have moved their source code to Jakarta EE 9 or higher. Shiro could start version 3 with Jakarta EE 10. It should not be that hard to keep supporting both 2.x and 3.x for some time, as the code is mostly identical.
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

That's being discussed currently on the mailing list.
Another topic is to keep base Java version as 11 or take it to 17 or 21.
Your opinion would be welcome.

Yes, I know. I'm the one who started the discussion. I would require Java 17. This will be required for Jakarta EE 11 as well. It has good support both in tools and servers. It would make sense to test on 21 as well, as it's the next LTS and servers like WildFly will make this the recommended SE version soon (probably WildFly 32 or 33).


Unhandled Exception: PlatformException(INITIALIZE_FAIL, SpeechService instance already exist., null, null)

When using the library in flutter everything works fine, but when I do a hot restart, suddenly this error occurs. I initialize the speech service using vosk.initSpeechService() in a separate method that I run in initState().

Hi! Please attach the code you are running.
Are you actually doing a "hot restart" or a "hot reload"?

this error happens on the package code example, I think it's related to not disposing the service and the recognizer, but I even tried to dispose them in the dispose() method and the error still happens.

For sake of time, I modified the existing class and added speechService and getter for my screen to access:
class VoskFlutterPlugin {
...
static SpeechService? _speechService;
Future<SpeechService?> initSpeechService(Recognizer recognizer) async {
if(_speechService!=null)
return _speechService;
if (await Permission.microphone.status == PermissionStatus.denied &&
    await Permission.microphone.request() == PermissionStatus.denied) {
  throw MicrophoneAccessDeniedException();
}
await _channel.invokeMethod('speechService.init', {
  'recognizerId': recognizer.id,
  'sampleRate': recognizer.sampleRate,
});
_speechService = SpeechService(_channel);
return _speechService;

}
SpeechService? getSpeechService() {
if(_speechService==null)
_speechService = SpeechService(_channel);
return _speechService;
}
My project code:
void initialize() async {
try {
_speechService = await _vosk.initSpeechService(_recognizer!); // init speech service
} catch (ex) {
print("Error in initializing speechservice: ${ex}. Manually access from getter property vosk.getSpeechService.");
_speechService = _vosk.getSpeechService();
}
}

For sake of time, I modified the existing class and added speechService and getter for my screen to access:
class VoskFlutterPlugin { ... static SpeechService? _speechService;
Future<SpeechService?> initSpeechService(Recognizer recognizer) async { if(_speechService!=null) return _speechService;
if (await Permission.microphone.status == PermissionStatus.denied &&
    await Permission.microphone.request() == PermissionStatus.denied) {
  throw MicrophoneAccessDeniedException();
}
await _channel.invokeMethod('speechService.init', {
  'recognizerId': recognizer.id,
  'sampleRate': recognizer.sampleRate,
});
_speechService = SpeechService(_channel);
return _speechService;

}
SpeechService? getSpeechService() { if(_speechService==null) _speechService = SpeechService(_channel); return _speechService; }
My project code: void initialize() async { try { _speechService = await _vosk.initSpeechService(_recognizer!); // init speech service } catch (ex) { print("Error in initializing speechservice: ${ex}. Manually access from getter property vosk.getSpeechService."); _speechService = _vosk.getSpeechService(); } }

Thanks for your solution @andyyapwl , it worked fine.


Missing tiles after fast zoom in and out with wouse-wheel

I'm experiencing missing tiles when i zoom in and out on the map. I first thought it's an issue with my tile-provider. But after extensive tests i can reproduce it with any Leaflet map and any provider. It's a bit tricky to provoke this though.
How to reproduce

I've tested it with LL 1.0.3, and the current trunk
I can reproduce it with Chrome, FireFox and Edge on Windows 10
I can reproduce this with a zoom-gesture on my notebook and a real mouse on my PC
I even can reproduce it with the Leaflet quickstart sample http://leafletjs.com/examples/quick-start/example.html:
First zoom out to world view.
Then zoom in very fast with the mouse-wheel
Immediately afterwards zoom out two wheel-clicks.

You need the right timing to get this result, i manage this about 20% of the time. All i can see is that the missing tile isn't even requested (using fiddler).

Since I cannot reproduce this easily, I'm gonna ask you to find some reproducible timings with synthetic WheelEvents.
Something like:
    function doTheWheel(amount) {
      var mapSize = map.getSize();
      var ev = new WheelEvent('wheel', {

        deltaX: 0,
        deltaY: amount,
        deltaZ: 0,
        deltaMode: 0,

        clientX: mapSize.x / 2,
        clientY: mapSize.y / 2
      });

      map.getContainer().dispatchEvent(ev);
    }

    function doTheWheelClosure(amount) {
      return function() {
        return doTheWheel(amount);
      }
    }

    setTimeout(doTheWheelClosure(-50), 600);  // Scroll "up"/"in" three times in very quick succession
    setTimeout(doTheWheelClosure(-50), 610);
    setTimeout(doTheWheelClosure(-50), 620);

    setTimeout(doTheWheelClosure(50), 1500); // Scroll "down"/"out" twice some time later
    setTimeout(doTheWheelClosure(50), 1700);

See https://playground-leaflet.rhcloud.com/gaxu/edit?html,output for a half-baked example. Changing the times and scrolling distances should be everything you'd need to do.

et voilà,
https://playground-leaflet.rhcloud.com/tefi/edit?html,output
this should be reproduce it on chrome and edge.  You should open it in incognito mode. Doesn't work on FF.
But i'm sure it will work on FF with different parameters as i can provoke it manually there. I'm quite good at it now :)

Hhhmmm.
I cannot reproduce this in my Chromium 56.0.2924 on Linux. I need other people to have a look and see if it's reproducible.
I wonder if this might be reproducible only on Win10?

Same here, not able to reproduce unfortunately. Tried it on both Chrome 56 and MS Edge 38 on Windows 10.

ok,
i now have a version that reproduces it for me on chrome, edge + ff (all latest version) on three differrent PCs, all running win 10 though.
Open your  browser and clear your cache before opening
http://<IP_ADDRESS>/vectortest/missing-tiles.html

Hhhhhmmmm, interesting, I can reproduce with that.

Yep, that gives me a big, blank square in the middle of the screen. 😞

I have this feeling that the bug involves a race condition in the tile pruning algorithm. I'm officially declaring a preemptive brainmelt.

ok,
i think i tracked it down to be a race condition at the incremental update. https://github.com/Leaflet/Leaflet/pull/5431
My test program runs ok now.
http://<IP_ADDRESS>/vectortest/missing-tiles-fixed.html
Also stress-tested it with a sample that makes heavy use of tiles layers.
http://<IP_ADDRESS>/agebs/

After testing with fix #5431 for a month, i consider this bug to be fixed.

After testing with fix #5431 for a month, i consider this bug to be fixed.


ServusTV

Checklist

[X] I'm reporting a broken site support
[X] I've verified that I'm running youtube-dl version 2021.06.06
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

PASTE VERBOSE LOG HERE
[debug] System config: []
[debug] User config: ['--no-check-certificate', '--geo-bypass-country', 'DE', '-
-hls-prefer-native', '--ffmpeg-location', 'C:\\Program Files (x86)\\Multimedia\\
FFMPEG\\bin']
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.servustv.com/unterhaltung/v/aa-1v
hrpqy1w2112/']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2021.06.06
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-93439-gb073fb9eea, ffprobe N-93439-gb073fb9eea
[debug] Proxy map: {}
WARNING: Falling back on generic information extractor.
ERROR: Unsupported URL: https://www.servustv.com/unterhaltung/v/aa-1vhrpqy1w2112
/
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl
31\build\youtube_dl\YoutubeDL.py", line 815, in wrapper
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl
31\build\youtube_dl\YoutubeDL.py", line 836, in __extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl
31\build\youtube_dl\extractor\common.py", line 534, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpkqxnwl
31\build\youtube_dl\extractor\generic.py", line 3520, in _real_extract
youtube_dl.utils.UnsupportedError: Unsupported URL: https://www.servustv.com/unt
erhaltung/v/aa-1vhrpqy1w2112/

## Description

<!--
Provide an explanation of your issue in an arbitrary form. Provide any additional information, suggested solution and as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.
-->

WRITE DESCRIPTION HERE
Hello!

seems that something has changed at servustv.com
In the past, youtube-dl worked perfect with this site, now I am getting the message "unsupported URL".

command line:
youtube-dl.exe https://www.servustv.com/unterhaltung/v/aa-1vhrpqy1w2112/

The issue applies for any content on servustv.com. All other functions of youtube-dl such as -F etc are also affected.

Looks like the format used to be https://www.servustv.com/videos/aa-1vhrpqy1w2112/ and is now https://www.servustv.com/unterhaltung/v/aa-1vhrpqy1w2112/.
However changing back to the old format then fails at the first step, trying to get an authorisation token from auth.redbullmediahouse.com.


Redirecting to Login Page on Refresh

Hey man, thank you for putting some time into this repo; it's incredible.
I'm using the verified middleware in my pages in Nuxt, except in login, of course. But when I refresh the page, I'm redirected to the login page and then back to home. Any idea of why this is happening?
Do you want me to provide any snippets from my code?
Thank you for your time

Hi, are you getting any errors in your browser's console? What about the terminal where you run Nuxt's dev server, any errors there?

Hi, sorry for the late response. I'm using your library on a side project which I work on once a month.
I'm not getting any errors on the terminal. In the browser's console, I get this warning


Tests scatterplot function

Do these tests look good enough? It is basically testing whether the sample data and its features are correctly being assigned to different attributes of the plot.

Thoughts on what more can I add?


Removing friends from FB does not take place

Removing friends does not refresh the contact list on iOs app in anyway. All initial contacts stay the same.

$feature https://github.com/hookflashco/hookflash.me/issues/22


Directory search functionality

How to implement the search functionality in the directory from the search UI in matrix ?

https://stackoverflow.com/questions/62149363/searching-users-in-keycloak-from-java-code


Vectorization support

This issue has been reflected in v0.6.
https://github.com/shapoco/calctus/releases/tag/v0.6.8857.6956-beta


jsonpp chokes on multiline input

To reproduce:
$   (echo [ 1; echo , 2; echo , 3; echo ]) | jsonpp
Version used:
http://cloud.github.com/downloads/jmhodges/jsonpp/jsonpp-1.0.0-osx-x86_
(homebrew didn't word-wrap that URL and my terminal was narrow at install-time.)

Known and allowed so that jsonpp can parse files containing newline separated json objects. See https://github.com/jmhodges/jsonpp/blob/master/data/multiple.json etc.
I could be convinced to add a flag to change this behavior if given a patch and a set of use cases that aren't exceedingly rare.

Actually, thinking on this again, we aren't going to support this. Newlines are not allowed in json objects and we're not going to fake that.


Uploading sample "currency" contract to blockchain fails

Running latest git master.
Following getting started examples.
 ./cleos set contract currency ../../contracts/currency/currency.wast ../../contracts/currency/currency.abi
Reading WAST...
Assembling WASM...
447826ms thread-0   main.cpp:1186                 main                 ] Failed with error: Assert Exception (10)
!"error parsing wast": Error parsing WebAssembly text file:
:1:1: expected '('
{
^

It looks like your current working directory is not accurate and/or you are using outdated docs.  I recently changed the command line usage so you only have to specify the contract folder and it will automatically identify the .wast and .abi which should be named after their parent folder according to the convention.
See this file for a tutorial on how it works now... much simpler:
https://github.com/EOSIO/eos/blob/09affc02fcc30fe7f04150087d4411b786775045/TUTORIAL.md

Thanks for the link, but these are instructions right from the latest readme file.

They should be updated to how it works now.

This needs to be reopened.
I followed instructions from the Tutorial and got same errror.
$ ./cleos set contract eosio contracts/eosio.bios -p eosio
Reading WAST...
Assembling WASM...
25368ms thread-0   main.cpp:1186                 main                 ] Failed with error: Assert Exception (10)
!"error parsing wast": Error parsing WebAssembly text file:
:1:1: expected '('

^

I hit this also. This sentence needs fixing:

This command assumes it is being executed from the root of the eosio source, but you could execute it from anywhere by specifying the full path to ${EOSIO_SOURCE}/contracts/eosio.bios

The .wast files are in the build tree: ${EOSIO_SOURCE}/build/contracts/eosio.bios

Thank to @tbfleming : cleos set contract eosio build/contracts/eosio.bios -p eosio


Annual copyright update 2023

2023 annual copyright file updates

@vinay-ebi could you have a look to figure out why the celery is not properly set up for tests?


fix(api): change seed delete order

Describe your changes

Issue ticket number and link
Type of change 🧩

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation update
[ ] Other (please explain in the description section above)

Checklist before requesting a review

[ ] I have performed a self-review of my own code
[ ] I have double checked this work does not include any hardcoded secrets or passwords
[ ] I have made corresponding changes to the documentation
[ ] I have provided details on how I have tested my code
[ ] I have referenced the ticket number above
[ ] I have provided a description of the ticket
[ ] I have included unit tests to cover any testable code changes

Should we close this for https://github.com/Planning-Inspectorate/appeals-back-office/pull/767?