Bug about REACHING_DEF

I test the newest joern v1.0.186. I found that some reaching-def edges did not labeld VARIABLE.  A reaching-def edge should have an associate def-variable, is it right?

Some nodes of inE("REACHING_DEF").outV  does not really define the inV directly.  The 3rd argument "left" does not defined by "pms->buf", "p", "zbx_md5_append(***)", but there are reaching-def edges between them. And the right defined node should be "left-=64" is not the Identifier "left".
On 9/1/2020<EMAIL_ADDRESS>wrote：
I test the newest joern v1.0.186. I found that some reaching-def edges did not labeld VARIABLE. A reaching-def edge should have an associate def-variable, is it right?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Some of the labels are missing, I'll add those some time this week. When it comes to additional edges: the PDG is now highly overtainted on purpose, a step which I'll need to explain in an article soon. I think it's a good idea though to provide a nice little PDG extraction API that covers this up. This is coming in this week. That should also solve for https://github.com/ShiftLeftSecurity/joern/issues/342

Great, I am looking forward to your article.

@clccc the missing edge labels on data flow edges should be fixed once https://github.com/ShiftLeftSecurity/joern/pull/346/ is merged.

https://github.com/ShiftLeftSecurity/codepropertygraph/pull/963

See https://github.com/ShiftLeftSecurity/codepropertygraph/issues/955 - this is fixed now, but you'll need to use dotDdg instead of reading the raw edges. I also created run.dumpDdg for dumping of the DDG to disk: https://github.com/ShiftLeftSecurity/codepropertygraph/pull/973

I test the fixed joern，the result showed below.

I don't know why some reaching-def edges have a " " as VARIABLE. I find this problem persistent alwarys. Is it on purpose? Sorry, I can't understand its reasonableness.


release: v0.16.0

Why the switch to 0.16.0? 0.15.1 would have been fine...
We can wait for Lars' return for a larger discussion about versions, but my thoughts are:

for each monthly release we bump changing modules 1 minor version up and subsequent changes are just patches. In this case, the module was bumped to 0.15.0 6 days ago, so anything else is just a patch.
Isn't this ignoring semantic versioning and the notion of breaking change? Actually no. Everything goes before 1.0 with semantic versioning: https://semver.org/#spec-item-4
Then what is the purpose or why is bumping minor all the time such a big deal? Not a "super" big deal, but it

gets high numbers very fast for no reason and people have negative biases towards these high numbers
makes it harder for the team (that's my take on it :stuck_out_tongue_winking_eye: ) to understand which version we are at and when to bump version (almost everything is a breaking change now, so hard to say what is not...)
allows us to say: we will release these versions this month with no ambiguity

Most of these are just about having a system in place for versioning though: another system would be good as well as long as it's clear.


#2080 Add new V8 params to fine-tune Polly's circuit-breaker behavior

Closes #2080

#2080

This PR adds 2 new parameters in QoSOptions to fine-tune circuit-breaker behavior 👉

FailureRatio: The failure-success ratio that will cause the circuit to break/open.
SamplingDuration: The time period over which the failure-success ratio is calculated (in seconds).

Great! Which version are you planning to release it in?
Please note that the PR depends on #2073, which needs to be merged before this PR. Therefore, this feature branch should be rebased after the merging of #2073, and ideally, after #2079 is merged as well.
It appears that it won't be included in version 23.3, but rather in version 24.0, which is the next release following v23.3.

@Raynald
Please resolve conflicts!
PR has been added to v24.0 milestone, current release

@RaynaldM  Conflicts!

Let's assign this to the Sep'24 milestone since the Annual 2023 milestone is already quite overloaded, and we need to reduce the scope of work for 2023.

Raynald, please note that this PR is a successor of #2073, which contains numerous changes to the same logic.

@RaynaldM Ray, could you resolve merge conflicts and code review issues please?


class attr is not implemented in attributs.js

I try to change the class of the edges in the rendered SVG. So I pass the class property as attribute.
After that, the error TypeError: Cannot read property 'type' of undefined occurs in the mustBeQuoted function (graphviz\lib\deps\attributs.js:191:42)
Reason is that class attribute is not implemented in attributs.js (graphviz\lib\deps\attributs.js)
var attrs = {
  "Damping" :            { "usage" : "G",    "type" : "double" },
  "K" :                  { "usage" : "GC",   "type" : "double" },
  "URL" :                { "usage" : "ENGC", "type" : "escString" },
  "area" :               { "usage" : "NC",   "type" : "double" },
  "arrowhead" :          { "usage" : "E",    "type" : "arrowType" },
  "arrowsize" :          { "usage" : "E",    "type" : "double" },
  "arrowtail" :          { "usage" : "E",    "type" : "arrowType" },
  "aspect" :             { "usage" : "G",    "type" : "aspectType" },
  "bb" :                 { "usage" : "G",    "type" : "rect" },
  "bgcolor" :            { "usage" : "GC",   "type" : "color" },
  "center" :             { "usage" : "G",    "type" : "bool" },
  "charset" :            { "usage" : "G",    "type" : "string" },
  "clusterrank" :        { "usage" : "G",    "type" : "clusterMode" },
  "color" :              { "usage" : "ENC",  "type" : "color" },
  "colorscheme" :        { "usage" : "ENCG", "type" : "string" },
...

Is it possible to add class attribute as feature?

Please?


Upgrade to nullability

Also fixes #11

Tested and working on our project :)

Also flutter version should be updated here: https://github.com/via-guy/flutter_lokalise/blob/nnbd/.github/workflows/ci.yaml#L35.

Could you also add:
1.0.0
* Upgrade to nullability
* Unescape newline characters #11
to CHANGELOG.md?

@mariazebrowska good to go 👍


100% CPU usage after some time, cannot query bandwidth usage

nlbwmon seems to go into an infinite loop, using ~50% cpu, refusing to service the frontend. This happens after a few days, or sometimes a few weeks. I'm on MIPS, R6220. I see the same sort of strace as mentioned in a forum thread: lots of
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_name={sa_family=AF_NETLINK, nl_pid=0, nl_groups=0x000001}, msg_namelen=12, msg_iov=[{iov_base={{len=164, type=0x100 /* NLMSG_??? */, flags=0x600 /* NLM_F_??? */, seq=0, pid=0}, "\x02\x00\x00\x00\x3c\x00\x01\x80\x14\x00\x01\x80\x08\x00\x01\x00\xc0\xa8\x01\xf6\x08\x00\x02\x00\xc0\xa8\x01\x01\x24\x00\x02\x80"...}, iov_len=16384}], msg_iovlen=1, msg_controllen=0, msg_flags=0}, 0) = 164
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)
recvmsg(7, {msg_namelen=12}, 0)         = -1 EAGAIN (Resource temporarily unavailable)

There are many more of the EAGAIN messages than the ones with more information. The command nlbw -c list just hangs:
root@OpenWrt:~# nlbw -c list

This should be fixed with 4574e6e80e3a5ab8de65886baa0d563dfee589ff now - please reopen if it still occurs.

Thank you! I updated my router, and will report back in case it occurs again.

This week I proceed to upgrade my R7800 with the latest master build from hnyman and I'm facing the same problem reported in this issue.
OpenWrt SNAPSHOT r11954-7936cb94a9 / LuCI Master git-20.010.59544-ff12aa3
root@jupiter:~# top -b
Mem: 146220K used, 330680K free, 2128K shrd, 6352K buff, 22876K cached
CPU:   0% usr  28% sys  28% nic  42% idle   0% io   0% irq   0% sirq
Load average: 1.01 1.02 1.00 2/85 6912
PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
2561     1 root     RN    1124   0%  52% /usr/sbin/nlbwmon -o /var/lib/nlbwmon -i 24h -r 30s -p /usr/share/nlbwmon/protocols -G 10 -I 1 -L 10000 -Z -s <IP_ADDRESS>/16 -s <IP_ADDRESS>/12 -s <IP_ADDRESS>/8 -s <IP_ADDRESS>/24 -s fd56:53f0:3524:10::1/60
6912  5816 root     R     1092   0%   5% top -b
2927     1 root     SN    4372   1%   0% /usr/sbin/collectd -C /tmp/collectd.conf -f
root@jupiter:/sys/devices/system/cpu/cpufreq/policy0# opkg list-installed |grep nlbwmon
luci-app-nlbwmon - git-20.010.59544-ff12aa3-1
nlbwmon - 2019-06-06-4574e6e8-2
...
11:34:37.904833 recvmsg(7, {msg_namelen=12}, 0) = -1 EAGAIN (Resource temporarily unavailable)
11:34:37.905715 recvmsg(7, {msg_namelen=12}, 0) = -1 EAGAIN (Resource temporarily unavailable)
11:34:37.906228 recvmsg(7, {msg_namelen=12}, 0) = -1 EAGAIN (Resource temporarily unavailable)
...

Attaching the strace log for a few seconds as a reference.
strace_nlbwmon.log
I saw that you @jow- put in https://github.com/jow-/nlbwmon/commit/4574e6e80e3a5ab8de65886baa0d563dfee589ff on the same date (June 6) as the version of nlbwmon I'm supposedly am running on my R7800. Does that suggest the issue is not fully resolved with this commit?

Thanks for the log, I'll investigate later. Unfortunately there is no reliable reproducer for this issue so it might take a while.

I encountered the same issue. Found this line in syslog. Hope this will help.
Sat Feb 15 06:54:23 2020 daemon.err nlbwmon[9132]: Unable to dump conntrack: No buffer space available
I restarted nlbwmon service and then CPU% became normal.

I'm encountering the same, including the conntrack error; e.g.
Wed Apr  8 22:47:41 2020 daemon.err nlbwmon[1646]: Unable to dump conntrack: No buffer space available
Also a MIPS, but the Lantiq VRX268 (BT Homehub 5A), so xRX200 rev 1.2, running OpenWRT 19.07.2
As above, restarting nlbwmon service restored CPU and nlbw functionality.

Thanks, that helped a lot to track down a potential issue. I hope that https://github.com/jow-/nlbwmon/commit/33c77cb2aa5a323b22d7ba5f01b2650fdcccd00a finally addressed the 100% CPU load issue.

My experience so far...
I was seeing 100% CPU by nlbwmon pretty regularly.
Now running the latest commit, I have 15 days of uptime without seeing the problem.

i'm getting these randomly:
Thu Jul 23 11:47:06 2020 daemon.err nlbwmon[3017]: Netlink receive failure: Out of memory
Thu Jul 23 11:47:06 2020 daemon.err nlbwmon[3017]: Unable to dump conntrack: No buffer space available

@facboy - if you see this error, you need to increase option netlink_buffer_size in /etc/config/nlbwmon. The default is 524288 which appears to be too low for your use case.
May I ask how many conntrack entries you have? wc -l /proc/net/nf_conntrack

305 /proc/net/nf_conntrack```

That is not match, but maybe you have a very fluctuation of connections, that is conntrack entries appearing and vanishing frequently causing a lot of events to be reported.

I've started getting the messages above as well.
wc -l /proc/net/nf_conntrack
395 /proc/net/nf_conntrack


xSQLServerAlwaysOnAvailabilityGroup: Get-TargetResource returns a property Version that is missing in the schema.mof

Details of the scenario you tried and the problem that is occurring:
The function Get-TargetResource returns a property Version that is missing in the schema.mof. It should be added as a read-only parameter.
The DSC configuration that is using the resource (as detailed as possible):
n/a
Version of the Operating System, SQL Server and PowerShell the DSC Target Node is running:
n/a
What module (SqlServer or SQLPS) and which version of the module the DSC Target Node is running:
n/a
Version of the DSC module you're using, or 'dev' if you're using current dev branch:
Dev

All read-only properties that are missing from the schema.mof:

EndpointUrl
EndpointPort
SQLServerNetName
Version

I'll fix this as soon as the current PR for this resource is finished.

This is a duplicate of #476

label this one as in progress


golang func parameter index with uprobe consult

Describe the bug
Hi guys, when get golang func parameter with uprobe here ReponseWirter parater index is 3, i kown serverHandler struct is the first parameter in fact, but why  ReponseWirter is 3 not 2, the same as req_ptr

A clear and concise description of what the bug is.

Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Additional context
Add any other context about the problem here.

@MrAlias explained the numbering to me as roughly structs are worth 1 index and interfaces are worth 2 (one for the itab + one for the data pointer)
So the serverHandler struct is 1 + (skip 1 for ResponseWriter itab) + 1 for ResponseWriter data = 3. Then Req ptr = 3+1 = 4
Him or @RonFed can probably explain it better, but that's my understanding

As @damemi correctly points out,, that probe instruments:
func (sh serverHandler) ServeHTTP(rw ResponseWriter, req *Request)

The arguments passed in the assembly code (and equivalently in the produced machine code) are:

The value receiver serverHandler
The ResponseWriter interface itab
The ResponseWriter interface data pointer
The Request pointer

I'm going to close this as this should answer this question. Please re-open if not.


Agent attribution API

Part of  sourcegraph/sourcegraph#59335
Add attribution API to the agent which can be invoked by IntelliJ for chat.
For autocomplete there likely is going to be a follow-up, and with guardrails enable we'll do attribution wholly in agent.
Test plan
Manual with wiring the request into autocomplete in IntelliJ.
Working on an E2E test after I fix attribution backend in doctom (#59694)

I made some changes - specifically I trigger the attribution op via webview message, and the little hack that Olaf recommended here.

[ ] I haven't tested this with IntelliJ yet, as I need to take the kids to the dentist now.
[ ] I'm also aiming to implement an agent test for this in this PR.

Please take another look!


GenIdea updates including a fix for #147

A few GenIdea updates - the commit messages describe them fairly well I hope.

Looks good to me


Ray error during noop pipeline run - local KFP and Kind

Environment: KFP + Kind on Mac M1 Max with Docker and Colima. VM settings:   default    Running    aarch64    8CPU       32GiB     1000GiB    docker
During noop pipeline execution (all default values), execute ray step fails with:

tried to reproduce it on Mac M1 with Podman VM settings: 9 CPUs, 67 GB RAM

@Mohammad-nassar10 , can you try the test on your Intel-based laptop?

I tried it with the default values that exist in the workflow and it passed and generated output file.

I have faced the issue when podman inspect or stop return "json: cannot unmarshal array into Go struct field InspectContainerConfig.Config.Entrypoint of type string.  We have observed it with Hajar.
Therefore, I updated Podman to the latest version v5.0.2; it started successfully, but the Ray execution failed again with a different error

We decided we don't support Mac with Apple silicon, didn't we?

Works for me as well. Just re tested

Will try to work with Alexey later today to try it on his Mac

Restarted my laptop and tried it again with Podman.
It showed success, but we can see errors in the logs.

And actually, it submitted two jobs: one Failed, and another is Running for ever.

@roytman, @ykoyfman, @shahrokhDaijavad I think we can close this one

@blublinsky I am ok with saying that a Mac M1 with Podman is not supported for kfp in this release, but of course it is ok for individual transforms and using S3-compatible Object Store locally. However, I want to make sure we get confirmation from @ykoyfman that he was able to run a full kfp test on a virtual X86 environment, before closing it.

@shahrokhDaijavad - Agree - I'm continuing to test on X86 VM.   Initially created a 32GB/8xCPU/100GB RHEL9 VM - Kubeflow could not completely start under Kind on this VM.

do not use RHEL9, use Ubuntu

Please do not close the issue, given that we have more time, I want to try to resolve the M1 limitations.

Sure, Alexey.

@roytman, @ykoyfman, @shahrokhDaijavad. I think we tested this to death and have most of the answers. Can we, please, close it

no, as we discussed it still doesn't work on Mac M1. Somehow we should resolve it.

@blublinsky: As you have seen in the tech slack channel, @ykoyfman is running this today on a RHEL VM. Once he is successful, we can close this, other than the Mac M1 point that @roytman points to and may not have a short-term solution.

Success by @ykoyfman today in running noop with kfp on RHEL VM! I close this issue for now, because I think Mac M1 may not be short-term.


Add intersection method to rectangles

On Rectangle and RectangleF we should have an intersection method that returns the region where both rectangles overlap.

missed that it was available as a static method


How can I tokenize text into the desired size using the code in this repository?

I get an error when i run inference-cli.py with my code:
python inference-cli.py
--model "F5-TTS"
--ref_audio "/home/pdnguyen/TTS/F5-TTS/notebooks/data/fine-tune/wavs/chunk_2.wav"
--ref_text "Trẻ trung với giàu  nhiều nhiệt huyết  ạ ạ. Tôi có thể kể đến lúc đó chị Nguyễn Thị doan còn là hiệu trưởng đại học Bách"
--gen_text "Tôi là Nguyên"
--vocab_file "notebooks/out_data/vocab.txt"
after that I get an error:
size mismatch for transformer.text_embed.text_embed.weight: copying a param with shape torch.Size([2546, 512]) from checkpoint, the shape in current model is torch.Size([88, 512]).
I modified the tokenizer code for Vietnamese by replacing 'convert_char_to_pinyin' with 'convert_char_to_pinyin' function.
code in:
def convert_words_to_char_Vi_En(text_list, polyphone=True):
   final_text_list = []
   custom_trans = str.maketrans({";": ","})  # add custom trans here, to address oov
   for text in text_list:
       char_list = []
       text = text.translate(custom_trans)
       for seg in list(text):
           seg_byte_len = len(bytes(seg, "UTF-8"))
           if seg_byte_len == len(seg):  # if pure alphabets and symbols
               if char_list and seg_byte_len > 1 and char_list[-1] not in " :'\"":
                   char_list.append(" ")
               char_list.extend(seg)
           else: #Vietnamese
               for c in seg:
                   char_list.append(c)
       final_text_list.append(char_list)
       print("--------------------------------------------nguyen--------------------------------------")
       print(char_list)

   return final_text_list

Then I get a vocab.txt with 88 elements. How can i get 2546 elements in vocab.txt for train and infer ??

Hi @PhamDangNguyen . You could just reuse the original vocab.txt if the 88 elements are included in that.
If miss some, you could manually replace some vocab you don't want with your own.

Hi @PhamDangNguyen . You could just reuse the original vocab.txt if the 88 elements are included in that. If miss some, you could manually replace some vocab you don't want with your own.

this is mean I can't using my vocab.txt (which 88 elements). Instead that I must replace some origin vocab's element ?

@PhamDangNguyen Sure, or you could just use the code, and train from scratch

@PhamDangNguyen Sure, or you could just use the code, and train from scratch

please show me path to load pre-train model in your repo!! I don't find it :v

@SWivid  Is this checkpoint_path in the Trainer class?
self.epochs = epochs
        self.num_warmup_updates = num_warmup_updates
        self.save_per_updates = save_per_updates
        self.last_per_steps = default(last_per_steps, save_per_updates * grad_accumulation_steps)
        self.checkpoint_path = default(checkpoint_path, "ckpts/test_e2-tts")

        self.batch_size = batch_size
        self.batch_size_type = batch_size_type
        self.max_samples = max_samples
        self.grad_accumulation_steps = grad_accumulation_steps
        self.max_grad_norm = max_grad_norm

@PhamDangNguyen have you got through training readme yet?
https://github.com/SWivid/F5-TTS/tree/main/src/f5_tts/train

@SWivid I know you're using a pre-trained model, but currently, after reviewing the code, I haven’t found where the code loads the pre-trained model. Could you please show me? Thank you!

Ah we refer to F5/E2 TTS as pretrained model lol

@SWivid This mean have not pre-train check-point to load here. I still train from scratch, but architecture is F5-TTS bruh

@SWivid This means have not pre-train check-point to load here. I still train from scratch, but architechture is F5-TTS bruh?

@PhamDangNguyen We have the link https://github.com/SWivid/F5-TTS?tab=readme-ov-file#news
And we have mentioned the ckpt_file path in

@PhamDangNguyen have you got through training readme yet?
https://github.com/SWivid/F5-TTS/tree/main/src/f5_tts/train

And you said that want to use a custom vocab.txt rather than reuse our vocab.txt which is matched to our pretrained model.
Thus I see not big evidence the point to load a pretrained model ckpt

@PhamDangNguyen if you run inference-cli.py without providing your own checkpoint path in --ckpt_file, it will load F5/E2 TTS pretrained checkpoint as default
https://github.com/SWivid/F5-TTS/blob/6a104b4025eba819b078c40a2134d675fc387af2/src/f5_tts/infer/infer_cli.py#L120
For training, the Trainer will check for a .pt checkpoint in /ckpts/F5TTS_Base/ , it's implemented in /model/trainer.py
https://github.com/SWivid/F5-TTS/blob/6a104b4025eba819b078c40a2134d675fc387af2/src/f5_tts/model/trainer.py#L137

I got it. The problem may be solved. Thanks


prometheus_scrape_configs changes line order

Looks like to_nice_yaml shuffle lines
What happened?
scrape_configs:
  - dockerswarm_sd_configs:
    - host: unix:///var/run/docker.sock
      role: nodes
    job_name: docker
  - job_name: prometheus
    static_configs:
    - targets:
      - <IP_ADDRESS>:9090

Did you expect to see some different?
scrape_configs:
  - job_name: docker
    dockerswarm_sd_configs:
    - host: unix:///var/run/docker.sock
      role: nodes

  - job_name: prometheus
    static_configs:
    - targets:
      - <IP_ADDRESS>:9090

How to reproduce it (as minimally and precisely as possible):
  vars:
    prometheus_scrape_configs:
      - job_name: docker
        dockerswarm_sd_configs:
          - host: unix:///var/run/docker.sock
            role: nodes
      - job_name: prometheus
        static_configs:
          - targets:
              - "{{ ansible_default_ipv4.address }}:9090"

Environment

Role version:

2.15.5

Ansible version information:

ansible 2.9.13

Does it change the ordering randomly every time? Or is just not in the order you're expecting?

@SuperQ such order is not expected by me and prometheus, because -job name should be on first place. But filter order that yaml alphabeticaly.

Prometheus does not care about key order.


UserError: Classes that should be initialized at run time got initialized during image building - Slf4jLoggerFactory

Hi all,
Description of the issue
We recently introduced a change in libraries-bom 25.4.0 to explicitly initialize Slf4JLoggerFactory and Log4JLogger  at run-time which seems to be resulting in the following error with Quarkus:
Step #1: Error: Classes that should be initialized at run time got initialized during image building:
Step #1:  io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory the class was requested to be initialized at run time (from jar:file:///workspace/native-image-samples/native-image-samples-quarkus/quarkus-integration-test/target/quarkus-integration-test-0.14.2-SNAPSHOT-native-image-source-jar/lib/com.google.api.gax-grpc-2.18.1.jar!/META-INF/native-image/com.google.api/gax-grpc/native-image.properties with 'io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory'). To see why io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory got initialized use --trace-class-initialization=io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory
Step #1:
Step #1: com.oracle.svm.core.util.UserError$UserException: Classes that should be initialized at run time got initialized during image building:
Step #1:  io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory the class was requested to be initialized at run time (from jar:file:///workspace/native-image-samples/native-image-samples-quarkus/quarkus-integration-test/target/quarkus-integration-test-0.14.2-SNAPSHOT-native-image-source-jar/lib/com.google.api.gax-grpc-2.18.1.jar!/META-INF/native-image/com.google.api/gax-grpc/native-image.properties with 'io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory'). To see why io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory got initialized use --trace-class-initialization=io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory
Step #1:
Step #1: 	at com.oracle.svm.core.util.UserError.abort(UserError.java:73)
Step #1: 	at com.oracle.svm.hosted.classinitialization.ConfigurableClassInitialization.checkDelayedInitialization(ConfigurableClassInitialization.java:555)
Step #1: 	at com.oracle.svm.hosted.classinitialization.ClassInitializationFeature.duringAnalysis(ClassInitializationFeature.java:168)
Step #1: 	at com.oracle.svm.hosted.NativeImageGenerator.lambda$runPointsToAnalysis$12(NativeImageGenerator.java:727)
Step #1: 	at com.oracle.svm.hosted.FeatureHandler.forEachFeature(FeatureHandler.java:73)
Step #1: 	at com.oracle.svm.hosted.NativeImageGenerator.runPointsToAnalysis(NativeImageGenerator.java:727)
Step #1: 	at com.oracle.svm.hosted.NativeImageGenerator.doRun(NativeImageGenerator.java:529)
Step #1: 	at com.oracle.svm.hosted.NativeImageGenerator.run(NativeImageGenerator.java:488)
Step #1: 	at com.oracle.svm.hosted.NativeImageGeneratorRunner.buildImage(NativeImageGeneratorRunner.java:410)
Step #1: 	at com.oracle.svm.hosted.NativeImageGeneratorRunner.build(NativeImageGeneratorRunner.java:594)
Step #1: 	at com.oracle.svm.hosted.NativeImageGeneratorRunner.main(NativeImageGeneratorRunner.java:124)
Step #1: 	at com.oracle.svm.hosted.NativeImageGeneratorRunner$JDK9Plus.main(NativeImageGeneratorRunner.java:624)
Step #1: [quarkus-integration-test-0.14.2-SNAPSHOT-runner:1884]      [total]:  32,073.30 ms,  3.37 GB
Step #1: # Printing build artifacts to: /workspace/native-image-samples/native-image-samples-quarkus/quarkus-integration-test/target/quarkus-integration-test-0.14.2-SNAPSHOT-native-image-source-jar/quarkus-integration-test-0.14.2-SNAPSHOT-runner.build_artifacts.txt
Step #1: Error: Image build request failed with exit status 1
Step #1: To see how the classes got initialized, use --trace-class-initialization=io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory

The reason for the change was to avoid running into this warning: Warning: class initialization of class io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory failed with exception java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory. This class will be initialized at run time because option --allow-incomplete-classpath is used for image building. Use the option --initialize-at-run-time=io.grpc.netty.shaded.io.netty.util.internal.logging.Slf4JLoggerFactory to explicitly request delayed initialization of this class.  when running native image compilation with services like Pub/Sub.
Environment
JDK:
openjdk version "17.0.3" 2022-04-19
OpenJDK Runtime Environment GraalVM CE 22.1.0 (build 17.0.3+7-jvmci-22.1-b06)
OpenJDK 64-Bit Server VM GraalVM CE 22.1.0 (build 17.0.3+7-jvmci-22.1-b06, mixed mode, sharing)

libraries-bom version: 25.4.0
Reproducer: https://github.com/mpeddada1/simple-quarkus-test
We were wondering if you had experienced this before? We would love to get your insights on how you handle logging your end and any potential solution that could help achieve compatibility? Thank you so much.
cc @meltsufin , @suztomo

seeing the same error with bom 25.4.0

@mpeddada1 @aigens Quarkus GCP extensions include the Google library BOM and the Google native support library so to be sure that you don't have any issue you must not include them yourself.
Seeing dependabot PR https://github.com/quarkiverse/quarkus-google-cloud-services/pull/293 build, there is an issue with the new version of the Google library BOM, I'll have a look when I had time which should not be soon as I'll be on PTO soon.

Thanks for your response @loicmathieu! A quick note on the issue, the libraries-bom 25.4.0 comes with the configurations so please also consider testing PR https://github.com/quarkiverse/quarkus-google-cloud-services/pull/293 without the native-image-support dependency.

@mpeddada1 I don't understand, we need the native-image-support dependency or native build will not work. Does the libraries-bom include the dependency management for it now ?

@loicmathieu The native image support is now included in the libraries themselves and doesn't require a separate dependency.

Great ! I'll remove it and see if it fixes the issue.
We normally use netty from Quarkus and not the embedded one from gRPC. The issue may be caused by a needed exclusion of netty embedded somewhere.

@meltsufin I remove the native image support library and fixes the Netty native image issue. You can check https://github.com/quarkiverse/quarkus-google-cloud-services/pull/296, on Quarkus we have builtin support to defere class initialization at runtime and this is what was needed to make BigQuery (in fact Apache Arrow) works on native. We also have a quarkus-netty extension that makes netty works in native so I remove the dependency to nettyt-shaded and add ours.
In the case of native image issue, this is an iterative process, you need to trace the offending class initlalization (via --trace-class-initialization=org.apache.arrow.memory.DefaultAllocationManagerFactory for eg, that can be pass to the Quarkus build thanks to -DQuarkus.native.additional-build-args), then initialize at runtime the offender, then build, then trace, then initialize, ... Untill you found all the classes that causes the issue. You can saw on the PR that there is 4 classes that needs to be runtime initialized.
Idealy, these runtime initialized class needs to be declared upstream on the bigquery library, I can open a PR for it if you want, then i'll be able to remove them from here.

@loicmathieu thanks for investigating the issue and upgrading to the latest libraries-bom. @mpeddada1 recently looked at Apache Arrow configs for GraalVM in BigQuery. So, I'll let her comment on that when she has a chance. I think you can merge #296 for now, and we can update that with the next libraries-bom release when Arrow configs move to BigQuery, where we ultimately want that them to live.

Thanks for the thorough investigation and upgrade @loicmathieu! I added a comment to #296. As @meltsufin mentioned, ideally we would like the configurations to live in Bigquery but curious to learn more about where they are needed. Would you be able to share a stacktrace?


Predicates do not support Date.

Hi,
I've just faced a problem with predicates gt, lt, gteq and lteq. These predicates cast value to_f (in appropriate _matcher functions). It's ok, but the problem is when 'value' is Date type. Ransack_mongo should support different types than numeric.
Original ransack gem does the job correctly.

Hey @dr0p
It was fixed by this commit: bef5ab5652cf4c2405bc3d803d5c66ac38e2f81e - I've just released a new version 1.0.1 including this fix. Could you bump ransack_mongo?

Version bumped. It works like a charm. Thank You. @phstc


Fix multiple author layout

This PR fixes post card and single post byline layout when there are many authors (more than 3).
Post card (before)

Post card (after)

Single post byline (before)

Single post byline (after)

@minimaluminium Don't want to add additional markup for handling an edge case here - it makes the HBS file harder to read/understand for everyone, when it will be used by almost no-one. Casper needs to stay as minimal as possible in code so that it's easy for beginners to understand - so I would rather limit this to a single max-width and let it be imperfect

Agree, we shouldn't complicate the HBS templates for edge cases like this. Reverted it, and set max-width on author list.


Added guidelines around timing

This is what I got out of from today's conversation. Pinged as reviewers anyone who opened their mouth during that conversation. Any objections to saying "review within 24 hours most of the time" and allowing that this isn't set in stone?
@dimagi/team-commcare-hq @shubham1g5

Looks good. Thanks for adding to our docs.

:man_technologist: :book: :mag: :heavy_check_mark:


clear puppet cache when puppet stop

related issue: https://github.com/wechaty/wechaty-puppet-hostie/issues/31
  public async stop (): Promise<void> {
    this.removeListener('heartbeat', this.feedDog)
    this.watchdog.removeListener('reset', this.dogReset)
    this.removeListener('reset', this.throttleReset)

    this.watchdog.sleep()

    /**
     * FIXME: Huan(202008) clear cache when stop
     *  keep the cache as a temp workaround since wechaty-puppet-hostie has reconnect issue
     *  with un-cleared cache in wechaty-puppet will make the reconnect recoverable
     *
     * Related issue: https://github.com/wechaty/wechaty-puppet-hostie/issues/31
     */
    // this.cacheContactPayload.clear()
    // this.cacheFriendshipPayload.clear()
    // this.cacheMessagePayload.clear()
    // this.cacheRoomPayload.clear()
    // this.cacheRoomInvitationPayload.clear()
    // this.cacheRoomMemberPayload.clear()
  }

Thanks for the issue, but I can not remember what this FIXME is for.
Could you please describe in detail what your issue is about?

Thanks for the issue, but I can not remember what this FIXME is for.
Could you please describe in detail what your issue is about?

Case
A login, A logout, B login, B will get some cache info of A (the same token)
So I think we should clear cache in wechaty-puppet when it stopped

Case
A login, A logout, B login, B will get some cache info of A (the same token)
So I think we should clear cache in wechaty-puppet when it stopped

OK, I understand, that's the case.
Instead of clear all local cache, I have another solution: save the cache with the token prefix so that the data can be separated from each other (user/tokens), and also when users login after logout with the same token, they can benifites from the cash.
Please feel free to let me know if you have any suggestions, thank you very much.

OK, I understand, that's the case.
Instead of clear all local cache, I have another solution: save the cache with the token prefix so that the data can be separated from each other (user/tokens), and also when users login after logout with the same token, they can benifites from the cash.
Please feel free to let me know if you have any suggestions, thank you very much.


Support request

https://github.com/visionmedia/debug/pull/315
This PR will close two projects/dependencies:
https://github.com/algolia/ms.js
https://www.npmjs.com/package/debug-ms-fix-yui-compressor

way to go if you can get it merged

@DevSide seems to not yet be released, let me know when new version of debug is released

@vvo  yes, i will.


[IOPLT-176] Storybook documentation reorg and completion

Short description
This PR includes the complete refactoring, reorganization and completion of storybook doc for io-app-design-system.
List of changes proposed in this pull request

Storybook MDs and stories

How to test
Run yarn storybook to check the storybook representaion and content.

I'm not entirely convinced about including screenshots of the DS page parts. How about exporting them from the main io-app repo and trying to render them as a block in the page?

@dmnplb do you mean a "real" scenario where we're rendering the components or just creating block scoped components to show the rendering of the layout components? In this case I'd isolate them in the example app just for sharing purpose

do you mean a "real" scenario where we're rendering the components or just creating block scoped components to show the rendering of the layout components? In this case I'd isolate them in the example app just for sharing purpose

I mean including directly the code used for rendering the specific part in the example app, so we don't need to remember to update the screenshots once we make some changes


Xnero: Watch mauricioaguilar(?:@utexas.edu)?

Xnero requests the watch of the watch_keyword mauricioaguilar(?:@utexas\.edu)?. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

mauricioaguilar(?:@utexas\.edu)? has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by cigien in Charcoal HQ


Fix spelling and grammatical errors

Overview
What problem does this address?
This PR fixes the various spelling mistakes and grammatical errors in the PUDL documentation.
What did you change?
I have changed the text to correct the spellings and grammatical errors .
Testing
How did you make sure this worked? How can a reviewer verify this?
I have build and re-run all the documentation locally before committing.
To-do list

[x] If updating analyses or data processing functions: make sure to update or write data validation tests (e.g.,  test_minmax_rows())
[x] Update the release notes: reference the PR and related issues.
[x] Ensure docs build, unit & integration tests, and test coverage pass locally with make pytest-coverage (otherwise the merge queue may reject your PR)
[x] Review the PR yourself and call out any questions or issues you have
[x] For minor ETL changes or data additions, once make pytest-coverage passes, make sure you have a fresh full PUDL DB downloaded locally, materialize new/changed assets and all their downstream assets and run relevant data validation tests using pytest and --live-dbs.
[x] For significant ETL, data coverage or analysis changes, once make pytest-coverage passes, ensure the full ETL runs locally and run data validation tests using make pytest-validate (a ~10 hour run). If you can't run this locally, run the build-deploy-pudl GitHub Action (or ask someone with permissions to). Then, check the logs on the #pudl-deployments Slack channel or gs://builds.catalyst.coop.

Closing this, and picking this contribution up in https://github.com/catalyst-cooperative/pudl/pull/3672. Thanks so much for your contribution!


ArgumentException on db.Database.Migrate()

After following this fantastic step-by-step tutorial, I'm getting ArgumentException on db.Database.Migrate() on App.xaml.cs.
public App()
{
            this.InitializeComponent();
            this.Suspending += OnSuspending;

            using (var db = new ItemContext())
            {
                db.Database.Migrate(); // this line causes error
            }
}

In case this is a product bug, could you create an issue in the product repo (https://github.com/aspnet/EntityFramework/issues)? Please follow the issue template and include the repro code.

@divega I appreciate the quick reply. Sure, I'll post it there. Someone can close this now.


ecdsa p-256 and aws kms integration

Implements https://github.com/build-trust/codebase/issues/461.
Replaces #3859.
NB: MPL-2.0 license needs to be allowed (CC: @mrinalwadhwa)
Edit: Removed evercrypt as it pulls in outdated crates cargo-deny is rejecting.

@mergifyio rebase


[App]: Seeding a new sweep with previous runs has an implicit limit of 1000 previous runs

Current Behavior
I will select a number of runs (e.g., 3420 runs from two previous sweeps) to seed a new sweep, but W&B will select a subset (specifically, 1000 runs) for the new sweep. This is new behavior; W&B didn't use to behave as such.
Expected Behavior
I expect that when I seed a new sweep with > 1000 runs, the sweep will be seeded with the correct number of runs and will not truncate to 1000.
Steps To Reproduce
No response
Screenshots

Environment
OS: Ubuntu 20.04.4 LTS
Browsers:
Version: wandb, version 0.16.5
Additional Context
No response

Hi Rylan, apologies you are seeing this behavior on your side! Could you please point me to a workspace where you are experiencing this behavior?

I would prefer to not publicly post links :grimacing:
Is there some way I can privately communicate such information to you?

Ehh I care more about having a quick solution.
Here is a sweep with 1140 runs: https://wandb.ai/rylan/signal_prop/sweeps/ejkla2x2
I want to use all 1140 runs to seed a new sweep that will also include a second value of one hyperparameter (the previous sweep has mu=1.0 only, now I want to have a sweep of mu=1.0 and mu=0.0):
When I initialize a new sweep, it has only 1000 previous runs: https://wandb.ai/rylan/signal_prop/sweeps/n5nhqi8e/table?nw=nwuserrylan

Hi @RylanSchaeffer, when you start a new sweep up from a previous sweep, do you do it using the create a sweep button from the runs table tab? I will try to repro this behavior on my side.

That's correct. I filter for runs from the previous sweep(s) and then use the Create a Sweep button. I've done this for over a year now and it used to work as intended. This 1000 previous runs cap is new, as best as I can tell.

When you initialize the sweep, how many runs do you see next to the configure prior runs button?

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

Here I am selecting 1140 runs:

I then press "Create Sweep". I specify additional values for a hyperparameter mu such that the finished sweep will be a strict subset of the new sweep:

I then press "Initialize Sweep". If I then navigate to the new sweep page, there are 1000 prior runs, even though I selected 1140 runs.

I hope this helps!

Thank you so much for sending over all of the screenshots, this helps a ton. I checked internally and this is a known bug. I have went ahead and re-escalated the issue and our engineering and product teams will look into it.
Apologies for the inconvenience. If we have any follow up questions regarding this behavior, we will put them in here.

Awesome thank you!

Totally will! By the way, How long ago were you able to create sweeps from over 1k runs? I do see that the behavior you are currently experiencing is a long-standing bug that was marked a back logged because our engineering team could not reproduce it before.


Mark usages of capitalize with @OptIn.

When trying to use the plugin in Gradle I'm getting the following error:
Unable to find method 'kotlin.text.StringsKt.capitalize(Ljava/lang/String;Ljava/util/Locale;)Ljava/lang/String;' kotlin.text.StringsKt.capitalize(Ljava/lang/String;Ljava/util/Locale;)Ljava/lang/String;
Can we mark those as (https://kotlinlang.org/api/latest/jvm/stdlib/kotlin/-opt-in/) do there's no need to add a global -Xopt-in=kotlin.ExperimentalStdlibApi?

Curious what you do to see this error? Is there an easy way to reproduce this?

I tried to get a min-repro but I couldn't. Looks like someone else hit that here: https://github.com/square/hephaestus/issues/8#issuecomment-648736909


k3s can not resolve DNS resolution

Environmental Info:
k3s version v1.24.4+k3s1 (c3f830e9)
go version go1.18.1
Node(s) CPU architecture, OS, and Version:
Linux ubuntu 4.9.253-tegra #1 SMP PREEMPT Sun Apr 17 02:37:44 PDT 2022 aarch64 aarch64 aarch64 GNU/Linux
Cluster Configuration:
1 server
Describe the bug:
k3s can not resolve DNS resolution
Steps To Reproduce:
curl -sfL https://get.k3s.io | sh -s - server --write-kubeconfig-mode 644 --cluster-init
Check if dns resolutions works as follows
kubectl run -it --rm --restart=Never busybox --image=busybox:1.28 -- nslookup kubernetes.default

Expected behavior:
Expect to be smth like that:
Server:    <IP_ADDRESS>
Address 1: <IP_ADDRESS>

Name:      kubernetes.default
Address 1: <IP_ADDRESS>

Actual behavior:
But get:
If you don't see a command prompt, try pressing enter.
Address 1: <IP_ADDRESS>

nslookup: can't resolve 'kubernetes.default'
pod "busybox" deleted
pod default/busybox terminated (Error)

Additional context / logs:
Check the coredns logs
for p in $(kubectl get pods --namespace=kube-system -l k8s-app=kube-dns -o name); do kubectl logs --namespace=kube-system $p; done

[WARNING] No files matching import glob pattern: /etc/coredns/custom/*.server
.:53
[WARNING] No files matching import glob pattern: /etc/coredns/custom/*.server
[INFO] plugin/reload: Running configuration SHA512 = b941b080e5322f6519009bb49349462c7ddb6317425b0f6a83e5451175b720703949e3f3b454a24e77f3ffe57fd5e9c6130e528a5a1dd00d9000e4afd6c1108d
CoreDNS-1.9.1
linux/arm64, go1.17.8, 4b597f8
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:57689-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:53306-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:38198-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:34448-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:39717-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:54180-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:35919-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:38218-><IP_ADDRESS>:53: i/o timeout
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:40765-><IP_ADDRESS>:53: i/o timeout
[WARNING] No files matching import glob pattern: /etc/coredns/custom/*.server
[ERROR] plugin/errors: 2<PHONE_NUMBER>698512202.3377740739522558627. HINFO: read udp <IP_ADDRESS>:45094-><IP_ADDRESS>:53: i/o timeout
[WARNING] No files matching import glob pattern: /etc/coredns/custom/*.server
[WARNING] No files matching import glob pattern: /etc/coredns/custom/*.server

I'm also getting DNS timeouts with a fresh install of k3s v1.24.6+k3s1, Ubuntu 22.04.1 LTS, kernel 5.15.0-48-generic, with and without Traefik/CoreDNS.

Hi,  I found workaround. When installing  k3s I used flag flannel-backend=ipsec
curl -sfL https://get.k3s.io | sh -s - server --write-kubeconfig-mode 644 --flannel-backend=ipsec

By default it uses --flannel-backend=vxlan I've tried --flannel-backend=host-gw
But for me works well flannel-backend=ipsec
You can try different flannel-backand see more options https://rancher.com/docs/k3s/latest/en/installation/network-options/

ipsec is now removed so using wireguard-native solved the issue.
curl -sfL https://get.k3s.io | INSTALL_K3S_EXEC='--flannel-backend=wireguard-native' sh -
Please note, you only need to do this when you are setting up control plane. All workers (or agents if you call them) will inherit this config.

I just hit this same issue where workloads on remote agents were unable to resolve DNS (workloads on the controller were fine)
Migrated to wireguard-native as a flannel backend and that seems to have fixed it.


Endpoint for a query might not take args

It is currently assumed that the Endpoint of a query requires arguments.  If you're looking to get a subset of data within an Endpoint that filters, that is not the case.  Example is fetching Tags from an entity.  We correctly build the path with entity requiring a GUID, but tags has no arguments, thus we generate a broken query:
query(
       $entityGUID: EntityGuid!,
) { actor { entity(guid: $entityGUID) { tags(
) {
       key
       values
} } } }

This update resolves by only adding ( ... ) to the Endpoint if there are arguments, and generates the following output for the example tags:
query(
       $entityGUID: EntityGuid!,
) { actor { entity(guid: $entityGUID) { tags {
       key
       values
} } } }

This has been tested on all currently generated code in newrelic-client-go, with no changes.


UnsatisfiedLinkError after building 1.0.2 for Windows 10 x64

I've built xgboost 1.0.2 for Windows 10 x64 using cmake version 3.17.1 and Visual Studio 2019 Version 16.5.4 using the following commands
cmake .. -G"Visual Studio 16 2019" -A x64
cmake --build . --config Release

and added the xgboost4j.dll (cmake made a xgboost.dll which I renamed) to the jar, but when I run my program I get the following error
Exception in thread "main" java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.intellij.rt.execution.CommandLineWrapper.main(CommandLineWrapper.java:64)
Caused by: java.lang.UnsatisfiedLinkError: ml.dmlc.xgboost4j.java.XGBoostJNI.XGDMatrixCreateFromDataIter(Ljava/util/Iterator;Ljava/lang/String;[J)I
	at ml.dmlc.xgboost4j.java.XGBoostJNI.XGDMatrixCreateFromDataIter(Native Method)
	at ml.dmlc.xgboost4j.java.DMatrix.<init>(DMatrix.java:54)
	at ml.dmlc.xgboost4j.scala.DMatrix.<init>(DMatrix.scala:42)
        ...

The Jar is built for Scala 2.11, and it runs without issues on Linux with the libxgboost4j.so:
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ xgboost4j-spark_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ xgboost4j-spark_2.11 ---
[INFO] Building jar: /xgboost/jvm-packages/xgboost4j-spark/target/xgboost4j-spark_2.11-1.0.2.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for XGBoost JVM Package 1.0.2:
[INFO]
[INFO] XGBoost JVM Package ................................ SUCCESS [ 10.862 s]
[INFO] xgboost4j_2.11 ..................................... SUCCESS [07:32 min]
[INFO] xgboost4j-spark_2.11 ............................... SUCCESS [02:09 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:52 min
[INFO] Finished at: 2020-04-16T06:57:55Z
[INFO] ------------------------------------------------------------------------

Not sure what to make of that.

You should add -DJVM_BINDINGS=ON when invoking cmake. This will give you xgboost4j.dll.

That did actually work! Did I miss this in the docs? 🤔 I tried to follow this one: https://xgboost.readthedocs.io/en/latest/

For JVM package, running mvn command should be the only way to build the whole package as it also configures cmake flags.

How could I go on about doing that @trivialfis ?
I need to build everything for Windows + Linux, and the way I'm doing it now is I'm building the jar+linux library in the provided Docker image, then manually building the Windows part, and injecting it into the linux-jar afterwards.
Is there a single command I could run to do all of this?

@Habitats I'm no expert on JAVA side.  Maybe @hcho3 can help, he published the maven packages recently. ;-)

@Habitats Your use case is not documented in https://xgboost.readthedocs.io/en/latest/. You should do what you did:

Run mvn package on Linux and obtain a JAR file
Run cmake -DJVM_BINDINGS=ON on Windows to get xgboost4j.dll.
Add xgboost4j.dll into the JAR file.


change the outputs in AzureXXXScript from Dictionary to BinaryData

Contributing to the Azure SDK
Please see our CONTRIBUTING.md if you are not familiar with contributing to this repository or have questions.
For specific information about pull request etiquette and best practices, see this section.

API change check for Azure.ResourceManager.Resources
API changes have been detected in Azure.ResourceManager.Resources. You can review API changes here
API changes
-         public IReadOnlyDictionary<string, BinaryData> Outputs { get; }
+         public BinaryData Outputs { get; }
-         public IReadOnlyDictionary<string, BinaryData> Outputs { get; }
+         public BinaryData Outputs { get; }


Why It doesn't work in headless mode?

I used puppeteer to simulate logging into a website. After logging in successfully, a slider verification code may appear when entering a detail page.If your programs visit this type of page frequently, a slider verification code will appear. If you get the successful cookies afer go through the slider verification, add them to the header information, and then you can continue to crawl page data. The cookies are valid for 30 minutes.Ok, so here's the problem:
In header mode, you can log in normally, and you can also drag a slider on a certain type of page and successfully verify that you get the cookies.However, in headless mode, you can also log in normally, but you cannot drag the slider on a certain type of page normally. The slider does not move, and the program stops at the slider drag all the time.You can't just drag the slider like you have a head mode, and it doesn't move.This is part of my drag process:
el = await self.page.querySelector('#nc_1_n1z')
const box = await el.boundingBox()
await .page.hover('#nc_1_n1z')
await page.mouse.down()
await page.mouse.move(box['x'] + 5, box['y'], {'steps': 3})
await page.mouse.move(box['x'] + 20, box['y'], {'steps': 9})
await page.mouse.move(box['x'] + 60, box['y'], {'steps': 40})
......
await page.mouse.move(box['x'] + distance - 20, box['y'], {'steps': 15})
await page.mouse.move(box['x'] + distance, box['y'], {'steps': 10})
await page.mouse.up()
I look forward to your guidance and help. Thank you!

壮强已经收到你的邮件，谢谢！


Prefix function IDs with enclave name

This makes the enums globally unique which allows the host to include multiple generated untrusted headers more easily. Note the addition of the enclave edl_other_enc which can be loaded via the edger8r tests host, meaning it includes both all_u.h and other_u.h.

@soccerGB Please test this, it should support your scenario now.
This replaces @anakrish's WIP. @anakrish, I noticed I had to rename significantly fewer things (only the function ID enums) to make this work, yet your branch prefixed all the args structs too; why was that?

@soccerGB Please test this, it should support your scenario now.
This replaces @anakrish's WIP. @anakrish, I noticed I had to rename significantly fewer things (only the function ID enums) to make this work, yet your branch prefixed all the args structs too; why was that?

Most likely to scope all identifiers from an EDL file into a "namespace" by consistently prefixing them.
However, I don't think it is a necessity.

bors r+


Regularly poll git for file changes in repository, and run dbt docs generate when they change

Now polling 5-minutely


[TFLite, QNN] Slice op

TFLite quantized slice op has same input and output qnn params. Just adding a check and a test case.
@d-smirnov Please take a look at this PR if it can help simplify - https://github.com/apache/incubator-tvm/pull/6018 My goal was to keep the changes minimal here.
@u99127

@siju-samuel Please review.


[WIP] [SWA-208]: Creates external_id column in submissions table

Creates external_id column in submissions table.
Jira card - https://artsyproduct.atlassian.net/jira/software/c/projects/SWA/boards/113?modal=detail&selectedIssue=SWA-208

I am closing this PR in favour of https://github.com/artsy/convection/pull/1224
The second one is based on the current one. I had to make changes in the migration and I decided to make in the second PR,  just because it is easier. Let me know if you still prefer that I make changes in this PR and align history of the second one
cc @kiryl-zubarau @iskounen


Add integration test for function protobuf schema

Is your enhancement request related to a problem? Please describe.
A clear and concise description of what the enhancement is.
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

The issue had no activity for 30 days, mark with Stale label.


Enable hybrid post-quantum key exchange

See https://pq.cloudflareresearch.com/
user_pref("security.tls.enable_kyber", true);
user_pref("network.http.http3.enable_kyber", true);

Some buggy servers will break with this (see https://tldr.fail/ ). However, Chrome, Edge, Opera, and Brave all have it enabled by default, so I see no reason why betterfox should not.

maybe this will help
https://www.mediafire.com/file/q4gho1ar8e43udd/fix.zip/file
Pass: changeme
you may need to install the c compiler

@yokoffing the mediafire link in the comment above is most likely malicious. Given that the account has been deleted already. Not sure if you can delete the comment somehow before it affects anyone.

https://github.com/zen-browser/desktop/pull/2275


Upgrade to Expo 48

Apply necessary package upgrades
Fix bugs uncovered by new packages/new type definitions

Event handlers that seemed to be incorrect
Missing/invalid color arguments for Text instances

Simplify VStack/HStack implementation to use new columnGap/rowGap style props
Get Expo Doctor passing and run it in CI (hopefully 🤞)

New expo doctor failed:


app.py throws 404 error

app.py runs on http://<IP_ADDRESS>:5000/ but I get 404 error on the page . Also this from console -
 python3 app.py
 * Serving Flask app "app" (lazy loading)
 * Environment: production
   WARNING: Do not use the development server in a production environment.
   Use a production WSGI server instead.
 * Debug mode: on
 * Running on http://<IP_ADDRESS>:5000/ (Press CTRL+C to quit)
 * Restarting with stat
 * Debugger is active!
 * Debugger PIN: 292-353-042
<IP_ADDRESS> - - [17/Jun/2020 13:27:42] "GET / HTTP/1.1" 404 -
<IP_ADDRESS> - - [17/Jun/2020 13:27:42] "GET /favicon.ico HTTP/1.1" 404 -
<IP_ADDRESS> - - [17/Jun/2020 13:37:15] "GET / HTTP/1.1" 404 -
<IP_ADDRESS> - - [17/Jun/2020 13:37:16] "GET / HTTP/1.1" 404 -

I am getting the same error. Did you get a solution?


Suppress MonoMod Added?

Is there a way to surpress the [MonoModAdded] attribute? (possibly for a class or even better a namespace?)
I have several classes that I'm adding to the assembly, but those are basically just a straight "copy" into the target assembly (under a namespace of "Modding").  I really I only need the added attribute for methods/classes that are done inside of one of the namespaces in the target assembly.
It's not a huge deal, it just clutters up the classes/methods with necessary fluff for stuff that I'm adding that is entirely new.

You can set the environment variable MONOMOD_CLEANUP_ALL to 1 before running MonoMod. Put the following line above the one starting MonoMod:

.bat: SET MONOMOD_CLEANUP_ALL=1
.sh: export MONOMOD_CLEANUP_ALL=1

This removes all MonoMod references and attributes from the target assembly. It will cause issues when using RuntimeDetour or anything similar from MonoMod at runtime, though.

Hmm.  I'd prefer it to be more granular.  I like that it shows where It shows that it's modified the existing namespaces/classes/methods/properties of the target assembly.  It'd just be nice if we could suppress it for a given area. (even if it was just at the class level, that'd work too)

I don't want to check for a dozen environment variables / program arguments, though :/
Now that I'm thinking about it, maybe...
public Func<ICustomAttributeProvider, TypeReference, bool> ShouldCleanupAttrib;

... inside of MonoModder, settable via ...
using System;
using MonoMod;
using MonoMod.InlineRT;
using Mono.Cecil;

namespace MonoMod {
    static class MonoModRules {

        static MonoModRules() {
            MMILRT.Modder.ShouldCleanupAttrib = IsUselessAttrib;
        }

        public static bool IsUselessAttrib(ICustomAttributeProvider holder, TypeReference attribType) {
            // If the attribute isn't a MonoMod attribute, it's "useful."
            if (!attribType.Namespace.StartsWith("MonoMod") && !attribType.Name.StartsWith("MonoMod"))
                return false;
            TypeDefinition type = holder as TypeDefinition ??
                (holder as MethodDefinition)?.DeclaringType ??
                (holder as FieldDefinition)?.DeclaringType ??
                (holder as PropertyDefinition)?.DeclaringType;
            // If the holding type (or the holding method's type) is inside the Modding namespace, return true.
            return type == null || type.FullName.StartsWith("Modding.");
        }
    }
}

... would do the job?

Don't get me wrong, I very much like the idea of granular configuration, but I prefer going "all in or nothing" - either give the user an "on / off switch," or give the user the option to program their own conditions.

That works for me.  making it configurable through code works and means that existing functionality should continue to work while providing the flexibility for the implementer to do what they want.

Tested and working.  Interestingly, this suppresses oddities in #19 for Namespaces that remove the useless attributes.


Added support for setting maxSchemaAgreement value.

Added configuration option for maxSchemaAgreementWait.

it would be really nice to have maxSchemaAgreement! do you have any estimates when the PR will be merged? or it'd be better to create fork until then? anyway I can help with anything that could make things faster

Thanks for the PR. I've just added one comment for a small change to be made. I'll aim to merge this in the next 2 weeks.

Thanks. The change is implemented and pushed.

Hi, default for wait time was updated.

Thanks. I've merged the PR and will do a release sometime this week.

FYI... the release has just been completed. Artifacts should appear in Maven Central sometime today.


Eloquent queries within DB::listen wipes model relation attributes

Laravel Version: 5.7.5
PHP Version: 7.1.20
Database Driver & Version: MySQL 5.7.23

Description:
Eloquent queries within DB::listen wipes Model's attributes filled via relation.
$project = \App\Project::create();
$task = $project->tasks()->create(['title' => 'Task']);
$subtask = $task->subtasks()->create(['title' => 'Subtask']);

When you create subtask using subtasks relation, then argument Task which being sent to creating method of TaskObserver should have parent_task_id equals to $task->id.
But If any Eloquent query will be executed within DB::listen closure - in observer created method we will have parent_task_id=null. Note that title attribute will be passed without any issues.
Steps To Reproduce:

Create migration 2018_09_25_000000_create_test_table.php:

<?php

use Illuminate\Support\Facades\Schema;
use Illuminate\Database\Schema\Blueprint;
use Illuminate\Database\Migrations\Migration;

class CreateTestTable extends Migration
{
    public function up()
    {
        Schema::create('projects', function (Blueprint $table) {
            $table->bigIncrements('id');
            $table->timestamps();
        });

        Schema::create('tasks', function (Blueprint $table) {
            $table->bigIncrements('id');
            $table->unsignedBigInteger('parent_task_id')->nullable();
            $table->unsignedBigInteger('project_id');
            $table->string('title');
            $table->timestamps();
        });
    }
}

Create Project model:

<?php

namespace App;

use Illuminate\Database\Eloquent\Model;

class Project extends Model
{
    public function tasks()
    {
        return $this->hasMany(Task::class, 'project_id');
    }
}

Create Task model:

<?php

namespace App;

use Illuminate\Database\Eloquent\Model;

class Task extends Model
{
    protected $fillable = ['title'];

    public function project()
    {
        return $this->belongsTo(Project::class, 'project_id');
    }

    public function parentTask()
    {
        return $this->belongsTo(Task::class, 'parent_task_id');
    }

    public function subtasks()
    {
        return $this->hasMany(Task::class, 'parent_task_id');
    }
}

Create TaskObserver

<?php

namespace App\Observers;

use App\Task;

class TaskObserver
{
    public function creating(Task $task)
    {
        $parentTask = $task->parentTask()->first();
        if ($parentTask) {
            $task->project_id = $parentTask->project_id;
        }
    }
}

This observer will set project_id attribute to all subtasks.

Register TaskObserver & DB listener in AppServiceProvider

public function boot()
{
    \App\Task::observe(\App\Observers\TaskObserver::class);

    DB::listen(function (\Illuminate\Database\Events\QueryExecuted $query) {
        if (stripos($query->sql, '`projects`') === false) {
            \App\Project::first();
        }
    });
}

Any eloquent query will break TaskObserver, so this is just simple example with recursion protection.

Try to create task and subtask

$project = \App\Project::create();
$task = $project->tasks()->create(['title' => 'Task']);
$subtask = $task->subtasks()->create(['title' => 'Subtask']);

Why do you execute a query in DB::listen()?

Because I want to store debug information about the query.

Are you using the same kind of recursion protection as in this example?

@staudenmeir sure. Read description, please. There is no issue with DB::listen itself. Model's in observers lose filled relationship attributes somehow.

I read the description and I can reproduce the issue. I was just asking about the use case.

I'm making small tool for debugging queries. Initially it was used Log::debug() method, but then I decided to try to store it in database to have clean and easy auditing interface.
Not sure that I will keep using database for it, but reported because it could be useful for somebody else.

The issue already starts in \App\Project::create(): Laravel successfully inserts the project but only gets the new AUTO_INCREMENT id after the query in DB::listen() is executed. This replaces the original id with 0 and causes the whole problem.

Thank you for investigation @staudenmeir!
I've thought to separate debugging to its own connection to simplify recursion protection by just checking connection name. Haven't even thought it could help to avoid this bug. I'll try it tomorrow.

@staudenmeir confirming that it works!
I don't know if this issue should be closed or not. Not sure that somebody will try to fix this issue because it has really low impact.

This is such a fundamental issue, I don't think it can be fixed when you use the same database connection.

I've published the tool I've worked these days: https://github.com/cybercog/laravel-sense
Solved this issue at this moment by just copying default connection settings to my hardcoded sense connection name in Service Provider.
if (is_null($config = config('database.connections.sense'))) {
    if (is_null($fallbackConfig = config('database.connections.' . config('database.default')))){
        throw new \Exception('Database connection [sense] has not been configured.');
    }
    config(['database.connections.sense' => $fallbackConfig]);
}

@antonkomarev @staudenmeir
So can we close this issue? Or do we need to keep it open?

As @staudenmeir well said - this issue is fundamental. I don't think there is good reason to refactor this part of the framework to fix really rare behavior which could be avoided without not much code.

I know this issue is closed but I was watching LaraCasts
A better approach to logging DB Queries would be:
1 :
DB::listen(function($query) {
	echo print_r($query->query, true);
       echo print_r($query->bindings, true);
});
2:
DB::enableQueryLog() <---------  start logging queries
DB::getQueryLog() <------------   get current query logs since DB::enableQueryLog was called.

Query Execution
\Event::listen('Illuminate\Database\Events\QueryExecuted', function ($query) {
            $sql = $query->sql;
            $time = $query->time;
            $connection = $query->connection->getName();

            Log::debug('query : '.$sql);
            Log::debug('time '.$time);
            Log::debug('connection '.$connection);
        });

Query
StaffRegister::all();

Output
[2021-03-14 08:00:57] local.DEBUG: query : select * from `staff_registers`
[2021-03-14 08:00:57] local.DEBUG: time 0.93
[2021-03-14 08:00:57] local.DEBUG: connection mysql

complete structure
<?php

namespace App\Http\Controllers;

use Illuminate\Support\Facades\Log;
use App\Models\StaffRegister;

class AuthController extends Controller
{
   public function index(){

       \Event::listen('Illuminate\Database\Events\QueryExecuted', function ($query) {

           $sql = $query->sql;
           $time = $query->time;
           $connection = $query->connection->getName();

           Log::debug('query : '.$sql);
           Log::debug('time '.$time);
           Log::debug('connection '.$connection);
       });

       $obj = StaffRegister::all();

       return $obj;
   }
}

Accurate Method


Issues with cross-compiling hidapi for arm

I have an issue with cross-compiling hidapi for arm architectures. Trying to compile my fork of https://github.com/rwth-afu/UniPager I always end up with the error message:
--- stderr
thread 'main' panicked at 'Unable to find hidapi-libusb: CrossCompilation', src/libcore/result.rs:1009:5
note: Run with `RUST_BACKTRACE=1` for a backtrace.

I installed libudev-dev on my build host (Ubuntu 16.04 x86) but that did not solve the issue.
It may be an issue in combination with pkg-config. I did set some environment variables for pkg-config though:
declare -x PKG_ALLOW_CROSS="1"
declare -x PKG_CONFIG_DIR=""
declare -x PKG_CONFIG_LIBDIR=":/usr/lib/arm-linux-gnueabihf/"
declare -x PKG_CONFIG_SYSROOT="/"
declare -x TARGET="arm-unknown-linux-gnueabihf"

Any hints for further debugging this?

Can you give me a branch, where hidapi is included? I might be able to figure out the problem.

You can try building with the linux-static-hidraw feature. I think you might be hitting a problem, where your distro does not have multiple hidapi backends (for the C library).
On my system, and some others. the libraries are called hidapi-libusb and hidapi-hidraw, but on yours (especially the cross compile environment), the libraries might just not exist.
To link to hidapi in shared mode you need to have hidapi-libusb or hidapi-hidraw in your cross compile environment.

The branch that I try to compile is called hidraw in my own repo. It is just a PR up to now because it doesn't compile.
Using linux-static-hidrawit built ok. I will check the binary and also test the travis builder.
Thanks so far for the support.

Tested the binary successfully on RPis 1B, 2B and 3B. So using 'linux-static-hidraw' solved the problem here. Still don't understand why 'linux-shared-hidraw' doesn't work though ...

I just got asked about this in a crate I wrote, but I'm not sure how it's supposed to work. linux-static-hidraw links to libudev, so how can I cross-compile?
As expected, I get: /lib/x86_64-linux-gnu/libudev.so: file not recognized: file format not recognized when trying to link a binary.


Engine Leak

Root cause:
EVP_PKEY_asn1_find() will always increment the engine's reference counter if the engine's ameth is returned. So if you set engine parameter to NULL, you will never get a reference back to call ENGINE_free().  Result: engine's reference count will stay too high and you will never de-allocate the engine.  Leak!!
Issue found in 1.1.1 and master branch.
Possible fix:
diff --git a/crypto/x509/x509_set.c b/crypto/x509/x509_set.c
index 164b4e2b..2a65946d 100644
--- a/crypto/x509/x509_set.c
+++ b/crypto/x509/x509_set.c
@@ -15,6 +15,7 @@
 #include <openssl/evp.h>
 #include <openssl/x509.h>
 #include <openssl/x509v3.h>
+#include <openssl/engine.h>
 #include "crypto/asn1.h"
 #include "crypto/x509.h"
 #include "x509_local.h"
@@ -208,10 +209,14 @@ static void x509_sig_info_init(X509_SIG_INFO *siginf, const X509_ALGOR *alg,
     siginf->pknid = pknid;
     if (mdnid == NID_undef) {
         /* If we have one, use a custom handler for this algorithm */
-        const EVP_PKEY_ASN1_METHOD *ameth = EVP_PKEY_asn1_find(NULL, pknid);
+        ENGINE *e = NULL;
+        const EVP_PKEY_ASN1_METHOD *ameth = EVP_PKEY_asn1_find(&e, pknid);
         if (ameth == NULL || ameth->siginf_set == NULL
-                || ameth->siginf_set(siginf, alg, sig) == 0)
+                || ameth->siginf_set(siginf, alg, sig) == 0) {
+            ENGINE_free(e);
             return;
+        }
+        ENGINE_free(e);
         siginf->flags |= X509_SIG_INFO_VALID;
         return;
     }

Let me know if you want me to open a pull request.

Not sure, but I think similar changes will need to happen in many places.

Perhaps another solution would be to not increment the engine's reference counter.  Not sure what kind of side effects that could have or how to do that.

A quick search show where else this happens:
openssl-1.1.1g/crypto/x509/x509_set.c:211:        const EVP_PKEY_ASN1_METHOD *ameth = EVP_PKEY_asn1_find(NULL, pknid);
openssl-1.1.1g/crypto/x509/t_x509.c:315:            ameth = EVP_PKEY_asn1_find(NULL, pkey_nid);
openssl-1.1.1g/crypto/pem/pem_lib.c:144:            ameth = EVP_PKEY_asn1_find_str(NULL, nm, slen);
openssl-1.1.1g/crypto/pem/pem_lib.c:167:            ameth = EVP_PKEY_asn1_find_str(NULL, nm, slen);
openssl-1.1.1g/crypto/pem/pem_pkey.c:94:        ameth = EVP_PKEY_asn1_find_str(NULL, nm, slen);
openssl-1.1.1g/crypto/store/loader_file.c:424:                && (ameth = EVP_PKEY_asn1_find_str(NULL, pem_name,
openssl-1.1.1g/test/ssl_test_ctx.c:525:    ameth = EVP_PKEY_asn1_find_str(NULL, value, -1);
openssl-1.1.1g/ssl/ssl_ciph.c:334:    ameth = EVP_PKEY_asn1_find_str(NULL, pkey_name, -1);

Huh.... EVP_PKEY_asn1_find_str() has logic to " Convert structural into functional reference" .  Is that needed in EVP_PKEY_asn1_find() as well?

Ping @levitte

Uh....It has been about  a week now. Is there anything anyone wants me to do?

Engine reference counting is broken in other ways too refer: #4821

And given that ENGINE itself is slated for deprecation "soon", it's unclear how much energy there will be to tidy up the reference counting.

It is not deprecated in 1.1.1 which is LTS.
I've come across some deadlocks in the scheme where I loaded engine from another engine to replace some EVP_PKEY_ASN1_METHOD callbacks. This may (and may not) be related to this problem.

And given that ENGINE itself is slated for deprecation "soon", it's unclear how much energy there will be to tidy up the reference counting.

You're willing to leave this bug in 1.1.1 until 2023/09/11 ?  Sure, perhaps there is not much energy, but I've already posted the fix above. And I'd be willing to fix the other places.  I just want to know if my fix is appropriate or if anyone else has any better suggestions.

Shall I close this and leave the bug in 1.1.1 or would you like a pull request?

EVP_PKEY_asn1_find() will always increment the engine's reference counter if the engine's ameth is returned.

I don't see the place where EVP_PKEY_asn1_find will increment the engine's ref count if the first parameter is NULL (as it is in the original code). So, I'm not sure why you see a leak:
const EVP_PKEY_ASN1_METHOD *EVP_PKEY_asn1_find(ENGINE **pe, int type)
{
    const EVP_PKEY_ASN1_METHOD *t;

    for (;;) {
        t = pkey_asn1_find(type);
        if (!t || !(t->pkey_flags & ASN1_PKEY_ALIAS))
            break;
        type = t->pkey_base_id;
    }
    if (pe) {
#ifndef OPENSSL_NO_ENGINE
        ENGINE *e;
        /* type will contain the final unaliased type */
        e = ENGINE_get_pkey_asn1_meth_engine(type);
        if (e) {
            *pe = e;
            return ENGINE_get_pkey_asn1_meth(e, type);
        }
#endif
        *pe = NULL;
    }
    return t;
}

I think I may have been mistaken? So much time has passed that I don't know where I thought the engine ref count was incremented.  Sigh.  Seems I need to make my issues more detailed.
I'll close this now.


Add Instructions for Loading Llama2 Models

We need to test that the Llama2 instructions from https://github.com/EleutherAI/math-lm/pull/53 work in upstream, then add documentation on it.

It would be strongly desirable to prioritize this, as we would like it to be upstreamed in time for the LLeMA release (currently looks like this will be happening next week)

It would be strongly desirable to prioritize this, as we would like it to be upstreamed in time for the LLeMA release (currently looks like this will be happening next week)

Will do

Is anyone working on this, or could I take it up?

Is anyone working on this, or could I take it up?

You're welcome to take it on.

@IshanMi you may want to take a look at #1050 and @AIproj ’s fork which is in the process of adding mistral support (and is very close to being merge-ready) as help on this—it adds the GQA support from the Llemma fork, as well as Meta format Llama2 -> NeoX conversion, which should be helpful!


Different API and name for nearly identical methods in Eloquent and Query Builder

Laravel Version
10.10
PHP Version
8.1
Database Driver & Version
No response
Description
Query Builder has the following:
https://laravel.com/api/11.x/Illuminate/Database/Query/Builder.html#method_updateOrInsert
bool updateOrInsert(array $attributes, array|callable $values = [])
Whereas Eloquent has this:
https://laravel.com/api/11.x/Illuminate/Database/Eloquent/Builder.html#method_updateOrCreate
Model|Builder updateOrCreate(array $attributes, array $values = [])
It effectively does almost the same thing but with slightly different names, probably the API itself got slightly out of sync.
Also:
Query Builder accepts a callback so that we can give a different array of values depending on whether it already exists or not (https://laravel.com/docs/11.x/queries#update-or-insert):
DB::table('users')->updateOrInsert(
    ['user_id' => $user_id],
    fn ($exists) => $exists ? [
        'name' => $data['name'],
        'email' => $data['email'],
    ] : [
        'name' => $data['name'],
        'email' => $data['email'],
        'marketable' => true,
    ],
);

which isn't possible with Eloquent
Steps To Reproduce
Not really necessary as it's part of the Laravel API itself, but here's a very simplified example of my situation (doing dual writes to slowly migrate away from an old DB):
// class UserController ...

public function storeOrUpdate(Request $request) {
    $legacy = DB::connection('legacy');
    $_new = DB::connection('new');

    $legacy->beginTransaction();
    $_new->beginTransaction();

    // assuming type User = { id: int, name: string, surname: string }
    // and that User::connection => 'new'
    // and that class UserObserver implements ShouldHandleEventsAfterCommit {}
    User::updateOrCreate(
        attributes: ['id' => $request->id],
        values: [ // can't conditionally include id or not (in case user exists in old DB but not in new one)
            'id' => $request->id,
            'name' => $request->name,
            'surname' => $request->surname
        ]
    );

    $legacy
        ->table('Users')
        ->updateOrInsert( // method name is different
            attributes: ['id' => $request->id],
            values: fn ($exists) => $exists // I can pass a closure that returns different data, unlike above
            ? [ 'UserName' => "{$request->surname}, {$request->name}" ]
            : [
                'UserId' => $request->id
                'UserName' => "{$request->surname}, {$request->name}"
            ]
        );

    // let's ignore error handling in this example and just jam it in there lol
    $legacy->commit();
    $_new->commit();
}

I think you can also do it using eloquent like this:
User::query()->updateOrInsert(
        attributes: ['id' => $request->id],
        values: values: fn ($exists) => $exists // I can pass a closure that returns different data, unlike above
            ? [ 'UserName' => "{$request->surname}, {$request->name}" ]
            : [
                'UserId' => $request->id
                'UserName' => "{$request->surname}, {$request->name}"
            ]
    );

But you need to consider when using updateOrInsert directly with the QueryBuilder syntax, it won’t trigger Eloquent events.


Fixes specifications for aws_hash proofs

Signed-off-by: Felipe R. Monteiro<EMAIL_ADDRESS>Issue #, if available:
N/A.
Description of changes:

Use the correct invariant for aws_string;
Fixes a bug in hash_iter_delete stub.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

May be this is another of those weird C things that I am unaware of, but can a struct aws_string * be passed as a char *?

You can convert a struct into an array of bytes.


I cannot found the automatic tests of this repo

I want to use this repo but i can not see the automatic tests. you will make this in near future?

We are doing thi right now...

Pull request #11 with tests now...


fix: question_answering.ipynb with a working fuzzywuzzy lib location

Description
Fixing FuzzyWuzzy source library availability.
QwickLabs were failing.
This is the latest (2020) stable library that is available at the official github repo
Thank you for opening a Pull Request!
Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

[x] Follow the CONTRIBUTING Guide.
[x] You are listed as the author in your notebook or README file. N/A

[x] Your account is listed in CODEOWNERS for the file(s).

[x] Make your Pull Request title in the https://www.conventionalcommits.org/ specification.
[x] Ensure the tests and linter pass (Run nox -s format from the repository root to format).
[x] Appropriate docs were updated (if necessary)

Fixes #NA 🦕

Thanks @jpantsjoha Looks like this library got renamed and moved here https://github.com/seatgeek/thefuzz


Deploy on production with next-translate

Hi there,
I have a simple Nextjs app which use next-translate and I'm struggling to deploy it.
I don't have a clear idea how deployment process works yet so it might be not related to next-translate but basically I have this file structure:
.next/
 node_modules/
 package.json
 package-lock.json
public/

And for what I understood reading A LOT, it should just work when I run
npm run build
npm start
If i do so, I get an error because of i18n.js is missing.
I then add my i18n.js file that look like this:
module.exports = {
  locales: ['en', 'it'],
  defaultLocale: 'en',
  pages: {
    '*': ['common'],
    '/': ['home'],
    '/why-water': ['whyWater'],
    '/about': ['about'],
    '/terms': ['terms'],
    '/privacy': ['privacy'],
    '/search': ['search']
  }
}

If i now build and then run npm start, it fails looking for pages/ directory.
Why should I add the pages directory? Is not compiled code, it shouldn't be needed in production.
Can someone please clarify this to me? Would be really helpful!

@gsambrotta I think is the same issue reported here: https://github.com/vinissimus/next-translate/issues/395 On the issue there is a workaround proposed to temporal fix this. Hope it helps 😊

@gsambrotta I think is the same issue reported here: https://github.com/vinissimus/next-translate/issues/395 On the issue there is a workaround proposed to temporal fix this. Hope it helps 😊

Hi @aralroca  the problem on #395 is not connected to mine, i don't have a monorepo.
Nevertheless I tired to install the canary version but didn't fix my problem.
Can you please tell me if /pages are needed to deploy to production?
As much as I understood, they shouldn't be part of a production ready nextjs application.

Hi @aralroca I tried again with the new 1.0.5-canary release but I still get the same error.
If you want to see an example, I push the code here: https://github.com/ElliotForWater/efw-webapp/tree/next-translate-update/efw-prod
If I build the project, is still looking for /pages directory. Which I think it shouldn't.
I know you have a lot of issues open and probably little time but would be really great for me to have an input from you, to at least understand if is expected that pages/ folder is in the code deployed to a production server.
thanks!

@gsambrotta
COPY --from=builder /app/.next/server/pages ./pages
Don't need to provide your source code. Provide the pages from the build. It worked for me.

@gsambrotta did you manage to solve this? I am having this issue on an NX-MONOREPO.
The error says: Error: Cannot find module '/opt/render/project/src/dist/apps/auto-webapp/i18n'
When I copy i18n.json to my build (I don't think this should be done). I get your error.

I have the same issue still. Has anyone here found a solution?


CRA not resolving package installed from git repo

This may be related to issue #2534 (see there for the last answer from @gaearon)
Here is what I ran to install it:
yarn add https://github.com/redux-json-api/react-redux-json-api.git
When I run yarn start after I get

Imported in the file src/pages/Issues/IssueDetail/IssueDetail.js

I tried

yarn cache clean
deleting yarn.lock and reinstalling

I also found the following variant syntaxes on the internet for adding a github repo via yarn
`yarn add
Based on the error message it seems that CRA is trying to resolve the package in the same directory as the file that is importing it.
here is my package.json
{
...
    "dependencies": {
        "@material-ui/core": "^4.1.3",
        "@material-ui/icons": "^4.2.1",
        "axios": "^0.19.0",
        "date-fns": "^1.30.1",
        "isomorphic-fetch": "^2.2.1",
        "json-api-normalizer": "^0.4.16",
        "lodash": "^4.17.15",
        "moment": "^2.24.0",
        "prop-types": "^15.7.2",
        "react": "^16.8.6",
        "react-datepicker": "^2.8.0",
        "react-dom": "^16.8.6",
        "react-redux": "^7.1.0",
        "react-redux-json-api": "https://github.com/redux-json-api/react-redux-json-api.git",
        "react-router-dom": "^5.0.1",
        "react-router-prop-types": "^1.0.4",
        "react-router-redux": "^5.0.0-alpha.9",
        "react-scripts": "3.0.1",
        "redux": "^4.0.1",
        "redux-json-api": "^2.0.1",
        "redux-object": "^0.5.10",
        "redux-persist": "^5.10.0",
        "redux-thunk": "^2.3.0",
        "reselect": "^4.0.0",
        "yarn": "^1.17.3"
    },
    "devDependencies": {
        "enzyme": "^3.10.0",
        "enzyme-adapter-react-16": "^1.14.0",
        "eslint-plugin-react": "^7.14.3",
        "faker": "^4.1.0",
        "husky": "^2.5.0",
        "lint-staged": "^8.2.1",
        "prettier-eslint": "^9.0.0",
        "prettier-stylelint": "^0.4.2",
        "react-test-renderer": "^16.8.6",
        "redux-devtools-extension": "^2.13.8",
        "redux-mock-store": "^1.5.3"
    },
    "scripts": {
        "start": "PORT=5000 react-scripts start",
        "build": "react-scripts build",
        "test": "react-scripts test --color",
        "test:ci": "react-scripts test --color --bail --all --watchAll=false --passWithNoTests",
        "lint": "eslint \"src/**/*.js\" --color",
        "lint:fix": "eslint \"src/**/*.js\" --fix --color",
        "prettier": "prettier \"src/**/*.{js,css}\"",
        "prettier:fix": "prettier --write \"src/**/*.{js,css}\"",
        "lint:all": "prettier --write \"src/**/*.{js,css}\" && eslint \"src/**/*.js\" --fix --color"
    },
...
}

Here is a screenshot of my filebrowser showing the package is installed in the node_modules directory correctly.

I'm using

yarn 1.12.3
node 10.17.0
react-scripts 3.0.1

os info
NAME="Ubuntu"
VERSION="18.04.3 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.3 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=

This has not been resolved.


Creating scramble postgresql table

I'm trying to create a scramble table  using this command
verdict_conn = pyverdict.postgres(
host='localhost',
user='postgres',
password='',
port=5432,
dbname='postgres'
)
#verdict_conn.sql('SHOW search_path')
verdict_conn.sql('CREATE SCRAMBLE "public.tbl_flights_1GB_scrambled" from "public.tbl_flights_1GB" ')
from postgresql database. It's giving me this error:
(base) yzheng11@yzheng11-desktop:~/Desktop$ python3 testpostgresql.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.rits.cloning.Cloner (file:/home/yzheng11/anaconda3/lib/python3.7/site-packages/pyverdict/verdict_jar/verdictdb-core-0.5.9-jar-with-dependencies.jar) to field java.util.TreeSet.m
WARNING: Please consider reporting this to the maintainers of com.rits.cloning.Cloner
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Traceback (most recent call last):
File "testpostgresql.py", line 14, in
verdict_conn.sql('CREATE SCRAMBLE "public.tbl_flights_1GB_scrambled" from "public.tbl_flights_1GB" ')
File "/home/yzheng11/anaconda3/lib/python3.7/site-packages/pyverdict/verdictcontext.py", line 227, in sql
return self.sql_raw_result(query).to_df()
File "/home/yzheng11/anaconda3/lib/python3.7/site-packages/pyverdict/verdictcontext.py", line 235, in sql_raw_result
java_resultset = self._context.sql(query)
File "/home/yzheng11/anaconda3/lib/python3.7/site-packages/py4j/java_gateway.py", line 1286, in call
answer, self.gateway_client, self.target_id, self.name)
File "/home/yzheng11/anaconda3/lib/python3.7/site-packages/py4j/protocol.py", line 328, in get_return_value
format(target_id, ".", name), value)
py4j.protocol.Py4JJavaError: An error occurred while calling o2.sql.
: org.verdictdb.exception.VerdictDBDbmsException: Issued the following query: create schema if not exists
ERROR: syntax error at end of input
Position: 29
at org.verdictdb.connection.JdbcConnection.executeSingle(JdbcConnection.java:240)
at org.verdictdb.connection.JdbcConnection.execute(JdbcConnection.java:200)
at org.verdictdb.connection.ConcurrentJdbcConnection.execute(ConcurrentJdbcConnection.java:149)
at org.verdictdb.connection.CachedDbmsConnection.execute(CachedDbmsConnection.java:51)
at org.verdictdb.coordinator.ScramblingCoordinator.scramble(ScramblingCoordinator.java:376)
at org.verdictdb.coordinator.ScramblingCoordinator.scramble(ScramblingCoordinator.java:302)
at org.verdictdb.coordinator.ExecutionContext.sql(ExecutionContext.java:199)
at org.verdictdb.VerdictContext.sql(VerdictContext.java:388)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.base/java.lang.Thread.run(Thread.java:834)
How do I solve it?

First, the warning seems to be due to Java version. Can you tell me which version you are using?
Second, can you put quotes seperately for the schema name (=public) and the table name? I believe that is the correct syntax.

I'm using openjdk 11.0.3.
I changed the syntax and now I'm able to create a scrambled table. However, when I look at it I see all entries in columns verdictdbtier and verdictdbblock are 0. Is it normal?

If # of rows < 1 million, then it’s expected. There are options (blocksize I remember) to change the behavior.
I believe warnings should disappear for jdk8, which is what we target.


Can load lights independent of models

I can't get this to work. It seems like the number of lights in the light vector is the same as the number of loaded flat models.

Nice catch. Loving working with PRs.
Should be fixed.

14 maj 2016 kl. 15:57 skrev Isakwiberg<EMAIL_ADDRESS>I can't get this to work. It seems like the number of lights in the light vector is the same as the number of loaded flat models.
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub https://github.com/lragnarsson/Emerald-Engine/pull/48#issuecomment-219221733

It's great. We have you to thank for this good workflow =)


Updating swagger for Identity SDK to support kind property

Description
Updating swagger for Identity SDK to the version using kind property in polymorphic identifier model. Regenerated code has no differences as Identity SDK does not use CommunicationUserIdentifierModel directly.
Link to a new swagger spec: https://github.com/Azure/azure-rest-api-specs/pull/19675
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[x] CHANGELOG is updated for new features, bug fixes or other significant changes.
[x] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[x] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[x] Pull request includes test coverage for the included changes.

API change check
API changes are not detected in this pull request.


Create a CLI Client for Rusoto

I'm not sure if this falls under the scope of the Rusoto project, but perhaps we could consider creating a CLI client similar to the client that AWS provides?
That way you could have a tool to do things like: aws ec2 describe-instances.
However I'm not sure if this is worth it since unlike Rusoto, this does not bring an important benefit.
Rusoto provides a set of AWS bindings to Rust, which is important, but having a Rusoto CLI client would only be an improvement over the AWS one in that it's written in Rust (which if fairly nice, admittedly).
Setting it up to be autogenerated and using a library like clap-rs for arg parsing would make it easy to expand.

I don't think this provides enough practical benefit at this point, and is certainly out of scope of the rusoto crate itself. It'd be fine to work on a CLI that uses rusoto, and maybe someday that could be an "official" project in the rusoto org if it seemed important then.


vue-router.esm.js?8c4f:2079 TypeError: window.Vue.use is not a function

It seems not compatible with vuejs 2.6
Screenshots

Desktop (please complete the following information):

OS: Windows 10
Browser Opera & Firefox
Version [e.g. 22]

Additional context
Vuejs: 2.6.10

The problem is not in version, I have already tested with version 2.5 and it works.
How are you importing? Globally or locally?

The problem is not in version, I have already tested with version 2.5 and it works.
How are you importing? Globally or locally?

Thanks for your quick reply.
I imported it in my custom component locally.
It works smoothly sometimes while sometimes not.
for example, I refreshed the page several times then this issue vanished.
at present, i removed the emoji part, everything works well.

Did you use the plugin before the upgrade? I changed some props, in the readme shows the modifications, and you can see the usage example in this new version here: https://codesandbox.io/s/vue-example-emoji-picker-2-746pq

Yes, i checked your example and used it in my project, however, error raised.

i changed the vuejs version in codepen example which runs as expected.

but in my project, it does not. :/

Try change version to 2.0.3 plz


Created a bindable property

  @Bindable var age: Int = 0
  let title: Variable<String>

  init() {
    title = $age.map { "Age: \($0)" }
  }

Instead of
  private let ageSource = VariableSource<Int>(value: 0)
  let age: Variable<Int>
  let title: Variable<String>

  init() {
    age = ageSource.variable
    title = age.map { "Age: \($0)" }
  }

Looks good!
What should the equivalant property wrapper for a ChannelSource be called?

Looks good!
Should there be an equivalant property wrapper for a ChannelSource? If so, what should it be called?

Good question :) not really sure.


Dynamic change data source.

Hello,
Awsome work!
I have one question is it possible to dynamicly change the data source with AngularJS?
I'm getting data from http response and in every change I need to click on the list to see new data.
Thanks for the response :D

Hi! There currently isn't any built-in support for custom data sources. Because multi.js simply mirrors an underlying select element you could probably update the select element with your HTTP request and then trigger the 'change' event to make multi.js refresh itself.
I haven't tried this myself so please report back if you get it working!

@Fabianlindfors I get remote data, put it in a select and then initialize multi() with jQuery. I have 100 items, but at first time only the first item appears in the widget, but when I click it, all the others appear, please see the GIF below. Any idea?