SSL certificate verify failed

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az webapp deployment source config-zip
Errors:
HTTPSConnectionPool(host='*****'.scm.azurewebsites.net', port=443): Max retries exceeded with url: /api/zipdeploy?isAsync=true (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate signature failure (_ssl.c:997)')))

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az webapp deployment source config-zip --resource-group {} --name {} --src {}

Expected Behavior
Environment Summary
Windows-10-10.0.22000-SP0
Python 3.10.10
Installer: MSI

azure-cli 2.47.0

Extensions:
appservice-kube 0.1.7

Dependencies:
msal 1.20.0
azure-mgmt-resource 22.0.0

Additional Context

Thank you for opening this issue, we will look into it.

@NrdWthaPythonScript Apologies for the late reply. Thanks for reaching out to us and reporting this issue. We are looking into this issue and we will provide an update.

@NrdWthaPythonScript Could you please confirm if you are behind a corporate firewall or corporate proxy ? If Yes, this seems to be causing the SSL connection to fail during the certificate check.

Could you please try the same operation from a different reliable network and check if that helps ?

If you want to make the AzCLI work behind a proxy follow this.

If you want to make this work with your Org's proxy then you need to follow the below:

You need to add HTTP_PROXY and HTTPS_PROXY environment variables to the system
Then you need to find certifi path for your AzCLI installation. Default path should be: "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\Lib\site-packages\certifi".
Download your corporate proxy's root certificate and append it to "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\Lib\site-packages\certifi\cacert.pem"

You could try setting the env variable (set AZURE_CLI_DISABLE_CONNECTION_VERIFICATION=1). Not a recommended approach though.

Hope this helps.

@NrdWthaPythonScript I wanted to do quick follow-up to check if you had a chance to look at my above comment. Please let us know if you had any updates on this. Awaiting your reply.

yes I have added the certs to the file

@NrdWthaPythonScript Thanks for your reply. Could you please share the update on Plan 1, Plan 2 and Plan 4 ? Did you try it ? Does that solve your issue ? Also check with your internal network team if they could whitelist the host='*****'.scm.azurewebsites.net', port=443 on the proxy ?  Awaiting your reply.

@NrdWthaPythonScript I wanted to do quick follow-up to check if you had a chance to look at my above comment. Please let us know if you had any updates on this. Awaiting your reply.

@NrdWthaPythonScript The action is pending on you to follow the Plan 1, Plan 2 and Plan 4 mentioned above and share an update. Once you are ready to resume your troubleshooting on this, please feel free to reopen this thread. We would be happy to help.


Option to sync to ConfigMaps as well as Secrets

Hi there,
Thank you for putting this tool together - it's incredibly helpful and works great!
I'm syncing multiple parameters from SSM, some are 'secret' and some are just plain configuration data. To keep things semantically correct, I'd ideally like to sync the plain config data to a ConfigMap instead of a secret.
I'm fairly new to Kubernetes but my understanding at the moment is that ConfigMaps and Secrets are almost the same (Secrets are just base64 encoded for now and may have encryption features added in future). I'm wondering therefore whether it might be possible for this tool to also sync ConfigMap resources, using pretty much the same annotations?

No worries - I haven’t written Go before, but this is probably a good place to start; I’ll try to get around to doing a PR (if no-one else does in the meantime).
Congrats on the new job!

Ok - I got this working on my fork:
https://github.com/cmattoon/aws-ssm/compare/master...tdmalone:master
Fair warning - I'm not a Go programmer. I almost literally copied and pasted the Secret configuration and did a find/replace.
It's working on my test cluster though!
I suspect for a PR you will want a much better job done with much less repetition; I wouldn't know how to go about that in Go but hopefully this helps anyone else who might want to use ConfigMaps in the meantime.

If this could be included, this would be amazing.


Memory address errors on linux x64

Hi, I am using the crystal-language extension as mentioned in the README and set the path to the prebuilt crystalline version that I downloaded from the releases.
Once I start VSCode and hover something, it crashes:
[Info  - 7:31:25 PM] Crystalline LSP server is ready.
Invalid memory access (signal 11) at address 0x0
[0xe755e6] ???
Invalid memory access (signal 11) at address 0x7f5bf8b6d380
[0xd8f6f2] ???
[0x1fab153] ???
[Info  - 7:31:26 PM] Connection to server got closed. Server will restart.
[Error - 7:31:26 PM] Request textDocument/hover failed.
Error: Connection got disposed.
	at Object.dispose (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/main.js:904:25)
	at Object.dispose (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-languageclient/lib/client.js:74:35)
	at LanguageClient.handleConnectionClosed (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-languageclient/lib/client.js:2309:42)
	at LanguageClient.handleConnectionClosed (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-languageclient/lib/main.js:155:15)
	at closeHandler (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-languageclient/lib/client.js:2296:18)
	at CallbackList.invoke (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/events.js:62:39)
	at Emitter.fire (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/events.js:121:36)
	at closeHandler (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/main.js:240:26)
	at CallbackList.invoke (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/events.js:62:39)
	at Emitter.fire (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/events.js:121:36)
	at StreamMessageReader.fireClose (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/messageReader.js:111:27)
	at Socket.<anonymous> (/home/jens/.vscode/extensions/crystal-lang-tools.crystal-lang-0.6.2/node_modules/vscode-jsonrpc/lib/messageReader.js:151:46)
	at Socket.emit (events.js:228:7)
	at Pipe.<anonymous> (net.js:664:12)
[Info  - 7:31:26 PM] Crystalline LSP server is ready

I am using Fedora Linux 32 (x86_64) with Crystal 0.35.1 and VSCode 1.50.1, the Crystal Language extension version is 0.6.2

Hi @Gelbpunkt, thanks for reporting the issue.

Once I start VSCode and hover something, it crashes:

Sorry to read this. I'll try my best to fix the problem, but unfortunately I don't have access to a machine running Linux, so I'll have to guess a bit.
Would you mind trying to run the following code with multithreading enabled and see if it runs fine?
require "compiler/crystal/**"

puts "Main thread: #{Thread.current}"

sources = [
  Crystal::Compiler::Source.new("hello.cr", %(puts "Hello world!")),
]

trigger = Channel(Nil).new
sync = Channel(String).new

Thread.new do
  puts "Thread > #{Thread.current}"
  kill_thread = Channel(Nil).new
  spawn same_thread: true do
    puts "Thread > Spawn on thread: #{Thread.current}"
    begin
      trigger.receive
      puts "Thread > Compiling…"
      compiler = Crystal::Compiler.new
      compiler.no_codegen = true
      puts "Thread > Before compilation."
      result = compiler.compile(sources, "")
      puts "Thread > Compilation done."
      sync.send "Ok: #{!result.nil?}"
    rescue e
      sync.send "Error: #{e}"
    end
    kill_thread.send nil
  end
  kill_thread.receive
end

puts "Main > Waiting…"

trigger.send nil
puts sync.receive

puts "Main > Bye!"

Basically saving the code in a file and running in a terminal:
crystal run file.cr -Dpreview_mt --debug

I am not sure what I should do with this. I started with errors like this:
--: : command not found
Showing last frame. Use --error-trace for full trace.

In crystal/crystal-0.35.1-1/share/crystal/src/llvm/lib_llvm.cr:13:17

 13 | VERSION = {{`#{LibLLVM::LLVM_CONFIG} --version`.chomp.stringify}}
                  ^

which fixed itself after installing llvm-devel (version 10).
It then failed at compiling with this error:
/usr/bin/ld: /home/jens/crystal/crystal-0.35.1-1/share/crystal/src/llvm/ext/llvm_ext.o: in function `llvm::MetadataTracking::track(llvm::Metadata*&)':
llvm_ext.cc:(.text._ZN4llvm16MetadataTracking5trackERPNS_8MetadataE[_ZN4llvm16MetadataTracking5trackERPNS_8MetadataE]+0x42): undefined reference to `llvm::MetadataTracking::track(void*, llvm::Metadata&, llvm::PointerUnion<llvm::MetadataAsValue*, llvm::Metadata*>)'
collect2: error: ld returned 1 exit status
Error: execution of command failed with code: 1: `cc "${@}" -o /home/jens/.cache/crystal/crystal-run-test.tmp  -rdynamic -L/home/jens/crystal/crystal-0.35.1-1/bin/../lib/crystal/lib -lz `command -v pkg-config > /dev/null && pkg-config --libs --silence-errors libssl || printf %s '-lssl -lcrypto'` `command -v pkg-config > /dev/null && pkg-config --libs --silence-errors libcrypto || printf %s '-lcrypto'` /home/jens/crystal/crystal-0.35.1-1/share/crystal/src/llvm/ext/llvm_ext.o `"/usr/bin/llvm-config" --libs --system-libs --ldflags 2> /dev/null` -lstdc++ -lpcre -lm -lgc -lpthread /home/jens/crystal/crystal-0.35.1-1/share/crystal/src/ext/libcrystal.a -levent_pthreads -levent  -levent  -lrt -ldl`

@Gelbpunkt Yes I'm sorry the snippet I posted forces you to compile the crystal compiler from source, which can be complicated.
I think we can tryto reproduce the issue with less accurate but simpler code first:
puts "Main thread: #{Thread.current}"

trigger = Channel(Nil).new
sync = Channel(String).new

Thread.new do
  puts "Thread > #{Thread.current}"
  kill_thread = Channel(Nil).new
  spawn same_thread: true do
    puts "Thread > Spawn on thread: #{Thread.current}"
    begin
      trigger.receive
      puts "Thread > Parsing…"
      GC.collect
      sync.send "Ok"
    rescue e
      sync.send "Error: #{e}"
    end
    kill_thread.send nil
  end
  kill_thread.receive
end

puts "Main > Waiting…"

trigger.send nil
puts sync.receive

puts "Main > Bye!"

While that did not run on a self-compiled crystal 1.0.0-dev:
In test.cr:1:1

 1 | puts "Main thread: #{Thread.current}"
     ^
Error: can't find file 'prelude'

it ran fine on the 0.35.1 release tarball:
Main thread: #<Thread:0x7fb540671f50>
Main > Waiting…
Thread > #<Thread:0x7fb540671af0>
Thread > Spawn #<Fiber:0x7fb5406729a0> on thread: #<Thread:0x7fb540671af0>
Ok
Main > Bye!

Hmm then I was wrong about that piece of code I guess. I was thinking that spawning a thread manually using Thread.new could behave differently in different OSes but it looks like it's working fine.
If it's not too much to ask, could you try building crystalline from source and try with the produced binary instead of using the prebuilt one?

It took a long while due to issues with LLVM again, ended up building crystal from source and then compiling crystalline without shards as that forkbombed itself.
The resulting binary works fine (yay!), so I assume the issue is with the build setup you are using.

It took a long while due to issues with LLVM again, ended up building crystal from source and then compiling crystalline without shards as that forkbombed itself.

The resulting binary works fine (yay!), so I assume the issue is with the build setup you are using.

Sorry you had to go through this, it's a good thing that it worked in the end 👍.
The build system uses an alpine linux docker image to build a static and supposedly portable binary, I will try to check why it is crashing on fedora but without access to a linux machine it's going to be a bit complicated.

Just FYI, I just got the exact same issue on my windows machine, using WSL2

Hi @tducasse, thanks for reporting!
Are you able to build it from sources and run it as well?

Yeah I'll try that today or tomorrow, maybe even try to find a way to fix the dockerfile if I find the time :)

okay so I've tried multiple things, but I basically did not succeed in compiling from sources, but I think WSL might be the issue here, since WSL as a tendency to look like it's working but actually it's not 😬
What I've tried though (in order to fix the Dockerfile that builds the static binary), is building from the official docker image (crystallang/crystal:0.35.1-alpine-build - dockerfile available here), because it looks like it's got all the right deps, using something like:
docker run --rm -it -v $PWD:/app -w /app crystallang/crystal:0.35.1-alpine-build shards build crystalline --release --static --progress --no-debug -Dpreview_mt

This yelled at me telling me that it could not find llvm_ext.o, so I created a Dockerfile to compile it myself (I've docker exec -ti into the container to check that g++ is installed and that the files exist):
FROM crystallang/crystal:0.35.1-alpine-build

RUN g++ -c usr/share/crystal/src/llvm/ext/llvm_ext.cc -I/usr/lib/llvm9/include -o /usr/share/crystal/src/llvm/ext/llvm_ext.o

This goes further, but still fails:
Dependencies are satisfied
Building: crystalline
Error target crystalline failed to compile:
/usr/lib/gcc/x86_64-alpine-linux-musl/9.2.0/../../../../x86_64-alpine-linux-musl/bin/ld: _main.o: in function `~procProc(Nil)@/usr/share/crystal/src/gc/boehm.cr:302':
main_module:(.text+0x6e5d): undefined reference to `GC_set_stackbottom'
/usr/lib/gcc/x86_64-alpine-linux-musl/9.2.0/../../../../x86_64-alpine-linux-musl/bin/ld: _main.o: in function `*Fiber::new<Pointer(Void), Thread>:Fiber':
main_module:(.text+0x770f): undefined reference to `GC_get_my_stackbottom'
collect2: error: ld returned 1 exit status
Error: execution of command failed with code: 1: `cc "${@}" -o /app/bin/crystalline  -rdynamic -static -L/usr/bin/../lib/crystal/lib -lyaml  -lz `command -v pkg-config > /dev/null && pkg-config --libs --silence-errors libssl || printf %s '-lssl -lcrypto'` `command -v pkg-config > /dev/null && pkg-config --libs --silence-errors libcrypto || printf %s '-lcrypto'` /usr/share/crystal/src/llvm/ext/llvm_ext.o `"/usr/bin/llvm-config" --libs --system-libs --ldflags --link-static 2> /dev/null` -lstdc++ -lpcre -lm -lgc -lpthread /usr/share/crystal/src/ext/libcrystal.a -levent_pthreads -levent -lrt`

So now I'm not entirely sure what the problem is, but I think it might be related to this issue about multi threads. Happy to help and delve further into the issue, but keep in mind I'm way out of my league here, as I've not even written my first line of Crystal code yet 🤣

As far as I can tell, this is a known issue with the Dpreview_mt flag, because the crystal devs have come up with a patch that they manually apply when they compile bwdgc, but they don't do it on their alpine version.
There's currently an approved PR solving exactly this issue, and it would most probably allow us to use the previous Dockerfile I linked (crystallang/crystal:0.35.1-alpine-build) and do:
FROM crystallang/crystal:0.35.1-alpine-build

# not sure whether it's llvm10 or 9 here, depends on their Dockerfile
RUN g++ -c usr/share/crystal/src/llvm/ext/llvm_ext.cc -I/usr/lib/llvm10/include -o /usr/share/crystal/src/llvm/ext/llvm_ext.o

Just FYI, I was able to manually compile a static binary using this Dockerfile (inspired by the PR I linked to):
FROM alpine:3.12 as runtime

RUN \
  apk add --update --no-cache --force-overwrite \
    # core dependencies
    gcc gmp-dev libevent-static musl-dev pcre-dev \
    # stdlib dependencies
    libxml2-dev openssl-dev openssl-libs-static tzdata yaml-dev yaml-static zlib-static \
    # dev tools
    make git patch autoconf automake libtool

ARG patch
COPY ${patch} /tmp/feature-thread-stackbottom-upstream.patch

ARG gc_version
ARG libatomic_ops_version
RUN git clone https://github.com/ivmai/bdwgc \
 && cd bdwgc \
 && git checkout ${gc_version} \
 && git clone https://github.com/ivmai/libatomic_ops \
 && (cd libatomic_ops && git checkout ${libatomic_ops_version}) \
 \
 && patch -p1 < /tmp/feature-thread-stackbottom-upstream.patch \
 \
 && ./autogen.sh \
 && ./configure --disable-debug --disable-shared --enable-large-config \
 && make -j$(nproc) CFLAGS=-DNO_GETCONTEXT \
 && make install

# Remove build tools from image now that libgc is built
RUN apk del -r --purge autoconf automake libtool

ARG crystal_targz
COPY ${crystal_targz} /tmp/crystal.tar.gz

RUN \
  tar -xz -C /usr --strip-component=1  -f /tmp/crystal.tar.gz \
    --exclude */lib/crystal/lib \
    --exclude */share/crystal/src/llvm/ext/llvm_ext.o \
    --exclude */share/crystal/src/ext/libcrystal.a && \
  rm /tmp/crystal.tar.gz

# Build libcrystal
RUN \
  cd /usr/share/crystal && \
  cc -fPIC -c -o src/ext/sigfault.o src/ext/sigfault.c && \
  ar -rcs src/ext/libcrystal.a src/ext/sigfault.o

CMD ["/bin/sh"]

FROM runtime as build

RUN \
  apk add --update --no-cache --force-overwrite \
    llvm10-dev llvm10-static g++

RUN g++ -c usr/share/crystal/src/llvm/ext/llvm_ext.cc -I/usr/lib/llvm10/include -o /usr/share/crystal/src/llvm/ext/llvm_ext.o

CMD ["/bin/sh"]

And running:
# build the image, in a folder containing the Dockerfile
# I downloaded the crystal from the official release channel
# and the patch from https://github.com/crystal-lang/distribution-scripts/blob/master/linux/files/feature-thread-stackbottom-upstream.patch
docker build \
--build-arg gc_version=v8.0.4 \
--build-arg libatomic_ops_version=v7.6.10 \
--build-arg patch=./feature-thread-stackbottom-upstream.patch \
--build-arg crystal_targz=crystal-0.35.1-1-linux-x86_64.tar.gz \
-t crystalbuilder .

# build crystalline, in the crystalline folder
docker run --rm -it -v $PWD:/app -w /app crystalbuilder crystal build src/crystalline.cr -o bin/crystalline --static --release --no-debug --progress -Dpreview_mt

Happy to help and delve further into the issue, but keep in mind I'm way out of my league here, as I've not even written my first line of Crystal code yet 🤣

@tducasse Thanks a bunch for investigating, you've done an amazing work!
I will rewrite the alpine Dockerfile to include the GC patch (and I realized that I also forgot the preview_mt flag), which should solve the issue hopefully.

No worries, happy to help 🙂

This still happens on Solus Linux
$ crystal --version
Crystal 1.8.0-dev [fc2250af9] (2023-03-17)

$ shards --version
Shards 0.17.2 [a894d1c] (2022-12-28)

$ llvm-config --version
14.0.6

$ gcc --version
gcc (Solus) 12.2.0
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

$ uname -a
Linux astrolemonade 6.1.5-229.current #1 SMP PREEMPT_DYNAMIC Thu Jan 12 20:29:03 UTC 2023 x86_64 GNU/Linux

I receive this:
Invalid memory access (signal 11) at address 0x7f41e56e4000
[Info  - 1:11:34 AM] LSP server is ready.

Hey @astrolemonade,

This still happens on Solus Linux

I am sorry to read this. I do not have access to a Linux environment so I am afraid I cannot do anything to fix this yet (and the Invalid memory access error is really too generic to infer anything from it).

With the Github release it works.

I guess using docker or similar to build crystalline should also work on any linux distro 🤞.

This still happens on Solus Linux
$ crystal --version
Crystal 1.8.0-dev [fc2250af9] (2023-03-17)

$ shards --version
Shards 0.17.2 [a894d1c] (2022-12-28)

$ llvm-config --version
14.0.6

$ gcc --version
gcc (Solus) 12.2.0
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

$ uname -a
Linux astrolemonade 6.1.5-229.current #1 SMP PREEMPT_DYNAMIC Thu Jan 12 20:29:03 UTC 2023 x86_64 GNU/Linux

I receive this:
Invalid memory access (signal 11) at address 0x7f41e56e4000
[Info  - 1:11:34 AM] LSP server is ready.

@elbywan
Code: the default shard init app code modified to
module Ll
  VERSION = "0.1.0"
  name = "something"
  nickname = "astrolemonade"
  handle = name + "@" + nickname
  puts handle
  print("ha")
end

With the Github release it works.

I could confirm with openSUSE Tumbleweed as well. I am building it inside OBS and I was looking at this issue since I thought I was just paranoid.
Well we can still keep this issue open until there is a solution right?

I tested a non release build of crystalline 0.10.0 and got this errors.
Invalid memory access (signal 11) at address 0x30
Invalid memory access (signal 11) at address 0x0
[0x95eec6] [0x95eec6] *Exception::CallStack::print_backtrace:Nil +118 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x93a436] ~procProc(Int32, Pointer(LibC::SiginfoT), Pointer(Void), Nil) +310 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7fdef381c330] *Exception::CallStack::print_backtrace:Nil +118 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x93a436] ?? +140595544834864 in /lib64/libc.so.6
[0x0] ~procProc(Int32, Pointer(LibC::SiginfoT), Pointer(Void), Nil) +310 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7fdef381c330] ?? +140595544834864 in /lib64/libc.so.6
[0xa710b0] *Crystal::Scheduler#reschedule:Nil +16 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7fdef140bc00] ???

Process crystalline stderr finished
Invalid memory access (signal 11) at address 0x30
Invalid memory access (signal 11) at address 0x0
[0x95eec6] [0x95eec6] *Exception::CallStack::print_backtrace:Nil +118 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x93a436] ~procProc(Int32, Pointer(LibC::SiginfoT), Pointer(Void), Nil) +310 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7f519d8fe330] ?? +139988512531248 in /lib64/libc.so.6
[0xa710b0] *Exception::CallStack::print_backtrace:Nil +118 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x93a436] *Crystal::Scheduler#reschedule:Nil +16 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7f519b5a1640] ~procProc(Int32, Pointer(LibC::SiginfoT), Pointer(Void), Nil) +310 in /home/uncomfy/development/obs/home:uncomfyhalomacro/crystalline/crystalline-0.10.0/crystalline
[0x7f519d8fe330] ?? +139988512531248 in /lib64/libc.so.6
[0x0] ???


Proposal for contract ownership

Me and @codenamejason stumbled on an issue today that highlighted the need for this.

Also, creating PR from a fork since neither me nor Jason have write access to this repo.

Closing this out for now cause this is something which ideally should not be a AIP. We'll make sure we transfer ownership after we launch the final contracts


[tool] Add support for Verible open source verilog style linting

This issue tracks the addition of Verible style-lint to our utility tools and CI. Verible style lint is an open-source style linter which implements rules that are very close to the lowRISC coding style guide.

[x] add build script. note: this requires the bazel build system and GCC7, so it is not planned to make this a mandatory tool requirement for the project.
[x] add run script, potentially with file exclusions to work around current tool issues.
[x] integrate with edalize: https://github.com/olofk/edalize/pull/100
[x] resolve blocking issues from Verible: https://github.com/google/verible/issues/128, to a lesser extent also https://github.com/google/verible/issues/133
[x] integrate into existing makefile-based lint flow (#1906)
[x] integrate into DVSIM (#1727)
[x] add configuration file option to FuseSoC / Edalize (https://github.com/google/verible/issues/133)
[x] find a waiver solution that works for our flow: https://github.com/google/verible/issues/105
[x] decide what to do with lint errors in generated files -> we have a way to waive them now, if needed
[x] remove experimental shell scripts related to Verible in util/
[x] update documentation and explain how Verible can be installed as part of the OT tooling
[x] integrate into CI
[ ] extend DVSIM to support structured output from Verible (#1727, https://github.com/google/verible/issues/257)

Also look at the related Ibex issue https://github.com/lowRISC/ibex/issues/579 which is a good testbed for this change, since the codebase is much smaller.

@msfschaffner can you update this issue description which verible issues which are blocking us making progress?

Updated. The main two blockers are google/verible#105 and google/verible#128, the rest should be relatively straightforward once those features are in.

Forgot to add this one here to the list of potentially blocking issues due to style discrepancies:
https://github.com/google/verible/issues/133
The rules affected are few, for instance the style of localparam / parameter is slightly different from the OT style.

Verible lint is now enforced in Ibex, all blockers have been removed; the ot branch in lowrisc/edalize (which we use in OT as well) has necessary patches to enable waivers (https://github.com/olofk/edalize/pull/178).

It looks like we are close to being able to enforce this on the master branch of opentitan as well:
https://reports.opentitan.org/hw/top_earlgrey/lint/veriblelint/summary.html
I'll take a crack at things on the opentitan side later this week.

@msfschaffner We probably can consider that done? The structured output isn't a blocker.

Yeah let's close this issue down. I think the structured output is mentioned in the dvsim issue as well, so we still have it tracked somewhere.


ISSUE-1226 Apply weighted average to Storm latency metrics

apply weighted average to both aggregating streams and aggregating time period
add unit tests

@arunmahadevan You may feel easier to determine the change based on newly added tests.

@arunmahadevan Thanks for reviewing. Addressed your comment.

+1


Feature Request: do not apply certain policies to selected users/groups/service accounts

Is your feature request related to a problem?
This is a feature request, based on a conversation happened on slack.

Hi! that's an interesting question.
The user name, uid, and groups are present on the userInfo  key of the admissionReviews that come from k8s apiserver, so it's possible, but AFAIK right now we don't have any policy written by the Kubewarden team that makes use of it.
It could be doable by writing a policy, running Rego policy or a Kyverno one (experimental still) in Kubewarden. (edited)
At the moment we as team plans to have the following fields to be part of settings of every policy
policy_not_applied_to_groups, policy_not_applied_to_service_accounts
Both of these are arrays. In our implementation, we compare these with the validationRequest.Request.UserInfo.Groups and validationRequest.Request.UserInfo.Username. If it matches we simply do kubewarden.AcceptRequest(). Else, we do the other validation and accepts requests only if the validations pass.
I want to know if there are other ways to do this without mentioning the groups or ids in the settings (edited)

Solution you'd like
No response
Alternatives you've considered
No response
Anything else?
No response

I like the 3rd option in terms of the control that the admins get. But in my view this sensitive data. So I would sugggest a way where this data is not part of any of the git commits. The key of this data can be used as part of the policy but the value itself should be configured inside the server, where data is pulled from a external secret.

Yes, the implementation of the policy that checks for the trusted users/groups/service accounts is entirely up to the policy author. We could of course provide a reference implementation.
There could be different ways to feed this data (the allow list) into the policy. Doing that by hard coding the values inside of the policy would be the worse way.
A simpler approach would be to leverage the policy settings. Basically this data would be read specified inside of the ClusterAdmissionPolicy / AdmissionPolicy yaml.
Another option would be to make this policy context aware and read the allow list from a specific Configmap or Secret.
I would personally prefer the settings route because:

Policy definition + configuration stays in the same place. When using a Secret/Configmap there's a layer of indirection
I don't think this data is confidential, hence worth of a Secret. Keep in mind that you can remove read access to the ClusterAdmissionPolicy/AdmissionPolicy resources via RBAC. Users won't be able to see their configuration options if you want to
Context-aware policies hit the Kubernetes API. Sure, we do some caching, but this could increase the load on the API server if your policy is invoked often. In this case, given the previous points. I don't think this is worth.

Again, this is my personal taste. You could write your own policy that works in a different way :)

I would go for option 3#


Inserter near not inserting near.

In 5dim_automatization_0.17.2, the following inserters have "insert_position" and "pickup_position" defined in 2 locations.
inserter-speed1-range1-close.lua
inserter-speed1-range1.lua
inserter-speed1-range2-close.lua
inserter-speed1-range2.lua
inserter-speed2-range1.lua
inserter-speed3-range1-close.lua
inserter-speed3-range1.lua
For most of them, I don't think it's causing any issues, since the values are the same, but for inserter-speed1-range1-close.lua the 2nd instance has the wrong value in insert_position which is causing the inserter to insert in the normal position instead of the near position.
Line 39/40
pickup_position = {0, -1},
insert_position = {0, 0.8},
Line  179/180
pickup_position = {0, -1},
insert_position = {0, 1.2},

#96 will fix this.

This issue has been fixed with the pull request accepted.


Revert "Revert "server: introduce ServerMetricRecorder API and move per-call reporting from a C++ interceptor to a C-core filter (#32106)" (#32272)"

PR #32106 caused msan errors in some tests while de-referencing the
server object where async calls are active after the server is
destroyed. Instead cache the ServerMetricRecorder pointer.

Please cherry-pick this change in case of a second revert.


⚠ Bofrost.es has degraded performance

In b609084, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1524 ms

Resolved: Bofrost.es performance has improved in 0f667b2 after 13 minutes.


[Bug]: Invalid Mapping Javascript Object using Extended

Expected Behavior
open the window with the values for each pdf field, with the option to download the finished product
Current Behavior
red error banner:

Steps to Reproduce

Use the dnd5ev11extended
Open a player character sheet and select export to pdf
choose the extended 5e character sheet file

Context
No response
Version
0.24.9
Foundry VTT Version
10.239
Operating System
Windows
Browser / App
Microsoft Edge
Game System
DnD 5 2.0.3
Modules Disabled

[ ] I can confirm that disabling all of my other modules doesn't fix this issue.

Unless I'm mistaken or things have changed, the last I heard, the "broken" part of this is well known at least on Reddit.
Something IS broken, no one has fixed it, it's been reported, and the only work around is to delete all the languages on the character sheet for the PC in Foundry. Then...it exports just fine.


The channel-like reads can behave like await

With the introduction of channel-like mapping macros, variable reads can now fail. That is, we are able to add await-like semantics to read.
This has a particular effect on the aborting semantics of either branches - now not only can you abort an either branch by typing await, you can also do this by reading a variable. Our ArchetypeResource interface does not support this result of a read operation - we would need to add at least a second return value to the read operation indicating that the read has failed (kind of like would-block semantics in POSIX socket programming). We also need to ensure that channel-like reads revert properly under abort conditions: since reading can pop a value off a queue (that is, mutate the context in some way), we need to ensure that this operation is undone on aborts.
Current status: fix later, we will not support this until we get our MVP working. Reads outside of either statements will block, and (archetype parameter) reads inside either statements will fail at compile time. We should however take care to avoid design decisions that will make the above modifications unreasonably hard.

Closing since this is an old discussion.


Rendering of IEV term source broken

Clause 3 term reference to the IEV leads to a broken rendering.
Source:
[.source]
<<ievterms,clause=102-03-19>>, Note 1 has been modified. Note 2 has been added.

Rendered as:

It should probably render as "([B1], 102-03-19, modified...)"
Originally posted by @ReesePlews in https://github.com/metanorma/metanorma-ieee/issues/337#issuecomment-1935871185

Markup error.
By default, <<ref,clause=1-2>> is interpreted as the range clause 1 to 2. To prevent such an interpretation, the clause designation needs to be put in quotes, so it is interpreted as a unitary entity: <<ref,clause="1-2">>
Most examples in documentation put the clause in quotes, but I'm seeing that one or two don't; and an expression with two hyphens cannot reasonably be interpreted as a range anyway. I am going to fix the examples and  add a note that the quotes are needed; but I'm also going to emend input  to treat a clause reference of type a-b-c as not a range anyway.


[closes #58] Create ProcessBuilderExecutor and run container through it

Tests passed.
Does not tested on aix.

I think that class InputStreamConsumerThread is too complicated. I would transform all possible "output objects" to either OutputStream or Writer and use only one method to write. You duplicate some code. Then your class can have only one main constructor and other constructors only prepare proper "output object". What do you think?

Refactored and tested.


[BUG] "Open In in Sagemaker Studio Lab" button process fails when attempting to "Copy Notebooks Only"

Describe the bug
Cloning a single notebook using the "Open In in Sagemaker Studio Lab" fails.  Cloning the whole repo works.
Using sagemaker's sample, https://github.com/aws/studio-lab-examples/tree/main/open-in-studio-lab, I get this error:
Unable to copy notebook to project.
The link to this notebook is broken or blocked. If this is a private GitHub notebook, sign in to GitHub before copying the notebook.aws/studio-lab-examples/blob/main/natural-language-processing/NLP_Disaster_Recovery_Translation.ipynb

To Reproduce
Steps to reproduce the behavior:

create MD cell with [![Open in SageMaker Studio Lab](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/aws/studio-lab-examples/blob/main/natural-language-processing/NLP_Disaster_Recovery_Translation.ipynb)  and run it
Click on the button that appears once you run the cell.  Will open new tab in browser
In the new pop up tab, click "Copy to Project".  Will open new tab in browser
In the new pop up tab's modal, select "Copy Notebook Only"
Error will now appear

Expected behavior
My notebook will open and appear, just as it would with cloning a directory
Screenshots

Desktop (please complete the following information):

OS: [Windows 11]
Browser [Chrome]
Version [97.0.4692.71]

Interesting - this works fine on my end, but I'm using a Mac. I'll create a ticket for you.

[


Split address into implicit and contract address

Problem
Currently, address is assumed to be an implicit address. But now that we're adding contracts, an 'address' could also be a contract address. But most places of the code that talk about addresses currently really mean to talk about implicit addresses.
Solution

Move Protocol.Address into Protocol.Address.Implicit. Then, almost everywhere that references Protocol.Address should now reference Protocol.Address.Implicit.

Rename Address_and_ticket_map to Implicit_address_and_ticket_map

Move Contract_hash.re from Tezos to Crypto.

Requesting @EduardoRFS's review because I'd like to get a change like this merged on the main branch ASAP (if it's a good change). Once the PR is approved here, I'll re-make it for the main branch

@Zett98

we probably should have balance on contracts to comply with tezos, as people can send tez directly to contract

probably, but it's outside the scope of this PR

maybe Deku_address.t and Contract_address.t?

good point, I'm not sure the names I chose are good

@anchpop in general this design is not great.

Address.Implicit.t

This type is both conceptually and in implementation identical to Key_hash.t, which makes most of this change noise.

Also Contract_hash is not a crypto thing, it should not be moved to Crypto.

@anchpop why not make this patch to main?

@anchpop why not make this patch to main?

Done

Correct me if i'm wrong but i think that we need to create separate key_hash for deku which is just ed25519 wrapped in abstract type with dz1 prefix(used for validators and implicit accounts). And contract_hash which is a hash of the operation and it's type should be abstract.

I think I spoke about this with @EduardoRFS and he said to just use tz1/kt1 for the prefixes

@EduardoRFS LGTM, do the patches address the comments you left?


feat: table of content copilot-12238

A table of content is designed to enhance the usability and navigation of our content. This feature provides users with a structured and accessible way to navigate through various sections of a story, especially long-form articles, improving the overall user experience and engagement. It will make it easier for users to find specific sections or information quickly.
It also encourages readers to explore more content by providing them easy access to different parts of our content.

Lets have the annotation name as well as filename etc be table-of-contents (contents plural vs singular )

thats not consistent with the rest of the files and names

@copilot-robot prerelease


Add make artifacts command to makefile

This command is used for releases (see #100)
Do not merge until #99 is merged

/hold

/lgtm

/hold cancel

/lgtm

@ahg-g the rebase removed the lgtm unfortunately


Add 'Not started' to progress and 'No decision' to decision radio buttons

As an analyst
I want to be able to correct my mistaken radio button selection
so that it doesn't cause errors in reporting and confusion in managing the application assessment process
Acceptance Criteria:

[x] new radio button labelled 'Not started' exists at the top of the Progress radio buttons on each assessment page.  Set this by default

[x] new radio button labelled 'No decision' exists at the top of the decision radio buttons (where exists) on each assessment page.  Set by default

[x] If 'No decision' selected for Decision radio buttons on any assessments then the table of assessments is blank for the decision column

[x] If progress = 'Not started' on any of the assessment pages then table of assessment shows 'Not started'

Technical notes:

[x] make sure that the logic for the table of assessments still works the same as it used to for all the other progress and decision radio buttons

I can't quite test the last two acceptance criteria as the 'Save' button on all the assessment pages does not seem to work.  After selecting any of the radio buttons or choosing an analyst or setting the due date, I click save.  When I go back to assessments table, no changes show there and when I go back to that assessment the changes did not save.  Even uploads do not save.  Do we need a separate bug ticket for this?  No one has reported this in prod yet.

I can't quite test the last two acceptance criteria as the 'Save' button on all the assessment pages does not seem to work.  After selecting any of the radio buttons or choosing an analyst or setting the due date, I click save.  When I go back to assessments table, no changes show there and when I go back to that assessment the changes did not save.  Even uploads do not save.  Do we need a separate bug ticket for this?  No one has reported this in prod yet.

Actually I don't think it's anything to worry about, everything is working fine locally, in dev and I believe in prod. Though I think we may have broke test when fixing the assessments the other day, we will see what we can do about the data tomorrow.

looks good, well done!


Merge Discovery

This is probably an API break as I do not have json dumps to ensure things are working. If model is not determined when reading from the API and had elements force set, those could be lost.

Convert discovery to determine deviceIds to add during discovery
Move all discovery code into a single pipeline
Update lights to support on/off, brightness, and color temps (I dont believe RBG was configurable in the current setup)
Create a new call to hubspace that can update multiple attributes in a single call
( #71  ) Fix Zandra Fans being unable to control lights
Cleanup a bunch of unused code after the migration
Fix an issue where auto-discovery would not discovery fans

This is currently running against my Zandra fan. The light works as expected but there are changed needed to the fan as the speed is off (0%) or on (20%) and I cannot adjust it from there. This issue existed prior to my changes.

@jdeath Have you been able to take a look at this?

I haven't yet. I'll be away for a few more days. Did you do a read me update to go with breaking change?

This may or may not be a breaking change. I was not sure how to support RGB so that functionality doesnt work. I would need to take another look at the code to see if HubSpace has any RGB lights and review previous code on that too.
Do you have a sample of RGB lights to reference so I can write some tests to ensure they still work?

Closing since #86 is now open.


⚠ Bofrost.lu has degraded performance

In 1fe9aa9, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1369 ms

Resolved: Bofrost.lu performance has improved in 5510790 after 6 minutes.


Add ffi test cases

@qur786 Keep a check the GH actions status. The build was running an infinite loop consuming too many resources (> 4 hrs):

@qur786 When you want to pass a reference-to-an-object as an input argument, use object.ref() instead of refNAPI.refType(object).
Have fixed some tests. Try to fix others via the same approach of turning refNAPI.refType(object) ==> object.ref() where applicable.

@qur786 Let me know once it is ready for review, also try to make the CI green

@qur786 Let me know once it is ready for review, also try to make the CI green

Sir it is actually ready , the CI is failing because we have imported InchiInpData but commented out the test which uses InchiInpData.so it is failing due to not using the above function.

@qur786 In that case, remove that import and trigger the CI again.

@qur786 In that case, remove that import and trigger the CI again.

@maneetgoyal Sir I commented out the import and now it is passing


The resource groups cannot be searched

Storage Explorer Version: 1.26.0-dev
Build Number: 20221006.3
Branch: feature branch
Platform/OS: Windows 10/Linux Ubuntu 22.04/MacOS Monterey 12.6 (Apple M1 Pro)
Architecture: ia32/x64
How Found: From running test cases
Regression From: Previous release (1.26.0)
Steps to Reproduce

Launch Storage Explorer.
Click the Filter button -> Make sure the 'Resource Groups (Disks)' option is selected.
Type a resource group name to the search box -> Execute 'Search'.
Check whether the resource group is searched.

Expected Experience
The resource group is searched.

Actual Experience
The resource group is not searched.

Verified this issue on the build 20221028.4. Fixed.


“Unknown stream file type” error on launch

I get the following error “Error: Implement me. Unknown stream file type!” on launch, I saw this in 0.80.0 and 0.81.0.

This occurs when launching from Finder or from the atom command line helper.
The application is non functional after this error :cry:.
/cc #1333

Gonna close this out - please feel free to reopen / comment if you can reproduce this with the latest version of Atom (0.210.0)


Make storage_formats independent from a concrete storage format

We currently expose different query compilers in the initialization file of the storage_formats module (see here). That induces importing storage format specific modules and can rise an error with library incompatibility like we have for OmniSci in #3774. So we should make storage_formats independent from a concrete storage format.

@YarShev is this still relevant? https://github.com/modin-project/modin/pull/4374 removed PyArrow from there to experimental, so the non-experimental storage_formats exposes only pandas StorageOptions, which seems somewhat fine for me.

I think this is still relevant because storage_formats directory still exposes the specifics of the storage formats. I would prefer we expose such the things (QC, parsers, etc.) in the concrete storage format directories (base, pandas, etc.).


get employee request list/details BE

fields

email
employee_type
status
...

filter by

email
status
tax_id

Blocked by edenlabllc/ehealth.api#3857


Run android with error ERR_UNHANDLED_ERROR

Hello everyone
when i run android i get error

Error [ERR_UNHANDLED_ERROR]: Unhandled error. ({})
at Compiler.emit (node:events:504:17)
at Worker. (/Users/nguyen.van.bac/Documents/pana_semp_mobile/SEMP_SHEM/packages/host/node_modules/@callstack/repack/dist/webpack/Compiler.js:110:14)
at Worker.emit (node:events:515:28)
at MessagePort. (node:internal/worker:263:53)
at [nodejs.internal.kHybridDispatch] (node:internal/event_target:810:20)
at exports.emitMessage (node:internal/per_context/messageport:23:28) {
code: 'ERR_UNHANDLED_ERROR',
context: {}
}

after that app is on splash screen forever

I see this issue and dont have any way to fix it. Does anyone have any solution?

@sun-nguyen-van-bac  how do you have fixed this issue?

@sun-nguyen-van-bac
How did you solve this issue?


青龙安装提示警告出错

WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
已尝试：
apk add --no-cache --virtual .build-deps gcc musl-dev python2-dev python3-dev libffi libffi-dev openssl openssl-dev
pip3 install pip setuptools --upgrade
pip3 install cryptography~=3.2.1
依然提示：WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

同样的问题，关注

同样的问题，关注

其他地方找到说明了，无视即可，实测也正常使用，这个更像是警告，但是实际安装上了。


add middlware for secure browser headers

Same as phoenix behaviour. https://github.com/phoenixframework/phoenix/blob/d02621e106a9420167e7152f88f0cc4ab57a7785/lib/phoenix/controller.ex#L975-L990
Note the headers are simply default values
use Raxx.SecureBrowserHeaders
# OR
use Raxx.DefaultHeaders [
  {"x-frame-options", "SAMEORIGIN"},
  {"x-xss-protection", "1; mode=block"},
  {"x-content-type-options", "nosniff"}
]

QUESTION: should this live as it's own package or part of a Raxx.Browser pack?

https://github.com/CrowdHailer/raxx/commit/a6e33f5dbd9b9344753b43c5d4eb4cbf838bdddf


How to insert line break?

I use it like this
with WhatsApp() as bot:
    for person in recipients:
        bot.send(person, f'Hello {person}\nNew line test')

But then the messages were split into 2 separate messages. I know that the Enter key is the send key in WhatsApp Web. That's why I ask here, how to insert a line break? Thank you

Thank you for raising this issue.
Earlier this used to work. But today I checked, it is working no more. I don't know why.
In WhatsApp Web SHIFT  + ENTER goes to new line. I know this and had implemented in my code.
See this.
It is working while done manually, but inside the script, it seems not to work.

Actually, I had made a small mistake. I am solving this now.

I fixed this issue just now.
Please update the package in your computer.
pip install --upgrade wappdriver

Now your same code would do the work. 😇
You don't have to do anything to your code. 😊☺🙂🙃. Just update the package, and everything will work fine.
Thanks a lot for reporting this. There was a small mistake in my code, which is now fixed.

Please update the package, test it once and say me if it is working as expected.

Thank you so much! Now it works perfectly. Do you mind telling me what did you change and how it fixes the issue? I'm still learning Python, so if you could explain it, I would really appreciate it. Thanks in advance!

you can understand simply by seeing my commit e9b44d921f9444fd1422fad51179433daf0c6ed6
i just removed a tab :smile:
it was a silly mistake from my part

One more thing, thank you so much for creating this. I was having trouble understanding Selenium and then I found your article on DEV.  Now I can just open up Python and run your script, rather than messaging them one by one with some little editing in between.

This is offtopic, for chatting with me, please use Telegram @aahnikdaw

That was the main purpose of creating this package. To let people not worry about selenium, chrome driver, selectors, etc, and allow people to easily send messages.
In the future, I will build a command-line version, where you can easily send messages, without even writing any python code.
If you are interested in Python and automation, you may see my Telegram Channel, where I post interesting stuff.

I'll be waiting for it, thanks for the information!


issue-metrics test 22 (roi-dashboard)

Description
Some description
Spec
What it do. Acceptance criteria and all that.
Copilot Prompts
A few statements or questions for Copilot
Target Date:  📆

Example: branch
Custom branch link test: issue-798

Branch: issue-798


Scheduling tags must be a yaml list

@nuwang Is there a yaml syntax checker? If not that could be a good thing to add to tpv.
One additional thing is that I don't think tpv complains if the destinations don't exist, I'll try to make an issue out of that.


When building with node-pre-gyp, the system libgeos_c is used

The node-pre-gyp build uses the system installed libgeos_c library even if it carries and builds its own copy of libgeos
This is the reason the build fails on systems which do not have it

Published to NPM - thanks!


Can't post route param along with the form data.

My application has dynamic routes (dynamic route param), in which it contains redux form .In order to distinguish the form data,I need to post redux form data along with the react route param .
I have passed the react route param as props from the parent component to the child component having the redux form i.e,initialvalues in props has the param value.I want to initialize the route param to the input fied with hidden type.But the resultant data is as below.Help is much appreciated.Thanks in advance

Please ask for usage support on StackOverflow.

I like the idea of a community based forum for questions, it seems that StackOverflow is not that active, nor the Gitter channel, a lot of users are sensing that and I am trying to help as much as I can. Where is everyone? I've heard there is also a Slack channel, are there more traction there? Thanks!

Sorry @ernani, we don't have any official channels actually.
We just prefer to keep usage support isolated from enhancements suggestions/bug fixing.
The usual suggestion of StackOverflow is one most people know about and is quite popular, so you could get a good answer there.


Nessus Import Incorrect Severity

Hello,
We've been testing DefectDojo for managing Nessus imports. I've noticed that the Severity seems to be acting weird. It seems to take the values from the Nessus scan correctly, but not display them correctly. If I then go to edit the finding, it will have the right settings and then saving it without making changes it displays as it does according to the Nessus report. As an example, this finding is marked in Nessus as a 9.8 - Critical, but is showing in DefectDojo findings as a 9.8 High:

If I then go and edit it, it has critical as the severity rating:

And then saving that without making any changes to what was already there changes it to a critical:

Is this expected behaviour? It seems odd.

We seem to have the exact same issue: A finding marked in Nessus as HIGH was imported in DefectDojo as MEDIUM. Changing the finding in DefectDojo showed the right severity (HIGH). Re-saving the finding without modifying any fields would update the severity back to the correct one.

it has been a while, for me this is not relevant anymore and I don't have access to a sample file either, sorry. Hopefully @AmenoBars can help out

I managed to reproduce this with existing unittests, but thank you anyway. :-)

could you close this issue please @mtesauro ?


Style does not propagate to child upon 'viewEncapsulation.None' : Angular 4

Bug, feature request, or proposal:
Bug
What is the expected behavior?
Style should propagate to child as per Angular 4 design
What is the current behavior?
Style does not propagate to child as per Angular 4 design
What are the steps to reproduce?
https://plnkr.co/edit/apNNPrUpRn8M65DJTUMd?p=preview
What is the use-case or motivation for changing an existing behavior?
I have a component (i.e. main) and used , inside it's  I have given the reference of another component that should render its content, not the I want the DIV tag to have its width as 100%, but upon giving that parameter, it does not affect the width at all, looks like the style does not propagate to child, I even tried view encapsulation as None but this also does not work, But if I use  and the  inside it, all in one component, the width and height works as expected.
My plnkr link shows this behavior.
https://plnkr.co/edit/apNNPrUpRn8M65DJTUMd?p=preview
Here, grid-list-dynamic-example.html has , inside which, I have  and the content of this tile referring to another component , I have  as width : 100% into other component's html template : grid-tile-div.html, but the result shows the width of Div stays as per the content inside it (depicted by white background color)
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
Angular Core - 4.2.4
Material - 2.0.0-beta.11
OS - Mac
TypeScript: 2.1.1
Is there anything else we should know?
If I add following css to grid-tile-div's css, it takes 100% width,
:host{
width: 100%;
}
This issue can be closed if this is the expected way of doing this.

I'm a little bit confused with your issue:

You want the child component to inherit the width from its parent's style, right?
If so, how do you expect it to get its width set to 100% from the parent if you set the width inside the component (at least it's like this in your plunk)?

Maybe what you want to do is define a class inside a component, and want it to be available to its parent...? In that case, you should set encapsulation to none: https://plnkr.co/edit/k12GqL85cYxmhj8vPLbz?p=preview

If I add 'div' with width as 100%, and add that inside the  with-in the same component, it works and div is displayed with 100% width -

   ****

But if I define grid-tile in one component, and try to get it's content to display from another component by copying the same div, this time the width is not 100% (this is shown in my plnkr)

    ****

here grid-tile-div is another component, which has html template as
Although, what you suggested is what I wanted to achieve, I was able to do it using ':host' style as well, still my question was to know if  should obey its style in second scenario as well.

Yeah... the ViewEncapsulation.None makes your css class globally defined. Personally, I think it must be used carefully. The using of :host seems like a less out-of-control way to do what you want. Stick with it.

Please keep GitHub issues for bug reports / feature requests. Better avenues for troubleshooting / questions are stack overflow, gitter, mailing list, etc.


What should zip: true do?

I'm not sure whether I understood it correctly. Consequently I can't figure out whether it's working like it should.
My settings in serverless.yml are:
custom:
  pythonRequirements:
    dockerizePip: non-linux
    zip: true

When looking at the zip file created by serverless deploy inside the .serverless folder, I find a copy of my venv folder. I'd expect that this folder is replaced by a zipped version? Or at least the site-packages folder. So essentially setting zip: true didn't reduce the unzipped version of the zip file uploaded to AWS Lambda. Therefore I keep exceeding the 250 MB limit.
 It took me ages to figure out the virtual environment folder should be excluded in serverless.yml.


Add MongoDB Target Support

Description

Add support for MongoDB target with unit testing

Add MongoCellTarget targeting a field in a single document
Add MongoRangeTarget targeting a field in a list of documents

Motivation and Context

Use MongoDB as a backend for task execution
Have you tested this? If so, how?

I have included unit testing with local MongoDB database. tox -e py27-nonhdfs mongo_test.py looks good. It needs  a local mongo instance running.
We use a sightly different implementation in production since almost 2 years for our tasks. Everything works just fine.

Possible Issue and implementation choice

The mongo queries used here and here might be too heavy. A solution is be to make them execute as batch but I was not sure it is needed in this PR.
I choosed to pass the pymongo client as a parameter intead of instanciating it in the constructor. This allow the client to choose how to handle the connection to mongoDB. Having a new instance at each constructor might lead to creating too many connection pools.

@dlstadther
The commit 23534be fix the Flake8 and doc syntax.
I also followed the pattern in Postgres Test in order to skip the unit test if there is not local mongo db instance running. That should make all the travis test pass.
Unfortunately, I can not use mongomock cause it does not fully support $project yet.
Concerning the reviewers, I do not know anyone using luigi and mongo except my coworkers whom already internally reviewed this code.

@MathiasDesch I agree that i'm not sure the current py34-cdh error is caused by your code - i'd still like to get some insight from @Tarrasch or someone regarding this error.
Regarding reviewers, since this is a contrib module which doesn't currently exist (and thus community impact is minimal), I have no problems merging if no one else reviews in the next few days.

@dlstadther Sounds good to me! :)

LGTM. Ignore the py34-cdh error.

@dlstadther No reviewer seems to show up. I guess we can merge.


DB2W modules expects catalog sources are missing

as part of CP4D, the catalog sources are missings
https://www.ibm.com/docs/en/cloud-paks/cp-data/4.0?topic=ccs-creating-catalog-sources-that-automatically-pull-latest-images-from-entitled-registry
Step 1 and Step 2 are missing

Fixed the issues with the code updates in the Create.yaml


Add to bower

Any chance you could add this to bower?
Thanks,
Cathal.

+1

Pull request created for this

request merged. It'll soon be available to Bower.

This package has now been added to bower.
You can install it by running bower install --save--dev slackapi-angularjs

Thanks for merging that in @nickaranz. I'm just wondering what you use to generate the "build" folder? You'll have to do this every time changes are made to the files within the "src". Otherwise people will be using the older version.


Address deprecation warnings about quoted references

Deprecation warnings are currently thrown because of quoted references to the ibm.vpc and ibm.powervs providers. The recommendation since terraform 0.12.14 is to remove any quotations. [0]
[0] https://discuss.hashicorp.com/t/terraform-0-12-14-released/3898

LGTM <3

Thanks for this patch @mjturek


load weights

Hello, load_weights.py is throwing an error saying:
KeyError: "Unable to open object (object 'model_weights' doesn't exist)"
can you please let me know @zcrwind  or upload the pytorch weights itself?

Hi while running train.sh, data_utils.py throwing an error as bellow:
File "/home/teleoperation/PredNet_pytorch/data_utils.py", line 139, in dataLoader
image_dataset = SequenceGenerator(self.data_file, self.source_file, self.args.num_timeSteps, self.args.shuffle, None, self.output_mode, self.sequence_start_mode, self.N_seq, self.args.data_format)
File "/home/teleoperation/PredNet_pytorch/data_utils.py", line 51, in init
varName = resList[0]
IndexError: list index out of range


Unable to save models to custom path

What is the issue?
I update my ollama.service file at /etc/systemd/system/ollama.service as below by adding the environment variable OLLAMA_MODELS so that I can have ollama download and save the models in a different location. By default it saves models in /usr/share/ollama/.ollama/models.
[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/local/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
Environment="OLLAMA_MODELS=/home/rattle/Downloads/LLMs/OllamaModels"

[Install]
WantedBy=default.target

I then changes the directory ownership by sudo chown -R ollama:ollama <directory> as can be seen below
rattle@loq:~/Downloads/LLMs/OllamaModels$ ls -lah
total 8.0K
drwxrwxr-x 2 ollama ollama 4.0K Nov 24 01:43 .
drwxrwxr-x 3 ollama ollama 4.0K Nov 24 01:43 ..

then a standard systemctl daemon-reload followed by systemctl restart ollama.
But upon checking the service I get the error below
sudo systemctl status ollama
● ollama.service - Ollama Service
     Loaded: loaded (/etc/systemd/system/ollama.service; enabled; preset: enabled)
     Active: activating (auto-restart) (Result: exit-code) since Mon 2024-11-25 01>
    Process: 61176 ExecStart=/usr/local/bin/ollama serve (code=exited, status=1/FA>
   Main PID: 61176 (code=exited, status=1/FAILURE)
        CPU: 21ms

OS
Linux
GPU
Nvidia
CPU
Intel
Ollama version
0.4.4

Small update:
Works when I run with OLLAMA_MODELS=/home/rattle/Downloads/LLMs/OllamaModels ollama serve, it downloads to the correct directory, but it's not running as a service this way. The service file should work, what's causing the error?

The  server ollama runs as user ollama, and doesn't have access to your Downloads directory because the permissions of /home/rattle prevent it.  You can either loosen the permissions (chmod a+x ~) or add ollama to your group: sudo usermod -a -G $USER ollama.


Added MoonScript, a language that compiles to Lua

The author does use GitHub releases, however there is a hash value (I believe a commit hash) used on the download URLs so I'm not sure how to properly set up autoupdate on this one.

(Specifically, this is a compiler and a basic linter.)

I think that's a good start. Thank you.


fix: secondary index range

The bug is related to the formation of secondary keys, which were created from the primary keys in cases where the secondary key is not unique.
The problems encountered in this issue https://github.com/vincent-herlemont/native_db/issues/208 show that this causes a problem when trying to scan with an inclusive range. This is because the secondary key concatenated with the primary key is always greater than the inclusive range (and falls outside the interval). To address this problem, I attempted to implement a byte delimiter by setting one byte to 0 when creating the key, and adding a byte set to 255 when creating the inclusive range. Since 255 is always greater than 0, the inclusive range will have the correct values.

The solution described in this comment was not good GitHub link, because in all cases, a bug could appear by shifting the bytes—see the test: test_low_level_scan_range. So, it was not a good solution.
The adopted solution is to use MultimapTable to manage secondary indexes, which avoids concatenating keys and provides a much more stable solution.
An automatic migration was also coded so that users do not have to do anything and no data is lost.

:tada: This PR is included in version 0.8.0 :tada:
The release is available on:

0.8.0
GitHub release

Your semantic-release bot :package::rocket:


Update dependencies to fix security issue in base64

Updating dependencies, to fix this RUSTSEC: https://github.com/RustSec/advisory-db/blob/master/crates/base64/RUSTSEC-2017-0004.toml
It would be nice if you would publish a new version on crates.io.

Looks good.  Thanks.


Use more threads for saving images

Previously we had 8 threads hardcoded to perform the saving of images.
For a set of 600 paths this took around 10 minutes on a 32 core machine.
Updating the thread count to match the number of cores our processor
resulted in a 3.5 minute runtime for the same set of paths.
This change should also help performance on machines with less than
eight cores as we'll have less communication overhead and saving an
image consumes an entire CPU core anyways.

I'm not sure why 8 was chosen initially, i'm guessing it may be due to websites throttling clients? So long as you're not scraping other peoples websites then I can't see a problem in going over 8 if you have enough cores available.
If you think it would be more appropriate to have the option user customisable then let me know and I can add a configuration option to achieve this!

I've made another PR #412 where i've added the option for this to be set, I think this is a better solution than hardcoding to the number of processors available as in my testing around 1.5x available CPUs yielded the best performance.
Closing, see: #412


Simple saveAsTable not working

Wanted to try this out : https://twitter.com/jaceklaskowski/status/1220780404652826625?s=21
I'm using Spark 2.4.2 (built with Scala 2.12) and Hive 1.x and Delta Lake 0.5.0 OSS
I'm running spark-shell as follows :
 ./spark-shell   --packages io.delta:delta-core_2.12:0.5.0 --conf spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension
I'm just running the following line :
spark.range(10).write.format("delta").option("path", "/bench/delta").saveAsTable("delta")
And I get the following error :

20/01/30 14:32:46 WARN hive.HiveExternalCatalog: Couldn't find corresponding Hive SerDe for data source provider delta. Persisting data source table default.delta into Hive metastore in Spark SQL specific format, which is NOT compatible with Hive.
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: hdfs://company-server:8020delta-PLACEHOLDER
at org.apache.hadoop.fs.Path.initialize(Path.java:205)
at org.apache.hadoop.fs.Path.(Path.java:115)
at org.apache.hadoop.fs.Path.(Path.java:93)
at org.apache.spark.sql.hive.HiveExternalCatalog.saveTableIntoHive(HiveExternalCatalog.scala:488)
at org.apache.spark.sql.hive.HiveExternalCatalog.createDataSourceTable(HiveExternalCatalog.scala:399)
at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$createTable$1(HiveExternalCatalog.scala:265)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:97)
at org.apache.spark.sql.hive.HiveExternalCatalog.createTable(HiveExternalCatalog.scala:236)
at org.apache.spark.sql.catalyst.catalog.ExternalCatalogWithListener.createTable(ExternalCatalogWithListener.scala:94)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createTable(SessionCatalog.scala:324)
at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:185)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.doExecute(commands.scala:122)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:80)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:80)
at org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:676)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:78)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:676)
at org.apache.spark.sql.DataFrameWriter.createTable(DataFrameWriter.scala:474)
at org.apache.spark.sql.DataFrameWriter.saveAsTable(DataFrameWriter.scala:453)
at org.apache.spark.sql.DataFrameWriter.saveAsTable(DataFrameWriter.scala:409)
... 49 elided
Caused by: java.net.URISyntaxException: Relative path in absolute URI: hdfs://company-server:8020delta-PLACEHOLDER
at java.net.URI.checkPath(URI.java:1823)
at java.net.URI.(URI.java:745)
at org.apache.hadoop.fs.Path.initialize(Path.java:202)
... 78 more

From the tweet, even with the SerDe warn, it seemed to be working but from my side I get an error because of the path apparently ?
The exact same line of code works when replacing format("delta") with format("parquet").
Any help appreciated

Hive-metastore-defined Delta tables do not work in OSS Delta yet, because Delta Lake expects all the table metadata (schema, etc.) to be read from the Delta log, not from the table definition in the Hive metastore. This requires very custom handling of table metadata when writing/reading table definitions in Hive metastore. Spark 2.4 does not have the APIs to add those customization for a specific data source like Delta. Those APIs will be released with Spark 3.0, so the first delta release on Spark 3.0 will have support for tables (DDLs, etc.) defined in Hive metastore.

#85 tracks metastore support

Support for saveAsTable and general table support has been merged into master.


Query parameter enums are generated as Strings

raml like this:
#%RAML 1.0
title: Query parameter enums are generated as Strings #291

/bus:
  get:
    queryParameters:
      brandName:
        type: string
        enum: [Volvo, Scania]

will generated method where brandName is a String.
BrandName enum will be generated but not referenced.
If brandName is a data type enum will be referenced as it should be.

Despite limitation explained above I'll fix:

enum query parameter defined as string
@Valid annotation missing from interface in case of Spring4ControllerDecoratorRule


Refactoring Transport once more (aspnetcore 2.1)

Hi @chkr1011  im planning to adapt the Connection abstraction of aspnetcore 2.1 for mqttnet. these abstractions provide a unified way to handle tcp, tls and websockets.
common:
https://github.com/aspnet/KestrelHttpServer/blob/dev/src/Connections.Abstractions/ConnectionContext.cs
tcp:
https://github.com/aspnet/KestrelHttpServer/blob/dev/src/Kestrel.Transport.Sockets/Internal/SocketConnection.cs
websocket:
https://github.com/aspnet/SignalR/blob/dev/src/Microsoft.AspNetCore.Http.Connections/Internal/Transports/WebSocketsTransport.cs
I see two ways of integration. What would you prefere?
Option 1: Implement IMqttServerAdapter, IMqttChannelAdapter for tcp in MQTTnet.AspnetCore (that depends on aspnetcore already just need to increment version to 2.1 once released)
Option 2: remove IMqttChannel, IMqttChannelAdapter, ... and let MQTT.Net depend on Kestrel
what I expect from the change:

perf boost
less errors

A hard dependency on Kestrel might be too much for some use cases (not all of them use Kestrel).
But as long as we can still plug in our own adapters, I won't mind too much... :-)

Depending on kestrel for a client-only use case would seem odd. I know @chkr1011 doesn't want to split the library on client / server though.

lets see what the aspnet comes up with.
client side story should be supported in 2.2.
also I could instead just depend on https://github.com/aspnet/KestrelHttpServer/blob/dev/src/Connections.Abstractions and copy the code for the implementations so there is no dependency on kestrel. but I dont really like that approach as it negates the advantage of having the code maintened by the aspnet team

We could fork and submodule kestrel code

@chkr1011 can you give me some feedback pls 2.1 is final and I would like to start experimenting over the weekend

@JanEggers To me option 1 is the best because one of the principles of this library is to be independent from 3rd party libs. I know that we already have dependencies to WebSocket libs but at least they belong to .net. I am also not sure if kestrel is supported for UWP!? Is there a way to support 2.0 as well? I don't know if everyone will directly migrate to 2.1. Probably support for 2.0 is still required.

Kestrel is netstandard so it should run on uwp but i never tested that myself. the lowest dependency to take is system.io.pipelines that runs on netstandard 1.3 and above. also if we depend on system.io.pipelines we are not tight to kestrel but need to implement the pipeline our own.
I will first provide some benchmarks to measure the difference between a pipeline and the current channel design.

my first results look good! for both cases it is 10000 chunks with 5 bytes each, just transport no serializer or adapter stuff just transport

Method
Mean
Error
StdDev
Gen 0
Allocated

existing
331.6 ms
6.786 ms
13.24 ms
3000.0000
12.07 MB

pipe
3.064 ms
0.0328 ms
0.0307 ms
85.9375
356.15 KB

100x faster and 3% of memory usage

as the pr is merged ill close this

@chkr1011 thx again for merging this, and your optimization efforts. I am really happy with the results!
I ran the MessageProcessingMqttConnectionContextBenchmark and with that new transport and the other optimizations I can transfer 10000 the messages in 15ms instead of 450ms meaning we are at 600K msg/sec thats amazing!

Wow 600K is very fast. Hopefully still with some required fixed for the ThreadStatic topic etc.


Scope is not always a string

When trying to work with Linear OAuth I found this check. Linear returns a list back, not a string and thus the parse fails.
I'm not clear on need to check for scope at this stage, but maybe consider supporting a list of strings?

Hi there!
Looks to me like the Linear API doesn't properly follow the OAuth2 specification.
For one, Linear expects the scope parameter to contain comma-separated scopes, when the OAuth2 spec asks for space-separated scopes. That means that you'll probably run into issues when using the authorization code grant like getAuthorizationUri({ scope: ['scopeA', 'scopeB'], as oauth2_client will follow the spec and join those scopes with a space character. This part is easily circumvented by joining the scopes yourself using , before passing them to getAuthorizationUri.
The OAuth2 spec also expects the access token response's scope value to follow the same space-separated format as above.
Right now this module doesn't support any other formats and to keep things simple (and spec-compliant) I'd rather keep it that way by default. What would be possible is to allow users of the module to customize/override these checks in cases like these where the authorization server doesn't follow the spec.
Do you think that would be a good solution to this issue?

Yea, that would be a reasonable outcome. Someway to customize the behavior for misbehaving servers.

I'm now working on extending this module to also support OpenID Connect out of the box. The proposed changes also open up the OAuth2 Grant classes for extension, making it possible to override the validation behaviour of the default AuthorizationCodeGrant to account for things like non-spec conformant scope values.
If you want to try it out, you can import the WIP version from https://raw.githubusercontent.com/cmd-johnson/deno-oauth2-client/feature/oidc/mod.ts!
You'd probably have to create a new class like this, extending the AuthorizationCodeGrant:
class LinearAuthorizationCodeGrant extends AuthorizationCodeGrant {
  protected async parseTokenResponse(
    response: Response,
  ): Promise<
    { tokens: Tokens; body: AccessTokenResponse & Record<string, unknown> }
  > {
    // copy the validation logic from https://github.com/cmd-johnson/deno-oauth2-client/blob/feature/oidc/src/authorization_code_grant.ts#L156-L211 and modify the scope validation logic
  }
}

After that you should be able to use it like this:
const linearAuthorizationCodeGrant = new LinearAuthorizationCodeGrant({
  /* the same config as when calling new OAuth2Client() /*
});
// now use the linearAuthorizationCodeGrant instance like you use oauith2Client.code


PLR0912: branches inside with statement not counted

PLR0912(too-many-branches) does not count branches inside with:  blocks.

This seems like an easy fix which is to just include the Stmt::With in this function:
https://github.com/astral-sh/ruff/blob/868bbd4de6e193352d2d9a44be2f323a0887dd51/crates/ruff_linter/src/rules/pylint/rules/too_many_branches.rs#L88-L88
And then to add some test cases.


Issue installing /running db-sync

OS
Your OS:
AWS Linux aim 2 ( related to Cent OS )
Versions
The db-sync version (eg cardano-db-sync --version):
PostgreSQL version:
N/a for db-sync version
Build/Install Method
The method you use to build or install cardano-db-sync:
nix-build -A cardano-db-sync -o db-sync-node
Run method
The method you used to run cardano-db-sync (eg Nix/Docker/systemd/none):
Did not make it that far
Additional context
Add any other context about the problem here.
I have been following the instructions provided by https://github.com/input-output-hk/cardano-db-sync/blob/master/doc/building-running.md  and followed the instructions at https://github.com/input-output-hk/cardano-node/blob/master/doc/getting-started/building-the-node-using-nix.md#iohk-binary-cache to build the cardano-node to improve speeds with Binary Cache. the cardano node is running in a terminal  and seems to have been successfully syncing for the last several hours.
When I try to run the  nix-build -A cardano-db-sync -o db-sync-node command when setting up the db-sync node I run into an error:
trace: To make project.plan-nix for haskell-project a fixed-output derivation but not materialized, set `plan-sha256` to the output of the 'calculateMaterializedSha' script in 'passthru'.
trace: To materialize project.plan-nix for haskell-project entirely, pass a writable path as the `materialized` argument and run the 'updateMaterialized' script in 'passthru'.
trace: WARNING: 8.8.2 is out of date, consider using 8.8.4.
trace: Checking materialization in /nix/store/i369k44ks1r4pwd7znr2pqvncx2nl06z-source/materialized/bootstrap/ghc882/happy-1.19.11
trace: WARNING: 8.8.2 is out of date, consider using 8.8.4.
It will keep repeating the WARNING and Checking Materialization until it gets a segmentation fault.
I have cannot seem to figure out what is out of date, as running sudo yum update indicates everything is up to date. using Linux Aim 2 as the OS, I believe it is almost the same as CentOS.

nix-build seems to be up to date being version 2.3.15 however when I try running ‘sudo yum update nix-build’ I get a failure:
repodata/repomd.xml from docker-ce-stable: [Errno 256] No more mirrors to try.
https://download.docker.com/linux/centos/2/aarch64/stable/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found

If you had any ideas what might be causing this I would greatly appreciate your assistance.
I'll try a more traditional linux distribution for now to see if that works better.
Problem Report
Please do not include screenshots or images, but instead cut and paste any relevant log messages
or errors.

Getting nix-build from the CentOS Yum repository is the likely issue. Nix is actually a an OS overlay, available at  https://nixos.org/ .

Is this with the stable version of nix?  If you run nix-build --version it should look like this if it is the stable version:
$ nix-build --version
nix-build (Nix) 2.3.12

The unstable version looks like this:
$ nix-build --version
nix-build (Nix) 2.4pre20210601_5985b8b

It would be interesting to know if the issue is resolved by switching to the latest stable version.  I switch back and forth with:
nix-env -f '<nixpkgs>' -iA nix

and
nix-env -f '<nixpkgs>' -iA nixUnstable

Nix flakes are only supported in the unstable version, but I seem to get the occasional segfault with it.

After trying `````````````` I still get
nix-build -A cardano-db-sync -o db-sync-node trace: To make project.plan-nix for haskell-project a fixed-output derivation but not materialized, set plan-sha256to the output of the 'calculateMaterializedSha' script in 'passthru'. trace: To materialize project.plan-nix for haskell-project entirely, pass a writable path as thematerialized argument and run the 'updateMaterialized' script in 'passthru'. trace: WARNING: 8.8.2 is out of date, consider using 8.8.4. trace: Checking materialization in /nix/store/i369k44ks1r4pwd7znr2pqvncx2nl06z-source/materialized/bootstrap/ghc882/happy-1.19.11 trace: WARNING: 8.8.2 is out of date, consider using 8.8.4.
with the WARNING and 'Checking materialization' repeating until a segmentation fault

Have you tried with installing Nix with the official installer?

It seems that the install script provided in the IOHK documentation uses the official installer, correct?
Josh Matthews
@.***
On Oct 10, 2021, at 12:41 PM, Timothy DeHerrera @.***> wrote:

Have you tried with installing Nix with the official installer https://nixos.org/download.html ?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/input-output-hk/cardano-db-sync/issues/879#issuecomment-939532052 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AIN6DRIV62ELLZ4LHCSE35DUGHM4RANCNFSM5FV6RGMA .
Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub . https://github.com/notifications/beacon/AIN6DRI3PSHDE62KQNOGLZDUGHM4RA5CNFSM5FV6RGMKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOHAAB6FA.gif

Is this possibly an issue with GHC? ghc --version returns ghc: command not found. Cannot seem to find any documentation on installing or updating ghc in Cent OS

If you are using Nix, you should be using the GHC from Nix, not the one installed by the host OS.
If you are not using Nix, the GHC in CentOS is likely to be too old.

I believe the issue was using an ARM architecture server, everything seems to have build properly after switching to x86_64 and using a tagged release, thank you!

@Jmatt512 Is this issue resolved? Can it be closed?


Build(deps-dev): Bump @typescript-eslint/parser from 5.33.1 to 5.34.0 (#3928)

Pull request opened by the merge tool on behalf of #3928

Merged in 84efd4ff8200bd4e69e89293ba232f990b55cb17


Drops are failing

Set drops to npc with sentinel trait.
Verify the drops are there after closing inventory graphical user interface.
Kill sentinel.
No drops.

Do you perhaps have any plugins/scripts that disable death drops for anything?
I replaced the old "forceful" drop code with just replacing the events' drops with the correct items.

Was confirmed on IRC to be a plugin fault - either way, added a workaround option to the config for this :) https://github.com/mcmonkey4eva/Sentinel/commit/20a2bd5675b542ee294315641f154fa4c632a76a


Is there a way to void scrolling when press space key?

I'm using the react package, and I want to make user can pan the div while holding the Space key and drag the div element. but the infinite-viewer just scrolls.
Is there a way to make the viewer do not scroll when the space key is pressed?

same

You need to use event listener
onKeyStroke(' ', (e) => {
    console.log('space')
    e.preventDefault()
}, { eventName: 'keypress' })

Listen for space keypress and prevent default behaviour.
this is vue code with VueUse library. Find hotkey library for react of use native event listeners


Support the installation of Microsoft office

Microsoft office is the dependency of jchemforoffice #3785 and jchemforofficelite #3796 .
Package Requested
Manifest:
Fill out as much of the manifest as you can:
Id: Microsoft.office
Publisher: Microsoft
Name: office
Version: string # version numbering format
License: copyright (c) microsoft
InstallerType: string # enumeration of supported installer types (exe, msi, msix, inno, wix, nullsoft, appx)
Installers:
  - Arch: x64
    Url: string # path to download installation file
    Sha256: string # SHA256 calculated from installer
# ManifestVersion: 0.1.0

I do not belive Microsoft Office have a download link, as a user you're supposed to download it from your portal which also links the license to the installer, in business they use Microsoft Office Deployment to make a installer without a license.
From looking at Chocolatey they extract Microsoft Office Deployment and runs it with a config file that defines the version of Office they want, then they run the installer. Which is a bit too advanced for WinGet at the moment.

If winget installs office in this way, this 2 issues should be solved.
extract archive file: microsoft/winget-cli#140
support config file: #246

Looks like Microsoft.Office was just added in https://github.com/microsoft/winget-pkgs/pull/9416

Thanks for commenting here @akoeplinger. I'll go ahead and close this issue.


Transient test error - java.sql.SQLIntegrityConstraintViolationException

Ran into this test failure case while building locally
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.599 sec <<< FAILURE! - in io.druid.metadata.SQLMetadataSupervisorManagerTest
testInsertAndGet(io.druid.metadata.SQLMetadataSupervisorManagerTest)  Time elapsed: 0.599 sec  <<< ERROR!
org.skife.jdbi.v2.exceptions.CallbackFailedException: org.skife.jdbi.v2.exceptions.UnableToExecuteStatementException: java.sql.SQLIntegrityConstraintViolationException: The statement was aborted because it would have caused a duplicate key value in a unique or primary key constraint or unique index identified by 'SQL160506204201978' defined on 'DRUIDTEST7CB9E3D334F949E0B23A8BE51C7EAFE8_SUPERVISORS'. [statement:"INSERT INTO druidTest7cb9e3d334f949e0b23a8be51c7eafe8_supervisors (id, spec_id, version, payload) VALUES (:id, :spec_id, :version, :payload)", located:"INSERT INTO druidTest7cb9e3d334f949e0b23a8be51c7eafe8_supervisors (id, spec_id, version, payload) VALUES (:id, :spec_id, :version, :payload)", rewritten:"INSERT INTO druidTest7cb9e3d334f949e0b23a8be51c7eafe8_supervisors (id, spec_id, version, payload) VALUES (?, ?, ?, ?)", arguments:{ positional:{}, named:{id:'test-supervisor-1_2016-05-06T20:42:01.963Z',payload:[123, 34, 116, 121, 112, 101, 34, 58, 34, 84, 101, 115, 116, 83, 117, 112, 101, 114, 118, 105, 115, 111, 114, 83, 112, 101, 99, 34, 44, 34, 105, 100, 34, 58, 34, 116, 101, 115, 116, 45, 115, 117, 112, 101, 114, 118, 105, 115, 111, 114, 45, 49, 34, 44, 34, 100, 97, 116, 97, 34, 58, 123, 34, 107, 101, 121, 49, 45, 49, 34, 58, 34, 118, 97, 108, 117, 101, 49, 45, 49, 45, 51, 34, 44, 34, 107, 101, 121, 49, 45, 50, 34, 58, 34, 118, 97, 108, 117, 101, 49, 45, 50, 45, 51, 34, 125, 125],spec_id:'test-supervisor-1',version:'2016-05-06T20:42:01.963Z'}, finder:[]}]
	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
	at org.apache.derby.impl.sql.execute.IndexChanger.insertAndCheckDups(Unknown Source)
	at org.apache.derby.impl.sql.execute.IndexChanger.doInsert(Unknown Source)
	at org.apache.derby.impl.sql.execute.IndexChanger.insert(Unknown Source)
	at org.apache.derby.impl.sql.execute.IndexSetChanger.insert(Unknown Source)
	at org.apache.derby.impl.sql.execute.RowChangerImpl.insertRow(Unknown Source)
	at org.apache.derby.impl.sql.execute.InsertResultSet.normalInsertCore(Unknown Source)
	at org.apache.derby.impl.sql.execute.InsertResultSet.open(Unknown Source)
	at org.apache.derby.impl.sql.GenericPreparedStatement.executeStmt(Unknown Source)
	at org.apache.derby.impl.sql.GenericPreparedStatement.execute(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedPreparedStatement.execute(Unknown Source)
	at org.skife.jdbi.v2.SQLStatement.internalExecute(SQLStatement.java:1328)
	at org.skife.jdbi.v2.Update.execute(Update.java:56)
	at io.druid.metadata.SQLMetadataSupervisorManager$1.withHandle(SQLMetadataSupervisorManager.java:88)
	at io.druid.metadata.SQLMetadataSupervisorManager$1.withHandle(SQLMetadataSupervisorManager.java:83)
	at org.skife.jdbi.v2.DBI.withHandle(DBI.java:281)
	at io.druid.metadata.SQLMetadataSupervisorManager.insert(SQLMetadataSupervisorManager.java:81)
	at io.druid.metadata.SQLMetadataSupervisorManagerTest.testInsertAndGet(SQLMetadataSupervisorManagerTest.java:99)

👍  We are also getting this in our builds
18:45:11 Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.606 sec <<< FAILURE! - in io.druid.metadata.SQLMetadataSupervisorManagerTest
18:45:11 testInsertAndGet(io.druid.metadata.SQLMetadataSupervisorManagerTest)  Time elapsed: 0.603 sec  <<< ERROR!
18:45:11 org.skife.jdbi.v2.exceptions.CallbackFailedException: org.skife.jdbi.v2.exceptions.UnableToExecuteStatementException: java.sql.SQLIntegrityConstraintViolationException: The statement was aborted because it would have caused a duplicate key value in a unique or primary key constraint or unique index identified by 'SQL160505184511998' defined on 'DRUIDTEST15FEBC9BC5E34E7288D782EA04CA87C7_SUPERVISORS'. [statement:"INSERT INTO druidTest15febc9bc5e34e7288d782ea04ca87c7_supervisors (id, spec_id, version, payload) VALUES (:id, :spec_id, :version, :payload)", located:"INSERT INTO druidTest15febc9bc5e34e7288d782ea04ca87c7_supervisors (id, spec_id, version, payload) VALUES (:id, :spec_id, :version, :payload)", rewritten:"INSERT INTO druidTest15febc9bc5e34e7288d782ea04ca87c7_supervisors (id, spec_id, version, payload) VALUES (?, ?, ?, ?)", arguments:{ positional:{}, named:{payload:[123, 34, 116, 121, 112, 101, 34, 58, 34, 84, 101, 115, 116, 83, 117, 112, 101, 114, 118, 105, 115, 111, 114, 83, 112, 101, 99, 34, 44, 34, 105, 100, 34, 58, 34, 116, 101, 115, 116, 45, 115, 117, 112, 101, 114, 118, 105, 115, 111, 114, 45, 49, 34, 44, 34, 100, 97, 116, 97, 34, 58, 123, 34, 107, 101, 121, 49, 45, 49, 34, 58, 34, 118, 97, 108, 117, 101, 49, 45, 49, 45, 51, 34, 44, 34, 107, 101, 121, 49, 45, 50, 34, 58, 34, 118, 97, 108, 117, 101, 49, 45, 50, 45, 51, 34, 125, 125],spec_id:'test-supervisor-1',id:'test-supervisor-1_2016-05-05T18:45:11.980Z',version:'2016-05-05T18:45:11.980Z'}, finder:[]}]
18:45:11 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
18:45:11 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.IndexChanger.insertAndCheckDups(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.IndexChanger.doInsert(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.IndexChanger.insert(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.IndexSetChanger.insert(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.RowChangerImpl.insertRow(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.InsertResultSet.normalInsertCore(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.execute.InsertResultSet.open(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.GenericPreparedStatement.executeStmt(Unknown Source)
18:45:11 	at org.apache.derby.impl.sql.GenericPreparedStatement.execute(Unknown Source)
18:45:11 	at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
18:45:11 	at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
18:45:11 	at org.apache.derby.impl.jdbc.EmbedPreparedStatement.execute(Unknown Source)
18:45:11 	at org.skife.jdbi.v2.SQLStatement.internalExecute(SQLStatement.java:1328)
18:45:11 	at org.skife.jdbi.v2.Update.execute(Update.java:56)
18:45:11 	at io.druid.metadata.SQLMetadataSupervisorManager$1.withHandle(SQLMetadataSupervisorManager.java:98)
18:45:11 	at io.druid.metadata.SQLMetadataSupervisorManager$1.withHandle(SQLMetadataSupervisorManager.java:83)
18:45:11 	at org.skife.jdbi.v2.DBI.withHandle(DBI.java:281)
18:45:11 	at io.druid.metadata.SQLMetadataSupervisorManager.insert(SQLMetadataSupervisorManager.java:81)
18:45:11 	at io.druid.metadata.SQLMetadataSupervisorManagerTest.testInsertAndGet(SQLMetadataSupervisorManagerTest.java:99)

Will investigate.

@drcrallen @pjain1 hm, seems like your computers are too fast, slow them down :P
The supervisors table uses the current time as part of the primary key, and when the test creates two entries in quick succession they are getting the same timestamp and thus conflicting. We could put in some logic to handle this, but I don't think this scenario would ever come up outside of a test (the rules table also uses the current time in the same way and I don't think we've had any issues with this), so it might make more sense to just throw some sleeps into the test to ensure we get different timestamps unless someone feels strongly against this.

@dclim Is it possible to use a latch instead of sleeps? Sleeps can be funky in travis and cause more transient errors, although with a large enough sleep it is usually pretty good

@dclim relying on ms time has bitten us in the past. If you can add a UUID or hostname or something in there it should help eliminate the potential for two machines in the cluster to do something in the same ms (or what they think is the same ms)

@drcrallen fair enough, I don't really see any significant issues with adding a uuid to the primary key so I'll do that


Remove padding from identifiers and add it back in as needed

Putting = in identifiers was a side effect of base64 encoding. This PR attempts to hide them from the user while not functionally changing the identifier scheme. Fix #860

+1. Thanks @david4096 for nipping this issue in the bud!

Looks good @david4096. It would be nice to see some unit tests for this behaviour. Say, cook up some strings that would be URL unsafe under the standard alphabet and verify that we convert the correctly?

Seconding @jeromekelleher 's comments

Update with test @jeromekelleher @dcolligan

Updated @jeromekelleher

Can you rebase this and squash the commits please @david4096? I think it's ready to go in. Whether we decide the schema should specify this or not, I think the server should return URL safe IDs.

@jeromekelleher squashed

+1
Looks like we're out-of-date again. Can you rebase and merge please?