"Get http://localhost:9200/: dial tcp [::1]:9200: getsockopt: connection refused"

Output of go version:
go version go1.6.2 linux/amd64

Output of docker version:
Client:
 Version:       17.12.1-ce
 API version:   1.35
 Go version:    go1.9.4
 Git commit:    7390fc6
 Built: Tue Feb 27 22:17:40 2018
 OS/Arch:       linux/amd64

Server:
 Engine:
  Version:      17.12.1-ce
  API version:  1.35 (minimum version 1.12)
  Go version:   go1.9.4
  Git commit:   7390fc6
  Built:        Tue Feb 27 22:16:13 2018
  OS/Arch:      linux/amd64
  Experimental: false

Output of docker info:
Containers: 2
 Running: 0
 Paused: 0
 Stopped: 2
Images: 20
Server Version: 17.12.1-ce
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 9b55aab90508bd389d7654c4baf173a981477d55
runc version: 9f9c96235cc97674e935002fc3d78361b696a69e
init version: 949e6fa
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.4.0-116-generic
Operating System: Ubuntu 16.04.4 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 15.66GiB
Name: localhost.localdomain
ID: J3ZY:ZUU7:SW6Y:QTFY:6LUH:LFYF:7NVD:J2AO:2YW4:55K6:G252:DT3A
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
 <IP_ADDRESS>/8
Live Restore Enabled: false

WARNING: No swap limit support

Additional environment details (AWS, VirtualBox, physical, Docker For Mac, Docker Toolbox, docker-machine, etc.):
Clean ubuntu 16.04 install on dedicated server. Only Malice is installed according instructions. I reinstalled the server several times, once with a ubuntu 14 version with the same result.  No errors
Run the first scan, everything is fine (malice scan sample.exe)
Reboot the system
Now when I run a scan it fails with the error below

Results:
ERRO[0000] "Get http://localhost:9200/: dial tcp [::1]:9200: getsockopt: connection refused"
goroutine 1 [running]:
github.com/maliceio/malice/malice/errors.CheckErrorWithMessage(0xdf02a0, 0xc420329d10, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/Users/user/src/go/src/github.com/maliceio/malice/malice/errors/errors.go:24 +0x7d
github.com/maliceio/malice/malice/errors.CheckError(0xdf02a0, 0xc420329d10, 0xc4203ae200)
/Users/user/src/go/src/github.com/maliceio/malice/malice/errors/errors.go:12 +0x62
github.com/maliceio/malice/malice/database/elasticsearch.InitElasticSearch(0x0, 0x0, 0x1, 0x1)
/Users/user/src/go/src/github.com/maliceio/malice/malice/database/elasticsearch/elasticsearch.go:124 +0x68
github.com/maliceio/malice/commands.ScanSample(0x7ffdb3b7e841, 0xe)
/Users/user/src/go/src/github.com/maliceio/malice/commands/scan.go:58 +0x46f
github.com/maliceio/malice/commands.cmdScan(0x7ffdb3b7e841, 0xe, 0x0, 0xc420380000, 0x0)
/Users/user/src/go/src/github.com/maliceio/malice/commands/scan.go:22 +0x35
github.com/maliceio/malice/commands.glob..func1(0xc4202f7680, 0x0, 0xc4202f7680)
/Users/user/src/go/src/github.com/maliceio/malice/commands/commands.go:25 +0x8a
github.com/maliceio/malice/vendor/github.com/urfave/cli.HandleAction(0x9c9220, 0xade028, 0xc4202f7680, 0xc420380000, 0x0)
/Users/user/src/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/app.go:485 +0xd4
github.com/maliceio/malice/vendor/github.com/urfave/cli.Command.Run(0xab9204, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0, 0xabcf9f, 0xb, 0x0, ...)
/Users/user/src/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/command.go:207 +0xb72
github.com/maliceio/malice/vendor/github.com/urfave/cli.(*App).Run(0xc42005dba0, 0xc420074090, 0x3, 0x3, 0x0, 0x0)
/Users/user/src/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/app.go:250 +0x7d0
main.main()
/Users/user/src/go/src/github.com/maliceio/malice/main.go:88 +0x584
2018/03/17 20:23:18 Head http://localhost:9200/malice: dial tcp [::1]:9200: getsockopt: connection refused
Additional information you deem important (e.g. issue happens only occasionally):
I do not get the system working again until a system reinstall of ubuntu.

Hi there,
I have some additional info. The issue looks like #57. But ram is not the issue on the system:
free -m
total        used        free      shared  buff/cache   available
Mem:          16038         101       15679          11         257       15648
Swap:          3904           0        3904
I tried the 2GB version of elasticsearch without avail (gives a different error, probably out of memory).
Docker command gives the following:
malice@localhost:~$ docker run --rm -v /var/run/docker.sock:/var/run/docker.sock \

            -v `pwd`:/malice/samples \
            -e MALICE_VT_API=$MALICE_VT_API \
            malice/engine -D scan ccsetup539.exe

DEBU[0000] Malice config loaded from: /malice/config/config.toml
DEBU[0000] config.toml version: v0.3.2, malice version: dev
DEBU[0000] Malice plugins loaded from plugins/bindata.go
DEBU[0000] Using 8 PROCS
DEBU[0000] Malice Version: dev, commit none, built at unknown
DEBU[0000] Running inside Docker...
DEBU[0000] Connected to docker daemon client             ip=localhost port=2375
DEBU[0000] Searching for container: malice-elastic       env=development
DEBU[0000] name:  malice-elastic   container.Name:  hungry_newton
DEBU[0000] MATCH:  false
DEBU[0000] name:  malice-elastic   container.Name:  malice-elastic
DEBU[0000] MATCH:  true
DEBU[0000] Container FOUND: malice-elastic               env=development
DEBU[0000] Elasticsearch is running.                     image="malice/elasticsearch" ip= network=default
DEBU[0000] Attempting to PING to: http://elasticsearch:9200
ERRO[0000] "Get http://elasticsearch:9200/: dial tcp: lookup elasticsearch on <IP_ADDRESS>:53: no such host"
goroutine 1 [running]:
github.com/maliceio/malice/malice/errors.CheckErrorWithMessage(0x563fd4ae08c0, 0xc420436540, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/maliceio/malice/malice/errors/errors.go:24 +0x92
github.com/maliceio/malice/malice/errors.CheckError(0x563fd4ae08c0, 0xc420436540, 0x0)
/go/src/github.com/maliceio/malice/malice/errors/errors.go:12 +0x64
github.com/maliceio/malice/malice/database/elasticsearch.InitElasticSearch(0x0, 0x0, 0x1, 0x1)
/go/src/github.com/maliceio/malice/malice/database/elasticsearch/elasticsearch.go:124 +0x6a
github.com/maliceio/malice/commands.ScanSample(0x7ffd78327f39, 0xe)
/go/src/github.com/maliceio/malice/commands/scan.go:58 +0x45e
github.com/maliceio/malice/commands.cmdScan(0x7ffd78327f39, 0xe, 0x0, 0xc42033a000, 0x0)
/go/src/github.com/maliceio/malice/commands/scan.go:22 +0x37
github.com/maliceio/malice/commands.glob..func1(0xc4202e1900, 0x0, 0xc4202e1900)
/go/src/github.com/maliceio/malice/commands/commands.go:25 +0x8c
github.com/maliceio/malice/vendor/github.com/urfave/cli.HandleAction(0x563fd4724660, 0x563fd4807de8, 0xc4202e1900, 0xc42033a000, 0x0)
/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/app.go:485 +0xd6
github.com/maliceio/malice/vendor/github.com/urfave/cli.Command.Run(0x563fd43c213b, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0, 0x563fd43c5eea, 0xb, 0x0, ...)
/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/command.go:207 +0xb98
github.com/maliceio/malice/vendor/github.com/urfave/cli.(*App).Run(0xc42009f860, 0xc42000c180, 0x4, 0x4, 0x0, 0x0)
/go/src/github.com/maliceio/malice/vendor/github.com/urfave/cli/app.go:250 +0x814
main.main()
/go/src/github.com/maliceio/malice/main.go:88 +0x54a
2018/03/18 09:28:39 Head http://elasticsearch:9200/malice: dial tcp: lookup elasticsearch on <IP_ADDRESS>:53: no such host
RUnning scan in debug as follow:
malice@localhost:~$ malice -D scan ccsetup539.exe
DEBU[0000] Malice config loaded from: /home/malice/.malice/config/config.toml
DEBU[0000] config.toml version: v0.3.11, malice version: 0.3.11
DEBU[0000] Malice plugins loaded from: /home/malice/.malice/plugins/plugins.toml
DEBU[0000] Using 8 PROCS
DEBU[0000] Malice Version: 0.3.11, commit 9e7f91e08345f227b4ddfe3690bc5ee52d1c6feb, built at 2017-07-22T23:52:36Z
DEBU[0000] Running inside Docker...
   15 minutes ago      Exited (143) 13 minutes ago                          malice-elastic
ffdbd1d97c4a        malice/kibana:5.5      "/docker-entrypoint.…"   13 hours ago        Created                       <IP_ADDRESS>:80->5601/tcp   malice-kibana
The Elasticsearch website report this is an access issue, but I am not sure where to change the access
https://discuss.elastic.co/t/i-am-getting-an-error-when-i-tried-to-restart-elasticsearch-service/44726/6
I hope this helps

The Docker-IN-Docker version of malice is currently broken.  Did you also try the binary or deb install?

Did you run this part?
echo "vm.max_map_count=262144" | sudo tee -a /etc/sysctl.conf
sudo sysctl -w vm.max_map_count=262144

It really sounds like ES is running out of memory.  I wonder if Docker is somehow limiting the mem that the container has?

Hi there, thanks for all the feedback :)
I have installed malice using the instructions on https://github.com/maliceio/malice/blob/master/docs/installation/linux/install.md:
$ wget https://github.com/maliceio/malice/releases/download/v0.3.11/malice_0.3.11_linux_amd64.tar.gz -O /tmp/malice.tar.gz
$ sudo tar -xzf /tmp/malice.tar.gz -C /usr/local/bin/
And  I did run:
echo "vm.max_map_count=262144" | sudo tee -a /etc/sysctl.conf
sudo sysctl -w vm.max_map_count=262144
The only issue during installation is the fact that this does not work on 16.04:

Hi there,
I tried all steps on the link, without avail. However I found another workaround which works.
After a restart I run Docker ps -a, take the ID for elasticsearch and give a reboot command
example:
docker restart b3bcb565eb2d
The ps -a command now report the task running:
b3bcb565eb2d        malice/elasticsearch:5.5   "/elastic-entrypoint…"   9 minutes ago        Up About a minute               <IP_ADDRESS>:9200->9200/tcp, 9300/tcp   malice-elastic
And the scan runs fine.
I get the same result if I remove the closed docker containers.
My suspicious is looking at the exit times, that the restart command of the server somehow crashes elasticsearch. Malice seems not to restart it until the closed docker is removed.
For now I will place a small script in my reboot sequence that runs:
docker rm $(docker ps -a -q)
This will close all exited dockers. Would it be an idea that this check is added to malice ?

if you delete the elasticsearch container you lose all the data?

Good point. I currently do not use the data. I make a scan, dump it to file and process this. I will check and let you know. Probably a docker restart is a more graceful solution :)

As far as I can see, indeed the data is lost (unless you commit the changes to the image, but this is not a help). As far as I can see as well the elasticsearch does not crash at all, unless there is a reboot.
I assume malice checks if the container exist, and if not creates it. It would be nice if it checks if it is up and running, and if not (re)start it. Now it just produces an error. I have seen the same when the AVG crasht and and all follow up scans provided errors.
Beside that everything works fine :)

I intend on adding a lot more checks around elasticsearch and allow people to supply their own and not use malice/elasticsearch as well as support for using other databases if the user wants.


nixos/i18n: don't build all supportedLocales by default

Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

This broke any custom extraLocaleSettings..

Shouldn't this have been announced here: https://discourse.nixos.org/t/breaking-changes-announcement-for-unstable/17574?
Either way, wouldn't it make more sense to default to something like:
    supportedLocales = with config.i18n; lib.unique (
      (lib.mapAttrsToList (n: v: v + "/UTF-8")
        (lib.filterAttrs (n: v: n != "LANGUAGE") extraLocaleSettings)
      ) ++ [ (defaultLocale + "/UTF-8") ]
    );

Shouldn't this have been announced here: discourse.nixos.org/t/breaking-changes-announcement-for-unstable/17574?

I didn't even know that thread existed.

Either way, wouldn't it make more sense to default to something like:

Please do a PR with that.

This broke any custom extraLocaleSettings (like LC_PAPER or LC_TIME etc.).

Presumable only when they are set to something other than your display language?

https://github.com/NixOS/nixpkgs/pull/179194

This broke any custom extraLocaleSettings (like LC_PAPER or LC_TIME etc.).

Presumable only when they are set to something other than your display language?

That's their only use, yes.  They default to the display language, so you don't need the override if it's the same.

https://github.com/NixOS/nixpkgs/issues/179607

https://github.com/NixOS/nixpkgs/issues/179486

I think unconditionally generating C.UTF-8/UTF-8 is probably also a good idea.

So we should revert this and reevaluate.

Like, for example, not generating C.UTF-8 by default shows that there is a fundamental gap in understanding here.

No, that’s not how that works.

If someone is presenting me a working code solution to a problem I think it is very reasonable to ask them to create a PR with that. The other option I would have would be to commit it as my own and then ask the same person to test their own code which is a bit weird.

You can’t break other people’s systems and then tell them to fix it themselves.

That is wrong. Every change has the potential to break something somewhere in some combination of the infinity of potential system combinations. We can only consider so much when doing a change. That's why I wrote a changelog entry because I knew before that if people relied silently on other locales their setup would break. There is just no other way to not break this. I and two reviewers didn't think about extraLocaleSettings or eo and only almost two weeks later we noticed that some things break.
Also my time is not infinite and between real life and other work and projects I might only find time to do this in a few days in which the fix could have been already be commited, merged and be on unstable.

So we should revert this and reevaluate.

Instead of hastily reverting changes and later reverting the revert, we should first consider if a small addition/change of code fixes those use cases or people need to adopt their config and explicitly mention a locale.

Like, for example, not generating C.UTF-8 by default shows that there is a fundamental gap in understanding here.

First of all, I know how locales work and the special meaning behind c.utf-8.
Then this must have been broken for a good amount of time in the minimal profile which is used in containers similar to environment.noXlibs.

Now back to fixing this instead of doing discussions.
First of all a big thanks to @gravndal for the two PRs fixing the situation when more complex settings are used. I'll really appreciate it.
Also regarding to #179486 : This must have been always broken but since we generated all locales by default this was never noticed. So to say we unconvered more bugs with this change that where always there.
Then why I didn't notice this while testing: I had C.UTF-8 set in i18n.supportedLocales so I couldn't. Happens when your configuration is multiple thousand lines long. Going to fix that in a PR right now.

That is wrong. Every change has the potential to break something somewhere in some combination of the infinity of potential system combinations.

Given that this PR has neither any description, nor a commit description, I would not assume much thought has been put into possible breakage.

It's called "unstable" for a reason…

I wanted to write that, too. 😂
Yes, breakages can happen even if we all try our best to avoid them.

https://github.com/NixOS/nixpkgs/issues/180935

I don't think that is good way to move this forward. I'd rather add an exception for that language instead of reverting improvements which where much needed and everyone benefits of.

Another issue https://github.com/NixOS/nixpkgs/issues/183960

@Artturin I don't think that's actually caused by this.
From some limited testing, it seems that if your current configured locales don't match the new supported locales reliably triggers those warnings.
A situation likes this can naturally occur if you're removing a locale from your extraLocaleSettings, e.g. I can trigger it by removing my LC_TIME=en_DK.UTF-8 (the only location where I reference this specific locale).


Fail to Download Rosbags

Hi, thanks for your great work first.
I failed to download the "alternative indoors and outdoors" rosbags from the provided link. But I could download the ".txt" format ground truth files successfully.
Do you have any ideas how to fix it?
Thank you!

Sorry for late reply. That might be a network problem. Have you tried to download this via campus network?

I tried to download this via campus network and it succeeded. Thank you!


AMD loaders break other downstream dependents due to grunt compilation order requirement

src/helpers/endUMD.js confuses Rails asset pipeline when this library is imported via the rails-assets gem (connects Rails to Bower):
# Gemfile
source "https://rails-assets.org/"
gem "rails-assets-rickshaw"

# assets.rb
Rails.application.config.assets.precompile += %w( *.js )

When running RAILS_ENV=production rake assets:precompile (in production), what happens is that Sprockets encounters the invalid partial JS file and then aborts. This is due to the fact that rails-assets pulls and compiles via Sprockets and not bower/grunt scripts; thus endUMD.js merely looks like a bad JavaScript file:
/gems/rails-assets-rickshaw-1.5.1/app/assets/javascripts/rickshaw/src/helpers/endUMD.js
rake aborted!
TypeError: no implicit conversion of nil into String
/gems/sprockets-2.12.4/lib/sprockets/processed_asset.rb:14:in `update'
/gems/sprockets-2.12.4/lib/sprockets/processed_asset.rb:14:in `initialize'
/gems/sprockets-2.12.4/lib/sprockets/base.rb:374:in `new'

An ugly hack that got me around this is to allow nil to be implicitly cast to an empty string in order to squelch the complaining Sprockets steps:
# config/initializers/nil_class.rb
class NilClass
  def to_str
    ''
  end
end

but this is really bad-behavior kind of thing to do to to your entire application.
Is there any possible way you might consider a different way to "modularize" your library, such as adding a task in your compilation which injects the start/end UMD wrappers from non .js extension files as a post-processing step instead, perhaps?

Essentially your Makefile needs to rename the startUMD.js.prepend and endUMD.js.apped files, then it could prepend and append the start/end clauses. Maybe I'll make a PR for this, but it's pretty low on my list.


[flagd] in-process evaluation mode, and shared evaluation engine

As mentioned in flagd documentation of  Creating an in-process flagd provider ^1, the in-process provider comes with unique advantages. This issue focuses on creating a TS/JS implementation. The implementation will be server-side, but shareable components (namely the evaluation engine, see tasks below) should be packaged and released separately, so they can be used in a hypothetical client side implementation, browser UI validation, etc.
Requirements

Fulfill requirements outlined by flagd in-process guideline ^1
Minimal external dependencies
Updated/New ReadMe & usage guide
Unit & e2e tests (e2e test already exist here)

Technical requirements

Build both remote and in-process providers into a single dependency (To be decided after the POC)
Reuse existing interfaces and implementations where possible
Shareable flagd evaluation engine lib published as independent module

Tasks
NOTE: each of these should be it's own issue. Please ping @toddbaert if you're interested in taking one of these tasks and I will create an issue on-demand.

[x] #615
[ ] evaluation engine package
[ ] Basic JSONLogic engine shared library

[ ] flag definition validation using the schema

[ ] Shared evaluators
[ ] injected properties

[ ] Custom JsonLogic evaluators

[ ] Fractional
[ ] Semver
[ ] String Comp

[ ] Serverside provider

[ ] uses evaluation engine package above
[ ] connects via gRPC sync to get flag definition

evaluation engine package is also completed with PR https://github.com/open-feature/js-sdk-contrib/pull/620
I am now actively working on Basic JSONLogic engine shared library. This should complete the flagd-core part of the implementation

PR https://github.com/open-feature/js-sdk-contrib/pull/623 completes the evaluation engine part of the flagd-core.
I will now start work on the serverside provider based on the flagd-core library


Reduce Reliance on Global Cache

We rely on global variables for shared cache state, which is an anti-pattern we should refactor out of the codebase.
This can cause issues with integration testing, and can increase the memory footprint of Terragrunt.
Develop a new mechanism for explicitly passing around that cache through a cache manager so that we can be more thoughtful with how we're caching content throughout an invocation of Terragrunt. Refactor caching throughout the codebase to leverage it.

An interesting observation made was that we generally are looking for caching to support memoization of our function calls.
Leveraging a OnceFunc with something to old the functions for re-use might provide a good pattern for a large scale refactor.

@denis256 did some refactoring within https://github.com/gruntwork-io/terragrunt/pull/3307 to pass in cache by context instead of a global cache, so we can consider this work done.
In the future, we may want to revisit this and refactor further to avoid storing the cache in the ctx parameter, etc.


[Issue #188] Correctly execute qpdf; store the repaired file's name on Doc

Proper chain qpdf -> mutool -> extraction
Store the correct repaired filename in the Document object
Make sure the TableDetectionModule executes on the repaired file

Resolves #188


Can you also define problems like:

Given a parrallelogramm abcd such that...

It seems there is a keyword para which means parallelogram.  It's used in the first rule in rules.txt.  Have you tried
para A B C D
?


[R] CRAN packaging checklist for version 13.0.0

Packaging checklist for CRAN release
For a high-level overview of the release process see the
Apache Arrow Release Management Guide.
Before the release candidate is cut

[x] Create a GitHub issue entitled [R] CRAN packaging checklist for version X.X.X and copy this checklist to the issue.
[x] Evaluate the status of any failing nightly tests and nightly packaging builds. These checks replicate most of the checks that CRAN runs, so we need them all to be passing or to understand that the failures may (though won't necessarily) result in a rejection from CRAN.
[x] Check current CRAN check results
[x] Ensure the contents of the README are accurate and up to date.
[x] Run urlchecker::url_check() on the R directory at the release candidate.
commit. Ignore any errors with badges as they will be removed in the CRAN release branch.
[x] Polish NEWS but do not update version numbers (this is done automatically later).
[ ] Run preliminary reverse dependency checks using archery docker run r-revdepcheck.
[ ] For major releases, prepare tweet thread highlighting new features.

Wait for the release candidate to be cut:
After release candidate has been cut

[ ] Create a CRAN-release branch from the release candidate commit

Optional: PRs for autobrew and rtools (release candidate)
Make pull requests into the autobrew and
rtools-packages repositories
used by the configure script on MacOS and Windows. These pull requests will
use the release candidate as the source.

[ ] Pull request to modify
the apache-arrow autobrew formula
to update the release version, SHA256 checksum of the release source file (which can be found in the same directory as the release source file), and any changes to dependencies and build steps that have changed in the
copy of the formula we have of that formula in the Arrow repo
[ ] Pull request to modify
the apache-arrow-static autobrew formula
to update the version, SHA, and any changes to dependencies and build steps that have changed in the
copy of the formula we have of that formula in the Arrow repo
[ ] Pull request to modify the
autobrew script
to include any additions made to
r/tools/autobrew.
[ ] Pull request to modify the
RTools PKGBUILD script
to reflect changes in
ci/PKGBUILD,
uncommenting the line that says "uncomment to test the rc".

Prepare and check the .tar.gz that will be released to CRAN.

[ ] git fetch upstream && git checkout release-X.X.X-rcXX && git clean -f -d
[ ] Run make build. This copies Arrow C++ into tools/cpp, prunes some
unnecessary components, and runs R CMD build to generate the source tarball.
Because this will install the package, you will need to ensure that the version
of Arrow C++ available to the configure script is the same as the version
that is vendored into the R package (e.g., you may need to unset ARROW_HOME).
[ ] devtools::check_built("arrow_X.X.X.tar.gz") locally
[ ] Run reverse dependency checks using archery docker run r-revdepcheck.

Release vote

[ ] Release vote passed!

PRs for autobrew and rtools (official release)
Create new autobrew and r-windows PRs such that they use the release
instead of the release candidate:

[ ] PR into autobrew/homebrew-core (apache-arrow autobrew formula)
[ ] PR into autobrew/homebrew-core (apache-arrow-static autobrew formula)
[ ] PR into autobrew/scripts
[ ] PR into r-windows/rtools-packages

Generate R package to submit to CRAN

[ ] If the release candidate commit updated, rebase the CRAN release branch
on that commit.
[ ] Pick any commits that were made to main since the release commit that
were needed to fix CRAN-related submission issues identified in the above
steps.
[ ] Remove badges from README.md
[ ] Run urlchecker::url_check() on the R directory
[ ] Create a PR entitled WIP: [R] Verify CRAN release-10.0.1-rc0. Add
a comment @github-actions crossbow submit --group r to run all R crossbow
jobs against the CRAN-specific release branch.
[ ] Regenerate arrow_X.X.X.tar.gz (i.e., make build)

Ensure linux binary packages are available:

[ ] Ensure linux binaries are available in the artifactory:
https://apache.jfrog.io/ui/repos/tree/General/arrow/r

Check binary Arrow C++ distributions specific to the R package

[ ] Upload the .tar.gz to win-builder (r-devel only)
and confirm (with Nic, who will automatically receive an email about the results) that the check is clean.
This step cannot be completed before Jeroen has put the binaries in the MinGW repository, i.e. here, here, and here.
[ ] Upload the .tar.gz to MacBuilder
and confirm that the check is clean
[ ] Check install.packages("arrow_X.X.X.tar.gz") on Ubuntu and ensure that the
hosted binaries are used
[ ] devtools::check_built("arrow_X.X.X.tar.gz") locally one more time (for luck)

CRAN submission

[ ] Upload arrow_X.X.X.tar.gz to the
CRAN submit page
[ ] Confirm the submission email

Wait for CRAN...

[ ] Accepted!
[ ] Tag the tip of the CRAN-specific release branch
[ ] Add a new line to the matrix in the backwards compatability job
[ ] (patch releases only) Update the package version in ci/scripts/PKGBUILD, dev/tasks/homebrew-formulae/autobrew/apache-arrow.rb, r/DESCRIPTION, and r/NEWS.md
[ ] (CRAN-only releases) Rebuild the docs with pkgdown::build_site(examples = FALSE, lazy = TRUE, install = FALSE) and submit a PR to the asf-site branch of the docs site with the contents of r/docs/news/index.html.
[ ] (CRAN-only releases) Bump the version number in r/pkgdown/assets/versions.json, and update this on the the asf-site branch of the docs site too.
[ ] Update the packaging checklist template to reflect any new realities of the
packaging process.
[ ] Wait for CRAN-hosted binaries on the
CRAN package page to reflect the
new version
[ ] Tweet!

TODO: follow-up on discussions in https://github.com/apache/arrow/pull/36551 to see if we need to do anything difference for this release

We'll need to cherry-pick the NEWS update into here: #36806

We also want to cherry pick #36884

We should flag #34775 as a breaking change

I've opened https://github.com/rstudio/pins-r/issues/761 on the pins repo

We might also need a fix for the gbifdb failure, which is the same as the error reported in #36907

We need to also grab the missing NEWS items documentation: #37326

And this one so we don't fail on CRAN: #37387

I've also cherry-picked this into this branch as we were failing on R-devel: #37457

Done!


Create rsa.c

Adding solution for RSA algorithm

I am adding solution for RSA algorithm

Hi Prateek, sorry for getting to this request a bit late...why don't you comment the code, its just plain code, not good for someone who might be studying it...
Do it and generate the pull request back...I'll get to it

ok

Thanks prateek, I'm merging it.


Wheel event inconsistencies

The wheel event object has properties like button  and buttons, but they are always zero and the empty tuple, respectively. The reason is that the wgpu event dict does not have these fields for the wheel event, but the PyGfx event object does, because it inherits from PointerEvent, so we always get their defaults.
This is confusing, because it looks like the event is broken.

It's consistent with web standards though: https://developer.mozilla.org/en-US/docs/Web/API/WheelEvent
WheelEvent inherits MouseEvent which includes said properties

Fixed upstream (just need a release of wgpu-py and jupyrer_rfb:

https://github.com/vispy/jupyter_rfb/pull/78
https://github.com/pygfx/wgpu-py/pull/397

Can close


Capacitorjs

How would I use this in a Ionic Capacitorjs project?

Hello @kieranbarlow .
As per
https://capacitorjs.com/docs/v2/cordova/using-cordova-plugins
You will need 2 commands
`
npm install cordova-plugin-brother-label-printer
npx cap sync
`
I have not tried this myself as I am still on an old Cordova project... But this should work.
Please let us know the outcome please.

Hey @arcadius, unfortunately I get errors when trying to run npx cap sync
Updating iOS native dependencies with pod install - failed!
[capacitor] ✖ update ios - failed!
[capacitor] [error] Analyzing dependencies

[!] Oh no, an error occurred.
[capacitor]
[capacitor]         Search for existing GitHub issues similar to yours:
[capacitor]         https://github.com/CocoaPods/CocoaPods/search?q=dlopen%28%2FLibrary%2FRuby%2FGems%2F2.6.0%2Fgems%2Fffi-1.15.5%2Flib%2Fffi_c.bundle%2C+0x0009%29%3A+tried%3A+%27%2FLibrary%2FRuby%2FGems%2F2.6.0%2Fgems%2Fffi-1.15.5%2Flib%2Fffi_c.bundle%27+%28mach-o+file%2C+but+is+an+incompatible+architecture+%28have+%28x86_64%29%2C+need+%28arm64e%29%29%29+-+%2FLibrary%2FRuby%2FGems%2F2.6.0%2Fgems%2Fffi-1.15.5%2Flib%2Fffi_c.bundle&type=Issues

Searching for inspections failed: undefined method `map' for nil:NilClass
[capacitor]         Looking for related issues on cocoapods/cocoapods...

LoadError - dlopen(/Library/Ruby/Gems/2.6.0/gems/ffi-1.15.5/lib/ffi_c.bundle, 0x0009): tried: '/Library/Ruby/Gems/2.6.0/gems/ffi-1.15.5/lib/ffi_c.bundle' (mach-o file, but is an incompatible architecture (have (x86_64), need (arm64e))) - /Library/Ruby/Gems/2.6.0/gems/ffi-1.15.5/lib/ffi_c.bundle

I've since tried arch -x86_64 pod install but I get the following:
- Analyzing dependencies
- Downloading dependencies
- Installing BRLMPrinterKit (<IP_ADDRESS>)
- Installing CordovaPluginsStatic (4.0.1)
- [!] The 'Pods-App' target has frameworks with conflicting names: brlmprinterkit.framework.

I should add I'm using

M1 mac

Closing this issue and raising a new one with better context.


Add pysam htslib VCF/BCF backend

This could use some tests... check out tests/unit/test_backends.py for an example of how we're doing it with wormtable currently.

@dcolligan: I agree-- this new functionality does need proper testing.  However, the Wormtable tests are not abstract or easily convertible to a different backend.  In an ideal world, I'd have time to prepare proper unit tests and remedy the situation.  Unfortunately, I am focused on building the mutable VCF/BCF API in pysam and a variant comparison and benchmarking engine (in addition to my day job).  I'm sorry to leave work for others, but my upfront commitment was only to provide a backend implementation as a proof of principle due to lack of API documentation.

This is great, thanks @bioinformed! I've got some minor style points to bring the code into line with the rest of the codebase, but otherwise it's perfect. I agree with you about the testing situation: we don't have any tests for the existing Tabix variant set, and this is something we will need to work on later.
+1 after the style issues are fixed and the commits squashed.

+1 - look forward to the merge +/- style updates & squash.

Would you mind making these minor mods please @bioinformed? We are very keen to merge this. (I thought I made a comment here a couple of days ago pinging you, but it must have gotten lost somewhere.)

I'm not a fan of many of the project's stylistic decisions, but these are
easy enough.  I'll update the PR shortly.
On Fri, Mar 6, 2015 at 8:56 AM, Jerome Kelleher<EMAIL_ADDRESS>wrote:

Would you mind making these minor mods please @bioinformed
https://github.com/bioinformed? We are very keen to merge this. (I
thought I made a comment here a couple of days ago pinging you, but it must
have gotten lost somewhere.)
—
Reply to this email directly or view it on GitHub
https://github.com/ga4gh/server/pull/194#issuecomment-77561805.

Thanks @bioinformed. Sorry to ask you to make them, but consistency is very important. We were sort of stuck with the camelCasing by the protocol, which I don't like at all (but I'd like a mixed camelCase and snake_case project even less). I would argue strongly about using non-booleans in conditionals though: if x is not None is a lot clearer than if x IMO.

Style changes are in.  Squashing commits destroyed the diffs in this pull request, but seems to have done the right thing overall.

Excellent, thanks!
+1


Fix Widget UI

Widget's text font/color is wrong.

Font cannot be changed that easily when it comes to remote views, so skipping this for now.


Add Wiki with Discord Usage

Hi there,
unfortunately it's not possible to send a pull request for a wiki page so instead I am opening this issue.
Would be great to have a Wiki Page under the "Usage" section on how to interact with the bot in Discord.
In the Page I suggest to have two sections:

Commands: with a list of commands the bot responds to
Configuration: with a list of advanced commands to configure to bot (e.g. setting up broadcasting channel)

Thanks

Hey there, sorry for the late response.
Yeah i will rework the wiki as soon as the next update is out

https://eliteschw31n.gitbook.io/mooncord/usage/discord-commands
Work in progress

with 1.0.5 i fully want to migrate to another wiki system that moonraker uses, easier to maintain.

done with 1.1.0 on here -> https://wiki.tludwig.dev/mooncord


Authentication with Azure AD

Hi mstaal ,
Thank you for this module , it has saved a lot of time for me authenticating with azure AD. /
I have one question though. Why there is no option for "client secret" used to identify the registered application as a trusted application to access the user's information securely. Is there a way to enable this ?
Thanks again!

Hi @shars95 !
Sorry for the late reply and thanks for your question. May I ask what your use case is, and why you would to use a client secret? The current design of the plugin is to support the OpenID Authorization Code flow (via PKCE) which does not rely on a client secret. The Client Credentials flow (which is a flow for system accounts) uses secrets, but it would be easy to implement something for that flow specifically.
Am I misinterpreting your question?
And thanks for your feedback! It's nice to know that the plugin is cherished. :-D

This is very useful! I was able to quickly get into the login screen. However, like the OP of this thread, I also saw that my registered app was deemed "untrustworthy" so the user has to go through an extra step to confirm that they want to use it (it's our corporate internal app, so should skip this part, as long as they are logged in through the work account).
In your sample code, there is a comment # Corresponds to the 'auth' configuration for an MSAL Instance when specifying the auth dictionary.
Assuming it is that, I added my own key called clientCredential that is supposed to correspond to the app secret. However, it doesn't seem it had any effect because I still got asked to confirm the app when I login.

Thanks a lot, @tipani86 ! I appreciate that it serves a purpose for you. Sorry for asking explicitly, but have you now resolved your issue? Or else I will try to look further into it. I try to make small adjustments every now and then.

Thanks a lot, @tipani86 ! I appreciate that it serves a purpose for you. Sorry for asking explicitly, but have you now resolved your issue? Or else I will try to look further into it. I try to make small adjustments every now and then.

Yeah I mean I just accept the fact that the user has to explicitly click an approval the first time they log in. Otherwise, it's fine.
Perhaps an unrelated issue were sometimes when I log in on different machines and get displayed a logged in status (with the button written as "Logout") but the site still runs as if I am not logged in, i.e. the login token is not present. Are you aware of such sync issues?
I can solve it by clicking Logout and going through the whole logout - login dance.

@tipani86 : Thanks for letting me know. I will try to look at it at some point. Generally, my feeling is that syncing is definitely an obstacle when getting a procedural / synchronous language like Python to sing with JavaScript, which is async in its very nature.


Error after executing docker-compose up -d

After trying to build docker compose, the kong container is not up and shows the following error in console:
database 'kong' is missing migration

I'm working with the 0.11.1 release version of the repo.

I also have same error
kong_1            | 2017/11/03 08:44:20 [warn] postgres database 'kong' is missing migration: (response-transformer) 2016-05-04-160000_resp_trans_schema_changes kong_1            | Error: /usr/local/share/lua/5.1/kong/cmd/start.lua:28: [postgres error] the current database schema does not match this version of Kong. Please runkong migrations upto update/initialize the database schema. Be aware that Kong migrations should only run from a single node, and that nodes running migrations concurrently will conflict with each other and might corrupt your database schema! kong_1            | kong_1            |   Run with --v (verbose) or --vv (debug) for more details kong_1            | prefix directory /usr/local/kong not found, trying to create it compose_kong_1 exited with code 1

I got the similar missing migration issue when run docker compose, had to manually restart the kong container to make it work.
It looks kong starts before the kong-migration completely finishing up even you have this
    depends_on:
      kong_migration:
        condition: service_started

A temporary solution is to add restart: on-failure for kong.

Should i add below build in Dockerfile of kong? But it is not working.
kong:
  build: kong/
  restart: on-failure

The kong migration commands are documented here kong-migrations
If migration bootstrap gets interrupted / times out etc run migrations up to complete any unfinished migrations


Retrieving value of a specific key is slow

I have a sqllite dictionary contains 4.2 million key. Each value is a list of pyspark sparsevector
Trying to retrieve the value of a specific key takes around 3 seconds! any known issue related?

@MiladAlshomary how large is that value? How long does pickling it take? (sqlitedict uses pickle internally to serialize the values)

@piskvorky
The values are not big. they are less than 1 kbyte. One thing I was wondering about, if the created sqllite table has already an index over they key column?

@MiladAlshomary it should be according to
MAKE_TABLE = 'CREATE TABLE IF NOT EXISTS "%s" (key TEXT PRIMARY KEY, value BLOB)' % self.tablename

Sure, it does. A key-value store without an index on key wouldn't be very useful :-)
If you send a minimal reproducing example, we'll have a look. Thanks.

Hi, it seems like the issue is not reproducible. Something went wrong with the db connection I believe. Now its working properly, retrieving the value of a key takes milli seconds

@MiladAlshomary aha, OK, thanks for the information.


trouble to separate  one  combined obj to a set of individual objs then to gltfs

here is my steps, help me
1、objdatas = loadObj(obj)
// try to assemble a set of objs whit the objdatas
// objs =[]
objs = splitObjdatas( objdatas )
// try to transform obj to gltf one by one
for obj in objs
createGltf ( obj, options)
writeGltf ...
2、i get the right set of models/gltfs/glbs, but i found the gltfs'textures  have wrong performance except
the first one.
3、i guess the textures properties  made with the index of node, but i can't find how it work, please give me some suggestions
4、the final goal is to transform one combined obj to 3dtiles  with a set of .b3dm.

I think as long as you pass in the materials array from loadObj to each call to createGltf it should be able to match up each primitive with each material.
However I haven't used obj2gltf in this way before so if you are able to send more sample code that would help.

Just as an FYI, I was also trying to split OBJs in separate files based on the groups, and I succeeded using this approach after a bit of trial-and-error. See sample code below:
var objData;
loadObj('/path/to/multi-group/asset.obj', options).then(function(data){
  objData = data;
});
var gltf = createGltf({ // creates the gltf for the first group in the .obj
  nodes: [ objData.nodes[0] ],
  materials:[],
  name:objData.nodes[0].name
}, options);
writeGltf(gltf, options); // writes the .bin file and cleans up the gltf (removes empty nodes, ...)
var fileData = Buffer.from(JSON.stringify(gltf));
fs.writeFileSync(objData.nodes[0].name + '.gltf', fileData); // writes the .gtlf file

It's important to know how to convert gltf to b3dm, which I think should be provided.


'GTMDefines.h' file not found

Failed to build iOS app
Could not build the precompiled application for the device.
Lexical or Preprocessor Issue (Xcode): 'GTMDefines.h' file not found
/Users/mac104/workspace/****/ios/Pods/GoogleToolboxForMac/Foundation/GTMNSData+zlib.h:19:8

What version of mobile_scanner Are you using?
What is your Flutter version?
Did you run pod install ? (Maybe you need to recreate your Podfile.lock)

[✓] Flutter (Channel stable, 3.22.0, on macOS 14.1.1 23B81 darwin-x64, locale zh-Hans-CN)
[✓] Android toolchain - develop for Android devices (Android SDK version 34.0.0-rc1)
[✓] Xcode - develop for iOS and macOS (Xcode 15.2)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2024.1)
mobile_scanner: ^5.2.1

It's a problem with the header file
I found GoogleToolboxForMac under ios/Pods/, and then changed the #import "GTMDefines.h" imported in the header of GTMLogger.h, GTMNSData+zlib.h, and GTMNSData+zlib.m under Foundation to #import <GTMDefines.h>. I solved this problem, but after I executed the “flutter clean” command, Pods became #import "GTMDefines.h" again. I still need to modify it manually. How can I do it?

You will have to raise an issue on the MLKit issue tracker. MLKit is one of our dependencies, and we are currently on the latest version of MLKit for iOS


Java Script

Java Script
User Story
as a boot camp student
I want the prework notes to be structured on a webpage
So that I can easily find and read the information
##Acceptance Criteria
given a prework study guide website
when I view the study guide
then I can see the four topic I learned listed along with a suggestion on what I should study first

added js


Fix: Initial database population is now part of migrations instead of…

… at init
This fixes #400 and sets the standard behavior of any new required defaults being populated in migrations.
This also closes #298, which is specifically to move these activities into a migration and out of the app init.

@ajacques I think maybe we can get this one through review and then plan and test a release before merging anything else. We're long overdue for a tagged version, and main is going to start having some backwards incompatible changes so I think we should ensure this is stable and provide a tag to pull


Update MD file on new branch 2017-22-16_11-11-27

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Restrict input chars

Feature Request: make it possible to specify the allowed characters for the input, like numbers or letters.
See also issue in cleave.js: https://github.com/nosir/cleave.js/issues/680
Thanks

here you go
https://github.com/lekoala/cleave-es6/releases/tag/1.0.1

Thanks for the quick implementation!
Did a quick test and found a bug: when a string with unallowed chars is pasted into the input no formatting is applied.
Since I couldn't find a demo with the allowedChars property, I made a small reproducers: https://stackblitz.com/edit/js-5dbedx

oh i see
fixed in https://github.com/lekoala/cleave-es6/releases/tag/1.0.2

Thanks, it seems fixed now.


Break apart playlists of > 1000 songs

GM only allows playlists to have 1000 songs

Everyone should give feedback to Google about increasing this limit, you can do this by going to the Play Music webpage, press the cog in the top right corner and "Help & Feedback" -> "Send Feedback".

Hello, i have that issue too, even one year later. What about dividing large playlists into small (x1000 songs)? It would be awesome.

Welp, finally got this done.  v0.3.14 breaks them apart into groups of 1000


Checking for malicious html or js in the project info.

Do we need to apply some checks to the metadata returned form the relay?

I believe @DavidGershony and @miladsoft have been discussing this @sondreb you have any comments?


fix: Issue 181, use handleRequest to perform introspection queries

instead of the fetch function
handleRequest handles includeCookies logic properly. The fetch uses the default which is same-origin
https://github.com/apollographql/embeddable-explorer/issues/181

@mayakoneval mind taking a look? 🙏

and much appreciate the contributions @bigman73! 🙏

@cheapsteak I opted to just pass our include cookies to the introspection request instead of using handleRequest directly. Handle request is meant to be a callback for users for each query they execute in explorer, but not sure we want to tie that to the introspection we fire off each time.
PR up here: https://github.com/apollographql/embeddable-explorer/pull/184
BIG thank you for continually raising @bigman73 & for your detailed issue reports 🙏🏻

actually @cheapsteak curious your thoughts on the use of handleRequest. Folks might put in specific headers they need that they don't want to manually add to Studio, should we just be using handleRequest for all embedded Sandbox requests?
On second thought I am leaning towards yes. Not seeing a lot of reason why that would be an issue. Might need to update the documentation to explain that

should we just be using handleRequest for all embedded Sandbox requests?

yup that makes sense to me 👍


Flush the prelude in non-blocking Servlet IO

We need to flush the response prelude before the first chunk when rendering a response with chunked transfer encoding.  This reaches parity with Ember and Blaze.
I thought we could just set the buffer size to zero, but this renders each byte as its own chunk.

Yes, yes, I know this is from a less popular module on an old version.  Fun times at $WORK.


Devcontainer

Please describe the changes this PR makes and why it should be merged:
Status

[ ] Code changes have been tested against the Discord API, or there are no code changes

Semantic versioning classification:

[ ] This PR changes the library's interface (methods or parameters added)

[ ] This PR includes breaking changes (methods removed or renamed, parameters moved or removed)

[ ] This PR only includes non-code changes, like changes to documentation, README, etc.

Wrong repo? Shouldnt this be on the boilerplate?

Oh lol


feat: New Component ProcessList MVP

Summary
This PR adds the USWDS ProcessList component in an MVP state.
Related Issues or PRs
#979
An enhancement that we may want to add as part of this GitHub issue would be to create a ProcessListItemHeader subcomponent. This would allow us to offer an out of the box way for our users to pass a heading that would automatically be styled by the usa-process-list__heading class irrespective of what element type the user passed.
This enhancement would meet the USWDS Accessibility guideline, "Use semantic heading levels," that states, "Though our default code uses an <h4>, use the correct heading level with the class name usa-process-list__heading in your own implementation."
How To Test
Check out this branch and run yarn test to execute tests and yarn storybook to see the new component in action.
Alternatively, you can scroll to the bottom of this page and click "Show environments" on the right above the comment input box to access this component in Storybook.
Screenshots (optional)
Default

No text, custom sizing

Custom Sizing

Warnings

:warning:
It looks like there are new component (JSX/TSX) files, but the entrypoint (index.ts) has not changed. - Did you forget to export new components from the library entrypoint?

  Generated by :no_entry_sign: dangerJS against c97724c86c63ddb00b476190462e207bcc96990e

@haworku and @brandonlenz, @suzubara requested that I get your opinions on whether or not we care to provide a ProcessListItemHeader subcomponent. As is, ProcessList is flexible but does not provide all of the tools that our users might benefit from.
Do either of you feel strongly in favor of adding the header subcomponent?

@haworku and @brandonlenz, @suzubara requested that I get your opinions on whether or not we care to provide a ProcessListItemHeader subcomponent. As is, ProcessList is flexible but does not provide all of the tools that our users might benefit from.
Do either of you feel strongly in favor of adding the header subcomponent?

Personally, I'm for creating the subcomponent. Since it should be able to be any type of heading (or p) tag, we could expose a variant prop or similar to allow the implementer to select what type of markup should be used.

Maybe a generic type prop so the interface might looks something like `<ProcessListHeading<'h1'>>"Heading text".
Disclaimer ⚠ I have not tried that, just thought it might be nicer than having a headerType prop if it works

Created issue #1134 for the ProcessListItemHeader subcomponent


Request Help～

This is a perfect project which I learn a lot from this.
I want to ask a question.
In 'Selects' showcase component, 'onChange' callback，how can i get current value? ‘event.target.value’ code is get the old value.
Looking forward to your reply, thank you!

I solved the problem, Thank.


tsec-http4s re-enabled

This was initially disabled but can now be a project once again

Hey @ChristopherDavenport I'm wondering if you're planning to continue with this PR or if you have any insight into the test failures so that I or someone else could pick this up and get tsec-http4s working for Scala 3. Thanks!


Add a MarkableArcCell to allow building reference-counted concurrent collections

What?
This PR adds a new type to crossbeam::sync - the MarkableArcCell. This type provides all the functionality of ArcCell and more. In particular, it allows one to mark the cell with a boolean value and then perform atomic compare_exchange operations on the (Arc<T>, bool) pair. It is based on a type from the java.util.concurrent.atomic module called the AtomicMarkableReference (docs) and is supposed to provide the same kind of functionality.
I also made a tiny addition to ArcCell - ArcCell::with_val(v) is equivalent to ArcCell::new(Arc::new(v)). I think it's nicer not to have to expliciitly initialize the Arc each time, but if the change is unwanted I don't mind removing it as it's not too important.
Why?
This type allows us to build concurrent lock-free collections as described in "The Art of Multiprocessor Programming" by M. Herlihy and N. Shavit. The book provides code in Java, which is a garbage-collected language. The big problem in writing such structures in non-GC languages is memory cleanup. In my opinion, the easiest to use equivalent of a GC is atomic reference counting, provided by Arc<T>.
I have already written a lock-free linked-list-based map and will publish it after this PR or its equivalent is merged, as the map depends on the MarkableArcCell. This will allow us to then create more performant maps, such as skiplist-based ones and stabilize the interface for a concurrent map in Rust, as discussed in #41, after which work on a lock-free hashmap could begin in crossbeam.
I have made some decisions regarding the interface of MarkableArcCell which might raise questions, so please ask and I will try to justify them.

What's the use case for this? The only literature that I found used this as some sort of atomic Optional. Are there uses for this where the nullness of the pointer and the marker status differ?
Is there a reason this must be reference counted instead of using the epoch memory management?
If there are any guarantees on heap pointer alignment in rust, this could also be done by using unused bits and would be implementable in a lock-free manner. If/when double word atomics are added they could make this current implementation lock free as well.

If there are any guarantees on heap pointer alignment in rust, this could also be done by using unused bits and would be implementable in a lock-free manner.

Yes, a tagged pointer would be an optimization over two values, but the reason I use a spinlock is not that there are two values. When you look at ArcCell, it also spinlocks. The problem is in the Arc->AtomicUsize conversion.
Consider the situation:
Thread 1 reads the usize and transmutes it to an Arc. Assuming no other Arc copies are present, the refcount is 1. Then it suspends. Thread 2 comes in, and uses set_arc (or set in ArcCell) to set a new value. set_arc returns the old value, which Thread 2 then drops. The refcount is 0, and Thread 1 holds an invalid value.
The spinlock protects from this, since between a take and put the value is guaranteed to be valid.
The ability to make this lock-free therefore depends not on squashing the boolean into the unused bits of the Arc pointer, but on making ArcCell lock-free. It would be great if somebody could do that, unfortunately I have no idea how at the moment.

If/when double word atomics are added they could make this current implementation lock free as well.

I wouldn't count on hardware support for this, unfortunately, but as explained above a DCAS is not necessary.

What's the use case for this?

The problem I am trying to solve is that we need a stronger guarantee than just knowing that the memory we have a pointer to can be accessed, because while the memory may be valid, it might've been logically deleted from the list.
When holding a mem::epoch::Shared pointer, we know that the node has not been deallocated, but we are not sure whether it is still in the list. Inserting a new node after a node that has been logically deleted will have no effect, and would therefore be invalid. A marker bit solves this, as we can use atomically make sure that we are setting the next pointer of the previous node to the new one only if the previous node's marker is false, which indicates still being in the list. A remove procedure would switch that bit to true.
My explanation is probably a bit wonky, so please see <IP_ADDRESS>, p. 57 in this.

Is there a reason this must be reference counted instead of using the epoch memory management?

Probably not, but to my knowledge epoch memory management would require a similar addition of a pointer-boolean pair for this to work, unless it already contains something like this. Due to the MarkableArcCell not actually being lock-free as you remarked, we might consider adding a markable pointer to mem::epoch.

I'm at work right now so this will be short, but I think that this commit is really doing two things at once - it's adding the idea of a markable pointer, and also the idea of an Atomic Arc. Would it make sense to separate them? If only a markable pointer was needed it would be far cheaper than the AtomicMarkableArc for loads/stores, and the AtomicArc also wouldn't have to deal with the overhead of being markable.

it's adding the idea of a markable pointer, and also the idea of an Atomic Arc.

If by AtomicArc you mean a type that provides atomic storage and retrieval of an Arc, then, well, it's already in crossbeam and it's called ArcCell. It's true that it doesn't provide CAS, but it might be extended to do that as well. Anyhow, this PR doesn't add that idea, as it's already there.
A markable pointer type is something that is indeed not yet present, and it's the aim of this PR to add one.

If only a markable pointer was needed it would be far cheaper than the AtomicMarkableArc for loads/stores, and the AtomicArc also wouldn't have to deal with the overhead of being markable.

The aim of this PR is to build a markable pointer that is already integrated with a cleanup scheme (not simply a ptr-boolean pair that has to be freed like a normal ptr) and the current choice is ref-counting or the epoch GC.  It's built on top of ArcCell, because I want to try to build some ref-counted structures and see how they hold up.
An alternative to ref-counting, as you mentioned, is a GC (e.g. the epoch GC), and a similar marked pointer type might be added to mem::epoch, but it's a matter of benchmarking to see whether it is really cheaper - no refcounts, but GC sweeps, etc.
You also rightly said that it's not lock-free, so I made an ArcCell with a wait-free get() and I'll try to rewrite the markable variant on top of that.

Finally got around to writing a more concurrency-friendly version of MarkableArcCell. In this one, all read methods are wait-free and all methods which write the Arc part are wait-free with respect to each other (other writes), but will lock until all readers are done. compare_arc_exchange_mark, which writes only the marker bit, may loop a little due to a CAS operation, so i'm not sure whether it can be classified as wait-free, but it's definitely lock-free.
With these guarantees, the guarantees that a skiplist as described in "The Art of Multiprocessor Programming" by M. Herlihy and N. Shavit implemented using this type would be:
find/contains - always lock-free
concurrent removes and inserts - won't block
concurrent writes with finds - writes may block until reads are done
What do you think?

I think this would be more appealing if you could link the code of the use cases you said to have. Code can be enlightening.

@arthurprs You're right. I have uploaded a repository containing a concurrent linked list based on the MarkableArcCell: SortedLazyList. It's just a PoC, so I might've gotten my lock-freedom guarantees wrong, there might be undetected race conditions (even though the tests seem to pass), etc., but it demonstrates how data structures can be built based on this primitive. It's also terribly slow, but it could be extended relatively easily into the skiplist I mentioned earlier, and skiplists are not bad at all.
I'm sorry for taking so long, but I've been busy with uni and other silly things.

That's great. But I'm confused, you say the linked list is terribly slow so how the skip list would fare better?

Oh I see it's not actually a linked list, just similar name.

Yes, skiplists are essentialy made by using several linked lists internally, each one with a different number of elements. Thanks to this and some other properties, skiplists scale much better than linked lists.

I see the use case more clearly now, thanks. Does this scheme perform well in practice though?

The linked list itself is not that useful, but good as a starting point. I used it in that way to write a map implemented as a skiplist using pretty much the same techniques as the linked list does. The problem with that map is that it is only lock-free if the underlying primitive (MarkableArcCell) is lock-free, and at the moment it is not (Please disregard the documentation on my repo, it assumes that MarkableArcCell is lock-free. Also, I was wrong when stating here earlier that it is). It nevertheless seems to perform reasonably well, maintaining the O(log n) complexity of a skiplist, although I hadn't yet done any significant optimizations or benchmarked it properly, since I focused on correctness when writing it. Like the linked list, it's based on "The Art of Multiprocessor Programming".
Now, even though the skiplist is more or less fast, we want it to perform well under contention, which can only be guaranteed by lock-freedom. I can see two ways of achieving this. One is to fix MarkableArcCell to be lock-free. I am unsure whether that's even possible, but feel free to try.
The other way is to replace the memory recollection scheme with crossbeam's epoch GC. That seems like the way to go for now, since plain pointers (epoch::Atomic) can trivially be paired with a bool (we cannot avoid the Markable part for skiplists) in a lock-free atomic primitive. I will probably PR something like MarkableAtomic soon and then try to rewrite the skiplist on top of that. This will have the additional advantage of being most likely faster. (Link taken from aturon's excellent blog post), but some disadvantages with respect to interface design (&ValueType cannot be returned, only ValueType).
TL;DR concurrency is hard

The linked list itself is not that useful, but good as a starting point. I used it in that way to write a map implemented as a skiplist using pretty much the same techniques as the linked list does. The problem with that map is that it is only lock-free if the underlying primitive (MarkableArcCell) is lock-free, and at the moment it is not (Please disregard the documentation on my repo, it assumes that MarkableArcCell is lock-free. Also, I was wrong when stating here earlier that it is). It nevertheless seems to perform reasonably well, maintaining the O(log n) complexity of a skiplist, although I hadn't yet done any significant optimizations or benchmarked it properly, since I focused on correctness when writing it. Like the linked list, it's based on "The Art of Multiprocessor Programming".
Now, even though the skiplist is more or less fast, we want it to perform well under contention, which can only be guaranteed by lock-freedom. I can see two ways of achieving this. One is to fix MarkableArcCell to be lock-free. I am unsure whether that's even possible, but feel free to try.
The other way is to replace the memory recollection scheme with crossbeam's epoch GC. That seems like the way to go for now, since plain pointers (epoch::Atomic) can trivially be paired with a bool (we cannot avoid the Markable part for skiplists) in a lock-free atomic primitive. I will probably PR something like MarkableAtomic soon and then try to rewrite the skiplist on top of that. This will have the additional advantage of being most likely faster. (Link taken from aturon's excellent blog post), but some disadvantages with respect to interface design (&ValueType cannot be returned, only ValueType).
TL;DR concurrency is hard

@Vtec234 should this be closed (same as #102)?

@arthurprs This primitive is integrated with a different memory-recollection scheme - reference counting. If the authors of crossbeam do not want to look into this scheme, since it's quite a bit slower, this should be closed, but i'll keep it open for now as reference counting has some advantages over garbage collection, primarily having more predictable recollection times.

More general types have been proposed in crossbeam-rs/rfcs#28.


Run automatic tests on all supported platforms and architectures

Currently we only run the tests for kpt on linux in our github actions. We should expand that to also include osx and windows.
We are also only running the tests on amd64 architecture, so we should look into running the tests on arm64 as well.

We should be able to start this by adopting GitHub Action's Build Matrix feature. Modifying the verifyGuides.yml should be a good start. Both Windows and Mac runners are supported by GitHub but for Arm64 a self-hosted runner seems to be required currently.

We should be able to start this by adopting GitHub Action's Build Matrix feature. Modifying the verifyGuides.yml should be a good start. Both Windows and Mac runners are supported by GitHub but for Arm64 a self-hosted runner seems to be required currently.

I created a PR to see what tests will fail on Windows and macOS. #1683
Windows error log:
logs_3412.zip
macOS error log:
logs_3413.zip


LHN - Individual chats are NOT grayed out when I sent split bill offline

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open the App
Login with any account
Disable the internet connection in the device
From the global create menu +, select Split bill
Go through the prompt and select TWO participants
The group chat is created with those participants and you are navigated to it (the whole chat should be greyed out
Individual chats with each participant are created (these chats should be greyed out)

Expected Result:
Individual chats are NOT grayed out
Actual Result:
Individual chats is greyed out
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android / native
[ ] Android / Chrome
[x] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: <IP_ADDRESS>
Reproducible in staging?: Yes
Reproducible in production?: Yes
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/3133273
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://user-images.githubusercontent.com/93399543/217405179-8fef7635-c35a-4673-9118-05b81eafefae.mp4
Expensify/Expensify Issue URL:
Issue reported by: Applause - Internal Team
Slack conversation:
View all open jobs on GitHub

Triggered auto assignment to @michaelhaxhiu (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

Bug0 Triage Checklist (Main S/O)

[ ] This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
[ ] This bug is not a duplicate report (check E/App issues and #expensify-bugs)

If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead

[ ] This bug is reproducible using the reproduction steps in the OP. S/O

If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
If the reproduction steps aren't clear and you determine the correct steps, please update the OP.

[ ] This issue is filled out as thoroughly and clearly as possible

Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.

[ ] I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

@michaelhaxhiu Huh... This is 4 days overdue. Who can take care of this?

@michaelhaxhiu Eep! 4 days overdue now. Issues have feelings too...

Will prioritize this one today

I tried to reproduce and the behavior seems to work correctly for me on iOS. Here are two scenarios I tried while offline:

Splitting a bill with someone who I have chat history with:

Splitting a bill with someone who I never chatted before:

It seems properly greyed out in both situations to me. @kbecciv can you lmk if you are still experiencing the issue?

@michaelhaxhiu  Checking with team. will update you shortly.

Issue is not reproduced any more.
https://user-images.githubusercontent.com/93399543/220172739-b3452a8b-b2b1-4ff8-bc73-77737a9d142e.MP4

@michaelhaxhiu @kbecciv this issue was created 2 weeks ago. Are we close to a solution? Let's make sure we're treating this as a top priority. Don't hesitate to create a thread in #expensify-open-source to align faster in real time. Thanks!

@michaelhaxhiu, @kbecciv Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

@michaelhaxhiu, @kbecciv Still overdue 6 days?! Let's take care of this!

@michaelhaxhiu  Be sure to fill out the Contact List!


etc vs etn

Under the tip about "Query String Parameters for the Main.aspx Page" you are using etc even though after the tip you say to not use etc but use etn.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 959d7f18-3c23-2ca5-080a-6d5d1b1d5042
Version Independent ID: 135ed837-1545-da0a-35f0-67d4b25ead68
Content: Open forms, views, dialogs, and reports with a URL (Developer Guide for Dynamics 365 Customer Engagement (on-premises))
Content Source: ce/customerengagement/on-premises/developer/open-forms-views-dialogs-reports-url.md
Service: crm-online
GitHub Login: @JimDaly
Microsoft Alias: jdaly

The tip is explaining how we can extract GUID from the record's UI.  The existing "Send a Link" button hyperlink still uses old etc notation. This might be changed in the future to etn notation.
However, when we are constructing addressable URLs for the purpose of opening it, MS is recommending us to use the etn instead of etc. Hope this helps.


Update how-to-populate-object-collections-from-multiple-sources-linq.md

https://github.com/dotnet/docs/issues/8837
Summary
Switched .First and .Last name in the select
Fixes #8837

In thinking about it, there are some additional issues here:

The directions presuppose that the example is run from Visual Studio, so that the data files are in the project directory, while the current directory is \bin\debug. The dependency on Visual Studio needs to be made clear, and the section "To create the data file" should make clear that the path in the code reflects access from Visual Studio and may need to be modified.
Even so, there is one too many ".." in the file paths of the data files in the source code. (The data files are two levels up from the current directory, not three.)
Because the console project template creates a module and the code doesn't use the Module...End Module statement, the startup object has to be changed in VS.

Is this code not available as a sample somewhere that folks can just download and that we can test?

We do try to move them all to dotnet/samples @richlander. These are probably legacy content that wasn't updated to have the samples moved out of the topic.
Eventually, we hope to get testing for all of them, I think right now only selected folders on that repo are being tested.


docs: update description

Coverage remained the same at 100.0% when pulling 1bbb11772ca7988b2e03bba3e5dc9798300feb6e on curbengh:readme into 8bcc617e7189b235b52718c777427c49e0641479 on hexojs:master.


Distributed tracing for EventHubs: add enqueueTime to Process span links

This PR adds enqueuedTime attribute on each link when processing messages: unix epoch time with milliseconds precision representing when the message was enqueued (x-opt-enqueued-time system property).

/azp run java - eventhubs

/azp run java - core - ci


change email validation

what did i do!
Switched to horizontal progress bar below toolbar.
No longer crashing when user can't connect to the server.
Added back CustomAdapter for Email because the mutation fails without it.
Added StringUtils. isValidPassword.
Added options menu to ChangeEmailActivity with save button that is enabled/disabled when input is valid or network call is in progress.
Hiding the keyboard when the user clicks save.
Created data class ChangeEmail so the validation is easier to follow in the view model.
Moved the start and end margin to the TextInputLayout instead of the TextInputEditText so the error is left aligned.
Showing error on email input when it loses focus and isn't valid.
Showing error snackbar. (will be restyled in a different PR)
Tests ✨
see

 Change email address: validation errors


Fixed Malwarebytes download url

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[ ] Have you validated your manifest locally with winget validate --manifest <path>?
[ ] Have you tested your manifest locally with winget install --manifest <path>?
[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

We had a static url before, but Malwarebytes deleted the file very quickly so this is sorta the best solution

#14340 winget cannot download from this url for some reason.
I am getting the same issue.

Hmm, Denelon said there was a few issues with the pipeline or something like that, i think this is a temporary issue when using winget

I've seen a few issues that seem to be impacting "download". I'm not sure if it's transient or deterministic yet. You can change the network settings from "default" to "wininet" to test.


Change recipe machine file but won't load

I don't know where ask this,  so sorry for issue, try to load custom machines.xml file, copy to user folder and change but nothing happen, how should I do it? Couldn't find any guides for it.
Thanks!

where did u get the custom machines xml file from?

I copied it from the folder recipes, i simply dragged the machines.xml file there and edited it, restarted the server but no changes loaded into the game.
What is the discord link?

https://discord.gg/sgYk3Jr


can not find allow recipes in emi

Issue Description:
What happens:
was not able to find most recipes mostly alloys
What you expected to happen:
to be able to see the alloy recipe
Steps to reproduce:

install emi and ender io
2.start world
3.look up alloy recipes
...

Affected Versions (Do not use "latest"):

EnderIO:6.2.4
EnderCore: not installed
Minecraft:1.20.1
Forge:47.3.12
SpongeForge? no
Optifine? no
Single Player and/or Server? both

Your most recent log file where the issue was present:
debug.log
latest.log

wrong issue tracker
report it here https://github.com/Team-EnderIO/EnderIO/issues


Improving the UI for Login and Sign Up pages with a modern design, while optimizing meta details for enhanced SEO performance.

Can you assign it to me?

 If you think any more improvements can be made, feel free to go for it. Keep up the great work, and happy contributing!


Documentation

Hi guys,
thanks for your hard work developing the new version of SignalR!
The question is -- is there is any documentation for the new version except this early presentation?
Thanks,
Oleg

We don't have any documentation at the moment - things are still changing rapidly. Samples might be helpful though.


TNBGem- All about banks- 2

Link to original project proposal.
#245
Link to most recent milestone payout request.
#309
Milestone Description
Setup interaction with Banks using Ruby

#
Objective
How can auditors verify milestone?

1
createBank
Check code in Github and verify using the network

2
getConfig and updateTrust
Check code in Github and verify using the network

3
getAccounts and updateAccounts
Check code in Github and verify using the network

4
getTransactions
Check code in Github and verify using the network

4
Tests
Run the test command in the repo and see if it passes

5
Documentation
Read the docs

How long do you estimate this milestone will take to complete?
1-2 weeks
Project Wallet
94cf53921e9c5ddf48dc5589b7cdf111f7acdc93dc3073b94880416d4676b9ae

Approved.


[sonarr-update-tba] Unable to determine IP address after recent update

Hi,
after a recent update the script fails:
./sonarr-update-tba.bash
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [verb]  No new updates available
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [info]  Processing container: sonarr
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [info]  Attempting to automatically determine container IP address
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [verb]  Container is utilizing 0 network type(s):
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [verb]  Lockfile removed
sonarr-update-tba.bash   ::   2024-01-28 21:51:07   ::   [error] Unable to determine IP address

LSIO Sonarr container is routed via gluetun, both in same compose file. Script used to run without a hitch with the same setup on my side.

I used to run mine through gluetun too. I also don't think I touched the find IP address section. In any case, let me look at it, I'll get back to you in the next day or two. Apologies for breaking it.

I ended up having a free 20 minutes and just sat down to look at it. I just pushed a commit that should fix it. Let me know if it's still giving you issues.

Thanks for the quick responses!
./sonarr-update-tba.bash
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [verb]  No new updates available
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [info]  Processing container: sonarr
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [info]  Attempting to automatically determine container IP address
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [verb]  Container is utilizing 0 network type(s):
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [info]  No network type defined. Checking to see if networking is through another container.
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [verb]  Network mode: container
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [info]  Networking routed through another container. Retrieving IP address.
sonarr-update-tba.bash   ::   2024-01-28 23:40:59   ::   [verb]  Lockfile removed

and that's it :(

Gah. Okay. I wanted to rewrite that block of script to be more resilient as a standalone function anyways, so here's my motivation to do that. I can probably get it done during down time at work tonight, as long as they don't keep me too busy. More commits to come soon™.

Alright, just pushed a commit that works for me in testing, let me know how it works for you.

Works beautifully, thank you!


UI: Wire up service call to fetch the list of connectors

On ConnectorsPage, we need to wire up fetching the list of connectors from the backend service.  The Connector model may need adjustments depending on the structure of the returned connectors.

Pending PR #139  - not complete, but should be a good initial start

Pending PR #152

PR merged - closing...


Create Contact Page

Directions

Sample Reference
Fields:

First Name
Middle Name [Optional]
Last Name
Email
Phone Number [Optional]
Message
There should be validation for the above fields
Add helper texts with a text transition for the above fields
Consult @anushbhatia for color and font suggestions
Make sure it is mobile responsive
Should be available at /contact

I would like to work on this under JWOC

Would you live to work on responsiveness for this on mobile device?

Would you live to work on responsiveness for this on mobile device?

yes!

You have to scroll left that shouldn't happen in mobile view

You have to scroll left/right that shouldn't happen in mobile view

okk


remove composer.lock from repo

for libs composer.lock should not be in the repo. for example see https://github.com/Seldaek/monolog

composer.lock is used to indicate when test breakage because of changed dependencies and not changes in the library itself.
Besides locked dependencies library is also tested with lowest and latest dependencies.
See travis build config file.


[stacked] Const constructors for view model widgets

Why be there no const constructors for the immutable ViewModelWidget class?
I feel like https://github.com/FilledStacks/stacked/blob/80bcaaddf51237c0870093a44b634e4a4b1cd590/lib/_viewmodel_widget.dart#L9
Should actually look like this:
const ViewModelWidget({Key key, this.reactive = true}) : super(key: key);

What is the rationale behind that decision?

If this is not intended, I can create a PR for this 👍🏽
I wanted to wait before creating any change as #27 should be merged first (I think it is imported and landing any other change before this one is tricky).

No rationale. I didn't make that choice consciously. You can definitely make a PR for that where it applies.


sql query result call twice

Hello,
I've got a problem with the result of mssql.query.
When I send an sql query, the result function is called twice...
I don't understand because my sql query is an "update" and the result is empty (I do not have multiple lines of results)
For example, I have a function that send an email with a new password. The email is sent twice... I found a temp solution with an index but it's not very clean.
Can you explain this ?
Here is the code :
//construct SQL query
var email =<EMAIL_ADDRESS>var password = require("crypto").randomBytes(4).toString('hex');
var password_md5 = require("crypto").createHash("md5").update(password).digest("hex");
var sql = "update dbo.mytable SET password='"+password_md5+"' where id=12";

var id = 0;     //temp solution

mssql.query(sql,
{
    success: function(results) {
        //Send email with new pwd
        if(id == 0) {
            response.send(statusCodes.OK,password_md5);
            sendEmail(email,password);
        }
        id++;   //temp solution
    },
    error: function(err) {
        response.send(statusCodes.INTERNAL_SERVER_ERROR,"Error : " + err);
    }
});

Thank you :-)
Steve

Are you sure you're using this module? Your code doesn't seems so.

Yes, here's the start of my function :
exports.put = function(request, response) {
var mssql = request.service.mssql;
...
}

That doesn't prove it - request.service.mssql can be anything... The code you posted is not compatible with this module, you can check the documentation on query method. You're propably using some kind of wrapper around mssql that causes response to be called twice.

OK.
I use "request.service.mssql" from Azure Mobile services.

I read abour request object on Azure Mobile service documentation : "exposes the request object functionality implemented by the Express.js library."

You're using Microsoft's Windows Azure Mobile Services - https://msdn.microsoft.com/en-us/library/azure/jj554212.aspx
It's a separate project and has nothing in common with this module. I can't see anything wrong with your code so I can advice you to contact Azure support. You can try to prefix your statement with set nocount on; command.

Oh it's working !
Thank you so much !!!
:-)


docs(RHTAPWATCH-1261): updating README

The README had some outdated content. Updating...

/retest


After adding Chrono lib a have an error - wasm execution failed with error: FunctionCallError(CompilationError(PrepareError(Instantiate)))

I have faced with an issue after adding chrono lib (https://docs.rs/chrono/latest/chrono/) into smart contract. I have an error  FunctionCallError(CompilationError(PrepareError(Instantiate))) permanently.
I created minimal example to reproduce problem - https://github.com/Dumbris/near_chrono_error
I just created new project using npx create-near-app command. And added these lines of code into the contract:
use chrono::{DateTime, NaiveDateTime, Utc}; https://github.com/Dumbris/near_chrono_error/blob/b92a06112d211147e40dc6f74fca26979eee79a6/contract/src/lib.rs#L11
let dt = Self::convert_timestamp_to_datetime(0); https://github.com/Dumbris/near_chrono_error/blob/b92a06112d211147e40dc6f74fca26979eee79a6/contract/src/lib.rs#L41
fn convert_timestamp_to_datetime(timestamp: u64) -> DateTime<Utc> {
        let naive_date_time = NaiveDateTime::from_timestamp(timestamp as i64, 0);
        DateTime::<Utc>::from_utc(naive_date_time, Utc)
    }

https://github.com/Dumbris/near_chrono_error/blob/b92a06112d211147e40dc6f74fca26979eee79a6/contract/src/lib.rs#L46
After deploy to testnet any interaction with smart contract gives an error - wasm execution failed with error: FunctionCallError(CompilationError(PrepareError(Instantiate)))
Any ideas how to fix it?
If it's impossible for now, how can I known in advance which libraries will cause such error?

So the issue is just that somewhere in this lib that's being compiled, it's using a host function which is not available on the NEAR runtime. Unfortunately, it would be very complex for us to check and assert this automatically, but hopefully we can do something to tighten that feedback loop.
In your case, what you can do is just disable the default features of chrono, and it will just work. Changing your dep in that repro to:
chrono = { version = "0.4", default-features = false }

compiles and runs fine. You can add back some of the default features if needed later, and try to find out which one is the incompatible, but hard to tell from a glance.

Thank you for clarifications and quick reply! I checked your solution it works 👍


Add documentation for R2DBC

We should provide some documentation around R2DBC so we end up with a specification that covers the SPI, behavior, and constraints of R2DBC.

What!?  Code == spec isn't enough?  😜 I thought I opened an issue about this before, and if I did, I'll link them together.  In the meantime, yep obviously and thankfully my SpringOne presentation has most of this information already cobbled together and ready to be turned into documentation.

You're right, I didn't associate #7 immediately with this topic.

With the remaining pull requests #53, #51 and #48 we will cover a majority of R2DBC SPI. We should then add documentation about:

Transactions, Transaction Isolation, and Savepoints
Statement
Batch
Row
Wrapping

We can consider this ticket done with the merge of the individual spec parts.


[WIP] Modifier with environment

fixes #439, fixes #443

/format

Now tracked in: https://github.com/outwatch/outwatch/pull/759


change get to post in README

when following the instructions with the developer provider I noticed that I needed to use post

Merged in another change that was the same as this, thank you for contributing


[Swagger] Review receipts returned format

Review and document how the account properties endpoint returns the data after the latest changes in catapult-rest.

Solved in #131


Make repo Bazel 0.27.0 compatible

This updates the rules_go to 0.18.6 because the older version was not Bazel 0.27.0 compatible.
When building the repo with Bazel 0.27.0 you receive this message:
Incompatible flag --incompatible_require_ctx_in_configure_features has been flipped, and the mandatory parameter 'ctx' of cc_common.configure_features is missing. Please add 'ctx' as a named parameter. See https://github.com/bazelbuild/bazel/issues/7793 for details

This has been fixed in the latest rules_go release

Also ran buildifier format on the WORKSPACE file. Just let me know if you want it gone and I'll remove the formatting.


Task links don't work most of the time

What happened?
Clicking on tasks is supposed to take you to the task in its original note. Clicking the task paragraph doesn't work, even though it selects the task, which feels unintuitive. Clicking on the text also fails to jump to the destination sometimes.

When successfully clicking the link, jumping to the destination is sometimes off, and the selected task is not even on screen. It's visible on this gif, and can be more egregious than this.

Maybe this is a separate issue (I'll open another issue if needed) but I really liked how task links used to be, and would like them to be back as an optional setting. Having the preview on the link icon hover was really convenient. The link icon is also more apparent to new users as something they can click and makes for more intuitive UX.
The examples are from the untouched Obsidian Help vault.
DQL
TASK
GROUP BY file.link

JS
No response
Dataview Version
0.4.23d
Obsidian Version
0.13.23
OS
Windows

Aha, so that's why... the whole div is not clickable. I can fix the "clicking only works intermittently". However, the view not scrolling to the task seems to be an Obsidian specific issue where it will not scroll to selected text, which is pretty frustrating.
I've fixed the issue partially in 0.4.23e... see if you still have bad scrolling behavior.

Clicking now also defaults to the old link behavior as well and THEN tries to select the task text, which heuristically should lead to better behavior.

Dataview has been reverted to 0.4.22 (via update 0.4.26).


buil: install the import libraries for windows

When building the target libraries, we need to install the import
library as well.  Unfortunately, due to the way that the swift build
system works, we do not have the ability to rely on CMake doing the
right thing and taking care of this for us.  We have to manually
construct and track the import library due to the fact that we fight the
cross-compilation support.  Add some logic to extract the import
libraries and install them so that uses can actually build for Windows.

Replace this paragraph with a description of your changes and rationale. Provide links to external references/discussions if appropriate.

Resolves SR-NNNN.

@swift-ci please test and merge

@swift-ci please test and merge

@swift-ci please test and merge

@swift-ci please test and merge


Client authorization using the browser does not work with Firefox (has workaround)

Client authorization using the browser does not work with Firefox 122.0 (64-bit) snap on Ubuntu 22.04.
app version: nightly amd-64 cli build
Your browser has been opened to authorize the client
Or copy and paste the following url:  https://umcg.geteduroam.nl/oauth/authorize/?client_id=app.geteduroam.sh&code_challenge=...............

Workaround:
Copypaste the url into Chromium instead of the default Firefox browser.
Preferred solution:
Bundle own browser (web app) ? or warn about using firefox?

Hmmm, what doesn't work exactly with firefox?

Hmm could be scripts being blocked or does the script expect some communication from the browser?

This is not an issue with this client, nor do I maintain that server. The authorize button itself works fine without javascript for me. Are you sure it's not because you're arriving at a microsoft portal that wants javascript to be enabled?


Fix warnings Pytest

[x] Add timezone in datetime for date_joined
[x] Add timezone in datetime for last_login

Coverage remained the same at 100.0% when pulling 2ab9bacc0cbdfb9a51942e2e4c5b217e16c15b64 on Fix_warnings_pytest into f7042a9ba0a6e6be4f5ed71584b7b1b4cb8a5679 on master.

Why make it simple when we can make it complicated? :blush:
All points are corrected. Thank you for your correction.

Coverage remained the same at 100.0% when pulling cce3f985a75cab4f477db6d5f8bcded0cf23565a on Fix_warnings_pytest into e1d07a405b29d74bb5af83429ce3cf036a6c3d85 on master.


New vision/eye phenotype FO-wave

Preferred term label: abnormal FO-wave shape

Synonyms: n/a

Textual definition: any anomaly in the graphical representation of the FO-wave in the electroretinogram; the ERG FO-wave can be used to assess the functional integrity of the photoreceptors, the pigment epithelial cells and the interactions between them.

Any additional notes to clarify the meaning or use of the term. Please provide a PubMed ID or URL(s) for the source of this information.

Suggested parent term (Please look in the hierarchy of the MP using the MP Browser or other browsers such as OLS and find the place in the MP where the new term best fits)

abnormal electroretinogram waveform feature (MP:0012029)

If you would like a nanoattribution, please indicate your ORCID id or provide a label such as MGI:sbello (organization, first initial-last name)

Trying to find a reference for the FO-wave definition

Trying to find a reference for the FO-wave definition

Reference from Abby PMID: 30040236 https://pubmed.ncbi.nlm.nih.gov/30040236/

Reference from Abby PMID: 30040236 https://pubmed.ncbi.nlm.nih.gov/30040236/

MP:0020974

MP:0020974


Change http.keepalive.max.connections to http.keepalive.connections

PR for issue: https://github.com/kaazing/gateway/issues/209

@jitsni, can you catchup with latest develop to get travis ci to go green?  Thanks


Corrected name of command "build" in usage

That was causing a typo in command description:
$ crystal build
Usage: crystal run [options] [programfile] [--] [arguments]

Options:
    --cross-compile flags            cross-compile
    -d, --debug                      Add symbolic debug info
   ...

Thanks!


fixed display message.

Upon buying my first domain I was prompted on success with the following message:
Codys-Mac-mini: my-blog codybrunner$ now domains buy rcws-development.com
> The domain "rcws-development.com" is available to buy under rockchalkwushock! [2s]
> Success! Domain purchased and created (some hash) [7s]
> You may now use your domain as an alias to your deployments. Run `now alias help`

Upon running that command I received:
Codys-Mac-mini: my-blog codybrunner$ now alias help
> Assigning alias help to deployment...
> Error! The alias you are trying to configure (help.now.sh) is already in use by a different account.

I believe what was meant was now alias --help or now alias -h. Changes have been made in this PR to that display message. All tests pass locally.

Thanks!

@leo
The only way I was able to test the fix in production was to purchase a domain. Can support remove that domain and refund me?

@rockchalkwushock I don't know, but I think so, yes. Please write at<EMAIL_ADDRESS>


67.2 Email Templates New Iteration

Follow up of #1680
Fixes left to do in Email Templates:

Keep Admin Request for non-Create requests template (PrivateCloudAdminRequest) and add Current and Requested data like in Edit Request
(old 4) In PrivateCloudAdminCreateRequest and PrivateCloudAdminRequest templates delete the header "Namespace Details" but leave the cluster data
(old 8) Delete the text that signifies Edit or Create request to make text universal in Completed Request emails (PrivateCloudRequestProvisioned and PrivateCloudRequestApproved)
(old 9) Same as point 8 (Universal wording) and delete “admin” in the text for Public Cloud Completed Request templates (PublicCloudRequestProvisioned and PublicCloudRequestApproved)
(old 15) Add comment from Admin (mandatory to Submit Approval) to Rejection and Approved templates for both Public and Private cloud (will require creation of the new component)
If user creates an Edit Request they receive an email with the header that it's Approved while it's not:

Emails w/ comments
PrivateCloudEditRequest 	-User- -working-
PrivateCloudRequestApproval 	-Admin -not working-
PrivateCloudRequestRejection 	-Admin- -not working-
PubliCloudEditRequest 		-User- -not working-
PublicCloudRequestApproval 	-Admin- -not working-
PublicCloudRequestRejection 	-Admin- -not working-

@Amritpal-Nijjar @okanji
Added a new point in the task:
If user creates an Edit Request they receive an email with the header that it's Approved while it's not:

Don't see the changes yet:

Everything is tested out and works good except these:
3. Approval Request is mutual for Create and Edit Request but it has wording about the new project set and about level of access (which is usually only mentioned when the new product is created).

4. The Public Cloud has mention of the Admin access which is not true in Public Cloud. Also it is information that is only suitable for creation approval and not for edit approval.


Create Timer

First in a series of three PRs for adding robust performance statistics tracking.

Internal presubmits failing for unrelated reasons.