Windows docker volume lock file issue

I am using "library/mongo:4.2-windowsservercore-1809" on Windows Server 2019 with a docker volume. When launching the container on an empty volume, it all works fine, but I am unable to restart my container without encountering a lock file issue.
This issue is similar to this older issue described here: https://github.com/StefanScherer/dockerfiles-windows/issues/322
I am using a docker volume instead of a bind mount to avoid file system issues, but it looks like docker volumes are problematic as well. What should I be verifying? Being unable to use MongoDB in a Windows container is a serious release blocker for me.
Here is the docker log:
2020-02-06T00:19:53.651+0000 I  CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none' 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] MongoDB starting : pid=5768 port=27017 dbpath=C:\data\db\ 64-bit host=224c0ea470d2 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] db version v4.2.3 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] git version: 6874650b362138df74be53d366bbefc321ea32d4 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] allocator: tcmalloc 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] modules: none 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] build environment: 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten]     distmod: 2012plus 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten]     distarch: x86_64 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten]     target_arch: x86_64 2020-02-06T00:19:53.991+0000 I  CONTROL  [initandlisten] options: { net: { bindIp: "*" } } 2020-02-06T00:19:54.066+0000 I  STORAGE  [initandlisten] Detected data files in C:\data\db\ created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2020-02-06T00:19:54.067+0000 I  STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3583M,cache_overflow=(file_max=0M),session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress], 2020-02-06T00:19:54.070+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:70320][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device Raw: [1580948394:70320][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device 2020-02-06T00:19:54.070+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:70320][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device Raw: [1580948394:70320][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device 2020-02-06T00:19:54.071+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:71316][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device Raw: [1580948394:71316][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device 2020-02-06T00:19:54.071+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:71316][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device Raw: [1580948394:71316][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device 2020-02-06T00:19:54.072+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:72314][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device Raw: [1580948394:72314][5768:140703784850016], wiredtiger_open: __win_file_lock, 241: C:\data\db\\WiredTiger.lock: handle-lock: LockFile: The process cannot access the file because another process has locked a portion of the file. : Resource device 2020-02-06T00:19:54.072+0000 E  STORAGE  [initandlisten] WiredTiger error (16) [1580948394:72314][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device Raw: [1580948394:72314][5768:140703784850016], wiredtiger_open: __conn_single, 1674: WiredTiger database is already being managed by another process: Resource device 2020-02-06T00:19:54.072+0000 W  STORAGE  [initandlisten] Failed to start up WiredTiger under any compatibility version. 2020-02-06T00:19:54.072+0000 F  STORAGE  [initandlisten] Reason: 16: Resource device 2020-02-06T00:19:54.073+0000 F  -        [initandlisten] Fatal Assertion 28595 at src\mongo\db\storage\wiredtiger\wiredtiger_kv_engine.cpp 789 2020-02-06T00:19:54.073+0000 F  -        [initandlisten]  ***aborting after fassert() failure
And the corresponding docker run command:
docker run --name den-mongo -d --network=den-network -v den-mongodata:c:\data\db

Is the initial container shutting down cleanly?  (Do the MongoDB logs show that it was able to shut down and close out the database files successfully?)

I shutdown the container with a simple "docker stop". My current code does not pass "--rm" to the docker run command, so the container lingers one after it's been stopped (easier to run docker logs afterwards). To compensate for not using --rm, I run docker stop + docker rm before docker run for all of my containers, so maybe something in this sequence messes things up.
Would it be possible that Windows accesses the files from the docker volume, causing them to be potentially locked by another process when it shouldn't?
I managed to find a temporary workaround by finding the real file path on the disk where the docker volume is stored, and deleting the WiredTiger.lock file while the container is not running. If the container is running, Windows won't let me delete it because another process is accessing it.
PS C:\Users\wayk-admin\den-test> $volume = $(docker volume inspect den-mongodata) | ConvertFrom-Json PS C:\Users\wayk-admin\den-test> $volume.MountPoint C:\ProgramData\docker\volumes\den-mongodata\_data PS C:\Users\wayk-admin\den-test> $WiredTigerLock = Join-Path $volume.MountPoint 'WiredTiger.lock' PS C:\Users\wayk-admin\den-test> Remove-Item $WiredTigerLock -Force

I launched my container, then instead of calling docker rm on it, I stopped it, then re-launched it with docker start (probably the best way to do it). I encountered the same issue, but since I didn't remove the container I could get a clean log of the previous shutdown. It all looks good to me, so I'm thinking it might be a timing issue related to docker and the fact that the lock file is one of the last operation done on the container shutdown:
2020-02-06T01:01:32.517+0000 I  CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none' 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] MongoDB starting : pid=8480 port=27017 dbpath=C:\data\db\ 64-bit host=875be735f5ee 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] db version v4.2.3 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] git version: 6874650b362138df74be53d366bbefc321ea32d4 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] allocator: tcmalloc 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] modules: none 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] build environment: 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten]     distmod: 2012plus 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten]     distarch: x86_64 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten]     target_arch: x86_64 2020-02-06T01:01:32.603+0000 I  CONTROL  [initandlisten] options: { net: { bindIp: "*" } } 2020-02-06T01:01:32.640+0000 I  STORAGE  [initandlisten] Detected data files in C:\data\db\ created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2020-02-06T01:01:32.641+0000 I  STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3583M,cache_overflow=(file_max=0M),session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress], 2020-02-06T01:01:32.922+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950892:922421][8480:140704011735648], txn-recover: Recovering log 2 through 3 2020-02-06T01:01:33.034+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950893:34523][8480:140704011735648], txn-recover: Recovering log 3 through 3 2020-02-06T01:01:33.194+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950893:194483][8480:140704011735648], txn-recover: Main recovery loop: starting at 2/6528 to 3/256 2020-02-06T01:01:33.477+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950893:477432][8480:140704011735648], txn-recover: Recovering log 2 through 3 2020-02-06T01:01:33.702+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950893:702420][8480:140704011735648], txn-recover: Recovering log 3 through 3 2020-02-06T01:01:33.813+0000 I  STORAGE  [initandlisten] WiredTiger message [1580950893:812425][8480:140704011735648], txn-recover: Set global recovery timestamp: (0, 0) 2020-02-06T01:01:34.124+0000 I  RECOVERY [initandlisten] WiredTiger recoveryTimestamp.  It's far from ideal, but at least it is no longer release blocking for me. However, we should definitely go to the bottom of this. Since "shutdown: removing fs lock..." is apparently the last operation made by the process, I highly suspect it might be a problem with file operations done right before docker terminates the container. I wouldn't be surprised that adding a 1 second sleep there would "solve" the problem.

I grabbed a Windows machine so I could test this out and I'm not actually able to reproduce -- I started MongoDB with a volume and did docker stop, then started a new container from the same volume and it started up without any issues. :confused:
(I also played with db.shutdownServer(), but that test worked fine too, which is less surprising.)

I can easily reproduce the issue with my cmdlet (https://github.com/devolutions/waykden-ps). I will see if I can make a smaller reproduction test case. Otherwise, just starting and stopping with my cmdlet that wraps docker containers is sufficient if you're willing to give it a shot. My last version has the workaround to delete the lock file but it prints it out when it does so you'd see it.

I am quite sure I've encountered this issue in the past on various Windows environments without hitting it consistently. Maybe it would help to know that I could see it happen every time in a very specific Azure VM instance, a dev/test sized Windows Server 2019 Core + containers exactly like the one from this guide I wrote: https://github.com/Devolutions/WaykDen-ps/blob/master/docs/getting-started-azure.adoc

@tianon I have made a simple script to run a MongoDB Windows container with a docker volume, stop it, then check for the remaining WiredTiger.lock file and delete it if present. It happens every single time I run it, no effort required: https://gist.github.com/awakecoding/f24608fad3ed6e867df624cef62e28ce
Let me know if you can reproduce the issue with the script, but I'm guessing it won't happen since you already tried. If you're willing to spend some time on it, I would be willing to create a virtual machine in Azure on our company subscription and give you access to it. I'd make sure that the issue is easy to reproduce on the virtual machine I'd prepare for you. I'd create an identical Windows Server 2019 Core + Containers virtual machine as the one where it happens all the time.

Bingo, someone investigated this very same issue and got a smaller program to reproduce it: https://github.com/moby/moby/issues/39088
It sounds like there is an issue with Windows containers and the APIs used for releasing the WiredTiger.lock file.

Is there a workaround for this? I can't restart MongoDB container without manually deleting .lock files.
I'm experiencing the same problem on Windows Server 2019 Host + MongoDB Windows-based container.
Tested on clean VM with Docker CE or Azure IoT Edge (Moby).

The only workarounds are to automate deleting the lock file or yo use MongoDB on a linux host.
Closing this in favor of the upstream issue in Windows Containers (https://github.com/microsoft/Windows-Containers/issues/37)


How can I control the startup sequence of the chart through Chart Hook?

Output of helm version:  v3.6.2
Output of kubectl version: {Major:"1", Minor:"19", GitVersion:"v1.19.7", GitCommit:"1dd5338295409edcfff11505e7bb246f0d325d15", GitTreeState:"clean", BuildDate:"2021-01-13T13:23:52Z",
GoVersion:"go1.15.5", Compiler:"gc", Platform:"windows/amd64"}
Cloud Provider/Platform (AKS, GKE, Minikube etc.):  docker desktop for kubernetes
As shown in the figure, I rely on other charts through requirements.yaml

Then I enable them in values.yml. The types of eureka and pg-run are both statefulset. I defined eureka's weight as a negative number and pg-run as a positive number through the chart hook. According to the official website, the weight of the negative number is executed first, so in theory, eureka starts first, but in fact, eureka and pg-run are at the same time How to use chart hook when it is started? Which step is wrong?

There is some information that may help understand what is happening.
Kubernetes is a declarative system. The idea is that you declare what you want, Kubernetes running reconcile loops tries to make it happen, along the way it updates the state (current state) to show where it is at. Sending many different manifests to Kubernetes should, in theory, eventually reconcile to make it work.
In practice you sometimes need ordering.
Helm sends all of the manifests to Kubernetes at one time. Weighting provides some ability to sort the manifests but they are still sent to Kubernetes at once.
If you want ordering with checking that things have come up you'll need a system on top of Helm. Helm is a package manager (like apt, yum, zypper) and not a deployment config manager (like ansible or chef). A system on top of Helm can install packages, check status, and install other tools. The people who installed OpenStack on Kubernetes did this. That software has now become airship.


Install super locally per repo or once globally?

Installing it locally is more in line with the everything-reproducible philosophy of Nix (which is generally a good idea). However, it's also a hassle, because e.g. do you require everyone to use Nix for their projects? That seems too restrictive.
Most people will also only have one super repo, and if they have two, they probably don't care that they use the same version of super.
I'm leaning more towards one global installation of the super binary, since it will make installation smoother and the initial adoption hurdle smaller.

Decision: super will be installed once globally.


Restore training states without create new version in lightning_logs?

I want to restore my training state, I read the docs and successful. But it create a new version in lightning_logs/ directory and when I use Tensorboard, they're like 2 separated processes rather than one is followed by the other.
How can I continue training without create a new version in logs?

Hey @vietnamican,
When you restore the Trainer, are you using Trainer(resume_from_checkpoint=...)

Would you mind trying this ?
Trainer(resume_from_checkpoint=..., callbacks=[ModelCheckpoint(dirpath=previous_path)]

Best,
T.C

Hey @vietnamican,
When you restore the Trainer, are you using Trainer(resume_from_checkpoint=...)

Would you mind trying this ?
Trainer(resume_from_checkpoint=..., callbacks=[ModelCheckpoint(dirpath=previous_path)]

Best,
T.C

@rohitgr7 Any idea ?

@rohitgr7 Any idea ?

@rohitgr7 And do you think saving / restoring self.dirpath in the checkpoint could solve this use-case

@rohitgr7 And do you think saving / restoring self.dirpath in the checkpoint could solve this use-case

@tchaton I try you suggestion and I checkpoints are restored the same directory every epoch. But I want to mention logs: PL is keeping create new version inside lightning_logs/ and when draw in Tensorboard, two versions are different colors, which makes me feel like they are two separate training processes rather than continuous one.
Copying the Tensorboard events.* files and put them under the same directory is simply way to solve this problem, sometimes it can be hard to handle though. If Trainer has a flag allow us to continue writing Tensorboard events.* files into the directory where the previous is, I think it sounds cool, right?

@tchaton I try you suggestion and I checkpoints are restored the same directory every epoch. But I want to mention logs: PL is keeping create new version inside lightning_logs/ and when draw in Tensorboard, two versions are different colors, which makes me feel like they are two separate training processes rather than continuous one.
Copying the Tensorboard events.* files and put them under the same directory is simply way to solve this problem, sometimes it can be hard to handle though. If Trainer has a flag allow us to continue writing Tensorboard events.* files into the directory where the previous is, I think it sounds cool, right?

@tchaton yes, saving/restoring dirpath will solve the issue. We need to have some conditions here. If a new dirpath is given in ModelCheckpoint while resuming, it shouldn't be restored. And not just dirpath, more things need to be saved and restored here. Discussion: https://github.com/PyTorchLightning/pytorch-lightning/issues/4911

@tchaton yes, saving/restoring dirpath will solve the issue. We need to have some conditions here. If a new dirpath is given in ModelCheckpoint while resuming, it shouldn't be restored. And not just dirpath, more things need to be saved and restored here. Discussion: https://github.com/PyTorchLightning/pytorch-lightning/issues/4911

Hey @vietnamican,
Would you be interested to contribute a fix ?
Best,
T.C

@tchaton I'm happy to contribute! I'll create a PR when I added this feature.

I found TensorboardLogger solves the problem.
Here the notebook example: https://colab.research.google.com/drive/1yKJpWQ2q2idsXbSd9rTkWNeiV0JpVzP9?usp=sharing

I found TensorboardLogger solves the problem.
Here the notebook example: https://colab.research.google.com/drive/1yKJpWQ2q2idsXbSd9rTkWNeiV0JpVzP9?usp=sharing

Thanks!!

I also noticed that the code in the notebook what modified and now it contains a syntax error:
from pytorch_lightning.loggers import TensorBoardLogger
logger = TensorBoardLogger('lightning_logs', name=''=0)


Add Configuration App [QUESTION]

First check

[V] I used the GitHub search to find a similar issue and didn't find it.
[V] I searched the FastAPI documentation, with the integrated search.
[V] I already searched in Google "How to X in FastAPI" and didn't find any information.

Description
in main.py define variable like this, this is an example from flask
config = Setting()
app.config.update(config.load_config) --> this will save all config in some state
app.config.db_conn = DBConnection(...)

in example.py
from flask import current_app
db_connection = current_app.config.db_conn --> Load config from state to shared in another class or file

How i can do this in fast api ???
Please help

Hi, @FerdinaKusumah !
You can use Config from starlette.

Thanks @Slyfoxy !
@FerdinaKusumah also, you don't really need to save stuff to the app object. You can store things in a variable that you use in other places.
For example, with Pydantic's BaseSettings: https://pydantic-docs.helpmanual.io/usage/settings/


Gym dependency

Evogym currently depends on gym 0.19.0, however pip no longer supports installing this version
pip install gym==0.19.0
Collecting gym==0.19.0
  Using cached gym-0.19.0.tar.gz (1.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [1 lines of output]
      error in gym setup command: 'extras_require' must be a dictionary whose values are strings or lists of strings containing valid project/version requirement specifiers.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

More recent versions of gym (>0.26.0) have changed their API and in the future, gym will be replaced by gymnasium, which uses the gym>0.26.0 API. Would it be possible to update the dependency to gymnasium and change the API?
For now, I've been able to use evogym with version 0.22.0 of gym, however this breaks the requirement to have stable-baselines3==1.4.0 in requirements.txt. This requirement doesn't seem necessary to run evogym, just to run the examples.

Hello @d9w!
FYI: #35 would be useful for you, thank you!

Updated in v2.0.0. Feel free to reopen this issue if the problem persists!


[4.0 beta 3] import 3.51 project and 'scancode' is not converted to 'keycode'

Godot version
4.0 Beta 3
System information
Kubuntu 22.04
Issue description
When importing from a 3.51 project into 4.0:
func _unhandled_input(event):
if event is InputEventKey:
if event.pressed and event.scancode == KEY_ESCAPE:
get_tree().quit()
event.scancode is not converted to event.keycode
Steps to reproduce
Try importing into Godot 4.0 beta 3 the above function from a 3.51 project.
Minimal reproduction project
No response

In PR #51950, @qarmin made a conscious decision to disable this specific conversion.
    // Some need to be disabled, because users frequently use these names for variables.
...
    //      { "scancode", "keycode" }, // InputEventKey

Therefore, I think we need to be careful before re-evaluating this decision and it shouldn't be rushed for 4.0.


throws error and causes app to crash when sematext server is down

Error [ERR_UNHANDLED_ERROR]: Unhandled error. ({
  source: 'logsene-js',
  err: {
    message: 'HTTP status code:503',
    httpStatus: 503,
    httpBody: '\r\n' +
      '<title>503 Service Temporarily Unavailable</title>\r\n' +
      '\r\n' +
      '
503 Service Temporarily Unavailable
\r\n' +
      '
nginx/1.17.10\r\n' +
      '\r\n' +
      '\r\n',
    url: 'https://logsene-receiver.sematext.com/_bulk'
  }
})
    at Logsene.emit (events.js:304:17)
    at Logsene.EventEmitter.emit (domain.js:485:12)
    at Request.httpResult [as _callback] (index.js:462:12)
    at Request.self.callback (node_modules/request/request.js:185:22)
    at Request.emit (events.js:315:20)
    at Request.EventEmitter.emit (domain.js:485:12)
    at Request.<anonymous> (node_modules/request/request.js:1154:10)
    at Request.emit (events.js:315:20)
    at Request.EventEmitter.emit (domain.js:485:12)
    at IncomingMessage.<anonymous> (node_modules/request/request.js:1076:12)

Needs proper error handling so it doesn't crash

currently sematext server seems down

Hey @joonhocho ! Thanks for creating an issue. I'm aware of this and have it on my todo list to handle ASAP. :ok_hand:

@adnanrahic Thanks!

Hi @joonhocho . I've released a new version of the agent with a fix for this issue.
Can you please check out version 1.1.70 and confirm it works for you?


panic: runtime error after golang update

Hello previous image flant/shell-operator:latest works fine after update pod throw error.
kubectl version:
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:14:22Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.10+IKS", GitCommit:"18e8565daf60eb3a20c0ac29a7d3a93622659e4d", GitTreeState:"clean", BuildDate:"2020-01-16T04:08:27Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"linux/amd64"}

After update image flant/shell-operator: latest i got:
{"level":"info","msg":"shell-operator master-3ab0bc97-ubuntu-2020.03.16_06:26:46","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Listen on <IP_ADDRESS>:9115","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Hooks dir: /hooks","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Use temporary dir: /tmp/shell-operator","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Debug endpoint listen on /var/run/shell-operator/debug.socket","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Kubernetes client is configured successfully with 'out-of-cluster' config","operator.component":"KubernetesAPIClient","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Initialize hooks manager. Search for and load all hooks.","time":"2020-03-17T01:42:33Z"}
{"hook":"hook.sh","level":"info","msg":"Load config from '/hooks/hook.sh'","phase":"config","time":"2020-03-17T01:42:33Z"}
{"hook":"hook.sh","level":"info","msg":"Loaded config: OnStartup:1, Watch k8s kinds: 'Node'","phase":"config","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"start shell-operator","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"add HookRun@OnStartup tasks for 1 hooks","operator.component":"initMainQueue","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"queue task EnableKubernetesBindings: with hook hook.sh","operator.component":"initMainQueue","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Create new metric shell_operator_shell_operator_live_ticks","operator.component":"metricsStorage","time":"2020-03-17T01:42:33Z"}
{"binding":"onStartup","hook":"hook.sh","level":"info","msg":"Execute hook","operator.component":"taskRunner","queue":"","task":"HookRun","time":"2020-03-17T01:42:33Z"}
{"level":"info","msg":"Create new metric shell_operator_shell_operator_tasks_queue_length","operator.component":"metricsStorage","time":"2020-03-17T01:42:33Z"}
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x12915d4]

goroutine 27 [running]:
github.com/flant/shell-operator/pkg/task/queue.(*TaskQueue).Iterate(0x0, 0xc0006818f0)
	/src/shell-operator/pkg/task/queue/task_queue.go:364 +0x34
github.com/flant/shell-operator/pkg/shell-operator.(*ShellOperator).CombineBingingContextForHook(0xc000195ea0, 0x19d7be0, 0xc0000a9920, 0x1)
	/src/shell-operator/pkg/shell-operator/operator.go:363 +0x1fc
github.com/flant/shell-operator/pkg/shell-operator.(*ShellOperator).TaskHandler(0xc000195ea0, 0x19d7be0, 0xc0000a9920, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/src/shell-operator/pkg/shell-operator/operator.go:285 +0xc4a
github.com/flant/shell-operator/pkg/task/queue.(*TaskQueue).Start.func1(0xc0005606c0)
	/src/shell-operator/pkg/task/queue/task_queue.go:292 +0x396
created by github.com/flant/shell-operator/pkg/task/queue.(*TaskQueue).Start
	/src/shell-operator/pkg/task/queue/task_queue.go:271 +0x4f

rollback to tag v1.0.0-beta.8 fixed this issue.

The bug was in #144. The compaction may start for a nonexistent queue. This is fixed in #150.


Navigation is broken when using keyboard

See https://www.reddit.com/r/programming/comments/krooqi/a_full_website_in_17_kb_all_assets_included/gib2ty9/

This looks like a viable solution:
https://codesandbox.io/s/hash-navigation-919fp?file=/index.html

This looks like a viable solution:
https://codesandbox.io/s/hash-navigation-919fp?file=/index.html


⚠ AlphaRatio has degraded performance

In 5b4c2c6, AlphaRatio ($AR) experienced degraded performance:

HTTP code: 200
Response time: 3361 ms

Resolved: AlphaRatio performance has improved in 5893775 after 6 minutes.


Docker container does not come up

I try to start the docker container as described, but it will not start. I tried it "as is" without any modification (besides renaming .env.example to .env) and also fully customized, but I always get this error:
onetime-app    | Bundle complete! 20 Gemfile dependencies, 34 gems now installed.
onetime-app    | Use `bundle info [gemname]` to see where a bundled gem is installed.
onetime-app    | /app/lib/onetime/core_ext.rb:30: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/attic-0.5.3/lib/attic.rb:13: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:654: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:655: warning: constant ::Bignum is deprecated
onetime-app    | onetime[1]: no implicit conversion of nil into String
onetime-app    | Error loading config:
onetime-app    | onetime[1]: Error loading config:

Then I renamed etc/config.example to etc/config but a new error occured:
onetime-app    | Bundle complete! 20 Gemfile dependencies, 34 gems now installed.
onetime-app    | Use `bundle info [gemname]` to see where a bundled gem is installed.
onetime-app    | /app/lib/onetime/core_ext.rb:30: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/attic-0.5.3/lib/attic.rb:13: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:654: warning: constant ::Fixnum is deprecated
onetime-app    | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:655: warning: constant ::Bignum is deprecated
onetime-app    | bundler: failed to load command: thin (/usr/local/bundle/bin/thin)
onetime-app    | bundler: failed to load command: bundle (/usr/local/bundle/bin/bundle)
onetime-app    | /usr/local/lib/ruby/2.6.0/erb.rb:901:in `eval': (erb):8: syntax error, unexpected ';', expecting ')' (SyntaxError)
onetime-app    | ...e=false&logging=false' ).to_s); _erbout.<< "\n  :config: /et...
onetime-app    | ...                              ^
onetime-app    |        from /usr/local/lib/ruby/2.6.0/erb.rb:901:in `result'

Any help would be appreciated!

Thanks for the quick answer. After adding the ")" and after doing "docker compose up -d" it now stops at
Container onetime-redis        Creating

So I overcame this problem, and the next occurs. From my understanding the port in ONETIMESECRET_REDIS_URL is wrong. It says  7179, but I think it should be 6379. Am I wrong?
Anyways, after correcting the port, I get:
onetimesecret-app      | Bundle complete! 20 Gemfile dependencies, 34 gems now installed.
onetimesecret-app      | Use `bundle info [gemname]` to see where a bundled gem is installed.
onetimesecret-app      | /app/lib/onetime/core_ext.rb:30: warning: constant ::Fixnum is deprecated
onetimesecret-app      | /usr/local/bundle/gems/attic-0.5.3/lib/attic.rb:13: warning: constant ::Fixnum is deprecated
onetimesecret-app      | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:654: warning: constant ::Fixnum is deprecated
onetimesecret-app      | /usr/local/bundle/gems/gibbler-0.8.9/lib/gibbler.rb:655: warning: constant ::Bignum is deprecated
onetimesecret-app      | bundler: failed to load command: thin (/usr/local/bundle/bin/thin)
onetimesecret-app      | bundler: failed to load command: bundle (/usr/local/bundle/bin/bundle)
onetimesecret-app      | /usr/local/bundle/gems/redis-2.2.2/lib/redis/client.rb:47:in `call': ERR AUTH <password> called without any password configured for the default user. Are you sure your configuration is correct? (RuntimeError)

I changed passwords in .env and redis.conf. By the way: in etc/config it says:
:config: /etc/onetime/redis.conf
Is this path correct? I would guess it should be :config: /etc/redis.conf. But this does not help, I still get the above error.
Could someone please share a working docker-compose file and the various config files? Thanks a lot!!!

I had luck by not specifying user or pass in the config file on line 4 "'redis://@localhost'sIP:6379/0?timeout=10&thread_safe=false&logging=false')  %>"
I still cannot figure out how to get it to identify my redis.conf file. It doesn't seem to matter what path I put there are a couple references in this project and I have tried changing them all, albeit not at the same time. So even if you comment out the requirepass, it doesn't matter it seems because it uses a default redis instead of using your config file. Let me know if you figure that out

Here's how to tell Redis to use your own config file:
services:
  redis:
    command: ["redis-server", "/usr/local/etc/redis/redis.conf"]
    volumes:
      - ./etc/redis.conf:/usr/local/etc/redis/redis.conf

Some new info:
Ensure that you can connect to the redis database and also ensure that the redis container is stood up with a default password.
This got it working for me.

Hi, could you explain me how it is working? I left changeme to test, on my redis.conf, .env and config files... could ou explain what can I do?
thanks a lot,
Rafa.


Adding a genetic algorithm for hyperparameter optimisation

On my dataset (~1000 data) and, using the fit_genetic function, I obtained an 8% improvement (on a 5-fold test set) compared to the fit_preset function of the last modnet update.
This model is used as follow:
ga = FitGenetic(train)
model = ga.get_model(data=train, size_pop=5, num_epochs=2)
where size_pop and num_epochs are optional parameters representing the population size and the number of generations respectively. Their default values are 15 and 5 respectively.
The running time depends obviously on the population size and the number of generations, but it's usually more expensive to run this model than the fit_preset one. On a 1000 data dataset, for a pop_size=15 and num_epochs=5, on a 5-fold test, the running time is 4h07, on my 7 years old computer, which is thus still reasonable.
I think that a genetic algorithm is better to generalize our modnet model than a fit_preset function. Therefore, I believe it will give better results on the Matbench.

Thanks a lot @ml-evs for your review !! I'll fix that and come back to you with the corrected version. ;)

@ml-evs I just read again all your remarks. I love them !! You highlighted very interesting points. See you tomorrow where I'll present you my results.
Greg

Hi Matthew,
I updated the fit_genetic file thanks to your suggestions. You can have a look when you'll have time ;)
Have a nice week-end!
Cheers,
Greg

You can find here an updated version of my genetic algorithm. Feel free to check it out and to let some comments.
I would love to see how is this algorithm performing on Matbench for the following parameters:

pop_size=10

num_generations=4

pop_size=15

num_generations=6

pop_size=20

num_generations=8

I added parallelization when doing cross-validation to speed up the genetic algorithm.

Hi, thanks for your work Greg! Could I ask you to resolve the conflicts. From what I see, removing models and utils file from the PR should be enough, as your PR isn't related to those files. Thanks.

I'll open another soon


[SPARK-13338][ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion

Can one of the admins verify this patch?

LGTM pending test.
ping @mengxr @jkbradley
Could you add @grzegorz-chilkiewicz to white list?

ok to test

Test build #51467 has started for PR 11216 at commit c66d5e5.

Test build #51467 has finished for PR 11216 at commit c66d5e5.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51467/
Test PASSed.

Merged build finished. Test PASSed.

The implementation should work with degree 1, but we need to add a test to show that. @grzegorz-chilkiewicz Could you update this PR and add a test to show with degree 1 it is a no-op? Just testing the setter is not sufficient.

OK, I'll prepare that test soon.
I've checked that with even degree 0, PolynomialExpansion works (and returns '0-length vector').
Does it make sense to extend range of legal parameters to gtEq(0) ?

@mengxr I could see value 1 being used in a cross-validation setup. But do we really want to allow <=0 param values? I don't think it makes a lot of sense to return a zero-length vector for a non-zero length input. There's no real use case for this.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51773/
Test FAILed.

Merged build finished. Test FAILed.

Test build #51774 has started for PR 11216 at commit 83f22a9.

No, it is not necessary to support 0 degree.

Test build #51774 has finished for PR 11216 at commit 83f22a9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51774/
Test PASSed.

LGTM. Merged into master. Thanks!


Support circuit breaker configuration per Feign client

Is your feature request related to a problem? Please describe.
Currently, there seems to be no way to configure different circuit breakers for different Feign clients without listing all their methods.
I can either customize the default configuration, but then this configuration will be applied to all Feign clients. On the other hand, if I want to customize a specific configuration, I must do so for all its methods, as the circuit breaker name is <feignClientName>-<methodName>.
Describe the solution you'd like
A simple solution would be to also check for a circuit breaker called feignClientName if no more specific one is found.
An ideal solution would be similar to the other Feign configuration, i.e. I can specify a Customizer Bean in the Feign configuration, like ErrorDecoder or Retryer. This customizer would then be applied to just this Feign client.
Describe alternatives you've considered
As I said, the current alternatives would be to list all methods in a client, which is quite error-prone.

If you think this is a good idea, I might try to implement it. I just need some pointers how I would go about implementing that.

I agree with @fdw. Configuration is difficult and error-prone. In Hystrix era we used SetterFactory to customize command names. We could simply use Feign class name only or class and method.
It would be great if we could easily get the same with Spring Cloud Circuit Breaker/Resilience4j.
Maybe something similar to feign.circuitbreaker.group.enabled=true that groups all methods into one configuration for bulkhead configuration?
Another solution would be to allow to customize circuitName in FeignCircuitBreakerInvocationHandler:
class FeignCircuitBreakerInvocationHandler implements InvocationHandler {
...
   @Override
   public Object invoke(final Object proxy, final Method method, final Object[] args) throws Throwable {
      ...
      String circuitName = Feign.configKey(target.type(), method); // allow to customize name
      ...
   }
}

My current small improvement for this issue is to display all possible circuit breaker names during app startup:
```java
@Bean
Capability customCapability() {
      return new ConfigKeysPrintingCapability();
}

@Slf4j
public class ConfigKeysPrintingCapability implements Capability {

    @Override
    public InvocationHandlerFactory enrich(InvocationHandlerFactory invocationHandlerFactory) {
        return (target, dispatch) -> {
            Set<Method> keySet = dispatch.keySet();
            for (Method method : keySet) {
                log.info("Method key: {}", Feign.configKey(target.type(), method));
            }
            return invocationHandlerFactory.create(target, dispatch);
        };
    }
}


Will llama2 70B be supported in future?

Hi there, many thanks for this wonderful sharing!
Just wonder will there be a 70b running on colab?
Have tried Petals' work however the chat worked not that right.
Best,

thanks for the info ❤ please test new v2.3


[HOLD for payment 2023-06-13] [$1000] On task description editing page field is showing mandatory when editing an existing task where by actually field should be optional

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Launch the app -> Login in account
Click on FAB button -> Click on Assign task option
Enter title & description -> add any assignee -> Click on confirm task -> will navigate to task detail page
On task detail page click on Description -> clear title field and press save -> Notice error message is This field is required instead of please enter a title

Expected Result:
On task description editing page field should be optional user can remove description & can save
Actual Result:
On task description editing page field is mandatory & user can't remove values
Workaround:
Can the user still use Expensify without this being fixed? Have you informed them of the workaround?
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android / native
[x] Android / Chrome
[x] iOS / native
[x] iOS / Safari
[x] MacOS / Chrome / Safari
[x] MacOS / Desktop

Version Number: <IP_ADDRESS>
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation

Expensify/Expensify Issue URL:
Issue reported by: @dhairyasenjaliya
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1684138155046919
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~0136c1b2820ecd2721
Upwork Job ID:<PHONE_NUMBER>367442432
Last Price Increase: 2023-05-17

This is not reproducible so I expect that it has been resolved in a recent deploy:
Testing task - description not required

no RBR
no error message
task is able to be sent without description

checking here in slack too about version numbers : https://expensify.slack.com/archives/C01SKUP7QR0/p1684334987930659

Okay, did some more testing and I understand the bug better now. It's that when you edit an existing task description, it is showing the error, not that the description field always throws an error.

Thank you @fedirjh ! Bump to @joelbettner please can you give us a 👍🏼 if you agree so we can move forward here please?

Going OOO and this is pretty active so needs management by bug0 team member, as per the new process to stay assigned but assign another team member, please can you keep a watch of this. I am OOO until 8th June. Thanks!

I'm actually also going to be OOO next week. So replacing myself as the additional assignee (per this discussion), so someone else who's working next week can help cover this until Zany's back!

I'm actually also going to be OOO next week. So replacing myself as the additional assignee (per this discussion), so someone else who's working next week can help cover this until Zany's back!

I followed up with Joel in Chat. I'm OOO on Monday but will check in on Tuesday.

No update

@dhairyasenjaliya's proposal looks good. 👍 Good call making sure the API updates with an empty value when the user deletes the description.

Based on @joelbettner's feedback, I'm assigning this GH to @dhairyasenjaliya.

Still being worked on

@dhairyasenjaliya - how's it going here?

Perfect, thank you for the update!

PR was merged on Friday! Woo!

Alright, we are waiting for the automation to kick in here.

payouts due

yep i will add that as the bonus amount :)

Agree @fedirjh that sounds like a sensible regression test to add 👍🏼

On hold. Not overdue.

@dhairyasenjaliya - I have paid you in one payment for contribution + reporting bonus + timeline bonus.

@fedirjh paid you and the bonus 🎉

All good here - I have bumped the regression test to be completed. But I am closing this out now as we are all sorted and regression test has its own issue!


tests: L1StandardBridge

Description
Adds tests for the L1StandardBridge contract. Adding these tests found a bug where
finalizeETHWithdrawal should be payable because the OptimismPortal needs to send
ETH to it to be forwarded to the end user.

Codecov Report

Merging #396 (735fe38) into main (0c05488) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #396   +/-   ##
=======================================
  Coverage   39.70%   39.70%
=======================================
  Files          50       50
  Lines        6301     6301
=======================================
  Hits         2502     2502
  Misses       3491     3491
  Partials      308      308

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0c05488...735fe38. Read the comment docs.


Blink16 inside Elks

I think it was a difficult project, but would it be possible to port blink16 to run inside Elks. This can allow some Dos binaries to run. I mean now that we have the open watcom compiler and the fact that we can access more memory.

No, there's no chance blink16 can run on actual 8086 hardware, as the program statically allocates a 1M byte array for the emulated memory - far more than will fit on any such system!

With DOOM we were able to use more than 500 kb.

The emulated memory could be reduced with great effort, but the BIOS runs at the very top of 1M and the interrupt vectors are at the very bottom, so not sure how anything would work.
Blink16 is mostly an 8086 instruction set emulator, not a full-system (meaning peripherals like EGA, etc) emulator. That means that, even when emulating user mode DOS programs, (as opposed to emulating a hardware system), very many DOS games write directly to the hardware, which is not supported by blink16. The reasons for this are many, but in general the only reliable way of emulating real hardware (quickly) is to run in a virtual machine (VM) mode, which requires a 32-bit CPU (and a different approach than blink16 takes). Running blink16 on an 8086 would cause programs to likely run 10-100x slower than normal, even at full speed.
If you're really trying to run DOS programs on ELKS on real 8086 hardware, (and don't want to reboot which is by far the best approach), writing a bunch of code to emulate the INT 21 system call interface and just letting the programs run on the real CPU and real hardware would be a better approach, IMO. However, since many more complicated DOS programs reprogram the hardware PIT and such, the system might have to be rebooted after running them after all anyways.


Implement 'for...of' and reserve 'let' in the example JS grammar

ref #448

I'm going to close this for now.  Having a full modern JS grammar is a separate project worth of effort, and I don't want to chase it here.


Is there a way to disable the tabline filetype icons?

Well, the question is that simple really. And if there is not, would it be possible to make such an option available? Otherwise thanks to everyone for the awesome job! :D

I think it is vim-devicons's issue.

https://github.com/ryanoasis/vim-devicons/

That solved it, thank you! 🎉🥳


[FEATURE] INITTO 2.0

Detailed description
Hi folks,
let's continue to fully change this website to an educational platform for Dev Protocol
We can get the ideas of what design we should build👉  Learn All About Blockchain & Cryptocurrency | Binance Academy.
Context
This will allow more users and new users to understand the Dev Protocol
Possible implementation
No response
Additional information
This can be done with the help of contributors
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Reference
https://community.devprotocol.xyz/t/community-builders/390/15?u=vinzvinci


Add CircleCI config

I wonder if we can add: mix compile --warnings-as-errors in there somewhere? I think it would be bad to release a version that produces warnings

I think that didn't work because I ran it locally and there is a failure :S
= Compilation error on file lib/ex_machina/ecto.ex ==
** (CompileError) lib/ex_machina/ecto.ex:109: Ecto.Association.BelongsTo.struct/0 is undefined, cannot expand struct Ecto.Association.BelongsTo
(elixir) src/elixir_map.erl:58: :elixir_map.translate_struct/4
(stdlib) lists.erl:1353: :lists.mapfoldl/3
(stdlib) lists.erl:1354: :lists.mapfoldl/3
(elixir) src/elixir_for.erl:101: :elixir_for.translate_gen/5
(elixir) src/elixir_for.erl:81: :elixir_for.translate_gen/4

Also, we should definitely figure out how to add it because it caught some problems with Ecto has_one/many commit. Our code is using the %Ecto.Association.BelongsTo{} form, instead of %{__struct__: Ecto.Association.BelongsTo} so it fails to compile without Ecto

I put this in Slack, but will add it here as well for history/searchability

I think I know why it passed, it was compiled in the test environment (which includes the Ecto dep)

So we may need to do MIX_ENV=prod mix compile --warnings-as-errors


[SPARK-31750][SQL] Eliminate UpCast if child's dataType is DecimalType

What changes were proposed in this pull request?

Eliminate the UpCast if it's child data type is already decimal type.
Why are the changes needed?

While deserializing internal Decimal value to external BigDecimal(Java/Scala) value, Spark should also respect Decimal's precision and scale, otherwise it will cause precision lost and look weird in some cases, e.g.:
sql("select cast(11111111111111111111111111111111111111 as decimal(38, 0)) as d")
  .write.mode("overwrite")
  .parquet(f.getAbsolutePath)

// can fail
spark.read.parquet(f.getAbsolutePath).as[BigDecimal]

[info]   org.apache.spark.sql.AnalysisException: Cannot up cast `d` from decimal(38,0) to decimal(38,18).
[info] The type path of the target object is:
[info] - root class: "scala.math.BigDecimal"
[info] You can either add an explicit cast to the input data or choose a higher precision type of the field in the target object;
[info]   at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveUpCast$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveUpCast$$fail(Analyzer.scala:3060)
[info]   at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveUpCast$$anonfun$apply$33$$anonfun$applyOrElse$174.applyOrElse(Analyzer.scala:3087)
[info]   at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveUpCast$$anonfun$apply$33$$anonfun$applyOrElse$174.applyOrElse(Analyzer.scala:3071)
[info]   at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDown$1(TreeNode.scala:309)
[info]   at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:72)
[info]   at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:309)
[info]   at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDown$3(TreeNode.scala:314)

Does this PR introduce any user-facing change?

Yes, for cases(cause precision lost) mentioned above will fail before this change but run successfully after this change.
How was this patch tested?

Added tests.

Test build #122812 has started for PR 28572 at commit b137ec4.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27459/
Test PASSed.

cc @cloud-fan @HyukjinKwon

Test build #122812 has finished for PR 28572 at commit b137ec4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122812/
Test PASSed.

Test build #122833 has started for PR 28572 at commit b4eb291.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27479/
Test PASSed.

Test build #122833 has finished for PR 28572 at commit b4eb291.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122833/
Test FAILed.

Test build #122838 has started for PR 28572 at commit 8fe0490.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27484/
Test PASSed.

Test build #122842 has started for PR 28572 at commit 6b70e77.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27487/
Test PASSed.

Test build #122844 has started for PR 28572 at commit bc0bbec.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27489/
Test PASSed.

Looks good to me

Test build #122850 has started for PR 28572 at commit e7664a1.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27495/
Test PASSed.

Test build #122838 has finished for PR 28572 at commit 8fe0490.

This patch fails from timeout after a configured wait of 400m.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122838/
Test FAILed.

Test build #122842 has finished for PR 28572 at commit 6b70e77.

This patch fails from timeout after a configured wait of 400m.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122842/
Test FAILed.

retest this please

Test build #122852 has started for PR 28572 at commit e7664a1.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27497/
Test PASSed.

Test build #122844 has finished for PR 28572 at commit bc0bbec.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122844/
Test PASSed.

Test build #122850 has finished for PR 28572 at commit e7664a1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122850/
Test PASSed.

Test build #122852 has finished for PR 28572 at commit e7664a1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122852/
Test PASSed.

Merged to master.
I think we can backport this to branch-3.0 if RC2 actually fails.

Okay, seems already failed. I merged to branch-3.0 as well.

thanks all!


The size of .sp is wrong after updating ^3.0.3

The size of .sp is wrong after updating ^3.0.3

The .sp implementation has been changed. I'm still taking a look at Hekhy's proposal to change it in Issue#9. Kindly continue the discussion there.


[AUT-3124] extend charts with fission deployment

`# Source: acp/templates/fission.yaml
apiVersion: fission.io/v1
kind: Environment
metadata:
name: nodejs
spec:
version: 1
imagepullsecret:
poolsize: 3
terminationGracePeriod: 1
runtime:
image: docker pull fission/node-env:latest
podspec:
containers:
- name: nodejs
imagePullPolicy: Always
apiVersion: fission.io/v1
kind: Environment
metadata:
name: rego
spec:
version: 1
imagepullsecret: artifactory
poolsize: 3
terminationGracePeriod: 1
runtime:
image: docker.cloudentity.io/rego-env:latest3
podspec:
containers:
- name: rego
imagePullPolicy: Always`

FYI this configuration works only with acp 1.16+, not 1.15.x


Browser support?

Might you be able to build this package in such a way as to allow browser support? I know Unicode info may be large, but I have a use for caching such scripts client-side....

Generally you won't want to build tries in the browser, but you may want to use them there.
You can use browserify to build for the browser, and it works just fine. You'll need to inline the generated trie data, using brfs. For an example, see linebreak and grapheme-breaker which both use unicode-trie under the hood, and work in the browser via browserify.

Awesome, thanks!


fix: quick fix to installation guidance

/azp run

Codecov Report

Merging #1369 (121e092) into master (be49658) will decrease coverage by 26.41%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master    #1369       +/-   ##
===========================================
- Coverage   84.77%   58.36%   -26.42%
===========================================
  Files         287      258       -29
  Lines       14230    12969     -1261
  Branches      732      732
===========================================
- Hits        12064     7569     -4495
- Misses       2166     5400     +3234

Impacted Files
Coverage Δ

...la/org/apache/spark/ml/param/TypedArrayParam.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

.../org/apache/spark/ml/LimeNamespaceInjections.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

.../microsoft/azure/synapse/ml/io/binary/Binary.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

.../microsoft/azure/synapse/ml/lime/BreezeUtils.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...oft/azure/synapse/ml/codegen/GenerationUtils.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...t/azure/synapse/ml/explainers/ImageExplainer.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...m/microsoft/azure/synapse/ml/codegen/CodeGen.scala
0.00% <0.00%> (-98.44%)
:arrow_down:

.../execution/streaming/continuous/HTTPSourceV2.scala
0.00% <0.00%> (-92.09%)
:arrow_down:

...che/spark/sql/execution/streaming/HTTPSource.scala
0.00% <0.00%> (-90.00%)
:arrow_down:

...ql/execution/streaming/continuous/HTTPSinkV2.scala
0.00% <0.00%> (-89.75%)
:arrow_down:

... and 119 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update be49658...121e092. Read the comment docs.


How to set up Parse Backend

Hello,
I am using parse for my small personal application. Now just news came out about Parse is going to stop services after one year and as Parse SDK is open source now. Is there any way to set up backend by ourselves now. If yes then is there any guidelines available to start with ? I have a phonegap app in which i sends push notification from .net. If i want to use direct SDK from here without Parse service. Is that possible ?

Hi @sankp,
You will want to check out our open-sourced Parse Server here: https://github.com/ParsePlatform/parse-server. The server is compatible with our SDKs (including Parse .NET SDK). The only thing to do from the SDK side is to change the Configuration.Server (https://github.com/ParsePlatform/Parse-SDK-dotNET/blob/master/Parse/Public/ParseClient.cs#L129) into your own hosted Parse Server.
Further question can be asked in Parse Server repo.
Hope it helps!


 I tried to extend them and perform such search for files that have too high uid/gid:
$ docker run --rm -it memgraph/memgraph-platform bash

root@fa41dca61e14:/# find / \( -type f -or -type d \) -exec \
    bash -c '[ $(expr $(stat -c "%u + %g" "$0") ) -ge 131069 ] && ls -dln "$0"' {} \;

-rw-r--r-- 1 718322462 454177323 1518 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/LICENSE.txt
-rw-r--r-- 1 718322462 454177323 26 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/.npmignore
-rw-r--r-- 1 718322462 454177323 484 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/package.json
-rw-r--r-- 1 718322462 454177323 45 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/.travis.yml
-rw-r--r-- 1 718322462 454177323 1045 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/index.js
-rw-r--r-- 1 718322462 454177323 1101 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/README.md
-rw-r--r-- 1 718322462 454177323 1013 May 18 16:04 /lab/node_modules/buffer-equal-constant-time/test.js

I'd like to ask to fix owner/group for those files (and some other at least under /lab/node_modules/) before-or-at the docker-build, otherwise, you see,

everyone will face pull-fail when userns-remap enabled (and ranges specified at subuid/subgid not cover too high IDs),
~those files would be inaccessible to non-root processes~ (UPD. Well, they're world-Readable, and their parent dir is everyone-eXecutable).

Also that would agree with a good practice to keep the stuff in order.
TIA!
UPD. I suggest COPY --chown=0:0 <...> at least at https://github.com/memgraph/memgraph-platform/blob/main/Dockerfile#L98 as good enough workaround, if you wish to fix this at docker-build stage instead of at the files origin (where they are copied from).

Hi @vpag and thank you for reporting this! This is definitely something we need to fix and thank you for giving us suggestions too. Will keep you posted on the issue. Btw. what are you working on with Memgraph?

Hi @katarinasupe This still isn't fixed? Looks like you are using an outdated library that has been superseeded by core as well? I've been tasked with evaluating Memgraph compared to Neo4j and we run unprivileged containers.

This is really vexing. This is a rather low hanging fruit and a work-around has been provided. for simply changing one line in a build-pipeline 6 months is really a long time. It is anything but trust inspiring.

Hi @teatreeoilchocolate, I agree with you and apologize for making you wait this long. The happy news is that we are working on something new to make deployment easier for any developer, and that's why we didn't focus on this issue. Does this issue block your work?

Not a blocking issue.
After I recovered from being flabbergasted by this ticket, its timeline, the triage of it, the minimal effort(especially considering that the fix is already provided) combined with the big impact and it not moving, the community dev that debugged the problem being ignored and being fed a boiler plate response(would've been ok if it weren't for the garbage-chute) for their effort in combination with throwing this ticket down the garbage-chute, I immediately moved to another graphdb after having penned my disbelieve in the previous response.

And to be clear, this is not entitlement speaking.
I appreciate free software I can run to cut my teeth on to grow. I appreciate the fact that being a dev in a public environment is stressful. I appreciate the minutea of working in a volatile environment with changing and competing priorities.  I report bugs in software I use. I sometimes even help to debug them where I can if asked. I have also not a problem with working around bugs and living with the ones I cannot work around.
But this,considering that it was triaged S2-I2(one short of ' the house is burning') last month with it not moving at all(considering that it is low effort) and touching on security in a software that  houses data and may at one point even house mine, leaves me speechless.
Especially since the new features must in fact be so awesome and big and heavy, that there was no time to address an issue concerning security for certain setups of users of your software within the last 6 months.

Thank you for your feedback, @teatreeoilchocolate. It will help us learn how to improve in the future. We recently changed our prioritization system and still have some tweaks to do. We will update the priorities in the community bugs and incremental features project. In the future, if you notice these things and you feel like something is urgent and we should make more effort, or if you have questions, don't hesitate to contact us by booking an office hours call. We are also quite active on Discord to help the community.

Let's revisit this with the new Memgraph Platform setup cc @MarkoBarisic @gitbuda


Acceptance Criteria for #27 Edit a Pending Booking

User story
#27
Acceptance criteria checklist

[ ] Users can edit the details of one of their bookings
[ ] Users cannot edit the details of a booking they didn't create

Accepted


Memory functions

Always return 8G for Haxecpp target (tested on windows)
https://github.com/jtransc/gdx-backend-jtransc/pull/72
 @JTranscMethodBody(target = "cpp", value = "return GC_get_free_bytes();")
 @JTranscMethodBody(target = "php", value = "return N::d2j((float)0.0);")
 public long freeMemory() {
 return 8 * 1024 * 1024 * 1024L;
 }

Maybe it's not a bug, but need more tests, i will check it today.

For what i have seen it requires @HaxeMethodBody annotations. Just implemented for jtransc direct targets

Confirmed broken for Haxe. Haxe have not this functions only use and allocated on this time memory, not free. I can try change backend for haxe use one template and other targets use other template with JT use.

Not sure if haxe provides exact match for these functions. But the portable way of doing so it works on java too is this i think. We can also expose thibgs like this is JTranscSystem class


Live stream link

Is it possible to get live stream link of the launch from response?  Thank You!

The livestream link is also always going to be the same, if you are wanting to stream the launch as it's happening: https://www.youtube.com/spacex/live
You should be able to format it similar to most videos, but be warned that you may receive errors with the /live link. It's a bit of tricky URL to work with, especially if you're trying to view the video player before the launch stream has officially started.

Thanks for all !


Currently the application does not actually work when run on a mesh

While developing the implementation testing has been done using a wired network consisting of 4 nodes, this should be changed to a mesh of a number of devices to confirm it still works properly.
When I tested an earlier version using a mesh the code did not work for unknown reasons.

this has seemed to magically start working at some point, I must have had something configured wrong in the sim runner


x/pkgsite: pkg/proc/native package is missing from github.com/go-delve/delve/

From<EMAIL_ADDRESS>I noticed the directory is missing the native directory.

https://github.com/go-delve/delve/tree/master/pkg/proc/native is the directory.
Suspected build constraints, but there are files without any build constraints.

Some build contexts (js/wasm, for example) are deliberately broken by having files with two different package names. We currently treat this error as so serious that we shouldn't process the package at all, but it isn't. We should just ignore the bad build contexts and process the others.


what license is this repository under?

Thanks for your interest. Our work is under the MIT license.


connectors getters throw an ESLint error with the V1 release

https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/docs/rules/unbound-method.md#examples

Interesting. I don't understand where the issue comes from, is it connector.id?

Interesting. I don't understand where the issue comes from, is it connector.id?

Yes ! connector.id and ˋconnector.name`

I will look into this. Seems it doesn't like the new abstract properties (that's the only change since v0).

This should be fixed in v2. If not, feel free to reopen.


Updated timeline events to sort by timestamp.

As a user, I may review an incident channel and decide that I want messages farther back in the channel to be added to the incident timeline. Currently, the messages in the timeline are ordered by the time that they were pinned. I think it would be nice if they were ordered by the actual message timestamp instead of the pinned timestamp, otherwise it could lead to a misleading timeline.
Before

After

Thanks for raising this.  We have them sorted on our internal version and this got missed off in the open source port.  Rather than sorting in the template, which ultimately pushes the job to python, it would be preferable to do this in the view here, so the DB returns the events in timestamp order.
If you'd like to make the change, this is the line and it just needs an .order_by('timestmap') added to the end:  https://github.com/monzo/response/blob/master/ui/views.py#L15

@evnsio cool, thanks for the suggestion! PR has been updated.


Can't use ! helper methods for enums

If I use the update method for enums, it returns an error:
ActiveRecord::RecordInvalid: Validation failed: Status can't be 1. Valid values are: active, archived
Model:
enum status: [:active, :archived]
validate_enum_attributes :status

Controller action:
def destroy
     set_vehicle
     @vehicle.archived!
     redirect_to admin_vehicles_path, notice: 'Successfully archived the vehicle'
end

@Jellyfishboy i added tests for bang methods on enum attributes and they pass. could you provide more info on the issue? what values does @vehicle have before trying @vehicle.archived!?
you can see the tests here
https://github.com/CristiRazvi/enum_attributes_validation/commit/199522b1fdf325073b3eab321aa72ce83ae7d015

@CristiRazvi Thanks for your response.
Model:
class Store < ApplicationRecord

    enum status: [:active, :archived]
    enum dropbox_setup: [:pending, :completed, :failed], _prefix: true

    validate_enum_attributes :status, :dropbox_setup
end

As you can see from the Rails console screenshot and the model set up, I am unable to use the bang methods without an error occurring.
Rails version: 5.2
Ruby version 2.4.4

@CristiRazvi I ended up implementing my own solution, thanks anyway.

this is still an issue in the gem


Replace Field.rel by Field.remote_field

https://docs.djangoproject.com/en/dev/releases/1.9/#field-rel-changes

Field.rel and its methods and attributes have changed to match the related fields API. The Field.rel attribute is renamed to remote_field and many of its methods and attributes are either changed or renamed.

To note from Django 2.0 removals:

Field.remote_field.to attribute will be removed.

Deprecated: 1.9
Removed: 2.0

Looking more closely, this seems more complicated to implement in a robust fashion.

Looking more closely, this seems more complicated to implement in a robust fashion.


Add multiple etcd address support.

Add multiple etcd address support
Issues resolved
Fix #1231

@membphis
test cases fails in https://github.com/apache/incubator-apisix/blob/master/lua/apisix/core/config_etcd.lua#L350
How the etcd db loaded for the travis encironemnt is it a mock one or a real etcd db running ?

is it a mock one or a real etcd db running ?

It is a real etcd, the same as your local ENV.

Hi @membphis
Most of the test cases fails with the below log
`" should not match any line in error.log but matches line "2020/03/15 22:47:57 [error] 17269#17269: *169 [lua] config_etcd.lua:350: failed to fetch data from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/ssl?waitIndex=10100&wait=true&recursive=true err:timeout,  etcd key: /apisix/ssl, context: ngx.timer" (req 0)
2020/03/15 22:47:57 [error] 17269#17269: *171 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/global_rules?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *171 [lua] config_etcd.lua:205: waitdir key: /apisix/global_rules prev_index: 10100, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *171 [lua] config_etcd.lua:206: res: null, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *171 [lua] config_etcd.lua:350: failed to fetch data from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/global_rules?waitIndex=10100&wait=true&recursive=true err:timeout,  etcd key: /apisix/global_rules, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *173 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/services?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *173 [lua] config_etcd.lua:205: waitdir key: /apisix/services prev_index: 10100, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *173 [lua] config_etcd.lua:206: res: null, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *173 [lua] config_etcd.lua:350: failed to fetch data from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/services?waitIndex=10100&wait=true&recursive=true err:timeout,  etcd key: /apisix/services, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *175 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/proto?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer
'
at /home/ayesh/Documents/API_ASPIX/incubator-apisix/../test-nginx/lib/Test/Nginx/Socket.pm line 1280.
Failed test 'TEST 9: invalid route: wrong count - pattern "[error]" should not match any line in error.log but matches line "2020/03/15 22:47:57 [error] 17269#17269: *171 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/global_rules?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer" (req 0)
2020/03/15 22:47:57 [info] 17269#17269: *171 [lua] config_etcd.lua:205: waitdir key: /apisix/global_rules prev_index: 10100, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *171 [lua] config_etcd.lua:206: res: null, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *171 [lua] config_etcd.lua:350: failed to fetch data from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/global_rules?waitIndex=10100&wait=true&recursive=true err:timeout,  etcd key: /apisix/global_rules, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *173 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/services?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *173 [lua] config_etcd.lua:205: waitdir key: /apisix/services prev_index: 10100, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *173 [lua] config_etcd.lua:206: res: null, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *173 [lua] config_etcd.lua:350: failed to fetch data from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/services?waitIndex=10100&wait=true&recursive=true err:timeout,  etcd key: /apisix/services, context: ngx.timer
2020/03/15 22:47:57 [error] 17269#17269: *175 [lua] config_etcd.lua:77: waitdir(): failed to get key from etcd: fail request to: http://<IP_ADDRESS>:2379/v2/keys/apisix/proto?waitIndex=10100&wait=true&recursive=true err:timeout, context: ngx.timer
2020/03/15 22:47:57 [info] 17269#17269: *175 [lua] config_etcd.lua:205: waitdir key: /apisix/proto prev_index: 10100, context: ngx.timer
'
at /home/ayesh/Documents/API_ASPIX/incubator-apisix/../test-nginx/lib/Test/Nginx/Socket.pm line 1280.
`
Hm I have no clue is it because now we are defining set of etcd hosts it can't find a leader ?
Some help here would be great

I updated the resty-etcd right now. Please rebase your branch with APISIX master branch.

you can use git rebase ..., it is simpler than creating a new issue.

@membphis  sure I will do so

@membphis  done opened the previous PR.

@membphis  but it won't affect the code base know ?. Shall I go on with the other PR. Since it will take more time to redo this I think it's easy to move forward with the other one
wdyt?

Shall I go on with the other PR.

You can continue working at this PR.

Hi @membphis  am not quite sure how to fix this I tried in few ways but it has so many conflicts will close this PR and work on the other one
Thanks


[Python] "Package would be ignored" warning from setuptools

Describe the bug, including details regarding any error messages, version, and platform.
When installing PyArrow, I now get a bunch of warnings like this:
  /home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning:     Installing 'pyarrow.include.arrow.flight.sql' as data is deprecated, please list it in `packages`.
      !!

      ############################
      # Package would be ignored #
      ############################
      Python recognizes 'pyarrow.include.arrow.flight.sql' as an importable package,
      but it is not listed in the `packages` configuration of setuptools.

      'pyarrow.include.arrow.flight.sql' has been automatically added to the distribution only
      because it may contain data files, but this behavior is likely to change
      in future versions of setuptools (and therefore is considered deprecated).

      Please make sure that 'pyarrow.include.arrow.flight.sql' is included as a package by using
      the `packages` configuration field or the proper discovery methods
      (for example by using `find_namespace_packages(...)`/`find_namespace:`
      instead of `find_packages(...)`/`find:`).

      You can read more about "package discovery" and "data files" on setuptools
      documentation page.

  !!

The way I install PyArrow is:
pip install --no-build-isolation -v -e .

Component(s)
Python

@AlenkaF @jorisvandenbossche Have we already seen this?

I have dealt with such a warning before, but reading back my comments in a setuptools issue, it was actually for pyarrow: https://github.com/pypa/setuptools/issues/3340#issuecomment-1219441604
And it also seems we fixed this warning once before: https://github.com/apache/arrow/pull/13309 (cc @raulcd), but now it re-appeared?

And the strange thing about the warning is that we already do use find_namespace_packages (what is suggests to use ..)

I can't seem to be able to reproduce in my current environment on main, with Python 3.10, and:
$ pip show setuptools
Name: setuptools
Version: 62.3.3
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email<EMAIL_ADDRESS>License:
Location: /home/raulcd/code/pyarrow-dev/lib/python3.10/site-packages
Requires:
Required-by: ipython, setuptools-scm
$ pip --version
pip 23.1.2 from /home/raulcd/code/pyarrow-dev/lib/python3.10/site-packages/pip (python 3.10)

@pitrou what version of setuptools are you using?

$ pip --version
pip 23.1.2 from /home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pip (python 3.10)
$ pip show setuptools
Name: setuptools
Version: 66.0.0
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email<EMAIL_ADDRESS>License:
Location: /home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages
Requires:
Required-by: gunicorn, numba, setuptools-scm

I tested a few different versions of both pip (22.3 and 23.1) and setuptools (66 and 67) in my local dev environment, and can't directly reproduce it.

Did you try to create an editable build as mentioned above?
(pip install --no-build-isolation -v -e .)

Yes, that's the command I tested with

@pitrou do you still see this, or has it resolved itself over time?

It seems to have vanished for now.


Wander Trader Doesn't get Affected By Merchant

can confirm

What do you mean exactly? You mean the additional trades don't show up?
If you are talking about the trades exhausting and being unavailable after having traded X times - that is intentional. Only the regular villagers will trade with merchants indefinitely.

oh i thought it was a bug i guess not


vorbisspi-1.0.3-1.jar location

\o
Up until the last update for 1.7.10 this file has always been downloaded to /mods/1.7.10, but after the last update the file is now being downloaded to /mods, but it's not deleting the .jar that is in the /mods/1.7.10 folder.
Is the new download location intentional?
I'm going to hold off on updating the mod this month because I'm almost finished the completing the update to the server.
Thanks for the wonderful work you do on this mod Mich. :)
ETA: also, just found that mp3spi-1.9.5-1.jar is doing the same thing.

Yes, this was intended, either one can be present, both can be present, it doesn't matter.


Running in jetson xavier NX JP 5.0.2

Hi, I am using Xavier NX development kit with jetpack 5.0.2, unfortunately i am not allowed to update the jetpack and OS.
Will this work with my setup.

Hello, JetPack 5.1 is a requirement because of DeepStream 6.2.


Fix make vagrant-deploy after namespace change

virt-handler wasn't getting cleaned up correctly after the NS change.
I also removed TPR cleanup now. We're pretty far beyond that at this point.

Some tests failed

retest this please

retest this please

retest this please


Modify open_xr_dataset to read remote and local Kerchunk files

roocs-utils version: current
Python version: current
Operating System: current

Description
We'd like open_xr_dataset(...) to read Kerchunk files as well and existing NetCDF support.
Update:
https://github.com/roocs/roocs-utils/blob/master/roocs_utils/xarray_utils/xarray_utils.py#L69
And write some tests.
Details
Some examples of relevant code:

No authz:

import xarray as xr
import fsspec
import matplotlib.pyplot as plt

file_uri = "https://dap.ceda.ac.uk/neodc/esacci/snow/docs/esacci_snow_swe_v2_5.json"
mapper = fsspec.get_mapper("reference://", fo=file_uri)
ds = xr.open_zarr(mapper)

With authz:

https://github.com/cedadev/kerchunk-tools/blob/main/kerchunk_tools/xarray_wrapper.py#L24-L38

Initial version implemented on branches:
https://github.com/roocs/daops/compare/enable-kerchunk?expand=1
https://github.com/roocs/roocs-utils/compare/i106-enable-read-kerchunk?expand=1


Controlled state of snap points not working properly

I want to trigger the change of the snap point programmatically, but currently its not working as expected. I need to press the button twice for it to work.
I forked the codesandbox with snap points to show the problem.
https://codesandbox.io/p/devbox/drawer-snap-points-forked-dts7ct

I'm noticing the same thing.
If I log the snap value in a useEffect I see the value change, but the component doesn't react to the state change.

Fixed in #248


Update CI to work with PR's from forks

Learnings:
After some trial and error, PR's from forks do not have permission to push a packages to a container registry (which is needed for the e2e testing)

Forks don't have any sort of write access to the repo (needs write access to packages)
Forks don't have access to any repo "secrets" so can't use PAT

Result:

Instead of having the CI push and pull docker images from a container registry, this update has one runner create the docker image and export it as a tarball file which then gets uploaded as an "artifact" using the upload-artifact and download-artifact actions.

This is proving extremely efficient. It only takes about 12 seconds to upload the tarball and 1 second for each runner to download the tarball.

With this change we can remove ci_integration.go as the docker name and tag will be the same for both running tests locally and in the CI.

Created a separate docker-publish.yaml action where images will still be published for each push to a branch but not If the branch is from a fork. (Images are not published anywhere in the e2e-tests.yaml workflow)

Other:
Branch protections rules have been updated to reflect new "required" test names.

Closes: https://github.com/strangelove-ventures/noble/issues/175

@Mergifyio backport release/v3.0.x


screen displayed when returning from album opening

First I select album-people (or things or my album...) I scroll to get a not visible album and I open it.
Now I want to go back to look at an other album. I use backward arrow of my navigator but I'm no more at the place where I was before. I'm back at the top of albums page.
That's annoying when you got hundreds of album.
Enhancement would be to return at the same place as before opening the album.
Note: behavior used to display a picture of an album is convenient ; press escape and you go back at the previous displayed place of the album.

Scroll restoration by our dependency got removed and now has to be implemented by the dev.
https://v5.reactrouter.com/web/guides/scroll-restoration
https://stackoverflow.com/questions/51906708/react-router-v4-keep-scrolling-position-when-switching-components

Seems to be an issue with react-virtualized: https://github.com/bvaughn/react-virtualized/issues/1693
This means I have to rewrite all the components that uses this.

This seems like an alternative: https://github.com/bvaughn/react-window


fix(version): update ngx-base to 1.3.0

@fabric8cd fabric8/fabric8-ui:SNAPSHOT-PR-2118-1 is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-2118-fabric8-planner.badger.fabric8.io

@nimishamukherjee this contained upgraded versions, if anything started to act weird you should revert this.


DPL-030 Beckman plate creation should transmit correct phenotype

User story
As someone reporting on Heron data I would like the correct result to be transmitted to the Sequencescape phenotype field when the destination plates are created in Sequencescape following a Beckman run.
Who are the primary contacts for this story
Katy, Eduardo
Acceptance criteria
To be considered successful the solution must allow:

[ ] In Beckman plate creation endpoint, Sequencescape sample_metadata 'phenotype' field should be set to the value of the 'result' field from MongoDB. This is consistent with what happens in the Sentinel plate creation endpoint.
[ ] The value should be all lowercase, to match the style of the existing, hardcoded value, and the way that the Sentinel endpoint works.
[ ] If possible, fix data that has been caused to be wrong by this bug (can split this out into a separate story if needed).

Additional context
Spotted this while processing the '3 MK plates'
Have started a branch here, but it is currently failing builds, and hasn't been manually tested - https://github.com/sanger/lighthouse/pull/360/files

UAT testing:
We tried setting the result to 'Void' for one of the samples and try to create the plate in Sequencescape, but it didnt work in the UAT testing because the process of finding samples in Lighthouse have hardcoded the string 'positive' in several other places in code and that needs to be corrected if we want to support results different from the string 'positive'.
We tested with both plates HT-114923 and HT-114949; we tested it worked ok on creating the plate when all samples were positives, but it failed when we tried setting the result as 'Void' or 'PositiveTestUAT'.
Needs to be reworked to fix the other issues. Some examples of code to change:
lighthouse.helpers.plates.py : def equal_row_and_sample
lighthouse.helpers.plates.py : def query_for_cherrypicked_samples

We were checking the code and we think we should make changes small but important that would require to be carefully tested, in relation to how we query for the samples in MongoDb and how we match samples between Mongodb and Dart.
At now in code we are matching samples by using the 4 sample properties (rna_id, root_sample_id, lab_id, result='positive'), however we have the unique identifier (lh_sample_uuid) that should be better for this task.
We think the change to do could be any of these 2, Option A will be small and easy change, but we see Option B as a better option long term.
Option A:
We could make changes to use the result value whatever it was defined in Mongodb and that would solve the current issue;
Option B:
We should be using the sample_uuid to match, to be identify in a better way the samples that are cherrypicked.
Any of these 2 options chosen will need to be carefully tested to check that we don't affect how currently cherrypicking works.

To test in UAT:
In Mongo change the result of a sample to Void:
db.samples.update({"lh_sample_uuid": "2e22a394-b4d8-47aa-b3e8-bc83c35e13ed"}, {"$set": {"Result": "Void"}})

Then send a GET HTTP request to uat lighthouse to :
/cherrypicked-plates/create?barcode=HT-114923&robot=B8758420K09&user_id=test
That should fail with a 422 (that barcode already exists), but then we check in kibana that Sequencescape received the plate HT-114923 and has a sample at A01 with phenotype=Void (the sample we have changed).

I just ran the test described by Eduardo above: https://github.com/sanger/lighthouse/issues/361#issuecomment-959708486
Kibana reports that the message received by Sequencescape was {"content"=>{"name"=>"TEST-114921_A01", "phenotype"=>"void", "supplier_name"=>"CPTD-272A08B", "sample_description"=>"RSID-TEST-11492101", "uuid"=>"2e22a394-b4d8-47aa-b3e8-bc83c35e13ed"}} which indicates that this worked.  The void phenotype was recorded, not the hardcoded positive from before.


Does not run into Blender 2.82a - Is EVERTims abandonware? -

I tried to reintall everything from scratch, Blender included.
Any idea?

No support for Blender > 2.79b. The current version is indeed "abandonware" : we're working on a complete rebuild due to mid 2021.

ah, just saw this after trying to get it to work for a while -- looking forward to trying this project when it is working again!


how to config the work

'conductor-client', version: '2.30.4' always print like below
23:31:00.857 [pool-2-thread-1] DEBUG com.netflix.conductor.client...

even throught i set log4j.properties log level

Please elaborate on the issue that you are facing, it is unclear from the description above.


Stream Guys link not working

Hello, I would like to listen to 91.5 WSCR Sandwich Community Radio. However, their Stream Guys Link produces an error message that says "The station is not valid." The only two listening links on their website are either Stream Guys or TuneIn Radio. Do you have an idea why URL Radio won't accept this link?

Hey,
you cannot use a Website as link.
Please use another url ends with .mp3, .aac etc.


IDE/editor section on frontpage needs feedback

I'm currently not sure which contents should be shown, and whether the icons should expand to show the content on the frontpage, or whether they should link to different pages.

I think it should be consistent with the Scala Platforms one,which means no expand.but how about show a overlay tooltips once the mouse over it?


Pass by value, or pass by reference?

Any detailed explaination about this on Starlark?

See https://github.com/google/starlark-go/blob/master/doc/spec.md#identity-and-mutation. It works similarly to Python.


Quit rogcat.exe while printing makes the shell text the same color as last text

If you quit rogcat.exe (via ctrl c) while it's printing, it leaves the color of the shell text as the last text color that is being printed. Probably works fine in linux.

Windows terminals tend to be tricky. I know from a couple of people who use Cmdr without any issues - maybe that's something for you. Anyway - this needs to be fixed.

Fixed by #128599


Suggestions

I am not sure if this is possible, but wanted to toss out some suggestions.

Is it possible to place a marker on the map, and have that appear in game as a custom way point?
Can you show the Departure and Destination points on the map?
Can we place multiple markers on the map?

A few friends and I love using this add-on, its really made our trips much more enjoyable.  Kudos on the good work.

Awesome suggestions

Bonjour,
Merci d'abord pour cette super Application.
Je suis preneur pour les suggestions de BiOforce1 et si possible réduire un peu la dimension de l'avion sur la carte.
Merci d'avance de votre réponse.
Bravo encore pour votre travail.
Traduction Google :
Hello,
Thank you first for this great Application.
I'm interested in BiOforce1's suggestions and if possible reduce the size of the plane on the map a bit.
Thank you in advance for your response.
Well done again for your work.

Hello, Thank you for your great plugin. I would like to have the flight plan loaded in FS2020 showed in the VFRmap window. In addition the possibility to include a button in the FS 2020 toolbar that open the VFRmap window as Skyvector has. Would be great this way it would replace completely the ugly VFRMAP included in FS 2020. Thanks a lot again. Skyvector has great detail but does not show the flight plan neither follows the plane.


fix operationRef dup

Ⅰ. Describe what this PR does
fix operationRef keep add the same name when using cron datamigrate
Ⅱ. Does this pull request fix one issue?

fixes #XXXX
Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

/test fluid-e2e

/test fluid-e2e

/test fluid-e2e

/test fluid-e2e


LeasedTreeNodeList abstraction

Add LeasedTreeNodeList abstraction.
The purpose is to simplify the node leasing contract by moving all the logic into a central location. The collection will ensure that either its contents are read exactly once or it is released exactly once. The guarantees are weak in that if the library developer forgets to invoke release we don't do anything other then issue some logging messages and fail on an assertion and these actions happen in a finalizer (bleh).
Added node.release() to the end of TreeMapState#pop() and removed return value from TreeMapState#pop(). We always release the node that is popped and then drop the reference to the node so the API should reflect this pattern.

I have to say I am finding the semantics of the read-once list to kinda confusing. There also seem to be plenty of cases where it won't actually detect leaks, and while I understand that those cases mostly mirror what existed before, I think an argument could be made that they were more obviously possible flaws.
Now a user might, fairly reasonably, attempt to rely on the API methods to validate that things are handled correctly.
I have a suggestion, which is to do leak detection on tree nodes directly. Hiding some of the boilerplate for handling leases / null / etc is nice, but maybe we should just move those to library methods. The reasoning is that users already still have to worry about tree node leases, so we might as well let them use a list interface they are probably familiar with (ie. List).

I talked to Ian. We can close this PR in favor of a simpler approach.
On Mar 13, 2015 4:13 PM, "Ian Barfield"<EMAIL_ADDRESS>wrote:

I have to say I am finding the semantics of the read-once list to kinda
confusing. There also seem to be plenty of cases where it won't actually
detect leaks, and while I understand that those cases mostly mirror what
existed before, I think an argument could be made that they were more
obviously possible flaws.
Now a user might, fairly reasonably, attempt to rely on the API methods to
validate that things are handled correctly.
I have a suggestion, which is to do leak detection on tree nodes directly.
Hiding some of the boilerplate for handling leases / null / etc is nice,
but maybe we should just move those to library methods. The reasoning is
that users already still have to worry about tree node leases, so we might
as well let them use a list interface they are probably familiar with (ie.
List).
—
Reply to this email directly or view it on GitHub
https://github.com/addthis/hydra/pull/161#issuecomment-79332864.


Ignoring whitespace at the end of text tag

Issue - #379
@dougbu @NTaylorMullen

Updated. Need to change a few more tests. I'll do that once the product code is accepted.

:watch:

:watch:

Updated.

:shipit: when @NTaylorMullen is pleased

solid, :shipit:


[Bug]: Buttons on an in-line widget shift every time buttons are added or deleted

Is there an existing issue for this?

[X] I have searched the existing issues

Description
Buttons on an in-line widget shift every time buttons are added or deleted
Steps To Reproduce

Use the latest Anvil DP and drop an in-line widget onto canvas
Add buttons from the property pane as seen in the video and observe the jumpy interaction
Delete buttons from the property pane and observe the jumpy interaction

Public Sample App
No response
Environment
Deploy Preview
Severity
Low (Inconsistent UI/UX)
Issue video log
https://www.loom.com/share/da4083d14cad42f49a3a5ef2db1709dc
Version
cloud

Seems like not relevant anymore.
Private Zenhub Video