Ensure workflow overrides roundtrip

Prior to this PR, override values of types other than int and float were automatically cast to strings when the workflow loaded/parsed the overrides (e.g. to form the xarray). This PR fixes that issue.
Additionally an override that specifies a sequence of values for a multirun is now returned specifically as a multirun list, enabling users to distinguish a multirun sequence of values vs a single override that happens to be a list.
Consider:
from rai_toolbox.mushin import multirun, hydra_list

class WorkFlow(MultiRunMetricsWorkflow):
    @staticmethod
    def evaluation_task(*args, **kwargs):
        return None

Before PR:
>>> wf = WorkFlow()
>>> wf.run(foo=hydra_list(["val"]), bar=multirun([False, True]), apple=1)
>>> wf.multirun_task_overrides
{'foo': "['val']", 'bar': ['False', 'True'], 'apple': 1}

After PR:
>>> wf = WorkFlow()
>>> wf.run(foo=hydra_list(["val"]), bar=multirun([False, True]), apple=1)
>>> wf.multirun_task_overrides
{'foo': ['val'], 'bar': multirun([False, True]), 'apple': 1}

Merging this so that I can get a few more changes in before releasing 0.2.0


Typo in README

at subscribing-to-nodes it says subcribe instead of subscribe

Fixed, thanks!
(Only on GitHub for now, fix will come to npm page with next version.)


improvementadd index_id column in show index stmt (#30431)

Proposed changes
pick from master #30431

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Registering multiple nodes simultaneously can cause some nodes to become stuck in a Registering state

What kind of request is this (question/bug/enhancement/feature request):
bug
Steps to reproduce (least amount of steps as possible):

v2.4.8 HA Rancher server
create VM templates with packer and pre-pull all of the container images for the desired Rancher version (template w/ v2.4.8 images and deploying Rancher v2.4.8)
deploy a cluster with scripting/automation using a template with matching pre-pulled images

Result:
If the container images exist (pre-pulled) on the node before the join command is run, it should fail. If the images do not exist, and the agent has to fetch them, there shouldn't be any failures. The Rancher agent on the node continues complaining about kubelet not found error and never recovers
Other details that may be helpful:
The issue reproduces only when multiple nodes are registering at almost the same time.
The customer is using the latest versions of the Terraform RKE and Rancher2 providers when deploying. They destroyed and recreated a child cluster 10 times. Only twice did all nodes successfully register. Sometimes it's only one node that fails, sometimes its 2-3 nodes. On the surface, it appears to be completely random.
Further notes regarding reproduction situations can be found on another GH issue https://github.com/rancher/rancher/issues/24450#issuecomment-649625528

If I deploy a cluster using a template with matching pre-pulled images, I run into this issue immediately and consistently. (e.g. template w/ v2.4.5 images and deploying Rancher v2.4.5)
If I run the exact same deployment as above, same template and Rancher version, but run docker system prune -a -f before the join command, I don't have the issue.
If I deploy a cluster using a template without matching pre-pulled images, I don't have the issue. (e.g. template w/ v2.4.4 images and deploying Rancher v2.4.5)
If I deploy a cluster using a template without any pre-pulled images, I don't have the issue.

Environment and Cluster Information
on-prem VMware using Rancher vsphere driver
RKE provisioned local and downstream cluster
Rancher server version: v2.4.3, v2.4.5, v2.4.8, Latest version tried on: v2.4.8
Kubernetes version: v1.17.5 / v1.18.6
Cluster Type: Custom RKE Cluster
Docker version: v19.03.9
OS: Ubuntu 18.04.4 LTS
kernel: 5.3.0-51-generic
gzrancher/rancher#10231

@sowmyav27 Can you help with reproduce this issue based on the steps provided above? Might need to take a few tries.

I have not had much luck with reproducing this in Rancher v2.4.5 / v2.4.8
I have a script which runs a local script in parallel against some number of nodes. With this script I do the following:
A script which pulls all images from our images manifest -> Run against all nodes
sudo docker pull busybox
sudo docker pull rancher/calico-cni:v3.13.4
sudo docker pull rancher/calico-ctl:v3.13.4
sudo docker pull rancher/calico-kube-controllers:v3.13.4
....

On the rancher server, create a custom cluster and save the registration commands for each group of nodes to a separate script -> etcd, worker, controlplane
#!/bin/bash
sudo docker run -d --privileged --restart=unless-stopped --net=host -v /etc/kubernetes:/etc/kubernetes -v /var/run:/var/run rancher/rancher-agent:v2.4.8 --server https://server --token token --ca-checksum checksum --worker

Then I run each registration script against all nodes in parallel
./runOnHosts.sh -f host_worker.txt -s registerworker.sh -u ubuntu
./runOnHosts.sh -f hosts_etcd.txt -s registeretcd.sh -u ubuntu
./runOnHosts.sh -f hosts_control.txt -s registercontrol.sh -u ubuntu

I've tested this 4 or 5 times with configurations of 3/5/7 etcd, 3/5 controlplane nodes, and 3 workers. Every time the cluster comes up and nodes don't get stuck in a registering state.
I did all of this in ec2 with all nodes in the same region and with large instance sizes to make things as quick as possible.
@sowmyav27 has the scripts so should be able to try to reproduce in the same manner


feat(applications-service-api): nsip-representation consumer function

Consumer for nsip-representation, which stores Representation data (with subset of represented/representative data), and attachments/documents
other changes

change some fields from NText to NVarchar(4000) (the maximum length), as the former is deprecated and not supported by Azure Function bindings
make all columns in Document optional, to allow a partial insert when inserting a representation document which is not yet published

:tada: This PR is included in version 2.12.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


AptDaemon and Ubuntu Software Center

On Ubuntu, generated .deb packages can be correctly installed using dpkg from command line, or the gdebi GUI frontend. However, by default Ubuntu tries to open .deb files with Ubuntu Software Center, which fails to correctly install packages generated by nw-global-build correctly because the postinstall scripts runs nwjsmanager, which is a GUI application. Ubuntu Software Center uses AptDaemon to install the packages, and a GUI can't be opened from a daemon. Years ago this was reported as a bug in AptDaemon. A possible solution could be to add an headless (non-gui) mode to nwjsmanager, but then the user installing from Ubuntu Software Center won't have any way to know the progress of the download.
So if a package is installed using Ubuntu Software Center, the installation of the correct nw.js binaries fails and it is retried at the first startup of the application; it then fails again because the user isn't root and thus can't write to /usr/lib/nwjs.

but then the user installing from Ubuntu Software Center won't have any way to know the progress of the download

I don't think that's true. WebUpd8's Oracle Java installer is a PPA that hosts a .deb package. When you install their .deb package, it downloads the correct TAR file from Oracle's web site, using wget, and then installs and configures it. While wget runs, I see progress displayed in the TTY where I'm running apt or in the 'show progress' frame in the Ubuntu or Mint "Update Manager" GUI tool.
I think if nwjsmanager had optionally no GUI and printed progress to stdout, it'd work fine. For example, it could write "$n percent done" after every 5MiB of progress.

Hi @bkidwell, thank you for this suggestion and the one on the other issue (#1).
As you may have noticed from the timestamps of the most recent commits to master, this project is now more or less abandoned. I no longer think that this kind of solution (a program to manage a global installation of nw.js) is a good idea, for the following reasons:

On Linux, this task of managing dependencies belongs to the system package manager (apt/dpkg on Ubuntu/Debian, pacman on Arch, etc). Another program is just additional overhead and I think it would be unwanted software for most Linux users. I wouldn't install something "packaged" in this way myself now that I use Linux as my main OS (I was more of a Windows person back in the days when I wrote nw.js-global-install and only occasionally used Linux VMs) because I think the correct solution is that the people who package a program for a certain distribution also build a separate package with the correct version of nw.js and make it a dependency of the application package. See for example how the Arch Linux team manages it for Electron (which, as you probably already know, is a platform similar to nw.js); the "electron" package is a dependency of Electron-based applications like Atom and everything is managed by the system package manager (pacman).
On Windows, nw.js-global-install may make a little more sense but it's still not worth it (in my opinion), because it would only have one advantage (reducing the disk space used by separate nw.js copies) which would only be meaningful if a large number of developers of nw.js-based applications used it. Understandably almost nobody would because it's just simpler for the Windows end user to have everything in the same installer and not having to mess with dependencies; in fact, if I recall correctly, most open source software on Windows is distributed with the various dependencies bundled in the installer (libraries like Qt or Gtk, etc).

Obviously nothing forbids you or anyone else to use nw.js-global-install and/or fork it to make improvements but I personally wouldn't advise it. I'd say the most reasonable way to distribute nw.js apps is to do so by following the official guidelines. You may also find this discussion interesting because some of the posts are about the various packaging and distribution methods for nw.js applications (but it is quite outdated).


targets.py: NRF51: support S110 builds for OTA and BOOT targets

Current S110 support is only available for default (SoftDevice + App)
images.
At the moment, a BOOT image built for micro:bit will contain the S130
SoftDevice and the app will be located at 0x1c000, even though we want a
S110 SoftDevice.
Since the elf build is still done with the S110 linker script, the entry
point will be offsetted by 0x2000 and it will fail to run.
This patch creates an interface class that allows all S110 targets to
override the SoftDevices list.
Signed-off-by: Jean-Philippe Brucker<EMAIL_ADDRESS>
Changes since v1:

Also move the TARGET_MCU_NRF51_16K_S110 label into the common interface

@screamerbg

Thanks


[ci] added build/include_subdir check to filter for cpplint

Refer to https://github.com/microsoft/LightGBM/issues/1990#issuecomment-482695889, https://github.com/microsoft/LightGBM/issues/1990#issuecomment-482776312.

Force-pushed with zero diff to re-trigger CI, because close-reopen doesn't work for branches.


No longer zip old log files, it was buggy

Files would not be zipped, only renamed with .gz
They would sometimes have some binary garbage appended to them
There are reports of this flag preventing file rotation completely when tailable=true in Winston 3.9.0 (we are still on 3.8.2)

Since we aren't getting the benefit of gzipped files, might as well avoid the downsides (binary garbage and tailable interactions) until these issues are fixed.
(See upstream Winston issues 1128 and 2318, not linked here just to avoid the auto-link-back that github aggressively inserts)

Thanks!

Meant to merge but closed it by mistake


context menu issue fixed

Issue
When viewing the slider on mobile and performing a long press on the image opens the context menu, once you exit the menu endtouchHandler() is never called. You are no longer able to swipe left or right because touch.count is equal to 2 and touch.multitouch is equal to true.
Fix
If the the context menu has been activated it will then call the touchendHandler() function.

Thanks for the contribution!
Firstly, could you remove the package-lock.json file from the PR? I'll add it later myself.
Secondly (if you have some time), could you move this logic to a separate method (named contextmenuHandler and attach it in the bindEvents method? Just like other handlers.

Great, we're almost there. bind attaches and detaches the event listener automatically and there's also slider available in the scope, so you can just write:
var contextmenuHandler = function() {
    touchendHandler();
};

bind(slider, 'contextmenu', contextmenuHandler);
Just test it, to be sure, thanks!

That's is a much better solution 👍
All seems to be working so hopefully that is now fixed.


fix(ext): segv on fork

We would segv when using proj and then fork a process. This is fixed by using proj's thread-safe context.
Fixes #39

@keithdoggett no the init function is only called on require. TBH I don't know why it works now since the context stays the same after fork.
We could wrap Process.fork to change the context (as done by ko1/nakayoshi_fork) but I don't see the need as it works as is.
Yet, if you can make more tests (and different than the ones I did I guess) I think it would be great. As I'm not really an expert on that topic.
Also see if the test I added reproduces the segv on your machine as well would be nice

I updated my local error reproduction project (the one I linked in the issue) to use the fix/fork-segv branch and i still get a seg fault. Let me know if I need to to anything else to verify the fix.

@Pe-co this means either I fixed another mistake and didn't find yours, or it is os dependent. Would you have time to also test that my branch is fixing something ?
t=$(mktemp -d)
git clone git@github.com:rgeo/rgeo-proj4 $t
cd $t
git checkout fix/fork-segv

for _ in a b c d e; do
  rake test
done
# verify that none failed by looking at the tests
# (look for dreadful long backtrace, or segv message)

git checkout master
git checkout fix/fork-segv -- test

for _ in a b c d e; do
  rake test
done
# verify that none failed by looking at the tests

cd - || cd
rm -rf $f

When i run the tests for fix/fork-segv or a clean master i get  955 assertions but no seg fault, so I assume something is missing in the setup. When i run them for 'master with git checkout fix/fork-segv -- test ' they hang.
Running one or several tests suites makes no difference

@Pe-co so it seems like we are fixing something, but not your thing! I say that we already merge that one and then we'll have one less bug to look at when trying to debug your issue :slightly-smiling-face:

Ok, so we expected an error on the master/test merge, but you got a seg fault an I just got a hang, makes sense.

@Pe-co I get a hang sometimes as well FYI (c.f. test description).
@keithdoggett ready to merge when you are

@BuonOmo as we discussed we're going to merge this since it's a step in the direction resolve this and was able to fix the issue in some instances. We talked about next steps for debugging the still pending issues and should have updates soon.
@Pe-co we will loop you in with any relevant updates as well.


Fixed warning in websocket.h: right shift count >= width of type

Fixed by static_cast-ing values from 32-bit values to 64-bit values.

Thank you for the PR.


Adding rubberBoot and leave button.

DUMS-104
Small PR to add leave room button no functionality.

Is the boot functionality in or just the icon?


Get it to build

These are all changes necessary to get it building. Please have a close look. My suspicion is that you haven't quite gotten the hang of .cpp and .h files and where you need which. As for the Makefile changes, it is probably useful to understand what I did there and why, but integrating the changes with Haiku later, it will be Jamfiles anyway. It's a bit different, but the Jamfiles are a complex build system which handles all of the various ways to build Haiku. Most of the Haiku devs themselves are intimidated by the build system, elegant as it may be, once you know it deeply.
The next task is getting the app to run. :-)

You created this pull for my master branch, is there any possible way I can shift this PR to my broken branch?

Why can't you just switch to the master branch, too?
I need to pick up my kid from a friend's house, will be back soon. Hoping we can spend some time in IRC later.


segment fault  under centos7

when use Schwarzwald --tiler -i /path/to/your/LAS/files -o /output/path/for/3D/tiles --output-format 3DTILES  ，it run error

Can you give us a little more information please? For example, what data set are you trying to convert? What error message do you get exactly?

I want to convert las to 3dtiles
Input files:
"i/zt-Cloud.las"
[00:00:00] indexing: 0 / 92.775M loading: 0 / 92.775M
this is  error

Is your input file OK? Did you check it with lasvalidate?
https://rapidlasso.com/lasvalidate/

I didn't，but I use las2las in https://github.com/LAStools/LAStools   it work well


"Add a new emoji" modal's label taking too long horizontal space

At the modal where we add an emoji the label with "Emoji Name" takes all space horizontally. This behavior creates a meaningless clickable space on the modal that feels a bit off.
To reproduce :
Settings >> Organization settings >> Custom Emoji >> Add a new emoji
The space, label "Emoji name" takes:

Behavior of the label:

what if we changes it from Emoji Name to some Name or Emoji by this it will reduce the horizontal scape

Not only for Emoji Name but all the labels have display: block property that comes from bootstrap CSS:

Unless explicitly changed using any other class such as here:

@zulipbot claim

@enesonus resolve the issue can i do Pull Request?

@Mohammadkhan18 please read the comments I left at your PR

@zulipbot claim

i want to work inthis issue

@zulipbot abandon


Update logging.rst

ASP.NET 5 to ASP.NET Core 1
https://github.com/aspnet/Announcements/issues/144

I'm pretty sure that this update was deliberately not yet done because the rename isn't yet in any official public release. These docs are still for RC1, which was called ASP.NET 5.
Also, I don't recommend sending a dozen PRs, each affecting only one file, each having only a few changed lines.
Lastly, I think the recommended nomenclature in docs will be "ASP.NET Core" without the version number because the version number won't be relevant.

Per Eilon (he's correct on all counts) , closing.


Using http get method to pull cert and ssl info from AVI controller

Recently, I created an Ansible playbook that uses the http get method to pull back cert data from an AVI load balancer. The load balancer in question has 12 pages of cert data. However, it appears the data being retrieved is only one page.  Listed below is an example of my playbook:

gather_facts: false
hosts: local
vars:
env: dev
tasks:

name: Get SSL Cert Info
avi_api_session:
controller: controller.com
tenant: DEV
timeout: 1000
path: sslkeyandcertificate
http_method: get
username: "{{ username }}"
password: "{{ password }}"
register: json

debug: var=json
Is there a module or command which can be used to pull multiple pages of data using the get http method?  Or would I have to use a loop to complete my request?
Thanks.

Closing issue..


Drawing certain data points using a different marker

Dear Pierre,
Is it possible to highlight some data points in a (scatter/violin) plot using a different marker? I created a new plot (based on a variable containing only the data points I wanted to highlight), and drew it on top of the first plot. However, this either replaces the first plot, or makes a mess of the plot's axes etc.
This I guess comes back to a known bug of gramm, the difficulty it has with plotting additional stuff on top of an existing gramm-created plot (see my earlier created issues).
Assuming a bigger update to take care of this general problem is not in store, would you be able to recommend a workaround for the task I've set out to do here?
Many thanks!
Tudor

Hi, sorry for taking so long to answer... You should look into the documentation and examples for the update() function, which is designed to do exactly what you want to do.


Allow markview to specify a contentDOM element

Use case: Use a markview to render hyperlink as a preview of the content
it links to for certain content types, e.g. a video thumbnail.
Otherwise allow prosemirror to manage hyperlinked text using contentDOM.

Why not use Decorations for this? IMO it doesn't make sense to add contentDOM in mark.

Hi @torifat, I started a thread on the forum to describe the situation in more detail and solicit suggestions. I don't see how decorations could solve the problem. Can you elaborate there?

I've merged d6b25fb0cb2fc74a20a5bd2299011d4cb2734d59 instead, which does the same thing slightly cleaner (adding an argument to the MarkViewSpec constructor instead of mutating the object after construction).

Thank you Marijnh. I agree, the constructor argument is preferable.


Backup command does not work

Under "Back up a persistent volume" topic, the command use does not work
az disk list --query '[].id|[?contains(@,pvc-a844d47a-a673-11e8-ba75-dec015575cfb)]' -o tsv
az : '[?contains' is not recognized as an internal or external command,
At line:1 char:1

az disk list --query '[].id|[?contains(@,`pvc-a844d47a-a673-11e8-ba75 ...

  + CategoryInfo          : NotSpecified: ('[?contains' is...ternal command,:String) [], RemoteException
  + FullyQualifiedErrorId : NativeCommandError

operable program or batch file.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d1ac572f-c613-71fc-580a-2805b740b793
Version Independent ID: b4aeef15-7b0f-abc7-872e-28051e10d6ca
Content: Create persistent volumes with Azure Kubernetes Service
Content Source: articles/aks/azure-disks-dynamic-pv.md
Service: container-service
GitHub Login: @iainfoulds
Microsoft Alias: iainfou

Command that works for me
az disk list --query '[].id | [?contains(@,pvc-faf0f176-8b8d-11e8-923b-deb28c58d242)]'

Thanks for the feedback! We are currently investigating and will update you shortly.

@hafizramly I ran through this doc using the Azure Cloud Shell and it ran as written
micah@Azure:~$ az disk list --query '[].id|[?contains(@,`pvc-86009e4e-a70d-11e8-af07-0a58ac1f1d4b`)]' -o tsv

XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX/resourceGroups/MC_MYAKSCLUSTER_MYAKSCLUSTER_EASTUS/providers/Microsoft.Compute/disks/kubernetes-dynamic-pvc-86009e4e-a70d-11e8-af07-0a58ac1f1d4b

Are you running this from Azure CLI on premise?  If so, you likely need to update to the lastest version of Azure CLI. That tends to be the problem when getting a error regarding recognizing a command.
The version of CLI used in Azure Cloud Shell currently is 2.0.44
You can check the version you are running use az --version
Try updating your Azure CLI and see if that helps. I will close for now as I have verified the doc works as written. If updating your CLI does not help let me know and we can reopen and continue.

@MicahMcKittrick-MSFT Yes I'm running these command on-prem. And below is my azure-cli version.
PS C:\Windows\system32> az --version
azure-cli (2.0.44)
acr (2.1.3)
acs (2.3.0)
advisor (0.6.0)
ams (0.2.2)
appservice (0.2.2)
backup (1.2.0)
batch (3.3.2)
batchai (0.4.1)
billing (0.2.0)
cdn (0.1.0)
cloud (2.1.0)
cognitiveservices (0.2.0)
command-modules-nspkg (2.0.2)
configure (2.0.18)
consumption (0.4.0)
container (0.3.3)
core (2.0.44)
cosmosdb (0.2.0)
dla (0.2.1)
dls (0.1.0)
dms (0.1.0)
eventgrid (0.2.0)
eventhubs (0.2.2)
extension (0.2.1)
feedback (2.1.4)
find (0.2.12)
interactive (0.3.28)
iot (0.3.0)
iotcentral (0.1.0)
keyvault (2.2.2)
lab (0.1.0)
maps (0.3.1)
monitor (0.2.2)
network (2.2.3)
nspkg (3.0.3)
policyinsights (0.1.0)
profile (2.1.1)
rdbms (0.3.0)
redis (0.3.0)
relay (0.1.0)
reservations (0.3.1)
resource (2.1.2)
role (2.1.3)
search (0.1.1)
servicebus (0.2.1)
servicefabric (0.1.1)
sql (2.1.2)
storage (2.2.0)
telemetry (1.0.0)
vm (2.2.1)
Python location 'C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe'
Extensions directory 'C:\Users\ramlmimy.azure\cliextensions'
Python (Windows) 3.6.5 (v3.6.5:f59c0932b4, Mar 28 2018, 16:07:46) [MSC v.1900 32 bit (Intel)]
Legal docs and information: aka.ms/AzureCliLegal
I'm experience a different success result when executing this command from PowerShell and cmd. They dont But I guess probably due to my environmental setup issue.

Thanks @hafizramly. The commands won't work in PS but they should be fairly similar to on prem CLI.
I tried the same on prem and got the same results.
@iainfoulds can you take a look and see if we should add a note or something?

Could be when ran from a Windows host, only difference I see is the space either side of the | for '[].id and [?contains
@MicahMcKittrick-MSFT Can you validate that the extra doesn't break behavior in the Cloud Shell, please? That would indicate it's fine with the extra spacing on *nix-based machines. As with line wrappings on long commands, we try to avoid them to minimize problems when moving between OSes, but with some complex commands, that's not always possible. If the extra space is fine from the Cloud Shell, the doc can be updated.
#in-progress

@iainfoulds done and done.
@hafizramly I updated the doc. Once the PR merges this issue will close and the changes will go live in a few hours.

Thanks @MicahMcKittrick-MSFT!


Add note timing visualization to pattern visualization timeline

This should be same as from the osu! analyzer project (see hitobject_plot)

done


Removed default arguments for source and resource  and added confirmation before updating content metadata command

Pre-Flight checklist

[ ] Testing

[x] Changes have been manually tested

What are the relevant tickets?
Closes #1251
What's this PR do?

Removes default arguments for source and resource.
Adds a confirmation before updating meta data

How should this be manually tested?

run ocw-studio
run docker-compose exec web bash
run update_content_metadata command

Codecov Report

Merging #1451 (0f6b762) into master (c9e9781) will increase coverage by 5.36%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1451      +/-   ##
==========================================
+ Coverage   89.09%   94.45%   +5.36%
==========================================
  Files         236      113     -123
  Lines        9927     3373    -6554
  Branches     1835      805    -1030
==========================================
- Hits         8844     3186    -5658
+ Misses        954      179     -775
+ Partials      129        8     -121

Impacted Files
Coverage Δ

static/js/lib/api/util.ts
77.77% <0.00%> (ø)

static/js/components/StudioList.tsx
87.09% <0.00%> (ø)

static/js/pages/MarkdownEditorTestPage.tsx
23.80% <0.00%> (ø)

...ic/js/lib/ckeditor/plugins/DisallowNestedTables.ts
12.50% <0.00%> (ø)

gdrive_sync/signals.py

main/utils.py

main/management/commands/filter.py

...t/commands/markdown_cleaning/rules/subsup_fixes.py

...nds/markdown_cleaning/rules/link_wrapped_images.py

videos/models.py

... and 117 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@Wassaf-Shahzad what's the status of this PR?


Link to Internal: SDK version is broken

Link going nowhere (404 page) https://github.com/Microsoft/ApplicationInsights-Home/blob/master/SDK-AUTHORING.md#sdk-version-specification

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 36c3dfe3-25e4-6899-9bb9-22c1690c8e83
Version Independent ID: d8ec3295-937e-5e64-132e-7bd503b0e5fc
Content: Azure Application Insights Telemetry Data Model - Telemetry Context - Azure Monitor
Content Source: articles/azure-monitor/app/data-model-context.md
Service: azure-monitor
Sub-service: application-insights
GitHub Login: @mrbullwinkle
Microsoft Alias: mbullwin

Hello @SychevIgor ,
Thank you for your feedback! We will review and provide an update as appropriate.

Hello @SychevIgor ,
I tried to use the same link and it didn't work for me either. I have assigned to content-author for further review.

#please-close

I hope it's done, not just close.

@SychevIgor
Yes, This issue has been linked to the pull request that recently merged and will go live tomorrow with an updated link for the documentation.
https://github.com/microsoft/ApplicationInsights-Home/blob/master/EndpointSpecs/SDK-VERSIONS.md


Incompatibility with Windscribe VPN (High CPU usage)

@aspasskaya commented on Mon May 13 2019
Steps to reproduce

Install Windscribe.exe and login
Enable Adguard

Actual behavior

Your environment

Win 10 64bit
Adguard 7.0.0 beta

core/pull-requests/1299


error installing/loading package

🐛 Bug
I have tried to install and then load immunarch both using
install.packages("immunarch")
and using
devtools::install_github("immunomind/immunarch")
and I get this error message:
> library(immunarch);
Error: package or namespace load failed for ‘immunarch’ in .doLoadActions(where, attach):
 error in load action .__A__.1 for package phangorn: loadModule(module = "Fitch_mod", what = TRUE, env = ns, loadNow = TRUE): Unable to load module "Fitch_mod": vector is too large

Additional context
`> sessionInfo()
R version 4.1.3 (2022-03-10)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6.5

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

Random number generation:
 RNG:     Mersenne-Twister
 Normal:  Inversion
 Sample:  Rounding

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base

other attached packages:
 [1] devtools_2.4.3      usethis_2.1.6       patchwork_1.1.1     dtplyr_1.2.1        ggpubr_0.4.0        lmerTest_3.1-3      lme4_1.1-29         Matrix_1.4-1        purrr_0.3.4
[10] readr_2.1.2         tibble_3.1.7        tidyverse_1.3.1     ggrepel_0.9.1       scales_1.2.0        stringi_1.7.6       gtsummary_1.6.0     Hmisc_4.7-0         Formula_1.2-4
[19] survival_3.3-1      lattice_0.20-45     stringr_1.4.0       forcats_0.5.1       tidyr_1.2.0         reshape2_1.4.4      dplyr_1.0.9         data.table_1.14.2   lubridate_1.8.0
[28] ggplot2_3.3.6       googlesheets4_1.0.0

loaded via a namespace (and not attached):
  [1] utf8_1.2.2          tidyselect_1.1.2    htmlwidgets_1.5.4   grid_4.1.3          munsell_0.5.0       codetools_0.2-18    withr_2.5.0         colorspace_2.0-3    knitr_1.39
 [10] ggalluvial_0.12.3   uuid_1.1-0          rstudioapi_0.13     stats4_4.1.3        robustbase_0.95-0   ggsignif_0.6.3      labeling_0.4.2      bit64_4.0.5         farver_2.1.0
 [19] rprojroot_2.0.3     vctrs_0.4.1         generics_0.1.2      xfun_0.31           ggseqlogo_0.1       diptest_0.76-0      R6_2.5.1            doParallel_1.0.17   ggiraph_0.8.2
 [28] flexmix_2.3-18      cachem_1.0.6        assertthat_0.2.1    promises_<IP_ADDRESS>    vroom_1.5.7         nnet_7.3-17         gtable_0.3.0        processx_3.5.3      rlang_1.0.2
 [37] systemfonts_1.0.4   GlobalOptions_0.1.2 splines_4.1.3       rstatix_0.7.0       gargle_1.2.0        broom_0.8.0         checkmate_2.1.0     abind_1.4-5         modelr_0.1.8
 [46] backports_1.4.1     httpuv_1.6.5        tools_4.1.3         ellipsis_0.3.2      RColorBrewer_1.1-3  sessioninfo_1.2.2   Rcpp_<IP_ADDRESS>        plyr_1.8.7          base64enc_0.1-3
 [55] prettyunits_1.1.1   ps_1.7.0            rpart_4.1.16        openssl_2.0.2       haven_2.5.0         cluster_2.1.3       fs_1.5.2            factoextra_1.0.7    magrittr_2.0.3
 [64] circlize_0.4.15     reprex_2.0.1        googledrive_2.0.0   pkgload_1.2.4       hms_1.1.1           mime_0.12           evaluate_0.15       xtable_1.8-4        jpeg_0.1-9
 [73] mclust_5.4.10       readxl_1.4.0        gridExtra_2.3       shape_1.4.6         testthat_3.1.4      compiler_4.1.3      gt_0.6.0            crayon_1.5.1        minqa_1.2.4
 [82] htmltools_0.5.2     later_1.3.0         tzdb_0.3.0          DBI_1.1.2           dbplyr_2.1.1        MASS_7.3-57         broom.helpers_1.7.0 fpc_2.2-9           rappdirs_0.3.3
 [91] boot_1.3-28         car_3.0-13          brio_1.1.3          cli_3.3.0           quadprog_1.5-8      parallel_4.1.3      igraph_1.3.1        pkgconfig_2.0.3     numDeriv_2016.8-1.1
[100] foreign_0.8-82      xml2_1.3.3          vdbR_0.1.0          foreach_1.5.2       rvest_1.0.2         snakecase_0.11.0    callr_3.7.0         digest_0.6.29       janitor_2.1.0
[109] rmarkdown_2.14      cellranger_1.1.0    fastmatch_1.1-3     htmlTable_2.4.0     curl_4.3.2          kernlab_0.9-31      shiny_1.7.1         modeltools_0.2-23   nloptr_2.0.3
[118] lifecycle_1.0.1     nlme_3.1-157        jsonlite_1.8.0      yingtools2_<IP_ADDRESS> carData_3.0-5       desc_1.4.1          askpass_1.1         fansi_1.0.3         pillar_1.7.0
[127] fastmap_1.1.0       httr_1.4.3          DEoptimR_1.0-11     pkgbuild_1.3.1      remotes_2.4.2       glue_1.6.2          UpSetR_1.4.0        png_0.1-7           prabclus_2.3-2
[136] iterators_1.0.14    bit_4.0.4           class_7.3-20        latticeExtra_0.6-29 memoise_2.0.1       ape_5.6-2          `

Hello, @tsonipeled!
I'm Aleksandr Popov, a developer of Immunarch package. Thank you for using our software!
"Vector is too large" error means that there is not enough memory to load a module. Please try to delete some data objects that you don't need anymore using rm() function. Also, there is an article about other methods that you can use to deal with memory errors: https://www.positioniseverything.net/error-vector-memory-exhausted-limit-reached
If you have more questions, feel free to ask them!
Best regards,
Aleksandr


dtc version 1.4.5 with ubuntu 18.04 and zephyr sdk-0.10.1

Describe the bug
Trying to build the hello_world project (https://docs.zephyrproject.org/latest/getting_started/index.html).  When trying to build via west or cmake I get an error that the detected version of dtc is unsupported (1.4.5 versus minimum supported 1.4.6).
echo $ZEPHYR_SDK_INSTALL_DIR
yields "zephyr"
echo $ZEPHYR_TOOLCHAIN_VARIANT
yields "/home/mas/zephyr-sdk-0.10.1"  (/home/mas is my home folder).
I had found one other related bug report, but this had been resolved when they discovered a misspelling in the environment variables.  I did check this (even cut and pasted the environment variables from the above referenced webpage).
To Reproduce
cd ~/source/zephyrproject/zephyr
source zephyr-env.sh
west build -b reel_board samples/hello_world
** or **
cmake -B build -GNinja -DBOARD=reel_board samples/hello_world
Expected behavior
no dtc error
Impact
cannot proceed
Screenshots or console output
-- west build: build configuration:
source directory: /home/mas/source/zephyrproject/zephyr/samples/hello_world
build directory: /home/mas/source/zephyrproject/zephyr/build
BOARD: reel_board (origin: command line)
-- west build: generating a build system
Zephyr version: 1.14.99
-- Selected BOARD reel_board
-- Found west: /home/mas/.local/bin/west (found suitable version "0.5.7", minimum required is "0.5.6")
CMake Error at /home/mas/source/zephyrproject/zephyr/cmake/extensions.cmake:1324 (message):
Assertion failed: The detected dtc version is unsupported.
  The version was found to be 1.4.5
  But the minimum supported version is 1.4.6
  See https://docs.zephyrproject.org/latest/getting_started/
  for how to use the SDK's dtc alongside a custom toolchain.

Call Stack (most recent call first):
/home/mas/source/zephyrproject/zephyr/cmake/host-tools.cmake:69 (assert)
/home/mas/source/zephyrproject/zephyr/cmake/app/boilerplate.cmake:414 (include)
CMakeLists.txt:5 (include)
-- Configuring incomplete, errors occurred!
ERROR: command exited with status 1: /usr/local/bin/cmake -B/home/mas/source/zephyrproject/zephyr/build -S/home/mas/source/zephyrproject/zephyr/samples/hello_world -GNinja -DBOARD=reel_board
run as "west -v build -b reel_board samples/hello_world" for a stack trace
Environment (please complete the following information):
Ubuntu 18.04
Zephyr SDK sdk-0.10.1
Additional context
I am a complete Zephyr-OS noob.

I don't even have 'dtc' installed on my system, AFAIK it gets it out of the SDK.
What is your output of:
$ $ZEPHYR_SDK_INSTALL_DIR/sysroots/x86_64-pokysdk-linux/usr/bin/dtc --version

I get:
Version: DTC 1.4.7-g78e113e8-dirty

If you get the same output, perhaps the build system is preferring a host installation of dtc over the SDK one?

Yes, I get the same output:
Version: DTC 1.4.7-g78e113e8-dirty
Any idea how to force it to use the one it came with?

@mas-co I don't know the build system too well, unfortunately.
As a short-term bandaid you could remove the host dtc.
But definitely sounds like we have a bug here.
@SebastianBoe @galak FYI

@mas-co I get DTC:FILEPATH=/opt/zephyr-sdk/sysroots/x86_64-pokysdk-linux/usr/bin/dtc
even though which dtc returns /usr/bin/dtc. Maybe there is something wrong in your setup, do you have the env variable ZEPHYR_SDK_INSTALL_DIR set correctly?
The DTC can be overriden with -DDTC=<your/dtc> when invoking either cmake or west.

@mas-co I can't reproduce this, although I force-installed an older dtc version.
I can't explain why this is happening, but can you try please cleaning your repository clone so that we are sure there's not some old CMake cache polluting the build? Try git clean -fdx from the root of your zephyr repo, though bear in mind that will delete any untracked files

@mas-co can you try adding this line:
diff --git a/cmake/toolchain/zephyr/0.10.1/host-tools.cmake b/cmake/toolchain/zephyr/0.10.1/host-tools.cmake
index 604c8ade4c..4d1577fa29 100644
--- a/cmake/toolchain/zephyr/0.10.1/host-tools.cmake
+++ b/cmake/toolchain/zephyr/0.10.1/host-tools.cmake
@@ -6,6 +6,7 @@ set(HOST_TOOLS_HOME ${ZEPHYR_SDK_INSTALL_DIR}/sysroots/${TOOLCHAIN_ARCH}-pokysdk
 # suffixes added. Ensures that the SDK's host tools will be found when
 # we call, e.g. find_program(QEMU qemu-system-x86)
 list(APPEND CMAKE_PREFIX_PATH ${HOST_TOOLS_HOME}/usr)
+message(${HOST_TOOLS_HOME}/usr)

 # TODO: Use find_* somehow for these as well?
 set_ifndef(QEMU_BIOS            ${HOST_TOOLS_HOME}/usr/share/qemu)

and seeing what gets printed when you build?
In my case I see:
/home/carles/bin/zephyr-sdk/sysroots/x86_64-pokysdk-linux/usr

@joerchan if i type ls $ZEPHYR_SDK_INSTALL_DIR  I get the contents of the /zephyr-sdk-0.10.1 folder.  The dtc in the zephyr sdk folder is  1.4.7-g78e113e8-dirty and if I add that to the west command using the -DDTC=/home/mas/zephyr-sdk-0.10.1/sysroots/x86_64-pokysdk-linux/usr/bin/dtc option, I get the following output:

Zephyr version: 1.14.99
-- Selected BOARD reel_board
-- Found west: /home/mas/.local/bin/west (found suitable version "0.5.7", minimum required is "0.5.6")
CMake Error at /home/mas/source/new/zephyrproject/zephyr/cmake/extensions.cmake:1324 (message):
Assertion failed: Zephyr toolchain variant invalid: please set the
ZEPHYR_TOOLCHAIN_VARIANT-variable
Call Stack (most recent call first):
/home/mas/source/new/zephyrproject/zephyr/cmake/generic_toolchain.cmake:54 (assert)
/home/mas/source/new/zephyrproject/zephyr/cmake/app/boilerplate.cmake:430 (include)
CMakeLists.txt:5 (include)

I triple-checked ZEPHYR_TOOLCHAIN_VARIANT and it is set to "zephyr"
I cut and pasted the environment variable settings from the install host dependencies webpage into my .bashrc file, so I dont' know what's up here.

@carlescufi I get the same results after running the git clean -fdx in the zephyrproject/zephyr
Where do you want me to add the --diff... line?

@mas-co
Please add the line:
message(${CMAKE_PREFIX_PATH})

in the file cmake/toolchain/zephyr/0.10.1/host-tools.cmake, after the line  list(APPEND CMAKE_PREFIX_PATH ${HOST_TOOLS_HOME}/usr)

@carlescufi
After including the message statement in the host-tools.cmake file, the output of cmake -B build -GNinja -DBOARD=reel_board samples/hello_world is below.
Zephyr version: 1.14.99
-- Selected BOARD reel_board
-- Found west: /home/mas/.local/bin/west (found suitable version "0.5.7", minimum required is "0.5.6")
CMake Error at /home/mas/source/new/zephyrproject/zephyr/cmake/extensions.cmake:1324 (message):
Assertion failed: The detected dtc version is unsupported.
  The version was found to be 1.4.5
  But the minimum supported version is 1.4.6
  See https://docs.zephyrproject.org/latest/getting_started/
  for how to use the SDK's dtc alongside a custom toolchain.

Call Stack (most recent call first):
/home/mas/source/new/zephyrproject/zephyr/cmake/host-tools.cmake:69 (assert)
/home/mas/source/new/zephyrproject/zephyr/cmake/app/boilerplate.cmake:414 (include)
CMakeLists.txt:5 (include)

Just to confirm the issue: This also started happening for me in a Ubuntu 18.04 machine around 2 weeks ago (I just took the shortest path and updated the dtc installed in the system).

@mas-co The message you added did not appear. It seems to me that you have some misconfiguration of your SDK.
The DTC error you get could be that the path to DTC is invalid.
Please check these (env | grep ZEPH):
ZEPHYR_TOOLCHAIN_VARIANT=zephyr
ZEPHYR_SDK_INSTALL_DIR=/opt/zephyr-sdk
ZEPHYR_BASE=/home/joakim/repos/zephyrproject/zephyr

And double check that the path to everything is correct.
Check that you are in fact pointing to the correct SDK:
cat $ZEPHYR_SDK_INSTALL_DIR/sdk_version
0.10.1

Check that cmake picked up on your SDK install:
cat CMakeCache.txt| grep SDK
//Zephyr SDK install directory
ZEPHYR_SDK_INSTALL_DIR:PATH=/opt/zephyr-sdk

Lastly check that you DTC was correctly selected:
cat CMakeCache.txt| grep DTC
DTC:FILEPATH=/opt/zephyr-sdk/sysroots/x86_64-pokysdk-linux/usr/bin/dtc

@mas-co please delete your build folder every time you run. I don't see any debug output from the message() statement, I assume because you didn't delete the build folder.

@carlescufi
After deleting the build folder the Hello World project built without error and zephyr.elf was in the build/zephyr folder.
I wish I knew that you needed to delete the build folder every time.  (sorry, I am transitioning to Linux from Windows and I am new to cmake---and only occasionally using makefiles)
I appreciate everyone's efforts to get me going.  I hope to be able to share the kindness in the future.
@joerchan
All of the variables were ok.  Just finished checking when I deleted the build folder.

Thanks for updating and closing the issue for future reference @mas-co

@carlescufi
You are welcome.
And again, thanks to everyone for their assistance!

@mas-co Deleting the build folder is a drastic measure. Probably you did run west build before you had installed zephyr:
cat build/CMakeCache.txt| grep SDK
//Zephyr SDK install directory
ZEPHYR_SDK_INSTALL_DIR:PATH=

Then if you install zephyr after all, the cmake build system doesn't pick it up. It uses the now stale ZEPHYR_SDK_INSTALL_DIR instead of picking it up from an environmental variable.
If I look into the source code I see namely
set_ifndef(ZEPHYR_SDK_INSTALL_DIR "$ENV{ZEPHYR_SDK_INSTALL_DIR}")
set(ZEPHYR_SDK_INSTALL_DIR ${ZEPHYR_SDK_INSTALL_DIR} CACHE PATH "Zephyr SDK install directory")

If the environmental variable is not defined this cache variable will become empty.
function(set_ifndef variable value)
  if(NOT ${variable})
    set(${variable} ${value} ${ARGN} PARENT_SCOPE)
  endif()
endfunction()

It can be solved by either checking also in set_ifndef if ${${variable}} is not EQUAL to an empty string (even if it is defined). Or the variable should only be set if it's not empty. Or the function where is checked if the ZEPHYR_SDK_INSTALL_DIR variable is set should return() before it is written to the CMake cache.

@mas-co
Hi, I've got the same problem. What is exactly the "build folder" and where could I fond it?


Add BookChangeEvent

Just like SignChangeEvent.

Are you talking about when a book gets signed?

@Guichaguri I would think possibly after a book is edited before it is signed.

@Guichaguri @twizmwazin A BookChangeEvent would fire in both cases. There would probably be an isSigned() attribute.

Maybe we should add a more generic event as well if any DataManipulator is applied or DataHolder is changed. Something like DataChangeEvent.

Currently, #685 is adding a ValueChangeEvent which would solve this issue as you can type check for an ItemStack on the getDataHolder and as well type checking on the possible Values for the getSuccessfulData() will result in an understanding of what was added vs replaced/removed. In this case, it is possible we can further narrow down some events from this, such as ItemStackValueChangeEvent or something. The idea behind the event is that most base events, such as EntityEvent would extend ValueChangeEvent, if not DataHolderEvent and manually note the various events that are backed by value changes.

Wouldn't a BookSignedEvent still be applicable?

Wouldn't a BookSignedEvent still be applicable?

It might not even be necessary at that point though since it is something REALLY specific.

I believe that when a book is signed, the item changes entirely (since it not only changes NBT it also changes from the perspective of the ItemType, in which case, there is definitely an inventory event to be thrown. Closing as that is the ultimate solution.


Blog post on "How MongoDB compares arrays"

Description
Closes FerretDB/engineering#18.

Readiness checklist

[ ] I added/updated unit tests.
[ ] I added/updated integration/compatibility tests.
[ ] I added/updated comments and checked rendering.
[ ] I made spot refactorings.
[ ] I updated user documentation.
[ ] I ran task all, and it passed.
[ ] I ensured that PR title is good enough for the changelog.
[ ] (for maintainers only) I set Reviewers (@FerretDB/core), Assignee, Labels, Project and project's Sprint fields.
[ ] I marked all done items in this checklist.

As per this thread my understanding most likely wrong and I assumed it would be sort of trivial how it compare elements of different types by looking at the code, I was very wrong. That just handles the sort order and not the comparison.
I think the main logic is here in the matcher. It never compares elements of different canonical types except for MinKey and MaxKey and if their canonical types summed equals 5.
https://github.com/mongodb/mongo/blob/1c458cebc23d20bf259d3774498b5080b7565ca1/src/mongo/db/matcher/expression_leaf.cpp#L127-L163
I'll take another stab at figuring this out someway.

Let's close it for now


Force gathering of facts only once

Instead of running on "all", which would loop multiple times, only do it
for host localhost.

👍


Finish save function

Progress on save needs to be completed for add_secret and update_secret to be functional. Please refer to this article for the current bug behavior on MacOS.

This bug has been deprecated.


WIP remove validate-microshift/

Is there an openshift/release side PR that removes the dependency on validate-microshift?

Removal of refs to validate-microshift/ from relevant CI configs: https://github.com/openshift/release/pull/42516

/retest

Looks good. Feel free to unhold once all tests pass.
/lgtm
/hold

/unhold


Backup keeps using same old *.ark file

Backup keeps using same old *.ark file
Hi,
I am runing arkmanager 1.6-dev currently running commit is 64741f1.
I have an automated backup running every 15 minutes however all the backups contain the same TheIsland.ark file, hash is the same across all version with an old timestamp.
The save file itself is fine and if I restore on of the old ark files from the Saves directory they are ok.
Appreciate you looking into the issue.

Please try switching to the master branch.

ok, switched to the master branch and upgrade-tools, now running 1.6.12, commit 567f899, based on the contents of the last backup, issue is still happening.

Are you using a total-conversion or map mod (e.g. The Center)?
Please check the contents of your ShooterGame/Saved/SavedArks directory.  Does the TheIsland.ark file have the same timestamp as in the backup?  Apart from the timestamped backups, are there any other .ark files there?

Hi,
This particular instance is only The Island, it has half a dozen steam workshop mods installed, none of them map mods. I have other instances that are not currently backed up for Scorched Earth and The Center. I am not running primitive plus either.
TheIsland.ark file is in ShooterGame/Saved/theIsland as I am using ark_AltSaveDirectoryName in my instance config.
TheIsland.ark in there has a different timestamp that is being updated regularly.
The only other ark files are the timestamped backups.

So you have ark_AltSaveDirectoryName=theIsland?
If you upgrade arkmanager, and perform a manual backup, what does it show the Saved arks directory as?

Correct, I have that line in my cfg.
The output from a manual backup doesnt actually specify the Saved arks directory.
See output below:
Running command 'backup' for instance 'TheIsland'
Copying ARK world file                                            [   OK   ]
Copying ARK profile files
xxx.arkprofile                                    [   OK   ]
Copying ARK tribe files
xxx.arktribe                                             [   OK   ]
Copying ARK tribute tribe files
Copying GameUserSettings.ini                                      [   OK   ]
Copying Game.ini                                                  [   OK   ]
Compressing Backup                                                [   OK   ]
Created Backup:  2016-12-11_06.39.46.tar.bz2

Please try upgrading arkmanager to v1.6.13, then try again.

No dice, is there a verbose option that will give me more info?

v1.6.13 adds printing out the detected saved arks directory and the world file name.  The commit should be 481b393

Sorry missed that, it lists the correct directory:
Running command 'backup' for instance 'TheIsland'
\033[0;39m Saved arks directory is /ark/server/ShooterGame/Saved/theIsland
Copying ARK world file (TheIsland)                                [   OK   ]
Copying ARK profile files
76561198001611860.arkprofile                                    [   OK   ]
Copying ARK tribe files
1539113781.arktribe                                             [   OK   ]
Copying ARK tribute tribe files
Copying GameUserSettings.ini                                      [   OK   ]
Copying Game.ini                                                  [   OK   ]
Compressing Backup                                                [   OK   ]
Created Backup:  2016-12-11_06.49.01.tar.bz2

The saved world file is exactly TheIsland.ark, and there are no other .ark files in the directory other than the timestamped backups?  Does any file in the directory match the timestamp of the .ark file that is being backed up?

Yes that is the name of the save file, there were no other .ark files in that directory excepot the timestamped backups BUT, I did find a directory in there which had an old TheIsland.ark file in there.
After I removed that directory it seems to have fixed it.


Illustrate differences between explicitly typed expressions and casts.

https://cockroachlabs.atlassian.net/browse/DOC-1598

This change is


getting internal error trying to get userInfo

Trying to get authorized after
apiClient.configureJWTAuthorizationFlow(new ClassPathResource("key_docusign_pub.rsa").getFile().getAbsolutePath(), new ClassPathResource("key_docusign.pem").getFile().getAbsolutePath(), OAuthBaseUrl, IntegratorKey, UserApiID, 3600); OAuth.UserInfo userInfo = apiClient.getUserInfo(apiClient.getAccessToken());
and while getting userInfo I'm getting an error
com.docusign.esign.client.ApiException: Error while fetching user info: Error while requesting server, received a non successful HTTP code 401 with response Body: '{"error":"internal_server_error","reference_id":"58c96d39-20db-42d7-b789-4628c0511d68"}'

make sure that: 1. the paths to the RSA keypair are correct (by printing out the files contents to the log) and 2. you gave user consent: https://developers.docusign.com/esign-rest-api/guides/authentication/oauth2-jsonwebtoken#step-1-request-the-authorization-code

Check out the new Java JWT example: https://github.com/docusign/eg-01-java-jwt/

Hi @bboysh1ft,
Thank you for the update!
Regards,
Larry


Caps lock issue#658

I have changed the quit message to use the yesnoprompt instead of the letterprompt and changed the caps Y and N in that function so all yesnoprompt questions can be used with caps lock on.
I have looked at your commit for this issue but I think this would be better.
I have tested it and it has the same behavior as before.
If you do not like it then just reject this pull request.
If there is any issue you need help or testing  on linux then let me know and I will try my best to help.

Thanks! I think this is an improvement. I'm not sure why it wasn't using YesNoPrompt earlier.


More integration tests and test configs

This pull request works on issue #64.
We extracted the server configs out of the test files so it is easier to reuse them. We wrote tests for the FileResourceStore with and without authentication.
We would like to extend the util functions so it is easier to write tests in the future. And also we are thinking how to run a serverconfig against a subset of the test and not the whole suite.
The tests are not yet tested on windows only on manjaro linux.
Sidenote: the FileResourceMapper is still from this pullrequest #142

It looks like the builds fail because of Cannot write file '.../community-server/index.d.ts' because it would overwrite input file. This is a problem that also occurs on my local machine.

It looks like the builds fail because of Cannot write file '.../community-server/index.d.ts' because it would overwrite input file. This is a problem that also occurs on my local machine.

That's very weird, haven't seen that myself yet. Any idea what might cause this?

Important note: right now src/init/CliRunner is getting ignored in the jest config because there is not enough test coverage for it. There should be unit tests added (for a separate issue or maybe if we still have time tomorrow).

Continued in #154


wrong content-type for some blogs at k8s.io/blog/

This is a Bug Report
Problem:
Kubernetes 1.2 and simplifying advanced networking with Ingress
Kubernetes 1.2: Even more performance upgrades, plus easier application deployment and management
Kubernetes 1.3: Bridging Cloud Native and Enterprise Workloads
Kubernetes 1.4: Making it easy to run on Kubernetes anywhere
Kubernetes 1.5: Supporting Production Workloads
Kubernetes 1.6: Multi-user, Multi-workloads at Scale
Kubernetes 1.7: Security Hardening, Stateful Application Updates and Extensibility

At least these blogs have wrong content-type 'application/octet-stream', for example:
$ curl -I -s https://kubernetes.io/blog/2016/03/kubernetes-1.2-even-more-performance-upgrades-plus-easier-application-deployment-and-management
HTTP/2 200
accept-ranges: bytes
cache-control: public, max-age=0, must-revalidate
content-length: 82588
content-type: application/octet-stream
date: Tue, 22 Oct 2019 07:05:56 GMT
etag: "144be287c274dd3239fb5b59e6b1176d-ssl"
strict-transport-security: max-age=31536000
age: 1285
server: Netlify
x-nf-request-id: 17f57fd9-7088-4efc-abad-6fd6482f16cb-16811818

Proposed Solution:
Local hugo serve works, so I guess it's a misconfiguration on the server side.
Page to Update:
At lease these pages:
https://kubernetes.io/blog/2016/03/kubernetes-1.2-and-simplifying-advanced-networking-with-ingress/
https://kubernetes.io/blog/2016/03/kubernetes-1.2-even-more-performance-upgrades-plus-easier-application-deployment-and-management/
https://kubernetes.io/blog/2016/07/kubernetes-1.3-bridging-cloud-native-and-enterprise-workloads/
https://kubernetes.io/blog/2016/09/kubernetes-1.4-making-it-easy-to-run-on-kuberentes-anywhere/
https://kubernetes.io/blog/2016/12/kubernetes-1.5-supporting-production-workloads/
https://kubernetes.io/blog/2017/03/kubernetes-1.6-multi-user-multi-workloads-at-scale/
https://kubernetes.io/blog/2017/06/kubernetes-1.7-security-hardening-stateful-application-extensibility-updates/

/kind bug
/priority important-soon
(I think)

I figured this one out after some poking around.
If the blog's front matter url: contains a period (usually from a k8s version), Netlify treats it as a file extension.
Example (broken): source
url: /blog/2016/03/Kubernetes-1.2-Even-More-Performance-Upgrades-Plus-Easier-Application-Deployment-And-Management

Will render as /blog/2016/03/Kubernetes-1.2-Even-More-Performance-Upgrades-Plus-Easier-Application-Deployment-And-Management making your browser think the page has a strange extension.
Example (working): source
url: /blog/2016/03/Kubernetes-In-Enterprise-With-Fujitsus

Will render as: /blog/2016/03/Kubernetes-In-Enterprise-With-Fujitsus**/** (which loads the auto-generated blog index.html shortcode).
Solution:

Find all blog posts where the front matter contains a url with a period
Swap periods for dashes
Profit

/good-first-issue


Display remote data (API) without filtering

Hello,
I have a problem with the dropdown. I use Tom Select with an API that already handles typos etc. But it seems that tom select excludes results that do not explicitly contain the content of the input field. Could I just include the results returned by my API?
Sincerely

This has been covered somewhere in the discussions or issues. It would be good to add to the docs once found.

Thank you for your quick answer. Is this this issue (#78) ?

Thank you @oyejorge. I tried to fix my select today and #78 was the correct issue. Maybe we can add something in the documentation about it ?
// Fetch remote data
load: function (query, callback) {
  const url = parent.urlValue + '?q=' + encodeURIComponent(query)

  fetch(url)
    .then(response => response.json())
    .then(json => {
      this.clearOptions()

      callback(json.hits)
    }).catch(() => {
      callback()
    })
},

Facing the same issue here. However I cannot use this.clearOptions() since I'm using virtual scroll plugin so I'd like user to have previosly loaded values.

Facing the same issue here. However I cannot use this.clearOptions() since I'm using virtual scroll plugin so I'd like user to have previosly loaded values.

I used clearOptions and just got stuck on virtual scroll not working.


Ingame Events Doesnt show

Please fill in the following fields:
Unity editor version: 2019.2.4f1
Firebase Unity SDK version: 6.4.0-6.6.0
Firebase plugins in use (Auth, Database, etc.):Firebase analytics,firebase messaging
Additional SDKs you are using (Facebook, AdMob, etc.): Admob,EasyMobile
Platform you are using the Unity editor on (Mac, Windows, or Linux): Windows
Platform you are targeting (iOS, Android, and/or desktop): Android
Scripting Runtime (Mono, and/or IL2CPP): IL2CPP
Please describe the issue here:
I built an apk file to confirm sdk install to get console and it went well but after some time i launched apk again but there is no event in streamview, but if i try debugview all the data can be seen in streamview
for good understanding this is workflow
1-build and apk and install it to my phone
2-play it around 5 min
3-there is about 10-15 events in streamview
4-wait for some time
5-play it around 5 min again
6-there is no event on streamview(i checked streamview about 30 minutes after that)
7-uninstall apk from my phone
8-there is events from step-5 gameplay +remove event in streamview
so in general i think it is only sending install and remove package but i dont know how to solve it

Hi @hanilak,
Thanks for the question. Looks like you are hitting a feature of analytics where it does bulk updates. Looks like DebugView in the Firebase console is updated more frequently and might solve your problem.
You can read more about it on this blog post.

@markchandler-google but thats not my problem, i already tried to debugview and i can see datas as i write in my question but i cant see datas in streamview, how often streamview events updating?


feat(config): specify package.json location (#823)

Updates loading of package.json to allow specifying of file location or
entire contents in addition to existing behavior.

Closing; will re-open once I get a chance to look at test failures.


Help in context in dock title bar.

@alejoe91 : can you check gramar : this doc are diplay in the GUI for the end users.

@alejoe91 : can you check gramar : this doc are diplay in the GUI for the end users.

I'll push directly on this branch

Yep better. Normally you can.
The best you be that you improve this doc while trying the GUI.
You will see when you press "?" on each view this help.


Adding Jobs List Molecule

We currently don't have a molecule which matches the current Carreer page requirements, so I've created a jobs list molecule. This molecule will be used on /about-us/careers/ page, within the Sidebar-Breakout organism.
Additions

Adding Jobs List Molecule

Testing

N/A

Review

@chosak
@richaagarwal
@virginiacc

Screenshots

Checklist

[ ] Changes are limited to a single goal (no scope creep)
[ ] Code can be automatically merged (no conflicts)
[ ] Code follows the standards laid out in the front end playbook
[ ] Passes all existing automated tests
[ ] New functions include new tests
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Placeholder code is flagged
[ ] Visually tested in supported browsers and devices
[ ] Project documentation has been updated (including the "Unreleased" section of the CHANGELOG)

Do we want to handle the (unlikely?) case that there are no current job openings?

Yeah, I think that's worthwhile

Do we want to handle the (unlikely?) case that there are no current job openings?

Fixed in https://github.com/cfpb/cfgov-refresh/pull/2275/commits/3a1102312e3003ae952066b1f7447883e56df90d

Looks good to me @rosskarchner!

👍

👍

👍 Looks great!


LICENSE

Hey guys,
I was wondering what is the deal with the license for this project. Can we have one? Is it something that should be done earlier rather than later.
A standard MIT license I think would be an easy choice.

yeah submit a PR for it.


May I use CLR for Adam optimizer?

From the paper and your implementation, your examples are only use SGD optimizer. I am wondering if I can use this CLR for Adam or other optimizers. Many thanks.

I use CLR with Adam without issue.

@mdhimes  which framework?

@mugheesahmad Keras/TensorFlow. It should also work with PyTorch, though I haven't implemented it there.

I may be a bit late here, but I'll add my two cents for the sake of a hopefully valuable addition for future readers.
Besides the practical side of things - "I haven't had any issues with it", see above - I would also conceptually argue that usage is perfectly fine when using Adam.
At a very high level, Adam differs from classic SGD in the sense that it (1) performs local parameter updates (i.e., makes changes at the parameter level) rather than SGD which does this globally, and (2) that it performs some momentum-like optimization contrary to no momentum with classic SGD.
Now, cyclical learning rates do nothing but move the learning rate back and forth between a higher and a lower value with the goal of escaping saddle points and, by consequence of the design, local minima as well.
Does this violate the conceptual improvements of Adam over SGD? Not in my opinion. Local optimization still takes place with respect to the current loss (irrespective of future learning rates), and CLRs slow down momentum one time, while making it a bit faster the other time (depending on where in the cycle you are).
Perhaps, CLR does thus even extend the conceptual improvements of the Adam optimizer, making it even better.
Now, this should all be verified empirically and at scale, but let's hope this answers your question from a conceptual point of view as well. And maybe not yours, but the ones of others who find this issue in the future 😄

Just a warning about using Adam with CLR: I wouldn’t do the LR range test with Adam, the momentum will throw off the results and not give the best max and base LR.

Fair enough Robert. Any tips?

Just a warning about using Adam with CLR: I wouldn’t do the LR range test with Adam, the momentum will throw off the results and not give the best max and base LR.

Can you comment more on this?  Whenever I've done an LR range test with Adam, the results have been fairly consistent.  I can understand why the determined max LR might not be the best due to the momentum, but I'm having a hard time seeing why the base LR would not be the best.  From a plot of validation loss vs. learning rate, it has always been quite clear, and the result is consistent as long as that determined base LR is within the explored range (e.g., 1e-15 -- 1e-1 and 1e-5 -- 1e-3 finds the same base LR of, e.g., 1e-4).  Perhaps you can share an example demonstrating that it doesn't find the best LR range?

@mdhimes That's a good point, there isn't any reason the base LR would differ too significantly when testing with Adam.
I've had bad results running my LR Range test with SGD, and then trying those learning rates with an Adam optimizer. In particular, I've had a LR of 0.001 work with plain Adam, and a SGD-based LR range test also conclude max_lr=0.001, but then have very unstable training with CLR + Adam using a max_lr=0.001.
I haven't seen this looked at rigorously in papers (only blogs posts doing a single run of CLR with Adam on one dataset, as opposed to Smith's work which focused on SGD + CLR and some forms of regularization: https://arxiv.org/pdf/1708.07120 https://arxiv.org/pdf/1803.09820 and https://arxiv.org/pdf/1506.01186), so I'm not sure if there is a consensus opinion on combining CLR and Adam. In the meantime, the simple solution may just be to use Adam during the range test if you're set on using Adam + CLR during training.

@robert-giaquinto these are good points... Someone should do a thorough investigation of it, I think it'd make for a good paper.  I'm sure there is some way to do the LR range test with Adam.
One thing I want to mention is that the LR range test discussed in Smith (2015), where accuracy vs. LR is plotted to determine the LR range, isn't very telling when using Adam in my experience.  However, using val loss vs. LR is usually quite clear, as you can see when things become unstable (loss will be constant for tiny LR, then start decreasing at some base LR, decreases smoothly until some slightly-above-max LR where it goes crazy).  I haven't done nearly a thorough enough investigation to conclude that the LR range test with Adam works when done in this manner, but I have observed that it leads to results that are better than using a constant LR with Adam. YMMV.

I was also surprised accuracy is often shown in the LR range test plots. Accuracy isn’t a proper scoring rule, validation loss should be much more stable and informative.


Support for multipart/form-data file upload

Description
Add support for file uploads via multipart/form-data body.

Well tested PRs welcome

Just in case there was any update on this?

Just in case there was any update on this?

@joreilly Nothing new here, PRs are welcome that have unit tests

@joreilly Nothing new here, PRs are welcome that have unit tests


Geometry column

https://geopandas.org/docs/reference/api/geopandas.GeoDataFrame.html lists to_gbq, but I think it just inherits pandas-gbq; is there any plans to support a geometry column here or should this be in geopandas?
Right now I think the geometry column gets converted to string in the schema

Now that we have some Geometry support in the google-cloud-bigquery library, I think this is a reasonable request.
We may just need to pass geometry_as_object=True if available (necessary library versions are installed). https://googleapis.dev/python/bigquery/latest/generated/google.cloud.bigquery.table.RowIterator.html#google.cloud.bigquery.table.RowIterator.to_dataframe

I think I just hit a regression because of this. Loading a shapefile into BigQuery with geopandas worked back on August 5th, 2021 but now fails with
...
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas/core/frame.py", line 2054, in to_gbq
    gbq.to_gbq(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas/io/gbq.py", line 212, in to_gbq
    pandas_gbq.to_gbq(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas_gbq/gbq.py", line 1148, in to_gbq
    connector.load_data(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas_gbq/gbq.py", line 565, in load_data
    chunks = load.load_chunks(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas_gbq/load.py", line 237, in load_chunks
    load_parquet(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/pandas_gbq/load.py", line 129, in load_parquet
    client.load_table_from_dataframe(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/google/cloud/bigquery/client.py", line 2671, in load_table_from_dataframe
    _pandas_helpers.dataframe_to_parquet(
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 591, in dataframe_to_parquet
    arrow_table = dataframe_to_arrow(dataframe, bq_schema)
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 534, in dataframe_to_arrow
    bq_to_arrow_array(get_column_or_index(dataframe, bq_field.name), bq_field)
  File "/Users/User/miniconda3/envs/segment_wgts/lib/python3.9/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 292, in bq_to_arrow_array
    return pyarrow.Array.from_pandas(series, type=arrow_type)
  File "pyarrow/array.pxi", line 913, in pyarrow.lib.Array.from_pandas
  File "pyarrow/array.pxi", line 311, in pyarrow.lib.array
  File "pyarrow/array.pxi", line 83, in pyarrow.lib._ndarray_to_array
  File "pyarrow/error.pxi", line 122, in pyarrow.lib.check_status
pyarrow.lib.ArrowTypeError: Input object was not a NumPy array

some of the conda-forge packages in use:
...
geopandas                 0.10.2             pyhd8ed1ab_1    conda-forge
geopandas-base            0.10.2             pyha770c72_1    conda-forge
google-cloud-bigquery     2.34.1             pyh6c4a22f_0    conda-forge
google-cloud-bigquery-core 2.34.1             pyh6c4a22f_0    conda-forge
google-cloud-bigquery-storage 2.11.0             pyh6c4a22f_0    conda-forge
google-cloud-bigquery-storage-core 2.11.0             pyh6c4a22f_0    conda-forge
pandas-gbq                0.17.1             pyh6c4a22f_0    conda-forge
pyarrow                   6.0.1           py39h4d6536f_5_cpu    conda-forge
shapely                   1.8.0            py39hbfbc381_5    conda-forge
...

Looks like geometry is getting mapped to a string here, and so all the juicy GEOGRAPHY-detecting code in python-bigquery gets ignored.
Is fixing this a matter of getting this mapping to map geopandas types to GEOGRAPHY? It looks like python-bigquery is doing something similar to detect pandas types here but is using dtype.name instead of dtype.kind as a key — that might be a more robust approach?
I might be able to put together a PR if I can get guidance or confirmation on this from someone in the know.

I got good help elsewhere and wanted to follow up with a solution/workaround.
My issue can be resolved by converting geopandas' geometry column to a WKT column in a vanilla Pandas DataFrame and then passing the vanilla DataFrame to BQ.
    working_shapefile = pd.DataFrame({
        col: (shapefile[col] if col != 'geometry' else [g.wkt for g in shapefile[col].values])
        for col in shapefile.columns.values
    })

Hopefully, this will help someone in the future.

Here is some extra input which might be helpful in case geometry support will be added.
The solution by @brews worked for a few rows in my case, I needed to manually specify the schema to get it to parse the geometry column as GEOGRAPHY. This is what I used:
import geopandas as gpd
from google.cloud import bigquery

client = bigquery.Client()

table_id = "dataset.tablename"

df = gpd.read_file("my_file")

#determine schema
type_dict = {
    'b' : 'BOOLEAN',
    'i' : 'INTEGER',
    'f' : 'FLOAT',
    'O' : 'STRING',
    'S' : 'STRING',
    'U' : 'STRING'
}
schema = [{'name' : col_name, 'type' : "GEOGRAPHY" if col_name == "geometry" else type_dict.get(col_type.kind, 'STRING')} for (col_name, col_type) in df.dtypes.iteritems()]

#https://cloud.google.com/bigquery/docs/pandas-gbq-migration#loading_a_pandas_dataframe_to_a_table
job_config = bigquery.LoadJobConfig(autodetect=True)
job = client.load_table_from_dataframe(
    df.to_wkt(), #same output as github issue solution
    table_id,
    job_config=job_config
)
job.result()

This worked for a small dataset but for a larger set I quickly started running into all kinds of errors where bq would not accept the polygons:
Invalid polygon loop: Edge 462 has duplicate vertex with edge 554
Invalid nesting: loop 1 should not contain loop 0

I found a potential solution using geojson instead of wkt: https://stackoverflow.com/questions/62233152/uploading-to-bigquery-gis-invalid-nesting-loop-1-should-not-contain-loop-0
After quite some experimentation I found a way to create a df that seemed acceptable to bq similar to the solution above:
df_json = pd.DataFrame({
    col: (df[col] if col != 'geometry' else df[col].map(lambda x: json.dumps(shapely.geometry.mapping(x))))
    for col in df
})

This led to another similar error as before:
Invalid geography value for column 'geometry', error: Polygon's first loop must be shell. It is nested in loop 2

I then found that bq has an option to fix this type of data using make_valid=>true: https://gis.stackexchange.com/a/376870
Now I have a fully working solution, it is relatively simple but it requires overwriting the table after creation:
import geopandas as gpd
from google.cloud import bigquery

client = bigquery.Client()

table_id = "dataset.tablename"
df = gpd.read_file("my_file")

df.to_wkt().to_gbq(table_id,if_exists="replace")

cols = ",".join("st_geogfromtext(geometry, make_valid => TRUE) as geometry" if col == "geometry" else col for col in df)

query = f"CREATE OR REPLACE TABLE {table_id} AS SELECT {cols} FROM {table_id}"
# print(query)
query_job = client.query(query)

I thought I'd share this solution in case others have similar issues.
It would be nice if make_valid=True could somehow be set in df.to_gbq or in bigquery.LoadJobConfig, but I have no idea whether the architecture allows this.


Orgs using D: Add ALEX

@irixi Please review and let me know what you would like to be changed. Especially for the description I couldn't find much.
As you can see on http://dlang.org/orgs-using-d.html, it's also nice to give a reason why you decided to D or why you like it.
Preview:

@wilzbach cheers, please use our logo as shown on https://twitter.com/arexeu as the avatar, as we never use the origami on its own. The logo comprised both the origami and the text.
The description could be a quote "D is a superb language for doing high volume and low latency order matching."

the logo comprised both the origami and the text.

Oh sorry (I removed it because there was ALEX written twice)

The description could be a quote "D is a superb language for doing high volume and low latency order matching."

Sounds great! It's a bit too large for our current system,

@CyberShadow @aG0aep6G - I could increase the width from 250px to 280px, then it would like this:

Better ideas?

@CyberShadow @aG0aep6G - I could increase the width from 250px to 280px, then it would like this:
[...]
Better ideas?

Both images look fine to me. I don't think it's too jarring when a quote needs a line more. The slightly wider boxes would be ok, too.


POSTGRES_PASSWORD changes authentication settings unexpectedly

I believe that current authentication configuration in docker-entrypoint.sh is less secure than it should be.  I have a problem with $POSTGRES_PASSWORD changing the authentication settings and not adequately warning user about it.
Currently if the password is not supplied host all all all trust is added to pg_hba.conf , disabling the password checks for all users. I think this goes way too far:

I honestly believe that there should be no way for the line host all all all trust to appear in configuration unless user explicitly sets ACCEPT_ANY_PASSWORD_FOR_ANY_USER=true
Currently any mistake in configuration (for example misspelling  POSTGRES_PASSWORD) results in disabled authentication
Disabled authentication is completely silent. User could believe that password authentication is working, since the DB accepts the password.
Warning displayed if POSTGRES_PASSWORD wasn't set does not convey that password checks were disabled altogether.

No password has been set for the database. This will allow anyone with access to the Postgres port to access your database.

Sounds like you can fix it by setting the password, but the password would be just ignored.
I had an unpleasant experience of discovering my development DB for a personal project consuming 100% of server's CPU because someone was mining some kind of crypto coin on it.
Initially I was using POSTGRES_PASSWORD, but later I decided to move password configuration for "postgres" user together with creating additional, less privileged users into an init SQL file in /docker-entrypoint-initdb.d/ (amazing feature, btw). As you might imagine, I did not believe that this would disable all password checks altogether, and since my server continued to grant access with my password I had no idea that I was completely insecure.
I did not expect (and didn't need) high security from DB with an exposed port and without SSL, but having literally no security is a really strange decision.
I've read issues about security of this image (#3 #29 #31), and it seems like "security is annoying and not our problem" argument is winning. I'd much rather have official images be more secure by default, but I feel like this fight is futile. So here are my suggestions, from less bothersome to more secure:

Change the warning to clearly state "all authentication is disabled, any password is valid for any user, change pg_hba.conf or set $POSTGRES_PASSWORD if this behavior is undesirable" or something like that. Add this warning to readme.
If POSTGRES_PASSWORD is not set (better yet, if ALLOW_EMPTY_PASSWORD is set), then set it to an empty string and keep the md5 authentication always enabled. That way developers can still easily connect to a DB with empty password, but changing the password would never be silently ignored, like it was in my case.
If POSTGRES_PASSWORD is not set (better yet, if GENERATE_RANDOM_PASSWORD is set), then set password to a random string and print it on initial launch.

Official MySQL image allows to get second or third behavior by setting MYSQL_ALLOW_EMPTY_PASSWORD or MYSQL_RANDOM_ROOT_PASSWORD environment variables. Alternatively, you can set MYSQL_ROOT_PASSWORD directly. One of the three variables must be set explicitly, or MySQL container fails to launch.
For backwards compatibility ACCEPT_ANY_PASSWORD_FOR_ANY_USER or similarly explicitly named environment variable could be added. If it is set to true then host all all all trust is added to the config.
I'm willing to write the necessary code, but I'd like to know beforehand which approach would be accepted. IMHO MySQL's approach is the correct one, it is both flexible and explicit, but it's up to the maintainers.

I was just about to report this same bug! It's rather surprising that when you don't set a password for the postgres user, no password will ever checked for any user.

I think that at minimum the image needs a big strong warning at the start of the readme, warning that the default configuration is:

not data-durable; and
applies no access control

then links to the sections that discuss how to set each up.
Plus clearly and explicitly documenting that not passing a POSTGRES_PASSWORD disables all authentication. Even if a password is set later. Experienced postgres users will understand why that is, but most people will be astonished that when they ALTER USER postgres SET PASSWORD 'foobar' that has no effect, and the same's true for creating other users.

I've just had my db (luckily a backed-up side-project db) targeted by ransomware. Imagine my surprise when, in trying to find how they were able to access the db, I managed to connect to the db on my server with a simple psql -h <ip> -U postgres from my laptop and later I found the line host all all all trust at the end of the pg_hba file!
Obviously my fault for not checking deployment and default options, I'm not trying to shift blame which obviously belongs to me and noone else. But I incorrectly assumed that, being a super popular docker image of the best relational database, it had a sensible pseudo-secure default, something like "trust all connections coming from localhost, and from anywhere if using the correct password".
"Trust anything from anywhere" is in my opinion an option that shouldn't even exist, much less be the default when some tangentially-related environment variable is unset! At the very least, if it really needs to exist, it should be under some very uncomfortable and scary-looking parameter, along the lines of ALLOW_ANYONE_IN_THE_WORLD_TO_MANAGE_YOUR_DATABASE_WITHOUT_ANY_KIND_OF_AUTHENTICATION

The problem is that localhost doesn't mean anything in a Docker context.  If you're running your database with localhost being the only thing accessible inside Docker, you might as well not be running it at all (since localhost is only accessible from directly within the PostgreSQL container itself).
One idea we've had to help combat this problem is to enforce an explicit POSTGRES_PASSWORD being set, which isn't great from a usability perspective but would be better from a default-security perspective.
Operationally as a side note, I would say there are very few good reasons for exposing the PostgreSQL port externally from the cluster (-p XXX:NNN), and would recommend instead utilizing Docker's (or Kubernetes') built-in networking and service discovery.

Hurray! Thanks for your response, @tianon.
In the past 20 days I’ve experimented with postgres and... For some strange reason you can’t supply empty string as a password. You can easily set empty sting as a password, but then you just can’t login with it: psql: fe_sendauth: no password supplied. 🤯🤬. At least now I understand why trust thing happened.

The problem is that localhost...

There's no problems with localhost, It's absolutely clear (for me, at least).
My problem is that insanely permissive host all all all trust could be set in pg_hba without user's explicit wish.

there are very few good reasons for exposing the PostgreSQL port externally

Yes there are. But if your image is intended only for usage in trusted networks, then please, let’s reflect this in the documentation ~preferably in bold and at the very top~. Otherwise your default configuration shouldn’t disable authentication without user’s consent.
My proposals, updated given the weird empty-password behavior:

Have md5 auth turned on by default and set "postgres" as a default password if no POSTGRES_PASSWORD is specified. Mention it in the logs.
If setting a default password is unacceptable then refuse to start without password supplied. It could be overridden by setting DISABLE_ALL_AUTHENTICATION_FOR_ALL_USERS or similarly descriptive variable. This option would add host all all all trust to pg_hba. This should be clearly documented, something like:

Postgres doesn’t allow empty passwords, so the only way to access db without password is to disable all authentication completely. Setting a password later would not re-enable authentication. This option should not ever be used if the postgres port is exposed to the internet.

If having developers specify one environment variable is too much of an inconvenience, then at least improve the messaging and documentation. Right now documentation for POSTGRES_PASSWORD is 3 paragraphs long, contains 2 notes, but fails to mention that not specifying it disables all authentication. Warning in entry point also doesn’t mention it.

I'm not talking about making postgres image secure by default, this will hurt usability and as we all know, usability is much more important than security when it comes to databases ~SQL Injections: going strong for 20 years!~. I'm only asking for understandable security model without backstabbing.

@tianon ^^^^^
Is somebody playing Curb Your Enthusiasm theme or is it in my head?

Currently any mistake in configuration (for example misspelling POSTGRES_PASSWORD) results in disabled authentication

This misconfiguration vulnerability (or, as you put it "Request") is open for 8 months with no actionable feedback.
Try searching github for POSTRES_PASSWORD, POSTGERS_PASSWORD and other possible misspellings. Not all of the results use db with exposed port, but all of those people have no authentication on their database and do not know it. And those are only the open source projects, normally people do not publish their production db config files.
Maintainers, please. Choose 1, 2, or 3 and I'll implement it. Propose 4th alternative and I'll implement that. Say "we don't care" and close the issue. Do something concrete.

This really needs to change. It's easy for users to expose their whole DB to the world by default, silently, but that doesn't make it user friendly. It just sets them up with a time bomb that will explode on them later.
Yes, it'd be better to use proper service mapping and discovery, but even then you should preferably define some model of authentication beyond "<IP_ADDRESS>/0 trust". To mitigate the issues around the lack of a true "localhost" you can expose a variable for allowed subnets, for example.

Opened #658. Let me know if that is sufficient or if you have any suggestions for improvement.

@yosifkit Thanks. Per comment on PR that looks sensible; making the user make an explicit decision is good. Better, it's BC so long as they're already doing the sensible thing and setting POSTGRES_PASSWORD so it only forces changes to be made by the people who really should be reviewing their setup anyway.


[FR] Search engine in the GUI

I'm really missing a search bar in the GUI, kind of like the one in KDE or Windows settings. It makes it so much easier to quickly find what we're looking for.
In those systems, the results are dynamic. In KDE, the top level menu items are coloured while the rest is greyed out. In Windows, you get the "pages" directly as results.

first version as quick navigation feature implemented as previously advertised in the roadmap :)


use the maximum poolsize of a threadpoolexecutor

in threaded operations in order to have scaling thread pools start new threads as needed

ack


[BEAM-7909] fix python container image name

Fix Python container image name variable.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Run Python Dataflow ValidatesContainer

Run Python PreCommit

R: @aaltay
I found a typo when running post commit tests. Is it possible to review and merge?
Thanks,


Fixes 602: Send create notification

Summary
Initial test of the notifications service integration.
This current PR only implements the "BulkCreate" API.
A follow up PR will implement the rest of the notifications required after this pattern is proven.
Testing steps
To test locally:

Navigate to "/pkg/notifications/client.go"

comment out lines 19 - 25, and the closing brace on line 67

Replace the "kafkaServers" on line 32 with the following:

Install/run KafkaCat so that you can record the message when it is sent.

Call bulkCreate (through the API or via UI)

Notice that kafkaCat should output a json blob.

(Optional) For schema verification, you can copy the json output from KafkaCat and paste it here, to very it is a valid schema.

/retest

This now needs a rebase


[all] update openstack version to zed

What this PR does / why we need it:
Which issue this PR fixes(if applicable):
fixes #
Special notes for reviewers:

Release note:

NONE

/test openstack-cloud-csi-cinder-e2e-test

/test openstack-cloud-controller-manager-e2e-test


Added documentation for tunneling to local machine and replaced sendDocument with senddocument.

[ ] All tests pass
[x] I have run npm run doc

Description

Added documentation for tunneling to local machine using ngrok. Included simple instructions to install ngrok and configuring webhook to use the HTTPS URL generated by ngrok.

Incidentally, when running 'npm run doc', it changed doc/api.md. So it would reflect the link https://core.telegram.org/bots/api#sendDocument instead of https://core.telegram.org/bots/api#senddocument. The former link does not redirect the user to the sendDocument section of the documentation page. Thus, in order to prevent 'npm run doc' from automatically modifying doc/api.md, I have configured sendDocument with senddocument under @see on line 773 in src/telegram.js.

Though the ngrok instructions are right (though slightly vague), It has been put in the wrong section of the help documentation, the proxy part is mostly associated with running the bot behind HTTP/SOCKS proxies commonly used in corporates. I would suggest you go ahead and create a new section, since ngrok is simply a tunnel to assist with webhook based API development.

Ngrok has changed alot since this PR. Marking it as stale.


Auto update

Add option to manually and automatically check for newer application versions and if so then allow application to download only necessary and changed files not overwrite the same ones.

Good idea. I cannot think of an easy way to do this with the current codebase but it is a good idea nonetheless.

Put this one on the milestone list for v0.4? Definitely something that I've been thinking of doing for a while as well.

Well, version checking is very easy for and codebase, I think that also for Java - just read version number from text document located on the Internet and compare it to the local version number.

Yes, and in the simple case just show a message to the user that they should upgrade. Or go the whole way and offer silent updates like pretty much all browsers are doing now - which is much trickier.

I have added this idea to the MultiBit 0.4 proposed feature list:
https://github.com/jim618/multibit/wiki

Thanks ;)


Parametrize TC & PO

Sometimes it is useful to set the url according to the environment. It will by super, if will be exist available added next options when running.
For example:
harness someTag -t 4000 -c dockerChrome -url http://production.com -user josef
Current:
module.exports = ->
  {expect} = require 'chai'

  abank =
    url: 'http://www.airbank.cz'

  {

    openHomepage: ->

      describe "Open home page #{abank.url}", ->

        it "When open home page #{abank.url}", (done) ->
          client.url abank.url, done

        it "And wait for document ready state", (done) ->
          client.waitForDocumentReadyState client, done

        it "Then title is I banku můžete mít rádi | Air Bank", (done) ->
          client.getTitle().then (title) ->
            try
              expect('I banku můžete mít rádi | Air Bank').to.eql title
            catch e
              {TestError} = depend.errors
              return done new TestError e
            return done()
  }

and it could look for example:
module.exports = ->
  {expect} = require 'chai'

  abank =
    url: dependencies.args.url

  {

    openHomepage: ->

      describe "Open home page #{abank.url}", ->
   ...

or
module.exports = ->
  {expect} = require 'chai'

  abank =
    url: if dependencies.args.url then dependencies.args.url else 'http://airbank.cz'

  {

    openHomepage: ->

      describe "Open home page #{abank.url}", ->
    ....

Done https://github.com/test-stack/harness/commit/ce9661b410c8796ffcaec5c5e4824dc49cbae68e


Review new host-adding states

Follow-up for added host's added-to-existing-cluster and cluster's adding-hosts statuses.
If the host is in added-to-existing-cluster status:

status icon is InProgressIcon
status detail text: Host is added to existing cluster

If the cluster is in adding-hosts status:

icon: InProgressIcon
Status label: Adding hosts

I do not see effect of these new states on our canDo...() UI checks atm.
Depends on:

[x] #244

Will any of these changes appear in the UI we have today once it merges? Or is this preparing for future stuff?

I guess the question is related to c.rh.c . We even skipped last release there since backend is outdated atm. SO hard to say. We need to get in sync asap.
Regarding PSI or our dev envs, it can be done immediately.


[bug] Sortable.destroy Catch error at beforeUnmount hook

main.js?t=1662605540736:50 Catch error at beforeUnmount hook:
TypeError: Cannot set properties of null (setting 'Sortable1662605561360')
at Sortable.destroy (sortable.esm.js:2450:8)
at Proxy.beforeUnmount (vuedraggable.js:146:54)
at callWithErrorHandling (runtime-core.esm-bundler.js:155:22)
at callWithAsyncErrorHandling (runtime-core.esm-bundler.js:164:21)
at hook.__weh.hook.__weh (runtime-core.esm-bundler.js:2682:29)
at invokeArrayFns (shared.esm-bundler.js:561:13)
at unmountComponent (runtime-core.esm-bundler.js:6172:13)
at unmount (runtime-core.esm-bundler.js:6066:13)
at unmountChildren (runtime-core.esm-bundler.js:6210:13)
at unmount (runtime-core.esm-bundler.js:6084:17)

"vue": "3.2.38"
"sortablejs": "1.15.0"
"vuedraggable": "4.1.0"

Same issue.

Same. I ran into this issue with Slickgrid and ended up here.

did anyone find a way to bypass or avoid this issue?


ROCm clang introduces bugs when compiling hipSYCL

This problem does not happen when compiling with vanilla clang-15. It only happens when compiling with ROCm custom modified clang-15 included in ROCm installation (which is what is hipcc command actually invoking).
ROCm clang compiler causes bugs which seem like some thread-safety problems in otherwise valid and well-working programs.
hipSYCL is built using cmake -DLLVM_DIR=/opt/rocm/llvm/lib/cmake/llvm ...
This program is compiled using syclcc --hipsycl-targets='hip:gfx900' -Ofast main.cpp:
#include <sycl/sycl.hpp>

int main()
{
	sycl::queue q;
	while(true)
	{
		q.single_task([](){}).wait();
	}
}

Possible outcomes:
free(): corrupted unsorted chunks
Aborted (core dumped)

malloc(): unsorted double linked list corrupted
Aborted (core dumped)

#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1  0x00007ffff5d96859 in __GI_abort () at abort.c:79
#2  0x00007ffff5e0126e in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7ffff5f2b298 "%s\n") at ../sysdeps/posix/libc_fatal.c:155
#3  0x00007ffff5e092fc in malloc_printerr (str=str@entry=0x7ffff5f2dad8 "malloc(): unsorted double linked list corrupted") at malloc.c:5347
#4  0x00007ffff5e0c2ec in _int_malloc (av=av@entry=0x7ffff5f60b80 <main_arena>, bytes=bytes@entry=152) at malloc.c:3744
#5  0x00007ffff5e0e299 in __GI___libc_malloc (bytes=152) at malloc.c:3066
#6  0x00007ffff619db39 in operator new(unsigned long) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007ffff7d04e2c in hipsycl::rt::dag_builder::build_node(std::unique_ptr<hipsycl::rt::operation, std::default_delete<hipsycl::rt::operation> >, hipsycl::rt::requirements_list const&, hipsycl::rt::execution_hints const&) () from /usr/local/bin/../lib/libhipSYCL-rt.so
#8  0x00007ffff7d05d42 in hipsycl::rt::dag_builder::add_command_group(std::unique_ptr<hipsycl::rt::operation, std::default_delete<hipsycl::rt::operation> >, hipsycl::rt::requirements_list const&, hipsycl::rt::execution_hints const&) () from /usr/local/bin/../lib/libhipSYCL-rt.so
#9  0x00007ffff7d05e93 in hipsycl::rt::dag_builder::add_kernel(std::unique_ptr<hipsycl::rt::operation, std::default_delete<hipsycl::rt::operation> >, hipsycl::rt::requirements_list const&, hipsycl::rt::execution_hints const&) () from /usr/local/bin/../lib/libhipSYCL-rt.so
#10 0x0000000000213d43 in main ()

Nothing like that happens when is hipSYCL built using vanilla clang-15 (for example using cmake -DLLVM_DIR=/usr/lib/llvm-15/cmake ..).

@misos1 ,  Should that not be a problem of syclcc's runtime ?

I tried your example with ROCm 5.3.3 and hipSYCL v0.9.3 and it works.

I got the same results.
I have ROCm 5.4.0 and hipSYCL from develop branch concretely commit https://github.com/illuhad/hipSYCL/commit/53937c6e908446bfd639a5e8ab7548e5f698b102
I also tested a combination of ROCm 5.4.0 and hipSYCL v0.9.3 and I still got crashes.

@misos1  Hi, is this resolved on the latest ROCm? If so can we close this ticket?

Closing the ticket as no response from @misos1.  Please re-open if you still observe this issue in latest ROCm 6.0.2.  Thanks.


Valid serial number for DSM

How do I configure a valid serial number so I can install the Active Backup for Business in the virtual DSM?
Thank you!

Got it.  Thank you for the quick reply.


Remove red herring tests

Half the primes/lists tested are junk: the bitmasks have all bits set to one (except bit 0), which is useless and always passes (unless the RSA key has a small prime factor, but then you have bigger problems to worry about). The entries that matter are 11,13,17,19,37,53,61,71,73,79,97,103,107,109,127,151,157.
The original code seems to have been obfuscated for some reason; a more straightforward implementation of what is actually going on is here: https://gist.github.com/marcan/fc87aa78085c2b6f979aefc73fdc381f . It may make more sense to use sets/lists instead of bitmasks, depending on the programming language, and precomputing those from the generators makes it clearer what is actually going on (and only takes a few cycles on startup).

Thanks! Have you presented this approach upstream? I’d like to keep the implementation as close to the original as possible so that any further analysis is easy to port over.

I assumed there was some reason upstream was deliberately making the code more complicated, but I've filed an issue about it. We'll see what they say :).

Great, thanks!

Yeah, see their latest comment. Seems it's deliberately obfuscated for no good reason.