lxc.id_map is not working in profiles

as discussed :)

The problem is that any extra id_map defined for a container through raw.lxc will cause the container to fail to start. This happens both through profiles and direct configuration.

I don't quite recall what was tried last week, however so long as I add the new requested range to /etc/subuid and /etc/subgid, this works fine for me.
can you please show a very specific example of this failing, showing /etc/sub[ug]id and the raw.lxc used?

So, my end goal is to allow bind mounts inside the container (to have functionality like the "-b $USERNAME" in lxc).
So I created a profile with the following:
name: homebind
config:
    raw.lxc: |
        lxc.mount.entry = /home/tribaal home/tribaal none bind 0 0
devices: {}

That mounts my home partition inside the container when I apply it, but it's read-only. I suspect that's because the uid outside the container and the uid inside the container are not the same (that was the working hypothesis last week).

@chrisglass I was saying the lxd.id_map in lxc.raw works for me, can you please try again and if/when it fails, show the /etc/subuid, /etc/subgid, and the file contents for 'lxc config edit ' ?

@hallyn I'll give it a try then.

Adding id_map makes the container fail to start as far as I can tell.
Here is the exact series of steps I did now (all binaries from master as of c6c3c9259b661a6432833146a3f8c2bfb91b11cb):

./lxd-images import lxc ubuntu trusty amd64 --alias ubuntu --alias ubuntu/trusty --alias trusty
lxc image list shows the image as having the fingerprint: 87b74884ebee
lxc profile create idmap
lxc profile edit idmap
Paste in this (from the example in https://www.stgraber.org/tag/containers/)

name: idmap
config:
  raw.lxc: |
    lxc.id_map = u 0<PHONE_NUMBER>
    lxc.id_map = g 0<PHONE_NUMBER>
    lxc.id_map = u 1000 1000 1
    lxc.id_map = g 1000 1000 1
    lxc.id_map = u 1001<PHONE_NUMBER>5
    lxc.id_map = g 1001<PHONE_NUMBER>5
devices: {}

lxc launch trusty foo
lxc stop foo
lxc profile apply foo idmap
lxc start foo

The containers fails to start with "error: exit status 1"
The debug output on the server side looks like:
http://pastebin.ubuntu.com/11098309/

Oh, yes, that won't work.  I'm not quite sure how we should support that, but we definately should.
For now, I thought this bug was about juts adding a new mapping.  So for instance
raw.lxc: |
lxc.id_map = u<PHONE_NUMBER> 2
lxc.id_map = g<PHONE_NUMBER> 2
so that your host uids and gids 1000-1001 get mapped into the container, albeit at weird high uids.  You could then define 200000 and 200001 in the container's /etc/passwd and /etc/group.
(Note that my suggestion remains to only map in host gids, and not your primary gid, in order to protect host from guest mistakes)

So "punching a hole" in the mappings (to map uid X on host to uid X in container) should either be a separate issue, blocked on doing per-user idmaps, or it should be a part of issue #632

Unfortunately, setting only the id_map you pasted still results in non-starting containers :/
Profile:
name: idmap
config:
  raw.lxc: |
    lxc.id_map = u<PHONE_NUMBER> 2
    lxc.id_map = g<PHONE_NUMBER> 2
devices: {}

Starting a machine after the profile was applied results in:
http://pastebin.ubuntu.com/11098684/

could you please show the result of 'lxc info foo --show-log' to show the container startup error messages?

also please show /etc/subuid and /etc/subgid

No, using a profile to add the idmaps works fine for me.  I did have to map to 400000 in the container because i was allocating 200001 uids by default, so container id 200000 was already taken.

This is a kernel issue of some sort...
I've tried applying a profile which maps uid and gid 200000 of the host to the same id in the container. The resulting LXC config looks as one would expect but starting it fails with newuidmap and newgidmap reporting EINVAL coming from the write to /proc/PID/{u|g}id_map
I've also reproduced this behavior by cloning a task with CLONE_NEWUSER (lxc-unshare -s USER -- /bin/bash), then attempting to setup its userns directly as root.
I can perfectly write "200000 200000 1" to /proc/PID/uid_map and so can I write "0<PHONE_NUMBER>6", but I can never write both of them conbined.
If I write "0<PHONE_NUMBER>6\n200000 200000 1", the first map is used and the second isn't applied. Write returns EINVAL.
Oddly enough, we're not seeing this problem when mapping the user's own uid/gid in an unprivileged container, so I'm really wondering what's going on in the kernel.
For good measure, I've logged calls to newnuidmap on my system, here are some examples:
Unprivileged container started from my user (uid 201105) => works fine
called with: 20622 0 100000 1<PHONE_NUMBER>05 1
called with: 20633 0<PHONE_NUMBER>6<PHONE_NUMBER>05 1
called with: 20630 0<PHONE_NUMBER>6<PHONE_NUMBER>05 1
LXD generated LXC config, started as root => fails
called with: 22836 65536 0 1 0<PHONE_NUMBER>6<PHONE_NUMBER>05 1
called with: 22829 0<PHONE_NUMBER>6<PHONE_NUMBER>05 1
LXD generated LXC config, started as root => works fine
called with: 23211 65536 0 1 0<PHONE_NUMBER>6
called with: 23203 0<PHONE_NUMBER>6
called with: 25346 0<PHONE_NUMBER>6
Note that when failing, it's always the write syscall failing, not one of the sanity checks in newuidmap, so it's not a problem with the map in /etc/uidmap.

I can perfectly write "200000 200000 1" to /proc/PID/uid_map and so can I write "0<PHONE_NUMBER>6", but I can never write both of them conbined.
That is expected, since 165536 < 200000 < 165536+65536

I don't understand what the "called with" numbers mean especially in the failed case.  There are 10 numbers... ?

@chrisglass can you please show the information I requested above (/etc/subuid, /etc/subgid, and container startup failure log from "lxc info foo --show-log")?

Sure, sorry.
Here's the profile I have now:
name: idmap
config:
  raw.lxc: |
    lxc.id_map = u<PHONE_NUMBER> 2
    lxc.id_map = g<PHONE_NUMBER> 2
devices: {}

And the requested info:
lxc info foo --show-log: http://paste.ubuntu.com/11101581/
/etc/subuid: http://paste.ubuntu.com/11101593/
/etc/subgid: http://paste.ubuntu.com/11101601/

@chrisglass your /etc/subuid and /etc/subgid do not have an entry for root:1000:2

@hallyn Confirmed that the problem I ran into was an overlap issue. I'm so used to my usual 100000+65536 range that I didn't even think about my userid already being part of the mapping (which is a problem for me, so I'll change the lxd range on my machines to avoid that).

Once I resolved the overlap problem, a container with a profile including lxc.id_map in raw.lxc started succesfuly and with the right map. So looks like there's no lxd bug after all.

Un-miletoning, tagging and assigning as there doesn't appear to be anything wrong with LXD.

Not a bug in lxd, but clearly we'll need to make some of this easier!  Just not sure where/how yet.

So, it is still impossible to modify files mounted from host system?

No. You can setup the bind-mount and if the bind-mounted directory is world writable or writable to a uid which exists in the container, you'll be able to write to it.
Alternatively, mapping the needed uids using lxc.id_map works too.

So, is it possible by default, for unprivileged container, map current user from host to root inside guest?

LXD runs as root, so for it "current user" would be uid 0, which would be a really really bad idea, so no.

LXD runs as root, so for it "current user" would be uid 0, which would be
a really really bad idea, so no.

But I execute lxc utility without sudo. It can forward my uid to LXD.

So the uid map would change based on what user used the lxc command tool? That seems rather confusing and also would be very weird when dealing with remote LXD hosts where your uid may well be owned by somebody else.

I am not sure how it is supposed to work then. My thought was that for unprivileged container user chooses a folder he wants to share from local machine. How that will work if the container is accessed from remote? Does LXC allow remote folder sharing, what happens if connection drops? I think that needs some sort of specification, because there are two use cases with remote shares:

Free for all storage attached to container for container
User specific storage that each user should provide itself

My vision is that 2 should work by default, and advanced users should bother with remote shares type 1 configuration explicitly.

LXD can only setup bind-mounts. Those must be setup ahead of times, as in, we can't create new ones or change them after the container is started.
LXD itself runs as root and has no knowledge of what's the uid/gid of the calling user, nor could it even get that when receiving a connection from a remote machine.
As such, all we can do with bind-mounts is have them be absolute paths which must exists at the time the container is started and cannot change based on who's execing stuff into the container.
Altering a uid/gid map at runtime also isn't possible. To do so, we'd need to stop the container, possibly re-map all the uid/gid on the filesystem (so touching all files) and then starting it all over again with the new map.
(The rewriting step is required in the event that your own user's uid is in the middle of the mapped range in the container).

Useful info. Is it going to be documented in some place that explains how to share directories with containers?
http://interactive.blockdiag.com/?compression=deflate&src=eJxLyslPzk7JTExXqOZSUAjOSCxKVdC1U_CJcAFRSk6ZeSkKvvmleSVK1kB5qLCfWzASLzjYA8SvBQAwMRQL


Error while executing imported notebooks

Is the issue already present in https://github.com/cloudera/hue/issues or discussed in the forum https://discourse.gethue.com?
No, it is not.
But the issue to Cloudera Support is already created with a lot of details inside - Case 674401.
Describe the bug:
Migration of notebooks from one Hue instance to another Hue was performed with the help of functionality "Export" and "Import" on the "Documents" page. But after notebooks from one hue are imported to another one, none of the queries inside of notebooks works.
Error is displayed when trying to execute some query (in my case specifically Hive and Impala snippets were checked) inside of the imported notebook:

{ "message": "Document 672652 does not exist", "traceback": [ " File "/usr/share/hue/desktop/libs/notebook/src/notebook/decorators.py", line 79, in wrapper\n document = Document2.objects.get(id=notebook_id)\n", " File "/usr/share/hue/build/env/local/lib/python2.7/site-packages/Django-1.11.29-py2.7.egg/django/db/models/manager.py", line 85, in manager_method\n return getattr(self.get_queryset(), name)(*args, **kwargs)\n", " File "/usr/share/hue/build/env/local/lib/python2.7/site-packages/Django-1.11.29-py2.7.egg/django/db/models/query.py", line 380, in get\n self.model._meta.object_name\n" ], "detail": null, "is_embeddable": false, "title": "Error" }

Steps to reproduce it?

Deploy two separate hue instances connected to the different backend databases
Login to 1st hue instances and create notebook with some code inside
Export this notebook to json file using button "Export"
Login to 2nd hue instance and import the notebook from json file using button "Import"
Try to execute code inside of the imported notebook

Hue version or source? (e.g. open source 4.5, CDH 5.16, CDP 1.0...). System info (e.g. OS, Browser...).
The issue was seen in CDH 5.11.2, CDH 5.16.2 and is still the case for open source 4.7.
System info - OS: Windows 10; Browsers: Firefox and Chrome.

FYI cloudera support answered the following regarding this issue:

I confirmed with engineering team, unfortunately we would no longer support notebook in HUE so there would be no fix plan regarding this issue...

After I asked for specifics in regards to future plans around notebooks the below information was provided:

The notebook feature may no longer supported and maintained for the future HUE release.
There may no substitution available for the notebook...

Eventually workaround to overcome this bug worked for my team:
To overcome the error “Document does not exist”

it is required to save notebook (the same approach for all the notebooks if you have imported multiple). It should be done by hitting button “Save as”.

There is no need to change anything in the Name or Description, just hit “Save”. After that queries inside the notebook work without issues.


Reusing VM instance names: RESOURCE_ALREADY_EXISTS

There seems to be an issue with the VM instances when recycling the names. In the below example I create, delete and create again an instance using the same name. The error is shown in the output snippet below.
var BUILDER_MACHINE_NAME = "image2";
var BUILDER_MACHINE_CONFIG = {
    os: "ubuntu",
    machineType: "g1-small"
};

var gce = gcloud.compute();
var zone = gce.zone(zone);

zone.createVM(BUILDER_MACHINE_NAME, BUILDER_MACHINE_CONFIG, function(err, vm, operation, apiResponse) {

    if (err) { return callback(err); }

    console.dir(apiResponse);
    console.log("1 --------------");

    operation.onComplete(function(err, metadata) {

        if (err) { return callback(err); }

        console.dir(metadata);
        console.log("2 --------------");

        vm.delete(function(err, operation, apiResponse) {

            if (err) { return callback(err); }

            console.dir(apiResponse);
            console.log("3 --------------");

            operation.onComplete(function(err, metadata) {

                if (err) { return callback(err); }

                console.dir(metadata);
                console.log("4 --------------");

                zone.createVM(BUILDER_MACHINE_NAME, BUILDER_MACHINE_CONFIG, function(err, vm, operation, apiResponse) {

                    if (err) { return callback(err); }

                    console.dir(apiResponse);
                    console.log("5 --------------");

                    operation.onComplete(function(err, metadata) {

                        if (err) { return callback(err); }

                        console.dir(metadata);
                    });
                });
            });
        });
    });
});

The operation after the 2nd createVM call will issue the error:
...
4 --------------
{ kind: 'compute#operation',
  id: '1947681473087096016',
  name: 'operation-1447083184520-5241d4f2c7b41-6718dbc3-790a19cf',
  zone: 'https://www.googleapis.com/compute/v1/projects/sigma-cairn-99810/zones/europe-west1-c',
  operationType: 'insert',
  targetLink: 'https://www.googleapis.com/compute/v1/projects/sigma-cairn-99810/zones/europe-west1-c/instances/image2',
  status: 'PENDING',
  user<EMAIL_ADDRESS>  progress: 0,
  insertTime: '2015-11-09T07:33:05.005-08:00',
  startTime: '2015-11-09T07:33:05.367-08:00',
  selfLink: 'https://www.googleapis.com/compute/v1/projects/sigma-cairn-99810/zones/europe-west1-c/operations/operation-1447083184520-5241d4f2c7b41-6718dbc3-790a19cf' }
5 --------------
{ errors:
   [ { code: 'RESOURCE_ALREADY_EXISTS',
       message: 'The resource \'projects/sigma-cairn-99810/zones/europe-west1-c/disks/image2\' already exists' } ] }

Can the VM instance names be reused? (Can you please point me to the documentation, if there is smth like this specified)
Thanks!

Found the issue! Our API allows you to provide the os config property, which we then turn into a full object the API call to create the VM actually wants:
{
  name: 'image2',
  machineType: 'zones/us-central1-a/machineTypes/g1-small',
  // ...
  disks: [
    {
      boot: true,
      initializeParams: {
        sourceImage: 'https://www.googleapis.com/compute/v1/projects/ubuntu-os-cloud/global/images/ubuntu-1504-vivid-v20150616a'
      }
    }
  ]
}

The problem is that a disk is automatically created for your VM. When you delete the VM, by default, it thinks you won't want the disk to be deleted as well. Here's what we need to do to change that:
  disks: [
    {
+     autoDelete: true,
      boot: true,

I'll put a PR that defaults autoDelete to true, but if you need this behavior now, you'll need to manually form the configuration object:
var gceImages = require('gce-images')

gceImages.getLatest('ubuntu', function (err, image) {
  if (err) // ...

  var cfg = {
    os: 'ubuntu',
    machineType: 'g1-small',
    disks: [
      {
        autoDelete: true,
        boot: true,
        initializeParams: {
          sourceImage: image.selfLink
        }
      }
    ]
  }

  zone.createVM('vm-name', cfg, function () {})
})

Good catch, by the way. I had quite a few lingering disks in my test project :)

Sorry, my last post had some bugs I just fixed. Refresh if you have already read it to get the latest.

I am trying it out now.

:stuck_out_tongue_winking_eye: :+1: :tada:
Same here with the disks. :)

Stumbling upon a new error when building the instances object:
{ [Error: Scopes are required for this request.] code: 'MISSING_SCOPE' }

I assume this has to do with the authentication. I am initialising gce-images with:
var gceImages = require("gce-images");
var images = gceImages({ keyFile:  "/Users/gabriel/Work/gcloud/keyfile.json"});

Sorry, try un- and re-installing gce-images (so that you get 0.2.1). Pushed a fix!

Ok, I am further. :smile:
Next one:
{ [ApiError: Invalid value for field 'resource.disks': ''.  At most one persistent disk can be marked as a boot device.]
  errors:
   [ { domain: 'global',
       reason: 'invalid',
       message: 'Invalid value for field \'resource.disks\': \'\'.  At most one persistent disk can be marked as a boot device.' } ],
  code: 400,
  message: 'Invalid value for field \'resource.disks\': \'\'.  At most one persistent disk can be marked as a boot device.',
  response: undefined }

I try to build the VM instance using this config:
var BUILDER_MACHINE_CONFIG = {
    os: "ubuntu",
    machineType: "g1-small",
    disks: [{
        autoDelete: true,
        boot: true,
        initializeParams: {
            sourceImage: sourceImage
        }
    }]
};

Thanks for being patient with me :) Remove the os from the BUILDER_MACHINE_CONFIG object.

Makes sense because the sourceImage URL has the info ...

Ok, we're flying! :rocket:
Thanks also for help. I'll bug you later. No worries! :stuck_out_tongue_closed_eyes:
You can close this issue is you don't have anything to track further.

Thanks again for catching this! I'll keep this open to make sure we don't forget to set autoDelete to true.


download, patch, and build gencumulativesky source

This is a multiplatform build helper that is part of setup.py, and uses distutils to download, patch, and build gencumsky from the source on any platform: windows, mac, and linux.

Hi @cdeline, @jalderman9, @tcapelle, @shirubana,
Although this is still a WIP, it is working - you can try it with either:
$ python setup.py bdist_wheel  # build a wheel with gencumulativesky.exe

or
$ python path/to/gencumsky/__init__.py build  # just download, patch, and build

to clean use
$ python path/to/gencumsky/__init__.py build  # just download, patch, and build

details:

alternative to #153 that also resolves #129
downloads the source from the link in the instructions, so no license is required
patches the source as needed

currently only patches the capitalization issue for climateFile.h

builds the source on the CI server when it is bundled into a wheel
multiplatform: works on

mac os x
windows
linux

allows users on linux and mac os x to build and install on their own using what ever toolchain they choose, EG: not just limited to GCC-3.7 or clang, etc.

IMO this is a sustainable solution that makes sure that the current binary is always built using the correct toolchain, and avoids any binary incompatibiltiies. It also uses transparent Python commands from distutils to build on any platform that Python natively supports.
Still to do:

[ ] diff the current version of DaySim and apply the patches necessary to make the older zipped source provide the -E option, not sure if this is doable or not
[ ] maybe make the location of the source and build output more flexible, and move the script to a script file parallel to setup.py
[ ] some testing of the binary and the build script?
[ ] discuss options with others regarding using distutils versus just more explicit subprocess.Popen?

There is a possible question about how to deploy this

if gencumsky is built by the CI, then that sorta makes the wheel platform specific, even though gencumsky is the only binary in there
linux can't deploy platform specific wheels, without using manylinux, manylinux2, etc.
currently the package is deployed as pure-python by the CI to pypi, which is convenient

It seems more advantageous to keep the package pure-python, and perhaps force the user to build gencumsky on first use? The windows binary doesn't have to be built, already part of package.

Another perhaps easier idea would be to split gencumsky off into a new repo, make it platform specific, and make it a requirement of bifacial_radiance - then bifirad could stay neutral, and folks on every platform can run it. Anyway, we can just shelve this until people start complaining. If there's no problem now, we can just close this.

@mikofski Attached is a patch that will update the old gencumulativesky sources from the zip file to the daysim version.
I agree that a separate repo is probably a good idea.
gencumulativesky_update.patch.gz

Thanks for the patch. Applying it using using python-patch is not so elegant, so I'm thinking that actually it would be better to apply the patch once and commit source to repo. This has the advantage of freezing it where we want it
Is there any reason it's not okay to redistribute this patched source code? IMO it should be okay, and it makes this script much simpler!

@mikofski I agree that it's ok to make the patched sources available.  The license explicitly states this.

Hi @cdeline , @shirubana , @jalderman9 , @tcapelle,
Okay, this is working, and builds wheels for linux, windows, and mac osx,
$ python setup.py bdist_wheel

but I'm not really sure what (if anything) you want to do with it now. Some questions, options:

do nothing, mac and linux users can grab the patch, apply it them selves, and run make, the windows binary is already available, although it was compile with debug flags so it's about 3x larger than it needs to be, the new binary is only 35-KB, while the old on is 1.1-MB
use it, get an azure pipeline going, and create windows wheels - what CI allows free mac wheels? Circle? AppVeyor? Travis.com?
move it to a new repository and deploy it as a separate package, require it in bifirad, but who will do this? NREL?
copy the source to the repo, since the license allows this, and we are including the license, rather than downloading and patching every build. This would freeze the build the way we
tweeks, changes, tests, etc. coveralls is upset that this adds code with not tests - another argument for moving gencumsky to its own repo/package.

Also what's the deal with falsecolor.exe is it used anywhere? It's a window binary, so it won't work for linux or mac. It's 3MB, is it necessary.

closed in favor of #182 - I will keep this in my personal bifirad repo


Voice > Receive an Inbound Call

See Gist: https://gist.github.com/adambutler/85bf06bb443ff3795195d500a6d55ce6

https://gist.github.com/judy2k/cc3c3bd2957f5b915b9d1df15ee9442c


Need a way to show all the scenarios under a particular feature if the scenarios fall under same feature name

Consider, I am having 2 feature files each having 1 scenario which have same feature name but as both are under different feature file hence in report it appears as 2 features but as I have the same feature name in both files, hence I want the report to show one feature only.
Is that possible by any way..request your input.

Hi @jaydeepqa
This report only translates the JSON files it gets provided to a HTML report. As long as they are reported as 2 different feature files in the JSON it will be handled as 2 different features. This means you need to handle this from within your framework.


Fix #200: File open dialog for conversion restricts filename extension

This is the same issue as microsoft/sarif-visualstudio-extension#104 that I fixed yesterday. The customer @LambdaScientist-1stEdge actually reported it here, in the VS Code extension.

@michaelcfanning is added to the review. #Closed

@rtaket is added to the review. #Closed

@cfaucon is added to the review. #Closed

@harleenkohli is added to the review. #Closed

Incorporated Larry's suggestion of "*.plist" for Fortify files also as part of the "merge".


add audio support

Add support for sending audio URL directives

Seems the new test is failing, equality issues with both json objects?.

crap, sorry - I completely forgot that I updated this and didn't re-run spec.  fixing


Added flutter app repository

Added Flutter Body Mass Index calculator app repository.

Hey @Jassi10000 Thankyou. is there something wrong? Because in Hacktoberfest dashboard it is showing me that "Exluded Project"

Hey @Jassi10000 Thankyou. is there something wrong? Because in Hacktoberfest dashboard it is showing me that "Exluded Project"

Can you post a screenshot of your issue here , so that I can better understand ur issue

Sure.

@viveeeeeek See if you are mentoring , then all the PRs to this repo will not be counted
coz this is a repo for resouces by mentors and not a code repo

Oh. Thanks, @Jassi10000. I didn't know about that. This is my first time managing a repository. Sorry If bothered you.

Oh. Thanks, @Jassi10000. I didn't know about that. This is my first time managing a repository. Sorry If bothered you.

Nevermind
we mentors are here to help you only


How do i setup this ui

how do i config this to my miningcore server
do you a manual for it (maybe a quick guide)

This repo is only for the Dallar mining core server. It is not intended to work for any mining core. But eventually, that might happen.


Intermittent Runtime Error: index out of range panics for certain queries

This is occurring in the latest master commit 9a17fbb:
I have been noticing some problems with a number of queries resulting in runtime error: index out of range messages.

I'm running a Grafana Server with carbonapi and carbonzipper.
carbonzipper is configured to connect to a carbonserver on a separate server (a go-carbon box sitting on the same network)

carbonapi daemon parameters:
carbonapi -z http://localhost:8000 -p 8080 -logdir /opt/carbonapi/log
         -cpus 3 -l 40 -cache memcache
         -mc graphite-production.wx5gjk.0001.euw1.cache.amazonaws.com

carbonzipper configuration:
{
  "Port": 8000,
  "TimeoutMs": 150000,
  "TimeoutMsAfterAllStarted": 300000,
  "ConcurrencyLimitPerServer": 0,
  "Backends": [
    "http://<IP_ADDRESS>:9001"
  ]
}

carbonserver daemon parameters:
carbonserver -p 9001 -w /mnt/data/whisper
    -maxexpand 100 -logdir /opt/carbonserver/log
    -maxprocs 10 -scanfreq 15m0s -vv

When I run queries for time periods like last 15 minutes, or last 30 minutes, or last 6 hours, things run fine.
When I expand my query out to last 7 days, that's when I start noticing this behavior.
I will get the following panic on certain queries in the carbonapi log file:
2017/02/20 21:48:17 panic during eval: format=json&from=-7d&maxDataPoints=100&target=groupByNode%28consolidateBy%28orp.%7Bprod%7D.%7Bap-northeast-1%2Cap-northeast-1b%2Ceu-west%2Ceu-west-1%2Cus-east%2Cus-east-1%7D.%7Bap%2Ccolumbus%2Cdcl%2Cdocrefpreview%2Cmcpcomm%2Cpdt%2Cuds%2Cunknown%2Cviper%2Cvp%2Cvp-dev%2Cvp-loc%2Cvp-tst%2Ccse%2Cvp-test%7D.%7Bunknown%2Clp%2Clp-redirect%2Cgp%2Cgp-browsercapture%2Cgp-personalizationcontrol%2Cgp-personalizationtest%2Cgp-redirect%2Cimage%2Clp-browsercapture%2Clp-prepress%2Cstudio%2Ccalgrid%2Cgp-fastpath%2Clp-animation%2Clp-directscene%2Clp-fastpath%2Clp-personalizationtest%2Clp-personalizationcontrol%2Canimation%2Cgp-redirffect%2Clp-directscene-redirect%2Cgp-directscene%7D.requests.total.count%2C+%27sum%27%29%2C+5%2C+%27sum%27%29&until=now: runtime error: index out of range
goroutine 2708930 [running]:
main.renderHandler.func2.1(0xc8230de300, 0x2e5)
        /home/ubuntu/carbonapi/main.go:415 +0xb0
panic(0xa35320, 0xc82000e050)
        /usr/lib/go-1.6/src/runtime/panic.go:443 +0x4e9
github.com/dgryski/carbonapi/expr.aggregateSeries(0xc82e729560, 0xc825576000, 0x1c1, 0x200, 0xc079a0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /home/ubuntu/gohome/src/github.com/dgryski/carbonapi/expr/expr.go:3660 +0x78d
github.com/dgryski/carbonapi/expr.EvalExpr(0xc82e729560, 0x58ab641f58a2299f, 0xc821fc5230, 0x0, 0x0, 0x0, 0x0, 0x0)
        /home/ubuntu/gohome/src/github.com/dgryski/carbonapi/expr/expr.go:2598 +0x2f4d
github.com/dgryski/carbonapi/expr.EvalExpr(0xc82350e240, 0x58ab641f58a2299f, 0xc82104b388, 0x0, 0x0, 0x0, 0x0, 0x0)
        /home/ubuntu/gohome/src/github.com/dgryski/carbonapi/expr/expr.go:1411 +0x21d0c
main.renderHandler.func2(0xc8230de300, 0x2e5, 0xc82350e240, 0x58ab641f58a2299f, 0xc82104b388, 0xc82104b1f8, 0xc82104af18, 0xc82104b180)
        /home/ubuntu/carbonapi/main.go:419 +0x8e
main.renderHandler(0x7f9e69c7bbc0, 0xc8229f3a40,

Retrying the query multiple times sometimes succeeds, but most times it fails and returns an empty list.
Another query I'm seeing this with is:
format=json&from=-7d&maxDataPoints=157&target=timeShift(sumSeries(consolidateBy(orp.{prod}.{ap-northeast-1,ap-northeast-1b,eu-west,eu-west-1,us-east,us-east-1}.hw.*.hostup,+'sum')),+'120s')&until=now

Here, the wildcard * actually expands out to 5000+ unique subfolders (server metrics for every server the service has or ever had running). At the 7 day and beyond mark, I can't get data for that query at all.
All whisper files in question have the following storage schema set on them:
10s:1d,1m:7d,1h:1y,1d:5y

I have another server running an old version of Graphite 0.9.12 where all my metrics are mirrored that is serving up these queries just fine, so I'm wondering where my configuration might be falling short.

My first suspicion is that carbonserver is returning series with mixed density, as your request is right on a rollup boundary. This would frequently break the logic in the internal aggregateSeries func which expects all series to be consistent length.
If you make it from=-8d does the problem persist?

@nnuss - I did suspect that it might be related to the aggregation boundary. If I do -8d it works consistently. Same if I do anything up to the aggregation window (like -6d or -5d), or if I keep going out further like -30d. It's really the -7d that is breaking it. Attempting at another rollup window (like -1y) also causes the problem.

That strongly suggests to me that carbonserver is racing with the whisper writes and/or time skew on the backend(s).
@Civil is there any go-carbon / carbonserver tuning to help here?
@birryree how far beyond -7d is required to get a consistent view?

-7d1s
-7d1min
longer?

We would like carbonapi to resolve this but it requires more meta information to be available during render: retention bands, aggregation function, and x-files factor for each series.

First of all, try to use go-carbon's carbonserver. It have support for that since 0.9.0 and it's also covered with some tests, so it will be easier to fix an error there (if it's not fixed there). Also you can do that not as a separate instance, but as part of your main go-carbon.

@nnuss If I modify the first query seen as part of the stacktrace log entry above and use from=-7d1s, it consistently returns results. Wrote a shell script to hit the API hundreds of times and every time a non-empty data list was returned. If I modify my script to use from=-7d, the results are back to either [] or non-empty again.
I checked the backend servers - every server involved runs ntpd and is synchronized to the same server pool. Checking their dates, they all report the same time.
@Civil I originally was trying to run go-carbon's carbonserver when I set this stack up, but could never get it running - netstat didn't show anything listening on the port I configured it to run on. I don't see anything in the logs, even with debug logging.
I'm running the latest 0.9.0 release via .deb package - my configuration for go-carbon follows:
[common]
user = "carbon"
logfile = "/var/log/go-carbon/go-carbon.log"
log-level = "debug"
graph-prefix = "carbon.agents.eu-west-1.graphite-a"
metric-endpoint = "tcp://carbonrelay.internal:2003"
max-cpu = 3
metric-interval = "1m0s"

[whisper]
data-dir = "/mnt/data/whisper/"
schemas-file = "/etc/go-carbon/storage-schemas.conf"
aggregation-file = "/etc/go-carbon/storage-aggregation.conf"
workers = 8
max-updates-per-second = 0
sparse-create = false
enabled = true

[cache]
max-size = 1000000
write-strategy = "max"

[udp]
listen = ":2003"
enabled = true
log-incomplete = false
buffer-size = 0

[tcp]
listen = ":2003"
enabled = true
buffer-size = 0

[pickle]
listen = ":2004"
max-message-size = 67108864
enabled = true
buffer-size = 0

[carbonlink]
listen = "<IP_ADDRESS>:7002"
enabled = true
read-timeout = "30s"

[carbonserver]
listen = "<IP_ADDRESS>:8080"
enabled = true
buckets = 10
max-globs = 1000
metrics-as-counters = false
read-timeout = "5m0s"
write-timeout = "5m0s"
scan-frequency = "10m0s"

[dump]
enabled = false
path = ""
restore-per-second = 0

[pprof]
listen = "localhost:7007"
enabled = false

Interesting. Actually if carbonserver support is enabled, it should print at least "[carbonserver] carbonserver support is still experimental, use at your own risk" in the logs. If it's not - maybe there are some problems with your deb package and what you've got is not 0.9. Also might be worth to test is to just build it manually and see if carbonserver module will work then.

@Civil As it turns out, when I execute sudo service go-carbon stop or sudo service go-carbon restart, it wasn't actually stopping/restarting the go-carbon daemon, so it was never re-reading my configuration and starting the go-carbon server. I had to do a manual kill and bring the service back for it to recognize my configuration changes and start the carbonserver.
I'm running the current go-carbon off the head of master, and I've seen a slight improvement in some queries. I can do this hardware scan now of thousands of whisper files:
format=json&from=-7d&maxDataPoints=157&target=timeShift(sumSeries(consolidateBy(orp.{prod}.{ap-northeast-1,ap-northeast-1b,eu-west,eu-west-1,us-east,us-east-1}.hw.*.hostup,+'sum')),+'120s')&until=now

However, I'm still running into the issue with queries against aggregation boundaries sometimes returning [].

I just spun this up to test it to based off the 0.9.0 go-carbon and latest mater of zipper/api today. sumSeries seems to break. Ive attached the the debug output from carbonzipper and the debug line from carbonserver1 im not sure how to interpret this.
brokencarbonapiquery.txt
These queries are for 3hours and the data most likely has gaps in the data due to some UDP loss. I wonder if its the nulls causing the issue? The best feature in the world "keeplastvalue" does not seem to solve the issue as normal with graphite!

Well that's interesting i just realized one of the files has an old aggregator setting (as shown in the debug logs above). Legacy graphite handles this just fine. However it looks like if the aggregations between 2 retrieved points don't match the problem occurs in carbonapi. I went in and whisper-resized the collectd tree, now carbonapi seems consistent now for me. But it doesn't explain the other issues listed here unless in some cases carbonserver is not sending the same amount of datapoints?


v10 Compatibility

In GitLab by @Asacolips on Jul 16, 2022, 16:55
Acceptance Criteria

[x] Replace calls to data.data with system
[x] Replace calls to object.data with object
[x] Replace calls to data.update with updateSource()
[x] Update macro creation logic for the new dropData format

/cc @Asacolips

In GitLab by @Asacolips on Jul 17, 2022, 18:33
marked the checklist item Update macro creation logic for the new dropData format as completed

In GitLab by @Asacolips on Jul 17, 2022, 18:33
marked the checklist item Replace calls to object.data with object as completed

In GitLab by @Asacolips on Jul 17, 2022, 18:33
marked the checklist item Replace calls to data.update with updateSource() as completed

In GitLab by @Asacolips on Jul 17, 2022, 18:54
Included in 0.6.0

In GitLab by @Asacolips on Jul 17, 2022, 18:33
marked the checklist item Replace calls to data.data with system as completed


Add CI job to validate localized strings files

This ensures we don't forget to update a strings file when adding new descriptions.

Does this confirm that for every localized string defined in a swift file there is a matching key in a strings file?

Yep, exactly! And also that there aren't duplicate keys.


Use Volume within Patterns

The patterns have a volume level associated with them, and it is also already being passed accross the channel throughout the tracker.
We should use this to actually adjust the output volume of the note.

Closing in favor of #50


Where are the data saved?

Where are the data saved?

Hey @biapar,
If you're using the default storage (read: if you haven't explicitly changed it), the data is stored in Lucene indexes per Umbraco node in ~/App_Data/FormEditor/[node ID].
Check the docs for more info ´.

Closing this now... @biapar feel free to reopen if you have any further questions.

Why Do you save the data into Lucene indexes?

@biapar because they support a wide range of advanced features that are hard to replicate with SQL - statistics among other things.
However, as you can read in the documentation you can swap the storage index, and there are samples available for storage indexes based on SQL and Elastic.


YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy (#6…

…455)

Description of PR
Backporting YARN-11639 from trunk to branch-3.3.
How was this patch tested?
Run the unit test for the class.
For code changes:

[ x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
6m 17s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ branch-3.3 Compile Tests _

+1 :green_heart:
mvninstall
47m 42s

branch-3.3 passed

+1 :green_heart:
compile
0m 56s

branch-3.3 passed

+1 :green_heart:
checkstyle
0m 42s

branch-3.3 passed

+1 :green_heart:
mvnsite
1m  0s

branch-3.3 passed

+1 :green_heart:
javadoc
0m 46s

branch-3.3 passed

+1 :green_heart:
spotbugs
1m 59s

branch-3.3 passed

+1 :green_heart:
shadedclient
35m 51s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 54s

the patch passed

+1 :green_heart:
compile
0m 49s

the patch passed

+1 :green_heart:
javac
0m 49s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 31s

the patch passed

+1 :green_heart:
mvnsite
0m 52s

the patch passed

+1 :green_heart:
javadoc
0m 33s

the patch passed

+1 :green_heart:
spotbugs
1m 56s

the patch passed

+1 :green_heart:
shadedclient
35m 15s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
91m 41s

hadoop-yarn-server-resourcemanager in the patch passed.

+1 :green_heart:
asflicense
0m 35s

The patch does not generate ASF License warnings.

230m 13s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6493/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6493

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 10a5ee62e366 5.15.0-88-generic #98-Ubuntu SMP Mon Oct 2 15:18:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
branch-3.3 / bcfd17d92ce282e5a28c7595a32ea36e2f4864b0

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~18.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6493/1/testReport/

Max. process+thread count
969 (vs. ulimit of 5500)

modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6493/1/console

versions
git=2.17.1 maven=3.6.0 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Provide settings to configure status bar

Issue Type: Feature Request
It's possible to right click the status bar to enable and disable things that are displayed there. However, I have to manually configure this on each machine. Unlike other display elements such as debug.toolBarLocation, editor.codeLens, explorer.openEditors.visible, workbench.activityBar.visible, and others there are no settings to control the status bar.
I'd like to be able to disable elements within the status bar via my settings.json.

VS Code version: Code 1.47.0 (d5e9aa0227e057a60c82568bf31c04730dc15dcd, 2020-07-09T08:02:06.629Z)
OS version: Windows_NT x64 10.0.19041

You will not need to configure this per machine once settings sync is enabled which we ship next milestone to stable.


Update Multiple Unique Rows in Single Query

I'd like to do the following, via knex, against a PostgreSQL DB:
update test as t set
    column_a = c.column_a
from (values
    ('123', 1),
    ('345', 2)
) as c(column_b, column_a)
where c.column_b = t.column_b;

My values will come from an array, of indeterminate size. Apart from string building the query (in a loop), and using knex.raw, is there anything knex can do to lend a hand?

@58bits @bendrucker I'm trying to do something similar, but don't understand how to build the values statement.
Here is what I have -
let string = knex
        .into('test t')
        .update('auth, c.auth')
        .values('(1, 1, false), (2, 1, false)')
        .where(knex.raw('c.id1 = t.id1 AND c.id2 = t.id2'))
        .toString()

        knex.raw(string)

Here is an sql fiddle of query I'm trying to recreate : http://sqlfiddle.com/#!17/62529/8
Hope you could help point me in the right direction?
Cheers


hyper download multiple files concurrently

Hello, here a rust newbie question, I got this example to work well, but I would like to pipe the response to files, and I found I don't know how to get filename (http request uri path) because they have been moved and also I cannot get path or url information from hyper::Response
Sorry again for posting this question here because it's quite urgent to finish it

    pub fn download_with_suffixs(&self, suffixs: &[&str]) -> std::io::Result<()> {
        let uris = self.build_tile_urls_from_suffixs(suffixs);
        let uris_clone = uris.clone();
        println!("{:#?}", uris);

        let https = HttpsConnector::new(4).expect("TLS initialization failed");
        let client = Client::builder()
            .build::<_, hyper::Body>(https);

        let work = stream::iter_ok(uris)
            .map(move |uri| client.get(uri))
            .buffer_unordered(N_PARALLEL)
            .and_then(|res| {
                res.into_body()
                    .concat2()
                    .map_err(|e| panic!("Error collecting body: {}", e))
            })
            .for_each(move |body| {
                println!("{:#?}", uris_clone);
                io::stdout()
                    .write_all(&body)
                    .map_err(|e| panic!("Error writing: {}", e))
            })
            .map_err(|e| panic!("Error making request: {}", e));

        tokio::run(work);

        Ok(())

In my example suffix is the filename, does future stream guarantee the order of request, I mean do I need to counter and use things like suffixs[i] to access it.
Sorry I'm very new to rust... Thanks in advance!

You could map a clone of the Uri on the response future, like this:
client
    .get(uri.clone())
    .map(|res| (res, uri))

And then you can access the tuple in your later and_then:
.and_then(|(res, uri)| {
    // ...
})


Optimizations method weighted

This pull request highlights changes that can improve the performance of the code. The first change involves iterating over sparse matrices using indexes instead of iterators, which allows for better compiler optimizations and is generally more suited for structures with a known size, such as vectors.
The second change introduces OpenMP parallelization for certain independent sections of the code, such as the treatment of rows, to further improve performance.
These changes are applied only to specific parts of the code relevant to our current interests. However, we understand that if these changes are accepted, a major refactor would be required to standardize their usage across all parts of the code that rely on this iterator structure. Such a refactor would represent a long-term development effort.
We also acknowledge that the iterator structure may have a specific purpose and might not be replaced. Our goal is to showcase the observed improvements on MN5 and explain how we achieved them.
We applied this changes to the ForceMissing calculation (section 3) and the MissingValueTreatment in this case MissingIfHeaviestMissing (section 9)
This first table contains the average burst time of the MIR Method weighted sections of different servers during an output step of Tco1279-eORCA12 simulations with the DE340 output plans focusing only on the ocean servers, so only eORCA12 data with missing values is showcased.
This is the base case.

Using indexes instead of iterators

Using indexes and 16 OMP threads

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Carlos seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Polyfills needed for webpack 5

If I understand correctly, this package is meant to support browser & node, but it required node packages like crypto, stream, ... and with webpack it fails to build.
Is it necessary to use polyfills?

Yes I'm receiving this error whenever I try to load my app in the browser:
ERROR in<EMAIL_ADDRESS>9:17-34
Module not found: Error: Can't resolve 'crypto' in '/my-project/node_modules/@toruslabs/eccrypto'

BREAKING CHANGE: webpack < 5 used to include polyfills for node.js core modules by default.
This is no longer the case. Verify if you need this module and configure a polyfill for it.

If you want to include a polyfill, you need to:
	- add a fallback 'resolve.fallback: { "crypto": require.resolve("crypto-browserify") }'
	- install 'crypto-browserify'
If you don't want to include a polyfill, you can use an empty module like this:
	resolve.fallback: { "crypto": false }

Yes you need to use a polyfill package - e.g. https://stackoverflow.com/a/65556946

See https://github.com/torusresearch/OpenLoginSdk/issues/89


npm install error

Describe the bug
❯ npm install
npm ERR! code E404
npm ERR! 404 Not Found - GET https://registry.npmjs.org/react-router-dom - Not found
npm ERR! 404
npm ERR! 404<EMAIL_ADDRESS>is not in this registry.
npm ERR! 404
npm ERR! 404 Note that you can also install from a
npm ERR! 404 tarball, folder, http url, or git url.
npm ERR! A complete log of this run can be found in: /home/.npm/_logs/2024-12-08T19_01_02_846Z-debug-0.log
Link to the Bolt URL that caused the error
https://bolt.new/~/sb1-kxkyxzma
Steps to reproduce
22:00:40 [vite] Pre-transform error: Failed to resolve import "zustand" from "src/store/errandStore.ts". Does the file exist?
22:00:40 [vite] Pre-transform error: Failed to resolve import "zustand" from "src/store/authStore.ts". Does the file exist?
22:00:40 [vite] Pre-transform error: Failed to resolve import "react-router-dom" from "src/components/layout/Layout.tsx". Does the file exist?
22:00:42 [vite] Pre-transform error: Failed to resolve import "react-router-dom" from "src/components/layout/Header.tsx". Does the file exist?
22:00:42 [vite] Pre-transform error: Failed to resolve import "react-router-dom" from "src/components/layout/Header.tsx". Does the file exist? (x2)
Expected behavior
app to run
Screen Recording / Screenshot

Platform
Browser name = Chrome
Full version = <IP_ADDRESS>
Major version = 131
navigator.appName = Netscape
navigator.userAgent = Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36
performance.memory = {
  "totalJSHeapSize": 75537889,
  "usedJSHeapSize": 70144013,
  "jsHeapSizeLimit":<PHONE_NUMBER>
}
Username = evansochuka
Chat ID = c1f8f564c3c3

Additional context
No response

https://status.npmjs.org/ maybe this?


Undo/redo history is lost in a method editor when scrolling when the coder is detached/attached

When scrolling in coder the edit history is lost when the coder is detached and reattached to the infinite element.
This happened after the fix for this issue: https://github.com/feenkcom/gtoolkit/issues/2710
We should consider adding another API method for when we create a coder that does not affect the history

When opened an editor has already three change events in its history. Ideally after opening, an editor should not have any edits in its history.


Create a Business Domain

Description
Proposing the creation of a Business domain. This domain will define the core business concepts, entities, relationships, and rules that our application architecture must adhere to. Establishing a well-defined business domain is crucial for ensuring that our architectural decisions align with the strategic goals and operational requirements of the organization. Additionally, what level of capabilities and actual business alignment, verbiage and descriptors are included.
Features
Domain Modeling: Identify and model the key business concepts and entities relevant to our architecture. This involves defining the attributes, relationships, and constraints for each entity within the domain. The domain model should be comprehensive and accurately reflect the real-world scenarios and business logic.
Schema Integration: Integrate the business domain into our existing architecture design and framework schema. This integration should ensure that all architectural components and configurations are consistent with the defined business domain, facilitating a cohesive and aligned system design.
Documentation and Guidelines: Create detailed documentation and guidelines for the business domain. This should include explanations of the business concepts, entities, and rules, as well as best practices for integrating and utilizing the domain within the architecture. Providing clear documentation will aid in onboarding new team members and ensuring consistent implementation across the organization.
Benefits
Developing a business domain for our architecture design and framework schema will provide a structured and aligned foundation for our application development. It will ensure that all architectural decisions are guided by the organization's business objectives and operational needs, enhancing the overall coherence and effectiveness of the system. Additionally, a well-defined business domain will improve communication and collaboration among team members by providing a common understanding of key concepts and entities. This approach will also facilitate scalability and maintainability by providing a clear and consistent framework for future development and expansion.
@fleureedwards - this aligns to the business discussion we had during the NYC CALM meeting earlier this year.

@dc-ms this sounds like the concept of flows? cc/ @rocketstack-matt

Agreed, will close in favour of https://github.com/finos/architecture-as-code/issues/426


Display in the standard cinnamon theme

Hello! I use centos 7 and cinnamon with the standard "minty-dark" theme. However, some of the labels are not visible or poorly visible, because they do not use the theme colors.

Hi @oblitsov ,
could you provide some screenshots that show the problem?
thanks in advance

Screenshots

Hello.
Same happening in Version <IP_ADDRESS>101032114 on Ubuntu:

Hello.
Same happening in Version <IP_ADDRESS>101032114 on Ubuntu:

Changing to dark theme solves the issue.
THanks
https://github.com/dbeaver/dbeaver/issues/5869

Changing to dark theme solves the issue.
THanks
https://github.com/dbeaver/dbeaver/issues/5869


Add build_prefix to azure postgresql

Description
For some reason Azure's Resource Group serves as a unique namespace for all resources except the PostgreSQL DBaaS instance.  This caused failures when multiple integration test pipelines were run concurrently due to naming collisions on the PostgreSQL instances.
This PR adds the build_prefix to the PostgreSQL instance name which prevents the naming collisions.
Signed-off-by: Christopher A. Snapp<EMAIL_ADDRESS>Issues Resolved
#2083
Check List

[ ] New functionality includes tests
[X] All buildkite tests pass
[ ] Full omnibus build and tests in buildkite pass
[ ] All commits have been signed-off for the Developer Certificate of Origin. See https://github.com/chef/chef/blob/master/CONTRIBUTING.md#developer-certification-of-origin-dco
[ ] PR title is a worthy inclusion in the CHANGELOG

https://buildkite.com/chef/chef-chef-server-master-integration-test/builds/255 and
https://buildkite.com/chef/chef-chef-server-master-integration-test/builds/256 kicked off in parallel to test this.


<EMAIL_ADDRESS>download via aria2 failed

Scoop Configuration

{
    "lastupdate":  "2022-05-28T09:04:35.4396172-04:00",
    "SCOOP_REPO":  "https://github.com/lukesampson/scoop",
    "SCOOP_BRANCH":  "master"
}

#8564


bulk_mode. 2. _execute_step. 3. Type checking.

I forgot bulk_mode in the schema because there were no example mapping files with it. Fixed now.

Renamed _load_mapping to _execute_step because _load_mapping always implied to me that it was loading the mapping file. This is subjective so tell me if you disagree.

I added stronger type checking which is how I found problem 1. Integration tests don't use bulk_mode but unit tests do

I deleted the test that checks what happens if a bulk_mode is set to a wrong value in mapping because the mapping parser should handle that now and it is hard to trigger with both pytest and typeguard working at the same time. In any case, the Salesforce API would give you an error pretty quickly if you found a way around all of this type checking...

@prescod the tests are failing because this imports from typing_extensions which is not in requirements


Add complex number support to linalg.cholesky

This PR

adds complex number support to linalg.cholesky, requiring that each complex-valued matrix be Hermitian.
replaces Unicode equations with TeX.
updates and adds an extended description

Thanks, @leofang! As this has now been approved and follows discussions originating in the original Cholesky PR(s) (see https://github.com/data-apis/array-api/pull/110, https://github.com/data-apis/array-api/pull/224#discussion_r679855262, and https://github.com/data-apis/array-api/pull/220), will merge...


Fix: map.compute_centroids fail for maps with no fragments

import siibra
mp = siibra.get_map('julich 3', 'mni152')
mp.compute_centroids()

expected: computes the centroids using the volumes of the map.
actual: cannot fetch the mask
This PR fixes this issue

Codecov Report

Merging #486 (b5d64cd) into main (5a0e6b3) will increase coverage by 0.62%.
Report is 149 commits behind head on main.
The diff coverage is 27.07%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
@@            Coverage Diff             @@
##             main     #486      +/-   ##
==========================================
+ Coverage   36.81%   37.44%   +0.62%
==========================================
  Files          61       61
  Lines        5421     5651     +230
==========================================
+ Hits         1996     2116     +120
- Misses       3425     3535     +110

Files
Coverage Δ

siibra/configuration/configuration.py
42.35% <ø> (ø)

siibra/core/atlas.py
85.71% <ø> (+1.23%)
:arrow_up:

siibra/core/region.py
45.61% <100.00%> (+1.31%)
:arrow_up:

siibra/features/connectivity/__init__.py
83.33% <100.00%> (ø)

...ibra/features/connectivity/tracing_connectivity.py
75.00% <100.00%> (ø)

siibra/features/image/__init__.py
100.00% <100.00%> (ø)

siibra/features/tabular/layerwise_cell_density.py
37.20% <ø> (+0.25%)
:arrow_up:

siibra/locations/boundingbox.py
19.88% <ø> (ø)

...a/features/connectivity/functional_connectivity.py
55.55% <0.00%> (ø)

siibra/features/image/volume_of_interest.py
68.42% <66.66%> (-0.33%)
:arrow_down:

... and 29 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


minor changes in compose

@thebigbone Hey can you please provide a description for your PR?

Added following tags:
container_name: for naming the containers
read_only: set to true
restart: unless-stopped

why did you close it?


[Question] Should it be an IllegalStateException if the group coordinator fails?

https://github.com/streamnative/kop/blob/f357a6f1d209e3ea6416e00c354804dce003b044/kafka-impl/src/main/java/io/streamnative/pulsar/handlers/kop/KafkaProtocolHandler.java#L284
I ran into an issue where the group coordinator failed during a K8s deployment, leaving the broker in a bad state where producers worked but consumers did not. Deleting the pod manually and letting K8 restart the pod cleared the problem, but had the broker failed, the restart would have been automatic. Should KoP throw an IllegalStateException in this case? (This question probably applies to the transaction coordinator as well).
16:53:21.131 [main] ERROR io.streamnative.pulsar.handlers.kop.KafkaProtocolHandler - initGroupCoordinator failed with
org.apache.pulsar.client.admin.PulsarAdminException: java.util.concurrent.CompletionException: org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector$RetryException: Could not complete the operation. Number of retries has been exhausted. Failed reason: tcm-pulsar1-broker-1.tcm-pulsar1-broker.maas-dev-tibco-tcm.svc.cluster.local

Yeah, it should. Are you willing to contribute a PR?

You bet.


Various bugfixes + better magic link feedback

This PR:

Fixes a text "Dein einzigartigen Nutzername" to "Dein Nutzername"
Compares usernames for uniqueness regardless of their case to avoid problems in the URLs.
Adds better feedback for magic links including small illustrations.

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


got error for the new version luci-app-bypass in X86

Seems some related components error or missing. Is there a free way to install the last correct version?
Plz check the detail output when re-installing.
Installing luci-app-bypass (git-22.190.50904-8006ace) to root...
Downloading https://op.supes.top/packages/x86_64/kiddin9/luci-app-bypass_git-22.190.50904-8006ace_all.ipk
Configuring luci-app-bypass.
cfg203db7
Too many arguments
And the error log is:
2022-07-15 16:35:14 SSR server: Shadowsocks Server1 Started!
2022-07-15 16:35:14 Socks5 Node: Can't find VMESS program, start failed!
2022-07-15 16:35:14 Main Node: Can't find VMESS program, start failed!

Reedit node or update nodes subscription.

U r right, thanks


Bug? Chording and macro bindings

When trying to bind a macro to a chording, the macro is executed multiple times. For example, l+semicolon = macro(compose s s) results in ßßß. Replacing macro by macro2 with zero timeout and repeat timeout results in no activation at all (output l;) but binding to overload(control, macro(compose s s)) results in flawless execution of the macro.

I believe this should be fixed in the latest commit.


g_value_set_enum no implicit conversion of true into Integer in Vips::Image.thumbnail

Trying to use vips to make thumbnails (the goal is [width, height].min=100 keeping aspect ratio and then crop to 100x100). But got this error:
src = "src_src/daily/qwe_qwe123_1280.jpg"
dst = "website/preview/2010-9-7.jpg"
Vips::Image.thumbnail(src, 100, height: 100, crop: true).write_to_file dst

/Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/gvalue.rb:155:in `g_value_set_enum': no implicit conversion of true into Integer (TypeError)
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/gvalue.rb:155:in `set'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/object.rb:258:in `set'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/operation.rb:249:in `set'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/operation.rb:398:in `block in call'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/operation.rb:388:in `each'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/operation.rb:388:in `call'
	from /Users/nakilon/.rbenv/versions/2.3.8/lib/ruby/gems/2.3.0/gems/ruby-vips-2.0.17/lib/vips/image.rb:216:in `method_missing'

Oh I'm stupid. It's my true. Didn't read the crop docs. You can delete this.


Config flow could not be loaded: 500 Internal Server Error Server got itself in trouble

When trying to configure a room named "Upstairs" I get the following error. All other rooms work fine. I have tried deleting the Upstairs integration and letting it rebuild it, and reinstalling the entire component, but the issue with this room is still there.

home-assistant.log

Hi! Which version are you on? I checked the log but couldn't find anything screaming at me there.

Hi is this still an issue?

This is because you have a group in an area and Home Assistant replaces the entity_id attribute with a list with the members' entity ids.
This is fixed in the develop branch and shall be going out on the release tomorrow.

Fixed on 3.0. If the issue persists, please reopen!


How to run mxnet python on GPU?

Hi ,
How to run mxnet python on GPU ?
The code running on the cpu

Hi, here is the toturials. https://beta.mxnet.io/guide/crash-course/6-use_gpus.html
Just set the context to GPU instead of CPU.

I put gpu(0) on :
def load_mxnet_model(weight_path):
ssd = SSD()
ssd.load_parameters(weight_path , cox = gpu(0))
return ssd
İt gives :
RuntimeError: Parameter 'conv2d_0weight' was not initialized on context cpu(0). It was only initiali|
zed on [gpu(0)].                                                                                |
ERROR.
Where should I put the CTX = GPU(0) . Not so familiar to the gluon
PS: are you planning to port c++ ? We would love to use it in our hospital entrance

On 6 Apr 2020, at 08:27, AIZOOTech<EMAIL_ADDRESS>wrote:
Hi, here is the toturials. https://beta.mxnet.io/guide/crash-course/6-use_gpus.html https://beta.mxnet.io/guide/crash-course/6-use_gpus.html
Just set the context to GPU instead of CPU.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/AIZOOTech/FaceMaskDetection/issues/26#issuecomment-609572629, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEFRZHYSJO7UTAKBB63ONIDRLFR4FANCNFSM4L7LAYZQ.

Found..
extra need to add default ctx to gpu
Best

@MyraBaba how did you  solve RuntimeError: Parameter 'conv2d_0bias' was not initialized on context cpu(0). It was only initialized on [gpu(0)].  error

need to set defult ctx in mxnet. It was my other GPU laptop. When I on it let you know.

@MyraBaba any update sorry to bother you. How did you add  extra default ctx to gpu.

@MyraBaba  i have the same issue , please need your help

Guys, I figured! Two changes need to be applied:
In 'mxnet_loader.py', edit the function 'load_mxnet_model' to be like this:
`def load_mxnet_model(weight_path, ctx=mx.gpu(0)):
ssd = SSD()
# ssd.initialize(ctx=ctx)
# ssd.collect_params().initialize(force_reinit=True, ctx=mx.gpu())
ssd.load_parameters(weight_path, ctx=ctx)
ssd.collect_params().reset_ctx(ctx)
return ssd`

And in the same .py file, edit another function 'mxnet_inference' to be like:
def mxnet_inference(model, img_arr, ctx=mx.gpu(0)):     # y_scores, y_bboxes = model(nd.array(img_arr), ctx=ctx)     y_scores, y_bboxes = model.forward(nd.array(img_arr).as_in_context(ctx))     return y_bboxes.asnumpy(), y_scores.asnumpy()
This should solve your problem.


WIP: Logic to send out the 'target.drain' event to haproxy

This is a WIP PR for the haproxy drain feature

The validation test failures (assert svc["drain_timeout_ms"] == 15000) will go away once the rancher_compose_executor PR is merged and version of compose is bumped up.
https://github.com/rancher/rancher-compose-executor/pull/126

LGTM


Update m-lab/go for updates to flagx.KeyValue

This change updates the version of m-lab/go used by the ndt-server. This version update brings in recent changes to https://github.com/m-lab/go/pull/142 read -label values from a file. This will enable us to read environment metadata directly from the command line. https://github.com/m-lab/k8s-support/pull/649

This change is

Pull Request Test Coverage Report for Build 1545

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.3%) to 81.675%

Totals

Change from base Build 1542:
0.3%

Covered Lines:
1765

Relevant Lines:
2161

💛  - Coveralls


[BUG][Azure.Identity] ManagedIdentityClient cache issue

Describe the bug
Each ManagedIdentityClient object caches a ManagedIdentitySource instance, when initialized ImdsManagedIdentitySource try to probe the imds endpoint.
We uses pod identity to work with Managed Identity. We found sometimes ImdsManagedIdentitySource failed to probe imds endpoint due to temporary network issue.
When this happen, ManagedIdentityClient caches a default null ManagedIdentitySource, and all following token requests will get CredentialUnavailableException.
Is it ok to only cache good ManagedIdentitySource instance in ManagedIdentityClient? Then the retry code can work without the need to rebuild a new ManagedIdentityCredential.
Environment:

Name and version of the Library package used: Azure.Identity 1.4.0
Hosting platform or OS and .NET runtime version: .NET 5.0 in AKS Linux container

Thank you for your feedback.  Tagging and routing to the team members best able to assist.


Create an account on the Gateway Demo system: Step 7

Tutorial https://www.sap.com/developer/tutorials/gateway-demo-signup.html
Progressed to step 7: 'Enter the URL of the SAP Easy Access page below and click Validate'

I copied in the URL: https://sapes5.sapdevcenter.com/sap/bc/gui/sap/its/webgui
Clicked validate but get 'Invalid response. Please try again'

What is the correct URL to paste to validate and complete the tutorial?
I've successfully logged into the SAP Gateway Web GUI ES5 and url displayed is https://sapes5.sapdevcenter.com/sap/bc/gui/sap/its/webgui

The URL can be shortened to:  https://sapes5.sapdevcenter.com (and will redirect).
To answer the bug, however, this was an issue with the server, which is now resolved.  I just checked, and the link works fine.  Let me know if you have any further issues!


Adding token hash to the payload

Purpose

Adding token hash in the payload in default reporter
Fixed https://github.com/wso2-enterprise/choreo/issues/7252

Codecov Report

Merging #61 (8761ae0) into main (e8767cc) will increase coverage by 0.42%.
The diff coverage is 45.45%.

@@             Coverage Diff              @@
##               main      #61      +/-   ##
============================================
+ Coverage     45.59%   46.02%   +0.42%
- Complexity      105      107       +2
============================================
  Files            35       35
  Lines           693      704      +11
  Branches         69       69
============================================
+ Hits            316      324       +8
- Misses          334      336       +2
- Partials         43       44       +1

Flag
Coverage Δ

unit_tests
46.02% <45.45%> (+0.42%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

.../am/analytics/publisher/client/EventHubClient.java
28.12% <45.45%> (+1.27%)
:arrow_up:

...analytics/publisher/reporter/cloud/EventQueue.java
58.62% <0.00%> (+10.34%)
:arrow_up:


[CARBONDATA-583] Add replace function support for spark 1.6 and 2

Add replace function support with Spark 1.6 and 2.0
Manually test that replace function is working
Add replace function example for spark 1.6 and 2.0
Run all unit test cases

Can one of the admins verify this patch?

Can you check regexp_replace spark function? This function replace all substrings of the specified string that matches the pattern

@nareshpr yes regexp_replace function already available in org.apache.spark.sql.functions package so if we want to use that in place of replace then we document it somewhere, Most of time user try replace directly as other database.

@phalodi  It is not good to add regular udf in carbon module unless carbondata wants it for some other features. What ever the functions available in spark we support the same and user can use the same functions. Carbondata does not require to document about Spark functions, user can refer the documentation of Spark for the same.

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Build Success with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/634/

SDV Build Fail , Please check CI http://<IP_ADDRESS>:8080/job/ApacheSDVTests/1265/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder/3100/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder/4019/

Build Failed  with Spark 2.1.0, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder1/7166/

Build Failed with Spark 2.2.1, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder/5942/


Side doc appear as collapsed instead of opened in IE

Under IE, when we open the help, the side doc appear as collapsed.
Expected :

In IE, go to makecode.microbit.org
Go to the help menu, click on Reference
The side doc opens with the Reference page.

Current situation :

In IE, go to makecode.microbit.org
Go to the help menu, click on Reference
The side doc appear as collapsed, so we don't see the documentation first. We have to click on the Expand button.

This has historically been by design. IE and mobile are considered as in "light mode", and in order to keep the page performant we open them up and keep it collapsed waiting for the user to indicate they want to open it.
It makes sense to keep it this way for the initial load, but not when the user opens a page from the help menu (as they have expressed interest in seeing the page at that point)

@veler feel free to fix.


WIP can derive default analysis

r? @fitzgen

:umbrella: The latest upstream changes (presumably #862) made this pull request unmergeable. Please resolve the merge conflicts.

@bors-servo r+

:clipboard: Looks like this PR is still in progress, ignoring approval

@bors-servo r+

:pushpin: Commit 0231a21 has been approved by fitzgen

:hourglass: Testing commit 0231a21a98f49064d6bb58734366fdd660ba69c7 with merge d1d35007c0e2d085ae8fa4f81573e2f45ec95643...

:sunny: Test successful - status-travis
Approved by: fitzgen
Pushing d1d35007c0e2d085ae8fa4f81573e2f45ec95643 to master...


#41: Sort layer names/indexes

Closes #41

define layer indexes from sorted layer names

Note to self: drink another coffee before first PR creation.
Not able/allowed to switch remote post creation, which is really annoying and I apologize for sometimes forgetting this.

Good timing, I was about to start working on this.


[RFE] Provide 2 default ResourceSet configs out of the box based on use-case

🚀 Feature Request
Background
Historically Rancher Backups (BRO) has opted to exclude sensitive data from backups by default as it's seen as a security risk. This in turn can lead to some less than stellar experience for customers using BRO from Backups or Migrations. Of particular concern are areas related to Fleet, Provisioning, and cluster config related credentials.
In the more recent era of BRO we've faced far too many support issues to continue with the philosophy of excluding sensitive data from Backups. As that ultimately leads to support cases during some extremely tense situations. To balance these concerns we've gradually shifted focus to push users to utilize the encryption features.
With the recent change on this feature we fully support the same Encryption options k8s does. This opens the door for us to adjust how we handle Secrets in our default ResourceSet and to take our efforts to suggest encrypting backups even further.
Is your feature request related to a problem? Please describe.
Yes, there are a number of open issues this is related to.
Put simply, this RFE will help address many issues that are related to BRO capturing or skipping various sensitive data (Secrets, etc). In the past BRO opted to intentionally not capture sensitive data to avoid potential risk of those secrets being accessible via the Backup file. Recent changes to BRO allow more complex encryption configs to be used which provides the opportunity for us to include and encrypt sensitive data in the backups.
Describe the solution you'd like
There are two overlapping concepts that this issue relates to within BRO, that is:

Ability to Encrypt BRO backups at rest, and
the rules in the default ResourceSet that BRO provides.

Using the functionality provided by the new Encryption features we can ship 2 default ResourceSet versions; one matching our existing one, and one that's meant to capture all the necessary secrets for Rancher to work. In our documentation and in our examples, we will need to compare and contrast the pros/cons of each; these mainly boil down to:

On the "Basic" ResourceSet, the backup files will not contain any sensitive or secrets data and not need encryption to be suggested/required to use. In this use-case the secrets necessary for the cluster which cannot/will-not be recreated should be backed up outside of BRO, or otherwise configured to deploy via CI/CD.
On the "Full" ResourceSet, the backup files will include any necessary secrets to fully restore Rancher to a working state. Any examples and documentation for this mode must also show usage of an EncryptionConfiguation.

Note: In setup docs, we should provide users with an example showing what resources we suggest they encrypt; however, we should exclude the keys from the example and instead direct users to create their own. (hopefully to prevent users from using any default/example keys given in docs)

In order to implement this without backwards compatability breaks, we actually will need to create both the above mentioned ResourceSets as new items. This way we can deprecate the old one without modifying or removing it in this release.
Once the two ResourceSet resources are being prepared we will need to do:

Adjust how the current ResourceSet is composed,
Add new ResourceSet items with a new names,
On the "Basic" set, we can start from the current one with Rules for secrets and such removed,
On the "Full" resource set we will need to collaborate with other teams (such as Fleet, Harvester, etc) to verify we capture all correct secrets; if not we will use the respective teams expertise to create new rules.
Release notes, to inform users that this change has happened and the deprecation.

Then in 2.10.2 (or later) we can follow up on this and change the UI default from the deprecated ResourceSet to use the new "Basic" one instead by default. Ensuring that users will have to fully opt-in to having the backups contain sensitive data that must be secured.
Describe alternatives you've considered
We have a method to capture secrets based on labels/annotations that may be helpful here. However, this alternative is unlikely to be a complete solution if implemented alone. It will likely be something we consider to implement in addition to these changes.
Additional context
Here are a list of Related issues that this solution could help address:

[!IMPORTANT]
A PR on this list is here purely because it's related to BRO/Secrets as a concept. If a PR is here it is not a guaruntee that it will be fixed by the PR to address this. Simply that the topics overlap and if possible we will improve or fix these issues along the way.

https://github.com/rancher/rancher/issues/46276 / SURE-8118
https://github.com/rancher/backup-restore-operator/issues/574
https://github.com/rancher/rancher/issues/44033
https://github.com/rancher/backup-restore-operator/issues/282
https://github.com/rancher/backup-restore-operator/issues/482
https://github.com/rancher/backup-restore-operator/issues/177
https://github.com/rancher/dashboard/issues/11211

https://github.com/rancher/rancher/issues/45812

Fleet related resources in general.

[!NOTE]
Some items linked above are long merged/solved PRs that are relevant context behind existing rules.

@jbiers - once you have a PR cooked up for this one we will have some support from R.Apetz (find in slack) who has a customer affected by https://github.com/rancher/backup-restore-operator/issues/574. So one we can produce an RC chart/image that includes your improvements they and their customer may be interested in testing it out.

The first PR in resolving this issue is ready for review: https://github.com/rancher/backup-restore-operator/pull/634. It introduces the two new resourceSets, basic and full, without removing the old standard one but treating it as deprecated. It will be removed completely in a later release.
Merging this PR will not close the issue. Here are the other necessary steps:

Update this documentation page to include a ResourceSet subsection detailing when users should choose full or basic. It will make clear that opting for full means backups will contain sensitive information and, as a best practice, should be encrypted. Also explain that when using basic the user is fully responsible for backing up their secrets. Include note about default resourceset deprecation. Also, add an example to this page.
Open issue to UI team to update the Backup creation screen (see current state below). Another section under the name of ResourceSets will be added, corresponding to the field spec.resourceSetName. This section will contain a dropdown menu with all available ResourceSets, and will currently default to rancher-resource-set. Along with the dropdown menu, we could add a warning text about using the rancher-resource-set-full with encryption.

Initiate conversations with other teams to map out all secrets needed for rancher to work correctly.
Open a follow-up issue with a milestone set to 2.12.0 for handling the complete removal of the old default resourceset.

@mallardduck and @alexandreLamarre once the holidays are over I'd appreciate some feedback on the initial PR as well as on the action plan detailed above 🤝


Install not working

after compiling a project with laravel
composer create-project mpociot/botman-laravel-starter botman
and startup laravel at port 8000
php artisan serve --port=8000
this is the message I found all the time
Sorry, the page you are looking for could not be found.
NotFoundHttpException in RouteCollection.php line 161
Please can you let me know how to fix it?

Which route are you trying to access?

<IP_ADDRESS>:8000

The only route accessible is /botman , as stated in the documentation.


[MSG] Inbox

Requirements

[ ] Zero state promoting how collecting on Artsy works
[ ] Message line items (including gallery name, artists name, work title, message blurb)
[ ] Thumbnail of inquired on artwork
[ ] Message time stamp
[ ] read/unread state

Landing page: 4 hours
Layout of message list: 4 hours
We can already fetch inquiries, as part of our loyalty program work.
But for read/unread state and excerpt of latest message we might need to add a connection to MP for Impulse’s conversations: 2 days

Total: 3 days

follow up with detail about how how list should be sorted

We need to make sure that we ask Impulse for messages that are not marked as spam (e.g. partner newsletters).

Read/unread might be more accurate if we used "opened on this app" v "not yet opened" given that impulse only knows that SOMEONE opened it (could be a gallery employee cced)

Issue moved to artsy/collector-experience #295 via ZenHub


Deflakify TestGatherTestInformation

Deflakes testGatherTestInformationOnlyOneErroring. Flakyness identified in https://github.com/eclipse/repairnator/issues/1176#issuecomment-809551348

Need to run this PR several times in CI to make sure it's fixed, as the problem only occurs in CI.

Ready

Thanks!


installation issues

Not sure where else to ask this other than maybe a chatroom, but I'll start here.
I have a Mycroft instance running on an OpenSuse server, I cloned this repository according to your directions and the HiveMind-core seems to be running correctly also.
My issue is connecting to the core from a satellite.  I have changed the credentials accordingly, but when I run either the Hive cli, or the Hive voice, I get the same error.
TypeError: init() got multiple values for argument 'crypto_key'
Any ideas?

How are you running the satellites? Have you filled out their config files, or are you passing credentials via the cli? (Just wanna figure out which way's bugged)

How are you running the satellites? Have you filled out their config files, or are you passing credentials via the cli? (Just wanna figure out which way's bugged)

try using the pip packages, i need to take some more care with github, but github is essentially always WIP and in between versions, so i might break things.... its safest to use pinned versions from pip
either way thanks for the heads up, i need to do a general cleanup of the packages and get them in sync, eg, some satellites depend on older versions of hivemind-core

try using the pip packages, i need to take some more care with github, but github is essentially always WIP and in between versions, so i might break things.... its safest to use pinned versions from pip
either way thanks for the heads up, i need to do a general cleanup of the packages and get them in sync, eg, some satellites depend on older versions of hivemind-core

I have tried changing the config files, and running the config from the cli.  I have tried the git repositories and the pip installations.  They both give the same error.
My test satellite is my laptop running manjaro

I have tried changing the config files, and running the config from the cli.  I have tried the git repositories and the pip installations.  They both give the same error.
My test satellite is my laptop running manjaro

I'm looking again at the instructions.  When adding keys, do I do a separate key for each device? Or do I change just the single entry and connect the satellites to that key and crypt?

I'm looking again at the instructions.  When adding keys, do I do a separate key for each device? Or do I change just the single entry and connect the satellites to that key and crypt?

It was mentioned in the chat that I may need to be using 16 characters for my access_key and crypto_key.  I tried that and ended with the same errors.
On my server:
(venv) jbrodie@ziggyhost:~/Mycroft/HiveMind-core> python examples/mycroft_master.py  2021-02-01 07:23:32.771 - OVOS - jarbas_hive_mind.master:start_announcing:176 - INFO - Registering zeroconf:HiveMind-websocket wss://<IP_ADDRESS>:5678 2021-02-01 07:23:32.784 - OVOS - jarbas_hive_mind.discovery.ssdp:register:108 - INFO - Registering upnp:HiveMind-websocket (http://<IP_ADDRESS>:8088/device.xml) 2021-02-01 07:23:32.794 - OVOS - jarbas_hive_mind:secure_listen:201 - INFO - HiveMind Listening: wss://<IP_ADDRESS>:5678 2021-02-01 07:25:33.286 - OVOS - jarbas_hive_mind.master:unregister_client:273 - INFO - deregistering client: tcp4:<IP_ADDRESS>:40318 2021-02-01 07:25:33.292 - OVOS - jarbas_hive_mind.master:connectionLost:116 - INFO - WebSocket connection lost: [Failure instance: Traceback: <class 'OpenSSL.SSL.Error'>: [('SSL routines', 'ssl3_get_record', 'http request')] /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/posixbase.py:614:_doReadOrWrite /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/tcp.py:243:doRead /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/tcp.py:249:_dataReceived /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/protocols/tls.py:315:dataReceived --- <exception caught here> --- /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/protocols/tls.py:235:_checkHandshakeStatus /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/pyOpenSSL-20.0.1-py3.7.egg/OpenSSL/SSL.py:1828:do_handshake /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/pyOpenSSL-20.0.1-py3.7.egg/OpenSSL/SSL.py:1566:_raise_ssl_error /home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/pyOpenSSL-20.0.1-py3.7.egg/OpenSSL/_util.py:57:exception_from_error_queue ] Unhandled Error Traceback (most recent call last):   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/jarbas_hive_mind-0.10.7-py3.7.egg/jarbas_hive_mind/__init__.py", line 222, in listen     return self.secure_listen(factory=factory, protocol=protocol)   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/jarbas_hive_mind-0.10.7-py3.7.egg/jarbas_hive_mind/__init__.py", line 203, in secure_listen     reactor.run()   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/base.py", line 1283, in run     self.mainLoop()   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/base.py", line 1292, in mainLoop     self.runUntilCurrent() --- <exception caught here> ---   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/Twisted-20.3.0-py3.7-linux-x86_64.egg/twisted/internet/base.py", line 913, in runUntilCurrent     call.func(*call.args, **call.kw)   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/txaio-20.12.1-py3.7.egg/txaio/_common.py", line 136, in _notify_bucket     notify_one_chunk(calls, self._chunk_size, max(0.0, delay_ms))   File "/home/jbrodie/Mycroft/HiveMind-core/venv/lib/python3.7/site-packages/txaio-20.12.1-py3.7.egg/txaio/_common.py", line 130, in notify_one_chunk     raise RuntimeError(msg) builtins.RuntimeError: Error(s) processing call_later bucket: 'NoneType' object has no attribute 'shutdown'
And my client:
HiveMind-cli --name ZiggyHiveMind --host <IP_ADDRESS> --access_key Ziggy_Home_Hive! --crypto_key Where_Am_I@_Now? 2021-02-01 07:25:33.218 - OVOS - jarbas_hive_mind:unsafe_connect:76 - INFO - Connecting to ws://<IP_ADDRESS>:5678 2021-02-01 07:25:33.218 - OVOS - jarbas_hive_mind:unsafe_connect:77 - WARNING - This listener is unsecured 2021-02-01 07:25:33.248 - OVOS - jarbas_hive_mind.slave.terminal:onClose:36 - WARNING - HiveMind websocket connection closed: connection was closed uncleanly (peer dropped the TCP connection without previous WebSocket closing handshake) 2021-02-01 07:25:33.249 - OVOS - jarbas_hive_mind.slave.terminal:onClose:50 - ERROR - ConnectionError 2021-02-01 07:25:33.250 - OVOS - jarbas_hive_mind.slave.terminal:clientConnectionLost:213 - ERROR - HiveMind connection lost: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionDone'>: Connection was closed cleanly. ] .. retrying .. 2021-02-01 07:25:33.250 - OVOS - jarbas_hive_mind.slave.terminal:clientConnectionLost:220 - ERROR - HiveMind connection lost: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionDone'>: Connection was closed cleanly. ]
Maybe you can scroll the error here easier.


Change the default --fix

Is it possible to change the default --fix in a way (default is 10) ?
  -f, --fix <FIX>     Number of decimal places in output (1 - 64) [default: 10]
I think eva does not use config files right where the user can change this.
Thanks :)

How would you propose this?


[BACKLOG-20780] Allow step logging from the streaming sources

Build Completed
:fire: This pull request has some issues. It would be preferable to fix them in order for it to be just perfect. See below for more details. Some links are also available below for further assistance in addressing those issues.
Build Commands
mvn -Dsurefire.runOrder=alphabetical -B -fn -f 'pom.xml' -pl 'engine' -P '!assemblies' -amd clean install && mvn -B -f 'pom.xml' -pl 'engine' -P '!assemblies' -amd site

Cleanup Commands
mvn -B -f 'pom.xml' -pl 'engine' -P '!assemblies' -amd build-helper:remove-project-artifact

Changed files
  engine/src/main/java/org/pentaho/di/trans/streaming/common/BlockingQueueStreamSource.java

Unit Test Coverage
These statistics help you identify how your changes have affected the coverage of the following files. If a file is not in this list, then its coverage was not affected by your changes. To get some help interpreting these metrics, please refer to Jacoco's documentation.

:warning: Coverage Changes: <0.1% (click to expand)
org.pentaho.di.trans.steps.dbproc.DBProcMeta

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.groupby.GroupByMeta

Branch Change: -2.1% :small_red_triangle_down:
Complexity Change: -2.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.ldapoutput.LDAPOutputMeta

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.processfiles.ProcessFilesMeta

Branch Change: -3.5% :small_red_triangle_down:
Complexity Change: -2.1% :small_red_triangle_down:
Instruction Change: -0.4% :small_red_triangle_down:

org.pentaho.di.trans.steps.setvalueconstant.SetValueConstantMeta

Instruction Change: -0.2% :small_red_triangle_down:

org.pentaho.di.trans.steps.singlethreader.SingleThreaderMeta

Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.trans.steps.webservices.WebServiceMeta

Branch Change: -1.7% :small_red_triangle_down:
Complexity Change: -1.2% :small_red_triangle_down:
Instruction Change: -0.1% :small_red_triangle_down:

org.pentaho.di.www.cache.CarteStatusCache

Instruction Change: -1.2% :small_red_triangle_down:
Line Change: -1.3% :small_red_triangle_down:

org.pentaho.di.trans.steps.gpload.GPLoadMeta

Branch Change: -0.9% :small_red_triangle_down:
Complexity Change: -0.8% :small_red_triangle_down:
Instruction Change: -0.2% :small_red_triangle_down:

@pentaho/ackbar


Neither Vagrant nor locally run Portia loads initial view when adding site

I tried both the Vagrant version as well as the locally run version in a virtualenv.
My problem is this: when I add a site, it doesn't load the initial preview in the frame.
Everything else is confirmed working:

I clicked on Test Spider while tcpdump'ing outgoing port 80 traffic. Requests are going out
running the spider manually with portiacrawl shows it's doing its work as expected

Any ideas what might be causing the preview in the frame to fail?
I'm using FF on Linux - should I try another browser/OS combo?

What does it say in your web console when you try to load the page?

It says 'No page loaded'..

Also, refresh button isn't enabled so I can't refresh...
tried it on slashdot.org
is the twisted port 9001 the only one needed? because I'm trying this over an ssh tunnel...

This is the same problem people had in #152. You just need to click the link in the start urls.
I've recognised that this is an issue and a fix has been pushed to the develop branch to auto load the page. https://github.com/scrapinghub/portia/commit/2c6b2ecb510253e641c28c22498c1f295e14cbec


(#1164) Type subreddit.py

Base: #1164

To anyone trying to code review this, read the final file as I had to move the classes in order to not create any more TypeVars

I'm not sure I understand why so many lines were modified. Can you clarify?

@jarhill0 I shifted all of the methods up from the bottom, so it looks as if every line was deleted and then recreated. This was to not create any more TypeVars

It appears that there is still a merge conflict here. Also, please rebase to avoid using merge commits.

I guess I should copy these over. Making new PR


Optimize proptools

Reduce primary builder times with two optimizations in proptools:

Cache results of reflect.Type.Field() to avoid the garbage produced in reflect.StructField.Index
Allow nil pointers to concrete struct types in properties to reduce allocating and copying empty structs

Also adds a -trace argument to the primary builder to allow tracing of concurrency.

LGTM


Feature request: Round corners + more

Hi. First of all thank you for this great tool! It really helps a lot.
I (and I think many other professional designers) are missing quick advanced tools like:

Round corners
Transform
Transitions

Also, It would be great to save snippets of CSS, to keep them right at your hand at any time (with possibility to sync between different PCs with same google account)
BR
grin-studio.com

Thanks for posting the feature requests @actualizator. I will keep em in mind. I am already tracking the ability to sync the styles elsewhere.


Added support for mamba up to 1.4.4

Checklist

[x] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

boa version stays the same.  Only rebuilt with support for mamba 1.4.4.

@conda-forge-admin, please rerender

I am sorry, I can't merge this because of a bug in mamba. I'll update the range once we've been able to test in the boa repository

Maybe we should convert this to draft so that others see this was tried already and there is a reason it is not merged

Thanks @wolfv and @jakirkham.  I was wondering if it was a bug with mamba specific to 1.4.4 and boa 0.15 together or is the bug present in previous versions of mamba?  I only ask because the range for mamba in boa 0.14 is >=1.0,<1.5.

Hello, any update on this ?
This PR is ultimately blocking https://github.com/conda-forge/miniforge/pull/462.
I struggle to find the details of the aforementioned issues related to mamba / boa. Could you please direct me to the issue(s) ?

this could be closed?


Enable eqeqeq on both configs for jshint

Currently we allow commits with == in.
@RabsRincon pulled me up on it in a PR. So lets enable http://jshint.com/docs/options/#eqeqeq to stop this.

Closed by #810


Correct use of pixel area map

Update the way that the pixel area map is used. Currently the final seed image is divided by the pixel area map, which is not correct for point sources.
Volk says that the PAM should be applied only to extended sources as well as zodi/backgrounds.

In progress, in proper-pam branch of my (bhilbert4) fork.
PAM use has been moved out of obs_generator.py and into catalog_seed_image.py. Currently it is used for all sources/backgrounds except tracked point sources. (It is applied to background point sources in the case of non-sidereal tracking.)
What about the static point sources? Does anything need to happen to them in order to account for pixel area map effects?

Pull request #72 created for the eventual merging of this code.

Fixed. PR #72.


HTTPS OTA (IDFGH-3220)

(https://docs.espressif.com/projects/esp-idf/en/latest
IDF branch master
Development Kit: ESP32-DevKitC
Module or chip used: ESP32-WROOM-32
Build System: Make
Compiler version (run xtensa-esp32-elf-gcc --version to find it):
Operating System: Windows
(Windows only) environment type: MSYS2 mingw32
Power Supply: USB

Error
No rule to make target '/home/varun/esp32/esp-idf/examples/Varun/https_request/server_certs/certs.pem', needed by 'embed_txt/certs.pem'.  Stop.
I am able to read soon file but I want to download .bin file.

@varunsavita You are specifying file name in CMakeLists.txt as ca_cert.pem but actual file name seems to be certs.pem?

@varunsavita Did you happen to solve this? Can we close the issue?


Attempting to fix #7

Pain and suffering

There are a few edge cases remaining, but this is mostly resolved now. Merging so dex-translator can pull in the updated logic.