Problems running grlc locally

I am trying to run locally grlc so I followed the instructions to install it via Docker. I didn't have any problem during the installation and the application is up un running at http://localhost:8001 as it is says in the documentation. My problem is that no matter what repos I try to load, I get the same error on the screen:
500 : <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <title>500 Internal Server Error</title>
Internal Server Error

The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
 http://linkeddata.dia.fi.upm.es:8001/api/albertmeronyo/lodapi/spec
In the terminal where I run the docker-compose instruction, I get the following error:

grlc_1  | 2017-10-26 14:08:55,655 [INFO] (server.swagger_spec) -----> Generating swagger spec for /albertmeronyo/lodapi on commit None
grlc_1  | 2017-10-26 14:08:58,363 [DEBUG] (prov.init_prov_graph) Ingesting Git2PROV output into RDF graph
grlc_1  | 2017-10-26 14:08:59,313 [INFO] (connectionpool._new_conn) Starting new HTTPS connection (1): api.github.com
grlc_1  | 2017-10-26 14:08:59,790 [DEBUG] (connectionpool._make_request) "GET /repos/albertmeronyo/lodapi HTTP/1.1" 401 83
grlc_1  | 2017-10-26 14:08:59,795 [INFO] (connectionpool._new_conn) Starting new HTTPS connection (1): api.github.com
grlc_1  | 2017-10-26 14:09:00,716 [DEBUG] (connectionpool._make_request) "GET /repos/albertmeronyo/lodapi/commits HTTP/1.1" 401 83
grlc_1  | 2017-10-26 14:09:00,721 [ERROR] (app.log_exception) Exception on /api/albertmeronyo/lodapi/spec [GET]
grlc_1  | Traceback (most recent call last):
grlc_1  |   File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1817, in wsgi_app
grlc_1  |     response = self.full_dispatch_request()
grlc_1  |   File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1477, in full_dispatch_request
grlc_1  |     rv = self.handle_user_exception(e)
grlc_1  |   File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1381, in handle_user_exception
grlc_1  |     reraise(exc_type, exc_value, tb)
grlc_1  |   File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1475, in full_dispatch_request
grlc_1  |     rv = self.dispatch_request()
grlc_1  |   File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1461, in dispatch_request
grlc_1  |     return self.view_functionsrule.endpoint
grlc_1  |   File "/home/grlc/grlc/src/server.py", line 211, in swagger_spec
grlc_1  |     swag = utils.build_swagger_spec(user, repo, sha, static.SERVER_NAME, prov_g)
grlc_1  |   File "/home/grlc/grlc/src/utils.py", line 260, in build_swagger_spec
grlc_1  |     commit_list = [c['sha'] for c in commits]
grlc_1  | TypeError: string indices must be integers

Any clue about what's going on?
I'm running grlc in an Ubuntu 16.04.3.

Hi @ma-garcia ! Thanks for using grlc.
It seems this is related to the access token your grlc instance uses to send requests to GitHub, since you're getting 401 responses to those.
Could you please try the following:

Get a GitHub personal access token. You'll find them in the web interface: go to your profile, then Settings, then Developer settings, Personal access tokens, and Generate new token
You'll get an access token string, copy it and save it somewhere safe (GitHub won't let you see it again!)
Edit your docker-compose.yml or docker-compose.default.yml file, and paste this token as value of the environment variable GRLC_GITHUB_ACCESS_TOKEN
Restart the container and try to generate a spec

I now see this is badly explained in the documentation, so apologies for that. Will update the docs if this fixes it.
Thanks!

That fixed the problem, thanks.


Back button slightly larger than forward button (blurry back icon)

This is a minor issue but, as you can see, the back button is slightly larger than the forward one, making the icon appear blurry:

I'm not sure if this only happens to me. My monitor has a 1920:1080 ratio; the issue exists independently of the size of the Firefox window. Using latest master under FF 60.0.
Once again, thank you for your work!

Oh god, that bug again. It was already fixed for FF 57, then again for FF 58, then it actually worked without changes for FF 59 and now it's broken again: #17. It's because the back button is bigger in Firefox' default theme to implement that fancy circle around it. Mozilla keeps changing the styles every release, so our overrides stop working and the icon scales improperly. I'll fix it in a second since I already found the culprit. Thanks for reporting it!

My bad for opening a new issue, I should have browsed through the closed ones beforehand!
But I'm glad that it's easy to fix! It's one of those small issues that drive you nuts after you notice them for the first time! :D

Yeah, small issues you notice, fix, and then they come back a hundred times. :P It's okay tho, the icon or the whole button is usually just forced to scale to some arbitrary size, so unsetting those rules fixes the problem. Just pushed a fix to master, works fine for me now.

Works fine for me too! Thank you for the quick fix!


Acme/Can't get DNS challenge validated: Where is the Renew button?

Important notices
Hello,
I am quite desperate as I can’t seem to be able to validate my CA with DNS-01 (nsupdate). when I create the certificate I don’t see the TXT key to be configured in my DNS therefore anytime I try to issue the CA a new TXT is trying to be verified and never matches the only ongoing.
At what moment should I be aware of the TXT key so I can set it before it gets verified.

[Sat Mar 14 21:41:44 CET 2020] txtdomain='_acme-challenge.xdealmeida.com'
[Sat Mar 14 21:41:44 CET 2020] txt='BPvSHaT2NKDerBylv7DI1Rz8qY48uuuO_FQfZuYOpyM'
[Sat Mar 14 21:41:44 CET 2020] d_api='/usr/local/share/examples/acme.sh/dnsapi/dns_nsupdate.sh'
[Sat Mar 14 21:41:44 CET 2020] Found domain api file: /usr/local/share/examples/acme.sh/dnsapi/dns_nsupdate.sh
[Sat Mar 14 21:41:44 CET 2020] Adding txt value: BPvSHaT2NKDerBylv7DI1Rz8qY48uuuO_FQfZuYOpyM for domain:  _acme-challenge.xdealmeida.com
[Sat Mar 14 21:41:44 CET 2020] adding _acme-challenge.xdealmeida.com. 60 in txt "BPvSHaT2NKDerBylv7DI1Rz8qY48uuuO_FQfZuYOpyM"
[Sat Mar 14 21:41:44 CET 2020] error updating domain

when I am creating the certificate I would have assume that I should get the TXT value to be configured before pressing the "Issue/Renew" button.

I don’t seem to find the Renew option like well described in https://www.reddit.com/r/PFSENSE/comments/5v6b0a/how_to_acme_lets_encrypt_dns_manual/
Plugin: os-acme-client (installed) 1.29 (acme.sh v2.8.5)
dig -t TXT _acme-challenge.xdealmeida.com
; <<>> DiG 9.11.3-1ubuntu1.11-Ubuntu <<>> -t TXT _acme-challenge.xdealmeida.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58533
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;_acme-challenge.xdealmeida.com.        IN      TXT

;; ANSWER SECTION:
_acme-challenge.xdealmeida.com. 3600 IN TXT     "BPvSHaT2NKDerBylv7DI1Rz8qY48uuuO_FQfZuYOpyM

MERCI
XabiX

I can’t seem to be able to validate my CA with DNS-01 (nsupdate)

The screenshot shows that you haven't configured the required nsupdate options. Do you know how nsupdate works?
If you want to validate the domain that is visible on the screenshots, you should probably choose CloudFlare for DNS-01 validation and enter the required credentials. (CloudFlare provides DNS for this domain.)

I don’t seem to find the Renew option like well described in https://www.reddit.com/r/PFSENSE/comments/5v6b0a/how_to_acme_lets_encrypt_dns_manual/

The linked guide is for pfSense, so it does not apply at all.

Unfortunately the documentation on the web is not that available at least when I was looking within an Opnsense case.
Got it working with CloudFlare API approach. thanks

Glad you got it working.


#include "caffe2/proto/caffe2.pb.h" not found

not found in logging.h
I manually checked the cafe2 proto folder and the file is not there.
Am I missing something?

@dawand hi, I guess you are testing feature-models branch right? In that case, yes, you will have this issue, because we are still developing this branch (in the stage of testing some error handling) and it's quite not stable. We will eventually publish a 2-0-stable branch for a clean/stable version of that branch.
I tested 1-0-stable, and it should not throw this error.
Also, this error thrown because in the feature-models branch, you are missing some files (which is too big for git an we didn't put it there.)
You can still do following to clean it:

Open it in Xcode and you will see under models folder, there are many pb files marked as red (due to it's too big)
Choose all the red ones and right click, then delete them

Then you will have no trouble.
Or, you can download for example tinyYoloInit.pb/tinyYoloPredict.pb in this repo: https://github.com/KleinYuan/caffe2-yolo
And do similar thing, remove whatever is not available or whatever you don't need.
In summary, the issue is that model files are missing and this branch is still under developing. Sorry for the confusion and we will publish 2-0-stable ASAP. :) hope helpful.

Thank you very much for the detailed explanation 👍 Keep going 💯

@dawand thanks for your appreciation and feel free to ask any question here. Also if you like it, star us to encourage us. :)

@dawand  hey man, I actually thought about it and it seems that also possible that your caffe2 build is not successful. Could you double check on that.
If everything build successfully, you will see that file in here:

@KleinYuan Hi, I met the same error today when I was trying to build the Caffe2-iOS. When I run setup.sh, there is an error:
CMake Error at cmake/External/nnpack.cmake:102 (add_library):
  Cannot find source file:

    /Users/lihuoran/home/workspace/dl-on-mobile/demos/Caffe2-iOS/src/caffe2/third_party/NNPACK/src/psimd/fft-block-mac.c

  Tried extensions .c .C .c++ .cc .cpp .cxx .m .M .mm .h .hh .h++ .hm .hpp
  .hxx .in .txx
Call Stack (most recent call first):
  cmake/Dependencies.cmake:52 (include)
  CMakeLists.txt:85 (include)

CMake Error: Cannot determine link language for target "CAFFE2_NNPACK".
CMake Error: CMake can not determine linker language for target: CAFFE2_NNPACK

Do you know what is going on and how to fix it! Thanks!

@KleinYuan I am also having the same problem as described above. My cmake, automake, and libtool installations were all successful.

Was there ever a fix for this issue?
I tried looking at https://github.com/KleinYuan/Caffe2-iOS/issues/23 but this isn't doing it for me either


Restructure of ioant repo

Reason
There was a need for clarifying the structure of the Ioant platform / folder structures.
Changes
The performed restructure of the IOAnt repository:

Tools has been added as a top-level folder.

Prango and UDP debugger tools have been moved here.

Restructure of Communication folder.

Now is divided based on platform/programming-language (or platform)
Devices and entities are clearly separated

IOAnts iopy python SDK has now been moved into a separate repository called pypi-packages

iopy has been renamed to ioant and mysql moduel (db) has been broken out an placed in a separate package called ioant_mysqlhelper
Both ioant and ioant_mysqlhelper have been made available on pypi (Python Package Index) for easy installation. Both start at version 0.1.0

Fixed bug in core esp8266 library. (resolves #4)
Updated installation scripts
Added proto support when building in windwos and mac (esp8266)
Improved logger functionality. Logging for UART is now fully functional.

Corrected issue found when reviewing. @simonlovgren


nsfs permission has to be set to 777 for creating the user buckets, otherwise permission denied is displayed

Environment info

NooBaa Version: VERSION
Platform: Kubernetes 1.14.1 | minikube 1.1.1 | OpenShift 4.1 | other: specify

Actual behavior

When the s3 service is deployed, on the noobaa-endpoint we need to set the permission to 777 for /nsfs. If this is not set then we can't get the s3users buckets created in the /nsfs//
s3users directory are pre-existing on the Storage Cluster
sh-4.4# pwd
/nsfs/noobaa-s3res-4080029599

drwxrwxr-x.  2 7001 8000 4096 Oct 11 16:38 s3user1-dir
drwxrwxr-x.  2 7003 8003 4096 Oct 11 16:38 s3user3-dir
drwxrwxr-x.  2 7002 8000 4096 Oct 12 19:12 s3user2-dir

sh-4.4# ls -lrt s3user1-dir
ls: cannot open directory 's3user1-dir': Permission denied
sh-4.4# ls -lrt s3user2-dir
ls: cannot open directory 's3user2-dir': Permission denied

After setting the permissions on the /nsfs as 777 and then create the s3 user accounts then there is no longer the Permission denied error for the user directories that are created thereafter

sh-4.4# pwd
/nsfs/noobaa-s3res-4080029599

drwxrwxr-x.  6 7008 8000 4096 Oct 13 16:07 s3user8-dir
drwxr-xr-x.  4 7009 8000 4096 Oct 13 16:08 s3user9-dir

sh-4.4# ls -lrt s3user8-dir
total 2
drwxr-x---. 3 7008 8000 4096 Oct 12 19:40 newbucket-user8
drwxr-x---. 3 7008 8000 4096 Oct 13 09:26 newbucket-user8-new
drwxr-x---. 2 7008 8000 4096 Oct 13 10:23 newbucket-user8-from-user9
drwxr-x---. 2 7009 8000 4096 Oct 13 10:25 newbucket-user9-from-user8
sh-4.4# ls -lrt s3user9-dir
total 1
drwxr-x---. 3 7009 8000 4096 Oct 13 09:41 newbucket-user9
drwxr-x---. 2 7009 8000 4096 Oct 13 16:08 newbucket-13oct-user8key

Summary is chmod 777 on /nsfs has to be done everytime by logging to the noobaa-endpoint pod which may not be the right way. Added to that in dev/test env when we do the upgrades of ODF or through delete pod method, the Noobaa will be freshly installed/re-conciled as a result the permission for the /nsfs set are lost and we need to set it again.
Ask: Is there a way to set this 777 for /nsfs in the noobaa-core when creating itself as it is not a good practice to ask Customers to set this by logging onto the noobaa pod.
We have appropriate permissions on the Storage Cluster and hence need this setting from Noobaa so it is taken care automatically when the namespacestore is created with the /nsfs to be at 777. Remember that on SC we have the SELINUX is set to Permissive mode.
Expected behavior

Steps to reproduce

More information - Screenshots / Logs / Other output

@rkomandu can this be the same as #6676 ?

This is on my SC
[root@storage-rkomandu-x-worker2 fs1]# ls -ld /ibm/fs1
drwxrwxrwx. 35 root root 262144 Oct 15 10:39 /ibm/fs1
[root@storage-rkomandu-x-worker2 fs1]# ls -ld /ibm/fs1/s3user1-dir
drwxrwxr-x. 2 7001 8000 4096 Oct 11 09:38 /ibm/fs1/s3user1-dir
[root@storage-rkomandu-x-worker2 fs1]# ls -ld /ibm/fs1/s3user8-dir
drwxrwxr-x. 6 7008 8000 4096 Oct 13 09:07 /ibm/fs1/s3user8-dir
[root@storage-rkomandu-x-worker2 fs1]# lsattr /ibm/fs1
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/fset-rkomandu-08Oct
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/fset-rkomandu-noobaa-with-ccs
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/new-noobaa-endpoint-down-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/rkomandu-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3resource-dir-13Jul-cli-created-new-again
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user3-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/fset-rkomandu-noobaa-cs
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/noobaa-down-now-1
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/noobaa-down-now
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/jul13rest-1
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/make-noobaa-endpoint-down-now
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/fset-s3service
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/13jul-newlycreated
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/pvc-764eabbc-ba1d-42b0-a194-fac244a1ffc6
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/newbucket-for-507
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/spectrum-scale-csi-volume-store
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/jul13rest-morn-2
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user11-dir-change
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/pvc-a9efed85-09bb-4110-9578-abe7403b8b59
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/fset-rkomandu
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/pvc-73c58724-1d19-4c75-9486-15b1751029c4
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user11-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user9-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user8-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/absderweewdffsaasddffdsaafffdssaaaasssssdddddddsaaaaaaawweerrttttyyyyyyyy
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3resource-dir-12Jul-cli-created
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3resource-dir-12Jul
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user2-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user-temp-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/jul13rest-morn-1
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/jul13rest-2
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/s3user1-dir
lsattr: Inappropriate ioctl for device While reading flags on /ibm/fs1/jul13rest
[root@storage-rkomandu-x-worker2 ~]# lsattr /ibm/fs1/s3user3-dir
[root@storage-rkomandu-x-worker2 ~]# lsattr /ibm/fs1/s3user1-dir
Cleaned up ODF to get on to a newer version. Ran into issues now with that, will work with Vijay from RH team to get this sorted out. upon successful installation and will create new set of user id's as Noobaa db is no longer there and then will update.
In the meantime you could look through this

Before creating the new set of user id's, just create namespacefs. it will create /nsfs folder with 755 permissions. Then, from endpoint, try to access your backing files.
Additionally, according to the error "lsattr: Inappropriate ioctl for device While reading flags", the backing cluster doesn't support the extended attributes. Could you check please why?

@igorpick
Noobaa is deployed through ODF 4.9 method (latest-stable.4.9.0) and then the namespacestore is created last night. When we check on the Noobaa endpoint it is set to 755 the /nsfs
sh-4.4# ls -ld /nsfs
drwxr-xr-x. 3 root root 37 Oct 18 18:29 /nsfs
sh-4.4# umask
0000
sh-4.4# ls -la /nsfs
total 256
drwxr-xr-x.  3 root root     37 Oct 18 18:29 .
dr-xr-xr-x.  1 root root     29 Oct 18 18:29 ..
drwxrwxrwx. 43 root root 262144 Oct 18 18:12 noobaa-s3res-4080029599
ls -ld /nsfs/noobaa-s3res-4080029599/
drwxrwxrwx. 43 root root 262144 Oct 18 18:12 /nsfs/noobaa-s3res-4080029599/
Can we have a webex and then you could pickup the inputs that you need for debugging this. The basic IO to work this is very important step and has to be done automatically than asking a user to change permissions logging through the Noobaa pod

PR #6769

@igorpick
As per last discussion, the steps were tried on a freshly deployed OCP 4.9 + CNSA 5121 + CSI 2.4.0 + ODF d/s install environment. The behavior seems to be same that s3 user can't create a bucket inside a directory using s3mb
Please find below the recreate steps and we need to get this sorted out ASAP.
nobaa-6761-permission-denied-5121-csi240.txt

@igorpick
on the same setup i.e 5121 (CSI 2.4.0) tried the busy-box that you have provided above

<EMAIL_ADDRESS>~]# oc rsh -n openshift-storage spectrum-nfs-busybox-68f65
/ # df -h
Filesystem                Size      Used Available Use% Mounted on
overlay                 249.5G     15.7G    233.8G   6% /
tmpfs                    64.0M         0     64.0M   0% /dev
tmpfs                    15.3G         0     15.3G   0% /sys/fs/cgroup
shm                      64.0M         0     64.0M   0% /dev/shm
tmpfs                    15.3G     54.8M     15.3G   0% /etc/resolv.conf
tmpfs                    15.3G     54.8M     15.3G   0% /etc/hostname
remote-sample           200.0G      2.6G    197.4G   1% /mnt/rkomandu
/dev/vda4               249.5G     15.7G    233.8G   6% /etc/hosts
/dev/vda4               249.5G     15.7G    233.8G   6% /dev/termination-log
tmpfs                    15.3G     54.8M     15.3G   0% /run/secrets
tmpfs                    29.6G     20.0K     29.6G   0% /var/run/secrets/kubernetes.io/serviceaccount
tmpfs                    15.3G         0     15.3G   0% /proc/acpi
tmpfs                    64.0M         0     64.0M   0% /proc/kcore
tmpfs                    64.0M         0     64.0M   0% /proc/keys
tmpfs                    64.0M         0     64.0M   0% /proc/timer_list
tmpfs                    64.0M         0     64.0M   0% /proc/sched_debug
tmpfs                    15.3G         0     15.3G   0% /proc/scsi
tmpfs                    15.3G         0     15.3G   0% /sys/firmware
/ # ls -lrt /mnt/rkomandu/
total 4
drwxrwx--x    3 root     root          4096 Oct 29 19:32 primary-fileset-remote-sample-4950932666296584575
drwxrwx--x    3 root     root          4096 Nov  2 21:59 primary-fileset-remote-sample-17836319176931783325
drwxrwx--x    3 root     root          4096 Nov  3 20:13 pvc-57253e00-3417-4154-8022-b747962e19b2
drwxrwx--x    3 root     root          4096 Nov  3 20:16 pvc-49bbbee5-fbb6-470c-91c5-5959d91336bc
drwxr-x---    3 5001     5000          4096 Nov  4 05:13 first-created-bucket
drwxrwxr-x    2 5002     5000          4096 Nov  4 05:16 user2-created-dir-on-sc
drwxrwxr-x    2 5003     5000          4096 Nov  4 05:31 user3-created-dir-on-sc
/ # ls -lrt /mnt/rkomandu/user3-created-dir-on-sc/
ls: can't open '/mnt/rkomandu/user3-created-dir-on-sc/': Permission denied
total 0
/ # ls -lrt /mnt/rkomandu/first-created-bucket/
total 112
-rw-r-----    1 5001     5000        108624 Nov  4 05:13 date
/ # ls -lrt /mnt/rkomandu/user3-created-dir-on-sc/
ls: can't open '/mnt/rkomandu/user3-created-dir-on-sc/': Permission denied
total 0

Busybox also the same problem, the permission denied
While the CNSA doesn't show anything problematic
sh-4.4# pwd
/mnt/remote-sample

sh-4.4# ls -lrt user3-created-dir-on-sc/
total 0
sh-4.4# uname -a
Linux worker0.hpo.cp.fyre.ibm.com 4.18.0-305.19.1.el8_4.x86_64 #1 SMP Tue Sep 7 07:07:31 EDT 2021 x86_64 x86_64 x86_64 GNU/Linux

This is what are the recreate steps. Discussed with CSI team internally as well
On the Storage cluster have the SELINUX set to Permissive mode
ls -lZ is issued as shown below

drwxrwxr-x. 2 10001 10000 unconfined_u:object_r:container_file_t:s0:c4,c27 4096 Nov 10 22:41 user10001-created-dir-on-sc
drwxrwxr-x. 2 10002 10000 unconfined_u:object_r:container_file_t:s0:c4,c27 4096 Nov 10 22:41 user10002-created-dir-on-sc

After that Noobaa is freshly deployed via ODF operator (S3 service create) and it gets the following SELINUX credentials
oc get pod noobaa-endpoint-6874689bfd-bnpqf -o yaml -n openshift-storage |grep seL -A2 -B2     runAsGroup: 0     runAsUser: 0     seLinuxOptions:       level: s0:c26,c25   serviceAccount: noobaa-endpoint
So this  on Storage Cluster
c4,c27
On Noobaa freshly deployed -->
seLinuxOptions:
level: s0:c26,c25
This is what is occurring in the system, which needs to be checked from Noobaa side, whether this is generated every time on Deployment

@rkomandu
If I'm not mistaken, you reproduced this on the busy-box, with no noobaa code. Meaning its not a noobaa code issue?

@nimrod-becker
I would have shown you a working one.. yday we had Noobaa deployed and Storage Cluster was set to permissive mode then the Noobaa buckets are working when creating inside the directory

oc get pod noobaa-endpoint-bcbc84f5-xbzn9 -o yaml | grep seLinux -A 2 -B 2
    runAsGroup: 0
    runAsUser: 0
    seLinuxOptions:
      level: s0:c27,c4
  serviceAccount: noobaa-endpoint

Today deployed newer Noobaa (ODF) version and then when checked the yaml it had a different SELinux values . As you could see the value changed is creating the issue as i understand.

oc get pod noobaa-endpoint-6874689bfd-bnpqf -o yaml -n openshift-storage |grep seL -A2 -B2
    runAsGroup: 0
    runAsUser: 0
    seLinuxOptions:
      level: s0:c26,c25
  serviceAccount: noobaa-endpoint

I understand that OCP Defaults have changed which causes us what we currently see.
Talking to Igor, overriding the defaults customer has set on his OCP might be problematic from the cust side, maybe what we want to do during the deployment of HPO is to verify values are as expected and if not alert the cust?
@igorpick @rkomandu

Hi @rkomandu @nehasharma5 @nimrod-becker,
According to the conversation with Neha,  steps to reproduce the issue.

Create a namespace. Kubernetes generates selinux categories for it, for example, c10,c20.
Install odf and spectrum scale cluster.
Create nsfs pointed to spectrum storage.
Create buckets and objects which get selinux context with categories c10,c20. Everything is working.
Remove the namespace
Create a new namespace. Kubernetes generates new categories for it, for example, c15,c25.
Install odf and create nsfs pointed to existing spectrum storage.
Try to list existing buckets or create a new bucket and get the 'Permission denied' error.

When an administrator reinstalls odf, he should provide the previous selinux categories to the new namespace, otherwise, there is a mismatch between new namespace selinux categories and assigned categories of the existing files and folders in the spectrum storage.
A few options to resolve the issue:

The administrator can run 'ls -Z' on the existing spectrum storage files to determine the correct categories and configure the new namespace with them.
The administrator can relabel (modify categories) the existing files and folders, according to the new namespace categories. (May take a while, depending on amount of existing files).
The administrator knows categories range on the system and can configure the new namespace with all the range, for example, c0.c1023. It will provide full selinux access from endpoint pod to spectrum storage mounted folder.

In order to modify the selinux labels/categories of a namespace:
oc edit ns
metadata:
annotations:
openshift.io/sa.scc.mcs: s0:c0.c1023

Linking to related issue from Spectrum Scale CSI -
https://github.com/IBM/ibm-spectrum-scale-csi/issues/481
Worth comparing the details of that issue vs this one.

Also referring to the Spectrum Scale docs on selinux volume relabeling -
https://www.ibm.com/docs/en/spectrum-scale-csi?topic=pods-considerations-mounting-read-write-many-rwx-volumes

@nimrod-becker ,
As per the slack discussion https://ibmandredhatguests.slack.com/archives/G015Z7SDWQ0/p1644928886864419, the Access Denied is hit for the "s3 mb" bucket creation at the mount point of the Namespacestore, i.e /nsfs/ where it had 755 permissions on the FS. Please take a look at the below information.
Noobaa-endpoint

sh-4.4# ls -ldZ /nsfs/noobaa-s3res-4080029599/
drwxr-xr-x. 6 root root system_u:object_r:container_file_t:s0 262144 Feb 15 11:21 /nsfs/noobaa-s3res-4080029599/

sh-4.4# ls -lrZ /nsfs/noobaa-s3res-4080029599/
total 2
drwxr-xr-x. 3 1002 1002 unconfined_u:object_r:container_file_t:s0    4096 Feb 15 11:49 user2
drwxrwx--x. 3 root root system_u:object_r:unlabeled_t:s0             4096 Feb 15 11:16 pvc-53582ead-32f6-4419-8d68-58826ad14542
drwxrwx--x. 3 root root system_u:object_r:unlabeled_t:s0             4096 Feb 15 11:14 pvc-277a24ec-00df-4aec-a4bc-a987e632cabf
drwxrwx--x. 3 root root system_u:object_r:container_file_t:s0:c2,c28 4096 Feb 15 07:57 primary-fileset-remote-sample-3148973613941210680

From Application node as user3 we are trying to create s3 mb and where we get the Access Denied

[root@autoosculate-x-app1 ~]# alias user3='AWS_ACCESS_KEY_ID=3Za49gmn1VcmoV5zkTpW AWS_SECRET_ACCESS_KEY=WZ6PoIPmNoy0oRLGROwELkB5J0AAeZbyoIQvoBMy aws --endpoint https://s3-openshift-storage.apps.don.cp.fyre.ibm.com/  --no-verify-ssl s3'
[root@autoosculate-x-app1 ~]# user3 ls
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-openshift-storage.apps.don.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[root@autoosculate-x-app1 ~]# user3 mb s3://bucket3
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-openshift-storage.apps.don.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
make_bucket failed: s3://bucket3 An error occurred (AccessDenied) when calling the CreateBucket operation: Access Denied

@jackyalbo , could you debug this and let us know what are the recommendations for this to work ?

In the live session with Jacky, the last occurrence was found to be irrelevant for NooBaa.
What else is left her eon this bug? @rkomandu

@nimrod-becker, Ketan mentioned the discussion he had with @jackyalbo on the /nsfs/ on endpoint is having 755 and how the noobaa user can create the directory on the mount-point, which is valid though
Ulf is saying will have some setup related changes and hasn't shared yet. For now keep this as low priority

@rkomandu Why?
There is nothing to be done on the NooBaa side + its not a bug => should not be kept open

closing this issue based on the @nimrod-becker comments and our agreements.


Issue after make command

After using the make-command I get this error:
[  2%] Built target LIBSHA1 [  4%] Building C object CMakeFiles/LIBUTILS.dir/lib/utils/src/utils_strsplit.c.o /home/arma/JAPM-master/lib/utils/src/utils_strsplit.c: In function ‘count_delims’: /home/arma/JAPM-master/lib/utils/src/utils_strsplit.c:17:2: error: ‘for’ loop initial declarations are only allowed in C99 or C11 mode   for (unsigned int it = 0; str[it]; ++it) {   ^ /home/arma/JAPM-master/lib/utils/src/utils_strsplit.c:17:2: note: use option -std=c99, -std=gnu99, -std=c11 or -std=gnu11 to compile your code /home/arma/JAPM-master/lib/utils/src/utils_strsplit.c:18:3: error: ‘for’ loop initial declarations are only allowed in C99 or C11 mode    for (unsigned int ij = 0; delims[ij]; ++ij) {    ^ CMakeFiles/LIBUTILS.dir/build.make:54: recipe for target 'CMakeFiles/LIBUTILS.dir/lib/utils/src/utils_strsplit.c.o' failed make[2]: *** [CMakeFiles/LIBUTILS.dir/lib/utils/src/utils_strsplit.c.o] Error 1 CMakeFiles/Makefile2:167: recipe for target 'CMakeFiles/LIBUTILS.dir/all' failed make[1]: *** [CMakeFiles/LIBUTILS.dir/all] Error 2 Makefile:76: recipe for target 'all' failed make: *** [all] Error 2
Would be great if you could fix that. Thanks in advance.

Hello,
You must have an older CC version using an old standard by default. This commit https://github.com/RaJiska/JAPM/commit/7635fe68ed3670daebaf8ee9af8e044e3ccc6ff6 should have fixed the issue by explicitely specifying the appropriate standard.


Both HWBPs and EBREAKs populate mtval

This is a normative change, but it is backwards compatible, since writing 0 to mtval remains a legal option.
Resolves #600

Is the technical term "breakpoint exception" defined earlier?

Effectively yes - see Table 3.7 in the Priv spec.

To clarify, the "breakpoint exceptions" are precisely the three mcause == 3 exceptions:

Instruction address breakpoint
Environment break
Load/Store/AMO address breakpoint

in Table 3.7?

Yes, all the (three) line items with Exception Code = 3.

Which raises the potential need for a clarification?  It's clear that "Environment break" results from an EBREAK instruction, whereas the address breakpoints (resulting from Trigger Module address triggers firing) need to be understood to be "hardware" breakpoints.

Okay. This matches my understanding from a (long ago) reading of Chapter 10 of the RISC-V Reader (pp.101-102):

Breakpoint exceptions arise from executing an ebreak instruction, or when an address or datum matches a debug trigger

I guess I never read this part of the Priv. spec. that carefully to notice the difference. Good spot, Andrew.

@allenjbaum gets credit for spotting the inconsistency; I merely proposed the wording of the fix!

I'm going to merge this since it doesn't seem controversial, but please reopen #600 if further discussion is warranted.


[ Library ] Design Pattern - chain of responsibility

Description
In Cairo 1.0 , implement the  chain of responsibility - design pattern for the pur library part : Data computation.
Acceptance Criteria

[ ] Implementation of the chain of responsibility pattern
[ ] Implementation of Unit tests

Hey team! Please add your planning poker estimate with Zenhub @tekkac @MartianGreed


Fix calling undefined functions

I found some function calls cause undefined function errors. I guess they are mistakes on moving script-local functions to autoload functions (seem to be added by #212). This PR fixes them.

Thanks!


integrate syft go-module detection with engine

The version of syft bundled with anchore-engine already supports extracting Go module dependencies from go binaries; however, this information is currently filtered out by anchore-engine.  This PR provides the necessary mappings to support go-modules within anchore-engine.

We might also be able to remove https://github.com/anchore/anchore-engine/blob/master/anchore_engine/analyzers/modules/32_golang_packages.py, but I wasn't completely sure

We might also be able to remove https://github.com/anchore/anchore-engine/blob/master/anchore_engine/analyzers/modules/32_golang_packages.py, but I wasn't completely sure

We can try to remove it in another PR and see if anything breaks!


Is the website only down for me?

I somehow can't reach https://coronawarn.app currently. Is it only down for me?

UptimeRobot also detects this issue: https://stats.uptimerobot.com/gKg1ZCqKJv

That's the issue I receive on my iPhone:

Now it works again, UptimeRobot also shows the page as UP again.
@dsarkar / @thomasaugsten was there an incident? Was the main server CWA contacts for DKs also affected?

@Ein-Tim

Was the main server CWA contacts for DKs also affected?

The page https://stats.uptimerobot.com/gKg1ZCqKJv shows no incidents and 100.00% availability over the last 90 days for "Main Server (svc90.main.px.t-online.de)" with details on https://stats.uptimerobot.com/gKg1ZCqKJv/790438384
so, no.

Thanks @MikeMcC399, you're right.
Closing this issue.

There was an unexpected long downtime for a maintenance update.


Configure Pipelines as Code to require /ok-to-test on every new commit

I am ok with the change but is there a jira issue to get the context of why changing this or maybe explain in the commit/PR description

/hold

/lgtm

I am okay with this change as well. We need to announce this change before we merge it as it will affect how users interact with the services. I have drafted up an email that we can use to make the announcement.


[Mirror] [FLINK-19238] Sanity check for RocksDB arena block size

This is a mirror of #13688 which addresses the final review comments and squashes all necessary commits. Submitting a PR simply to trigger the pre-commit build and make sure nothing broken.

@flinkbot run azure

The pre-commit build with 39cc0db was failed due to FLINK-19882, rerun to get a green build.

The latest Azure build failed due to FLINK-20052, and comparing the two builds we could make sure the failure is irrelative to changes here, thus I will merge the commits soon.
@rmetzger @dianfu JFYI (for 1.12.0 release).

Merged via 93c6256


[modify] kana/dictionary_spec for removing the warning

The warning message is below:
WARNING: Using the `raise_error` matcher without providing a specific error or message risks false positives, since `raise_error` will match when Ruby raises a `NoMethodError`, `NameError` or `ArgumentError`, potentially allowing the expectation to pass without even executing the method you are intending to call. Instead consider providing a specific error class or message. This message can be supressed by setting: `RSpec::Expectations.configuration.warn_about_potential_false_positives = false`. Called from /somewhere/shirasagi/spec/models/kana/dictionary_spec.rb:95:in `block (4 levels) in <top (required)>'.

Fixed by 4cb4c65925fb3f8df593928a97632fe551872176


Adding quickstart template for the VM expiration date feature.

Currently, we only have a template to create VM (with expiration date) from existing custom images. But we'll add support for gallery image in the next work item.

Hi @mithunshanbhag, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
We will now validate the agreement and then real humans will evaluate your PR.
TTYL, AZPRBOT;


Probably not something you want...

But I'll let you be the judge of that!
This isn't really an improvement so much as achieving different goals than what you had here already. I wanted to be able to use this without worrying about buffer overflows and incorporated BigInt into the featureset, replacing support for generic numeric values.
I also refactored the automatic reduction of values (2/4 -> 1/2) to instead be a property on an instance (or with an optional initializer flag) as I have a use case for not immediately reducing the fraction.
I honestly do not expect you want to merge seeing as this is, once again, achieving different goals than previously.
In the event that I'm incorrect and you actually do want these changes, just be aware that I still have some cleanup to do and can revert some of the readme stuff (like the name change), so please just let me know :)

Hey! I have actually been considering adding a BigInt equivalent, but there was no native implementation in Swift.
I honestly much prefer having everything be normalized as that enables some optimizations under the hood, but overflows are definitely a problem I want to solve somehow. I remember there were multiple BigInt implementations for Swift last time I checked. Why did you pick this one specifically?

Hey! I have actually been considering adding a BigInt equivalent, but there was no native implementation in Swift.

🔥

I honestly much prefer having everything be normalized as that enables some optimizations under the hood, but overflows are definitely a problem I want to solve somehow.

Well I definitely need normalization as an option for my use, so that might just be a non starter when it comes to merging back in. However, if there are other bits of the code you want, I would be more than happy for you to grab them.
Out of curiosity, what is your use case that needs that level of uber optimization? Personally, I'm creating a calculator where having an unreduced fraction might be a legitimate step in breaking down an equation. That's up to the user. It also means that extreme optimization isn't really necessary since each calculation will be separated by some user input. No loops or fast and frequent calculations requiring that level of tight optimizations.

I remember there were multiple BigInt implementations for Swift last time I checked. Why did you pick this one specifically?

Honestly, I didn't put that much thought into it. It was mostly a gut feeling, however, I remember looking at the project and thinking it was well documented, that the code looked good to me, and it appeared to be mature with relatively good support. I DID look at several different projects, both BigInt and Rational in nature and ultimately felt like I liked the developer experience of these two best. Ymmv, of course!

(it might delight you to know that I actually came across this BigInt from another Rational library, but didn't like theirs as much as yours, hence taking the time to combine them :) )

I actually built this library for a SwiftUI calculator app I never got to finish lol, so it doesn't necessarily need that level of optimization. I remember experimenting with a lot of different ways to represent rational numbers in Swift and ended up concluding that having them normalized makes things simpler. I don't mind reconsidering though if it's a deal breaker. I didn't realize non-normalized fractions had a use case, so I just went with normalized.

I actually built this library for a SwiftUI calculator app I never got to finish lol, so it doesn't necessarily need that level of optimization.

🤪

I remember experimenting with a lot of different ways to represent rational numbers in Swift and ended up concluding that having them normalized makes things simpler. I don't mind reconsidering though if it's a deal breaker. I didn't realize non-normalized fractions had a use case, so I just went with normalized.

Honestly, I don't think it has a logistical use case as much as helping the use intuit what's happening a little easier. If they have control over inputing 4/4 then press a simplify button to get 1, I think that's both closer to what's taught in school (at least when I was in high school over a decade ago) and better reflects what they entered into the app.
A better example might be if I'm calculating something and have 4/4 as an input. If I hit enter and it immediately shows 1, that's pretty simple to understand. However, if I input something like 10941/13139 and it immediately showed 1563/1877, I might have a moment of "... That's not what I typed... was that correct? Was that supposed to reduce like that?" whereas, if I have a button to break that into two steps, I can plainly see and double check my input before simplification.
Additionally, while we would still miss out on those sweet sweet optimizations, the app dev then has the choice whether to simplify/reduce proactively or not, which could then be passed on to the user as a setting for the app. Maybe one user doesn't care about the scenario I just laid out, but another would. :)
Anyways, that's my reasoning. And I want to make sure you know there's no pressure from me to include my changes. I just want to give back if you want it! But I'm also perfectly content to just keep an alternative that has a slightly different goal in mind. :D
P.S. While it's not out yet, this might be moot in the near future with https://forums.swift.org/t/se-0450-package-traits/75598 🤞🏻 - then we could both have our cake and eat it too 😁

So I added the use of NaN instead of getting null values (where possible) - this actually allowed for achieving 100% test coverage!
However, just a heads up for whether you merge or not (trying to break down my adhd thought spasm):

by refactoring to use Sign instead of checking the numerator for pos/neg, floorDivision ended up never having an a value below 0, therefore the else statement never ran.
This actually negatively impacted coverage, so I wrote a specific test to target floorDivision with its different outcomes
It didn't produce results as I had anticipated, so I fired up python and ran all the test cases I produced through python to be sure
While I got a couple wrong myself, the original method also produced some wrong results
I fixed in this latest push
Buuuut - it passed all tests previously...
Comments can lie and my only source of truth is that the comment saysEquivalent to Python's `//` operator.

So while I assume it's telling the truth, it COULD be that the comment was written before the method was adjusted for a new, expected outcome that differed from Pythons // operator...
But if not - I synced it up to produce the proper outcome.

Ohh - and the reason I added NaN was so I can (hopefully) allow a Rational comprised of Rationals - like (a/b) / (c/d), etc. We'll see how it goes, but that's the goal :)

That traits proposal is interesting. Reminds me of Rust crate features.
I experimented with NaN before as well. I would return NaN whenever overflow happened, but I ended up deciding against it to avoid bad states.
For example, I have some methods to round a Rational to an integer, but if it's NaN, there's no way to compute that. I didn't want to make it optional either, so I just decided against NaN entirely.

Also, there's no pressure at all, don't worry. I'm down to make this library more flexible. I could still enable those optimizations with a flag under the hood to determine if it's reduced or not. I'll see if it ends up making sense.

For example, I have some methods to round a Rational to an integer, but if it's NaN, there's no way to compute that. I didn't want to make it optional either, so I just decided against NaN entirely.

If it's NaN, the result is NaN :)
Anyways - off to see about rational-ception


🐛 (coral): Preview and build-in-Klaw not working as expected

What happened?
pnpm preview

pnpm preview does not use the remote api

running build in Klaw
It seems like it's not updating the dist files correctly:

does not update templates/coral/index.html

does not update assets correctly (I'll add a screenshot what happens when you run it twice)

adding files manually at the right place does work when you go to coral/topics, index page is empty

Steps to reproduce

add new content to index.ts page:

const HomePage = () => {
  return (
    <>

Index

      new content here.
      <Pagination activePage={1} totalPages={1} setActivePage={() => {}} />
    </>
  );
};

in main.module.css, add:
.test-class {
  color: red
}

(use class somewhere in index.tsx)

run make enable-coral-in-springboot in /coral
go to /klaw, run make run-core
check http://localhost:9097/coral
check index page and sources (nothing there, test class not in assets)

Same happens when running the JAR file.
-> I'm not sure if I'm doing something wrong (then we have to update documentation) or if something is not working correctly.

Will close as it works now!


New Generic GO slim - BP

Hello,
As discussed at the Fall 2021 GOC meeting subsets workshop, we propose a new generic GO slim for BP  (other aspects will be reviewed later)

GOID
Term label

GO:0000278
mitotic   cell cycle

GO:0000910
cytokinesis

GO:0002181
cytoplasmic   translation

GO:0002376
immune   system process

GO:0003008
system   process

GO:0005975
carbohydrate   metabolic process

GO:0006091
generation of precursor metabolites and energy

GO:0006260
DNA   replication

GO:0006281
DNA   repair

GO:0006310
DNA   recombination

GO:0006325
chromatin   organization

GO:0006351
transcription,   DNA-templated

GO:0006355
regulation of trancription, DNA-templated

GO:0006399
tRNA   metabolic process

GO:0006457
protein   folding

GO:0006486
protein   glycosylation

GO:0006520
cellular   amino acid metabolic process

GO:0006575
cellular modified amino acid metabolic process

GO:0006629
lipid   metabolic process

GO:0006766
vitamin   metabolic process

GO:0006790
sulfur   compound metabolic process

GO:0006886
intracellular   protein transport

GO:0006913
nucleocytoplasmic   transport

GO:0006914
autophagy

GO:0006954
inflammatory   response

GO:0007005
mitochondrion   organization

GO:0007010
cytoskeleton   organization

GO:0007018
microtubule-based   movement

GO:0007031
peroxisome   organization

GO:0007040
lysosome   organization

GO:0007059
chromosome   segregation

GO:0007155
cell   adhesion

GO:0007163
establishment or maintenance of cell polarity

GO:0012501
programmed   cell death

GO:0015979
photosynthesis

GO:0016071
mRNA   metabolic process

GO:0016073
snRNA   metabolic process

GO:0016192
vesicle-mediated   transport

GO:0022414
reproductive   process

GO:0023052
signaling

GO:0030163
protein   catabolic process

GO:0030198
extracellular   matrix organization

GO:0031047
gene   silencing by RNA

GO:0032200
telomere   organization

GO:0032502
developmental   process

GO:0034330
cell   junction organization

GO:0036211
protein   modification process

GO:0042060
wound   healing

GO:0042254
ribosome   biogenesis

GO:0044782
cilium   organization

GO:0048870
cell   motility

GO:0051604
protein   maturation

GO:0055065
metal   ion homeostasis

GO:0055085
transmembrane   transport

GO:0055086
nucleobase-containing small molecule metabolic   process

GO:0061024
membrane   organization

GO:0065003
protein-containing   complex assembly

GO:0071554
cell   wall organization or biogenesis

GO:0071941
nitrogen   cycle metabolic process

GO:0072659
protein localization to plasma membrane

GO:0098542
defense   response to other organism

GO:0098754
detoxification

GO:0140013
meiotic   nuclear division

GO:0140053
mitochondrial   gene expression

GO:1901135
carbohydrate derivative metabolic process

Discussion with @hattrill and @RLovering about multicellular organism processes:
We will replace      GO:0003008 system process
by the more specific children:

GO:0003013 circulatory system process
GO:0022600 digestive system process
GO:0050886 endocrine process
GO:0061007 hepaticobiliary system process
GO:0003012 muscle system process
GO:0050877 nervous system process
GO:0003014 renal system process
GO:0003016 respiratory system process
Thanks, Pascale

Also, replace GO:0032502 developmental process
by GO:0030154 cell differentiation and GO:0048856 anatomical structure development

New goslim_generic 2021-11-09 - 76 terms
Note that only BPs have been changed
GO:0007568	aging
GO:0048856	anatomical structure development
GO:0006914	autophagy
GO:0008150	biological_process
GO:1901135	carbohydrate derivative metabolic process
GO:0005975	carbohydrate metabolic process
GO:0007155	cell adhesion
GO:0030154	cell differentiation
GO:0034330	cell junction organization
GO:0048870	cell motility
GO:0071554	cell wall organization or biogenesis
GO:0006520	cellular amino acid metabolic process
GO:0006575	cellular modified amino acid metabolic process
GO:0006325	chromatin organization
GO:0007059	chromosome segregation
GO:0044782	cilium organization
GO:0003013	circulatory system process
GO:0000910	cytokinesis
GO:0002181	cytoplasmic translation
GO:0007010	cytoskeleton organization
GO:0098542	defense response to other organism
GO:0098754	detoxification
GO:0022600	digestive system process
GO:0006310	DNA recombination
GO:0006281	DNA repair
GO:0006260	DNA replication
GO:0050886	endocrine process
GO:0007163	establishment or maintenance of cell polarity
GO:0030198	extracellular matrix organization
GO:0031047	gene silencing by RNA
GO:0006091	generation of precursor metabolites and energy
GO:0061007	hepaticobiliary system process
GO:0002376	immune system process
GO:0006954	inflammatory response
GO:0006886	intracellular protein transport
GO:0006629	lipid metabolic process
GO:0007040	lysosome organization
GO:0140013	meiotic nuclear division
GO:0061024	membrane organization
GO:0055065	metal ion homeostasis
GO:0007018	microtubule-based movement
GO:0140053	mitochondrial gene expression
GO:0007005	mitochondrion organization
GO:0000278	mitotic cell cycle
GO:0140014	mitotic nuclear division
GO:0016071	mRNA metabolic process
GO:0003012	muscle system process
GO:0050877	nervous system process
GO:0071941	nitrogen cycle metabolic process
GO:0055086	nucleobase-containing small molecule metabolic process
GO:0006913	nucleocytoplasmic transport
GO:0007031	peroxisome organization
GO:0015979	photosynthesis
GO:0012501	programmed cell death
GO:0030163	protein catabolic process
GO:0006457	protein folding
GO:0006486	protein glycosylation
GO:0072659	protein localization to plasma membrane
GO:0051604	protein maturation
GO:0036211	protein modification process
GO:0065003	protein-containing complex assembly
GO:0006355	regulation of transcription, DNA-templated
GO:0003014	renal system process
GO:0022414	reproductive process
GO:0003016	respiratory system process
GO:0042254	ribosome biogenesis
GO:0023052	signaling
GO:0016073	snRNA metabolic process
GO:0006790	sulfur compound metabolic process
GO:0032200	telomere organization
GO:0006351	transcription, DNA-templated
GO:0055085	transmembrane transport
GO:0006399	tRNA metabolic process
GO:0016192	vesicle-mediated transport
GO:0006766	vitamin metabolic process
GO:0042060	wound healing

New goslim-generic

FYI link to GO workshop https://docs.google.com/presentation/d/1dPmzAJGqIT-IS6I0hnGMYvREVziSk3CuIAtYNVJnYv4/edit#slide=id.gf7b8e17507_0_6

Hi
I have added a column to the list of removed terms (above) to indicate the ones that are currently on the new SLIM and were not actually removed
Ruth

Should we have root terms in the slim?

Well it is there at the moment, I think Val would say no?

That's a "nay" from I

Removed root terms here: #22525


connected textures are funky on infused ships

green (active) not connecting to adjacent green electromagnets
a red one connecting to a  green one very cursed

also happens with chisel (CTM)

also happens with chisel (CTM)


Can it support Inspector protocol?

I want to debug when python executes js code. I checked some documents of V8, but I am not familiar with C++ and cannot implement this function myself. So, I would like to ask if this feature can be added in subsequent updates.

Can you further detail what you would be interested in? Not sure I figured that out. Thanks"

For example, the v8Py library (https://github.com/tbodt/v8py/blob/master/v8py/devtools.py) provides a debugger function. With the help of V8’s Inspector, the executing js code can be debugged through ChromeDevtools. js code can also be understood as debugging js code in node. I'm not sure if it's easy to understand if I express it this way.
I think this is a very good feature. I am currently trying to learn from the debugger part of v8Py and want to implement it in STPyV8, but it may be very difficult for me.

One of the main STPyV8 design goals is to keep the code as simpler as possible and to support just key features to execute JavaScript code from Python. Introducing the debugger support would greatly increase the complexity of the project and would not add great value to the project, at least for our own purposes. BTW please feel free to submit some code and we will evaluate together if including that is worth doing. Thanks.


⚠ Bofrost.lu has degraded performance

In a727f95, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 899 ms

Resolved: Bofrost.lu performance has improved in b69912f after 9 minutes.


updated agent pool in pipeline from ubuntu to windows

This change will allow this pipeline to run on the on-premises agent pool, which does not have any Linux servers

This change is required to run the builds on our on-prem windows agents.


Why do I see K's and numbers over my opponents cards now?

Ever since the most recent update I see K's and numbers over my opponents deck.  I'm assuming its some kind of counter that may have been hidden before but now it can be seen.   Screenshot below.  What should I do?  Should I uninstall/reinstall?

This is a new (cool) feature :)
The number is the turn in which your opponent draw the card, the K means for "kept", the M for "mulligan", S is for "stolen", C is for "Coin".

Okay I do like the idea, but is there any way to disable it.  I tend to use multiple Desktops on my Macbook a whole lot, and I have issues when swiping from one desktop to the next.  Also, in the past if HSTracker crashed as it sometimes does right when I start a match I could pretty much restart HSTracker before I picked my cards and it would be fine.  However, now I would assume due to the overlay if you start HSTracker after the match begins it will just error out and close.


Request for assistance

Thank you for a great product.
Is it possible to replace the root in DockingLayout with a new root?
My application is complex and I have to replace the docking area with a completely different layout.
I have tried creating a new DockingLayout but that does not refresh properly.
If a do a hot reload from vscode then the layout is displayed correctly
Many Thanks
Garth

Hi @garthawaters!
"Works" if recreating the Docking with a new DockingLayout. But I found here a memory leak problem because it doesn't execute the dispose of the old layout when receiving a new one. I will solve this and try to provide a method to change the root.

Thanks for you quick response
I appreciate any changes you make to assist me
Many thanks
Garth Waters
On 2022-07-12 18:12, Carlos Eduardo Leite de Andrade wrote:

Hi @garthawaters [1]!
"Works" if recreating the Docking with a new DockingLayout. But I
found here a memory leak problem because it doesn't execute the
dispose of the old layout when receiving a new one. I will solve this
and try to provide a method to change the root.
--
Reply to this email directly, view it on GitHub [2], or unsubscribe
[3].
You are receiving this because you were mentioned.Message ID:
@.> [ {
@.": "http://schema.org", @.": "EmailMessage",
"potentialAction": { @.": "ViewAction", "target":
"https://github.com/caduandrade/docking_flutter/issues/2#issuecomment-1181964503",
"url":
"https://github.com/caduandrade/docking_flutter/issues/2#issuecomment-1181964503",
"name": "View Issue" }, "description": "View this Issue on GitHub",
"publisher": { @.***": "Organization", "name": "GitHub", "url":
"https://github.com" } } ]
Links:
[1] https://github.com/garthawaters
[2]
https://github.com/caduandrade/docking_flutter/issues/2#issuecomment-1181964503
[3]
https://github.com/notifications/unsubscribe-auth/AYJIKZ7L5VLSAA3MVNQUBM3VTWKQXANCNFSM53LQXXXA

Done! Version 1.3.0
Now you can rebuild the Docking with a new DockingLayout or use layout.root = ...
Let me know if you need anything. If I take a while to respond, it's because I will be on vacation :wink:

Wow so quick - thank you so much
On 2022-07-12 19:20, Carlos Eduardo Leite de Andrade wrote:

Closed #2 [1] as completed.
--
Reply to this email directly, view it on GitHub [2], or unsubscribe
[3].
You are receiving this because you were mentioned.Message ID:
@.>
[ { @.": "http://schema.org", @.": "EmailMessage",
"potentialAction": { @.": "ViewAction", "target":
"https://github.com/caduandrade/docking_flutter/issues/2#event-6979688910",
"url":
"https://github.com/caduandrade/docking_flutter/issues/2#event-6979688910",
"name": "View Issue" }, "description": "View this Issue on GitHub",
"publisher": { @.***": "Organization", "name": "GitHub", "url":
"https://github.com" } } ]
Links:
[1] https://github.com/caduandrade/docking_flutter/issues/2
[2]
https://github.com/caduandrade/docking_flutter/issues/2#event-6979688910
[3]
https://github.com/notifications/unsubscribe-auth/AYJIKZ5HT4SNHDWR4WZP2H3VTWSOJANCNFSM53LQXXXA

Sorry to worry you
When I did the upgrade I get an error 'multiple widgets used the same
globalkey' on the widgets that are created within the DockingAreas.
When I downgraded to the previous docking version these errors went
away.
The problem is probably on my side so I will continue to test.
Many Thanks
Garth Waters
On 2022-07-12 19:20, Carlos Eduardo Leite de Andrade wrote:

Closed #2 [1] as completed.
--
Reply to this email directly, view it on GitHub [2], or unsubscribe [3].
You are receiving this because you were mentioned.Message ID: @.***>

Links:
[1] https://github.com/caduandrade/docking_flutter/issues/2
[2]
https://github.com/caduandrade/docking_flutter/issues/2#event-6979688910
[3]
https://github.com/notifications/unsubscribe-auth/AYJIKZ5HT4SNHDWR4WZP2H3VTWSOJANCNFSM53LQXXXA

Hi! Make sure you're not reusing the same GlobalKey in more than one place. It must be unique. In fact, you probably shouldn't even need to declare any global keys :wink:

Thanks Carlos
I will track down the issue
On 2022-07-12 22:08, Carlos Eduardo Leite de Andrade wrote:

Hi! Make sure you're not reusing the same GlobalKey in more than one place. It must be unique. In fact, you probably shouldn't even need to declare any global keys 😉
--
Reply to this email directly, view it on GitHub [1], or unsubscribe [2].
You are receiving this because you were mentioned.Message ID: @.***>

Links:
[1]
https://github.com/caduandrade/docking_flutter/issues/2#issuecomment-1182450332
[2]
https://github.com/notifications/unsubscribe-auth/AYJIKZ5HZEDVZLUNUF65LG3VTXGCHANCNFSM53LQXXXA


ignore key file if it's absent

@rultor release, tag is 0.0.9

@rultor release, tag is 0.0.9

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.0.9

@yegor256 Done! FYI, the full log is here (took me 2min)


[SPARK-14804][Graphx] Graph vertexRDD/EdgeRDD checkpoint results Clas…

EdgeRDD/VertexRDD wrap partitionsRDD
e.g. EdgeRDDImpl.checkpoint() calls partitionsRDD.checkpoint()
EdgeRDD/VertexRDD isCheckpointed() method should be implemented the same way - it should call partitionsRDD.isCheckpointed
Spark-shell test works:
import org.apache.spark.graphx._
val users = sc.parallelize(List((3L, "lucas"), (7L, "john"), (5L, "matt"), (2L, "kelly")))
val rel = sc.parallelize(List(Edge(3L, 7L, "collab"), Edge(5L, 3L, "advisor"), Edge(2L, 5L, "colleague"), Edge(5L, 7L, "pi")))
sc.setCheckpointDir("/tmp/check")

val g = Graph(users, rel)
g.checkpoint
g.vertices.collect
g.edges.collect
g.isCheckpointed // true
// try to collect EdgeRDD/VertexRDD again
g.vertices.collect // works
g.edges.collect  // works

Can one of the admins verify this patch?

Related PRs
https://github.com/apache/spark/pull/15396
https://github.com/apache/spark/pull/12576

Test build #3329 has started for PR 15447 at commit b123b68.

Test build #3329 has finished for PR 15447 at commit b123b68.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

@apivovarov do we need this fix?


Vita shutting down

Possible source; plug-in incompatibility.
Other repatch plugins installed causing the vita to shutdown.
Possible issues with repatch / repatch_4.

If there is an incompatablity it's a user fix.
Reluctant to mess with users kernals


Deploy widget grouping is incorrect

I set up three deployment jobs from my "TestJenkins" for three different apps: "MyTestApp", "MySecondApp", "AnotherTestApp". On the deploy widget config they show up as just one entry:

@MarkRx I think this logic in UI/src/components/widgets/deploy/config.js is not quite correct
link to the diff: https://github.com/capitalone/Hygieia/pull/891/files?diff=split

Do the created collector items have unique options.applicationId's? Can you post them? The assumption would be that "MyTestApp", "MySecondApp", and "AnotherTestApp" would each have their own unique applicationId. If not then they will be treated as the same application if they all have the same instanceUrl.
var dataGrouped = dataGrouped = _(data)
                	.groupBy(function(d) { return (!multiServerEquality ? d.options.instanceUrl + "#" : "" ) + d.options.applicationId; })
                	.map(function(d) { return d; });

Ah. Got it. In my case (testing jenkins plugin) I had the same instanceUrl. And no applicationId in the collector item option. May be the workaround is to put Job url in the "instanceUrl". Not sure yet. But manually editing the json document to make the instance url the job url did work.
Noticed that if I turn the grouping off, it still groups.

@MarkRx the following code should work both ways:
var dataGrouped =  _(data)
                	.groupBy(function(d) { return (!multiServerEquality || d.options.applicationId == null ? d.options.instanceUrl + "#"+d.options.applicationName : "" ) + d.options.applicationId; })
                	.map(function(d) { return d; });

Can you test this change locally?

I think the proper solution should be to have the jenkins plugin assign each application an applicationId. That field really shouldn't be nullable as it is meant to be an identifier. The identifier could be something arbitrary like the md5sum of the instanceUrl + applicationName. It's possible there are other parts of the code that will choke if it is null.
Since a.applicationId == b.applicationId implies a.applicationName == b.applicationName you can use this:
var dataGrouped = dataGrouped = _(data)
                	.groupBy(function(d) { return (!multiServerEquality ? d.options.instanceUrl + "#" : "" ) + d.options.applicationName + "#" + d.options.applicationId; })
                	.map(function(d) { return d; });

The origin of applicationID was from uDeploy that had some kind of of UUID for each applicationID. I am sure this ID will change if the same App was setup in another "Prod" uDeploy server. May be we should create another ID (some kind of CMDB identifier)? In your case, how are you keeping this ID same across multiple deployment server?

I kind of "cheated". XLD uses composite path keys based on the names of items in the path. Since this is the case the applicationId remains the same so long as they have the same path.
For example:
Server1:
Id: Applications/Foo/Bar
Name: Bar
Server2:
Id: Applications/Foo/Bar
Name: Bar

@MarkRx @amitmawkin @satishc1 @mrpudn please review these following change proposal before I submit it in a PR form:
With PR https://github.com/capitalone/Hygieia/pull/891 there was a change in how deployed Apps were grouped together by "deploying server"s. Nice change. This allows to visualize an App deployment where different deployment servers (such as QA Jenkins, Prod Jenkins or whatever) are deploying the same app.
There are two major changes in that PR:

New API for to return a boolean attribute (systemConfig.multipleDeploymentServers) to the API properties file that determines if servers need to be grouped.
UI changes to group the servers in https://github.com/capitalone/Hygieia/blob/master/UI/src/components/widgets/deploy/config.js and https://github.com/capitalone/Hygieia/blob/master/UI/src/components/widgets/deploy/config.html

I am proposing a refactor of #1 and slight change to #2.
Slight Change to #2: Instead of relying on non-null applicationId, I am proposing a non-null applicationName + applicationId check in grouping of elements:
Old code (https://github.com/capitalone/Hygieia/blob/master/UI/src/components/widgets/deploy/config.js)
                var dataGrouped = _(data)
                    .groupBy(function(d) { return (!multiServerEquality ? d.options.instanceUrl + "#" : "" ) + d.options.applicationId; })
                    .map(function(d) { return d; });

Proposed change
                var dataGrouped = _(data)
                    .groupBy(function(d) { return (!multiServerEquality ? d.options.instanceUrl + "#" : "" ) + d.options.applicationName + d.options.applicationId; })
                    .map(function(d) { return d; });

Refactoring of #1
Instead of capturing/configuring the "multipleDeploymentServers" property via API, I am proposing that we do that in the UI and store each individual dashboard's choice in the "dashboard" document in dashboard -> widgets -> options section of the json document:
        {
            "_id" : ObjectId("5863ed079220ab16e6a1c3c8"),
            "name" : "deploy",
            "componentId" : ObjectId("583394884969c83f6715b588"),
            "options" : {
                "id" : "deploy0",
                "aggregateServers" : true
            }
        },

Corresponding UI changes are pretty simple.
Add a check box in deploy widget config:
        <div class="form-group checkbox">
            <label>
                <input type="checkbox" name="aggregateServers" ng-model="deployConfig.aggregateServers" ng-change="reload()">
                Aggregate Servers
            </label>
        </div>

Add a new variables in the corresponding controller (config.js) and add a function that looks like this:
        $scope.reload = function() {
            processResponse(ctrl.currentData);
        };

And store the currentData in a global variable after the data is obtained from the API calls.
With these changes, there will be no API needed to save/retrieve the config and the config is set for each individual dashboard.
Thoughts?
Screen shots:

After reading the thread, I think I follow...
Would it make more sense for the collector to record the deployment server as a compound key?
i.e.
[
  {
    "applicationId": "MyTestApp",
    "deployServer": "TestJenkins"
  },
  {
    "applicationId": "MySecondApp",
    "deployServer": "TestJenkins"
  },
  {
    "applicationId": "AnotherTestApp",
    "deployServer": "TestJenkins"
  }
]

I'm not sure exactly what the data looks like that the widget is displaying or if I completely understand the problem, but this data model would make it possible to group/aggregate by deploy server, as proposed.

@mrpudn changing the collectors / collector_items around would be a big undertaking and would most certainly not be backwards compatible.
@tabladrum Looks fine so long as the same guid implies the same name (meaning we don't care about renaming). Just note I don't see the api endpoint I made going away as there are more uses for it. For example: Configurable Pipeline Stage Names #1020

@MarkRx The "System Config" API should evolve. For this particular instance we will rely on the UI config ability.

Sounds good.

https://github.com/capitalone/Hygieia/pull/1055


COVID19_Data-Analysis

Greetings Sir/Mam,
I would like to work on this project and contribute!!
For this I have prepared a Jupyter notebook for the main code/analysis, readme file and 2 datasets.
Kindly assign me this issue.
This is regarding LGMSOC.
{Description of project}
This project helps us calculate and visualize the relationship between the spread of Corona virus in a country and how happy people are living in that country by merging two different datasets . The two datasets used includes First, Covid-19 dataset published by Jonh Hopkins university which cantains datasets related to cumulative number of confirmed cases countries per day and second, a dataset related to world happiness report, an annual publication by the United Nations.

Hii, I would like to work on this issue. Do assign me if possible. Thank You!


Test Failures on 1.8 & master

Under 1.8 and master tests, travis is currently failing on add_timeframed_query_manager raising AppRegistryNotReady (sample job).
I think providing an AppConfig and moving the signal registration to the ready ought to work, with a if not hasattr(django, 'setup') check around the old usage in models.py, though I'm perplexed as to why that isn't also a problem under 1.7.
Additionally I think the select_subclasses(ModelCls, ...) functionality may be broken under master at least--though the tests don't show such--as I believe parent_model has been dropped, possibly in favour of model.
I ought to be able to fix that, though the timeframed blocker would prevent my testing the entire build for success.

PR #161 should fix both, I think. (The select-related one was pretty simple so I just did it while I was in there.) Let's see what Travis says...

Fixed with merge of #161


Login via Proxy / VPN

My server is located on a country where betfair could not be accessed, is there any simple way or some relevant tutorial /gems you could share that could help me fixing this? Like connect via proxy / openvpn, etc (I have a PIA account..) thanks

the httpi gem which we use supports proxying, just at the moment there isn't a way to pass the options through. I'll release a new version in the next few days to support this.
:+1:

That would be awesome, I'll be waiting an update. Thanks

On betfair gem (https://github.com/lukebyrne/betfair) they already have a proxy configuration, you probably already know but just to make sure :)

Any update on this?

been busy. will take a look this week :).

Thanks! I'm impatiently waiting for it :+1:
Don't want to change server just because of this..

rightio, this should be possible now with 3b28053e4fd426786a3e9526a7151b4ceab481f3. you can pass any options that HTTPI's Request initializer accepts (http://httpirb.com/#options) as the 2nd parameter to Betfair::Client initialization, for example proxy:
client = Betfair::Client.new({ "X-Application" => "your application code" }, { proxy: 'https://my.proxy.address' })

if you could test it by using the latest code from github, then if it's all good, I'll release a new version to rubygems.

2.1.0 :019 > client.interactive_login("user@mail", "mypass")
ArgumentError: Invalid URL: <IP_ADDRESS>

i cant login anything rather than http:// (ip, https, etc.. dont work).
I would like to use PIA socks 5 proxy, do you know if its possible to use a socks5 proxy with this?
Also do I send credentials for proxy on that?
(https://www.privateinternetaccess.com/forum/discussion/258/private-internet-access-proxy-now-available-now-open)
Sorry I never used proxy, just VPN.
Thanks

i don't know anything about PIA socks 5 proxy, tbh, but a quick bit of research shows that the net-http adapter for httpi supports Net::HTTP.SOCKSProxy which sounds like it might be what you're after.
it detects whether or not you want to use this socks proxy if you use the socks uri scheme, so something like socks://<IP_ADDRESS>, i guess.

for authentication, we may need to create a pull request for httpi to allow username and password to be passed through to Net::HTTP.SOCKSProxy.

actually, that patch to support socks proxy in http hasn't been released to rubygems yet. i could probably submit a patch to httpi for the auth stuff and ask them to release it so we can update our dependency here, but i dunno when i'll have the time to look at it. feel free to take a look if you wish.

Don't worry, ill try to get an http proxy, thanks for your support. I will update here when I get success.

I am tryng some of the free proxies here http://proxylist.hidemyass.com/search-1297445#listable but seems like I can only authenticate via http which may bring security problems. when i try https i get the following error
[2015-12-06T00:11:13.164867 #5774] DEBUG -- : HTTPI POST request to identitysso.betfair.com (httpclient)
ArgumentError: unsupported proxy https://<IP_ADDRESS>:3129

None of the http proxies worked, dont know if proxy problem or betfair doesnt allow non secure connections (but should be proxy since sometimes i get error 400 bad request and error 500 internal error), but when I force https proxy to run http the request is made and in fact i receive a strange response telling the appkey is wrong when its clearly not. If I test it again without the proxy param the response is correct.
RSA 1024 bit CA certificates are loaded due to old openssl compatibility
 => {"detail"=>{"exceptionname"=>"APINGException", "APINGException"=>{"errorDetails"=>"", "errorCode"=>"INVALID_APP_KEY", "requestUUID"=>"prdang036-11240513-003a872e31"}}, "faultcode"=>"Client", "faultstring"=>"ANGX-0007"}

the https issue that you're having appears to be related to a bug in the adapter that you're using, httpclient, not allowing https proxy servers for some reason :/. you can switch adapters, to net-http for instance, by doing:
HTTPI.adapter = :net_http

i've tested with a UK proxy from http://www.xroxy.com/proxy-country-GB.htm (https://<IP_ADDRESS>:80) and it worked fine for me.

It's really strange when I request using proxy I always get error on appkey:
2.1.0 :171 >       sports = client.list_event_types(filter: {})
D, [2015-12-06T01:16:52.955375 #5774] DEBUG -- : HTTPI POST request to api.betfair.com (net_http)

 => {"detail"=>{"exceptionname"=>"APINGException", "APINGException"=>{"errorDetails"=>"", "errorCode"=>"INVALID_APP_KEY", "requestUUID"=>"prdang025-11240513-002db72638"}}, "faultcode"=>"Client", "faultstring"=>"ANGX-0007"}

maybe you're not initializing the betfair client correctly when you pass the proxy option, and it's interferring with your app key stuff.

I dont know what do do, already replaced the client file again from my files and rebooted server but the problem persists.
I noticed now that the X-Authent comes empty when I use the proxy, like this:
<EMAIL_ADDRESS>"pass")
D, [2015-12-07T00:32:46.387787 #26958] DEBUG -- : HTTPI POST request to identitysso.betfair.com (net_http)
 => {"X-Application"=>"my_app_token", "Accept"=>"application/json", "Content-Type"=>"application/json", "X-Authentication"=>""}

that means that the log-in is failing, it's not returning an authentication token.
how are you initialising the client?

HTTPI.adapter = :net_http

1
    client = Betfair::Client.new({ "X-Application" => "myappkey" }, { proxy: 'https://<IP_ADDRESS>:3128' })

2
<EMAIL_ADDRESS>"pass")

not sure what to advise, it works fine for me. the authentication is definitely failing for some reason and it's not an issue with the proxy server because the request is going through fine, we can tell that because you're getting a legitimate response.

Finally I could get a success response. tried a lot of proxies from the site you gave yesterday and only worked with one: https://<IP_ADDRESS>:80
Dunno maybe betfair it only accepts on port 80?

/shrugs. no idea. you're not likely to have great success with free proxies for anything serious anyway as they usually don't stay up for very long.

Yeah I know, I would buy something without problem but I need to know if its possible to buy some proxy without user:pw credentials as there's currently no credential supports here (if it were i would be already using my paid socks 5 proxy)
I will be looking on here for updates during the following weeks.
And once again. Thanks for your support !

i'm pretty sure that for a regular proxy credentials can be passed through by setting the proxy to something like<EMAIL_ADDRESS>

Yeah but it seems different for socks authentication. I will keep trying while wait for a reply there
https://github.com/astro/socksify-ruby/issues/1#issuecomment-162905681

okayyyyy, so, putting all the peices of this puzzle together, you should be able to get this working now by:
apply httpi changes to support socks proxy. these changes aren't released to rubygems yet so we cannot have them as a dependency of betfair, so probably the easiest way would be to load a monkey patch:
require "socksify/http"

module HTTPI
  module Adapter
    class NetHTTP
      def create_client
        proxy_url = @request.proxy || URI("")
        if URI(proxy_url).scheme == 'socks'
          proxy = Net::HTTP.SOCKSProxy(proxy_url.host, proxy_url.port)
        else
          proxy = Net::HTTP::Proxy(proxy_url.host, proxy_url.port, proxy_url.user, proxy_url.password)
        end
<EMAIL_ADDRESS>@request.url.port)
      end
    end
  end
end

module HTTPI
  class Request
    def normalize_url!(url)
      raise ArgumentError, "Invalid URL: #{url}" unless url.to_s =~ /^http|socks/
      url.kind_of?(URI) ? url : URI(url)
    end
  end
end

in your app code:
require 'betfair'
require 'httpi_patch' # require the patch above

HTTPI.adapter = :net_http

TCPSocket.socks_username = "username" # socks username
TCPSocket.socks_password = "password" # socks password

client = Betfair::Client.new({ "X-Application" => "myappkey" }, { proxy: 'socks://ipaddress:port' })

hopefully that works!

Simply amazing. I will try it tonight and confirm you.
Once again, I'm very thankfully for all your support and dedication to solve this issue

Absolutely brilliant Mike! Works smoothly

great, no problem. in order to get this working 'out the box':

i'll wait for the socksify PR to be merged & released
write a PR for httpi to allow the socks credentials to be set
update betfair's httpi dependency

I'll be following this topic and make the appropriate changes when all dependencies get updated

Is there any update regarding this issue?
Every-time I make a new installation I have to come here to check and apply the monkey patch you provided in order to put socks proxy working

Nevermind.. I forgot to update the client.rb like this https://github.com/mikecmpbll/betfair/commit/3b28053e4fd426786a3e9526a7151b4ceab481f3
Hope this could be supported by default soon to avoid having to hardcode 3 different files to have socks proxy working.

iirc i was waiting for this PR on socksify-ruby https://github.com/astro/socksify-ruby/pull/24 but it doesn't look like anything's happening with it.


Rephrase spring boot section to mention dependency management

A version is currently hardcoded in the Maven and Gradle example of the spring boot section of the documentation. Spring Boot is using dependency management to avoid specifying any version at all and this includes the Flyway dependency.
I understand that we can't assume users are using this feature so simply removing the version might not be a good idea. It would be nice to mention that users using our dependency management do not have to specify the version.
Thanks!

Thanks for the request. The update to the documentation will be released with V6.


Colorful output

That would be nice if the standard output could be also colorful like
https://github.com/felixfbecker/cli-highlight

Hey @pesarkhobeee, I hacked together a first implementation for colored output in #6. If you are interested you can try it out and let me know what you think.
One problem with colorful output is that it dts will get very slow in situations where the output is very large as there is a lot of parsing work involved for the syntax highlighting. But for these cases you could then use --color=never to disable output coloring.

@martinohmann Sadly I couldn't compile it, you can see the error message in the picture

My idea was feeding it via below command and see how colors and transformation to the YAML format will work:
docker run --rm -v $HOME/Library/Caches:/root/.cache/ aquasec/trivy:0.18.3 --ignore-unfixed --severity CRITICAL --vuln-type library --format json  docker.bintray.io/jfrog/artifactory-oss:6.8.7 > transfer_this_json_yaml_with_dts.json

@pesarkhobeee The was an issue with the clap dependency which i'm currently using in 3.0.0-rc-* since the 3.0.0 is not out yet. They seem to have changed some APIs in the most recent release candidate.
I pushed a fix and rebased the PR, it should build correctly now.

@martinohmann thanks, I tested it and it seems everything is correct and fast :)

I was thinking about two opinions, maybe changing the default color them to something like "Github" will give a better first impression to the users. the other opinion is supporting pagination because if I use less or more commands I am not able to see the output colorful anymore!

Using GitHub as a default theme is not very sensible I think. It only works well with terminals that have a light background and becomes hard to read on dark backgrounds. I'll go with base16 as a default for now as it's a good middle ground. If you prefer GitHub, just set it globally via DTS_THEME=GitHub.
If dts is piped it will not emit colors with the linked PR with --color auto which is the default. You have to force color for that by setting DTS_COLOR=always or via CLI arg:dts tests/fixtures/example.json --color always | less

I may add pagination but not as part of this issue.

thanks a lot @martinohmann, like always it was informative, would be nice if we have this kind of examples in the readme and man page too :)

I think the initial implementation of colored output is in a good enough state for now, so I merged #6.


Post deployment steps fixed (CES-10170)

Added correct credentials required for Overcloud flavors and volume creation.
Host aggregation stack creation was not working. This step is redundant so removed it rather than fixing it.

Looks good.


 As such, many fonts that are available on the host system cannot be used in the Flutter environment.
Please consider allowing a Flutter application to reference a font by its PostScript name, or some other unique identifier.

Related feature in Chromium (which may be relevant if this is implemented in Skia): https://www.chromestatus.com/feature/5676948229455872

Wanted to surface this to @GaryQian, as it seems you're involved in the Skia side of fonts.

Ping. Any desire to implement this feature? Its absence makes building desktop software with text editing capabilities fall noticeably short of native counterparts.


When I clone this project and run in Net 8.0，it can not show the list of blogs, or the other items in cms page?

It seems error happened in DbMigrationMiddleware.cs line 34 ——await next(context)

I found out , it's "yarn" be not installed.


yAxis.nicing: true does not set a nice (or even labeled) max tick value

code sample:
$(function () {
    new Contour({
        el: '.myLineChart',
        yAxis: { nicing: true }
      })
    .cartesian()
    .line([0.8, 2, 4, 5, 8.2, 11.5])
    .render();
});

behavior with 0.9.80:

behavior with 0.9.105:

we'd like to have the max tick mark labeled, and at a "nice" value.

verified in 0.9.108


[mainnet] EAS support OP runbook review

Need to get OP's review on the EAS support runbook

Reviewed. This LGTM.

Review Error for maurelian @ 2023-09-05 15:00:55 UTC
User must have write permissions to review

Review Error for maurelian @ 2023-09-05 20:19:18 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help

Review Error for maurelian @ 2023-09-05 20:20:40 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help


[SPARK-38449][SQL] Avoid call createTable when ignoreIfExists=true and table exists

What changes were proposed in this pull request?
In current V2 code, we can see that when table exist and ignoreIfExists = true,  spark won't do nothing
case class CreateTableExec(
    catalog: TableCatalog,
    identifier: Identifier,
    tableSchema: StructType,
    partitioning: Seq[Transform],
    tableSpec: TableSpec,
    ignoreIfExists: Boolean) extends LeafV2CommandExec {
  import org.apache.spark.sql.connector.catalog.CatalogV2Implicits._

  val tableProperties = CatalogV2Util.convertTableProperties(tableSpec)

  override protected def run(): Seq[InternalRow] = {
    if (!catalog.tableExists(identifier)) {
      try {
        catalog.createTable(identifier, tableSchema, partitioning.toArray, tableProperties.asJava)
      } catch {
        case _: TableAlreadyExistsException if ignoreIfExists =>
          logWarning(s"Table ${identifier.quoted} was created concurrently. Ignoring.")
      }
    } else if (!ignoreIfExists) {
      throw QueryCompilationErrors.tableAlreadyExistsError(identifier)
    }

    Seq.empty
  }

But in current v1 code, it still will call externalCatalog.createTable()
And for current InMemoryCatalog.createTable(), there is even no code to handle concurrent create table request.
So here, we can handle it like v2 too. Under this case we just can do nothing.
Why are the changes needed?
Remove unnecessary call create table, especially hive metastore
Does this PR introduce any user-facing change?
No
How was this patch tested?

ping @cloud-fan

thanks, merging to master!


[WEB-SDK] - Add Payment Method with Dynamic Field Rendering - Givex

The Hyperswitch SDK is a versatile tool built to streamline payment integration for developers. It simplifies the process of adding multiple payment methods, allowing you to quickly implement support for various gateways without the need to manually integrate each one. With Hyperswitch, you can efficiently manage payments across platforms, reducing complexity and boosting development speed.
Getting started

Get familiar with ReScript.
Check the README.md for project structure and setup instructions.
To setup locally, follow these steps

#  Clone repository
cd hyperswitch-web
yarn install
yarn run server     # This starts the mock server
yarn run re:start   # In another terminal

# Start Demo App in another terminal
cd hyperswitch-react-demo-app
yarn install
yarn run start        # This starts the demo app

Description:
We are looking to implement a new payment method in our WebSDK that supports dynamic field rendering. The goal is to allow the backend to define the fields required for the payment method and have the frontend WebSDK render these fields dynamically based on the response.
This feature should be flexible enough to handle different payment methods, each potentially requiring different types of input fields (e.g., text fields, dropdowns, checkboxes, etc.).

Requirements:

Payment Method Integration Details:
In this section, we provide details on the payment call response and the confirm call payload for the newly integrated payment method. Ensure you have configured the payment method at Hyperswitch Dashboard correctly. The backend already includes support for this payment method, so no additional configuration is needed.
Payment Method List Response for Givex -
{
  "payment_method": "gift_card",
  "payment_method_types": [
    {
      "payment_method_type": "givex",
      "payment_experience": [
        {
          "payment_experience_type": "redirect_to_url",
          "eligible_connectors": ["adyen"]
        }
      ],
      "card_networks": null,
      "bank_names": null,
      "bank_debits": null,
      "bank_transfers": null,
      "required_fields": {
        "payment_method_data.gift_card.cvc": {
          "required_field": "payment_method_data.gift_card.cvc",
          "display_name": "gift_card_cvc",
          "field_type": "user_card_cvc",
          "value": null
        },
        "payment_method_data.gift_card.number": {
          "required_field": "payment_method_data.gift_card.number",
          "display_name": "gift_card_number",
          "field_type": "user_card_number",
          "value": null
        }
      },
      "surcharge_details": null,
      "pm_auth_connector": null
    }
  ]
}

Confirm call Payload should look like:
curl --location 'http://localhost:8080/payments' \
--header 'Content-Type: application/json' \
--header 'Accept: application/json' \
--header 'api-key: dev_gRhGuLackoI3xKj28l7FmpKvA1dIueUXXRZhVqb8XQxdidicq3jpPS9s32YVuuIH' \
--data '{
	"amount": 1100,
	"currency": "EUR",
	"confirm": true,
	"capture_method": "automatic",
	"capture_on": "2022-09-10T10:11:12Z",
	"amount_to_capture": 1100,
	"phone_country_code": "+1",
	"description": "Its my first payment request",
	"authentication_type": "no_three_ds",
	"return_url": "https://duck.com",
	"payment_method": "gift_card",
	"payment_method_type": "givex",
	"payment_experience": "redirect_to_url",
	"payment_method_data": {
 	"gift_card": {
   	"givex": {
       	"number": "6364530000000000",
       	"cvc":"73737"
   	}
 	}
	}
}'

Dynamic Field Rendering:

Based on the backend response, the WebSDK should dynamically generate the necessary input fields.
Each field should be properly validated (e.g., required, length, pattern matching) based on the backend specifications.
Support different types of fields such as:

Text fields (e.g., for name, card number)
Select dropdowns (e.g., for country or card type)
Checkbox fields (e.g., for terms and conditions)

User Inputs:

Once the user fills in the fields, the WebSDK should package the input data and send it back to the backend for payment processing.

Contribution Guidelines:

Fork the repository and create a new branch for your work.
Ensure the WebSDK follows best practices for API integration and field rendering.
Write clean, well-documented code with clear commit messages.
Add unit tests to ensure the dynamic field rendering works as expected.
Make sure to follow our coding standards and contribution guidelines.

Helpful Resources:

Link to WebSDK documentation: WebSDK Docs
Link to the API endpoint specifications: API Docs

Submission Process:

Ask the maintainers for assignment of the issue, you can request for assignment by commenting on the issue itself.
Once assigned, submit a pull request (PR).
Maintainers will review and provide feedback, if any.
Maintainers can unassign issues due to inactivity, read more here.

Refer here for Terms and conditions for the contest.
If you have any questions or need help getting started, feel free to ask in the comments!

Hello @gorakhnathy7 @sakksham7 ,
I would like to take this issue as hacktoberfest contributer, please assign it to me.

[x] I followed the README for guidelines on file structure and formatting.
[x] I ensured adherence to API integration and field rendering best practices.
[x] I will write clean, well-documented code with clear commit messages.
[x] I complying with coding standards and contribution guidelines.

Thank You


files.autoSave closes snippets editor

When using the following VSCode setting editing a snippet is quite annoying, as the editor is automatically closed on save:
  "files.autoSave": "afterDelay",

Is it possible to change this behavior somehow?

Thank you for your advice. We added an autoCloseSnippetBodyEditor option to control this, and it's available in v0.1.22. 🎉

Thanks for the quick fix. Works just as it should!!


[Config] Fix Set list path

Q
A

Bugfix
yes

Hi @TomasVotruba,
I tried create custom Rector SetList class for laminas-servicemanager-migration, named: Laminas\ServiceManager\Migration\Rector\Set\ValueObject\SetList, so it need to be usable to:
<?php
// rector.php
declare(strict_types=1);

use Rector\Core\Configuration\Option;
use Laminas\ServiceManager\Migration\Rector\Set\ValueObject\SetList;
use Symfony\Component\DependencyInjection\Loader\Configurator\ContainerConfigurator;

return static function (ContainerConfigurator $containerConfigurator): void {
    $parameters = $containerConfigurator->parameters();
    $parameters->set(Option::PATHS, [__DIR__ . '/module']);

    $parameters->set(Option::SETS, [
        SetList::LAMINAS_SERVICEMANGER_40,
    ]);
};

However, when I tried, it shows that Set was not found:
➜  laminas-mvc-skeleton vendor/bin/rector process module/Application/src/Listener

 [ERROR] Set
         "/Users/samsonasik/www/laminas-mvc-skeleton/vendor/laminas/laminas-servicemanager-migration/src/Rector/Set/Valu
         eObject/../../../../config/rector/set/laminas-servicemanager-40.php" was not found

 ! [NOTE] Pick one of:

 * defluent
 * action-injection-to-constructor-injection
 * array-str-functions-to-static-call
 * cakephp30
 * cakephp34
 .
 .
 .

I re-check the path even with realpath, and the path actually correct.
Do you have idea how to make it works? Thank you.

Hi, I'd try to run the command with --debug. See the class this exception is thrown.

@TomasVotruba thank you, using --debug got the same output. Also tried dev-main as 0.9.31 to get latest got different error, but the Pick one of is now exploded by -:
vendor/bin/rector process module/Application/src/Listener --debug

 [ERROR] Set
         "/Users/samsonasik/www/laminas-mvc-skeleton/vendor/laminas/laminas-servicemanager-migration/src/Rector/Set/Valu
         eObject/../../../../config/rector/set/laminas-servicemanager-40.php" was not found

 ! [NOTE] Pick one of:

 * d-e-f-l-u-e-n-t
 * a-c-t-i-o-n-i-n-j-e-c-t-i-o-n-t-o-c-o-n-s-t-r-u-c-t-o-r-i-n-j-e-c-t-i-o-n
 * a-r-r-a-y-s-t-r-f-u-n-c-t-i-o-n-s-t-o-s-t-a-t-i-c-c-a-l-l
 * c-a-k-e-p-h-p30
 * c-a-k-e-p-h-p34
 * c-a-k-e-p-h-p35
 * c-a-k-e-p-h-p36
 * c-a-k-e-p-h-p37
 * c-a-k-e-p-h-p38
 * c-a-k-e-p-h-p40
 * c-a-k-e-p-h-p41
 * c-a-k-e-p-h-p42
 * c-a-k-e-p-h-p-f-l-u-e-n-t-o-p-t-i-o-n-s
 * c-o-d-e-q-u-a-l-i-t-y

The realpath of set actually found:
php > echo realpath('/Users/samsonasik/www/laminas-mvc-skeleton/vendor/laminas/laminas-servicemanager-migration/src/Rector/Set/ValueObject/../../../../config/rector/set/laminas-servicemanager-40.php');

/Users/samsonasik/www/laminas-mvc-skeleton/vendor/laminas/laminas-servicemanager-migration/config/rector/set/laminas-servicemanager-40.php

@TomasVotruba it seems it because the rector's RectorSetProvider::SET_LIST_CLASSES defined constant so it can't be customized, ref:
https://github.com/rectorphp/rector/blob/c815334bed781c555f08dff82ce7861d758e9e7a/packages/Set/RectorSetProvider.php#L30
I will check if I can update it to make it extendable.

I've added handling use custom set list at https://github.com/rectorphp/rector/pull/5894 🎉

I got the solution as commented at https://github.com/rectorphp/rector/issues/5891#issuecomment-803291383 . I will update the documentation.

tested and it works 🎉

Documentation config example updated. Merging ... 🎉


Document error

" Visual Studio integrated development environment (IFE) ", should be IDE.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a0be310e-4cea-4cb7-3fad-578140c35e0a
Version Independent ID: a61988d8-f1c9-e283-b071-5cc024c42ca1
Content: Overview of Azure Sphere applications
Content Source: AzureSphere/articles/app-development/applications-overview.md
Product: azure-sphere
GitHub Login: @pennyo
Microsoft Alias: azurespheredocs

@xiongyu0523 Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

Fixed, verified, and closed.