Gradient of scipy.sparse.spsolve

I'm interested in using autograd for applications where one has an objective J(x) where the vector x is the solution to the sparse linear system Ax = b.
How could one implement the gradient of x = spsolve(A, b) using autograd?
It is well known that dx/dp = d/dp [ inv(A) b ] = -inv(A) dA/dp x but I am not sure how to translate this into autograd function.
Are there any alternatives?  Perhaps if the matrix A is in LU decomposition form one may use solve_triangular  from scipy.lilnalg?
Thanks
Tyler

Sounds like photonic inverse design?
I tried this (not for photonic inverse design) a couple weeks ago.  I wrapped up the sparse matrix operations in primitives so autograd didn't have to see them, and sent in the val+row+col data as the arguments to the linear system solver.  This way I was able to get only the gradient with respect to the nonzeros in the matrix, which is of course what you would want (prevent explosion into a dense vector).
I think it might work very nicely for permittivities.  In my experience runtime will depend on how efficiently you can create the nonzero values.  In my application I couldn't figure out a way to make the values efficiently and the runtime was horrific.

@plisdku Yes this is exactly right :D  If you have that code I'd love to see it.  The plan was to write some package for doing fully automated adjoint-based optimization of photonic structures.  Perhaps we could chat some time about it.

see also https://github.com/HIPS/autograd/issues/80#issuecomment-429158923

I wrapped up the sparse matrix operations in primitives so autograd didn't have to see them, and sent in the val+row+col data as the arguments to the linear system solver. This way I was able to get only the gradient with respect to the nonzeros in the matrix, which is of course what you would want (prevent explosion into a dense vector).

Yes, this works very nicely. For the record (I already showed this to @twhughes) you can find a version of this as an Autograd primitive here:
https://github.com/google-research/neural-structural-optimization/blob/07ce57f9045ed7b32fd44e67c546352dc9034f60/neural_structural_optimization/autograd_lib.py#L156-L203


starbook theme class

Completed Theme class. check #277  @hashirshoaeb

Design is not ready, so we will not be able to generate theme class for now


serial blocks are hidden in adfruit and maker

In the adafruit circuit playground and in the maker tool the serial blocks are hidden. You can access the functions in java and you can see the serial blocks listed properly in the support documents for these two apps. I've tried the windows 10 adafruit app and it has the same missing serial blocks issue running the app locally as it does running it on in a browser on the web. Also may I ask how to use the webusb. I saw mention of it and it sounds exciting. It will be way easier for students to upload using a direct usb connection. Keep up all the exciting work. The serial blocks are still available in microbit.

Serial blocks are renamed to console as they are more student friendly and should work on windows app.

Webusb is still in experimental phase and questions are mostly related to security and usability of the prompts. Also webusb is not a web standard and still a proposal for W3C.

Does this mean the missing serial blocks are still being moved to the
console tab. What about write number, write line, read line, read line
until, read string, serial redirect, etc. I would hate to see all of those
blocks go away. It will really impact the functionality of working with
serial data using blocks.
On Mon, Apr 2, 2018 at 4:38 PM, Abhijith Chatra<EMAIL_ADDRESS>wrote:

Serial blocks are renamed to console as they are more student friendly and
should work on windows app.
[image: image]
https://user-images.githubusercontent.com/6107272/38221397-27bc70ba-3694-11e8-8cf7-bb7ec3cf0c27.png
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Microsoft/pxt/issues/4040#issuecomment-378081758, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AZlqVCHQDiH_pogUUgisyCMCnm5jFBD1ks5tkrZwgaJpZM4TCq5z
.


Added sequel gem that provides a general API for database access.

Hi there!
I hope you will find this pull request acceptable.
Basically, I just added the sequel and pg gem.
I could have just added the pg gem and a couple of adapter files to implement the same behaviour without the need of the sequel gem, but I thought that using sequel was easier and will give us the possibility of adding more database adapters in the future without writing a line of code.

Yes, that's cool


Action support in netopeer2-server

Hi
I have some problem to assert an action (Yang 1.1) to netopeer2-server.
From my NETCONF client (NETCONFc) I send an action but netopeer2-server claims in this way
May 30 12:36:32 sysrepo netopeer2-server[5503]: Session 1: received message: <?xml version="1.0" encoding="UTF-8"?> <rpc xmlns="urn:ietf:params:xml:ns:netconf:base:1.0" message-id="e96d6d1e-e935-11e6-81fb-b870f4ee5398">   <action xmlns="urn:ietf:params:xml:ns:yang:1">     <cli:config xmlns:cli="http://www.tiesse.com/ns/tiesse-cli/1.0">       <dhcp-server:dhcp-server xmlns:dhcp-server="urn:ietf:params:xml:ns:yang:tiesse-dhcp-server">         <dhcp-server:on/>       </dhcp-server:dhcp-server>     </cli:config>   </action> </rpc>
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting "rpc" with collision
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "urn:ietf:params:xml:ns:netconf:base:1.0"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting "message-id" with collision
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting "e96d6d1e-e935-11e6-81fb-b870f4ee5398" with collision
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "action"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "urn:ietf:params:xml:ns:yang:1"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "config"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "cli"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "http://www.tiesse.com/ns/tiesse-cli/1.0"
May 30 12:36:32 sysrepo netopeer2-server[5503]: DICT: inserting (refcount) "dhcp-server"
May 30 12:36:32 sysrepo netopeer2-server[5503]: Session 1: sending message: <rpc-reply xmlns="urn:ietf:params:xml:ns:netconf:base:1.0" message-id="e96d6d1e-e935-11e6-81fb-b870f4ee5398"><rpc-error><error-type>protocol</error-type><error-tag>operation-not-supported</error-tag><error-severity>error</error-severity><error-message xml:lang="en">Request could not be completed because the requested operation is not supported by this implementation.</error-message></rpc-error></rpc-reply>
May 30 12:36:32 sysrepo netopeer2-server[5503]: Session 1: sending message:  ##

The I have tried to assert the same action from netopeer2-cli by the following file (/tmp/action)
<action xmlns="urn:ietf:params:xml:ns:yang:1">
      <cli:config xmlns:cli="http://www.tiesse.com/ns/tiesse-cli/1.0">
            <dhcp-server:dhcp-server xmlns:dhcp-server="urn:ietf:params:xml:ns:yang:tiesse-dhcp-server">
                    <dhcp-server:on/>
             </dhcp-server:dhcp-server>
      </cli:config>
</action>

from inside netopeer2-cli
> user-rpc --content /tmp/action
nc VERBOSE: <rpc-error> <error-message> without the recommended "xml:lang" attribute.
ERROR
        type:     protocol
        tag:      operation-not-supported
        severity: error
        message:  Request could not be completed because the requested operation is not supported by this implementation.

The answer is the same received from the NETCONF client.
Then I have tried to assert the same action directly to sysrepo by a command of mine
~ # sysrepo-action-sender -x /tiesse:config/tiesse-dhcp-server:dhcp-server/on

and the action callback has been properly invoked by sysrepod
here below some traces from sysrepo-plugind
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] fd 3 readable
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] 136 bytes of data received on fd 3
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] fd 3 would block
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] New message of size 132 bytes received.
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] Received Action request for subscription id=2033137842.
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] Calling Action callback for subscription id=2033137842.
May 30 12:43:24 sysrepo sysrepo-sysrepo-plugind[5760]: [DBG] tiesse-dhcp-server: tiesse-dhcp-server: ACTIONS plugin handler called for xpath /tiesse:config/tiesse-dhcp-server:dhcp-server/on

So my feeling is that netopeer2-server is missing something.
Have I to enable YANG 1.1 support in some way?
Thanks a lot for your feedback
fabio

Hi Fabio,
could you please provide the schemas? Thanks.
Regards,
Michal

Hi Michal
here below the excerpt of the schemas
 augment "/cli:config" {
     container "dhcp-server" {
         leaf "active" {
             type cli-types:onoff;
             description "[hidden] Admitted values: on/off";
             default "off";
         }
         action on {}
         action off {}
         list server {
             key "name";
             leaf "name" {
                 type "string";
                 description "[hidden] Dhcp server name";
             }
             uses dhcp-params;
                  action on {}
                  action off {}
             description "[hidden|noexec] Dhcp server list";
         }
         description "[deleteflag] Dhcp server container";
     }
 }

thanks
fabio
On 02/02/2017 13:13, michalvasko wrote:

Hi Fabio,
could you please provide the schemas? Thanks.
Regards,
Michal
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/CESNET/Netopeer2/issues/97#issuecomment-276941976,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFpJncBHmSGYKJRWEkz2qWEA-UOqsr_rks5rYchvgaJpZM4L1AJl.

Hi Fabio,
are you using master or devel branches?
Michal

I'm using the master branch for all the packages
thanks
fabio
On 02/02/2017 14:58, michalvasko wrote:

Hi Fabio,
are you using |master| or |devel| branches?
Michal
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/CESNET/Netopeer2/issues/97#issuecomment-276963855,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFpJnSaMl3H9b_xAmCn6Uqe9LtBb93bdks5rYeDpgaJpZM4L1AJl.

Because I am using actions quite a lot lately and had no problems, but I use the devel branch. Could you please try it?
Michal

AT the moment I cannot switch all the packages to the devel
is it possible to use the devel branch only for Netopeer2 and Libyang?
When do you plan to merge the devel into the master branch?
thanks a lot
fabio
On 02/02/2017 15:02, michalvasko wrote:

Because I am using actions quite a lot lately and had no problems, but
I use the |devel| branch. Could you please try it?
Michal
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/CESNET/Netopeer2/issues/97#issuecomment-276965028,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFpJnVww43aeMeLOKLLHAS9u6JPdMAp_ks5rYeHwgaJpZM4L1AJl.

No, you would have to use devel of libyang, libnetconf2, netopeer2-server, and sysrepo. We plan to do the merge at the end of February, could you maybe wait until then? If not, then I will try it myself on master and find the bugfixes from devel that will fix the issue, if I manage to reproduce it, but it will take some of my time, so I would rather avoid it.
Michal

Hi Michal
thanks a lot for your support
We can wait because the actions are working writing directly to
sysrepod. SO we can test them from the shell.
with regards
fabio
On 02/02/2017 15:10, michalvasko wrote:

No, you would have to use |devel| of libyang, libnetconf2,
netopeer2-server, and sysrepo. We plan to do the merge at the end of
February, could you maybe wait until then? If not, then I will try it
myself on |master| and find the bugfixes from |devel| that will fix
the issue, if I manage to reproduce it, but it will take some of my
time, so I would rather avoid it.
Michal
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/CESNET/Netopeer2/issues/97#issuecomment-276967274,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFpJnXSdsiDVJd4hsXKmIas__j7gr3y9ks5rYePbgaJpZM4L1AJl.

I have successfully verified the Action feature with the devel branches. It works fine. So the issue can be closed. Thanks
fabio


Fails to execute 'getImageData' on 'CanvasRenderingContext2D'

I got Uncaught TypeError: Failed to execute 'getImageData' on 'CanvasRenderingContext2D': The provided float value is non-finite. error while executing below snippet.
            var canvas = document.getElementById('canvas');
            canvas.width = 150;
            canvas.height = 150;

            var context = canvas.getContext('2d');
            context.font = "bold 70px Helvetica"
            context.textAlign = 'center'
            context.textBaseline = 'middle'
            context.lineWidth = 3;
            context.fillStyle = "rgb(0, 0, 0)";

            var gif = new GIF({
              workers: 2,
              quality: 10
            });

            gif.addFrame(context, {copy: true, delay: 200});

Odd, can you link a jsfiddle or similar where you can reproduce it?

/r/reddit issue? I seem to have "upset" the "higher powers" if you will for some odd reason. Non related to reddit rather Ello.com?? Wayback internet archive???  And of course Googlewemaster cache bla bla bla..I am a loyal Apple advocate; hence I'm using mobile e.g, IPad Air 2 and IPhone 6+ certain links, media Are censored, i'm certain you Know this Vk.com is Russian social media?  Quite contrary to media of choice...I read the disclaimers, privacy, intellectual property, as well as Safe Harbor Act both versions, Freedom of Information Act, Digital millennium mobilization Act bla bla bla...Get My drift?  Sorry, My apologies for digressing.  I enjoy social media, love writing (literature, creative writing) that's my thing.  I'm well-traveled, cultured, comical and Self deprecating but "Those" like to Challenge me??  I'm a Fan or Foe with social "Friends". As s female, I yearn for intelligent communications..they're out there they find me for certain or various links I'm pretty transparent, but ambiguious, I Prefer for various geographical "small town small mind". I welcome suggestions, Feedback etc. I was Hoping to create a repository (Outing ill minded, hackers, trolls, digital terrorists, anti-Progressives etc...  And can use a Public Benefit Corporation as well, it's for a good "cause" Benefits there Are a plethora to Choose.  Let me Know how I can help...no outer or external "influences" Trust that...you can take that to the "bank" !  No pun intended, well maybe a little!  I'm ornery and like wine as aging it matures!  So go figure ?

Hey @bitshadow since you are passing a context you should specify the width and the height of the canvas (according to this encoder) at the time of initializing the gif. If you will use gif.render() after adding your frame you will get this error message of adding width and height at the time of initialization.

It determines width and height from the first frame. https://github.com/jnordberg/gif.js/blob/master/src/gif.coffee#L12
Looks like the issue is here. https://github.com/jnordberg/gif.js/blob/master/src/gif.coffee#L48
AddFrame can have image and context as (image) param. Actual image can have width and height. But to get size from context we need to use canvas. ex. context.canvas.width && context.canvas.height.

yes I was about to submit that patch too, but to resolve your issue in the existing code you can specify the width and the height at the time of initialization till my patch doesn't get merged.

@anuragagarwal561994 help me very well, thanks!


Can't install from documentation

Plone version: 6.0.0b3
Volto version: 16.0.0-alpha.42

I'm trying to install with yarn add volto-form-blockon a cookiecutter installation and I get the following message
yarn add v1.22.19
$ if [ -f $(pwd)/mrs.developer.json ]; then if [ -f $(pwd)/node_modules/.bin/missdev ]; then yarn develop; else yarn develop:npx; fi; fi
yarn run v1.22.19
$ missdev --config=jsconfig.json --output=addons --fetch-https

Using src/addons
Update paths in tsconfig.json

✨  Done in 0.33s.
error Running this command will add the dependency to the workspace root rather than the workspace itself, which might not be what you want - if you really meant it, make it explicit by running this command again with the -W flag (or --ignore-workspace-root-check).
info Visit https://yarnpkg.com/en/docs/cli/add for documentation about this command.

I then tried yarn add volto-form-block -W, followed by make build-frontend. When I run make start-frontend I get the following error:
yarn run v1.22.19
$ razzle start
 WAIT  Compiling...

✔ Client
  Compiled successfully in 470.57ms

✔ Server
  Compiled successfully in 5.84s

/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/node_modules/@plone/volto/src/config/server.js:8
  expressMiddleware: [
^
TypeError: Object(...) is not a function
    at /Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/node_modules/@plone/volto/src/express-middleware/devproxy.js:44:1
    at<EMAIL_ADDRESS>(/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/node_modules/@plone/volto/src/config/server.js:8:1)
    at __webpack_require__ (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:754:1)
    at fn (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:59:1)
    at<EMAIL_ADDRESS>(/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/node_modules/@plone/volto/src/config/index.js:63:1)
    at __webpack_require__ (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:754:1)
    at fn (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:59:1)
    at<EMAIL_ADDRESS>(/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/server.js:118604:77)
    at __webpack_require__ (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:754:1)
    at fn (/Users/gustavoborges/Documents/projects/ifabr/ifa-br/frontend/build/webpack:/webpack/bootstrap:59:1)
sswp> !!! Script exited with code 1

I'm also unable to install it with yo @plone/volto on a dockerfile
RUN yo @plone/volto \
    plone-frontend \
    --description "Plone frontend using Volto" \
    --addon "@eeacms/volto-listing-block" \
    --addon "volto-form-block" \
    --skip-install \
    --skip-workspaces \
    --volto=${VOLTO_VERSION} \
    --no-interactive

RUN cd plone-frontend \
    && yarn install \
    && yarn build

#14 256.3 success Saved lockfile.
#14 256.3 $ yarn omelette && yarn patches
#14 256.5 yarn run v1.22.19
#14 256.5 $ if [ ! -d omelette ]; then ln -sf node_modules/@plone/volto omelette; fi
#14 256.6 Done in 0.05s.
#14 256.7 yarn run v1.22.19
#14 256.7 $ /bin/bash patches/patchit.sh > /dev/null 2>&1 ||true
#14 256.8 Done in 0.06s.
#14 256.8 Done in 256.27s.
#14 257.9 yarn run v1.22.19
#14 257.9 $ razzle build --noninteractive
#14 259.9 /build/plone-frontend/node_modules/@plone/scripts/node_modules/razzle/scripts/build.js:10
#14 259.9   throw err;
#14 259.9   ^
#14 259.9
#14 259.9 TypeError: Cannot destructure property 'include' of 'options.webpackOptions.babelRule' as it is undefined.
#14 259.9     at defaultModify (/build/plone-frontend/node_modules/@plone/volto/razzle.config.js:234:11)
#14 259.9     at modifyWebpackConfig (/build/plone-frontend/node_modules/@plone/volto/razzle.config.js:317:27)
#14 259.9     at /build/plone-frontend/node_modules/@plone/scripts/node_modules/razzle/config/createConfigAsync.js:1023:22
#14 259.9 error Command failed with exit code 1.
#14 259.9 info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

@pnicolli Same here<EMAIL_ADDRESS>/frontend/build/webpack:/node_modules/@plone/volto/src/config/server.js:8
  expressMiddleware: [
^
TypeError: Object(...) is not a function...

@pnicolli Also when using upgrade_to_volto16 branch

@pnicolli Ok, this is because of dependency: volto-subblocks.
You need to merge and release:

https://github.com/collective/volto-form-block/pull/47
https://github.com/collective/volto-subblocks/pull/6

Also update the dependency:

https://github.com/collective/volto-form-block/blob/upgrade_to_volto16/package.json#L35

We usually use * in add-ons, and pin them in volto-projects. Otherwise it's a nightmare with this version pins.

Yeah, working on some testing myself these days, there are several things to put together as I am working on updating several add-ons.
Regarding the dependency, I would suggest (and will probably also try asap) using peer dependencies in order to delegate version choice in the volto project, so you can also trigger warning for improper version choices.

Meanwhile, I moved volto-subblocks to peer dependencies in the upgrade_to_volto16 branch, in order to continue testing.

Released version 3.0.0 of this add-on with the aforementioned PRs released. Currently testing it myself, I'll keep you posted.

From the first manual tests, version 3.0.0 of the add-on seems to be working. I'm currently testing plone 6.0.0b3 with volto 16.0.0-alpha.45.
Let me know if the issue is solved or if you find any other problems.
Thanks

I don't understand why we're dealing with this problem.
Of course, we also have yarn as a saboteur. I have found that the problem with the express middleware is that the webpack-dev-server depends on http-proxy-middleware 0.19, while Volto wants a 2.0.1 release. But hoisting and everything gets the wrong version in the top level. So in my project I pinned http-proxy-middleware in package.json:
  "resolutions": {
    "http-proxy-middleware": "2.0.1"
  },


Update permissions-reference.md

It should be clearly stated that User Administrator cannot modify security questions for password reset operation. I've added it.

@rolyon
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Hi @azarboon
Thanks for your contribution. We'll work on getting this added to the docs.
thanks

#sign-off


Forward port the ability to create a ConfigMap at the project scope

Some people asked questions about the ability to create project-scoped Secrets and ConfigMaps in Rancher v2.6, so I have opened this issue to track the last project-related feature that was not forward ported to the new UI.
As of 2.6, the ability to create project scoped Secrets is still possible, but is gated behind a feature flag. A similar process to create project-scoped ConfigMaps is not in 2.6, but could be added if someone requests it.
In Rancher v2.6, he workflow for creating project scoped Secrets is:

Go to Global Settings and click Feature Flags
Go to legacy and click ⋮ > Activate
Go to cluster explorer and go to Legacy > Project
In the top nav bar, filter to see only one project
In the left nav bar, click Secrets under Project
Click Add Secret

If the ability to create a project scoped ConfigMap is added, the workflow would be the same as the one for creating project scoped secrets. The form to create them would use iFrames for the Ember UI.

The steps to use the project scoped ConfigMap are:

Go to Global Settings and click Feature Flags

Go to legacy and click ⋮ > Activate

Go to cluster explorer and go to Legacy > Project

In the top nav bar, filter to see only one project

In the left nav bar, click Config Maps under Project

Click Add Config Map

Create Config Map with random key and value

Test Environment:
Rancher version: v2.6-head da382a8
Rancher cluster type: HA
Docker version: 20.10
Downstream cluster type: AWS EC2

Testing:
Tested this issue with the following steps:

Go to Global Settings and click Feature Flags
Go to legacy and click ⋮ > Activate
Go to cluster explorer and go to Legacy > Project
In the top nav bar, filter to see only one project
In the left nav bar, click Config Maps under Project
Click Add Config Map

Create Config Map with random key and value

Result - Pass
Config Map is successfully created at the project scope

@sowmyav27 @nwmac

Confirmed with @catherineluse and @gaktive to add release note label.


Select element in jfxlistview

Hi, how can i select label from sublist in jfxlistview? Method getSelectedIndex always returns -1. :(

Hi, Well sublists in jfxlistview will be removed in next release, thus it's no longer supported.


ValueError: too many values to unpack (expected 5)

Hello
I have been trying to use compass but I get the following error, but given my limited knowledge I'm not able to find the issue.
This is my script
. /tools/Miniconda3.7/etc/profile.d/conda.sh
conda activate /data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass

which compass

compass --data-mtx compass_adipocytes_only_input_transposed.tsv genes.csv --num-processes 10 --species mus_musculus

# To deactivate an active environment, use:
conda deactivate
exit

And here is the error:
[diogomoraes@lobster compass]$ ./metabolismanalysis.sh
/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/bin/compass
Warning: The arguments used in the temporary directory,  /data04/projects04/MarianaBoroni/adipocyte_int/bin/compass/_tmp , are different from current arguments. Cached results may not be compatible with current settings
Differing arguments:  ['data', 'data_mtx', 'species']
Enter y or yes if you want to continue Compass and used cached results.
 Otherwise rerun Compass after removing/renaming the temporary directory or changing the --temp-dir argument
y
Evaluating Reaction Penalties...
Traceback (most recent call last):
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/bin/compass", line 8, in <module>
    sys.exit(entry())
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/main.py", line 500, in entry
    args)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/compass/penalties.py", line 57, in eval_reaction_penalties
    expression = utils.read_data(expression_file) #pd.read_csv(expression_file, sep='\t', index_col=0)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/utils.py", line 54, in read_data
    return read_mtx(data[0], data[1], data[2])
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/utils.py", line 60, in read_mtx
    mtx = scipy.io.mmread(mtx_file)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/scipy/io/mmio.py", line 72, in mmread
    return MMFile().read(source)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/scipy/io/mmio.py", line 423, in read
    self._parse_header(stream)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/scipy/io/mmio.py", line 487, in _parse_header
    self.__class__.info(stream)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/scipy/io/mmio.py", line 230, in info
    [asstr(part.strip()) for part in line.split()]
ValueError: too many values to unpack (expected 5)

As far as I can tell, this indicates the gene expression matrix is not in the matrix market format scipy wants when reading the header. The first lines should look something like this:
%%MatrixMarket matrix coordinate real general
%
40152 40 752673
Where 40152 is the number of rows, 40 is the number of columns, and 752673 is the number of nonzero entries. I would recommend trying to convert it to mtx format. If you want to send something formatted like the file you have here or to<EMAIL_ADDRESS>I can take a look and give more details.

As far as I can tell, this indicates the gene expression matrix is not in the matrix market format scipy wants when reading the header. The first lines should look something like this:
%%MatrixMarket matrix coordinate real general
%
40152 40 752673
Where 40152 is the number of rows, 40 is the number of columns, and 752673 is the number of nonzero entries. I would recommend trying to convert it to mtx format. If you want to send something formatted like the file you have here or to<EMAIL_ADDRESS>I can take a look and give more details.

Thank you Schel
Now I feel stupid because I structured the data in a tsv format and forgot to change the script! This was definitely the issue.
However, I'm getting a different error this time:
Evaluating Reaction Penalties...
Traceback (most recent call last):
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/bin/compass", line 8, in <module>
    sys.exit(entry())
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/main.py", line 500, in entry
    args)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/compass/penalties.py", line 99, in eval_reaction_penalties
    input_knn=input_knn, output_knn=output_knn, latent_input=latent_input)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/compass/compass/penalties.py", line 162, in eval_reaction_penalties_shared
    reaction_expression = pd.concat(reaction_expression, axis=1)
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/pandas/core/reshape/concat.py", line 284, in concat
    sort=sort,
  File "/data04/projects04/MarianaBoroni/lbbc_members/lib/conda_envs/compass/lib/python3.6/site-packages/pandas/core/reshape/concat.py", line 331, in __init__
    raise ValueError("No objects to concatenate")
ValueError: No objects to concatenate

This looks related to the issue here https://github.com/YosefLab/Compass/issues/45
I am not certain of the cause of this issue, but first I would suggest trying to parse the data in python using pandas.read_csv("expression.tsv", sep="\t", index_col=0) and see if the data has been read correctly.


Update source-code-explore.md

Coverage remained the same at 87.282% when pulling bd133af3557f41e3eee799668deef9d6bffb027d on qianL93:patch-1 into 3b8c87c25cf6acf44f0ec619f21705358e4fec7e on dvajs:master.


Update meta utility

It may be useful to be able to inspect metadata file. Also sometime we may need to manually edit it: change disk_consistent/prev_record lsn.

+1, tools like this are golden when debugging.
Another thought: the metadata is very small, and isn't updated very often so it's not performance-critical. How about writing the metadata file in a text or JSON format, so that it would be easy to edit manually? The checksum makes that a bit tricky though..

This branch contains garbage commit.


builder.Prompts.text() is not including custom channelData in the returned message

ON HOLD I've not been able to re-create in an isolated enviroment. Maybe hold fire until I get a test case together...
I set some custom data to be sent back to the user using
let channelData = { example: true }
let msg = new builder.Message(session)
        .text("some text")
        .sourceEvent({ '*' : channelData });`

When I pass this to builder.Prompts.time() the channelData is visible in the bot emulator. When I pass it through builder.Prompts.text() the channelData is missing.

Mistake in my code - closed


Feature request: specify AWS credentials either with aws_profile item in aws section of config, or with --profile command line option

Environment:
-aws-parallelcluster==2.4.0

RHEL 7
slurm
None
None

I would like to be able to specify the AWS credentials through the use of a profile ~.aws/credentials, as is done with most other AWS utilities. In the case of pcluster, this could be achieved by adding aws_profile item in the [aws] section of the configuration file, or by adding support for the --profile command-line option.

Hi Joey,
Thank you for opening this feature request.
Supporting profiles like aws cli does (with a --profile cli option) is a very valid enhancement and we'll take this into account for the upcoming releases of ParallelCluster.
Francesco

FWIW @joeydumont using export AWS_PROFILE=<you-profile> has worked for me when running pcluster on a system with multiple AWS profiles.


Move to UBI Base Image

move up to level of base image using UBI
alter jvm system truststore location to match the one in the new base image.
Minikube/Docker need testing before this goes non-draft.

This change is

Minikube/Istio/Helm tested OK

Docker tested OK


Issue- stuck while downloading attachment from udemy

Issue- stuck while downloading attachment from udemy

I am also facing the same issue since the last 2 weeks. Can anyone help?

Facing the same issue for the past week. Whenever I try to download any course, It gets stuck permanently as soon as any attachment comes.

Issue Image: https://ibb.co/26N0L5w


Locked keys

Issue Type: Bug
I haven't installed anything or modified settings since when it was fine, was just working and got "(S) was pressed. Waiting for second key".. shown on statusbar and the input not passed, happen on each S key press.
(of course the S are not listed/defined in the Keybindings)
Anyone please help.
p.s. its about 5th brickwall issue i meet with the VSCode (had 1 with Atom in a 3 times longer time).
 There's an F1 command for doing that (F1, then start typing 'reload')
If that doesn't help I suggest you first update to the latest version (1.33.1) and see if the issue remains. Or is there some reason you're still on 1.30.1 ?

@gabrieljacobsen didn't help

it persist trough system restarts, no idea what to do, even if reinstall of the VSCode would help without knowing the reason it ca happen again.

If you run the Preferences: Open Keyboard Shortcuts (JSON) command, what does it show in your keybindings.json file?

@Ilias48rus Please check for keybindings of s in your keybindings.json file.

@alexandrudima. i'm sorry that didn't close it, think it was something about content displaying in the keybindings window and was solved with the .json .


resurrect: Update properly when the unit is successfully resurrected

INCOMING_RESURRECT_CHANGED is not dependable, and I've often seen that once the unit is successfully resurrected, the icon gets stuck.

Seems to have been resolved in Legion.


Question: Multiple relations of same model

// in class "Books":
  @BelongsTo(() => Person, 'authorId')
  author: Person;

  @BelongsTo(() => Person, 'proofreaderId')
  proofreader: Person;

  // in class "Person":
  @HasMany(() => Book, 'authorId')
  writtenBooks: Book[];

  @HasMany(() => Book, 'proofreaderId')
  proofedBooks: Book[];

How do we now reference these separately when retrieving ex: when we need to include just the Author when retrieving a book
Book.findById(id, {
  includes: [
    {
       model: Person    // How to specify we need author, but not the proofreader here?
    }
  ]
})

Thanks

Hey @rasikas, you can achieve this by using as like:
Book.findById(id, {
  includes: [
    {
       model: Person,
       as: 'author'
    }
  ]
})

Thanks a lot @RobinBuschmann , really appreciate the quick response and wonderful library

Hey @rasikas can this be closed then? :)

yes thank you


How does this implementation differ from (tokio-)tungstenite?

Faster is always nice :) I'm curious how this implementation differs from tokio-tungstenite and, if it's faster, what different decisions were made that makes it so.

I'm curious how this implementation differs from tokio-tungstenite

No code is faster then no code : )
It provide simple implementation which make it 3x faster

if it's faster, what different decisions were made that makes it so.

There is no magic! It does two jobs well, encoding frames, and parsing incoming websocket frames.

Just like @nurmohammed840 said, there is no magic. It tries to keep things simple and optimal.
Some key differences from tokio-tungstenite:

fastwebsockets is fully built on async streams whereas tokio-tungstenite wraps on sync tungnstenite.
fastwebsockets provides a lower level access to the protocol. You can play around with vectored writes, fragmentation policy, utf-8 validation etc.
Careful allocations and clone-on-write frame payloads.


Property 'createLiveModeRunner' does not exist on type 'TestCafe'

What is your Test Scenario?

We have a programatic runner written in TypeScript and it seems that the interface definition is missing createLiveModeRunner so it fails to compile.
What is the Current behavior?

TestCafe runner fails to compile.
What is the Expected behavior?

TestCafe runner should compile as createLiveModeRunner is a new method.
What is your web application and your TestCafe test code?

Your website URL (or attach your complete example):

Your complete test code (or attach your test files):

import { default as createTestCafe } from "testcafe";

 createTestCafe("localhost")
  .then((tc: TestCafe) => {
    testcafe = tc;
    runner = environment.live ? testcafe.createLiveModeRunner() : testcafe.createRunner();
    return getTests();
  })

Your Environment details:

testcafe version:          1.1.0
node.js version:           8.12.0

Thank you for pointing this issue to us and for your PR. We'll have a look at it in the nearest future.

fixed in https://github.com/DevExpress/testcafe/pull/3582


Separate keystore to be used for internal data encryption

This is issued as a WUM update for IS 5.5.0, need to include this into IS 5.6.0 as a WUM update.

@rushmin: is this included in the public branch?

@IndunilRathnayake Yes, it is. Closing the ticket.
[1] - https://github.com/wso2/carbon-kernel/issues/1789
[2] - https://github.com/wso2/carbon-kernel/pull/1818


Add a application/{app}/prod resource

I sketched out this while thinking about issues with disappearing deployments and instances in our application view in the Console. I think the only way out of this is to always show a union of what is currently deployed/registered in ZooKeeper and what is mentioned in deployment.xml.
In this draft PR I created a new /application/{app}/prod resource that recursively shows all this information. The structure returned is
tenant: name
application: application
instances:
  - name: instance-name
    deployments:
      - name: test
         declared: true
         active: null
     - name: prod.aws-us-east-1c
        declared: true
        active:
          <all deployment stuff here>

declared means the deployment is mentioned in the latest deployment spec. active that is non-null means there is a running deployment that we have information about.
@freva and @jonmv - is this a good approach to make sure we don't accidentally hide information about the system state to the user?

Non-deployed instances already covered here: https://github.com/vespa-engine/vespa/blob/fc9db2992f799bffb80df2b1d57bd4f320da5e7e/controller-server/src/main/java/com/yahoo/vespa/hosted/controller/restapi/application/ApplicationApiHandler.java#L1394
Only gap is test deployments that disappear.


fix windows build

It still sporadically fails on Appveyor, for this commits it did succeed https://ci.appveyor.com/project/splix/emerald-wallet/build/277 a fail https://ci.appveyor.com/project/splix/emerald-wallet/build/278
Maybe something related to build caching :(


Appstudio update hacbs-test-project-8e78

Pipelines as Code configuration proposal
To start the PipelineRun, add a new comment with content /ok-to-test
For more detailed information about running a PipelineRun, please refer to Pipelines as Code documentation Running the PipelineRun
To customize the proposed PipelineRuns after merge, please refer to Build Pipeline customization

Pipelines as Code CI has failed.There was an error creating the PipelineRun: hacbs-test-project-8e78-on-pull-request-
creating pipelinerun hacbs-test-project-8e78-on-pull-request- in namespace rhtap-demo-vtwj-tenant has failed.
Tekton Controller has reported this error: the namespace of the provided object does not match the namespace sent on the request

Pipelines as Code CI has failed.There was an error creating the PipelineRun: hacbs-test-project-8e78-on-pull-request-
cannot patch pipelinerun hacbs-test-project-8e78-on-pull-request-: failed to patch pipelinerun rhtap-demo-imil-tenant/logURL with hacbs-test-project-8e78-on-pull-request-xjvmf: pipelineruns.tekton.dev "hacbs-test-project-8e78-on-pull-request-xjvmf" not found


LDAP/LDAPS authentication with Microsoft Active Directory

Is your proposal related to a problem?

LDAP/LDAPS authentication with Microsoft Active Directory seems not yet supported by Kafka-UI.
Describe the solution you'd like

It would be nice if Kafka-UI also support LDAP and LDAPS authentications with Microsoft Active Directory.
According to the  Spring documentation this is supported by the framework (but maybe will require one or more extra options).
Describe alternatives you've considered

No alternatives available.
Additional context

Our Kafka-UI service resides in a Kubernetes cluster and has been deployed by the official helm chart (v0.3.2).
The configuration for LDAP we use is the following one (modulo server and domain names, that have been obfuscated):
kafka-ui:
  envs:
    config:
      AUTH_TYPE: "LDAP"
      SPRING_LDAP_URLS: "ldaps://ad01.domain.com:636"
      SPRING_LDAP_DN_PATTERN: "OU=people,DC=ad,DC=domain,DC=com"

The login windows reappears in a loop when I enter the credentials and no messages are printed in the pod's logs.
I think it would also be useful to see something logged in case of user logins in the Kafka-UI interface.
This issue has been briefly discussed with @Haarolean on the Kafka-UI discord channel.

Thanks, we can actually schedule it for 0.4, I'll let you know if we'll need to test it out

Ok. Thanks! I'll be glad to help testing this feature.

I add a feature request about it: our Kafka cluster uses Active Directory for authn/authz and the user should be able to do what its user is granted to. The kafka-ui should use the provided credential to connect to the cluster using SASL_SSL.

@angeloxx thanks for the suggestion, but that's totally another feature: #753

The #753 plans to manage RBAC on the tool, this request is to pass-thru authentication and use providede credential to access to the cluster.

@angeloxx ah, got you. Please raise a new issue

Please try this test build:
Import it via docker load < file.tar.gz.
Image name is provectuslabs/kafka-ui:ldap_ad.
Additionally to other LDAP settings add these:
OAUTH2_LDAP_AD=true
OAUTH2_LDAP_AD_DOMAIN=google.com
The link is available for 7 days. Let me know how it goes.

@madrisan updated the link. It'll be active for 7 days.

Sorry. I'm unable to bypass the image arch issue
$ docker inspect --format='{{.Os}}/{{.Architecture}}/{{.Variant}}' provectuslabs/kafka-ui:ldap_ad
linux/arm64/v8

that ends up in a runtime error (even when running with --platform "linux/amd64")
image was found but does not match the specified platform: wanted linux/amd64, actual: linux/arm64/v8

Oh well, let's try this one, I've built it for amd64 this time.

Thanks.
I get an Authentication failed: Invalid Credentials message:
2022-06-02 15:28:25,185 DEBUG [reactor-http-epoll-2] o.s.h.c.FormHttpMessageReader: [c200c7b0-22] Read form fields [username, password, _csrf] (content masked)
2022-06-02 15:28:25,185 DEBUG [reactor-http-epoll-2] o.s.s.w.s.u.m.OrServerWebExchangeMatcher: Trying to match using PathMatcherServerWebExchangeMatcher{pattern='/login', method=POST}
2022-06-02 15:28:25,185 DEBUG [reactor-http-epoll-2] o.s.s.w.s.u.m.PathPatternParserServerWebExchangeMatcher: Checking match of request : '/login'; against '/login'
2022-06-02 15:28:25,185 DEBUG [reactor-http-epoll-2] o.s.s.w.s.u.m.OrServerWebExchangeMatcher: matched
2022-06-02 15:28:25,185 DEBUG [boundedElastic-2] o.s.s.w.s.a.AuthenticationWebFilter: Authentication failed: Invalid Credentials
2022-06-02 15:28:25,185 DEBUG [boundedElastic-2] o.s.s.w.s.DefaultServerRedirectStrategy: Redirecting to '/login?error'
2022-06-02 15:28:25,185 DEBUG [boundedElastic-2] o.s.w.s.a.HttpWebHandlerAdapter: [c200c7b0-22] Completed 302 FOUND

Is LDAPS (our current setting) supported?

Thanks.
I got an UNAUTHORIZED login error:
2022-06-02 16:19:01,029 DEBUG [boundedElastic-1] o.s.s.w.s.a.AuthenticationWebFilter: Authentication failed: simple bind failed: <IP_ADDRESS>:636; nested exception is javax.naming.CommunicationException: simple bind failed: <IP_ADDRESS>:636 [Root exception is java.net.SocketException: Connection or outbound has closed]
2022-06-02 16:19:01,030 DEBUG [boundedElastic-1] o.s.s.w.s.DelegatingServerAuthenticationEntryPoint: Trying to match using org.springframework.security.config.web.server.ServerHttpSecurity$HttpBasicSpec$$Lambda$700/0x0000000801085840@11a68372
2022-06-02 16:19:01,030 DEBUG [boundedElastic-1] o.s.s.w.s.DelegatingServerAuthenticationEntryPoint: No match found. Using default entry point org.springframework.security.web.server.authentication.HttpBasicServerAuthenticationEntryPoint@2ab53c6a
2022-06-02 16:19:01,030 DEBUG [boundedElastic-1] o.s.w.s.a.HttpWebHandlerAdapter: [382d1f76-2] Completed 401 UNAUTHORIZED

I need to investigate more bit I'll be off for some days.

Yes, we use LDAPS and I thought also of a probable certificate issue. It's a recurrent issue. Thanks for the documentation! I'll try to test this setup next week.

I was able to import our SSL certificate into the Java keystore but now I got all the time a login authentication error.
The cause is likely to be an incorrect configuration on my part.
Unfortunately I don't have access to the AD logs so it's very difficult to get the root cause and fix it: p

I think so. This project has not reached the 1.0 version so one can expect some minor issues, and having this feature available will permit other people to test it (or use it if it work just fine). IMHO.

Hi @madrisan I faced issue while authentication with LDAPS. I already added certificate of ldaps to keystore. But I still couldn't login. Do you know what I were missing?
My docker-compose.yml
version: '3.4'
services:
  kafka-ui:
    container_name: kafka-ui
    image: provectuslabs/kafka-ui:v0.7.0
    ports:
      - 8080:8080
    environment:
      LOGGING_LEVEL_ROOT: DEBUG
      AUTH_TYPE: "LDAP"
      SPRING_LDAP_URLS: "ldaps://ldap001.as1.domain.net:636"
      SPRING_LDAP_USERFILTER_SEARCHBASE: "OU=Users,OU=Evidence.com,DC=as1,DC=domain,DC=net"
      SPRING_LDAP_ADMINUSER: "CN=ldap_user,OU=Service Accounts,OU=ABC.com,DC=as1,DC=domain,DC=net"
      SPRING_LDAP_ADMINPASSWORD: "xxxx"
      SPRING_LDAP_USERFILTER_SEARCHFILTER: "(&(uid={0})(objectClass=inetOrgPerson))"
      SPRING_LDAP_DN_PATTERN: "cn={0},OU=Users,OU=ABC.com,DC=as1,DC=domain,DC=net"
      OAUTH2.LDAP.ACTIVEDIRECTORY: "true"
      OAUTH2.LDAP.AСTIVEDIRECTORY.DOMAIN: "as1.domain.net"
      KAFKA_CLUSTERS_0_NAME: "kafka"
      KAFKA_CLUSTERS_0_PROPERTIES_SECURITY_PROTOCOL: SSL
      KAFKA_CLUSTERS_0_PROPERTIES_SSL_KEYSTORE_LOCATION: "/ssl/cacerts"
      KAFKA_CLUSTERS_0_PROPERTIES_SSL_KEYSTORE_PASSWORD: "pass"
      KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS: "kafka01:9091"
      KAFKA_CLUSTERS_0_SSL_TRUSTSTORELOCATION: "/ssl/cacerts"
      KAFKA_CLUSTERS_0_SSL_TRUSTSTOREPASSWORD: "pass"
      KAFKA_CLUSTERS_0_PROPERTIES_SSL_ENDPOINT_IDENTIFICATION_ALGORITHM: ''
      DYNAMIC_CONFIG_ENABLED: 'true'
    volumes:
      - path/compose/ssl:/ssl

Error logs:
kafka-ui  | 2023-05-12 04:44:26,153 DEBUG [reactor-http-epoll-8] o.s.w.s.a.HttpWebHandlerAdapter: [660a4958-10] HTTP POST "/login"
kafka-ui  | 2023-05-12 04:44:26,154 DEBUG [reactor-http-epoll-8] o.s.s.w.s.u.m.OrServerWebExchangeMatcher: Trying to match using PathMatcherServerWebExchangeMatcher{pattern='/login', method=POST}
kafka-ui  | 2023-05-12 04:44:26,155 DEBUG [reactor-http-epoll-8] o.s.s.w.s.u.m.PathPatternParserServerWebExchangeMatcher: Checking match of request : '/login'; against '/login'
kafka-ui  | 2023-05-12 04:44:26,155 DEBUG [reactor-http-epoll-8] o.s.s.w.s.u.m.OrServerWebExchangeMatcher: matched
kafka-ui  | 2023-05-12 04:44:26,155 DEBUG [reactor-http-epoll-8] r.n.c.FluxReceive: [660a4958-3, L:/<IP_ADDRESS>:8080 - R:/<IP_ADDRESS>:37802] [terminated=false, cancelled=false, pending=0, error=null]: subscribing inbound receiver
kafka-ui  | 2023-05-12 04:44:26,155 DEBUG [reactor-http-epoll-8] o.s.h.c.FormHttpMessageReader: [660a4958-10] Read form fields [username, password] (content masked)
kafka-ui  | 2023-05-12 04:44:26,762 DEBUG [boundedElastic-3] o.s.s.w.s.a.AuthenticationWebFilter: Authentication failed: Connection to LDAP server failed
kafka-ui  | 2023-05-12 04:44:26,763 DEBUG [boundedElastic-3] o.s.s.w.s.DefaultServerRedirectStrategy: Redirecting to '/login?error'

I just wanted to add my comments for anyone else who might be facing issues with setting up Ldaps while running Provectus UI in a container.
While the above settings are right, I was still facing issues and it seemed that adding the ldaps certs (server and ca) to the truststore was not enough. Because I was getting an error:
DEBUG [reactor-http-epoll-2] o.s.h.c.FormHttpMessageReader: [41223826-4] Read form fields [username, password] (content masked)
DEBUG [boundedElastic-1] o.s.s.w.s.a.AuthenticationWebFilter: Authentication failed: Connection to LDAP server failed

Uncertain why this error occurs, i checked with tcpdump/Wireshark the ldaps port comms, and turned out to be a cert error:
7  0.013859 source.ip.address ldaps.ip.address TLSv1.2  63   Alert (Level: Fatal, Description: Certificate Unknown)

Got help regarding this on Discord (many thanks), and adding another parameter helped, ldaps worked - have to specify a JAVA_OPTS environment variable inside the container (so -e when spinning up a container), where I specified the truststore / pwd of the truststore containing the ldaps certs.
-e JAVA_OPTS='-Djavax.net.ssl.trustStore=/app/truststore.jks -Djavax.net.ssl.trustStorePassword=truststore-pwd'

You could do it with JAVA_OPTS environment variable also.


dns/ddclient Add Cloudflare

Added Cloudflare
had to add an additional config option for the zone. I hope that's the right way. Is it possible to make that field required only for cloudflare?
fixes #2772

Is it possible to make that field required only for cloudflare?

It is, but will make things a bit more complicated as you would either need to extend the model validation or add a constraint (https://docs.opnsense.org/development/frontend/models_constraints.html) like : https://github.com/opnsense/plugins/blob/16f3522d08d30919b17e66bdec38352ef4c75208/security/tinc/src/opnsense/mvc/app/models/OPNsense/Tinc/Tinc.xml#L47-L54
If zone might be relevant for more types, I would start without enforcing it, adding a validation at a later point in time isn't a big deal.
Is this ready to merge? It looks functional.

Yes, this is tested and works.
Several other types will use zone as well.

@MrRoundRobin thanks!


update job eventTriggerConfig using cli and --yaml flag

Please provide us with the following information:

This issue is a: (mark with an x)

[ x] bug report -> please search issues before submitting
[ x] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

Issue description
https://learn.microsoft.com/en-us/cli/azure/containerapp/job?view=azure-cli-latest#az-containerapp-job-update shows an option for [--yaml], but the example is for a container app, not a job.  I need to know how to configure the Trigger Configuration in my yaml file.
Steps to reproduce

setup a manual job following this tutorial
try and update the job to be an Event triggered job with the CLI: az containerapp job update --name job-name --resource-group rg-job-group --yaml config.yml (where the config updates any of the job configuration, but specifically sets triggerType to Event

Expected behavior [What you expected to happen.]
trigger type updates accordingly
Actual behavior [What actually happened.]
fails with

(ContainerAppsJobTriggerConfigurationMissing) Container apps job 'xxxxx' must have Trigger Configuration corresponding to trigger type 'Event'

setting my eventTriggerConfig to
eventTriggerConfig:
      minExecutions: 0
      maxExecutions: 10
      scale:
        rules:
        - name: queue-based
          type: azure-servicebus
          auth:
            connection: service-bus-conn
          metadata:
            queueName: my-queue-name
            messageCount: 1
    replicaRetryLimit: 0
    replicaTimeout: 60

fails with

Invalid YAML provided. Please see https://aka.ms/azure-container-apps-yaml for a valid YAML spec.

Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
my goal is to have Terraform setup a generic manual job and all the ancillary bits.  Then, individuals repos can create a pipeline to update the job using the AZ CLI to be event driven, add in secrets / env / acr registry / etc.  All the other settings work, but I can't for the life of me figure out what the eventTriggerConfig format is

Thanks for reaching out @jason-berk-k1x.
We will fix our docs/CLI help so that the YAML reference in points to a Jobs spec and not a Container App

We have added a YAML example for Jobs here: https://learn.microsoft.com/en-us/azure/container-apps/azure-resource-manager-api-spec?tabs=yaml#job-examples
We will change the link provided in the CLI error message to point to the new YAML example

thanks....  it would be really nice to also reference the trigger config options as well....  I found them here
https://learn.microsoft.com/en-us/azure/templates/microsoft.app/2023-05-01/jobs?pivots=deployment-language-arm-template#resource-format-1

Fixed with: https://github.com/Azure/azure-cli/pull/28799


Can't stub method call

This isn't working for some reason:
let(:chef_run) do
  ChefSpec::ServerRunner.new(platform: 'ubuntu', version: '14.04') do
    allow_any_instance_of(Chef::Recipe).to receive(:my_method).and_return('stubbed_value')
  end.converge(described_recipe)
end

Usually this works, but for some reason it's still running the original method. All tests fail because of a missing file that the original method expects to be present.

I believe the converge is failing.

The solution was to change my module into a class. Since I'm dealing with actual instances, the stubbing works now.


Add RISC-V RINTC Affinity Structure in SRAT

The ACPI SRAT provides information that allows OSPM to associate the processors with system locality/proximity domains and clock domains. The provided information is also essential for the Linux ACPI NUMA support.
This ECR try to add a new affinity structure type for RISC-V RINTC in SRAT to provide the RISC-V HART association with system proximity domains.
https://docs.google.com/document/d/12xlo-1jIPShyjMfmBAfRKccmIACXWyEuJB41_NnBxjI

The ECR is approved by ASWG on 01/26/2024. The approved version is here


Race issue on cursor.next() and getMore

Calling multiple time cursor.next() while current batchDocument is empty cause multiple time getMore command and throw error like:
"MongoError: clientcursor already in use? driver problem?"
"MongoError: Cursor not found, cursor id:<PHONE_NUMBER>832"
Trying to create a simplified step to reproduce.
CF: https://github.com/Automattic/mongoose/issues/5446

Simplified step to reproduce:
exports['Should iterate cursor without race condition on next()'] = {
  metadata: {
    requires: { topology: ["single", "replicaset", "sharded"] }
  },

  test: function(configuration, test) {
    var Server = require('../../../lib/topologies/server')
      , bson = require('bson');

    // Attempt to connect
    var server = new Server({
      host: configuration.host, port: configuration.port, bson: new bson()
    });

    var ns = f("%s.cursor2", configuration.db);
    // Add event listeners
    server.on('connect', function(_server) {
      // Execute the write
      _server.insert(ns, [
        {a:1}, {a:2}, {a:3}, {a:4}, {a:5},
        {a:6}, {a:7}, {a:8}, {a:9}, {a:10}
        ], {
        writeConcern: {w:1}, ordered:true
      }, function(err, results) {
        test.equal(null, err);

        // Execute find
        var cursor = _server.cursor(ns, {
          find: ns
          , query: {}
          , batchSize: 5
        });

        var async = require('async');
        async.times(5, function(n, next) {
          cursor.next(next);
        }, function(err) {
          test.equal(null, err);
          async.times(5, function(n, next) {
              cursor.next(next);
          }, function(err) {
            test.equal(null, err);
            // Destroy the server connection
            _server.destroy();
            // Finish the test
            test.done();
          });
        });
      });
    });

    // Start connection
    server.connect();
  }
};

Ugly workaround to better understand ; at least it fix the problem.
https://github.com/christkv/mongodb-core/compare/2.0...lchenay:patch-1

Any news?

I'm getting "MongoError: cursor id not found" a lot and it's distressing. I'm trying to step through only 20,000 documents and my loop periodically dies from this and I have to restart from that point forward using skip to continue from the point of death. Pretty bad. I'm sorry I don't have the patience to post more info right now, but can later if desired. Using Node 8.5.0, Mongoose 5.0.10 and Mongo 3.6.2, default heap.

@teddis please file a bug report on our JIRA, thank you.

@cosminn777 please file a bug report on our JIRA, thank you.

Also getting MongoError: cursor id ... is already in use randomly, and I'm not sure how I can file a meaningful bug report on JIRA without sharing my collection. The code is
const cursor = collection.find({ createdAt: { $lt: new Date() } });
do {
  // ...
  const bulk = collection.initializeOrderedBulkOp();
  for (const item of itemsToUpdate)
    bulk.find({ _id: item._id }).replaceOne(item);
  const result = await bulk.execute();
} while (cursor.hasNext());

@dandv it looks like you need to be doing } while (await cursor.hasNext())

@mbroadst: After adding await, I still see a related error in a similar loop, if processing takes longer than ~10 minutes:

MongoError: cursor id<PHONE_NUMBER>9 not found

const cursor = await users.find(
  { },
  {
    projection: { ... },
  }
).batchSize(100 * 100);

let user = await cursor.next();
while (user) {
  const usersInDb = { };
  // Get up to PAGE_SIZE users (<PAGE_SIZE at the end of the cursor)
  for (let i = 0; i < PAGE_SIZE && user; i++, user = await cursor.next())
    usersInDb[user._id] = user;

  // Process users...
  // ...
  const bulk = users.initializeUnorderedBulkOp();
  // ...
  bulk.find({ _id: id }).updateOne(userUpdateForDb);

  // Update users
  try {
    await bulk.execute();
  } catch (error) {
    ...
  }
}

The collection has ~65,000 documents, and I've reduced the batch size to 10,000 per this SO question in order to keep the cursor alive.

@dandv have you tried disabling the cursor timeout? Also, would you mind creating a jira ticket for your issue? We try as much as possible to make that our single source of truth for driver bugs these days.

Sorry, forgot to include the link to the JIRA ticket.
Haven't tried disabling the cursor timeout because it didn't seem necessary - according to the explanations in that SO answer, a smaller batchSize would keep the cursor alive as the client requests more documents from it. Traversing the whole collection of 65k documents took ~20 minutes, so with a batchSize of 1000, I expected the cursor to be pinged every about 20 seconds.


Add support for listing and restoring deleted log analytics workspaces.

Resource Provider
Microsoft.OperationalInisghts
Description of Feature or Work Requested
We need to enable PS/CLI to recover a deleted workspace. Recovering a workspace is simply calling PUT (create) on a workspace resource, providing the original location. A workspace can be recovered during 14 days after it was deleted.
The UI for this feature will be available this week. The basic UI flow is this:

Going to the Log Analytics Workspaces page in Azure portal.
Clicking ‘Recover’ button.
Listing deleted workspaces in a subscription.
Selecting a workspace to recover.

The flow in API would be this:

Calling GET /deletedWorksapces API to list the deleted workspaces and select the one you need (this is optional if you know your workspace resource id)
Calling PUT /workspaces to re-create the workspace. If you specify just the location and empty properties, the workspace is recovered with the same properties it had when it was deleted. You can optionally provide properties that will override the ones we keep for that workspace. The behavior is PATCH like.

We need simple PS/CLI to do the same. I would  suggest the following syntaxes for PS, but we can apply the same for CLI:

Get-AzOperationalInsightsDeletedWorkspaces -SubscriptionId
Gets the recently deleted workspaces in a subscription.

Recover-AzOperationalInsightsWorkspace -ResourceId  -Location
Sends a PUT (Create) workspace with empty properties.

Recover-AzOperationalInsightsWorkspace -SubscriptionId  -WorksapceName
Calls GET /deletedWorkspaces, locates the desired workspace by name, then calls PUT to recover the workspace.

Recover-AzOperationalInsightsWorkspace -SubscriptionId  -WorksapceId
Calls GET /deletedWorkspaces, locates the desired workspace by id, then calls PUT to recover the workspace.

Recover-AzOperationalInsightsWorkspace -Workspace
Takes a workspace object that was selected from the results in Get-AzOperationalInsightsDeletedWorkspaces, clears some read-only properties and calls PUT to recover the workspace with possibly patched properties.

Of course no need for SubscriptionId parameter if you run Select-AzSubscription. I’m not sure if we need to provide it at all.
Here is our current documentation for delete and recover workspaces:
https://docs.microsoft.com/en-us/azure/azure-monitor/platform/delete-workspace
Minimum API Version Required
2020-03-01-preview
Swagger Link
Workspaces API is here:
https://github.com/Azure/azure-rest-api-specs/blob/master/specification/operationalinsights/resource-manager/Microsoft.OperationalInsights/preview/2020-03-01-preview/Workspaces.json
deletedWorkspaces API is pending merge:
https://github.com/Azure/azure-rest-api-specs/pull/9401
Target Date
M3 29-May-2020

feature request at monitor

add to S170


Remove deprecated calls for Jedi >= 0.16.0

Further work on https://github.com/palantir/python-language-server/pull/775 which helped me for the OpenSUSE package (where Jedi has a version 55 commits after 0.16.0)

Jedi 0.17.0 came out and bbfcce1 is an intermediate commit. This is still WIP, as stated in #744

Rebased and completed. See https://github.com/palantir/python-language-server/issues/744#issuecomment-614294243

I reused the same branch for #781 and after the rebase this does not merge into 755 anymore. closing.


Remove extra comma after the last property in .eslintrc json

VS Code is showing error due to an extra comma after the last json property

My change should not fail the build as it is a typo fix in .eslintrc.
The build is failing on npm install. Does anybody know what could be going wrong?

It's not your fault. Travis CI has some bugs with node 9 at the moment.
Thanks!

Great! Thanks @timdorr for the merge !!


Chemical Injection Chamber won't automatically accept crystals

So I'm trying to do the x5 ore processing, but when I get to the end of the tier 4 processing and have my crystals. However, when telling the crystalizer to eject the crystals, the CIC won't accept them. I've tried 3 other ways to move them out.

Using Ender IO conduits.

Using Extra Utilities NODES.

Using Steve's factory

In each scenario I made sure that the slots were the correct color for input/output. In the end I have to manually move them by hand. ( Shift doens't work as well )
I can Transfer to Chest or inventories like AE 2, but the CIC dont accept.
Im playing at Mekanism 8.1.8 at 1.7.10 modpack.
I read at mekanism github that old version from meknaism had this problem and have been fixed, maybe the mekanism from this modpack is out to date? Or maybe a miss config?
EDIT : The Metallurgic Infuser are not acceptin shift click to any items.

Fixed in dev


New version: RealVNC.VNCViewer version <IP_ADDRESS>

Checklist for Pull Requests

[x] Have you signed the Contributor License Agreement?
[x] Is there a linked Issue? Fix #194244

Manifests

[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?
[ ] Have you tested your manifest locally with winget install --manifest <path>?
[x] Does your manifest conform to the 1.6 schema?

Note: <path> is the directory's name containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Thanks, the new version works.  Uninstall of the old version didn't work either (preventing the install of the new version) until I deleted the reg key (using powershell).
Remove-Item -Path "HKLM:\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\RealVNC.VNCViewer_Microsoft.Winget.Source_8wekyb3d8bbwe" -Recurse -Force


[T5A1][T09-A4] Wong Jun Wei

Add 2 new user stories.
Add 'Rename tag' use case.
Add 2 new NFRs.

Reviewed in class.


update recs per 2022 Cloud Report

Fixes DOC-3742.
Fixes DOC-3391.
Updated the following per 2022 Cloud Report:

Recommended instance types for GCP, AWS, Azure
Added some additional workload-specific recommendations

Also moved the instance recs into includes so that these are updated across all docs.

This change is

@keith-mcclellan Let me know if you'd like to tag another reviewer here.
Also, I had a couple questions:

Is it still OK to recommend the compute-optimized instances? We already had one listed for Azure, and I went ahead and mentioned the AWS c types as well.
Do the recommendations under ### Cloud-specific recommendations conflict with anything under ### Sizing at all (or do we think having guidance on smaller vs. larger nodes in 2 places might be confusing)?

In general this looks good, one caveat is we need to call out provisioning IOPS and Throughput for gp3 volumes (aws)
With gp3 you get 3000 IOPS and 125MiB/Sec throughput by default, if you need more than either of those they need to be provisioned  separately
For example, an 8 vcpu box needs 4000 IOPS for example, and a 16 vCPU box we would want a min of 8000 IOPS and 250 MiB/sec Throughput

For example, an 8 vcpu box needs 4000 IOPS for example, and a 16 vCPU box we would want a min of 8000 IOPS and 250 MiB/sec Throughput

@keith-mcclellan The recommendation in our docs is 30 MB/s per vCPU, which comes out to 480 MB/s for a 16 vCPU machine. Can you help me square this away? Or is this a different value?

Honestly, this is the first I've seen the 30 MB/s recommendation per vCPU - TIL.
I'm not sure we can push it that much in most cases, but it doesn't hurt to overprovision things a bit,. So let's say 240 MB/s for the 8 vCPU instances and 480 MB/s for the 16 vCPU instances then. That work?


Add 1024 icon

Add support for iTunesArtwork@2x icon (required for iphone x).

@mschmidt-healthx Thanks for your contribution. Unfortunately, the build is failing. Would you please take a look at your commit and the tests to see what you need to change to make the tests pass? Also, in general, please make sure your change is covered by tests.


chore: upgrade cosmos v13.0.2 -> v14.1.0

https://github.com/cosmos/gaia/releases/tag/v14.1.0
DO NOT MERGE UNTIL: https://www.mintscan.io/cosmos/block/18262000

I had manually upgraded these to avoid deploy time and falling out of sync during the fork, but forgot to actually merge the PR.... merging now


Write an article for customers to use nosqlbench with aiven service for cassandra

What should we add to our content collections?
a step-by-step article on how to use nosqlbench to load sample data into cassandrain aiven.
Is this something you would work on yourself?
YES, I will do the article and submit a PR for it.
[X] I plan to open a pull request for this

New article. https://docs.aiven.io/docs/products/cassandra/howto/use-nosqlbench-with-cassandra.html


RSS Widget with FreshRSS not working

Environment
Docker
Version
0.11.5
Describe the problem
The rss widget with my local instance of FreshRSS cannot load the feed. The format is like http://<IP_ADDRESS>:82/i/?a=rss
Additional info

Please tick the boxes

[X] You've read the docs
[X] You've checked for duplicate issues
[X] You've tried to debug yourself

Hi. Thanks for your issue.
Are there any errors in the log?
Can you quickly do this?

Open your developer tools
Switch to the network tab
Search for a request that ends with "rss" and paste the response here in a code block

The only thing that shows in the response is: "Internal Server Error"

Then send the log please. We need some information to investigate from :)

Here it is the log: https://pastebin.com/w4BNFDgf

Wait! I've found a solution by enabling the anonymous reading of the articles in FreshRSS.

Okay, nice 👍
Maybe we should provide more information in the front-end if it fails... 🤔


No scripts folder for migration in download link

Actual behaviour
Migration impossible as there is no scripts folder in download archive.
Expected behaviour
'php scripts/migrate-db.php --sqlite-db=../miniflux/data/db.sqlite --admin=1' would result in a migrated database.
Steps to reproduce

Download https://miniflux.net/miniflux-1.2.0.zip and unzip
Execute 'php scripts/migrate-db.php --sqlite-db=../miniflux/data/db.sqlite --admin=1'
Could not open input file: scripts/migrate-db.php

Configuration

Miniflux version: 1.2.0
PHP version: 7.1
OS: Ubuntu 16.10

Ah yes, the script is in the Git repo.

After four days no update of the accouncement on the blog and no update of the linked ZIP file?
I found the script myself before opening this issue. But I think it's a tremendous disservice to all those people who have been or will be downloading the ZIP file.

The documentation, the news item on the website and the ChangeLog have been updated since the time.


Need to check that disconnected BLEClient doesn't try and use connection

Imagine the ESP32 is running as a BLE Client.  It connects to the target BLE Server and reads and writes characteristics.  All is well.  Now imagine that the client is "disconnected" from the BLE Server.  We will be notified that we have been disconnected.  All good.  However, what if the programmer then attempts to continue to read/write to the BLE Server now the connection is gone?  We don't handle that at all.
Today, we interact with a BLE Server by getting a BLERemoteCharacteristic object and then calling its readValue() and writeValue() methods.  Since we can't get a BLERemoteCharacteristic object without first connecting to the server, we don't have to worry about attempting to interact with the server without first having formed a connection.  What we failed to appreciate is that having a BLERemoteCharacteristic NOW doesn't mean that this object will be good into the future.  Specifically, it is no longer good once we have lost the connection.  We need to maintain state in the client such that if the connection is lost, an attempt (mistakenly) by the programmer to use the connection is rejected.

One immediate workaround without code changes in the library appears to be to invoke the:
BLEClient::isConnected()
and only if we are connected, then perform the read or write.

I see, thank you very much for your help!

Studying the traces when a server disappears from a connected ESP32 BLE Client, I seem to see two events.  These are ESP_GATTC_DISCONNECT_EVT and ESP_GATTC_CLOSE_EVT.   Now I need to study to determine the distinction between these.

Some non trivial changes have now been made.

We now detect a disconnect
A callback function called onDisconnect() which is part of the BLEClientCallbacks class is now available and will be called when a disconnection is discovered.
When we attempt to re-connect or when we attempt to perform a subsequent getServices(), the cache of existing services (and their chains of characteristics and descriptors) are released.
If we attempt to perform a read or write on a characteristic or descriptor where we have no connection results in a BLEDisconnectedException being thrown which can be caught.

I tried to use this callback on esp32 arduino but I got:
C:\PROGRAMY\arduino\hardware\espressif\esp32\libraries\BLE\src/BLEExceptions.h:13:2: error: #error "C++ exception handling must be enabled within make menuconfig. See Compiler Options > Enable C++ Exceptions."

 #error "C++ exception handling must be enabled within make menuconfig. See Compiler Options > Enable C++ Exceptions."

You have to edit sdkconfig.h file and set this option:
CXX_EXCEPTIONS=y

ok :) thank you for the tips.
This change will be introduced in arduino-esp? Is anyone working on it?
I use daily sync with master repo and I do not want to change files locally.

This is option you have to change locally, sorry but we cant change it

Action: Work with @me-no-dev to switch on Exception handling in Arduino-ESP32 libs ... or determine why that is a bad idea.

Let me have a look... I think there was a reason why I did not enable them.

ok :) will have it enabled in the next Arduino update ;)

@reaper7 based on mr @me-no-dev  response (thank you sir), we now have a dependency chain on an update to the Arduino-ESP32 before a new version of the BLE C++ classes can be formally packaged with the Arduino-ESP32 libs.  However, as Mr @chegewara says, in the interim, we can manually switch on that flag in the Arduino sdkconfig.h file.  I'm hoping that will be "sufficient" to enable exception handling in Arduino-ESP32 land ... I can't think of any obvious reason that would be a problem.
In your previous post, you said:
I use daily sync with master repo and I do not want to change files locally.
Can you clarify, which projects are you syncing?  I see possibilities including:

ESP-IDF
Arduino-ESP32
cpp_utils
some or all of the above

@nkolban the only way to get that working with Arduino before I release the next build is to actually use it as IDF component. Changing that in the prebuilt version will not change anything.

@me-no-dev .. as you know I miss obvious things and apologies for that. Can you help me understand?
My thinking is that in current ESP-IDF with current toolchains, C++ exception handling was enabled.  However, there is a modest RAM cost for enabling exception handling and since that is only applicable to C++ programs, Espressif decided to make the "availability" of C++ exception handling optional and off by default.  To "switch it on", one would normally run "make menuconfig" and enable the setting.  The "low-level" result of that the sdkconfig.h file is modified to create a new definition which appears to be:
CXX_EXCEPTIONS=1

In the latest BLE C++ classes, we added usage of exceptions and added a guard to validate that the exception support was enabled by checking that the value was set and, if not, aborting compilation with a human readable message asking the user to switch it on.
My understanding is that Arduino-ESP32 also leverages the ESP-IDF and toolchain.  However, make menuconfig isn't present/available/desirable but the sdkconfig.h file still exists ... and as set by the Arduino-ESP32 project in development.  To enable C++ exception handling in Arduino-ESP32 before a formal fix/change, would it not be sufficient for a user to edit the Arduino-ESP32 supplied sdkconfig.h file and add the entry that would enable exception processing?

I didnt check that particular option/flag how it will behave if changed in sdkconfig.h, i just assumed it will works if changing options about stack size in WiFi stack and mbedtls or bluetooth makes visible changes in compiled application.

Well here is the thing :) All IDF components are precompiled in Arduino with the sdkconfig that is attached. Changing values to sdkconfig could only influence code that is not compiled. All code that is already compiled and in binary form will not change. Definitions work only at compile, not at link time :)

@me-no-dev Aha ... gotcha sir.  The light bulb went on for me (only 25W in my case though).  That makes perfect sense.  We will wait for your nod that in a future release of the Arduino-ESP32 libs that flag has been turned on at compilation time when you build the ESP-IDF for distribution.  However, I noted your excellent suggestion about using the Arduino-ESP32 as an ESP-IDF component.  My assumption there is that in that pattern, we don't leverage the pre-supplied ESP-IDF compiled libraries but instead leverage the ESP-IDF that is in the environment of the project for the user?

Yup exactly :) it's like the tools/sdk folder of Arduino does not even exist and you are compiling the whole IDF based on the project's sdkconfig

I know it is possible but without tutorial i wouldnt know how to do that and this is something i would like to know. There is few libraries its available only on arduino ide and its pain to refactor it to idf

@chegewara Contact me on evenings/weekends via IRC and I'll walk you through it.  Study the notes in my book ... I should have written it up and, if not, that would be an ideal topic.

@nkolban

Can you clarify, which projects are you syncing? I see possibilities including:

I sync (pull) almost all stared by me (on github) libs for arduino (esp32, esp8266, others)
and of course cores for esp32 and esp8266 and Your cpp_utils (ble part) too.
ESP-IDF not :)

Do we have some progress here? Is c++ exceptions compiled yet? @nkolban  @me-no-dev

since idf 3.1 pre was tagged over the weekend, I can whip out a release in the next couple of days

Whats the status? I think c++ exceptions are not in yet, correct?

To the best of my knowledge, that is correct.  We still await the nod from mr @me-no-dev .  If we look at the files found here:
https://github.com/espressif/arduino-esp32/tree/master/tools/sdk/lib
We see the precompiled ESP-IDF that is supplied with the Arduino-ESP32 libs (as best as I understand it).  At the time of writing, these appear to be over a month old and (to me) indicate that we haven't yet achieved a release with C++ exceptions compiled in.

Does there a tutorial exist how to enable 'CXX_EXCEPTIONS=1' for arduino IDE?

No, there is no tutorial because you would have to build whole development environment and compile esp-idf libraries to arduino-ide. As for now you can use this library (i will update it today) where i commented out all exceptions usage, but its only for testing purpose to test new ble features not to build production app.
https://github.com/nkolban/esp32-snippets/pull/315


Fix typo in HISTORY.md.

Change Summary
Typo in HISTORY.md.
Related issue number
N/A
Checklist

[X] The pull request title is a good summary of the changes - it will be used in the changelog
[ ] Unit tests for the changes exist
[X] Tests pass on CI
[X] Documentation reflects the changes where applicable
[X] My PR is ready to review, please add a comment including the phrase "please review" to assign reviewers

Selected Reviewer: @sydney-runkle

please review

Thanks @felixxm nice to see you here!


Cosmetic adjustments

[ ] matrix e(_N): adjust labels to group A and group B instead of "matched" and "controls"
[x] Should we also display labels in matching-table of nopo decomp (instead of grp == 4)?
[ ] what happens if one uses abbreviations of roptions in the kmatch-passthrough-option?

_N was a leftover from kmatch - I would omit it except when requested by kmpassthru (implemented in last commit). We could still return a table, but I doubt that it brings much more to the table than the returns we already have.
Display is implemented, but with the group == x addition to be clear
Dunno :D


Add JSON.awk.

https://github.com/step-/JSON.awk
https://github.com/step-/JSON.awk/blob/master/doc/JSONTestSuite/results/full_results.md

@nst, is there something that prevents this PR from being merged?  Just wondering if I should keep updating it.  Thank you.


Unexpected token

SyntaxError: Unexpected token
undefined:1
SyntaxError: Unexpected token
Error: Command "node "c:\Users\bocai.yang.vscode\extensions\shengchen.vscode-leetcode-0.15.7\node_modules\vsc-leetcode-cli\bin\leetcode",plugin,-i,company" failed with exit code "1".

Please try to remove the folder $HOME/.lc and try again

解决了，谢谢发自我的华为手机-------- 原始邮件 --------发件人： Sheng Chen<EMAIL_ADDRESS>2019年10月30日周三 17:16收件人： jdneo/vscode-leetcode<EMAIL_ADDRESS>Icarus<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>  题： Re: [jdneo/vscode-leetcode] Unexpected token  (#471)Please try to remove the folder $HOME/.lc and try again
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or unsubscribe.

I met the same problem which bothered me serveral weeks ... and solved by delete $HOME/.lc  !!


Ukrainian translation

Fixed translation for ledgerConnectTip

Hello, we have changed these two translations in the application. The new version already supports UK. Thank you for your support.


Deadlock in ResourceReaper when running multiple containers

Describe the bug
When multiple containers are starting simultaneously, deadlock happens as the lock aquired in line 93 of ResourceReaper.cs are not released if defaultInstance is already initialized
To Fix
In ResourceReaper.cs move line 96-101 into the try-finally block

When changing to the implementation below it works:
public static async Task<ResourceReaper> GetAndStartDefaultAsync(CancellationToken ct = default)
    {
      if (defaultInstance != null && !defaultInstance.disposed)
      {
        return defaultInstance;
      }

      await DefaultLock.WaitAsync(ct)
        .ConfigureAwait(false);

      try
      {
        if (defaultInstance != null && !defaultInstance.disposed)
        {
          return defaultInstance;
        }

        defaultInstance = await GetAndStartNewAsync(DefaultSessionId, RyukImage, default, ct)
          .ConfigureAwait(false);

        return defaultInstance;
      }
      finally
      {
        DefaultLock.Release();
      }
    }

👍 good catch. Thanks. I'll try to add a fix later that evening.

Fixed in 1.6.0-beta.2226.

Thnx - tested and working :-)


Add Google Places Autocomplete API call to location search

https://developers.google.com/maps/documentation/places/web-service/autocomplete


shared.config.browser_name naming?

consider renaming to... config.name? config.executor?
seems like renaming to config.name is a bad idea,
then element.config.name would be irrelevant
element.config.executor - yet might be ok...
but should not then executor accept and remote url of the hub?

    # in the past we forced browser to restart
    # if the config.browser_name was changed to a new version...
    # now we removed this to keep things KISS
    # and potentially less conflict with e.g. Appium...
    # we also checked browser session_id ... why?
    # if stored and \
    #       stored.session_id and \
    #       stored.name == self.browser_name:
    #     return stored

why browser_name is bad?

It's not bad... But it becomes irrelevant when we for example use remote driver...
Question is - can we choose a name that can be used in more cases...

What about driver_name? Covers both: "chrome" and "remote"

yeap... might be a good option to consider...

config.browser_name definitely will be deprecated, because conflicts with Mobile context, where the default driver name is Appium, but we still via capabilities can configure betwean actual mobile browser name and native application...
In general, we don't just need to count the remote context but also the appium context. Probably we should peak the name that will be compliant fully with mobile automation. Maybe we even can allow to set config.name = 'Espresso', and this will automatically configure appium driver to connect to first available android mobile device, and so on... We might thing about config.name as driver.name for web context and automationName capability for mobile context.
Currently in master, while preparing Release Candidate 1, it's named as config.name. So we probably have to decide betwean:

config.name
config.driver_name

To make the decision, we should:

analyze:

automationName section at https://appium.io/docs/en/writing-running-appium/caps/#general-capabilities

automationName capabilitiy
browserName capability (probably to be set still via config.options as for remote context)

check config.driver.name property for all contexts (local driver, remote driver, appium espresso driver for app, appium uiautomator 2 driver for app, appium driver for mobile browser)

Some arguments for config.driver_name

has a driver term, that connects it by meaning with other *driver* named config.* options and separate form other like timeout and base_url

some examples:
from selene import browser

browser.config.timeout = 10  # to not repeat it for each below

chrome = browser.with_(driver_name='chrome', base_url='https://autotest.how')
mobile_chrome = browser.with_(driver_name='Appium', driver_options={'browserName': 'Chrome'}, base_url='https://autotest.how')
mobile_app = browser.with_(name='Espresso', driver_options={'app': '/abs/path/to/my.apk'})

# example may not be correct instead of passed driver_options, that type should be different
# we should create options object, and then update it with capabilities,
# but for simplicity I just passed dict there

Some arguments for config.name:

seems similar to config.driver_name but more concise and pretty

some examples:
from selene import browser

browser.config.timeout = 10  # to not repeat it for each below

chrome = browser.with_(name='chrome', base_url='https://autotest.how')
mobile_chrome = browser.with_(name='Appium', driver_options={'browserName': 'Chrome'}, base_url='https://autotest.how')
mobile_app = browser.with_(name='Espresso', driver_options={'app': '/abs/path/to/my.apk'})


Added .envrc

This one should work well for users with good old nix, with nix flakes and with lorri. And for users without nix (would just plain ignore loading everything except layout)

i see i should have gone into more detail, sorry about that ☺
to me an .envrc file is customization, it's something a human will write to integrate with their system and match their preferences.
and i expect a repo to define and setup what's required to work on it and match its style (like indentation or linting rules) but not my customization (like my color theme or editor layout or keyboard shortcuts).
the specifics i mentioned before are just examples, there's so much more stuff someone could want to put in their .envrc. some more examples i can think of:
source_up because they have common configuration in a parent directory. GIT_AUTHOR_* variables they set depending on context. a custom PATH for kinds of projects (like ones with yarn 1, or ones with github actions, or whatever else).
but the specifics don't really matter, my point is that whatever someone might want to do with their .envrc, i think they should be able to with minimal effort. and to me the easiest way to support that is to not include an .envrc in the repository but let people use their own.
does that make sense to you?
maybe it'd be better to add .envrc to our .gitignore?
or if we provide a sample one so it's less effort to get started using it?
would that help?
or would you really really prefer that we include an .envrc?

I would really prefer to include it.
To me, .envrc is an instruction to create an environment, a quick way to onboard a person.
And all the other (personal) configuration is either done in .envrc in parent folders (I manage work usernames and configs this way), or just never committed (cause magit/edamagit is nice)
Your use case, although, looks peculiar. Perhaps adding .envrcrc to direnv spec would be a nice thing, and I am interested what @zimbatm has to say about this :D
I am cool with adding it to .gitignore)

well if git is tracking the file already, adding it to .gitignore doesn't have any effect :upside_down_face:
and tracking a file that someone has to keep ignoring changes to is a no-go for me
how about we either

add a simple .envrc.default file to the repo and .envrc to .gitignore, then people can copy or source that default .envrc, or
add a .envrc that checks for maybe a .envrc.local and loads that instead if it exists, and we add .envrc.local to .gitignore?

in either case i think i'd like the file to be simple (like use flake, ignore nix and lorri) and to include the shellcheck annotation from the one i removed

I've opted for the second variant)

Really sorry for being so insistent :sweat_smile:

ghh

LGTM

Your use case, although, looks peculiar. Perhaps adding .envrcrc to direnv spec would be a nice thing, and I am interested what @zimbatm has to say about this :D

Initially, the .envrc was supposed to be personal but the cat got out of the bag. It would make sense to introduce an official .envrc.local-like file for user overrides. In previous discussions, we also had the idea of having those live under ~/.config/direnv/configs/<hash(path)>.sh so they don't pollute the repo tree. The main holdup is that I want to rewrite the diff context to become more extensible before doing that kind of change.


Removal of user authentication extension

According to this post on the SQLite forum the User Authentication Extension has been formally deprecated (see also SQLite Check-In message or deprecation notice in file user-auth.txt).
Therefore I intend to remove the User Authentication Extension from the SQLite3 Multiple Ciphers code base for the next release.
If someone has strong arguments to keep this extension in the SQLite3 Multiple Ciphers code base, please drop a note here.

No feedback is also a kind of feedback.
For the version of SQLite3 Multiple Ciphers based on SQLite 3.46.0 (expected in July 2024) the source code of the user authentication extension will be removed from the code base.

Good!

SQLite just removed it too

@rogerbinns Thanks for reminding me. I will remove it, too, now that this extension is officially gone. Actually, this will happen, when SQLite 3.48.0 will be released. Version 3.47.0 still includes it, and I expect that versions 3.47.x (if they happen) will also include it.

The User Authentication extension was finally removed for release 2.0.0.
The release of SQLite version 3.48.0 is expected mid of January 2025 according to the current schedule.


Added a new Project [Hotstar clone]

Title and Issue number

Title :
Hotstar Clone
Issue No. :
#129
Code Stack :
HTML , CSS ,JS
Close #129

Checklist:

[X] I have mentioned the issue number in my Pull Request.
[X] I have commented my code, particularly in hard-to-understand areas
[X] I have created a helpful and easy to understand README.md
[X] I have updated the Index.html file for my contribution

@sadanandpai Please take a review of my PR & merge it

@sadanandpai Please take a review of my PR & merge it

@sadanandpai Please take a review of my PR & merge it

@sadanandpai Please take a review of my PR & merge it

This repo is for front-end logical challenges and not for full-blown websites/UIs.
Closing this PR as invalid.


MSID: 88770 Version: 1 DOI: 2<IP_ADDRESS>5854

"msas": "Genetics and Genomics"
"msid": "88770"
"preprintDoi": "10.1101/2<IP_ADDRESS>5854"
"Reviewed Preprint posted": "2023-08-02"
"Sent for peer review": "2023-05-19"
"Posted to bioRxiv": "2023-03-28" (link: "Go to bioRxiv": "https://www.biorxiv.org/content/10.1101/2<IP_ADDRESS>5854v1
[PLACE PDF URL HERE WHEN AVAILABLE] See step 7
Step 1. Inform bioRxiv
Who can help: @QueenKraken, @nlisgo, @scottaubrey

[x] Manuscript is in data hub index (https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v1/by-publisher/elife/get-by-manuscript-id?manuscript_id=88770)

Step 2. Create preview of manuscript
Who can help: @fred-atherden, @nlisgo, @scottaubrey

[ ] Manuscript is available for preview (https://prod--epp.elifesciences.org/preview/88770/v1)

[ ] Trigger import for staging: https://prod--epp.elifesciences.org/import
[ ] Sync data folder with s3://prod-elife-epp-data/data
[ ] Trigger import for staging: https://staging--epp.elifesciences.org/import
[ ] Sync data folder with s3://staging-elife-epp-data/data
[ ] Pull request created to enhanced-preprint-data
[ ] Post link to pull request below

Pull request: [PLACE LINK TO PULL REQUEST HERE]
Detailed instructions: https://github.com/elifesciences/enhanced-preprints-data#add-a-manuscript
Step 3: Awaiting public reviews and QC
Who can help: Production team

[ ] QC passed or QC not needed

Who can help: Editorial team

[x] Public reviews available on sciety (https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>5854)
[x] Manuscript and editor details at the top of this issue (Supplied by Editorial team)
[ ] Reviews returned by EPP - https://prod--epp.elifesciences.org/api/reviewed-preprints/88770/v1/reviews

Example
"msas": "Genetics and Genomics", "Neuroscience"
"msid": "84628"
"version": "1"
"preprintDoi": "10.1101/2<IP_ADDRESS>4241"
"articleType": "Reviewed Preprint"
"status": "Published from the original preprint after peer review and assessment by eLife."

"Reviewed Preprint posted": "2023-01-02"
"Sent for peer review": "2022-10-28"
"Posted to bioRxiv": "2022-11-21" (link: "Go to bioRxiv": "https://www.biorxiv.org/content/10.1101/2<IP_ADDRESS>4241v1")

Editors:
Reviewing Editor
Michael B Eisen
University of California, Berkeley, United States
Senior Editor
Michael B Eisen
University of California, Berkeley, United States

Step 4: Modify manuscripts.json (no PDF)

[ ] Reviewed preprint is published to EPP (https://elifesciences.org/reviewed-preprints/88770)

[ ] Pull request created to enhanced-preprint-client
[ ] Pull request switched to "Ready for review"
[ ] Post link to pull request below

[ ] Request that a doi be registered

[ ] Post link to #enhanced-preprint comment below

Pull request: [PLACE LINK TO PULL REQUEST HERE]
#enhanced-preprint comment thread: [PLACE LINK TO COMMENT HERE]

Instructions to modify manuscripts.json

Visit: https://github.com/elifesciences/enhanced-preprints-client/actions/workflows/publish-manuscript.yaml
Click: Run workflow
Complete the form and click "Run workflow"
A successful run should result in a new pull request at https://github.com/elifesciences/enhanced-preprints-client/pulls
Open the pull request and click the "Ready for review" button to trigger tests
Once the tests pass and you are happy with the changes the PR can be merged

Example pull request: https://github.com/elifesciences/enhanced-preprints-client/pull/334/files
Once the pull request is merged in it should be available a few minutes later.

Request that a doi
Post the following in #enhanced-preprint:
@Fred can you register a doi for https://elifesciences.org/reviewed-preprints/88770

Step 5: Awaiting search reindex

[ ] Reviewed preprint is avaliable on journal homepage (https://elifesciences.org)

The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.

Additional info
If needed, the jenkins pipeline to reindex search can be triggered sooner.
https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 6: Published! Request PDF generation

[ ] Post the link to the PDF url at the top of the issue

[ ] Post link to #enhanced-preprint comment below

#enhanced-preprint comment thread: [PLACE LINK TO COMMENT HERE]
Post the following to the #enhanced-preprint on slack:
@Ryan Dix-Peek please can you generate a PDF for https://elifesciences.org/reviewed-preprints/88770

Step 7: Introduce PDF to data folder and git repo

[ ] PDF is avaliable at https://github.com/elifesciences/enhanced-preprints-data/raw/master/data/88770/v1/88770-v1.pdf

Detailed instructions: https://github.com/elifesciences/enhanced-preprints-data#add-a-pdf
Step 8: Add PDF url to manuscripts.json

[ ] Reviewed preprint PDF is available for download (https://prod--epp.elifesciences.org/reviewed-preprints/88770)

[ ] Pull request created to enhanced-preprint-client
[ ] Pull request switched to "Ready for review"
[ ] Post link to pull request below

[PLACE LINK TO PULL REQUEST HERE]

Instructions to add PDF url to manuscripts.json

Visit: https://github.com/elifesciences/enhanced-preprints-client/actions/workflows/add-pdf-url-to-manuscript.yaml
Click: Run workflow
Complete the form and click "Run workflow"
A successful run should result in a new pull request at https://github.com/elifesciences/enhanced-preprints-client/pulls
Open the pull request and click the "Ready for review" button to trigger tests
Once the tests pass and you are happy with the changes the PR can be merged

Example pull request: https://github.com/elifesciences/enhanced-preprints-client/pull/397/files
Once the pull request is merged in it should be available a few minutes later.

Step 9: Done!

[ ] Kettle is on!

Figure titles displaying like header titles

Large inline equations display too small to read

vol and eLocation missing from some refs


remove old python versions and pypy, add coverage and codecov to tox …

…gh-actions configs

Oh, github actions are independent for each command in a step, so probably merging coverage and codecov into tests is the best route. just a sec

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@02fba99). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #22   +/-   ##
=========================================
  Coverage          ?   58.33%
=========================================
  Files             ?        4
  Lines             ?       60
  Branches          ?        9
=========================================
  Hits              ?       35
  Misses            ?       24
  Partials          ?        1