iPython cluster resource usage

Hi Brad,
We're seeing a rather complicated problem. We notice that when we're trying to use our cluster to full capacity, the iPyhton jobs keep throwing timeout errors.
To illustrate:
Our cluster consists of 2 nodes, with respectively 8 and 16 cores, and 2GB ram per core. When we start a bcbio run on 16 cores (memory constrained) , the jobs get splitted nicely over the two nodes, and everything runs smootly and fast. When the first parallel job (mapping etc.)  is finished and iPython tries to submit the following jobs (variant calling etc.) the analysis shuts down, noting the new iPython jobs have timed out. I think this is because the previous jobs take a while to exit fully, while still holding the allotted cores and memory occupied. This causes one of the new jobs to remain queued for some time, and resulting in a timeout. In practice, this means we have to restart the analysis 2 times for it to finish, if we want to use our cluster to it's full potential.
I we start the analysis on just 8 cores ( so more resources remain available), the cascade of jobs runs perfectly.
I suppose a fix for this issue would be to speed up the exit of previous jobs, or to increase the timeout on new jobs. Or if possible in any way, perhaps wait to submit any new jobs untill the others have finished.
sorry for the wall of text, but I'd like to hear your thoughts on this.
Thanks!
M

Hi @matthdsm,
Does bumping up the --timeout parameter help? By default it waits for a short amount of time for resources to be available, setting that to something higher in minutes might fix the problem.
On some schedulers we have trouble shutting down finished jobs at the end, which could be contributing to the problem. Which scheduler are you using?
For the job that is timing out, is it requesting too many resources for the cluster? We estimate what the cluster looks like by submitting one job and looking at what the machine has for resources and then assuming all of the machines have about those resources available. In a heterogeneous cluster like this, we might be assuming too many resources exist and ask for too much. If you look at the job submission script for the step that is timing out, is it asking for more resources than your cluster has?
Hope any of that helps.

You can see what bcbio estimated was available by looking in provenance/system-ipython-general.yaml . If it says 16 cores in there it might be over-requesting resources. If you switch that to 8 it should run. But at that point I think you're better off just running the single job locally on the 16 core node since you'll use the same amount of cores.

Hi @roryk,
Thanks for your 2 cents! We'll try to increase the timeout, and perhaps use the retry option. Guess I missed those in the manual. I'll get back to you when we've got some results!
M

Hi @roryk
As promised, the results of our latest run. But first, some more info. We're running a torque cluster. I suppose this is one of the clusters where you have issues closing finished jobs? I think this is exactly the problem we're having. Strange thing is, it's a bit hit and miss, sometimes everything runs smoothly, other times, thing go to hell right after the first ipython jobs have finished.
Could we be missing something in the configuration of our cluster? Or could there be some port used by iPython that is blocked by the firewall between our nodes?
tl;dr: Adding the --retries and --timeout option didn't help. The jobs timed out trying to start the variant call postprocessing (QC,gemini, etc.)
M

Hi Matt,
If the cluster is just two nodes, one with 16 cores and one with 8 cores, you're probably better off just running bcbio in local mode on the 16 core node. bcbio will look at either the 8 core or the 16 core machine to figure out what resources are available and either overschedule (if jt thinks both have 16 cores) or underschedule (if it thinks both of 8 cores). Either way, you'll be operating for the most part using a maximum of 16 cores so you won't be losing much.

Hi @roryk
We're running the bcbio jobs as "local" now. It's too bad we can't make use of the iPython possibilities, but at least we're able to finish a run without any issues. thanks for the help.
M


Feature: Implement toString and fromString for RecordId class

Is your feature request related to a problem?
RecordId usage is pretty common in surrealdb, and casting from/to a string right now is not easy because toString gives [object Object], and to cast it from a string you need to split(':') table and id parts.
Describe the solution
It would be good if we could just do id.toString() because it's the default for JS and will be called automatically when you pass it as a string.
In case of fromString, it would be good if we had a class method for casting a string with both parts as a record id e.g.
RecordId.fromString('table:id')
// or
new RecordId('table:id')

Alternative methods
NONE
SurrealDB version
1.4.2 for windows 11 x64
SurrealDB.js version
1.0.0-beta.4
Contact Details
<EMAIL_ADDRESS>Is there an existing issue for this?

[X] I have searched the existing issues

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Just realized you can new RecordId('table', 'table:id') without having to split(':') the id parameter... Is this a correct thing to do? Or should I wait for a proper fromString implementation?

Instead of this solution I went for another route: changing the entire app to use only the .id part of RecordId. It has solved my problems, but I still think .toString() should be more readable so we could console.log it.


Fix the flaky test 'test_npx_batch_norm'

Description
Fix #18687
The flaky test is related to the PR #18504.
When axis is not 1, the CUDNN Batch Norm will be invoked on GPU. Since the size of dimention 0  is 24, the float-number precision triggers the error.
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at https://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

@mxnet-bot run ci [windows-cpu]

Can you elaborate why 24 results in imprecise results?

I merge this PR to prevent flakyness. Please still elaborate on the root cause for the imprecision. Thank you!

I ran into this issue developing a PR I have yet to submit.  The discrepancy in model outputs is caused by the fact that when cudnn calculates the running variance, it uses the 'sample variance', while this test is comparing in all cases to the 'population variance'.  The difference is that the sample variance uses a factor of N-1 in the denominator, while the population variance uses N (where N is the number of elements in the sample).
My upcoming PR will include a fix for this, and after it's merged, if you want you could revert this commit that changed the problem sizes, since that is not the real issue here.

My PR https://github.com/apache/incubator-mxnet/pull/18694 is now pushed and I am working toward getting a clean CI prior to merging.  The sample- vs. population-variance issue I mentioned above is corrected in that PR's commit https://github.com/apache/incubator-mxnet/pull/18694/commits/e0a7dda38d17c7c607a94ef4efe3b88ff1955fb3 .  Let me know if you would like the problem sizes reverted back to what they were and I can add a commit for that.

@DickJC123
Thank you!
The problem size could be reverted back after merging the PR #18694 : )


build CVE-susceptible images

[x] v0.21.1: link
[x] v0.20.0: link
[x] v0.19.2: link
[ ] v0.17.2
[x] v0.16.1: link
[ ] v0.14.3

duplicate? https://github.com/bitcoin-dev-project/warnet/issues/356

Kind of, I'd prefer to keep this as it's own issue though as I plan on adding it to a project page

CVE-2018-17144: critical inflation and crash bug
https://bitcoincore.org/en/2018/09/20/notice/

In Bitcoin Core 0.15.X, 0.16.0, 0.16.1, and 0.16.2, any attempts to double-spend a transaction output within a single transaction inside of a block where the output being spent was created in the same block, the same assertion failure will occur (as exists in the test case which was included in the 0.16.3 patch).
However, if the output being double-spent was created in a previous block, an entry will still remain in the CCoin map with the DIRTY flag set and having been marked as spent, resulting in no such assertion. This could allow a miner to inflate the supply of Bitcoin as they would be then able to claim the value being spent twice.

Affected versions:
https://bitcoincore.org/bin/insecure-CVE-2018-17144/

0.15.X
0.16.0
0.16.1
0.16.2

CVE-2017-18350: buffer overflow vulnerability in SOCKS proxy server
https://bitcoincore.org/en/2019/11/08/CVE-2017-18350/

allows a malicious SOCKS proxy server to overwrite the program stack on systems with a signed char type (including common 32-bit and 64-bit x86 PCs).
To be vulnerable, the node must be configured to use such a malicious proxy in the first place. Note that using any proxy over an insecure network (such as the Internet) is potentially a vulnerability since the connection could be intercepted for such a purpose.
Upon a connection request from the node, the malicious proxy would respond with an acknowledgement of a different target domain name than the one requested. Normally this acknowledgement is entirely ignored, but if the length uses the high bit (ie, a length 128-255 inclusive), it will be interpreted by vulnerable versions as a negative number instead. When the negative number is passed to the recv() system call to read the domain name, it is converted back to an unsigned/positive number, but at a much wider size (typically 32-bit), resulting in an effectively infinite read into and beyond the 256-byte dummy stack buffer.

Versions

0.7.0

< 0.15.1

CVE-2015-6031: MiniUPnP Internet Gateway Device Protocol XML Parser Buffer Overflow
https://bitcoincore.org/bin/insecure-CVE-2015-6031/README.txt
and
https://bitcoin.org/en/alert/2015-10-12-upnp-vulnerability

Versions before 1.9.20151008 of the miniupnpc library are vulnerable to a buffer overflow in the XML parser during initial network discovery. The vulnerable code triggers at startup of Bitcoin Core if UPnP is enabled.

It has been verified that the vulnerability can be used to crash the application at startup by running a malicious UPnP server on the local network.
To have more connectable nodes, the Bitcoin Core executables distributed by bitcoin.org include the miniupnpc library and have always had UPnP functionality enabled by default, to forward the P2P port.
This applies to the distributed executables only, not those built from source or from distribution provided packages. Self-built executables have UPnP disabled by default, unless --enable-upnp-default was provided to the configure script.

Versions
https://bitcoincore.org/bin/insecure-CVE-2015-6031/

0.8.6
0.9.0
0.9.1
0.9.2
<IP_ADDRESS>
0.9.3
0.9.5
0.10.0
0.10.1
0.10.2
0.11.0

More versions now available:
https://bitcoincore.org/en/blog/
So looks like v0.20.0, v0.19.2, v0.17.2 and v0.14.3 should start off as the prime targets (in that order of difficulty, I guess)

I updated the 12 node graph using the v0.19.2 images and got the following results:
$ warcli network start test/data/12_node_bitcoin_19_02.graphml --force

$ kubectl logs pod/warnet-tank-000000
/entrypoint.sh: setting data directory to /root/.bitcoin

Error loading shared library libboost_chrono.so.1.72.0: No such file or directory (needed by /usr/local/bin/bitcoind)
Error relocating /usr/local/bin/bitcoind: _ZN5boost6chrono12system_clock3nowEv: symbol not found
Error relocating /usr/local/bin/bitcoind: _ZN5boost6chrono12steady_clock3nowEv: symbol not found

I updated the 12 node graph using the v0.19.2 images and got the following results:
$ warcli network start test/data/12_node_bitcoin_19_02.graphml --force

$ kubectl logs pod/warnet-tank-000000
/entrypoint.sh: setting data directory to /root/.bitcoin

Error loading shared library libboost_chrono.so.1.72.0: No such file or directory (needed by /usr/local/bin/bitcoind)
Error relocating /usr/local/bin/bitcoind: _ZN5boost6chrono12system_clock3nowEv: symbol not found
Error relocating /usr/local/bin/bitcoind: _ZN5boost6chrono12steady_clock3nowEv: symbol not found

This should be fixed now

This is done in #498

Closing as complete


irq: inform device of IRQ mask & unmask via callback

Client masks or unmasks a device IRQ using the
VFIO_USER_DEVICE_SET_IRQS message. Inform the device of such changes to
the IRQ state.
Signed-off-by: Jagannathan Raman<EMAIL_ADDRESS>

@jlevon @tmakatos Hi, this pull request adds a way for client to directly inform the device about updates to IRQ state - if it's masked or unmasked


File not found when run in spyder

Environment

Python: 3.11.2 (main, Feb 12 2023, 00:48:52) [GCC 12.2.0]
IPython: 8.5.0
pyodbc: 4.0.34
OS: Debian GNU/Linux bookworm/sid
DB: mysql
driver: MySQL ODBC Connector 8
Spyder: 5.4.2

Issue
I have an ODBC connection set up with all the necessary attributes. It works through isql.
Test code: import pyodbc; x=pyodbc.connect("DSN=name").
This code works in python. It works in ipython run separately.
But it gives an error if run in a spyder ipython window:
In[1]: import pyodbc; x=pyodbc.connect("DSN=name")
Traceback (most recent call last):
        Cell In [1], line 1
                import pyodbc; x=pyodbc.connect("DSN=name")
Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib '/usr/lib/x86_64-linux-gnu/odbc/libmyodbc8w.so' : file not found (0) (SQLDriverConnect )")

Of course this file exists and is readable.
How to determine what is the difference between running in console and running in spyder?

Possibly related: https://github.com/mkleehammer/pyodbc/discussions/1157
In that case, the venv was loading its own version of a system library (libcrypto.so) instead of using the system-wide version. The strace command was used to discover that.


Judgement for whole media items

Currently, the judgment mechanism (primarily on the UI side) expects segments (of videos) to be judged, rather than whole objects. This should be generalized, so it would also work for task types that have an entire object as a target.

Ideally, this should also be interoperable with #300.


feat: add core html5_webos and cmd meta

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 65.62500% with 11 lines in your changes missing coverage. Please review.

Project coverage is 89.21%. Comparing base (1adfd78) to head (fa8043f).

Files
Patch %
Lines

src/lib/common/math.lua
65.62%
11 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff              @@
##              main      #17       +/-   ##
============================================
- Coverage   100.00%   89.21%   -10.79%
============================================
  Files            2        2
  Lines           89      102       +13
============================================
+ Hits            89       91        +2
- Misses           0       11       +11

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Check the buttons

This button could for now be selected by default 👍

The functionalities of the 2 buttons are currently inverted

i fixed it.


DXF : add support for INSERT entities

Expected Behavior
Mulitple renderings of the block entity are inserted into the returned shapes.
Actual Behavior
Just one, from the block.
Steps to Reproduce the Problem

Convert the given DXF
There should be several holes (circles) offset from the first.

For the INSERT entity to work properly its need the BLOCKS section to be dynamic and support:

Adding new blocks
Adding entities to blocks (lines, circles, etc...)
Add INSERT entity by referencing created blocks

There is to options to acheive this:

Using a tier library to handle all the complexity (I suggest my lib dxfjs/writer 😁).
Implement dynamic solution. I want to mention there is some content optional included in the static parts.

If you can tell which option I will make some PRs to help as I can.
Regards


Investigate validating Policies.xml before uploading to Vault

The PVWAConfig safe has an XML schema definition that may be worth using before uploading Policies.xml to the Vault.

Looking at Policies.xsd and PoliciesPSM.xsd in root\ConfigurationSchemas it would not be worth the effort to implement.


Don't allow user ssh->container if environment isn't healthy

We need to make those containers not active in menu and somehow notify user about the reason.

done


Handle Deeply Nested Extensions

In some cases, a field's sub-field may be mapped to something in the FHIR target, but the field's other sub-fields are not.  In this case we (probably) shouldn't create a stand-alone extension for the whole field (since part of it is already mapped) -- but we need to do something with the other sub-fields.  Those will likely be extensions, but not necessarily at the root of the resource.
We need to determine how we want to handle this -- what we do with unmapped sub-fields and where we put them.

It might be possible to disambiguate by adding something to the mapping grammar, e.g., map  as extension to  or something like that.

It's been implemented as "maps to [path].extension


I can't find the dataset in "https://www.bcsc-research.org/" website. Can you tell me the details of the download link? Thank you.

Which dataset? The dataset we used in our research is not publicly available.

Which dataset? The dataset we used in our research is not publicly available.

I saw in the paper that you said the data was the same as the reference [2,10].

Then I looked at the reference [10], "Learning to Segment Breast Biopsy Whole Slide Images". The paper says the data comes from reference “Breast Cancer Surveillance Consortium. http://www. bcsc-research.org/”. But I can't find the download link for the pathology images.

I want to ask, has this code never been run on public datasets?
Thank you for your reply.

A version of this code is tested on volumetric images, which were publicly available as a part of BRATS competition. See our repository 3D-ESPNet for the same.
Regarding dataset: The images were collected from Breast cancer consortium. However, this does not provide annotated images. For annotations, our co-author, Dr. Joann Elmore, did a pathological study which is published in JAMA, a reputed medical journal. See references in our paper for details about the paper.


MB-9049 Add a wait time for the SC login test

Description
This PR is to fix a flaky test we have: Office authorization redirects Services Counselor to Services Counselor homepage
This integration test has failed 20 times in the master branch within the past 90 days (in 487 runs of the integration_tests step, a single-test failure rate of 4.1%).
Reviewer Notes
I just re-used a constant time for long-loading pages. I mainly used it because when I did the steps the test does locally, it took a bit to load. Though I'm surprised it fails on the second thing it checks on the page. I'm wondering if we fixed this issue via devseed data and that's why we haven't seen it since around June: CircleCI test failure
Setup

If you haven't run migrations recently:
make db_dev_fresh

Run e2e tests
make run-e2e-test-docker

Code Review Verification Steps

[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

References

Jira story for this change

Messages

:book:
:link: MB-9049

  Generated by :no_entry_sign: dangerJS against 19f54e5f7ce4eda99ad84564a433c6da4b76635a


Fix check for self throwing error

Closes #67
See 2.2 in this article http://2ality.com/2013/09/window.html. The existing checks throw a reference error if self is undefined. I changed them to checks that are safe to use.

This has been dealt with


Not searching data (Checking all HyP3 projects for current INSAR_GAMMA jobs  is not working)

Notebook name
opensarlab_MintPy_Recipe_Book Version
Describe the bug
A clear and concise description of what the bug is.
its not checking data from earth data account and table of contents nothing is there
To Reproduce
Steps to reproduce the behavior:

Go to 'opensarlab_MintPy_Recipe_Book Version'
Click on '3_Access_HyP3_Data'
Scroll down to 'cell number 8'
See error "NameError                                 Traceback (most recent call last)
Cell In[10], line 11
7 for project in tqdm(my_hyp3_info['job_names']):
8         batch = Batch()
9         batch = hyp3.find_jobs(
10             name=project,
---> 11             job_type=product_type
12         ).filter_jobs(running=False, include_expired=False)
13         if len(batch) > 0:
14             active_projects.update({batch.jobs[0].name: batch})

NameError: name 'product_type' is not defined"
Expected behavior
A clear and concise description of what you expected to happen.
"It should fetch data from earth data account. so i can choose my Ondemand HyP3 data"
Screenshots
If applicable, add screenshots to help explain your problem.

Are you running locally or in OpenSARLab?
OpenSARLab
System Info (If not working in OpenSARLab):

OS: [e.g. iOS]
JupyterLab version
opensarlab_MintPy_Recipe_Book Version [e.g. 1.0.0]
Browser [e.g. chrome, safari]

Data
Details of your InSAR SBAS stack, if applicable to your problem: Polav_ISCE_1 is the project name
Additional context
Add any other context about the problem here.
After this only i can run next step so rectify quickly.

Hi @Deva234678, It appears that you skipped running the proceeding code cell, which initializes the product_type variable.

https://github.com/ASFOpenSARlab/opensarlab_MintPy_Recipe_Book/blob/main/3_Access_HyP3_Data.ipynb?short_path=6ddd836#L216-L225


Add CICRA Campus (Pvt) Ltd

Official website URL: https://cicra.edu.lk/
Long-term IT-related course URL: https://cicra.edu.lk/bachelor-of-cyber-security-pathway-program-deakin-university-australia/
Proof Documents: https://drive.google.com/drive/folders/1It2uUtG2aBTNrRdjiQurXaqdjOWkx1eY?usp=share_link
(Please go ahead and request access to the proof documents and post a reply here. Didn't provide public access to proof documents due to them containing PII)

@nmasnadithya lib/domains/net/cicracampus: this request has an incorrect file path format, please ensure that you are familiar with     this repository rules located at the bottom of this page and change     your request accordingly. If you don't know how to change request, close it and open a new one.     If you are not able to make the pull request according the instructions, please send us an email to<EMAIL_ADDRESS>Please mention this request URL in the message.

@philipto extremely sorry about that. Fixed the issue with the extension.
If I wasn't clear enough, the student emails are from the domain https://cicracampus.net while the official website is hosted under https://cicra.edu.lk/

@nmasnadithya  Thank you for the update! Pull request merged.


[nextest-filering] Remove reliance on Incomplete

Incomplete specifically means that there isn't enough data to continue processing.
Its a bit of a hack to reuse this for error recovery. This will no longer work if/when moving to winnow.
At least judging by the tests, nothing fails when removing this so its good enough?

Happy to land this if you don't have any objections.

I started writing another parser for #1172 and realized that it would probably end up conflicting with the work you're doing to port it to winnow. Let me know how you want to sequence things.

Feel free to merge this if you are ready for it.
If you feel you will be getting to the new parser in the next couple of days, go for it.  I'd like to focus on this but with some time off and other obligations it might be spotty and I'd rather not hold you up

OK, I ended up falling quite sick so never did it sadly. I may pick this up some long weekend.


Update index page Showcase

Summary
Brief explanation of the feature.
Basic example
Include a basic example or links here.

https://gridsome.org/starters/

Motivation
Why are we doing this? What use cases does it support? What is the expected outcome?

b9acbc2054f4e8a27ba0a558c84e5432c00db09f


ContracKit LocallySigned Setup SN fetch every single block

Expected Behavior
By looking at https://github.com/MetaMask/web3-provider-engine/blob/master/index.js
it seems that the ProviderEngine we use for locally signed transaction is constantly polling for new blocks, and getting the full block, thus totally suboptimal when we are using a ultralight client; since we'll get every block.
We should investigate why this behaviour and if this can be avoided. I don't know why ProviderEngine does this.

@asaj fyi

@mcortesi We are planning to use Http provider for the infura setup. Afaik, web3 will not maintain an ongoing connection and blocks won't be auto-fetched in that case. Is this issue still a concern for that case?

I think is important to get done; so i wouldn't close it. But we can deprioritize it for now

Either way doesn't look that complex to do


Add playground to the workspace

What's the value in adding this to the workplace?

IIUC we need adding it to the workspace to use custom frameworks.

Motivation: I wanted to make it sure that the code example in README should work correctly.

I'm not sure it makes sense to add this to the repository. If you want to test out other changes, you'll need to revert them or not add them when you commit. IMO it's not any harder to do that than to revert or not commit the addition of the playground to the workspace.

Thanks for the comment. It's okay, I don't have no compelling reason to add this now. Closing this. :relaxed:


Add a JWT-SVID authenticator

The authenticators validates a JWT SPIFFE Verifiable Identity Document.
Adds a configuration option to choose this new authenticator and also
adds tests for it.

This won't work until the changes are pushed in some rust-spiffe repository 🥇


App Crashes when Deleting Last Trip

I've been fighting this bug for a couple hours, but I've got to go to bed and take a break, so logging it here so I don't forget.
Essentially, when deleting multiple trips (or one, not sure), and you delete the last one, it crashes.
One idea I just came up with, move the navigationlinks out of the list, put buttons as triphomerows there instead, do the ol selection/tag thing, see if that works.
I think part of the issue is that when there are zero trips, the part of the view hosting the tripdetail is going away, so it crashes.
Maybe also (a simpler thing), would be to put the add button thing there if there are zero trips, but not take away the host if there are zero, but just let it be empty and (hopefully) take up no space.

Can confirm the simpler option DOES NOT CRASH (or appears not to). Only issue is the list takes up space even if there are no options.
THIS IS WHY TEMPLATEHOME DOESN"T HAVE THESE ISSUES.

Maybe we go with the complex option, and store the navigation links somewhere in the VStack.
Would have to make them literally invisible/infinitely small

This seems to be an iOS 14 bug!

I think this is an OS error. I'll come back to this later in the summer

Lol, issue is still in gm. I'll have to make an elegant solution later. Still kinda rare that someone will be deleting all their trips one after the other. Adding a saveContext so that if it does crash, it'll save


Update dependency-availability-by-country.md

@tiffanyyumsft : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@tiffanyyumsft once your content is ready for review and merge, type "#sign-off" in a new comment.

#sign-off

@tiffanyyumsft: I'm sorry - only the author of this article, @genlin, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

@AmandaAZ : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@tiffanyyumsft The "#sign-off" isn't limited to the author of this article. You can also type "#sign-off" to let us know your change is ready for review and merge. In addition, I made minor change such as change the note format. Let me know if there is any problem.

@AmandaAZ thanks for these changes. The changes look good to me. You've got my #signoff

@tiffanyyumsft The article is republished with the necessary changes. Thanks for your contribution.

@tiffanyyumsft The changes take effect. You can check them again from the article.


⚠ Bofrost.be has degraded performance

In e5bc88f, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1476 ms

Resolved: Bofrost.be performance has improved in 74f7886 after 6 minutes.


Add a roadmap page for resource coverage.

I can't find the left sidebar to add a link for this page.  Should I use that, or somewhere else?

The sidebar is built using the headings in index.md.
I would just add a section in index.md and then move roadmap.md to /roadmap/index.md. You'll also want to include a permalink directive in header similar to what's in /testing/index.md for example.

Forgot to mention, there is currently no PRs to link for the in progress items.

Adding cla: yes label, as the PR author is a googler at the time of this PR was created.


add --autodetect option for bq load

This PR uses --autodetect option (suggested in #1552) to create schema based on uploaded data if table doesn't exists yet.
It's also seem to be connected to #229. This PR doesn't follow idea from that issue, but final effect is the same - if table doesn't exists, it's being created. Advantage is that it doesn't require additional information and creates schema based on the data.

@asaksena can you also take a look on this? Thanks

Darius, I will be testing and closing this PR out this week. Sorry for the delay.

Hey @asaksena, any updates on this one? I just merged latest master in so changes are up-to-date again.

Merged.

Great, thanks!


does not support http headers

websocket class support headers out of the box
declare var WebSocket: {
    prototype: WebSocket;
    new (
        uri: string,
        protocols?: string | string[] | null,
        options?: {
            headers: { [headerName: string]: string };
            [optionName: string]: any;
        } | null,
    ): WebSocket;
    readonly CLOSED: number;
    readonly CLOSING: number;
    readonly CONNECTING: number;
    readonly OPEN: number;
};

the options supported here are
export declare type Options = {
    WebSocket?: any;
    maxReconnectionDelay?: number;
    minReconnectionDelay?: number;
    reconnectionDelayGrowFactor?: number;
    minUptime?: number;
    connectionTimeout?: number;
    maxRetries?: number;
    maxEnqueuedMessages?: number;
    startClosed?: boolean;
    debug?: boolean;
};

This should probably be closed. It appears that WebSockets doesn't support adding headers to the request:
https://stackoverflow.com/a/58451279/6365919
Looks like it works in my react-native project but not in the web implementation.
Work around I've used is to add the bearer token as a parameter to the URL and then implement a custom security lookup in the backend based on the presence of the token in the URL. Hope this helps.
ex: wss://myserver.com/sock?t={bearer token}

@johnbonds Since we have a headers option in ws lib, so why don't we have the same option here?
Ref: https://github.com/websockets/ws/blob/master/lib/websocket.js#L720

Web implementation of WebSockets doesn't support headers, it supports Sec-WebSocket-Protocol
refer the below link for more info
Ref :https://stackoverflow.com/questions/4361173/http-headers-in-websockets-client-api

That is only for the browser implementation of websockets, however the nodejs websocket use case (using the ws lib) does support headers.
A common method is to send the Authorization header along with the upgrade request for normal Auth behavior.


Add performance support for JSON_MATCH_ANY on S2 8.0+

Hey all,
I'm working with the S2 team, and we've run into huge performance issues when querying on multiple JSON fields in S2 (see Support ticket #27009)
Example:
WHERE
JSON_EXTRACT_STRING(`value`, 'lccontent') = 'paid' OR
JSON_EXTRACT_STRING(`value`, 'lccontent') = 'cpm' OR
JSON_EXTRACT_STRING(`value`, 'lccontent') = 'cps' OR
JSON_EXTRACT_STRING(`value`, 'lccontent') = 'cpc'

With the JSON improvements in version 8, we can replace that with something like this, which runs at 1.25s without load:
JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE '%paid%', `value`, 'lccontent') OR
JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE '%cpm%', `value`, 'lccontent') OR
JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE '%cps%', `value`, 'lccontent') OR
JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE '%cpc%', `value`, 'lccontent')

However, the Laravel driver doesn't currently support JSON_MATCH_ANY out of the box.
I've gotten it working on my system, using the following changes to SingleStore\Laravel\Query\Grammar
Functions to determine if we should use this new code:
/**
 * Get the SingleStore engine we're running on
 *
 * @param Builder $query
 * @return string
 */
private function getVersion(Builder $query)
{
    return Str::after($query->getConnection()->getPdo()->getAttribute(PDO::ATTR_CLIENT_VERSION), ' ');
}

/**
 * Whether we should do the JSON override or not (isJsonSelector & v > 8)
 * 8.0+ has a number of improved JSON functions to speed up queries
 *
 * @param Builder $query
 * @param         $where
 * @return bool
 */
private function doJsonOverride(Builder $query, $where)
{
    return $this->isJsonSelector($where['column']) &&
        version_compare($this->getVersion($query), '8.0') >= 0;
}

We then create a function to wrap the default query with JSON_MATCH_ANY, swapping in MATCH_PARAM_* for the colum:
/**
 * Wrap the returned data in a JSON_MATCH_ANY query for S2 performance
 *
 * @param Builder $query
 * @param         $where
 * @param         $originalCallable
 * @return string
 */
protected function wrapJsonMatchAny(Builder $query, $where, $originalCallable)
{
    // Swap out our column, and call the base query
    $column = $where['column'];
    $where['column'] = DB::raw('SINGLESTORE_JSON_MATCH');
    $whereSQL = call_user_func($originalCallable, $query, $where);

    // Set up our JSON Query
    // -------------------------------------------

    // Break apart the column name from the JSON keypath.
    [$field, $path] = $this->wrapJsonFieldAndPath($column);

    // TODO: Get the matching type from the value
    $matchType = 'MATCH_PARAM_STRING_STRICT()';

    // Re-assemble and return
    // -------------------------------------------
    $whereSQL = str_replace('SINGLESTORE_JSON_MATCH', $matchType, $whereSQL);
    return "JSON_MATCH_ANY($whereSQL, {$field}{$path})";
}

Finally, we apply the override to each where* function that we want support for:
protected function whereBasic(Builder $query, $where)
{
    return $this->doJsonOverride($query, $where) ?
        $this->wrapJsonMatchAny($query, $where, 'parent::whereBasic') :
        parent::whereBasic($query, $where);
}

Let me know if a PR would be preferred.

Hi @harisenbon
Thanks for your request.
As for me, it looks a little bit weird that JSON_EXTRACT_STRING(value, 'lccontent') = 'paid' works much slower than JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE '%paid%', value, 'lccontent').
I would do some investigations before adding this feature.

@AdalbertMemSQL

As for me, it looks a little bit weird that it works much slower

Yeah, I thought so too ;)
I would love to use , JSON_EXTRACT_STRING (as it gives some type casting benefits) but I have a month of tickets with support about how I should be using JSON_MATCH_ANY instead.

I just had a chance to test this thing.
Used 8.0.12 version of the SingleStore.
MySQL [db]> select * from t where JSON_EXTRACT_STRING(`value`, 'lccontent') = 'asdas';
Empty set (0.163 sec)

MySQL [db]> select * from t where JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE 'asdas', `value`, 'lccontent');
Empty set (0.479 sec)

Looks like JSON_EXTRACT_STRING worked ~3 times faster.
Then I tried bigger JSON values and the difference was not so significant, but even with very big JSON values,  JSON_EXTRACT_STRING is slightly faster.
MySQL [db]> select * from t where JSON_EXTRACT_STRING(`value`, 'lccontent') = 'asdas';
Empty set (1.525 sec)
MySQL [db]> select * from t where JSON_MATCH_ANY(MATCH_PARAM_STRING_STRICT() LIKE 'asdas', `value`, 'lccontent');
Empty set (1.873 sec)

@harisenbon Can you please clarify, what version of SingleStore are you using and what the schema/size of your JSON data is?
Probably, this performance degradation happens only in some specific cases.


Web component:  MegaMenu desktop and mobile Prod QA testing

This work is a follow-on to the development work done to create the same React version.  The React development was managed under epic (#3120)
User Story

As a [user role below]:
developer using the ibm.com Library MegaMenu

I need to:
have a version of the component that has been tested for accessibility compliance as well as on multiple browsers and platforms

so that I can:
be confident that my ibm.com web site users will have a good experience

Additional information

Browser Stack link
Browser Standard
Browser versions to be tested:  Tier 1 browsers will be tested with defects created as Sev 1 or Sev 2.  Tier 2 browser defects will be created as Sev 3 defects.
Platforms to be tested, by priority:  1)  Desktop  2)  Mobile  3)  Tablet
Mobile & Tablet iOS versions: 13.1 and 13.3
Mobile & Tablet Android versions: 9.0 Pie and 8.1 Oreo
Browsers to be tested:  Desktop: Chrome, Firefox, Safari, Edge, Mobile: Chrome, Safari, Samsung Internet, UC Browser, Tablet: Safari, Chrome, Android
Accessibility Checklist
Creating a QA bug
See the Epic for the Design and Functional specs information
Desktop Dev issue (#3284)
Mobile Dev issue (#3849)
Once development is finished the updated code is available in the Web Components Canary Environment for testing.
The React canary environment component should be used for comparison

Acceptance criteria

[ ] Accessibility testing is complete.  Component is compliant.
[ ] All browser versions are tested
[ ] All operating systems are tested
[ ] All devices are tested
[ ] Defects are recorded and retested when fixed

@Praveen-sr The Megamenu web component has been developed. You can test here: https://ibmdotcom-web-components-canary.mybluemix.net/?path=/story/components-masthead--default
CC: @RobertaJHahn

Prod QA testing of desktop has started

Msg from Kenny posted to Dev issue:  @RobertaJHahn @Praveen-sr This is ready for QA http://ibmdotcom-web-components-canary.mybluemix.net/?path=/story/components-masthead--default

@RobertaJHahn Prod QA testing and accessibility testing has be completed.


Run verify slow on first test method

Hi,
I am running  java/maven/JUnit4  on  multiple test classes  from testparameterinjector  1.14 ,  I do find the first method of first test class execution is very slow , it takes more than  3-4 mins compared with Junit Parameterized , any suggestion on this ?
I can  not find this delay on sequently method/class .

Can you replicate this issue in a minimal example and share that example, please?

the test project  is running against our internal  spring context  /bean app , it is very hard to have a simple example.
we found 3-4 mins increase  for first test method in Junit test xml ,   does testparameterinjector overwrite  the way  calculating  test execution time ?

does testparameterinjector overwrite the way calculating test execution time ?

Not that I know

we  add  time stamp on before/after  method ,   execution time  is not different , but  execution time from  junit report has increased a lot .

I take a  quick look on  PluggableTestRunner ,
getTestMethodProcessors().postProcessTestInstance(testInstance, testInfo);
I think this method would take a longer time to process at the first time ,  considering there are multiple inherence in test class , and each test class have spring beans  such as
@Autowired
private TestA  testa;
......
@Autowired
private TestB  testb;
It would be slow at beginning when going  through  on parent classes from java reflection .

What would you suggest to fix this?

Maybe we could  exclude    parsing /scan effort as part of test case execution itself , that cause  confusion .
Also , it looks like PluggableTestRunner is  running  postProcessTestInstance/scan  on every test method which is ver heavy.
Not sure how JUnitParamsRunner handle this .

One more suggestion is maybe we need move  parse/scan   out of methodBlock , otherwise Junit  treats that as part of  method execution time.
Ideally , we need parse/scan/inject  before test class start .

So if I understand you correctly, this is more about the confusing timings reported by JUnit than it is about the actual slowness?
 Do you have many test methods? I'd think that the @Autowired stuff gets done after the TestParameterInjector stuff. It would really be helpful if you have a minimal test that you can share that reproduces this issue, so that I can investigate where all the time is being spent. There is definitely a lot of work that's happening multiple times that could be cached if the need arises.
About the time reporting: I had a look at JUnitParamsRunner, and they seem to be interfacing with JUnit in a completely different way, and it's a bit hard to see which one is best.
If you have a proof of concept of what we could do differently, I'm happy to run it against all Google tests and see if it works.

yes, you are right , sorry for confusion , that is not  slowness actually , I changed title just now .
Our  test classes are inherence from many layers, each layer is spring context  with huge  @Autowired ,  there are around 10000 test class/context need to be initialized,  it takes 3-4 mins ,  we compared between JUnitParamsRunner and testparameterinjector ,  that initialization time is same , only difference  is ,  JUnitParamsRunner trigger initialization before test class start  while for testparameterinjector , it happens after test class start .
I think JUnitParamsRunner handle  different  way as yours for sure .
We will take a look and ping you back once we have good solution .
Thanks for help and support !!!


Add ability to create console apps

This PR has two changes:

It adds CONSOLE option to the ax_setup_app_config() function to allow creating console apps that use Axmol.
And a small change to 1k/build.ps1 to print out what CMake command is run when building.

entrypoint will missing when build as console app

I'm aware of this, but I think if someone will use this option, then he knows what he is doing. And I don't know of a simple way to solve this.

I'm aware of this, but I think if someone will use this option, then he knows what he is doing and it will be an easy fix. And I don't know of a simple way to solve this.

What about adding a AX_CONSOLE_APP definition or similar in cmake, via add_compile_definition, that you can check for in the code, and have the correct main function used in proj.win32/main.cpp and .h as a result?
#if defined(AX_CONSOLE_APP)
int main()
#else
int WINAPI _tWinMain(HINSTANCE hInstance, HINSTANCE hPrevInstance, LPTSTR lpCmdLine, int nCmdShow)
#endif
{
...
}

I'm aware of this, but I think if someone will use this option, then he knows what he is doing and it will be an easy fix. And I don't know of a simple way to solve this.

What about adding a AX_CONSOLE_APP definition or similar in cmake, via add_compile_definition, that you can check for in the code, and have the correct main function used in proj.win32/main.cpp and main.h as a result?
#if defined(AX_CONSOLE_APP)
int main()
#else
int WINAPI _tWinMain(HINSTANCE hInstance, HINSTANCE hPrevInstance, LPTSTR lpCmdLine, int nCmdShow)
#endif
{
...
}

I fixed it


Connection issue

I have an error from backend when calling most of functions

, for example this function:
self.userSession = try msa?.blockingConnect(username: name, password: pass)
MySocialApp was compiled with optimization - stepping may behave oddly; variables may not be available.
I detect this error message by breakpoint, because when after function running the console is empty.
Also the method of connect() doesnt return anything.
can you please look at this?

Hi,
Can you please use the issue template. We're lacking information there to help you.
I'm closing the issue.
Thanks for your comprehension


OData Actions: Multiple exports with identical name generated

Context:
The SAP Cloud Application Programming Model generates a draftPrepare Action into the metadata for each entity that is draft enabled (or "inherits" the draft enablement). This is done to be able to execute checks to validate the current draft entity.
Problem:
Seems like for each action with identical name (but related to a different entity), e.g.
<Action Name="draftPrepare" IsBound="true" EntitySetPath="in">
    <Parameter Name="in" Type="MyService.EntityA"/>
    <Parameter Name="SideEffectsQualifier" Type="Edm.String"/>
    <ReturnType Type="MyService.EntityA"/>
</Action>
<Action Name="draftPrepare" IsBound="true" EntitySetPath="in">
    <Parameter Name="in" Type="MyService.EntityB"/>
    <Parameter Name="SideEffectsQualifier" Type="Edm.String"/>
    <ReturnType Type="MyService.EntityB"/>
</Action>

the resulting MyServiceModel.d.ts from odata2ts exports an identical interface (each one below the interface of the respective entity):
export interface EntityA {
    [...]
}

export interface draftPrepareParams {
    SideEffectsQualifier?: string | null;
}

export interface EntityB {
    [...]
}

export interface draftPrepareParams {
    SideEffectsQualifier?: string | null;
}

In my specific case it's eight times the same interface 🙈
Of course ESLint does not approve: ESLint: Multiple exports of name 'draftPrepareParams'

fixed 👍


Some transactions are relayed with no "vout" field

If you watch the sockets for a little bit you'll notice this odd phenomena. This tx was relayed from the bitpay insight node:
{"txid":"6f5b576c2abdfb0f0dcbadabd9915685fa29608a90e1086e91e5c7ea4b6b620e","valueOut":0.00178}
Looks ok here, it has output addresses, they just weren't sent to the socket.
https://insight.bitpay.com/tx/6f5b576c2abdfb0f0dcbadabd9915685fa29608a90e1086e91e5c7ea4b6b620e

oops this should be on the insight-api repo issues. sorry. can close here, I'll open it there.


Transaction in raw queries doesn't work

Environment
Knex version: 0.19.4
Database + version: Mysql v5.7.27
OS: OSX
Bug
If I use transaction with a raw query, when an error occurs, the rollback function is called but without effect into the database.
Is it possible to use transaction with raw queries?
Below the snippet of my code:
const trx = await knex.transaction();
trx.raw('INSERT INTO...").then(trx.commit).catch(trx.rollback);

Please add error message that you are getting.

Also what do you mean by "without effect into the database"... if rollback is called, there should be no effect.

I mean the Knex rollback funtion is called but the just inserted rows are
still there
Il giorno mar 24 set 2019 alle 21:13 Mikael Lepistö <
<EMAIL_ADDRESS>ha scritto:

Also what do you mean by "without effect into the database"... if rollback
is called, there should be no effect.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tgriesser/knex/issues/3452?email_source=notifications&email_token=AA2AHCL3YKD2KV2HVVT5KGDQLJRFPA5CNFSM4IZ5DW52YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7PPWQY#issuecomment-534707011,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA2AHCIFXM5XMSUJSN527ITQLJRFPANCNFSM4IZ5DW5Q
.

does it work if you are doing the same query with .insert without using knex.raw? Which error are you getting? I mean you example code should not insert anything if error is thrown and that nothing should be removed anyways if rollback is executed...
Please add complete reproduction code.

Failed to reproduce on postgres with same knex version

    await db.raw(`CREATE TABLE IF NOT EXISTS test(a text)`);
    await db
        .transaction(async (trx) => {
            try {
                await trx.raw(`INSERT INTO test(a) VALUES ('lol')`);
                await trx.raw(`INSERT INTO test(b) VALUES (5)`);
                await trx.commit();
            } catch (e) {
                await trx.rollback();
            }
        })
        .catch(console.error);
    console.log((await db.raw('SELECT * FROM test')).rows.length); // === 0
    await db.raw('DROP TABLE test');

Closing until complete reproduction code is provided.

You can use this snippet to reproduce the issue
  const trx = await knex.transaction();

  await trx.schema.createTable("test", function(table) {
    table.increments();
    table.string("name");
  });

  await trx("test").insert({ name: "foo1" });
  await trx("test").insert({ name: "foo2" });

  await trx.rollback();

The behavior expected is no table created into the database, but the table is there instead

Apparently in MySQL creating a table causes an implicit commit https://dev.mysql.com/doc/refman/5.6/en/implicit-commit.html

Ok, but the two rows are inside the table as well. According to your supposition, I would expect just an empty table

@KristjanTammekivi is correct.
Transaction gets committed directly after createTable is executed. Then when you send new inserts to that connection trx they are just executed in implicit transaction and finally when you try to rollback, there is actually nothing to rollback, since there is no active transaction going on.
Would be good if we are able to recognize when implicit commits are happening and also commit transaction on knex side at the same moment.
I don't know if mysql driver provides any events to catch those though.

Effectively trx returned by knex.transaction() is just a knex instance, which is bound to always use the same connection and with couple of extra methods for commit / rollback.

this snippet works correctly
await knex.schema.createTable("test", function(table) {
  table.increments();
  table.string("name");
});

const trx = await knex.transaction();

await trx("test").insert({ name: "foo1" });
await trx("test").insert({ name: "foo2" });

await trx.rollback();

As you can see, if I don't use the transaction to create the table, the transaction is correctly rollbacked and the table is empty.
Maybe, can I use the transactionProvider to fix the issue?

this snippet works correctly
await knex.schema.createTable("test", function(table) {
  table.increments();
  table.string("name");
});

const trx = await knex.transaction();

await trx("test").insert({ name: "foo1" });
await trx("test").insert({ name: "foo2" });

await trx.rollback();

As you can see, if I don't use the transaction to create the table, the transaction is correctly rollbacked and the table is empty.
Maybe, can I use the transactionProvider to fix the issue?

If that works perfectly, what is the issue that you are thinking of fixing with transactionProvider?

According @KristjanTammekivi the create table does an implicit commit. As you can see, I don't use the transaction to create the table.
I would like to use everywhere the transaction, but I think it's a technical limit of mysql. If so, for me the issue is closed.


npm support

Isn't it available on npm?
If no, will it be available on near future?
Thank you

I've fixed the error and published this library as an NPM module giving credit to the author.
https://www.npmjs.com/package/fakeloader
npm install fakeloader

Hi all
The fakeLoader.js was updated to V.2.0.0
You can now installing by npm or yarn:
https://github.com/joaopereirawd/fakeLoader.js/blob/master/README.md
What's new in version 2.0:
https://github.com/joaopereirawd/fakeLoader.js/releases/tag/V2.0.0


Javascript error when disabling Hyperdeck instance

I use Companion and a Stream Deck to manage a rack of Blackmagic video equipment.  The Companion app runs in the background, so when I shut down the video equipment rack there is a Companion command to disable the interfaces to all of the Blackmagic devices.  I have had issues with Companion crashing silently when I shut everything down.  Through trial and error I have isolated it to a reproducible situation when I attempt to disable a Hyperdeck instance when the Hyperdeck is already powered off (in a "connecting" or "error" state in Companion).  Attached is the javascript error that results in Companion crashing.
Expected behavior: Companion should gracefully handle this error and disable the Hyperdeck instance even if the Hyperdeck is not currently connected.

Thanks for the report.
Can you confirm which version of Companion you are using?

2.1.1

I haven't managed to precisely narrow down the conditions to recreate this every time, but I can reproduce the bug by toggling the enable/disable status when the deck is unreachable.
An error event is being emitted by hyperdeck-connection, which is usually caught and logged, but not under some conditions.
events.js:291
      throw er; // Unhandled 'error' event
      ^

Error: connect ETIMEDOUT <IP_ADDRESS>:9993
    at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1145:16)
Emitted 'error' event on Hyperdeck instance at:
    at Socket.<anonymous> (…/companion/lib/module/bmd-hyperdeck/node_modules/hyperdeck-connection/dist/hyperdeck.js:45:45)
    at Socket.emit (events.js:314:20)
    at emitErrorNT (internal/streams/destroy.js:92:8)
    at emitErrorAndCloseNT (internal/streams/destroy.js:60:3)
    at processTicksAndRejections (internal/process/task_queues.js:84:21) {
  errno: 'ETIMEDOUT',
  code: 'ETIMEDOUT',
  syscall: 'connect',
  address: '<IP_ADDRESS>',
  port: 9993
}

Any ideas @baltedewit ?

It looks to me like it's an old socket lingering around. I can reproduce this by enabling the instance with a non-hyperdeck IP address and then waiting for a long time. It seems more consistent since the node 12 upgrade too so that will be good for reproducing.

This edge-case needs to be handled better by hyperdeck-connection, as there is no way for us to know if a connection attempt is still in-flight (and therefore need to wait for it to time-out).
https://github.com/nrkno/sofie-hyperdeck-connection/issues/16

Latest update should prevent all these crashes happening now.


alerts: adding prometheus rules for basic alerts

Let's start with those two alerts. The latest one is a basic alert, the easiest way to emit information about clusters with OSC installed for our internal dashboards. Only the first one will be converted into an incident report.
- What I did
New clusters will have those prometheus rules.
- How to verify it
Deploy the operator and check your alerts into your cluster UI.
- Description for the changelog[
New alerts: added basic Prometheus rules for OSC monitoring.

@gkurz @bpradipt those are the two alerts that we came up after a few meetings with the ARO team. This will be consumed by Prometheus -> ARO-RP -> Geneva.
Flagging as draft because I'm still waiting some confirmation from them, but please feel free to comment on top this in meanwhile.


Predicate compilation succeeds when it should not

A simple predicate with an unwrap contains the revert opcode, which should fail compilation but does not
This later fails with (looks like a VM error)
Transaction(Validation("PredicateVerificationFailed(PanicInstruction(PanicInstruction { reason: ContractInstructionNotAllowed, instruction: RVRT { value: 0x0 } (bytes: 36 00 00 00) }))"))

The error seems to be coming from https://github.com/FuelLabs/fuel-vm/blob/a3f4f1e9ca57d3960c90e50cb7b1b22de15cbc2a/fuel-vm/src/interpreter/executors/instruction.rs#L94
The VM checks what opcodes are allowed at https://github.com/FuelLabs/fuel-vm/blob/master/fuel-asm/src/lib.rs#L688, we check which are NOT allowed at https://github.com/FuelLabs/sway/blob/master/sway-core/src/asm_generation/fuel/checks.rs.
Maybe it is worthy to do the same as the VM and avoid future problems.

We will implement a static check at https://github.com/FuelLabs/sway/issues/5986


🐞 - Enabling REMOVE_STYLES_ON_COMPONENT_DESTROY causes "leave" animations to misbehave

Description
If you enable REMOVE_STYLES_ON_COMPONENT_DESTROY in Angular 16, all the "Taiga UI" component "leave" animations start to misbehave. The setting is disabled by default in Angular 16, but will be enabled in Angular 17 according to the docs.
Sidenote: Angular Material animations seem to be unaffected by this setting.
Angular version
16.1.1
Taiga UI version
3.32.0
Which browsers have you used?

[X] Chrome
[ ] Firefox
[ ] Safari
[ ] Edge

Which operating systems have you used?

[ ] macOS
[X] Windows
[ ] Linux
[ ] iOS
[ ] Android

it didn't exist in angular 12 yet

Why does it matter?

yes I agree, just wanted to pin my message

@hakimio can you please name a component that exhibits this, I'll try to isolate it on Stackblitz. I don't think we do many complicated stuff with leave animations, maybe that would boil down to a bug in Angular.

hint, dropdown, notification toasts (alertService.open()), etc.
All of them have buggy leave animations when REMOVE_STYLES_ON_COMPONENT_DESTROY is enabled.

Closing this as an Angular bug:
https://github.com/angular/angular/issues/50791


Unable to use the CRD example schema

I'm trying to validate my kubernetes templates using kubeconform in a github actions workflow, however I get an error in my CI
Here is the step in my build process
- uses: docker://ghcr.io/yannh/kubeconform:master
  with:
    entrypoint: '/kubeconform'
    args: >
      -summary -output text
      -schema-location default
      -schema-location 'https://raw.githubusercontent.com/datreeio/CRDs-catalog/main/{{ .Group }}/{{ .ResourceKind }}_{{ .ResourceAPIVersion }}.json'
      manifest-${{ matrix.name }}.yaml"

I have copied the url from the README, however I get the following error:
failed initialising schema location registry: template: tpl:1:64: executing "tpl" at <.Group>: can't evaluate field Group in type struct { NormalizedKubernetesVersion string; StrictSuffix string; ResourceKind string; ResourceAPIVersion string; KindSuffix string }
It appears that {{.Group}} is not valid as part of the template string? What should I be using there instead?

try without the spaces before and after each variable.
-schema-location 'https://raw.githubusercontent.com/datreeio/CRDs-catalog/main/{{.Group}}/{{.ResourceKind}}_{{.ResourceAPIVersion}}.json'

it's a weird bug in GH workflow

Ah apologies, I modified that line to make it clearer for the issue. In my workflow it's a one liner, with no spaces in the template
        args: "-summary -output text -schema-location default -schema-location 'https://raw.githubusercontent.com/datreeio/CRDs-catalog/main/{{.Group}}/{{.ResourceKind}}_{{.ResourceAPIVersion}}.json' manifest-${{ matrix.name }}.yaml"

are you able to reproduce this issue when running kubeconform locally?
the error that you're getting is related to an older version of kubeconform but it looks like you're using the latest version 🤷

Ohhh very nice catch on the incorrect tag, apologies ❤

Closing, the Readme has been updated :bow: thanks for the report :heart:

I ran into a similar issue and the fix for me was dropping the '' around the schema links:
- name: Scan files with kube-conform
  if: inputs.kube_conform_checks == 'true'
  id: kube_conform_scan
  uses: docker://ghcr.io/yannh/kubeconform:v0.6.4
  with:
    entrypoint: '/kubeconform'
    args: >
      -summary
      -strict
      -kubernetes-version ${{ inputs.kubernetes_version }}
      -schema-location default
      -schema-location https://raw.githubusercontent.com/datreeio/CRDs-catalog/main/{{.Group}}/{{.ResourceKind}}_{{.ResourceAPIVersion}}.json
      -schema-location https://json.schemastore.org/kustomization.json
      -output ${{ inputs.kube_conform_format }}
      ${{ inputs.directory }}


Workaround cinterop issue with PhoenixCrypto

There's an incompatibility between XCode 13 (recently released) and the clang shipped with
Kotlin/Native, causing issues when building PhoenixCrypto. The workaround
is to make NS_FORMAT_ARGUMENT a noop.
More on this here:
https://youtrack.jetbrains.com/issue/KT-48807#focus=Comments-27-5210791.0-0

Additional info: The github CI environment  that we use to test and build ios/macos (and android) projects is https://github.com/actions/virtual-environments/blob/main/images/macos/macos-10.15-Readme.md which includes XCode12.
It should be upgraded to https://github.com/actions/virtual-environments/blob/main/images/macos/macos-11-Readme.md soon, which still seems to use XCode12


Random text typos

that I noticed.
I think automagically should be an English word.

"automagically" is in the Oxford dictionary: http://www.oxforddictionaries.com/definition/english/automagically
Great to know, I have been using it for some years, so nice to know it is official.


Expand variables in containers' env, cmd, args

Depends on #7936, not ready for review.

@smarterclayton @derekwaynecarr @a-robinson PTAL

cc @thockin

For the record, I decided when coding this that adding a new env var source was unnecessary / inconsistent with the rest of the agreed upon changes.

@a-robinson if you have bandwidth I'd love your input on this

@derekwaynecarr @a-robinson Should be ready for review.

LGTM other than a few really minor cleanups. Thanks for the revisions!

Re: ordering sure thing
On Sat, May 23, 2015 at 7:43 PM Alex Robinson<EMAIL_ADDRESS>wrote:

LGTM other than a few really minor cleanups. Thanks for the revisions!
—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/pull/8149#issuecomment-104955188
.

@a-robinson PR deloused, PTAL

@derekwaynecarr, any other comments?

@a-robinson, derek is too stunned to speak, clearly.  any chance the on-call can TAL tomorrow?

@a-robinson unfortunately I need to remove LGTM status from this, i believe there is something I missed that needs to be updated.

elaborating on my prior comment, looks like the dns test needs to be updated since it uses the subshell $() syntax in the image's command.

Cluster logging e2e is affected too.  They should both pass but I don't want to be sloppy.

Good catch, let me know when you've fixed them up.
The oncall is still catching up with the backlog from last week's merge freeze, so the current protocol is just to slap the status/lgtm on it and wait for them to come by and merge it.

@a-robinson Latest code has fixes.  Thnx for clarification re: on-call.

LGTM, assuming you made sure the modified e2e tests pass.

Yeah, i got a clean e2e run in GCE
On Wed, May 27, 2015 at 12:46 AM Alex Robinson<EMAIL_ADDRESS>wrote:

LGTM, assuming you made sure the modified e2e tests pass.
—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/pull/8149#issuecomment-105754694
.


2.0.4

:white_check_mark: Build TheIdServer 2.0.4-ci.1+6.build.967 completed (commit https://github.com/Aguafrommars/TheIdServer/commit/1016751521 by @aguacongas)

:white_check_mark: Build TheIdServer 2.0.4-ci.1+8.build.970 completed (commit https://github.com/Aguafrommars/TheIdServer/commit/0b317927e6 by @aguacongas)


Wire up support for stable asm!()

Support for asm!() has finally landed in stable rust!  This should make the crate usable by those building with 1.59 stable and later.  Earlier nightly compilers should continue to work, provided the feature(asm) declaration is still in the consumer crate.

This is awesome! Thank you. Can you update the README.md as well? I would suggest writing it from the perspective of 1.59+ being the norm, but perhaps with a section devoted to pre 1.59
This "test_does_it_work" looks potentially unstable... you might check with @bnaecker if it's not an easy one to resolve.

Can you update the README.md as well?

I've tweaked it to emphasize the inline-asm-is-now-stable case.  I'm happy to defer if you think it should be done differently.

This "test_does_it_work" looks potentially unstable... you might check with @bnaecker if it's not an easy one to resolve.

I'm not sure what's going on there.  On my illumos (omnios) machine, the does-it-work test passes, but the relative-import test fails (due to compiler error output being slightly different between nightly and stable).

I think the test_compile_errors failure may be due merely to a change in the rustc error formatting..

@ahl Yeah, agreed. I'm not sure those tests are valuable anymore, to be honest. They were useful during development, to make sure we had helpful messages. But now that we do, it seems only a test of the internals of these messages. And given that we'll be supporting both stable and nightly (for macOS) for a while, I doubt those messages will be consistent enough to test.


Misc cleanup, and code review feedback.

Unified with my other project, and addressed some comments on my previous PR.

Hey sorry I completely missed this. I'm making some more changed to support the new Fleet API; I'll roll your improvements into that and get your review.


Web scraping using OCR software .

Problem - Data scrapped from the website would be insufficient and inaccurate with only usage of selenium and beautiful soap for scrapping.
solution- I propose the usage of OCR software called Tesseract , which would extract text from images , selenium has a feature where it can take couple of screenshots of website  ,this will be given to tesseract for extraction.
Please assign me  this issue

I am eager to make a meaningful contribution to this project. Kindly assign me this tasks as it aligns with my skills and expertise.

assigned to you @litesh1123
Issue will be assigned to Only 1 person ...FCFS basis.
Others get a chance if the issue gets stale & the assignee is inactive for 5+ days
Also if you would like to work on more issue create a new issue and I will create label and assign you.

@sanjay-kv  thank you sir

Please assign me this issue


Spaceship– 'Bad Request' and crash on match development

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I have read the Contribution Guidelines

Issue Description
When running match development to generate certificates to share, spaceship crashes while trying to create new ones. Also crashes if there is a generated certificate but you have an empty match repo. To be clear, I am trying to run match standalone to troubleshoot, thus why my fastfile includes no mention of it.
Complete output when running fastlane, including the stack trace and command used

+-----------------------+------------------------------------------+
|                     Summary for match 0.6.2                      |
+-----------------------+------------------------------------------+
| git_url               | XXXXXXXXXXX |
| type                  | development                              |
| git_branch            | master                                   |
| username              | XXXXXXXXXXX                            |
| keychain_name         | login.keychain                           |
| readonly              | false                                    |
| team_id               | XXXXXXXXXX                               |
| verbose               | false                                    |
| force                 | false                                    |
| shallow_clone         | false                                    |
| force_for_new_devices | false                                    |
| skip_docs             | false                                    |
+-----------------------+------------------------------------------+

[15:34:19]: Cloning remote git repo...
[15:34:19]: 🔓  Successfully decrypted certificates repo
[15:34:19]: Verifying that the certificate and profile are still valid on the Dev Portal...
[15:34:21]: To not be asked about this value, you can specify it using 'app_identifier'
The bundle identifier of your app: XXXXXXXXXXX
[15:34:31]: Couldn't find a valid code signing identity in the git repo for development... creating one for you now

+---------------+----------------------------------------------------+
|                       Summary for cert 1.4.1                       |
+---------------+----------------------------------------------------+
| development   | true                                               |
| force         | true                                               |
| username      | XXXXXXXXXXX                             |
| team_id       | XXXXXXXXXXX                                         |
| keychain_path | /Users/carterkonz/Library/Keychains/login.keychain |
+---------------+----------------------------------------------------+

[15:34:31]: Starting login with user 'XXXXXXXXXXX'
[15:34:33]: Successfully logged in
[15:34:33]: 🔒  Successfully encrypted certificates repo

Looking for related GitHub issues on fastlane/fastlane...

➡  crash on ad_hoc provisioning profile delete
   https://github.com/fastlane/fastlane/issues/3427 [closed] 1 💬
   08 Mar 2016

➡  crash on ad_hoc provisioning profile delete!
   https://github.com/fastlane/fastlane/issues/3485 [closed] 0 💬
   08 Mar 2016

/Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/2.3.0/json/common.rb:156:in `parse': [!] 784: unexpected token at 'Bad Request' (Faraday::ParsingError)
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/2.3.0/json/common.rb:156:in `parse'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday_middleware-0.10.0/lib/faraday_middleware/response/parse_json.rb:11:in `block in <class:ParseJson>'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday_middleware-0.10.0/lib/faraday_middleware/response_middleware.rb:48:in `parse'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday_middleware-0.10.0/lib/faraday_middleware/response_middleware.rb:39:in `process_response'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday_middleware-0.10.0/lib/faraday_middleware/response_middleware.rb:32:in `block in call'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:57:in `on_complete'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday_middleware-0.10.0/lib/faraday_middleware/response_middleware.rb:30:in `call'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:177:in `post'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/client.rb:411:in `block in send_request'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/client.rb:328:in `with_retry'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/client.rb:410:in `send_request'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/client.rb:385:in `request'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/portal/portal_client.rb:284:in `create_certificate!'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/spaceship-0.31.2/lib/spaceship/portal/certificate.rb:298:in `create!'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/cert-1.4.1/lib/cert/runner.rb:137:in `create_certificate'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/cert-1.4.1/lib/cert/runner.rb:37:in `run'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/cert-1.4.1/lib/cert/runner.rb:6:in `launch'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/generator.rb:19:in `generate_certificate'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/runner.rb:49:in `certificate'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/runner.rb:17:in `run'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/commands_generator.rb:55:in `block (3 levels) in run'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/commander-4.4.0/lib/commander/command.rb:178:in `call'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/commander-4.4.0/lib/commander/command.rb:153:in `run'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/commander-4.4.0/lib/commander/runner.rb:444:in `run_active_command'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/fastlane_core-0.50.2/lib/fastlane_core/ui/fastlane_runner.rb:36:in `run!'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/commander-4.4.0/lib/commander/delegates.rb:15:in `run!'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/commands_generator.rb:121:in `run'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/lib/match/commands_generator.rb:12:in `start'
	from /Users/carterkonz/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/match-0.6.2/bin/match:6:in `<top (required)>'
	from /Users/carterkonz/.rbenv/versions/2.3.1/bin/match:23:in `load'
	from /Users/carterkonz/.rbenv/versions/2.3.1/bin/match:23:in `<main>'

Configuration Files
Please copy the complete content of your Fastfile and any other configuration files you use below:
Fastfile:
fastlane_version "1.96.0"

default_platform :ios

platform :ios do
  before_all do
    ENV["SLACK_URL"] = "XXXXXX"
    unlock_keychain(
      path: "~/Library/Keychains/login.keychain",
      password: "XXXXXX"
    )

  end

  desc "Submit a new Beta Build to Apple TestFlight"
  desc "This will also make sure the profile is up to date"
  lane :dev do
    recreate_schemes(
      project: 'XXXXXX.xcodeproj'
    )
    increment_build_number({
      build_number: latest_testflight_build_number(
        app_identifier: "XXXXXX"
      ) + 1
    })
    # match(type: "appstore") # more information: https://codesigning.guide
    # Build your app - more options available
    cert
    sigh(
      app_identifier: "XXXXXX"
    )
    gym(
      scheme: "XXXXXX"
    )
    # Upload to Testflight
    pilot(
      app_identifier: "XXXXXX",
      skip_waiting_for_build_processing: true
    )

  end

  after_all do |lane|

  end

  error do |lane, exception|

  end
end

# More information about multiple platforms in fastlane: https://github.com/fastlane/fastlane/blob/master/fastlane/docs/Platforms.md
# All available actions: https://github.com/fastlane/fastlane/blob/master/fastlane/docs/Actions.md

# fastlane reports which actions are used
# No personal data is recorded. Learn more at https://github.com/fastlane/enhancer

Environment
fastlane version (run fastlane -v): 1.101.0

[ ] Do you use bundler to execute fastlane (i.e. bundle exec fastlane)?

[x] Do you use a Ruby environment manager (e.g. [ ] chruby, [x] rbenv, [ ] rvm)?

I have checked the Code Signing Troubleshooting Guide.

This seems like a server error. Did the setup work for you before?

No, this is the first time I have attempted to set up match.

I've actually been trying to set up 'match' and 'cert' for the past couple of hours now, getting the same 'Bad Request' error.

Same here. I've been trying to run match adhoc for a couple of hours to no avail

I am experiencing on a setup with match that worked previously.  I had to nuke match's development certs and pp because a developer attempted the "Fix Issue" button :( and when I tried to re-create everything after the nuke I started getting server errors when trying to create new certs

Having the same issue here.  We have been using match without issue for a while. Today we did a nuke of development and then ran "match development".  We get the bad request error.  :-(

+1 - unexpected token at 'Bad Request' for me when running match. This setup was previously working fine

+1 - unexpected token at 'Bad Request' for me when running match. This setup was previously working fine

Thanks everybody, I can reproduce, and I'm already working on a fix 🚀

Pull request is ready, we'll push a new release in a few minutes https://github.com/fastlane/fastlane/pull/5803 🚀

The new release is live, please update using [sudo] gem update spaceship or if you're using bundler, use bundle update 🚀
Please let us know if that solves the problem for you 👍

@KrauseFx Working flawlessly, thank you! 🍰 Excellent support, gotta hand it to you. We really appreciate it.

I can also confirm that the fix is working 👍
thanks for the quick turnaround

Nike work @KrauseFx everything woking here! Thanks!

I'm seeing the same issue with PEM @KrauseFx.  Can you release a fix for that to please?

@CareerFairPlus Have you updated to the latest version of spaceship that was released a few minutes ago?

Yes, I'm on 0.31.5

@CareerFairPlus 0.31.7 is the latest release.

i'm going to close this issue since the origin problem with cert and match have been fixed.
If, after updating to 0.31.7, you're still seeing Bad Request please follow #5827 where we will continue to look for a fix for the remaining issues.


Cannot find module '@schematics/angular/utility/config'

Environment
Provide the content of the package.json file in the project:
{   "name": "@nativescript/template-hello-world-ng",   "main": "main.js",   "version": "7.0.9",   "author": "NativeScript Team<EMAIL_ADDRESS>  "description": "NativeScript Application",   "license": "SEE LICENSE IN <your-license-filename>",   "publishConfig": {     "access": "public"   },   "keywords": [     "nativescript",     "mobile",     "angular",     "{N}",     "template"   ],   "repository": "<fill-your-repository-here>",   "bugs": {     "url": "https://github.com/NativeScript/NativeScript/issues"   },   "dependencies": {     "@angular/animations": "~11.0.0",     "@angular/common": "~11.0.0",     "@angular/compiler": "~11.0.0",     "@angular/core": "~11.0.0",     "@angular/forms": "~11.0.0",     "@angular/platform-browser": "~11.0.0",     "@angular/platform-browser-dynamic": "~11.0.0",     "@angular/router": "~11.0.0",     "@nativescript/angular": "~11.0.0",     "@nativescript/core": "~7.1.0",     "@nativescript/theme": "~3.0.0",     "reflect-metadata": "~0.1.12",     "rxjs": "^6.6.0",     "zone.js": "~0.11.1"   },   "devDependencies": {     "@angular/compiler-cli": "~11.0.0",     "@nativescript/android": "7.0.1",     "@nativescript/schematics": "^11.0.0",     "@nativescript/types": "~7.0.0",     "@nativescript/webpack": "~4.0.0",     "@ngtools/webpack": "~11.0.0",     "@schematics/angular": "^11.1.4",     "tslint": "^6.1.3",     "typescript": "~4.0.0"   },   "private": "true",   "readme": "NativeScript Application" }
Describe the bug
I have run: npm i -D @nativescript/schematics @schematics/angular tslint in the project folder.
The when I try to ng g c hello I got:
An unhandled exception occurred: Cannot find module '@schematics/angular/utility/config'
Require stack:
-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\@angular\cli\bin\ng
See "C:\Users\guerb\AppData\Local\Temp\ng-hgrizI\angular-errors.log" for further details.

Expected behavior
I expected to automtically create a component.

I install npm i<EMAIL_ADDRESS>(11.0.1) it's version of Angular in my project.
it worked for me!

I don't know what is going on. Can you try with the package.json I print above? Because I install the version you use npm i<EMAIL_ADDRESS>and it returns this:
An unhandled exception occurred: Cannot find module '@schematics/angular/utility/parse-name'
Require stack:
-<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>-<EMAIL_ADDRESS>- C:\Users\guerb\AppData\Roaming\npm\node_modules\@angular\cli\bin\ng

An unhandled exception occurred: Cannot find module '@schematics/angular/utility/parse-name'

Did you make this step?
npm i --save-dev @angular/cli npm i --save-dev @nativescript/schematics

With npm i --save-dev @nativescript/schematics I don't get any Cannot find module ... anymore.
But now I got
Option "entryComponent" is deprecated: Since version 9.0.0 with Ivy, entryComponents is no longer necessary.
Could not find an NgModule. Use the skip-import option to skip importing in NgModule.

This is the default project generated by the tns command. The app.module.ts exists in the folder src\app  . With ng g c hello --skip-import it generates the files in src\app with an error Failed to generate remapped imports! Please see: https://docs.nativescript.org/angular/code-sharing/intro#remapped-imports and a warning Option "entryComponent" is deprecated: Since version 9.0.0 with Ivy, entryComponents is no longer necessary.. I don't have any "entryComponent" in my NgModule.

With npm i --save-dev @nativescript/schematics I don't get any Cannot find module ... anymore.
But now I got
Option "entryComponent" is deprecated: Since version 9.0.0 with Ivy, entryComponents is no longer necessary.
Could not find an NgModule. Use the skip-import option to skip importing in NgModule.

This is the default project generated by the tns command. The app.module.ts exists in the folder src\app . With ng g c hello --skip-import it generates the files in src\app with an error Failed to generate remapped imports! Please see: https://docs.nativescript.org/angular/code-sharing/intro#remapped-imports and a warning Option "entryComponent" is deprecated: Since version 9.0.0 with Ivy, entryComponents is no longer necessary.. I don't have any "entryComponent" in my NgModule.

Error or Warning? I have same... But, generating is work! Import no.

In that case, generate components ng g c should be declared manually in the app.module.ts? Because the reason I use the command to generate components is because I don't want to open the AppModule everytime.

In that case, generate components ng g c should be declared manually in the app.module.ts? Because the reason I use the command to generate components is because I don't want to open the AppModule everytime.

Unfortunately I didn't find a solution:( Yes, you have to manually add components to modules...
The authors are silent...

Too bad. But thanks for your help.


Missing Federated Authenticators from new UI

Describe the issue:
The Federated authenticators listed below are currently unavailable in the new console of the IS product.
Email OTP ->#16762
SMS OTP - > #16767
Office365
Twitter
Windows Live
Passive STS
IWA Kerberos
Apple SMS OTP
Organization authenticator
How to reproduce:
Log in to the new console and try to create a new connection for each federated authenticator.
Environment information (Please complete the following information; remove  any unnecessary fields) :

Product Version: IS 7.0.0 M3
OS: mac
Database: [e.g., MySQL, H2]
Userstore: [e.g., LDAP, JDBC]

Optional Fields
Related issues:
#16762
#16767
Suggested labels:

There's a Custom Connector template that would enable a set of authenticators to be added.
@melanisilva please check if this solves this issue.
cc:/ @NipuniBhagya

The latest SMS OTP and Email OTP authenticators are also available under the connections.


Add Import Contacts command to WhatsApp extension.

Description

Add Import Contacts command to WhatsApp extension so users can start using the extension quicker.
This command does NOT override existing contact where the phone number matches.
We did not include this because this was too slow but I found a way to make it faster.
Type of change

Bug fix / improvement for my extension

Screencast

https://user-images.githubusercontent.com/36263538/145076566-70f6c865-95d5-463f-bbdd-3ad3ab37d5c6.mp4
Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing

Yay! It’s great that you’ve found the way. Will take a look at that tomorrow

@mattisssa I updated the code so it created the file in the tmp directory.
Let me know if it still gives you that error :)

I am out of ideas in this one. I would love to know how you guys do it for the command Search Contacts

I could not reproduce your issue, it works fine for me

@mattisssa What's the status of this PR and how do we move forward?

Hey @vimtor!
Is there info about my laptop setup that could help you with the issue? I'm not really sure how else I can help here.
Do you have your WhatsApp app open when you start the command?
Does your Contacts app open when you do this?

I don't have much time to look into this, and the current extension works so I will close the PR
Feel free to add any changes


error when deploying last prometheus-boshrelease 26.1.0

Hello,
when i try to update prometheus bosh release from 25.0.0 to 26.1.0 , i have this errors
i have this erros
  instance_groups:
  - name: grafana
    jobs:
    - name: grafana
      properties:
        grafana:
          prometheus:
            dashboard_folders:
            - name: BOSH
              files:
+             - "/var/vcap/jobs/credhub_dashboards/*.json"
+   - name: credhub_dashboards
+     release: prometheus

Continue? [yN]: y

Task 362485

Task 362485 | 10:48:38 | Error: Job 'credhub_dashboards' not found in release 'prometheus'

i have done somthing wrong ?  :)

Hi @jyriok. Are you using master branch? Please switch to 26.1.0 tag and try again.

i use the 26.1.0 tag and on the file "prometheus-26.1.0.yml" i didn't find some info about credhub_dashboards :(

bad move :(  i close accidentaly my issue, can you re-open it please, i don't have right to do that i think

i use it as a submodule :
0fd52fbbd68a7e8ade5f9825f9774d61ce274202 prometheus-boshrelease/26.1.0 (v26.1.0-30-g0fd52fb)

i didn't see "credhub_dashboards" item on the build section
https://github.com/bosh-prometheus/prometheus-boshrelease/tree/v26.1.0/.final_builds/jobs
i guess the credhub dashboard is not ready to use ?

@jyriok credhub_dashboards job was introduced after v26.1.0 release. You need to use manifest and opsfiles for v26.1.0 tag. master branch is already ahead of v26.1.0 tag.

thanks for your answer. my mistake is to have chekout master instead the good branch :) (despite have label on submodule :))
ok now with the good files, that work and , if i well understand , on the next release , we will obtain a credhub dashboard :) (v26.2.0 ) ?


[RC 9] [RC 10] Cannot read properties of undefined (reading 'modules') when vue is installed in parent dir

Related issues

nuxt/nuxt.js#14907
nuxt/nuxt.js#14802
nuxt/nuxt.js#14928
https://github.com/nuxt/nuxt.js/issues/14923
sidestream-tech/sidebase#16

Reproduction
Minimal reproduction: https://stackblitz.com/edit/github-2yn1ze?file=app%2Fpackage.json,app%2Fnuxt.config.ts
Describe the bug
How it happens: If vue dependency is installed outside of project directory in an adjutant directory (usually home directory with node_modules), vite-node that is enabled by default for RC.9+ makes issues. (issue is with nuxt custom external options)
Additional context
Workaround 1
Try switching to the edge channel. It should have been solved with nuxt/framework#7612.
Workaround 2
Check your home directory. If there is any node_modules dir, remove it or rename it. It is probably created wrongly in the past.
Workaround 3
It might be also because of a monorepo setup that has ../node_modules/vue dependency. In this case, switch to the legacy vite bundler:
export default defineNuxtConfig({
  vite: {
    devBundler: 'legacy',
  },
});

Remarks
The root cause of this issue is having multiple instances of vue in externals. In the future similar issue might happen with different causes as vue does not support multiple version instances.

We've not had recent reports of this issue. Do you think this is still something we need to track @pi0?

We've not had recent reports of this issue. Do you think this is still something we need to track @pi0?

I'm having a similar issue in installing a local monorepo package as a nuxt module, not sure if it is the same issue though

We've not had recent reports of this issue. Do you think this is still something we need to track @pi0?

Just got this today 😓

Closing as I've not seen this or heard this reported recently. But please do open a new issue with reproduction if you encounter it 🙏


telemetry: fix local position health flag

This flas was actually just fake before and a duplicate of the GPS available flag.
Hopefully this will help with https://github.com/PX4/Firmware/issues/14835.
FYI @kamilritz

I am not convinced that this will help. The local position message is sent no matter if the local_position is valid. By valid I mean if it is constrained by any measurment (GPS, flow, ...). The ekf2 is giving sending this information over vehicle_local_position.xy_valid field. But this field is not exposed over MAVLINK.
There is the estimator status MAVLINK message, which reports the uncertainty of the position estimate. This could be used to check if it is safe to takeoff / local_position is valid.

The local position message is sent no matter if the local_position is valid.

Are you sure?
https://github.com/PX4/Firmware/blob/76de299302c9a91a0e1ac316fa174ed001f15a2e/src/modules/mavlink/mavlink_messages.cpp#L2683-L2697
The question is when vehicle_local_position is started to be published via uORB.
In theory it would have a valid flag that we shoudl check in PX4 before sending the MAVLink message:
https://github.com/PX4/Firmware/blob/76de299302c9a91a0e1ac316fa174ed001f15a2e/msg/vehicle_local_position.msg#L5

I will fix this true-false-true behavior, which is coming from a bug inside the estimator. But we need to think of a way that the MAVLINK user knows that he can takeoff in the offboard mode. One option would be:

In theory it would have a valid flag that we should check in PX4 before sending the MAVLink message

Another option would be to send a valid flag to the user, or an uncertainty measurement.

@kamilritz right. Actually, we should use this flag, no?
https://mavlink.io/en/messages/common.html#MAV_SYS_STATUS_SENSOR_XY_POSITION_CONTROL

This is a fantastic idea. We only want to start the offboard mission if the position controller is running.

Right but we need to check if that's sent out in PX4 yet, probably not.

I think this is an improvement for now until we can use https://mavlink.io/en/messages/common.html#MAV_SYS_STATUS_SENSOR_XY_POSITION_CONTROL.
Merging.


Adding Action bug

When you add an action while on the Actions view, the view does not automatically update afterwards. You have to manually refresh it.

Fixed with 4ff5e2cebf6e5a3bc69eef14806db668aacbd604


Upgrade tox and linter to conventions used by other projects

Updated tox to use flake8 for the linter and changed black and isort configurations to match linting and styling conventions used by all other projects for consistency (most noticeably changing line-length from 88 to 100).
mypy's newest release allows configurations to be stored in pyproject.toml instead of requiring its own mypy.ini.
Cleaned up the setup.py dev requirements as they are no longer needed since tox will automatically install them in a virtualenv wrapper when needed.
All changes made are purely linting fixes (most of which are by black and isort auto-formatting) such as:

removing unused imports
removing unused variables
docstring capitalization/formatting
changing type annotations
consolidating/expanding code into less/more lines

Fixed the string wrapping and added the flake8 config to ignore line length linting for tests/
Also added the tox -e docs option to run mkdocs and serve the site. Thus mkdocs was removed from the dev requirements since tox will automatically install it. This is documented in server/README.md
Finally changed the version number in server/setup.py to match client/package.json.


get rid of Guava's Predicate

Requires few simultaneous merges, will provide the links shortly.

https://github.com/JetBrains/jetpad-ot/pull/226

https://github.com/JetBrains/datapad/pull/112
Ready for merge


Instructions requested for TLS enabling an MS SQL Server connection

System information:

macOS 10.15.6
DBeaver version 7.1.5

Connection specification:

MS SQL Server
Microsoft SQL Server 14.00.3223
Microsoft SQL Server 2017 (RTM-CU16) (KB4508218) - 14.0.3223.3 (X64)
Jul 12 2019 17:43:08
Copyright (C) 2017 Microsoft Corporation
Enterprise Edition: Core-based Licensing (64-bit) on Windows Server 2019 Standard 10.0  (Build 17763: ) (Hypervisor)

Describe your question:
Given the database connection for MS SQL Server has been encrypted with TLS 1.2 how can we configure DBeaver to connect?  Instructions would be greatly appreciated.
MS SQL Server documentation

@jsimone-infoarmor
we've got no instruction especially for that type of server. Did you try to connect as to the usual server?
btw, some special settings could be founded there https://docs.microsoft.com/en-us/sql/connect/jdbc/connecting-with-ssl-encryption?view=sql-server-ver15
you could try to change some settings in driver properties (e.g. encrypt, trustServerCertificate to true)

ok, I can add those 2 driver properties there.  Where can I drop the cert used to authenticate the connection?

setting encrypt=true and trustServerCertificate=false I get the following error when I test the connection:
tThe driver could not establish a secure connection to SQL Server by using Secure Sockets Layer (SSL) encryption. Error: "PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target". ClientConnectionId:0e812163-c864-4aaf-a274-d283e02c0d20
  PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
  PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
    unable to find valid certification path to requested target
    unable to find valid certification path to requested target

where do I add the .pem file which represents the cert.  I tried to add to driver libraries as a file which did nothing.

verified

For now the only solution is to provide path to keystore (PFX/JKS) and its password along. Feel free to ask questions.

I am using 7.2.0 and there is no SSL tab.  Main/Driver Properties/SSH/Proxy ... that's all.
So how would one enter in the above information?

You need to upgrade DBeaver to the latest version.

I am using 7.2.0 and there is no SSL tab. Main/Driver Properties/SSH/Proxy ... that's all.
So how would one enter in the above information?

i upgraded to 7.2.1 community edition and there is no SSL tab.

Sorry, this fix is included in the next release of product.
If current solution with keystore is suitable for you, then you can setup it manually via Driver properties:

Key
Value

encrypt
true

trustServerCertificate
false

trustStore
Keystore file (.pfx/.jks)

trustStorePassword
Keystore password

hostNameInCertificate
Certificate hostname

ok, let me give that a try.  thx.


add installation instructions

Thanks for the corrections - the "checks" failed - but not for the documentation 😉

thank you @narimiran