An error occurred while provisioning resources (Error Type: Disconnect).

Description
Jobs on macOS would intermittently fail without logs, with the error message in title only appearing some of the time.
Here are a list of failed jobs over the past three days:
https://github.com/mishoo/UglifyJS/runs/2730669944?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2719886305?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2718446501?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2716605609?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2712627146?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2711652206?check_suite_focus=true
Not sure if related, whilst at lower frequency I also encountered jobs being reported as cancelled:
https://github.com/mishoo/UglifyJS/runs/2706621544?check_suite_focus=true
Area for Triage:  Deployment/Release

Question, Bug, or Feature?:  Bug

Virtual environments affected

[ ] Ubuntu 16.04
[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[x] macOS 10.15
[ ] macOS 11
[ ] Windows Server 2016 R2
[ ] Windows Server 2019

Image version
Current runner version: '2.278.0'
Expected behavior
Jobs complete with viewable logs.
Actual behavior
Missing logs − even with View raw logs:
2021-05-31T14:43:02.9964115Z ##[section]Starting: Request a runner to run this job
2021-05-31T14:43:03.4321453Z Can't find any online and idle self-hosted runner in current repository that matches the required labels: 'macos-latest'
2021-05-31T14:43:03.4321551Z Can't find any online and idle self-hosted runner in current repository's account/organization that matches the required labels: 'macos-latest'
2021-05-31T14:43:03.4321605Z Can't find any online and idle hosted runner in current repository's account/organization that matches the required labels: 'macos-latest'
2021-05-31T14:43:03.4321706Z Found online and busy hosted runners in current repository's account/organization that matches the required labels: 'macos-latest'. Waiting for one of them to get assigned for this job.
2021-05-31T14:43:03.6599602Z ##[section]Finishing: Request a runner to run this job

Repro steps
A description with steps to reproduce the issue. If your have a public example or repo to share,
please provide the link.

watch scheduled workflow spawn
occasionally macOS job would fail with missing logs

thanks @alexlamsl for creating a separate issue. Am I right that it is enough to simply fork https://github.com/mishoo/UglifyJS/ and run the following workflow to reproduce the problem? https://github.com/mishoo/UglifyJS/blob/master/.github/workflows/ufuzz.yml

Yes forking the repository and letting the aforementioned workflow run should be able to produce the (intermittent) issue.
You may want to edit out the Linux & Windows jobs to lighten the load since they don't exhibit the issues.
Please be advised that the job may fail sometimes due to fuzzer hitting a false positive − but they would be distinctly different from the issue due to presence of logs.

Another bunch of recent samples:
https://github.com/mishoo/UglifyJS/runs/2763713274?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2760713866?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2760250084?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2757930927?check_suite_focus=true
https://github.com/mishoo/UglifyJS/runs/2757074905?check_suite_focus=true

@alexlamsl thank you for provided examples, we are investigating the issue on our side to determine the exact reason for such behavior. Currently, I found only one thing, that tests consuming a lot of CPU resources on macOS machines, and possibly it leads the pipeline to fail.  We need more time to find a root cause for this particular situation.
I'll keep you informed.

Not sure if related, but just now I've hit an instance of this but on Windows:
https://github.com/mishoo/UglifyJS/runs/2821517386?check_suite_focus=true

@alexlamsl thanks for the update! Windows is a pretty different story, so it's not related. Speaking about mac — we've narrowed down the list of the environments with issues, but unfortunately, we are still searching for the root cause.

Not sure if this helps, but this failed job contains some information under View raw logs:
https://github.com/mishoo/UglifyJS/runs/3003410939?check_suite_focus=true
And from a glance it seems to got "cancelled".

Hi,
I have the same issue with macOS 11.

@FireFighter80 do you have access to the macOS-11 pipeline? Just to make sure it's not the access issue

@miketimofeev Thx. You're rights. That was the issue

@miketimofeev has this issue been resolved?
I am still getting steady stream of these job failures, especially in the past week on a daily basis.

@alexlamsl we haven't heard any cases so far that's why decided to close. Could you provide some new examples of such builds so I can escalate the issue?

Ones that are immediately relevant:
https://github.com/mishoo/UglifyJS/actions/runs/2306997233
https://github.com/mishoo/UglifyJS/actions/runs/2296601772
https://github.com/mishoo/UglifyJS/actions/runs/2284012926
Others that fail unexpectedly, not sure if related:
https://github.com/mishoo/UglifyJS/actions/runs/2281443778
https://github.com/mishoo/UglifyJS/actions/runs/2327083565
https://github.com/mishoo/UglifyJS/actions/runs/2300065092
P.S. for the past few days I would encounter Angry Unicorn ~5% of the time when loading any Actions-related URLs

I can replicate this on my fork as well:
https://github.com/alexlamsl/UglifyJS/actions/runs/2310731271
https://github.com/alexlamsl/UglifyJS/actions/runs/2310324508
https://github.com/alexlamsl/UglifyJS/actions/runs/2309311098
https://github.com/alexlamsl/UglifyJS/actions/runs/2307865027
https://github.com/alexlamsl/UglifyJS/actions/runs/2264485393
Others:
https://github.com/alexlamsl/UglifyJS/actions/runs/2277862274
https://github.com/alexlamsl/UglifyJS/actions/runs/2263136893
(ran into 🦄🦄🦄 while looking for these)

@alexlamsl thanks, will engage the engineering team

We're seeing the same issue very frequently with our Windows builds. There's no detailed errors to indicate what went wrong:
https://github.com/Azure/bicep/actions/runs/2633252423
Summary view:

Trying to see logs for an individual job:

Just to chime in here, this is plaguing one of my repos as well, but on ubuntu-latest image. Sadly it's not public, so I can't share any links or anything, but my workflows all fail around the 30min mark with either the error:
An error occurred while provisioning resources (Error Type: Disconnect).
Received request to deprovision: The request was cancelled by the remote provider.

or
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
Process completed with exit code 143.

The workflow is just a simple action running npm quicktype. Occasionally, I will get some logs (as opposed to the typical no logs on the failing step that ran for 30min), but they only ever contain Killed\n. This has been happening for the past 4 months

@niehusstaab even links to private repos will help as we don't need access to your repo to get the telemetry for the run and see if there was high CPU usage or something like that. Most likely this is the root cause.

We're seeing the same issue very frequently with our Windows builds. There's no detailed errors to indicate what went wrong: https://github.com/Azure/bicep/actions/runs/2633252423
...
@miketimofeev - any update on this?

To circle back - by chance I discovered that one of our tests was eating up a LOT of system memory, and this issue stopped occurring once I fixed it. It would be super helpful if this information could have been communicated somehow through the workflow logs, and would have saved a lot of time spent debugging.

If links to repos are still useful, here's a public action that failed with this specific error: https://github.com/SuffolkLITLab/ALActions/actions/runs/3913807100, running on ubuntu-latest.
It's a really lightweight action that only runs ~20 lines of beautiful soup python on a small webpage, and normally finishes  in < 30 seconds, so I'm fairly confident that it wouldn't be eating up memory or using a lot of CPU. The latest failing job took 26 minutes, but there aren't any logs to see what it was doing in that time.

what is the status in here? we have encountered similar problems, for more information, see #7004

+1 (ubuntu)
One thing that would likely be useful would be to have a way to retrieve missing logs (see @anthony-c-martin comment above).

Due to the fact that virtually all of the cases mentioned here are related to resource consumption above what is possible, I am forced to close this request.
About logs: It is not possible for the moment to publish provisioner logs due to a pack of reasons including security reasons.
For the curious and new arrivals: I recommend paying attention to the discussion with a lot of information from users who encounter the same problem for various reasons: https://github.com/actions/runner-images/discussions/7188.


🐛 [firebase_app_check] Remove discontinued safetynet app attestation api

Bug report
Context: Play Store displaying warning regarding use of safetynet app attestation api
com.google.android.gms:play-services-safetynet:18.0.0
This SDK version has a note from the SDK developer. Here's what the SDK developer told us:
The SafetyNet Attestation API is being discontinued and replaced by the new Play Integrity API. Begin migration as soon as possible to avoid user disruption. The Play Integrity API includes all the integrity signals that SafetyNet Attestation offers and more, like Google Play licensing and better error messaging. Learn more and start migrating at https://developer.android.com/training/safetynet/deprecation-timeline

Hello @canewsin, Play Integrity is already implemented in the AppCheck plugin. SafetyNet will not be removed until the end of support in January 2025.


Creation of vxlan-vport in fastdp does not fail if udp:6784 is taken

To reproduce:
$ weave reset
$ nc -l -u -p 6784 &
$ weave launch

In the case of failure, we would expect to see a warning https://github.com/weaveworks/weave/blob/v1.5.2/router/fastdp.go#L405 , but it doesn't happen.
It might be a case that the creation of vxlan-vport is async in the kernel, because no error is returned. However, in the dmesg report we can spot it:
[175079.718300] vxlan: Cannot bind port 6784, err=-98

Kernel version: 4.5.4-1-ARCH

The issue does not apply to the 4.2.0 kernel.

@brb Can you think of any way of fixing this? Checking the port beforehand would be racy.

http://marc.info/?l=linux-netdev&m=147075637009483&w=2
In order to detect such case, we could check whether a corresponding netdev is in the DOWN state after a vxlan vport has been successfully created.

In order to detect such case, we could check whether a corresponding netdev is in the DOWN state after a vxlan vport has been successfully created.

+1 (if that is easy)

Closed by f6864088082368f76ab940bb7e94541e613eee72


net: shell: Fix net mem command output

Pool size is no longer available so it is no use trying to print
its value. This change was introduced in commit dd09cbc1c455ab1e
("net: buf: Redesigned API with split data and meta-data")
Signed-off-by: Jukka Rissanen<EMAIL_ADDRESS>

Codecov Report

Merging #6268 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #6268   +/-   ##
=======================================
  Coverage   53.16%   53.16%
=======================================
  Files         412      412
  Lines       40117    40117
  Branches     7726     7726
=======================================
  Hits        21327    21327
  Misses      15653    15653
  Partials     3137     3137

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e84d1a4...f3113a5. Read the comment docs.


[Question] About eventmesh-trace-plugin module

Search before asking

[X] I had searched in the issues and found no similar issues.

Question
About eventmesh-trace-plugin module, I would like to have a comprehensive understanding of its functions first. Due to the relatively simple documentation on the official website, I still don't know the functionality of this module after reading it.
I have two questions:
1： Three types of plugins should be similar. Such as Pinpoint, this plugin allows users to send trace data to the Pinpoint server directly through eventmesh without installing Pinpoint's client, right?
2： Is the trace data collected by this module only internal eventmesh? Or the overall project of eventmesh?
Looking forward to a response from the community.

想先整体了解下eventmesh-trace-plugin模块的功能。由于官网上文档略简单，看了以后依然没明白该模块的功能。
我的疑问有两个：
一：三种插件应该都差不多吧，比如pinpoint，该插件可以使用户不用安装pinpoint的客户端，直接通过eventmesh就能将trace数据发送到pinpoint服务端，是这样吗？
二：该模块采集的trace数据只是eventmesh内部的？还是使用了eventmesh的整体工程？
希望社区能回复下。

@leopardrota

The eventmesh-trace-plugin module is mainly used for link tracking. If you look at the code, you will find that it is mainly used in the runtime module.
The eventmesh-trace-plugin has an API module that is mainly based on the OpenTelemetry Trace specification. As for pinpoint and Zipkin, OpenTelemetry Trace only imports data into different services. For details, please refer to the official website of OpenTelemetry.

eventmesh-trace-plugin这个模块主要是用于链路跟踪，你看代码就会发现这个主要用在runtime模块里面。
eventmesh-trace-plugin有一个API的模块主要是基于OpenTelemetry Trace规范做的。而对于pinpoint以及Zipkin只是OpenTelemetry Trace将数据导入不同的服务，具体可以参照OpenTelemetry的官网文档

@mxsm Thank you very much for your reply.
So the link data collected by the eventmesh-trace-plugin module is the traffic flowing through the runtime module (which may come from the eventmesh itself or the application project it is in), right?
So with the eventmesh-trace-plugin module, if link tracking data needs to be transmitted to zipkin or pinpoint, there is no need to install an additional zipkin or pinpoint client, right?

所以eventmesh-trace-plugin模块采集的链路数据是流经runtime模块的流量（可能来自eventmesh自身，也可能来自所在的应用工程），对吗？
所以有了eventmesh-trace-plugin模块，链路追踪数据要传到zipkin或者pinpoint，是不需要额外安装zipkin客户端或者pinpoint客户端的，对吗？

So the link data collected by the eventmesh-trace-plugin module is the traffic flowing through the runtime module (which may come from the eventmesh itself or the application project it is in), right?

Only events delivered by current EventMesh Runtime instance will be traced.

So with the eventmesh-trace-plugin module, if link tracking data needs to be transmitted to zipkin or pinpoint, there is no need to install an additional zipkin or pinpoint client, right?

No, a zipkin instance is required to collect data.


IronPython 2.7.11 are not detected and listed in Visual Studio Python Environment

Describe the bug

Steps to Reproduce

Install IronPython (downloads at http://ironpython.net ) if no IronPython.
Create Python Application project.
Right-click on Python Environments node in SE and select "View All Python Environments".

Expected behavior
The Ironpython distributions installed should displayed in the list.
Actual behavior

Thanks for the bug. IronPython is no longer supported.

Hi @rchiodo , could you please clarify which support has been dropped/will be dropped? It looks like VS2022 still debugs hosted/embedded IronPython as long as the necessary debug info is still there even though new projects/environments are no longer available.
It also seems like debugging only works for .NET 4.x and not for core/5/6. Do you happen to have any info on why that is?
And as a last request: depending on your answers it might be nice to update https://docs.microsoft.com/en-us/visualstudio/python/debugging-python-in-visual-studio?view=vs-2022 accordingly. Is that content managed by the team itself or should I raise an issue there as well?

IronPython is no longer officially supported. So if it works, it's just by luck. We don't test with it anymore so you'd be on your own if you wanted to use it with VS 2022. I believe VS 2019 was the last version that had support for it.


Bug report test case 20

Tested Version
v0.0
Description
The program compiled even if the asm file contain: "jmp ra"
Steps
Compile and run assembler.exe.
Create a file named example.asm containing set sp 2.
cmdline: assembler.exe example.asm example.bin.
Context
Doing the test cases before accepting the pull request: "Merge of preprocessor as of 02/21".
Actual Result (optional screenshot)

Security Criteria
3
Discovery/Resolve Date
02/22/2024
Expected Result
It should send an error.
Possible Solution
//
Other
//

made it so if a type J instruction wasn't given an adress it gives an error instead of making it 0


Show how the LLM is involved in the MCP workflow

I would appreciate, if the high-level architecture diagrams would also show the data flow (requests, response, message payloads from the context) to and from the LLM. From the weather-server example with Claude Desktop it seems to me that Claude Desktop calls the LLM to create the tool call with the correct arguments. But I can't see how the returned forecast data will be formatted in a user-friendly way. Is Claude Desktop passing the forecast data to the LLM to get a nicely formatted answer or is Claude Desktop able to show this data in a nicely formatted way (e.g. table) out of the box?

Which component (host, server) calls the LLM and when?
Or is it up to developer to choose if the host or the server calls the LLM when it seems to be best from the workflow perspective?
Are there any recommendations or best practises for getting the LLM involved?

Finally, adding the LLM to high-level diagrams would also help to understand potential risks when using MCP with sensitive data. Claude Desktop obviously uses Claude LLMs via the internet. But with sensitive data one might consider using a local LLM, which would maybe called by the MCP server.

I was about to write the exact same text, this would be really interesting!


docs: Deeplink ordering note added to README.md

ISSUE
My app has multiple SSO options set up. When I added Facebook SSO using this package, it worked fine for Android and some iOS devices as well. But for some iOS devices, the app navigates to the Facebook app to authenticate and switches back to my app with a deep link like fbAppId://somePermissions%data%etc.
After debugging for an entire day, I realized that I had put RCTLinkinganager condition before FBSDKApplicationDelegate and just changing the order fixed it.
I believe this short note would be helpful for anyone having multiple other SSOs while integrating this package

@mikehardy Can you take a look at this, please?


version release

Hey @jgrss for the conda build I need a new release so it can pull the .zip.  Can you create one for install fix?

Done -- see v1.5.16.


CLONE_NEWNS needs MS_PRIVATE on / before fork?

Hi Liz,
I've been following "Building Containers from Scratch with Go on Safari".
Thank you very much for this course, I love it!
I hope you can shine some light on an issue I'm having with "Container Process IDs and Mounts in Go". Somehow CLONE_NEWNS doesn't hide my mount-points in the container from the host, so running mount | grep something on the host still shows mount-points from the container.
After a bit of researching, I was able to hide them, but only after setting the mount option MS_PRIVATE on / before forking. I'm running Ubuntu 16.04.3 LTS with the 4.4.0-101-generic kernel by the way.
Does this sound familiar to you?
Regards, and thanks again,
Mel.

Hi @mlvnd, thanks for your very kind comments!
Yes, it does sound familiar. I have a note to myself somewhere about mounting root with the --make-rprivate flag so that mount points aren't shared. Sounds like setting the MS_PRIVATE flag is the better way of achieving this - thank you so much for letting me know about it!

Hi @lizrice,
You're welcome. I can submit a PR if you like.

That sounds good!
But now you have got me wondering whether it work to make a similar call to mount() with the private + recursive flags in the child, after the chroot? If that worked, it would only affect the part of the host file system that the container is using, which would be nice...
I haven't tried it, and I'd accept your PR as proposed - I'm just curious so if you happen to have time to try it out, let me know how it goes!

Hi @lizrice,
I tested your proposal and it works great! However, I spent some more time researching and noticed that this problem was marked as a bug in Go, which got fixed in 1.9 (see os/exec: handle Unshareflags with CLONE_NEWNS for more info). I'd guess you would agree this is an even nicer solution. :)

Thanks Liz!


Remove hidden dependencies on HttpClient

This is part 16 of a broken down version of the #140101 refactor.
This only makes one dependency explicit. Further PRs will do the same for other dependencies, until these APIs have no hidden dependencies.
This PR makes no effort to keep the order of parameters reasonable. There is an existing TODO to do a refactor sweep later that does nothing but reorder arguments/parameters/fields to be consistent.

(a bunch of these will go away when we remove the dependency on the gold client itself, so maybe i should have done that first, but it's two PRs either way so...)


empty  at the begining of the highlight since 2.1.1

(Original issue 1254 created by andre_felipe_dias on 2016-07-09T15:45:07.328838+00:00)
Since v.2.1.1, the hightlight output starts with an empty span tag.
Steps to reproduce:
#!/usr/bin/python3

from pygments import highlight
from pygments.lexers import get_lexer_by_name
from pygments.formatters import HtmlFormatter

def pygmentize(code, language, **kwargs):
    lexer = get_lexer_by_name(language)
    formatter = HtmlFormatter(**kwargs)
    return highlight(code, lexer, formatter)

code = 'print("hello world")'
print(pygmentize(code, 'python'))

code = '# comment'
print(pygmentize(code, 'bash'))

at Pygments 2.1 and before, the output is:

print("hello world")

# comment

Since Pygments 2.1.1, the output is:

print("hello world")

# comment

Note the empty span tag just after
. It doesn't look right.

(Original issue 1254 last updated on 2016-08-26T00:26:47.985372+00:00)
(Issue automaticaly closed due to status in Bitbucket: wontfix)

(Original comment by brondsem on 2016-08-25T22:50:51.022989+00:00)
Looks like it was changed in 164574c intentionally to fix #1111.  Would be nice if there was a cleaner way though, maybe only add the span tags when necessary?

(Original comment by andre_felipe_dias on 2016-08-26T00:13:49.339909+00:00)
It is a good reason indeed. Probably, changing the current implementation is not worth the trouble.

Would be nice if this was fixed.


Add fully-qualified action name and action limits to annotations of activations

In addition, a cloudant view is provided, that returns only action-activations.

PG1#404 is running

we'll need a test for the this - the go CLI appears to ignore the annotations on activations.
@dubeejw

PG1#426

@rabbah PG426 was good. The failed test case was not related with this code base. Issue 2533 covers it.

or PG445 also approved.

Tests for view and for the annotations is written.
New PG2#196 is running.

The CLI updates look good.

The cloudant view is removed and PG2#203 is running.

I moved the test and rewrote the check. Merged as https://github.com/openwhisk/openwhisk/commit/a9ebadfa454434e4998a39dfb7a5b82159cac1f1.


Option to skip certain folders

Love the application
Only question would be if it's possible to add an option where you can skip a folder, i.e. node_modules etc.

that is a great idea! Will scope it out a bit and incorporate it soon

There is now a new flag to skip a folder or file: --ignore!
A few things to note:

The pattern specified will consider the target directory the root. So hashdir --ignore "node_modules" ~/Desktop/project will only ignore ~/Desktop/project/node_modules.
If you wish to ignore all occurrences of something, use the standard globing pattern "**". So hashdir --ignore "**/node_modules" ~/Desktop/project will ignore all directories (& files) named node_modules.
You can specify custom patterns as needed using glob patterns (e.g. "build/cache", "output/temp/*.xml")
Lastly, you can specify multiple ignore patterns. hashdir --ignore "node_modules" --ignore "**/*.xml" ~/Desktop/project

Hope this helps!

This is great! Thank you :D can't wait to get going with this ^^


Task: Create authUser Route

When users login, their email and password information needs to be authenticated. This involves grabbing the user's information from the SQL database and comparing it to their Frontend inputs.

create authUser route that gets user's password/email info from the server
send the Frontend inputs to server.js using "login" button.
compare server info to inputs.
If they match let the user login. If not, deny the user's access to the application.
You may need to create a message that lets the user's know their login info isn't correct.

https://docs.carboninterface.com/#/ <-----  LOOK AT THIS our api calls have a beginning but they are currently looking up to json instead of carbon interface. We need api calls converted back to talk directly to carbon API to get this information BUT LIMIT THE TIMES YOU DO THIS as we get like 200 api calls a month. Eventually we will store the car's vehicle ID in the sql database so that each time they drive it doesn't need 3 api calls, only 1.


chore: upgrade manifests to idf 1.12.0

Changes

upgrade manifests to idf-modules 1.12.0

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Running integration tests on the source branch...

Integration test failed on one manifest due to access role timeout, will fix session duration now.

This is ready for merge, just updated to seedfarmer apply * --enable-session-timeout which should resolve our issue.


Confirm user has MANAGE permission and assignee has OWN permission

https://tools.hmcts.net/jira/browse/RWA-162

We decide to close it in favour of this one https://github.com/hmcts/wa-task-management-api/pull/80/files  which follows more the existing pattern


Explicit template instantiation of unit tests using Boost UTF

Convert another test and and demonstrate how to deal with template test cases with Boost

Codecov Report

Merging #548 into master will increase coverage by 0.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #548      +/-   ##
==========================================
+ Coverage   95.88%   95.89%   +0.01%
==========================================
  Files         134      134
  Lines        9595     9594       -1
==========================================
  Hits         9200     9200
+ Misses        395      394       -1

Impacted Files
Coverage Δ

packages/Search/test/DTK_EnableViewComparison.hpp
100% <ø> (ø)
:arrow_up:

packages/Search/test/tstDetailsUtils.cpp
100% <100%> (+0.64%)
:arrow_up:

...es/Search/src/details/DTK_DetailsTreeTraversal.hpp
97.22% <0%> (+0.02%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fc005f2...72aa669. Read the comment docs.


Build not working without ForwardAgent

When running nsd cont buildall I can't clone the repository.
To make it work you need to configure forwardAgent as follow.
# .ssh/config
host *
  ForwardAgent yes

Hi there, if you are working with nscale in aws/digitalocean etc, your machine will need some way to authenticate with github. You can either configure ForwardAgent to use your local machine's keys as you mentioned (which we now have documented) or you can generate a new keypair on the machine and associate it with your github account. Either will work. Closing this.

The point here is getting this documented. Is it, @darragh-hayes? Can you please add a link to this issue to the explanation?


trapezoidal/clenchaw-curtis quadrature (integrate) and a test angular…

Hi,
I have included in the scipy/integrate.py some base class (Quadrature) to implement some quadratures: Trapezoidale (Trap) for test and the more advanced Clenshaw-Curtis (CC) one.
Then, in the angular_cl.py I have C&P the default angular_cl function to implement a call to one of the quadrature above mentioned. Then, jec_angular_cl could be tested not touching the default version.
Now, to test I have writen the JECQuadTest notebook which basicaly compute  WeakLensing C_ell using either the default angular_cl function which use the spimson code, either the new version of the integration using different orders of the CC quad.
Here is one possible output:

Have fun!
Jean-Eric

Thanks a ton @jecampagne ! This is super promising, we should be able to have a much more efficient integration technique with this, which should also translate into much smaller memory footprint when computing C_ells.
Still trying to assess the performance on GPU and CPU, but I just have a small recommendation on the code itself, just adding the extra argument quadInt to the parameters of the angular_cl function itself instead of adding a separate one. If I understand the code correctlty, by default it does the old simps integration.
Then the next thing to look at is whether it's more costly to compute the jacobian of the Cell with respect to cosmological parameters with this implementation than with the default simps

Everything seems to work great for auto-spectra, but I'm getting a mismatch for cross-spectra

I'm adding a test to catch this


Filter store to reduce memory usage

Is your feature request related to a problem? Please describe.
mitmproxy stores all of the requests in memory even those that are not needed.
Describe the solution you'd like
It would be nice to only store requests that are relevant using some kind of filter that only stores requests that match the filter. Another way to look at it, is a view filter that not only filters the view but also filters the store.
Describe alternatives you've considered
It seems to be possible to clear some requests, so maybe this can be implemented as a plugin, I'm not sure how though. It is also possible to use mitmdump however, a lot of functionality is lost.

I just noticed the --ignore-hosts option, would this do what I described?

I just noticed the --ignore-hosts/--allow-hosts option, would this do what I described?

If that is the case, then it would be nice to have them work as general purpose filters rather than just for hosts


How can I turn off the line numbering?

How can I turn off the line numbering?

Ctrl-R

If you want numbering off all the time then
Ctrl-E to go into cmd mode
The type in below and then press return to disable the ruler (numbering)
set ruler off

You can toggle back on and off with Ctrl-R.


paper-input invalid attribute cannot find function or filter

When setting the invalid attribute of a paper-input to a filter using a function of the element, the function is  called only once, and then modifying the input's value causes an error "Cannot find function or filter: functionName".
I've made a simple fiddle to demonstrate this:
http://jsfiddle.net/tudbzmbt/5/
As expected, on loading the page inputA is invalid and inputB is valid, since the associated filters return true and false. However when editing the inputs, the javascript console shows errors.
If the filter functions are changed to the commented code (which marks the inputs as invalid unless they match) I would expect both inputs to be valid when the input values match, and invalid otherwise, but this does not happen since the filter functions are only evaluated once.
The use case for this is a password entry form that marks the input fields as invalid until they match.

Closing this issue due to age and the release of version 1 of Polymer - please feel free to re-open if this is incorrect.


How to install

Hi there
I'm new to Freeswitch and have been playing around with it recently. I saw your repository https://github.com/davehorton/drachtio-freeswitch-modules and wanted to try it out, which lead me to this repository.
How would I install this? I have never used ansible before.
I did a bit of googling and here is what I tried.
I have a clean install of Debian 10.
I installed ansible as per below:
sudo apt update
sudo apt install ansible -y

I saw you posted this playbook on this issue (https://github.com/davehorton/ansible-role-fsmrf/issues/6), which appears to be more current than the one on the readme:
---
- hosts: all
  become: yes
  vars_prompt:
    - name: "build_with_extra"
      prompt: "Include the extra modules (mod_aws_transcribe, mod_google_transcribe, mod_google_tts, mod_dialogflow)?"
      private: no
      default: false
    - name: "cloud_provider"
      prompt: "Cloud provider: aws, gcp, azure, digital_ocean"
      private: no
      default: none

  roles:
    - ansible-role-fsmrf

I created a file with the above content called install.yml in the root directory of where I extracted the files to, and tried the following command (found online for running a playbook locally)
ansible-playbook -c local -i localhost, install.yml
But I got the following error:
ERROR! the role 'ansible-role-fsmrf' was not found in /root/ansible-role-fsmrf-master/roles:/root/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/root/ansible-role-fsmrf-master

The error appears to have been in '/root/ansible-role-fsmrf-master/install.yml': line 15, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

  roles:
    - ansible-role-fsmrf
      ^ here

I noticed there is no roles folder in the repository. Should this file be in a specific folder, is there another file I need to create, or am I way off?
Any guidance would be appreciated.

first, have a look at where ansible looks for its configuration files.
Your problem is that ansible is not finding your ansible-role-fsmrf folder.
In my case, put my ansible config file under my home directory, and configure it to look for roles under a 'git' folder where I have them all checked out:
$ more ~/.ansible.cfg
[defaults]
roles_path = /Users/dhorton/beachdog-enterprises/beachdog-networks/git

and you can see that I have that role in the configured location:
$ ls -lrt ~/beachdog-enterprises/beachdog-networks/git/ansible-role-fsmrf/
total 16
drwxr-xr-x   3 dhorton  staff    96 Feb 13  2018 vars
drwxr-xr-x   3 dhorton  staff    96 Feb 13  2018 handlers
drwxr-xr-x   4 dhorton  staff   128 Feb 13  2018 tests
-rw-r--r--   1 dhorton  staff  1068 Mar 14  2018 LICENSE
drwxr-xr-x   9 dhorton  staff   288 Oct 25  2019 templates
-rw-r--r--   1 dhorton  staff  3304 Oct  4 14:06 README.md
drwxr-xr-x   3 dhorton  staff    96 Oct  4 14:06 defaults
drwxr-xr-x  11 dhorton  staff   352 Oct  4 14:06 files
drwxr-xr-x   4 dhorton  staff   128 Oct  4 14:06 tasks

With that in place, you can run ansible-playbook from any folder and it will find your roles.
(By the way, running ansible locally is not something I do, so I am not sure how that will work out for you.  I find it easier to run ansible from my laptop against the server(s) that I want to configure)

Thanks for the fast response. What I had to do was set up my folders like so:
/ (install.yml I created here)
/roles/ansible-role-fsmrf/ (checked out code here)

Basically it was looking for a roles folder under the current directory, and then a folder under that matching the role name. Then it started working.
Sorry if this is the wrong place to ask - but what would be the next steps I should take?
My goal is to have incoming calls on Freeswitch handled by IVRs (these will be different applications based on the number called). Users will interact with the IVRs using voice, so I want to use google text to speech/speech to text/dialogflow, which is how I found your freeswitch modules repository originally.
Based on the examples in your modules repo (I'm looking at the google_tts.js as a basic example), I'll need drachtio-server, so I've installed that using your ansible-role-drachtio repo. So I have drachtio-fsmrf and drachtio-server installed.
What I'm confused about now is how I configure freeswitch (or drachtio) so that it knows what application to run to handle the call when a call comes in, so I can actually get developing. For example, if I dial extension 4000 I want the call to be handled by application A, where as if I dial extension 4001 I want the call to be handled by application B. etc. In plain Freeswitch this can be done by setting up a dialplan for each extension that uses a javascript action, but I'm not sure how to do this using drachtio. I saw the mrf.xml file in the freeswitch dialplan folder, but it looks like I shouldn't be touching this and instead I should configure it somewhere else.
Can you please point me in the right direction?

Hi there,
I think I've made a little progress. In /etc/drachtio.conf.xml I've uncommented the request-handlers tag and put the url to an API I've created, as per https://drachtio.org/docs/drachtio-server#request-handlers-section
My API is receiving the request when I try to make a call which is good. Currently my API just logs the requests and responds with the below rejection (example from the link above).
{"reject":{"data":{"status":"503","reason":"reason goes here"}}}

In the logged request, the fromUser seems to be<PHONE_NUMBER>000001 followed by the server IP address, and the toUser<PHONE_NUMBER>000001 followed by some other numbers I don't recognise. The toUser number seems to be the same no matter what extension I dial.
How would I determine what extension number was called in Freeswitch so I can respond with the appropriate "route" response with the url to the application which should handle the call?
I had a look at your sample app here (https://github.com/davehorton/drachtio-sample-webapp) and it looks like the toUser should be the field I want, just not sure how to get the matching number dialled from freeswitch.

I'm unclear on your scenario and where freeswitch fits into it.  Is freeswitch generating an inbound call to the drachtio server?

Hi Dave
Thanks for your time. I'll try to explain a bit better. What I want to achieve:

Receive incoming calls on freeswitch and have the call routed to an IVR based on the DID. Calls on different DIDs would be handled by different IVR applications.
User will interact with the IVRs using voice. Planning to use Google text-to-speech and speech-to-text to achieve this, and possibly Google Dialogflow (also considering Rasa) for intent recognition based on what the caller is saying.

I don't have any SIP trunks configured on Freeswitch yet. Our call centre uses a different phone system currently, but we're looking at using Freeswitch for IVRs due to technical limitations with our current phone system. So for now, I just want to be able to log into Freeswitch with a softphone and call an extension to test an IVR (once the IVRs are developed).
I started out building a regular Javascript Freeswitch application (mod_v8) which worked in a naive way - play an announcement, record audio for x seconds, then send the wav file to google to transcribe it and take action. But I would like to do the transcribing in real time instead to give a better user experience. I couldn't see an easy way to access the call audio and do speech-to-text in real time, which is how I came across Drachtio and your related projects. And as far as google integration with freeswitch goes, it looks like you've already built it.
Apologies if I'm going about this the wrong way or mixed up how your projects work but here's what I've done from the beginning:

Installed freeswitch using ansible-role-fsmrf including the google modules.
Installed drachtio using ansible-role-drachtio.
Created a 4000.xml file in /usr/local/freeswitch/conf/directory/default which is just a copy of 1000.xml with the extension 4000 and a password I chose (so I can log into freeswitch with a softphone using extension 4000).
Created an API which takes a request and gives a JSON response as per https://drachtio.org/docs/drachtio-server#request-handlers-section. Currently always returns a reject response for testing, but I will change this to do a database lookup and give an appropriate route response later. By the way, the example JSON responses on that page aren't actually valid JSON, so I'm not sure my response is right yet.
Updated /etc/drachtio.conf.xml to uncomment the request-handlers tag, and set the url to the API I created in step 4

Haven't touched any other configuration anywhere apart from above. Once test calls are working I then plan to build IVR applications as per https://drachtio.org/docs/developer-guide/#outbound-connections.
I tried making a call to a random number (5001) from a softphone using extension 4000 (Zoiper softphone) and I see this in the freeswitch logs (I changed server IP to __ServerIP__ and my IP to __MyIP__).
eceaee9c-0dca-11eb-bc27-b523ca158164 Dialplan: sofia/drachtio_mrf/4000@__ServerIP__:5080 Regex (FAIL) [socket] ${sip_user_agent}(Z 5.4.6 rv<IP_ADDRESS>) =~ /^drachtio-fsmrf:(.*)$/ break=on-false

Based on this line it doesn't seem to be routing the call to Drachtio. How would I configure freeswitch send the call to drachtio server? Do I need to add a dialplan, if yes what would it look like?
Also - am I understanding the way it works overall correctly (that the call goes from freeswitch to drachtio then is handled by drachtio), or should I be using your freeswitch modules without drachtio?
Full freeswitch log for the test call if its of any use
recv 911 bytes from tcp/[__MyIP__]:63578 at 03:11:17.430169:
------------------------------------------------------------------------
INVITE sip:5001@__ServerIP__:5080;transport=TCP SIP/2.0
Via: SIP/2.0/TCP <IP_ADDRESS>:42573;branch=z9hG4bK-524287-1---ff1fa67e62b458e7;rport
Max-Forwards: 70
Contact: <sip:4000@__MyIP__:42573;transport=TCP>
To: <sip:5001@__ServerIP__:5080>
From: <sip:4000@__ServerIP__:5080;transport=TCP>;tag=57604b00
Call-ID: OZbvIc9Ef48eRmTYKvSp8w..
CSeq: 1 INVITE
Allow: INVITE, ACK, CANCEL, BYE, NOTIFY, REFER, MESSAGE, OPTIONS, INFO, SUBSCRIBE
Content-Type: application/sdp
User-Agent: Z 5.4.6 rv<IP_ADDRESS>
Allow-Events: presence, kpml, talk
Content-Length: 336

v=0
o=Z<PHONE_NUMBER>438 1 IN IP4 __MyIP__
s=Z
c=IN IP4 __MyIP__
t=0 0
m=audio 8000 RTP/AVP 106 9 98 101 0 8 3
a=rtpmap:106 opus/48000/2
a=fmtp:106 sprop-maxcapturerate=16000; minptime=20; useinbandfec=1
a=rtpmap:98 telephone-event/48000
a=fmtp:98 0-16
a=rtpmap:101 telephone-event/8000
a=fmtp:101 0-16
a=sendrecv
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [NOTICE] switch_channel.c:1118 New Channel sofia/drachtio_mrf/4000@__ServerIP__:5080 [eceaee9c-0dca-11eb-bc27-b523ca158164]
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:585 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_NEW (Cur 1 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] sofia.c:10243 sofia/drachtio_mrf/4000@__ServerIP__:5080 receiving invite from __MyIP__:63578 version: 1.10.1-release git f999022 2019-08-20 16:54:04Z 64bit
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] sofia.c:11433 Setting NAT mode based on nat.auto
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] sofia.c:7290 Channel sofia/drachtio_mrf/4000@__ServerIP__:5080 entering state [received][100]
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] sofia.c:7300 Remote SDP:
eceaee9c-0dca-11eb-bc27-b523ca158164 v=0
eceaee9c-0dca-11eb-bc27-b523ca158164 o=Z<PHONE_NUMBER>438 1 IN IP4 __MyIP__
eceaee9c-0dca-11eb-bc27-b523ca158164 s=Z
eceaee9c-0dca-11eb-bc27-b523ca158164 c=IN IP4 __MyIP__
eceaee9c-0dca-11eb-bc27-b523ca158164 t=0 0
eceaee9c-0dca-11eb-bc27-b523ca158164 m=audio 8000 RTP/AVP 106 9 98 101 0 8 3
eceaee9c-0dca-11eb-bc27-b523ca158164 a=rtpmap:106 opus/48000/2
eceaee9c-0dca-11eb-bc27-b523ca158164 a=fmtp:106 sprop-maxcapturerate=16000; minptime=20; useinbandfec=1
eceaee9c-0dca-11eb-bc27-b523ca158164 a=rtpmap:98 telephone-event/48000
eceaee9c-0dca-11eb-bc27-b523ca158164 a=fmtp:98 0-16
eceaee9c-0dca-11eb-bc27-b523ca158164 a=rtpmap:101 telephone-event/8000
eceaee9c-0dca-11eb-bc27-b523ca158164 a=fmtp:101 0-16
eceaee9c-0dca-11eb-bc27-b523ca158164
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] sofia.c:7703 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State Change CS_NEW -> CS_INIT
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:604 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State NEW
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:585 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_INIT (Cur 1 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:628 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State INIT
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] mod_sofia.c:93 sofia/drachtio_mrf/4000@__ServerIP__:5080 SOFIA INIT
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:40 sofia/drachtio_mrf/4000@__ServerIP__:5080 Standard INIT
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:48 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State Change CS_INIT -> CS_ROUTING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:628 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State INIT going to sleep
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:585 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_ROUTING (Cur 1 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_channel.c:2332 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Callstate Change DOWN -> RINGING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:644 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State ROUTING
send 334 bytes to tcp/[__MyIP__]:63578 at 03:11:17.432085:
------------------------------------------------------------------------
SIP/2.0 100 Trying
Via: SIP/2.0/TCP <IP_ADDRESS>:42573;branch=z9hG4bK-524287-1---ff1fa67e62b458e7;rport=63578;received=__MyIP__
From: <sip:4000@__ServerIP__:5080;transport=TCP>;tag=57604b00
To: <sip:5001@__ServerIP__:5080>
Call-ID: OZbvIc9Ef48eRmTYKvSp8w..
CSeq: 1 INVITE
User-Agent: drachtio MRF
Content-Length: 0

eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] mod_sofia.c:154 sofia/drachtio_mrf/4000@__ServerIP__:5080 SOFIA ROUTING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:236 sofia/drachtio_mrf/4000@__ServerIP__:5080 Standard ROUTING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [INFO] mod_dialplan_xml.c:637 Processing 4000 <4000>->5001 in context mrf
eceaee9c-0dca-11eb-bc27-b523ca158164 Dialplan: sofia/drachtio_mrf/4000@__ServerIP__:5080 parsing [mrf->socket] continue=false
eceaee9c-0dca-11eb-bc27-b523ca158164 Dialplan: sofia/drachtio_mrf/4000@__ServerIP__:5080 Regex (FAIL) [socket] ${sip_user_agent}(Z 5.4.6 rv<IP_ADDRESS>) =~ /^drachtio-fsmrf:(.*)$/ break=on-false
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [INFO] switch_core_state_machine.c:312 No Route, Aborting
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [NOTICE] switch_core_state_machine.c:313 Hangup sofia/drachtio_mrf/4000@__ServerIP__:5080 [CS_ROUTING] [NO_ROUTE_DESTINATION]
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:644 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State ROUTING going to sleep
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:585 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_HANGUP (Cur 1 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:848 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Callstate Change RINGING -> HANGUP
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:850 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State HANGUP
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] mod_sofia.c:460 Channel sofia/drachtio_mrf/4000@__ServerIP__:5080 hanging up, cause: NO_ROUTE_DESTINATION
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] mod_sofia.c:605 Responding to INVITE with: 404
send 697 bytes to tcp/[__MyIP__]:63578 at 03:11:17.432893:
------------------------------------------------------------------------
SIP/2.0 404 Not Found
Via: SIP/2.0/TCP <IP_ADDRESS>:42573;branch=z9hG4bK-524287-1---ff1fa67e62b458e7;rport=63578;received=__MyIP__
Max-Forwards: 70
From: <sip:4000@__ServerIP__:5080;transport=TCP>;tag=57604b00
To: <sip:5001@__ServerIP__:5080>;tag=c9eBm9FZ6NyKN
Call-ID: OZbvIc9Ef48eRmTYKvSp8w..
CSeq: 1 INVITE
User-Agent: drachtio MRF
Accept: application/sdp
Allow: INVITE, ACK, BYE, CANCEL, OPTIONS, MESSAGE, INFO, UPDATE, REGISTER, REFER, NOTIFY
Supported: path, replaces
Allow-Events: talk, hold, conference, refer
Reason: Q.850;cause=3;text="NO_ROUTE_DESTINATION"
Content-Length: 0
Remote-Party-ID: "5001" <sip:5001@__ServerIP__>;party=calling;privacy=off;screen=no

eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:60 sofia/drachtio_mrf/4000@__ServerIP__:5080 Standard HANGUP, cause: NO_ROUTE_DESTINATION
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:850 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State HANGUP going to sleep
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:620 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State Change CS_HANGUP -> CS_REPORTING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:585 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_REPORTING (Cur 1 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:936 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State REPORTING
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:174 sofia/drachtio_mrf/4000@__ServerIP__:5080 Standard REPORTING, cause: NO_ROUTE_DESTINATION
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:936 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State REPORTING going to sleep
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:611 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State Change CS_REPORTING -> CS_DESTROY
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_session.c:1726 Session 1 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Locked, Waiting on external entities
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [NOTICE] switch_core_session.c:1744 Session 1 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Ended
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [NOTICE] switch_core_session.c:1748 Close Channel sofia/drachtio_mrf/4000@__ServerIP__:5080 [CS_DESTROY]
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:739 (sofia/drachtio_mrf/4000@__ServerIP__:5080) Running State Change CS_DESTROY (Cur 0 Tot 1)
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:749 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State DESTROY
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] mod_sofia.c:365 sofia/drachtio_mrf/4000@__ServerIP__:5080 SOFIA DESTROY
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:181 sofia/drachtio_mrf/4000@__ServerIP__:5080 Standard DESTROY
eceaee9c-0dca-11eb-bc27-b523ca158164 2020-10-14 03:11:17.421192 [DEBUG] switch_core_state_machine.c:749 (sofia/drachtio_mrf/4000@__ServerIP__:5080) State DESTROY going to sleep

OK, if you want to use drachtio in this scenario, you would need to do things in a completely different fashion:

zoiper will send calls to drachtio server, not freeswitch
freeswitch will not be used for registration - if you need registration you will write a drachtio app (e.g Node.js)
freeswitch is just a media server.  Repeat that: freeswitch is just a media server
you will not implement IVRs on freeswitch, you will do that in your drachtio app (e.g Node.js)
there is no need to have different drachtio apps for different IVR apps -- unless you want to.  This is completely analagous to an express.js http middleware app that mounts multiple endpoints with different behavior -- you wouldn't put those into different applications.

So this is a very different way of working with freeswitch, and it may not be for you.


NotImplementedException when running HandInteractionExample scene in editor

I'm getting an exception when running the HandInteractionExample scene. The error doesn't seem to impact behavior, but I believe we want to have no errors / exceptions thrown when running a scene.
Editor: Unity 2018.4.14f1
Build Settings Platform: UWP
To repro, open the handinteractionexample scene and hit play
NotImplementedException: The method or operation is not implemented.
System.Runtime.InteropServices.Marshal.GetHRForLastWin32Error () (at <e1319b7195c343e79b385cd3aa43f5dc>:0)
WinRT.Mono+ThreadContext..cctor () (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
Rethrow as TypeInitializationException: The type initializer for 'ThreadContext' threw an exception.
WinRT.Delegate+InitialReference..ctor (System.Guid iid, System.IntPtr invoke, System.Object invoker) (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
WinRT.Interop.DelegateProperty`1[T].set_Value (T value) (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
WinRT.Interop.IAsyncOperation.set_Completed (WinRT.Interop.IAsyncOperation+CompletedHandler value) (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
WinRT.Interop._IAsyncOperation`2[TTask,TResult].AsTask (System.Threading.CancellationToken cancellationToken) (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
WinRT.Interop._IAsyncOperation`2[TTask,TResult].AsTask () (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
Microsoft.Windows.Perception.People.IEyesPoseStatics.RequestAccessAsync () (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
Microsoft.Windows.Perception.People.EyesPose.RequestAccessAsync () (at <da2d3aabe3524d9fba5ebaabd307ffc7>:0)
Microsoft.MixedReality.Toolkit.WindowsMixedReality.Input.WindowsMixedRealityEyeGazeDataProvider+<AskForETPermission>d__30.MoveNext () (at Assets/MixedRealityToolkit.Providers/WindowsMixedReality/XR2018/WindowsMixedRealityEyeGazeDataProvider.cs:186)
--- End of stack trace from previous location where exception was thrown ---
System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () (at <e1319b7195c343e79b385cd3aa43f5dc>:0)
System.Runtime.CompilerServices.AsyncMethodBuilderCore+<>c.<ThrowAsync>b__6_0 (System.Object state) (at <e1319b7195c343e79b385cd3aa43f5dc>:0)
UnityEngine.UnitySynchronizationContext+WorkRequest.Invoke () (at C:/buildslave/unity/build/Runtime/Export/UnitySynchronizationContext.cs:155)
UnityEngine.UnitySynchronizationContext:ExecuteTasks() (at C:/buildslave/unity/build/Runtime/Export/UnitySynchronizationContext.cs:105)

Looks like this is from DotNetWinRT. Are you remoting when this happens?

No I was not running Unity Remoting.

I habe the same issue Editor: Unity 2018.4.14f1 , MRTK 2.3
NotImplementedException: The method or operation is not implemented.
System.Runtime.InteropServices.Marshal.GetHRForLastWin32Error () (at :0)
WinRT.Mono+ThreadContext..cctor () (at :0)
Rethrow as TypeInitializationException: The type initializer for 'ThreadContext' threw an exception.
WinRT.Delegate+InitialReference..ctor (System.Guid iid, System.IntPtr invoke, System.Object invoker) (at :0)
WinRT.Interop.DelegateProperty1[T].set_Value (T value) (at <ed1f6dedc2514473bacf0986f8922b29>:0) WinRT.Interop.IAsyncOperation.set_Completed (WinRT.Interop.IAsyncOperation+CompletedHandler value) (at <ed1f6dedc2514473bacf0986f8922b29>:0) WinRT.Interop._IAsyncOperation2[TTask,TResult].AsTask (System.Threading.CancellationToken cancellationToken) (at :0)
WinRT.Interop._IAsyncOperation`2[TTask,TResult].AsTask () (at :0)
Microsoft.Windows.Perception.People.IEyesPoseStatics.RequestAccessAsync () (at :0)
Microsoft.Windows.Perception.People.EyesPose.RequestAccessAsync () (at :0)
Microsoft.MixedReality.Toolkit.WindowsMixedReality.Input.WindowsMixedRealityEyeGazeDataProvider+d__30.MoveNext () (at Assets/MixedRealityToolkit.Providers/WindowsMixedReality/XR2018/WindowsMixedRealityEyeGazeDataProvider.cs:186)
--- End of stack trace from previous location where exception was thrown ---
System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () (at :0)
System.Runtime.CompilerServices.AsyncMethodBuilderCore+<>c.b__6_0 (System.Object state) (at :0)
UnityEngine.UnitySynchronizationContext+WorkRequest.Invoke () (at C:/buildslave/unity/build/Runtime/Export/UnitySynchronizationContext.cs:115)
UnityEngine.UnitySynchronizationContext:ExecuteTasks()

It looks like this was an artifact of switching branches in mrtk_development and DotNetWinRT folder not getting cleared out. Doing a fresh clone of mrtk_development branch removed the issue.


Apparently misleading "fatal" message during site build

When building with bin_files/build-site on two different boxes, I've noticed the following line
fatal: cannot change to 'local_raku_docs': No such file or directory

in between the caching and rendering stages. I'm not sure which Collection step is attempting to change directory but local_raku_docs definitely exists and is pulled/updated each time I run the build script. Furthermore, the site builds just fine, so this "fatal" error appears to be a false positive from the user perspective.
Sample output from a recent run here. See line 13.

I do not think this is a "false positive". Some file has not been found, and a process has been prematurely ended.
If a plugin callable fails, the Failure is caught but processing normally continues. The error may only be visible in the final site when something does not work correctly.
A lot more could be done to provide better debugging information when an error has occurred.
There are a number of options to generate more information about where the problem occurs.
Try passing --collection-info into build-site. This shows each milestone in the Collection process, and the plugins that are called.
Try bin_files/build-site --more-help for more options.

I would expect the following behavior from CLI programs:

a "fatal" error stops execution immediately, and yields a non-zero exit code
other kinds of errors (perhaps) allos execution to proceed, but still yield a non-zero exit code
warnings just make noise in the logs, and do not affect the exit code

"fatal" and "error" are kind of special words when it comes to logging output, in other words. Admittedly, this is merely a convention, but it's a common convention.

Agreed. This needs fixing. But I need a bit more information to track down why the Fatal is just being reported, and not throwing the process.

Excerpt from a run with bin_files/build-site --collection-info:
Plugin ｢raku-doc-setup｣ is listed for milestone ｢setup｣ and has keys ｢authors,version,name,auth,setup,license｣
Plugin ｢git-reflog｣ is listed for milestone ｢setup｣ and has keys ｢setup,custom-raku,render,license,template-raku,auth,version,authors,name,transfer,information｣
fatal: cannot change to 'local_raku_docs': No such file or directory
Starting ｢Setup｣ milestone
Rendering Collection on 2023-02-28 at 22:53:39

P.S. I referred to this as a false positive because

the site builds in spite of the listed error, and
if it were truly fatal I would have expected the build to terminate prematurely

(which largely echoes what @dontlaugh mentioned above).

@cfa there is a problem with git-reflog that I am trying to work on. On my local machine, it works. On the build environment, it does not.
The plugin runs a git command on the repo. Somehow the repo is not being found.
I think that the information required (the reflog of the Raku/docs repo from which the sources are being pulled) is not urgent.
I think the git-reflog plugin needs to be disabled for a while.
In addition, I will look at Collection to make sure that Fatal warnings stop execution.

Thanks @finanalyst. Please let me know if/when you'd like me to test anything on my end.

This Fatal error is happening in git-reflog. The plugin is not working in the build envrionment as expected in any case.
So I am disabling the plugin.

plugin has been removed. Closing issue


Add Winget installation reference

I have just added Neo-cowsay to Winget: https://github.com/microsoft/winget-pkgs/pull/94786

I will PR a Winget Releaser workflow in this repo soon for automatic package updates.

@sitiom Thank you!


Flatten TagHelperOutput when writing

This change 'flattens' a TagHelperOutput when writing it out to an
HtmlTextWriter. This is a beneficial perf change because more often than
not the thing being written to is a ViewBuffer in Razor, which uses pooled
memory. This allows us to 'join' islands of pooled ViewBuffer memory back
into the main buffer instead of keeping them wrapped up in a
TagHelperOutput or TagHelperContent.

Talked offline: We can't delay render begin/end tags etc. due to attribute values potential to be IHtmlContent's containing @(i++). @rynowak has an idea on how to fix this.
Waiting till the concern is addressed to look over the PR further.
:watch:

due to attribute values potential to be IHtmlContent's containing @(i++)

@NTaylorMullen what IHtmlContent implementations contain user expressions? We have a few that defer encoding, avoid Substring() et cetera but I can't think of any containing Funcs.

@dougbu IHtmlContent is just an interface, any implementation would cause this behavior. Even more worrisome though is if a TagHelper author holds onto their TagHelperOutputs Attributes and then modifies them. Delayed rendering would destroy both scenarios.

Delayed rendering would destroy both scenarios.

We do delayed rendering all over the place. You're talking about two corner cases that, while possible, should really be warned about (if we had the appropriate Roslyn analyzers). For example "holds onto their TagHelperOutputs Attributes and then modifies them" involves tag helper authors (1) creating an IHtmlContent implementation containing Funcs, (2) putting their own expressions into those Funcs (note we don't give tag helper author's access to the user's expressions), and (3) also setting up their IHtmlContent for deferred execution.

Discussed with @NTaylorMullen - we agree that what this code is doing today isn't really a change in semantics.
We're still going to try and make the behavior more straightforward, and avoid holding a reference to the TagHelperAttributesList after the call to WriteTo completes. We think we can do this without causing any new perf problems.
I'll send an update to this PR shortly

@dougbu @NTaylorMullen - updated
This now forces eager evaluation of attributes

:shipit:

:shipit:


Bump dependencies to Play 2.4.6 compatibility

Solves #18

Looks good, thank you for your contribution :+1:

Are you planning to make a release soon?

I've bumped the version up to 1.0 and cut a release which should propagate out to mvn shortly.

thanks a lot ! btw, it may be useful to other users to make this lib use sem version (http://semver.org/), but that's up to you :)


extension for exactly distinct count for single long type dimension:accurate-cardinality

Now, Druid offers the ability by nested group by query.
Its logic can be described as follows:
For a sql like:
select count(distinct pid) from DATASOURCE where col="val"

the exactly query will be like:
select count(*) from (
  select pid from DATASOURCE_segments_in_historical1 where col="val" group by pid
  UNION ALL
  select pid from DATASOURCE_segments_in_historical2 where col="val" group by pid
  UNION ALL
  select pid from DATASOURCE_segments_in_historical3 where col="val" group by pid
  ...
) group by pid

For high cardinality case, the size of result transfered from historical node to broker node can be really large and leads to poor performance.
So this extension try to use bitmap(64bit RoaringBitmap) as the container for the result data from the historical.
The performance can be 10 times better the nested group by method.
After PR #6768. Sorry for making the previous PR staled.

Sorry for the delayed review. I'll look through this PR soon.
From the PR description, I'm wondering the SQL syntax could be better. I guess it might not easy to use this feature if they have tons of segments. My question is, can we use the same SQL syntax and add a new query context to enable this feature? For example, it could be something like this.
{
  "query": "select count(distinct pid) from DATASOURCE where col='val'",
  "context": {
    "accurateCardinarlity": true
  }
}

Also, please update the PR description as detailed as possible based on https://github.com/apache/incubator-druid/blob/master/.github/pull_request_template.md. The PR template now has a section to explain design choices which can help others to understand this PR better.

Oh maybe I was confused. From the documentation, looks like you aded a new ACCURATE_CARDINALITY method for this feature. Then it looks good to me.

@elloooooo Hi, have you had any stress tests for this PR?


laravel 5 intergration

How would i integrate this into my laravel 5 app?

Hello @obonyojimmy !
You can integrate AMD with backend the same way as any other Angular SPA application.


Flatcar arm64 running on QEMU (kvm enabled) does not have video output when using VNC

I am trying to run a flatcar arm64 image on qemu-kvm (accel = kvm) with VNC console configured - VNC console just shows "Display output is not active" after the grub2 boots the kernel.
With Flatcar (tried every release channel flatcar_production_qemu_uefi_image.img.bz2), I see the bootloader menu - grub version 2.02, then the boot process seems to continue as expected -- but the VNC console just shows "Display output is not active".
This looks to be a Linux configuration issue, anyone happen to know what are the missing flags or maybe I can try a special linux cmdline param to test?
For example, Ubuntu works with no issues (so there is not a problem on my setup).
I have seen that in your flatcar_production_qemu_uefi.sh script, you are suggesting to run with -nographic, which works great for its purpose, but I would like to use VNC.
 Does the VNC feature also work with another emulated graphics card?

Maybe you can also test this with the amd64 image on your laptop to see the differences with arm64.

Maybe you can also test this with the amd64 image on your laptop to see the differences with arm64.

I do not think the same drivers / config options for the linux kernel apply -- as usually there are different config trees. Do you happen to know where the flatcar-arm64 linux kernel config is to compare with a working Ubuntu kernel?
Thank you.

From the running flatcar with -nographic:
grep -ira virtio config
CONFIG_BLK_MQ_VIRTIO=y
CONFIG_VIRTIO_VSOCKETS=m
CONFIG_VIRTIO_VSOCKETS_COMMON=m
CONFIG_NET_9P_VIRTIO=m
CONFIG_VIRTIO_BLK=m
CONFIG_SCSI_VIRTIO=m
CONFIG_VIRTIO_NET=m
CONFIG_VIRTIO_CONSOLE=m
CONFIG_HW_RANDOM_VIRTIO=y
CONFIG_VIRTIO=y
CONFIG_VIRTIO_MENU=y
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_PCI_LEGACY=y
CONFIG_VIRTIO_BALLOON=m
CONFIG_VIRTIO_INPUT=m
CONFIG_VIRTIO_MMIO=y
CONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=y
# CONFIG_RPMSG_VIRTIO is not set
# CONFIG_VIRTIO_FS is not set
# CONFIG_CRYPTO_DEV_VIRTIO is not set

From the Ubuntu:
grep -ira virtio /boot/config-5.15.0-71-generic
CONFIG_BLK_MQ_VIRTIO=y
CONFIG_VIRTIO_VSOCKETS=m
CONFIG_VIRTIO_VSOCKETS_COMMON=m
CONFIG_BT_VIRTIO=m
CONFIG_NET_9P_VIRTIO=m
CONFIG_ARM_SCMI_TRANSPORT_VIRTIO=y
CONFIG_VIRTIO_BLK=m
CONFIG_SCSI_VIRTIO=m
CONFIG_VIRTIO_NET=m
CONFIG_CAIF_VIRTIO=m
CONFIG_VIRTIO_CONSOLE=y
CONFIG_HW_RANDOM_VIRTIO=m
CONFIG_I2C_VIRTIO=m
CONFIG_GPIO_VIRTIO=m
CONFIG_DRM_VIRTIO_GPU=m
CONFIG_SND_VIRTIO=m
CONFIG_VIRTIO=y
CONFIG_VIRTIO_PCI_LIB=y
CONFIG_VIRTIO_MENU=y
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_PCI_LEGACY=y
CONFIG_VIRTIO_VDPA=m
CONFIG_VIRTIO_PMEM=m
CONFIG_VIRTIO_BALLOON=y
CONFIG_VIRTIO_INPUT=m
CONFIG_VIRTIO_MMIO=y
CONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=y
CONFIG_VIRTIO_DMA_SHARED_BUFFER=m
CONFIG_VIRTIO_IOMMU=y
CONFIG_RPMSG_VIRTIO=m
CONFIG_VIRTIO_FS=m
CONFIG_CRYPTO_DEV_VIRTIO=m

The main difference would be the CONFIG_DRM_VIRTIO_GPU -- I suppose it is worth a try?

Yes, you can add it here https://github.com/flatcar/scripts/tree/main/sdk_container/src/third_party/coreos-overlay/sys-kernel/coreos-modules/files to the common config. Filing a PR will give you a link to the built image after some time where you can test it. Otherwise, you can check https://www.flatcar.org/docs/latest/reference/developer-guides/sdk-modifying-flatcar/ for building on your own.


”Rediu” is listed in the drop-down menu

Description:
"Rediu" is listed in the drop-down menu alongside its corresponding county and commune, according to the law.
Precondition:
The website is up an running.

Step 1
Type "Rediu" in the search bar.

Expected results
The location is listed in the drop-down menu as "Comuna Rediu, IAȘI".


Fix code generation for OpenMP GPU backend with NVHPC

Solves the issues described in https://forums.developer.nvidia.com/t/issue-with-locally-defined-classes-in-openmp-offload-region-since-nvhpc-22-5/228735/7 by defining the functor structs in the beginning of the file
Each time there is an EigenNewtonSolverBlock there will be another functor struct defined. This is to make sure that the proper structs are always defined regardless of the order and where they are defined (nrn_init block, nrn_state or function)
Added integration and unit tests
In BB5 we have sympy 1.9 and in the other CIs there was 1.11. These two different versions generated different code and the new unit tests will fail in one or the other. To solve this issue I created a requirements.txt which is used to install all the python packages needed in all of the CIs. Currently I have pinned the sympy version the same as BB5. It can be updated once we update the version in BB5 as well

CI is green and the PR is now ready for review :rocket:
Once this is merged I can update the Spack PR (https://github.com/BlueBrain/spack/pull/1654) with a new NMODL version to deploy NVHPC 23.1


Authorization | Government Analyst can save a draft of a new credit transaction (Validation/Award/Reduction) |3|

https://trello.com/c/GuI0Z6ny/597-authorization-government-analyst-can-save-a-draft-of-a-new-credit-transaction-validation-award-reduction-3
Story:
As a Gov't Analyst, I want to be able to save a draft of a new credit transaction so that I can prefer multiple balance changes for the Director to review simultaneously.
Scenario:
GIVEN that I my organization is Government
AND I my role is Government Analyst
AND I am creating a "New Credit Transaction"
WHEN I click Save Draft
THEN the transaction history record is saved on the Credit Transactions page
AND the status changes to Draft
AND I am returned to the Credit Transactions page
AND the transaction record for the transfer should be shown at the top of the Credit Transactions page
AND the transaction record has a clickable edit icon

 Authorization | Government Analyst can save a draft of a new credit transaction (Validation/Award/Reduction) |3|


Test with 4 processes (3 workers)

This reverts commit 0fc7bf2efc9648fc08872b7848cea4f6d27f2dc7.

Not sure if this is relevant to #10, but in #8 I found that the test hangs with Julia 1.8-DEV but not with Julia 1.6. https://github.com/JuliaFolds/FoldsDagger.jl/runs/4316965001?check_suite_focus=true
Also, in the current master branch (after #8), the entry point for the test will be a bit different (and should become a bit more robust for loading tests in multiple workers). I'm also trying to support the standard test entry point #12.

@jpsamaroo Not sure if this is relevant to #10, but in #8 I found that the test hangs with Julia 1.8-DEV but not with Julia 1.6. https://github.com/JuliaFolds/FoldsDagger.jl/runs/4316965001?check_suite_focus=true
Also, in the current master branch (after #8), the entry point for the test will be a bit different (and should become a bit more robust for loading tests in multiple workers). I'm also trying to support the standard test entry point #12.


mopidy-youtube not able to read metadata from youtube.

Hello,
I have been using the youtube extension for a while; however, a month or more back it stopped doing searches and bringing back the metadata into existing playlists.   I can create a valid Mopidy URI and add it and it will play from YT.  And all existing URIs in playlists, still work but after a refresh of the playlists  ( in IRIS) the video info is all gone and the URIs are shown as seen like this:
youtube:video:-NuX79Ud8zI
- * YouTube Video:

Since I had a workaround I just kept using it; however, with the update to mopidy I decided to dig in a bit on this issue. I even tried to pull the GIT feature/yt_playlist tree but it did not help, and seemed to have no effect.
I run mopidy as a service on a pi4b arm64 rpios.
Everything is updated, (I will put all versions and system info at bottom).
I do not use the API.
Error returned from trying to update track info
Below shows the error returned from systemctl when looking up metadata.  EG refresh a playlist that has a YT URI in it.  I believe it puts out one error block for every YT URI it tries to update.
sudo systemctl status mopidy
---snip---
Jul 09 22:09:21 elan4 mopidy[5486]: INFO     [ThreadPoolExecutor-32_0] mopidy_youtube session.get triggered: list_videos (experimental)
Jul 09 22:09:21 elan4 mopidy[5486]: INFO     [ThreadPoolExecutor-32_0] mopidy_youtube session.get triggered: bs4api run_search
Jul 09 22:09:23 elan4 mopidy[5486]: INFO     [ThreadPoolExecutor-32_0] mopidy_youtube nothing in the soup, trying japi
Jul 09 22:09:23 elan4 mopidy[5486]: ERROR    [ThreadPoolExecutor-32_0] mopidy_youtube list_videos error "Extra data: line 1 column 84575 (char 84574)"
Jul 09 22:09:23 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.lookup "youtube:video:-NuX79Ud8zI"
Jul 09 22:09:23 elan4 mopidy[5486]: [youtube] cBdNsC0BMT8: Downloading player 51ff6aac

Error Returned from using search
When using the search feature from the front end only searching Youtube.  Nothing is returned. (eg search for big iron seen below).  The page will show a message saying "Searching Youtube XYZ" where XYZ is at least Tracks and Playlist and the rest is too fast to see.
I have tried many searches using only letters (no spaces, numbers or special chars) I have tried URL's and Video ID as well. all return nothing with the same type of error seen below (I think the "column X (char X-1)" changes).
The systemctl status shows after search:
Jul 09 22:09:23 elan4 mopidy[5486]: [youtube] cBdNsC0BMT8: Downloading player 51ff6aac
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'artist': ['Big Iron']}"
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'album': ['Big Iron']}"
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'any': ['Big Iron']}"
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube Searching YouTube for query "Big Iron"
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: search
Jul 09 22:24:46 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: bs4api run_search
Jul 09 22:24:47 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube nothing in the soup, trying japi
Jul 09 22:24:47 elan4 mopidy[5486]: ERROR    [YouTubeBackend-3] mopidy_youtube search error "Extra data: line 1 column 259817 (char 259816)"
Jul 09 22:24:47 elan4 mopidy[5486]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

Search for the video ID.

Jul 09 22:24:47 elan4 mopidy[5486]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.
Jul 09 22:36:03 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'artist': ['-NuX79Ud8zI']}"
Jul 09 22:36:03 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'album': ['-NuX79Ud8zI']}"
Jul 09 22:36:04 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'any': ['-NuX79Ud8zI']}"
Jul 09 22:36:04 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube Searching YouTube for query "-NuX79Ud8zI"
Jul 09 22:36:04 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: search
Jul 09 22:36:04 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: bs4api run_search
Jul 09 22:36:04 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube nothing in the soup, trying japi
Jul 09 22:36:04 elan4 mopidy[5486]: ERROR    [YouTubeBackend-3] mopidy_youtube search error "Extra data: line 1 column 23126 (char 23125)"
Jul 09 22:36:04 elan4 mopidy[5486]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

Search for just the letter a
Jul 09 22:55:57 elan4 mopidy[5486]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'artist': ['a']}"
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'album': ['a']}"
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'any': ['a']}"
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube Searching YouTube for query "a"
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: search
Jul 09 23:22:32 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: bs4api run_search
Jul 09 23:22:33 elan4 mopidy[5486]: INFO     [YouTubeBackend-3] mopidy_youtube nothing in the soup, trying japi
Jul 09 23:22:33 elan4 mopidy[5486]: ERROR    [YouTubeBackend-3] mopidy_youtube search error "Extra data: line 1 column 230792 (char 230791)"
Jul 09 23:22:33 elan4 mopidy[5486]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

Using feature/yt_playlist
I read some of the closed issues, where it was stated that using the GIT feature/yt_playlist tree may help with search issues.   This seemed to rev ytmusicapi from .15 to .18, but had no effect (tests above shown after proc below but are the same as before and I do not use the API).
I am not quite sure if I did it right.  To use the tree I had to use sudo as mopidy is running as a service.
$ sudo python3 -m pip install git+git://github.com/natumbri/mopidy-youtube.git@feature/yt-playlists
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting git+git://github.com/natumbri/mopidy-youtube.git@feature/yt-playlists
  Cloning git://github.com/natumbri/mopidy-youtube.git (to revision feature/yt-playlists) to /tmp/pip-req-build-e0q7e8re
  Running command git clone -q git://github.com/natumbri/mopidy-youtube.git /tmp/pip-req-build-e0q7e8re
  Running command git checkout -b feature/yt-playlists --track origin/feature/yt-playlists
  Switched to a new branch 'feature/yt-playlists'
  Branch 'feature/yt-playlists' set up to track remote branch 'feature/yt-playlists' from 'origin'.
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done

---snip all requirements met and download of ytmusicapi---

Installing collected packages: ytmusicapi
  Attempting uninstall: ytmusicapi
    Found existing installation: ytmusicapi 0.15.1
    Uninstalling ytmusicapi-0.15.1:
      Successfully uninstalled ytmusicapi-0.15.1
Successfully installed ytmusicapi-0.18.0

System Versions and settings:
Running "/usr/bin/mopidy --config /usr/share/mopidy/conf.d:/etc/mopidy/mopidy.conf deps" as user mopidy
Executable: /usr/bin/mopidy
Platform: Linux-5.10.46-v8+-aarch64-with-debian-10.10
Python: CPython 3.7.3 from /usr/lib/python3.7
Mopidy: 3.2.0 from /usr/lib/python3/dist-packages
---snip---
Mopidy-YouTube: 3.3 from /usr/local/lib/python3.7/dist-packages
  youtube-dl: 2021.2.10 from /usr/local/lib/python3.7/dist-packages
  cachetools: 4.2.1 from /usr/local/lib/python3.7/dist-packages
  Mopidy: 3.2.0 from /usr/lib/python3/dist-packages
  Pykka: 2.0.3 from /usr/lib/python3/dist-packages
  ytmusicapi: 0.18.0 from /usr/local/lib/python3.7/dist-packages
    requests: 2.25.1 from /usr/local/lib/python3.7/dist-packages
      certifi: 2018.8.24 from /usr/lib/python3/dist-packages
      chardet: 3.0.4 from /usr/lib/python3/dist-packages
      idna: 2.6 from /usr/lib/python3/dist-packages
      urllib3: 1.24.1 from /usr/lib/python3/dist-packages
  setuptools: 54.2.0 from /usr/local/lib/python3.7/dist-packages
  beautifulsoup4: 4.7.1 from /usr/lib/python3/dist-packages
  requests: 2.25.1 from /usr/local/lib/python3.7/dist-packages
    certifi: 2018.8.24 from /usr/lib/python3/dist-packages
    chardet: 3.0.4 from /usr/lib/python3/dist-packages
    idna: 2.6 from /usr/lib/python3/dist-packages
    urllib3: 1.24.1 from /usr/lib/python3/dist-packages
---snip---
GStreamer: <IP_ADDRESS> from /usr/lib/python3/dist-packages/gi
  Detailed information:
    Python wrapper: python-gi 3.30.4
    Relevant elements:
      Found:
        uridecodebin
        souphttpsrc
        appsrc
        alsasink
        osssink
        oss4sink
        pulsesink
        id3demux
        id3v2mux
        lamemp3enc
        mpegaudioparse
        mpg123audiodec
        vorbisdec
        vorbisenc
        vorbisparse
        oggdemux
        oggmux
        oggparse
        flacdec
        flacparse
        shout2send
      Not found:
        flump3dec
        mad

Thank you for any help and for creating a really useful extension.
Side note:  my workaround was to search on youtube and copy the video ID out of the URL.   Bandcamp extension has a javascript link that scrapes and creates a Mopidy URI from pages... Something like that for YT would be cool  and probably easier because you could use the URL to get the Video ID directly.

In theory there's already a fix for this problem in #170. Unfortunately the fix has not yet found its way into a release.

In theory there's already a fix for this problem in #170. Unfortunately the fix has not yet found its way into a release.

That is the reference I was referring to when I updated to the feature/yt_playlist tre, where @natumbri stated he updated that branch with the work around...  I upgraded to that branch and it had not effect.   It may have done more but it updated the ytmusicapi that I do not use.
I am a bit of a  git noob, could someone point me to how to add the fix/patch.  (Should I downrev to the release, then apply what to get the fix?  Other than the feature tree I did not see where a fix was implemented in that issue.)

There was some new error info in journalctl when executing:
Jul 27 14:44:59 elan4 mopidy[3379]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.lookup "youtube:video:06ht9MyJLT4"
Jul 27 14:44:59 elan4 mopidy[3379]: INFO     [ThreadPoolExecutor-2_0] mopidy_youtube session.get triggered: list_videos (experimental)
Jul 27 14:44:59 elan4 mopidy[3379]: INFO     [ThreadPoolExecutor-2_0] mopidy_youtube session.get triggered: bs4api run_search
Jul 27 14:45:01 elan4 mopidy[3379]: INFO     [ThreadPoolExecutor-2_0] mopidy_youtube nothing in the soup, trying japi
Jul 27 14:45:01 elan4 mopidy[3379]: ERROR    [ThreadPoolExecutor-2_0] mopidy_youtube list_videos error "Extra data: line 1 column 175110 (char 175109)"
Jul 27 14:45:01 elan4 mopidy[3379]: INFO     [YouTubeBackend-3] mopidy_youtube youtube PlaybackProvider.translate_uri "youtube:video:06ht9MyJLT4"
Jul 27 14:45:01 elan4 mopidy[3379]: [youtube] 06ht9MyJLT4: Downloading webpage
Jul 27 14:45:02 elan4 mopidy[3379]: [youtube] 06ht9MyJLT4: Downloading player 02486e7d
Jul 27 14:45:04 elan4 mopidy[3379]: ERROR    [Core-11] mopidy.listener Triggering event failed: stream_changed(uri)
Jul 27 14:45:04 elan4 mopidy[3379]: Traceback (most recent call last):
Jul 27 14:45:04 elan4 mopidy[3379]:   File "/usr/lib/python3/dist-packages/mopidy/listener.py", line 44, in on_event
Jul 27 14:45:04 elan4 mopidy[3379]:     getattr(self, event)(**kwargs)
Jul 27 14:45:04 elan4 mopidy[3379]:   File "/usr/lib/python3/dist-packages/mopidy/core/actor.py", line 85, in stream_changed
Jul 27 14:45:04 elan4 mopidy[3379]:     self.playback._on_stream_changed(uri)
Jul 27 14:45:04 elan4 mopidy[3379]:   File "/usr/lib/python3/dist-packages/mopidy/core/playback.py", line 147, in _on_stream_changed
Jul 27 14:45:04 elan4 mopidy[3379]:     self._trigger_track_playback_started()
Jul 27 14:45:04 elan4 mopidy[3379]:   File "/usr/lib/python3/dist-packages/mopidy/core/playback.py", line 514, in _trigger_track_playback_started
Jul 27 14:45:04 elan4 mopidy[3379]:     self.core.history._add_track(tl_track.track)
Jul 27 14:45:04 elan4 mopidy[3379]:   File "/usr/lib/python3/dist-packages/mopidy/core/history.py", line 31, in _add_track
Jul 27 14:45:04 elan4 mopidy[3379]:     ", ".join(artist.name for artist in track.artists)
Jul 27 14:45:04 elan4 mopidy[3379]: TypeError: sequence item 0: expected str instance, NoneType found

Weird.  I didn't have any trouble adding and playing youtube:video:06ht9MyJLT4.
Haven't seen this before: ERROR    [ThreadPoolExecutor-2_0] mopidy_youtube list_videos error "Extra data: line 1 column 175110 (char 175109)" and can't make it happen for me...

@afredsa try the new fix/thumbnails.
While I was trying to fix the thumbnail support, I started to get an error a bit like yours. Turns out the format of the data YouTube was sending changed unexpectedly. I fixed it - maybe it will solve your problem?

@afredsa are you interested in testing this?  I've merged everything into develop.  No problem if you don't want to test - but let me know and I'll close off the issue.

@natumbri, thank you.  I am away and have limited time right now, however,  I have tried both the things above your latest check but they did not seem to work... exactly.
Setting the cookie seemed to change getting metadata in IRIS FE(front end) to be seen on "Now Playing" but only intermittently????. There was no change to the search which is returning no results or to the playlist metadata load.   The cookie behavior led me to think that search was being called/handled differently between search (which is currently returning nothing) and the metadata retrieval  (still getting no results)after cookie change.   At this point I started to use mscode to dig into functions being called (unfortunately I do not know how to debug mopidy as service on python, yet)  and I bogged down in printing debug INFO lines "Here"...  and bogged down in checking that it is not an FE problem: all 3 of the http FE (IRIS, Muse, Musicbox) have the same behavior and errors Seen in "Errors Returned from Search" in first post). I could not figure out how to limit ncmpc*(pp) mpd clients to a YT ext search only.  ncmpc did not return any YT hits and only output these lines below in journalctl before hitting an error in backend.radionet and resetting the mpd connection.  (All http clients are limited only to youtube search for testing, so the below error I do not think is germane to YT ext ).
Aug 17 03:15:40 elan4 mopidy[29066]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'track_name': ['Jude']}"
Aug 17 03:15:40 elan4 mopidy[29066]: ERROR    [MpdSession-22] pykka Unhandled exception in MpdSession (urn:uuid:---x---):
Aug 17 03:15:40 elan4 mopidy[29066]: Traceback (most recent call last):
Aug 17 03:15:40 elan4 mopidy[29066]:   File "/usr/lib/python3/dist-packages/pykka/_actor.py", line 193, in _actor_loop
Aug 17 03:15:40 elan4 mopidy[29066]:     response = self._handle_receive(envelope.message)
---snip---
Aug 17 03:15:40 elan4 mopidy[29066]:   File "/usr/lib/python3/dist-packages/pykka/_actor.py", line 299, in _handle_receive
Aug 17 03:15:40 elan4 mopidy[29066]:     return callee(*message.args, **message.kwargs)
Aug 17 03:15:40 elan4 mopidy[29066]:   File "/usr/local/lib/python3.7/dist-packages/mopidy_radionet/library.py", line 91, in search
Aug 17 03:15:40 elan4 mopidy[29066]:     self.backend.radionet.do_search(' '.join(query['any']))
Aug 17 03:15:40 elan4 mopidy[29066]: KeyError: 'any'
Aug 17 03:15:41 elan4 mopidy[29066]: INFO     [MpdSession-23] mopidy_mpd.session New MPD connection from [---x---

The fix/thumbnails:   I tried:
sudo python3 -m pip install git+git://github.com/natumbri/mopidy-youtube.git@fix/thumbnails
This did not seem to install anything returning dependency met on all items.   So I am not sure anything was changed.   And had no change when testing after.
I should be able to do:
sudo python3 -m pip install git+git://github.com/natumbri/mopidy-youtube.git@develop
In the next day or two...  If someone could tell me if this is the right way of updating (or should (and how do I) uninstall/reinstall) the YT Ext.  That could help me from wondering if what I am installing from git is changing anything.
....
I just did it...  No change after reboot.
I checked /usr/local/lib/python3.7/dist-packages/mopidy_youtube/backend.py
and it seemed to still have my cookie edit ("Cookie": "PREF=hl=en; CONSENT=YES+20210629;",) and my debug statements, and edit date, so I am not sure if the install works this way.
pi@x:~ $ sudo python3 -m pip install git+git://github.com/natumbri/mopidy-youtube.git@develop
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting git+git://github.com/natumbri/mopidy-youtube.git@develop
  Cloning git://github.com/natumbri/mopidy-youtube.git (to revision develop) to /tmp/pip-req-build-72qvpqzc
  Running command git clone -q git://github.com/natumbri/mopidy-youtube.git /tmp/pip-req-build-72qvpqzc
  Resolved git://github.com/natumbri/mopidy-youtube.git to commit a3e44b2542d386a395795e191ac122adf3355398
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from Mopidy-YouTube==3.3) (54.2.0)
Requirement already satisfied: requests in /usr/local/lib/python3.7/dist-packages (from Mopidy-YouTube==3.3) (2.25.1)
Requirement already satisfied: youtube-dl>=2020.12.22 in /usr/local/lib/python3.7/dist-packages (from Mopidy-YouTube==3.3) (2021.2.10)
Requirement already satisfied: Pykka>=2.0.1 in /usr/lib/python3/dist-packages (from Mopidy-YouTube==3.3) (2.0.3)
Requirement already satisfied: cachetools in /usr/local/lib/python3.7/dist-packages (from Mopidy-YouTube==3.3) (4.2.1)
Requirement already satisfied: beautifulsoup4 in /usr/lib/python3/dist-packages (from Mopidy-YouTube==3.3) (4.7.1)
Requirement already satisfied: Mopidy>=3.1 in /usr/lib/python3/dist-packages (from Mopidy-YouTube==3.3) (3.2.0)
Requirement already satisfied: ytmusicapi>=0.17 in /usr/local/lib/python3.7/dist-packages (from Mopidy-YouTube==3.3) (0.18.0)
Requirement already satisfied: idna<3,>=2.5 in /usr/lib/python3/dist-packages (from requests->Mopidy-YouTube==3.3) (2.6)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/lib/python3/dist-packages (from requests->Mopidy-YouTube==3.3) (3.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3/dist-packages (from requests->Mopidy-YouTube==3.3) (1.24.1)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->Mopidy-YouTube==3.3) (2018.8.24)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
pi@elan4:~ $

---Search output ---
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'artist': ['Running']}"
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'album': ['Running']}"
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube youtube LibraryProvider.search "{'any': ['Running']}"
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube Searching YouTube for query "Running"
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: search
Aug 17 03:40:54 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube session.get triggered: bs4api run_search
Aug 17 03:40:55 elan4 mopidy[3800]: INFO     [YouTubeBackend-3] mopidy_youtube nothing in the soup, trying japi
Aug 17 03:40:55 elan4 mopidy[3800]: ERROR    [YouTubeBackend-3] mopidy_youtube youtube.py search error "Extra data: line 1 column 359951 (char 359950)"
Aug 17 03:40:55 elan4 mopidy[3800]: WARNING  [Core-11] mopidy.core.library YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

I will try some things later.

Could it be that this regex  is greedy and is matching more than just the json structure you want to then try and parse? Try changing it to:
r"ytInitialData = ({.*?});",

Or add some debugging around there.

Thanks @kingosticks - I don't reckon that's the problem, but fixing that regex up is a good idea in any case. I'll look into it. (It might be the problem, but I have a feeling it is something else.)
I'm going to simplify things shortly, by getting rid of the regex and bs4 based APIs and keeping only the official API, the JSON based one and YouTube Music. Hopefully fewer of these types of issues to sort out!

I saw a related issue for some other project where their regex was catching a load of random javascript that had suddenly appeared after the json struct they wanted and of course the json decoder complains about that. Worth a try!

For sure.
But also, the version of the code you linked to, but which @afredsa appears not to be using (despite his efforts), no longer uses the regex for searches. It is still used for other things, just not search. Instead of a session.get to a browser endpoint (which returns a webpage, complete with HTML, JavaScript and JSON, burried somewhere), search now uses a session.post to the youtubei/v1 API endpoint (which returns pure JSON and so doesn't need a regex).
For the methods that do use the browser endpoint and regex, I think a bunch of JavaScript has started appearing from time to time after the JSON I'm looking for, exactly as you have suggested.  I think your suggestion might be the correct way to fix it.

Hello,
I uninstalled mopidy_youtube and then installed develop branch.
All searchers are now working!  Thank you.
sudo systemctl stop mopidy
sudo  python3 -m pip uninstall Mopidy-YouTube
sudo python3 -m pip install git+git://github.com/natumbri/mopidy-youtube.git@develop
sudo systemctl start mopidy

Since you are working with KOS I am not sure if I should close.  Feel free to close, OR/and if you like I can do more testing, send logs, etc. (like if a new regex is created).  Thank you again.

Great - I think this can be closed; I will take up @kingosticks useful suggestion, but no need to keep this issue open, I think.
Thanks @afredsa for your patience and for going through the testing and providing feedback. I'm glad to hear it's working for you.


Linux Env Setup and steps

There are steps added if the users want to deploy from a linux VM

Created an MD file to show the linux setup steps

Moved the Linux setup steps to and MD file.


Add confirmation step to ddev remove

The Problem:
ddev rm removes all data for a site, it might not be obvious to the user that they're about to lose their whole setup.
The Fix:

Add confirmation step
Add Y/N prompting mechanism (copied from bootstrap drud cli)
Fix test to use the confirm flag
Add a cmd-side test for ddev remove to make sure the various options work

The Test:
Run ddev rm and use the options available.
Automation Overview:

A new TestDevRemove test was added. It uses a pipeline with "echo" as a very simple way to offer the option to ddev.
Related Issue Link(s):
Release/Deployment notes:

That was good feedback. I softened the abort message and added a cmd test TestDevRemove. It uses "echo", which is not exactly what we want, but the way echo is used here is even valid on Windows I think.


Review / Fix licences for MoJ org

We currently have 115 repos without a licence - we should fix that.
TODO:

Do we do it ourselves?
Is it a comms piece?
What exactly needs doing?

The work to fix the solution in our code to make it look in more detail for a MIT license will be covered in this ticket