Update Set-CsTeamsAcsFederationConfiguration.md

cc: @tomkau

Docs Build status updates of commit 90ba701:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

teams/teams-ps/teams/Set-CsTeamsAcsFederationConfiguration.md
:white_check_mark:Succeeded
View (teams-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 50cc414:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

teams/teams-ps/teams/Set-CsTeamsAcsFederationConfiguration.md
:white_check_mark:Succeeded
View (teams-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 6bad85a:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

teams/teams-ps/teams/Set-CsTeamsAcsFederationConfiguration.md
:white_check_mark:Succeeded
View (teams-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Cron

There is no general tab to configure cron or is there another way?
I am logged in as administrator

docker run -d --name speedtest-tracker --restart unless-stopped -p 8765:80 -e PUID=1000 -e PGID=1000 -e APP_KEY=base64:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX -e APP_URL=http://localhost -e DB_CONNECTION=sqlite -v ${PWD}:/config lscr.io/linuxserver/speedtest-tracker:0.20.7

same, and on the dashboard page it now says I don't have any schedule test, which I had scheduled in previous version:

Just use: lscr.io/linuxserver/speedtest-tracker:0.19.0
Apparently the general tab was removed in favor of environment variables for site name, dashboard public toggle, time zone(s), speed test schedule, results pruning, speedtest servers, etc. Apparently some aspect of maintaining the GUI was proving too time consuming relative to the huge upgrades to the API or... something, but idk. I just never really looked to a speedtest snapshot container for a robust API, I just wanted a nice visual web app to track routine speedtests charts. I just think environment variables where docker apps like this are concerned, should be the very bare metal aspects of the app, it shouldn't be the prime modus for controlling app functionality.

ok, saw the changes now:
https://github.com/alexjustesen/speedtest-tracker/releases/tag/v0.20.0


ModuleNotFoundError: No module named 'cv2'

I got this error:
Traceback (most recent call last):
  File "/lib/security/howdy/compare.py", line 19, in <module>
    import cv2
ModuleNotFoundError: No module named 'cv2'

Are you using that "recommended" package on openSUSE? It's completely broken.  For some reason the package "depends" upon OpenCV3, where the runtime actually uses OpenCV2.
I'm not familiar with OpenCV (or Python) in general, but I've read that v3 can be substantially faster than v2; therefore, I'm wondering if any efforts are being made to migrate the project over to it.

Feel free to re-open it if you can provide more information.

For what it's worth - I'm no linux or python expert, but after trying lots of stuff online I ended up with:
Run sudo python
Run each of the import lines from cli/test.py - see which fails. eg:
import configparser
import os
import sys
import time
import dlib
import cv2

Had to install dlib using pip install dlib - worked fine
Then tried getting cv2 (opencv-python) a bunch of ways, but the only way that worked for me was
sudo apt install -y python3-opencv

Test now running and trying to get the rest set up.


CFN template in yaml or json format

Note: If your feature-request is regarding the AWS Amplify Console service, please log it in the
official AWS Amplify Console forum

Is your feature request related to a problem? Please describe.
I like to use yaml whenever possible. Its shorter to write and easier on the eyes.
Describe the solution you'd like
I would like for the CLI so support the yaml format, particularly for the cloudfront hosting.
The yaml templates work up to a point, like I can update the cloudfront with it, but when it gets to the step where it publishes my react app it fails. It says it cannot find a template.json file, which is true since I have a template.yaml file.
The "issue" is on this line: https://github.com/aws-amplify/amplify-cli/blob/master/packages/amplify-category-hosting/lib/S3AndCloudFront/index.js#L120
If you guys could have a file reader that works for both yaml and json that would be great.
Describe alternatives you've considered
Alternatives would be to go back to JSON, which is what I will do in the meantime. But it would be nice to have this feature, cause you guys say that formats are not enforced: https://github.com/aws-amplify/amplify-cli/issues/1286 (I know its related to Cognito there)
Additional context
Add any other context or screenshots about the feature request here.

@timoteialbu Thanks for the feedbacks.
The team will have a discussion and update you on this.

Thanks, looking forward to your response.

Any update on this? Can we use YAML for our custom stacks yet in Amplify?

@kevinc1984 That's exactly what I do. Convert to yaml, make my changes and then convert back. It would just be nice to support both, since amplify could do that conversion on their side, merge the JSON stuff and then output it back into the format I had.

FWIW I'm using YAML for my custom stacks right now (since 4.0.) and it "just works"

What do you mean "just works" I put a .yml file in my stacks directory and I get:
Yaml is not yet supported. Please convert the CloudFormation stack my-stack.yml to json.

I created a custom stack template in YAML, and put it in the path ./amplify/backend/{category}/{name}/{name}-cloudformation-template.yaml and it is deployed with an amplify push.

@rowanu that doesn't do anything for me. You're sure it is deployed?If it is, it's because something else going on on your system.

The only other steps I followed were those for custom CloudFormation stacks in the CLI docs 🤷♂

YAML didn't work for me either, using Amplify CLI 4.16.1. It failed with:

SyntaxError: Unexpected token A in JSON at position 0
at JSON.parse ()
at AmplifyToolkit.readJsonFile [as _readJsonFile] (/usr/local/lib/node_modules/@aws-amplify/cli/src/extensions/amplify-helpers/read-json-file.js:11:15)
at /usr/local/lib/node_modules/@aws-amplify/cli/node_modules/amplify-provider-awscloudformation/lib/push-resources.js:250:41

I resorted to conversion from YAML to JSON before build, with automation so it's seamless, using "postinstall" in package.json:

"scripts": {
"postinstall": "cfn-flip cloudformation-template.yaml | tee ../yaml_converted_template.json"
}

cfn-flip is taken from https://github.com/awslabs/aws-cfn-template-flip
To make it work on AWS Amplify Console, I created an executable with pyinstaller and checked it in my repo:
docker run --rm -v $(pwd):/foo/dist -w /foo amazonlinux:2 ./dist/package_cfn_flip.sh cfn-flip
where package_cfn_flip.sh is:

#!/bin/bash -ex
yum install -y python3 binutils
python3 -m venv venv
source venv/bin/activate
pip3 install pyinstaller cfn_flip
echo "from cfn_flip import flip; import sys; print(flip(open(sys.argv[1], 'r').read()))" > cfnflip.py
pyinstaller --onefile --name $1 cfnflip.py
deactivate
rm -rf venv

Still not working entirely on Amplify 4.29. Works with push, not with publish:
Publish started for S3AndCloudFront
File at path: '.../amplify/backend/hosting/S3AndCloudFront/template.json' does not exist

I have a template.yaml, but template.yml doesn't work either.

Closing in favor of existing feature request - Feature request: Use YAML for all CloudFormation files.


flannel unhealthy

Just noticed in my dashboard it's showing flannel as unhealthy.
Should I try stopping the flannel jobs to see if it fixes it. Just want to check as don't want to break anything

Please run sudo flynn-host collect-debug-info and post the resulting gist so we can try and understand why flannel is unhealthy.

https://gist.github.com/22b944c2ced786b6cebe871b1066f6ed
https://gist.github.com/b44e8ef5488fbcde9b08549ce8dc372c
https://gist.github.com/f9729db9f76cd12d16b52d79b77bee9e

Did you manage to look into this?

@dottodot sorry for the delay on this, I have looked through the logs but can't really get a sense of why flannel is reporting as unhealthy.
Looking at the code, nothing is actually logged to understand what the issue is. Would you be able to come into IRC where we can debug this together?
In any case, Flannel being unhealthy is probably not having any effect on your cluster, unless you have noticed anything else not functioning correctly?

this was fixed by adding the following firewall rule
sudo ufw allow in on flannel.1


Add the option of using reattach-to-user-namespace

When OS X runs as a scheduled service in OS X, it runs as root in a way
that shelling out, even as a specific user, results in bad responses
from Mas. The reattach-to-user-namespace utility can help with this, but
let's leave it disabled by default.
$ mas account
<EMAIL_ADDRESS>
$ sudo mas account
Not signed in

$ sudo su -
$ mas account
Not signed in

$ sudo -u jhartman mas account
Not signed in

$ sudo -u jhartman reattach-to-user-namespace mas account
<EMAIL_ADDRESS>

Hopefully a fix for #39.

Coverage remained the same at 100.0% when pulling 6abf4694b70c7680f7eade38bcf2588cf5451f9f on jdh-user-rtun-when-needed into e80a78c88ad6a5f98d1c0de807fac0a7e7334a9d on master.


[SPARK-6837][R] Several cleanClosure fixes with minor refactoring

Several fixes on cleanClosure: write-after-read (WAR) order; remove "SparkR" package constraint on package private functions; handle "missing arguments"; ignore the symbol with qualifier "::" and ":::"
Minor refactoring.

Merged build triggered.

Merged build started.

Test build #32651 has started for   PR 6133 at commit 26a1743.

Test build #32651 has finished for   PR 6133 at commit 26a1743.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32651/
Test PASSed.

Merged build finished. Test PASSed.

@davies @shivaram

Build triggered.


[DO NOT MERGE] demo bastion and SSH tunnel for UI

What does this PR do?
A demo for accessing UI from a control node, via bastion node.
How should this be manually tested?
e2e with the inventory vars from my example
Is there a relevant Issue open for this?
Provide a link to any open issues that describe the problem you are solving.
Who would you like to review this?
cc: @tomassedovic  PTAL

@tomassedovic e2e works for me. This basically includes the shade inventory, bastion patches on review. So those should be working as well. Please test for yourself and let me know results.

resubmitted as https://github.com/openshift/openshift-ansible-contrib/pull/596


Support for non-embedded videos

Which area is this feature request for?
Other
Describe the feature you'd like to request
Videos that are embedded into .ipynb files render without problems on the generated html files.
This is how the embedding looks like in the .ipynb file
"data": {
"text/html": [
  "<video controls autoplay loop style=\"max-width: 60%;\"  >\n",
  " <source src=\"data:video/mp4;base64,AAAAIGZ0eXBpc29tAAACAGlzb21pc28yYXZjMW1wNDEAAAAIZnJlZQAAMyttZGF0AAACrgYF//+q3EXpvebZSLeWLNgg2SPu73gyNjQgLSBjb3JlIDE2NCByMzA5NSBiYWVlNDAwIC0gSC4yNjQvTVBFRy00IEFWQyBjb2RlYyAtIENvcHlsZWZ0IDIwMDMtMjAyMiAtI...

However, when I include a non-embedded video file, it won't render.
Non-embedded videos look like this in the .ipynb file (they point to an external mp4 file):
"data": {
"text/html": [
  "<video src=\"media/jupyter/Example<EMAIL_ADDRESS>controls autoplay loop style=\"max-width: 60%;\"  >\n",
  "      Your browser does not support the video element.\n",
  "    </video>"
],
"text/plain": [
  "<IPython.core.display.Video object>"
]
},
"metadata": {},
"output_type": "display_data"
}

Here is a sample project for testing media-content:
https://github.com/kolibril13/mystjs-media-example
Describe the solution you'd like
No response
Describe alternatives you've considered
No response

Super cool to start seeing manim outputs here. 🚀
I think there are a few different parts to this issue:

being able to embed a video in myst directly (see #246 for some discussion); and
recognizing the output of a notebook, and copying that content into the project.

I think (1) is great and something we should just do (i.e. allow for direct embedding of videos in the same way we do images). I am less sure about how to do (2) as it is a raw text/html string, and then figuring out if there is content we should copy into the _build folder, and then rewrite the HTML in the output. It seems like there would be a lot of edge cases there.
Perhaps if we provide a way to embed the video, the second path will be less required as we show a way to get to the solution you are looking for at least.

Thanks for pointing me to this conversation!
I like the idea of embedding ".mp4"s with ![](myvideo.mp4).
It's funny that you mention the hazzle with raw text/html strings, a few months back I wrote jupyter_capture_output, a cell magic that captures outputs of certain types into files.
For capturing non-embedded videos I've used regex, which is not pretty, but it works.
https://github.com/Octoframes/jupyter_capture_output/blob/65b3050dcf7a0d96d762d47ee785e1c5d496ebba/jupyter_capture_output/co_cellmagic.py#L179
That brings me to the idea: When people want to have non-embedded videos in mystjs, they can use jupyter_capture_output.

and another thought:
Is there a package that converts jupyter output into a png, like a screenshot?
That way one could embed any content into a myst website (e.g. when the output js component is calculation intensive and one wants to support slow laptops, when it's a video or widget, but the final document should be a latex file)

recognizing the output of a notebook, and copying that content into the project.

I just made another minimal example.
Here, "assets/dog_with_water.mp4" is in the same folder as the notebook.
Therefore, the idea: One could copy the notebook-whole folder and its sub-folders into the myst project.


Create a new release to PyPI

I'll do this after https://github.com/openworm/tracker-commons/pull/48 is merged.

Done: https://github.com/openworm/tracker-commons/releases/tag/v0.3.0


Testing: Blank line at bottom of CSV Generates out of range error

From testing- having a blank line at bottom of CSV generates out of range error
This should be handled.

Develop Branch working ok


Npgsql.PostgresException (0x80004005): 42704: publication "pub_test" does not exist

Describe the bug
Error in replication listener. Waiting for 10 seconds...
Npgsql.PostgresException (0x80004005): 42704: publication "pub_test" does not exist
at Npgsql.Internal.NpgsqlConnector.g__ReadMessageLong|232_0(NpgsqlConnector connector, Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
at Npgsql.Replication.ReplicationConnection.StartReplicationInternal(String command, Boolean bypassingStream, CancellationToken cancellationToken)+MoveNext()
To Reproduce
Steps to reproduce the behavior:
Source code and database table definitions to reproduce the behavior. Include details about RabbitMQ topology (exchanges, queue bindings) if applicable.
Expected behavior
Need to receive the replication data
Error messages or screenshots
Npgsql.PostgresException (0x80004005): 42704: publication "pub_test" does not exist
at Npgsql.Internal.NpgsqlConnector.g__ReadMessageLong|232_0(NpgsqlConnector connector, Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
at Npgsql.Replication.ReplicationConnection.StartReplicationInternal(String command, Boolean bypassingStream, CancellationToken cancellationToken)+MoveNext()
Further technical information:
Severity: ERROR
SqlState: 42704
MessageText: publication "pub_test" does not exist
Where: slot "pg2j_9cafd1dbeed342439d71158c76344dd9", output plugin "pgoutput", in the change callback, associated LSN 0/1A37100
File: pg_publication.c
Line: 533
Routine: get_publication_oid
Additional context
Add any other context about the problem here.

Found the problem and resolved.
To Resolve this issue.
Need to create publication with following format
CREATE PUBLICATION {publicationName} FOR TABLE {tableName};

It would be better, if it is document about this step.

Hi @ssamsundar - the step about creating the publication is documented in the main readme file of the repository.
But, I agree, it's good to have some info in the TestWorker project too (it's added now as summary comment of the Worker class).


Does the Web UI support qualified name syntax?

Reading up on cross-database documentation for the language syntax, it seems like it should. EG:
database("<database name>").<table name>
But everytime I try to do that with a selected cluster in the UI, I get an ERROR: Please select a database to execute queries.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5e0fe92a-90be-c666-9d29-fe3d4eb68b27
Version Independent ID: db56e6c1-c71b-7d84-4e38-1c555db1fa67
Content: Quickstart: Query data in Azure Data Explorer
Content Source: articles/data-explorer/web-query-data.md
Service: data-explorer
GitHub Login: @orspod
Microsoft Alias: orspodek

@jderus Thank you very much for the inquiry. We are investigating and will update you when we have accurate information.

@jderus I just tried running some queries and it works fine.
let subscriptionList = ServiceTree_AIRSSubscriptionFeedV1
| where ServiceGroupName in ("ABCD")
| distinct SubscriptionId;
database("Shared").ARM_AllSubscriptionResources
| where SubscriptionId in (subscriptionList)
| join kind = inner ........

You will need to select a scope

Please let us know if you are still facing issues.

@jderus Its been a while we heard back from you.
We will close this issue now. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.

@KalyanChanumolu-MSFT
Perhaps I am missing context here....
What is confusing is that the Scope seems to indicate a database, but then the query seems to be ignoring that database context. Is that correct?
If so, that seems a little counterintuitive.
If not, can you please clarify the context of your provided example?

So, for what it is worth, I gave it shot and it does seem that this works.
It also works when you select a database and do not even use that database in the cross-db query.
So I guess the web ui/error is just a little counterintuitive.


Performance issue with translations

Whenever the locale is not the default one (so, Spanish), searching for cards triggers a slow query by lack of index.
 )
          OR ( Coalesce(t4_.content, c0_.traits) LIKE 'House Tully. %' )
          OR ( Coalesce(t4_.content, c0_.traits) LIKE '%. House Tully.' )
          OR ( Coalesce(t4_.content, c0_.traits) LIKE '%. House Tully. %' ) )
ORDER  BY Coalesce(t1_.content, c0_.name) ASC,
          c0_.code ASC;

Part of the problem, for the last query at least, is the ext_translations.content field isn't indexed, so MySQL is resorting to temporary tables to do the ORDER BY, whereas the equivalent field card.name is indexed. Though in my brief poking around, adding the index to content didn't seem to immediately fix that problem.
Coalesce is almost certainly interfering with query efficiency. Even if content were indexed, I don't think MySQL would look at either index since you're passing it through a function.
Could this problem be solved operationally? Instead of doing the fallback within the queries w/ coalesce, you could try doing the fallback when importing data. Always import the English text into the ext_translations table and then override that text if translation exists for the card. You'd be duplicating text for each language, which isn't ideal, but it should simplify the queries / get rid of the need for coalesce. (I'm not familiar with how the Translatable extension works so I don't know if it would give you control over that)


[Feature Request]: Integrating Docker into the project

🎮 feature Request
feature logic and basic descriptionDocker is a must for open-source projects nowadays as it has its benefits.
Use Case
Dockerfile has many benefits but consistency and isolation stand out the most.
I will also be updating the docs for it.
Point down the features
Docker allows you to package your entire application, including its dependencies, into a single container. That makes sure your application will run across different environments.
another benefit is that it runs in its environment without interfering with other applications or the host system.
Select program in which you are contributing
GSSoC24
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

hi @Ratangulati,
also do Create a updation in learn.md as well as readme file regarding the same. explaining each step of process.
Thank You

@Manaregr8 if no one do this issue kindly assign this issue to me i will resolve this


templates: de: improve parsing QualityHosting lines

A single QualityHosting invoice position spans across multiple lines.
For that reason it uses a very generic RegEx for middle lines:
line: '^\s+(?P<desc>.+)$'

That doesn't work well with multi-page invoices. It's because above
RegEx matches page footer lines. That results in footer content getting
extracted as invoice line "desc".

Improve that situation by adding "last_line" RegEx matching position
last line. That prevents parsing lines between last and first lines
(e.g. footer content).

So what do we do about this pull request?
It received some minor cross-pull-request comment in the #417:

Maybe better to leave suboptimal tests and examples in this library. Just as an showcase. (Same goes for the OCR examples in this repo). It is definityle helping us to find these corner cases.

As de.qualityhosting.yml is a template for actual (real-life) invoices I really think we should fix it. By that I mean accepting this pull request.
If we need to test some corner cases - that can be done using custom templates & tests. I added support for such in the just-merged #414.

So what do we do about this pull request?

I'd suggest we let this one sit here for a moment.
At least until we've sorted out the multiline parsing.
Wen't trought the re lib docs. need some time to test and verify things. Will report back in #417

As in 417 mentioned.
I agree to update this template.
Possibly to include only lines with more then 30 spaces in front
^\s{30,}
For this particular invoice we could make the lastline specific, (or either leave it very generic, like before this pr)
Just the question wat kind of example we would like to include.
As per your previous suggestion:
'^\s+(?P<desc>\d\d\.\d\d\.\d\d-\d\d\.\d\d\.\d\d)$'
I would like to propose to change it to
'^\s{30,}(?P<desc>\d{2}[.]\d{2}[.]\d{2}[.]-\d{2}[.]\d{2}[.]\d{2})$'
rewrote the . to [.] as it is best practice to prevent the use of a plain . preformance wise.
(I quikly drafted this, it needs testing..)

Used this version of thetemplate to check the code of #417.
Intentional it is without last_line. Because the purpose of the check was to see if it is adding a matched line to the output without the lastline key.
issuer: QualityHosting AG
fields:
  amount: Total EUR\s+(\d+,\d+)
  amount_untaxed: Total EUR\s+(\d+,\d+)
  date:
    - \s{2,}(\d+\. .+ \d{4})\s{2,}
    - Rechnungsdatum\s+(\w+ \d+, \d{4})
  invoice_number: Rechnungsnr\.\s+(\d{8})
  vat: DE 232 446 240
lines:
  start: 'Contract No. \w+'
  end: 'Total EUR'
  first_line: '\s+(?P<pos>\d+)\s+(?P<qty>\d+)\s+(?P<desc>.{,70})\s+(?P<price>\d+,\d+)'
  line: '^\s{30}(?P<desc>.{5,30})$'
  types:
      qty: float
      price: float
keywords:
- QualityHosting
options:
  currency: EUR
  decimal_separator: ","

@rmilecki  Is it ok for you to use this version?


gorouter does not check for successful backend websocket upgrade

Issue
Our users were experiencing random 404s for otherwise working urls. (see https://cloudfoundry.slack.com/archives/C05586PBX/p1513360375000396) This issue only appeared intermittently.
We believe that the issue is caused because gorouter does not check for a successful WebSocket upgrade when connecting to a backend. Leading (in combination with persistent HTTP connections) to a tunnel where request that should have been handled by gorouter are blindly forwarded to the backend that didn't establish / upgrade to a WebSocket connection.
Context
Analyzing this issue over several weeks now lead us to this (most likely) scenario as cause for the issue.
Involved components:
[1 Client] -> [2 AWS ALB] -> [3 GoRouter] -> [4 Loggregator] -> [5 cloud_controller ]
All incoming connections (plain http / websocket) share the same ALB listener (port 443).
Sequence of events:

a client (cf cli) want to stream app logs and connects to doppler.sys.<cf_domain>:443/apps/5a507deb-48d1-4d14-ad51-d81493964100/stream
ALB (2) establishes or re-uses an already established connection (C1) to gorouter and forwards the request - see L1
gorouter accepts the request, identifies it as websocket request and establishes a plain TCP connection (C2) to the Loggregator Trafficcontroller (4). Then is starts a gorouting that simply copies everything from C1->C2 and from C2->C1 stopping only if an EOF occurs - see L2 (https://github.com/cloudfoundry/gorouter/blob/master/proxy/handler/request_handler.go#L244).
Loggregator tries to authorize the log access request with cloud_controller (5), receives a 404 Non 200 response from CC API: 404 for 5a507deb-48d1-4d14-ad51-d81493964100 and returns this 404 to the client - see L3 (https://github.com/cloudfoundry/loggregator/blob/9ed548bc30d69c1639b8bfdd676f4cc10c353677/trafficcontroller/internal/proxy/log_access_middleware.go#L31).
gorouter (3) simply copies the bytes and keeps the connection open (as does the golang stdlib http server in the Loggregator (4) )
ALB (2) receives the response and because the WebSocket upgrade didn't succeed it keeps the connection to gorouter (3) open

Now we basically have established a "tunnel" from the ALB (2) straight to Loggregator (4)
Now, if another request comes in and ALB happens to pick C1 from its pool of connection to gorouter, the request hit loggregator, which (rightfully) returns a 404. see L4
Steps to Reproduce
Up until now we didn't manage to reproduce the issue willingly.
Expected result
If the WebSocket upgrade fails on the backend, gorouter must not establish a plain TCP connection (tunnel).
Possible Fix
Only upgrade to a plain TCP connection of gorouter can verify that the WebSocket upgrade was successful at the backend.
Logs:
L1 - ALB access log
1..._elasticloadbalancing_eu-west-1_app.dilab-app-prod-apps-alb.cfc9a3d27629f775_20180130T0805Z_54.x.x.151_3ma3cl4s.log.gz:https 2018-01-30T08:04:07.050749Z app/dilab-app-prod-apps-alb/cfc9a3d27629f775 217.x.x.121:49974 10.x.x.75:80 0.000 0.023 0.000<PHONE_NUMBER> 147 "GET https://doppler.sys.<cf_domain>:443/apps/5a507deb-48d1-4d14-ad51-d81493964100/stream HTTP/1.1" "Go-http-client/1.1" ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 arn:aws:elasticloadbalancing:eu-west-1:1...:targetgroup/dilab-app-prod-apps-http/3d151219c9a4b491 "Root=1-5a7026f7-6906254f2ff11eca65469161" "doppler.sys.<cf_domain>" "arn:aws:acm:eu-west-1:1....:certificate/6d28448a-c4d5-4165-a5e0-bd6d239ad4f7"

L2 - gorouter log
10.x.x.75 - gorouter [2018-01-30 08:04:07+0000]
{
    "log_level": 1,
    "timestamp":<PHONE_NUMBER>.026743,
    "message": "handling-websocket-request",
    "source": "vcap.gorouter.proxy.request-handler",
    "data": {
        "RemoteAddr": "10.x.x.40:63175",
        "Host": "doppler.sys.<cf_domain>",
        "Path": "/apps/5a507deb-48d1-4d14-ad51-d81493964100/stream",
        "X-Forwarded-For": [
            "217.x.x.121"
        ],
        "X-Forwarded-Proto": [
            "https"
        ],
        "Upgrade": "websocket"
    }
}
[instance@47450 director="" deployment="cloudfoundry" group="router" az="z1" id="80484006-1f24-4e07-a956-25f13c8e9070"]

L3 - Loggregator log access 404
10.x.x.23 - loggregator_trafficcontroller CEF:0|cloud_foundry|loggregator_trafficcontroller|1.0|GET /apps/5a507deb-48d1-4d14-ad51-d81493964100/stream|GET /apps/5a507deb-48d1-4d14-ad51-d81493964100/stream|0|rt=1517299447972 cs1Label=userAuthenticationMechanism cs1=oauth-access-token cs2Label=vcapRequestId cs2=0842815b-12d8-454b-4e47-2d9d28738f08 request=/apps/5a507deb-48d1-4d14-ad51-d81493964100/stream requestMethod=GET src=217.x.x.121 spt= dst=10.x.x.23 dpt=8081 [instance@47450 director="" deployment="cloudfoundry" group="log-api" az="z2" id="ee719e00-09fb-4900-bbc2-d4f49e10922d"]
10.x.x.23 - vcap.trafficcontroller 2018/01/30 08:04:07 Non 200 response from CC API: 404 for 5a507deb-48d1-4d14-ad51-d81493964100 [instance@47450 director="" deployment="cloudfoundry" group="log-api" az="z2" id="ee719e00-09fb-4900-bbc2-d4f49e10922d"]

L4 - Follow up request that get's tunneled to loggregator and results in a 404

Notice the ALB source port (63175) it's the same as in the WebSocket upgrade request in L2
ASCII extracted from pcap:
GET<EMAIL_ADDRESS>HTTP/1.1
X-Forwarded-For: 52.x.x.5
X-Forwarded-Proto: https
X-Forwarded-Port: 443
Host: identity.vwgroup.io
X-Amzn-Trace-Id: Root=1-5a702a...
Accept: application/json, application/*+json
X-NewRelic-ID: VQAOW...
X-NewRelic-Transaction: PxQHAgBQXAVRXAIGDg...
User-Agent: Java/1.8.0_162

HTTP/1.1 404 Not Found
Content-Type: text/plain; charset=utf-8
X-Content-Type-Options: nosniff
Date: Tue, 30 Jan 2018 08:17:49 GMT
Content-Length: 19

(Shannon here)
@zrob @ahevenor
What do you make of this? I don't know why Trafficcontroller calls out to CC when Gorouter routes a websocket request it, but it seems to me Trafficcontroller shouldn't be passing HTTP responses it receives from CC back through to the client. If Trafficcontroller has some dependency on CC, either it should not accept the websocket connection from Gorouter if it can't satisfy this dependency, or it should disconnect the websocket connection if the call to CC fails, or it should mask the responses from CC. All Gorouter should know is whether Trafficcontroller accepts the websocket request or not.

@shalako Whether or not Loggregator is doing the right thing here, I think gorouter should make sure that no WebSocket backend can basically "hijack" traffic by "misbehaving".

Sascha, in your testing have you found that Loggregator does accept the
websocket connection? If not, that could be something we can remedy. If so,
how should gorouter recognize "misbehaving"? Once a TCP connection is
established, gorouter should not be aware of anything above L4, right?
Shannon Coen
Product Manager, Cloud Foundry
Pivotal, Inc.
On Fri, Feb 2, 2018 at 10:21 AM, Sascha Matzke<EMAIL_ADDRESS>wrote:

@shalako https://github.com/shalako Whether or not Loggregator is doing
the right thing here, I think gorouter should make sure that no WebSocket
backend can basically "hijack" traffic by "misbehaving".
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cloudfoundry/gorouter/issues/208#issuecomment-362664247,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJjmI0TPmOkE_GdvPevRPJ8K5YA05Ygks5tQ1JEgaJpZM4R3ga4
.

Loggregator accepts the TCP connection but never successfully completes the WebSocket Handshake (by returning a HTTP 101 Switching Protocols response).
I‘ve put misbehaving in quotes because this is actually 100% valid behavior. If a resource doesn‘t exist the backend must answer with a 404, because before the WebSocket handshake is complete, we‘re still in plain HTTP territory.
Goroute must not establish a plain tcp bridge between client and backend before it saw a HTTP 101 response from the backend (only then is the WebSocket handshake complete and a switch to TCP safe).

@shalako I think the RFC 6455 is very clear in this:

The handshake from the server is much simpler than the client
handshake.  The first line is an HTTP Status-Line, with the status
code 101:

   HTTP/1.1 101 Switching Protocols

Any status code other than 101 indicates that the WebSocket handshake
has not completed and that the semantics of HTTP still apply.  The
headers follow the status code.

According to the last paragraph, gorouter is clearly not in TCP area until it sees an server acknowledgement. Since this acknowledgement never reaches gorouter in the case of the issue, the semantics of HTTP still apply .
Please come up with a fix ASAP. The possibility that gorouter sends requests to the wrong apps is pretty scary....


Add random errors to data to test validation failures

Currently most of the samples in our tests are valid samples. We want to test validation failures thoroughly as well. We will introduce one error per checklist data sample and see how it behaves. The errors should be introduced into the BioSamples documents. Later we will introduce multiple errors and check the error messages for correct and consistent behaviour.
Create a list with:

checklist accession

field that is invalidated

error type from list below

For clarity see below:

[x] missing mandatory fields
[x] invalid enum value - @snathanvj
[ ] invalid pattern regex - @ESapenaVentura
[ ] invalid json

Looking at ENA checklist,Field type is mostly text field, text area all of them accepts text/number everything. So invalid data type , we can not do.

Running this on codon would show you all 26 uniq regex patterns in the checklists:
cd /nfs/production/tburdett/workstreams/fairification/checklists/checklist-converter/schema
grep --no-filename pattern *BSD* | sort | uniq

Most of them are dates and numbers. Some are strings that start with a certain character sequence.
A string like __XYZ_BANANA_123%$£ should fail all of them. You could find out by copying them to some online evaluator and check that this string fails them all.

changes are in this branch for both mandatory field error, enum error and validate the result using biovalidator and check validation results . https://github.com/ebi-ait/checklist-converter/tree/ck_38_add_random_errors_to_sample
I have executed the script for the list of accessions in accessions.csv
files are in /nfs/production/tburdett/workstreams/fairification/checklists/senthil/checklist-converter/data/invalid
Generated invalid files : /nfs/production/tburdett/workstreams/fairification/checklists/senthil/checklist-converter/data/invalid
validation results: /nfs/production/tburdett/workstreams/fairification/checklists/senthil/checklist-converter/data/invalid/validation_result
Result: all of the validated files conatins expected validation error
How to run:
To generate invliad biosample json files:
python3 invalid_sample_generator.py --action=generate
To validate all generated biosample jsons:
first set up biovalidator as described in https://github.com/ebi-ait/checklist/issues/25
and then run
python3 invalid_sample_generator.py --action=validate
it will generate validation result files in data/invalid/validation_result directory
to check results:
mkdir -p data/invalid/enum;  mv data/invalid/validation_result/*enum.json data/invalid/validation_result/enum
mkdir -p data/invalid/mandatory;  mv data/invalid/validation_result/*mandatory.json data/invalid/validation_result/mandatory
./check_results.sh data/invalid/validation_result/enum 'must be equal to one of the allowed values' | grep missing
./check_results.sh data/invalid/validation_result/mandatory/ 'must have required property' | grep missing

created separate ticket for regexp errors #51

made a curl request with dummy json to biovalidator
curl -X POST -H "Content-Type: application/json" -d "{'schema':{},'data':{}}" http://host:3020/validate >> malformed_json_post_to_biovalidator.txt
output: {"error":"Received malformed JSON."}
results are in
/nfs/production/tburdett/workstreams/fairification/checklists/data/run008/malformed_json_post_to_biovalidator.txt


since the issue #4907 i think the class RestMappingMethodInterceptor should implements the method “getAcceptedMethodTypes”

Please answer these questions before submitting your issue.

Why do you submit this issue?
[*] Question or discussion
[ ] Bug
[ ] Requirement
[ ] Feature or performance improvement

Question
Since the issue #4907 I think the class RestMappingMethodInterceptor should implements the method “getAcceptedMethodTypes” which returns “” by now

Bug

Which version of SkyWalking, OS and JRE?

Which company or project?

What happened?
If possible, provide a way to reproduce the error. e.g. demo application, component version.

Requirement or improvement

Please describe your requirements or improvement suggestions.

I think #5084 has fixed this.

I think #5084 has fixed this.

in #5084 it changed the code in the class AbstractMethodInterceptor use “getAcceptedMethodTypes(method)” but the method “getAcceptedMethodTypes” is a abstract one ，the implements are RequestMappingMethodInterceptor.getAcceptedMethodTypes and RestMappingMethodInterceptor.getAcceptedMethodTypes，then the RequestMappingMethodInterceptor.getAcceptedMethodTypes has handle the case but  the RestMappingMethodInterceptor.getAcceptedMethodTypes just return a empty string, did i miss something..

Ping @BFergerson for a closer look.
@whfjam If you have known what we're missing, could you send a pull request directly?

Ping @BFergerson for a closer look.
@whfjam If you have known what we're missing, could you send a pull request directly?

yes, i'd like to

https://github.com/apache/skywalking/pull/5085 is my attempt at fixing this. The only thing not working is the e2e tests.

#5085 is my attempt at fixing this. The only thing not working is the e2e tests.

i have saw your code， i noticed that in the last else situation u used the <return ""> i think this code
will cause the recursive to be ended because in the method ParsePathUtil.recursiveParseMethodAnnotaion it judges the result by
Objects.isNull(result) , i doubt if you have notice that.

#5085 is my attempt at fixing this. The only thing not working is the e2e tests.

here is my code if any helps to you
@Override
public String getAcceptedMethodTypes(Method method) {
return ParsePathUtil.recursiveParseMethodAnnotaion(method, m -> {
GetMapping getMapping = AnnotationUtils.getAnnotation(m, GetMapping.class);
if (getMapping != null) {
return RequestMethod.GET.toString();
}
PostMapping postMapping = AnnotationUtils.getAnnotation(m, PostMapping.class);
if (postMapping != null) {
return RequestMethod.POST.toString();
}
PutMapping putMapping = AnnotationUtils.getAnnotation(m, PutMapping.class);
if (putMapping != null) {
return RequestMethod.PUT.toString();
}
DeleteMapping deleteMapping = AnnotationUtils.getAnnotation(m, DeleteMapping.class);
if (deleteMapping != null) {
return RequestMethod.DELETE.toString();
}
PatchMapping patchMapping = AnnotationUtils.getAnnotation(m, PatchMapping.class);
if (patchMapping != null) {
return RequestMethod.PATCH.toString();
}
return null;
});
}

#5085 is my attempt at fixing this. The only thing not working is the e2e tests.

here is my codes if any helps to you
@Override
public String getAcceptedMethodTypes(Method method) {
return ParsePathUtil.recursiveParseMethodAnnotaion(method, m -> {
if (AnnotationUtils.getAnnotation(m, GetMapping.class) != null) {
return RequestMethod.GET.toString();
}
if (AnnotationUtils.getAnnotation(m, PostMapping.class) != null) {
return RequestMethod.POST.toString();
}
if (AnnotationUtils.getAnnotation(m, PutMapping.class) != null) {
return RequestMethod.PUT.toString();
}
if (AnnotationUtils.getAnnotation(m, DeleteMapping.class) != null) {
return RequestMethod.DELETE.toString();
}
if (AnnotationUtils.getAnnotation(m, PatchMapping.class) != null) {
return RequestMethod.PATCH.toString();
}
return null;
});
}

@whfjam You could review that PR directly, comment on the specific line(s). And the codes should be well formated by using markdown(GitHub supports this).

#5085 merged, if you still have some doubts, submit your proposal change through a pull request.


Documentation: Priors

We need a nice wiki writeup on priors.
After #81 is complete, maybe add information on arbitrary priors.
Make sure to also include a section about when it is correct to initialize targets at a specific value.

We have this: https://github.com/eriq-augustine/psl/wiki/Rule-Specification#priors


pretrained model downlad problem

Thanks for your great work....i have one problem to download pretrained model. i cannot access your mit files website. So when i try ./tools/download~.sh, i failed. There is any reason?

Hi @SeungHwi0613,
Would you mind having a try again? I just attempted to access the URLs to our pretrained checkpoints using cellular data (so that I am not in the school network), and I was able to download these files.
Best,
Haotian

hi,when i download swint-nuimages-pretrained.pth,it has a problem as follow:

hi,when i download swint-nuimages-pretrained.pth,it has a problem as follow:

same thing happened to me.

same thing happened to me.  It cannot be opened in the browser either

Hello, the official address for downloading the pre-training model of the project is invalid. If you have swint-nuimages-pretrained.pth, could you share it with my email address [(mailto:balms123456@gmail.com)], Wish you all the best in scientific research.

I had the same issue and later using the chrono plugin in chrome downloaded fine

Thank you so much it is so helpful to me

Hi @hubingqingorc @SeungHwi0613,
Could you please share the downloaded wights with me? My email address is<EMAIL_ADDRESS>I can provide the upload link on the cloud drive. Please get in touch with me by email.
I really appreciate any help you can provide.

HI, I have found a solution in #521. After replacement, the new download link is as follows
mkdir pretrained &&
cd pretrained &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained_updated/bevfusion-det.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained_updated/bevfusion-seg.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained/lidar-only-det.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained/lidar-only-seg.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained_updated/camera-only-det.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained_updated/camera-only-seg.pth &&
wget http://hanlab18.mit.edu/projects/bevfusion/files/pretrained_updated/swint-nuimages-pretrained.pth


✨ Can you support "-webkit-image-set" function ?

Description
I want to use webp picture as background, but to support more browsers, I still have to use png as alternatives.
Like this demo, how to implement this in Master CSS?
image-set()

All CSS functions are available out of the box:
<div class="background-image:-webkit-image-set(url('large-balloons.avif')type('image/avif'),url('large-balloons.jpg')type('image/jpeg'))">

In this case, if you don't have collocation selectors or media queries and will only use them once, you can use the inline style directly.


Added Archaeology Minor YAML

References

Linear: https://linear.app/hoagie/issue/DEV-65/archaeology-minor

Proposed Changes

Added ART.yaml for Archaeology Minor

Ah shoot you're right


Bump rebar3

Proposed Changes
Bump rebar3
Types of Changes
What types of changes does your code introduce to this project?
Put an x in the boxes that apply

[ ] Bugfix (non-breaking change which fixes issue #XXXX)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation (correction or otherwise)
[ ] Cosmetics (whitespace, styles...)
[x] DevOps (Build scripts, pipelines...)

Checklist
Put an x in the boxes that apply. You can also fill these out after creating
the PR. If you're unsure about any of them, don't hesitate to ask on the
mailing list. We're here to help! This is simply a reminder of what we are
going to look for before merging your code.

[x] I have read the CODE_OF_CONDUCT.md document
[x] All tests pass locally with my changes
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have added necessary documentation (if needed)
[ ] Any dependent changes have been merged and published in related repositories
[ ] I have updated changelog (At the bottom of the release version)
[ ] I have squashed all my commits into one before merging

Further Comments
My editor uses a recent version of rebar3 and always clobbers the lock file. I don't know if other folks are running into this or not.

I'm pretty sure that 23.0.1 matrix fail is just a timing thing that shows up in CI.

Yeah, always timing :) I need rebar3 to work with my internal builds, that's why I don't merge this right away. I'll make sure of that.

For what it's worth, I've verified that the release and tar targets complete with no errors. I haven't done smoke tests on the results.

Closing since this is covered by https://github.com/vernemq/vernemq/pull/1737


Cannot install on MacbookAir M1 processor

➜  PROJECTS brew install davidalger/warden/warden
Updating Homebrew...
==> Auto-updated Homebrew!
Updated 2 taps (homebrew/core and homebrew/cask).
==> Updated Formulae
Updated 40 formulae.
==> Updated Casks
Updated 9 casks.
==> Tapping davidalger/warden
Cloning into '/usr/local/Homebrew/Library/Taps/davidalger/homebrew-warden'...
remote: Enumerating objects: 210, done.
remote: Counting objects: 100% (56/56), done.
remote: Compressing objects: 100% (29/29), done.
remote: Total 210 (delta 13), reused 55 (delta 13), pack-reused 154
Receiving objects: 100% (210/210), 23.69 KiB | 1.08 MiB/s, done.
Resolving deltas: 100% (50/50), done.
Tapped 1 formula (14 files, 36.2KB).
Error: Cannot install in Homebrew on ARM processor in Intel default prefix (/usr/local)!
Please create a new installation in /opt/homebrew using one of the
"Alternative Installs" from:
  https://docs.brew.sh/Installation
You can migrate your previously installed formula list with:
  brew bundle dump

=====================
Running: MacOs Big Sur 11.2.3
Chip Apple M1

@amarmureanuarnia Unless I'm mistaken, the error there is related to how Homebrew is installed and not specific to Warden.
Please create a new installation in /opt/homebrew using one of the
"Alternative Installs" from:
  https://docs.brew.sh/Installation
You can migrate your previously installed formula list with:
  brew bundle dump

On that linked installation docs page, you'll notice Homebrew states on M1 Macs it will install into /opt/homebrew instead of /urs/local and the error above indicates it's incorrectly installed, why I can't say, but I would look into that and try again.
If you want to give Warden a shot without needing to fix or change your Homebrew installation, feel free to use the alternate installation method documented here: https://docs.warden.dev/installing.html#alternative-installation

Thanks for the fast response. I already tried brew bundle dump but still not working. Probably I'm doing something wrong. I'll try the alternative way!

Hi @amarmureanuarnia, did you get a chance to get this working on an M1 Mac?
Also, @davidalger - is Warden officially supported on an M1 Mac? I'm just curious about the state of Magento development on Apple Silicon systems. :)

Hei @drpayyne ! Unfortunately, I didn't had time to try again. As of M1 Mac development, I can tell you that 90% of my work is still done on my old Macbook Pro late 2015 Intel based. I tried a couple of other projects with docker images, and from 4 projects only one worked without the need of doing some customization. Everyone that right now has an M1 Mac should invest time in building images for their project on the new ARM architecture. How I'm seeing it, is that even with the new Macbookpro 16 M2 there will still be missing pieces in the development process. In conclusion I still feel like an pioneer :)))

There is certainly room for some improvements on M1 currently, but complete support (i.e. no emulation required) is going to be a long time coming and there is no ETA for that, as many of these issues relate to upstream deps, many of which lack arm64 / aarch64 images and/or rpms. I'm also limited in the time I have to spend building, testing, etc.

There are no arm64 images for MySQL, Mailhog, or the base image used for Magepack image builds
There are arm64 images for MariaDB, Nginx, RabbitMQ and Redis, but the build process in here needs amending to pull/build/push with both architectures
Varnish doesn't even provide RPMs for arm64 so building a varnish image with native M1 support is not currently possible
Elasticsearch publishes arm64 images (at least for later versions) but they use tags to denote this instead of multi-platform images as Docker Hub does, so ES specific build process changes will be needed to pull/build/push with both architectures.
Remi does not build aarch64 RPMs for PHP, and currently has no ETA (or plans really) to do so as he lacks an arm builder and rebuilding PHP for Arm is not exactly a small endeavor (https://forum.remirepo.net/viewtopic.php?pid=11836#p11836) so the PHP-FPM images used here won't build for arm64 / aarch64 architecture (I tried it, which is how I discovered this)

Could be more issues beyond this list specifically applicable to Warden and it's underlying dependencies, but my honest and blunt take is basically this: Docker Desktop literally just reached "GA" (whatever that means) only this past April. It was in tech preview starting Dec 2020, and that is hardly time to become stable. Developers that know they rely on Docker Desktop racing out to buy M1 macs, many before Docker Desktop was even out of tech preview, are not making a very wise choice IMO. There is a reason the first M1 models Apple has released are not super developer focused, it takes time (a lot of time) for an entire ecosystem to catch up, particularly with complicated things like emulation and virtualization.
Even with native arm64 images (that won't require QEMU emulation), there are "known issues" such as the following turning up in the release notes for Docker Desktop (this one is from June 6th):

On Apple Silicon in native arm64 containers, older versions of libssl in debian:buster, ubuntu:20.04 and centos:8 will segfault when connected to some TLS servers, for example curl https://dl.yarnpkg.com. The bug is fixed in newer versions of libssl in debian:bullseye, ubuntu:21.04 and fedora:35.

There is list of known issues (that I assume is kept current) here: https://docs.docker.com/docker-for-mac/apple-silicon/
An initial and first step here will be updating the image build system here to build and push multi-platform images for those where upstream dependencies exist to support it, while keeping the other image builds unchanged. This will take time to accomplish (and is something for which I also have no ETA as I cannot make it a priority at the moment)

Thank you so much @davidalger, for taking the time and effort for this detailed explanation of the state of Docker based Magento development in M1 Macs. This is the most helpful. It really gives a perfectly clear status of this.

This will take time to accomplish (and is something for which I also have no ETA as I cannot make it a priority at the moment)

Of course, I understand it will take a lot of time for full support. Thank you again for your work with Warden!

Elasticsearch publishes arm64 images (at least for later versions) but they use tags to denote this instead of multi-platform images as Docker Hub does, so ES specific build process changes will be needed to pull/build/push with both architectures.

Elasticsearch has multi-arch images in Docker Hub for versions >=7.8.0. Is this what we need? (ref: https://hub.docker.com/_/elasticsearch?tab=tags&page=1&ordering=name)

There are no arm64 images for MySQL, Mailhog, or the base image used for Magepack image builds

MariaDB is Magento supported, so can we switch to that? Also, we don't have any customization in any of our MariaDB Dockerfiles, so is there a reason we have custom builds for that? If it's better to use the base MariaDB image directly, can we?
MailHog hasn't been updated in over a year and here are our options

we contact its maintainer and check if it's on their roadmap (helps with our timelines)
if it's on their roadmap, we wait for them to push an arm build
if not

we use their Dockerfile and build it on our own for multi-arch considering its dependencies and publish it under the wardenenv Docker Hub namespace
we switch to https://hub.docker.com/r/sj26/mailcatcher which is both multi-arch and maintained. Relevant PR in @markshust's repo by me can be found here: https://github.com/markshust/docker-magento/pull/512/files. This is a proposal to switch MailHog with MailCatcher.

There is an open issue for Magepack's base image and I've checked in to see if a multi-arch image is in their plans.

@davidalger, the above are my thoughts on this and I'm happy to collaborate and contribute to this as required. Please let me know what you think, thanks!

Might also be an option to switch the Mailhog image to
https://hub.docker.com/r/cd2team/mailhog/tags?page=1&ordering=last_updated

Update
I have forked this repository and made it run natively on both Intel and Apple Silicon chips, making it multi-platform. You can find more info at https://github.com/drpayyne/warden-multi-arch. Currently, only the one mainstream version of each service is rebuilt and provided.
I have rebuilt all necessary Dockerfiles as multi-platform Docker images (linux/arm64, linux/amd64) and published them in GitHub Packages.
Warden services

I have re-used the MailHog Dockerfile and rebuilt it as a multi-platform image. Same for mhmailsend, which MailHog needs. Refer https://github.com/drpayyne/mhsendmail.
Dnsmasq and sshd are rebuilt as multi-platform images. Refer https://github.com/drpayyne/docker-sshd and https://github.com/drpayyne/docker-dnsmasq-multi-arch.

Magento 2 services

All PHP images have been switched to Fedora 34 from CentOS 8 after much efforts, as I tried to rebuild the entire PHP 7.4 binary and its extensions from Remi's repository for arm64 but was not successful as I don't have much experience in RPM building. Sorry! Refer https://github.com/drpayyne/docker-php.
The base images for Magepack (Chrome with Node & Puppeteer) is rebuilt as multi-platform images. Refer https://github.com/drpayyne/chrome.
Varnish 6.5 is rebuilt as a multi-platform image as Varnish now provides RPMs for both architectures.
Elasticsearch 7.9 is rebuilt as a multi-platform image.
Nginx 1.16 is rebuilt as a multi-platform image.
RabbitMQ 3.8 is used directly from DockerHub. (already provides multi-platform images)
All database containers now use MariaDB 10.4 directly from DockerHub. (already provides multi-platform images)
Redis 5.0 is used directly from DockerHub. (already provides multi-platform images)

cc/ @fooman @davidalger @amarmureanuarnia

@drpayyne That's exciting! I'm looking forward to getting an M1 Macbook Pro once they're released (hopefully later this year) and will look into your fork at that time.

The fork from @drpayyne works fine for except xdebug, but there is already a pull request. Would be nice if you'd can consider to add the fork as an m1 version for warden or so

@DavidLambauer Just merged and rebuilt the Docker images. Thank you!

Still valid, yes.

Maybe you want to have a look at https://github.com/davidalger/warden/pull/501.

All the magento commands in Warden are very, very slow on my M1 Pro and also the online store is slow. Do you know what could be the reason?

This project is not maintained anymore. Feel free to migrate to den --> https://github.com/swiftotter/den
den is a fork from warden, providing a faster, maintained version of warden!

You can also give https://github.com/rewardenv/reward a try. It's Warden rewritten in Golang.
Find the complete documentation here: https://rewardenv.readthedocs.io

This project is not maintained anymore. Feel free to migrate to den --> https://github.com/swiftotter/den
den is a fork from warden, providing a faster, maintained version of warden!

Hi. Is it safe to migrate from Warden https://github.com/drpayyne/warden-multi-arch to Den using standard method described in documentation? https://swiftotter.github.io/den/changelog.html

@pawel-snowdog You can use Warden 0.13 or greater and run it on an M1 mac. Den has since been deprecated in favor of Warden. Not all Den features have been ported over, but it's being worked on.

@bap14 thx for info. Is there php8.2 and OpenSearch support in Warden newest release?

Warden package versions are available to browse both on Docker Hub and on GitHub: https://github.com/orgs/wardenenv/packages?repo_name=images
Latest PHP: 8.2
Latest OpenSearch: 2.6
I check for newer versions of all needed softwares semi-often

@erikhansen great! Is there documentation how to migrate from https://github.com/drpayyne/warden-multi-arch to https://github.com/wardenenv/warden/ ?

Quick update - I've now archived the https://github.com/drpayyne/warden-multi-arch repository with a deprecation notice in favor of migrating back to this repository to avoid confusion.

@drpayyne Awesome.
Thanks for your early work in getting Apple Silicon compatibility—that enabled me to buy an M1X MacBook Pro a couple of years ago and enjoy the 2-4x M2 local development performance it offers over my Intel MacBook Pro.

Huge Appreciation for your work @drpayyne - I couldn't have lived without it ❤

Guys I need Your help with migration from https://github.com/drpayyne/warden-multi-arch to https://github.com/wardenenv/warden/ ? How to do it without loosing existing locals? Many thanks for your replies.

Thanks folks! Appreciate it. :) And thanks to you both back for the early testing and the continued support for Warden!

@pawel-snowdog

How to do it without loosing existing locals? Many thanks for your replies.

I did not have to do anything special when moving from https://github.com/drpayyne/warden-multi-arch to Warden, but YMMV. Summary of my steps:
warden svc down
# Shut down Docker Desktop (I'm using 4.10.0)

# Move warden to temp directory and then set reminder to delete this directory a few weeks later, once warden is still working
sudo mv /opt/warden /opt/warden_backup

brew install wardenenv/warden/warden

# Open Docker Desktop

warden svc up
warden env up


added dat.json url parser to clone command.

Pull request #845 was accidentally merged and had to be reverted.
I've added a dat.json url parser to the clone command as described in #639. dat clone /path/to/key, dat clone /path/to/dat.json, dat clone /path/to/key ./dirand dat clone ./path/to/dat.json ./dir should work as expected and clone into the target directory. If the target directory isn't specified the target directory defaults to ..
This will also likely solve issue #792.

@joehand just reopened PR with edits from maintainers. Will debug join.path now.

@joehand I just fixed the parser so that it opts.dir defaults to opts._[0] which means in terms of usage means that dat clone /path/to/dir is equivalent to dat clone /path/to/dir /path/to/dir.
It also constructs a directory name if only a file is given such that dat clone /path/to/json is equivalent to dat clone /path/to/dat.json /path/to/
While writing this I realized that passing a path for the first argument will overwrite the second argument. Pushing something now to fix this.

@joehand can you restart the build? I don't have the button on the top right. All tests including the ones you test added pass locally on my machine. I think only things that are left may be debugging a path.join call for windows and updating docs.

@joehand think we're ready to merge this and docs?

@joehand think we're ready to merge this and docs?

Sweet! So happy to have this in here, now we can make a real dat-git workflow =).
Thanks for your patience with my bad merging.

Woohoo! 🎉 👍 💯. Glad to have this merged. No problem with funky merging. My bad for not allowing maintainers.


[Part1] Partition and Sort Enforcement, PhysicalExpr enhancement

Which issue does this PR close?

Partially Closes #3854. This PR covers the PhysicalExpr related enhancement.
Rationale for this change

What changes are included in this PR?

Implement PartialEq<dyn Any> for PhysicalExpr
Add PhysicalExpr::children() and PhysicalExpr::new_with_children()
Add TreeNodeRewritable Trait for PhysicalExpr rewriting

Are there any user-facing changes?

@alamb @tustvold @yahoNanJing
Please help to review.

I plan to review this carefully tomorrow

@alamb Thanks

@alamb Could you please approve and merge the PR? Then I can work on the following parts.

Only a minor testing suggestion, but other than that at least a brief overview of the general logic on comparisons and utilities looks great to me.

No problems merging this in. The overall goal seems great to me, but not much time now to go over the code.

Will plan to merge this in tomorrow unless I hear otherwise -- if @mingmwang  hasn't had a chance, we can do the changes as a follow on PR

I am merging this PR in as it has already been around for a while and is blocking work. @mingmwang  can you please respond to @isidentical 's comment https://github.com/apache/arrow-datafusion/pull/3969#discussion_r1008281138 and submit another PR with additional tests, if appropriate?

I am merging this PR in as it has already been around for a while and is blocking work. @mingmwang can you please respond to @isidentical 's comment #3969 (comment) and submit another PR with additional tests, if appropriate?

@alamb @isidentical
Sure, will add one more UT in the following PR.


dependency caching enablement error

Hi all 👋
We tried to enable dependency caching of Ruby gems on my GitHub Actions CI workflow, but for some reason rake cannot be found when dependencies are restored in following runs. We were able to get around the issue by running bundle check --path vendor/bundle but we'd like to know why this was required.
I can see dependencies being restored here:
Cache Size: ~194 MB (203369864 B)
8
/bin/tar -xz -f /home/runner/work/_temp/26260154-8639-4d0c-9b0d-31d540b6cdd5/cache.tgz -C /home/runner/work/real-server/real-server/vendor/bundle
9
Cache restored from key: Linux-gem-0f38158bbccf6cf5370751f110b5fd9a39e49c5abd6d91a07a0b99d1825a9ae5

But in the next step rake isn't found:

Run bundle exec rake db:create db:schema:load --trace
8
Bundler::GemNotFound: Could not find rake-12.3.3 in any of the sources
9
bundler: failed to load command: rake (/home/runner/.rubies/ruby-2.5.7/bin/rake)
10
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/spec_set.rb:91:in `block in materialize'
11
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/spec_set.rb:85:in `map!'
12
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/spec_set.rb:85:in `materialize'
13
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/definition.rb:170:in `specs'
14
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/definition.rb:237:in `specs_for'
15
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/definition.rb:226:in `requested_specs'
16
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/runtime.rb:108:in `block in definition_method'
17
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/runtime.rb:20:in `setup'
18
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler.rb:107:in `setup'
19
/home/runner/.rubies/ruby-2.5.7/lib/ruby/gems/2.5.0/gems/bundler-1.17.3/lib/bundler/setup.rb:20:in `<top (required)>'
20
/home/runner/.rubies/ruby-2.5.7/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in `require'
21
/home/runner/.rubies/ruby-2.5.7/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in `require'
22
##[error]Process completed with exit code 1.

Any insight is appreciated 🙇♀

Thanks for your help @dhadka ✨  You're correct, the config path was not specified. I'll go ahead and close this out.


Add support for delayed Initiate

This change alters the way that startup occurs on child contexts whose parents are not yet started.  Formerly, invoking CoreContext::Initiate on a child context where Initiate was not called on the parent would result in recursive initiation of all parents up to the global context.  Now, the child will be transitioned into an initiated metastate where it is ready to run but not yet started.

Skipping this one for now due to a concern @gittyupagain expressed to me.


Creating child objects with non-unique URIs should be disallowed

When creating child objects, it is currently possible to create objects with non-unique URIs as follows.  (This issue does not appear to affect TopLevel objects in the Document)
>>> cd = ComponentDefinition('cd')
>>> cd.sequenceAnnotations.create('sa')
<sbol.sequenceannotation.SequenceAnnotation object at 0x111bdf5d0>
>>> cd.sequenceAnnotations.create('sa')
<sbol.sequenceannotation.SequenceAnnotation object at 0x111bdf610>
>>> for ann in cd.sequenceAnnotations:
...     print(ann)
...
http://examples.org/ComponentDefinition/cd/sa/1
http://examples.org/ComponentDefinition/cd/sa/1

This works when the ComponentDefinition is in a Document, and fails when the ComponentDefinition is not in a Document. Add test cases for both.


Remove/Reduce margin between grid items

Is there any way that I can completely remove/reduce the margin between each grid item?

Yes, the margin prop. Please read the documentation.
On Jun 9, 2016 12:56 AM, "sudheerjami"<EMAIL_ADDRESS>wrote:

Is there any way that I can completely remove/reduce the margin between
each grid item?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/STRML/react-grid-layout/issues/259, or mute the
thread
https://github.com/notifications/unsubscribe/ABJFP-CbVLjCViDzpTQgbQl-dNQE-khrks5qJ6sUgaJpZM4Ixpyy
.

Thank you very much. BTW, Great work!!!


Add dbVersion to introspection panic report & migrate

Sure I think it will be best to wait for https://github.com/prisma/prisma/issues/3788 first anyway :)

After it's done it will unblock https://github.com/prisma/prisma/issues/3486

@pantharshit00 this will be merged soon after a PR review, @pantharshit00 I think it's not a problem to merge this before you actually implement it (data will be missing in the reporting and will appear after you implement it, only for the issues reported after you implemented)

@Jolg42 Backend change for this was implemented. This is ready to go from my end


there is a problem with launching the web interface.

Good afternoon. I have a NAS synology DS718+.
I installed docker-handbrake.
installed, launched, but there is no access to the web interface. What could be the problem?
NAS is installed in a local network and to come on the web interface I try to come from the computer which is in the same local network.

What is the configuration of the container ?  Could you provide the output of docker inspect <container name>?

I took screenshots and uploaded them to the cloud, link below. Please look.
https://yadi.sk/d/M0QY83po3WgcU9

According to the docker inspect output, the network ports are not mapped.  Is it the case?  You should make sure that at least port 5800 is mapped.

Closing this issue.  Please re-open if needed.


Ensure None values don't get included in the images

An error occurs when the bigthumbhd property cannot be found on the video object (https://github.com/mopidy/mopidy-youtube/blob/861a71141491d0eb3a54731a71857eb5ed78a0a2/mopidy_youtube/backend.py#L75)
This should fixes the problem for me.

Thanks for the fix! Sorry I took so long to merge it.


Add copy directory support for other OSs (Windows for example)

Hello, I add Go directory copy functions for support Windows OS (and others).

Sorry, without copyright on this I can't merge it. Please reopen if you can find out about that.


pre-trained models

Hi, are the pre-trained models released here ready to be used for any customised content/style image pairs? Thanks!

Yes, all the released models are designed for arbitrary style transfer.

Hi @JarrentWu1031, thanks for the greate job and share all the pretrained models and codes. Does the only required model for training is vgg_normalized.pth?  Could you share some informations on how to train this encoder?

Yes, the only pre-trained model involved here is the vgg model. It is trained on ImageNet for classification. If you are interested, you could train your own encoder from scratch. You could refer to the original paper of VGG.

Hi @JarrentWu1031 , I have tried to retrain the encoder, but the result looks not good. Do you have some recommanded encoder codes for this? thanks.

In this paper, we didn't train our own encoder. Instead we use the pre-trained model from 'https://drive.google.com/file/d/1EpkBA2K2eYILDSyPTt0fztz59UjAIpZU/view?usp=sharing' as previous works do. If you really want to   retrain your own encoder, you could google like 'VGG ImageNet classification'. I think it's ok for you to use the pre-trained model as well. Our work aims to train the SCT module and decoder, not including the encoder (we assume the extracted features are meaningful).

Hi @JarrentWu1031  I retrained the vgg net with pytorch on imagenet classification task, and the model converged. But it does not work for style transfer. I dumped the vgg_normalised.pt's weights, and its first conv weights is:

0.weight
0.bias

0
-103.939

0
-116.779

255
-123.68

0

255

0

255

0

0

Do you know why?

Yes, I understand the whole pipeline, and I am trying to train a light-weighted network to get real-time inference. But I found that the vgg based encoder took much time, that why I am trying to retrain the encoder.

Well, that is strange. It seems the provided VGG model shares the same weights with yours. Have you fix the parameters of your pre-trained encoder during style transfer training?

Yes, I have fixed the encoder's parameters. Seems the provided vgg's weights have be normalized by the imagenet dataset. I found that lots of arbitrary style transfer methodologies used this normalized vgg weights.


Initial Solution Design - Type of Model

Detail whether you will use a pre-trained model, fine-tune it, or train a new one, justifying your decision.

@Gungwah

Assigned to @Gungwah.
It is completed


Add thousand spec

Hello :)
I'd like to contribute something I've called "thousand spec" that tests real world performance of executing specs of different sizes, from .5ms to 10ms. Tests spawn external processes so we're 100% sure whole thing is correctly measured.
I hope in the future this test will be expanded to include more real-world code, but I think for now is good enough and does few important things:

It is a regression test so rspec real-world performance isn't slower than its main competitor
Tells rspec how much overhead rspec currently have compared to its main competitor

It turns out RSpec is just max 1.1 (normal tests) - 1.6 (micro tests) times slower
Let's improve this 🔥

Oh and it'll be worth only running this on later Rubies, I'm definitely not interested in benchmarking 1.8.7 support between the two :joy:

I'm on the fence if this is worthwhile including in our specs, yes I'd like to not introduce speed regressions but I'm not overly bothered about competing with minitest here, the two libraries have different goals and techniques.

Still there's often argument that one should select minitest because rspec is slower (e.g. http://ozim.eu/why-do-i-prefer-minitest-than-rspec/). I think this is an opportunity to show it's not the case and have nice proof. With enough effort rspec could get below minitest (from the tip of my mind, it could e.g. load specs in separate threads, so while one test is doing sleep(), other could be requiring)

Still there's often argument that one should select minitest because rspec is slower (e.g. http://ozim.eu/why-do-i-prefer-minitest-than-rspec/). I think this is an opportunity to show it's not the case and have nice proof. With enough effort rspec could get below minitest (from the tip of my mind, it could e.g. load specs in separate threads, so while one test is doing sleep(), other could be requiring)

Its great you feel this way, perhaps a blog post with some benchmarks and examples would be more instructive? We will always welcome performance enhancing PRs, and I wouldn't be against adding specs to ensure our performance doesn't get worse, but comparing us to minitest is subjective, and not a fair test.

I think comparing to minitest can be useful because without it there's no point of reference to tell whether rspec is fast or slow. I don't mean to shame anyone, I like minitest as well :)
Say I added benchmarks without comparing them to minitest, they would help preserving the performance, but they woudn't tell whether rspec performance needs more optimization or not (and whether it can be optimized and by how much).
If you feel strongly about it I could provide other points of reference, e.g. 1000 tests inside one file vs 1000 tests in 100 files, or 1000 tests in raw ruby vs 1000 tests in rspec.

Say I added benchmarks without comparing them to minitest, they would help preserving the performance, but they woudn't tell whether rspec performance needs more optimization or not (and whether it can be optimized and by how much).

Comparing to minitest just tells us comparative performance, it doesn't tell us that RSpec can be made faster, they're mutually exclusive statistics.

Okay I won't push it. I have two other suggestions instead of comparing to minitest

1000 same tests in raw ruby vs 1000 tests in rspec (tells how much overhead rspec has compared to just running them fastest way possible in pure ruby)
1000 tests inside one file vs 1000 tests in 100 files (tells how efficient rspec is at loading spec files)

Are they fine?

I would be much happier with that comparison, staying within a certain benchmark of Ruby.

@JonRowe I've applied all your suggestion and changed minitest to Test::Unit, but TBH I still think minitest was better reference as it's faster than Test::Unit

Ah that wasn't what I meant at all...

Hmm, that's no problem, but I no longer know what template should I use. Could you tell the example single test file I should prepare for benchmarking against ruby?

Why this benchmark could not live into a new repo? Something that @sheerun runs?
Thanks a lot for this work @sheerun

Feel free to close


We Fly Digital

Summary
Basics

You should follow the layout of the provided design. You should change only the titles, descriptions, and photos - in order to create a website about something other than motorcycles.
Select a theme for your website - is it going to be a website for booking doctor appointments, booking online classes, or something else?

Features
Core features - for teams of each size

The user logs in to the website, only by typing the username (a proper authenticated login is a requirement if your group is made of 5 people).

In the navigation panel, the user can see links to:

Motorcycles/doctors/classes/items that you selected as a theme.
"Reserve" form.
"My reservations".
"Add motorcycle/doctor/class/item that you selected as a theme" (the link is visible to everybody).
"Delete motorcycle/doctor/class/item that you selected as a theme" (the link is visible to everybody).

On the main page, the user can see a list of motorcycles/doctors/classes/items that you selected as a theme.

When the user selects a specific item, they can see the details page with its full description (skip the "Rotate image" button).

In the details page, the user can click the "Reserve" button (in the design you can see the "Configure" button - please replace it with the "Reserve" button).

When the user clicks the "Add item" link in the navigation panel they can see a form for adding a new item.

Make the app responsive, creating both mobile and desktop versions.

If your team has 3-4 members these are the required features; otherwise, consider them as optional features.

When the user clicks the "Delete item" link in the navigation panel they can see a list of all items with title and "Delete" button.

When the user clicks the "Delete" button, the selected item is marked as removed and does not show on the main list anymore.

To reserve an appointment, the user has to select a date and city (username and selected item are autofilled).

Use the design based on the "Book a vespa test-ride" and add all necessary inputs.
The user can also access the "Reserve" page from the navigation panel. In that case only username is autofilled.

When the user clicks the "My reservations" link in the navigation panel they can see a list of their reservations (with information about item name, date and city).
Add full documentation for your API.

If your team has 5 members these are the required features; otherwise, consider them as optional features.

Implement proper user authentication from the front-end to the server.
Make sure that the "Add item" and "Delete item" links are accessible only by users who are admins.

Technical set up

Set up the repository/repositories on GitHub and use Gitflow.
You should use Postgres as your database
Use Rails to create backend API.
Use React & Redux to create frontend UI.
You can choose if you want to set up your project as two separate apps or as one.
The Creative Commons license of the design requires that you give appropriate credit to the author. Therefore, you must do it in the README of your project.

@Meltrust & @mcrd25 Thank you both for all your suggestions.


Regression in exported pages for chalkit.goToPage

The chalkit API to change pages works in view, works in preview but does not work once exported. I tested starting from scratch with this code on my trigger

It's done.
See branch "issue_327"


Add a new Device backed by flutter_tester.

What's the purpose of this device?

Three currently:

it's used for integration testing flutter_tools, to catch regressions in hot reload and debugging (https://github.com/flutter/flutter/tree/master/packages/flutter_tools/test/integration)
it's used for integration testing of IDEs, so they can run through full tests in CI systems w/o having to have native toolchains and emulators installed. VS Code in using it now, and we plan to do the same for IntelliJ
we use it as a headless device to enable previewing individual widgets in the Flutter Outline view (https://medium.com/flutter-io/flutter-outline-hot-reload-and-the-implementation-of-a-live-widget-preview-69abd39aa3bb)


Support training on big datasets

Subsumes #6836 as a problem-oriented issue

Description of Problem:

With big datasets we run into memory issues

multiwoz: 113,000 conversation turns, 8500 e2e stories
ubuntu: 470,000 conversation turns, 75000 e2e stories
advising: 269,000 conversation turns, 24500 e2e stories

Current Status
There have been several attempts to tackle this issue:

training on chunks for NLU #8306 (ideas doc)
streamed training for NLU #8518
training on chunks for core branch
there have been improvements in the recent Rasa 3.0 prototypes in how tracker stores are featurized (benchmarking still outstanding #8593 )

These approaches haven't been finished yet, or haven't directly addressed the biggest bottleneck right now, which seems to be core training. According to this forum post 400 stories lead to out of memory for 12GB (GPU?) memory. Also, 400-500 stories seems to have been max for research so far, but potentially that wasn't with maxed out memory (slack thread). Part of #8593 is figuring out how much memory is consumed where in the core e2e training. This will help us decide which parts of the existing proposals to use to tackle this issue.
Definition of Done:
End2end training for the following corpora can be run on one of our cloud gpu servers:

[ ] multiwoz
[ ] Ubuntu
[ ] advising

We are also working on #8734 as part of this as well


IT-1710: GH deployer user and role

This PR creates a user and a role to be used by GH workflow for portal deployment (sageit account)

This is superseded by the GH OIDC in infra.


Tensor needs absolute url prop

Codecov Report

Merging #149 into master will increase coverage by 0.48%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #149      +/-   ##
==========================================
+ Coverage   82.38%   82.87%   +0.48%
==========================================
  Files          81       81
  Lines        2651     2633      -18
  Branches      546      542       -4
==========================================
- Hits         2184     2182       -2
+ Misses        460      444      -16
  Partials        7        7

Impacted Files
Coverage Δ

src/container/NGLContainer.tsx
54.54% <ø> (ø)
:arrow_up:

src/container/PredictedContactMapContainer.tsx
0% <ø> (ø)
:arrow_up:

src/container/BioblocksVisualization.tsx
72.5% <ø> (+13.24%)
:arrow_up:

src/reducer/SpringReducer.ts
100% <ø> (ø)
:arrow_up:

src/reducer/ValueReducer.ts
100% <ø> (ø)
:arrow_up:

src/reducer/DataReducer.ts
100% <ø> (ø)
:arrow_up:

src/container/TensorTContainer.tsx
76.31% <ø> (ø)
:arrow_up:

src/container/AnatomogramContainer.tsx
44.94% <ø> (+0.98%)
:arrow_up:

src/container/SpringContainer.tsx
60% <ø> (+5%)
:arrow_up:

... and 5 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e50b952...2edb5c8. Read the comment docs.

 Full Implementation of react - server -mongo/filesystem


apply Network Configuration has downtime only with dev sku

The process of applying Network Configuration might take 15 to 45 minutes or more. The Developer SKU has downtime during the process. The Basic and higher SKUs don't have downtime during the process.

@SherrySahni : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#label:"aq-pr-triaged"

@SherrySahni : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


Add favicon to docs

Description
Add favicon to docs
More details in #687
Motivation and Context
Add favicon to docs for better documentation looking
Types of changes
What types of changes does your code introduce? Put an x in all the boxes that apply:

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds core functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[x] Documentation (update in the documentation)
[ ] Example (update in the folder of example)

Checklist
Go over all the following points, and put an x in all the boxes that apply.
If you are unsure about any of these, don't hesitate to ask. We are here to help!

[x] I have read the CONTRIBUTION guide. (required)
[x] My change requires a change to the documentation.
[ ] I have updated the tests accordingly. (required for a bug fix or a new feature)
[ ] I have updated the documentation accordingly.

LGTM!


Habit streak is not nullified when no status is submitted

I was trying to fix this using cron jobs (checking everyday at noon if we need to update status), but it gets nasty when using with Engine, so right now when you are updating your habit and you didn't last time, streak will be 1.
Little bit ugly, but works.


Enable updater v2

Enables updater (component) in keybase install (and keybase uninstall)
Adds KBUpdateService to KeybaseInstaller.app to make sure updater is installed
Removes update checker from service main

After this goes out, I'll can remove the rest of the v1 updater code.
This is intended to go out in a few days, when the stagger stuff is ready.
@keybase/updater-hackers

how do we test this

retest this please

I can make a build/dmg of this branch.. after copying to /Applications and running Keybase.app.

keybase launchd list shows Updater (v2)
launchctl list | grep keybase shows keybase.updater
~/Library/Logs/keybase.updater.log is present and looks ok

http://prerelease-test.keybase.io.s3.amazonaws.com/darwin/Keybase-1.0.16-20160609183306%2B732354d.dmg

I did a clean install test with new dmg

LGTM, just one small question.


Drizzle studio in table editor crashed when toggle columns

Steps to reproduce

Log in to https://console.neon.tech/
Go to table editor
Try to toggle some column

Expected result
Column toggled
Actual result
Crash with report
Environment
https://console.neon.tech/
Logs, links

bug-report.zip
The problem disappears only after clearing the application data

Hi - this github project is for the open source neon components.
Please open a support ticket if you're on a paid plan, or otherwise visit Discord (links on https://neon.tech/docs/introduction/support)


fix(TDI-45328): [CVE] jetty and jetty-util: Directory Traversal in Talend/components (master)

What is the current behavior? (You can also link to an open issue here)
https://jira.talendforge.org/browse/TDI-45328
What is the new behavior?
https://jira.talendforge.org/browse/TDI-45328
Please check if the PR fulfills these requirements

[x] The commit message follows Talend standard
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features) ?
[ ] The code coverage on new code >75%
[ ] The new code does not introduce new technical issues (sonar / eslint)

What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build / CI related changes
[ ] Other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[x] No

Pull request test result: failure :x:

Pull request test result: failure :x:


MB-10354 List external vendor shipments last

Jira ticket for this change
Summary
This PR puts external vendor shipments at the end of the list of shipments on the move details page. It also makes HHG shipment cards collapsible.
Setup to Run Your Code

💻 You will need to use three separate terminals to test this locally.
Terminal 1
Start the Storybook locally.
make storybook

Terminal 2
Start the UI locally.
make client_run

Terminal 3
Start the Go server locally.
make server_run

Additional steps

Access the office app
Login as a TOO and look at move HNTMIS
Verify that the HHG shipment expands/collapses
Edit the HHG shipment to use an external vender
When you're back on the Move details page, verify that the HHG shipment is now at the end

Verification Steps for Author
These are to be checked by the author.

[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

Verification Steps for Reviewers
These are to be checked by a reviewer.

Frontend

[ ] User facing changes have been reviewed by design.
[ ] There are no aXe warnings for UI.
[ ] This works in Supported Browsers and their phone views (Chrome, Firefox, IE, Edge).
[ ] There are no new console errors in the browser devtools
[ ] There are no new console errors in the test output

Backend

[ ] Code follows the guidelines for Logging
[ ] The requirements listed in Querying the Database Safely have been satisfied.

Warnings

:warning:
This PR does not include changes to unit tests, even though it affects app code.

Messages

:book:
:link: MB-10354

  Generated by :no_entry_sign: dangerJS against f9d0bc457e805c06495affebcdeb88bab96f9bd3


Update HLAPI docs.

Updating docs after adding set selection API to HLAPIs.
Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] I have signed the Adobe Open Source CLA.
[ ] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

Aren't the docs moved to the other repo now?
They live here now:
https://github.com/AdobeDocs/express-add-ons-docs/tree/main/src/pages/references/authoring/editor

@nimitz92 yep, it looks like this is superseded by Priyanshu's newer PR into the newer repo: https://github.com/AdobeDocs/express-add-ons-docs/pull/26
Closing this one to avoid confusion.  @hollyschinsky should we just lock or archive this entire repo now?


More FP maths errors

Following the previous advice I switched to using u64::max as the max_quote_qty in new_order::params.
However now there's some actual bad maths occurring. Not money losing but definitely incorrect and frustrating.
    Program log: params: Params { max_base_qty:<PHONE_NUMBER>00000, max_quote_qty:<PHONE_NUMBER>3709551615, limit_price: 858993400, side: Ask, match_limit: 1, callback_info: [41, 86, 95, 46, 36, 249, 213, 204, 152, 102, 187, 132, 192, 124, 21, 22, 110, 98, 167, 177, 185, 5, 92, 244, 250, 77, 243, 219, 45, 249, 158, 178], post_only: true, post_allowed: true, self_trade_behavior: AbortTransaction }
    Program log: u64::max as fp32:<PHONE_NUMBER>4264337589248983040
    Program log: limit price in fp32: 858993400
    Program log: divided values, before going back to u64:<PHONE_NUMBER>5099794235
    Program log: base_qty_to_post:<PHONE_NUMBER>155
    Program log: order summary OrderSummary { posted_order_id: Some(15845631410805618355103334400), total_base_qty:<PHONE_NUMBER>155, total_quote_qty:<PHONE_NUMBER>614, total_base_qty_posted:<PHONE_NUMBER>155 }
    Program log: max base qty<PHONE_NUMBER>00000

The problem is stemming from these lines https://github.com/Bonfida/agnostic-orderbook/blob/e37a30793f58029f1a89e1efbb7a5ea2533bf376/program/src/orderbook.rs#L257-L260
In plain language

a post order to sell 100 million tokens (6 decimal places) is being made
the asking price is 0.2
the posted order is for only 6 million tokens

this is because fp32_div(u64::MAX / (0.2 as FP32 % 0.001 (the tick size))) = 6.35 million which is lower than 100 million tokens, hence it's chosen as the base_qty_to_post

What am I doing wrong here?
(and yes this is using the checked maths of bonfida utils, not the old unchecked FP32 utils functions which were quietly deleted)

Maybe this is a loss of funds thing 🤷 ? The fact it returns the value of 6 million could be because of an overflow when casting down from u128 to u64. This was mentioned in the neodyme article https://blog.neodyme.io/posts/solana_common_pitfalls#integer-overflow-%26-underflow . Instead of casting as you should always try to use try_from.

I originally did not put checked_math in the fp32 utils for divisions because I was assuming b_fp32 > 1 << 32 but in this case that would lead to an overflow. I added the checks https://github.com/Bonfida/bonfida-utils/pull/13
In your case the overflow was happening because b_fp32. < 1 << 32 and you were using u64::MAX. You can just use u64::MAX / 10 and it should work fine.

I was assuming `b_fp32 > 1 << 32`

Sorry but isn't the point of using fixed point to have decimals?


Invalid path to node

The path to node is not correct, see https://github.com/bbtsoftware/docker-azure-devops-agent/issues/8.

@x-jokay Is this in reference to an example in a specific topic, could you please indicate which so that we can triage?

@x-jokay I see you filed a pull request related to this feedback- thank you.


Quantization is no longer possible in version 0.0.12

Quantization is no longer possible in 0.0.12 version,
but quantization is possible in 0.0.11 version.
PS C:\exllamav2-0.0.12> python convert.py  -i mnt/models/TinyLlama-1.1B-python-v0.1/ -o mnt/models/temp/ -cf mnt/models/TinyLlama-1.1B-python-v0.1-4.0bpw-exl2/ -b 4.0
-- Resuming job
!! Note: Overriding options with settings from existing job
-- Input: mnt/models/TinyLlama-1.1B-python-v0.1/
-- Output: mnt/models/temp/
-- Using default calibration dataset
-- Target bits per weight: 4.0 (decoder), 6 (head)
-- Max shard size: 8192 MB
-- RoPE scale: 1.00
-- RoPE alpha: 1.00
-- Full model will be compiled to: mnt/models/TinyLlama-1.1B-python-v0.1-4.0bpw-exl2/
Traceback (most recent call last):
File "C:\exllamav2-0.0.12\convert.py", line 185, in
model.load(lazy = True)
File "C:\exllamav2-0.0.12\exllamav2\model.py", line 248, in load
for item in f: return item
File "C:\exllamav2-0.0.12\exllamav2\model.py", line 276, in load_gen
cleanup_stfiles()
File "C:\exllamav2-0.0.12\exllamav2\fasttensors.py", line 30, in cleanup_stfiles
ext_c.safetensors_free_pinned_buffer()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'exllamav2_ext' has no attribute 'safetensors_free_pinned_buffer'
The way I quantized is the same for both versions.
OS：WIN10
CPU：Ryzen 7 5700G
GPU：RTX4070 12GB
RAM ：32GB

Do you still have v0.0.11 installed?
pip show exllamav2

Thank you
pip uninstall exllamav2
pip install exllamav2
The 0.0.12 version is now installed correctly.
and it started working correctly.


Presenter mode inaccessible in Windows

In older versions of MDX Deck I used /?mode=presenter#0 to get into presenter mode on Windows, now that's not an option and there's no details on how to get into it on other platforms other than macOS.
Alt+p in windows is used to pin a browser tab
Alt+Shift+p goes into a stacked mode
Ctrl+p is to print

I face the same issue in Linux Mint. Is there are workaround?


Fix missing holes in the block GraphQL endpoint

There are a few pieces of the block missing from the GraphQL endpoint. Specifically we need to add support for aux_hash and pending_coinbase_aux substructures.

Also body_reference


unable to call "samtools"

Hello,
I am trying to run fragCounter to generate one of the required input files for JaBbA, i.e. coverage.txt.
I was able to install it successfully (I think), and tried to run it on your test data:
> ./bin/fragCounter-master/frag -b ./bin/fragCounter-master/inst/extdata/chr21.bam -d ./bin/fragCounter-master/inst/extdata/gcMAP21/ -w 200
One of the output messages was the following, which indicates that it cannot call the samtools:
Calling samtools view  -f 0x02 -F 0x10 ./bin/fragCounter-master/inst/extdata/chr21.bam -q 1 | cut -f "3,4,9"
sh: samtools: command not found

My samtools has indeed been installed, and is aliased in my bashrc file as below:
> which samtools
alias samtools='/user/bin/linux-x86_64/samtools-0.1.17/samtools'
	/user/bin/linux-x86_64/samtools-0.1.17/samtools

Would you be able to tell me what I need to do (e.g. modify in your code) in order for fragCounter to recognize my samtools executable?
Thanks very much for your help.

I don't think aliases get expanded in non interactive shell sessions
You should instead put the samtools executable in the PATH var
On Mon, Aug 23, 2021 at 8:12 PM ehjChun @.***> wrote:

Hello,
I am trying to run fragCounter to generate one of the required input files
for JaBbA, i.e. coverage.txt.
I was able to install it successfully (I think), and tried to run it on
your test data:

./bin/fragCounter-master/frag -b
./bin/fragCounter-master/inst/extdata/chr21.bam -d
./bin/fragCounter-master/inst/extdata/gcMAP21/ -w 200

One of the output messages was the following, which indicates that it
cannot call the samtools:
Calling samtools view  -f 0x02 -F 0x10 ./bin/fragCounter-master/inst/extdata/chr21.bam -q 1 | cut -f "3,4,9"
sh: samtools: command not found
My samtools has indeed been installed, and is aliased in my bashrc file as
below:

which samtools
alias samtools='/user/bin/linux-x86_64/samtools-0.1.17/samtools'
/user/bin/linux-x86_64/samtools-0.1.17/samtools

Would you be able to tell me what I need to do (e.g. modify in your code)
in order for fragCounter to recognize my samtools executable?
Thanks very much for your help.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mskilab/fragCounter/issues/14, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC73JELKZYDSUXXG6OVMUETT6LPYVANCNFSM5CVWCSTQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.

Ah, that indeed solved the problem - Thank you!


[SYSTEMML-1665] Add MNIST LeNet nn example to MLContext Guide

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1527/

Sounds good. Thanks for reviewing.

Refer to this link for build results (access rights to CI server needed):
https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1573/