Failed at the<EMAIL_ADDRESS>serve script 'serve ./ -p 12580'

17 error Linux 3.13.0-32-generic
18 error argv "/opt/node/bin/node" "/opt/node/lib/node_modules/cnpm/node_modules/.bin/npm" "--userconfig=/root/.cnpmrc" "--disturl=https://npm.taobao.org/mirrors/node" "--registry=https://registry.npm.taobao.org" "run" "serve"
19 error node v6.0.0
20 error npm  v3.10.9
21 error code ELIFECYCLE
22 error<EMAIL_ADDRESS>serve: serve ./ -p 12580
22 error Exit status 1
23 error Failed at the<EMAIL_ADDRESS>serve script 'serve ./ -p 12580'.
23 error Make sure you have the latest version of node.js and npm installed.
23 error If you do, this is most likely a problem with the weex package,
23 error not with npm itself.
23 error Tell the author that this fails on your system:
23 error     serve ./ -p 12580
23 error You can get information on how to open an issue for this project with:
23 error     npm bugs weex
23 error Or if that isn't available, you can get their info via:
23 error     npm owner ls weex
23 error There is likely additional logging output above.
24 verbose exit [ 1, true ]
在./start 后报错，显示Failed at the<EMAIL_ADDRESS>serve script 'serve ./ -p 12580'. 有遇到这种问题的小伙伴么，或者知道这个 'serve ./ -p 12580'在哪
（when i was running ./start ,there was a err in my console，anyone konw what hapend? i think  'serve ./ -p 12580' something wrong ,but i dont konw how to fix it）

端口好被占用，解决方法有2种
1.修改端口好，在package文件里
2.删除本机本占用的端口号12580的进程

确实是端口得占用了，我用的是ubuntu14.04  （the port 12580 already used）
解决办法：netstat -ap | grep 12580   ,查看pid号 ，然后 kill pid
再次运行 ./start

It seems that the issue has been resolved. It can be reopened if the author finds some new problems about this issue.


Update Upgrade-Assistant to prefer non-preview versions of MSBuild

This works around issues like dotnet/msbuild#6377


Mommy forgot a possessive marker~

There was a missing 's in one of the recently introduced messages.

mommy's so proud of you~


HdfsUtils using kerberos

Description
Sparta's Kerberos Integration.
Now the config has two new variables:

principalName
keytabPath

Coverage decreased (-0.2%) to 53.153% when pulling cb8a5339767e39d338431ad1cf0048ae7c4ccde8 on feature/kerberos-integration into 5edcb8cd8184cd15ed532031fded95ca80f9b70d on master.

Coverage decreased (-0.1%) to 53.176% when pulling 5e87fe05890e232c7d120314ae6a135a728f3889 on feature/kerberos-integration into 5edcb8cd8184cd15ed532031fded95ca80f9b70d on master.

:shipit:

A job will handle this PR ASAP on Jenkins

Rebase && testing in progress


Remove polymorphic fields from bad rows schemas

Some of the bad rows schemas contain "polymorphic" fields, e.g. the field value can be an object or a string, depending on the context. This causes problems for querying the badrows in BigQuery, where fields must have a single well-defined type.
The schemas should be simplified so that each field has only one type.
Here is a list of the affected fields:

Enrichment failures:  data.failure.message.error
Loader iglu error: data.failure.dataReports.targets
Loader recovery error: data.failure.error.location
Schema violations: data.failure.messages.error
Tracker protocol violations: data.failure.messages.error

This also caused problems in Elasticsearch and we needed to add some code in ES loader to handle the issue.

This should be accompanied by a property-based test that in a particular release of snowplow-badrows no two instances can have properties with different types.


Update rlp to v0.5.2

update rlp to v0.5.2
make clippy happy

@sorpaas PTAL, the reason I didn't also update ethereum-types to the latest version in this PR is because I thought maybe we could release a new version v0.12.1 of the ethereum crate firstly.

@sorpaas PTAL, the reason I didn't update ethereum-types version in this PR is because I thought maybe we could release a new version v0.13.0 of the ethereum crate firstly. (prepare for new evm and frontier version?)
I plan to upgrade ethereum-types to the latest in the next release v0.14, maybe v0.13 can also include #44?

Oops, it seems evm v0.36.0 has been released.
Maybe we could release ethereum v0.13 firstly, and then release evm v0.36.1 and yank evm v0.36.0 :confused:


DBeaver loses control over connection status

System information:

Operating system (distribution) and version: Ubuntu 18.04.3
DBeaver version: 6.1.4
Additional extensions: none

Connection specification:

Database name and version: MySQL 5.7.27 on Ubuntu server 16.04.1
Driver name: MySQL
Do you use tunnels or proxies (SSH, SOCKS, etc)? No

Describe the problem you're observing:
As soon as I connect to my remote MySQL db all operations are executed quickly. Everyting works fine while I keep interacting with DBeaver. But if I leave the UI for a short time and (for example) read an email, when I return to DBeaver I'm no longer able to do anything. Every task takes forever, there is no way to cancel any pending task and the only way to let DBeaver to work again is to kill the process and restart it. Hitting the "Cancel" button under the "Fetch table data" for example, or hitting the "Stop" button in the "Background tasks" view, this simply does nothing but change the button status to "Disabled" so that it can no longer be clicked. This makes DBeaver unuseful.
I tried to change some connections driver parameters before posting this issue:

Change the connectionTimeout parameter to 0
changed the interactiveClient to true

Steps to reproduce, if exist:
As above
Include any warning/errors/backtraces from the logs

hi @zazy is it still actual?

Hi @uslss I'm now on 7.0.3 and I no longer have this bug. Feel free to close this. Thank you.


multi-pipelines: origin needs to be factored into freight id

I set up two warehouses today where both looked for manifests in the same repo -- one using includePaths: [microservice-a] and the other using includePaths: [microservice-b].
Because the most recent commit had changes to both paths (it was an initial commit), both warehouses calculated the same Freight name and only one piece of Freight was produced. That piece of Freight had origin: {kind: Warehouse, name: microservice-a}.
The result is that Stages requesting Freight from origin: {kind: Warehouse, name: microservice-b} could not have that request fulfilled.
If we factor origin into each piece of Freight's deterministically calculated name, these conflicts will not occur.
cc @hiddeco for a sanity check.

For the record: I think your reasoning adds up here.
I did wonder for a bit if there are any potential downsides of the "deduplication" not happening (i.e. two Warehouses producing the same Freight because they ship the same items), but I think we are at a point where it has become clear that Freight is unique to its origin, and not necessarily just the contents.

This was fixed in #2241, but remained open because the feature branch its in has not been merged to main yet.
#1680 is the epic that we'll close when that happens.
I think we can safely close this as completed.


can't require(mxnet) --with CPU

For bugs or installation issues, please provide the following information.
The more information you provide, the more likely people will be able to help you.
Environment info
Operating System:windows 10
Compiler:R studio  R version 3.3.1
Package used (Python/R/Scala/Julia):R
MXNet version:don't know.I just use the command in R studio.
install.packages("drat", repos="https://cran.rstudio.com")
drat:::addRepo("dmlc")
install.packages("mxnet")
Or if installed from source:
MXNet commit hash (git rev-parse HEAD):
If you are using python package, please provide
Python version and distribution:
If you are using R package, please provide
R sessionInfo():
Error Message:
载入需要的程辑包：mxnet
Error : 'namespace:DiagrammeR'没有出口‘combine_edges’这个对象
Minimum reproducible example
if you are using your own code, please provide a short script that reproduces the error.
Steps to reproduce
set up:
install.packages("drat", repos="https://cran.rstudio.com")
drat:::addRepo("dmlc")
install.packages("mxnet")
require:
require(mxnet) or library(mxnet)
What have you tried to solve it?
1.install.packages add a parameter,dependency = TRUE
2.search with google,can't find answer either.
3.I try to download the mxnet package,and install the local file.It doesn't work either

The same with https://github.com/dmlc/mxnet/issues/4574

thanks so much ,when I use your advice in #4574. install DiagrammeR. It does work.!

require(devtools)
install_version("DiagrammeR", version = "0.8.1", repos = "http://cran.us.r-project.org")

This has been fixed. Feel free to reopen if necessary.


Correction for raw affiliation Molecular Structure Division, MRC National Institute for Medical Research, The Ridgeway, Mill Hill, London NW7 1AA, UK.

Correction needed for raw affiliation Molecular Structure Division, MRC National Institute for Medical Research, The Ridgeway, Mill Hill, London NW7 1AA, UK.
raw_affiliation_name: Molecular Structure Division, MRC National Institute for Medical Research, The Ridgeway, Mill Hill, London NW7 1AA, UK.
new_rors:
previous_rors: 04tnbqb63
works_examples: W2072253906;W2077269911;W2024145718;W1975060079;W2026387680
contact: 292c29b2c004380d805daabbdc6b0c5f:5bcbed921fc5cbca0bad0c74daa9808897532bab @ crick.ac.uk

This issue was accepted and ingested by the OpenAlex team on 2024-10-10. The new affiliations should be visible within the next 7 days.


Breaks when changing multiple values (due to non-deterministic behaviour)

Inside whatever non-deterministic magic is happening with setting a new object on yawn.json, if the whole object is replaced with more than one change, that cascades into causing miscellaneous parser errors to be thrown from yaml-js.
I only managed to find out why this was happening while trying to comment and uncomment huge swaths of my Yaml data files. I noticed when there was just one value changed, no errors were thrown, but if multiple values changed at the same time, yaml-js cried bloody murder with all sorts of ParserError.YAMLError errors, such as expected <block end>, but found <scalar> and special characters are not allowed…
😢

Can you paste steps to reproduce or better a pr with failing tests?

@mohsen1 Created a PR with a failing test: #14


Update URL for Last.fm

On Last.fm, clicking the "Simple Last.fm Scrobbler" link seen when someone is using it to scrobble goes to the Google page, not this github one.

I queried the Last.fm staff about this. I'll report back ASAP.

I've updated the URL in the Last.fm API Developer portal, and this should now be fixed. Could anyone please verify?

Apparently the link hasn't changed (thanks @HumbleBeeBumbleBee). We'll wait a while and see if it does, otherwise we'll contact Last.fm support.

I am going to close this because it seems the device which is scrobbling the music is no longer shown on the new website. I will reopen this discussion if that last.fm app scrobble link returns and is still wrong.


Adding notification extension to existing app

Question Checklist

[ x] Updated fastlane to the latest version
[ x] I read the Contribution Guidelines
[ x] I read docs.fastlane.tools
[ x] I searched for existing GitHub issues

Question Subject

Match/Produce

No

No
I'm trying to add a notification extension to my existing app that has run many years on Fastlane.  I have a rather complicated custom setup, because I do bundle ID swaps for staging, production and app store releases.  After a search of old Fastlane issues, I thought I had an understanding of what I needed, but there is still something wrong.
I added the new target for my NotificationExtension.  Then I used produce to create the new App ID:
 fastlane produce -u<EMAIL_ADDRESS>-a com.MyApp.NotificationExtension --skip_itc
And modified my fastfile, which has a lane that does all the match stuff in one command:
  desc "Bootstrap certs and profiles from match"    lane :bootstrap do     match(git_branch: "myBranch", type: "development", app_identifier: ["com.MyApp", "com.MyApp.NotificationExtension"], force_for_new_devices: true, team_id: "XXXX")     match(git_branch: "myBranch", type: "appstore", app_identifier:["com.MyApp", "com.MyApp.NotificationExtension"], force_for_new_devices: true, team_id: "XXXX")     match(git_branch: "myBranch", type: "adhoc", app_identifier: ["com.MyApp.staging", "com.MyApp.production", "com.MyApp.qa", "com.MyApp.NotificationExtension"], force_for_new_devices: true, team_id: "XXXX")   end
The change is adding com.MyApp.NotificationExtension for each.  The bootstrap lane passes without errors.  However, I am getting a signing problem on the notification extension, which means I have done something wrong.

This same signing cert is used to sign the debug version of the app without issue.
Thoughts on what I may have missed here?

✅ fastlane environment ✅
Stack

Key
Value

OS
10.15.5

Ruby
2.6.5

Bundler?
false

Git
git version 2.24.3 (Apple Git-128)

Installation Source
~/.rbenv/versions/2.6.5/bin/fastlane

Host
Mac OS X 10.15.5 (19F101)

Ruby Lib Dir
~/.rbenv/versions/2.6.5/lib

OpenSSL Version
OpenSSL 1.1.1d  10 Sep 2019

Is contained
false

Is homebrew
false

Is installed via Fabric.app
false

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
11.5

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL

LANGUAGE

fastlane reports which actions are used
No personal data is recorded. Learn more at https://github.com/fastlane/enhancer
</details>

<details><summary>`./fastlane/Appfile`</summary>

```ruby
app_identifier "com.MyApp" # The bundle identifier of your app
apple_id "" # Your Apple email address

team_id "[[DEV_PORTAL_TEAM_ID]]"  # Developer Portal Team ID

# you can even provide different app identifiers, Apple IDs and team names per lane:
# More information: https://github.com/fastlane/fastlane/blob/master/fastlane/docs/Appfile.md

fastlane gems

Gem
Version
Update-Status

fastlane
2.150.3
✅ Up-To-Date

Loaded fastlane plugins:

Plugin
Version
Update-Status

fastlane-plugin-appcenter
1.8.1
✅ Up-To-Date

Loaded gems

Gem
Version

did_you_mean
1.3.0

slack-notifier
2.3.2

rouge
2.0.7

xcpretty
0.3.0

terminal-notifier
2.0.0

terminal-table
1.8.0

plist
3.5.0

CFPropertyList
3.0.2

addressable
2.7.0

multipart-post
2.0.0

word_wrap
1.0.0

babosa
1.0.3

colored
1.2

highline
1.7.10

commander-fastlane
4.4.6

unf
0.1.4

domain_name
0.5.20190701

http-cookie
1.0.3

faraday-cookie_jar
0.0.6

fastimage
2.1.7

gh_inspector
1.1.3

mini_magick
4.10.1

multi_xml
0.6.0

rubyzip
2.3.0

security
0.1.3

xcpretty-travis-formatter
1.0.0

dotenv
2.7.5

bundler
2.1.4

jwt
2.1.0

uber
0.1.0

declarative-option
0.1.0

representable
3.0.4

retriable
3.1.2

mini_mime
1.0.2

httpclient
2.8.3

google-api-client
0.38.0

nanaimo
0.2.6

colored2
3.1.2

claide
1.0.3

atomos
0.1.3

xcodeproj
1.17.0

unicode-display_width
1.7.0

public_suffix
4.0.5

tty-screen
0.8.0

tty-cursor
0.7.1

tty-spinner
0.9.3

excon
0.75.0

faraday
1.0.1

unf_ext
<IP_ADDRESS>

faraday_middleware
1.0.0

json
2.3.1

naturally
2.2.0

simctl
1.6.8

declarative
0.0.20

multi_json
1.14.1

signet
0.14.0

os
1.1.0

memoist
0.16.2

googleauth
0.13.0

rake
13.0.1

digest-crc
0.6.1

google-cloud-errors
1.0.1

google-cloud-env
1.3.2

google-cloud-core
1.5.0

google-cloud-storage
1.26.2

emoji_regex
3.0.0

aws-eventstream
1.1.0

aws-sigv4
1.2.1

aws-partitions
1.338.0

jmespath
1.4.0

aws-sdk-core
3.103.0

aws-sdk-kms
1.36.0

aws-sdk-s3
1.73.0

forwardable
1.2.0

logger
1.3.0

stringio
0.0.2

ipaddr
1.2.2

openssl
2.1.2

ostruct
0.1.0

strscan
1.0.0

date
2.0.0

fileutils
1.1.0

etc
1.0.1

io-console
0.4.7

zlib
1.0.0

rexml
3.1.9

psych
3.1.0

mutex_m
0.1.0

webrick
1.4.2

fastlane-plugin-appcenter
1.8.1

csv
3.0.9

generated on: 2020-07-06

I fixed this issue.  Two things going on here:  By default, debug build settings were set to iOS Distribution, not iOS Developer.  Second issue is that changing this reset the provisioning profile for debug back to app store.  After fixing those things, it began to work.


KAFKA-17479 Fail the whole pipeline if junit step times out [4/n]

Follow up from #17106, this patch fixes a bug in the workflow where the tests timeout but no JUnit errors are found. Since the test report is incomplete, this is a false positive for a build being green. We should fail the whole workflow if the JUnit tests timeout.

I have tested the timeout case on mumrah/kafka here https://github.com/mumrah/kafka/actions/runs/10745303070/job/29804106047?pr=13#step:6:71
This is a perfect example since we do actually see some test reports being processed
Did not find done file 'build/junit-xml/done'. These are partial results!
1057 tests cases run in 31s. 1057 PASSED ✅, 0 FAILED ❌, 0 FLAKY ⚠ , 0 SKIPPED 🙈, and 0 errors.
Failing this step because done file was missing.

The timeout error is coalesced into the Parse JUnit Tests step:

And, most importantly, the link from the PR takes us to the JUnit summary instead of the actual Test step. This is important because the Test step usually has 10s of thousands of log lines and often gets truncated in the UI. Linking to the summary step is much more user friendly.
https://github.com/user-attachments/assets/44d18d7e-57ee-4ee5-8f32-90e4560fa85d

Adding a finalizer to the default "test" task did not work as expected. I can't find a simple way to add task to run after all the subproject ":test" tasks, so I changed this to have the GH workflow explicitly call createDoneFile

Adding a finalizer to the default "test" task did not work as expected. I can't find a simple way to add task to run after all the subproject ":test" tasks, so I changed this to have the GH workflow explicitly call createDoneFile

Could we check the create time of build/.../xml instead?

If there is no xml file -> timeout
If any xml's creation time is too old -> timeout

Could we check the create time of build/.../xml instead?

The trouble is, we may have some of the copied XML files, but not all of them. For example, if all the tests finished except for :core we would have several XML files in build/junit-xml, but not any from core.

The whole problem we're working around here is that there's no easy way to distinguish between a timeout and some other failure in a GitHub step (a major limitation, IMO). Another solution could be to use the Linux timeout command to do our own timeout. With this approach, we just watch for a particular exit code from timeout to determine if Gradle had an error or if it timed out.
It would be something like:
timeout 180 ./gradlew ...
RET=$?
if [[ $RET == 124 ]]; then
  echo "timed out";
elif [[ $RET == 0 ]]; then
  echo "ok";
else
  echo "failed";
fi

Maybe we could capture the exit code and store it as a step output to be read by the Parse JUnit step. WDYT?

The trouble is, we may have some of the copied XML files, but not all of them. For example, if all the tests finished except for :core we would have several XML files in build/junit-xml, but not any from core.

I meant we can check creation time of xml file (from finished tests) in parsing and throw error if one of them has "too old" creation time.

Maybe we could capture the exit code and store it as a step output to be read by the Parse JUnit step. WDYT?

Sound good. Overall it would be better to avoid complicating build.gradle 😄

@chia7712 I took advice from this thread https://github.com/orgs/community/discussions/46992#discussioncomment-4961541 to capture the exit code. I tested it with a 5s timeout here https://github.com/apache/kafka/actions/runs/10752630233/job/29821166851, seems to work.
I think this is a better solution than fiddling with files.


[JEP-227] Compatibility with Spring Security

Attempting to make this compatible with https://github.com/jenkinsci/jenkins/pull/4848. There is no test coverage and the usage of Spring is unusual and complex so this may or may not work at all.

Hello @jglick, just to be sure: are you finished working on this, and what is the current state? (working or not, tested or not...)
Thanks for all the work around this btw, abandoning Acegi Security was long overdue, and will simplify this plugin a bit ;-)

are you finished working on this

Yes. If merged and released, the update would become available to users running weeklies but not LTS versions, which is what we would want.
Note that unlike all other security realm plugins I worked on, I did not find a way to produce a single version which works in 2.266+ as well as 2.265-, so a user would need to take care to do the upgrade or core and plugin atomically, which is not possible solely using the GUI AFAIK; otherwise after the core upgrade you would be unable to log in as an admin to request the plugin upgrade, a kind of Catch-22. Can probably manually download the plugin update and save it to the Jenkins controller filesystem just prior to running the core update; untested.

what is the current state? (working or not, tested or not...)

Completely untested. As noted in the PR description, the plugin has no functional or acceptance tests, and I scarcely know that CAS is, much less how to set up a test environment for it. This patch compiles against Jenkins 2.266+, and mostly uses migration idioms proven in other plugins, but if for example there were some typo in a String argument from the Groovy → Java migration this would only be caught by a manual sanity check.
Glad to see an active maintainer here!

Alright thanks for the feedback, I'll take it over from here. Do you know when a LTS including the Spring Security migration will be released?

when a LTS including the Spring Security migration will be released

Expected around early March. We deliberately merged https://github.com/jenkinsci/jenkins/pull/4848 soon after selecting the baseline for the current LTS (2.263) so that we would have the longest possible “runway” to iron out problems.

@fcrespel Let me know if you'd like help testing this out.  I'm currently using the CAS plugin in Jenkins.  I don't know much about spring-xstream, but I do know how the CAS protocol itself works.

Thanks for the offer @vwbusguy, I'll try working on this during the weekend, I'll let you know when it's ready for testing.

If anyone cares to try out this PR so far (no warranty), you can download and install: https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/cas-plugin/1.5.0-rc88.860ce26b5e96/cas-plugin-1.5.0-rc88.860ce26b5e96.hpi

I just pushed an update that works on my test environment, @vwbusguy if you want to test it you can grab it here.
The first version didn't work due to various complications with Spring Security filters, SecurityContext, sessions, etc. I also refactored it to bring back an actual Spring AnnotationConfigApplicationContext and the CasEventListener, which is needed for all this integration to work.

Tested cas-plugin-1.5.0-rc89.828f27fec447.hpi and it appears to work as expected.

Sorry, I got pulled into other things at work.  I'll try to test it out this afternoon.

Good news!  1.5.0 works for me on Jenkins 2.267

Good to hear, thanks for the feedback. I'll merge this now, then push a few more updates and create a release soon.

When you cut a release, please https://github.com/jenkinsci/jep/edit/master/jep/227/compatibility.adoc to reflect the compatible status and the version with the fix. There are lots of plugin entries to use as a model; this one is unique in that there is no plugin version compatible with both 2.266+ and 2.265-, so it deserves a note that upgrading will be tricky if you are not configuring Jenkins as code.

@jglick release 1.5.0 is done, compatibility doc PR is in jenkinsci/jep#338


Support for setting output location

Issue #157
default dir of "test-results" preserved
can be changed via cmdline -o/--output or env var OP_TEST_OUTPUT
with cmdline taking precedence
print output directory at start and end of run
msg was being created, but never written to screen
via --suffix allow changing of suffix added to files
default still current time
output and outsuffix load into conf so available to tests
for use if needed

Signed-off-by: Jason Albert<EMAIL_ADDRESS>

This change is

thanks! Looks good and merged to master as of 839f0539d0c57aaa1b5436e7a0de1fc3075540dc


Firmware 05.02.00 on CT200

Thermostat got a update to version 05.00.01 and the integration does not work anymore.
You can find the debug scan here:
http://jsonblob.com/1283143134916501504
Thanks for all the work on this integration!

fixed in https://github.com/bosch-thermostat/home-assistant-bosch-custom-component/releases/tag/v0.26.2


Azure sign-in error with unhelpful message at Minecraft Education

We faced an issue when Minecraft Education accounts under a school tenant failed to log in within the school premise.

The issue occurred after and only after 2022-12-08 16:00 GMT+08, meaning students could log in before that specific time and still play, but students attempting log in after that specific time all failed with the attached message
As the tenant school was really using Win7/IE, we advised them to install more modern browsers and when that failed, use newer devices. The issue persisted when Win10/Edge is used on 2023-02-02.
On 2023-02-02, I could log in with an account that was not under the school tenant using the school machines with the same privilege, ruling out network and local privilege issues.

From the error message alone, Issue #104022 could be related but those are not admin accounts, those are accounts of students staying after school waiting to log in Minecraft Education.
As I am not affiliated with the tenant itself, I cannot provide much information regarding their setup - but I'm glad to relay any instructions that may help the situation and refer them to you if necessary.

services: active-directory
ms.service: active-directory
ms.subservice: authentication
ms.topic: conceptual
ms.date: 01/07/2023
ms.author: justinha
author: justinha
ms.reviewer: jpettere
manager: amycolannino

@henry132109
Thanks for your feedback! We will investigate and update as appropriate.

Hi @henry132109
It would be great if you could add a link to the Microsoft documentation you are following for these steps? This would help us redirect the issue to the appropriate team. Thanks!!
As per the screenshot you attached i would recommend you install the latest version browser and try to login by following the document .

Hi @henry132109
Could you update the version of the browser and try once to login.
We are going to close this thread as resolved but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.

The issue seems to be resolved as of 2023-02-09

I've disabled Internet Explorer and installed Microsoft Edge fresh, the same error appears on this screen.


Avatar preview is blurry.

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open the app
Go to Settings => Profile => Change the Avatar with any images that doesn’t look blurry.
Kill the app and wait for a while, open the app again and try to preview your avatar inside any report.
Notice that your avatar preview looks so blurry.

Expected Result:
Avatar preview shouldn’t look blurry
Actual Result:
Avatar preview looks blurry.
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: 1.2.54-2
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos:
https://user-images.githubusercontent.com/43996225/212785025-f9675070-d034-4f6c-8cd3-dc0397a6e59e.mp4
https://user-images.githubusercontent.com/43996225/213020562-e0459204-6437-4814-b15f-727e3e5c6c97.MP4
https://user-images.githubusercontent.com/43996225/213020947-6648537f-5527-43ef-98f7-3a7267530a33.mp4
Expensify/Expensify Issue URL:
Issue reported by: @hungvu193
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1673615491816959
View all open jobs on GitHub

I don't think the second video in the OP is relevant right @kavimuru?

Hm, I wasn't able to reproduce this. I changed my avatar image, killed the app, went back later and it still looks clear. Adding Eng for more eyes.

@lschurr Updated video. Sorry about that.

@Beamanator I think this should be fixed by the fix for your issue. Do you agree?

Aah yes most likely, because we're full-screening a thumbnail picture :D

Thanks for the confirmation. I'll set this on hold for now.

Weekly - same as the issue that is held on.

Still on hold.

Believe this is still on hold.. is that right @cristipaval?

Hmm.. it looks like the fix for the other one was merged. I'll test this one today and keep you posted here.

yeah, it looks like this one is fixed now by this PR

Reopening so that we can issue a reporting bonus - https://expensify.slack.com/archives/C01GTK53T8Q/p1676940741190779

@hungvu193 - Could you apply for the job in Upwork? https://www.upwork.com/jobs/~01903124f5eb7845ca

All set - payment has been issued.


OU-539 Dynamically Reload Certificates

Based on modifications: https://github.com/openshift/monitoring-plugin/pull/264

/hold
/cc @anpingli
This PR is trying to address OU-576. Could you test it?

/retest

/cc @anpingli
I pushed some changes, could you test this PR?

Test pass, LGTM

LGTM


`make install' requires gtest and tests to be built

sudo make install under Linux requires the test targets to be build [because under the  `all' target]

Isn't there a flag already to exclude them? Something like -DBUILD_TEST=OFF (out of my mind since I'm from mobile).

Yes there is that flag.
I'm just wondering if installing gtest/gmock and tests in /usr/local/lib makes any sense.
I'll investigate this further.

Oh... I didn't get it's installing them too. Good catch.

You should put a close #N in your commit messages to have your issues closed automatically when things get merged on master. :wink:

Just want to avoid you deliberately merge it into master.
Joking, should I force-push?

Nah, just a suggestion for the next time. We can still close this one as usual. :+1:

Merged on master.


Miner doesn't open

The miner doesn't work, i'm using coinomi as a wallet ethermine as a pool.
And i can't even see it through task manager even if stealth mode is disabled.

Post your settings here.

I would advice you to use the new miner: https://github.com/UnamSanctam/SilentCryptoMiner instead. But make sure that your GPU drivers are updated enough to have CUDA 11.2.

i have the same problem w the new miner

In the new miner, go to the "Main" tab, then press "Save", zip that file and then send it here.

test.zip

You have a newline (enter) after your pool port, remove the new line. And also update your SilentCryptoMiner.

test2.zip
so now it should working?

btw i don't see any process in the task manager

Yeah you have "Install Rootkit" enabled so it's hidden from the Task Manager. But yes your miner itself is working.


Kill the client without it crashing or swalling signal

dupe of https://github.com/CodaProtocol/coda/issues/2656


[Docs] Improve Sidebar Labeling and Hierarchy

The sidebar in the docs is the index for the documentation content. We must rethink the labels and structure of the sidebar to improve UX and provide an easier way to infer what information a doc page will have based on its sidebar label.

Doing this in #2853


Support hostname with _ in name

Bug Report
I spotted the same issue that was described here https://www.chrissearle.org/2022/02/22/r2dbc-postgresql-invalid-ipv6-address-when-dockerized/
When using docker host alias with _ host and port are incorrectly parsed.
Versions

Driver: 1.0.0
Database: not relevant
Java: 11
OS: macOS

Current Behavior
Host is incorrect parsed. Host contains port instead keeping port in port variable.

Stack trace
// your stack trace here

Table schema

Input Code
-- your SQL here;

Steps to reproduce

Input Code
// your code here;

Expected behavior/code

Possible Solution

Additional context

It looks that this is underlying issue https://stackoverflow.com/questions/28568188/java-net-uri-get-host-with-underscores


CSS: Weird left margin in ion-input on Android

Hi,
With Ionic2, on Android, at least when using Crosswalk, when I select an ion-input a weird left-margin (sometimes even just a half sized left-margin) gonna be displayed. This doesn't happens neither while debugging with Chrome or on iOS. Could that glitch be a bug?
Test code:
 <ion-grid>
     <ion-row>
        <ion-col width-100>
          <ion-item>
            <ion-icon name="pin" item-left></ion-icon>
            <ion-input type="text" placeholder="Test"></ion-input>
          </ion-item>
   </ion-col>
 </ion-row>

 <ion-row>
        <ion-col width-100>
          <ion-list>
            <ion-item>
              <ion-icon name="pin" item-left></ion-icon>
              <ion-input type="text" placeholder="Test"></ion-input>
       </ion-item>
     </ion-list>
   </ion-col>
 </ion-row>
 </ion-grid>

Thx in advance for having a look.
P.S.: Follow up of https://forum.ionicframework.com/t/ion-item-question-and-weird-android-css/62754
P.P.S.: Even without ion-grid the same effect happens. To reproduce the problem I also cleared all my custom css and could reproduce it only with the native css I use.

Hello, thanks for using Ionic! Does this also happen when not using crosswalk on an android device or emulator running 5.0 and higher?

Yes, just tested both cases, with or without Crosswalk this happens on my Nexus 5X / Android 6 device.

Ummm in my project, seems I solved the issue. Don't know exactly how.
I've got these input inside a slider and it seems that fixing the overflow of that slider fixed it, but not sure.
Well then in my project seems to be solved, so I don't mind of course if you want to close the task, even with the native css I think I still could reproduce it.

@peterpeterparker thanks for the info. I was actually going to get back to you and let you know that on my devices (Nexus 6 running Android 7.0, Nexus 7 running Android 6.0.1, and a Moto X running 5.1.1) I cannot reproduce this issue. Because of this and the fact that you seemed to solve the issue in your app I am going to be closing this issue for now. Thanks for using Ionic!

@jgw96 thx for the feedback and sorry for time lost

@jgw96
I have this problem for Android 5, NOT 6. Using Crosswalk and without crosswalk is the same for Android 5. The line only occurs when the input is dirty. And it persists if the label is floating.
Below is my template:
      <ion-item>
        <ion-label floating>Username</ion-label>
        <ion-input type="text" formControlName="username" id="username-field"></ion-input>
      </ion-item>
      <ion-item>
        <ion-label stacked>Password</ion-label>
        <ion-input type="password" formControlName="password" id="password-field"></ion-input>
      </ion-item>
      <ion-item>
        <ion-label>Username</ion-label>
        <ion-input type="text" formControlName="username" id="username-field"></ion-input>
      </ion-item>
      <ion-item>
        <ion-label inline>Password</ion-label>
        <ion-input type="password" formControlName="password" id="password-field"></ion-input>
      </ion-item>

I just duped the username and password field, replacing it with different label types. So, the first one will give a persisting line around the left and right edge of the div. The remaining label types will only show the line on first selection, then after 1 second or so it disappears. So it's onselect.
For me, I'll stay the hell away from floating and switch to something else. Hope this helps your team fix it.


RealmSwift 10.29.0 increased my WatchKit App bundle size

How frequently does the bug occur?
All the time
Description
I did pod update for realm-swift to run/debug in XCode 14. But when i submit a build to Appstore i got an error as Size Limit Exceeded  the 75MB size limit.
Help me
Stacktrace & log output
No response
Can you reproduce the bug?
Yes, always
Reproduction Steps
No response
Version
10.29.0
What SDK flavour are you using?
Local Database only
Are you using encryption?
No, not using encryption
Platform OS and version(s)
iOS 16, Watch OS 8
Build environment
Xcode version: ...
Dependency manager and version: ...

@veluloganathan from which version are you migration from? Are there other frameworks updates from the last time you uploaded to App Store?

i migrated from 10.25.0 and i havn't updated any other frameworks.

Have you tried using a older version of Xcode?, I would try this but I cannot upload anything to the AppStore, this may help us identify if the issue is in our side or Apple side.

No, But i managed to install realm-swift using SPM and it solves the issue for now.
FYI: I do see librealm-monorepo.a added to my built product(watchOS App).

@veluloganathan I made some tests and It look like we haven't made any big changes in our side to represent any big increase in the binary size.
In Xcode 14 builds for watchOS now include arm64 architecture which would explain the increase in the size, and because build flags for Cocoapods and SPM are different there may be a slight difference between the builds.
This difference may be the cause for your app binary size to go over the max app size for a watchOS App, because your app may be almost in the limit to go over 75Mb.


More project types

Add more project types. This should include:

skeleton projects for various languages (Python, PHP, Node.js...)
skeleton projects for specific frameworks (React, Django, Flask, Laravel, Symfony, Slim...)
other pre-built projects

And also allow users to add their own projects after installation of this program.

Thank you for the feedback! I am definitely looking into adding more project types. Also, feel free to fork and submit a pull request for these additional options!

We need to come up with a list and break this up into smaller issues

Closing and creating smaller issues for new project types.


Dcarpente/small samples fix

For some files, FFMPEG outputs audio samples that are as short as 2 or 3 ms, which was causing performance issues in our scenarios. This pull request changes MediaSampleProvider::GetNextSample to take in a minSampleDuration argument, and changes FFmpegInteropMSS to request audio samples to have duration >= 50 ms.

@dcarpente,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

Hi @dcarpente,
I've pushed a small change, the start offset was missing from your merge of master.
But also, I've tried the following and I'm seeing a huge delay now.
//const TimeSpan MINAUDIOSAMPLEDURATION = { 500000 };
const TimeSpan MINAUDIOSAMPLEDURATION = { 250000000 };
I would assume that the audio sample timestamp represents the start of the audio sample. So if I pass in a much bigger sample, such as 2 compressed samples, I would expect that they both play with the timestamp still matching. But this instead I'm seeing a huge AV-Sync issue about the size of a compressed sample. Is that normal or am I missing something?

After a clean build, the sync issues don't show up anymore. I think we're good.


[wip] authn+authz

Okay, please to review @lognaturel @matthew-white @ggalmazor. Commit messages are highly descriptive.
Explicitly open questions:

There aren't yet tests; I have ideas on approaches here (test the raw db queries more explicitly; test the higher-order queries logically; do integration tests at the HTTP level (but what to do about the database?)), but I'd like to hear suggestions now that the code is more concrete.
Some of the linting things are maybe a bit insane (no-use-before-define).
.transacting vs .transacting() are currently not consistent; would like to hear which is preferred and I will push them all in that direction.

Downriver questions that don't prevent this PR from merging:

How exactly we want to expose and machine the rudimentary perms settings we've discussed for MVP (eg "anybody can register an account" vs "admins must create an account"; "any account holder can create a new form" vs "admins must create a new form"; etc).
a. Option A: the backend has no idea about them and the frontend simply looks for and creates/deletes the appropriate grants records explicitly, or
b. Option B: the backend understands and explicitly exposes a simplified /settings endpoint that provides some of these concepts as higher-level booleans.
c. The answer here should keep in mind the down-the-road state of things, where these rudimentary options work alongside a more flexible permission assignment UI.
How to do session refresh; right now all sessions last for exactly 24 hours with no refresh.
a. Option A: implicitly kick expiry out to 24 hours from each use. (pros: simple; cons: GETs trigger database writes).
b. Option B: use OAuth2's refresh token mechanism. (pros: explicit, standardized, we'll need it anyway; cons: more homework up front (n.b. I don't mind doing this homework)).
c. Option C: ignore the problem for now.
We'll need HTTPS to protect plaintext passwords in transport.
The mechanism whereby the frontend is informed of the current sessionholder's rights on various things, so that it can appropriately provide the correct verbs/grey out inaccessible operations, etc.
a. Option A: GETted objects contain a grants key containing an array of available verbs.
b. Option B: A separate API endpoint may be queried to retrieve said array of verbs. (We will likely need this endpoint anyway, but the question stands.)

More options exist for each of these; these are just the obvious paths in my mind.

Okay, now basic Form POST/GET are in there too since they were incredibly easy to add.

I hear what you're saying on "easy"/"just"/etc, but without such words it is difficult to express the justification for punting certain things down the road.

I'm going to merge this just to simplify the cross-repository stuff and start working on subbranches but please don't let that stop anybody from continuing to review and comment.

Hi everyone!
I've reviewed the commit messages and I've also downloaded your branch and checked the code and I can't see any important stuff that we should have to take care of right now. I feel that with this PR, Jubilant is taking a good momentum. Huge step forward here, congratulations! :)

Regarding the tests, I can't really add much to what I said in #29 at this moment. Maybe after you develop your ideas I can be more helpful. As I mentioned in Slack, I'll be focusing on Aggregate and Briefcase but I can still help with specific problems.


withAuthenticationRequired invokes loginWithRedirect multiple times

Explanation:

I had an intermittent/inconsistent login issue on my site. It was happening mostly in Google Chrome incognito, but was also being reported by users using regular Chrome.
I reached out to Auth0 support, and we figured out that there was a mismatch happening b/w code_verifier and code_challenge and the call to /authorize would 403.
Auth0 support agent figured out that my application was setting code_verifier multiple times due to multiple invocations of loginWithRedirect().
My application is using withAuthenticationRequired method from @auth0/auth0-react. To help myself debug, I pulled out this method into my own application so I could debug/log stuff. I realized that the useEffect here is being invoked multiple times, and the culprit is loginOptions as a dependency. I'm not passing in loginOptions, so it seems that on each render we're defaulting it to a new instance of an empty object (here), and this is triggering the useEffect (bc they are different empty objects and they are !==).
To fix the issue, I defined const emptyObject = {} and then used it as the default: loginOptions = emptyObject.

Expected behavior:

Should invoke loginWithRedirect only once.

Reproduction:

Not sure if this is specific to my application or how I've set things up. Unfortunately I haven't had a chance to try and build a simple example that reproduces. I'm using Next.js v11.0.0.

Environment:

Version of auth0-react used: 1.8.0
Which browsers have you tested in? Chrome, esp incognito
Which framework are you using, if applicable (Angular, React, etc): Next.js v11.0.0
Other modules/plugins/libraries that might be involved: N/a

Hi @kweiberth - thanks for raising this

Expected behavior:
Should invoke loginWithRedirect only once.

withAuthenticationRequired only invokes loginWithRedirect once (see https://github.com/auth0/auth0-react/blob/master/src/with-authentication-required.tsx). If you're invoking loginWithRedirect multiple times, it means you're trying to render the component that is wrapped by withAuthenticationRequired multiple times.
I'd be happy to debug what's happening with your app, if you can provide me with a repo that demonstrates the issue.

Hi @adamjmcgrath, thanks for the quick response. I'll see if I can get a repo together. In the meantime, can you describe a little more why we are so certain that withAuthenticationRequired invokes loginWithRedirect only once?
From what I can tell, it's being invoked inside a useEffect here, and the useEffect will render anytime any one of isLoading, routeIsAuthenticated, loginWithRedirect, loginOptions or returnTo changes b/w renders. In my case, it's loginOptions that is causing multiple invocations. It does seem like some parent/wrapped component of mine is rendering more than once. However, I'm not passing in a new loginOptions; instead, withAuthenticationRequired is defaulting it to an empty object, but on each render that's a new instance of an empty object, and it triggers useEffect.

@adamjmcgrath I've created a repo that reproduces this issue: https://github.com/kweiberth/multiple-Auth0-logins. State is set in _app.tsx here, which causes an additional render, which causes the useEffect in withAuthenticationRequired here to be invoked twice. Comments here show how we can avoid/fix this issue.
Let me know if you need any more information!

Thanks for sharing the repo @kweiberth

but on each render that's a new instance of an empty object, and it triggers useEffect.

You make a good point - I'll take a look at this today or tomorrow and get back to you.

@kweiberth - I've had a look at your repo and while I think there's some merit to your suggestion about login options (or something similar). I'll add something to our backlog, but this will probably have to wait until the new year.
As an aside, you're also creating a new instance of Auth0Provider for every route change/App render (see https://github.com/kweiberth/multiple-Auth0-logins/blob/master/utils/with-auth0.tsx#L104) which will have other undesired effects. You should take a look at the nextjs example app in the repo, specifically https://github.com/auth0/auth0-react/blob/master/examples/nextjs-app/pages/_app.js

Hi @adamjmcgrath, thanks for looking into it. Will it help if I make a PR? It's a pretty simple change.
Re: multiple instances on each route: I'm doing this bc auth0 JS SPA is a huge bundle size (like 40kb I think?), so I can't add it to every route. There are profile-type pages on our site that need to load as fast as possible, and don't require auth. I've been meaning to see if I can lazy load it w/ Next.js's dynamic imports, but haven't had a chance to explore.

Sure - happy to look at a PR @kweiberth thanks. But either way, it wont get released until shortly after the beginning of January

Re: multiple instances on each route: I'm doing this bc auth0 JS SPA is a huge bundle size (like 40kb I think?), so I can't add it to every route.

Ok, I would just make sure that https://github.com/kweiberth/multiple-Auth0-logins/blob/master/utils/with-auth0.tsx#L104 doesn't get invoked more than once per page load

Okay yeah, makes sense. I don't think it is, but I guess it could be happening transiently/inconsistently to my users (similar to this one that we're discussing/fixing here).
I've made a PR to address this issue: https://github.com/auth0/auth0-react/pull/311


[BUG] Get-PnPListItem does not return the list field named 'DisplayName' under FieldValues property

Notice
Many bugs reported are actually related to the PnP Framework which is used behind the scenes. Consider carefully where to report an issue:

Are you using Invoke-PnPSiteTemplate or Get-PnPSiteTemplate? The issue is most likely related to the Provisioning Engine. The Provisioning engine is not located in the PowerShell repo. Please report the issue here: https://github.com/pnp/pnpframework/issues.
Is the issue related to the cmdlet itself, its parameters, the syntax, or do you suspect it is the code of the cmdlet that is causing the issue? Then please continue reporting the issue in this repo.
If you think that the functionality might be related to the underlying libraries that the cmdlet is calling (We realize that might be difficult to determine), please first double check the code of the cmdlet, which can be found here: https://github.com/pnp/powershell/tree/master/src/Commands. If related to the cmdlet, continue reporting the issue here, otherwise report the issue at https://github.com/pnp/pnpframework/issues

Reporting an Issue or Missing Feature
Please confirm what it is that your reporting:
When using 'Get-PnPListItem' to get the field values of SharePoint lists, fields with the InternalName of 'DisplayName' are missing from the FieldValues property.
Expected behavior
Please describe what output you expect to see from the PnP PowerShell Cmdlets
Input: (Get-PnPListItem -List $TestList | Where-Object{$_.FieldValues.Title -eq "Test Row"}).FieldValues.'TestFieldName'
Output: TestFieldValue

Actual behavior
Please describe what you see instead. Please provide samples of output or screenshots.
Input: (Get-PnPListItem -List $TestList | Where-Object{$_.FieldValues.Title -eq "Test Row"}).FieldValues.'DisplayName'
Output: null/empty value

Steps to reproduce behavior
Please include complete script or code samples in-line or linked from gists
$Testlist = Get-PnPList -Identity "Test List"
(Get-PnPListItem -List $TestList | Where-Object{$_.FieldValues.Title -eq "Test Row"}).FieldValues.'DisplayName'

What is the version of the Cmdlet module you are running?
(you can retrieve this by executing Get-Module -Name "PnP.PowerShell" -ListAvailable)
2.99.48 nightly

Which operating system/environment are you running PnP PowerShell on?

[x] Windows
[ ] Linux
[ ] MacOS
[ ] Azure Cloud Shell
[ ] Azure Functions
[ ] Other : please specify

Hello @s-roop,
Can you try the following?
Typically I would assign the get-pnplistitem to a variable and iterate over each to another array if I needed to do something with the values but this format has worked for me in the past.
$Testlist = Get-PnPList -Identity "Test List"
(Get-PnPListItem -List $TestList -Fields "Title","DisplayName").FieldValues | Where-Object{$_.Title -eq "Test Row"}

Hello @s-roop, Can you try the following? Typically I would assign the get-pnplistitem to a variable and iterate over each to another array if I needed to do something with the values but this format has worked for me in the past. $Testlist = Get-PnPList -Identity "Test List" (Get-PnPListItem -List $TestList -Fields "Title","DisplayName").FieldValues | Where-Object{$_.Title -eq "Test Row"}

I gave it a try but this only gets the Title field properties - I tried a few more different ways but with no luck.
I've since created a field with the internal name of 'DisplayName_' and copied the existing data over. Everything works as expected and I've adjusted my scripts for a workaround but it's still an annoying solution.


Feature Request: Support managed identity in init containers

Is your feature request related to a problem? Please describe.
Managed identity is not supported in init containers
See also https://github.com/MicrosoftDocs/azure-docs/issues/111276 which is about this limitation not currently being documented.
Describe the solution you'd like.
The MSI endpoint and secret environment variables should be made available also for an init container.
Additional context.
This works for a non-init container.

It's on our roadmap and partially dependent on this https://github.com/kubernetes/kubernetes/pull/116429

Looks like kubernetes supports this already.

Progress being made on this?

Any update here?

Hi all, we are actively working on this and will update with an ETA soon.

Hello @vturecek, it's been about three months since the last update. Could you please provide a status update or an ETA? We're looking forward to this feature. Thanks!

@johanbenschop sorry for the delay. Managed identity is now supported in init containers on the Workload Profile Consumption plan. In addition, we've added a setting in API version 2024-02-02-preview that allows you to control in which phase of your application managed identity is available to your container (init, main, all, none). See here for more information: https://learn.microsoft.com/en-us/azure/container-apps/managed-identity?tabs=portal%2Cdotnet#control-managed-identity-availability

@vturecek Can we please get an update/ETA for when this feature will be available for Consumption Only plans?

@vturecek Thanks for the reply. Like nattyg93, we're on the consumption-only plan, and it looks like we cannot switch an existing environment over to the workload plan.
Also, when I look for where to add this new setting in our bicep files, I don't find it. The reference for the latest version of Microsoft.App/containerApps on the Microsoft Docs here don't mention identitySettings anywhere. Also, there isn't a version 2024-02-02-preview, but the bicep tooling in VS Code does have 2024-03-01, which is also not in the docs. I feel like I'm missing something obvious.


Look into a better alternative for transfer to Bianca

Transferring to Bianca via transit works, but transit has an allocated amount of space for a specific project (defined when project created in SUPR), which may result in problems if we're working with huge amounts of data.
@valyo Correct me if the above information is incorrect and if there's anything to elaborate on please fill in the gaps, thanks!

The information is in general correct, here are some details:

When they ssh to Transit, the users end up in their usual home directory on the non-sensitive HCP cluster(s).
The changes they made there are not persistent: if they download data from dds there, it will not persist beyond their ssh session
To download data in SENS (Bianca) project, they need to mount a specific directory of a SENS project on Transit, and then set the mount point as destination in the dds_cli command
This directory is part of what is known as nobackup storage allocation of the SENS project

Basically, the users should be aware of (at least) three things:
a) to mount the correct SENS project on Transit
b) the size of the data they need to download vs the nobackup storage allocation of the corresponding SENS project
c) to start the download in a screen/tmux session for anything larger than a few hundreds of GB

Nice! How does a user mount the space? Is it something that could be done within the DDS CLI?

they mount it with a "mount_wharf sens_projectID" command, which prompts for a uppmax password + TOTP code.
IMO integration with SUPR and a solution like todays deliver would be the best option

I was half wondering if we could have a --bianca-project option (could even auto detect available projects from the user's groups and have a select menu) which then runs the mount command and sets the destination directory automatically.
The user would still need to do the Bianca auth but it would at least mean fewer steps to get right.

To be clear I think SUPR integration would be nice, I just worry that it will be technically very difficult to get it to work with the two separate authentication and decryption systems.

The information is in general correct, here are some details:

When they ssh to Transit, the users end up in their usual home directory on the non-sensitive HCP cluster(s).
The changes they made there are not persistent: if they download data from dds there, it will not persist beyond their ssh session
To download data in SENS (Bianca) project, they need to mount a specific directory of a SENS project on Transit, and then set the mount point as destination in the dds_cli command
This directory is part of what is known as nobackup storage allocation of the SENS project

Basically, the users should be aware of (at least) three things: a) to mount the correct SENS project on Transit b) the size of the data they need to download vs the nobackup storage allocation of the corresponding SENS project c) to start the download in a screen/tmux session for anything larger than a few hundreds of GB

@valyo Is this correct?

$ ssh -A<EMAIL_ADDRESS>Don't use dds data get get without the --destination option
username@transit:~$ mount_wharf <sens_project> -> dds data get --destination <sens_project>/<destination>/
No backup

Great, thanks.

Moving to Jira.


Add option to enable pre ruby 3.2 =~ beahvior

Addresses #2424
This is disabled by default but is needed if a release template is incorrectly using =~
=~ was removed from Kernel in ruby 3.2 and those templates will now break without this.
Ruby change context: https://bugs.ruby-lang.org/issues/15231

Forcing release authors to update is the right thing to do. However sometimes it is not possible for operators to make this happen. We don't want to block operators from upgrading their director version which is why it is important to have this patch available.

After discussing this in the FI WG meeting let's go this way.


Script to update Freyja CSV outputs with new LOIs?

A lineage of interest (LOI) is a label for annotating the estimated frequency of a lineage (e.g., lineage X is derived from LOI Z).
Designation of new lineages can require reprocessing from raw data (?)
LOIs may change at a fast pace (faster than the designation of new lineages).
Rather than reprocessing data upon change in list of LOIs, we could simply update the respective field in the CSV outputs

we should track versions for lineage definitions, barcodes, and LOIs (probably using checksums, if third-party version numbering is not available or inconsistent)

need to come up with some protocol of what data gets revised upon update of (1) LOIs, (2) lineage definitions, (3) Freyja pipeline


metadata generation should fail gracefully if pyff isn't running

gen-metadata fails with a rather nasty-looking error if pyff isn't running.  It should be straightforward to fail a bit more gracefully.
TASK [satosa : Generate metadata] **********************************************
fatal: [proxy.vm.scz-vm.net]: FAILED! => {
    "changed": true,
    "cmd": "./gen_metadata",
    "delta": "0:00:00.704807",
    "end": "2018-01-17 13:55:55.124074",
    "rc": 1,
    "start": "2018-01-17 13:55:54.419267"
}

STDERR:

Setup frontends: ['SamlIdP', 'SamlMirrorIdP', 'OIDC']
The SAML service provider accepts unsigned SAML Responses and Assertions. This configuration is insecure.
The SAML service provider accepts unsigned SAML Responses and Assertions. This configuration is insecure.
Setup backends: ['SamlSP', 'SamlMirrorSP']
Loaded frontend plugins: ['SamlIdP', 'SamlMirrorIdP', 'OIDC']
Loaded backend plugins: ['SamlSP', 'SamlMirrorSP']
Creating SAML backend 'SamlSP' metadata
Backend SamlSP EntityID https://proxy.scz-vm.net/SamlSP/proxy.xml
Creating SAML backend Mirror metadata for 'SamlMirrorSP' and frontend 'SamlIdP'
Traceback (most recent call last):
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/saml2/mdstore.py", line 811, in __getitem__
    return self.entity[item]
KeyError: 'https://sp-test.scz-vm.net/saml/module.php/saml/sp/metadata.php/default-sp'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connection.py", line 141, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/util/connection.py", line 83, in create_connection
    raise err
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connectionpool.py", line 357, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.5/http/client.py", line 1107, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python3.5/http/client.py", line 1152, in _send_request
    self.endheaders(body)
  File "/usr/lib/python3.5/http/client.py", line 1103, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python3.5/http/client.py", line 934, in _send_output
    self.send(msg)
  File "/usr/lib/python3.5/http/client.py", line 877, in send
    self.connect()
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connection.py", line 166, in connect
    conn = self._new_conn()
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connection.py", line 150, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7ff5c8fbc828>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/adapters.py", line 440, in send
    timeout=timeout
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/connectionpool.py", line 639, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/urllib3/util/retry.py", line 388, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=8081): Max retries exceeded with url: /entities/%7Bsha1%7D9cf868c63facb578874f88ec55eb097ee2bbb2bb (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff5c8fbc828>: Failed to establish a new connection: [Errno 111] Connection refused',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/satosa/satosa-env/bin/satosa-saml-metadata", line 11, in <module>
    sys.exit(construct_saml_metadata())
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/satosa/scripts/satosa_saml_metadata.py", line 105, in construct_saml_metadata
    create_and_write_saml_metadata(proxy_conf, key, cert, dir, valid, split_frontend, split_backend, split_module)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/satosa/scripts/satosa_saml_metadata.py", line 64, in create_and_write_saml_metadata
    frontend_entities, backend_entities = create_entity_descriptors(satosa_config)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/satosa/metadata_creation/saml_metadata.py", line 148, in create_entity_descriptors
    backend_metadata = _create_backend_metadata(backend_modules, frontend_modules)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/satosa/metadata_creation/saml_metadata.py", line 83, in _create_backend_metadata
    meta_desc = frontend.get_metadata_desc()
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/satosa/frontends/saml2.py", line 519, in get_metadata_desc
    ui_info = self.idp.metadata.extension(entity_id, "spsso_descriptor", "{}&UIInfo".format(UI_NAMESPACE))
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/saml2/mdstore.py", line 996, in extension
    srvs = _md[entity_id][typ]
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/saml2/mdstore.py", line 815, in __getitem__
    'Accept': SAML_METADATA_CONTENT_TYPE})
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/api.py", line 72, in get
    return request('get', url, params=params, **kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "/opt/satosa/satosa-env/lib/python3.5/site-packages/requests/adapters.py", line 508, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=8081): Max retries exceeded with url: /entities/%7Bsha1%7D9cf868c63facb578874f88ec55eb097ee2bbb2bb (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff5c8fbc828>: Failed to establish a new connection: [Errno 111] Connection refused',))

MSG:

non-zero return code

	to retry, use: --limit @/home/bas/Workspace/Repositories/SCZ-deploy/provision.retry

PLAY RECAP *********************************************************************

Can't reproduce in VM, current deploy.

This is ancient, anyway.  Haven't seen this in any recent builds.


systemctl reload glauth-ui stops service

When I run
systemctl reload glauth-ui`

the service stopped afterwards.
https://github.com/bodsch/ansible-glauth-ui/blob/97cc6a6f061c706c3775e81f258bc036849c8ee2/templates/init/systemd/glauth-ui.service.j2#L15
I don't know much about golang, but I cannot find any SIGHUP in glauth-ui-light, so probably this is some copy-paste error from a different service?

note for me https://www.freedesktop.org/software/systemd/man/systemd.service.html#ExecReload=

A common use case for kill is to send the HUP signal, which tells the processes to reload its settings.
I think that glauth-ui has implemented incorrect signal handling here.
I'll see if I can open a bug report on this.


General: work on an analysis is not being saved

My work on an analysis is being saved when i close out of qa.clinepidb.org, but it is not being saved as i move through the website using either the  "Search a study" drop-down or navigating to the homepage and clicking on the explore icon on the card. Something also seems weird with previous analyses, so for this ticket I first deleted all of my previous analyses.
I now have no analyses in the "my analyses" table, and i open a GEMS1 analysis from the study card. I apply 2 filters (Country & Case or Control Participant) to select 1394 Bangladesh cases. the analysis is labeled "unnamed analysis"
I click on clinepidb (top left) to get back to the homepage. I next click immediately back on the explore icon for GEMS1. Now I have 3859 participants and the filter for Cases has been removed.
The same thing happens when i am in my unnamed GEMS1 analysis and have my selected population of 1394 Bangladesh cases and click on GEMS1 analysis icon in the search a study dropdown.

I’m able to reproduce this, so I can likely figure out what’s going on.
Thanks for the detailed report!
On Tue, Aug 31, 2021 at 8:51 PM Danica Helb @.***>
wrote:

My work on an analysis is being saved when i close out of qa.clinepidb.org,
but it is not being saved as i move through the website using either the
"Search a study" drop-down or navigating to the homepage and clicking on
the explore icon on the card. Something also seems weird with previous
analyses, so for this ticket I first deleted all of my previous analyses.
I now have no analyses in the "my analyses" table, and i open a GEMS1
analysis from the study card. I apply 2 filters (Country & Case or Control
Participant) to select 1394 Bangladesh cases. the analysis is labeled
"unnamed analysis"
I click on clinepidb (top left) to get back to the homepage. I next click
immediately back on the explore icon for GEMS1. Now I have 3859
participants and the filter for Cases has been removed.
The same thing happens when i am in my unnamed GEMS1 analysis and have my
selected population of 1394 Bangladesh cases and click on GEMS1 analysis
icon in the search a study dropdown.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/VEuPathDB/web-eda/issues/366, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACZEU7PQANF5HSEKLSNAHDT7V2IVANCNFSM5DFJIEZA
.

Looks good, closing ticket.
Replicated this issue in the same study and tested in other studies, they all look good now.


backwards compatibility for Ubuntu 12.04

I'm going to close this and open a new pull request for the previous commit e32e9db only.
note drake-distro submodule would have to point at e32e9db, not master after this merge.


Cluster map

Fixes the cluster map by using useLMarkerClusterCustom Adapted version of : {https://github.com/nuxt-modules/leaflet/blob/0ce672e60537210e733846dae6e40d9c75d0e5a3/src/runtime/composables/useLMarkerCluster.ts} which allows for passing through cluster options.

It might be in my head but the animations look nicer in this than the previous version! Good job on solving this, I know it wasn't easy. Functionally works great.


System.Net.Sockets.SocketException: Address already in use

I am getting the error System.Net.Sockets.SocketException: Address already in use on the line server.Start(socket =>.... My server accepts a websocket request from the client, and works perfectly when a single connection is established. However, when the client attempts to make a concurrent websocket connection, the error occurs. What could be causing this errror? Client side or server side? Thanks, the code below is what I am using.
ConcurrentDictionary<Guid, IWebSocketConnection> allClientConnections = new ConcurrentDictionary<Guid, IWebSocketConnection>();
WebSocketServer server = new WebSocketServer("ws://<IP_ADDRESS>:2001");

        server.Start(socket =>
        {
            socket.OnOpen = () =>
            {

            };

            socket.OnMessage = message =>
            {

            };

            socket.OnClose = () =>
            {
                allClientConnections.TryRemove(socket.ConnectionInfo.Id, out IWebSocketConnection removedSocket);
            };

            socket.OnError = exception =>
            {
            };
        });`

Again, this sounds like you are triggering the socket server to start up each time a client connects. If the socket server has started and is listening on your port 2001, you cannot start the socket server again. If you do, it will throw that error, because the port is already in use. You can only start the socket server again IF the app has stopped running and the socket server has released the port.
Put a debug breakpoint on the line WebSocketServer server = new WebSocketServer("ws://<IP_ADDRESS>:2001"); and see if the breakpoint is triggered each time a client connects. It should only be triggered once...and once only for the entire duration that the app is running.

I implemented some better debugging capability into my program, and it turns out that the actual error message is this:
System.Net.Sockets.SocketException: Address already in use    at System.Net.Sockets.Socket.UpdateStatusAfterSocketErrorAndThrowException(SocketError error, String callerName)    at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)    at System.Net.Sockets.Socket.Bind(EndPoint localEP)    at Fleck.WebSocketServer.Start(Action'1 config)    at telebot_pianomoves_v1.Program.Main(String[] args) in C:\Users\hjstu\Desktop\Telebot\Visual_Studio\my-project\Program.cs:line 227.
Noting that the error is actually occuring on line 277. This line is where I execute socket.Send(someBinary);. And the error only occured when two websocket requests were made near simultaneously. I doubt starting the websocket server is the problem now. Also, WebSocketServer server = new WebSocketServer("ws://<IP_ADDRESS>:2001"); is executed in public static void Main(string[] args) which is used as an entry point for the application and is not reinvoked.
Thanks

Something is trying to bind to a port that's already in use, that's why the error is being thrown.
Maybe share a bit more logic from client & server side so we have more information to work with.

Here is a more detailed sample from my code. Essentially, the client sends an initial text message with some metadata, then I begin sending the binary audio data to a transcription service. When the transcription service detects that someone's speech has paused, it sends the transcription result. Once I receive this response, I repeat the process by beginning a new transcription service request and then send binary data to the service once again. The error I am receiving occurs most commonly before the first transcription service response is received, but is random sometimes also. I seem to get the error message System.NullReferenceException: Object reference not set to an instance of an object. in conjunction with the address error message. Both error messages occur at the line socket.OnBinary = async (binaryData) => await APICall.WriteAsync(binaryData).
    public static void Main(string[] args)
    {
        ConcurrentDictionary<Guid, IWebSocketConnection> allClientConnections = new ConcurrentDictionary<Guid, IWebSocketConnection>();
        WebSocketServer server = new WebSocketServer("ws://<IP_ADDRESS>:2001");

        server.Start(socket =>
        {
            bool firstMessage = false;

            socket.OnOpen = () =>
            {
                allClientConnections.TryAdd(socket.ConnectionInfo.Id, socket);
            };

            //After the websocket has been opened, I receive the first message from the client, the first message from the client is always textual and contains metadata for the connection, all subsequent messages are binary
            socket.OnMessage = message =>
            {
                //I initialise a speech transcription API here
                APICall = new TranscriptionRequest();
                firstMessage = true;
            };

            socket.OnClose = () =>
            {
                allClientConnections.TryRemove(socket.ConnectionInfo.Id, out IWebSocketConnection removedSocket);
            };

            //When the first binary message is received, invoke OnBinaryLambda()
            socket.OnBinary = binary => OnBinaryLambda(socket);

            socket.OnError = exception =>
            {
                throw new Exception(exception.ToString());
            };
        });
    }

    public static async Task OnBinaryLambda(IWebSocketConnection socket)
    {
        //firstMessage == true on invocation of this method
        if (firstMessage == true)
        {
            //Prevent this block from looping
            firstMessage = false;

            APICall.begin();

            //This task runs asynchronously, waiting to receive the speech transcription results
            Task.Run(async () =>
            {
                if(APICall.response = true)
                {
                    //When the transcription service results have been received, immediately repeat this process by reinvoking OnBinaryLambda() so that a new transcription service api call is made
                    socket.OnBinary = async (binaryData) => await OnBinaryLambda();
                    firstMessage = true;
                }
            });

            //Once the transcription API has been initialised and the async task that listens to the response stream has been started, begin sending audio data to the transcription service
            socket.OnBinary = async (binaryData) => await APICall.WriteAsync(binaryData) //Every time a binary message is received, send it to the transcription service
        }
    }

Im Getting This Too

https://github.com/dotnet/runtime/issues/23803
please, change this line from netcoreapp2.0 to netcoreapp2.1 or above
https://github.com/statianzo/Fleck/blob/9683310579a5632aa3f8d3c9e0023674389b570d/src/Fleck/Fleck.csproj#L12

Still does not work :(


Move to Ruby 2.7+

Ruby 2.5 and 2.6 are unsupported and providing Ruby 3 compatibility is easier with Ruby 2.7 as the lower bound.
It should be noted that from testing it appears Ruby 3 support is broken. Should the upper bound be lower to < 3 for now?

Should the upper bound be lower to < 3 for now?

I'd say yes.

The diffs would be smaller if https://github.com/svenfuchs/safemode/pull/43 was merged, but I've updated it now.

Could we also drop lib/rubyparser_bug.rb while we're at it?

Done

Thank you @ekohl !


Working with React Native's propTypes

I have a React Native component BannerButton. The React propTypes should be:
BannerButton.propTypes = {
  title: PropTypes.string.isRequired,
  onPress: PropTypes.func.isRequired,
  style: View.propTypes.style,
  titleStyle: Text.propTypes.style,
  disabled: PropTypes.bool,
  disabledColor: PropTypes.string,
};

Now I want to use flowtype instead of propTypes. How do I get the flowtype from View.propTypes.style and Text.propTypes.style?
props: {
  title: string,
  onPress: Function,
  style: View.propTypes.style,  // No idea how to get the flowtype
  titleStyle: Text.propTypes.style,  // No idea how to get the flowtype
  disabled: boolean,
  disabledColor: string,
};

Did I do right?
UPDATED
There are more React Native propTypes need to be changed to flowtype. For example:
TouchableHighlight.propTypes.style
Image.propTypes.source

How can I find those flowtypes?

For a general style flow type, see https://github.com/flowtype/flow-typed/issues/631.

@blainekasten any idea where to find some documentation on this? I've been looking on both flow/react-native documentation but even these simple things do not seems to be mentioned anywhere. For example it seems like TextInput doesn't have the equivalent of the view props type. On the other hand TextInput apparently has a TextInput.propTypes but flow doesn't really seem to like it used as props type:
class CustomTextInput extends React.Component<TextInput.propTypes> {
...
}

Gives:

Cannot use propTypes as a type. A name can be used as a type only if it refers to a type, interface, class, or enum definition. To get the type of a non-class value, use typeof.Flow(value-as-type)

It looks to be defined here, but no clue on how to access this as end user. And I wouldn't like to have to check this every time I need to extend existing types. I remember working with flow 2 years ago was a nightmare but it looks even worse today. I guess nobody cares and people will just go without any static type checking because it's just too messy.
This is somewhat related to Are there any flow types definition for react-native styles?

This issue has been around since 2017. Flow has been upgraded in react native so types first is enabled by default which makes the need of this even bigger.
Why is there better support for TypeScript instead of flow today in react native? Or am I mistaking? Or maybe this is the wrong place to discuss this issue. But this is how it is discussed in the react native github page:
https://github.com/facebook/react-native/issues/26263
Poor guy tried 3 times in a month before stale bot did the work it does the best (remove issues of value that is ignored).
I am pretty sure my response here will waist a couple of minutes of my life along with others so I am not even sure why I try.

We no longer supports propTypes


GitHub Integration Does show that "pancho" wants to access my GitHub

I imagine you refer to the moment when you have to authorize the application on github. It says that "the application JsonFormsEditor by @pancho111203 is requesting access...".
This is intended as I'm using the tokens generated on the forked repository owned by me. If you want to use the tokens of the eclipsesource account, someone with admin access needs to generate them.
Although for developing it should be okay to use my repo.

@JonasHelming ping

https://github.com/settings/applications/new

@koegel As discussed, please create a JSON Forms Editor account under our organization that can be used to access github.

We need a way to externalize the key information in to another file outside of the github repository

Provide documentation and send to Maximilian

The documentation has been added in the second page of this file:
https://docs.google.com/document/d/12DRtV5CfoxCMhKwpNUv9j_O3EzNT5WAgvOZ3iGuF36A/edit#


Update manage-cluster-horizontal-scaling.md

changes in logic

@Gabilehner : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@orspod : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@Gabilehner - I reviewed your change and committed additional changes. Merging now.
Please make sure you make changes in dataexplorer-docs-pr. Follow email that I sent for more info.


In class BasicRFB_a

In class RFB_a branch_3 below block is different from original paper.
 self.branch3 = nn.Sequential(
     BasicConv(in_planes, inter_planes // 2, kernel_size=1, stride=1),
     BasicConv(inter_planes // 2, (inter_planes // 4) * 3, kernel_size=(1, 3), stride=1, padding=(0, 1)),
     BasicConv((inter_planes // 4) * 3, inter_planes, kernel_size=(3, 1), stride=stride, padding=(1, 0)),
     BasicConv(inter_planes, inter_planes, kernel_size=3, stride=1, padding=5, dilation=5, relu=False)
 )

I think this should be like
 self.branch3 = nn.Sequential(
      BasicConv(in_planes, inter_planes, kernel_size=1, stride=1),
      BasicConv(inter_planes, inter_planes, kernel_size=3, stride=1, padding=1),
      BasicConv(inter_planes, inter_planes, kernel_size=3, stride=1, padding=5, dilation=5, relu=False)
)

Is there any meaning in your work?  For example, It occurs better result or there are some issues, etc.
(Anyway why _a? , '_s' is original paper express...)
Thanks

Actually,
In class BasicRFB, below code is also different from the original paper.
I think you did to reduce the number of parameters. I guess.
        self.branch0 = nn.Sequential(
                BasicConv(in_planes, 2*inter_planes, kernel_size=1, stride=stride),
                BasicConv(2*inter_planes, 2*inter_planes, kernel_size=3, stride=1, padding=visual, dilation=visual, relu=False)
                )
        self.branch1 = nn.Sequential(
                BasicConv(in_planes, inter_planes, kernel_size=1, stride=1),
                BasicConv(inter_planes, 2*inter_planes, kernel_size=(3,3), stride=stride, padding=(1,1)),
                BasicConv(2*inter_planes, 2*inter_planes, kernel_size=3, stride=1, padding=visual+1, dilation=visual+1, relu=False)
                )
        self.branch2 = nn.Sequential(
                BasicConv(in_planes, inter_planes, kernel_size=1, stride=1),
                BasicConv(inter_planes, (inter_planes//2)*3, kernel_size=3, stride=1, padding=1),
                BasicConv((inter_planes//2)*3, 2*inter_planes, kernel_size=3, stride=stride, padding=1),
                BasicConv(2*inter_planes, 2*inter_planes, kernel_size=3, stride=1, padding=2*visual+1, dilation=2*visual+1, relu=False)
                )

        self.ConvLinear = BasicConv(6*inter_planes, out_planes, kernel_size=1, stride=1, relu=False)


Using correct versions for bundles

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/lgtm
@jonathanmeier5 this was a tiny bit missed

/approve


Why does MEMOTE give different numbers of energy generating cycle reactions?

The first time I generated a MEMOTE report with the erroneous energy generating cycle tests not all being skipped (but my catch for if a metabolite was present or not wasn't working, so nothing skipped, just errored), I got that there were >150 reactions involved in ATP generating cycles.

Then, when I fixed that if statement bug (so metabolites skipped rather than erroring if they aren't present), I got that there were 84 reactions involved in ATP generating cycles:

And I continued to get that when I ran my GitHub action several times.
Then I merged by ms2-model branch into main, and got >170 reactions:

And when I try to run MEMOTE locally (using the pip installable MEMOTE- not my branch, so I'm just using running the function once for ATP, I get a lot fewer reactions):

Just as a sanity check, I made sure the model files were the same on the main branch and on the cycles branch, which was giving two different numbers in the MEMOTE report.
When I checked the diff, there was no difference in the model file:

To be able to test this more easily (and not have to run GitHub actions for everything) I made a new conda environment called my-memote that runs MEMOTE (specifically and editable install from my local copy).

I tried just using the consistency.detect_energy_generating_cycles function directly with this code:
import cobra
import memote.support.consistency as consistency

# Load the model
model = cobra.io.read_sbml_model("model.xml")

met = "MNXM3"  # ATP

print("Finding ATP generating cycles")
print("----------------------------")
# For a specfied number of times
for i in range(0, 10):
    # Make a copy of the model
    model_copy = model.copy()
    # Run just the function for finding ATP generating cycles
    rxns = consistency.detect_energy_generating_cycles(model_copy, met)
    # Print the results
    print(rxns)

But each run gave the same results:

Then I ran the whole snapshot generation command 10 times with this code:
import subprocess

# Loop the number of times you want to run memote
for i in range(0, 10):
    # Define the output file name
    output_file = "report_" + str(i) + ".html"

    # Define the command as a list of strings
    command = [
        "memote",
        "report",
        "snapshot",
        "--filename",
        output_file,
        "model.xml",
    ]

    # Run the command using subprocess
    process = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.PIPE)

    # Wait for the process to finish
    stdout, stderr = process.communicate()

And got a whole range of values (all much higher than 3):

152
198
160
160
164
160
160
84
164
144

Daniel say to:

Do some debugging/print statements, to figure out how exactly the HTML report is being generated. Is the Erroneous energy generating cycles section really using the function I think it is?

I had to add a few things to various init.py files to be able to actually run the snapshot function from python, but when I put debug breakpoints I verified that the snapshot function was doing what I thought it was, but that the majority of reactions returned had a tiny flux (10^-48 tiny). When I increased the flux > 0 to flux > 0.001, I got the same three reactions I got when I ran just the detect_energy_generating_cycles function locally.
Not sure how that gave different results when running the snapshot function versus running just that one function, but I think that may just be down in the actual CS weeds.

I changed the code to use the TOLERANCE_THRESHOLD variable which was already set and being used in other consistency checks:


[Feature] Support Volcano for batch scheduling

This PR is based on the branch created by @loleek and the Spark Operator integration with Volcano.
Why are these changes needed?
To enable advanced multi-tenancy features for running multiple Ray cluster in a shared environment.
Related issue number
Closes #697
Checks

[ ] I've made sure the tests are passing.
Testing Strategy

[ ] Unit tests
[ ] Manual tests
[ ] This PR is not tested :(

Thank @tgaddair for this contribution!
In my opinion, KubeRay shouldn't be too opinionated about external tools. Maybe the better solution is to make sure the exposed interfaces are enough for users to configure which tools they want to use. cc @DmitriGekhtman @Jeffwan

I will help review this as well.

As @tgaddair explained yesterday, the reason "native" integration is required is that Volcano requires creation of a podgroup with an owner reference to the RayCluster CR before the RayCluster's pods are reconciled.
I think all of this is reasonable. We should probably take some steps to mitigate the risk from increased code complexity.
Some things that would need to be done to merge this:

Use an annotation to toggle batch scheduling support, rather than an operator flag.
Express this feature in a modular way that would allow plugging other batch schedulers.
Write some CI tests.
Do some manual testing and record the testing steps in this PR's comment thread.
Document this support in the "features" section. In that section, identify yourself as the maintainer of this integration (see the note here for an example).

@Jeffwan thanks for the review! I made some updates to make the implementation more general, so we can add in additional schedulers in the future. This also makes the implementation consistent with the Spark Operator, which follows a similar convention. I'll take some time to address your comments and ensure tests are passing.

In addition to the Helm configuration, it would be great to also add a kustomize overlay with kuberay/ray-operator/config/default as the base.

In addition to the Helm configuration, it would be great to also add a kustomize overlay with kuberay/ray-operator/config/default as the base.

On second thought, never mind. Duplicate Helm and Kustomize versions of all custom configs would be annoying to maintain!

For the docs, could you document a simple example workflow that demonstrates the gang scheduling functionality?
That would help people understand the usefulness of this integration. It'd also serve as a manual (later, automated) e2e test of the integration.

Hey @DmitriGekhtman, thanks for the great feedback. I added a pretty complete end-to-end example in the docs, and verified it worked as written. Let me know what you think!
I believe this PR should be good to go at this point.

Looks great, one last suggestion concerning memory allocation for the Ray head pod.

Thanks @DmitriGekhtman, updated the example to use 2Gi of RAM for the head node.

oops, looks like I leave comments late. @tgaddair feel free to have follow up pr to address, Thank you for the contribution!

Sorry, @sihanwang41, I was a bit trigger happy!
@tgaddair feel free to follow-up on Sihan's documentation comments in another PR!

Thanks @sihanwang41, will update in a follow-up that also fixes a typo in the example.

@sihanwang41 addressed comments in #776.

The document is very detailed! Thank @tgaddair for this high-quality contribution!
I feel risky to merge this big feature into the master at the last minute of the v0.4.0 branch cut. Will we add this PR into release v0.4.0 or move it to the next release? cc @DmitriGekhtman @sihanwang41
Risk:

Although this feature is disabled by default, we do not have a chance to update the exposed interfaces if we release in v0.4.0.
We do not know the Kubernetes compatibility for Volcano. (https://github.com/ray-project/kuberay/issues/213#issuecomment-1144914264 => I am not sure about the accuracy of this comment, but we need to be serious about it.)

Any thoughts? Thanks!

Thanks @kevin85421, these are reasonable concerns!
I think the key priority for the release will be testing compatibility of core, stable functionality (the operator and especially the KubeRay operator) against a range of Kubernetes versions. This integration is an alpha feature.
Also, eventually, we need automated tools to validate a Kubernetes compatibility matrix -- I think that's tracked somewhere.


Undefined method getEditor

I'm using Summernote 0.6.9, and in this version the method $.summernote.eventHandler.getEditor is undefined.
It's on file src/summernote-ext-emoji.js, line 13:
var editor = $.summernote.eventHandler.getEditor();
Is this var used?

I didn't upgrade to latest summernote. Just tested and that var is not used, so you can safely remove it.


Reshuffling large amount of parquet files blows up worker memory

I have a large dataset split up to around 400k different parquet files.
I want to reshuffle to group data by a specific column.
Lets say schema is (all columns are text):
username, first name, last name, location
And files are grouped by last name (i have a file with data for each last name) - file size ranges between 5K and 5M.
Now I need to group files by location (do bulk operations on each location)
Since the entire dataset doesn't fit in the shared memory of all my machines in the cluster (I have about 40GB shared amongst ~10 workers) - i thought processing chunks of files, reshuffle them and write intermediate results partitioned based on the 'location' column - creating multiple partitions for each column value.
Then go through each location, and repartition them to have better fitting files (less files, not too large)
But the problem is that after a few chunks the memory in the workers starts to fill up (causing workers to slow down) until eventual freeze.
My code looks like this:
def fdata_read(path, file_data):
    df = pd.read_parquet(path)
    df['first_name'] = file_data.first_name
    df['last_name'] = file_data.last_name
    return df

def process_chunk(file_iterator, n=100):
    file_data = itertools.islice(file_iterator, n)
    if not file_data:
        return None
    df = dd.from_delayed([delayed(fdata_read)(file_data) for file_data in file_list])
    df = df.apply(lambda x: pd.Series({
        'location': x.full_location.split('_')[0].lower(),
        'hash': x.hash[:8],
        'first_name': x.first_name,
        'last_name': x.last_name,
    }), axis=1, meta={'location': 'object', 'hash': 'object', 'first_name': 'object', 'last_name': 'object})

    df = df.set_index('location', drop=False)
    d = df.to_parquet('s3://my_bucket/result', partition_on=[location'], compute=False)
    return d

while True:
   f = process_chunk(file_iterator)
   if not f: break
   f.compute()

What do you observe on the dashboard during the computation?
I probably won't have a chance to look at this personally, until a minimal example is provided (which may end up identifying where things are going wrong).
Is s3 necessary, or do you observe the same behavior with the local file system?

I tried minimizing this to the following:
p = s3://path/to/src
for i in range(10_000):
    df = dd.read_parquet([p]*10)
    df.set_index('location')
    df.to_parquet('s3://path/to/dst', partition_on=['location'])

I think it can work with almost any parquet file (mine had about 100 rows and three columns) - as long as 'location' is not sorted.
The issue that I'm seeing in the dashboard is the memory tab keep growing, for ever (even after the loop is finished).
With very large datasets it grows until it becomes orange, and reaches the 80% area (where it stops working until it finishes writing to disk - in my case, there isn't much space on the workers hd so it freezes)

I'm not sure how it behaves locally

Ok - the following reproduces on LocalCluster:
for i in range(1_000_000):
    d = dd.from_pandas(pd.DataFrame({'datetime': ['2000-01-03', '2000-01-02']*10_000, 'id': [1, 2]*10_000, 'location': ['United States', 'Madagaskar']*10_000}), npartitions=20)
    d.to_parquet('s3://vdoo-binary-analysis-data/tmp/test2', partition_on=['location'])

It doesn't happen when target is local drive but does when target is s3 (this was test on MacOS)
When opening bokeh we can see that Bytes stored counter never decreases (the leak is also disable through ps/process monitor or whatever)

@martindurant any response here?  Are you still tracking this issue?  Is there further information that @talz needs to provide to be helpful here?

I have not had a chance to look into this. From the description, it sounds like s3fs is keeping hold of memory, at least in the way it is being used by Dask. I don't have an idea of why this might happen. Presumably, if the behaviour also occurs in the single-threaded scheduler, there would be a good chance to track down the source.


⚠ Bofrost.de has degraded performance

In ff8bbcf, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1622 ms

Resolved: Bofrost.de performance has improved in 3efd4f2.


Branch 2.0

What changes were proposed in this pull request?
Fixed missing closing bracket in branch-2.0 line:1704 of DataFrameSuite.scala which was found during ./dev/make-distribution.sh
[warn] Pruning sources from previous analysis, due to incompatible CompileSetup.
[info] Compiling 174 Scala sources and 19 Java sources to /Users/wesleyfabella/Documents/projects/RLE-CloudTeam/spark/sql/core/target/scala-2.11/test-classes...
[error] /Users/wesleyfabella/Documents/projects/RLE-CloudTeam/spark/sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala:1704: Missing closing brace `}' assumed here
[error] }
[error] ^
[error] one error found
[error] Compile failed at Mar 11, 2017 2:36:12 PM [0.610s]
How was this patch tested?
Tested:
$SPARK_SRC/spark/sql/core/target/scala-2.11/test-classes...
Successful Build:
$SPARK_SRC/dev/make-distribution.sh --tgz -Psparkr -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn
Please review http://spark.apache.org/contributing.html before opening a pull request.

Can one of the admins verify this patch?