inputText is typing too fast and skipping characters when app stutters/jank

When running with Android emulator and calling inputText, it appears that the app suffers some stutter or jank and the command misses some characters. For example:
When executing inputText to type Lorem ipsum, sometimes it'll actually type Loemipsu. The skipped characters are random, so it does not appear to be a keyboard auto-correction. Sometimes, the same test will type characters correctly and tests will succeed.
I've tested that on debug builds, which are not optimized and the app can suffer from stutters or jank, and the problem is more frequent, but the same also works with an optimized release build.
My (hopefully) temporary workaround for this is to have one command per character, like this:
- inputText: "l"
- inputText: "o"
- inputText: "r"
- inputText: "e"
- inputText: "m"

Is there any way to set typing or command speed? If not, this could be a possible implementation for cases like this. E2E should have some breathing space when typing to avoid errors like this.

@edgarlealbd is your problem maybe happening inside an Android webview, like some webform or login screen inside the app?

@pwicherski the typing in question is not happening inside a WebView. The app is built with Flutter.

Update: I can't reproduce the error locally with an Android 10 emulator, only with an Android 12 (API 31).

We've opened up a fix for this. The fix should be included in the next release of Maestro once this is landed #417

Hey @edgarlealbd @pwicherski
I have just merged the fix can you upgrade the local maestro to head and try these commands to check if this is fixed. Would recommend to do it multiple times as this was inconsistent.  To upgrade:
 brew uninstall maestro
 brew install maestro-head --HEAD

Let me know if this works will release this in the new version
To go back on stable after checking
 brew uninstall maestro
 brew install maestro

@amanjeetsingh150 I'm getting java-related errors when running with the head version from homebrew:
I have a Mac Pro M1 Max.
Exception in thread "main" java.lang.UnsupportedClassVersionError: maestro_android/MaestroDriverGrpc has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:756)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	at maestro.drivers.AndroidDriver.<init>(AndroidDriver.kt:65)
	at maestro.Maestro$Companion.android(Maestro.kt:402)
	at maestro.Maestro$Companion.android$default(Maestro.kt:401)
	at maestro.cli.util.MaestroFactory.createMaestro(MaestroFactory.kt:40)
	at maestro.cli.command.TestCommand.call(TestCommand.kt:74)
	at maestro.cli.command.TestCommand.call(TestCommand.kt:36)
	at picocli.CommandLine.executeUserObject(CommandLine.java:1933)
	at picocli.CommandLine.access$1200(CommandLine.java:145)
	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2332)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2326)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2291)
	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2159)
	at picocli.CommandLine.execute(CommandLine.java:2058)
	at maestro.cli.AppKt.main(App.kt:109)

Hey @edgarlealbd , have created fix for this can you try with latest head again by:
brew uninstall maestro-head
brew install maestro-head --HEAD

Hey @edgarlealbd can you confirm that the latest version works fine for you?

@amanjeetsingh150 I thought that I already commented this out. It's is working fine now.

Awesome @edgarfroes thanks 🙌

Hey @amanjeetsingh150 - this, or similar is still happening - installed Maestro today - using RN, pretty small app right now
Video below - let me know if you need anymore details?
https://user-images.githubusercontent.com/13877025/215972194-a7ba6890-ea3a-4944-8341-ccec9fea8ff4.mp4

Hey, @janyk @artem888 is working on a fix here. Should be fixed by this: https://github.com/mobile-dev-inc/maestro/pull/720. Can you open a separate issue though for this it will be easy to follow up.

Same here

I'm seeing the same issue with v1.26.0

Workaround:
Create sub-flow myInput.yaml:
appId: com.myapp
env:
  TEXT: ${TEXT}
  ATTEMPTS_LIMIT: ${ATTEMPTS_LIMIT || 5}
---
- evalScript: ${output.status = 'unknown'}
- evalScript: ${output.attempt = 1}
- repeat:
    while:
      true: ${output.status === 'unknown'}
    commands:
      - inputText: "${TEXT}" # Fill text field

      - runFlow:
          when:
            visible: "${TEXT}" # check if entered text is correct
          commands:
            - evalScript: ${output.status = 'success'}

      - runFlow:
          when:
            true: ${output.status != 'success'}
          commands:
            - eraseText # Clear text field

      - evalScript: ${output.attempt = output.attempt + 1}
      - runFlow:
          when:
            true: ${output.attempt >= ATTEMPTS_LIMIT}
          commands:
            - evalScript: ${output.status = 'timeout'}

And then use that sub-flow instead of inputText:
- runFlow:
    file: myInput.yaml
    env:
      TEXT: "My text"
      ATTEMPTS_LIMIT: 3 # optional (by default 5)

I'm facing the same issue in version 1.26.1
And I have this behaviour not only for - inputText: command, but for - 'inputRandomEmail' command too.

'inputRandomEmail' command typing invalid emails sometimes and I think because of the same reason as inputText:
I don't know if this is possible, but visually it looks like the print in the input is filling in two places, as if there are two cursors in the input.

instead of<EMAIL_ADDRESS>I got<EMAIL_ADDRESS>

I am seeing a slightly different, but potentially related issue. I have the following flow:
appId: com.machinelink.contractorselogs
---

- tapOn: "Username"
- inputText: "Ethan"
- tapOn: "Password"
- inputText: "blklbl"
- tapOn: "Sign In"
- assertVisible: .*Current Duty Status.*

What I am seeing is that the flow usually works without issue. However, every so often (on ~20% of runs or somewhere in that ballpark) an extra "y" will be added at the end of the password, causing the test to fail (since it becomes the wrong password with a "y" at the end). It is always a "y" character for some reason. I can open a separate issue if that makes sense, but thought it might be related to this existing issue.

@lossen @el-ethan does this happen on Android or on iOS? If this is an issue on iOS, please file a new bug report with as much details as possible and we'll take it from there to reduce noise in this issue.

Typing a couple of characters at a time seems to work well:
- tapOn: 'Email address'
- inputText: 'si'
- inputText: 'mon'
- inputText: '+'
- inputText: 'em'
- inputText: 'ail'
- inputText: '@'
- inputText: 'coo'
- inputText: 'kin'
- inputText: '.com'

instead of
- tapOn: 'Email address'
- inputText<EMAIL_ADDRESS>
Looking forward to seeing this PR merged though 🤞

Any news on this?

+1

hey folks! we applied one more fix, which hopefully should fix majority of the issues with inputText. it's going to be released in the next maestro cli version

sweet! that's exciting, thanks for working on this issue. is there a planned release date for that version?

sweet! that's exciting, thanks for working on this issue. is there a planned release date for that version?

we're planning to release it early next week

sounds good. by any chance is this fix to inputText going to also touch eraseText? That one seems to be pretty buggy in maestro cloud as well, but maybe it's a related issue.

@ferdy-roz  not really, since eraseText is a separate command. but might be flaky for similar reasons, going to check that

Looks like inputText might be fixed, but yes eraseText still has issue in Maestro Cloud

@ferdy-roz that's good to hear, I'll try to fix eraseText in the next version. can you please provide me with uploadId or appId for the failing maestro cloud upload?

@artem888 where do I find that in the cloud console?

@ferdy-roz should be a part of the console link, i.e.

@ferdy-roz You can also simply provide a link to an Upload details page in your Cloud console where this error happens if that is easier 🙂

@artem888 got one today: efaf4b2b-73f0-43df-ba49-0b1e8d39beca&analysisId=bcc544be-addf-4943-ba36-6d7ce7fb1427

Are there certain API levels that this could not work in? I haven't had any issues prior, working on API 33, but now I've gone down to API 29 I'm noticing it consistently, on fresh boots of the device.
Maestro version: 1.31
Phone: Pixel 5
API level: 29
If you need any more info just let me know

I'm getting the same issue on a webview. When using inputText some characters are not typed.
I am running the Webview inside of a Flutter app.
Maestro: 1.33.1
Android 11
Pixel 3a
Virtual device
This is quite painful as I do not wish to split up the password and username that comes from environment variables into multiple inputText commands.

I'm also confronted with the issue in a React Native app. It happens around 40% of the test runs, but it always occurs around the + symbol. See screenshot.

It's either the above, or the first e that gets placed at the end of the email, resulting in<EMAIL_ADDRESS>This raises concern in if the password that gets typed in is also correct, since that contains much more special characters too.
Environment Details

System:
OS: macOS 13.5.1
CPU: (12) arm64 Apple M2 Pro
Memory: 495.14 MB / 32.00 GB
Shell:
version: "5.9"
path: /bin/zsh
Binaries:
Node:
version: 18.17.1
path: /var/folders/xf/zkm337511h90gglzjm93phk80000gn/T/yarn--1698054147244-0.21111488938809386/node
Yarn:
version: 1.22.19
path: /var/folders/xf/zkm337511h90gglzjm93phk80000gn/T/yarn--1698054147244-0.21111488938809386/yarn
npm:
version: 9.6.7
path: ~/.nvm/versions/node/v18.17.1/bin/npm
Watchman:
version: 2<IP_ADDRESS>
path: /opt/homebrew/bin/watchman
Managers:
CocoaPods:
version: 1.13.0
path: /Users/gunnark/.rvm/gems/ruby-3.2.1/bin/pod
SDKs:
iOS SDK:
Platforms:
- DriverKit 23.0
- iOS 17.0
- macOS 14.0
- tvOS 17.0
- watchOS 10.0
Android SDK: Not Found
IDEs:
Android Studio: 2022.3 AI-223.8836.35.2231.10671973
Xcode:
version: 15.0/15A240d
path: /usr/bin/xcodebuild
Languages:
Java:
version: 11.0.20
path: /usr/bin/javac
Ruby:
version: 3.2.1
path: /Users/gunnark/.rvm/rubies/ruby-3.2.1/bin/ruby
npmPackages:
"@react-native-community/cli": Not Found
react:
installed: 18.2.0
wanted: 18.2.0
react-native:
installed: 0.72.4
wanted: 0.72.4
react-native-macos: Not Found
npmGlobalPackages:
"react-native": Not Found
Android:
hermesEnabled: true
newArchEnabled: false
iOS:
hermesEnabled: true
newArchEnabled: false

+1
We're also facing this issue on Android/flutter based app. Sometimes the inputText miss some chars and the flow fails.
Maestro v1.34.1
Platform: Android / Flutter

Hey folks, is anyone able to provide a reproduction scenario of this happening on Android? I understand that the issue seems to be flaky which makes it very hard to debug on our end, so would appreciate if anyone could share an app binary and Flow where this happens with me<EMAIL_ADDRESS>and we'll see whether we can reproduce and come up with a fix. Thanks!

I found the same issue today in maestro cloud.

Thats the cloud link: https://console.mobile.dev/uploads/6739cd0f-8c2a-4f61-a721-f688a094737e?teamId=43872dfc-a4b8-4040-9de5-2ec41fc01754&appId=551173e3-eefd-4185-a865-048b6f2861fa&analysisId=a5cb3836-8d05-46d5-84da-4e2e73ac2682&checkIdx=2

I am seeing a slightly different, but potentially related issue. I have the following flow:
appId: my-app
---

- tapOn: "Username"
- inputText: "Ethan"
- tapOn: "Password"
- inputText: "blklbl"
- tapOn: "Sign In"
- assertVisible: .*Current Duty Status.*

What I am seeing is that the flow usually works without issue. However, every so often (on ~20% of runs or somewhere in that ballpark) an extra "y" will be added at the end of the password, causing the test to fail (since it becomes the wrong password with a "y" at the end). It is always a "y" character for some reason. I can open a separate issue if that makes sense, but thought it might be related to this existing issue.

Im having exactly this issue on android

I am seeing a slightly different, but potentially related issue. I have the following flow:
appId: my-app
---

- tapOn: "Username"
- inputText: "Ethan"
- tapOn: "Password"
- inputText: "blklbl"
- tapOn: "Sign In"
- assertVisible: .*Current Duty Status.*

What I am seeing is that the flow usually works without issue. However, every so often (on ~20% of runs or somewhere in that ballpark) an extra "y" will be added at the end of the password, causing the test to fail (since it becomes the wrong password with a "y" at the end). It is always a "y" character for some reason. I can open a separate issue if that makes sense, but thought it might be related to this existing issue.

Looks like using android SDK 34 resolves this issue:
maestro cloud  --android-api-level 34 tests/
I ran 15+ test runs in maestro cloud without problems. Have not tested with Android SDK 31-33. Shout out to @Fishbowler for his help debugging this.

Hey guys, any updates on this, I'm still experiencing it, the following is a screenshot from Maestro Cloud

I am using this version and facing issue on textinput , It's filling email/text to fast and wording almost not showing correct .
Do we have any option to slow down it's speed
"react-native": "0.74.2",
maestro --version : 1.37.9

Typing a couple of characters at a time seems to work well:
- tapOn: 'Email address'
- inputText: 'si'
- inputText: 'mon'
- inputText: '+'
- inputText: 'em'
- inputText: 'ail'
- inputText: '@'
- inputText: 'coo'
- inputText: 'kin'
- inputText: '.com'

instead of
- tapOn: 'Email address'
- inputText<EMAIL_ADDRESS>
Looking forward to seeing this PR merged though 🤞

This trick works for me Thanks

Hi guys! Any news on this? I am stuck with running tests on Maestro because of this. I believe that a simple option to slow down typing would already be enough for the moment

In the meantime, I created a util that types characters three-at-a-time:
# maestro/utils/inputTextSlowly.yaml
appId: my.app
---
- evalScript: ${output.index = 0}
- evalScript: ${output.chunkSize = 3}
- repeat:
    while:
      true: ${output.index < TEXT.length}
    commands:
      - inputText: ${TEXT.slice(output.index, output.index + output.chunkSize)}
      - evalScript: ${output.index = output.index + output.chunkSize}

Then I used it in my flows that needed the text to be accurate:
# maestro/flow/example.yaml
appId: my.app
---
- runFlow:
     file: ../utils/inputTextSlowly.yaml
     env:
       TEXT: This is what I want to type


Disable custom movement

I dont wanna move items into different columns but still can re-order item likka move item up and down in own column
Example :

FORM INPUT cannot move into PDF Fields
PDF INPUT cannot move into FORM Fields

My Source Code : index.js
I wanna know that how to do it ... Thankx

Rename groupName of each container


chore(main): release 0.20.0

:robot: I have created a release beep boop
0.20.0 (2023-03-16)
Features

chart: less barWidth (ea1470f)
dio: addSentry (65a4b0d)
heart-rate: 10s -> 5 QRSs (25fd505)
heart-rate: show progress (9f44033), closes #199

Bug Fixes

deps: update dependency sentry_flutter to v7 (#206) (c460f33)
deps: update dependency sentry_logging to v7 (#207) (de73885)
heart-rate: 4s learning & 1 beat (b6bf0cf)
heart-rate: reset start time & buffer when rebuild (12e75cf)
heart-rate: update PanTompkinsQRS (91c80eb)

Reverts

make HeartRateData public again (6e2c8b9)

Miscellaneous Chores

deps: update dependency all_lint_rules_community to ^0.0.26 (#205) (5063487)

Code Refactoring

heart-rate: make HeartRateData private (3b7d055)
heart-rate: make HeartRateData visible for testing (a4f9286)
heart-rate: rename HeartRate to HeartRateWidget (6595ccb)
heart-rate: rename heartRateUnit to bpm (5ff4d2a)
heart-rate: rename rate to data (19024b9)
use DateTime instead of double for EcgData.time (#202) (843d723)

Tests

heart-rate: add test for HeartRateData (98b1eff)

Build System

flutter pub add sentry_dio (11fe38c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/CCXXXI/ecg_monitor/releases/tag/v0.20.0 :sunflower:


Quick click issue when during offcanvas opening

Prerequisites

[X] I have searched for duplicate or closed issues
[X] I have validated any HTML to avoid common problems
[X] I have read the contributing guidelines

Describe the issue
When trying to open offcanvas and during opening transition clicking outside the offcanvas area, instead of slide and hide offcanvas smoothly, the screen was flushing and offcanvas markup crashing, and finally hiding without transition.
Reduced test cases

Go to the official documentation page
Quick double click to offcanvas demo buttons: "Link with href" or "Button with data-bs-target"
You can see the visual issue

What operating system(s) are you seeing the problem on?
Windows, Linux
What browser(s) are you seeing the problem on?
Chrome, Firefox
What version of Bootstrap are you using?
5.3

A potential solution could involve adding a debounce function to the offcanvas close event handler to prevent it from triggering while the open animation is still in progress. Additionally, checking the state of the offcanvas (whether fully opened) before allowing it to close could help manage this issue


Shared cache is racy

Shared cache implementation currently takes a lock, checks whether item is absent, releases the lock, takes the lock again, and only then inserts the item.
The problem is that in some scenarios another call to the same function can come in between those operations and take the lock, leading to racing errors.
It should instead hold the lock for the duration of the entire function.

The reason it's done like that is #3 - the lock cannot be held while calling the original function, because it might again call the memoizer.
So, either be racy or work on recursive functions. To me, the latter is much more useful, and typical for applications. If I understand correctly, the worst case of a race here is that the underlying function will be called twice instead of once, and the result (which will be identical) will be inserted twice. Which is not a terrible outcome, and not an error either (because all hashmap accesses are still synchronized).
What do you think?

If I understand correctly, the worst case of a race here is that the underlying function will be called twice instead of once

Yes, this is the problem, because I'm using memoization specifically to ensure that given function is called only once for given arguments (I'm working with a database, so unique key -> call really matters in this scenario).
For now I'm using custom memoization in a bunch of places with a manual static + Mutex + Option + HashMap in each function but I wanted to switch to this crate for nicer DX, but then ran into this issue where racing caused duplicate calls.
IMO guaranteeing that function is called only once for given arguments is usually a more important property of memoization than recursive calls, but I believe you can have both properties if you wrap not only HashMap itself, but also values into something like Arc<OnceLock<...>>.
Then you'd only need to hold a global HashMap mutex shortly - to insert an uninitialized OnceLock "cell", and after that you can init it which is guaranteed to happen only once. This will allow other calls to the same functions to succeed recursively without deadlocking.


Implement another variant of the Hückel guess

Implements another variant of the Hückel guess based on the updated GWH rule from doi:10.1021/ja00480a005

Thanks Susi! It seems that there are some test failures.

Thanks Susi! It seems that there are some test failures.

Cheers; I just copy-pasted the Hückel reference values. Should work now

There is one test failure which is unrelated to this PR and appears to only happen on two builders:
FAILED pyscf/ci/test/test_gcisd.py::KnownValues::test_contract - AssertionError: 91.99837289004502 != -102.17887236599671 within 9 places<PHONE_NUMBER>5604172 difference)

please fix the lint errors

please fix the lint errors

done


Step 2/10 : FROM mysql:${MYSQL_VERSION}

Info:

Docker version ($ docker --version):
Laradock commit ($ git rev-parse HEAD):
System info (PC):
System info disto/version:

Issue:

ERROR: Service 'mysql' failed to build: Get https://registry-1.docker.io/v2/library/mysql/manifests/8.0: unauthorized: incorrect username or password

Expected behavior:

Reproduce:

Relevant Code:
// place a code sample here

This ticket needs more information so that we can proceed with offer assistance.  If you can supply the necessary details as outlined in the issue request, we can address it easier
In addition, if you could please supply your version of .env and docker-compose.yml that would be helpful


Add code for reusable load from files component #290

This PR contains code for load from files component related to #290

Ya sure, I'll do those changes and push. I couldn't test the component locally but I tested it's core components like get_file_handler and FilesToDaskConverter on a local zip file. In fact, I wanted to ask you how can I test the component using docker on my local machine

Have you followed our Getting Started tutorial? It should help you run a pipeline locally. You can then create a pipeline with your component to test it the same way.

@RobbeSneyders, I have update the component with all suggested changes. Please review it

Did you manage to run your component in a pipeline locally? (using the local runner)

Did you manage to run your component in a pipeline locally? (using the local runner)

@GeorgesLorre, I tried running it locally, but Im getting this error
(env) ➜  load_from_hf_hub git:(add_load_from_files_component) fondant run pipeline:my_pipeline --local
unknown shorthand flag: 'f' in -f
See 'docker --help'.

Usage:  docker [OPTIONS] COMMAND```

I even tried existing running existing components for them also Im getting same error

Did you manage to run your component in a pipeline locally? (using the local runner)

@GeorgesLorre, I tried running it locally, but Im getting this error
(env) ➜  load_from_hf_hub git:(add_load_from_files_component) fondant run pipeline:my_pipeline --local
unknown shorthand flag: 'f' in -f
See 'docker --help'.

Usage:  docker [OPTIONS] COMMAND```

I even tried existing running existing components for them also Im getting same error

Do you have docker-compose installed and if so which version ?

Yes, I do have docker compose and this is the verions
docker-compose version 1.29.2, build unknown

Seems like a really old version ? Is that possible ? I have Docker Compose version v2.19.1
What OS are you using ?

Yes, I do have docker compose and this is the verions
docker-compose version 1.29.2, build unknown

Seems like a really old version ? Is that possible ? I have Docker Compose version v2.19.1
What OS are you using ?

Im using Ubuntu 22.04.02 LTS

Yes, I do have docker compose and this is the verions
docker-compose version 1.29.2, build unknown

Seems like a really old version ? Is that possible ? I have Docker Compose version v2.19.1
What OS are you using ?

Im using Ubuntu 22.04.02 LTS

Can you try updating or installing to the latest docker-compose ? And try running the pipeline again

Yes, I do have docker compose and this is the verions
docker-compose version 1.29.2, build unknown

Seems like a really old version ? Is that possible ? I have Docker Compose version v2.19.1
What OS are you using ?

Im using Ubuntu 22.04.02 LTS

Can you try updating or installing to the latest docker-compose ? And try running the pipeline again

Ill test on Mac with latest docker compose

Yes, I do have docker compose and this is the verions
docker-compose version 1.29.2, build unknown

Seems like a really old version ? Is that possible ? I have Docker Compose version v2.19.1
What OS are you using ?

Im using Ubuntu 22.04.02 LTS

Can you try updating or installing to the latest docker-compose ? And try running the pipeline again

Ill test on Mac with latest docker compose

@GeorgesLorre , I tried to run this with docker compose Docker Compose version 2.20.2 using
Dir structure
./
----> pipeline.py
----> components
                ---->load_from_files
                               -----> fondant_component.yml

pipeline.py
from fondant.pipeline import Pipeline, ComponentOp

my_pipeline = Pipeline(
    pipeline_name='my_pipeline',
    base_path='/',  # TODO: update this
    pipeline_description='This is my pipeline',
)

load_from_files = ComponentOp(
    component_spec_path='./components/load_from_files/fondant_component.yml',
    arguments={
        'directory_uri': './data.zip',
    }
)

my_pipeline.add_op(load_from_files, dependencies=[])

*Running the pipeline using *
fondant run pipeline:my_pipeline --local
It is creating this docker compose file
services:
  load_from_files:
    build: ./components/load_from_files
    command:
    - --metadata
    - '{"run_id": "my_pipeline-20230724190932", "base_path": "/"}'
    - --output_manifest_path
    - //load_from_files/manifest.json
    - --directory_uri
    - ./data.zip
    - --component_spec
    - '{"name": "Load from files", "description": "Component that loads a dataset
      from files", "image": "ghcr.io/ml6team/load_from_files:dev", "produces": {"file":
      {"fields": {"content": {"type": "binary"}}}}, "args": {"directory_uri": {"description":
      "Local or remote path to the directory containing the files", "type": "str"}}}'
    depends_on: {}
    volumes:
    - source: /
      target: /
      type: bind
version: '3.8'

But it is failing with this error
[2023-07-24 19:20:00,169 | root | INFO] Found reference to un-compiled pipeline... compiling to {spec_ref}
[2023-07-24 19:20:00,169 | fondant.compiler | INFO] Compiling my_pipeline to docker-compose.yml
[2023-07-24 19:20:00,169 | fondant.compiler | INFO] Base path found on local system, setting up / as mount volume
[2023-07-24 19:20:00,169 | fondant.compiler | INFO] Compiling service for Load from files
[2023-07-24 19:20:00,170 | fondant.compiler | INFO] Successfully compiled to docker-compose.yml
[+] Building 0.0s (2/2) FINISHED
 => [load_from_files internal] load build definition from Dockerfile                                                                                0.0s
 => => transferring dockerfile: 2B                                                                                0.0s
 => [load_from_files internal] load .dockerignore                                                                                0.0s
 => => transferring context: 2B                                                                                0.0s
failed to solve: failed to read dockerfile: open /var/lib/docker/tmp/buildkit-mount2544504493/Dockerfile: no such file or directory

Do you have a Dockerfile in ./components/load_from_files ?

No Should we create one? Because it is not mentioned in Docs

Do you have a Dockerfile in ./components/load_from_files ?

No Should we create one? Because it is not mentioned in Docs

So normally the images already exist for reusable components (in your case ghcr.io/ml6team/load_from_files:dev) but this is not yet the case so for easy testing of your component I would treat it as a custom one:
So something like this: (you can
.
├── components
│   ├── load_from_files
│   │   ├── Dockerfile
│   │   ├── fondant_component.yaml
│   │   ├── requirements.txt
│   │   └── src
│   │       └── main.py
└── pipeline.py

The local runner will then build the component locally and run it which allows you to test it once everything works we can abstract it to a reusable component.

I'm also having a bit of difficulties reviewing your code since the files changed section contains a lot of changes that are already in our main branch. I'm not 100% sure why these changes are also displayed. Can you try updating your branch so only the real changes are visible?
https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork
https://stackoverflow.com/questions/16306012/github-pull-request-showing-commits-that-are-already-in-target-branch
Again I'm also unsure why this happens but I'm sure we can figure this out together.

I'm also having a bit of difficulties reviewing your code since the files changed section contains a lot of changes that are already in our main branch. I'm not 100% sure why these changes are also displayed. Can you try updating your branch so only the real changes are visible?
https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork https://stackoverflow.com/questions/16306012/github-pull-request-showing-commits-that-are-already-in-target-branch
Again I'm also unsure why this happens but I'm sure we can figure this out together.

That's because I have been taking pull from main branch before I pushed the code, so that during merge it will easier without any issues since my branch will be uptodate with the new changes in main

I'm also having a bit of difficulties reviewing your code since the files changed section contains a lot of changes that are already in our main branch. I'm not 100% sure why these changes are also displayed. Can you try updating your branch so only the real changes are visible?
https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork https://stackoverflow.com/questions/16306012/github-pull-request-showing-commits-that-are-already-in-target-branch
Again I'm also unsure why this happens but I'm sure we can figure this out together.

That's because I have been taking pull from main branch before I pushed the code, so that during merge it will easier without any issues since my branch will be uptodate with the new changes in main

Actual the last commit I pushed has been synched with upstream

Or Shall I do one thing I'll delete this PR and re-fork the repo and I'll submit the code related to this issue. That would make it easier for you to review the code

Do you have a Dockerfile in ./components/load_from_files ?

No Should we create one? Because it is not mentioned in Docs

So normally the images already exist for reusable components (in your case ghcr.io/ml6team/load_from_files:dev) but this is not yet the case so for easy testing of your component I would treat it as a custom one:
So something like this: (you can
.
├── components
│   ├── load_from_files
│   │   ├── Dockerfile
│   │   ├── fondant_component.yaml
│   │   ├── requirements.txt
│   │   └── src
│   │       └── main.py
└── pipeline.py

The local runner will then build the component locally and run it which allows you to test it once everything works we can abstract it to a reusable component.

Is there a template to create docker or can I just use a simple Docker with python3.8-slim buster with fondant installed in it

Is there a template to create docker or can I just use a simple Docker with python3.8-slim buster with fondant installed in it

You can use the files you already created from fondant/components/load_from_file

Hi @GeorgesLorre, I have created docker file and run it locally, Im getting this error But as per the main branch there is DaskLoadComponent in fondant.component. Doesn't the latest fondant package have these changes?
                        Created0.1s
 ! load_from_files The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested 0.0s
Attaching to my_pipeline-load_from_files-1
my_pipeline-load_from_files-1  | <jemalloc>: MADV_DONTNEED does not work (memset will be used instead)
my_pipeline-load_from_files-1  | <jemalloc>: (This is the expected behaviour if you are running under QEMU)
my_pipeline-load_from_files-1  | Traceback (most recent call last):
my_pipeline-load_from_files-1  |   File "main.py", line 21, in <module>
my_pipeline-load_from_files-1  |     from fondant.component import DaskLoadComponent
my_pipeline-load_from_files-1  | ImportError: cannot import name 'DaskLoadComponent' from 'fondant.component' (/usr/local/lib/python3.8/site-packages/fondant/component.py)
my_pipeline-load_from_files-1 exited with code 1

Hmm strange, can you check which Fondant version gets installed? You should have this in your Dockerfile:
ARG FONDANT_VERSION=main
RUN pip3 install fondant[aws,azure,gcp]@git+https://github.com/ml6team/fondant@${FONDANT_VERSION}

Maybe there is some caching issue ?

@GeorgesLorre , I tried removing the Docker Image and container and re-ran
fondant run pipeline:my_pipeline --local    but still getting the same error. And my docker file does point to main branch to pull latest version of fondant
Dockerfile
FROM --platform=linux/amd64 python:3.8-slim

# System dependencies
RUN apt-get update && \
    apt-get upgrade -y && \
    apt-get install git -y

# Install requirements
COPY requirements.txt /
RUN pip3 install --no-cache-dir -r requirements.txt

# Install Fondant
# This is split from other requirements to leverage caching
ARG FONDANT_VERSION=main
RUN pip3 install fondant[aws,azure,gcp]@git+https://github.com/ml6team/fondant@${FONDANT_VERSION}

# Set the working directory to the component folder
WORKDIR /component/src

# Copy over src-files
COPY src/ .

ENTRYPOINT ["python", "main.py"]

Hmm, I'm not sure what the problem is then. Could you share the code you have for running it locally ?

Hmm, I'm not sure what the problem is then. Could you share the code you have for running it locally ?

Sure, are you on fondant's discord?

BTW: I changed the base of this PR to something random and then back to main which seems to have removed all the already merged changes

Hmm, I'm not sure what the problem is then. Could you share the code you have for running it locally ?

@GeorgesLorre ,Sure, are you on fondant's discord?

Yes I am !

BTW: I changed the base of this PR to something random and then back to main which seems to have removed all the already merged changes

@GeorgesLorre, But usually fetching upstream and merging it with the working branch before raising PR is good practice right? So that PR code is in sync with main branch

Hmm, I'm not sure what the problem is then. Could you share the code you have for running it locally ?

@GeorgesLorre ,Sure, are you on fondant's discord?

Yes I am !

@GeorgesLorre, Cool Ill share you my local code there

I have shared you the code in Discord.

On 25-Jul-2023, at 2:21 PM, Georges Lorré @.***> wrote:
Hmm, I'm not sure what the problem is then. Could you share the code you have for running it locally ?
—
Reply to this email directly, view it on GitHub https://github.com/ml6team/fondant/pull/296#issuecomment-1649402642, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADTAUPF66JFHJBV6HI6I4R3XR6CHJANCNFSM6AAAAAA2MVGWMU.
You are receiving this because you were mentioned.


No docs on how to use task groups in multi-stage pipelines

We have a fairly complicated blue-green deploying strategy which we have bundled together in task groups. I would like to re-use this in all my multi-stage pipelines without copy-pasting a lot of code. Is this possible?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 521b594c-dbb9-54d5-f56f-00e2f5fa1d92
Version Independent ID: 509d3e4e-23db-8493-e1a6-acb67ec47e81
Content: Customize your pipeline - Azure Pipelines
Content Source: docs/pipelines/customize-pipeline.md
Product: devops
Technology: devops-cicd
GitHub Login: @vijayma
Microsoft Alias: vijayma

Are task groups renamed to templates for multi-stage pipelines?

Thanks for your question. It looks like your question isn't an issue with the documentation, but an issue or question specific to your implementation or a bug in the product itself.
For help with a specific task, here are a couple of options where you might consider asking your question:

Azure DevOps on Stack Overflow
Azure DevOps Support Bot

If you've encountered an issue with the product itself, to make sure it gets in front of the right people, please submit your bug here.
If you have an idea for improving the product, please submit your idea here.


Data File Corrupt error

Hello, I'm still getting used to Ubuntu so forgive my likely visible ignorance, I'm trying to learn, heh.
I recently installed crontab-ui on my Ubuntu v16.04.3 LTS, and while it initially worked it has suddenly faltered only a few days later since installation (not sure what caused it).
Running NPM v5.5.1, Node v8.7.0. My Crontab-UI folder is not at /usr/lib/node_modules/crontab-ui but instead /usr/local/lib/node_modules/crontab-ui.
The error I receive is detailed below when attempting to run crontab-ui at Terminal:

Node version: 8.7.0
Crontab UI is running at http://<IP_ADDRESS>:8000
/usr/local/lib/node_modules/crontab-ui/crontab.js:14
if (err) throw err; // no hope, just terminate
^
Error: More than 10% of the data file is corrupt, the wrong beforeDeserialization hook may be used. Cautiously refusing to start NeDB to prevent dataloss
at Persistence.treatRawData (/usr/local/lib/node_modules/crontab-ui/node_modules/nedb/lib/persistence.js:242:11)
at /usr/local/lib/node_modules/crontab-ui/node_modules/nedb/lib/persistence.js:281:38
at tryToString (fs.js:514:3)
at FSReqWrap.readFileAfterClose [as oncomplete] (fs.js:502:12)

Crontab-ui never automatically launched at system boot by default (not sure if this is typical), so I decided to add it to my /etc/crontab to launch just after a daily scheduled reboot; with a regular user login (not root). This is the only thing I can think of that may have broken it.
I've tampered with one of the files to add the http basic_authorisation stuff, and used Apache Tools to create the encrypted password file. I also installed NGINX to proxy and access externally. Both of these were working fine though before the problem.
The only other thing I can report is, when I initially tried to import crontab using the UI's web interface, it didn't import /etc/crontab but another file from somewhere else on the system (don't know where) which only contained one command (I recognised it as part of another application we had installed in the past). I think that cron entry is now lost/deleted because I couldn't import anything after that - even if I browsed for /etc/crontab, it didn't seem to accept it.
It's all quite strange to me! I appreciate your time & support, I tried to use sudo npm uninstall crontab to maybe start fresh but it didn't seem to do anything...
Edit: I should probably clarify one thing, although crontab-ui was installed and operating, I never actually got around to solving the issue of importing my crontab job list, I experienced this application error before I had a chance to actually "use" crontab-ui. Maybe the failed import attempts is what nuked it...

Try reinstalling
sudo npm uninstall -g crontab-ui
sudo npm install -g crontab-ui

Following these commands, the application successfully uninstalls, and then (re)installs again.

manager@Cellar:~$ sudo npm uninstall -g crontab-ui
removed 95 packages in 1.615s
manager@Cellar:~$ sudo npm install -g crontab-ui
/usr/bin/crontab-ui -> /usr/lib/node_modules/crontab-ui/bin/crontab-ui.js
/usr/bin/crontab-ui-mailer -> /usr/lib/node_modules/crontab-ui/bin/crontab-ui-mailer.js

<EMAIL_ADDRESS>added 95 packages in 7.335s

Unfortunately though, I continue to receive the same error as originally posted.
I'm not sure which data file is corrupt, but any chance it's one that can be deleted and then be automatically re-created by NPM or Crontab-UI?
Thanks for your assistance.


Newtonsoft.json Conflicts

Description of bug
Referencing DotNetNuke.Web dll results in following build warning:
Warning		Found conflicts between different versions of the same dependent assembly. In Visual Studio, double-click this warning (or select it and press Enter) to fix the conflicts; otherwise, add the following binding redirects to the "runtime" node in the application configuration file:
Steps to reproduce
Create a new project and reference the DotNetNuke.dll and DotNetNuke.Web.dll.
Current behavior
Build warning is generated as soon as you reference the DotNetNuke.Web.dll
Expected behavior
No Warnings.
Error information
DotNetNuke.Web is internally referring to Newtonsoft.Json.dll 6.0.0 instead of the latest 10.0.0

The Newtonsoft.Json reference in DotNetNuke.Web is pointing to 10.0.3, as is the reference in DotNetNuke.dll.
It looks like Newtonsoft.Json was updated from 7 to 10 in fcb64c641abdf89290e605795b27851d9720cc4c.  Do you have any thoughts on where this 6.x reference is?

The Dnn.EditBar.Library project is still referencing Newtonsoft.Json 6:
https://github.com/dnnsoftware/Dnn.Platform/blob/76fc4bec4c53f3d66fef9a2aafb8fbdfb9c65de1/Dnn.AdminExperience/EditBar/Dnn.EditBar.Library/Dnn.EditBar.Library.csproj#L40-L43
The other Persona Bar projects have weird references, but ultimately builds against Newtonsoft.Json 10.x:
https://github.com/dnnsoftware/Dnn.Platform/blob/76fc4bec4c53f3d66fef9a2aafb8fbdfb9c65de1/Dnn.AdminExperience/EditBar/Dnn.EditBar.UI/Dnn.EditBar.UI.csproj#L241-L244
https://github.com/dnnsoftware/Dnn.Platform/blob/f1397aa562499242dd6d25c41803941f2801f217/Dnn.AdminExperience/Library/Dnn.PersonaBar.UI/Dnn.PersonaBar.UI.csproj#L58-L61
https://github.com/dnnsoftware/Dnn.Platform/blob/63ea5cdb51c114129358b217effd141299016776/Dnn.AdminExperience/Dnn.PersonaBar.Extensions/Dnn.PersonaBar.Extensions.csproj#L703-L706

It looks like Newtonsoft.Json was updated from 7 to 10 in [fcb64c6]

Great. I wasn't testing on the latest 9.7.0 RC2; that resolves this issue.
I suppose we can keep this issue open for DNN.PersonaBar references.


Reconciliation failure for missing Secret

I experienced a failure when trying to delete a TenantControlPlane, waiting for finalization to complete.
From the logs of the controller it seems a Secret named "" is not found when trying to cleanup the resources of the TCP.

Sorry for the missing full log, but I wasn't able to reproduce it.


Enhance identifier based duplicate detection

Originally by arwagner on 2011-06-27
Besides checking the field 035 for duplicate entries it would make sense to add other fields to this simplistic check.
024 7_ $2doi $0 10.1016/123.456.789
comes to mind immediately. Given the semantics of (http://www.loc.gov/marc/bibliographic/bd024.html) 024 the whole family qualifies for dupe checking. However, for 7_ the identifier to compare would be the combination (concatenation) of $2 and $a while for other indicators (1_, 2_, 3_) the content of field $a would suffice.
Usecases: e.g. external document delivery from publishers, avoiding to list every identifier twice to keep to the MARC standard.
Sample of a collection of identfiers (unique IDs for Physical Review / D):
024 7_ $2ERA $a ERA:1078
024 7_ $2EZBID $a EZBID:52540
024 7_ $2ISI $a ISI:PHYSICAL REVIEW D
024 7_ $2JCR $a JCR:PHYS REV D
024 7_ $2Medline $a medline:0242621
024 7_ $2OCLC $a OCLC:645318259
024 7_ $2SCOPUS $a SCOPUS:110157
024 7_ $2SCOPUS $a SCOPUS:29459
024 7_ $2ZDBID $a ZDBID:1461167-3
024 7_ $2ZDBPPN $a ZDPPN:019545339

One can use PID fetchers to extract identifiers and compare them with already registered ones in Invenio 3.


get role-description and arcrole-description from object's parent model

This pr tries to resolve #8
Issue
Attributes .role-description and .description not returning the correct value for roles of a taxonomy loaded as a second taxonomy using taxonomy(...)  in the rule (after an initial taxonomy was loaded), indicating that the values for these attritbutes are being retrieved from the initial taxonomy loaded only, resulting in incorrect value or incorect none value.
Reason for the issue
In XuleProperties.py, functions property_role, property_role_uri, property_arcrole, passes xule_context.model  to role_uri_to_model_role and arcrole_uri_to_model_role. The xule_context.model does not seem to be updated to reflect the modelXbrl in the current scope, the functions always pass the initially loaded modelXbrl, which is fine until a new taxonomy is loaded via taxonomy(...) then the model passed must be the correct model for the current scope.
Suggested Changes
Get the correct modelXbrl from the model object itself before passing it to the conversion functions. This relys on Arelle Cntlr keeping track of which object relates to which parent model, which is very reliable in my experience.
You may want to keep track of the model in scope another way, this is why this is a draft pr just to pinpoint the issue.
Testing
Same as in issue #8, check for a role that exists only in ESEF 2021 loaded using taxonomy(...) after initially loading ESEF 2019.
Steps to test
Before applying the changes in this pr
Save following rule to file test.xule:
constant $other_taxonomy_networks = taxonomy('http://www.esma.europa.eu/taxonomy/2021-03-24/esef_all.xsd')
                                        .networks(none, "http://www.esma.europa.eu/xbrl/role/all/ifrs_17_role-836600o")

output get-from-network-level
for ($nw in $other_taxonomy_networks)
        dict(
        list("Role", $nw.role),
        list("Role description Network attr", $nw.role-description),
        list("Role description (Role attr)", $nw.role.description)
        ) /* Just to print it out in a readable format*/

output get-from-networks-level
list("\nRole description (Networks attr): {string($other_taxonomy_networks.role-description.to-set())}\n---------------\n")[1]

Run using the following command (loads ESEF 2019)
$ arelleCmdLine --plugins xule -f http://www.esma.europa.eu/taxonomy/2019-03-27/esef_all.xsd --internetRecheck never --xule-run --xule-compile test.xule --xule-rule-set test.xule.zip --logFormat "%(message)s"

The role description is not detected, the ouput should be as follows:
{'Role': <xule.XuleValue.XuleRole object at 0x7f38aa9790a0>,
 'Role description (Role attr)': None,
 'Role description Network attr': None}
{'Role': <xule.XuleValue.XuleRole object at 0x7f38aa979790>,
 'Role description (Role attr)': None,
 'Role description Network attr': None}
{'Role': <xule.XuleValue.XuleRole object at 0x7f38aa979d30>,
 'Role description (Role attr)': None,
 'Role description Network attr': None}
{'Role': <xule.XuleValue.XuleRole object at 0x7f38aa988310>,
 'Role description (Role attr)': None,
 'Role description Network attr': None}

Role description (Networks attr): set(None)

After applying the changes in this pr
Run the same exact test above, the role description is detected and the output should be as follows:
{'Role': modelRoleType[126944, uri: http://www.esma.europa.eu/xbrl/role/all/ifrs_17_role-836600o, definition: [836600o] Notes - Insurance contracts (IFRS 17), esef_all.xsd line 804]),
 'Role description (Role attr)': '[836600o] Notes - Insurance contracts (IFRS '
                                 '17)',
 'Role description Network attr': '[836600o] Notes - Insurance contracts (IFRS '
                                  '17)'}
{'Role': modelRoleType[126944, uri: http://www.esma.europa.eu/xbrl/role/all/ifrs_17_role-836600o, definition: [836600o] Notes - Insurance contracts (IFRS 17), esef_all.xsd line 804]),
 'Role description (Role attr)': '[836600o] Notes - Insurance contracts (IFRS '
                                 '17)',
 'Role description Network attr': '[836600o] Notes - Insurance contracts (IFRS '
                                  '17)'}
{'Role': modelRoleType[126944, uri: http://www.esma.europa.eu/xbrl/role/all/ifrs_17_role-836600o, definition: [836600o] Notes - Insurance contracts (IFRS 17), esef_all.xsd line 804]),
 'Role description (Role attr)': '[836600o] Notes - Insurance contracts (IFRS '
                                 '17)',
 'Role description Network attr': '[836600o] Notes - Insurance contracts (IFRS '
                                  '17)'}
{'Role': modelRoleType[126944, uri: http://www.esma.europa.eu/xbrl/role/all/ifrs_17_role-836600o, definition: [836600o] Notes - Insurance contracts (IFRS 17), esef_all.xsd line 804]),
 'Role description (Role attr)': '[836600o] Notes - Insurance contracts (IFRS '
                                 '17)',
 'Role description Network attr': '[836600o] Notes - Insurance contracts (IFRS '
                                  '17)'}

Role description (Networks attr): set([836600o] Notes - Insurance contracts (IFRS 17))
---------------

This issue has been addressed with a separate commit.


Change the prettier printWidth setting to something wider than 80 please.

Not sure this warrants opening an issue, but can we change the prettier printWidth setting to something wider than 80 please.  I am not finding it at all pretty when I am arbitrarily forced to line split perfectly reasonably wide lines.  It is really frustrating when two lines are similar in function (e.g. assigning a to b) but because variable names are of different length one is forced to be split into two and the other is not.
eslint allows for a line max-len of 140... can we set prettier to the same please.
I've made this change locally in my .prettierrc file and I'm a whole lot happier with the results. :-)

Yeah, sure thing! You could have just create a PR :D As I said I don't insist any settings, I just want to see consistent line breaks, semicolons, etc...


Build mono (C#) script macOS. msbuild not found xbuild can't build with godot api.

I cannot build a c# script (start the game) with msbuild selected in the editor settings.

If I change to xbuild I can start the project but only if the script does not interact with the godot api.
Calling set_postion, declaring a Vector2 or using get_node. Or I think any other godot api function.
getting the same error.

Can you check if it can find MSBuild after #11845 is merged?

IINW you were using the homebrew package, which I think does not include MSBuild (I'm not sure). If it still can't find MSBuild after the mentioned PR is merged, you could try with the package from mono's page.

@Tommel1234 What version of mono do you have?

<IP_ADDRESS>.. I think it don't come with msbuild .. maybe It doesnt install msbuild with this version..

I get some error when i generate the glue too

I'm afraid that the solution is somehow not working: even after #11845 (I'm on today's master) I still get msbuild not found error which on my machine gets fixed by adding
msbuild_path = '/Library/Frameworks/Mono.framework/Versions/Current/bin/msbuild'
at this line.
I'm just not sure why that's needed as the folder  '/Library/Frameworks/Mono.framework/Versions/Current/bin/' was added in the #11845 PR.

@piever Oh, I forgot to add that hint path to the build system as well. I will make a PR tonight.

Generating _Thread...
ERROR: _load: No loader found for resource: res://modules/mono/glue
At: core/io/resource_loader.cpp:184.
ERROR: start: Failed loading scene: res://modules/mono/glue
At: main/main.cpp:1546.
Mono: Runtime cleanup...
debugger-agent: Unable to listen on 42
WARNING: cleanup: ObjectDB Instances still exist!
At: core/object.cpp:1858.

That error is not related to glue generation. After generating the glue, Godot will continue with initialization, it will think you want to open the path you passed via cmd as a scene, and fail. I'll check if we can make it exit before that.

Thanks for looking into this!
I'm still not sure whether I got a successful mono build or not, because in the end, despite the error, the glue had already been generated, but after I open the Godot app I have the .cs script option but it's broken: it doesn't accept any name as valid class name.

You need to type in the Class Name as well.

Wow, that was silly... But the problem persists: after giving it a name I still get a:
Failed to build GodotSharp solution
so it seems like there are still some issues (not sure if related with msbuild or glue generation: I'll check again after @neikeq 's PR

@przmkg What version of Mono do you have installed? Where is MSBuild located in your filesystem?
@piever Is there any error in the bottom panel (Mono -> Builds, although it's made visible on errors)? If not, try running from the terminal to see the output.

@neikeq The version is 5.4 but I can't seem to find any sort of MSBuild binary on my system. I'm using the mono-stable from the AUR on Manjaro.
I will try to compile it from the official source by myself and will report the result.

Okay, now when I'm creating  a C# script, I have:
ERROR: save: Cannot add res://Character.cs to the C# project because it could not be created.    At: modules/mono/csharp_script.cpp:1927.
Don't know if my mono installation and msbuild is well done. Maybe it would be better to wait and see if someone else has this issue.

@neikeq I hadn't noticed it at first but I get two errors:

Surprisingly enough, the first seems to happen even if there's no cs script at all...

@przmkg try with https://aur.archlinux.org/packages/msbuild-bin/
@piever Do you see something like this?

@neikeq This is the one I tried with and I got the error mentioned in my previous post.

I see this if I hover on the error:

UPDATE: I rebuilt after @neikeq PRs and it's working now!

@przmkg is msbuild's directory in the PATH variable? If not, what's the location?

@neikeq Okay, everything is working now.
So basically, I've compiled a recent version of mono 5.4 by myself (though mono-stable from the AUR should work).
After that, I took the latest deb file from here (in this case msbuild_15.4+xamarinxplat.2<IP_ADDRESS>.14-0xamarin1+ubuntu1404b1_all.deb) and I've extracted it manually into /usr. Now it works wonderfully.
Thanks again!

Any issues with MSBuild on OSX after #12535?

Working fine on my machine, thanks a lot for fixing this!

I got thie errors. I'm using latest mono stable version. Can anyone help me, pls?

@rodrigofbm You can check the workarounds in #16327, until that is fixed.


WIP: #150 & #192 Couple DatasetMetadata to MapContext and Add Image preview upload

added new fields to MapContext Model.
Added new autocomplete urls related to metadata.
Added new fields to MapContext Form
Fixes #150 and #192

@jokiefer , this MR will be closed because, due to the new structure conflicts I created a new branch and made the changes again, making it easier to resolve. This MR is now obsololete and was replaced by #224 . Branch will also be deleted.


<EMAIL_ADDRESS>

@Asymvivastos
Thank you for your post!
Would you be able to share additional info regarding your question/ask when it comes to our documentation or this product? So I can gain a better understanding of your issue.

@Asymvivastos
Thank you for your post!
Since this is a duplicate of https://github.com/MicrosoftDocs/azure-docs/issues/70752, I'll go ahead and close this out.


Form focus states not identical in all browsers

While perusing some Government websites on different browsers I noticed that form focus states are not identical in all browsers.
See below screen recording, and note the browsers.

(tested on Windows and Mac, but recording was on Windows)
What is the intended design?

@nickcolley I think it fixes it.

These focus styles are set by the govuk_template, once PR #259 has been merged, the steps to fix this for govuk_elements are:

[ ] Bump the version of govuk_template
[ ] Update the version of govuk_template_jinja that govuk_elements is using to pull in this change
[ ] Update _govuk-template-base.scss, this file duplicates the base styles set by govuk_template, for anyone consuming govuk-elements-sass without govuk-template.

Will be fixed in the next release. Thanks for the report!


Add person variable

Overview
Added new person variable and converted lmb plugin to insert this new person variable with prefilled information
connected issues and PRs:
GN-4876
Setup
You should have the backend running and the vendor-proxy service configured correctly
How to test/reproduce
Insert a new person variable in the regulatory statement part and fill it with a person
Challenges/uncertainties
We know that the first time you click the insert/edit button on the card it doesn't work, but no idea why
Checks PR readiness

[x] UI: works on smaller screen sizes
[x] UI: feedback for any loading/error states
[x] Check if dummy app is correctly updated
[x] Check cancel/go-back flows
[x] changelog
[x] npm lint
[x] no new deprecations

made a followup for the button issue https://binnenland.atlassian.net/browse/GN-4949


the plugin is using an incorrect return / redirect url

Hi 👋🏻,
shopware has apparently introduced new Transaction URLS in its latest version (6.4). This means that the current Mollie plugin (1.4.1) cannot yet be used for version 6.4.
At the following point in the code:
https://github.com/mollie/Shopware6/blob/6826ccf40b455ef702f9e4a9ee68796f037adae3/src/Handler/PaymentHandler.php#L225
a different URL than expected is returned when "$transaction-> getReturnUrl ()" is called.
Shopware 6.4 now gives a URL with a JWT token, which means that the maximum number of characters of the Mollie API is exceeded.
https://<shop-domain.tld>/payment/finalize-transaction?_sw_payment_token=<jwt-token>
This JWT token contains a return url under the "ful" key.
For a quick fix in one of our projects, I parsed the "jwt token" from the url and decoded it. Then I passed the value in the "ful" key as returnUrl to Mollie. This worked on the quick. However, proper implementation would be desirable.
Unfortunately, i was unable to prepare a generally valid "fix", in terms of time.
I hope I could help!

Original Error Message:
Could not create a Mollie Payment Url, error: Could not create Mollie order, error: [2021-05-26T15:15:37+0000] Error executing API call (422: Unprocessable Entity): The redirect URL is too long. It should not be longer than 1023 characters. Field: payment.redirectUrl.

@cschwerdt Thx for the report. I will have a look on the issue soon. We never encountered the problem before and did a lot of testing with 6.4. May you tell me some more information? e.g. special configuration in your environment
Thx

we are working on a fix.

Hi
if this is the error for "return url is too long" then this is the fix
https://github.com/mollie/Shopware6/pull/154/files
all cypress tests seem fine, still its not "officially" tested, but I guess you will immediately see if its working
the solution is to just remove the returnUrl als parameter.
its not used anyway, because its taken from the database (order - custom fields).
so its not making a difference if the parameter exists or not
let me know if it works for you

fixed with release 1.4.2


QG4 System Team checks (Release 3.1)

QG checks
Please keep this issue open until QG4 is concluded!
Product Name: Traceability FOSS
Product Owner: @tbraun-zf
Dev SPOC: @ds-mwesener
Helm Chart Version:  1.3.5
App Version:  3.1.2
QG4 Approval: no
TRG 1 Documentation
TRG 1.01
https://eclipse-tractusx.github.io/docs/release/trg-1/trg-1-1

[x] #83

TRG 1.02
https://eclipse-tractusx.github.io/docs/release/trg-1/trg-1-2

[x] an appropriate INSTALL.md

TRG 1.03
https://eclipse-tractusx.github.io/docs/release/trg-1/trg-1-3

[x] an appropriate CHANGELOG.md

[x] the versioning itself follows semantic versioning

TRG 2 Git
TRG 2.01
https://eclipse-tractusx.github.io/docs/release/trg-2/trg-2-1

[x] default branch is named main

TRG 2.03
https://eclipse-tractusx.github.io/docs/release/trg-2/trg-2-3

[x] #82
[x] /charts directory exits and must contain the Helm chart for the Tractus-X product IF available
[x] AUTHORS.md file (optional)
[x] CODE_OF_CONDUCT.md file
[x] CONTRIBUTING.md file
[x] #95
[x] LICENSE file
[x] NOTICE.md file
[x] SECURITY.md file

TRG 2.04
https://eclipse-tractusx.github.io/docs/release/trg-2/trg-2-4

[x] a Leading product repository
[x] repository name must be productname without prefix or suffix
[x] should contain the release
[x] contain product helm chart
[x] references/urls to the product's other repositories
[x] README.md: contains the urls for the backend and frontend applications if needed

TRG 2.05
https://eclipse-tractusx.github.io/docs/release/trg-2/trg-2-5

[x] .tractusx metafile is present in the root of the repository and file has a proper format

TRG 3 Kubernetes
TRG 3.02
https://eclipse-tractusx.github.io/docs/release/trg-3/trg-3-2

[x] if data persistence is needed in Kubernetes the use of PersistentVolume and PersistentVolumeClaim resource

TRG 4 container
TRG 4.01
https://eclipse-tractusx.github.io/docs/release/trg-4/trg-4-1

[x] All images must be tagged following semantic versioning
[x] #84

TRG 4.02
https://eclipse-tractusx.github.io/docs/release/trg-4/trg-4-2

[x] must add a section to your top level README.md file, that contains information about the used base image
[x] Java, Kotlin, ... if JVM based language use base image from Eclipse Temurin

TRG 4.03
https://eclipse-tractusx.github.io/docs/release/trg-4/trg-4-3

[x] #85
[x] #86

TRG 4.05
https://eclipse-tractusx.github.io/docs/release/trg-4/trg-4-5

[x] released image must be present on GitHub Package registry or Dockerhub

TRG 5 Helm
TRG 5.01
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-01

[x] Helm chart must be released
[x] appropriate semantic versioning for version and appVersion has to be used in Chart.yaml
[x] must not contain any environment specific values-xyz.yaml
[x] values.yaml file must contain proper default values/placeholders
[x] No hostname provided for ingress
[x] Ingress is disabled
[x] No references to any secret engine service (e.g.: Hashicorp Vault)
[x] Dependencies should be prefixed with the nameOverride and/or fullnameOverride properties
[x] Image tag is set to the Chart.yaml appVersion property
[x] must be deployable to any environment without overwriting default values with a simple helm install command
[x] dependencies have to be declared in Chart.yaml NOT requirements.yml

TRG 5.02
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-02

[x] Helm chart location inside Git repository in /charts directory
[x] chart file structure

charts/
    chartNameA/
      Chart.yaml
      ...
    chartNameB/
      Chart.yaml
      ...
AUTHORS.md
DEPENDENCIES.md
LICENCE
README.md

[x] #87
[x] latest tag is not used in helm chart be default

TRG 5.04
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-04

[x] CPU and memory limits and requests are properly set

TRG 5.06
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-06

[x] every startup configuration aspect of your application must be configurable through the Helm chart (ingress class, tls, labels, annotations, database, secrets, persistence, env variables)

TRG 5.07
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-07

[x] if dependencies are present in the Chart.yaml they are properly configured

TRG 5.08
https://eclipse-tractusx.github.io/docs/release/trg-5/trg-5-08

[x] a product has a single deployable helm chart that contains all components (backend, frontend, etc.)
[x] name of the Chart should be just the product-name without prefix or suffix
[x] values file should contain all available variables (even from subcharts) with default values and comments about what they do
[x] #89
[x] #88

Testing

[x] installed and running on pre-prod without errors

Hints
Information Sharing

Hi TraceX Team! I would kindly ask you to fill these information:
Product Owner:
Dev SPOC:
Helm Chart Version:
App Version:

Product Owner: @tbraun-zf
Dev SPOC: @ds-mwesener
Helm Chart Version: 1.3.2
App Version: 3.1.1

Actually the 1.3.2 chart version contains the 3.1.0 appVersion. Is that correct @ds-mwesener?

On image releases latest tag should be used alongside the semver version. See TRG 4.01

Already created some issues based on the problems I've found. The unchecked lines without issues will be further investigated by the System Team.

Actually the 1.3.2 chart version contains the 3.1.0 appVersion. Is that correct @ds-mwesener?

Hi @almadigabor yes this is correct. We have not created a new helm chart release for the bug-fix version 3.1.1 because they were no chart changes.

I see. Although I would recommend creating a new helm chart each time there is a new app release, because you should update the Chart.yaml file's appVersion property and every time a file changes in the chart the chart's version needs to be bumped.

Hi @almadigabor please recheck on hotfix release:
3.1.2 -> https://github.com/eclipse-tractusx/traceability-foss/releases/tag/3.1.2
helm-charts-1.3.5 -> https://github.com/eclipse-tractusx/traceability-foss/releases/tag/helm-charts-1.3.5

@ds-mwesener  Seems like there is some issue with the 1.3.5 chart. It is not visible here and on main branch I see 1.3.4 in the Chart.yaml. Although I see the tag for helm-charts-1-3-5. Being released properly is required for our installment on pre-prod env.

Hi @almadigabor this relates to our push action for github pages. Basically I had to create a hotfix branch for creating the release 3.1.2 with helm-charts 1.3.5. This can be seen here:
https://github.com/eclipse-tractusx/traceability-foss/tree/release/3.1.2
Therefore the index.yml does not contain the version. Is this mandatory for this release?
The main branch already includes another version which should not be related to the quality gates.
Thanks in advance.

Right, it took some time for the charts repo to pick up this version. Now it is there and I've deployed it on pre-prod. The last issue remaining is #95

Closing the issue as all checks are done. Thanks for the great collaboration @ds-mwesener!


Use specific Laravel version

We wont know if this package will break in Laravel 5.3. Laravel doesn't follow SemVer. This way we can get ahead of future problems.

StyleCI seems to fail. Though, it has nothing to do with this pull request since it only updates the composer.json file.

Conflicts due to other PR, if you can't resolve I'll just merge it locally when I get a chance.

@jasonlewis I've replaced it with #969


Fix Minecraft (Headless) Tutorial Layout

This is one part of the fix needed for Minecraft's tutorial layout after the PXT bump. The other part is in the pxt-minecraft repo: https://github.com/microsoft/pxt-minecraft/pull/2314
Tutorials with fixes applied can be seen here: https://minecraft.makecode.com/app/8ef76a97727b2cdaf01a9b01e0703b80e23721a8-8e733a6100
Note that this does not fix https://github.com/microsoft/pxt-minecraft/issues/2312, which I'll investigate and address in a separate change.
Before:

After:

I found a bug that I'm not sure is super important to address and might be something we want to address later, but if you shrink the screen down so it's the horizontal instruction view and then enlarge the screen again, the tutorial instructions seem to be stuck in a smaller div and scrollable.

I found a bug that I'm not sure is super important to address and might be something we want to address later, but if you shrink the screen down so it's the horizontal instruction view and then enlarge the screen again, the tutorial instructions seem to be stuck in a smaller div and scrollable.

Yeah, I have that filed here: https://github.com/microsoft/pxt-minecraft/issues/2312
Will fix separately, as it's not new from these changes and exists in other targets too.

Oh, crap, sorry. I saw that issue but just didn't watch the GIF all the way through. Sounds good. Sorry for wasting your time there.

Oh, crap, sorry. I saw that issue but just didn't watch the GIF all the way through. Sounds good. Sorry for wasting your time there.

Hahah it's no problem :)


Investigate build failure for tests in scheduled multi-Nebula (T3000) pipeline

https://github.com/tenstorrent-metal/tt-metal/actions/runs/8062107025/job/22038359381
Linker issue + pytest collects no tests issue.
Looks like we have two concurrent issues:

something broke the multi-nebula tests linking during build
someone moved tests, forcing a no tests found exit code in pytest. We need to find what tests were moved, fix the location / pytest target, and remind the responsible developer of the contribution guidelines.

I should be able to fix this on my own when I have some spare cycles soon.
cc: @jliangTT @aliuTT

@TT-BrianLiu to fix


#562 Add Scribe logging backend

Resolves #562.
Before submitting pull request:

[x] Check if the project compiles by running sbt compile
[x] Verify docs compilation by running sbt compileDocs
[x] Check if tests pass by running sbt test
[x] Format code by running sbt scalafmt

Released in 3.0.0-RC2, thanks!


adds materialize support

Hello.
I've added basic materialize support.
I'm working in another feature (with options) in order to fulfill my project's needs that I think can be useful: adding support for icons instead of text in prev / next links
Carles.

Great, thanks!
You should be able to use icons already like previous: render("prev_link.html", []), next: render("next_link.html", []) where those functions are other phoenix EEX templates. If that doesn't work, let me know! Also, if you'd like to add that as an example (if its not already) to the README, I'll gladly accept a PR for that.

Awesome, this looks really good! Give me a little bit and I'll have it out in a release.

v1.5.0 released!


Update dataflow client.

Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

R: @pabloem
Would you take a look? I haven't done this before so let me know if I'm doing it wrong.


Reenable test updates for SLE12

+1 if this passes gating.

Succeeded with develcloud5, let's test with cloud6.

+1 . Merging. Testing with cloud 5 is fine.


Angular Application don't load assets/fonts

Describe the bug or question
Hello there. In my angular app with single spa I can't get assets/fonts.
To Reproduce
In root application:
<script type="systemjs-importmap">
  {
    "imports": {
      "root-config": "//localhost:9000/root-config.js",
      "myapp": "http://localhost:4200/main.js"
    }
  }
</script>

In angular app (myapp):
angular.json

.
.
.
"myapp": {
      "projectType": "application",
      "schematics": {
        "@schematics/angular:component": {
          "style": "scss"
        }
      },
      "root": "",
      "sourceRoot": "src",
      "prefix": "app",
      "architect": {
        "build": {
          "builder": "@angular-builders/custom-webpack:browser",
          "options": {
            "outputPath": "dist/myapp",
            "index": "src/index.html",
            "main": "src/main.single-spa.ts",
            "polyfills": "src/polyfills.ts",
            "tsConfig": "tsconfig.single-spa.json",
            "aot": true,
            "assets": [
              "src/favicon.ico",
              "src/assets",
              {
                "glob": "**/*",
                "input": "node_modules/design-system/src/lib/@theme/styles/fonts",
                "output": "/assets/fonts"
              }
            ],
            "styles": [
<EMAIL_ADDRESS><EMAIL_ADDRESS>              "node_modules/pace-js/templates/pace-theme-flash.tmpl.css",
              "src/styles.scss"
            ],
            "scripts": [
              "node_modules/pace-js/pace.min.js"
            ],
            "customWebpackConfig": {
              "path": "extra-webpack.config.js",
              "libraryName": "myapp",
              "libraryTarget": "umd"
            }
          },

.

.

.

styles.scss:

@font-face {
  font-family: "Moderat";
  src: url("/assets/fonts/Moderat-Light.woff2") format("woff2"),
    url("/assets/fonts/Moderat-Light.woff") format("woff"),
    url("/assets/fonts/Moderat-Light.ttf") format("truetype");
  font-weight: 300;
  font-style: normal;
}

Running with:
ng serve myapp --disable-host-check --port 4200 --deploy-url http://localhost:9000/ --live-reload false
my fonts is located in"node_modules/design-system/src/lib/@theme/styles/fonts":
Expected behavior
In root config, my angular app loaded with fonts as imported at styles.scss (myapp).
Screenshots and/or console output
GET http://localhost:9000/assets/fonts/Moderat-Light.woff2 net::ERR_ABORTED 404 (Not Found)
GET http://localhost:9000/assets/fonts/Moderat-Light.woff net::ERR_ABORTED 404 (Not Found)
GET http://localhost:9000/assets/fonts/Moderat-Light.ttf net::ERR_ABORTED 404 (Not Found)

Describe the bug or question
Hello there. In my angular app with single spa I can't get assets/fonts.
To Reproduce In root application:
<script type="systemjs-importmap">
  {
    "imports": {
      "root-config": "//localhost:9000/root-config.js",
      "myapp": "http://localhost:4200/main.js"
    }
  }
</script>

In angular app (myapp):
angular.json
.
.
.
"myapp": {
      "projectType": "application",
      "schematics": {
        "@schematics/angular:component": {
          "style": "scss"
        }
      },
      "root": "",
      "sourceRoot": "src",
      "prefix": "app",
      "architect": {
        "build": {
          "builder": "@angular-builders/custom-webpack:browser",
          "options": {
            "outputPath": "dist/myapp",
            "index": "src/index.html",
            "main": "src/main.single-spa.ts",
            "polyfills": "src/polyfills.ts",
            "tsConfig": "tsconfig.single-spa.json",
            "aot": true,
            "assets": [
              "src/favicon.ico",
              "src/assets",
              {
                "glob": "**/*",
                "input": "node_modules/design-system/src/lib/@theme/styles/fonts",
                "output": "/assets/fonts"
              }
            ],
            "styles": [
<EMAIL_ADDRESS><EMAIL_ADDRESS>              "node_modules/pace-js/templates/pace-theme-flash.tmpl.css",
              "src/styles.scss"
            ],
            "scripts": [
              "node_modules/pace-js/pace.min.js"
            ],
            "customWebpackConfig": {
              "path": "extra-webpack.config.js",
              "libraryName": "myapp",
              "libraryTarget": "umd"
            }
          },

.

.

.

styles.scss:
@font-face {
  font-family: "Moderat";
  src: url("/assets/fonts/Moderat-Light.woff2") format("woff2"),
    url("/assets/fonts/Moderat-Light.woff") format("woff"),
    url("/assets/fonts/Moderat-Light.ttf") format("truetype");
  font-weight: 300;
  font-style: normal;
}

Running with:
ng serve myapp --disable-host-check --port 4200 --deploy-url http://localhost:9000/ --live-reload false
my fonts is located in"node_modules/design-system/src/lib/@theme/styles/fonts":
Expected behavior
In root config, my angular app loaded with fonts as imported at styles.scss (myapp).
Screenshots and/or console output
GET http://localhost:9000/assets/fonts/Moderat-Light.woff2 net::ERR_ABORTED 404 (Not Found)
GET http://localhost:9000/assets/fonts/Moderat-Light.woff net::ERR_ABORTED 404 (Not Found)
GET http://localhost:9000/assets/fonts/Moderat-Light.ttf net::ERR_ABORTED 404 (Not Found)

I am also getting the same issue. Tried in different ways. Could not find any solutions .I think the only solution is to set the  webpack_public path in assetUrl function .Any way I am not able to fix it. It is road blocking issue. Could not find any code snippet for angular to deal with this
Useful Url :https://webpack.js.org/guides/public-path/#root

I am also getting the same issue. Tried in different ways. Could not find any solutions .I think the only solution is to set the webpack_public path in assetUrl function .Any way I am not able to fix it. It is road blocking issue. Could not find any code snippet for angular to deal with this
Useful Url :https://webpack.js.org/guides/public-path/#root

I'm transferring this to single-spa-angular. I don't spend much time maintaining single-spa-angular and there aren't many that help there, so I don't think you'll get a response quickly. I suggest reading https://single-spa.js.org/docs/ecosystem-angular#angular-assets

Could you find any update on this

I am also getting the same issue. Tried in different ways. Could not find any solutions .I think the only solution is to set the webpack_public path in assetUrl function .Any way I am not able to fix it. It is road blocking issue. Could not find any code snippet for angular to deal with this

I had the same problem and also couldn't get public_path working. Our workaround was to load the font in the root HTML.

Hey, I know it's been long since this issue is opened. It's a pity that Webpack doesn't parse __webpack_public_path__ within CSS files, that would be easy just to write something like url(__webpack_public_path__/assets/some_font.woff2).
I've added an example into master on how to load fonts: https://github.com/single-spa/single-spa-angular/commit/3f7ae764c9e021e9e7a69f5a75a3fc513965fd93
You can also load it via style element and not via the FontFace:
function loadMontserrat(): void {
  const id = 'montserrat';
  if (document.getElementById(id) !== null) {
    return;
  }
  const style = document.createElement('style');
  style.innerHTML = `
  @font-face {
    font-family: 'Montserrat';
    src: url(${assetUrl('/path-to-font.woff2')}) format('woff2');
  }
`;
  style.id = id;
  document.head.appendChild(style);
}

I had the same issue, and used the less sophisticated approach of copying the fonts in the 'public' directory of the root-config single-spa project, from which Webpack serves static assets  in a local env.  It seems to work fine.
In a QA/production environments,  you would have to make the fonts available in the same equivalent static folder.
I am relatively new to single-spa (and angular), so take it with a grain of salt.


Maybe not a bug

This may not be a bug but a lot of metadata isn't displayed when using the tool (at least with standard fields). I had the task to find where the Opportunity.Amount field was used on an Org and the only Metadata it showed was Worflow Rules, Workflow Field Update and Validation Rules.
But it left out a lot of formula fields, Flows, Process Builders, list views, fieldsets and layouts. Can't say for code because there was no code related (at least no apex showed up for me when searching on VSCode).
But it would be a great plus to be able to display all those other metadata

Hi @pacol85 ,
Thanks for getting in touch! HappySoup.io is based on the MetadataComponentDependency
https://developer.salesforce.com/docs/atlas.en-us.api_tooling.meta/api_tooling/tooling_api_objects_metadatacomponentdependency.htm
This object does NOT support standard fields. So the "where is this used" functionality for standard fields is entirely custom built, which means that unfortunately not every metadata is caught.
I will look into how to potentially add more metadata types for standard fields.
Thanks again!


feat: on pinentry request, allow password to be cached in os keyring

When using pinentry to request the passphrase to decrypt the age identities file, allow the pinentry program to cache the password.
Example:

@dominikschulz I'm not sure why the Linux check failed - was this a transient error? Or is there an issue with this PR?


feat: support arbitrary tokens when using the email send api

Mautic's email send API allows you to supply arbitrary tokens in the POST body payload. This PR adds support for Twig to process these tokens.
Tokens can be strings or full-on objects, eliminating the need for storing data temporarily in contact/lead fields, as well as JSON parsing. See the provided example in the README.

@radicand thats ok. Thank you for responding.


Purge remaining containers if they are not disposed of automatically

It seems like AppDomain.CurrentDomain.ProcessExit and Console.CancelKeyPress is not working properly (at least on macOS) e. g. STRG + C does not exit the application gracefully.  Any other way? See also: dotnet/coreclr#8565.

We can probably use Microsoft.Extensions.Hosting, however, it seems like not working reliable on macOS. IHostedService.StopAsync gets "skipped".


JVM Integration: Fix logic to allow specifying target package prefix

In the current logic, the fuzz-introspector will gather all jar files built and analyse all classes in them and exclude some well known library classes. If there is some java based oss-fuzz project that generates a large list of dependencies and include them as jar files in the output directory, those dependencies are also analysed by fuzz-introspector if their package name is not specifically excluded. This setting actually creates a large overhead by analysing classes which are not part of the target project itself. Indeed, may project runs into OOM or timeout during fuzz-introspector processing because of this reason. This PR aims to decrease the overhead by allowing the project specifying its package prefix and fuzz-introspector will only go through classes with the specified package prefix. If no package prefix has been specified, then it will work like before, in which the fuzz-introspector will analyse all classes in all jar files. This setting is used to be backward compatible for projects which do not specify the package prefix.
In order to apply the new package prefix specification, a special comment line must add to the fuzzer executable when they are created in the oss-fuzz build.sh of that project. The special comment are
##PACKAGE_NAME##[Target package prefix, separated by ':']##PACKAGE_NAME##
For example, ##PACKAGE_NAME##org.fuzz-introspector.:org.oss-fuzz.##PACKAGE_NAME##

Wrong push.


Use SYSTEM_NAMESPACE variable instead of hardcoded value

Proposed Changes

🧽  Remove references to hard-coded "knative-eventing" namespace, preferring system.Namespace() call
🧽  Store the environment, loaded in the controller main(), in the context instead of re-reading it whenever NewController is called

/ok-to-test

/approve
/hold

holding for some final manual testing...

@matzew - Can you take a look at the test/e2e files to make sure you're ok with that - I've looked at the rest.

/unhold


Regression: bold/italic on webfonts doesn't work

On PhantomJS 1.9.8 you could generate projects with bolded and/or italicized webfonts.
For example, when I wanted to generate bolded webfont I did these steps:

reset font weight inside font-face declaration to normal:
@font-face {
font-family: 'userSelectedFont';
font-style: normal;
font-weight: normal;
src: url("/usr/share/fonts/dejavu/DejaVuSerif.ttf");
}

set font-weight to bold on actual tag

Unfortunately after upgrading to v2.0 this solution doesn't work anymore.
So the question is: is there a way to achieve bolded/italicized webfonts in newer versions of PhantomJS? Going back to v1.9.8 is not an option for me:)
thanks in advance

Normal, bold, italic, and bold italic are separate TTF files, and you need to write a separate @font-face rule for each one:
@font-face {
    font-family: 'userSelectedFont';
    font-style: normal;
    font-weight: normal;
    src: url("/usr/share/fonts/dejavu/DejaVuSerif.ttf");
}
@font-face {
    font-family: 'userSelectedFont';
    font-style: normal;
    font-weight: bold;
    src: url("/usr/share/fonts/dejavu/DejaVuSerif-Bold.ttf");
}
@font-face {
    font-family: 'userSelectedFont';
    font-style: italic;
    font-weight: normal;
    src: url("/usr/share/fonts/dejavu/DejaVuSerif-Italic.ttf");
}
@font-face {
    font-family: 'userSelectedFont';
    font-style: italic;
    font-weight: bold;
    src: url("/usr/share/fonts/dejavu/DejaVuSerif-BoldItalic.ttf");
}

Then setting font-family: "userSelectedFont" on some element will work as you expect.
This is not a bug in PhantomJS; it is how @font-face is specified to work.
In the future, please take this type of question to discuss.phantomjs.org, Stack Overflow, or the user mailing list.  Please only file bugs in this bug tracker when you are certain that there is a bug in PhantomJS.

@zackw, you are wrong ;)
You dont have to have each font as a spearate files, to see them for example bolded. Bolding , is a css property that will make any font look bolder, regardles of defined fonts.
Here, take a quick look at this fiddle, with just one font (normal):
https://jsfiddle.net/ghzs1egj/1/
Every browser displays this properly, but not Phantom since 2.x versions were released. So, as @miase pointed, it is clearly a bug.

@paulwalczewski you've taught me something new; I would have swore that I've ran into cases before where I could not bold a font because it was not built into the font.. but, as you've shown us, any font can apparently be bolded.  I owe you a cup of coffee.


[Bug] Shell Storages destroy my shells and doesn't let me repair them.

What happened?
So, I was a huge fan of the original sync mod, so when I found this, I was like, "Hell yeah!" Though, in the latest version of it I downloaded (the version where the file is sync-mc1.18-3.1.jar), I encountered a bug where my shell storages weren't actually storing my shells properly, yet when stepping into another shell storage it still listed them as being there.
Whenever I try to select one of my shells, it says:
The selected shell cannot be found.
When I found there was the /sync command in the game, I thought that using it to fix them would repair the issue, yet it states that the coordinates used don't contain a shell storage. The issue is though is that I don't specify specific coordinates, thus causing the mod to have to physically locate the coordinates where the shell storage is to be able to give me the error message in the first place.
What I get when entering the command, /sync repair @a (or whatever the command is my memory isn't that good),  is something along the lines of
Failed to repair shell storage at [insert coordinates here]. The selected coordinates does not contain a Shell Storage.
I wanted to report it because I didn't have this issue in an older version of the mod that I played, though I don't remember specifically what version. I thought it may be due to the other mods I'm using, but I don't know for sure.
Version
3.1
Minecraft Version
1.18.1
Fabric API Version
0.46.1
Installation Source
CurseForge
Logs
No response
Other Mods
All the other mods I'm using are:

-3D Skin Layers (1.3.1)
-Architectury API (3.4.9)
-Atlantis (2022.1.28-1.188-1.0.0)
-Cam's Backpacks (2.8)
-Clotrh API (3.1.61)
-Crawl (Fabric) (0.10.2)
-Elemental Creepers: Refabricated (1.4.1+1.18.1)
-Fabric API (0.46.1)
-Geckolib (3.0.30)
-Identity (1.16.0-1.18.1)
-Lamb Dynamic Lights (2.1.0)
-Mod Menu (3.0.1)
-No AI Spawn Eggs (Fabric) (10.0.4)
-Portal Gun (Fabric) (3.0.1)
-Prefab (3.0.2)
-Reborn Core (5.1.0 beta 7)
-Tech Reborn (5.1.0 beta 7)
-REI (7.2.416)
-Sandwichable (1.2-rc3A)
-'Slight' GUI Modifications (2.0.3)
-Sodium (0.4.0-alpha6+build.14)
-Starry Skies (1.5.1)
-Survival Plus (0.1.6b)
-Survival Plus Primer (0.1.0b)
-Survival Plus Lightsabers (0.1.6b)
-Valley (2.2.1)

If one of these mods is causing the issue, then lmk.

Additional Information
Most of the settings are default, although I did set it so that:
-Redstone can be used as a power source.
-it doesn't require health to create a shell.

Could you elaborate, please? It says «shell storages», so does this happen to you regularly?
The /sync ghostshells repair command requires an existing empty shell storage to be present at the same position as the missing shell.
Please, locate the crosshair at the bottom part of the one, then type /sync ghostshells repair Your_Nickname  and press Tab 3 times (therefore the command will be completed with the coords of the block you're looking at) and execute the command. If the problem persists, I'd ask you to make a screenshot in the same position with debug screen (F3) and chat output being visible

I don't know how to elaborate any further. I go into my shell storage and
choose either another shell in storage or to the one in my shell
constructor, i wait only for a minute, and then when I choose the shell
while I'm in another shell storage, it says the shell cannot be found.
Nothing I do fixes it. Not even destroying it. When I destroy it, the shell
still comes up as a selectable shell to use.
On Tue, Feb 8, 2022, 2:33 AM Kir_Antipov @.***> wrote:

Could you elaborate, please? It says «shell storages», so does this
happen to you regularly?
The /sync ghostshells repair command requires an existing empty shell
storage to be present at the same position as the missing shell.
Please, locate the crosshair at the bottom part of the one, then type /sync
ghostshells repair Your_Nickname and press Tab 3 times (therefore the
command will be completed with the coords of the block you're looking at)
and execute the command. If the problem persists, I'd ask you to make a
screenshot in the same position with debug screen (F3) and chat output
being visible
—
Reply to this email directly, view it on GitHub
https://github.com/Kir-Antipov/sync-fabric/issues/23#issuecomment-1032398636,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ARDKFOIEPUEVU4PX6W2CMV3U2DPPDANCNFSM5NSUPCXQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID:
@.***>

It would be very nice of you if you could provide me with one of your worlds where the problem has happened, and maybe with your modpack, so I don't have to assemble it myself


⚠ SolarOscp has degraded performance

In b1ae9bd, SolarOscp ($SOLAROSCP_URL) experienced degraded performance:

HTTP code: 200
Response time: 123 ms

Resolved: SolarOscp performance has improved in 0926a08 after 10 minutes.


Bug/Regression [BGV]: Wrong result from innerSum for params.N() elements

What version of Lattigo are you using?
v6.1.0
Does this issue persist with the latest release?
Yes
What were you trying to do?
Let N = params.N().
Create a vector of length N, populate with random 1s and 0s.
Count the number of 1s by computing the inner sum of the encrypted vector with batch_size 1 and group size N
What were you expecting to happen?
The result to match the number of 1s in the clear text bit vector.
What actually happened?
The computed result was constantly slightly off from the expected result.
The answer was correct when

Only filling the first N/2 slots of the plaintext and calling inner sum with group size N/2
OR
Call to innerSum with group size N/2 and addition with RotateRowsNew

Variant 1:
clear text vector has length N with 1s all over.
inner sum is called with batch_size 1 and group size N
-> Incorrect result
Variant 2:
clear text vector has length N with 1s all over.
inner sum is called with batch_size 1 and group size N >> 1
Addition with RotateRowsNew
-> Correct result
Variant 3:
clear text vector has length N >> 1 with 1s all over.
inner sum is called with batch_size 1 and group size N >> 1
-> Correct result
"I think the library should return an error when asking innersum with N or handle this case internaly in the BGV side (because the backend of innersum is in the RLWE package, which is agnostic of the scheme and packing, hence why it doesn't return an error). The BGV evaluator should re-implement this method by calling the RLWE innersum but then add this last step if n = N." -Jean-Philippe Bossuat
Reproducibility
Minimal example with variant 1.
Variant 2 is achieved by removing comments around RotateRowsNew
Variant 3 is achieved by replacing all 'params.N()' by 'params.N() >> 1'
package main

import (
	"fmt"
	"github.com/tuneinsight/lattigo/v6/core/rlwe"
	"github.com/tuneinsight/lattigo/v6/schemes/bgv"
	"math/rand/v2"
)

func innerSumTest() {
	// Setup copied from examples
	var err error
	var params bgv.Parameters

	if params, err = bgv.NewParametersFromLiteral(bgv.ExampleParameters128BitLogN14LogQP438); err != nil {
		panic(err)
	}

	kgen := rlwe.NewKeyGenerator(params)

	sk := kgen.GenSecretKeyNew()
	ecd := bgv.NewEncoder(params)

	enc := rlwe.NewEncryptor(params, sk)
	dec := rlwe.NewDecryptor(params, sk)

	decrypt := func(ct *rlwe.Ciphertext) []uint64 {
		pt := bgv.NewPlaintext(params, params.MaxLevel())
		dec.Decrypt(ct, pt)

		decoded := make([]uint64, params.N())
		if err = ecd.Decode(pt, decoded); err != nil {
			panic(err)
		}
		return decoded
	}

	rlk := kgen.GenRelinearizationKeyNew(sk)
	gal := params.GaloisElementsForInnerSum(1, params.N())

	evk := rlwe.NewMemEvaluationKeySet(rlk)

	galk := kgen.GenGaloisKeysNew(gal, sk)

	eval := bgv.NewEvaluator(params, evk)
	evalks := rlwe.NewMemEvaluationKeySet(rlk, galk...)
	eval = eval.WithKey(evalks)

	//Init inputs
	values1 := make([]uint64, params.N())

	sum := 0
	for i := range values1 {
		if rand.Int()%3 == 0 {
			values1[i] = 1
			sum += 1
		}
	}
	fmt.Printf("Input: %v...\n", values1[:100])

	//Encode + encrypt
	pt1 := bgv.NewPlaintext(params, params.MaxLevel())

	if err = ecd.Encode(values1, pt1); err != nil {
		panic(err)
	}

	var ct *rlwe.Ciphertext
	if ct, err = enc.EncryptNew(pt1); err != nil {
		panic(err)
	}

	//Eval inner sum
	tmp := bgv.NewCiphertext(params, 1, params.MaxLevel())
	if err = eval.InnerSum(ct, 1, params.N(), tmp); err != nil {
		panic(err)
	}
/*
	var tmpRot *rlwe.Ciphertext
	if tmpRot, err = eval.RotateRowsNew(tmp); err != nil {
		panic(err)
	}

	if err = eval.Add(tmp, tmpRot, tmp); err != nil {
		panic(err)
	}
*/

	//Verify output
	decRes := decrypt(tmp)
	fmt.Printf("Expected: %d\n", sum)
	fmt.Printf("Computed: %d\n", decRes[0])
}

Edited: RotateRowsNew does compute the correct result

Thanks for the bug report. Fixed in #513.


Generate source code in src dir

Now all files get generated in the root of the repo. This makes the repo cluttered.

source code in src/ dir
Apache config should be in `apache2/conf/`` dir
etc. for other types of files

Update CI after fixing this.


Update synth_t structure

Update synth_t struct according to current FPGA structure, which sums to a size of 1244 bytes:
package shape_pkg;
    typedef enum logic [7:0]{
        SAWTOOTH = 0,
        SQUARE,
        SIN,
        PIANO
    } wave_shape;
endpackage
package protocol_pkg;
    //---------------------------------------------------------------------------------------------/
    // Definition of protocol for communication between MCU and FPGA
    //---------------------------------------------------------------------------------------------/
    import shape_pkg::*;

    typedef struct packed {
        logic [31:0] gain /* FIXED POINT */;
        logic [31:0] duration;
    } envelope_t;

    typedef struct packed {
        logic [31:0] freq /* FIXED POINT */;
        logic [31:0] velocity;
        envelope_t [0:`ENVELOPE_LEN-1] envelopes;
        wave_shape shape;
        logic [7:0] cmds;
    } wavegen_t;

    // typedef struct packed {
    //     logic [31:0] delay;
    //     logic [31:0] feedback;
    // } echo_t;

    typedef struct packed {
        logic signed [31:0] balance /* FIXED POINT */;
    } pan_t;

    // typedef struct packed {
    //     logic [31:0] playback_volume;
    //     logic [7:0] playback_speed;
    //     logic [7:0] cmds;
    // } looper_t;

    typedef struct packed {
        // Tau values are delays. 0, 1, 2 and 3 are for comb filters, selected in a 1:1.5 range where
        // the smallest determines the initial delay. Tau 4 and 5 are for all-pass filters, usually
        // set to 5ms and 1.7 ms. Tau is computed as time [ms] * sample rate
        // Gain values are always < 1.0. 0, 1, 2 and 3 are for comb filters = 10 ^ (-3 t / T), where
        // T is the reverb time.
        logic signed [31:0][0:5] tau;
        logic signed [31:0][0:6] gain /* FIXED POINT */;
    } reverb_t;

    typedef struct packed {
        wavegen_t [0:`N_OSCILLATORS-1] wave_gens;
        logic [31:0] master_volume;
        reverb_t reverb;
        pan_t pan;
        // looper_t looper;
        // echo_t echo;
    } synth_t;
endpackage

Possible changes to save bandwidth:
    typedef struct packed {
        logic [7:0] gain /* FIXED POINT */;
        logic [7:0] duration;
    } envelope_t;

Takes size from 1244 bytes to 524 bytes.


Image component renders blurry on Desktop

Reproducible in current experimental ImageViewer implementation.
iOS vs Desktop:

Android:

@SebastianAigner is this still reproducible with the latest changes? I cannot reproduce the error anymore (images changed too) in the experimental example.

Nope, looks good now!

Please check the following ticket on YouTrack for follow-ups to this issue. GitHub issues will be closed in the coming weeks.


IsParameterized and GetParameterDetails don't work with route segment constraints

The following two Nancy extension methods use a regex that doesn't support route segment constraints (e.g. {id:int}):

Nancy.Extensions.StringExtensions.IsParameterized(string segment)
Nancy.Extensions.StringExtensions.GetParameterDetails(string segment)

The regex supports curly segments with a name, then an optional default prefixed by ?:

{(?<name>[A-Za-z0-9_]*)(?:\?(?<default>[A-Za-z0-9_-]*))?}

It appears the Nancy codebase doesn't use either nor does it use the ParameterSegmentInformation class, I'm not sure if the regex should be fixed or if this is just obsolete code that hasn't been removed yet.
I'm attempting to use these functions to add path parameters to automatically generated documentation, I'd prefer to use the actual parsing code and I'd love to get instances of IRouteSegmentConstraint but that doesn't seem possible without a URL.
Steps to Reproduce
Looking at the unit tests there are the following cases:
"route".IsParameterized().ShouldBeFalse();
"{param}".IsParameterized().ShouldBeTrue();
"".IsParameterized().ShouldBeFalse();

While something like this will fail:
"{param:int}".IsParameterized().ShouldBeTrue();

System Configuration
The regex and extension methods are unchanged between 1.x-WorkingBranch and master.

@phillip-haydon you did work on the {params:xxxxx} stuff, care to look at this?


Fullscreen image viewing

After an image is shown in the sidebar, add an option for viewing it fullscreen. This should still use player51 to show detections.

Resolved by #254 and #412