add pytest tests

I want to add some tests to validate that everything is working as intended.
Would love some unit tests to make sure individual functions work as intended and some integration tests to ensure that, overall, the script is working normally.

Labeled this as Help Wanted, as I have only a bit of experience with pytest, so if anyone just loves working with pytest, I'd love their help.


Paritial Refunds

Adds support for partial refunds on hpp payments.
Also, api failures do not fail the payment now (see last commit message for explanation).

Might be our Solidus implementation, but we're getting a number of Cannot transition state via :failure from :void (Reason(s): State cannot transition via "failure"). Might be related to cancelling an order making the payment void, whilst it sends a void request to adyen, so when the notification comes back it can't do payment.failure!. It's difficult to see exactly what's going on because the notification doesn't seem to get saved.

Looks like that error is caused by Spree::Order.cancel!.
Spree::Order.cancel! calls cancel! on all payments. For our Adyen payments we don't actually make use of the capture!, credit! and cancel! methods found in Spree::Payment::Processing because They assume all actions are synchronous and change the payment state.
In this situation cancel! is called on our payment, in this case a payment from Sofort or other payment method that doesn't support api cancellations or refunds, which calls cancel on the Spree;:Gateway::AdyenHpp, which makes the api request, and finally the payment is marked as void.
Later, we get a notification from Adyen saying the cancel_or_refund modification failed, and the payment is marked as a failure. Because the payment is already void, it cannot transition to failed and so we get an exception.
I'm currently working on a fix for this, which I will have tomorrow, but as it stands it's isolated from this refund code which I believe is good to go.


codecs.encode throws a TypeError exception when encoding bytes

Description
When using codecs.encoding with the obj argument as an instance of bytes, a TypeError: expected str, got bytes exception is thrown.
Steps to Reproduce
Run the code:
import codecs

x = b'f483'
y = codecs.encode(x, 'hex')
z = int(y, 16)

Expected behavior: variable z to be<PHONE_NUMBER>. Tested with CPython 2.7.13.
Actual behavior: TypeError: expected str, got bytes exception is thrown.
Versions
IronPython 2.7.9 <IP_ADDRESS> on .NET 4.0.30319.42000

The argument of binascii.b2a_hex probably needs a [BytesConversion] attribute.


Scrolling with lower vertical resolution

With a lower vertical resolution, it's not possible to scroll to the lower rows:

This is an issue with ranking as well:


feat: add log type info collection for test entries to enable log decoding at forc-test

Description
Adds necessary capabilities to forc-pkg to collect types of logs used in a test. Type information is retrieved from the type engine, and collected for each test entry. This will later on be used for decoding the log receipts at forc-test.

closed in favor of #5812


_loadSourceElement doesn't honor crossOrigin

Title says it all, this function is not setting the crossOrigin property of the elements it loads.

@englercj do we have any update on this?

I just haven't had time to put a fix in, a PR would be great.

would do for sure if i figure out a fix :)

If you are using new Image() to load images and now control over server hosting images, then you can add CORS as following:
const image = new Image();
image.crossOrigin = "anonymous"; // ask for CORS permission
image.src = 'https://www.somwhere.png';

More information can be found here:
image element Attributes
CORS Attributes settings


strange error when trying to do Compatibility 4 1 profile vs Core 4 1 profile

Hey! So after some futzing, i got the readme example to work wiht >= opengl3 flavor stuff. as below.
i did hit a strange crash i'm not sure how to understand when i tried a compatiblity profile (not that i expect to need it, but was just trying things)
carterschonwald@CarterHydra ~/W/p/a/genicad (main) [1]> cabal run exe:trash_demo
Build profile: -w ghc-9.4.7 -O1
In order, the following will be built (use -v for more details):
 - genicad-<IP_ADDRESS> (exe:trash_demo) (file app/Trash.hs changed)
Preprocessing executable 'trash_demo' for genicad-<IP_ADDRESS>..
Building executable 'trash_demo' for genicad-<IP_ADDRESS>..
trash_demo: SDLCallFailed {sdlExceptionCaller = "SDL.Video.glCreateContext", sdlFunction = "SDL_GL_CreateContext", sdlExceptionError = "Failed creating OpenGL context at version requested"}

the full code with working core profile is as below
{-# LANGUAGE OverloadedStrings,GHC2021 #-}

module Main ( main ) where

import Control.Exception
import Control.Monad.IO.Class
import Control.Monad.Managed
import DearImGui
import DearImGui.OpenGL3
import DearImGui.SDL
import DearImGui.SDL.OpenGL
import Graphics.GL
import SDL
import SDL.Video

main :: IO ()
main = do
  -- Initialize SDL
  initializeAll

  runManaged $ do
    -- Create a window using SDL. As we're using OpenGL, we need to enable OpenGL too.
    window <- do
      let title = "Hello, Dear ImGui!"
      let config = defaultWindow { windowGraphicsContext = OpenGLContext defaultOpenGL{glProfile=Core Normal 4 1} , windowResizable       = True }
      managed $ bracket (createWindow title config) destroyWindow

    -- Create an OpenGL context
    glContext <- managed $ bracket (glCreateContext window) glDeleteContext

    -- Create an ImGui context
    _ <- managed $ bracket createContext destroyContext

    -- Initialize ImGui's SDL2 backend
    _ <- managed_ $ bracket_ (sdl2InitForOpenGL window glContext) sdl2Shutdown

    -- Initialize ImGui's OpenGL backend
    _ <- managed_ $ bracket_ openGL3Init openGL3Shutdown

    liftIO $ mainLoop window

mainLoop :: Window -> IO ()
mainLoop window = unlessQuit $ do
  -- Tell ImGui we're starting a new frame
  openGL3NewFrame
  sdl2NewFrame
  newFrame

  -- Build the GUI
  withWindowOpen "Hello, ImGui!" $ do
    -- Add a text widget
    text "Hello, ImGui!"

    -- Add a button widget, and call 'putStrLn' when it's clicked
    button "Clickety Click" >>= \x -> case x of
      False -> return ()
      True  -> putStrLn "Ow!"

  -- Show the ImGui demo window
  showDemoWindow

  -- Render
  glClear GL_COLOR_BUFFER_BIT

  render
  openGL3RenderDrawData =<< getDrawData

  glSwapWindow window

  mainLoop window

  where
    -- Process the event loop
    unlessQuit action = do
      shouldQuit <- checkEvents
      if shouldQuit then pure () else action

    checkEvents = do
      pollEventWithImGui >>= \x -> case x of
        Nothing ->
          return False
        Just event ->
          (isQuit event ||) <$> checkEvents

    isQuit event =
      SDL.eventPayload event == SDL.QuitEvent

So... what is the problem here?
Readme example uses OpenGL2 and its defaultOpengl requests a version 2 compat context.
You tried to request the 4.1 profile and it failed?.. Does it work without the dear-imgui stuff?

it works when i set Core 4 1, but fails when I set the context to Compatibility 4 1, this might be an SDL2 binding/library issue


Unable to seed a file via client

WebTorrent version: 0.94.3
Node.js version: 6.2.1
Browser name/version (if using WebTorrent in the browser): Electron 1.2.1

Trying the usage example,
// When user drops files on the browser, create a new torrent and start seeding it!
dragDrop('body', function (files) {
  client.seed(files, function (torrent) {
    console.log('Client is seeding:', torrent.infoHash)
  })
})

.../node_modules/webtorrent/lib/torrent.js:851 Uncaught Error: invalid selection gets thrown

I rechecked and It happens with all the tiny text files but succeeds for larger files. @feross Any solution?

Can you share an example of one such text file?

I tried it again with different files of similar sizes and it worked. Didn't encounter it again! 😄


kms "AccessDeniedException" handling

Some KMS keys do not allow viewing of details, which was generating exceptions.

Coverage increased (+0.04%) to 53.536% when pulling a82bfa38f2751cae361c111585a233a175e6054e on Bridgewater:8219_kmsfix into db30af1f440fb43791030d669128719aafb9d85e on Netflix:develop.


Norm delimiter width inconsistent?

While playing around with some math, I noticed that the width of the delimiters of norm are inconsistent: for large content, they seem to get scaled horizontally in an undesirable way.
I've included the output from Typst and Latex:

Also, the size of x and y in the vector are reduced compared to the first norm, but I assume that is desired behavior?
I tried to look into the code for glyph.stretch_vertical in library/src/match/stretch.rs but I could not spot where the behavior for this might be arising.
Do you know what would be needed to fix this? I'm happy to try to take a crack at it if it's not too complicated 🙂

The reduces size might result from this being inline math in Typst and display math in TeX? I'm unsure whether this is something we can fix. It might just be how the stretched symbol looks in the font.

Thanks! I tried to move from inline to block, and the behavior is the same as inline (with the stretched symbols growing larger horizontally. The vertical bars also seem to be thicker.

What does your actual typst code look like?

I can confirm that something is weird
Compare Typst

with LaTeX

In Typst it's like the delimiter is just scaled up. The same thing happens with abs(), and possibly other delimiters.
Compare Typst

with LaTeX

I'm closing this issue, because it's a font issue and not a typst issue.
However I can confirm that the maintainer is working on improving this.

It's fixed after https://github.com/typst/typst/pull/2764 is merged.


Add parser for appellate case query pages

We need to add support for parsing appellate case query pages.

The RECAP extension issue for this is here: https://github.com/freelawproject/recap/issues/317


[KEDA] Update helm values to work from v2.14.0

Issue:
Since v2.14.0, #625 updates some Helm chart values that are not backward compatible with the old settings. The serviceAccount has been separated per service, such as operator, metricServer, and webhooks.This causes the upgrade to v2.14.0+ to recreate the new operator serviceAccount without the IAM role annotation
Description of changes:

Update version to current latest v2.14.2
Move creating namespace out of irsaRole condition check to avoid CDK delete keda namespace if we change irsaRole[] to empty
Remove workaround for SQS Scalar https://github.com/kedacore/keda/issues/837 as KEDA-is-secure-by-default
Update  serviceAccount to serviceAccount.operator

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/do-e2e-tests

/do-e2e-tests

Failure in e2e unrelated to the changes here.
FAIL test/cloudwatch-insights.test.ts
I will create a PR to fix them and rerun.

/do-e2e-tests

/do-e2e-tests


Style attribute side effect scope should not contain value

Environment
"@unhead/vue": "^1.9.13",
"nuxt": "^3.12.1"

Reproduction
Stackblitz
Describe the bug
Currently using useHead to update body style attributes for different pages. It was not working for some reason, the style would be cleared no matter what.
After some investigation, I found that the styles are cleared because the tracked scope includes the value of the attribute, making the previous pending side effect unable to be removed.
https://github.com/unjs/unhead/blob/c0ca0c1cc196928b40952d525f7f5e0d9edd54ce/packages/dom/src/renderDOMHead.ts#L111-L120
My proposal is to change the scope of the side effects for style attributes to ${ck}:${k}, removing the value from the scope. Can confirm the bug is fixed in my patched local project.
Additional context
No response
Logs
No response

Hi, thank you for the detailed issue and reproduction.
A fix is available in v1.9.14.


Rust version of sshnpd

Is your feature request related to a problem? Please describe.
The python version of sshnpd has substantial underlying requirements that use a lot of flash storage.
Customers are asking for something that will fit into ~2MB Flash on a MIPS based OpenWRT device.
Describe the solution you'd like
A Rust based version of sshnpd that will fit into 2MB by making use of existing shared libraries for crypto etc.
Describe alternatives you've considered
C would also fit in well with existing OpenWRT packages.

During PR73 we've been able to look at Rust (and the Rust tooling within OpenWRT) closely enough to establish that a Rust version is unlikely to satisfy the needs expressed. So shifting focus to C, and moving this to the backlog.

Dropping this after considerable progress and learning with C version.


Export as JSON

I'm new to Python so I apologize if there is a simple solution, but is there a way to output the optimized lineups as JSON?

Hi, This library only supports export to csv, so for exporting to json you need to write custom exporter. What format do you expect for exported json?

I think what's given to us is sufficient enough. Ex:
{
    "id": 1,
    "firstName": "-",
    "lastName": "-",
    "positions": ["PG", "SG"],
    "team": "-",
    "salary": 1,
    "fppg": 1,
    "gameInfo": "TOR @ GSW"
}


Bluetooth

Resolves #560.

Wonderful! It could be better if something like BTHPROTO_RFCOMM constant is included in this pull request. Thank you!

This has been already merged in by #753
-> should be closed


Video Challenges- JavaScript Lingo- Question 3

Video Challenges-
JavaScript Lingo: MDN and Documentation
Question 3

The title and question for this part only states Question 3 with a passing answer of True.
Question should be removed or updated.

@jp5486 just fixed this for Issue #6781 via PR #6890
You can close this.

Closing as a duplicate of #6826. Thanks and happy coding!


Creating settings on startup not working

See https://github.com/rancher/telemetry/pull/19#issuecomment-484263244
Looks like we somehow broke a use case for settings.
possibly related to changes made in this pr
https://github.com/rancher/rancher/pull/17960/files

➤ Craig Jellick commented:
fixes the telemtry issue referenced in er-173

➤ Jack Luo commented:
The bug is reproduced in Rancher v2.2.2
Steps:

run rancher container
when setting the password, do not check the for collecting anonymous data
check the page url/v3/settings to confirm that the variable telemetry-uid does not exist
run the following command

curl -k -u your-token -X POST -H 'Content-Type: application/json' -d '{"name":"telemetry-uid", "value": "foo"}' https://url/v3/settings/Result:

the command returns failure

The bug fix is validated in Rancher: master and v2.2.3-rc1
Following the same steps as before, and see the variable is created and its value is set to foo as expected.


Gitignore

Added a .gitignore file to improve GitHub Desktop use.

Heh. Guess I've always forgot to push that.
So I'm running the don commands inside the DMSP dir. First couple took a half second. The third failed as always. The fourth is taking its time, the group change. Hopefully that does it.
I'm on the second command for the pysatData dir overall.
On Oct 31, 2017, at 12:16 PM, Angeline Burrell <notifications<EMAIL_ADDRESS>wrote:
Added a .gitignore file to improve GitHub Desktop use.

You can view, comment on, or merge this pull request online at:
https://github.com/rstoneback/pysat/pull/3
Commit Summary

Merge pull request #3 from rstoneback/master
Merge pull request #4 from rstoneback/master
Merge remote-tracking branch 'rstoneback/master'
Merge pull request #5 from rstoneback/master
Merge pull request #6 from rstoneback/master
add .gitignore

File Changes

A .gitignorehttps://github.com/rstoneback/pysat/pull/3/files#diff-0 (65)

Patch Links:

https://github.com/rstoneback/pysat/pull/3.patch
https://github.com/rstoneback/pysat/pull/3.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/rstoneback/pysat/pull/3, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ADbdeTrVro0HPL0uLIgDy-Kuf2SyQxtiks5sx1YAgaJpZM4QNHPc.

Coverage remained the same at 80.056% when pulling ccbded47ed7b7e81578376c6e76b4fa07b31f61c on aburrell:gitignore into adb614d8059b32acca8bc7138ce2f8e36078e3b3 on rstoneback:master.


vendor/autoload.php in submodule with composer.json sought in wrong place

Warning message:
.../submodule/vendor/autoload.php missing, not installed?

I think this is down to the submodule being loaded first, and may be making a mess of the whole autoload system.

Working directory is a bit of a complex problem, but ultimately it should be one of:

User-supplied value
Directory of composer.json for first file
Shortest directory matching all files?
Directory of first file

"First file" behaviour is done now, but I do want to add a user override

--working-directory now supported


[redbull.com] ERROR: No video formats found

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2019.07.14
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl https://www.redbull.com/int-en/tv/video/AP-1XH4Y6WCN1W11/men-s-dh-finals-les-gets --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.redbull.com/int-en/tv/video/AP-1XH4Y6WCN1W11/men-s-dh-finals-les-gets', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.07.14
[debug] Python version 2.7.15+ (CPython) - Linux-4.15.0-20-generic-x86_64-with-LinuxMint-19-tara
[debug] exe versions: ffmpeg 3.4.6, ffprobe 3.4.6
[debug] Proxy map: {}
[RedBullTV] AP-1XH4Y6WCN1W11: Downloading access token
[RedBullTV] AP-1XH4Y6WCN1W11: Downloading video information
[RedBullTV] AP-1XH4Y6WCN1W11: Downloading m3u8 information
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/redbulltv.py", line 82, in _real_extract
    self._sort_formats(formats)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1327, in _sort_formats
    raise ExtractorError('No video formats found')
ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

Hello there!
I've got an 'No video formats found' error on redbull.com site with these links:
https://www.redbull.com/int-en/tv/video/AP-1XH4Y6WCN1W11/men-s-dh-finals-les-gets
https://www.redbull.com/int-en/tv/video/AP-1XH4Y6X2D1W11/women-s-dh-finals-les-gets

Unfortunately this seems to unreproducible now, as those two links 404. This issue should be closed, I believe.

ran into the same issue with this url
https://www.redbull.com/int-en/live/women-downhill-2020-maribor-round-2

a few hours later it is working... so i guess pages are changeing after some time...


add Apache license to psql docker files

shouldn't be on master...  needs to be psql-rebase branch..


update russian translation

Are you going to be around over the next 2 hours? I still have minor translations changes to commit. Planning to release in 4-6 hours

Yeah, sure, I will update the translation if needed.

All I need to change is all fey presence powers to a 15ft cone instead of 3x3 cube originating from caster. You can go ahead and update that one. There are 3 descs that need changes.


Unable to Migrate VM from  admin to user Account

ISSUE TYPE

Bug Report
Improvement Request
Enhancement Request
Feature Idea
Documentation Report
Other

COMPONENT NAME

VM

CLOUDSTACK VERSION

4.18.1 version

CONFIGURATION

OS / ENVIRONMENT

SUMMARY

STEPS TO REPRODUCE

Instal 4.18.1 version apache cloud stack. Lauch a VM in admin account. Now migrate the  VM from admin account to user account.

EXPECTED RESULTS

Live migration of VM from admin account to user account should happen

ACTUAL RESULTS

Root
![vm](https://github.com/user-attachments/assets/90fc3c52-ab78-4676-85e3-5c9d9306e05a)
Account doesnot have permission to operate within domain

@anjanahkarthic
Could you please provide more information, what was the exception message that you received when you performed the operation
Did you try the API call
https://cloudstack.apache.org/api/apidocs-4.18/apis/assignVirtualMachine.html
Please stop the vm and try to assign the vm to a different account

@anjanahkarthic I have also run across this issue if the template/ISO that the instance was created with is not accessible to the target account. If the template/ISO was not public, you need either update template/ISO permissions to share with the target account, or make it public.

@anjanahkarthic that is expected behaviour. If you want to assign a VM to a particular account then associated entities such as template, network, etc must also be accessible to that account.

I am able to migrate VMs from the admin account to all other accounts except for one particular account. There are no logs indicating a Java stack trace. Below is the log generated during the VM migration failure:
2024-07-31 23:57:15,396 DEBUG [c.c.u.AccountManagerImpl] (qtp1444635922-1869211:ctx-53b8517d ctx-be4d1fe7) (logid:89d18691) Access to Account [{"accountName":" rootadmin","id":6,"uuid":"8f70f318-f905-4557-a448-2d213ae28882"}] granted to Account [{"accountName":"xxxxxxx@gmail.com","id":332,"uuid":"3c2ca9a1-00c9-41bb-a391-06c177cdbe7f"}] by DomainChecker
2024-07-31 23:57:15,433 ERROR [o.a.c.a.c.a.v.AssignVMCmd] (qtp1444635922-1869211:ctx-53b8517d ctx-be4d1fe7) (logid:89d18691) Failed to move vm due to: [Ljava.lang.StackTraceElement;@18d33d83
2024-07-31 23:57:15,433 INFO  [c.c.a.ApiServer] (qtp1444635922-1869211:ctx-53b8517d ctx-be4d1fe7) (logid:89d18691) Failed to move vm due to Account<EMAIL_ADDRESS>does not have permission to operate within domain id=e2f92784-02d3-11ee-9664-7a9b079e52f0


Create a knowledge map

https://github.com/NCATS-Tangerine/translator-knowledge-beacon/issues/40
https://biolink.github.io/biolink-model/
This would be globally useful in describing the biomedical data contained in wikdata, and could theoretically be generated by @andrawaag 's Shex models
It could also be used to draw a new genewikiworld network diagram (like: https://github.com/SuLab/GeneWikiCentral/issues/78)
See also:
https://github.com/biolink/biolink-model/issues/5
https://github.com/biolink/biolink-model/issues/8
https://github.com/biolink/biolink-model/issues/9

Currently restructuring these models here https://github.com/SuLab/Genewiki-ShEx


Is there a method I can call to tell Homebridge that my device is offline / not responding?

Sorry, this issue should have been raised in the homebridge repo not the template.

Describe Your Problem:

I am creating a plugin to control a swimming pool heat pump. To do this I am using the Thermostat service. Sometimes the heat pump will disconnect from the WiFi network and when that happens I would like my plugin to be able to tell Homebridge that the accessory is offline.
How I imagine this working is that when Homebridge or the Home app attempts to fetch new data for the accessory from the plugin, an initial condition checks the Heat Pump API to see if the device is online or offline. What I would like to know is if there is anything in the Homebridge API that I can call to report back that the device is offline? I'd preferably like to do this once for the whole accessory instead of having to implement it in every single Characteristic getter and setter.
Sorry if this is a blindingly obvious question. I'm still trying to get comfortable with your API!
Logs:
NA

Plugin Config:
{
  "pluginAlias": "NorsupHomebridgePlugin",
  "pluginType": "platform",
  "singular": true,
  "schema": {
    "type": "object",
    "properties": {
      "username": {
        "title": "Aqua Temp Username",
        "type": "string",
        "required": true,
        "default": ""
      },
      "passwordHash": {
        "title": "MD5 Hashed Password",
        "type": "string",
        "required": true,
        "default": ""
      }
    }
  }
}

Screenshots:

Environment:

Plugin Version:
Homebridge Version:  1.1.6
Node.js Version:  14.7
NPM Version:  6.14.7
Operating System:  macOS

return an error in the first argument of the callback value.
eg.
https://github.com/oznu/homebridge-esp8266-garage-door/blob/master/homebridge/src/platformAccessory.ts#L86-L90

return an error in the first argument of the callback value.
eg.
https://github.com/oznu/homebridge-esp8266-garage-door/blob/master/homebridge/src/platformAccessory.ts#L86-L90

Thanks very much for the speedy reply! This solution would definitely work but I can't help but feel without adding it to every single callback it's a little bit hacky. What would be great is if an accessory had an event for when any of the Characteristic were attempting to get or set that would cancel these attempts if the accessory was reported to be offline?

Not really unfortunately, you could create a wrapper function, decorator, or just a reusable function you call at the start of each get / set callback.

Not really unfortunately, you could create a wrapper function, decorator, or just a reusable function you call at the start of each get / set callback.

Yep, sounds like a decorator might be the way to go. Thanks for your help @oznu


Blank Startup page

VSCode Version: 1.19.0 (1.19.0)
OS Version: 10.12.6 (16G1114)

Steps to Reproduce:

Download and install
Start the app

Reproduces without extensions: Yes (same as above produce the the same bug)

Do you still see the issue when running code --user-data-dir <path to some empty folder>?
If the menu items are responding, then share any errors/callstacks from Help -> Toggle Developer Tools -> Console

Most likely this is the same as #40329
@hamaney Can you check if you have editor.tokenColorCustomizations set to null in your settings file (you can find it at ~/Library/Application Support/Code/User/settings.json). If yes, then set it to {} instead and then try opening VS Code.

@ramya-rao-a  yes I do see the issue when I run
code --user-data-dir <EmptyFolder> and
code --disable-gpu
Here is the Console output:
index.js:5 TypeError: Cannot read property 'comments' of null
    at file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:2920:762
    at Array.forEach (native)
    at e.setCustomTokenColors (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:2920:735)
    at new e (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:2927:679)
    at t.create (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:90:103)
    at e._createInstance (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:1209:289)
    at e.createInstance (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:1208:560)
    at e.initServiceCollection (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:4516:741)
    at e.createContents (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:4511:118)
    at e.open (file:///Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/workbench.main.js:4518:113)
onError @ index.js:5

when I checked editor.tokenColorCustomizations i foun it was set to null in the settings file at ~/Library/Application Support/Code/User/settings.json. After changing its value to {} it workd :)
Thanks

duplicate of #40339
The fix will be out in the recovery build of 1.19.1


commit-mono: 1.132 -> 1.134

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/eigilnikolajsen/commit-mono/releases.
meta.description for commit-mono is: An anonymous and neutral programming typeface focused on creating a better reading experience
meta.homepage for commit-mono is: https://commitmono.com/
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.134 with grep in /nix/store/ad0mngkixlfvrz4mzhjkdnhi3z5bk43r-commit-mono-1.134
found 1.134 in filename of file in /nix/store/ad0mngkixlfvrz4mzhjkdnhi3z5bk43r-commit-mono-1.134

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
commit-mono

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ad0mngkixlfvrz4mzhjkdnhi3z5bk43r-commit-mono-1.134 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A commit-mono https://github.com/r-ryantm/nixpkgs/archive/5b6244cb5002bd5d0516874ee1cebe020be38c83.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ad0mngkixlfvrz4mzhjkdnhi3z5bk43r-commit-mono-1.134
ls -la /nix/store/ad0mngkixlfvrz4mzhjkdnhi3z5bk43r-commit-mono-1.134/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

commit-mono

Maintainer pings
cc @yoav-lavi for testing.

@r-ryantm this already has an open PR here:https://github.com/NixOS/nixpkgs/pull/249267
I think either can be merged


Playtime color change

[x] This issue is for enhancement/bug fixing.
[ ] This issue is an addition to JSON database.

[ ] Pull Request Title is of form Added [Anime Name].

[ ] This addition is already on ongaku.

[ ] This PR is an improvement to current addition.

[x] I have checked my addition locally and it is working and won't break existing entries.
[x] I have gone through Contribution Guidelines.
[x] This pull request will be closed if I failed to update it even once in a week.

This was a fix I noticed to the Playtime being hard to read with darker background images. I set it to the same transparent background color and font color as the playlist to maintain a uniform appearance while allowing greater visibility of the time.

@sbrown17 thanks for this. 👍
Also, don't feel shy to star the repo. 😆


I got a NullPointerException when I tried to view the page.

Will no one fix it?

I had the similar issue, this fixed it:


Should rolt have its own math types?

Jolt, and by extension JoltC and joltc-sys have their own math types. This is unavoidable.
rolt, on the other hand, is a Rust library and so we've got some options for what math types to expose:

Expose JPC_* types from JoltC and use them for everything
Create new math types like rolt::Vec3
Use and re-export types from another crate like glam

The current releases of rolt have their own types, with conversions defined to the JoltC math types. Internally, those types are converted to Jolt's math types.
I'm currently leaning towards option 3: changing the library to depend on glam as a public dependency.
1: Only export JPC_ types, potentially with type aliases
Pros:

Fewer total types involved, fewer conversions to write

Cons:

The rolt crate cannot implement mint conversions or methods on these types
All users have to write conversions, either via mint or directly to these types

2: Use custom math types
Pros:

We can write conversions to JPC_ math types and implement helpful methods directly

Cons:

I have to maintain a math library.
All users have to write conversions, either via mint or directly to these types

3: Use types from glam or similar
Pros:

We get to use existing math types
Some users may already be using these types, similar to rapier with nalgebra
Users will already be able to convert their math types to glam via mint

Cons:

Semver churn from having a pre-1.0 public dependency

I have run into this a bit with both yakui and crevice

Cannot implement traits to assist in conversion to/from JPC_ math types.

Let's use glam!!


Change GetSelfPastesByAmount to fetch only given amount of paste IDs

Change GetSelfPastesByAmount() to fetch pastes after fetching only given amount of paste IDs, using GetSelfPasteIdsByAmount() ( #7 )

Used GetSelfPasteIdsByAmount() in GetSelfPastesByAmount() to fetch amount amount of paste IDs under user's account.
Replaced GetSelfPastes() used inside GetSelfPastesByAmount() with with a similar logic but iterating through the newly fetched pasteIDs

Related Issue #6


Tobin vuid spec integration

This is the VUID migration we've been pushing for since last year.
This change uses the same general format for our accounting in validation layers, but all of the ENUMs now use 8-digit HEX to represent the errors, and the mapping from a VUID string to the HEX value can be seen in vuid_mapping.py script.
The vuid_mapping.py script can be used by code-gen scripts to determine which ID relates to a given error and then errors IDs should be easily integrated into existing codegen (parameter_validation.cpp).
I've also added the file "layers/old_vuid_to_new_mapping.txt" to allow for simple reference and mapping between the legacy VUIDs and the new values. All of the code references should already be updated, but this is for ISVs, tools, issues, etc, that may need to map from the old values to the new.
There's a bit of extra functionality left over in spec.py from the previous ID method as well as from the migration itself so I'll have some follow-on commits to clean that up and streamline the new process for updating the IDs each week based on the json file.

 Is this to be expected?

Speaking of which, @jeremy-lunarg, you now need to rename your VALIDATION_ERROR_0nnnn layer validation tests.

vkvalidatelayerdoc.sh are not expected as I had it clean locally prior to testing. I'll investigate and fix. No need to rename tests as those were renamed as part of migration.

I just pulled master, did a clean build, and ran vkvalidatelayerdoc.sh and it's passing. Can you double-check clean build, @jeremy-lunarg and if you're still seeing errors file an issue and assign to me?

Mark just set me straight. It does pass, but I'm still seeing a lot of error spew. I'm told this is working as intended.

Yeah, it'd better to suppress these warnings unless in a verbose or debug mode.


feat: re-implement calculateTransactionFee

This PR re-implements the calculateTransactionFee to unify all logic for calculating the fee for an already processed transaction.

@Torres-ssf, hi.
It seems that your implementation reports the wrong value for this transaction:

calculateTransactionFee reports 2212
if we subtract output from input: 10000000 - 9997789 = 2211


Set learning rate of GradientBoosting

Is your feature request related to a problem?
It's not possible to set the learning rate of gradient boosting.
Desired solution

Add a new parameter learning_rate: float to the initializer of safeds.ml.classification.GradientBoosting and safeds.ml.regression.GradientBoosting
Raise a value error if learning_rate <= 0
Pass it along to learning_rate of the wrapped scikit-learn model in the fit method

Possible alternatives (optional)
No response
Screenshots (optional)
No response
Additional Context (optional)
No response

:tada: This issue has been resolved in version 0.12.0 :tada:
The release is available on:

v0.12.0
GitHub release

Your semantic-release bot :package::rocket:


Properly detect failing fallocate

The check for CAN_FALLOCATE in whisper.py assumes that if it can import ctypes.util it can fallocate. This assumption is not all the time valid, since on most solaris based operating systems running ZFS will fail. I believe the assumption is not correct.

I can confirm that fallocate will fail on ZFS on Solaris 11.1. It seems to work fine in Solaris 11.3 with ZFS, though.
try:
  import ctypes
  import ctypes.util
  CAN_FALLOCATE = True
except ImportError:
  CAN_FALLOCATE = False

fallocate = None

if CAN_FALLOCATE:
  libc_name = ctypes.util.find_library('c')
  libc = ctypes.CDLL(libc_name)
  c_off64_t = ctypes.c_int64
  c_off_t = ctypes.c_int

  try:
    _fallocate = libc.posix_fallocate64
    _fallocate.restype = ctypes.c_int
    _fallocate.argtypes = [ctypes.c_int, c_off64_t, c_off64_t]
  except AttributeError:
    try:
      _fallocate = libc.posix_fallocate
      _fallocate.restype = ctypes.c_int
      _fallocate.argtypes = [ctypes.c_int, c_off_t, c_off_t]
    except AttributeError:
      CAN_FALLOCATE = False

  if CAN_FALLOCATE:
    def _py_fallocate(fd, offset, len_):
      res = _fallocate(fd.fileno(), offset, len_)
      if res != 0:
        raise IOError(res, 'fallocate')
    fallocate = _py_fallocate
  del libc
  del libc_name

# The actual test
fd = open("test", "w")
fallocate(fd, 0, 4096)

From the posix_fallocate man page on Solaris 11.1:
NOTES
     The posix_fallocate() function is supported only for regular
     files  residing  on UFS filesystems. Attempts to use it with
     files on any other filesystem  type  results  in  an  EINVAL
     error.

The same comment is in the Solaris 11.2 man page.

As the fallocate support is per filesystem I don't see how you could detect if fallocate is supported in advance. One solution could be to try to use fallocate, and if EINVAL is returned (thrown) then resort to using non-fallocate methods. It's perhaps not the most elegant solution.


ipc_service: Make the backend sample more realistic

The current static_vrings backend sample is allocating all host
instances on one core and all remote instances on the other core.
Change this by mixing up the roles of the instances to make the sample
more useful, complex and more close to the actual real-life usage.
Change the sample to dynamically print the role instead of hardcoding
it.
Signed-off-by: Carlo Caione<EMAIL_ADDRESS>

Could you detail what you mean by "more close to the actual real-life usage"?
The samples using OpenAMP have been designed to optimize the code for the remote side (i.e. the coprocessor).
For this the main processor is usually set to host role and and the remote processor is set to remote role.
This configuration allows to set the  CONFIG_OPENAMP_MASTER=n optimizing the OpenAMP library footprint for the remote processor which can have more memory constraint.
Another constraint is that the static vrings have to be initialized by the host before the remote can use it. If the remote processor is started by the host, this can lead to the use.

Could you detail what you mean by "more close to the actual real-life usage"?

What I'm thinking is a platform with 3 cores: A, B and C. They all want to communicate with each other. In this case it is likely that you will end up with instances on the same core that will be host with respect to one core but remote with respect to the other one.
[host] ─────instance───► [remote]

    ┌───┐                ┌───┐
    │ A ◄────────────────┤ B │
    └─┬─┘                └─▲─┘
      │                    │
      │                    │
      │                    │
      │                    │
      │                    │
      │        ┌───┐       │
      └────────► C ├───────┘
               └───┘

The samples using OpenAMP have been designed to optimize the code for the remote side (i.e. the coprocessor). For this the main processor is usually set to host role and and the remote processor is set to remote role. This configuration allows to set the CONFIG_OPENAMP_MASTER=n optimizing the OpenAMP library footprint for the remote processor which can have more memory constraint.

Yes, but there could be cases in which a core can be host and remote at the same time on different instances. This change is showing that also this configuration (that, I agree, is unusual) is supported by the backend.

Another constraint is that the static vrings have to be initialized by the host before the remote can use it. If the remote processor is started by the host, this can lead to the use.

But the backend (and the API) is meant to prevent that, indeed I can postpone the initialization of the host with respect to the remote and the sample will run just fine.

Could you detail what you mean by "more close to the actual real-life usage"?

What I'm thinking is a platform with 3 cores: A, B and C. They all want to communicate with each other. In this case it is likely that you will end up with instances on the same core that will be host with respect to one core but remote with respect to the other one.
[host] ─────instance───► [remote]

    ┌───┐                ┌───┐
    │ A ◄────────────────┤ B │
    └─┬─┘                └─▲─┘
      │                    │
      │                    │
      │                    │
      │                    │
      │                    │
      │        ┌───┐       │
      └────────► C ├───────┘
               └───┘

Thank for the clarification!
What about creating a specific sample for this configuration and keep existing one for host<->remote basic IPC?

Thanks for the clarification!

Thanks for your reviews :)

What about creating a specific sample for this configuration and keep existing one for host<->remote basic IPC?

Sure, no prob.

@carlocaione should we push this forward?

@carlocaione should we push this forward?

Not actually needed anymore. Closing.


v1.0.1: sidebar-right fix, section fix, CR Prize announcement

One thing: I didn't see a map file change there for the scss file, but I also don't see it in .gitignore. Unless browsers need it, I'd be inclined to remove it altogther since the repo will have the css file used by the extension as well as the scss file that serves as its source.

Reader to merge I think!


ix-select cannot be selected after clearing the input field

What happened?

Use official document : https://ix.siemens.io/docs/controls/select.
Focus on input field of the selector.
Clear the input field, such as item1.
Select item1 again.
Item1 cannot be selected at this time

What type of frontend frameware are you seeing the problem on?
Angular
Which version of iX do you use?
2.0.4
Code to produce this issue.
https://ix.siemens.io/webcomponent-examples/dist/preview-examples/select.html?theme=theme-brand-dark

I'm guessing you probably mean that the item can be deleted by backspace, but it doesn't change back to what it was when you click on it again.

Internal ref [IX-865]


Overlay - WebKit Browser

WebKit does not show the overlay on the latest release.
On line 690 I have changed this:
elem.style.opacity = 0;
to this:
elem.style.opacity = 1;
Will that have any negative effect? Thank you for the great product.

Can't reproduce in Linux/Chrome and OSX/Safari. Most probably this issue is up to your environment.

It is a complete blank page with nothing in it, so I don't think so.

Can you please create JSFiddle?
JSFiddle template: https://jsfiddle.net/limon/ad3quksn/

It only happens when the HTML file is blank. So don't worry that won't happen in most cases.


Support for MSG_WTX from BIP339

Bitcoin Core uses WTXID-based transaction relaying described in BIP339, it uses MSG_WTX (0x00000005) inv type (in inventory vector) see src.
So I suggest to add MSG_WTX into InventoryType.
Is it suitable?

@NicolasDorier  some info?

Hey @torx-cz sorry I just saw this

Released in 7.0.20

Thanks a lot @NicolasDorier.


Confusing reference to Key Vault VNet integration

At
https://learn.microsoft.com/en-us/security/benchmark/azure/baselines/key-vault-security-baseline#ns-1-establish-network-segmentation-boundaries
The text says:
"Service supports deployment into customer's private Virtual Network (VNet)"
and

Supported
Enabled By Default
Configuration Responsibility

True
False
Customer

This would lead me to believe that I can configure my KeyVault within a VNet.
However, when I follow the "Learn More" link it Key Vault is not listed.
https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-for-azure-services#services-that-can-be-deployed-into-a-virtual-network
It seem like the text of the baseline indicated that it is supported ("True" listen in the supported column) but the other page says the opposite.
Which is it?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 9ccbaaaf-2267-bbf4-c6c4-9e7cb63f3465
Version Independent ID: 8e0ae980-eace-6fde-59ec-61ea040196e0
Content: Azure security baseline for Key Vault
Content Source: benchmark/azure/baselines/key-vault-security-baseline.md
Service: key-vault
GitHub Login: @msmbaldwin
Microsoft Alias: mbaldwin

@garthoid
Thanks for your feedback! We will investigate and update as appropriate.

@garthoid
Thanks for bringing this to our attention.
I'm going to assign this to the document author so they can take a look at it accordingly
@msmbaldwin
Can you please check and add your comments on this doc update request as applicable.

@garthoid in configuration guidance says:
"Configuration Guidance: Azure Key Vault supports virtual network service endpoints which allows you to restrict the key vault access to a specified virtual network."
Which means you can restrict access in Key Vault to specific virtual network including private endpoints.

#please-close

However, when I follow the "Learn More" link it Key Vault is not listed.
https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-for-azure-services#services-that-can-be-deployed-into-a-virtual-network

It does list services like Compute, WebApps which can run under private network, so you can access Key Vault using those private endpoints. Which is described in configuration guidance:
"Azure Key Vault supports virtual network service endpoints which allows you to restrict the key vault access to a specified virtual network."

So why does it not say "key vault" in "Services that can be deployed into a virtual network" in https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-for-azure-services#services-that-can-be-deployed-into-a-virtual-network?


Sinatra 1.4 requires a different version of Tilt than what sinatra-contrib requires

Unable to activate sinatra-contrib-1.4.2, because tilt-2.0.1 conflicts with tilt (~> 1.3) (Gem::ConflictError)
In Gemfile:
sinatra-contrib (>= 0) ruby depends on
tilt (~> 1.3) ruby
sinatra (~> 1.4) ruby depends on
  tilt (2.0.1)

Just ran into this today as well.

@boblmartens - i was able to get around this. If i recall, i uninstalled all versions of tilt and sinatra conrtib then bundled (with contrib in my gemfile). That installed just fine!

9cd766a496cde59d661abaea6633613ecdc7806d

Thanks @zzak! I'm wondering if you know when an official release might be sent out.

When the build is green ;)
On Mon, Apr 27, 2015 at 5:31 AM, Bob Martens<EMAIL_ADDRESS>wrote:

Thanks @zzak https://github.com/zzak! I'm wondering if you know when an
official release might be sent out.
—
Reply to this email directly or view it on GitHub
https://github.com/sinatra/sinatra-contrib/issues/153#issuecomment-96633000
.

Touche. :-)

Is this fixed ? Any ideas what is the work around for this ?

Method described by @gffuentes worked perfectly for me. gem uninstall sintra-contrib and tilt, add them to Gemfile and run bundle install


The argument type

The argument type 'FutureOr Function(Request)' can't be assigned to the parameter type 'List'.?

Please provide some more info @djildo like dart version, shelf version, code snippet of where you added this middleware etc

Closing due to inactivity


System.Private.CoreLib.dll!System.Reflection.RuntimeAssembly.GetExportedTypes() Line 192	C#

System.Private.CoreLib.dll!System.Reflection.Assembly.ExportedTypes.get() Line 72	C#
Microsoft.Toolkit.Uwp.SampleApp.dll!Microsoft.Toolkit.Uwp.SampleApp.Sample.LookForTypeByName(string typeName) Line 660	C#
Microsoft.Toolkit.Uwp.SampleApp.dll!Microsoft.Toolkit.Uwp.SampleApp.Sample.PreparePropertyDescriptorAsync() Line 572	C#

Is this the same underlying issue? https://github.com/microsoft/microsoft-ui-xaml/issues/2518 I originally filed it in the WinUI repo, but I'm thinking I should have actually opened a ticket here.
It's an access violation coming on the heels of an WinRT.IInspectable bad cast, but the violation only happens with the managed debugger attached and reproduces in a clean WinUI project when WinRT interop. I tried to use the latest .NET preview but WinUI still calls RegisterAsGlobalInstance instead of RegisterForMarshalling so I can't test it out (presumably it's fixed in the WinUI 3 git repo but I haven't gotten around to building it from code).

Yes that is the same underlying issue. Once we update to use RegisterForReferenceTracking, the InvalidCastException will go away. The related AV will go away as well, but the actual fix for the underlying issue is in .NET 5.0.0-preview.6.20262.3 or newer.

Thank you very much for the confirmation, I was very close to losing my mind trying to figure it out and really confused that I seemed to be the only one tripping over it left and right w/ the WinUI 3 preview release.

Now that .NET 5 Preivew 6 is released, I'm going to close this.


Update cross-tenant-mailbox-migration.md

How do I know this worked?
=> testing relationship^and endpoint before/after creating at list one object in the target tenant
;)
FM

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks

@kelleyvice-msft Please help. Thanks

hi all
tested and used twice during two migrations with the actual manual

Test-MigrationServerAvailability -Endpoint "[the name of your cross-tenant migration endpoint]" -TestMailbox "[email address of a source mailbox that is part of your migration scope]"

nok error, even before/after creating target object(s)
so for checking the source & target organisation's preparations:
target tenant:

Test-MigrationServerAvailability -Endpoint "[the name of your cross-tenant migration endpoint]"
Get-OrganizationRelationship | fl name, DomainNames, MailboxMoveEnabled, MailboxMoveCapability

source tenant:

Get-OrganizationRelationship | fl name, DomainNames, MailboxMoveEnabled, MailboxMoveCapability

ok, informations indicate ready for mailboxes migrations for both organisations (source & target)
these commands came from the previous manual's version (tested and used several times too)
thanks

@kelleyvice-msft Please merge this PR. Thanks


Search on dashboard does not work for non-synced transactions

Story
As a user who is interested in the transactions that just happened, I want to enter the transaction hash into a search box and get to the transaction details page even if it is not synced yet. (the page is expected to work just fine in this case, but it seems that search does not "see" new transactions via the API calls it does; search should just query nearcore via explorer-wamp nearcore-tx RPC)
Acceptance Criteria

[ ] Search by a hash of a very recent transaction (which is already available via nearcore RPC) leads to Transaction Details page
[ ] Tested

Unfortunately, I touch this a little bit, it raised some questions:

for nearcore-tx method, transaction hash and signer id are both required and only transaction hash could not fetch correctly.
in transaction status method, there will be no block hash included and can not get gas price, with also not getting trnsactionFee.
Do we still want this implementation? If so, I recommend having a separate search for this one and some part of the transactionDetails page need fix. @frol

In the single shard case we can hack around the transaction id by prepending an arbitrary string, although I think it makes sense to resolve it properly, i.e, asking user to enter <accountId>:<transactionHash>

I suggest we change our requirements so signer (sender) account ID is required along with the transaction hash. We are in control of all the links we provide to transactions (near-api-js, near-shell, Explorer itself), so we should be able to update our code so that we have the account ID in the URL itself, and thus the frontend will be able to use nearcore-tx method.


fixes deny subnet without nsg & udr policy

Overview/Summary
This PR fixes the issue that is described here: https://github.com/Azure/Enterprise-Scale/issues/407
Despite of the deny policies Deny-Subnet-Without-Udr & Deny-Subnet-Without-Nsg a vNet with a subnet without udr or nsg can be created in a single ARM deployment. After the deployment the subnets get be marked as non-compliant.
Cross-Reference: https://github.com/Azure/Enterprise-Scale/pull/885
This PR fixes/adds/changes/removes

https://github.com/Azure/Enterprise-Scale/issues/407

Breaking Changes
Testing Evidence
After the fix I now getting a deny, when I try to create a vnet with a subnet without udr & nsg.
As part of this Pull Request I have

[x] Checked for duplicate Pull Requests
[x] Associated it with relevant issues, for tracking and closure.
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[x] Performed testing and provided evidence.
[ ] Updated relevant and associated documentation.
[ ] Updated the "What's New?" wiki page (located in the Enterprise-Scale repo in the directory: /docs/wiki/whats-new.md)

+1

Closing as commented here on the ESLZ PR created https://github.com/Azure/Enterprise-Scale/pull/885#issuecomment-1006733621


add-on: mozlz4-edit - edit *.lz4 *.mozlz4 *.jsonlz4 *.baklz4 *.json files within FF

a cool tool - i am liking this - i'm using it to build a new search.json.mozlz4 file, but it can edit other files as well

mozlz4-edit by serj_kzv
The addon lets you add custom search engines to the Mozilla Firefox without the Internet connection using! Add your own search engine to the Firefox!

https://addons.mozilla.org/en-US/firefox/addon/mozlz4-edit/
if you look at the source code, it also has a an unexposed script to apparently get/display all the google search parameters as well
the permissions for the add-on worried me - the developer comments on this in the reviews and i looked at the code, searching it for "http" and turned up nothing nefarious

I also used this add-on myself to create own search plugins (all of them), without the need of Mycroft Project.
Just use this add-on in a new profile, if you don't like the permissions and save the seach.json.mozlz4 to your real profile.


Index Error: too many indices for tensor of dimension 0

In https://github.com/fredzzhang/pocket/blob/master/pocket/utils/meters.py, the following lines of code returns an error when denom is a zero-dimensional tensor.
...
elif type(denom) is Tensor:
    zero_idx = torch.nonzero(denom == 0).squeeze(1)
    denom[zero_idx] += 1e-8
...

On zero-dimensional tensors, torch.nonzero  returns tensor([], size=(1, 0), dtype=torch.int64) when the condition is met, and tensor([], size=(0, 0), dtype=torch.int64) otherwise. Using the returned tensor to index a zero-dimensional tensor returns index error

The issue has been fixed with https://github.com/fredzzhang/pocket/commit/305007eb6cd08bcb858df75063dc8ce7eb0e6029


Adding form component and connecting it to the database

I don't have any idea on this particular json file. Just want to clarify that were you able to resolve the issues u were facing ealier?
If yes, we are good to merge.

I don't have any idea on this particular json file. Just want to clarify that were you able to resolve the issues u were facing ealier? If yes, we are good to merge.

Yes, I fixed it and its working now


Add description

Please add a description to the read me and side panel of github.

We need to add readme at the GitHub organization level,ballroom-backend level and ballroom-frontend repositories


A way to block Drag a single Board, not to all like dragBoards

Is possible to make a dragBoard=false for an specific board, the issue #5  show to us a way to block all Boards, but for single one what is the right way?

Duplicate of #32
But a solution like this will be nice! :)


Is CloudAdapter supported in DirectLine Extension?

Use this query to search for the most popular feature requests.
Is your feature request related to a problem? Please describe.
CloudAdapter is the new adpater. However when I am reading the document, I found we are still using BotFrameworkHttpAdapter for DirectLine Extension here:
https://docs.microsoft.com/en-us/azure/bot-service/bot-service-channel-directline-extension-net-bot?view=azure-bot-service-4.0#troubleshooting
Could we use the new one?
Describe the solution you'd like
We should use the new one.
Related https://github.com/microsoft/botbuilder-dotnet/issues/6288

@xieofxie This is supported in 4.16.0, which is in the process of being released now.


Default transactions to abort on drop

Hey!
Here's an idea for indexed-db-futures v0.5: what if transactions aborted on drop, instead of committing on drop?
This'd make them farther away from the indexed-db standard, for sure, but the indexed-db standard is based on callbacks, which are pretty different from futures anyway. And, in Rust, it's very easy to miss one early-return point, to make sure that returning Err from a function aborts the transaction.
TL;DR:
fn foo() {
    let transaction = [...];
    transaction.add_key_val(...).unwrap().await.unwrap();
    do_some_check(&transaction).await?;
    Ok(())
}

This will (AFAICT) commit the transaction if do_some_check were to return an Err. The behavior I'd expect from the code if just reading it intuitively, would be for the transaction to be aborted.
In order to get the behavior I'd instinctively expect, I need to use the following code, which is quite a bit less pleasant to both write and read:
fn foo() {
    let transaction = [...];
    transaction.add_key_val(...).unwrap().await.unwrap();
    if let Err(e) = do_some_check(&transaction).await {
        transaction.abort().unwrap();
        return Err(e);
    }
    Ok(())
}

WDYT about adding a commit(self) function to transaction, that'd commit it (ie. just drop it), and to have IdbTransaction's Drop implementation abort the transaction if it has not been explicitly committed?
Anyway, I'm just starting using indexed-db-futures, but it already seems much, much more usable than the web-sys version. So, thank you! :D

After some more investigation, I learned that this would be a nontrivial feature.
So I decided to go ahead and implement it, and this resulted in the indexed-db crate, that has a misuse-resistant API with transactions that always abort upon errors and never commit early.
Do you want to keep this issue open to track this feature inside indexed_db_futures, or should we close it? :)

This issue has been included in v0.6.0 :tada:
- Your friendly neighbourhood :robot: semantic release bot


(PUP-6945) acceptance: fix lookup rich data values test

previous commits did not use hiera v5 functionality

👍
      - Host Configuration Summary -

              - Test Case Summary for suite 'tests' -
       Total Suite Time: 22.68 seconds
      Average Test Time: 22.68 seconds
              Attempted: 1
                 Passed: 1
                 Failed: 0
                Errored: 0
                Skipped: 0
                Pending: 0
                  Total: 1


pgpool's healthcheck in k8s uses psql to connect..

..and will fail when all connection slots are currently busy.
The same can be reimplemented using pgpool's pcp control channel via unix domain sockets, trying it now for my setup.

Seems to work for me, I'll try submitting a patch

Test will make it applied faster.


Failed to load file in public folder

Describe the bug
After modifying srcDir, the runtime reports an error:
WXT 0.17.10                                                                                8:54:17 PM
✔ Started dev server @ http://localhost:3000                                                                                8:54:18 PM
ℹ Pre-rendering chrome-mv3 for development with Vite 5.2.7                                                                                8:54:18 PM
✔ Built extension in 659 ms                                                                                8:54:18 PM
  ├─ .output/chrome-mv3/manifest.json               875 B
  ├─ .output/chrome-mv3/popup.html                  552 B
  ├─ .output/chrome-mv3/background.js               126.87 kB
  ├─ .output/chrome-mv3/chunks/popup-Cx96etly.js    7.41 kB
  ├─ .output/chrome-mv3/content-scripts/content.js  136.01 kB
  ├─ .output/chrome-mv3/icon/128.png                3.07 kB
  ├─ .output/chrome-mv3/icon/16.png                 559 B
  ├─ .output/chrome-mv3/icon/32.png                 916 B
  ├─ .output/chrome-mv3/icon/48.png                 1.33 kB
  ├─ .output/chrome-mv3/icon/96.png                 2.37 kB
  └─ .output/chrome-mv3/wxt.svg                     1.07 kB
Σ Total size: 281.03 kB
✔ Opened browser in 1.144 s                                                                                8:54:20 PM
8:54:23 PM [vite] Internal server error: Failed to resolve import "/wxt.svg" from "src/entrypoints/popup/App.vue". Does the file exist?
  Plugin: vite:import-analysis
  File: /Users/caven/workspaces/_labs/wxt-public-issue/src/entrypoints/popup/App.vue:8:25
  11 |  });
  12 |  import { createElementVNode as _createElementVNode, createVNode as _createVNode, Fragment as _Fragment, openBlock as _openBlock, createElementBlock as _createElementBlock, pushScopeId as _pushScopeId, popScopeId as _popScopeId } from "vue";
  13 |  import _imports_0 from "/wxt.svg";
     |                          ^
  14 |  import _imports_1 from<EMAIL_ADDRESS>  15 |  const _withScopeId = (n) => (_pushScopeId("data-v-89a223eb"), n = n(), _popScopeId(), n);
      at formatError (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:50796:46)
      at TransformContext.error (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:50790:19)
      at normalizeUrl (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:65935:33)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
      at async file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:66090:47
      at async Promise.all (index 3)
      at async TransformContext.transform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:66011:13)
      at async Object.transform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:51105:30)
      at async loadAndTransform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:53858:29)
8:54:23 PM [vite] Pre-transform error: Failed to resolve import "/wxt.svg" from "src/entrypoints/popup/App.vue". Does the file exist?
9:06:35 PM [vite] Internal server error: Failed to resolve import "/wxt.svg" from "src/entrypoints/popup/App.vue". Does the file exist?
  Plugin: vite:import-analysis
  File: /Users/caven/workspaces/_labs/wxt-public-issue/src/entrypoints/popup/App.vue:8:25
  11 |  });
  12 |  import { createElementVNode as _createElementVNode, createVNode as _createVNode, Fragment as _Fragment, openBlock as _openBlock, createElementBlock as _createElementBlock, pushScopeId as _pushScopeId, popScopeId as _popScopeId } from "vue";
  13 |  import _imports_0 from "/wxt.svg";
     |                          ^
  14 |  import _imports_1 from<EMAIL_ADDRESS>  15 |  const _withScopeId = (n) => (_pushScopeId("data-v-89a223eb"), n = n(), _popScopeId(), n);
      at formatError (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:50796:46)
      at TransformContext.error (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:50790:19)
      at normalizeUrl (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:65935:33)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
      at async file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:66090:47
      at async Promise.all (index 3)
      at async TransformContext.transform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:66011:13)
      at async Object.transform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:51105:30)
      at async loadAndTransform (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:53858:29)
      at async viteTransformMiddleware (file:///Users/caven/workspaces/_labs/wxt-public-issue/node_modules/vite/dist/node/chunks/dep-C-KAszbv.js:63631:32)

To Reproduce
https://github.com/keyding/wxt-public-issue
Steps to reproduce the bug using the reproduction:

Bootstrap project: bunx wxt@latest init wxt-public-issue
Install dependencies: bun install
Create src folder
Moving the assets, components, entrypoints and  public to the src folder
Configuration file wxt.config.ts add srcDir: 'src'
Start dev mode: bun run dev
Click on the extension icon

Expected behavior
Files in the public folder are correctly recognized.
Screenshots

Environment

System:
  OS: macOS 14.4.1
  CPU: (10) arm64 Apple M1 Pro
  Memory: 47.94 MB / 16.00 GB
  Shell: 5.9 - /bin/zsh
Binaries:
  Node: 20.11.1 - ~/.volta/tools/image/node/20.11.1/bin/node
  Yarn: 1.22.19 - ~/.volta/bin/yarn
  npm: 10.2.4 - ~/.volta/tools/image/node/20.11.1/bin/npm
  pnpm: 8.15.1 - ~/.volta/bin/pnpm
  bun: 1.0.30 - ~/.bun/bin/bun
Browsers:
  Brave Browser: <IP_ADDRESS>
  Chrome: 123.0.6312.87
  Safari: 17.4.1
npmPackages:
  wxt: ^0.17.0 => 0.17.10

Additional context
If a public folder also exists in the root directory, it works fine.

I had noticed this before, but never tried to figure out what exactly was the cause... So it's moving the public directory out of the root folder... Good find. I think I know how to fix it

Released fix in v0.17.11


fix: remove internalKeys from Selected row and Triggered row

Description
Remove primaryKey and originalIndex from selectedRow, selectedRows and triggeredRow
Fixes #9837
Type of change

Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

Jest Test

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

Test coverage results :test_tube:
:green_circle: Total coverage has increased
// Code coverage diff between base branch:release and head branch: fix/remove-internalKeys-from-Selected-row-and-Triggered-row

Status
File
% Stmts
% Branch
% Funcs
% Lines

:green_circle:
total
56.37 (0.02)
37.83 (0.03)
35.97 (0.01)
56.59 (0.02)

:green_circle:
app/client/src/utils/autocomplete/TernServer.ts
52.94 (0.23)
41.67 (0.84)
36.21 (0)
56.99 (0.25)

:green_circle:
app/client/src/widgets/TableWidget/widget/derived.js
69.77 (4.68)
66.27 (4.73)
55.81 (4.65)
68.18 (5.1)

/ok-to-test sha=721a2d3

/ok-to-test sha=3292ebb

/ok-to-test sha=6839269

/ok-to-test sha=b13a75b

Tested this PR and working as expected

/ok-to-test sha=b13a75b


Wiki bug

Wiki showed me a Machine Frame images. but game use other Machine Frame image.

oh... I can't make Machine Frame now.  Why?

because Changed Machine Frame recipes in v4.0.5 .


duplicate message listener not displays tag

As per #123 the muted message listener now displays a mentionable user as well as their user name.
@moe (moe#9999) was muted for Automatic mute for repeat-spam detection due to security level Normal

You should change this to user.descriptor()


How to access Browser Window

Hello.
Could you tell me where you are creating the BrowserWindow?
Is there any way to access the BrowserWindow on Meteor side?
I wanna access the BrowserWindow to check if it's focused/minimzed etc.
The eventBus doesn't provide a method like isMinimzed(). That's why i thought, that
i could access the Browser window via remote and accessing BrowserWindow
I'm doing the following:
const remote = window.require('electron').remote;
getting the error:
Uncaught Error: Cannot find module 'electron'.
p.s. Im running the project with npm run desktop and i can't access the assets folder
with'___desktop\meteor.png'
Any ideas?

You should probably look into building a bridge between Meteor code and Electron code using IPC.
    eventsBus.on('windowCreated', (window) => {
        mainWindow = window;

        // Uncomment to show the devTools even in production (for debugging production only issues)
        // window.webContents.openDevTools()

        window.webContents.on('crashed', Desktop.windowCrashedHandler);

        window.on('unresponsive', Desktop.windowUnresponsiveHandler);

        // Launch the app in fullscreen
        window.webContents.on('dom-ready', () => {
            window.setFullScreen(true);
        });

        // Listen for the minimize event
        desktop.on('minimize', () => {
            window.minimize();
        });
    });

@KoenLav How do I emit an event from the Meteor side/renderer process to be executed by desktop.js?

Desktop.send('desktop', 'minimize');


SQL Server connector only allows globally unique index names

After running introspect, prisma is throwing this error because of the index names. This might cause issues to keep evolving the model moving forward because the migrations would go crazy with the indexes 😬

Can you possibly provide the SQL for this table (or tables, Clients and Users) so we can reproduce this manually? Would help us a lot.

@janpio sure!

(Maybe you can also share the part of the schema you took a screenshot off - this might just be a visual problem even)

Oh, I probably forgot another table (the one that uses the same index).
generator client {
  provider        = "prisma-client-js"
  previewFeatures = ["microsoftSqlServer"]
}

datasource db {
  provider = "sqlserver"
  url      = env("DATABASE_URL")
}

model Classes {
  Id                  Int       @id @default(autoincrement())
  End                 DateTime? @db.DateTime
  IsActive            Boolean
  Name                String    @db.NVarChar(100)
  Start               DateTime  @db.DateTime
  Client_Id           Int
  Manager_UserID      Int
  Clients             Clients   @relation(fields: [Client_Id], references: [Id])
  Users               Users     @relation(fields: [Manager_UserID], references: [UserID])

  @@index([Client_Id], name: "IX_Client_Id")
  @@index([Manager_UserID], name: "IX_Manager_UserID")
}

model Clients {
  Id             Int       @id @default(autoincrement())
  IsActive       Boolean
  Name           String    @db.NVarChar(100)
  Manager_UserID Int
  Users          Users     @relation(fields: [Manager_UserID], references: [UserID])
  Classes        Classes[]

  @@index([Manager_UserID], name: "IX_Manager_UserID")
}

model Users {
  UserID         Int       @id @default(autoincrement())
  AccessGuid     String?   @db.UniqueIdentifier
  Address        String?   @db.NVarChar(200)
  City           String?   @db.NVarChar(100)
  CreationDate   DateTime  @db.DateTime
  HasAdminAccess Boolean   @default(false)
  IsActive       Boolean
  LastLogin      DateTime? @db.DateTime
  Login          String    @unique @db.NVarChar(100)
  Name           String    @db.NVarChar(200)
  Password       String    @db.NVarChar(100)
  Phone          String?   @db.NVarChar(50)
  PostalCode     String?   @db.NVarChar(15)
  State          String?   @db.NVarChar(100)
  ManagerID      Int?
   That does not seem to be true for SQL Server, while it is probably true for some other database.
Code for this: https://github.com/prisma/prisma-engines/blob/789a706435edd011021ae544bad8e2bf582efd9f/libs/datamodel/core/src/transform/ast_to_dml/validate.rs#L216-L252
So supports_multiple_indexes_with_same_name() is wrong for the SQLServer connector probably.

I'm glad you found out!


Update specs to 19.0.0

Issue #, if available:
Description of changes:

Update specs to 19.0.0

scripts/update_specs_from_pricing.py # requires Boto3 and Credentials
scripts/update_specs_services_from_ssm.py # requires Boto3 and Credentials
cfn-lint --update-specs # https://github.com/aws-cloudformation/cfn-python-lint/pull/1383\#issuecomment-629891506
cfn-lint --update-iam-policies
cfn-lint --update-documentation

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

AWS::MediaPackage::PackagingConfiguration resource schema for reference


add option to allowProxyBypass

this does not work yet since i do not know how this mod works at all but the config file has the option and i did an attempt

#45

I really could use this option as well. I have a setup with a publicly exposed port to velocity, but on my internal network sometimes I want to connect using a dev build of the fabric client and it is not logged in.

I made the same attempt in #68


RuntimeError: OSError: [Errno 2] No such file or directory [while running 'Map(<functools.partial object at 0x7f367367bdb8>)']

What am I doing wrong? I installed sciencebeam a month ago and last week my vm got deleted, now I reinstalled the sb on it but I always get this:

python2 -m sciencebeam.examples.grobid_service_pdf_to_xml --input "/home/lopo/"
INFO:main:default_values: {'runner': 'FnApiRunner'}
INFO:main:parsed_args: Namespace(autoscaling_algorithm='NONE', cloud=False, grobid_action='/processHeaderDocument', grobid_url='http://localhost:8080/api', input='/home/lopo/', max_num_workers=10, num_workers=10, output_path='/home/lopo', output_suffix='.tei-header.xml', project=None, runner='FnApiRunner', setup_file='./setup.py', start_grobid_service=True, xslt_path=None)
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f3672f040c8> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f3672f04758> ====================
INFO:root:==================== <function lift_combiners at 0x7f3672f042a8> ====================
INFO:root:==================== <function expand_gbk at 0x7f3672f041b8> ====================
INFO:root:==================== <function sink_flattens at 0x7f3672f04140> ====================
INFO:root:==================== <function greedily_fuse at 0x7f3672f047d0> ====================
INFO:root:==================== <function sort_stages at 0x7f3672f04848> ====================
INFO:root:Running (ref_AppliedPTransform__ReadFullFile/Read_3)+((ref_AppliedPTransform_Map(<functools.partial object at 0x7f367367bdb8>)_4)+((ref_AppliedPTransform_MapKeys_5)+(ref_AppliedPTransform_WriteToFile/Map()_7)))
INFO:root:start <DoOperation WriteToFile/Map() output_tags=['out']>
INFO:root:start <DoOperation MapKeys output_tags=['out']>
INFO:root:start <DoOperation Map(<functools.partial object at 0x7f367367bdb8>) output_tags=['out']>
INFO:root:start <ReadOperation _ReadFullFile/Read source=SourceBundle(weight=1.0, source=<sciencebeam.beam_utils.fileio._ReadFullFileSource object at 0x7f3672f6d4d0>, start_position=None, stop_position=None)>
INFO:sciencebeam.transformers.grobid_service_wrapper:grobid_service_instance: None
INFO:sciencebeam.transformers.grobid_service_wrapper:command_line: java -cp "/home/lopo/stuff/sciencebeam/.temp/grobid-service/lib/" org.grobid.service.main.GrobidServiceApplication
INFO:sciencebeam.transformers.grobid_service_wrapper:args: ['java', '-cp', '/home/tlopo/stuff/sciencebeam/.temp/grobid-service/lib/', 'org.grobid.service.main.GrobidServiceApplication']
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/lopo/stuff/sciencebeam/sciencebeam/examples/grobid_service_pdf_to_xml.py", line 190, in
run()
File "/home/lopo/stuff/sciencebeam/sciencebeam/examples/grobid_service_pdf_to_xml.py", line 182, in run
configure_pipeline(p, known_args)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/pipeline.py", line 410, in exit
self.run().wait_until_finish()
File "/usr/local/lib/python2.7/dist-packages/apache_beam/pipeline.py", line 390, in run
self.to_runner_api(), self.runner, self._options).run(False)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/pipeline.py", line 403, in run
return self.runner.run_pipeline(self)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 218, in run_pipeline
return self.run_via_runner_api(pipeline.to_runner_api())
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 221, in run_via_runner_api
return self.run_stages(*self.create_stages(pipeline_proto))
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 859, in run_stages
pcoll_buffers, safe_coders).process_bundle.metrics
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 970, in run_stage
self._progress_frequency).process_bundle(data_input, data_output)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 1174, in process_bundle
result_future = self._controller.control_handler.push(process_bundle)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/portability/fn_api_runner.py", line 1054, in push
response = self.worker.do_instruction(request)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 208, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 230, in process_bundle
processor.process_bundle(instruction_id)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/bundle_processor.py", line 289, in process_bundle
op.start()
File "apache_beam/runners/worker/operations.py", line 243, in apache_beam.runners.worker.operations.ReadOperation.start
File "apache_beam/runners/worker/operations.py", line 244, in apache_beam.runners.worker.operations.ReadOperation.start
File "apache_beam/runners/worker/operations.py", line 253, in apache_beam.runners.worker.operations.ReadOperation.start
File "apache_beam/runners/worker/operations.py", line 175, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 85, in apache_beam.runners.worker.operations.ConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 403, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 404, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 569, in apache_beam.runners.common.DoFnRunner.receive
File "apache_beam/runners/common.py", line 577, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 618, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 575, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 353, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/core.py", line 973, in
wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
File "/home/lopo/stuff/sciencebeam/sciencebeam/transformers/grobid_service.py", line 52, in run_grobid_service
start_service_if_not_running()
File "/home/lopo/stuff/sciencebeam/sciencebeam/transformers/grobid_service.py", line 25, in start_service_if_not_running
service_wrapper.start_service_if_not_running()
File "/home/lopo/stuff/sciencebeam/sciencebeam/transformers/grobid_service_wrapper.py", line 98, in start_service_if_not_running
args, cwd=cwd, stdout=PIPE, stderr=subprocess.STDOUT
File "/usr/lib/python2.7/subprocess.py", line 394, in init
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1047, in _execute_child
raise child_exception
RuntimeError: OSError: [Errno 2] No such file or directory [while running 'Map(<functools.partial object at 0x7f367367bdb8>)']

Thanks, but when I use the old pipeline I get:
raise HTTPError(http_error_msg, response=self)

requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:8070/api/processFulltextDocument [while running 'Map(<functools.partial object at 0x7fe79a257100>)']
and when using the new pipeline I get:
/usr/bin/python2: No module named pipeline_runners
It worked so far by installing the docker, but now I can't convert pdfs to xml anymore.
Thanks for helping me out.

If you are getting No module named pipeline_runners then you are either not using the latest source or your environment doesn't find the sciencebeam module. I just tried it myself.
Although I realised the --data-path parameter is required in combination with the new pipeline, e.g.: 'python2 -m sciencebeam.pipeline_runners.beam_pipeline_runner --grobid-url=http://localhost:8070/api --data-path "/home/lopo" --source-path "/home/lopo/*.pdf".
I am not quite sure why you would get 400 Client Error. It could be that one of the PDF files is corrupt.
You could also try to run ScienceBeam itself as a Docker container:
cd /home/lopo
docker pull elifesciences/sciencebeam
docker run --rm --net host -v"$(pwd):/data" elifesciences/sciencebeam \
  python -m sciencebeam.pipeline_runners.beam_pipeline_runner \
  --grobid-url=http://localhost:8070/api \
  --data-path "/data" \
  --source-path "/data/*.pdf" \
  --output-path "/data/output"

This will mount the current directory (/home/lopo) to /data within the container. And it will output to /data/output (i.e. /home/lopo/output on the host). (It assumes that GROBID is running)
(The same could be achieved using docker-compose which could manage starting GROBID as well)

I entered this:
 cd /home/lopo
 docker pull elifesciences/sciencebeam
 docker run --rm --net host -v"$(pwd):/data" elifesciences/sciencebeam \

python -m sciencebeam.pipeline_runners.beam_pipeline_runner
--grobid-url=http://localhost:8070/api
--data-path "/data"
--source-path "/data/*.pdf"
--output-path "/data/output"
And got this:
python2 -m sciencebeam.pipeline_runners.beam_pipeline_runner --grobid-url=http://localhost:8070/api --data-path "/data" --source-path "/data/.pdf" --output-path "/data/output"
INFO:sciencebeam_gym.beam_utils.main:default_values: {'runner': 'DirectRunner'}
INFO:main:args: Namespace(autoscaling_algorithm='NONE', base_data_path='/data', cloud=False, data_path='/data', debug=False, grobid_action=None, grobid_url='http://localhost:8070/api', grobid_xslt_path='xslt/grobid-jats.xsl', job_name=None, job_name_suffix=None, limit=None, max_num_workers=1, no_grobid_pretty_print=False, no_grobid_xslt=False, num_workers=1, output_path='/data/output', output_suffix='.xml', pipeline=None, project=None, resume=False, runner='DirectRunner', setup_file='./setup.py', source_file_column='url', source_file_list=None, source_path='/data/.pdf')
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/pipeline_runners/beam_pipeline_runner.py", line 296, in
run()
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/pipeline_runners/beam_pipeline_runner.py", line 288, in run
configure_pipeline(p, args, pipeline, config)
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/pipeline_runners/beam_pipeline_runner.py", line 154, in configure_pipeline
steps = pipeline.get_steps(config, opt)
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/pipelines/init.py", line 45, in get_steps
for step in pipeline.get_steps(config, args)
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/pipelines/grobid_pipeline.py", line 86, in get_steps
pretty_print=not args.no_grobid_pretty_print
File "/home/ubuntu/tos/install/sciencebeam/sciencebeam/transformers/xslt.py", line 15, in xslt_transformer_from_file
ET.tostring(ET.parse(xslt_filename)),
File "src/lxml/etree.pyx", line 3425, in lxml.etree.parse
File "src/lxml/parser.pxi", line 1839, in lxml.etree._parseDocument
File "src/lxml/parser.pxi", line 1865, in lxml.etree._parseDocumentFromURL
File "src/lxml/parser.pxi", line 1769, in lxml.etree._parseDocFromFile
File "src/lxml/parser.pxi", line 1162, in lxml.etree._BaseParser._parseDocFromFile
File "src/lxml/parser.pxi", line 600, in lxml.etree._ParserContext._handleParseResultDoc
File "src/lxml/parser.pxi", line 710, in lxml.etree._handleParseResult
File "src/lxml/parser.pxi", line 637, in lxml.etree._raiseParseError
IOError: Error reading file 'xslt/grobid-jats.xsl': failed to load external entity "xslt/grobid-jats.xsl"
Do you why this fails?
Thanks

Are you positive that the following was entered as a single command? You do need the leading slashes to make sure it's a single command.
docker run --rm --net host -v"$(pwd):/data" elifesciences/sciencebeam \
  python -m sciencebeam.pipeline_runners.beam_pipeline_runner \
  --grobid-url=http://localhost:8070/api \
  --data-path "/data" \
  --source-path "/data/*.pdf" \
  --output-path "/data/output"

(The python command is meant to run within the container - there is no need to add 2 to the python command, which I can in your output but shouldn't appear if copied like above)
The docker pull elifesciences/sciencebeam was meant to make sure it's pulling the latest image.

That sounds like either the GROBID container is not running or is not reachable because the --net host parameter is missing. You could try to telnet localhost 8070 to ensure it's reachable locally.

You are right:
Trying <IP_ADDRESS>...
telnet: Unable to connect to remote host: Connection refused

So is this working after starting the GROBID container?

Trying <IP_ADDRESS>...
Connected to localhost.
Escape character is '^]'.
------------------------------------------------ so this works great now.
But the output folder stays empty for some reason.
in gob folder there is data, in data there is ouput
root@mol:~/gob$ sudo docker run --rm --net host -v"$(pwd):/data" elifesciences/sciencebeam \

python -m sciencebeam.pipeline_runners.beam_pipeline_runner
--grobid-url=http://localhost:8070/api
--data-path "/data"
--source-path "/data/.pdf"
--output-path "/data/output"
INFO:sciencebeam_gym.beam_utils.main:default_values: {'runner': 'DirectRunner'}
INFO:main:args: Namespace(autoscaling_algorithm='NONE', base_data_path='/data', cloud=False, data_path='/data', debug=False, grobid_action=None, grobid_url='http://localhost:8070/api', grobid_xslt_path='xslt/grobid-jats.xsl', job_name=None, job_name_suffix=None, limit=None, max_num_workers=1, no_grobid_pretty_print=False, no_grobid_xslt=False, num_workers=1, output_path='/data/output', output_suffix='.xml', pipeline=None, project=None, resume=False, runner='DirectRunner', setup_file='./setup.py', source_file_column='url', source_file_list=None, source_path='/data/.pdf')
INFO:main:steps: [DocToPdfStep(DOC to PDF), FunctionPipelineStep(Convert to TEI), FunctionPipelineStep(TEI to JATS)]
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7ff765027a28> ====================
INFO:root:==================== <function lift_combiners at 0x7ff765027b18> ====================
INFO:root:==================== <function expand_gbk at 0x7ff765027ed8> ====================
INFO:root:==================== <function sink_flattens at 0x7ff765027b90> ====================
INFO:root:==================== <function greedily_fuse at 0x7ff765027c08> ====================
INFO:root:==================== <function sort_stages at 0x7ff765027500> ====================
INFO:root:Running (ref_AppliedPTransform_Create/Read_3)+((ref_AppliedPTransform_PreventFusion/AddKey_5)+(PreventFusion/GroupByKey/Write))
INFO:root:start <DataOutputOperation PreventFusion/GroupByKey/Write >
INFO:root:start <DoOperation PreventFusion/AddKey output_tags=['out']>
INFO:root:start <ReadOperation Create/Read source=SourceBundle(weight=1.0, source=<apache_beam.transforms.core._CreateSource object at 0x7ff76495e6d0>, start_position=None, stop_position=None)>
INFO:root:finish <ReadOperation Create/Read source=SourceBundle(weight=1.0, source=<apache_beam.transforms.core._CreateSource object at 0x7ff76495e6d0>, start_position=None, stop_position=None), receivers=[ConsumerSet[Create/Read.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation PreventFusion/AddKey output_tags=['out'], receivers=[ConsumerSet[PreventFusion/AddKey.out0, coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder], LengthPrefixCoder[FastPrimitivesCoder]]], len(consumers)=1]]>
INFO:root:finish <DataOutputOperation PreventFusion/GroupByKey/Write >
INFO:root:Running (((PreventFusion/GroupByKey/Read)+((ref_AppliedPTransform_PreventFusion/Ungroup_10)+((ref_AppliedPTransform_ReadFileContent/Map()_12)+(ref_AppliedPTransform_ReadFileContent/Count_13))))+((ref_AppliedPTransform_Determine Type_14)+(ref_AppliedPTransform_DOC to PDF_15)))+((ref_AppliedPTransform_Convert to TEI_16)+(((ref_AppliedPTransform_TEI to JATS_17)+(ref_AppliedPTransform_Map()_18))+((ref_AppliedPTransform_WriteOutput/Map()_20)+(ref_AppliedPTransform_WriteOutput/Log_21))))
INFO:root:start <DoOperation WriteOutput/Log output_tags=['out']>
INFO:root:start <DoOperation Map() output_tags=['out']>
INFO:root:start <DoOperation WriteOutput/Map() output_tags=['out']>
INFO:root:start <DoOperation TEI to JATS output_tags=['out']>
INFO:root:start <DoOperation Convert to TEI output_tags=['out']>
INFO:root:start <DoOperation DOC to PDF output_tags=['out']>
INFO:root:start <DoOperation Determine Type output_tags=['out']>
INFO:root:start <DoOperation ReadFileContent/Count output_tags=['out']>
INFO:root:start <DoOperation ReadFileContent/Map() output_tags=['out']>
INFO:root:start <DoOperation PreventFusion/Ungroup output_tags=['out']>
INFO:root:start <DataInputOperation PreventFusion/GroupByKey/Read receivers=[ConsumerSet[PreventFusion/GroupByKey/Read.out0, coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder], IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
INFO:root:finish <DataInputOperation PreventFusion/GroupByKey/Read receivers=[ConsumerSet[PreventFusion/GroupByKey/Read.out0, coder=WindowedValueCoder[TupleCoder[LengthPrefixCoder[FastPrimitivesCoder], IterableCoder[LengthPrefixCoder[FastPrimitivesCoder]]]], len(consumers)=1]]>
INFO:root:finish <DoOperation PreventFusion/Ungroup output_tags=['out'], receivers=[ConsumerSet[PreventFusion/Ungroup.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation ReadFileContent/Map() output_tags=['out'], receivers=[ConsumerSet[ReadFileContent/Map().out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation ReadFileContent/Count output_tags=['out'], receivers=[ConsumerSet[ReadFileContent/Count.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation Determine Type output_tags=['out'], receivers=[ConsumerSet[Determine Type.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation DOC to PDF output_tags=['out'], receivers=[ConsumerSet[DOC to PDF.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation Convert to TEI output_tags=['out'], receivers=[ConsumerSet[Convert to TEI.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation TEI to JATS output_tags=['out'], receivers=[ConsumerSet[TEI to JATS.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=2]]>
INFO:root:finish <DoOperation WriteOutput/Map() output_tags=['out'], receivers=[ConsumerSet[WriteOutput/Map().out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]>
INFO:root:finish <DoOperation Map() output_tags=['out'], receivers=[ConsumerSet[Map().out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=0]]>
INFO:root:finish <DoOperation WriteOutput/Log output_tags=['out'], receivers=[ConsumerSet[WriteOutput/Log.out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=0]]>

It's happening again, but this time I gett 400 Client Error
raise HTTPError(http_error_msg, response=self)

requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:8070/api/processHeaderDocument [while running 'Map(<functools.partial object at 0x7efcf0c6e100>)']
roor@tvm:~/toq$ sudo docker ps
CONTAINER ID        IMAGE                    COMMAND                  CREATED             STATUS              PORTS                    NAMES
87085sdsd16        lfoppiano/grobid:0.5.1   "/tini -- ./grobid-s…"   11 minutes ago      Up 11 minutes       <IP_ADDRESS>:8070->8070/tcp   serene_ardinghelli
ntu@tos-vm:~/tos/feq$ telnet localhost 8070
Trying <IP_ADDRESS>...
Connected to localhost.
Escape character is '^]'.

What happens if you submit the same file to GROBID directly? e.g. via the browser? Have you tried a different file?

Can this issue be closed?

Closing due to inactivity, happy to re-open


Test fixes

Some fixes mostly to prevent flaky tests run. It is part of the work done in https://github.com/apache/camel-k/pull/5119

I think the native tests tend to not work in GH actions, do they? @valdar Maybe you can run the native tests on your machine and give feedback here when they succeeded?


Fix optionality of function parameters & return

This PR fixes #295. It does this primarily by moving the decision of nullability to TypeReflection.AsPredefinedType, where the Optional type hint is considered. As a result of this, the literalExpressionSyntax in ArgumentReflection.ArgumentSyntax also becomes a simple switch expression that's solely based on the PythonConstant of the parameter's default value.
This also fixes some tests that were incorrect previously, like:
https://github.com/tonybaloney/CSnakes/blob/048e011b5d70849edb1d0c26fa9b985f8a48f6dc/src/CSnakes.Tests/GeneratedSignatureTests.cs#L30
The b parameter cannot have a default value of None per the type hint of str. The C# signature is correct, but because it was based on the presence of None as the default value.
MethodReflection.ProcessMethodWithReturnType needed some bigger changes because the return type's nullability needed to be handled with some extra care. PyObject.As<T> isn't good enough since it uses reflection based on type of T and isn't aware of nullability. As a result, MethodReflection.ProcessMethodWithReturnType generates code to check for None and return null instead when the return type is Optional. I've added  integration tests for this (see test_optional.py), where you can see this in action along the lines of:
public long? TestInt(long? n)
{
    using (GIL.Acquire())
    {
        // ...
        return __result_pyObject.IsNone() ? null : __result_pyObject.As<long>();
    }
}

The b parameter cannot have a default value of None per the type hint of str.

I added that test because type hints are just hints. Python developers often (although it is wrong) use default of None with a parameter that is not marked as optional either via Optional[str] or Union[str, None] or str | None