overlay file system is enabled, why picamera2 no work?

Due to a power outage that has damaged the raspberry pie zero 2w system, I want to use the overlay file system to protect the system security. Picamera2 can be used for normal photography on the raspberry pie distribution system. After opening the overlay file system in raspi-config, it is no longer possible to take full resolution photos. Is there a way to add swap areas, caches, and the like to make Picamera2 work properly?
pi@raspberrypi:~ $ cat /proc/cpuinfo | grep Revision | awk '{print substr($NF,length($NF)-5,6)}'
902120
pi@raspberrypi:~ $ uname -a
Linux raspberrypi 5.15.84-v7+ #1613 SMP Thu Jan 5 11:59:48 GMT 2023 armv7l GNU/Linux
pi@raspberrypi:~ $ head -1 /etc/os-release
PRETTY_NAME="Raspbian GNU/Linux 11 (bullseye)"

pi@raspberrypi:~ $ python3 capture_jpeg.py
[0:01:17.535504083] [882] INFO Camera camera_manager.cpp:299 libcamera v0.0.4+22-923f5d70
[0:01:17.634467781] [883] INFO RPI raspberrypi.cpp:1476 Registered camera /base/soc/i2c0mux/i2c@1/imx477@1a to Unicam device /dev/media0 and ISP device /dev/media1
[0:01:17.650710646] [882] INFO Camera camera.cpp:1028 configuring streams: (0) 4056x3040-BGR888
[0:01:17.651476114] [883] INFO RPI raspberrypi.cpp:851 Sensor: /base/soc/i2c0mux/i2c@1/imx477@1a - Selected sensor format: 4056x3040-SBGGR12_1X12 - Selected unicam format: 4056x3040-pB CC
Killed

Hi, I've tried this and it seemed to work for me. Perhaps you can explain a bit more what you did and what happened. Here's what I tried:

It seems to me that you are using the 32-bit Lite version of the OS, is that correct? So I flashed that onto an SD card.
After the Pi had booted I ran sudo apt update and sudo apt upgrade.
Then I enabled the overlay file system. I left the boot partition writable (which seems to be the default).
After rebooting again, I started Picamera2 and took full resolution capture.

I note that you used the capture_jpeg.py script. I wouldn't expect this to work as it creates a Qt preview window. Though it wouldn't have worked before you created the overlay file system either. Or have you installed X Windows and Qt on top of your OS Lite?
If you could supply more information that would be helpful. Things like:

Did you install the Lite OS, or the desktop one? If the Lite OS, did you install X Windows and Qt on top?
Are you trying this on a faily "clean" image, or have a large number of other changes been made?
Are you able to create a preview window (which would normally be a DRM overlay on the Lite OS)?
Does the camera start?
At what point does it fail - is it when you write to the file or before?
Can you capture full resolution images if you don't write them to a file (e.g. using capture_array)? Is other software able to write to the file system?

Though I should add that I was using a Pi 3 as I don't have a Pi Zero 2W available at the moment. But I can try that if the answers to the above questions don't help. Thanks.

Using the libcamera-still -o a.jpg command can successfully take 4056 resolution photos

Thanks for the update. I've reproduced the problem by setting total_mem=512 in my /boot/config.txt.
It does indeed seem like memory is the problem. I'm guessing that the overlay filesystem doesn't work with the system swap file which is why this has started happening.
libcamera-still is more efficient in terms of memory usage because it uses YUV420 buffers, so a 12MP image is "only" 18MB. Unfortunately Python modules generally have no support for YUV420, so buffers all have to be 24-bit RGB which are an enormous 36MB each.
In Picamera2 you could set the format to "YUV420", but the catch is then that there are no easy functions to save the images as JPEG files!
So anyway, if you want advice on the swap file issue then you probably need to ask on a more general Raspberry Pi forum - it's not something I know anything about and it's not something I can fix in Picamera2.
As for workarounds, I don't know if libcamera-still is enough. Otherwise you could capture an array in the YUV420 format, close the camera object, and then convert the YUV420 image to RGB and save it. But that's quite ugly.
Some good news is that we do have some fairly large memory improvements coming in Picamera2 in the next couple of weeks, and these may be enough to make this use case work (though it is of course hard to be certain).


censys search only one port

Hi.
me try code but need only one port no all port
censys search "services.http.response.html_title: "WSO2 Management Console"" | jq -c '.[] | {ip: .ip, ports: [.services[].port]}'
report :
{"ip":"<IP_ADDRESS>","ports":[22,443,9443]}
{"ip":"<IP_ADDRESS>","ports":[443]}
{"ip":"<IP_ADDRESS>","ports":[22,80,443,5601,5602,8001,8080,8200,8203,8243,8250,8251,8253,9093,9443,20001]}
{"ip":"<IP_ADDRESS>","ports":[21,22,443,445,446,8243,8280,9763,9765,9766]}
{"ip":"<IP_ADDRESS>","ports":[443]}
{"ip":"<IP_ADDRESS>","ports":[443,9443]}
{"ip":"<IP_ADDRESS>","ports":[80,443]}
{"ip":"<IP_ADDRESS>","ports":[22,80,123,3006,6379,8060,8080,8090,8302,9443]}
{"ip":"<IP_ADDRESS>","ports":[9444]}
{"ip":"<IP_ADDRESS>","ports":[443,9443]}
{"ip":"<IP_ADDRESS>","ports":[22,80,443,8443]}
{"ip":"<IP_ADDRESS>","ports":[443]}
{"ip":"<IP_ADDRESS>","ports":[22,3690,4041,7712,8010,8015,8020,9444,9712,14001]}
{"ip":"<IP_ADDRESS>","ports":[80,81,443,8243,9443,9444]}
I need example :
http or https ://xxx.xxx.xxx.xxx:80 or 443
thanks

This little bash script should output what you are looking for:
#!/bin/bash

# Run the Censys search command and pipe the output to jq
censys_output=$(censys search "services.http.response.html_title: 'WSO2 Management Console'" | jq -c '.[] | {ip: .ip, ports: [.services[].port]}')

# Loop through each line of the output
while read -r line; do
  # Extract the IP address and ports from the line
  ip=$(echo "$line" | jq -r '.ip')
  ports=$(echo "$line" | jq -r '.ports[]')

  # Loop through each port and output the corresponding URL
  while read -r port; do
    if [ "$port" -eq 80 ]; then
      echo "http://$ip:$port"
    elif [ "$port" -eq 443 ]; then
      echo "https://$ip:$port"
    fi
  done <<< "$ports"
done <<< "$censys_output"

Output:
http://x.x.x.x:80
https://x.x.x.x:443

can add save file to text.
thanks a lot.


another migration spec

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

Steps to reproduce

Does this PR introduce a user-facing change?

Does this PR require documentation?

I'm going to make sure https://testgrid.kurl.sh/run/laverya customer migration aug18-2 passes before I merge this, but I'm pretty confident


If a configuration is disabled then the corresponding file scanner should be disabled as well

Will be fixed by #266.


Prepare set Room bug

set are on the reverse side.
misuse SET

Head SET
Controller { Bar, Pointer}

NEXT BTN is off
MAIN BTN is off

FIXED in beta1.2.5


dose not work on some mobile devices ( Iphone ,4,5,6 gen)

when I click on the share button for facebook or google it does nothing on my iphone using (safari)  , I'm guessing it's because you have set it as a popup and not to open in a  new window.
but when I go on my android , it works fine , any reason to this also I tried this with the demo you provided just to make sure it was not my code that was a fault.
thanks Samrura

Hello! Thank you for your report, but unfortunately i can't reproduce this bug. I tried it in my ipad mini with latest firmware and with "block popups" enabled option in preferences it's works (opens in new tab). Also i tried in safari on iphone 4s emulator (default settings) -- works too. Maybe you have options to block javascript in your browser or something like this? Can you check it? Maybe tell more about your test environment?


Class NkDrawVertex removed?

Hi,
We get some errors while compiling our application with LWJGL 3.0.1-SNAPSHOT.
Gradle Log:
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:369: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_pos, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.POS);
		                                                                ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:369: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_pos, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.POS);
		                                                                              ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:370: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_uv, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.UV);
		                                                               ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:370: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_uv, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.UV);
		                                                                              ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:371: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_col, 4, GL11.GL_UNSIGNED_BYTE, true, NkDrawVertex.SIZEOF, NkDrawVertex.COL);
		                                                                       ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
D:\Users\Justin\IdeaProjects\pentaquin-core\pentacore-graphic\src\main\java\com\pentaquin\core\graphic\renderer\pixelwizard\PixelWizardRenderer.java:371: error: cannot find symbol
		GL20.glVertexAttribPointer(attrib_col, 4, GL11.GL_UNSIGNED_BYTE, true, NkDrawVertex.SIZEOF, NkDrawVertex.COL);
		                                                                              ^
  symbol:   variable NkDrawVertex
  location: class PixelWizardRenderer
6 errors
:pentacore-graphic:compileJava FAILED

FAILURE: Build failed with an exception.

Code:
GL20.glVertexAttribPointer(attrib_pos, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.POS);
GL20.glVertexAttribPointer(attrib_uv, 2, GL11.GL_FLOAT, false, NkDrawVertex.SIZEOF, NkDrawVertex.UV);
GL20.glVertexAttribPointer(attrib_col, 4, GL11.GL_UNSIGNED_BYTE, true, NkDrawVertex.SIZEOF, NkDrawVertex.COL);

GL20.glUniformMatrix4fv(uiprogram.getUniformLocation("projection"), false, uimemStack.floats(
				2.0f/context.getWidth(), 0.0f, 0.0f, 0.0f,
				0.0f, -2.0f/context.getHeight(), 0.0f, 0.0f,
				0.0f, 0.0f, -1.0f, 0.0f,
				-1.0f, 1.0f, 0.0f, 1.0f
		));

Was this class NkDrawVertex removed? Or is it in another package?
Gradle dependencies:
compile group: "org.lwjgl", name: "lwjgl", version: "3.0.1-SNAPSHOT"
compile group: "org.lwjgl", name: "lwjgl-vulkan", version: "3.0.1-SNAPSHOT"
compile group: "org.lwjgl", name: "lwjgl-opengl", version: "3.0.1-SNAPSHOT"
compile group: "org.lwjgl", name: "lwjgl-nanovg", version: "3.0.1-SNAPSHOT"
compile group: "org.lwjgl", name: "lwjgl-nuklear", version: "3.0.1-SNAPSHOT"
compile group: "org.lwjgl", name: "lwjgl-stb", version: "3.0.1-SNAPSHOT"
compile group: "org.joml", name: "joml", version: "1.6.6"

Yes, nk_draw_vertex has been removed in Nuklear 1.13 in order to support custom vertex layouts. See this Nuklear issue and this LWJGL commit for details.

@Spasi Thanks for your answer!
This means we have to hard code this values now, like in your example code?
Code:
glVertexAttribPointer(attrib_pos, 2, GL_FLOAT, false, 20, 0);
glVertexAttribPointer(attrib_uv, 2, GL_FLOAT, false, 20, 8);
glVertexAttribPointer(attrib_col, 4, GL_UNSIGNED_BYTE, true, 20, 16);
``´

It's up to you how you do it exactly (hardcoded or whatever). Nuklear doesn't require a particular layout anymore.

@Spasi Thanks for your answer!
You can close this issue now.


selenium.common.exceptions.InvalidArgumentException: Message: binary is not a Firefox  executable

Describe the bug
Error while starting sync with firefox.
Ubuntu 24.04.1 LTS
Mozilla Firefox 131.0
geckodriver 0.35.0 ( 2024-09-24)
NVIM v0.10.2
To Reproduce
Steps to reproduce the behavior:

Install Jupinium in a virtual env
Install Jupinium in neovim with Lazy, uncomment build part and specify jupynium folder in the virtualenv
Launch Jupynium with :JupyniumStartAndAttachToServerInTrminal

Expected behavior
Have Jupynium running.
Logs in /tmp/jupynium/logs/
The tmp directory path can be different in a different OS.
Alternatively, run :JupyniumStartAndAttachToServerInTerminal to see the output directly in neovim.

jupynium.pynvim_helpers:   15 - INFO - nvim addr: /run/user/1001/nvim.17312.0
jupynium.pynvim_helpers:   34 - INFO - nvim attached
jupynium.pynvim_helpers:   38 - INFO - Initialising..
jupynium.pynvim_helpers:   39 - INFO - Communicating with channel_id 8
jupynium.cmds.jupynium:  517 - INFO - Namespace(notebook_URL='localhost:8888/nbclassic
', nvim_listen_addr='/run/user/1001/nvim.17312.0', attach_only=False, sleep_time_idle=
0.05, version=False, check_running=False, firefox_profiles_ini_path=None, firefox_prof
ile_name=None, jupyter_command=['jupyter'], notebook_dir=None, no_auto_close_tab=False
)
jupynium.cmds.jupynium:  102 - INFO - Using firefox profile: None
jupynium.cmds.jupynium:  623 - ERROR - Exception occurred
Traceback (most recent call last):
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
jupynium/cmds/jupynium.py", line 526, in main
with webdriver_firefox(
^^^^^^^^^^^^^^^^^^
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
jupynium/cmds/jupynium.py", line 111, in webdriver_firefox
return webdriver.Firefox(options=options, service=service)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
selenium/webdriver/firefox/webdriver.py", line 71, in init
super().init(command_executor=executor, options=options)
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
selenium/webdriver/remote/webdriver.py", line 212, in init
self.start_session(capabilities)
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
selenium/webdriver/remote/webdriver.py", line 299, in start_session
response = self.execute(Command.NEW_SESSION, caps)["value"]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
selenium/webdriver/remote/webdriver.py", line 354, in execute
self.error_handler.check_response(response)
File "/home/myuser/virtualenvs/my_env/lib/python3.12/site-packages/
selenium/webdriver/remote/errorhandler.py", line 229, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.InvalidArgumentException: Message: binary is not a Firefox
executable
[Process exited 0]

Additional context
I suppose there is a problem with the firefox_profiles_ini_path which is None, so it can't open Firefox properly.
I have added a line in the logs with all the args in input.

https://github.com/kiyoon/jupynium.nvim/issues/27#issuecomment-1405888448
Can you try this simple python code to see if you can run selenium with firefox no problem?

Python 3.12.3 (main, Sep 11 2024, 14:17:37) [GCC 13.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from selenium import webdriver
>>> driver = webdriver.Firefox()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/gillesrecouvreux/virtualenvs/onroad-us_env/lib/python3.12/site-packages/selenium/webdriver/firefox/webdriver.py", line 71, in __init__
    super().__init__(command_executor=executor, options=options)
  File "/home/gillesrecouvreux/virtualenvs/onroad-us_env/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 212, in __init__
    self.start_session(capabilities)
  File "/home/gillesrecouvreux/virtualenvs/onroad-us_env/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 299, in start_session
    response = self.execute(Command.NEW_SESSION, caps)["value"]
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/gillesrecouvreux/virtualenvs/onroad-us_env/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 354, in execute
    self.error_handler.check_response(response)
  File "/home/gillesrecouvreux/virtualenvs/onroad-us_env/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 229, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.InvalidArgumentException: Message: binary is not a Firefox executable

Did you install firefox with Snap? I googled online and people say that the selenium may not pick up the correct geckodriver.
https://stackoverflow.com/questions/76846675/selenium-ubuntu22-bug-message-binary-is-not-a-firefox-executable
https://github.com/SeleniumHQ/selenium/issues/13169
Can you try the solution and see if it works (with the minimal code)?

I think, if you use the consistent version of firefox it will work.
For example,
Option 1: remove firefox from apt and use only the snap firefox and snap geckodriver
Option 2: fix the profile missing error following this: https://support.mozilla.org/en-US/kb/how-run-firefox-when-profile-missing-inaccessible

I went with option 2, fix all, thanks


About their role forms - Add same organisation page

Context
Employer can select if the person they are referring works in the same organisation.
An error message will be shown when submitting without selecting a value.
https://trello.com/c/c46KiqWB/987-about-their-role-forms-add-same-organisation-page
https://teacher-misconduct.herokuapp.com/report/teacher-role/school
Changes proposed in this pull request
Adds the following page:

Update the routes
Generate a migration for adding the same organisation field to the referrals table.
Add the form, including validation
Link the form to the job title page

Checklist

[x] Attach to Trello card
[] Rebased main
[] Cleaned commit history
[x] Tested by running locally

 About their role forms: Add same organisation page


[Issue]: When Windows username contains umlaut the installer fails

What happened?
Installation directory of nvm installer is by default ".../Users/[USERNAME]/...". But when the Windows username contains umlaut character like ü/Ü, ö/Ö, ... the installer fails eventually. On command line it is visible that the umlaut character fails to be read correctly.
What did you expect to happen?
Installer in all stages should be able to locate the Windows user folder even if the username contains umlaut characters like ü/Ü and ö/Ö.
Version
1.1.11 or newer (Default)
Which version of Windows?
Windows 11
Which locale?
English
Which shell are you running NVM4W in?
cmd
User Permissions?
Administrative Privileges, Elevated
Is Developer Mode enabled?
No
Relevant log/console output
No response
Anything else?
I forgot the exact stage this failure occurs, since I actually experienced this problem a few weeks ago and did a walkaround by changing the installation directory.

#726
Pretty much any "special" character makes this issue appear, I cannot install any node version because my name has a "é"...
I never thought Windows and other apps would still have issues with basic UTF-8 or Unicode characters, but here we are!
Apparently this is a workaround to fix this issue, I am yet to try it though.


fix removeNotRequiredBracesFrom to handle nested objects with empty strings

Input:
"{ foo: '', bar: { a: 'text' } }"
Observed:
"{ foo: } }"
Expected:
{ foo: , bar: { a: } }
which is a problem for the comparison of opening and closing brackets.

looks good for me


Consider a key for moving styles into web_modules

While this isn't necessarily a standard use case for either Pika or npm, would you consider an option to move CSS files over to web_modules/? While Pika currently uses the module key in a dependency's package.json, it could be useful to consume some CSS files or other assets (icons, images, etc) from a dependency (think design systems). I don't have a real proposal for what that key should be, but this could be an incredibly useful feature especially for enterprise.

I'd love to have an example of a package with a decent number of users that uses CSS (Bulma or Bootstrap maybe?).
I think Rollup has a CSS plugin that would move it into web_modules/ as a common asset automatically, which would be perfect. If anyone wants to take the lead on investigating this, I'd be happy to prioritize reviews/responses.

Looks like both Bulma and Bootstrap just have a style key in their package.json. I'd be happy to take a stab at this.

That would be great! From a quick search it looks like this would be a good starting point: https://github.com/egoist/rollup-plugin-postcss
Some other random thoughts:

It seems like most CSS-related packages tell you to import the CSS file directly (ex: import 'bulma/css/bulma.css'), so supporting {"webDependencies": ["bulma/css/bulma.css"]} would be a fine place to start.
As a future enhancement, if a package only has a "style" key and no "main" / "module" / "browser" and no default top-level "index.js" then it would be possible to add support for {"webDependencies": ["bulma"]} as well. Actually, in that case maybe we just support both "style" & "module" by default if both exist...
In the codebase everything assumes that files are JS, so just watch out for that, especially around file extensions.
To test, I would just recommend creating a test directory that contains the package.json you'd like to support and then running your package locally after building it. Something like: ../PIKA_WEB_CLONE_DIR/pkg/dist-node/index.bin.js  --clean

Perfect. I'll get this in my backlog. One random thought I'd like to verify before getting started: Pika should only support compiled CSS, correct? It would be possible to support SCSS, LESS, Stylus et al should be pre-compiled. I know rollup-plugin-postcss can handle each of those variants, but it doesn't feel like a good strategy (to me at least), but I'm happy to defer that decision.

Yea, I think you're on to something there. My approach to these sorts of things is "lets add the thing that we wanted, and then see who asks for the extra thing". So let's add CSS support only to start, and then see if anyone even wants SCSS/LESS/Stylus support and then we can have that convo.
Thanks for offering to tackle!

OK, so I have this feature added, but am not entirely sure how I should proceed if two packages use the same filename (index.css or similar). Any preferences right now?
For the record, it's a pretty naïve implementation right now: I just look for the file an copy it over however it is presented (without manipulation) using fs.copyfile. Any qualms with that approach? I initially tried generating a JS file and using Rollup to and rollup-plugin-postcss, but that seemed like more effort than it was worth.

Yea, let's start with that, easy and simple. That also lets us kick the "I want to import a CSS file inside of JS" discussion down the road while the different native CSS import proposals/discussions play out:

https://github.com/MicrosoftEdge/MSEdgeExplainers/blob/master/CSSModules/v1Explainer.md
https://github.com/w3c/webcomponents/issues/759

Love it. Any ideas on potential naming conflicts? Once I get that hammered down (and my company's open source office approval), I'll submit a PR.

I was imagining a straight copy from node_modules -> web_modules. So;

webDependencies: ["bulma/css/bulma.css"] -> web_modules/bulma/css/bulma.css
If you want to add "style" entrypoint resolution: - webDependencies: ["bulma"] -> web_modules/bulma.css.

But maybe i'm misunderstanding what you mean by naming conflicts. If so, can you give me an example of what you mean?

The idea was to just port over whatever file is referenced in the "style" entry in the package (assuming it is CSS and not some other file type). So for Tachyons, it would bring over css/tachyons.min.css into web_modules/ (so web_modules.tachyons.min.css).
Ideally there would be a common directory structure where we could bring over the entirety of a library's output, but there doesn't seem to be a real standard there. Even Bulma, funny enough, doesn't point its style property at an actual file because it adds the /bulma prefix to it (although I've tested what I've written with Bootstrap, Bulma, Shed-CSS, Tachyons and Tailwind and Bulma is the only one to fail so far).

Gotcha, how do you feel about using the strategy above instead ({webDependencies: ["bulma/css/bulma.css"]} -> web_modules/bulma/css/bulma.css)? That way we can follow the same strategy that we're already using to reference files within packages.
Preserving the existing folder structure also allows you to include multiple CSS files if any  @imports exist.

Would that only work as opt-in then? Or would the CLI still work?

yea, exactly. Right now only ESM packages (those that expose a "module") are included by default.   At least to start, this can be an opt-in feature through webDependencies config only (I would imagine some people getting surprised to see CSS in their web_modules/ directory without opting in).
We can release it that way to start, get some early feedback, and then consider adding features / making it default if there's interest.

Perfect. I'll get that up and running. Thanks for talking me through it.

So right now this feature will only work if isExplicit === true, do you think there would be any value in adding a flag for the isExplicit === false or just run with it for the time being? Other than that question, I have this ready to go once I get approval.

Sorry for the barrage of comments here, but I've actually been giving this some thought while using this feature locally and I want to propose a change to the scope of this and would love your feedback.
As an employee at a large enterprise company with our own internal npm, design system including style assets, icons, etc. I believe it would be beneficial to introduce a separate "assets" key to the @pika/web property in the package.json that would copy over a series of white-listed assets including CSS, fonts and images (SVG particularly).
{
  "name": "@corporatescope/some-package",
  "@pika/web": {
    "webDependencies": [
      "lit-element"
    ],
    "assets": [
<EMAIL_ADDRESS>      "@corporatescope/design-system-icons/directory?"
<EMAIL_ADDRESS>    ]
  }
}

no problem at all! Thanks for being so thoughtful with this change, it's very much appreciated!
So if we're going down the asset road, it sounds like we have two options:
1. The 2-value config outlined above
2. A single-value config, that's more powerful but potentially more magic
// This config:
{
  "@pika/web": {
    "include": [
      "lit-element",
      "@corporatescope/design-system" // Future work: include all CSS, Fonts, etc. for a package.
    ]
  }
}

// Leads to this web_modules/:
- lit-element.js
- @corporatescope/design-system.js (if "module" or "main" exists)
- @corporatescope/design-system/* (all {css,svg,woff,etc} assets, if any exists)

Tbh I like that option #2 doesn't get more complicated as we add features/support. I don't think it would be too magic, given that most packages don't contain CSS or Fonts and that we would still support current "file path instead of package name" fallback. I guess the one thing to make sure we handle there are asset packages that have no JS in them (no "module" or "main" entrypoint, then maybe we check for a "style" entrypoint and accept that?).
Either way, for now for the scope of this first PR it makes sense to just start by adding support for non-JS file paths in<EMAIL_ADDRESS>This would get us support for CSS, Fonts, SVGs and any other non-JS assets without needing to force a larger interface change/addition. It would also be good to try out the current interface first before adding a new config, to get a better sense of whether we need it.
Another good idea that's already been requested would be glob support, so that you could do  something like "@corporatescope/design-system-icons/**/*{css,svg}". If you're interested in tackling this, feel free to do so in a follow up PR / not tackle immediately.
Does that make sense?

Yeah, that makes sense. What I have already will allow for some future options with small modifications, but I'll just leave this initial PR as explicitly-added non-JS files.
Thanks.

perfect, can't wait to see!

Lending weight to this, Chrome announced intent to implement v1 CSS modules: https://groups.google.com/a/chromium.org/forum/#!msg/blink-dev/vCrJCQxNnzo/OAYI9cPWAQAJ
The tl;dr:
import sheet from "./styles.css";

document.adoptedStyleSheets = [...document.adoptedStyleSheets, sheet];

Nice! I think that's a reason to keep CSS in web_modules, if we'll be moving towards importing CSS in JS on the web.
Closed via #85


cargo flash does not work inside members of a workspace

It looks for target in the current directory, but in a workspace target is in the workspace root, resulting in a panic like this:
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" }', src/libcore/result.rs:1084:5

This is an error in cargo-project: https://github.com/japaric/cargo-project/issues/5 .
Maybe someone finds time to fix it. I think I focus on other things for now.

Hmm, I ran this from the subcrate when it failed (Rubble's demos/nrf52810-demo)

That is odd. Guess we'll need to investigate some more.

Wasn't this fixed?

Saw this when working with project https://github.com/chris-zen/mdp-link-rs, the symptom when running cargo flash is the message seen on https://github.com/probe-rs/probe-rs/issues/102.

Well, the problem is that cargo-project (the crate we use to get the metainfo) does always look for a valid cargo manifest before marching up the directory tree and looking for a project workspace.
This: https://github.com/japaric/cargo-project/blob/master/src/lib.rs#L74 is where it fails to parse the workspace manifest, because it expects a project manifest. Maybe you could try and go from there :)

Had a quick look at it and I'm not sure what would be the best course of action since cargo flash from the top level workspace directory is not specific enough: which sub-cargo-project should be flashed if there are multiple that generate the corresponding targets?


Skip over unknown boxes

If the box size is non-zero, skip over it and continue reading. Otherwise if
the box size is zero, exit the loop.

Sure thing, added a comment.

Thank you!


[TW-144] ignore incoming data if handler finished

This prevents a simple attack (described in the ticket) in which anybody
who knows what peer data you expect can fill up your heap with bytes.
Note that there's another side to the story in case this is backed by
network-transport-tcp: the transport's QDisc. If the simple unbounded
QDisc is used, the attack will probably still work, because the
unbounded Chan will fill up with data faster than the dispatcher can
remove it. Using a one-place or fair QDisc mitigates this.

@georgeee @dcoutts if we're concerned about DoS then we should merge this one.

This prevents an attack by a peer who SYNs the conversation, but looking through the changes just now I realize the same attack is still possible by an ACKing peer. Will fix that.


How to use configurationfile.ini in xSQLServerSetup

Details of the scenario you try and problem that is occurring:
Hi folks,
how can I use a configurationfile.ini using xSQLServerSetup? I must admin: I'm still having hard time to get the "big picture" which file and how configured do I need to install the SQL-Server? Only, let's say the file: InstallDefaultInstanceSingleServer.ps1? Thanks for your help.
Purclot Avignon
The DSC configuration that is using the resource (as detailed as possible):
xSQLServer
Version of the Operating System, SQL Server and PowerShell the DSC Target Node is running:
Windows Server 2012 R, PS Ver. 5
Version of the DSC module you're using, or 'dev' if you're using current dev branch:

Hi @Purclot, currently the INI file is not supported with xSQLServer. Take a look at issue #377 for some details around the conversation.
I'll let @johlju comment on the example configuration.

hi Dan, thanks for your fast response. I'd really love to participate on this project, but I still don't get the "big picture" about the module xSQLServer. Do we have some simple docs describing the stuff?
Thanks for your help
Purclot

The documentation is something we've been discussing how to handle since we rely on other components and resources in DSC. Right now the documentation is the README.md file that is available on the project home page.
The purpose of managing SQL with DSC is to ensure consistency across any number of servers and to ensure the state of the instance, server, databases, etc. doesn't drift.
What's your experience level with DSC? Have you tinkered with any of the basic tutorials?

hi Dan,
my DSC-experience is very low, I've started with some basic tutorials (thanks for any advice!), my company  pushes me and the need for a SQL Server DSC is a huge topic, means for me: jump in! So thanks for any advice and hints how to start with DSC, I hope then to collaborate and help later!
Purclot

@Purclot Thanks for asking the question! I bet more people than you are wondering the same.
As @randomnote1 said, currently there is no step-by-step on how to use this resource. Unfortunately, at this stage, the documentation assumes that the user has a knowledge in the workings of LCM and DSC.
It is not as easy as download the module an run the InstallDefaultInstanceSingleServer.ps1 script. But I guess you figured that out already since you are asking. 😄
If you want to learn how LCM and DSC works I would suggest reading this book https://leanpub.com/the-dsc-book. It do assume that you have a knowledge of PowerShell.
After that you could start (in simple terms) by deploying a VM, setting LCM into push mode, creating a configuration file that contains for example .Net Framework and push that to a client. But pushing SQL Server in an environment (for examples using the configuration in the example InstallDefaultInstanceSingleServer.ps1) you need more, like certificate to encrypt the configuration (when using passwords for accounts) and on each server you need to have the same certificate to encrypt the passwords.
If you gonna pull the configuration then you need a pull server on top of all that. :)
All this is explained in the book I mentioned earlier. But it does not go into how to use the xSQLServer resources. But I think, when you read that book you have a much bigger understanding on what you need to do to get a test and production environment running using DSC.
I hoped this help.

hi Johan,
thanks for your answer, it explains a lot. I hoped it would be (a bit) easier, but it's always the same with a new technology! The DSC seems to be a cool thing, my company is pushing me into it, so let's do it. I hope to get the grip, if so, maybe I could help you and other contributors!
Purclot

@Purclot You are more than welcome to contribute in any way you can! You already started by submitting an question (issue) 😄
Can we close this issue at this time?

yes, please!


Python interactive and VS Code window reload

Hello.
I'm using VS Code with SSH conection to remote server and mostly use .py files and Python Interactive window.
However, sometimes VS Code can't re-establish SSH connection and I have no option but to press "Reload VS Code window". After that Python Interactive is gone with all the work in it and I have to start from scratch.
Is there a way to revive Python Interactive window after reloading VS Code Window?

Thanks for filing this issue.
Currently this isn't possible, however there's an issue that would make this possible https://github.com/microsoft/vscode-jupyter/issues/1516
Please do upvote that.


[Info request]: Command to list all UEs connected to open5gs

Ask: Please provide command to list all UEs connected to open5gs.
We have deployed docker version of open5gs as mentioned in https://github.com/s5uishida/docker_open5gs_volte_sms_config
We have real eNBs and UEs connected to it.
We want to see on open5gs core which UEs are connected to core with their IMSI, APN, allocated IP.
I could not find such command in open5gs documentation.
Is there any way to get this info.

I dont think you will be able to see which UEs are connected with their IMSI, APN and IP. But if you access the Prometheus, then you would be able to have the graph of the following metrics


Fix three issues

1.https://github.com/Karambirov/GitHubSearch/issues/47
2.https://github.com/Karambirov/GitHubSearch/issues/43
3.https://github.com/Karambirov/GitHubSearch/issues/46

Close #47 #43 #46


sqlite3.OperationalError: unable to open database file

Is your backup encrypted?

Nope :/

Will try

Wait the whole backup is sorted into like folders am I supposed to preprocess this somehow?

Folders named from 00 to ff?

Yup

You don't have to touch them. There should be a Manifest.db in the root directory of the backup folder.

looks like the db doesnt have a manifest.db

Unless Apple changed the backup structure, the manifest.db should be located in the root directory.  You may check if the backup is intact or delete the backup and do it again.

First of all, thanks for this method. Unfortunately, I encounter a somewhat similar problem, this is from my terminal
Do you have any idea what is going on? I have tried opening Manifest.db with DB Browser for sqlite and that seems to work... Cheers

Hi. Is your iOS backup encrypted?

First of all, thanks for this method. Unfortunately, I encounter a somewhat similar problem, this is from my terminal
Do you have any idea what is going on? I have tried opening Manifest.db with DB Browser for sqlite and that seems to work... Cheers

Hi. Is your iOS backup encrypted?

It is not. I specifically chose the option "don't encrypt".

It is not. I specifically chose the option "don't encrypt".

Can you get the value of the final path at line 50 and confirm the path is correct?
    with sqlite3.connect(os.path.join(base_dir, "Manifest.db")) as f:

Sorry, I don't exactly understand, which path and how would I get it?

Sorry, I don't exactly understand, which path and how would I get it?

Add the following line above line 50.
print(os.path.join(base_dir, "Manifest.db"))

i.e.
def is_encrypted(base_dir):
    print(os.path.join(base_dir, "Manifest.db"))
    with sqlite3.connect(os.path.join(base_dir, "Manifest.db")) as f:

thanks. I have put the print statement in line 50 of extract_iphone_media.py. I ran the wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/... command again, but get the same output as before, that is, it is not printing.
~/working_wts » wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/...
/Users/julius/Library/Application Support/MobileSync/Backup/.../Manifest.db
Traceback (most recent call last):
  File "/usr/local/bin/wtsexporter", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/Whatsapp_Chat_Exporter/__main__.py", line 271, in main
    extract_iphone_media.extract_media(args.backup)
  File "/usr/local/lib/python3.11/site-packages/Whatsapp_Chat_Exporter/extract_iphone_media.py", line 66, in extract_media
    if is_encrypted(base_dir):
       ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/Whatsapp_Chat_Exporter/extract_iphone_media.py", line 51, in is_encrypted
    with sqlite3.connect(os.path.join(base_dir, "Manifest.db")) as f:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
sqlite3.OperationalError: unable to open database file

the py file lines looks like this:
def is_encrypted(base_dir):
    print(os.path.join(base_dir, "Manifest.db"))
    with sqlite3.connect(os.path.join(base_dir, "Manifest.db")) as f:
        c = f.cursor()
        try:
            c.execute("""SELECT count()
                    FROM Files
                    """)
        except sqlite3.OperationalError as e:
            raise e  # These error cannot be used to determine if the backup is encrypted
        except sqlite3.DatabaseError:
            return True
        else:
            return False

Ah well, so this was apparently an error on my site. I forgot to add a slash at the end of the device id directory, so it was not properly recognized as base_dir, and you didn't see this error, given I had censored the part of the terminal screenshot. I am sorry for the confusion. For my sake, you may close this issue.

So,
wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/{device id}
does not work while
wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/{device id}/
works?

yes

Here my two cents, in case anyone else is facing this on MacOS:
You'll get this error also if you don't grant Full Disk Access to the Terminal in Security & Privacy settings.
Thank you so much for this great tool 🤙

Ah well, so this was apparently an error on my site. I forgot to add a slash at the end of the device id directory, so it was not properly recognized as base_dir, and you didn't see this error, given I had censored the part of the terminal screenshot. I am sorry for the confusion. For my sake, you may close this issue.

So, wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/{device id} does not work while wtsexporter -i -b ~/Library/Application\ Support/MobileSync/Backup/{device id}/ works?

The path problem should be fixed.

Here my two cents, in case anyone else is facing this on MacOS: You'll get this error also if you don't grant Full Disk Access to the Terminal in Security & Privacy settings.
Thank you so much for this great tool 🤙

This solved my problem. Should put this as one of the solutions in the docs.


Known drugs widget disappears when searching the table

Describe the bug
Issue observed in the Known Drugs widget table in profile and evidence pages. When searching the widget's table, the whole widget disappears from the page. This problem was first observed and reported by @HelenaCornu .
Observed behaviour
When searching the widget's table, a set of results matching the search are displayed in the table. If however the search term is not found, the whole widget is removed from the page.
The known drugs table uses server side pagination. So when searching the table, a new API request is fired.
If no rows match the search term, the API returns null.
The newly refactored sections in the front end check for null in order to determine which sections to display, and so at it point it removes the widget.
I need to investigate this a little further, but it might need to be fixed with help from the @opentargets/be-team: possible idea perhaps return an empty array with also the search term?
Expected behaviour
When searching the known drugs table and no match is found, then the widget should display some message, e.g. "no data".
To Reproduce
Steps to reproduce the behaviour:

Go to a profile page, e.g. https://platform.dev.opentargets.xyz/target/ENSG00000073756
Scroll down to the known drugs widget
In the search box for the widget table, type something random, e.g. "asdf"
See widget disappears.

We should look into this as well tomorrow

@LucaFumis @prashantuniyal02 Would this be a valid response ``````

@LucaFumis @prashantuniyal02 Would this be a valid response { "data": { "target": { "id": "ENSG00000073756", "knownDrugs": { "count": 0, "cursor": null, "rows": [], "__typename": "KnownDrugs" }, "__typename": "Target" } } }

@remo87 yes that the expected response

The widget was still disappearing after the change in the API, so I created this PR with a fix for the frontend

The search also crashes when a term is not found in the Safety widget on the profile page. Example

The search is not crashing now for the above widgets in dev platform.
We should ideally fix the root cause which is handling the case when the search results are not found inside the widgets.


System properties

"systemProperties" in the yaml file? is this our convention?

Well... that's one of the reasons I didn't like the term... don't like it either...
Imposed by the yaml parser, it has to be identical to the java member name...
Suggestions?

Didn't we decided something after all of the mails about it? was it systemProperties??
I don't think that this is a good functional name, and if the yamlParser is the problem we should handle it somehow.

we agree on system properties
and as i comment to the FS: i think it should be system_properties in the DSL

So we go with system_properties and system_property? should I try to figure a workaround for the parser?

@meirwah, @orius123, @meshipeer, @oritstone can you please review & merge?


[fs-bq-export] update import script instructions for npm info

Updates to IMPORT_EXISTING_DOCUMENTS.md include:

add intro line about which extension the script is for
add info about installing script via npm
add info about needing Node.js
general style updates

please DO NOT MERGE until JHULEATT has reviewed this PR.

@rachelsaunders do you also want to use this PR to move the contents of this file into a new README.md so that the contents get displayed on npm? Or would it be easier to save that for another PR?

@jhuleatt I'd like to do the file move in a separate PR.  I _think that if we do the move in this PR, then the PR will just show the whole file as changed, rather than just the individual diffs.  Is this ok?

Waiting for another PR makes sense. LGTM!


3.0适配和sql查询表格化展示

安装依赖报错：
`
D:\projectCode\html\TDengineGUI> cnpm install --verbose electron
√ Installed 6 packages
√ Linked 250 latest versions
[1/2] scripts.postinstall<EMAIL_ADDRESS>run "node install.js", root: "D:\projectCode\html\TDengineGUI\node_modules\_electron@21.2.3@electron"
[1/2] scripts.postinstall<EMAIL_ADDRESS>finished in 2s
[2/2] scripts.postinstall<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>run "node -e "try{require('./postinstall')}catch(e){}"", root: "D:\projectCode\html\TDengineGUI\node_modules\_core-js@2.6.12@core-js"
Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!
The project needs your help! Please consider supporting of core-js on Open Collective or Patreon:

https://opencollective.com/core-js
https://www.patreon.com/zloirock

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)
[2/2] scripts.postinstall<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>finished in 135ms
√ Run 2 scripts
anti semver<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>› @types/node@* delcares @types/node@*(resolved as 18.11.9) but using ancestor(electron)'s dependency @types/node@^16.11.26(resolved as 16.18.3)
deprecate<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>Please use @electron/osx-sign moving forward. Be aware the API is slightly different
deprecate<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>Please use @electron/asar moving forward.  There is no API change, just a package name change
deprecate<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS>›<EMAIL_ADDRESS><EMAIL_ADDRESS>is no longer maintained and not recommended for usage due to the number of issues. Because of the V8 engine whims, feature detection in old core-js versions could cause a slowdown up to 100x even if nothing is polyfilled. Some versions have web compatibility issues. Please, upgrade your dependencies to the actual version of core-js.
√ All packages installed (269 packages installed from npm registry, used 8s(network 6s), speed 48.52KB/s, json 8(285.44KB), tarball 0B, manifests cache hit 243, etag hit 243 / miss 8)
后续继续执行可以通过
D:\projectCode\html\TDengineGUI>
√ Installed 6 packagesngineGUI> cnpm install
√ Linked 0 latest versions
√ Run 0 scripts
√ All packages installed (used 24ms(network 19ms), speed 0B/s, json 0(0B), tarball 0B, manifests cache hit 0, etag hit 0 / miss 0)
D:\projectCode\html\TDengineGUI>cnpm run start

<EMAIL_ADDRESS>start
electron .

`
但是运行出来的没有样式


Testing, please ignore. (phxxhl)

Bug bounty test - please ignore.... Please DO NOT APPROVE THIS! (phxxhl)

Spambot, closing PR.


Windows Support

Is your feature request related to a problem? Please describe.
when I try to run it on windows, it requires "render.so", apparently this is a linux library
Describe the solution you'd like
can you add windows support?
Describe alternatives you've considered
if it is supported, please share how?

You can use the default Sim3DR, disable the c render. For example, comment out line 13 and uncomment out line 12. https://github.com/cleardusk/3DDFA_V2/blob/fa8dfc479b46c218e7d375706c673d5823ddb464/demo.py#L12-L13
Accordingly, comment out the build scripts in Line9-11
https://github.com/cleardusk/3DDFA_V2/blob/fa8dfc479b46c218e7d375706c673d5823ddb464/build.sh#L9-L11

wsl2 supports the instructions of the repo


Unable to locate package python-opengl

In Unit1, the very beginning, local machine, ubuntu 22.04, python 3.10, conda virtual environment. when I type command:
sudo apt install python-opengl, it give me error:
E: Unable to locate package python-opengl.
I search on net for help, cannot find any helpful info, always refer to PyOpenGL. Is it the same of python-opengl? I find a package named python3-opengl, is it the same of python-opengl?
If it is only me encounter this kind of problem?
Any help.

same problem

Doing this worked for me
sudo apt-get install -y python-opengl

I got though this
in ubuntu 22, install comand should be:
sudo apt-get install -y python3-opengl

@simoninithomas Why was it closed? The issue is still reproducible when running in Colab. In Unit 2, it is even worse, since the command is !apt install python-opengl ffmpeg xvfb. Since it fails on installing python-opengl, it doesn't install the other packages, ffmpeg and xvfb, which in turn leads to
No such file or directory: 'Xvfb'
when trying to run the following cell
# Virtual display
from pyvirtualdisplay import Display

virtual_display = Display(visible=0, size=(1400, 900))
virtual_display.start()

@mrvincenzo my appologies it was a mistake. I updated the notebook some weeks ago and I forgot to push it to to the github repo.

The update is done ✅ Thanks for pointing this out. And my apologies for the closing mistake 🤗

I got though this in ubuntu 22, install comand should be:
sudo apt-get install -y python3-opengl

this worked for me, thanks!


Facial Recognition Attendance Management System

Hi, Can I give it a try please? It would be geat if you could assign this to me.

ok assigning it to u

Hi, can i get 2 more days please?


How can we trigger a Status EventType?

We don't  have a plan for this kind of event due to two issues: i) we don't know yet what triggers this kind of change; and ii) we don't know which SCMB topic holds events of this kind. Our current plan to solve the first issue is the suggestion by @danielreed of applying a Server Profile with a connection and then removing the used card (via DCS CLI) should lead to a Critical state.

OneView DCS CLI does not allow to remove the mezz card of a blade currently connected to the enclosure. The following message is presented:
DCS $ removemezzcard 3
Blade is Connected to Enclosure. Cant Remove the Mezz card

The verb setstatus of the enclosure can be used to change the status for the whole enclosure, triggering a change in the status of all blades connected to it. Unfortunately, the change took quite long to be noticed by OneView and I missed the event.


[FEATURE] Write the first persona story

We have done the first interview in the framework of #720. Let's summarize it.

We have done that some time ago


Issues with IDN domains

If domain contains non-ASCII symbols you'll get exception:
Exception 'Screen\Exceptions\InvalidUrlException' with message 'The url 'http://президент.рф' is not valid.'
...
in .../vendor/microweber/screen/src/Injection/Url.php:24

The reason is here:
        if (!$url || !filter_var($url, FILTER_VALIDATE_URL)) {
            throw new InvalidUrlException($url);
        }

http://php.net/manual/en/filter.filters.validate.php

FILTER_VALIDATE_URL ... Note that the function will only find ASCII URLs to be valid; internationalized domain names (containing non-ASCII characters) will fail.

I tried idn_to_ascii() to work it around.
Image was created, but contained only background (white for jpg, transparent for png).
This happens both on Windows and Ubuntu.

Solved (just removed timeout from params - seems I did not reach desired result using it).


Rendering support for field types

Support the following field types for rendering:

[x] #12
[x] #13
[x] #14
[x] #15

Resolved in 4f224e08a9875c528e6c7a6c35e233d1dddbcb29.


Added transition documentation to Connection Manager API

The implementation LGTM wrt to the specification. At least I tried to check all the transitions and they seemed fined. @coot says that the tests do not show any problems so far as well.
The Server and IPG modules could be structured in a more organized way. As it is now (Server  and Server2) it is not really intuitive where to look.
The code for the ConnectionManager is big and scary but after reading the documentation and understanding how the components are supposed to work together it  was easier to follow the code. Maybe it can be broken in several parts, withConnectionManager is over 1000 lines! I wonder if the state machine pattern matching can be refactored for each impl (probably not).
The tests are still in development. The only possible invariants that I could think of for the Connection Manager was for the relation between connected node to be injective (i.e. 1-to-1-to-1 relation between 2 nodes and a given state) and the ConnectionManagerState being a Map already gives us that. The other one was that in a given interval, assuming the 2 nodes are correct (do not fail), if node A puts B in DuplexState, then B puts A in DuplexState as well. The same for the other States (OutboundDuplex vs InboundDuplex, for example). There's already a test that checks if connections are being reused, which covers the DuplexState case. The other cases can be included in the tests for the IPG and Server; the Connection Manager simulation has only one side (Outbound).

bors merge


JGProgressHUDRingIndicatorView Didn't show.

The loading image was showing as the default one even thought i set it to the JGProgressHUDSuccessIndicatorView(). I'm trying to have the progress indicator showing before the app finished parsing xml file and go to the next view with parsed docutment. I'm calling the DispatchQueue.main.asyncAfter(deadline: .now() + .milliseconds(400)) in prepare segue.
(I want the indicator to be the Ring one with % showing, but it showed only for 0.1 second right before the next vc show up.)

import JGProgressHUD

 let hud = JGProgressHUD(style: .light)
override func viewDidLoad() {
        super.viewDidLoad()

        documentPicker.delegate = self
        documentPicker.allowsMultipleSelection = false

        hud.textLabel.text = "Loading"
        hud.dismiss(afterDelay: 3.0)
        hud.indicatorView = JGProgressHUDRingIndicatorView()
    }

func incrementHUD(_ hud: JGProgressHUD, progress previousProgress: Int) {
       let progress = previousProgress + 1
       hud.progress = Float(progress)/100.0
       hud.detailTextLabel.text = "\(progress)% Complete"

       if progress == 100 {
           DispatchQueue.main.asyncAfter(deadline: .now() + .milliseconds(500)) {
               UIView.animate(withDuration: 0.1, animations: {
                   hud.textLabel.text = "Success"
                   hud.detailTextLabel.text = nil
                   hud.indicatorView = JGProgressHUDSuccessIndicatorView()
               })
               hud.dismiss(afterDelay: 1.0)
           }
       }
    }

    override func prepare(for segue: UIStoryboardSegue, sender: Any?) {
        switch segue.identifier {
        case "importEHR":
            if let navController = segue.destination as? UINavigationController {
                if let vc = navController.topViewController as? ViewEHRVC {

                    let hudProgress = (xml?.description.components(separatedBy: "\n").count)! / 100
                    hud.show(in: self.view)

                    DispatchQueue.main.asyncAfter(deadline: .now() + .milliseconds(400)) {
                        self.incrementHUD(self.hud, progress: hudProgress)
                    }

                    if isNewEHRSelect == false {
                        vc.xml = xml
                        vc.ccdAdded = true
                        vc.title = "Imported Health Record"
                    } else {
                        vc.xml = SWXMLHash.parse(Data(combinedXML.utf8))
                        vc.ccdAdded = true
                        vc.title = "Health Record Merge"
                    }
                }
            }
        default:
            return
        }
    }
}
`

Looks like a bug, I'll check it out. But regardless, you should completely configure your HUD before showing it. So set the indicator view, then show the HUD.

@JonasGessner So instead of setting it up in prepare segue I put it in the viewdidload(). Now its showing the ring indicator but still not doing the % loading correctly.

The examples project contains examples for exactly what you are doing. Please use that code as a reference.

@JonasGessner in the example the pervious int was set to 0. When I do that the ring indicator doesn’t show any %. So I’m trying to do it by counting the xml line. And it only show 10% and got stuck.

I can't help you with your code and I'm not sure what your code is supposed to do. From reading your code and from what you said it sounds like you are reading an XML file with 11 lines, hence the 10% progress. Can't really say anything more since this has nothing to do with this library.

uh ok thank!


Fix to issue that submission details is returning tons of repeated data

This PR fixes an issue that the Submission Details query was returning tons of extraneous repeats of reports.   See ticket #6454.
How to Test
How to test localhost:
Generate a bunch of data going to several receivers, into a file called ./junk/mix.csv:
./prime data --input-fake 30 --input-schema primedatainput/pdi-covid-19 --output ./junk/mix.csv --target-states MD,HI,FL
Send that data to your local reportstream and get back a report id:
curl -X POST -H "client:simple_report" -H "Content-Type: text/csv"  --data-binary<EMAIL_ADDRESS>"http://localhost:7071/api/reports"

Response:
{
  "id" : "7cee139b-bbaa-4b03-abb3-2a4e11ba339c",
 <etc>
}

Local API query to see the Submission details:
curl "http://localhost:7071/api/waters/report/7cee139b-bbaa-4b03-abb3-2a4e11ba339c/history"
If you see reasonable destination data, it works.  If you see a ton of repeats, it failed.  You can even submit the data prior to changing the code to the new branch, then do the history curl to see the bad result, then update the code to this branch, then do the history curl again, to see the good result.
How to test in Staging
I have sent a test submission 01a6f9ff-0fd8-465f-9ab5-c38dd34f139a to Staging, that exhibits the problem.    You can try running these steps before and after merging this PR onto Staging.  Before = bad/screwed-up data.   After = hopefully fixed.
Run these three commands:
./prime login --env staging
export TOK=$(cat ~/.prime/accesstoken.json | grep token | cut -d"," -f1 | cut -d":" -f2 | tr -d \")
curl -H "authentication-type: okta" -H "authorization: bearer $TOK" "https://staging.prime.cdc.gov/api/waters/report/01a6f9ff-0fd8-465f-9ab5-c38dd34f139a/history"

Changes

The problem was caused by the fact that a receive Action has multiple reports attached to it.  The query where clause used to constrain to just the report with a non-null sending_org, but that constraint was removed from code; I'm not sure why.  Its now back in.

Checklist
Testing

[X] Tested locally?
[X] Ran ./prime test or ./gradlew testSmoke against local Docker ReportStream container?
[N/A] (For Changes to /frontend-react/...) Ran npm run lint:write?
[X] Added tests?

Process

[N] Are there licensing issues with any new dependencies introduced?
[Y] Includes a summary of what a code reviewer should test/verify?
[N] Updated the release notes?
[N/A] Database changes are submitted as a separate PR?
[N/A] DevOps team has been notified if PR requires ops support?

Fixes
#6454
To Be Done

I did notice that if the useBatchHeaders is false for a receiver, the bug still surfaces.  CA has useBatchHeaders as false in localhost, so if you generate this data, you'll still see the issue:
./prime data --input-fake 40 --input-schema primedatainput/pdi-covid-19 --output ./junk/mix.csv --target-states
MD,CA,FL,VT

I believe there are currently no receivers in Prod that use that setting, so this is low priority, I'm hoping.

@kevinhaube thanks for catching those issues!    I think the NullPointer is fixed.
Regarding the second issue, I think there were multiple issues with the multiple destinations and I’ve only fixed one of them.    The queries are very complicated; it'll take me a while to dissect the issue, so we might want to go with this fix for now, then I'll do further work.


chore(ci): add nix flake build

Description of change
Adds flake building to CI

Help is needed to add rust-cache support

AFAIK pkgs.rustPlatform.buildRustPackage can't use rust-cache so I have no idea what can be done

Maybe @jla2000 or @Titaniumtown has an idea about this

@ch4og I think you will need to cache the nix store.

Maybe @jla2000 or @Titaniumtown has an idea about this

I'm not too familiar with using nix with github actions, srry :(

@ch4og I think you will need to cache the nix store.

Doesn't nix magic store do this?

Should be good to merge
Caching nix store using other way worked. It uses cache after first build now
But this build time can be decreased even more with https://github.com/orhun/binsider/pull/76


dataflow: avoid importing log4j at all

Remove any direct dependencies of log4j and use slf4j instead, as recommended by the documentation, and update to Beam 2.34 which doesn't depend on log4j.
Confirmed with mvn dependency:tree | grep log4j-api that there are no direct or indirect dependency instances of log4j on any sample by doing this.

[ ] I have followed Sample Format Guide
[ ] pom.xml parent set to latest shared-configuration
[ ] Appropriate changes to README are included in PR
[ ] API's need to be enabled to test (tell us)
[ ] Environment Variables need to be set (ask us to set them)
[ ] Tests pass:   mvn clean verify required
[ ] Lint  passes: mvn -P lint checkstyle:check required
[ ] Static Analysis:  mvn -P lint clean compile pmd:cpd-check spotbugs:check advisory only
[ ] Please merge this PR for me once it is approved.

Hopefully fixes #5875

You may need to drop the beam version for some of these samples for tests to pass.

Fixed lint issues. For the spanner sample, I'm trying Beam 2.32, if that passes I'll try 2.33 since we know something's broken with 2.34.

I noticed that the Spanner sample was using Java 8, which ends its support in 3 months. Updating to Java 11, maybe that'll fix the failing tests as well.

Java 11 didn't fix the tests, but downgrading to Beam 2.33 works for now. We still need to investigate why Beam 2.34 breaks SpannerIO.
cc: @jsimonweb @skuruppu @ansh0l -- tests for the SpannerIO sample with Beam 2.34 are still a blocker to upgrade versions (#5875)

@davidcavazos I will investigate separately on beam 2.34 issue. I'm assuming that for now, things are working with beam 2.33 in place.


themed Mine Threat decks

This is a bit more in-depth, but I've been looking into doing themed Mine Threat decks. So if know I'm going to Jargono, then I only stock the Mine threat deck with Jargono-related enemies. So even just listing out a "suggested threat deck" or something might be good, probably tied to the Other World and/or Enemy theme. Current themes I've worked up are: Outlaw (Human/Undead/Scafford), Void, Aliens, Wasteland/Canyons, then each of the Otherworlds. Still a work in progress, but those were the divisions that made sense. A simpler solution may be to just pick a random enemy type.

https://www.reddit.com/r/shadowsofbrimstone/comments/7mptca/brimstone_random_mission_picker/drwijtw/


Lint all source files, not just the test ones.

Closes #5097.
I apologize in advance for the mess this will cause to pull requests, I am keen to wait for big PRs to be merged before this.
Most (but not all) changes are re-indentation so git merge -Xignore-space-change should make this a lot more manageable than it looks.

This is also discussed on the mailing list: https://groups.google.com/g/openrefine-dev/c/fw_iFbSNz9o

I have just rebased this PR on master and the option to ignore whitespace changes made the process fairly straightforward: I did have some merge conflicts to solve, but they were non-trivial. Therefore I think it should be manageable for other PRs to also adapt after this one is merged.


Fix for change event first parameter and deeply nested events

Might have a double event firing. will update branch shortly


chore(main): release 3.7.2

:robot: I have created a release beep boop
3.7.2 (2024-09-18)
Bug Fixes

Disable winbar for lualine (c3f3fd2)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v3.7.2
:sunflower:


Possibility to use arrays in fields

Hi,
I want to post 2 addresses in one request.
(like billingaddress and deliveryaddress)
It seems Apigility cannot work with a fieldname like "billingAddress[salutation]". In the config this is just a string and not an array. Is it in any way possible to use input parameters as arrays?
Greetings Jan

I made a quick patch which works with the multiform and can handle flat arrays. Deep arrays foo[bar[baz]] are not supported only foo[] will work with this patch.
Index: vendor/zfcampus/zf-content-negotiation/src/MultipartContentParser.php
IDEA additional info:
Subsystem: com.intellij.openapi.diff.impl.patch.CharsetEP
<+>windows-1252
===================================================================
--- vendor/zfcampus/zf-content-negotiation/src/MultipartContentParser.php	(revision d779bbfde1cc5802c0d6a5f2ac9cc34bf5b71475)
+++ vendor/zfcampus/zf-content-negotiation/src/MultipartContentParser.php	(revision )
@@ -111,7 +111,7 @@
                     // Time to handle the data we've already parsed!
                     // Data
                     if (! $filename) {
-                        $data->set($name, rtrim($content, "\r\n"));
+                        $this->processContent($data, $name, $content);
                     }

                     // File (successful upload so far)
@@ -264,6 +264,31 @@
         }

         return $data->toArray();
+    }
+
+    /**
+     * Process the non-file data.
+     * @param Parameters $parameters
+     * @param $name
+     * @param $content
+     */
+    protected function processContent(Parameters $parameters, $name, $content) {
+        $name = rtrim($name, '[]');
+        $content = rtrim($content, "\r\n");
+
+        if ($parameters->offsetExists($name)) {
+            $data = $parameters->get($name);
+
+            if (is_array($data)) {
+                $data[] = $content;
+            } else {
+                $data = [$data, $content];
+            }
+
+            $parameters->set($name, $data);
+        } else {
+            $parameters->set($name, $content);
+        }
     }

     /**

It will behave somewhat like the $_POST. Thats why we remove the [] from the name

I am not exactly sure where you do not manage to configure your nested field. But Apigility is definitely able to handle such cases. Check an example here on stackoverflow

When i was implementing your SO solution i had the feeling that it's for a fixed list? What if i would want to accept a normal array.
So my post could contain:
foo-bar[] = 1
foo-bar[] = 2
foo-bar[] = 3

@Wilt i found some other posts of you regarding this aswell as the post about the raw $data param we have in the methods. I am using this raw $data param, and that doesnt seem to work with arrays.

I am not sure what you want to achieve. From the address example at the beginning I assumed you want to post a collection of addresses. But with your last foo-bar example it seems you simply want to post some array values. Do you want to post an array variable or a collection?
Can you be more explicit about your data type?

Array values as defined in foobar example. And get them from the raw data param which we have in the controllers

Maybe the problem lies in your structure. If I post data like this it works totally fine:
{
    "foo-bar": [1, 2, 3]
}

No, i use multiform

Created a pull request for this, maybe that makes it more obviouse; https://github.com/zfcampus/zf-content-negotiation/pull/55

This repository has been closed and moved to laminas-api-tools/api-tools; a new issue has been opened at https://github.com/laminas-api-tools/api-tools/issues/63.


Pulldown menu button for app selection too small

If the app name is short or empty, the user can only click on the triangular icon, which is too small if you try to do this e.g. on a tablet.

Fixed in c50ef543089c48339e6a4c1a6c9ab8b7ee4676c3


Add SANDBOX_WORKSPACE_DIR into config

You probably need to modify the comment in
https://github.com/OpenDevin/OpenDevin/blob/d692a72bf3809df35d802041211fcd81d56b1dc6/agenthub/monologue_agent/agent.py#L128
and
the prompt in
https://github.com/OpenDevin/OpenDevin/blob/d692a72bf3809df35d802041211fcd81d56b1dc6/agenthub/monologue_agent/utils/prompts.py#L61

@li-boxuan Thanks a lot for the reminder! Just modified those!

Thanks!


Change slave->worker

Signed-off-by: Sameer Raheja<EMAIL_ADDRESS>Removing the term "slave" in documentation.
Tested with docker run --rm -it  --volume="$PWD:/srv/jekyll" -p 4000:4000 sameerz/jekyll:0.1 jekyll serve and locally building without tests.

Related to issue #363

build


Sign assemblies with strong-name

Huge fan of your project! I use it extensively at work, but we need to sign our code, and unfortunately that means all of our dependencies also need to be signed.
Everything compiles fine and unit tests pass. Let me know if I missed anything.
Thanks again for the great library!

Thanks for looking into this.
Regards,
Adrian
On Fri, Mar 15, 2019 at 4:34 PM Joe<EMAIL_ADDRESS>wrote:

Huge fan of your project! I use it extensively at work, but we need to
sign our code, and unfortunately that means all of our dependencies also
need to be signed.
Everything compiles fine and unit tests pass. Let me know if I missed
anything.
Thanks again for the great library!
You can view, comment on, or merge this pull request online at:
https://github.com/adrianaisemberg/CLAP/pull/50
Commit Summary

sign assemblies with strong-name

File Changes

M CLAP/CLAP.csproj
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-0 (7)
A CLAP/CLAP.snk
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-1 (0)
A ConsoleTest/CLAP.snk
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-2 (0)
M ConsoleTest/ConsoleTest.csproj
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-3 (13)
A Tests/CLAP.snk
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-4 (0)
M Tests/Tests.csproj
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-5 (7)
A WinFormTest/CLAP.snk
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-6 (0)
M WinFormTest/WinFormTest.csproj
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-7 (7)
A packages/Newtonsoft.Json.4.0.8/.signature.p7s
https://github.com/adrianaisemberg/CLAP/pull/50/files#diff-8 (0)

Patch Links:

https://github.com/adrianaisemberg/CLAP/pull/50.patch
https://github.com/adrianaisemberg/CLAP/pull/50.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/adrianaisemberg/CLAP/pull/50, or mute the thread
https://github.com/notifications/unsubscribe-auth/AA0VhjzjY30B8GkFKogaTtD5DTbDNYj8ks5vXC4IgaJpZM4b3dkv
.


deployment name

Hi all,
I am using the template service in the portal to provide my clients a GUI based experience of the templates we have. Unfortunately I cannot figure out how to (dynamically) change the deployment name of a deployment from the template service in Azure portal.
Each time I start a deployment through the portal, the deployment calls "['my_UPN'.'template_name']". So each time I start a deployment from the template to the same resource group more than one time, the last deployment log will be overwritten by the new deployment, because it always has the same name. I know there are ways through AzCLI, PowerShell and so on to pass an own deployment name, but I cannot find a way to do this when I use the template service in the portal. Is there a way to change the deployment name?
Thank you very much! Best regards, Daniel

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bec5cd7c-2241-dc13-0f95-be2bbf300d6c
Version Independent ID: c42e2294-e257-9993-dc9c-5da0453513d9
Content: Create and deploy an Azure Resource Manager template by using the Azure portal
Content Source: articles/azure-resource-manager/resource-manager-quickstart-create-templates-use-the-portal.md
Service: azure-resource-manager
GitHub Login: @mumian
Microsoft Alias: jgao

@nnamedieh Thanks for the Comment. We are actively investigating and will get back to you soon.

Hi @femsulu ,
do you have any updates? Besides this problem, I just faced another one that also affects the deployment name of the template service from the Azure portal. The problem I faced is that I am the "publisher" of the template and have shared it with my colleagues. Every time one of my colleagues deploys a VM from one of my templates, the deployment name contains my UPN, probably because I'm the publisher. This is very confusing in case I did not initiate the deployment. It would be very helpful if the deployment name contains the UPN of the actual initiator of the deployment.
Thank you very much for your help!

Hi @nnamedieh,
Sorry for the late response.  The template library doesn't support updating deployment names.  The template library hasn't been updated for a while.  If you are looking for a way to store your templates, you might consider using Azure Storage account, GitHub, Azure Repo ....  There are some examples in the Resource Manager tutorials.  Template Library is used in this tutorial because it simplifies the procedure.  The main purpose of this tutorial is to show users how to generate a template and deploy the template. I will remove the template library part from this tutorial in a week or two. I hope it helps.
#please-close.


eval.py error please

File "eval.py", line 292, in
difficult = np.array([x['difficult'] for x in R]).astype(np.bool)
KeyError: 'difficult'
thx

Does your Annotations contain difficult element?


Tox flake8

Description: Adds flake8 check to tox config and enables it on TravisCI
JIRA: https://appsembler.atlassian.net/browse/OT-276

Thanks Anders! Doesn't it conflict ywith pylint? I'm planning to add this soon. What do you think?

@OmarIthawi it shouldn't conflict with anything. Personally, I feel like flake8 strikes a better balance of utility and minimal configuration than pylint, but that's my own opinion.

Thanks @thraxil! Makes sense. I'll go with flake8 for now in favor of pylint.
I just don't like having to type comments like this:
# noqa pylint: disable=broad-except

So I'll opt out of pylint unless it's needed.


Avoid deserializing spawned activities

Tickets addressed: N/A
Review: By commit
Merge strategy: Merge (no squash)

Description
This PR replaces the spawn(String, Map<String, SerializedValue>) interface for spawning tasks with a better-typed method, spawn(DirectiveTypeId<Input, Output>, Input, Task<Output>), that shifts the responsibility for when to serialize and deserialize directives from the model to the engine. In particular, spawned activities were previously forced by this interface to be serialized on one side and then deserialized on the other; now, though a serialization is still necessary for output production, no deserialization is necessary.
The key insight is that, where the model currently refers to directive types by String names, it ought to refer to them by better-typed handles like the existing Query<Event, State> for referencing managed cells. We introduce a new such handle, DirectiveTypeId<Input, Output>, so that we can provide an Input rather than a Map<String, SerializedValue>. Moreover, we separate the roles of "information about a task" from "information specifying a task", for which the serialized information played double duty: the Input is solely "information about a task", reported to planners, and we provide a Task<Output> that solely specifies the task to be executed.
In order for the model to receive these IDs, we replace the one-shot getTaskTypes(), which provides a load of directive types to the driver all at once, with an interaction-based buildRegistry(DirectiveTypeRegistrar<Model>) method, which allows the model to register directive types one by one, and store the received IDs locally for future use. The task types are communicated to the driver through the provided registrar, while the return value is an opaque value (capturing the saved IDs) to be passed to instantiate() when a model is actually constructed.
@adrienmaillard, commit da4e921cc removes some driver benchmarking code that relied on the old spawn(String, Map) method. If you still need this code, I'm happy to work with you to find an alternative solution for your needs. I removed it on the assumption that its point has been well-made -- an incremental driver has quadratic wins over one that must reset on every plan change.
Verification
The compiler itself should validate the majority of changes, since most changes are structural, rather than logical. I ran SimulateMapSchedule (foomissionmodel) and Main (banananation) and saw no obvious issues; these ought to catch any potential silliness with the construction of Directives in SimulationEngine.
Documentation

The generated ActivityTypes class has changed significantly; any users depending on its contents will need to go through some extra steps. Specifically, DirectiveTypeRegistry.extract(ActivityTypes::register).taskSpecTypes will provide the Map that was once a field of ActivityTypes.
The MissionModelFactory interface has changed as described above.

Future work

Move the remaining serialization off the critical path (the core simulation loop) and into results production. Ideally, this will  remove a source of workload heterogeneity that might put pressure on the JVM. Mission models may already be somewhat heterogeneous, but serialization uses an almost completely disjoint set of classes; taking serialization off the critical path may, for instance, allow more of the code cache to be dedicated to JITed model logic.
Unify the new spawn method with the remaining spawn(Task<Return>) method. Every task produces a span with Input start attributes and Return end attributes; the types of these attributes, taken together, define a signature for that task's resulting span. Lambdas are currently tasks with no (VoidEnum) start attributes and no end attributes. And, there is no reason a lambda could not have associated start and end attributes in the future.

Some care must be taken so that lambdas' spans can still be suppressed in the output, as they are now. For instance, signatures might carry a "hidden" flag that may be set to suppress spans with that signature by default.

Remove the MissionModel parameter from SimulationEngine#performJobs, and hence also from all of the internal methods it passes it to. This MissionModel is ultimately threaded through to the EngineScheduler (which the active task communicates with to inform the engine of its doings), which only uses it to construct a Directive that gets stored to the taskDirective component table. We should be able to store the DirectiveTypeId and Input instead, and let the client of the taskDirective table -- the results processing logic -- look up the needed information from the MissionModel it still receives.

This is an important step to separating the results processing logic from the simulation engine, as it will make the engine proper completely independent of the MissionModel at hand, only concerned with the behaviors of the tasks it's been asked to orchestrate.

Generalize the DirectiveTypeRegistry to also accept resource definitions. Currently, the set of resources exported by a model might vary with the model configuration provided; but this is over-expressive, and both prevents us from caching schematic information from resources and prevents planners from relying on the presence of resources across configuration changes. To my understanding, existing end-users don't use this functionality and didn't ask for it; it was just an accident of implementation. The buildRegistry method exists at the exact right time in the MissionModelFactory's lifecycle to receive registered resources before the configuration has been provided.

Granted, it may be better to add a new method and a new registry, but the point stands -- the approach in this PR paves the way.

This PR introduces another stack-Scoped contextual variable, this time to make the stored DirectiveTypeIds available to the spawn methods for each activity type. I consider it a strong smell to have two context globals around, and I'd like to find some way to unify them. As a side-benefit, we should no longer need to thread an Executor through the ThreadedTask, ReplayingTask, and their respective ReactionContexts.

This might be necessary, anyway, to unify lambda spawning with directive spawning.

This PR will conflict in interesting ways with #66. They're independent PRs, but they touch similar regions of code, so care must be taken when rebasing one once the other lands.

FYI, I'm chasing an issue regarding spawning activities from top-level test methods right now.

I've fixed the issue; this branch should be ready for review again.
The last commit isn't well-integrated into the others (in particular, there are test failures before it), so I'll re-integrate it later on, but I figured I should leave it as it is so folks have the opportunity to judge my solution.

@mattdailis, I think I've addressed all of your comments? 😃

This PR will conflict in interesting ways with #66. They're independent PRs, but they touch similar regions of code, so care must be taken when rebasing one once the other lands.

With #66 merged, I've rebased this branch and taken care of the conflicts noted above.

Bump! Anything I can do to help move things along? 😄

I've rebased and pushed the branch, checked that all commits build, and -- for good measure -- double-checked that the output of SimulateMapSchedule is consistent with develop.

I have an update for Aerie Lander ready to accommodate this PR.

Would you prefer to coordinate merging these updates, or should I go ahead and merge this now?

Rebased on top of latest develop; congrats on releasing 0.11 😄


Axon 2.4.x

Allard,
These are team submissions for changes/fixes for problems we have encountered during performance testing our Axon services. The named queries provides a minor uplift the second is a cleanup approach for Units of work.

Thanks (again) for the contribution!


Feature request: FileIO.jl integration

FileIO.jl provides common IO interface for most of the packages in Julia ecosystem.
Integration with FileIO.jl makes common interface to read(load) and write(save) for both Images and Videos.
It solves half part of #30.
Below are list of formats to add
Image Formats

[ ] PNG
[ ] JPEG
[ ] BMP
[ ] TIFF
[ ] JP2
[ ] WEBP

Video Formats

[ ] To-Do

Reference for Image formats https://docs.opencv.org/4.x/d4/da8/group__imgcodecs.html#ga288b8b3da0892bd651fce07b3bbd3a56

I have created JuliaIO/FileIO.jl/pull/381, it covers most common image formats.

I have created JuliaIO/FileIO.jl/pull/381, it covers most common image formats.


x/mobile/bind: Reflection to get ApplicationContext is disallowed on Android P (API Level 28) and causes a crash on Android Q

Problem
For loading gobind-libraries on Android, currently the non-SDK method android.app.AppGlobals.getInitialApplication is used via reflection in LoadJNI.java to provide the ApplicationContext to the native-library.
Application appl = (Application)Class.forName("android.app.AppGlobals").getMethod("getInitialApplication").invoke(null);
androidCtx = appl.getApplicationContext();

Usage of non-SDK methods is not allowed in Android P and up (API level 28 and higher), for more information see: developer.android.com: Restrictions on non-SDK interfaces
From Android Q on this prevents an gobind-library from loading and causes an exception:
 D/StrictMode: StrictMode policy violation: android.os.strictmode.NonSdkApiUsedViolation: Landroid/app/AppGlobals;->getInitialApplication()Landroid/app/Application;
        at android.os.StrictMode.lambda$static$1(StrictMode.java:406)
        at android.os.-$$Lambda$StrictMode$lu9ekkHJ2HMz0jd3F8K8MnhenxQ.accept(Unknown Source:2)
        at java.lang.Class.getDeclaredMethodInternal(Native Method)
        at java.lang.Class.getPublicMethodRecursive(Class.java:2079)
        at java.lang.Class.getMethod(Class.java:2066)
        at java.lang.Class.getMethod(Class.java:1693)
        at go.LoadJNI.<clinit>(LoadJNI.java:28)
        at java.lang.Class.classForName(Native Method)
        at java.lang.Class.forName(Class.java:454)
        at java.lang.Class.forName(Class.java:379)
        at go.Seq.<clinit>(Seq.java:38)
        at go.Seq.touch(Seq.java:55)

Solution
I think we should consider asking the ApplicationContext to be provided by the application when loading the gobind-library instead of acquiring it via reflection.
An proposal to defer context-binding was discussed in #12725. Another option would be to defer loading of the library itself.

I introduced a fix: https://github.com/golang/mobile/pull/30

With the Play Store now giving warnings, can we look at this or another solution getting merged?

This was resolved via CL 175103, closing.
(The reason it wasn't closed automatically is because the "Fixes #31364" line in the commit message was missing the "golang/go" prefix required on subrepos. See details here).

It looks like the fix makes app.RunOnVM unavailable for gomobile-bind. I realized that originally RunOnVM should not be used for gomobile-bind, so that's fine, I was surprised though.

app.RunOnVm should still work, but you have to call the (new) static method Seq.init(Context context) to pass the required Context to Go before using app.RunOnVm

I think you meant Seq.setContext? Yes, that fixed the issue. I missed that in the CL. Thank you!
BTW, I started to wonder if reverse binding would be better than RunOnJVM. RunOnJVM cannot be called in init functions while the reverse binding should be available anywhere. I'll check this later.

Yes, sorry quick reply from my phone. I edited my original post.


[t] add DEBUG=1 to enable logging to stdout

It is nice to not have to remember the full env variable. Just setting DEBUG=1 will run in debug mode with more information.

The PR and commit titles say this logs to stdout, but the code says it logs to stderr.

Well spotted, will change.


Transducer GPU support

Transducer training on GPU raises an error because it encounters a mixed CPU/GPU operation. Sample trace:
Epoch 0:   0%|                                                   | 0/294 [00:00<?, ?it/s]Traceback (most recent call last):
  File "/home/kbg/.miniconda3/bin/yoyodyne-train", line 8, in <module>
    sys.exit(main())
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/yoyodyne/train.py", line 448, in main
    trainer.fit(model, train_loader, eval_loader)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 770, in fit
    self._call_and_handle_interrupt(
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 723, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 811, in _fit_impl
    results = self._run(model, ckpt_path=self.ckpt_path)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1236, in _run
    results = self._run_stage()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1323, in _run_stage
    return self._run_train()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1353, in _run_train
    self.fit_loop.run()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/base.py", line 204, in run
    self.advance(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/fit_loop.py", line 269, in advance
    self._outputs = self.epoch_loop.run(self._data_fetcher)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/base.py", line 204, in run
    self.advance(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 208, in advance
    batch_output = self.batch_loop.run(batch, batch_idx)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/base.py", line 204, in run
    self.advance(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 88, in advance
    outputs = self.optimizer_loop.run(split_batch, optimizers, batch_idx)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/base.py", line 204, in run
    self.advance(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 203, in advance
    result = self._run_optimization(
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 256, in _run_optimization
    self._optimizer_step(optimizer, opt_idx, batch_idx, closure)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 369, in _optimizer_step
    self.trainer._call_lightning_module_hook(
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1595, in _call_lightning_module_hook
    output = fn(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/core/lightning.py", line 1646, in optimizer_step
    optimizer.step(closure=optimizer_closure)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/core/optimizer.py", line 168, in step
    step_output = self._strategy.optimizer_step(self._optimizer, self._optimizer_idx, closure, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 193, in optimizer_step
    return self.precision_plugin.optimizer_step(model, optimizer, opt_idx, closure, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 155, in optimizer_step
    return optimizer.step(closure=closure, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/torch/optim/optimizer.py", line 113, in wrapper
    return func(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/torch/optim/adadelta.py", line 87, in step
    loss = closure()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 140, in _wrap_closure
    closure_result = closure()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 148, in __call__
    self._result = self.closure(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 134, in closure
    step_output = self._step_fn()
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 427, in _training_step
    training_step_output = self.trainer._call_strategy_hook("training_step", *step_kwargs.values())
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1765, in _call_strategy_hook
    output = fn(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 333, in training_step
    return self.model.training_step(*args, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/yoyodyne/models/base.py", line 115, in training_step
    preds = self(batch)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/yoyodyne/models/transducer.py", line 86, in forward
    prediction, loss = self.decode(
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/yoyodyne/models/transducer.py", line 174, in decode
    last_action = self.decode_action_step(
  File "/home/kbg/.miniconda3/lib/python3.9/site-packages/yoyodyne/models/transducer.py", line 260, in decode_action_step
    end_of_input = (input_length - alignment) <= 1  # 1 -> Last char.
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!
Epoch 0:   0%|          | 0/294 [00:00<?, ?it/s]

This is a blocker for a post-beta release candidate.

Note: the issue is one of the initialized values in the decode_step function. Debugging didn't catch difference in flags. Issue can be solved relatively quickly provided gpu. (Still my issue just putting it down for general note-keeping.)

I'm taking over this because it's related to another thing I'm working on, and I think I've got a handle on this. Nothing personal ;)

I'm taking over this because it's related to another thing I'm working on, and I think I've got a handle on this. Nothing personal ;)

Sgtm (I'm two weeks/stipend check out from getting to a GPU anyhow)


feat: add output for system assigned identity principal id

ref: https://github.com/equinor/terraform-azurerm-storage/pull/115#issuecomment-1488303861


Issue/1291 irt archive stdout mypy (#4788)

Pull request opened by the merge tool on behalf of #4788

Merged into branches iso4 in ffd2c5688ab10f597d695f7600f6f91f0df80872


Updated _base.scss with minute UI improvement

Following changes have been made to the _base.scss file:

Added border-radius for the project images.
Added scroll-behavior : smooth to the body.
Added slim scroll for better view on Windows.

Have made minor modifications to the UI.


Test failure and recovery cases for block with withheld data

We should do network tests for cases like if a block producer withholds some of the block:
(1) will full nodes reconstruct it in case the block is recoverable, and how long will it take?
(2) after the block is reconstructed - what happens to light clients that have hanging DAS queries?
(3) if the erasure code is valid, will a bad coding fraud proof be generated and how long?

(1) will full nodes reconstruct it in case the block is recoverable, and how long will it take?

I think it is worth to consider worst-case scenarios here were essentially there are only (and theoretically sufficiently many) light nodes that all sampled successfully and a full node that is trying to recover the full block an is only connected to a subset of these light nodes (but not other full nodes that already have and serve the data).

Yes, that's a good idea. Formulas for computing the minimum light nodes required are in the fraud proofs paper, and I also have code for it.


Glossary definitions required for: mass traces, features, feature maps and consensus maps

Definitions are required for the terms listed in the issue title.

Some ideas for the definitions, adopted from your previous suggestions:
Mass Trace:
A mass trace contains peaks similar in mass-to-charge moving along retention time.
Feature:
A LC-MS feature represents the combined isotopic mass traces of a detected chemical compound.
The chromatographic peak shape of a feature is defined by the interaction of the analyte with the LC column.
Each feature contains information on retention time, mass-to-charge ratio, intensity and overall quality.
FeatureMap:
A feature map is a container for features. One feature map can contain many features.
ConsensusMap:
Contains information on features from different samples. Features with similar retention time and mass-to-charge values get linked and are considered a ConsensusFeature.
The ConsensusFeature contains information on the common retention-time and mass-to-charge values as well as the intensities from each sample.

Perhaps the figure in this tutorial could be helpful as context:
https://pyopenms.readthedocs.io/en/latest/metabolomics_preprocessing.html