send_columns has false-positive when promoting batch to column for list-types

Out check for whether a batch is a column is currently just whether it is a list array:
https://github.com/rerun-io/rerun/blob/5a2d5dd8089038a33894a32dc6d801d8d509d0e6/rerun_py/src/arrow.rs#L167-L169
However, for types that are already list arrays, such as ImageBuffer, this leads us to pass through the batch without wrapping it suitably, leading to downstream errors.
This came up in the context of a proof-of-concept for logging image batches:
import numpy as np
import pyarrow as pa
import rerun as rr

rr.init("rerun_example_send_columns", spawn=True)

COUNT = 64
WIDTH = 100
HEIGHT = 50
CHANNELS = 3

# Create our time
times = np.arange(0, COUNT)

# Create a batch of images
rng = np.random.default_rng(12345)
image_batch = rng.uniform(0, 255, size=[COUNT, HEIGHT, WIDTH, CHANNELS]).astype(dtype=np.uint8)

# Log the ImageFormat once, as static
format_static = rr.components.ImageFormat(width=WIDTH, height=HEIGHT, color_model="RGB", channel_datatype="U8")
rr.log("image", [format_static], static=True)

# Manually create an ImageBuffersBatch
image_buffers = (row.tobytes() for row in image_batch.reshape(COUNT, -1))
raw_arrow = pa.array(image_buffers, type=rr.components.ImageBufferType())
buffers_batch = rr.components.ImageBufferBatch(raw_arrow)

# Uncomment this to work around the problem
# buffers_column = buffers_column.partition([1] * COUNT)

rr.send_columns(
    "image",
    times=[rr.TimeSequenceColumn("step", times)],
    components=[rr.Image.indicator(), buffers_column],
)

Which ends up with the fairly cryptic error:
/home/jleibs/rerun/docs/snippets/all/tutorials/send_columns.py:37: RerunWarning: send_columns: RuntimeError(Detected malformed Chunk: The outer array in chunked component batch must be a sparse list, got List(Field { name: "item", data_type: UInt8, is_nullable: false, metadata: {} }))
  rr.send_columns(

Even though it's a bit less performant, this could be a good argument for moving column-promotion from python, where we still have the full object context.

noticed this issue only now. Moving column promotion to Python is essentially what I did in

https://github.com/rerun-io/rerun/pull/7155


Unable to see X-RAY traces

Hi Experts,
I have configured x-ray daemon on aws EC2 as mentioned here https://docs.aws.amazon.com/xray/latest/devguide/xray-daemon-ec2.html. I could see the xray service running on the ec2 instance. Below are the x-ray logs,
**$ /usr/bin/xray
2019-02-27T05:57:33Z [Info] Initializing AWS X-Ray daemon 2.1.3
2019-02-27T05:57:33Z [Error] listen udp <IP_ADDRESS>:2000: bind: address already in use
$ cat /var/log/xray/xray.log
2019-01-30T15:21:10Z [Info] Initializing AWS X-Ray daemon 2.1.3
2019-01-30T15:21:10Z [Info] Using buffer memory limit of 160 MB
2019-01-30T15:21:10Z [Info] 2560 segment buffers allocated
2019-01-30T15:21:10Z [Info] Using region: ap-south-1**
OS INFO:
NAME="Amazon Linux AMI"
VERSION="2018.03"
ID="amzn"
ID_LIKE="rhel fedora"
VERSION_ID="2018.03"
PRETTY_NAME="Amazon Linux AMI 2018.03"
ANSI_COLOR="0;33"
CPE_NAME="cpe:/o:amazon:linux:2018.03:ga"
HOME_URL="http://aws.amazon.com/amazon-linux-ami/"
But still i don't see any traces in the x-ray console. EC2 instance has xray:* permission. Am i missing any configuration here.
Appreciate your valuable help on this!!!

Hi @sandygvs ,
From this message listen udp <IP_ADDRESS>:2000: bind: address already in use, a process (possibly old X-Ray daemon) is running on the same port. Can you configure the daemon on another port using cfg.yaml or kill the existing process, running on the same port.
Further more, are you sending any data through X-Ray SDK that is instrumented by your app? If yes, which language ?
Traces generated by X-Ray SDK are by default sent to "udp : localhost:2000". And if the X-Ray daemon is listening on the same port, the daemon batches Segments received on the port and sends to X-Ray service. You should make sure, X-Ray SDK is correctly configured with the daemon address if the the address is other than "udp -> localhost:2000"
If the daemon receives any Segment, you would see a log entry : [Info] Successfully sent batch of 1 segments.
From the logs, I would expect to see traces in ap-south-1 region, if everything is correctly configured.
Please let me know if you need more help.
Thanks,
Yogi

Thanks for the explanation, it works as expected. There was an issue with instrumenting the app with x-ray, after resolving it. Everything works well!!!

Hi @sandygvs ,
For X-Ray, is the following logs means that AWS X-Ray Daemon is running well in my EC2 server?
To test if X-Ray Daemon working fine, how should I do some simple test in my EC2 server?
Logs:
2022-06-12T08:46:40Z [Info] Initializing AWS X-Ray daemon 3.3.3
2022-06-12T08:46:40Z [Info] Using buffer memory limit of 19 MB
2022-06-12T08:46:40Z [Info] 304 segment buffers allocated
2022-06-12T08:46:40Z [Info] Using region: ap-southeast-1
2022-06-12T08:46:40Z [Info] HTTP Proxy server using X-Ray Endpoint : https://xray.ap-southeast-1.amazonaws.com
2022-06-12T08:46:40Z [Info] Starting proxy http server on <IP_ADDRESS>:2000

Screenshot:

Thanks in advance!


Breadcrumb root

How to change the root breadcrumb from" Hugo zzo Theme". I have followed  the instructions for a fresh site. Everything works okay, but the breadcrumb shown when clicking the "posts" menu item begins with "Hugo zzo Theme" how can  change this?

Same problem. And  title bar also shows "Hugo zzo Theme".

You can change it in: languages.toml, but it changes title for everything.

[es]
  title = "my title"

You can change it in themes/zzo/layouts/partials/body/breadcrumb.html

{{ if eq (len .p1.Title) 0 }}

    {{ printf "Title for breadcrumb" }}
{{ else if eq .p1 .p2 }}


path2Curve produces wrong result when converting L command

Path for testing:
M57.063 -18.541L13.225 -18.203L0 -60L-13.225 -18.203L-57.063 -18.541L-21.399 6.953L-35.267 48.541L0 22.5L35.267 48.541L21.399 6.953Z

after toCurve, I changed some CSS style:
fill: none;
stroke: red;

Thanks for the report, I believe this must be related to the latest optimizations, but will look into it asap.

Thanks for the report, I believe this must be related to the latest optimizations, but will look into it asap.

Thanks, I think the problem came from the following lines which calculate control points for cubic bezier:
https://github.com/thednp/svg-path-commander/blob/master/src/process/lineToCubic.js#L24-L29

Exactly.

@xiaoiver please test latest master, it's solved for me.

@xiaoiver can you please confirm the fix? We're ready to push the next v1.0.5 now.

@xiaoiver can you please confirm the fix? We're ready to push the next v1.0.5 now.

I found another bug about converting A command to C, this is my test path:
M7.34788079488412e-15,-120A120,120,0,0,1,95.46267154065043,-72.71092312934756L59.66416971290652,-45.44432695584223A75,75,0,0,0,4.592425496802574e-15,-75Z

It should look like this:

But after converting to curve, it became this:

I found the problem, it's the arcToCubic that's messing things up, also an issue introduced with the ES5->ES6 changes.
Will come back with a fix asap. Stay tuned.

@xiaoiver please test. Now this works for me


adds "cursor:pointer" to .btn

When hovering over a button, the cursor should display as a pointer.
This PR adds that functionality.

Yep, I'll merge this as soon as my exams are done
Sorry for not responding earlier, as you might have noticed, I got busy with school.


issue with bicep

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az bicep upgrade
Errors:
The command failed with an unexpected error. Here is the traceback:
[WinError 193] %1 is not a valid Win32 application
Traceback (most recent call last):
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 697, in _run_job
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 333, in __call__
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/custom.py", line 3654, in upgrade_bicep_cli
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 99, in ensure_bicep_installation
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 203, in _get_bicep_installed_version
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 241, in _run_command
  File "subprocess.py", line 501, in run
  File "subprocess.py", line 969, in __init__
  File "subprocess.py", line 1438, in _execute_child
OSError: [WinError 193] %1 is not a valid Win32 application

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az bicep upgrade

Expected Behavior
Environment Summary
Windows-10-10.0.22000-SP0
Python 3.10.5
Installer: MSI

azure-cli 2.40.0 *

Additional Context

Thank you for opening this issue, we will look into it.

I upgraded azi cli version
"azure-cli": "2.47.0"
and bicep cli version
Bicep CLI version 0.16.2 (de7fdd2b33)
Still am facing the issue. am unable to deploy anything. this issue occured when i tried to upgrade bicep cli
[WinError 193] %1 is not a valid Win32 application

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az deployment group create
Errors:
The command failed with an unexpected error. Here is the traceback:
[WinError 193] %1 is not a valid Win32 application
Traceback (most recent call last):
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 663, in execute
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 726, in _run_jobs_serially
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 697, in _run_job
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 333, in call
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/custom.py", line 3811, in show_bicep_cli_version
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 94, in run_bicep_command
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 273, in _get_bicep_installed_version
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/resource/_bicep.py", line 311, in _run_command
File "subprocess.py", line 503, in run
File "subprocess.py", line 971, in init
File "subprocess.py", line 1440, in _execute_child
OSError: [WinError 193] %1 is not a valid Win32 application
To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.
I tried to upgrade bicep CLI "az bicep upgrade" its stopped in the middle. later when I tried to deploy the resources I got the above error.

az deployment group create -g {} -f {}

Expected Behavior
Environment Summary
Windows-10-10.0.22000-SP0
Python 3.10.10
Installer: MSI

azure-cli 2.47.0

Additional Context

I reinstalled azure cli and bicep cli but still I have the issue.
azi cli version
"azure-cli": "2.47.0"
and bicep cli version
Bicep CLI version 0.16.2 (de7fdd2b33)
Kindly help me to resolve asap. this is urgent requirement. am unable to deploy the resources in production

@ArthiSaravana Can you please clean up the %USERPROFILE.azure\bin folder and run az bicep install to reinstall Bicep for Azure CLI.

Yes am facing with all the azure CLI command. But powershell command is working. I think azure CLI is corrupted

I tried reinstalling azure CLI but getting same error.

@ArthiSaravana Are you following the same steps as mentioned here for uninstallation.  Have tried cleaning up C:\Users\<username>\.azure\msal_token_cache.bin or C:\Users\<username>\.azure\msal_token_cache.json.


Typo

[Enter feedback here]
There is a typo here
This should be type and not value.
"chatId"<EMAIL_ADDRESS>
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6eb2244d-b82d-0559-0255-ac0cb7ce05e3
Version Independent ID: e3a7a842-7efe-40db-e3c7-da56d7b24c02
Content: Export content with the Microsoft Teams Export APIs - Microsoft Teams
Content Source: Teams/export-teams-content.md
Service: msteams
GitHub Login: @SerdarSoysal
Microsoft Alias: serdars

Same thing for "user": {
"id": "0de69e5e-2da8-4cf2-821f-5e6585b2c65b",

@salakhani Thank you for submitting feedback and contributing to the docs. We are currently investigating this.


Update StarlingMonkey to pull in PBL+weval updates in SpiderMonkey.

This PR pulls in bytecodealliance/starlingmonkey#106, which in turn pulls in bytecodealliance/spidermonkey-wasi-embedding#21, which in turn pulls in bytecodealliance/gecko-dev#57, to fix a bug in weval'd PBL execution (AOT compilation mode) for TableSwitch opcodes.

I added a CI job to test Web Platform Tests under AOT compilation (weval) and it passes now after these fixes!

Can confirm it all passes for me also, this is fab!


Type inference seems to not work for properties

Version: 2.0.0-dev.67.0
class Example<T> {
  T test;

  sample(T value) {
    if (value is List) print(value.first); // Compiles
  }

  sample2() {
    if (test is List) print(test.first); // Doesn't compile (test isn't recognized as list)
  }

  sample3(){
    T testCopy = test;
    if (testCopy is List) print(testCopy.first); // compiles
  }
}

Yes, this is WAI. It is possible the type of test has changed.
You can use a local variable:
sample2() {
  final test = this.test;
  if (test is List) {
    print(test.first);
  }
}


fix(fs): Fix DebouncedEvent type to match what notify-rs returns

Same fix as #840 this time to the v2 branch

Thanks for your contributions, could you add a change file in .changes directory?

Hi, since this was fixed on the v1 branch I typically just merge v1 into v2 to sync it, so this pr would probably just cause merge conflicts (and a duplicate commit) :)
I didn't have the time to do that yet but can do it once I'm home today or tomorrow :)

This shouldn't introduce a conflict since v1 is under fs-watch not fs directory so I think it is fine to merge.


Connection code centralization.

Description
Moving connection creation code to central place
Motivation and Context

Connection creation code moved from
core/chaincode/shim/chaincode.go, core/peer/peer.go, events/consumer/consumer.go and core/crypto/node_grpc.go to new package core/comm (connection.go file) - issue #1362
Cached configuration ("peer.tls.enabled") moved to comm/config.go instead peer/config.go, to avoid circular dependency.
Added method to read peer tls credentials InitTLSForPeer to comm/connection.go, instead reading it in each file (peer.go, chaincode.go, consumer.go)
Fixed hardcoded peer address in core/chaincode/shim/chaincode.go - issue #1304

Fixes #1362
How Has This Been Tested?
Run unit tests and behave tests
Checklist:

[x] I have added a Signed-off-by
[x] Either no new documentation is required by this change, OR I added new documentation
[x] Either no new tests are required by this change, OR I added new tests
[x] I have run goimports, go vet, and golint. I have cleaned up all valid errors and warnings in code I have added or modified. These tools may generate false positives.  The goal is clean, consistent, and readable code.

Signed-off-by: Gennady Laventman<EMAIL_ADDRESS>

In the interest of loose coupling, I would suggest not having to import fabric into shim ? I know we do some fabric imports already IMHO but we should really be finding ways to decouple more. At some point when we stop including the entire fabric with chaincode image, these will become thorny. Also there is the issue of multi-language chaincode support. Suggest we consider making shim an exception ?

@muralisrini  - not sure exactly what you mean on the "decouple" comment?   I think part of the problem is that everything related to the fabric project goes under the "fabric" root.  Looking at things that way, fabric no longer really means just the peer, but everything else as well.
BUT - to your point, there is way too much cross calling of "packages" with needless cross-dependencies.  So there needs to be a much more modular approach to packages (which by the way should all be self-testable).
But I don't think that any of that directly relates to this PR as the goal here was to create a universal comms package which I think this PR does nicely.

@muralisrini @mastersingh24 IMO this is one reason why a deploy transaction should only require the chaincode and not the shim also. The chaincode would just indicate its shim dependency and the peer would supply it if it's one of the included shims.

@mastersingh24   more the import dependencies we add to shim, less isolated it becomes... more the difficulty in converting to other languages.
And fabric package import dependencies add a twist - we have to be extra careful in changing the common code so we don't introduce changes that other languages will also have to keep up with.  Bottomline, IMO, keeping the shim self-contained is a good thing and so worth making a principle.
@srderson dependency between shim and chaincode is unavoidable - there is  a shim side chaincode is tied to... and chaincode is developed on top of. So regardless of who supplies (comes with the chaincode or peer provides it)  the dependency has to be carried from dev to deployment.  This is more about reducing those dependencies.

@muralisrini - while I kinda see what you are saying here, I don't quite understand how you want this to be handled.  The fabric/core/comm package created here is actually a standalone package - meaning it does not have any other dependencies on any other fabric packages / components.  The idea here is to provide a common module for all Go code used by / with the fabric to handle client connections rather than coding up client connections everywhere they are used.   If you import this package, you are not bringing in any other parts of the fabric.   Now if you are saying that not everything belongs under core, perhaps that's OK but up to this point (at least not that I have seen) no one has really made any rules on what goes under core.   But in any case, even if at a later date this package was moved, it would still function

@gennadylaventman  - I noticed that there is not a standalone test for the comm package.  I'd suggest creating a test file within this package so that it is testable on its own.

@mastersingh24
Will add it.

@mastersingh24 It would still function if it was go. But if the chaincode is Java and the common go package was changed, we'll have to change the java.  And you might change the core in a way that is not needed for the chaincode interaction. All I'm saying is the more we add, the more these subtle differences and book keeping we have to do.

@muralisrini
Agreed in general, but this is not a case. It doesn't really matter if shim connection code located it shim/chaincode.go or in totally standalone package - if connection code changed in go - you have to change it in java.

@gennadylaventman the hidden assumption with that statement is that all changes will be needed for all the parts.  Peer connections are qualitatively different from chaincode connections and we may find some changes to one do not apply to another.
IMO its good to adhere to the principle of keeping number of imports as small as possible on the chaincode side and use protos.ChaincodeMessage to encapsulate protocol/communication as much as possible.
But I don't want to belabor the point. We should go with majority decision which I think is to accept the PR as is :-)

@gennadylaventman LGTM and it sounds like we're ready to merge the change. Could you rebase on master as there seems to be a conflict? Thanks.

@srderson Done, I think.

Yes, LGTM. Thanks!


[ FEATURE ] Docker

FEATURE Requests
I know sarotate is not designed to run inside a Docker, but would it be possible to make this Docker based?
King Regards

In its current state it requires to be installed alongside rclone since it does not currently remote control through http so you would have to deploy it with rclone to get it to work in a container. How that fits your use case would be up to you.
Rewriting sarotate to use http requests instead isn't really in the current plans since it was mostly built for how Cloudbox/Saltbox uses rclone but I suppose it could happen at a later date. The rclone rc commands themselves can traverse docker networks just fine regardless so I see no reason why you couldn't get it working as is.
I could look at supporting a container if such a rewrite were to happen but I cannot say when or even if that will happen.

Rewrite was done and a proof of concept dockerfile exists in the repo. I do not plan on testing it any time soon though so your mileage may vary.


Fix an issue with the sort order of inactive applications

Inactive applications were appearing under the No action needed header instead of the Received – make a decision header. This was because it was ignoring the inactive choices with a reject_by_default_at date in the past.
Before:

After:

 Manage: Group inactive applications under the correct section


typo: Double word "the"

@nschonni : Thanks for your contribution! The author, @mialdrid, has been notified to review your proposed change.

Merging typo fix


Show something in the photo carousel when no internet connection

What

Currently the images just dissapear on the product page
The first box is the nutrition add card which is shown because the product has no image of that, but the fron photo is missing completely

https://user-images.githubusercontent.com/39344769/165511662-e7ca29b2-a918-40ad-8280-b4d54ffcdc69.mp4

I will take this up

@vik4114 What do you have in mind ?

@teolemon I was thinking to show a image from assets when there is no connection.

@vik4114  something with fadeInImage?

@teolemon @M123-dev How it looks? for now I have used smoothie icon
https://user-images.githubusercontent.com/46121493/166143273-a7f98f1e-77b7-459f-9944-10670fb73e42.mp4

Heyy @vik4114 looks great, of course the image has to be replaced with a clear no internet image. But looking at the images directly changing after turning off the internet without reloading I'm guessing, that you are doing some kind of connection state checking, am I right? Here it probably makes more sense not to listen to it, (photos should remain visible when they are already loaded) and, the cards for photo upload,should also remain visible, because there will probably be some kind of offline upload in the future. (Also this is also offline available data)

FadeInImage.assetNetwork(
  placeholder: 'assets/loading.gif',
  image: 'https://picsum.photos/250?image=9',
),
//or
FadeInImage(
  placeholder: MemoryImage(bytes),
  image:  NetworkImage('https://backend.example.com/image.png'),
)

I guess something like this will make more sense, @vik4114

@M123-dev I thought the same to implement, but for the online one, it was not good so I did this.

FadeInImage.assetNetwork(
  placeholder: 'assets/loading.gif',
  image: 'https://picsum.photos/250?image=9',
),
//or
FadeInImage(
  placeholder: MemoryImage(bytes),
  image:  NetworkImage('https://backend.example.com/image.png'),
)

I guess something like this will make more sense, @vik4114

Its just for moment of loading.


Add messaging API to api module

Current implementation has a circular dependency because we are too tightly coupled to vert.x.  Adding this API will break the code coupling which can lead to a further refactoring.
This is important before we add new features like GenShen and GenZGC parsing.

Messaging API has been settled upon. Parser and Analytics need to be rewired in and then the tests updated.

Duplicate of issue #4

#252


Fix windows connect/disconnect issues #528, #536, #423. #620

Fixes problems with connecting and disconnecting on Windows:

DisconnectDeviceAsync hangs and device remains connected
When a connected device loses power, DeviceDisconnected is fired instead of DeviceConnectionLost

Steps to reproduce 1 of 2:

Start App
Power On Device
Start Scanner
Select Device
Stop Scanner
Connect to device
Power off device

Error: DeviceDisconnected is fired instead of DeviceConnectionLost

Power On Device
Connect to device
10 Disconnect device

Error: Disconnect hangs and device remains connected

Steps to reproduce 2 of 2:

Start App
Power On Device
Start Scanner
Select Device
Stop Scanner
Power off device

Error: DeviceDisconnected is fired instead of DeviceConnectionLost

Connect to device

Correct: Device connection fails

Power on device
Connect to device
10 Disconnect device

Error: Disconnect hangs and device remains connected

Awesome, fixing three issues in one sweep. 😁
Does it possibly also fix #620?

The sample app still has problems but I can see why.  When a device is disconnected, DisconnectDeviceNative disposes the IDevice object but this object is cached in ViewModel.  When you try to connect again, it is using a disposed object.
If you instead use the "Connect to previous", then it works because this uses the ConnectToKnownDeviceAsync function then updates the underlying IDevice object in the ViewModel.
So..  Either you cannot cache IDevice objects (same as services/characteristics) or you can't dispose the IDevice object on disconnect.
My test app assumes the former which is why I don't see this problem with it. I would suggest updating the sample app and your readme.md to clearly state that you cannot reuse any objects after a disconnect or connection lost.

This second push fixes the #620 issue with the sample program.

This second push fixes the #620 issue with the sample program.

Fantastic! Code-wise it also looks pretty good at first glance.
I'm actually AFK for about ten days now, but I plan to merge this once I'm back. In the meantime, I hope that some of the bug reporters can confirm that the bugs are fixed. @Auto72 @JongChern @sisaacks @andrey-val-rodin @TStein1984 @nathenxbrewer
There are nupkgs built via GitHub Actions that can be used for testing (see the green checkmarks next to the commits).

I'm actually AFK for about ten days now, but I plan to merge this once I'm back. In the meantime, I hope that some of the bug reporters can confirm that the bugs are fixed. @Auto72 @JongChern @sisaacks @andrey-val-rodin @TStein1984 @nathenxbrewer

Huh, unfortunately no feedback here yet, but in any case I'm going to merge this now (as announced).

I've been beating on it enough to know that it's a step in the right direction.  I still see an issue where disconnect will hang when I set breakpoints in just the right place.  There must be a race condition somewhere but that's a different issue.  I think you can close all the PRs for this one.


Option for closing the panel when editor area is used

I like the features of the integrated terminal, but I like to see either the terminal or the files I edit and not both because then I don't have enough space either the file editor and nor the terminal.
While it is possible to open the terminal always maximized, I don't see an option how to automatically hide the terminal then you click on a file in the explorer section. Then you click on a file in the explorer section the terminal only resizes, which, how I have described above, I don't like.
My feature request is an option in the settings which hides the panel completely then something in the editor area has changed (e.g. clicking on a file).

This feature request is now a candidate for our backlog. The community has 60 days to upvote the issue. If it receives 20 upvotes we will move it to our backlog. If not, we will close it. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!

:slightly_smiling_face: This feature request received a sufficient number of community upvotes and we moved it to our backlog. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!


Get ready for smart contract auditing

Describe the feature request
Here is a list of things we need to finish:

[ ] Dani: Update Bridge related developer docs on our website.
[ ] Dani: Go over https://secure-contracts.com/ and OZ's checklist
[ ] Dave: Internal review of all comments for Bridge and Vaults (focus on real comments inside the code, not the doc comments please)
[ ] Dave & Daniel & Dani: update core protocol related developer docs
[ ] Dave: Resolve all security vulnerabilities in repo stated by github
[ ] Dave: Upgrade to latest patch version of solidity compiler
[ ] Daniel: move https://github.com/taikoxyz/taiko-mono/blob/main/packages/protocol/docs/how_taiko_proves_blocks.md to Taiko website

Describe alternatives you've considered
Description of the alternatives you've considered here.
Additional context
Additional context here.

good

wish you all the best

GOOD PROJECT LEST GO LAUNCH GUYS

alpha 6 is coming!


Parameters in translation keys

[ ] bug report => check the FAQ and search github for a similar issue or PR before submitting
[x ] support request => check the FAQ and search github for a similar issue before submitting
[ ] feature request

Right now, if you use interpolation in the translation source/key you will get a translation is applied after the interpolation, so in the next example, if the version is 2.0, ngx-translate will look for a 'Version: 2.0' key in the file.

 Version: {{ version }}

The way this is currently supported after my understanding, is that you have to remove the parameters from the translation key/source like this:

 Version:

The problem is that the translation key doesn't contain any information about the parameter names that the translator must provide, and when we extract and generate automatically the .pot template and give it to the translators, they have somehow to know the parameter names. Also it would be nice to make as little changes as possible in the angular templates when providing translations.
We thought of using some convention, for example like this:

 Version: [[version]]

In this way the translators will know that the version is a parameter, and that they have to provide something like this; {{version}} in the translated text.
I feel like this is a little hack, and it's not the best way to work out this problem. Do you think there is a better way of doing this?  I imagine it is impossible to extract the 'original' uninterpolated value from the translate directive and use it as a key, instead of the interpolated value? I think this would be the easiest solution from my point of view....

I'm also using this gettext-ish approach, where the "key" is actually a real text, like this:
Level {{level}}
I'm pretty sure it used to work with previous versions of angular and/or ngx-translate. I noticed it doesn't work only a few days ago.

@mciureanu did you find a way to make it work?
@biesbjerg it seems to me that you tried to achieve almost the same thing; did you succeed?
thanks!

@cvaliere I did. https://github.com/ngx-translate/core/issues/340#issuecomment-265156635

ok, so indeed the updated version of the snippet works (https://github.com/ngx-translate/core/issues/340#issuecomment-280601290)
though, as also said in that issue,
{{ 'Hello { name }' | translate: { name: 'Kim' } }} works, but not Hello { name }
@biesbjerg did you find a way to make this second syntax also work, or you just go with the 1st one (and it's already great, thank you for this!)

@cvaliere I don't use translateParams so I haven't looked at why it doesn't work. Seems weird that it doesn't!

angular won't allow something like Hello {name}
it generates
ERROR Error: Uncaught (in promise): Error: Template parse errors: Unexpected character "EOF" (Do you have an unescaped "{" in your template? Use "{{ '{' }}") to escape it.) ("

I have this code in my app without any issues:
<button ion-item detail-none (click)="onLogout()">
	<ion-icon name="log-out" item-left></ion-icon>
	{{ 'Log out ({ email })' | translate: { email: (user$ | async)?.email } }}
</button>

yes, this works
but
<button ion-item detail-none (click)="onLogout()">
	<ion-icon name="log-out" item-left></ion-icon>
        Log out ({email})
</button>

would generate the error above

I'm having an issue regarding that code you share @biesbjerg. When I add a translation in the .po file to that string for example:
English: Log out ({ email })
Spanish: Salir ({email})
It doesn't reach the handle function inside the MyMissingTranslationHandler class. Only the strings with no translations reach it.

thumbs up

Just to provide some more clarity:
This will work:

{{'USER.DIALOG.BLOCK_USER.HEADING' | translate: { name: data.name } }}

// where 'USER.DIALOG.BLOCK_USER.HEADING` = "Block user {{ name }}"

Just to provide some more clarity:
This will work:

{{'USER.DIALOG.BLOCK_USER.HEADING' | translate: { name: data.name } }}

// where 'USER.DIALOG.BLOCK_USER.HEADING` = "Block user {{ name }}"


[test] Improve using junit5 test logger extension in flink test module

(Please specify the module before the PR name: [core] ... or [flink] ...)
Purpose
(What is the purpose of the change, or the associated issue)
Tests
(List UT and IT cases to verify this change)
API and Format
(Does this change affect API or storage format)
Documentation
(Does this change introduce a new feature)

What's the benefit? I don't get it.

TestLogger is a junit-4-style test logger.
TestLoggerExtension is a junit-5-style test logger.
This pr is to change TestLogger to use TestLoggerExtension.

What's the benefit? I don't get it.

TestLogger is a junit-4-style test logger.
TestLoggerExtension is a junit-5-style test logger.
This pr is to change TestLogger to use TestLoggerExtension.

Thanks for the explanation. Sounds good to me.


Enhanced Scrolling demos

This PR adds all of the demos from demo.cs that had to do with ScrollView to Scrolling in UI Catalog.
Along the way it proves that there is a bug in Mainloop or the drivers w.r.t. the mouse being held down to scroll a ScrollView - If there is not a ProgressBar using an AddTimeout timer the behavior does not work.

I'm not going accept this and will incorporate it into the bigger clipping PR after miguel comments. Just posting here so @BDisp can see.

It's great. Is the Demo supposed to have the subview uncovered? It's good for debugging. In the same way that vertically the frame can be negative I also think that horizontally it could be negative. I noticed that on the horizontal scroll the content on the right is not displayed because it cannot be moved further to the left.

Make sure you merge in the clip PR.

Will include in bigger clip PR


Feature/show2 1041 pull refresh controller

Why

try to add the bounce effect on iOS.
currently, refresh control is not good, we need to use our design-system style.

How

use Spinner to refresh control.

Test Plan
check if the Tab looks good.

@axeldelafosse yeah, I'll remove it.


Pagination for search works only on the first page

pagination not working on search feature --> $_post value is probably returning null when clicking the pagination links

Issue resolved but the pagination is still generating too many links with empty contents

Recom:
configure 'total_rows' in pagination config variable to count first the total rows in the select query statement with the corresponding condition

Issue fixed


Make headers on Dashboard clickable

Minor suggestion: make these headers hot and go to the relevant pages:

This improvement is now available in the development branch.


Stuck on "Waiting for the essential requirement 1 of 5: "ssh"; Permission denied (publickey)

Description
I'm trying to start lima with default settings using limactl start and with default settings but I'm stuck on this error.
INFO[0003] SSH Local Port: 60022
INFO[0003] [hostagent] Waiting for the essential requirement 1 of 5: "ssh"
DEBU[0003] [hostagent] executing script "ssh"
DEBU[0003] [hostagent] executing ssh for script "ssh": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile="/Users/shadow/.lima/_config/user" -o IdentityFile="/Users/shadow/.ssh/id_rsa" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers="^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath="/Users/shadow/.lima/default/ssh.sock" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]
DEBU[0010] [hostagent] stdout="", stderr="kex_exchange_identification: read: Connection reset by peer\r\nConnection reset by <IP_ADDRESS> port 60022\r\n", err=failed to execute script "ssh": stdout="", stderr="kex_exchange_identification: read: Connection reset by peer\r\nConnection reset by <IP_ADDRESS> port 60022\r\n": exit status 255
INFO[0020] [hostagent] Waiting for the essential requirement 1 of 5: "ssh"
DEBU[0020] [hostagent] executing script "ssh"
DEBU[0020] [hostagent] executing ssh for script "ssh": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile="/Users/shadow/.lima/_config/user" -o IdentityFile="/Users/shadow/.ssh/id_rsa" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers="^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath="/Users/shadow/.lima/default/ssh.sock" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]
DEBU[0020] [hostagent] stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n", err=failed to execute script "ssh": stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n": exit status 255
INFO[0030] [hostagent] Waiting for the essential requirement 1 of 5: "ssh"
DEBU[0030] [hostagent] executing script "ssh"
DEBU[0030] [hostagent] executing ssh for script "ssh": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile="/Users/shadow/.lima/_config/user" -o IdentityFile="/Users/shadow/.ssh/id_rsa" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers="^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath="/Users/shadow/.lima/default/ssh.sock" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]
DEBU[0030] [hostagent] stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n", err=failed to execute script "ssh": stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n": exit status 255
INFO[0040] [hostagent] Waiting for the essential requirement 1 of 5: "ssh"
DEBU[0040] [hostagent] executing script "ssh"
DEBU[0040] [hostagent] executing ssh for script "ssh": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile="/Users/shadow/.lima/_config/user" -o IdentityFile="/Users/shadow/.ssh/id_rsa" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers="^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath="/Users/shadow/.lima/default/ssh.sock" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]
DEBU[0040] [hostagent] stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n", err=failed to execute script "ssh": stdout=""<EMAIL_ADDRESS>Permission denied (publickey).\r\n": exit status 255

limactl version 0.11.2
colima version 0.4.4
QEMU emulator version 7.0.0
System: MacOS v12.4 M1
I have already gone through other related issues (#525, #17, #745, #767, #745, #713, #503, #543) but still no luck. I even tried it with some other versions of ubuntu but all show the same error. But ya fedora works fine.

The logs might have more info

It happens only with default settings. When I try it for fedora or something else, it works fine. Btw I'm on Mac M1

Any update on this??

There might be more details in the sshd log, why it is rejecting the key. You can also run ssh with some more -v options.

This is the error which I keep getting. Initially I thought it might be coz the ssh key has a passphrase but even after I removed it the issue persists.
{"level":"debug","msg":"Creating iso file /Users/shadow/.lima/default/cidata.iso","time":"2022-08-04T14:18:19+05:30"}
{"level":"debug","msg":"Using /var/folders/8c/0cmpb48d4klb3v93jbcsn00h0000gp/T/diskfs_iso840991425 as workspace","time":"2022-08-04T14:18:19+05:30"}
{"level":"debug","msg":"firmware candidates = [/Users/shadow/.local/share/qemu/edk2-aarch64-code.fd /opt/homebrew/share/qemu/edk2-aarch64-code.fd /usr/share/AAVMF/AAVMF_CODE.fd /usr/share/qemu-efi-aarch64/QEMU_EFI.fd]","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"OpenSSH version 8.6.1 detected","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing<EMAIL_ADDRESS>and aes256-gcm@openssh.com","time":"2022-08-04T14:18:20+05:30"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/Users/shadow/.lima/default/serial.log\")","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"Start udp server listening on: <IP_ADDRESS>:53381","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"qCmd.Args: [/opt/homebrew/bin/qemu-system-aarch64 -m 4096 -cpu host -machine virt,accel=hvf -smp 4,sockets=1,cores=4,threads=1 -drive if=pflash,format=raw,readonly=on,file=/opt/homebrew/share/qemu/edk2-aarch64-code.fd -boot order=c,splash-time=0,menu=on -drive file=/Users/shadow/.lima/default/diffdisk,if=virtio -cdrom /Users/shadow/.lima/default/cidata.iso -netdev user,id=net0,net=<IP_ADDRESS>/24,dhcpstart=<IP_ADDRESS>,hostfwd=tcp:<IP_ADDRESS>:60022-:22 -device virtio-net-pci,netdev=net0,mac=xx:xx:xx:xx:xx:xx -device virtio-rng-pci -display none -vga none -device ramfb -device qemu-xhci,id=usb-bus -device usb-kbd,bus=usb-bus.0 -device usb-mouse,bus=usb-bus.0 -parallel none -chardev socket,id=char-serial,path=/Users/shadow/.lima/default/serial.sock,server=on,wait=off,logfile=/Users/shadow/.lima/default/serial.log -serial chardev:char-serial -chardev socket,id=char-qmp,path=/Users/shadow/.lima/default/qmp.sock,server=on,wait=off -qmp chardev:char-qmp -name lima-default -pidfile /Users/shadow/.lima/default/qemu.pid]","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"Start tcp server listening on: <IP_ADDRESS>:51370","time":"2022-08-04T14:18:20+05:30"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/shadow/.lima/_config/user\" -o IdentityFile=\"/Users/shadow/.ssh/id_rsa\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath=\"/Users/shadow/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2022-08-04T14:18:20+05:30"}
{"level":"debug","msg":"stdout=\"\", stderr=\"kex_exchange_identification: read: Connection reset by peer\\r\\nConnection reset by <IP_ADDRESS> port 60022\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\", stderr=\"kex_exchange_identification: read: Connection reset by peer\\r\\nConnection reset by <IP_ADDRESS> port 60022\\r\\n\": exit status 255","time":"2022-08-04T14:18:28+05:30"}
{"level":"debug","msg":"handleQuery received DNS query: ;; opcode: QUERY, status: NOERROR, id: 6196\n;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1\n\n;; OPT PSEUDOSECTION:\n; EDNS: version 0; flags: ; udp: 1472\n\n;; QUESTION SECTION:\n;api.snapcraft.io.\tIN\t AAAA\n","time":"2022-08-04T14:18:32+05:30"}
{"level":"debug","msg":"handleQuery received DNS query: ;; opcode: QUERY, status: NOERROR, id: 18018\n;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0\n\n;; QUESTION SECTION:\n;api.snapcraft.io.\tIN\t AAAA\n","time":"2022-08-04T14:18:32+05:30"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2022-08-04T14:18:38+05:30"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2022-08-04T14:18:38+05:30"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/shadow/.lima/_config/user\" -o IdentityFile=\"/Users/shadow/.ssh/id_rsa\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath=\"/Users/shadow/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2022-08-04T14:18:38+05:30"}
{"level":"debug","msg":"stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\": exit status 255","time":"2022-08-04T14:18:38+05:30"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2022-08-04T14:18:48+05:30"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2022-08-04T14:18:48+05:30"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/shadow/.lima/_config/user\" -o IdentityFile=\"/Users/shadow/.ssh/id_rsa\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath=\"/Users/shadow/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2022-08-04T14:18:48+05:30"}
{"level":"debug","msg":"stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\": exit status 255","time":"2022-08-04T14:18:48+05:30"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2022-08-04T14:18:58+05:30"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2022-08-04T14:18:58+05:30"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/shadow/.lima/_config/user\" -o IdentityFile=\"/Users/shadow/.ssh/id_rsa\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath=\"/Users/shadow/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2022-08-04T14:18:58+05:30"}
{"level":"debug","msg":"stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\": exit status 255","time":"2022-08-04T14:18:58+05:30"}
{"level":"debug","msg":"handleQuery received DNS query: ;; opcode: QUERY, status: NOERROR, id: 8964\n;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0\n\n;; QUESTION SECTION:\n;ntp.ubuntu.com.\tIN\t A\n","time":"2022-08-04T14:19:00+05:30"}
{"level":"debug","msg":"handleQuery received DNS query: ;; opcode: QUERY, status: NOERROR, id: 12952\n;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0\n\n;; QUESTION SECTION:\n;ntp.ubuntu.com.\tIN\t AAAA\n","time":"2022-08-04T14:19:00+05:30"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2022-08-04T14:19:08+05:30"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2022-08-04T14:19:08+05:30"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/shadow/.lima/_config/user\" -o IdentityFile=\"/Users/shadow/.ssh/id_rsa\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=shadow -o ControlMaster=auto -o ControlPath=\"/Users/shadow/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2022-08-04T14:19:08+05:30"}
{"level":"debug","msg":"stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\"<EMAIL_ADDRESS>Permission denied (publickey).\\r\\n\": exit status 255","time":"2022-08-04T14:19:09+05:30"}

Same issue here on my M1, may I ask if you've solved it yet?

Same issue here, problem with permissions for public key.
Colima version: 0.6.7
Lima version: 0.19.1
macOS: Sonoma 14.2.1
Processor: M1, 2020
Cleaning ~/.colima and ~/.lima directories did not help.

There should some logs in systemctl status ssh

There should be some logs in systemctl status ssh

I assume this should be done inside VM. How can I get in to run this?

The pubkey itself should be in ~/.ssh/authorized_keys

On host or in VM?

Both the logs and the ssh files are in the VM*, since ssh seems to be broken you probably have to use the console.
* The host/client uses ~/.lima/_config/user.pub or something similar (under $LIMA_HOME) for storing the public key

Hmm, authenticating might be an issue. I think the boot will dump you at a login prompt on the console.

@afbjorklund here's the line from ha.stderr.log:
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/admin/.lima/_config/user\" -o IdentityFile=\"/Users/admin/.ssh/id_rsa\" -o IdentityFile=\"/Users/admin/.ssh/iron-proxy\" -o IdentityFile=\"/Users/admin/.ssh/its-admins\" -o IdentityFile=\"/Users/admin/.ssh/its-shared\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm<EMAIL_ADDRESS>-o User=admin -o ControlMaster=auto -o ControlPath=\"/Users/admin/.lima/default/ssh.sock\" -o ControlPersist=yes -p 60022 <IP_ADDRESS> -- /bin/bash]","time":"2024-01-06T15:28:04+03:00"}

As you can see, it lists identities both from lima config and from my local ~/.ssh folder.
All these have -rw------- permission as per security recommendations.

You can disable the adding of your regular keys. It is probably going to be the default soon.

The curious port is what happens on the server, if there is anything in serial.log or sshd log...

I'll be glad to debug and help. But regard to (co)lima I'm just a user who wants his images to run. If there's somewhat meaningful description exists then I'll try to follow it.

That is OK, and not expected.
Do you get the regular output from cloud-init (in serial.log), where it prints out the authorized keys and the host keys?
ci-info: +++++++++++++++++++++++++++++++Authorized keys from /home/anders.linux/.ssh/authorized_keys for user anders++++++++++++++++++++++++++++++++
ci-info: +-------------+-------------------------------------------------------------------------------------------------+---------+---------------+
ci-info: |   Keytype   |                                       Fingerprint (sha256)                                      | Options |    Comment    |
ci-info: +-------------+-------------------------------------------------------------------------------------------------+---------+---------------+
ci-info: | ssh-ed25519 | 62:49:b4:0b:2d:da:9f:7d:e3:1d:3c:15:99:59:d0:e2:b5:52:73:fd:4c:6b:ab:81:3b:67:50:87:9c:4c:03:c3 |    -    | anders@ubuntu |
ci-info: +-------------+-------------------------------------------------------------------------------------------------+---------+---------------+
<14>Jan  6 14:01:05 cloud-init: #############################################################
<14>Jan  6 14:01:05 cloud-init: -----BEGIN SSH HOST KEY FINGERPRINTS-----
<14>Jan  6 14:01:05 cloud-init: 1024 SHA256:R/VZpJMEFwQZHg2dNEOJkOBlv6uOE2x9tb+vKDkirls root@lima-default (DSA)
<14>Jan  6 14:01:05 cloud-init: 256 SHA256:juQhkjN2pthhgRyuMsElojI4sq86nQS11kITO8moJ60 root@lima-default (ECDSA)
<14>Jan  6 14:01:05 cloud-init: 256 SHA256:o/FiOTjLAZRFaaEZoxPpSOtiZczvf3gz28H4uHLlOQ8 root@lima-default (ED25519)
<14>Jan  6 14:01:05 cloud-init: 3072 SHA256:luqbyEmRnph59hSu7yR66pfS47DRY58vmh7NbFHT5Mo root@lima-default (RSA)
<14>Jan  6 14:01:05 cloud-init: -----END SSH HOST KEY FINGERPRINTS-----
<14>Jan  6 14:01:05 cloud-init: #############################################################

(they all start with ci-info)
There should also be the regular systemd output for the service itself.
         Starting ssh.service - OpenBSD Secure Shell server...
[  OK  ] Started ssh.service - OpenBSD Secure Shell server.

Here's something suspicious I see in serialp.log:
lima-default login: [   26.388197] cloud-init[2359]: + '[' '!' -f /usr/local/bin/nerdctl ']'
[   26.389247] cloud-init[2359]: + '[' -f /usr/local/bin/nerdctl ']'
[   26.389426] cloud-init[2359]: + tar Cxzf /usr/local /mnt/lima-cidata/nerdctl-full.tgz
[   29.428937] cloud-init[2359]: + mkdir -p /etc/bash_completion.d
[   29.452918] cloud-init[2359]: + nerdctl completion bash
[   29.473242] cloud-init[2359]: + rm -rf /tmp/tmp.yhotkxLurZ
[   29.475320] cloud-init[2359]: + : default
[   29.475371] cloud-init[2359]: + : overlayfs
[   29.475414] cloud-init[2359]: + '[' '' = 1 ']'
[   29.475598] cloud-init[2359]: + '[' 1 = 1 ']'
[   29.475955] cloud-init[2359]: + '[' '!' -e /home/admin.linux/.config/containerd/config.toml ']'
[   29.476442] cloud-init[2359]: + mkdir -p /home/admin.linux/.config/containerd
[   29.478436] cloud-init[2359]: + cat
[   29.480865] cloud-init[2359]: + chown -R admin /home/admin.linux/.config
[   29.482122] cloud-init[2359]: chown: invalid user: ‘admin’
[   29.483055] cloud-init[2359]: LIMA| WARNING: Failed to execute /mnt/lima-cidata/boot/40-install-containerd.sh
[   29.484671] cloud-init[2359]: LIMA| Exiting with code 1
[   29.485475] cloud-init[2359]: 2024-01-06 12:27:55,630 - cc_scripts_per_boot.py[WARNING]: Failed to run module scripts_per_boot (per-boot in /var/lib/cloud/scripts/per-boot)
[   29.487775] cloud-init[2359]: 2024-01-06 12:27:55,631 - util.py[WARNING]: Running module scripts_per_boot (<module 'cloudinit.config.cc_scripts_per_boot' from '/usr/lib/python3/dist-packages/cloudinit/config/cc_scripts_per_boot.py'>) failed
[   29.491134] cloud-init[2359]: 2024-01-06 12:27:55,636 - util.py[WARNING]: Running module ssh_authkey_fingerprints (<module 'cloudinit.config.cc_ssh_authkey_fingerprints' from '/usr/lib/python3/dist-packages/cloudinit/config/cc_ssh_authkey_fingerprints.py'>) failed

Oh, you can't use the name "admin".
https://xkcd.com/327/

https://github.com/lima-vm/lima/issues/2037

Bummer. Looks like it explain everything.
Yes, there is such warning in logs.

@afbjorklund case is closed for me, thanks a lot.
I've created another user, su'd to it and lima starts successfully.

For the history, here's my solution to a problem:
Create new user on behalf of who '[co]lima` will work:
# Create new user and put its home dir under /var
sudo sysadminctl -addUser lima -fullName "Lima Colima" -password procedure -admin
# Hide user's home
dscl . create /Users/lima IsHidden 1
# Create alternative user's home under /var
sudo dscl . -create /Users/lima NFSHomeDirectory /var/lima
mv /Users/lima /var/lima

From this point it's possible to run [co]lima after su-ing to lima user.
Alternatively, create new docker context and point it to /var/lima/.colima/docker.sock (adjusting this file permissions, of course).

https://github.com/lima-vm/lima/issues/1015


[fix] fix way to style elements via ElementRef now using Renderer

@ederribeiro It's preferable to user Renderer2 as Renderer is deprecated.


Deploying deis to multi AZ/region using cloudformation

Hello,
is there an easy way to deploy deis in a multi-az fashion?
thanks,
Gergely

The AWS provisioning process already spreads your hosts across subnets in two AZs.  You also have the option of bringing your own VPC-- which is a better option because it would allow you to spread your hosts across subnets in as many AZs as you like in a given region.  Ideally, for production, you use at least three AZs.

Thanks!


Design for Read Database

This task is automatically imported from the old Task Issue Board and it was originally created by James Dunkerley.
Original issue is here.

Ability to get list of tables / views
Fetch whole table or view
Ability to run custom SQL query

Includes reviewing the Dialect design to ensure full support for samples, aggregation, joining and filters.
Blockers:
#183390662 blocked
#183390699 blocked
#183377997 blocked
#183390797 blocked
#183578491 blocked
Comments:
James Dunkerley reports a new STANDUP for today (2022-07-14):
Progress: Started on the Database.read design work. Experimenting with ideas at the moment. It should be finished by 2022-07-18.
Next Day: Next day I will be working on the ##182652055 task. Continuing design. (Enso Bot - Jul 14, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-15):
Progress: Working over Column_Type and Column type design for Database.read. It should be finished by 2022-07-18.
Next Day: Next day I will be working on the ##182652055 task. Continuing design - hoping to get a first draft done for Monday. (Enso Bot - Jul 15, 2022)

**James Dunkerley** reports a new **🔴 DELAY** for today (2022-07-18):
Summary: There is 4 days delay in implementation of the Design for Read Database (#182652055) task.
It will cause 1 day delay for the delivery of this weekly plan.
Expanded the scope to cover column types.
Delay Cause: Too hot so working on another task on laptop. (Enso Bot - Jul 18, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-18):
Progress: PR review on Date work. 1:1s with Sylwia and Wojciech. Some more design work. Started on Linear Regression as too hot. Type name alignment. It should be finished by 2022-07-22.
Next Day: Next day I will be working on the ##182652055 task. Continuing linear regression work. (Enso Bot - Jul 18, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-19):
Progress: Completed type name revision. Discussed Database.Read and column types with Ned and Sylwia. Exceptions meeting with engine team. Working on regression functions and statistics. It should be finished by 2022-07-22.
Next Day: Next day I will be working on the ##182652055 task. Continuing linear regression work and design work. (Enso Bot - Jul 19, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-20):
Progress: Linear regression functions working. Did some work on improving what is included in Standard.Base and Standard.Table. Working over Radek's PRs to get them merged. It should be finished by 2022-07-22.
Next Day: Next day I will be working on the ##182652055 task. Continuing linear regression work and design work. (Enso Bot - Jul 20, 2022)

**James Dunkerley** reports a new **🔴 DELAY** for today (2022-07-26):
Summary: There is 7 days delay in implementation of the Design for Read Database (#182652055) task.
It will cause 0 days delay for the delivery of this weekly plan.
Returned to working on this ticket and the column types one after having been working on other tickets,
Delay Cause: Other work needing completed. (Enso Bot - Jul 26, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-26):
Progress: Adjusted the design for Database/Schema and table list querying. Working on Column Types and Query design. It should be finished by 2022-07-29.
Next Day: Next day I will be working on the ##182652055 task. Aiming to get a decent version to review with Ned and Sylwia tomorrow. (Enso Bot - Jul 26, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-27):
Progress: Completed prototype for Databases and Schemas. Worked through Tables design. Reviewed with Ned and Sylwia. It should be finished by 2022-07-29.
Next Day: Next day I will be working on the ##182652055 task. Adding renaming to metadata columns. Adding reading table structure from metadata and query design. Then onto types. (Enso Bot - Jul 27, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-28):
Progress: Worked over issues in the Postgres and SQLite prototypes following review with Ned and Sylwia yesterday. Set up the tables function and columns_metadata_table function. Still working on Column_Type type design. It should be finished by 2022-07-29.
Next Day: Next day I will be working on the ##182652055 task. Continuing on columns work and hopefully getting to query work. (Enso Bot - Jul 28, 2022)

**James Dunkerley** reports a new **🔴 DELAY** for today (2022-07-29):
Summary: There is 6 days delay in implementation of the Design for Read Database (#182652055) task.
It will cause 0 days delay for the delivery of this weekly plan.
Found difficulties with mapping type from Postgres metadata. With Gdansk trip will be a few more days.
Delay Cause: Other work needing completed. (Enso Bot - Jul 29, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-07-29):
Progress: Working over types in Postgres and how they map through JDBC into Enso data types. It should be finished by 2022-08-04.
Next Day: Next day I will be working on the ##182652055 task. Travelling to GDansk and some more types work (Enso Bot - Jul 29, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-08-03):
Progress: PR reviews for Radek. Some admin sorting out post the trip. Then working on restructuring the Database Connection type allowing for reuse of as much as possible as design moves to specific ones for each database. It should be finished by 2022-08-04.
Next Day: Next day I will be working on the ##182652055 task. Continuing the Database read work. (Enso Bot - Aug 3, 2022)

**James Dunkerley** reports a new **🔴 DELAY** for today (2022-08-04):
Summary: There is 15 days delay in implementation of the Design for Read Database (#182652055) task.
It will cause 0 days delay for the delivery of this weekly plan.
Refactoring work after finding data type issues for Postgres.
Delay Cause: Adding the work of column types made this a larger task. Should mean completing both read and column types sooner. Additional delay caused by holidays. (Enso Bot - Aug 4, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-08-04):
Progress: Refactored the Connection type. Allows for much easier specific implementations. As no inheritance still has a lot of boiler plate. Prototype all working. It should be finished by 2022-08-19.
Next Day: Next day I will be working on the ##182652055 task. Holiday until 15th then will pick this back up. (Enso Bot - Aug 4, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-08-15):
Progress: Catching up after week off. Repaired examples. Reviewing PRs. Replying to Discord. Meeting on Arrays and dynamic widgets. It should be finished by 2022-08-19.
Next Day: Next day I will be working on the ##182652055 task. Investigating Windows installer issue. Work on dynamic widgets design then back to database design. (Enso Bot - Aug 15, 2022)

**James Dunkerley** reports a new **🔴 DELAY** for today (2022-09-22):
Summary: There is 38 days delay in implementation of the Design for Read Database (#182652055) task.
It will cause 0 days delay for the delivery of this weekly plan.
Picking back up to finish off design.
Delay Cause: Not working on it... (Enso Bot - Sep 22, 2022)

**James Dunkerley** reports a new **STANDUP** for today (2022-09-22):
Progress: Work on the ArraySlice code. Finished off query and read prototype and design. It should be finished by 2022-09-26.
Next Day: Next day I will be working on the ##183208844 task. Prototype up the filter design. (Enso Bot - Sep 22, 2022)

Related:

[ ] #5262
[ ] #5269
[ ] #5263
[ ] #5264

Closing as design complete.


typeof with identically named type and value causes invalid .d.ts output

🔎 Search Terms
type, value, .d.ts, circular, circularity, invalid, output, declaration
🕗 Version & Regression Information

This changed between versions 5.4 and 5.5

⏯ Playground Link
https://www.typescriptlang.org/play/?ts=5.5.0-dev.20240501#code/KYDwDg9gTgLgBAYwgOwM7wCbFQqBLMGPFVOAXjgG8AoOOAMwggC44AiAIwEMo3qBfatVCRYcGAE8wwOFhz5CxNOXFTgEerOy4CREkA
💻 Code
export const descriptions = {
  foo: "bar"
}

export type descriptions = typeof descriptions

🙁 Actual behavior
Actual .d.ts output:
export declare const descriptions: typeof descriptions;
export type descriptions = typeof descriptions;

🙂 Expected behavior
Expected .d.ts output:
export declare const descriptions: {
    foo: string;
};
export type descriptions = typeof descriptions;

Additional information about the issue
No response

Bisects to https://github.com/microsoft/TypeScript/pull/57772

@RyanCavanaugh Is this not worth patching into TS 5.5?
Given how easy this is to repro, I'd assume this would occur often in the wild.
Issues like this that are only exposed in build output are also particularly insidious because most library authors don't explicitly check their build output, and most consumers use skipLibCheck, which would result in the affected type silently resolving to any.

This would be quite a disaster especially considering this only occurs in the .d.ts which for libraries are often generated just before publishing.

Following as Effect may be affected

Given that this was introduced before release wouldn't it be a better strategy to revert the commit that introduced the bug and defer that commit to 5.6? It feels a bit odd to introduce a bug, recognize that it is a bug and defer the fix till a further version. I would understand the choice if this didn't came up pre-release

Hmm this matches a ton of common behavior, even the humble as const "enum" is affected.
export const Color = {
  Red: "Red",
  Green: "Green",
  Blue: "Blue"
} as const

export type Color = typeof Color
export type Colors = Color[keyof Color]

This being broked^
though this works fine:
export const Color = {
  Red: "Red",
  Green: "Green",
  Blue: "Blue"
} as const

export type Color = typeof Color[keyof typeof Color]

hmmmm

Yeah, good points all around


Add Webview to scaffold sample execution-environment.yml file using creator add subcommand

Summary
This PR adds a new webview for adding a sample execution-environment.yml file to an existing destination path.
Available fields:

Destination Path: The path where the sample execution-environment.yml file gets added. If the destination path does not exist, an error message comes up.

Webview

Related JIRA: AAP-36883

I'm wondering if we need to keep the log output to file, copy logs, and open log file options - similar to how the devfile webview currently is.
@audgirka What do you think?

Reopening this PR on a branch off the upstream project so we can check code coverage - #1727


Gallery, Scrollable tabs: tab body and tab header settling at different times

This is more of a feature request (enhancement) than a bug. I think.
Open the gallery, then Scrollable tabs. Swipe back and forth.
Notice that the tab body settles into place before the tab header settles into place.
Here's the slow-mo version of the animations: https://youtu.be/t9nmTPy8zlw
Regular speed: https://youtu.be/N_0e6Emvy2g
Regular speed, but sloooowly swiping: https://youtu.be/M3tMUTvx4vo
Notice how in the above video, the tab body and the underline movements are synced, but the tab header movement is not synced. It pops into place.
We might want to consider synchronizing the movement of the underline, tab body, and tab header, such that all three land in their final place at the same time. And, as the finger swipes back and forth, all three are moving together.
Here's a video of Play Newstand. Notice how the underline, tab body, and tab header all end at the same time: https://youtu.be/xxYafHZ_GVY

This doesn't appear to be an issue anymore.


Please support MinGW compiler

You could try standalone cmake and standalone MinGW but I recommend using MSYS2 with the UCRT64 environment.
https://github.com/frang75/nappgui/issues/4

Hi @iahung2, thanks for the feedback.
I'll evaluate this feature for NAppGUI 1.4


JS auto import not working: not showing workspace symbols

Problem
I cannot get any symbols to show up in the suggestion menu that are clearly defined inside the workspace  (see screenshots below).

My environment
I checked out latest insider to reproduce:

Version: 1.38.0-insider
Commit: 1c6e25b87e05a8429c986c59431be77467af9449
Date: 2019-08-16T09:45:29.036Z
Electron: 4.2.9
Chrome: 69.0.3497.128
Node.js: 10.11.0
V8: 6.9.427.31-electron.0
OS: Darwin x64 18.6.0

My workspace and user settings are both empty, using default settings.
Steps to Reproduce

Open workspace
Start typing the name of a symbol present inside the workspace (like EmptyA, short for EmptyArray) - Nothing there! - Screenshot:

(note that it does suggest built-ins)

Make sure, EmptyArray actually exists in workspace:

Does this issue occur when all extensions are disabled?
Yes (I ran without extensions; it said extensions were temporarily disabled on start; and problem still there)

A few more notes:

When renaming something in one file (using F2), does not change it when imported in another
Problem exists in all of my workspaces
All of this worked just fine until (probably?) a month ago.

Can you please share a small example project so I can how the code is structured?
Also, do you have a jsconfig?

Adding a jsconfig.json in my src folder fixed it o_X
At the same time, if I create a new project, things work fine without a jsconfig.json.

Thank you so much! At least it's working now!
I have not narrowed down what actually causes the problem (as it can work with and without jsconfig.json in difference scenarios), so I'm rather interested:
Any idea why? Is there something I did wrong? In what circumstances do I need a jsconfig.json?


DMPs: Pagination is broken

Describe the bug
See the screenshot:

Is this a regression?
Yes
Expected behavior
Normal paginator behaviour.
Environment

Damap version 4.3

Additionally, the sorting that should happen when pressing the column titles does not work.

These two errors are most likely connected.


github: allow the Github API calls to fail

I suspect the reason we didn't spot this earlier is that we use Lwt.join instead of Lwt.choose to monitor all the threads. That means we'll only see an error if all the threads fail.


Use --force-reinstall in integration test and skip wheel

Summary of changes
In integration test:

Replace pip install -I with pip install --force-reinstall
Do not install wheel as it is no longer a build dependency (it also no longer gets automatically installed in the build env in regular workflows).

Closes #4564
Pull Request Checklist

[ ] Changes have tests
[ ] News fragment added in newsfragments/.
(See documentation for details)

Integration tests should run in https://github.com/pypa/setuptools/actions/runs/10369805360, so we can see if this fixes the problem or not.

Integration tests pass after the changes: https://github.com/pypa/setuptools/actions/runs/10369805360/job/28707136245.

I re-ran the failed jobs for v72.2.0, since the release didn't go out as planned, and it succeeded.


Replace deprecated dependency gulp-util

Replace deprecated dependency gulp-util
gulp-util has been deprecated recently. Continuing to use this dependency may prevent the use of your library with the latest release of Gulp 4 so it is important to replace gulp-util.
The README.md lists alternatives for all the components so a simple replacement should be enough.
Your package is popular but still relying on gulp-util, it would be good to publish a fixed version to npm as soon as possible.
See:

https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
https://github.com/gulpjs/gulp-util/issues/143

looks like we use log, colors, and template here. should be easy enough, will look into this today!


Bugfix/matter lock max codes calculation

Previously calculating the max credential index available for pin codes
we used the formula NumberOfPINUsersSupported * NumberOfCredentialsSupportedPerUser, but this calculation was misguided
and results in an index out of range for some devices. The max credential
index available on a lock is actually bounded by
NumberOfPINUsersSupported. This is not super clear in the spec, but
has been confirmed by some of the lock companies, and other CSA members.
This change also checks the RequirePINForRemoteOperation attribute when determining if a COTA credential is needed.
An improvement that will be done in a follow up PR is to select the COTA credential index based on the scanned credentials rather than always picking the highest credential slot.

I tested this with a lock that does require COTA pins and after switching to this driver the COTA PIN wasn't being included in the lock/unlock commands. I'll PM you the logs.

I tested this with a lock that does require COTA pins and after switching to this driver the COTA PIN wasn't being included in the lock/unlock commands.

I cannot reproduce this when I tried going from the old driver to this version. If it does end up being reproducible, we can have a conversation about if such a breaking change is okay at this point, given the number of devices on the platform is so low.


Column name as Keyword

Hi,
The MSSQL DB has a column name which is called index, which is of course a keyword.
Error is pymssql._mssql.mssqldatabaseexception Incorrect syntax near ‘index’ . If this is intended as a part of a table hint, A WITH keyword and parenthesis are now required ...
I use tap-mssql --variant buzzcutnorman as the extractor and it works as is expected.
Full Error message -> sqlalchemy.exc.OperationalError: (pymssql.exceptions.OperationalError) (1018, b”Incorrect syntax near ‘index’. If this is intended as a part of a table hint, A WITH keyword and parenthesis are now required. See See SQL Server Books Online for proper synatx.DB-Lib error message 20018, serverity 15:\nGeneral SQL Server error: Check messages from the SQL Server\n”)
I think the problem is because the index has single quotation. The  T-SQL syntax should be [index] for that case.
How I could sort this out, please?

Hi, you are entirely correct @miko866 this target does not properly bracket column names. The best fix for you is probably to look at one of the 12 forks, several of which has implemented this fix (none of them have made a PR back here). I can probably help out figuring which of the forks are best for that purpose, or you might ask in the slack.

Hi @radbrt,
I'd be grateful if you could help me find the fork, I've already asked in slack about the problem but no answer.

Sorry for the late reply @miko866. The fork I was thinking of was https://github.com/FXTransparency/target-mssql, they accidentally submitted (and deleted) a PR to this repo with what looked like the necessary changes for correctly bracketing column names.
If you are feeling adventurous, you can also try my old attempt at bracketing, which lives in its own branch of my own fork: https://github.com/radbrt/target-mssql/tree/orig-colnames

Hi @radbrt, thank for your answer. I will take a look at that.

We've moved on from Meltano and are no longer maintaining this repository. Therefore I'm closing this issue.


To reduce the version differences of modules between WORKSPACE.bazel and MODULE.bazel.

Description
There were version differences in external dependency modules when building with the options --noenable_bzlmod (--config workspace) and enable_bzlmod, so we reduced these differences.
Additionally, by separating the Bazel files for qt_macos, we encouraged a decrease in analysis time　during builds on Linux and other platforms.
Issue IDs
Steps to test new behaviors (if any)
Additional context
When specifying --noenable_bzlmod, the build completes even without network access. However, the versions of the required modules are slightly different.
I encountered an issue where I couldn't build without network access due to differences in Bazel versions and switching between enabling and disabling bzlmod. So, I made some adjustments.
When bzlmod is enabled, it seems that remote patches and some modules need to be downloaded. Since bzlmod is enabled by default, network access is essentially required.
ERROR: Error computing the main repository mapping: in module dependency chain <root> -> protobuf@_ -><EMAIL_ADDRESS>Error accessing registry https://bcr.bazel.build/: Unknown host: bcr.bazel.build

While I believe building would be possible if the repository_cache is sent as is, it seems difficult with the distdir option.
If bzlmod is disabled, it was possible to build more easily without network access by specifying the archive files of necessary modules with the distdir option.
Because the module versions differ between bzlmod and workspace (--noenable_bzlmod), this commit is an attempt to adjust them to be as similar as possible.
However, modifying files in this part might not have been accepted due to policy. If that's the case, please feel free to close it.

Hi phoepsilonix,
Thank you for your PR.
offline builds with Bzlmod
For offline builds with Bzlmod, you also need to specify the --registry option.
bazel fetch --repository_cache="/path/to/repository_cache"
git clone https://github.com/bazelbuild/bazel-central-registry.git /path/to/bcr
bazel build --repository_cache=/path/to/repository_cache --registry=file:///path/to/bcr …

If you have additional questions, please feel free to ask it in Discussions.
build errors on macOS
I got the following errors with your PR on macOS.
Could you please double check whether your PR works for the macOS build?
mozc/src% MOZC_QT_PATH=${PWD}/third_party/qt bazel build --config oss_macos package
Starting local Bazel server and connecting to it...
DEBUG: /private/var/tmp/_bazel_komatsu/16974d89627788468869c7fcdea85b18/external/rules_python~/python/private/python.bzl:46:10: WARNING: Ignoring toolchain 'python_3_11' from module 'rules_android': Toolchain 'python_3_11' from module 'rules_python' already registered Python version 3.11 and has precedence
DEBUG: /private/var/tmp/_bazel_komatsu/16974d89627788468869c7fcdea85b18/external/rules_android_ndk~/rules.bzl:28:14: Either the ANDROID_NDK_HOME environment variable or the path attribute of android_ndk_repository must be set.
ERROR: /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel: no such target '//gui/about_dialog:about_dialog_macos': target 'about_dialog_macos' not declared in package 'gui/about_dialog' defined by /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel (did you mean about_dialog_main, or about_dialog_ja.qm?)
ERROR: /Users/komatsu/github/mozc/src/mac/BUILD.bazel:56:23: no such target '//gui/about_dialog:about_dialog_macos': target 'about_dialog_macos' not declared in package 'gui/about_dialog' defined by /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel (did you mean about_dialog_main, or about_dialog_ja.qm?) and referenced by '//mac:mozc_macos'
ERROR: Analysis of target '//:package' failed; build aborted: Analysis failed
INFO: Elapsed time: 74.773s, Critical Path: 0.06s
INFO: 1 process: 1 internal.
ERROR: Build did NOT complete successfully

mozc/src% MOZC_QT_PATH=${PWD}/third_party/qt bazel build --config oss_macos --noenable_bzlmod package
ERROR: /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel: no such target '//gui/about_dialog:about_dialog_macos': target 'about_dialog_macos' not declared in package 'gui/about_dialog' defined by /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel (did you mean about_dialog_main, or about_dialog_ja.qm?)
ERROR: /Users/komatsu/github/mozc/src/mac/BUILD.bazel:56:23: no such target '//gui/about_dialog:about_dialog_macos': target 'about_dialog_macos' not declared in package 'gui/about_dialog' defined by /Users/komatsu/github/mozc/src/gui/about_dialog/BUILD.bazel (did you mean about_dialog_main, or about_dialog_ja.qm?) and referenced by '//mac:mozc_macos'
ERROR: Analysis of target '//:package' failed; build aborted: Analysis failed
INFO: Elapsed time: 2.140s, Critical Path: 0.00s
INFO: 1 process: 1 internal.
ERROR: Build did NOT complete successfully
FAILED:
    Fetching repository @@local_config_apple_cc; starting
    Fetching repository @@local_config_xcode; Fetching the default Xcode version

WORKSPACE and Bzlmod
Since WORKSPACE and  –distdir will be deprecated and removed from Bazel in future, we'd like to focus on Bzlmod.
Updating versions in WORKSPACE makes sense, but modifying Bzlmod and BUILD files for WORKSPACE is not preferred.

"First of all, thank you very much for your response. I especially appreciate your information about the --registry option, which was very helpful. Some distribution build servers restrict network access during the build process after uploading trusted sources. It seems that building will be possible even in such environments. However, in such environments, if --distdir is deprecated in the future, offline builds might be difficult without manually reconstructing the repository cache. This is because uploading the repository cache as-is would probably not be allowed. In any case, I'm deeply grateful that we were able to clarify the steps to enable offline builds. As for the MAC build environment, I had confirmed up to the point where the toolchain couldn't be found due to the lack of a build environment. If it turns out that the build cannot be completed successfully, it might be better to close it.

If bzlmod is disabled, it was possible to build more easily without network access by specifying the archive files of necessary modules with the distdir option.

If you find any questions about offline build in bzlmod mode, I’d suggest looking for information in the Bazel community first, since improving offline build support is one of the key goals of bzlmod as clearly described in its original proposal. I am pretty sure that the upstream Bazel team is aware of the use cases you mentioned.

Poor support for enterprise use cases

Bazel does not offer an easy way to set up and perform an offline build.

It's possible to use --distdir to avoid downloading certain archives, but there is no automatic workflow to set up a distdir. There are also further problems with the distdir setup: it contains unextracted archives; files in the distdir are not distinguished by the full URL; etc.
To enforce a build to be offline, users need to rely on the undocumented --nofetch flag, which completely disables repo rule evaluation (even guaranteed offline logic such as extracting distdir archives).

There is no good way to force all dependencies to come from an internal server or proxy.
Since each repo rule invocation directly names a list of URLs, users need to change every single invocation to force everything to come from an internal server or proxy.

This is exacerbated by the deps.bzl pattern -- users need to override the URLs of indirect dependencies by hand.

There is no sure-fire way to override a dependency to use a local directory (aka "vendoring").

Mostly due to the prevalence of the deps.bzl pattern and the uncertainty of WORKSPACE evaluation order.
There is also no easy way to set up a dependency to be vendored (users have to perform manual downloads).

The files in the folder specified by distdir don't change frequently, right? Repeatedly uploading these could be considered a waste of network resources. For some systems, it might be possible to manage previously uploaded archives using URLs and HASHes, and avoid fetching them again if the same ones are specified. If distdir is deprecated, it would be nice to have a similar functionality with a different option.

I am pretty sure that the upstream Bazel team is aware of the use cases you mentioned.

Thank you so much.
Please convey my regards.

For now, we'll call it off. If there's another opportunity, I'll try to separate it again.
Thank you very much for checking various things.

P.S.
I think people would be pleased if there were also release files in bcr.


[Feature Request] Single episode requests

Description
In the current version, it's not possible to only ask for a particular episode or a particular season of a serie.
Desired Behavior
Be able to ask by episodes and/or by seasons with kinda the same system already in place for film or whole series.
Additional Context
No response
Code of Conduct

[X] I agree to follow Overseerr's Code of Conduct

Need some clarification on what you mean by it's not possible to request for a particular season of a series as it has always been possible. Just not individual episodes

Oh okay i haven't seen that when you click on ask it would prompt you that, i thought it would download the entire serie

I think requesting individual episodes would be very helpful, especially when you're looking for something new to watch and don't want to request entire seasons just to watch a single episode.

Is this going to be done?

Saw this post about why it might be hard (https://github.com/Fallenbagel/jellyseerr/issues/592#issuecomment-1847836482).
But Sonarr does implement multiple monitoring options like "Pilot Episode Only". I'm not familiar with the Jellyseerr implementation, how it submits new series / movies Sonarr/Radarr, but I can imagine adding a series as "paused", changing it to "monitor only pilot episode" and then "unpause" it could work.. :thinking:

Would it be possible to add this function initially for series where sonarr and tmdb agree on episode numbering? And/or perhaps set this feature as experimental, to be activated in the settings if we understand the risks ?

Is anybody working on this?

Still one of the best ideas. I keep wishing.....


This is my solution for my suggestion issue #168

I changed return value code from
return titleEl != null ? titleEl.text().trim() : "";
to
return titleEl != null ? titleEl.text().trim().replaceAll("\n", "").replaceAll("(\s){2,}", " ") : "";
for removing unnecessary spaces and newline chars in the document title if exists.

Thanks. This was fixed with https://github.com/jhy/jsoup/commit/05ae97865c84536a6cfe7759ca6c382eb761ecb2


[QuantNoise] Details of int4 quantization in image classification task

❓ Questions and Help
Before asking:

search the issues.
search the docs.

What is your question?
Thanks for open-sourcing such a great project!
I'm tring to reproduce QuantNoise for int4-mobilenetv2 in ImageNet according to the paper and this project. But I'm confused about some details in the paper.

Table1 in the paper shows that training int4-EfficientNet-B3 in ImageNet-1k with QAT and Quant-Noise gets 59.4% and 67.8% top-1 accuracy respectively. In such a experiment(Table1),

Section8.3 say that activations are quantized with Hitogram(L2) scheme in scalar quantization.
What about weights? Are weights all quantized with Histogram(L2) scheme as well?
As I know, origin QAT quantized activations with MovingAverageMinMax scheme and fold BN into Conv to apply FakeBN.
Which scheme is used for QAT in the experiment, Histogram(L2) or MovingAverageMinMax?
Does QAT use FakeBN in the experiment, or just use normal BN? Does the normal BN freeze statistic parameters(running_mean and running_varience)?
Are all weights and activations symmetricly quantized into int4, including depthwise convolutions, downsample convolutions, SE modules, the first convolution as well as the last fully connection layer?

Table9 compares the results of Histogram and Channel scheme.
Are weights and activations both quantized with Histogram scheme or Channel scheme here?

Code

What have you tried?
What's your environment?

fairseq Version (e.g., 1.0 or master):
PyTorch Version (e.g., 1.0)
OS (e.g., Linux):
How you installed fairseq (pip, source):
Build command you used (if compiling from source):
Python version:
CUDA/cuDNN version:
GPU models and configuration:
Any other relevant information:

Hi @hey-yahei, did you figure out how to run the image classification task on MobileNet?


chore(build): update source copy script with sourcemap to relative path

@trxcllnt for visibility - would you able to give a shot if this fixes source path lookup issue #1423 ? For me it seems work, but not 100% sure and would like to have second opinion for verification.

Blocked until it's verified.

Actually seems I noticed few caveat for this.. closing PR but leave branch to allow anyone tryout. I'll reopen once I get more confidence.

@kwonoj doesn't seem to be working, for example in util/toSubscriber.js.map, the "sources":["util/toSubscriber.ts"] needs to be "sources":["toSubscriber.ts"]

Yes, I noticed that so closed PR immediately :(


raw.crop doesn't adjust onset of annotations for eyetracking data leading to interpolation errors

Description of the problem
specifically for eyetracking data (not sure about other types), the raw.crop method will trim the signal down appropriately, but no adjustment is made to the onset time of any annotations that remain in the data. this is particularly problematic when you use mne.preprocessing.eyetracking.interpolate_blinks where it will just interpolate over random segments of the signal
i am not sure if this is an intended behaviour as I think, in the past, the .crop function has adjusted the onset time of events (before annotations were used). If i'm wrong, please send me away!
Steps to reproduce
import mne
from mne.datasets.eyelink import data_path
mne.viz.set_browser_backend('qt')

dpath = data_path() / "eeg-et" / "sub-01_task-plr_eyetrack.asc"
raw = mne.io.read_raw_eyelink(dpath, create_annotations = ['blinks'])
raw.plot(scalings = dict(eyegaze = 1e3))
raw = raw.crop(tmin = 4)
raw = mne.preprocessing.eyetracking.interpolate_blinks(raw, buffer = 0.15)
raw.plot(scalings = dict(eyegaze = 1e3)) #can see interpolation happens exactly 4s after the actual blink period

Link to data
No response
Expected results
it should interpolate the blinks (removing blink artefact)
Actual results
it interpolates exactly Xs after the blink, where X is the tmin applied in the raw.crop call
Additional information
Platform             macOS-14.2.1-arm64-arm-64bit
Python               3.11.6 | packaged by conda-forge | (main, Oct  3 2023, 10:37:07) [Clang 15.0.7 ]
Executable           /Users/sammichekroud/anaconda3/envs/mne/bin/python
CPU                  arm (8 cores)
Memory               16.0 GB
Core
├☒ mne               1.6.0 (outdated, release 1.6.1 is available!)
├☑ numpy             1.26.2 (OpenBLAS 0.3.25 with 8 threads)
├☑ scipy             1.11.4
├☑ matplotlib        3.8.2 (backend=Qt5Agg)
├☑ pooch             1.8.0
└☑ jinja2            3.1.2
Numerical (optional)
├☑ sklearn           1.3.2
├☑ numba             0.58.1
├☑ nibabel           5.2.0
├☑ nilearn           0.10.2
├☑ dipy              1.7.0
├☑ openmeeg          2.5.7
├☑ pandas            2.1.4
└☐ unavailable       cupy
Visualization (optional)
├☑ pyvista           0.43.1 (OpenGL 4.1 Metal - 88 via Apple M2)
├☑ pyvistaqt         0.11.0
├☑ vtk               9.2.6
├☑ qtpy              2.4.1 (PyQt5=5.15.2)
├☑ pyqtgraph         0.13.3
├☑ mne-qt-browser    0.6.1
├☑ ipywidgets        8.1.1
├☑ trame_client      2.14.1
├☑ trame_server      2.13.1
├☑ trame_vtk         2.6.3
├☑ trame_vuetify     2.3.1
└☐ unavailable       ipympl
Ecosystem (optional)
└☐ unavailable       mne-bids, mne-nirs, mne-features, mne-connectivity, mne-icalabel, mne-bids-pipeline

from looking at the source code for raw.crop, it looks like this is because the annotations created by mne.io.read_raw_eyelink come with an orig_time feature. With this feature the onsets of the annotations aren't actually adjusted to be relative to the first sample of the signal

Thanks for the report!
I think we need to account for raw.first_time in the interpolate_blinks function, which will be a non-negative integer after you call raw.crop:
https://github.com/mne-tools/mne-python/blob/65d826d199c3bbed0ee7035dda0f4560282b43ff/mne/preprocessing/eyetracking/_pupillometry.py#L75-L100
starting at line 89 above, something like:
        for annot in blink_annots:
            if "ch_names" not in annot or not annot["ch_names"]:
                msg = f"Blink annotation missing values for 'ch_names' key: {annot}"
                raise ValueError(msg)
            start = annot["onset"] - raw.first_time - pre_buffer   # critical change here
            end = annot["onset"] - raw.first_time + annot["duration"] + post_buffer  # critical change here

After which, running your code above, should still interpolate the blinks as expected:

neat! Thanks for the quick fix - would it be ok to change my pupillometry.py to include that fix until it's released?
also, possibly not the right place to mention this as it's less of an issue and more of a feature request - would it be possible to have this function return the non-interpolated, but still nanned signals? this is actually quite useful when you want to see how much data in a trial is missing (after epoching the raw data, it works well with epoched.plot_image) to aid in trial rejection for later analysis. If useful, i am v happy to be pointed to wherever is good for feature requests to add this!

neat! Thanks for the quick fix - would it be ok to change my pupillometry.py to include that fix until it's released?

@schekroud would you be up to submit a PR with the fix? If we get stuck somewhere (our change breaks existing tests, etc.) I'll be happy to help troubleshoot as well.

also, possibly not the right place to mention this as it's less of an issue and more of a feature request - would it be possible to have this function return the non-interpolated, but still nanned signals?

Like return a numpy array of the signals before interpolation? Sorry if I'm misunderstanding, but feel free to open up a new ticket if its something you want to discuss more!

To fix this rather than any new code I think the solution is to use _annotations_starts_stops

OK, using _annotations_starts_stops an implementation could look like (again starting from line 89 above):
starts, ends = _annotations_starts_stops(raw, "BAD_blink")
        starts = np.divide(starts, raw.info["sfreq"]) # convert to seconds
        ends = np.divide(ends, raw.info["sfreq"])
        for annot, start, end in zip(blink_annots, starts, ends):
            if "ch_names" not in annot or not annot["ch_names"]:
                msg = f"Blink annotation missing values for 'ch_names' key: {annot}"
                raise ValueError(msg)
            start -= pre_buffer
            end += post_buffer
            ...
            ```

@scott-huberty i'll submit the PR later on, sure

If this is all you need raw["eyegaze"] or raw.get_data(...) or similar should get you what you want

not quite. i'm talking about adding a channel during mne.io.preprocessing.interpolate_blinks where the channel contents are basically the output of
# signal is your trace
# mask is the np.zeros_like(signal) with boolean for if the sample is to be interpolated
signal[np.squeeze(np.where(mask))] = np.nan
#append signal as new channel called e.g. pupil_nan

i'll open a new issue with feature request to explain a bit more - but it is specifically quite useful for eyetracking to identify 'blinky' subjects that you may want to discard as you're interpolating large %s of data

i'll open a new issue with feature request to explain a bit more - but it is specifically quite useful for eyetracking to identify 'blinky' subjects that you may want to discard as you're interpolating large %s of data

Sure, feel free. Maybe what we really need is a function to quantify how much of a given raw instance is "covered" by annotations of a specific type. In your case it could be something like mne.annotations.quantify_coverage(raw, "BAD_BLINK") or something similar.

@scott-huberty i'll submit the PR later on, sure

awesome!

Maybe what we really need is a function to quantify how much of a given raw instance is "covered" by annotations of a specific type. In your case it could be something like mne.annotations.quantify_coverage(raw, "BAD_BLINK") or something similar.

if so, maybe we can just repurpose some of the code use for logging in mne.preprocessing.annotate_break into a function:
https://github.com/mne-tools/mne-python/blob/65d826d199c3bbed0ee7035dda0f4560282b43ff/mne/preprocessing/artifact_detection.py#L600-L613