CDK Deployment on Sepolia - Timeout Issue on bridge

System information
Ubuntu 24.04 LTS
Commit id
2a6ee1f
Tools versions
./scripts/tool_check.sh: command not found
Description & steps to reproduce
I am trying to deploy the CDK on Sepolia with the following changes

In Params.yml

deploy_l1: false

#L1 Configurations
l1_chain_id: 11155111
l1_preallocated_mnemonic: new mnemonic ......
l1_funding_amount: 5ether
l1_rpc_url: https://eth-sepolia.g.alchemy.com/v2/
l1_ws_url: wss://eth-sepolia.g.alchemy.com/v2/

In templates > trusted-node > node-config.toml

BatchMaxDeltaTimestamp = "2m"
LastBatchVirtualizationTimeMaxWaitPeriod = "15m"

In cdk_bridge_infra.star - commented the following lines

 #l1rpc_service = plan.get_service("el-1-geth-lighthouse")
 # "l1rpc_ip": l1rpc_service.ip_address,
 # "l1rpc_port": l1rpc_service.ports["rpc"].number,

sudo kurtosis clean --all
kurtosis run --enclave cdk-v1 --args-file params.yml --image-download always .
Getting the Following Error
Adding service with name 'zkevm-bridge-service-001' and image 'hermeznetwork/zkevm-bridge-service:v0.6.0-RC1'
There was an error executing Starlark code
An error occurred executing instruction (number 68) at github.com/0xPolygon/kurtosis-cdk/cdk_bridge_infra.star[24:21]:
  add_service(name="zkevm-bridge-service-001", config=ServiceConfig(image="hermeznetwork/zkevm-bridge-service:v0.6.0-RC1", ports={"grpc": PortSpec(number=9090, application_protocol="grpc"), "rpc": PortSpec(number=8080, application_protocol="http")}, files={"/etc/zkevm": Directory(artifact_names=["bridge-config-artifact", "claimtxmanager-keystore"])}, entrypoint=["/app/zkevm-bridge"], cmd=["run", "--cfg", "/etc/zkevm/bridge-config.toml"]))
  Caused by: Unexpected error occurred starting service 'zkevm-bridge-service-001'
  Caused by: An error occurred waiting for all TCP and UDP ports to be open for service 'zkevm-bridge-service-001' with private IP '<IP_ADDRESS>'; this is usually due to a misconfiguration in the service itself, so here are the logs:
  == SERVICE 'zkevm-bridge-service-001' LOGS ===================================
  {"level":"info","ts":1728650244.1119413,"caller":"cmd/run.go:26","msg":"Starting application","pid":7,"version":"v0.6.0-RC1","gitRevision":"002f436","gitBranch":"HEAD","goVersion":"go1.21.13","built":"Thu, 26 Sep 2024 10:05:53 +0000","os/arch":"linux/amd64"}
  {"level":"info","ts":1728650244.1920202,"caller":"pgstorage/utils.go:63","msg":"successfully ran 12 migrations","pid":7,"version":"v0.6.0-RC1"}
  {"level":"warn","ts":1728650244.194674,"caller":"etherman/etherman.go:187","msg":"Claim compressor Address not configured","pid":7,"version":"v0.6.0-RC1"}
  {"level":"error","ts":1728650244.1965096,"caller":"cmd/run.go:232","msg":"L2 etherman 0http://cdk-erigon-node-001:8123, error: invalid opcode: PUSH0\n/src/log/log.go:142 github.com/0xPolygonHermez/zkevm-bridge-service/log.appendStackTraceMaybeArgs()\n/src/log/log.go:217 github.com/0xPolygonHermez/zkevm-bridge-service/log.Error()\n/src/cmd/run.go:232 main.newEthermans()\n/src/cmd/run.go:52 main.start()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333 github.com/urfave/cli/v2.(*App).RunContext()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307 github.com/urfave/cli/v2.(*App).Run()\n/src/cmd/main.go:56 main.main()\n/usr/local/go/src/runtime/proc.go:267 runtime.main()\n","pid":7,"version":"v0.6.0-RC1","stacktrace":"main.newEthermans\n\t/src/cmd/run.go:232\nmain.start\n\t/src/cmd/run.go:52\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269\ngithub.com/urfave/cli/v2.(*App).RunContext\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333\ngithub.com/urfave/cli/v2.(*App).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307\nmain.main\n\t/src/cmd/main.go:56\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:267"}

  Error: invalid opcode: PUSH0
  {"level":"error","ts":1728650244.1965914,"caller":"cmd/run.go:54","msg":"invalid opcode: PUSH0\n/src/log/log.go:142 github.com/0xPolygonHermez/zkevm-bridge-service/log.appendStackTraceMaybeArgs()\n/src/log/log.go:217 github.com/0xPolygonHermez/zkevm-bridge-service/log.Error()\n/src/cmd/run.go:54 main.start()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333 github.com/urfave/cli/v2.(*App).RunContext()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307 github.com/urfave/cli/v2.(*App).Run()\n/src/cmd/main.go:56 main.main()\n/usr/local/go/src/runtime/proc.go:267 runtime.main()\n","pid":7,"version":"v0.6.0-RC1","stacktrace":"main.start\n\t/src/cmd/run.go:54\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269\ngithub.com/urfave/cli/v2.(*App).RunContext\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333\ngithub.com/urfave/cli/v2.(*App).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307\nmain.main\n\t/src/cmd/main.go:56\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:267"}

  == FINISHED SERVICE 'zkevm-bridge-service-001' LOGS ===================================
  Caused by: An error occurred while waiting for all TCP and UDP ports to be open
  Caused by: Unsuccessful ports check for IP '<IP_ADDRESS>' and port spec '{privatePortSpec:0xc001c6b080}', even after '240' retries with '500' milliseconds in between retries. Timeout '2m0s' has been reached
  Caused by: An error occurred while calling network address '<IP_ADDRESS>:8080' with port protocol 'TCP' and using time out '200ms'
  Caused by: dial tcp <IP_ADDRESS>:8080: i/o timeout

Error encountered running Starlark code.

Desired behavior
Should have run it success.
What is the severity of this bug?
Critical; I am blocked and Kurtosis CDK is unusable for me because of this bug.

We can have a look at this. I think in the short run, I would make sure you're following the latest documented guide as closely as possible:
https://github.com/0xPolygon/kurtosis-cdk/blob/main/docs/deploy-using-sepolia.org
The error in your case is coming from the bridge, but most likely there is something else wrong in the deployment. I don't think any changes /should/ be required in cdk_bridge_infra.star. So if you were running into an issue that required that, it would be good to know.

I reverted the code in cdk_bridge_infra.star.
Followed the steps given here
https://github.com/0xPolygon/kurtosis-cdk/blob/main/docs/deploy-using-sepolia.org
**

Restarted the CDK Node container (But it keeps failing after some seconds).

**
Getting the same issue
`There was an error executing Starlark code
An error occurred executing instruction (number 68) at github.com/0xPolygon/kurtosis-cdk/cdk_bridge_infra.star[24:21]:
add_service(name="zkevm-bridge-service-001", config=ServiceConfig(image="hermeznetwork/zkevm-bridge-service:v0.6.0-RC1", ports={"grpc": PortSpec(number=9090, application_protocol="grpc"), "rpc": PortSpec(number=8080, application_protocol="http")}, files={"/etc/zkevm": Directory(artifact_names=["bridge-config-artifact", "claimtxmanager-keystore"])}, entrypoint=["/app/zkevm-bridge"], cmd=["run", "--cfg", "/etc/zkevm/bridge-config.toml"]))
Caused by: Unexpected error occurred starting service 'zkevm-bridge-service-001'
Caused by: An error occurred waiting for all TCP and UDP ports to be open for service 'zkevm-bridge-service-001' with private IP '<IP_ADDRESS>'; this is usually due to a misconfiguration in the service itself, so here are the logs:
== SERVICE 'zkevm-bridge-service-001' LOGS ===================================
{"level":"info","ts":1728680057.9976766,"caller":"cmd/run.go:26","msg":"Starting application","pid":7,"version":"v0.6.0-RC1","gitRevision":"002f436","gitBranch":"HEAD","goVersion":"go1.21.13","built":"Thu, 26 Sep 2024 10:05:53 +0000","os/arch":"linux/amd64"}
{"level":"info","ts":1728680058.075379,"caller":"pgstorage/utils.go:63","msg":"successfully ran 12 migrations","pid":7,"version":"v0.6.0-RC1"}
{"level":"warn","ts":1728680058.0780013,"caller":"etherman/etherman.go:187","msg":"Claim compressor Address not configured","pid":7,"version":"v0.6.0-RC1"}
{"level":"error","ts":1728680058.0798602,"caller":"cmd/run.go:232","msg":"L2 etherman 0http://cdk-erigon-node-001:8123, error: invalid opcode: PUSH0\n/src/log/log.go:142 github.com/0xPolygonHermez/zkevm-bridge-service/log.appendStackTraceMaybeArgs()\n/src/log/log.go:217 github.com/0xPolygonHermez/zkevm-bridge-service/log.Error()\n/src/cmd/run.go:232 main.newEthermans()\n/src/cmd/run.go:52 main.start()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333 github.com/urfave/cli/v2.(*App).RunContext()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307 github.com/urfave/cli/v2.(*App).Run()\n/src/cmd/main.go:56 main.main()\n/usr/local/go/src/runtime/proc.go:267 runtime.main()\n","pid":7,"version":"v0.6.0-RC1","stacktrace":"main.newEthermans\n\t/src/cmd/run.go:232\nmain.start\n\t/src/cmd/run.go:52\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269\ngithub.com/urfave/cli/v2.(*App).RunContext\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333\ngithub.com/urfave/cli/v2.(*App).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307\nmain.main\n\t/src/cmd/main.go:56\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:267"}
{"level":"error","ts":1728680058.0799484,"caller":"cmd/run.go:54","msg":"invalid opcode: PUSH0\n/src/log/log.go:142 github.com/0xPolygonHermez/zkevm-bridge-service/log.appendStackTraceMaybeArgs()\n/src/log/log.go:217 github.com/0xPolygonHermez/zkevm-bridge-service/log.Error()\n/src/cmd/run.go:54 main.start()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269 github.com/urfave/cli/v2.(*Command).Run()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333 github.com/urfave/cli/v2.(*App).RunContext()\n/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307 github.com/urfave/cli/v2.(*App).Run()\n/src/cmd/main.go:56 main.main()\n/usr/local/go/src/runtime/proc.go:267 runtime.main()\n","pid":7,"version":"v0.6.0-RC1","stacktrace":"main.start\n\t/src/cmd/run.go:54\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:276\ngithub.com/urfave/cli/v2.(*Command).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/command.go:269\ngithub.com/urfave/cli/v2.(*App).RunContext\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:333\ngithub.com/urfave/cli/v2.(*App).Run\n\t/go/pkg/mod/github.com/urfave/cli/v2@v2.27.4/app.go:307\nmain.main\n\t/src/cmd/main.go:56\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:267"}
Error: invalid opcode: PUSH0
== FINISHED SERVICE 'zkevm-bridge-service-001' LOGS ===================================
Caused by: An error occurred while waiting for all TCP and UDP ports to be open
Caused by: Unsuccessful ports check for IP '<IP_ADDRESS>' and port spec '{privatePortSpec:0xc00201ecf0}', even after '240' retries with '500' milliseconds in between retries. Timeout '2m0s' has been reached
Caused by: An error occurred while calling network address '<IP_ADDRESS>:8080' with port protocol 'TCP' and using time out '200ms'
Caused by: dial tcp <IP_ADDRESS>:8080: i/o timeout
Error encountered running Starlark code.`

We can have a look at this. I think in the short run, I would make sure you're following the latest documented guide as closely as possible: https://github.com/0xPolygon/kurtosis-cdk/blob/main/docs/deploy-using-sepolia.org
The error in your case is coming from the bridge, but most likely there is something else wrong in the deployment. I don't think any changes /should/ be required in cdk_bridge_infra.star. So if you were running into an issue that required that, it would be good to know.

Any update

I've updated the guide and tested. Please have a look @gouravnaik . From following the guide, I have Kurtosis running locally and it's sequencing and verifying batches here:

Rollup: https://sepolia.etherscan.io/address/0x31635db1133Bdc8204918ce47161eE84dE58ccB2
Rollup Manager: https://sepolia.etherscan.io/address/0x698e0dDF844E13E736F21B48DAee689914ec22aC


⚠ AGEG website (redirect) has degraded performance

In 404766d, AGEG website (redirect) (https://ageg.ca/) experienced degraded performance:

HTTP code: 200
Response time: 2266 ms

Resolved: AGEG website (redirect) performance has improved in 479cf52.


Incorrect behavior when used inside ReactFlow

Hi!
I want to start with gratitude, thank you so much for your work!
I ran into a problem with the overlay when used inside Reactflow (there, a container is used as a "canvas" that works due to transformations) (gif)

MLElement;
I tried to redefine the measuring prop for DndContext. Received the following code
const getTransform = (node: HTMLElement) => {
  const parent = node.offsetParent as HT

  const top = node.offsetTop + parent.offsetTop;
  const left = node.offsetLeft + parent.offsetLeft;

  return {
    width: node.offsetWidth,
    height: node.offsetHeight,
    left,
    top,
    right: 0,
    bottom: 0,
  };
};

export const DND_MEASURING_FOR_REACTFLOW: MeasuringConfiguration = {
  draggable: {
    measure: getTransform,
  }
};

The problem with incorrect positioning of the overlay during the dragging is gone, but there was a problem when releasing the element (gif)

After that I tried adding dragOverlay measuring
const getTransform = (node: HTMLElement) => {
  const parent = node.offsetParent as HTMLElement;
  const top = node.offsetTop + parent.offsetTop;
  const left = node.offsetLeft + parent.offsetLeft;

  return {
    width: node.offsetWidth,
    height: node.offsetHeight,
    left,
    top,
    right: 0,
    bottom: 0,
  };
};

const getOverlayTransform = (node: HTMLElement) => {
  return {
    width: node.offsetWidth,
    height: node.offsetHeight,
    left: node.offsetLeft,
    top: node.offsetTop,
    right: 0,
    bottom: 0,
  };
};

export const DND_MEASURING_FOR_REACTFLOW: MeasuringConfiguration = {
  dragOverlay: {
    measure: getOverlayTransform,
  },
  draggable: {
    measure: getTransform,
  },
};

The problem with the positioning of the overlay during drop disappeared, but there was a problem that now the position of where to insert the element (collisionDetection) is incorrectly determined (gif)

Most likely the problem is in the getOverlayTransform function, but I do not know how to change it so that everything works correctly. I will be very grateful if you tell me what needs to be done. Thank you in advance

The problem is easily reproduced if a transformation is added to the container inside which DND occurs (transform: translateX(1px))


表单field支持a.b.c的写法

General

✏ Mark the necessary items without changing the structure of the PR template.

[ ] Pull request template structure not broken

Type

ℹ What types of changes does your code introduce?

👉 Put an x in the boxes that apply

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist

ℹ Check all checkboxes - this will indicate that you have done everything in accordance with the rules in CONTRIBUTING.

👉 Put an x in the boxes that apply.

[x] My code follows the style guidelines of this project
[x] Is the code format correct
[x] Is the git submission information standard?
[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

表单中有类似写法时，setFieldsValue无法正确赋值。配置field为a.b.c时，setFieldValue支持传 { a: { b: { c: '' } } }


Clarification about token for testing

What token is this line referring to?
The token generated by the Microsoft Entra provisioning service should only be used for testing. It shouldn't be used in production environments.
Is it talking about the testing token from the /scim/token endpoint if the SCIM provisioning server ? If so, this token is not from the Microsoft Entra provisioning service, but from the SCIM application if the ASPNETCORE_ENVIRONMENT property is set to Development ?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 271dc426-fb47-7441-d627-ec11f8c7a6ea
Version Independent ID: 4cb8bfc8-4748-e501-425a-e4c2da0f5f5a
Content: Tutorial - Develop a SCIM endpoint for user provisioning to apps from Microsoft Entra ID - Microsoft Entra ID
Content Source: docs/identity/app-provisioning/use-scim-to-provision-users-and-groups.md
Service: active-directory
Sub-service: app-provisioning
GitHub Login: @kenwith
Microsoft Alias: kenwith

@LijuV-MSFT
Thanks for your feedback! We will investigate and update as appropriate.

Hi @LijuV-MSFT
The line you mentioned is not referring to any specific token. It is just a general statement that the token generated by the Microsoft Entra provisioning service should only be used for testing and not in production environments.
Regarding your question about the /scim/token endpoint, you are correct that this token is not from the Microsoft Entra provisioning service, but from the SCIM application if the ASPNETCORE_ENVIRONMENT property is set to Development.

thank you.


Bot Framework Getting 502 Bad Gateway Errors in Production Environment after the Bot is not Requested for around 10 Minutes (Node.js)

When I use Microsoft Bot Framework for developing a conversational bot using multiple waterfall dialogs, I always receive 502 Bad Gateway errors in the Production Environment when the bot is not requested for around 10 Minutes.
However, in the local environment, the error will not happen when the application is tested using Bot Emulator.
I have been looking for solutions regarding this issue, and it seems that the error is caused by the bot not being able to send back the response within 15 Seconds.
Here are the things that I have tried in order to get around with the issue:

Enabled "Always on" options for Azure Cloud Application (cannot solve the issue)

Changed the in-memory storage of state into custom storage using Cosmos DB (cannot solve the issue)

Sending Proactive Messages for certain long-running processes. However, when the 502 error starts to happen, even fetching one document from Firebase Firestore can be the "long-running process" which results in the error. Since my application requires checking Firebase document status constantly to see whether certain conversation stage is open and decide which Dialog should be applied, it is unlikely to identify long-running processes in this context.

Based on my observation, when the 502 gateway error occurs, the bot will be stuck in the initial stage rather than running slowly (i.e. the bot will be stuck in the initial Firebase request), and it does not seem to be the problem of long-running processes. It is not a problem with Firebase since fetching data from Firebase (which basically should take no time) will appear to be long-running processes when the bot does not appear to be "active" after around 10 minutes. The issue is that the bot seems not being capable of sending the fetching requests.
Also, when the error occurs, the error message throwing by the bot framework is as follows, and I cannot find any related solutions for the error activity.code with value "14" must be of type string.

[onTurnError]: Error: No connection established
BotFrameworkAdapter.processActivity(): 500 ERROR - Error: activity.code with value "14" must be of type string. (node:5132) UnhandledPromiseRejectionWarning: Error: Error: activity.code with value "14" must be of type string. At BotFrameworkAdapter.processActivity (D\home\site\wwwroot\node_modules\botbuilder\lib\botFrameworkAdapter.js:511:19) at process._tickCallback (internal/process/next_tick.js:68:7). (node:5132) Unhandled Promise Rejection Warning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled
with .catch(). (rejection id: 9)

Considering this situation, what is the proper workaround of the issue?

I am trying to write a cloud function to actively sending requests to the bot at a 5 minutes interval to keep it alive, but I am not sure whether it will be working and it does not seem to be the proper solution.
If I need to send proactive messages for every received message (since it is not possible to identify long-running processes), how can I push the waterfall dialog forward & prompt users for certain inputs with proactive messages? Since the Proactive Message Sample https://docs.microsoft.com/en-au/azure/bot-service/bot-builder-howto-proactive-message?view=azure-bot-service-4.0&tabs=javascript does not provide an implementation to continue the waterfall dialog & prompt user for certain inputs (e.g. AttachmentPrompt, NumberPrompt, etc.).

Looking into

activity.code with value "14" must be of type string

as that is not an error I recognize offhand.

You said:

how can I push the waterfall dialog forward & prompt users for certain inputs with proactive messages

It is possible to create a dialog context and use it to begin the dialog from within the proactive context created when you call adapter.continueConversation.

@benbrown Hi, could you please specify a little bit about? If I am trying to forward all the messages received to proactive context, what should I do in the following function? Just send a HTTP request to the /api/notify endpoint?
adapter.processActivity(req, res, async turnContext => {
    //
}

Also, in the /api/notify route, after I get the conversationReference, this function seems not to be working. Using adapter.continueConversation, I can only await turnContext.sendActivity(msg), but I cannot run the current context. Could you provide some details regarding this?
await adapter.continueConversation(
      conversationReference,
      async turnContext => {
        return await bot.run(turnContext);
      }
    );

@jwiley84 Hi, is there any update for the error? I tried to activate the bot using a scheduler (sending the request to the bot at a five-minute interval in order to keep it alive), but it seems that it can only prolong the lifetime of the bot. And after 1 hour or so, I will still receive the same error message as activity.code with value "14" must be of type string.
And after receiving this error message, all the consequent messages will receive a 502 error.

Hello @PeterChen1105! Our support team looked into this item and escalated it to the dev team. I'm investigating, and will come back with questions and / or checks you can do to get to the resolution of this item. I'll reach out after I catch up and do a first round of investigation here.

Hi @carlosscastro, thx for your information, cheers

Hello @PeterChen1105!
There is a lot to unpack here so I'd like us to go back to the original issue. First, I'd like to note that if you could provide a minimal code example that demonstrates the problem with very little code and precise instructions, we could try it ourselves and analyze if there is a bug. So if you feel inclined and really want to get this fixed, I'd definitely recommend isolating the problem and how to get to it and sending us the steps and minimal code.
In the meantime, I'd like to organize the information here, particularly the original report:

The bot is a conversational bot using multiple waterfall dialogs
Customer always receives 502 Bad Gateway errors in the Production Environment when the bot is not requested for around 10 Minutes.
On the local environment, the error will not happen when the application is tested using Bot Emulator.
Enabling always or switching to memory store does not help

Then you mentioned that you tried proactive as a means to fixing this. Since it didn't fix it, potentially proactive would just complicate things further so I'd like to tackle the original issue.
Note that some of your symptoms make sense, since the timeout in directline when your bot is deployed to production is 15 seconds, while in the emulator we don't enforce that. This means that if your bot takes more than 15 seconds to respond we'll stop waiting.
Since I don't have a repro of your issue at this point, here are a few things that I'd recommend trying in order to gather more information. I cannot guarantee that any of these will lead to the root cause but they should help get closer to it.

Simplify and obtain minimal repro: As I mentioned below, remove all your custom logic and just replace with hardcoded answers in the waterfall and no database calls. Does the bot still get stuck? If yes, send us that code along with instructions on how to deploy and we can try it.
App insights: Are you using app insights? It's an amazing way of knowing what is going on with your bot, how long your bot is taking to respond, how long it's spending waiting for external calls to respond, etc
Deploy a sample: You could try getting a bot sample from botbuilder-samples and deploying it to see if it gets stuck for you: https://github.com/microsoft/BotBuilder-Samples/tree/master/samples/javascript_nodejs/16.proactive-messages and then add your logic to it to see if that makes it get stuck

If I were in your position, I'd go for 2. and 1. If in 1 you remove your custom logic and the bot is not stuck anymore, you can tell which was the offending line and find a way to fix it.

@PeterChen1105 - Hi Peter, are you able to update this thread with a current status?

Hi @PeterChen1105, just checking in if you were to get a small repro of the issue so we can help you debug.

Hi @carlosscastro @cleemullins I have contacted the Microsoft Support Team to get some extra help, and it seems that the error is caused by Firestore that I used for persisting data and push real-time notifications.
Thu Dec 12 2019 15:14:56 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 1, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 16:14:56 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 1, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 17:14:58 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 1, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 17:14:58 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 2, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 17:14:58 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 3, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:00 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 1, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:00 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 2, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:01 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 3, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:03 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 4, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:05 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 5, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:09 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 6, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:11 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 7, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:16 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 8, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:22 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 9, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:35 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 10, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:15:58 GMT+0000 (Greenwich Mean Time): enter backoffAndWait, retryCount+1, this.retryCount: 11, exports.MAX_RETRY_ATTEMPTS: 10 Thu Dec 12 2019 18:16:34 GMT+0000 (Greenwich Mean Time): enter backoffAndWait error situation, this.retryCount: 11, exports.MAX_RETRY_ATTEMPTS: 10 Encountered error: Error: Exceeded maximum number of retries allowed
When encountering a maximum number of retries, the next bot message will receive a timeout error.
I tried to update the version of Firestore and started monitoring the bot status from the day before yesterday, and up until now, the error does not occur for 24 hours. So I will keep monitoring the status and hopefully, the problem has been tackled by the latest version of Firestore.
Sorry for the late update of the thread status since to reproduce the error, sometimes it will take more than 10 hours.


⚠ ClamAV has degraded performance

In b509fc6, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 21 ms

Resolved: ClamAV performance has improved in 54fc05c.


Update NTP role - in preparation of ansible 2.2

The external ntp role is not updated for over a year: https://github.com/resmo/ansible-role-ntp
With ansible 2.2.0 (detached HEAD d81b9ca29e) last updated 2016/05/30 08:21:44 (GMT +000)
we are seeing the below failures:

TASK [ansible-role-ntp : Start/stop ntp service] *******************************
task path: /ansible-role-ntp/tasks/main.yml:22
...
fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "invocation": {"module_args": {"enabled": "yes", "name": "ntpd", "pattern": "/ntpd", "state": "started"}}, "msg": "unsupported parameter for module: pattern"}

2.2 in EPEL is quite far away (2.1 is not in there and that was only released a week ago).
I think we should change this to a compatible role (compatible = we don't have to change any variables in fgci-ansible group_vars).
It might be that the pattern= missing in the 2.2.0's service module is an error and that this is an erroneous error. In either case it would be good to move to a maintained external role.

Probably this needs to change anyway in case we want to switch to chrony per https://github.com/CSC-IT-Center-for-Science/fgci-ansible/issues/103 ?

Let's go with chrony instead.
Ansible 2.2 has target September 2016, so it's about time to start using chrony.
Continuing the work in #103


Update Get-CsOnlineUser.md

@JohanFreelancer9

@traya1

@traya1

@traya1 Gentle reminder.

Hi @yogkumgit - Apologies for the delayed response. I was using this PR to review some formatting behavior. Moving forward, I'll use the comment field to specify whether my PRs require reviews or are for testing purposes.
Apologies for wasting y'alls time!
CC: @tiburd


[SPARK-45229][CORE] Show the number of drivers waiting in SUBMITTED status in MasterPage

What changes were proposed in this pull request?
This PR aims to show the number of drivers waiting in SUBMITTED status in MasterPage. Note that this UI improvement is valid even when we don't use spark.deploy.maxDrivers because the submitted drivers are in SUBMITTED status until it gets allocated in all Spark versions.
BEFORE:
Drivers: 3 Running, 13 Completed

AFTER:
Drivers: 3 Running (1 Waiting), 13 Completed

Why are the changes needed?

Does this PR introduce any user-facing change?
No.
How was this patch tested?
Manual check.
Was this patch authored or co-authored using generative AI tooling?
No.

Could you review this PR when you have some time, @yaooqinn ?

LGTM

Thank you, @yaooqinn !

Thank you for revising the PR title.
Since core module test passed and I verified manually, let me merge this.


Administrator: You must provide a valid menu item in the home_page option of your config

Hello. I started learning laravel and now trying to install Administrator. When i try it i have erro message

Administrator: You must provide a valid menu item in the home_page option of your config

But home_page is configurated
`<?php
return array(
/**
 * Package URI
 *
 * @type string
 */
'uri' => 'admin',

/**
 *  Domain for routing.
 *
 *  @type string
 */
'domain' => '',

/**
 *  Middleware for admin routing.
 *
 *  @type array
 */
'middleware' => ['web'],

/**
 * Page title
 *
 * @type string
 */
'title' => 'Admin',

/**
 * The path to your model config directory
 *
 * @type string
 */
'model_config_path' => config_path('administrator'),

/**
 * The path to your settings config directory
 *
 * @type string
 */
'settings_config_path' => config_path('administrator/settings'),

/**
 * The menu structure of the site. For models, you should either supply the name of a model config file or an array of names of model config
 * files. The same applies to settings config files, except you must prepend 'settings.' to the settings config file name. You can also add
 * custom pages by prepending a view path with 'page.'. By providing an array of names, you can group certain models or settings pages
 * together. Each name needs to either have a config file in your model config path, settings config path with the same name, or a path to a
 * fully-qualified Laravel view. So 'users' would require a 'users.php' file in your model config path, 'settings.site' would require a
 * 'site.php' file in your settings config path, and 'page.foo.test' would require a 'test.php' or 'test.blade.php' file in a 'foo' directory
 * inside your view directory.
 *
 * @type array
 *
 * 	array(
 *		'E-Commerce' => array('collections', 'products', 'product_images', 'orders'),
 *		'homepage_sliders',
 *		'users',
 *		'roles',
 *		'colors',
 *		'Settings' => array('settings.site', 'settings.ecommerce', 'settings.social'),
 * 		'Analytics' => array('E-Commerce' => 'page.ecommerce.analytics'),
 *	)
 */
'menu' => ['users'],

/**
 * The permission option is the highest-level authentication check that lets you define a closure that should return true if the current user
 * is allowed to view the admin section. Any "falsey" response will send the user back to the 'login_path' defined below.
 *
 * @type closure
 */
'permission'=> function()
{
	return Auth::check();
},

/**
 * This determines if you will have a dashboard (whose view you provide in the dashboard_view option) or a non-dashboard home
 * page (whose menu item you provide in the home_page option)
 *
 * @type bool
 */
'use_dashboard' => false,

/**
 * If you want to create a dashboard view, provide the view string here.
 *
 * @type string
 */
'dashboard_view' => '',

/**
 * The menu item that should be used as the default landing page of the administrative section
 *
 * @type string
 */
'home_page' => 'users',

/**
 * The route to which the user will be taken when they click the "back to site" button
 *
 * @type string
 */
'back_to_site_path' => '/',

/**
 * The login path is the path where Administrator will send the user if they fail a permission check
 *
 * @type string
 */
'login_path' => 'auth/login',

/**
 * The logout path is the path where Administrator will send the user when they click the logout link
 *
 * @type string
 */
'logout_path' => false,

/**
 * This is the key of the return path that is sent with the redirection to your login_action. Session::get('redirect') will hold the return URL.
 *
 * @type string
 */
'login_redirect_key' => 'redirect',

/**
 * Global default rows per page
 *
 * @type int
 */
'global_rows_per_page' => 20,

/**
 * An array of available locale strings. This determines which locales are available in the languages menu at the top right of the Administrator
 * interface.
 *
 * @type array
 */
'locales' => array(),

);
`

Make sure you have users.php model config file in your config/administrator directory. More on this: http://administrator.frozennode.com/docs/model-configuration


How to do this specific query

Not sure where is best to ask, from the source or stackoverflow.
But stackoverflow, bookshelf tag only has 91 followers and this is the source.
So I just post the stackoverflow link here: https://stackoverflow.com/questions/50821395/bookshelf-querying-a-related-model-with-their-id
To get some attention, and we can close or delete if this is totally wrong place to ask for this.

I follow the Bookshelf tag, so it's best not to spam me with duplicate questions. Just chose one or the other.


grafx2: desktop entry doesn't work

Describe the bug
The GrafX2 desktop entry points to an incorrect executable, causing it to not work.
Steps To Reproduce
Steps to reproduce the behavior:

Install GrafX2
Try to use the installed desktop entry
Failed to execute child process "grafx2" (No such file or directory)

Expected behavior
GrafX2 actually starting up
Screenshots

Additional context
The actual executable name is "grafx2-sdl"
Workaround
Add a new file in "~/.local/share/applications" called grafx2.desktop, with the following contents:
[Desktop Entry]
Name=GrafX2
Comment=Deluxe Paint Clone
Comment[fr]=Clone de Deluxe Paint
Exec=grafx2-sdl %f
Terminal=false
Type=Application
Icon=grafx2
Categories=Graphics;
MimeType=image/lbm;image/iff;image/pcx;image/tga;image/gif;image/bmp;image/x-icon;image/png;

You might have to run xfdesktop -R afterwards to clear caches? i'm not sure.
Importantly, this changes Exec=grafx2 %f to Exec=grafx2-sdl %f
Notify maintainers
Maintainer list is empty! @-ing people who edited the file recently.
@jchv @AndersonTorres @trofi @Zoomulator (this is what happens when you don't leave a specified successor)

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 6.6.0, NixOS, 23.05 (Stoat), 23.05.4705.621f51253edf`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.6`
 - channels(root): `"nixos-23.05, unstable"`
 - channels(hjs): `""`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Priorities
Add a :+1: reaction to issues you find important.

I will adopt this, then.


Request to Add "urlReplacer" Parameter to Experimental "preprocessCSS" Function

Description
While exploring the capability to customize the transformation of CSS file content, I was pleasantly surprised to discover the existence of the "preprocessCSS" function. This function internally invokes the "compileCSS" function. However, to my unexpected finding, the crucial "urlReplacer" parameter within the "compileCSS" function is not exposed externally. This limitation hinders my ability to achieve comprehensive CSS transformation through the "preprocessCSS" function.

Suggested solution
I would like to propose the inclusion of the missing "urlReplacer" parameter in the input parameters of the "preprocessCSS" function. This addition will empower users to fully leverage the capabilities of the underlying "compileCSS" function and customize the URL replacement logic according to their specific needs.
Alternative
No response
Additional context
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

Can you elaborate more what is your need for this?
Maybe there is something else possible with the current plugin API that would avoid extending the public surface API

Can you elaborate more what is your need for this? Maybe there is something else possible with the current plugin API that would avoid extending the public surface API

I'm in the process of migrating an old project, and I want it to be a gradual process. The original Less files were based on webpack, and I can't directly rename all of them to 'xxx.module.less'. In the migration process, I want to replace the development tool first. Therefore, I need to make the old files compatible. I used 'preprocessCSS' to convert Less files to modules, and I encountered this issue. I found that Vite processes CSS based on the 'vite:css' plugin. However, as a developer, I can't directly modify this plugin. The plugin itself passes the 'urlReplacer' parameter when calling 'compileCSS'. As a developer, I have the ability to directly modify the 'code' generated by 'preprocessCSS' in another way, but I feel that this is not an elegant solution. So, I hope that Vite can expose the 'urlReplacer' parameter of 'preprocessCSS' to developers. Of course, if Vite has other elegant solutions for this issue, I would appreciate it if you could let me know.

Thanks for explaining your usecase. The preprocessCSS API not exposing urlReplacer is intentional as it's out of scope of preprocessing. It's current goal is to only compile down superset CSS formats to plain CSS, and the plain CSS is still expected to go through the Vite CSS pipeline so that it resolves the URLs, among other transforms and optimisations.
At the moment, I'd suggest doing the rename you mentioned as I think it's the easiest way without hacking into internals, as if you do have access to urlReplacer, you're likely to hit other edge cases too.
Perhaps you can do the rename migration as part of before the Vite migration, so it's less impactful. I'm going to close this for now as it's not something we plan to expand on.


Cast audio not playing for certain spells unless hitting target

Certain spells, namely locomotomortus, don't have any cast sound effects unless the spell is converted to use a CustomProjectile action.

Fixed for locomotomortus in c2f552b712a2b462faafbc098a96a2d565ea30a2
Resolve to fix this with conversion to CustomProjectile usage in the future.


[SOZ-Phone] Re-enabling Zutom

https://github.com/SOZ-Faut-etre-Sub/SOZ-FiveM-Server/issues/352#issue-2754862704 - Re-enabling Zutom

Integrated in the main repository, thanks for the PR.


ADR 0004: Documentation

Issue Number: 446
Summary
Introduces ADR 0004 to standardize documentation.

Propose changes look good. We will want to ensure that the changes do not conflict with Green-Software-Foundation#99

@esgraham Good call!  Seems like it is fully aligned with this proposal.  This would take that PR further.

Closing in favor of having this conversation on the main GSF repo Green-Software-Foundation/carbon-aware-sdk#105


ci: conformance-kind: re-enable flaky Aggregator test

Looking at https://github.com/cilium/cilium/issues/24622 this should now be fixed.

Ran it 5 times, all green. Hopefully that's a good enough indication.

/test


fix(AEB): suppress build error (-Werror=pedantic)

Description
Related link: https://github.com/autowarefoundation/autoware.universe/issues/1219
Suppress build error.
In file included from /usr/include/pcl-1.12/pcl/point_types.h:354,
                 from /usr/include/pcl-1.12/pcl/common/transforms.h:43,
                 from /opt/ros/humble/include/pcl_ros/transforms.hpp:40,
                 from /home/satoshi/pilot-auto/src/autoware/universe/control/autonomous_emergency_braking/include/autonomous_emergency_braking/node.hpp:19,
                 from /home/satoshi/pilot-auto/src/autoware/universe/control/autonomous_emergency_braking/src/node.cpp:15:
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:241:12: error: ISO C++ prohibits anonymous structs [-Werror=pedantic]
  241 |     struct { \
      |            ^
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:259:3: note: in expansion of macro ‘PCL_ADD_UNION_POINT4D’
  259 |   PCL_ADD_UNION_POINT4D \
      |   ^~~~~~~~~~~~~~~~~~~~~
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:337:5: note: in expansion of macro ‘PCL_ADD_POINT4D’
  337 |     PCL_ADD_POINT4D; // This adds the members x,y,z which can also be accessed using the point (which is float[4])
      |     ^~~~~~~~~~~~~~~
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:289:7: error: ISO C++ prohibits anonymous structs [-Werror=pedantic]
  289 |       { \
      |       ^
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:313:3: note: in expansion of macro ‘PCL_ADD_UNION_RGB’
  313 |   PCL_ADD_UNION_RGB \
      |   ^~~~~~~~~~~~~~~~~
/usr/include/pcl-1.12/pcl/impl/point_types.hpp:368:5: note: in expansion of macro ‘PCL_ADD_RGB’
  368 |     PCL_ADD_RGB;
      |     ^~~~~~~~~~~
...

Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

@shmpwk Thanks, again. By the way, I'm curious about that why CI/CD couldn't detect this error :thinking:

I have no idea either ......
The CI should detect the error though ...
https://github.com/autowarefoundation/autoware.universe/actions/runs/4293965866


text effects should apply to inline icons as well

If I apply drop shadow or outline to text it works fine, but it would be nice if these effects could be applied to inline images as well. A

ttached are the specific properties on text that I use and would like to get applied to images.

I'll see what I can do. And I think there should probably be  an option to disable this feature.


Disable failing PrivateEndpointConnectionCreateAndUpdate test

Relates to #37421

API change check
API changes are not detected in this pull request.


Invalid MAX_NV_BUFFER_SIZE defined in stable 1.3.0

The testcase test_tpm2_nv.sh in the latest stable version of tpm2-tools 3.0.1 fails with the following failure:
/ERROR: Failed to read NVRAM area at index 0x1000000 (16777216). Error:0x80006
tpm2_nvread -Q -x $nv_test_index -a $nv_auth_handle > $large_file_read_name on line 167 failed: 1
test_tpm2_nv.sh ... FAILED

The root cause it due to invalid definition of MAX_NV_BUFFER_SIZE:
sapi/implementation.h:280:#define MAX_NV_BUFFER_SIZE              1024

This definition in the latest tpm2-tss has already corrected to 2048. I wonder whether we will have a new stable version of tpm2-tss with this fix.
Thanks.

Hi @jiazhang0. We had a chat about this on the<EMAIL_ADDRESS>mailing list a while back: https://lists.01.org/pipermail/tpm2/2017-November/000330.html but I'm only seeing the original message from @williamcroberts in the archive, not any of the replies.
The end result of the discussion is that this constant is used to define the maximum read size supported by the TSS. It's still possible to read NV areas larger than this, but it will require multiple read operations. The maximum NV read possible for a given TPM is vendor specific and that value can be queried using GetCapability with the capability field set to TPM_CAP_TPM_PROPERTIES and the property field set to TPM_PT_NV_BUFFER_MAX so it's quite possible that you may have a TPM that supports NV operations with buffers larger or smaller than the MAX_NV_BUFFER_SIZE supported by the TSS.
So this isn't an issue with the TSS, but instead it looks like the tpm2_nvread tool may need some attention. Hopefully @williamcroberts can help shed some light on this.
In the meantime can you provide some additional data? I know you're working to enable the test cases to be run against a hardware TPM so if you're using anything other than the simulator here it would help to know the make / model / firmware version etc from your TPM.

@flihp This is the fixed properties returned from my hw TPM NationZ Z32H320TC.
$tpm2_getcap -c properties-fixed
TPM_PT_FAMILY_INDICATOR:
  as UINT32:                0x08322e3000
  as string:                "2.0"
TPM_PT_LEVEL:               0
TPM_PT_REVISION:            1.16
TPM_PT_DAY_OF_YEAR:         0x0000012f
TPM_PT_YEAR:                0x000007de
TPM_PT_MANUFACTURER:        0x4e545a00
TPM_PT_VENDOR_STRING_1:
  as UINT32:                0x4e545a00
  as string:                "NTZ"
TPM_PT_VENDOR_STRING_2:
  as UINT32:                0x00000000
  as string:                ""
TPM_PT_VENDOR_STRING_3:
  as UINT32:                0x00000000
  as string:                ""
TPM_PT_VENDOR_STRING_4:
  as UINT32:                0x00000000
  as string:                ""
TPM_PT_VENDOR_TPM_TYPE:     0x00000011
TPM_PT_FIRMWARE_VERSION_1:  0x00040001
TPM_PT_FIRMWARE_VERSION_2:  0x15041509
TPM_PT_INPUT_BUFFER:        0x00000667
TPM_PT_HR_TRANSIENT_MIN:    0x00000004
TPM_PT_HR_PERSISTENT_MIN:   0x00000007
TPM_PT_HR_LOADED_MIN:       0x00000004
TPM_PT_ACTIVE_SESSIONS_MAX: 0x00000040
TPM_PT_PCR_COUNT:           0x00000018
TPM_PT_PCR_SELECT_MIN:      0x00000003
TPM_PT_CONTEXT_GAP_MAX:     0x0000ffff
TPM_PT_NV_COUNTERS_MAX:     0x00000000
TPM_PT_NV_INDEX_MAX:        0x00000667
TPM_PT_MEMORY:              0x00000004
TPM_PT_CLOCK_UPDATE:        0x003e8000
TPM_PT_CONTEXT_HASH:        0x0000000b
TPM_PT_CONTEXT_SYM:         0x00000006
TPM_PT_CONTEXT_SYM_SIZE:    0x00000080
TPM_PT_ORDERLY_COUNT:       0x000000ff
TPM_PT_MAX_COMMAND_SIZE:    0x000008ac
TPM_PT_MAX_RESPONSE_SIZE:   0x000008ac
TPM_PT_MAX_DIGEST:          0x00000020
TPM_PT_MAX_OBJECT_CONTEXT:  0x000003a0
TPM_PT_MAX_SESSION_CONTEXT: 0x000000f4
TPM_PT_PS_FAMILY_INDICATOR: 0x00000002
TPM_PT_PS_LEVEL:            0x00000000
TPM_PT_PS_REVISION:         0x00000100
TPM_PT_PS_DAY_OF_YEAR:      0x00000000
TPM_PT_PS_YEAR:             0x00000000
TPM_PT_SPLIT_MAX:           0x00000080
TPM_PT_TOTAL_COMMANDS:      0x00000065
TPM_PT_LIBRARY_COMMANDS:    0x00000063
TPM_PT_VENDOR_COMMANDS:     0x00000002
TPM_PT_NV_BUFFER_MAX:       0x00000667

Weird, 3.X releases should include the fix:
https://github.com/intel/tpm2-tools/blob/3.0.1/tools/tpm2_nvread.c#L118
The code queries the TPM to get the max buffer transmission size via: TPM_PT_NV_BUFFER_MAX
The test queries for TPM_PT_NV_INDEX_MAX and uses that to define the size of the index to use in nvdefine.
Then tpm2_nvwrite writes TPM_PT_NV_BUFFER_MAX chunks until it's written the data that is TPM_PT_NV_BUFFER_MAX bytes big.
Did I miss something here?

@williamcroberts @flihp The issue only happens if the requesting buffer size is larger than MAX_NV_BUFFER_SIZE supported by TSS.
This is the reference code and I add the comments for the test results.
    UINT32 max_data_size;
    rval = tpm2_util_nv_max_buffer_size(sapi_context, &max_data_size);
    if (rval != TPM_RC_SUCCESS) {
        return false;
    }

    UINT8 *data_buffer = malloc(data_size);
    if (!data_buffer) {
        LOG_ERR("oom");
        return false;
    }

    UINT16 data_offset = 0;
    while (ctx.size_to_read) {

        UINT16 bytes_to_read = ctx.size_to_read > max_data_size ?
                max_data_size : ctx.size_to_read;

        TPM2B_MAX_NV_BUFFER nv_data = TPM2B_TYPE_INIT(TPM2B_MAX_NV_BUFFER, buffer);

        //                           bytes_to_read         max_data_size    nv_data.t.size
        // success case:  13                            1639                    1024
        // failure case:      1639                       1639                    1024
        // success case:   1639                       1639                    2048
        rval = TSS2_RETRY_EXP(Tss2_Sys_NV_Read(sapi_context, ctx.auth_handle, ctx.nv_index,
                &sessions_data, bytes_to_read, ctx.offset, &nv_data, &sessions_data_out));
        if (rval != TPM2_RC_SUCCESS) {
            LOG_ERR("Failed to read NVRAM area at index 0x%x (%d). Error:0x%x",
                    ctx.nv_index, ctx.nv_index, rval);
            goto out;
        }

MAX_NV_BUFFER_SIZE is just a configuration value supported by TSS. If a hw tpm has a max_data_size (TPM_PT_NV_BUFFER_MAX) smaller than MAX_NV_BUFFER_SIZE, there would be no any problem.
Therefore, If the fixup should locate in tpm2-tss, just simply enlarge MAX_NV_BUFFER_SIZE; If the fix fixup should locate in tpm2-tools, such a pseudo code will fix this issue as well.
    UINT32 max_data_size;
    rval = tpm2_util_nv_max_buffer_size(sapi_context, &max_data_size);
    max_data_size = MIN(max_data_size, MAX_NV_BUFFER_SIZE);

@jiazhang0 I prefer your proposed fix for the tools, since enlarging MAX_NV_BUFFER_SIZE will only fix the issue in some TPM, there could always be a TPM that has a TPM_PT_NV_BUFFER_MAX bigger than whatever MAX_NV_BUFFER_SIZE constant we defined in tpm2-tss.

@martinezjavier I see this PR can fix this issue https://github.com/intel/tpm2-tools/pull/725/commits/d89a9813cd4566fc1f2a34008ee5f9ae69967f82

@jiazhang0 yes, already fixed by Jerry.


Endpoints #63

Closes #63

I think, as this is intended to be controlled entirely within a provider's own infrastructure & not externally exposed, it's not an important feature at this time. If we ever enhance this for a different type of deployment, we can revisit.


Add Connector Guardian to online-resources.asciidoc

I develop Connector Guardian a tool which take care of Connectors in production environment. I will be happy if more people can use it :)

@anvaari Hi, thanks for the link, interesting project. Do you please have a blogpost or example of using it with Debezium? If yes then such link would be even better.
Thanks

@anvaari Applied, thanks

Sorry dear @jpechane, seems I forgot to check my email 😅  . I will come back with another PR and a blog post soon :)


 This allows you to use arrays (that are not fake columns) without letting this trait modify them.

@jorenvanhee this seems to as if there could be some unintended side effects.

I changed this because if you use <select multiple>, you post an array. And that array is then json_encoded. That looks like an unwanted side effect of the fake columns feature.
But you're right. If someone used it like that before, it could be breaking for them. Maybe we could put this in the next major (breaking) release then?

@jorenvanhee , I know this is pretty old - but do you still remember what the problem was? Could you please give an example - I don't really understand.
I'm on a merging spree for 4.0, it's a good opportunity for breaking changes, and I'd love to merge this too.
Thanks!

I don't remember a lot about this sorry. I don't even have access my old codebase anymore and I barely remember what project it was.
But my last comment might have some clues :/ I guess it was impossible to post a <select multiple> field. Backpack would treat it as a translation because it was an array. But that was unwanted.
That's all I can think of right now... Good luck with v4 :)

Hmm... since this is old and we don't remember why it exists... I'm going to close this...
Sorry for taking so long to reply @jorenvanhee ... 😔


Fix k4run -l

BEGINRELEASENOTES

Fix k4run -l. Currently it fails because the parsing always wants a config file.

ENDRELEASENOTES
Current behavior (for example in the nightlies):
$ k4run -l
Error: missing gaudi options file.
Usage: k4run <options_file.py>, use --help to get a complete list of arguments

After this PR:
$ k4run -l
[k4run] Available components:
=====================
  AbortEventAlg (from GaudiExamples),
		 path: /Gaudi/install/python/GaudiExamples/__init__.py

  AlgContextAuditor (from GaudiAud),
		 path: /Gaudi/install/python/GaudiAud/__init__.py

  AlgContextSvc (from GaudiCommonSvc),
  ...

Passing no arguments keeps working as expected:
$ k4run
Error: missing gaudi options file.
Usage: k4run <options_file.py>, use --help to get a complete list of arguments

@atolosadelgado @BrieucF

Merging to get this into the nightlies since it seems no one has any complaints about this and it fixed the issue for me


world_physics.vmdl_c->PHYS not get string correctly

Describe the bug
when analyzing the deadline street_test-.pk, it is not possible to obtain a normal string when obtaining the PHYS in world_physics.vmdl_c

Expected behavior
perhaps it's due to the large file size? hope to obtain the string correctly
Relevant log output or exception with stacktrace
No response
What game does this happen in
deadlock
Reference file in a Source 2 game
Steam\steamapps\common\Deadlock\game\citadel\maps\street_test.vpk
What version of VRF are you using?
v10.2.3850

The problem here is "fast" colored text box. It does actually get stringified just fine, but it can't get displayed because the text viewer allocates so much memory.
You can dump the block with the cli utility.

The issue here is that street_test is such a big map, the string builder for PHYS block has a length of 1.3gb, and for some reason calling StringBuilder.ToString throws OOM due to some limitation of the .NET runtime.

so how to solve this?

so how to solve this?
rewritten ToString and export phys directly

so how to solve this?
rewritten ToString and export phys directly

any example code or it will fix in next version?


Update to DragonFly 4.6. Use https

r? @brson
(rust_highfive has picked a reviewer for you, use r? to override)

Thanks!


Tidy up admin options on school manage meters page

This PR covers a number of small cosmetic changes to the meters index page to tidy up the page for admin users:

[x] Changes the heading on the page to “Manage meters”
[x] Adds the name of the default issues admin for the school group (similar to what is now on the admin school group page) appearing for Energy Sparks admins only.
[x] Removes the “View target data” section, replacing it with a “View target data” link in the admin section of the Manage School menu
[x] Removes the “Manage tariffs” button from the page, as there’s an link in the Manage school menu
[x] Changes the text on the “Review meters” button (which links to new_admin_school_meter_review_path) to be “Pending DCC meter reviews”
[x] Changes the text on the “Meter reviews” button (which links to admin_school_meter_reviews_path) to be “Completed DCC meter reviews”
[x] Changes the “Completed DCC meter reviews” button so it only appear is there are any completed meter reviews
[x] Combines the remaining options in the alert alert-secondary mb-2 sections (the grey notices) into a single grey bar. Ordered as: Validate meter readings, School downloads, Manage Solar API feeds, Pending DCC meter reviews, Completed DCC meter reviews.
[x] Removes the “This may take some time!” warning

@ldodds default issues admin user partial and data_processing_turned_on_message tooltip added.  I think this one's ready for review again.


feat: allow custom-XML-serialization of lists/child-elements

the current implementation of custom serialization in JSON is actually a custom normalization.
Whatever is returned, it will be JSON-encdeded when needed.
unfortunately, this functionality is not there when custom-serializing for XML.
it allows strings only or casts the returns to strings. this prevents needed functionality.
Feature request: if serialize returns a list instead of a string, then the list is treated as child-items, that will then be serialized.
use case: https://github.com/CycloneDX/cyclonedx-python-lib/blob/afe0ba90ec211a89fdb57adc719ba09a0a6f92a1/cyclonedx/serialization/init.py#L88-L95

proposed changes
              elif prop_info.custom_type:
                  if prop_info.is_helper_type():
-                     SubElement(this_e, new_key).text = str(prop_info.custom_type.serialize(v))
+                     new_cont = prop_info.custom_type.serialize(v)
                  else:
-                     SubElement(this_e, new_key).text = str(prop_info.custom_type(v))
+                     new_cont = prop_info.custom_type(v)
+                 if isinstance(custom_val, list):  # content = list of children
+                     SubElement(this_e, new_key).extend(
+                         c.as_xml(view_=view_, as_string=False, element_name=None, xmlns=xmlns) for c in new_cont
+                     )
+                 else:  # content = text
+                     SubElement(this_e, new_key).text = str(new_cont)

Example implementation here:
serializable.patch.zip

obsolete. write your own normalizers, via #32


is https possible with hls?

I can stream hls over http without a problem and now I need to publish it on a https  site. Is it possible  to do that? Do I also have to encrypt my stream to do this?

We just succesfully stream hls over https. So I can close the issue.


Investigate OOM for maven builds

Maven CI pipeline builds are failing due to OOM errors. Investigate the root cause of this issue.
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=106707&view=logs&s=6884a131-87da-5381-61f3-d7acc3b91d76&j=b78b2312-96d2-579e-3173-f597ed388512

@srnagar Is this fully resolved now?

After Mitch increased the maven heap size, we haven't noticed this issue. I guess that was the fix. Will close this issue.


Popover Fixes

Details

We now confirm bank account deletion using a center alert modal style popover (this is bottom on mobile).
Fixed Issues
$ https://github.com/Expensify/App/issues/29729
PROPOSAL: https://github.com/Expensify/App/issues/29729#issuecomment-1765674068
Tests
Prerequisite: A bank account should be added to the user account.
Steps to add a bank Account
Make sure you are using the staging server (Go to Preferences -> Use Staging Server)

Click on Profile Icon -> Workspaces -> Click on a workspace
Click on Bank Account.
Click on Connect Online With Plaid
Choose Wells Fargo. Use the following credentials:
- Username: user_good
- Password: pass_good
- Mobile Code: credential_good
Select Plaid Saving.
Select both additional information checkboxes. Click Continue.
Accept terms. Click on Connect Account Information
Click on Allow
You come back to connect Account Page. Click Save & Continue

Test Steps:

Click on profile picture -> Wallet
In the bank accounts card, we have a list of bank accounts. Click on a bank account.
Click Delete.
Verify that the confirmation popover shows in the middle for wide screens,
Verify that the confirmation popover is bottom docked in mobile screens

[x] Verify that no errors appear in the JS console

Offline tests

Same as Tests Step.
QA Steps

Same as Tests Step.
PR Author Checklist

[x] I linked the correct issue in the ### Fixed Issues section above
[x] I wrote clear testing steps that cover the changes made in this PR

[x] I added steps for local testing in the Tests section
[x] I added steps for the expected offline behavior in the Offline steps section
[x] I added steps for Staging and/or Production testing in the QA steps section
[x] I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
[x] I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).

[ ] I included screenshots or videos for tests on all platforms
[ ] I ran the tests on all platforms & verified they passed on:

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

[x] I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
[x] I followed proper code patterns (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
[x] I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method

[x] If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:

[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is approved by marketing by adding the Waiting for Copy label for a copy review on the original GH to get the correct copy.
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I followed the guidelines as stated in the Review Guidelines
[x] I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] I verified that if a function's arguments changed that all usages have also been updated correctly
[x] If a new component is created I verified that:

[x] A similar component doesn't exist in the codebase
[x] All props are defined accurately and each prop has a /** comment above it */
[x] The file is named correctly
[x] The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
[x] The only data being stored in the state is data necessary for rendering and nothing else
[x] If we are not using the full Onyx data that we loaded, I've added the proper selector in order to ensure the component only re-renders when the data it is using changes
[x] For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
[x] Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
[x] All JSX used for rendering exists in the render method
[x] The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions

[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(themeColors.componentBG))

[x] If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[x] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
[ ] I have checked off every checkbox in the PR author checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native

Android: mWeb Chrome

iOS: Native

iOS: mWeb Safari

MacOS: Chrome / Safari

MacOS: Desktop

@neonbhai Can you complete the author checklist & fix the lint issue?

Reviewer Checklist

[x] I have verified the author checklist is complete (all boxes are checked off).
[x] I verified the correct issue is linked in the ### Fixed Issues section above
[x] I verified testing steps are clear and they cover the changes made in this PR

[x] I verified the steps for local testing are in the Tests section
[x] I verified the steps for Staging and/or Production testing are in the QA steps section
[x] I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)

[x] I checked that screenshots or videos are included for tests on all platforms
[x] I included screenshots or videos for tests on all platforms
[x] I verified tests pass on all platforms & I tested again on:

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[x] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

[x] If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
[x] I verified proper code patterns were followed (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
[x] I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is approved by marketing by adding the Waiting for Copy label for a copy review on the original GH to get the correct copy.
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I verified that this PR follows the guidelines as stated in the Review Guidelines
[x] I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] If a new component is created I verified that:

[x] A similar component doesn't exist in the codebase
[x] All props are defined accurately and each prop has a /** comment above it */
[x] The file is named correctly
[x] The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
[x] The only data being stored in the state is data necessary for rendering and nothing else
[x] For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
[x] Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
[x] All JSX used for rendering exists in the render method
[x] The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions

[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(themeColors.componentBG)

[x] If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[ ] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
[ ] I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native & iOS: Native

Android: mWeb Chrome  & iOS: mWeb Safari

MacOS: Chrome / Safari

MacOS: Desktop

@neonbhai
Bug: Delete action is not performed
https://github.com/Expensify/App/assets/85645967/23a1d26a-f298-414e-85f6-7b6a32c12024

Any update?

bump @neonbhai

@neonbhai Will this be ready for review tomorrow?

Thanks will review it tomorrow, meanwhile please test carefully and ensure there are no regressions. Resolve merge conflicts if any thanks!

Can you fix lint please?

Can we merge this one @jasperhuangg ?

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Deployed to staging by https://github.com/jasperhuangg in version: 1.4.13-0 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
failure ❌

🕸 web 🕸
success ✅

🚀 Deployed to staging by https://github.com/jasperhuangg in version: 1.4.13-0 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

🚀 Deployed to production by https://github.com/jasperhuangg in version: 1.4.13-8 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅


404页面显示错误

Describe the bug
404页面显示错误，在自己的站点和大佬的博客上访问都出现显示问题，切换主流浏览器均如下图所示：

Reproduction
https://yunyoujun.cn/404.html
System Info
System:
    OS: Windows 11 10.0.22631
    CPU: (16) x64 12th Gen Intel(R) Core(TM) i5-12500H
    Memory: 3.63 GB / 15.73 GB
  Binaries:
    Node: 20.7.0 - D:\Program Files\nodejs\node.EXE
    Yarn: 1.22.19 - D:\Program Files\nodejs\yarn.CMD
    npm: 10.2.3 - D:\Program Files\nodejs\npm.CMD
  Browsers:
    Edge: Chromium (120.0.2210.61)
    Internet Explorer: 11.0.22621.1

Used Package Manager
yarn
Validations

[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A, please open a GitHub Discussion instead.
[X] The provided reproduction is a minimal reproducible of the bug.

Closed in https://github.com/YunYouJun/valaxy/commit/fa470be207ed223ea56dfb0ec6810764c11a46b2.


Remove h5py requirement and made it optional.

Keras documentation says h5py is optional, but a recent commit 1ebec1e515bac4c4c4564a410c2de3ee33bb8a1e made it a requirement. Because there are problems installing h5py inside a virtualenv, I would suggest that it remains optional.
This fix uses the extras option to specify optional dependencies. Usage:
pip install 'package[h5py]'

This has been discussed a couple times before. There seems to be issues both ways.
Can we recap what the arguments are for making it optional, or not?

Something I've been thinking about -- not ideal, but for instances (like virtualenv) or odd use-cases (I've found myself in a few) where h5py plus HDF5 isn't feasible, could we create a weight saving backend using numpy?

could we create a weight saving backend using numpy?

model.get_weights() will return a list of numpy arrays (which can then be reinjected into model.set_weights). You could save this in any format that works for you (which is all save_weights is really doing).

Against h5py being a requirement:

h5py has system dependencies that most Python users do not have or can not install (Python development headers, HDF5 shared library with development headers)
h5py also requires heavyweight library Cython that requires GNU C/C++ development tools and takes a long time to install (compilation also fails hard if something is missing)
all above requirements make h5py difficult to install inside a virtualenv, consequently also keras
as @fchollet mentioned, model.get_weights() and model.set_weights() can be used for those who do not want to depend of h5py

Afaik scikit-learn comes with joblib as an alternative to pickle for dumping Python objects that may contain large NumPy arrays. But I like the HDF5 file format much more.

If it's just saving numpy grids, what about
http://docs.scipy.org/doc/numpy/reference/generated/numpy.ndarray.dump.html
?
On 9 September 2015 at 18:01, gw0<EMAIL_ADDRESS>wrote:

Against h5py being a requirement:

h5py has system dependencies that most Python users do not have or
can not install (Python development headers, HDF5 shared library with
development headers)
h5py also requires heavyweight library Cython that requires GNU
C/C++ development tools and takes a long time to install (compilation also
fails hard if something is missing)
all above requirements make h5py difficult to install inside a
virtualenv, consequently also keras
as @fchollet https://github.com/fchollet mentioned,
model.get_weights() and model.set_weights() can be used for those who
do not want to depend of h5py

Afaik scikit-learn comes with joblib as an alternative to pickle for
dumping Python objects that may contain large NumPy arrays. But I like the
HDF5 file format much more.
—
Reply to this email directly or view it on GitHub
https://github.com/fchollet/keras/pull/662#issuecomment-138817908.

--
Tennessee Leeuwenburg
http://myownhat.blogspot.com/
"Don't believe everything you think"

@tleeuwenburg the above could be use as a fallback when h5py is not available, I suppose. But this raises compatibility issues; is there any known way to quickly tell if a file is HDF5 or a pickle (some kind of header maybe)?

@fchollet You could check the file extension (eg. .h5 vs .pkl vs .npy). Additionally as far as I know in case of NumPy dumps there would be multiple files (one for each array).
Sources of recommended extensions:

.h5, .hdf5 for HDF5 format appears in https://en.wikipedia.org/wiki/Hierarchical_Data_Format (generate using h5py)
.pkl, .p for NumPy pickle format appears in https://docs.python.org/2/library/pickle.html and https://wiki.python.org/moin/UsingPickle (generate using ndarray.dump(file))
.npy for NumPy binary format appears in https://docs.scipy.org/doc/numpy/reference/generated/numpy.save.html (generate with numpy.save(file, arr))

I know this is long dead and that development is in tensorflow/tensorflow now but I was recently looking for a way to reliable serialized a trained model to an io stream (in my case specifically, io.BytesIO). I was surprised to learn that this is not possible.
@fchollet, what are your thoughts on allowing saving to arbitrary file streams using numpy.save?
This would involve creating a new module keras/saving/numpy_format.py and some logic in keras/saving/save.py:
if (save_format == 'h5' or (h5py is not None and isinstance(filepath, h5py.File))):
    if h5py is None:
         raise ValueError(...)
    save_model_to_hdf5(...)
elif save_format == 'tf' :
    saved_model_save.save(...)
else:
      save_model_to_numpy(...)   # no need to check for string vs file object, let numpy handle it

I'm willing to make a PR for this in tensorflow/tensorflow if this is a feature that makes sense.


SCSI command or ioctl pass-through vendor command

Hi all,
Does pyusb support usb ioctl vendor command?

@mcuee, I'm not familiar with these areas... can you take this one?

If I had to guess, and because PyUSB wraps libusb, it should generally be possible to create pretty much any USB request that is wanted, including any SCSI commands at the USB level.
On the other hand, since a generic driver is used to access the device (e.g.usbfs) instead of the appropriate class specific driver (e.g. for USB Mass Storage), I don't think ioctls would be available.  Plus we don't yet expose the associated file descriptor (and I don't know if libusb even supports that on all platforms).

I use Ubuntu(Linux) to develop python script.
So , i want to write/read USB vendor command via pyusb.
When uses USB vendor command access device , needs to use SCSI Command Descriptor Block.
Any examples for scsi access in pyusb ?

You should be able to translate the xusb.c example into pyusb. I will close this issue for now.

Another example: ST-Link v1 libusb example.
https://github.com/stlink-org/stlink/blob/develop/src/stlink-lib/sg.c


fix(Grid): Stacking doesn't appear to do anything

Steps to Reproduce

https://react.semantic-ui.com/collections/grid#grid-example-stackable
Resize the window
Also, try Chrome dev tools with "device toolbar" for testing mobile devices (e.g. "iPhone 5" in portrait mode)

Expected
The Grid columns should stack on top of one another when the window becomes smaller.
Result
Stacking seems to happen occasionally for desktop dynamic window resize, but not reliably.
Testcase
Docs show the issue, use: https://react.semantic-ui.com/collections/grid#grid-example-stackable

Related issue: #1931 (has a screenshot)

In fact, all works correctly, because columns are stacked. It works same as in SUI docs.
However, our docs aren't mobile friendly, they even doesn't define viewport. PRs that improves this are welcome.

@layershifter interesting. When using "Responsive" under Chrome emulated devices, it simply scales the 2 columns down and never stacks them. But, you're right... not using any emulation seems to work.

What happened to 2009's "mobile first"? ;)

@ericis It doesn't work because viewport isn't defined in our docs, see my reply.
However, SUIR and SUIR are responsive and perfectly works on mobile devices. BTW there is PR that will facilitate complex responsive markups, #1872.

What happened to 2009's "mobile first"? ;)

I have not seen any developer working with the mobile :smile This is not my priority, we have enough other tasks.


Using third party angular 1.x libs from angular 2

Greetings,
I have an existing project on Angular 1.x using Angular Material 1.x. I've faced with an issue that I can't use Angular Material 2 since it is in alpha stage and some really important components are missing so I decided to use Angular Material 1.x with Angular 2. But thats a problem too because I can't use, for instance, md-autocomplete component:
Error: Template parse errors:
'md-autocomplete' is not a known element:
...

So here is question: how to use third party components written in Angular 1.x inside Angular 2?

Hi, this isn't a support channel - I'd suggest asking this question on Stackoverflow.


New installation of prometheus not accessible from other hosts when using port 9090

What did you do?
Downloaded, unpacked and ran prometheus with default configuration
What did you expect to see?
Prometheus should be accessible through a web browser from another host on the network on the default port
What did you see instead? Under which circumstances?
Web browser from other hosts returns a 404 error when accessing http://pinode01:9090/metrics with the following text. (same error occurs with IP address vs hostname access)
404 page not found
Curl from localhost returns successfully
curl http://localhost:9090/metrics
Other web services all work as expected and are accessible across my network from this host e.g. python/nodejs/grafana/etc. The problem is specific to Prometheus and port 9090.
If I start prometheus on any other port, then I can access it across the network. However, there does not appear to be anything on my system using port 9090 so I'm very confused as to what is going on.
beirti@pinode01:~/prometheus/prometheus-2.19.1.linux-armv7 $ sudo netstat -anp | grep 9090
beirti@pinode01:~/prometheus/prometheus-2.19.1.linux-armv7 $

As there's nothing in the logs even with debug turned on, I don't know what else I can look for.
Environment
Raspberry Pi 4

System information
Linux 5.4.42-v8+ aarch64

Prometheus Version
prometheus-2.19.1.linux-armv7

Configuration
Just using the default configuration that came with the tarball

Logs

PS and Netstat output:
beirti@pinode01:~ $ ps -ef | grep prometheus
beirti    9024 12628  1 13:45 pts/0    00:00:00 ./prometheus --log.level=debug
beirti    8233  7934  0 13:45 pts/1    00:00:00 grep --color=auto prometheus
beirti@pinode01:~ $ sudo netstat -anp | grep 9024
tcp6       0      0 :::9090                 :::*                    LISTEN      9024/./prometheus
tcp6       0      0 ::1:57324               ::1:9090                ESTABLISHED 9024/./prometheus
tcp6       0      0 ::1:9090                ::1:57324               ESTABLISHED 9024/./prometheus

IFConfig output:
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet <IP_ADDRESS>  netmask <IP_ADDRESS>  broadcast <IP_ADDRESS>
        inet6 fe80::d734:b499:13af:beab  prefixlen 64  scopeid 0x20<link>
        ether dc:a6:32:86:ff:c5  txqueuelen 1000  (Ethernet)
        RX packets 313832  bytes 205978534 (196.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 202947  bytes 59591242 (56.8 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet <IP_ADDRESS>  netmask <IP_ADDRESS>
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 35239  bytes 19395541 (18.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 35239  bytes 19395541 (18.4 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Logs:
level=info ts=2020-06-23T12:40:17.460Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d
level=info ts=2020-06-23T12:40:17.460Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.19.1, branch=HEAD, revision=eba3fdcbf0d378b66600281903e3aab515732b39)"
level=info ts=2020-06-23T12:40:17.460Z caller=main.go:338 build_context="(go=go1.14.4, user=root@62700b3d0ef9, date=20200618-17:44:42)"
level=info ts=2020-06-23T12:40:17.460Z caller=main.go:339 host_details="(Linux 5.4.42-v8+ #1319 SMP PREEMPT Wed May 20 14:18:56 BST 2020 aarch64 pinode01 (none))"
level=info ts=2020-06-23T12:40:17.461Z caller=main.go:340 fd_limits="(soft=1024, hard=1048576)"
level=info ts=2020-06-23T12:40:17.461Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)"
level=info ts=2020-06-23T12:40:17.465Z caller=main.go:678 msg="Starting TSDB ..."
level=info ts=2020-06-23T12:40:17.465Z caller=web.go:524 component=web msg="Start listening for connections" address=<IP_ADDRESS>:9090
level=info ts=2020-06-23T12:40:17.481Z caller=head.go:645 component=tsdb msg="Replaying WAL and on-disk memory mappable chunks if any, this may take a while"
level=info ts=2020-06-23T12:40:17.482Z caller=head.go:706 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0
level=info ts=2020-06-23T12:40:17.482Z caller=head.go:709 component=tsdb msg="WAL replay completed" duration=670.12µs
level=info ts=2020-06-23T12:40:17.490Z caller=main.go:694 fs_type=EXT4_SUPER_MAGIC
level=info ts=2020-06-23T12:40:17.490Z caller=main.go:695 msg="TSDB started"
level=debug ts=2020-06-23T12:40:17.490Z caller=main.go:696 msg="TSDB options" MinBlockDuration=2h MaxBlockDuration=36h MaxBytes=0B NoLockfile=false RetentionDuration=15d WALSegmentSize=0B AllowOverlappingBlocks=false WALCompression=false
level=info ts=2020-06-23T12:40:17.490Z caller=main.go:799 msg="Loading configuration file" filename=prometheus.yml
level=debug ts=2020-06-23T12:40:17.492Z caller=manager.go:224 component="discovery manager scrape" msg="Starting provider" provider=string/0 subs=[prometheus]
level=debug ts=2020-06-23T12:40:17.492Z caller=manager.go:224 component="discovery manager notify" msg="Starting provider" provider=string/0 subs=[config-0]
level=debug ts=2020-06-23T12:40:17.492Z caller=manager.go:242 component="discovery manager scrape" msg="Discoverer channel closed" provider=string/0
level=info ts=2020-06-23T12:40:17.492Z caller=main.go:827 msg="Completed loading of configuration file" filename=prometheus.yml
level=info ts=2020-06-23T12:40:17.492Z caller=main.go:646 msg="Server is ready to receive web requests."
level=debug ts=2020-06-23T12:40:17.493Z caller=manager.go:242 component="discovery manager notify" msg="Discoverer channel closed" provider=string/0

What did you do?
What did you expect to see?
What did you see instead? Under which circumstances?
Environment

System information:
insert output of uname -srm here

Prometheus version:
insert output of prometheus --version here

Alertmanager version:
insert output of alertmanager --version here (if relevant to the issue)

Prometheus configuration file:

insert configuration here

Alertmanager configuration file:

insert configuration here (if relevant to the issue)

Logs:

insert Prometheus and Alertmanager logs relevant to the issue here

Of course, immediately after posting, I discovered the issue. I'll post it here in case anyone else encounters this strangeness. Nothing to do with portainer after all!
I have a docker swarm running on this host. There is a container that was bound to port 9090, but this did not show up in the netstat list. As the magic docker ingress network was swallowing this traffic, it appeared like it was going to prometheus and getting a 404 but was in fact going to one of the docker containers.
Top tip, always run 'docker ps' when trying to figure out what else might be swallowing network traffic.
CONTAINER ID        IMAGE                            COMMAND                  CREATED             STATUS                 PORTS                    NAMES
a52011cda331        voucher/vouch-proxy:latest-arm   "/vouch-proxy"           3 hours ago         Up 3 hours (healthy)   **9090**/tcp                 vouch-proxy_vouch-proxy.1.fesdct34tvjqecthivyjjpxut


Document the prescribed burn test parameters

The who, what, when, where with expected outcomes.

@svaleroc create a summary deck. Will enhance that with some additional details.


Save AdditionalFlags to env var

the  ${{ inputs.additional_flags }} syntax basically acts like a string interpolation, which in the case of multiline strings will break inside a bash command. So it is now first saved to an env var, which is then referenced in the code

No longer needed (did not really fix the underlying issue either).


VoxelFilter for TimedPointCloud, Filter method.

This makes the VoxelFilter ready for TimedPointCloud and
per-point unwarping.

Done with the corrections, PTAL

@wally-the-cartographer merge

Merge requested by authorized user gaschler. Merge queue now has a length of 2.


Update operator-ci.yaml

Description

Removed duplicate Arm/Amd Image build from GitHub action

Fixes #593
Type of change

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist

[ ] Tests have been added/modified and all tests pass.
[ ] Functionality/bugs have been confirmed to be unchanged or fixed.
[ ] I have performed a self-review of my own code.
[ ] Documentation has been updated or added where necessary.

Additional Context

You have pushed in your repo now create a PR


Inconsistent Language and Phrasing in Organizational Message

Issue Description:
The current text on the website contains some inconsistencies and redundancy in language that could be improved for clarity and impact. The specific sentence in question is:

"We are an Australian not-for-profit umbrella organization for open-source projects. We believe the open-source philosophy provides a resource-efficient channel to transfer knowledge and achieve innovation and education."

This sentence could be rephrased to enhance readability and maintain consistency with the overall messaging of the organization. The goal is to make the language more concise and aligned with the organization's mission and values.
Suggested Solution:

Rephrase the sentence to improve clarity and flow.
Ensure that the new phrasing is consistent with the organization's overall messaging and core values.

Example Revision:
"We are an Australian non-profit organization dedicated to supporting open-source projects. Our belief in the open-source philosophy drives us to create resource-efficient channels for knowledge transfer, innovation, and education."
Screenshot:

@ceilican I would like to work on this issue.Could you please assign this issue to me?


Fast ending for query with limit

Is your feature request related to a problem? Please describe.
Suppose we have a large table t and user execute the following query.
select * from t limit 1

We expect this query would end up once the first row is fetched, but currently it seems this query will scan the whole table.
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response

I think this is because limit is not pushed down. Similar question happens for top n.

Yes, I just introduce two phase limit in distributed mode before. Now I think local mode also need them.

Fixed by #4920.


feat: split reddit into 2 subcommands to add support for getting a specific post

Requested on the server.
This requires https://github.com/skyra-project/archid-components/pull/343

Instead of making this a subcommand, considering they take the same input type (but slightly different format), what about handling both cases without subcommands? That way we can expand it in the future and it won't clutter the chat input command list with more reddit subcommands (which is something that annoyed me from the old /convert)

As per Discord chat, subcommands are preferred.