libretuya-esphome: MQTT: realtek-ambz

Enabling MQTT in the ESPHome for "realtek-ambz" produces the error:
Processing sw09 (board: wr3; framework: arduino; platform: https://github.com/kuba2k2/libretuya.git)
--------------------------------------------------------------------------------
HARDWARE: RTL8710BN 125MHz, 256KB RAM, 788KB Flash
 - framework-arduino-api @ 3.0.0-a4cbfc+sha.3a4cbfc
 - framework-realtek-amb1 @ 0.0.0+v2022.06.21.sha.c4e44ef
 - library-flashdb@03500fa @ 3500.0.0-fa+sha.03500fa
 -<EMAIL_ADDRESS>@ 2.1.3-amb1+sha.5d6edaa
 -<EMAIL_ADDRESS>@ 6.0.0+sha.8b831c1
 - tool-ltchiptool @ 2.0.2+sha.7559033
LDF: Library Dependency Finder -> https://bit.ly/configure-pio-ldf
Dependency Graph
|-- AsyncMqttClient-esphome @ 0.8.6+sha.a659596
|-- ArduinoJson @ 6.18.5
Compiling .pioenvs/sw09/src/esphome/components/api/api_connection.cpp.o
....
In file included from .piolibdeps/sw09/AsyncMqttClient-esphome/src/AsyncMqttClient.h:4:0,
                 from src/esphome/components/mqtt/mqtt_backend_arduino.h:6,
                 from src/esphome/components/mqtt/mqtt_client.h:15,
                 from src/esphome/components/mqtt/custom_mqtt_device.h:7,
                 from src/esphome/components/mqtt/custom_mqtt_device.cpp:1:
.piolibdeps/sw09/AsyncMqttClient-esphome/src/AsyncMqttClient.hpp:14:22: fatal error: AsyncTCP.h: No such file or directory

******************************************************************
* Looking for AsyncTCP.h dependency? Check our library registry!
*
* CLI  > platformio lib search "header:AsyncTCP.h"
* Web  > https://registry.platformio.org/search?q=header:AsyncTCP.h
*
******************************************************************

compilation terminated.
*** [.pioenvs/sw09/src/esphome/components/mqtt/custom_mqtt_device.cpp.o] Error 1
========================= [FAILED] Took 10.31 seconds =========================

Add web_server component and it should work. Keep this issue open so that I remember to fix it.

:+1:

It compiles, but crashing on MQTT connection.

Hi,
i realized to late that MQTT for beken-72xx is not implemented yet (https://docs.libretuya.ml/docs/status/arduino/). An ESPHome  configuration with MQTT enabled compiles - but is also crashing on MQTT connections or shortly after the connection. Topics are sent once.
@kuba2k2   is implementing/fixing MQTT for beken-72xx planned in the near future? I need MQTT for ioBroker support...

It's not my priority currently. Also, I don't have ways to test it - I don't have any MQTT broker, except for mosquitto installed on my PC locally, which I tested and it didn't crash.

ok! Maybe i can help by providing some more information? Can i grab some logs somehow? The device is accessible only via network, i used cloudcutter to flash.

A device without UART access won't do. When I was fixing issues on various components, I even had a JTAG debugger attached sometimes.

I also have the same issue I believe.
CBU module (BK7231N) in a tongou rail switch.
Works fine on Esphome API, but crashes after 1 message on MQTT. (Mosquito broker in HASS that i use for all my other devices)

I also have the same issue I believe. CBU module (BK7231N) in a tongou rail switch. Works fine on Esphome API, but crashes after 1 message on MQTT. (Mosquito broker in HASS that i use for all my other devices)
Let me know if there are any logs I can get to assist

I think I’m running into the same issue.
I have the same board (CBU) and I can compile the firmware if I add the mqtt component.
However, as soon as the device starts I can only see a message in the console saying “MQTT Connected!” and this is the only message that gets constantly spammed into the console. No other updates for sensors or button are sent to the MQTT broker.
I can’t even access the device via its IP, but the web server is enabled in the configuration. I don’t know if it constantly restarts or what, I can perform OTA update though, so I guess it stays online.
Any help on this would be highly appreciated, let me know if I can provide you additional information or logs.

Same issue on my side. I've got a WRE2 Board in a power plug with an RTL8710BN chip. As long as I keep the mqtt component disabled / commanded it works. But ones I compile and download OTA with the mqtt component, the board is'nt anymore reachable and opens after a while the fallback hot spot. It seem's some how the WiFi connection will be cut of, because of the mqtt component and hangs somewhere on a loop. The topics will be created, so for very short moment the establishment of connection must be succeed. I'm using ioBroker as well, so no chance for the api component and HASS for me. @kuba2k2 Let me know how I can help, because without mqtt this power plug is just another lab rat for me.
That's my yaml in case it's useful.
  name: plug01
  friendly_name: plug01

rtl87xx:
  board: wr2e
  framework:
    version: dev

# Enable logging
logger:

# Enable Home Assistant API
#api:
#  encryption:
#    key: "NNmEHnn7ZGraG+GLnM1l9vkvern/aLGSRdV1SQtQtHs="

ota:
  password: "3855fb12edfaac040202d0493ace64de"

wifi:
  ssid: "mySSID"
  password: "myPassword"

  # Enable fallback hotspot in case wifi connection fails
  ap:
    ssid: "Plug01 Fallback Hotspot"

captive_portal:

# Example configuration entry
web_server:
  port: 80

binary_sensor:
  - platform: gpio
    pin:
      number: 05
      inverted: true
      mode:
        input: true
        pullup: true
    name: "TouchSwitch"
    on_press:
      - switch.toggle: relay
  - platform: status
    name: "TouchSwitch Status"

sensor:
  - platform: wifi_signal
    name: "Plug01 WiFi Signal"
    update_interval: 60s

switch:
  - platform: gpio
    name: "Relay"
    on_turn_on:
      then:
      - switch.turn_on: led
    on_turn_off:
      then:
      - switch.turn_off: led
    pin:
      number: 14
      inverted: true
    id: relay

  - platform: gpio
    name: "Status LED"
    pin:
      number: 19
      inverted: true
    id: led

status_led:
  pin:
    number: 12
    inverted: true

What version of the firmware are you using? Now that libretiny has been officially merged into esphome, I would suggest you try the official version to see if it works. I did some quick tests, and I found out that mqtt is working fine using the latest esphome release. However, I noticed that deep sleep is not supported anymore in the official release, which is what I'm currently struggling with, but in your case this should not be a problem if you need to control a plug.

@alessiocappa I am using the docker version from here (2023.9.0-dev) on my Pi 4 to manage and installed it according to this Tut. I flashed the Board with the Itchiptool v4.6.0. In the first place I used this yaml to got the device connected to my WiFi.
  friendly_name: plug01

rtl87xx:
  board: wr2e
  framework:
    version: dev

# Enable logging
logger:

# Enable Home Assistant API
api:
  encryption:
    key: "NNmEHnn7ZGraG+GLnM1l9vkvern/aLGSRdV1SQtQtHs="

ota:
  password: "3855fb12edfaac040202d0493ace64de"

wifi:
  ssid: "mySSID"
  password: "myPassword"

  # Enable fallback hotspot in case wifi connection fails
  ap:
    ssid: "Plug01 Fallback Hotspot"

captive_portal:

# Example configuration entry
web_server:
  port: 80

Have you link for me and the reader to this post to the official version as a docker container?
Thanks for the effort.

@alessiocappa  Ok, I guess I found it (here).
I was first confused, because in the device wizzard wasn't showing the WR2E board. So I choose something, and exchange the yaml configuration. Without the mqtt component same status. So my file and device still work.
Unfortunately the yaml wouldn't accept and compile with the mqtt component (see picture). It seems not to be available for the WR2E board with the RTL8710BN chip.
Or I am doing something wrong?

Which device platform are you using? Beken chip?

Newer versions of ESPHome (specifically the upstream version, not the fork) make MQTT compilation on Realtek impossible, due to the crashing issues. Older versions will compile (they didn't have such a check) but will obviously not work properly.
MQTT is incompatible with Realtek. I have not been able to get it to work yet - I don't know what makes it crash (and I've been searching for the cause).

@alessiocappa Ok, I guess I found it (here). I was first confused, because the device wizzard wasn't showing the WR2E board. So I choose something, and exchange the yaml configuration. Without the mqtt component same status. So my file and device still work.
Unfortunately the yaml wouldn't accept and compile with the mqtt component (see picture). It seems not to be available for the WR2E board with the RTL8710BN chip. Or I am doing something wrong?
Which device platform are you using? Beken chip?

@BinaryBrain86 sorry, I think I misread the chip you're using. Indeed, I'm using a CBU board (BK7231N) and MQTT seems to be working fine with the latest ESPHome version.

Newer versions of ESPHome (specifically the upstream version, not the fork) make MQTT compilation on Realtek impossible, due to the crashing issues. Older versions will compile (they didn't have such a check) but will obviously not work properly.
MQTT is incompatible with Realtek. I have not been able to get it to work yet - I don't know what makes it crash (and I've been searching for the cause).

@kuba2k2 Thanks for the information, and even more I appreciate you effort.
I was searching in the Repo for mqtt and found this:

I'm right the library here will be used for mqtt?
In that case you probably considered this (I know it's written ESP8266, but who knows).

I tried to go through some Python build scripts, but after a while I lost the thread.

This library is not used in ESPHome. The one used is called AsyncMqttClient-esphome.

Not sure I'm on the right spot, but in the PlatformIO.ini is still version 1.0.0 referenced.

2.0.0 Is already released. Not sure if it matter.

This file is not used for compilation, though it should have been updated too. This file doesn't affect errors.
As I have mentioned before, MQTT with this library is incompatible with Realtek. This is not about compilation errors or different versions - it crashes on runtime. There's nothing you can do by changing versions.


go/types: race-y initialization of Struct.offsets

This program doesn't seem to violate any documented constraints of the go/types package, but it fails under the race detector because of the "compute offsets on demand" code in go/types.(*StdSizes).Sizeof: http://play.golang.org/p/VI2ablwxtX

See also comment at go/types/type.go:125.


Still can't return direct with multi-action agent

I'm still getting this error even after this discussion was solved.
Am I doing something wrong?
This is my snippet of code
const agent = RunnablePassthrough.assign({
	agent_scratchpad: x => generatedScratchpad((x.intermediateSteps ?? []) as AgentStep[]),
}).pipe(prompt).pipe(this.verboseRunnable).pipe(currentLLM).pipe(new ProceduresOutputParser())

const agentExecutor = AgentExecutor.fromAgentAndTools({
	agent,
	tools,
	returnIntermediateSteps: true,
	maxIterations: 5,
})

that throws the error:
https://github.com/langchain-ai/langchainjs/blob/ed1f3fbcafdb494e7807f60d5ede74cf75f57b4b/langchain/src/agents/executor.ts#L433
Originally posted by @zAlweNy26 in https://github.com/langchain-ai/langchainjs/discussions/4631#discussioncomment-9563797

@dosu but in the discussion the maintainer said it was an oversight and that the tools with returnDirect set to true should work with multi-action agents.

https://github.com/langchain-ai/langchainjs/pull/4643#issuecomment-1986677391
The reason for not removing this detection mechanism in RunnableMultiActionAgent is that if you want to bypass this restriction, you can use RunnableSingleActionAgent. You can try the code below:
const agent = AgentRunnableSequence.fromRunnables(
  [
    RunnablePassthrough.assign({
      agent_scratchpad: x => generatedScratchpad((x.intermediateSteps ?? []) as AgentStep[]),
    }),
    prompt,
    this.verboseRunnable,
    currentLLM,
    new ProceduresOutputParser(),
  ],
  {
    name: “YourAgentName",
    streamRunnable,
    singleAction: true,
  }
);

@jeasonnow thanks for the reply, I'll try it!

@jeasonnow it seems that the AgentRunnableSequence is not exported in the index.ts file of the agents.
Also, based on the TODO on the class, it seems deprecated, do you know what is the new alternative to it?

@jeasonnow it seems that the AgentRunnableSequence is not exported in the index.ts file of the agents. Also, based on the TODO on the class, it seems deprecated, do you know what is the new alternative to it?

Try this
import { RunnableSequence } from "@langchain/core/runnables"

Try this
import { RunnableSequence } from "@langchain/core/runnables”;

const agent = RunnableSequence.from([
    RunnablePassthrough.assign({
      agent_scratchpad: x => generatedScratchpad((x.intermediateSteps ?? []) as AgentStep[]),
    }),
    prompt,
    this.verboseRunnable,
    currentLLM,
    new ProceduresOutputParser(),
  ], ‘YourAgentName');
agent.singleAction = true;

@jeasonnow the singleAction property does not seem to exist in RunnableSequence class

@jeasonnow it seems that the AgentRunnableSequence is not exported in the index.ts file of the agents. Also, based on the TODO on the class, it seems deprecated, do you know what is the new alternative to it?

Alternative in general is LangGraph
Will still try to look into this as it seems like a thorn for lots of folks but we generally see LangGraph as the more flexible future.


Do nothing if there's only one column

I'm using breakAt and it works as intended. The only problem is that Macy still sets every item position even if there's only one column. It would be more efficient to do nothing and let the browser and the user's CSS rules do its work, specially on mobile devices.

I second this - inline styles also remain on masonry elements after destroying the Macy instance, breaking the page layout.


Function's "read" access to GQL API doesn't work

Describe the bug
When a function is allowed only "read" operation on a GQL API, and the function's source tries to run a Get query via AppSync GraphQL client using IAM credentials, then it constantly gets response code 401. Adding any other operation along with "read" fixes this issue.
Amplify CLI Version
4.18.0
To Reproduce

Create a GraphQL API via amplify api add
Create a function via amplify function add
Select category "api" to be accessible via this new lambda function
Select only "read" as permissible operation
Run GraphQL API query from lambda function using AppSync GraphQL client

Expected behavior
The Get query should execute successfully.
Desktop:

OS: Linux Mint 19.01
Node Version: v13.12.0

Additional context
When only "read" operation is permitted, then the AmplifyResourcesPolicy.Properties.PolicyDocument.Statement[0] from cloudformation template looks like this:
{
	"Effect": "Allow",
	"Action": [
		"appsync:Get*",
		"appsync:List*"
	],
	...
}

this results in a 401 response. If I add appsync:GraphQL to allowed actions, then this problem is solved. Adding another operation along with "read" (e.g. "create", "update") also adds this action to the policy statement, which solves the problem. Perhaps the cloudformation template generation is missing appsync:GraphQL while it's necessary for AppSync client to work properly.
Sample lambda code:
const AWS = require('aws-sdk');
const appsync = require('aws-appsync');
const async = require('async');
const gql = require('graphql-tag');
require('cross-fetch/polyfill');

const region = process.env.REGION
const apiSkylightGraphQLAPIEndpointOutput = process.env.API_SKYLIGHT_GRAPHQLAPIENDPOINTOUTPUT

AWS.config.update({
  region: region
});

const credentials = AWS.config.credentials;

exports.handler = async (event) => {

  console.log('event received:' + JSON.stringify(event));

  //create appsync client - using IAM permissions
  const graphqlClient = new appsync.AWSAppSyncClient({
    url: apiSkylightGraphQLAPIEndpointOutput,
    region: region,
    auth: {
      type: 'AWS_IAM',
      credentials: credentials
    },
    disableOffline: true
  });

  const getLight = gql`query GetLight($id: ID!) {
      getLight(id: $id) {
          id
          name
          owner
      }
  }`;

  //execute the query
  try {
    console.log('executing getLight query');

    //execute the get query to see if the light exists
    const light = await graphqlClient.query({
      query: getLight,
      variables: {
        id: event.arguments.input.id
      }
    });

    return {
      statusCode: 200,
      body: JSON.stringify({message: 'Success'})
    };
  } catch (err) {
    return {
      statusCode: 400,
      body: JSON.stringify({message: err.message})
    };
  }
};

Error:
{
    "errorType": "Error",
    "errorMessage": "Network error: Response not successful: Received status code 401",
    "graphQLErrors": [],
    "networkError": {
        "errorType": "Error",
        "errorMessage": "Response not successful: Received status code 401",
        "response": {
            "size": 0,
            "timeout": 0
        },
        "statusCode": 401,
        "result": {
            "errors": [
                {
                    "errorType": "UnauthorizedException",
                    "message": "Permission denied"
                }
            ]
        },
        "stack": [
            "Error: Response not successful: Received status code 401",
            "    at throwServerError (/var/task/node_modules/apollo-link-http/lib/bundle.umd.js:35:17)",
            "    at /var/task/node_modules/apollo-link-http/lib/bundle.umd.js:58:13",
            "    at processTicksAndRejections (internal/process/task_queues.js:97:5)"
        ]
    },
    "message": "Network error: Response not successful: Received status code 401",
    "stack": [
        "Error: Network error: Response not successful: Received status code 401",
        "    at new ApolloError (/var/task/node_modules/apollo-client/bundle.umd.js:85:32)",
        "    at /var/task/node_modules/apollo-client/bundle.umd.js:1039:45",
        "    at /var/task/node_modules/apollo-client/bundle.umd.js:1411:21",
        "    at Array.forEach (<anonymous>)",
        "    at /var/task/node_modules/apollo-client/bundle.umd.js:1410:22",
        "    at Map.forEach (<anonymous>)",
        "    at QueryManager.broadcastQueries (/var/task/node_modules/apollo-client/bundle.umd.js:1405:26)",
        "    at /var/task/node_modules/apollo-client/bundle.umd.js:988:35",
        "    at processTicksAndRejections (internal/process/task_queues.js:97:5)"
    ]
}

Hello @adeelnawaz we do have docs here on how to access your GraphQL API from lambda.
Docs: https://docs.amplify.aws/cli/function#graphql-from-lambda
Should you have any issues with this set up please comment below.

@adeelnawaz You'll have to give "create" access as well along with "read" to execute the GraphQL operations from the Lambda function. Please let us know if after adding "create" permissions as well you're not able to execute the GraphQL operations.

Up ! I have the exact same error

Any news here ? I'm still having the issue

I get 401 error using a similar approach. Have you found a solution?

Nope, and I am going to switch to firebase in the near future because this github and its 800+ issues are tiresome, gl though

Nope, and I am going to switch to firebase in the near future because this github and its 800+ issues are tiresome, gl though

Ah, I agree, It is sometimes hard to find a straight answer to some niche questions regarding AWS. Btw, it seems like I found an approach that works. You should try adding an AppSync Policy for your Lambda IAM Role i.e., AWSAppSyncInvokeFullAccess. Also, make sure you allowed 'iam' public or private queries in your schema for your Light type definition.


Lazy loading data

Is it possible to load data in a lazy way? Having a virtual row length of i.e. 10.000 and loading sets of e.g. 5 * pageSize rows.
If not so that would be a nice feature.
Sorting over the whole set could be done on the data server, filtering may be only local.

Approve
onsdag 1 april 2015 skrev Ronald Poell<EMAIL_ADDRESS>
Is it possible to load data in a lazy way? Having a virtual row length of
i.e. 10.000 and loading sets of e.g. 5 * pageSize rows.
If not so that would be a nice feature.
Sorting over the whole set could be done on the data server, filtering may
be only local.
—
Reply to this email directly or view it on GitHub
https://github.com/wootapa/watable/issues/21.

--
//Andreas

I know some asks for this, so it'll be something to consider in a future release. Thanks!

You're welcome. I hope we can see this soon. Thanks.


Background on mobile changes from grey to white, make breakpoint CSS fix

Hi,  I would like to get involved in the project, If you would assign me this task I will work on it for you.    Thanks.

@MyBaBB - hey Brett I'd love to collaborate! Sorry I missed your message...
Can I follow up with you on Slack? - join here https://chat.climatetechhandbook.com

Hi, thanks for responding back to me,  However after reviewing your code I
realized that it is written in TSX and I am writing JSX. Although I could
figure it out, I would not be efficient in this language.    I can do the
css with no problem.  Or I could convert it.   TSX would be my next
language to learn so I will this and follow you until I get faster at
writing TSX.   Thank you.
On Tue, Apr 23, 2024 at 4:40 PM futuresoup @.***> wrote:

@MyBaBB https://github.com/MyBaBB - hey Brett I'd love to collaborate!
Sorry I missed your message...
Can I follow up with you on Slack? - join here
https://chat.climatetechhandbook.com
—
Reply to this email directly, view it on GitHub
https://github.com/climate-tech-handbook/climate-tech-handbook/issues/442#issuecomment-2073661237,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A4VTGWKLUDT5XCWQ7WNXFKLY63WPTAVCNFSM6AAAAABE6AV5QGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANZTGY3DCMRTG4
.
You are receiving this because you were mentioned.Message ID:
@.***
com>

ok, Me and Mike Watton have connected.


Only catch reflection exceptions

With regards to the API design, I'd suggest only catching the most specific exceptions that are relevant to you. For example, most of the methods which invoke methods via reflection do it like so:
public boolean isWifiApEnabled() {
	try {
		return (Boolean) isWifiApEnabled.invoke(wm);
	} catch (Exception e) {
		Log.e(TAG, "", e);
	}
	return false;
}

I'd suggest only catching the exceptions to do with reflection. That way, if a genuine exception occurs inside one of the hidden API methods, then it will get thrown to the consumer of your API.
The tricky part is trying to identify if there are any checked exceptions (ones which must be caught or thrown in the hidden API, because it may well differ depending on the version of Android which provides the API.
I'm happy to submit pull requests for this and other issues I'll submit, just documenting now for prosterity.

I'm thinking that I should probably not catch any exception. If the reflection invoke() call fails, silently logging the error and returning a zero value - false, null, -1, etc - doesn't seem like the best approach.
What do you think?


Windwos 11 Visual Studio  22 Cmake Build Problem

Hello.
At root of fresh master branch git clone I've executed a command
cmake -G "Visual Studio 17 2022" -A Win64

I've got an error
CMake Warning:
  No source or binary directory provided.  Both will be assumed to be the
  same as the current working directory, but note that this warning will
  become a fatal error in future CMake releases.

CMake Deprecation Warning at CMakeLists.txt:2 (cmake_policy):
  Compatibility with CMake < 2.8.12 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.

-- Selecting Windows SDK version 10.0.19041.0 to target Windows 10.0.22000.
CMake Error at CMakeLists.txt:7 (project):
  Failed to run MSBuild command:

    C:/Program Files/Microsoft Visual Studio/2022/Community/MSBuild/Current/Bin/amd64/MSBuild.exe

  to get the value of VCTargetsPath:

    Microsoft (R) Build Engine version 17.2.1+52cd2da31 for .NET Framework
    Copyright (C) Microsoft Corporation. All rights reserved.

    Build started 6/2/2022 6:49:39 PM.
    Project "C:\Users\User\Desktop\Vulkan\CMakeFiles\3.23.2\VCTargetsPath.vcxproj" on node 1 (default targets).
    C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Current\Bin\amd64\Microsoft.Common.CurrentVersion.targets(824,5): error : The BaseOutputPath/OutputPath property is not set for project 'VCTargetsPath.vcxproj'.  Please check to make sure that you have specified a valid combination of Configuration and Platform for this project.  Configuration='Debug'  Platform='Win64'.  You may be seeing this message because you are trying to build a project without a solution file, and have specified a non-default Configuration or Platform that doesn't exist for this project. [C:\Users\User\Desktop\Vulkan\CMakeFiles\3.23.2\VCTargetsPath.vcxproj]
    Done Building Project "C:\Users\User\Desktop\Vulkan\CMakeFiles\3.23.2\VCTargetsPath.vcxproj" (default targets) -- FAILED.

    Build FAILED.

    "C:\Users\User\Desktop\Vulkan\CMakeFiles\3.23.2\VCTargetsPath.vcxproj" (default target) (1) ->
    (_CheckForInvalidConfigurationAndPlatform target) ->
      C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Current\Bin\amd64\Microsoft.Common.CurrentVersion.targets(824,5): error : The BaseOutputPath/OutputPath property is not set for project 'VCTargetsPath.vcxproj'.  Please check to make sure that you have specified a valid combination of Configuration and Platform for this project.  Configuration='Debug'  Platform='Win64'.  You may be seeing this message because you are trying to build a project without a solution file, and have specified a non-default Configuration or Platform that doesn't exist for this project. [C:\Users\User\Desktop\Vulkan\CMakeFiles\3.23.2\VCTargetsPath.vcxproj]

        0 Warning(s)
        1 Error(s)

    Time Elapsed 00:00:00.92

  Exit code: 1

-- Configuring incomplete, errors occurred!
See also "C:/Users/User/Desktop/Vulkan/CMakeFiles/CMakeOutput.log".

How to fix it?
And, generally writing, I want just compile example and run one of them.
How to get this without IDE? Cmake must be enough.

I'm still on VS2019, where CMake works out of the box without an IDE. The error states something about a missing config, so did you try explicitly selecting e.g. a debug config? nd what CMake version are you using?

Thanks for reply,
latest just downloaded cmake, latest visual studion and the last commit
from the current repo.
Can please suggest what you mean by debug config?
On Thu, Jun 2, 2022, 21:01 Sascha Willems @.***> wrote:

I'm still on VS2019, where CMake works out of the box without an IDE. The
error states something about a missing config, so did you try explicitly
selecting e.g. a debug config? nd what CMake version are you using?
—
Reply to this email directly, view it on GitHub
https://github.com/SaschaWillems/Vulkan/issues/952#issuecomment-1145156105,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ARNHLCXXFI466VI66CNN6DDVNDZHHANCNFSM5XVNQWGA
.
You are receiving this because you authored the thread.Message ID:
@.***>

You should use "-A x64" if you are trying to target 64bit. Win64 means nothing to CMake afaik

As @MattGuerrette noticed, the syntax for newer VS versions is slightly different. I have updated the build instructions accordingly.


Update Install Instructions to be More Explicit About sudoing

Update the installation instructions to be more clear about how to run the install in sudo mode. Fixed #518

awesome thankya!


Segfault if trying to use certain builders before GTK is initialized

(This is partially duplicated from https://github.com/gtk-rs/gir/issues/1590, because I think that's where the fix should ultimately go, even though the bug itself affects gtk4-rs)
Using some builders before initializing GTK can cause a segfault. Instead, the generated builder should check if GTK has been initialized, and panic if not.
use gtk4::prelude::*;
use gtk4::{Application, ApplicationWindow, glib};

const APP_ID: &str = "me.annahope.gtk4-rs-segfault";

fn build_ui(app: &Application) {
    let window = ApplicationWindow::builder()
        .application(app)
        .title("Segfault")
        .build();  // Segfaults if GTK hasn't been initialized.

    window.present();
}

fn main() -> glib::ExitCode {
    let app = Application::builder().application_id(APP_ID).build();
    // app.connect_activate(build_ui); // Doesn't segfault, as expected
    build_ui(&app); // Segfaults.
    app.run()
}

Stacktrace
gtk_style_provider_get_settings 0x0000000101dfd1c4
gtk_css_value_initial_compute 0x0000000101e926bc
gtk_css_static_style_compute_value 0x0000000101ea2384
gtk_css_static_style_new_compute 0x0000000101ea0ebc
gtk_css_static_style_get_default 0x0000000101ea0c78
gtk_css_node_init 0x0000000101e94ca4
g_type_create_instance 0x00000001015bf428
g_object_new_internal 0x00000001015ab838
g_object_new_with_properties 0x00000001015ab0e4
gtk_css_widget_node_new 0x0000000101eaa4ac
gtk_widget_init 0x0000000101e4124c
g_type_create_instance 0x00000001015bf428
g_object_new_internal 0x00000001015ab838
g_object_new_with_properties 0x00000001015ab0b0
glib::object::Object::new_internal object.rs:1490
glib::object::Object::with_mut_values object.rs:1425
glib::object::ObjectBuilder<O>::build object.rs:1634
gtk4::auto::application_window::ApplicationWindowBuilder::build application_window.rs:420
gtk4_segfault::build_ui main.rs:7
gtk4_segfault::main main.rs:18
core::ops::function::FnOnce::call_once function.rs:250
std::sys_common::backtrace::__rust_begin_short_backtrace backtrace.rs:155
std::rt::lang_start::{{closure}} rt.rs:159
[Inlined] core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once function.rs:284
[Inlined] std::panicking::try::do_call panicking.rs:559
[Inlined] std::panicking::try panicking.rs:523
[Inlined] std::panic::catch_unwind panic.rs:149
[Inlined] std::rt::lang_start_internal::{{closure}} rt.rs:141
[Inlined] std::panicking::try::do_call panicking.rs:559
[Inlined] std::panicking::try panicking.rs:523
[Inlined] std::panic::catch_unwind panic.rs:149
std::rt::lang_start_internal rt.rs:141
std::rt::lang_start rt.rs:158
main 0x0000000100edbbd0
start 0x000000019a4b60e0

This is now fixed


Behat loops infinitely for *.scenarios files

As described in https://github.com/Behat/Behat/issues/1067, I am experiencing infinite looping when using a *.scenarios file to segment my tests.
My scenarios file looks like this:
features/path/to/some/feature1.feature
features/path/to/some/feature2.feature

Running Behat like this:
vendor/bin/behat path/to/my/scenariosfile.scenarios

Behat loops indefinitely, rerunning the same tests over and over again. I have to manually terminate the process by pressing Ctrl-C.
Behat version: v3.4.3
I see that you closed the issue I referenced above for insufficient information. If this is not sufficient information to investigate, please let me know what else I can provide. Thanks!

PHP version in my testing environment is:
# php --version
PHP 5.6.31 (cli) (built: Oct 10 2017 02:22:55)
Copyright (c) 1997-2016 The PHP Group
Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
    with Zend OPcache v7.0.6-dev, Copyright (c) 1999-2016, by Zend Technologies
    with Xdebug v2.5.5, Copyright (c) 2002-2017, by Derick Rethans

I have experienced the same problem, and i have found out what caused that !
My behat.yml file contains configuration for several suites, when I switch back to old default configuration without custom suites, it stops looping "infinitely".
Now let me give some informations about my Symfony project :
php : 7.1.4
behat/behat                          v3.5.0             Scenario-oriented BDD framework for PHP 5.3
behat/gherkin                        v4.5.1             Gherkin DSL parser for PHP 5.3
behat/mink                           v1.7.1             Browser controller/emulator abstraction for PHP
behat/mink-browserkit-driver         1.3.3              Symfony2 BrowserKit driver for Mink framework
behat/mink-extension                 2.3.1              Mink extension for Behat
behat/mink-selenium2-driver          v1.3.0             Selenium2 (WebDriver) driver for Mink framework
behat/symfony2-extension             2.1.4              Symfony2 framework extension for Behat
behat/transliterator                 v1.2.0             String transliterator
That problem happened too when behat/behat was v3.4.3 like  AC-TimRourke.
My behat.yml configuration for suites looks like  :
    suites:
        suite1:
            paths: [ '%paths.base%/features/software/Suite1' ]
            contexts:
                - FirstContext
                - SecondContext
                - ThirdContext
        suite2:
            paths: [ '%paths.base%/features/software/Suite2' ]
            contexts:
                - FirstContext
                - SecondContext
                - ThirdContext
        suite3:
            paths: [ '%paths.base%/features/software/Suite3' ]
            contexts:
                - FirstContext
                - SecondContext
                - ThirdContext
        suite..N:
            paths: [ '%paths.base%/features/software/Suite..N' ]
            contexts:
                - FirstContext
                - SecondContext
                - ThirdContext

And this configuration for suites caused vendor/bin/behat failed.scenarios to loop "infinitely".
But it does not seem to loop infinitely. Actually it seems to loop the number of times you have a suite configured. If i have 10 suites, it will loop 10 times.
I have modified Behat\Behat\Gherkin\Specification\Locator\FilesystemScenariosListLocator::locateSpecifications(Suite $suite, $locator) to check how many times it runs, and it ran 10 times if i had 10 suites. (I dont know if it gives a clue to you, but thats what i did to get my clues)
When I switched back to simple configuration for suites, it ran the scenarios only once as expected !
simple configuration for suites  :
    suites:
        default:
            contexts:
                - FixturesContext:
                - FeatureContext:
                - TableContext:

What do you think about that ?

Cannot reproduce in the latest version, closing


Expose import_cython_function

Closes gh-2764.
The documentation could use beefing up, but it seemed reasonable to make sure I'm putting everything in the right place first.

Codecov Report

Merging #2807 into master will increase coverage by <.01%.
The diff coverage is 80%.

@@            Coverage Diff             @@
##           master    #2807      +/-   ##
==========================================
+ Coverage    86.2%   86.21%   +<.01%
==========================================
  Files         323      323
  Lines       66762    66777      +15
  Branches     7455     7456       +1
==========================================
+ Hits        57555    57570      +15
  Misses       8015     8015
  Partials     1192     1192

First round of review comments has (hopefully) been addressed.

Ok, second round of changes made.

Thanks for the fixes and this great contribution. Assuming the tests pass, this is good to merge (holding off as farm is busy will LLVM6 changes). Thanks again.

Tests failed on older Python's due to strcmp on error messages, looks like a minor fixup ?

Ok, hopefully this fixes the issue. Might have gone a little overboard pulling in a regex.

Tests are now passing. Thanks once again for this contribution. Merging.

Thanks for reviewing @stuartarchibald. One remaining thing it might be nice to do is talk to the Cython folks about the fused-types name mangling scheme. It being more memorable it would be useful both here and in SciPy.


Altona sync: Received block parent root doesn't match our head

Describe the bug
Initial sync is suspended with:
2020-07-19 13:54:31  [SYNC]             warn: Received block parent root doesn't match our head head=0x9d388a55e7b865f8bf10cfbaf1312d94a91fd9a9d67b1bb6fa6505dfe91fd1a3, headSlot=142161, blockParent=0x729ab4115fd5c7949b90e24edfb4a92f9092b2714eba7570ca2e0ac03a6b269b, blockSlot=142163

Previous log:
2020-07-19 13:54:27  [SYNC]             info: Fetching blocks for 142131...142162 slot range
...
2020-07-19 13:54:29  [CHAIN]            info: Processed new chain head newChainHeadRoot=0x9d388a55e7b865f8bf10cfbaf1312d94a91fd9a9d67b1bb6fa6505dfe91fd1a3, slot=142144, epoch=4442
2020-07-19 13:54:29  [SYNC]             info: Sync progress - currentEpoch=4442, targetEpoch=4442, speed=10.1 slots/s, estimateTillComplete=0 hours
2020-07-19 13:54:29  [SYNC]             info: Fetching blocks for 142162...142225 slot range
2020-07-19 13:54:29  [SYNC]          verbose: updating block target 142225
...
2020-07-19 13:54:30  [CHAIN]            info: Processed new chain head newChainHeadRoot=0x729ab4115fd5c7949b90e24edfb4a92f9092b2714eba7570ca2e0ac03a6b269b, slot=142161, epoch=4442
...
2020-07-19 13:54:30  [CHAIN]            info: Processed new chain head newChainHeadRoot=0x729ab4115fd5c7949b90e24edfb4a92f9092b2714eba7570ca2e0ac03a6b269b, slot=142161, epoch=4442
2020-07-19 13:54:31  [SYNC]             info: Imported blocks for slots: 142163,142164,142165,142166,142168,142169,142170,142172,142173,142176,142177,142178,142179,142181,142182,142183,142184,142187,142188,142190,142192,142193,142194,142195,142196,142197,142199,142200,142201,142203,142204,142206,142207,142210,142211,142213,142214,142215,142216,142217,142218,142219,142220,142221,142224,142225

Analyse

Block 142163 has parent root at 0x729ab4115fd5c7949b90e24edfb4a92f9092b2714eba7570ca2e0ac03a6b269b which is block 142161 and it's a correct block
But our calculated head is somehow not correct and it points to an obsolete block  142144 which we processed already in previous round
It seems that we fetch 142162...142225 range too early right after block 142144 (should be after block 142161) when the previous block range process were not finished

Sometimes I got same issue as well:
2020-07-21 09:03:03  [SYNC]             info: Imported blocks for slots: 152447,152449,152450,152452,152453,152454,152455,152457,152458,152459,152460,152461,152462,152463,152464,152465,152466,152468,152469,152470,152472,152474,152475,152476,152477,152487,152488,152489,152490,152491,152492,152494,152495,152496,152497,152498,152499,152500,152501,152502,152503,152504,152505,152507,152508,152509,152510
2020-07-21 09:03:03  [SYNC]             warn: Received block parent root doesn't match our head head=0xa36779e7674615c5a2b08d798550888d58d51ecf83c315401bfece863f6d48c1, headSlot=152477, blockParent=0x23d89d8c4717154eeeeabc0d242ef9b45a118847e9a5bc76476a72074b397ee3, blockSlot=152487

we can see that we miss some blocks from 152478 - 152486, probably some peers did not response correctly to us. I'm gonna add some more logs for it.
The good news is we can recover (sync will continue) if this happens.


Node v18 not allowed

Is there an existing issue for this?

[X] I have searched the existing issues

Current behavior
When installing the package I get the error "The engine "node" is incompatible with this module. Expected version "^12.19.0 || ^14.15.0 || ^16.13.0". Got "18.12.1""
Minimum reproduction code
No response
Steps to reproduce

npm ci
Get error

Expected behavior
Node v18 should work fine as oidc-provider supports it: https://github.com/panva/node-oidc-provider/blob/efd5344216017860fb01f015e3ae3a29273f1f89/package.json#L106
NestJS version
9.2.0
Packages versions

Node.js version
18.12.1
In which operating systems have you tested?

[ ] macOS
[X] Windows
[X] Linux

Other
No response

Released v1.1.1.
Thanks!


fix(#729): options sizes adjusted for mobile

Description
Options section reported as too big for mobile screens, I tried make it a bit more responsive. I will put a SS down below, it might be a little more smaller if requested.
discord username: İlker Sarica#7138
closes #issue: #729

Please describe your changes. Also describe your aim and content. Do not forget to list the dependencies required caused by those changes.
## Things to check before creating a PR

[ ] I have inspected my topic, checked.
[ ] If it is a core feature, executed detailed tests.

Creating PR rules

[ ] PR must be created for an issue with approved tag. Otherwise PR will be rejected.
[ ] Relevant issue number: The issue number related to PR must be attached to head of PR header, after prefix after prefix # must be attached in parenthesis. A header like this could be used "prefix(#issue_number): PR header" .
[ ] A descriptive and understandable title: The PR title should clearly describe the nature and purpose of the changes. The PR title should be the first thing displayed when the PR is opened. And it should follow the semantic commit rules. For example, a title like "docs(#issueId): Add README.md" can be used.
[ ] Related file selection: Only relevant files should be touched and no other files should be affected.
[ ] Format and Lint Suitability : The code should be made in accordance with a certain format standard and examined according to the lint rules.
[ ] Clean commit history: The commits where the changes are made should be clear and organized.
[ ] Opening PR when job is completed: PR should be opened when job is completed and sent for review by other team members.

Changes

[ ] A new feature (a change that adds a new feature, not a breaking change)
[ ] A new refactor (a change that is not a breaking change, that improves the readability or performance of the code)
[ ] A breaking change
[ ] Documentation change

How were these changes tested?
Please describe the tests you did to test the changes you made. Please also specify your test configuration.
Test Configuration:

Firmware version:
Hardware:
Toolchain:
SDK:

I added the UX/UI label, let's get a review from them.

@handekaratas96 @absolutezero13  we need to take feedback for this. We need to learn if option sizes are accessible for mobile and also we are open to other feedback.

I don't know what is options, couldn't understand. Could you tell me a bit more about it? @absolutezero13

There has been some updates in the Figma which impacts this one as well: https://www.figma.com/file/sctw6xtcdoFOfmE0gC97Ft/Afetharita.com?node-id=2349%3A8093&t=f6awKxgk9198heIf-0 Please have a look. But I think it is still work in progress.
Once the first iteration is finalised, we can continue with this PR.

what is the related issue for this task?

There has been some updates in the Figma which impacts this one as well: https://www.figma.com/file/sctw6xtcdoFOfmE0gC97Ft/Afetharita.com?node-id=2349%3A8093&t=f6awKxgk9198heIf-0 Please have a look. But I think it is still work in progress.
Once the first iteration is finalised, we can continue with this PR.

is it finalised? where should I ask? will continue accordingly

you can ask to me @absolutezero13 , I am leading the afetharita.com's design team. you can tag me on frontend text channel on discord


Error: Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/appintegrations'

I ran a replication job from a public bucket (will also try from a bucket I own):
skyplane cp -r s3://imagenet-bucket s3://sarah-skylark-eu-north-1/imagenet-bucket
This resulted in the following error:
_____ _   ____   _______ _       ___   _   _  _____
/  ___| | / /\ \ / / ___ \ |     / _ \ | \ | ||  ___|
\ `--.| |/ /  \ V /| |_/ / |    / /_\ \|  \| || |__
 `--. \    \   \ / |  __/| |    |  _  || . ` ||  __|
/\__/ / |\  \  | | | |   | |____| | | || |\  || |___
\____/\_| \_/  \_/ \_|   \_____/\_| |_/\_| \_/\____/

13:07:37 [ERROR] Bucket location imagenet-bucket is not public. Assuming region is us-east-1.
⠼ Querying objects in imagenet-bucket13:07:41 [ERROR] Bucket location imagenet-bucket is not public. Assuming region is us-east-1.

Will transfer 1153 objects totaling 143.41GB from aws:us-east-1 to aws:eu-north-1
    VMs to provision: 1x aws:eu-north-1, 1x aws:us-east-1
    Estimated egress cost: $2.87 at $0.02/GB
    synset_labels.txt => imagenet-bucket/synset_labels.txt
    train-00000-of-01024 => imagenet-bucket/train-00000-of-01024
    train-00001-of-01024 => imagenet-bucket/train-00001-of-01024
    train-00002-of-01024 => imagenet-bucket/train-00002-of-01024
    ...
    validation-00124-of-00128 => imagenet-bucket/validation-00124-of-00128
    validation-00125-of-00128 => imagenet-bucket/validation-00125-of-00128
    validation-00126-of-00128 => imagenet-bucket/validation-00126-of-00128
    validation-00127-of-00128 => imagenet-bucket/validation-00127-of-00128
Continue? [Y/n]: Y
Transfer starting (Tip: Enable auto-confirmation with `skyplane config set autoconfirm true`)

Storing debug information for transfer in /tmp/skyplane/transfer_logs/20220921_130747/client.log
✓ Initializing cloud keys (5/5) in 5.72s
✓ Provisioning gateway instances (2/2) in 45.08s
✓ Installing gateway package (2/2) in 25.50s
🚀 143.41GB transfer job launched
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/appintegrations'
13:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/s3'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:06 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/iotsecuretunneling'
13:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/workdocs'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/ssm-contacts'
13:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/connect-contact-lens'
13:18:07 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/rum'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/s3control'
13:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/ecr'
13:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/secretsmanager'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/cloudfront'
13:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/location'
13:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/fms'
13:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/elastictranscoder'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:08 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/greengrassv2'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/wafv2'
13:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/kinesisvideo'
13:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/cloudfront'
13:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/sns'
13:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/kinesisanalyticsv2'
13:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/iottwinmaker'
13:18:09 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/organizations'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/signer'
13:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/waf-regional'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/ecr'
13:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/kms'
13:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/location'
13:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/ds'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/service-quotas'
13:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/kms'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/datasync'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/lexv2-models'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/quicksight'
13:18:12 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/macie'
13:18:12 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/quicksight'
13:18:13 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/macie'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:13 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/neptune'
13:18:12 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/inspector'
13:18:13 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/resiliencehub'
13:18:11 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/workmail'
13:18:10 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/mediaconnect'
  Transfer progress (3189 of 3189 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 GiB ? 0:00:0013:18:12 [ERROR] Error running complete_upload: [Errno 24] Too many open files: '/Users/sarahwooders/repos/skyplane/env/lib/python3.7/site-packages/botocore/data/servicecatalog'

I tested another transfer skyplane cp s3://sarah-skylark-us-west-1 s3://sarah-skylark-eu-north-1 -r --debug (where I own both buckets) and chunks started transferring without an issue.

@sarahwooders Can you first run ulimit -n 8192 in your shell then run the transfer again? This setting only lasts for the current shell session but should fix this issue. If it works, please add a new entry to the FAQ with the fix (if it works) https://skyplane.org/en/latest/faq.html.

This should be fixed with better multipart transfer logic.


update front end

User interface (UI) should be updated in line with latest Figma prototype iteration
Preview:

clean up front end designs

will have to make new figma iteration before sending mockup designs to Andri or Harshit

As discussed during meetings / UI review with @marissathai:

[ ] Fix spacing underneath notifications stack header when opened
[ ] Take out small subject header since it's on the main stack
[ ] include “Clear All” if the sections have a notification card underneath
[ ] If the section is already empty then the “Clear All” shouldn’t show up
[ ] Blocking pop up snack bar should disappear in 25 seconds
[ ] width of pop up snack bar should end up on edge of the Notification Center sidebar
[ ] Extended width would make the message only have two lines and would convince the users that its a shorter message so they have time to read it all, instead of three lines that would turn off the user's interest
[ ] User Joined Session <-- all words should be all capitalized
[ ] because the subject header is in bold it makes sense for it to be capitalized to convince users that it's an important message
[ ]


Network: fwmark use all podcidr as src match

Description
This PR sets the first IP of the pod CIDR as the IP used to Masquerade the src of the packets incoming from a nodeport service.

/merge


panic: runtime error: invalid memory address or nil pointer dereference in ledger snapshot comparision

System information
fabric version: release-2.5
OS & Version: Linux
Expected behaviour
Run ledger snapshot comparison as normal.
Actual behaviour
panic: runtime error: invalid memory address or nil pointer dereference in SnapshotReader
Backtrace
Root location:
https://github.com/hyperledger/fabric/blob/release-2.5/core/ledger/kvledger/txmgmt/privacyenabledstate/snapshot.go
	if !exist {
		logger.Infow("Data file does not exist. Nothing to be done.", "filepath", dataFilePath)
		return nil, nil
	}

In line 450, returns snapshotReader as nil.
func (r *SnapshotReader) Next() (string, *SnapshotRecord, error) {
	if !r.cursor.move() {
		return "", nil, nil
	}

	snapshotRecord := &SnapshotRecord{}
	if err := r.dataFile.DecodeProtoMessage(snapshotRecord); err != nil {
		return "", nil, errors.WithMessage(err, "error while retrieving record from snapshot file")
	}
	return r.cursor.currentNamespace(), snapshotRecord, nil
}

In lines 504-514, uses the SnapshotReader without a nil checking.
log info:
panic: runtime error: invalid memory address or nil pointer dereference

[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x1524d26]

goroutine 1 [running]:

github.com/hyperledger/fabric/core/ledger/kvledger/txmgmt/privacyenabledstate.(*SnapshotReader).Next(0x0, 0x0, 0x0, 0xc0000e4280, 0x0, 0x0)
 github.com/hyperledger/fabric/core/ledger/kvledger/txmgmt/privacyenabledstate/snapshot.go:505 +0x26
github.com/hyperledger/fabric/internal/ledgerutil.Compare(0x7ffeefbff997, 0x43, 0x7ffeefbff9db, 0x4b, 0x16c4950, 0xd, 0x0, 0x0)
github.com/hyperledger/fabric/internal/ledgerutil/compare/compare.go:144 +0x5f1
main.main()
github.com/hyperledger/fabric/cmd/ledgerutil/main.go:72 +0x259

@BlockFuzz How did you build the binary? Or where did you pick up the binary?

I believe this is resolved with the new image and binary approach, please try v2.5.0-beta and re-open if still an issue.


Offline installation of this module?

Hi
Is there any way to install this module offline. I tried npmbox and it unboxes but when i try to run it shows error - "Cannot find module". My server is in a closed network and has no access to internet. Please help.
Thanks in advance.

I guess you also have to add all peer dependencies. You can also have a look at https://github.com/npm/npm/issues/1349


MM-18075 Reuse output of /jira view in the output of /jira create

Summary
This pull request reuses code which generates view for /jira view  command and produces same view for /jira create as an ephemeral post visible only to the person who created the issue.

Ticket Link

Fixes #420
Jira: https://mattermost.atlassian.net/browse/MM-18075

I've updated the pull request. This is how it looks.

I've updated the pull request. This is how it looks.

@iamsayantan @mickmister I like how it posts both publicly and privately with information. Good stuff @iamsayantan !
@mickmister In the future, perhaps we can consider making the public post use the "Meta-Data in RHS Pane" to display extra information about the Jira ticket in the RHS - so it stays slim in the channel, but can be expanded to be viewed in the RHS optionally.
Example:

The functionality I'm referring to is here Under props:card - https://developers.mattermost.com/integrate/incoming-webhooks/#parameters

/update-branch


"HTTP request failed" when using hardware wallet with MetaMask and trying to download a file from an existing dataset

This issue was reported by @TheStroj on Gitter:

Hey guys, wanted to provide some feedback and ask some questions about the commons marketplace:

Using a hardware wallet account (in MetaMask), I get the "HTTP request failed" error when trying to download a file from an existing dataset. When trying to publish a dataset with that account, it seems to be stuck on the signing loading wheel.

what hardware wallet?

The wallet I'm having this issue with is a Trezor One (newest stable firmware, version 1.8.0).

Interestingly, I get a MetaMask confirmation (containing the transaction info, including transaction price and gas fee) after I get the HTTP error, but nothing happens afterwards (not even one hour later).

Hey @TheStroj, would you be able to test this again with your setup? We deployed many changes in the last days around the consuming process and this issue here might have been fixed too. Thanks!

Tested three different dataset files, and one worked, two didn't - still the same error as before ("HTTP request failed"). Tried waiting for half an hour, but didn't go through. As before, I get a MetaMask confirmation (containing the transaction info, including transaction price and gas fee) after I get the HTTP error, but now I also get an extra confirmation after the HTTP error (the one labelled Contract Interaction). So I get the HTTP error, then soon after the first confirmation, and then after a while also the second one (whereas before, I only got the first confirmation after the error).

@TheStroj Can you verify if this error is happening with all accounts from hardware wallet or there is no difference between ones with hardware wallet and non-hardware wallet.

Tried to do things a bit more systematically this time. I tested 4 different datasets, and downloaded the first file for each of them, with both the hardware and non-hardware wallets:

https://commons.oceanprotocol.com/asset/did:op:091dc3b04aad459ea7a59ad152ddbe184ae2b2b3837c4879abe56fcc3a2af377
Hardware: HTTP request failed (once), Error consuming assets (multiple times)
Non-hardware: HTTP request failed (once), Error consuming assets (multiple times)

https://commons.oceanprotocol.com/asset/did:op:0e2f45bfc79d450c955a677db521c238b201eae30dcf44979e1d6ad337d761b3
Hardware: HTTP request failed (once), Error consuming assets (multiple times)
Non-hardware: Error consuming assets (multiple times)

https://commons.oceanprotocol.com/asset/did:op:2f9624ab05764a5e8f9727fb660cad77505d86d8f8e14c408d2b6098912d3097
Hardware: works
Non-hardware: HTTP request failed (multiple times), works

https://commons.oceanprotocol.com/asset/did:op:b3bb62769a3d4d52960a2390ff33eb6319b324519c7b4509b3bfb9a3bcbafb68
Hardware: works
Non-hardware: works

Observations:

Apart from the occasional "HTTP request failed" error, there doesn't seem to be any difference between hardware and non-hardware wallets for all 4 datasets. So the errors could indeed be the same as #86.
Datasets 1 and 2 throw the "Error consuming assets" after 4 confirmations (tested at least twice for all variations).
Datasets 3 and 4 work as intented.
Occasionally, I got a "HTTP request failed" for 3 of the 4 datasets, but then the next time it would go back to the "Error consuming assets" error (for datasets 1 and 2) or to working normally (for dataset 3). Every time it would happen just once, with the exception of dataset 3 with a non-hardware account, where it happened multiple times in a row - after 3 tries, it started working though. So I couldn't effectively replicate the error - it seemed to appear randomly as I was testing.

This asset fails every time for me (worked 0/5 tries). Could be that remote file is not there anymore and Brizo is failling to retrieve it. Solution would be to do periodic health checks on assets and provide clear error message to the user.
Works (3/5 tries)
Works (4/5 tries)
Works (5/5 tries)

There are still random failures on consume flow that we are resolving and are tied to stability of network or services.
I did not detect any difference between hardware wallet or not using hardware wallet. So I will be closing this issue and add comments on thread about consume files (https://github.com/oceanprotocol/commons/issues/86)


Error running post-install hook when there is a space in the Windows username

To reproduce this error, create a new Windows user with a space in their username (e.g., "User Name"). Then install MicroDrop using the default options and try downloading and installing any of the standard plugins (e.g., the dmf_control_board_plugin) using the MicroDrop gui. Here's the traceback:
2016-11-29 11:28:52 [INFO:microdrop.app]:   running post install hook for wheelerlab.dmf_control_board_plugin
2016-11-29 11:29:01 [INFO:root]: Traceback (most recent call last):
  File "C:\Users\New User\MicroDrop\lib\site-packages\microdrop\app.py", line 208, in __init__
    plugin_manager.post_install(p)
  File "C:\Users\New User\MicroDrop\lib\site-packages\microdrop\plugin_manager.py", line 98, in post_install
    try_admin=True, working_dir=hooks_path)
  File "C:\Users\New User\MicroDrop\lib\site-packages\run_exe\__init__.py", line 87, in run_exe
    output = run_func(exe, params, True)
  File "C:\Users\New User\MicroDrop\lib\site-packages\run_exe\__init__.py", line 50, in run_func
    (exe, params, os.getcwd(), return_code))
RuntimeError: Error running: on_plugin_install.bat "C:\Users\New User\MicroDrop\python.exe"
  (in C:\Users\New User\Documents\MicroDrop\plugins\dmf_control_board_plugin\hooks\Windows).
Process returned error code: 1

2016-11-29 11:29:01 [ERROR:root]: Error running post-install hook for dmf_control_board_plugin.
Traceback (most recent call last):
  File "C:\Users\New User\MicroDrop\lib\site-packages\microdrop\app.py", line 208, in __init__
    plugin_manager.post_install(p)
  File "C:\Users\New User\MicroDrop\lib\site-packages\microdrop\plugin_manager.py", line 98, in post_install
    try_admin=True, working_dir=hooks_path)
  File "C:\Users\New User\MicroDrop\lib\site-packages\run_exe\__init__.py", line 87, in run_exe
    output = run_func(exe, params, True)
  File "C:\Users\New User\MicroDrop\lib\site-packages\run_exe\__init__.py", line 50, in run_func
    (exe, params, os.getcwd(), return_code))
RuntimeError: Error running: on_plugin_install.bat "C:\Users\New User\MicroDrop\python.exe"
  (in C:\Users\New User\Documents\MicroDrop\plugins\dmf_control_board_plugin\hooks\Windows).
Process returned error code: 1

Note that once you've executed these steps, you can reproduce the error from the MicroDrop environment prompt through the following commands:
> cd C:\Users\New User\Documents\MicroDrop\plugins\dmf_control_board_plugin\hooks\Windows
> on_plugin_install.bat "C:\Users\New User\MicroDrop\python.exe"

   User\MicroDrop\python.exe""=="" was unexpected at this time.

The problem seems to be related to the way in which Windows batch files handles spaces in path names.

I implemented a fix for the dmf_control_board_plugin. A similar fix will have to be made for all MicroDrop plugins.
Instead of maintaining a separate .bat file for all plugins, we should maybe consider implementing a default on_plugin_install hook (that could be overridden only where necessary). That way, we could apply fixes similar to the one linked above in a single place for the vast majority of plugins.


SqlException: A connection was successfully established with the server, but then an error occurred during the login process. (provider: Shared Memory Provider, error: 0 - No process is on the other end of the pipe.)

I have deployed a Blazor .NET 7 app to IIS on a server and when I try to access the database I get the following error.
Win32Exception: No process is on the other end of the pipe.
SqlException: A connection was successfully established with the server, but then an error occurred during the login process. (provider: Shared Memory Provider, error: 0 - No process is on the other end of the pipe.)
The app works fine on my development PC inside VS 2022.
I saw this article and tried the below options, but it didn't work.
https://learn.microsoft.com/en-us/ef/core/what-is-new/ef-core-7.0/breaking-changes#encrypt-true

If the server has a certificate, but it is not trusted by the client, then TrustServerCertificate=True to allow bypassing the normal trust mechanisms.
Explicitly add Encrypt=False to the connection string.

connection string:
"DefaultConnection": "Server=.;Database=******;Integrated Security=SSPI;Encrypt=False"

Can you switch your server from . to tcp:localhost?, this will expose the actual error message instead of  No process is on the other end of the pipe. because the stream has been disconnected by the server.

ok.. I changed to tcp:localhost. recycled the app pool.
"DefaultConnection": "Server=tcp:localhost;Database=********;Integrated Security=SSPI;Encrypt=False"
still getting the same error. When I try again I get the following error. Getting the same error until I recycle the app pool.
  You might want to enable your sa account on your Sql Server using Sql Server Management Studio or Azure Data Studio and specify the UID and PWD in the connection string instead of the Integrated Security = SSPI or if you need to want to use Integrated Security make sure IIS Instance for your Blazor app uses your windows account in your application pool because the default account on application pool might be referenced as a different account i.e. NT Service\<ApplicationPoolName> which might not exist on the Sql Server.

hi, I tried the sa login as well. still same. App pool is using local system.
SqlException: Login failed for user 'sa'.
connection string:
"DefaultConnection": "Server=tcp:localhost;Database=*****;User Id=sa;Password=****************;Integrated Security=False;MultipleActiveResultSets=true;TrustServerCertificate=True;Encrypt=False"
screenshot of the error:
https://ibb.co/6vSnGYN
Im inclined to try .NET 6 to see if it resolves the issue

I don't think it's an issue with .NET7 or .NET6 nor SqlClient but a configuration issue with your Sql Server sa account or IIS's application pool identity. To check if the sa account has access, have you tried connecting to your Sql Server with the Sql Server Authentication with sa account with SSMS? If you're unable to login to your sa account, you have 2 options.
Option 1 - Ensure the sa account is enabled:
The sa account might be disabled, you may need to use Windows Authentication option in SSMS and manually enable it.
Databases > Security > Logins > sa > Login Properties > Status
"Permission to connect to database engine" is set to Grant
"Login" is set to Enabled
Option 2 - Explicitly set the IIS Application Pool Identity to a Windows account:
I'm not an expert in IIS as it's out of scope of my expertise, but if you have a windows account added in the logins to have access to your db, you try explicitly specifying your windows credentials in IIS Manager
Application Pools > "Your_Blazor_Apps_application_pool_name" > Advanced Settings > Identity > Custom account
and specify that username and password there.
Also, in your connection string, when you specify the user id and password, you can exclude Integrated Security = false and if you specify TrustServerCertificate=True, you don't need to specify Encrypt=False and vice versa.

Any updates? I am facing the same problem

@RafaelxFernandes This issue does not look like a client driver issue, but more of IIS setup issue. The login fails for the provided user. You need to see what credentials have passed to the server and why server is rejecting them. Maybe server logs could be helpful.

I was with the same error message.
change your .csproj
false
It seems to be InvariantGlobalization sent the incorrect credentials when you try to connect to your SQL Server database.
It solved to me.

Closing as stale and solutions are discussed above.


Defang generate with Redis should automatically add x-defang

I generated a project with defang generate which ended up looking like this:
services:
  service1:
    restart: always
    build:
      context: .
      dockerfile: Dockerfile
    environment:
      - REDIS_HOST=redis
      - REDIS_PORT=6379

  redis:
    image: redis:alpine
    ports:
      - 6379:6379

Good starting point, but we should make sure that generated code includes x-defang-redis: true if it includes Redis at all.

Also, even with x-defang-redis: true the code wouldn't work because of https://github.com/DefangLabs/defang/issues/547


Not working on iOS or Safari

Apparently you cannot access microphone via getUserMedia in Safari on OSX and Safari/Chrome on iOS due to OS limitation, so the recorder is not working.
I think a reference to which browsers are currently supported would be helpful.

Thanks for your issue.


Feature request: hide jailbreak for specific app

Is it possible to to hide the jailbreak for a specific app?
I installed the SMBC Bank app and tried using Choicy, DopamineBlackList, but none of them worked. Only Dopamine's hidejailbreak feature works on it, but it's such a hassle to do every time (when the jailbreak is restored, the Sileo icon pops up in a different place, and its permissions get reset).

not possible

not possible

So is it possible to keep the Sileo icon in the correct place and prevent permissions from being reset when the jailbreak restored?

not possible

So is it possible to keep the Sileo icon in the correct place and prevent permissions from being reset when the jailbreak restored?

Not really as it being removed is important to prevent apps from detecting it being installed. It's a feature, not a bug.

Are use California Coast Credit Union, even if I reboot my iPhone into a non-jailbroken state, the app will not let me get to the sign in screen, but if I open Dopamine and enable the hide my jailbreak feature, I can open the bank app. But if I am jailbroken, and it's not hidden, and I reboot into non-jailbroken state, it's still won't let me open the bank app, the only way I can open it while non-jailbroken is to open the Dopamine app and hide the jailbreak even though I'm not currently jailbroken. This setting saves even if I reboot my iPhone from a jailbroken state or from a non-jailbroken state. It's curious that this app can detect the jail break even after I reboot my iPhone, but that dope mean is also able to hide in the jail break, even when I'm not in jailbroken.

TLDR: It's curious that my bank app can detect the jailbreak even after I reboot my iPhone, yet dopamine is able to hide the jailbreak from said bank app while not in a jailbroken state.

I use California Coast Credit Union, even if I reboot my iPhone into a non-jailbroken state, the app will not let me get to the sign in screen, but if I open Dopamine and enable the hide my jailbreak feature, I can open the bank app. But if I am jailbroken, and it's not hidden, and I reboot into non-jailbroken state, it's still won't let me open the bank app, the only way I can open it while non-jailbroken is to open the Dopamine app and hide the jailbreak even though I'm not currently jailbroken. This setting saves even if I reboot my iPhone from a jailbroken state or from a non-jailbroken state.
For some reason (while not jailbroken) I can only switch the hide my jailbreak feature on once and then it disappears and I can't disable the hide my jailbreak anymore till I actually jailbreak again... rebooting keeps the same hidden feature enabled (it saves the setting) and I can't turn it back to the normal setting till I jailbreak again - at which point it has turned it off (normal).

try Dopamine-roothide

What are the limitations of roothide


Awattar "last day" after update

Hi,
first of all thanks for the wonderful integration, I love it. After the update 2 days ago, I see now for the Awattar (at) sensor the actual day, and after 14pm the data for tomorrow (so far so good). BUT now, additionally I always see the last day also. Is this what you want? I have to change my diagrams now because I then need the slices 25-48 for today and 49-72 for tomorrow (because slice 1-24 is now yesterday).
I also deleted awattar sensor and set it up newly, the same situation.
e.g: today is 4.2.2024 10am, and I see all data from 3.2.2024 and todays data. After 14pm I will see also tomorrows data, but yesterdays data won't dissapear.

Hi, this is by intention: Yesterdays data is needed for EPEX Spot Sensor.
Please adjust your diagrams accordingly.

Just for confirming, this is new since last update, right?
04.02.2024 11:51:47 Steffen Zimmermann @.***>:

Hi, this is by intention: Yesterdays data is needed for EPEX Spot Sensor[https://github.com/mampfes/ha_epex_spot_sensor].
Please adjust your diagrams accordingly.
—
Reply to this email directly, view it on GitHub[https://github.com/mampfes/ha_epex_spot/issues/105#issuecomment-1925700188], or unsubscribe[https://github.com/notifications/unsubscribe-auth/BD5NB35D2G7V2Z23JVD36ZLYR5R4FAVCNFSM6AAAAABCYWNKKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVG4YDAMJYHA].
You are receiving this because you authored the thread.


Make # links open tabs

I came across https://github.com/mildlygeeky/craft-instruction-links wich will open tabs from instructions. it would be nice if this was in your plugin as well 🥇

https://github.com/mildlygeeky/craft-instruction-links doesn't do anything regarding tab links (if we are talking about tabs on the Edit screen), and as far as I know, it's not possible to link to tabs from field instructions.
How can I replicate this?

Oh I am sorry... You are right the craft instructions links plugin does not open a tab from the edit screen.
In fact it would be nice if a link could open a tab in edit view like this:
please fill out the details.
and then open the tab "details"...
I know it has to be done with js... the link itself is not sufficient enough.


Fixed StateMachine validate function

Fixed with this, https://github.com/koushikr/easy-fsm/pull/6


Don't run tests if on docs.

This will either work or not, I think.

This isn't working the way I want yet.

@phildini I'm going to close this, since we're not using Travis anymore.
Feel free to reopen it if needed or to create a ticket on what you want implemented (maybe in beefore?).


Deleting CRDs lead to dataloss (fortunately on test cluster)

What happened?
We had a cluster that was running the 0.10 azure provider, and I needed to upgrade to 0.15ish. It had 19 CRDs, not the 17 0.15 has, so we removed the azure crossplace specific CRDs in a batch, as there was no time efficient way to determine which kubernetes-api-named CRD matched which kubebuilder-named file on disk.
This then lead to a cascading delete of all the managed resources (but we didn't know about it immediately). What we observed was a stall on the delete, which eventually corrected itself, and being used to Kubernetes and CRDs, we didn't immediately panic.
We then uploaded the new CRDs, uploaded a new deployment object for the provider, and then watched in horror as it reconciled the pending deletes deleting all our databases, accounts etc.
How can we reproduce it?
The above should be sufficient
What environment did it happen in?
Crossplane version:
0.10 + v0.15.0-rc.0-3-g1627754

Hi @rbtcollins, thanks for raising this issue.
Do I follow correctly that you:

Stopped the 0.10 Azure provider (i.e. removed or scaled down its deployment).
Deleted all 0.10 Azure CRDs.
Installed new 0.15 Azure CRDs
Started the 0.15 Azure provider

If so, the behaviour you described is what I would expect - deleting a CRD deletes all of the CRs defined by that CRD. What I suspect happened here is that deleting the CRDs set a deletion timestamp on all of your Azure managed resources - i.e. marked them for deletion. Typically Kubernetes will immediately delete resources once the deletion timestamp is set, but the Crossplane provider adds a finalizer to the resources. The API server waits for this finalizer to be removed before completing the deletion - giving the provider time to potentially delete your external resources correspondingly. In this instance the deletion of the CRDs and their defined CRs would have been blocked because there was no provider running to process the deletes and remove the finalizers. As soon as you deployed the new 0.15 provider it would have seen that all of its resources had deletion timestamps set and thus processed the deletes.
One way to guard against this is to set deletionPolicy: Orphan on all of your resources - even as a temporary measure when undertaking potentially risky migrations or maintenance. When this policy is set Crossplane will orphan rather than delete your Azure resources if their corresponding managed resources are deleted.

Hi @rbtcollins, thanks for raising this issue.
Do I follow correctly that you:

Stopped the 0.10 Azure provider (i.e. removed or scaled down its deployment).
Deleted all 0.10 Azure CRDs.
Installed new 0.15 Azure CRDs
Started the 0.15 Azure provider

If so, the behaviour you described is what I would expect - deleting a CRD deletes all of the CRs defined by that CRD. What I suspect happened here is that deleting the CRDs set a deletion timestamp on all of your Azure managed resources - i.e. marked them for deletion. Typically Kubernetes will immediately delete resources once the deletion timestamp is set, but the Crossplane provider adds a finalizer to the resources. The API server waits for this finalizer to be removed before completing the deletion - giving the provider time to potentially delete your external resources correspondingly. In this instance the deletion of the CRDs and their defined CRs would have been blocked because there was no provider running to process the deletes and remove the finalizers. As soon as you deployed the new 0.15 provider it would have seen that all of its resources had deletion timestamps set and thus processed the deletes.
One way to guard against this is to set deletionPolicy: Orphan on all of your resources - even as a temporary measure when undertaking potentially risky migrations or maintenance. When this policy is set Crossplane will orphan rather than delete your Azure resources if their corresponding managed resources are deleted.

Yes, that was the sequence. Is that deletion of CR's done via ownerReferences in the crossplane case, or is it some underlying system behaviour I just haven't encountered before?
We did have external deletion protection in place, but I'm not sure if it was via deletionPolicy: Orphan or something else @kornelione can shed light on that. (But whatever it was it wasn't honoured).

Yes, that was the sequence. Is that deletion of CR's done via ownerReferences in the crossplane case, or is it some underlying system behaviour I just haven't encountered before?
We did have external deletion protection in place, but I'm not sure if it was via deletionPolicy: Orphan or something else @kornelione can shed light on that. (But whatever it was it wasn't honoured).

is it some underlying system behaviour

I believe so. The CRD documentation says:

When you delete a CustomResourceDefinition, the server will uninstall the RESTful API endpoint and delete all custom objects stored in it.

is it some underlying system behaviour

I believe so. The CRD documentation says:

When you delete a CustomResourceDefinition, the server will uninstall the RESTful API endpoint and delete all custom objects stored in it.

This is expected behavior of CRDs in Kubernetes and there isn't much Crossplane can do to prevent deletion of CRs when CRD is deleted. Feel free to reopen.


Support date-time format in model-util

Expected Behaviour
(Placeholder) When generating a string with format equal to date-time, model-util should recognize the format and generate a realistic date-time value.
Actual Behaviour
Reproduce Scenario (including but not limited to)
Steps to Reproduce
Platform and Version
Sample Code that illustrates the problem
Logs taken while reproducing problem

Sorry, I remember we discussed this, but can you put some more details in this issue?
Does this not address what you're after?:
https://github.com/adobe/ride/blob/develop/utilities/ride-model-util/src/main/java/com/adobe/ride/utilities/model/ModelObject.java#L431
Is the value generated not realistic?
Thanks!
Ted

Hi @tedcasey, sorry, I don't remember specifics, and I don't know if this has been addressed since I first logged the issue. But it appeared at the time that, given a schema with type: string and format: date-time, Ride's model-util either did not generate any kind of date-time-like value, or generated a date-time-like value that didn't conform to the date-time production as defined in RFC 3339, which JSON Schema uses as the specification for the date-time format.
If you're familiar with ISO 8601 dates, which are used in XML Schema, I think that's a pretty good reference point for this. RFC 3339 says it's a "profile" (i.e. a subset) of ISO 8601.

@tedepstein , ok, I'll check it out.  Thanks for the additional info!
Ted


usage logging

log taxon/name detail API requests and name matching results in db to generate stats by datasets and larger taxonomic groups. Consider to also log entire downloads & searches in the future

Came out as 3rd highest priority after portal and editor!

see also gbif/gbif-api#46 and Sp2000/colplus#16


RTnetlink answers: file exists

Hi. Apologies if this is answered elsewhere, but I've been stuck on this for a very long while and I really want to solve it. I have googled to no avail. I know the charts are deprecated but any comment helps.
This is how I install and configure the chart on my cluster:
helm install pine \
  --set env.LOCAL_NETWORK="<IP_ADDRESS>\/8\,<IP_ADDRESS>\/12\,<IP_ADDRESS>\/24" \
  --set env.OVERRIDE_DNS_1=<IP_ADDRESS> \
  --set env.OVERRIDE_DNS_2=<IP_ADDRESS> \
  --set env.OPENVPN_CONFIG=ca_vancouver \
  --set env.OPENVPN_OPTS="--inactive 3600 --ping 10 --ping-exit 60 --pull-filter ignore ping" \
  --set env.OPENVPN_PROVIDER=PIA \
  --set env.OPENVPN_USERNAME=... \
  --set env.TRANSMISSION_DOWNLOAD_DIR=\/media \
  --set env.TRANSMISSION_INCOMPLETE_DIR=\/media\/incomplete \
  --set secretEnv.OPENVPN_PASSWORD=... \
  --set persistence.existingClaim="nfs-pvc" \
  --kube-context=pine \
  -f values.yaml \
  utkuozdemir/transmission-openvpn

my values.yaml...
extraVolumeMounts:
  - mountPath: /media
    name: media

extraVolumes:
  - name: media
    persistentVolumeClaim:
      claimName: nfs-pvc

persistence:
  accessModes:
    - ReadWriteMany

This runs perfectly, but then once the kubelet evicts the pod (several days later, at random) and creates a new one, the pod creation Crashloops when trying to add routes with:
RTNETLINK answers: file exists

Deleting the pod and then letting it restart solves the issue, but this shouldn't happen --this takes my transmission server down until I manually delete the crashlooping pod.
I have seen many explanations around:

Some suggested to add all possible local networks under LOCAL_NETWORK (tried that, by using the three different CIDRs listed above, to no avail).
Some suggested to add an explicit value for OPENVPN_CONFIG, set it to ca_vancouver, this also didn't fix the issue.
The official docker image's documentation has an entry for this error; however, it's been left behind as a TODO item: https://haugene.github.io/docker-transmission-openvpn/faq/#rtnetlink_answers_file_exists

Please advise.

Geez, it actually seems that in my specific setup, I actually need no LOCAL_NETWORK variable. Removing the assignment of LOCAL_NETWORK, I think, finally solved it. Just tried forcing an eviction after I redeployed without LOCAL_NETWORK and it all works flawlessly, ingress and VPN included.
Going to run this for a few days and report back.

Hi,
I have a feeling that this is not about the chart but about the upstream project. I guess it sometimes for some reason cannot do a proper cleanup when it is terminating, so it fails to start on the next run.
I'd suggest taking the latest upstream project image tag from here https://haugene.github.io/docker-transmission-openvpn
and specifying image.tag in the chart. It seems they did some fixes on the startup/shutdown scripts, so it might actually help.


Adding the support for a Streaming Iterator that uses Solr's Export H…

Adding the support for a Streaming Iterator that uses Solr's Export Handler. This iterator is made available for use  in queries that are used in the compute() of  SolrRDD

Squash merged 0d5ac1b5f47d5a5ea320dac2a4f443d542bbd1c3.


requestData is undefined with POST requests

With POST requests, bugsnag.requestData becomes undefined :/ Normal?
I have this error: Cannot set property 'user' of undefined. My node version is 7.9.0
console.log(req.method, bugsnag.requestData === undefined, req.user._id)

Thanks for the report, @Grmiade. After some testing, this issue seems to be unrelated to the HTTP method but rather to the active domain changing, as is the case if the error is triggered by an unhandled promise rejection or other event emitter. (I have an example of promise rejection specifically here)
In Node v8.0.0, promises run in the domain which call them, though the implementation does not provide a way to capture that domain externally without wrapping the promise, and even then, domain.active is unset. The correct solution would be to remove the reliance on domains, though this probably will need to wait for the stabilization of async hooks or similar to handle asynchronous resource-specific data.
Looking into this further.

Would it be an idea to have some sort of fallback where you can set the requestData on the request object itself?

Hey @Grmiade have you had a chance to try Node v8 yet? As @kattrali mentioned, the native promises there should behave in a slightly better way (if indeed you were using promises).
Unfortunately there's not a lot we can do here… domains are fundamentally flawed (which is why they have been deprecated) in ways such as this, but there isn't a direct replacement yet for the features that they provide. We continue to watch this space and will be doing some of our own investigation with async hooks. For the near future at least we just have to stick with the current implementation, which is better than not using domains at all!
In response to your suggestion @Fjandin… yes it is possible to set request data on the req object, however the difficulty is that in an error triggered by that req/res handler (in a future tick on the event loop) there is no reference back to req – which is why the information is attached to the current domain, which is available (except when it isn't 😞 ).
I could have misunderstood your suggestion however! If you do see a way of doing this, if you could sketch it out in a gist or something, that'd be great!
Closing this off as unfortunately I don't see anything we can do at present.


Error on Gnome 44

I get the following error on my gnome-extensions GUI after updating to gnome 44.1:
Gtk.IconTheme.get_default is not a function

Bumping this, getting the same error even after updating the extension.


Cannot type "@" with Italian keyboard

I cannot type some special characters (such as "@") with Italian keyboard. It is very useful for captive portals to access some wifi.

On the keyboard that came with it when I installed, Shift+' worked for @


Properties operations should all return CI data

PUT, DELETE, and POST were build with no specified output model.
They correctly return CI Errors, but should include CI data for successful execution, even if the data is empty.

Fixed in 10dfdda0a7f9b221f808e8d0e4b001d01dfac547


Fix: Embedded MariaDB startup issue

For debugging #5279

why do not you use Surrealdb.... it s better than mariadb


Spelling

Spelling

Coverage increased (+0.002%) to 16.249% when pulling 245a325fcdf746fb735544a821a742e6bbec667b on BFergerson:patch-1 into d1d4eedf6b91666622850743d97dff4cf3722c13 on apache:master.


Open source the code?

I don't see any code in your project, it's just a bunch of GIF files. You've created a nice tool and put up a GIthub project but with no code, which is strange.
Is it possible for you to release a free, open source version of your tool? I only need the functionality to generate the commit message, don't care about the other features as there are other ChatGPT related plugins that already do that (and for free).
At the end of the day, it's just generating a simple one to two line sentence for the commit message, which ultimately uses your OpenAI API key and so all the costs for the API query are paid for by the users.  I'd probably buy it if it was a one-time purchase for a small amount, but considering that there are other free tools that can do AI commit message generation, it really doesn't sit well with me that you're charging users a monthly subscription.
I've already got 2 other tools that can do this in a single command in Powershell (or some other shell). Problem is that they're not directly integrated into PyCharm as a single button click.

Thank you for your feedback and suggestions! We respect open-source tools greatly, and the GitHub project with the GIF animations we provided is to give users a demonstration of how our tool works, to help them better understand and utilize our product.
Regarding your suggestion for an open-source version that generates commit messages, we will seriously consider it. Our goal is for users to make efficient use of open AI technology, and we understand that different users may have different needs and budgets.
As for the pricing, our subscription fees mainly support our maintenance costs and continual improvements to the product, as well as providing technical support. As a small team, we strive to balance product quality, customer support, and sustainability, and we know our solution won't be attractive to everyone.
We will heed your comments and evaluate whether we can provide a one-off purchase option or more flexible pricing strategies. Your feedback to us is important, as it will help us improve our products and services. Thank you!

Thank you for your feedback and for sharing the alternatives.
It's wonderful that you found a solution that works well for you. We encourage users to select the solution that fits.
Have a good time ：）


document merge as supported incremental_strategy for both dbt-postgres & dbt-redshift

What are you changing in this pull request and why?

resolves: #3545
Checklist

[ ] Add versioning components, as described in Versioning Docs
[ ] https://github.com/dbt-labs/dbt-redshift/pull/490 should get merged first

will take a look at this later today for you @dataders !


removed css-modules dependency.

Thank you @mberneti! Looks very good. There are just a few things that I'll point out as "code review".

I think i fixed those couple issues in this commits.


Generate a Packet Project API Key with the project

As discovered by monitoring the Packet Portal API requests, Project API keys can be generated:
curl -X POST -H "Content-Type: application/json" -H "X-Auth-Token: $PACKET_TOKEN" -d '{"description": "", "read_only": false}' https://api.packet.net/projects/{ID}/api-keys

Let's generate one with the new project and return that to the workflow.
Questions/Thoughts:

Do we expose this as an output, an env, or both?
As an env, we can overwrite the variable name we started with (PACKET_TOKEN? PACKET_AUTH_TOKEN?). The user can still access secret.PACKET_TOKEN to get the original.
Should the env variable name be optionally configurable?
Expose the description and read_only flags? (read_only sounds very useful for dropping privileges for select GH actions)
Can the sweeper use the project key to delete the project?

This is currently exposed as METAL_PROJECT_TOKEN


How to deploy the transformer model？

After training the model with transformer, how do you know which tensor is the input and which tensor is the output.
That is, how to use the model to read user input, translate it in the model, and then output the corresponding sentence.
the code:
sess = tf.Session()
saver = tf.train.import_meta_graph('./checkpoint_test/average-0.meta')
saver.restore(sess, tf.train.latest_checkpoint('./checkpoint_test/'))

I want to use flask to deploy the model online.

Hi @kFoodie - Can you check this out? https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/serving
That should provide some information.


Switching to autogenerated documentation.

We would like to start autogenerating the documentation from docstrings in the source. What are your thoughts on this, and suggestions as to what tools we should use and how this should be handled?
In particular, we would like to:

keep the documentation source files in MarkDown
be able to blend additional "manual" notes (stored in MarkDown files) with the autogenerated MarkDown, seamlessly
be able to integrate with our existing static website generator (mkdocs).

The natural choice would be Sphinx and readthedocs host. But Sphinx uses RST.
There is some discussion about using Sphinx with Markdown http://stackoverflow.com/questions/2471804/using-sphinx-with-markdown-instead-of-rst#2487862
I'd really like to keep markdown too. RST can be a pain.

I just found out that readthedocs also supports markdown: http://docs.readthedocs.org/en/latest/getting_started.html#in-markdown

Worse comes to worst, I image we could write our own docstring parser and Markdown generator. How difficult could it be?

Mkdocs (which last time I checked is used for the keras docs?) also has the possibility to generate docs from docstrings and pull in the python api and autogenerate a structured documentation from that, using an extension: https://github.com/erichulser/mkdocs_autodoc
(I will go ahead and close the ancient #220 which I opend with this goal in mind ;-) )

@phreeza seems like it could be a good option. Thanks for mentioning it! I'll look into it.

Just a heads-up that we will be rolling out our own documentation generation system, which will offer us maximum flexibility. It's fairly trivial in Python, the only difficult point being the handling of inheritance data, which we will hack around.

will we use @phreeza suggestions or are you planning something custom?

@EderSantana custom. Here's a sample page: https://gist.github.com/fchollet/b9d32c6c19f543d7f5b9
I don't think we'll keep the methods section, too redundant for layers.
The powerful thing about it, is that any change in style or functionality is now just a few lines of code away --since everything is programmatic. This will save me a ton of time.

Layer docs are now autogenerated from the docstrings. http://keras.io/layers/core/
Please check it out, and let me know if you spot any issues, or think of things we should do differently.
We'll roll it out to the most of the documentation over the week-end (the core of the work is to add docstrings in all classes and methods).

@fchollet can you show me what you are using. I may like to use it elsewhere for document other projects too.

@EderSantana I've just made it part of Keras (in the docs folder). 200 lines of hack, unclear if it could easily be adapted elsewhere since it is very ad-hoc.
I've extended the autogeneration business to optimizers, callbacks and models.
The remainder would just be preprocessing utils, everything is fine with manual docs.


tpl: Add workaround for Go template data race

Closes #5926

name                                    old time/op    new time/op    delta
SiteNew/Regular_Tags_and_categories-16    42.4ms ± 2%    48.3ms ± 4%  +13.93%  (p=0.029 n=4+4)

name                                    old alloc/op   new alloc/op   delta
SiteNew/Regular_Tags_and_categories-16    15.3MB ± 0%    15.6MB ± 0%   +2.01%  (p=0.029 n=4+4)

name                                    old allocs/op  new allocs/op  delta
SiteNew/Regular_Tags_and_categories-16      294k ± 0%      296k ± 0%   +0.63%  (p=0.029 n=4+4)

Hmm... That did surprise me. I guess this needs to somehow be done concurrently.