Add (inline_query_placeholder) in (User) object, returned only in getMe

I suggest add inline_query_placeholder in User object, And returned only in getMe method.
It should be returned in JSON object when supports_inline_queries == true.
Use cases
Useful for third-party creator bots, It can be in the settings, For inline bots.

Programming note
I can implement this, But I need a permission to do that, After permission I'll send a pull request.
Files will be edited in my pull request:

Client.cpp (JsonUser class, And add_user method)
Client.h (UserInfo class)

It can be added, but how is it useful? It is just a text and bot's functionality doesn't depend on it, nor the placeholder can be changed by the bot itself.

,hard tema

This field wasn't added intentinally, because it doesn't affect bot's functionality and bots can't interact with it in any way. There are no reasons to provide this field through API.


Split annotation opcode validation into new file.

Moves annotation opcode checks from idUsage into a new pass
minor style updates
fixed a typo in an error string

Rebased and committed as 7d4b0464a334bfc7b11a1f34fb24dc5d89ebde7c


Add support for MSFS2024

Fixes #1819
Fixes #1818

Update UI strings all over the place to reference "2024" as well as "2020", including doing some consistency and phrasing touch-ups
Update WASM install process via the menu item to handle installing to two different locations

This is just a draft. We have no idea what the install locations are for 2024, nor do we know if any of it will even work.

Status bar:

Menu:

Output configs:

Input configs:

WASM dialog on first launch:

Looking good. The 2024 path will still change, so we keep this as a Draft until we get final version?

Yeah, or maybe we get in the dev alpha and that uses the real path.

Nice, it seems to be working fine for me in MSFS2024.

Nice, it seems to be working fine for me in MSFS2024.

Thanks! I have to clean up a few things then we should be able to put this out.

@DocMoebiuz UI changes redone at 100% scaling.

@DocMoebiuz This is ready

This isn't working on Steam.

It now works fine on the MS Store version for me.  Thanks!


GitOps Run cannot detect Enterprise Dashboard

As an enterprise user when I am using gitops run it is always asking me if I want to install the dashboard.  This feature should be able to detect when I have the enterprise dashboard installed and not ask this question.
It should port-forward the enterprise dashboard, so it's consistent with what happens when we find an installed OSS dashboard.

Created a prerequisite issue https://github.com/weaveworks/weave-gitops/issues/3337
Will use the same code/principle to detect the enterprise dashboard.
Moved the second part of this ticket

It should port-forward the enterprise dashboard, so it's consistent with what happens when we find an installed OSS dashboard.

to
https://github.com/weaveworks/weave-gitops/issues/3338
because it requires modifying the port-forwarding functionality which is separate from dashboard detection.


Delete {{noprint|...}} and find new ways to implement it

The occurence of {{noprint|...}} in https://de.wikibooks.org/wiki/Mathe_für_Nicht-Freaks:_Körperaxiome can be changed to {{Annotation|...}}. However I first want to collect ideas for new ways of implementing {{noprint|...}} here...

We should fist discuss wether we want a semantic version of the noprint template or a more generic article composition tool. We may end up to need both:

There are certainly some places where we actually want to annotate semantic meaning like "important", "illustratory", things like that.
On the other hand, sometimes we just want to change article composition for different targets (target platforms, target formats, target audiences), maybe also with plans for mid-term structural changes in mind.

Which one do you think is currently more common? Does this distinction make sense with our current platform or should we not bother with compatibility with rather vague plans?

@vroland Yes you are right, we need a good plan for the content exportation. Your second idea seems to be very promising. Another idea: Currently we can only exclude sections. It would be great to exclude named sematic boxes (title-paramter of a proof, hint, etc), too.

Jep, that would be nice to have. But if we don't need that right now I would rather experiment a bit with article representation / composition first.


CUDA_VISIBLE_DEVICES aren't working

When I run the optimum benchmarking code with a cuda device in the config, it doesn't see my GPU:
optimum-benchmark --config-dir examples/ --config-name energy_star
[2024-04-04 11:35:53,609][launcher][INFO] - ََAllocating process launcher
[2024-04-04 11:35:53,609][process][INFO] - 	+ Setting multiprocessing start method to spawn.
[2024-04-04 11:35:53,620][device-isolation][INFO] - 	+ Launched device(s) isolation process 96990.
[2024-04-04 11:35:53,625][process][INFO] - 	+ Launched benchmark in isolated process 96991.
Process Process-1:
Traceback (most recent call last):
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 113, in assert_system_devices_isolation
    devices_pids = get_pids_running_on_system_devices()
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 99, in get_pids_running_on_system_devices
    devices_pids = get_nvidia_devices_pids()
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 44, in get_nvidia_devices_pids
    devices_ids = [int(device_id) for device_id in os.environ["CUDA_VISIBLE_DEVICES"].split(",")]
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/os.py", line 679, in __getitem__
    raise KeyError(key) from None
KeyError: 'CUDA_VISIBLE_DEVICES'
[PROC-0][2024-04-04 11:35:55,780][datasets][INFO] - PyTorch version 2.2.1 available.
[PROC-0][2024-04-04 11:35:55,938][backend][INFO] - َAllocating pytorch backend
[PROC-0][2024-04-04 11:35:55,938][backend][INFO] - 	+ Setting random seed to 42
[PROC-0][2024-04-04 11:35:56,564][pytorch][INFO] - 	+ Using AutoModel class AutoModel
[PROC-0][2024-04-04 11:35:56,564][pytorch][INFO] - 	+ Creating backend temporary directory
[PROC-0][2024-04-04 11:35:56,565][pytorch][INFO] - 	+ Loading model with random weights
[PROC-0][2024-04-04 11:35:56,565][pytorch][INFO] - 	+ Creating no weights model
[PROC-0][2024-04-04 11:35:56,565][pytorch][INFO] - 	+ Creating no weights model directory
[PROC-0][2024-04-04 11:35:56,565][pytorch][INFO] - 	+ Creating no weights model state dict
[PROC-0][2024-04-04 11:35:56,566][pytorch][INFO] - 	+ Saving no weights model safetensors
[PROC-0][2024-04-04 11:35:56,567][pytorch][INFO] - 	+ Saving no weights model pretrained config
[PROC-0][2024-04-04 11:35:56,568][pytorch][INFO] - 	+ Loading no weights AutoModel
[PROC-0][2024-04-04 11:35:56,568][pytorch][INFO] - 	+ Loading model directly on device: cpu
[PROC-0][2024-04-04 11:35:57,810][pytorch][INFO] - 	+ Turning on model's eval mode
[PROC-0][2024-04-04 11:35:57,814][benchmark][INFO] - Allocating energy_star benchmark
[PROC-0][2024-04-04 11:35:57,814][energy_star][INFO] - 	+ Loading dataset
[PROC-0][2024-04-04 11:36:01,932][energy_star][INFO] - 	+ Preprocessing dataset
[PROC-0][2024-04-04 11:36:06,367][energy_star][INFO] - 	+ Initialising dataloader
[PROC-0][2024-04-04 11:36:06,367][energy_star][INFO] - 	+ Initializing Inference report
[PROC-0][2024-04-04 11:36:06,367][energy_star][INFO] - 	+ Preparing backend for Inference
[PROC-0][2024-04-04 11:36:06,367][energy_star][INFO] - 	+ Warming up backend for Inference
[PROC-0][2024-04-04 11:36:06,598][energy_star][INFO] - 	+ Running energy tracking
100%|██████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 10.72it/s]
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ forward CPU energy: 0.000006 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ forward GPU energy: 0.000006 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ forward RAM energy: 0.000000 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ forward total energy: 0.000012 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ preprocess CPU energy: 0.000000 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ preprocess GPU energy: 0.000000 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ preprocess RAM energy: 0.000000 (kWh)
[PROC-0][2024-04-04 11:36:11,932][energy][INFO] - 		+ preprocess total energy: 0.000000 (kWh)
[PROC-0][2024-04-04 11:36:11,933][energy][INFO] - 		+ forward efficiency:<PHONE_NUMBER>42 (samples/kWh)
[PROC-0][2024-04-04 11:36:11,933][energy][INFO] - 		+ preprocess efficiency: 24438423.246041 (samples/kWh)
[2024-04-04 11:36:12,275][device-isolation][INFO] - 	+ Closing device(s) isolation process...
[2024-04-04 11:36:12,297][datasets][INFO] - PyTorch version 2.2.1 available.

However, when I do  CUDA_VISIBLE_DEVICES=0 optimum-benchmark --config-dir examples/ --config-name energy_star the code runs on GPU (and echo $CUDA_VISIBLE_DEVICES and nvidia-smi both show available GPUs).
Pytorch also seems to see them (when called from command line python):
 import torch
>>> torch.cuda.device_count()
1

I'll be explicitly setting  CUDA_VISIBLE_DEVICES=0 when calling optimum-benchmark, but just wanted to flag the issue :hugs:
Thank you @regisss for helping me find a fix for now!

My understanding is that the code assumes that the env variable CUDA_VISIBLE_DEVICES always exists here but it seems that is not necessarily the case: https://stackoverflow.com/questions/67730572/keyerror-cuda-visible-devices#comment119721259_67730572

that's weird, it's only the device isolation process that doesn't see CUDA_VISIBLE_DEVICES in this case (that's why the benchmark still runs successfully), but it works in a clean docker environment (CUDA_VISIBLE_DEVICES no set manually), I just added device_isolation in all tested configs yesterday https://github.com/huggingface/optimum-benchmark/blob/main/tests/configs/device_isolation.yaml and it works in the CI.
@regisss CUDA_VISIBLE_DEVICES is set by the backend config when instantiated using device_ids here https://github.com/huggingface/optimum-benchmark/blob/1f9d6451269c44786f5e5a7f6f0c611fcb20aeb1/optimum_benchmark/backends/config.py#L68-L76
the __post_init__ code is triggered very early by the CLI here: https://github.com/huggingface/optimum-benchmark/blob/1f9d6451269c44786f5e5a7f6f0c611fcb20aeb1/optimum_benchmark/cli.py#L61-L63
and then the env var is transferred to the spawned isolation process automatically.

What do you mean by "passing the device ids explicitly between processes"?
if I just try that branch without specifying the device, it gives the same error:
optimum-benchmark --config-dir examples/ --config-name energy_star
[2024-04-05 09:02:42,710][launcher][INFO] - ََAllocating process launcher
[2024-04-05 09:02:42,711][process][INFO] - 	+ Setting multiprocessing start method to spawn.
[2024-04-05 09:02:42,745][device-isolation][INFO] - 	+ Launched device(s) isolation process 124513.
[2024-04-05 09:02:42,751][process][INFO] - 	+ Launched benchmark in isolated process 124514.
Process Process-1:
Traceback (most recent call last):
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 113, in assert_system_devices_isolation
    devices_pids = get_pids_running_on_system_devices()
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 99, in get_pids_running_on_system_devices
    devices_pids = get_nvidia_devices_pids()
  File "/home/sasha/Documents/HuggingFace/optimum-benchmark/optimum_benchmark/launchers/isolation_utils.py", line 44, in get_nvidia_devices_pids
    devices_ids = [int(device_id) for device_id in os.environ["CUDA_VISIBLE_DEVICES"].split(",")]
  File "/home/sasha/anaconda3/envs/energystarai/lib/python3.9/os.py", line 679, in __getitem__
    raise KeyError(key) from None
KeyError: 'CUDA_VISIBLE_DEVICES'


List containers can fail when contents have exotic alignments

gcc had a specific problem when trying to compile STD_OFFSETOF(struct NODENAME, stPayload) inside a std_list() type, for which I wasn't able to find a way around., and so used sizeof(std_list_node_t) instead.
But perhaps it would be better to static assert and halt the compilation if an exotic alignment (i.e. 16 bytes or more) is specified for a list container item?

Fixed, now builds fine under gcc


pq

Add small hack to be able to test partial charges with SPICE. This can be the base PR to come up with a solution to total charge, partial charges, spins, etc.

You could avoid creating a tensor of zeros with the charges here:
https://github.com/torchmd/torchmd-net/blob/fae79bd9e8e96ab235c52d5e54e33c3be9e4d05d/torchmdnet/models/tensornet.py#L240-L243
https://github.com/torchmd/torchmd-net/blob/fae79bd9e8e96ab235c52d5e54e33c3be9e4d05d/torchmdnet/models/tensornet.py#L496
If you set "q" (please lets change the name of that variable) to something like this:
        if q is None:
            q = 0
        else:
            q = q[batch, None, None, None]

I previously tested this method for injecting partial charges and found it didn't work at all.  The loss got much worse.  In contrast, the method in #289 does work and makes the loss better.

Yes, we did already have this discussion. :)  My point is that this shouldn't be merged until we do a full evaluation of both PRs and determine which one works better.
Also, #289 truly is a generic method that supports arbitrary sets of global and per-atom properties.  This one is hardcoded to just a single property which must be called pq, and it isn't clear how it could be generalized to support multiple properties.

Sorry Peter, perhaps I was not clear enough: I meant agnostic in the sense
that we are trying to come up with a unified way to feed the models with
all these extra attributes, rename them to have clearer names, being
compatible with priors, etc, regardless of how they are manipulated inside
the models. Regarding this way of dealing with them, I have tests with
total charges, partial charges, and spins, and results are pretty
convincing (in our setting at least, not using any prior, I cannot specify
further since I am writing a preprint, but I will be happy to discuss
privately if you want to reproduce it) But yes, this is not going to be
merged at the moment.
On Tue, 5 Mar 2024 at 18:27, Peter Eastman @.***> wrote:

Yes, we did already have this discussion. :) My point is that this
shouldn't be merged until we do a full evaluation of both PRs and determine
which one works better.
Also, #289 https://github.com/torchmd/torchmd-net/pull/289 truly is a
generic method that supports arbitrary sets of global and per-atom
properties. This one is hardcoded to just a single property which must be
called pq, and it isn't clear how it could be generalized to support
multiple properties.
—
Reply to this email directly, view it on GitHub
https://github.com/torchmd/torchmd-net/pull/304#issuecomment-1979279048,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANJMOA2O6DXWZEQ5AM2NANTYWX56PAVCNFSM6AAAAABEG4MU7SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNZZGI3TSMBUHA
.
You are receiving this because you authored the thread.Message ID:
@.***>

What do you think about this setup in the yaml file:
model_extra_args:
  total_charge:
    learnable: true
    coeff: 0.1
  partial_charge:
    learnable: true
    coeff: 0.1
  spin:
    learnable: false
    coeff: 1

The keys of the dict will be used to define which args of extra_args should go to the model so the prior behavior is preserved as it is now. Then the coeff is used as starting parameter for the specific arg, if learnable requires_grad is set to true. In the init  a nn.ParameterList is initialized with length equal to the  model_extra_args.keys().

You are assuming the extra_args are going to just be multiplied by a constant (as guillem does now), this might not be the case in the future, when perhaps we lean towards Peter's strategy of embeddings, or we use some kind of small MLP to compute the prefactors.
OTOH I do not really like the name "model_extra_args". Why would "total_charge" be extra but "box" is just an optional argument? I do not have a better alternative for you, just saying...


Typescript to JSON Schema

Input:
interface Client {
	firstName: string
	lastName: string
	nickName: string
	age: number
}

Expected output:
  "id": "Client",
  "type": "object",
  "properties": {
    "firstName": {
      "type": "string"
    },
    "lastName": {
      "type": "string"
    },
    "nickName": {
      "type": "string"
    },
    "age": {
      "type": "number"
    }
  },
  "required": [
    "firstName",
    "lastName",
    "nickName",
    "age"
  ],
  "additionalProperties": false
}

Output generated with typson.

Not really sure how to make this happen or help out, but I'm willing to learn how to do it 🤓
Related projects:

typescript-json-schema
typson

None of them will ensure the right output. Any JSON schema you get from TypeScript won't be trustworthy. for example, a number in TS can be any of number or integer in JSON Schema.


feat: application version in footer

Description
Resolves #459
Demo

'develop' will have -dev suffix, while prod will have no suffixes at all.
Checklist:

[x] I have read and followed the Contributing Guide
[x] My change does not require a change to the documentation.

@michele-franchi great ideas, I believe everything is fixed.
@janmichek I love that feature but I decided not to implement linking directly to a specific tag because:

it will not work for aescan outside production because we create releases only for released code. That means on develop and previews aescan link will navigate to github error page
if middleware or core team removes some release or tag the code differently than the release itself (intentionally or not) it will again navigate users to github error page. I think it's safer to link users to releases page which is always working.

I hope it makes sense


Support icon variant on commands, make start and stop icons filled

Description
Consistent feedback on the start/stop/restart icons was the stop icon looked like an empty checkbox. The standard for this kind of UI is to have filled icons. For example, VS debugging start/stop buttons are filled.
This PR:

Adds icon variant option to commands. Defaults to regular.
Changes start and stop icons to be filled icons.
Changes the icon size from 20 to 16. Size 20 filled icons felt too big. Size 16 looks good.
Fixes error when command doesn't have an icon.

Demo:

Checklist

Is this feature complete?

[x] Yes. Ready to ship.
[ ] No. Follow-up changes expected.

Are you including unit tests for the changes and scenario tests if relevant?

[ ] Yes
[x] No

Did you add public API?

[x] Yes

If yes, did you have an API Review for it?

[ ] Yes
[ ] No

Did you add <remarks /> and <code /> elements on your triple slash comments?

[ ] Yes
[ ] No

[ ] No

Does the change make any security assumptions or guarantees?

[ ] Yes

If yes, have you done a threat model and had a security review?

[ ] Yes
[ ] No

[x] No

Does the change require an update in our Aspire docs?

[ ] Yes

Link to aspire-docs issue:

[x] No

Microsoft Reviewers: Open in CodeFlow

/azp run

/azp run


Marathon Version 0.16.0-RC1

Marathon doesn't appear here: https://github.com/mesosphere/multiverse/blob/8b6247490420ed8477204cbb831d37139c22e115/repo/meta/index.json
Is that file now deprecated?

In an effort to make DCOS packages more accessible to users, Mesosphere will be decommissioning this repo in favor of https://github.com/mesosphere/universe
On Wednesday March 30th 2016 13:30 PDT (Wednesday March 30th 2016 20:30 UTC) the contents of this repo will be migrated to https://github.com/mesosphere/universe
In preparation for this move please update this PR to ensure that it can merge and is targeted at branch version-2.x. If this PR is obsolete please feel free to close it.
If this PR is not ready to merge prior to the above time, this PR will be closed and not migrated.
After this repo has been decommissioned all contributions for packages will still follow the same PR process just targeting https://github.com/mesosphere/universe instead of this repo.
In an effort to make DCOS packages more accessible to users, Mesosphere will be decommissioning this repo in favor of https://github.com/mesosphere/universe
On Wednesday March 30th 2016 13:30 PDT the contents of this repo will be migrated to https://github.com/mesosphere/universe
In preparation for this move please update this PR to ensure that it can merge and is targeted at branch version-2.x. If this PR is obsolete please feel free to close it.
If this PR is not ready to merge prior to the above time, this PR will be closed and not migrated.
After this repo has been decommissioned all contributions for packages will still follow the same PR process just targeting https://github.com/mesosphere/universe instead of this repo.

@aquamatthias please bump Marathon to the latest RC.

Close this and create a new one for the latest RC.


mongo decoding error: invalid mongo op 2010

mongo decoding error: invalid mongo op 2010
[2018-03-07 13:54:40.083][3963593][info][mongo] source/common/mongo/proxy.cc:243] mongo decoding error: invalid mongo op 2010

OP_COMMAND | 2010 | Cluster internal protocol representing a command request.
MongoDB Wire Protocol

Should this command be supported ?
$ cat conf/mongodb.yaml
admin:
  access_log_path: /tmp/admin_access.log
  address:
    socket_address: { address: <IP_ADDRESS>, port_value: 9901 }

static_resources:
  listeners:
  - name: listener_mongodb
    address:
      socket_address: { address: <IP_ADDRESS>, port_value: 10001 }
    filter_chains:
    - filters:
      - name: envoy.mongo_proxy
        config:
          stat_prefix: mongodb_proxy
          access_log: /tmp/mongodb_access.log
      - name: envoy.tcp_proxy
        config:
          stat_prefix: tcp_proxy
          cluster: mongo_proxy
          idle_timeout: 1.5s
          max_connect_attempts: 5
  clusters:
  - name: mongo_proxy
    connect_timeout: 0.25s
    type: static
    hosts: [{ socket_address: { address: <IP_ADDRESS>, port_value: 27017 }}]

In what context does this occur? As the Mongo docs suggest, this is a cluster internal command. It wouldn't be difficult to add support, but the use case and a repro would be helpful.

@danielhochman  I use the Mongodb admin tools  Robo 3T, maybe the tools send  OP_COMMAND for some purpose.  I am not sure our client will use this command or not. But I found something useful from the page

WARNING
OP_COMMAND and OP_COMMANDREPLY are cluster internal and should not be implemented by clients or drivers.
Changed in version 3.6: The OP_COMMAND and OP_COMMANDREPLY format and protocol are deprecated and may be removed in a future release of MongoDB.

Sure we can support this if someone wants to implement. Marking "help wanted."

@mattklein123 I will implement this.

@cpakulski OK will add you to org so I can assign.


add function to create folders

New Option..

Duplicate of https://github.com/quasar/Quasar/issues/262


suppressApplicationTitle doesn't work when extra command is run in commandLine

Environment
Windows build number: Version 10.0.18363.476
Windows Terminal version: Version: 0.7.3291.0

Steps to reproduce
I created a profile like this:
{
    "name": "VS2017 Developer CMD",
    "tabTitle": "VS2017 Developer CMD",
    "commandline": "cmd.exe /k \"C:/Program Files (x86)/Microsoft Visual Studio/2017/Professional/Common7/Tools/VsDevCmd.bat\"",
    "icon": "ms-appx:///ProfileIcons/{0caa0dad-35be-5f56-a8ff-afceeeaa6101}.png",
    "suppressApplicationTitle": true,
    "startingDirectory": "C:/Source"
},

Expected behavior
The title of the tab should be VS2017 Developer CMD.
Actual behavior
The title of the tab is VS2017 Developer CMD - C:/Program Files (x86)/Microsoft Visual Studio/2017/Professional/Common7/Tools/VsDevCmd.bat

I can confirm the issue.
It works with:
"commandline" : "%windir%/system32/openssh/ssh.exe<EMAIL_ADDRESS>However when you have:
"commandline" : "%windir%/system32/openssh/ssh.exe<EMAIL_ADDRESS>-i path_to_the_authentication_key"
the title still changes to 'OpenSSH SSH client'...
Anything else i can try?


Extract WETH error in the bot executor contract

Dear sir,
I deployed a bot-executr contract  on Arbitrum using your code. Currently, I want to extract the balance of the weth, however, I encountered this error.
ValueError: Execution reverted during call: 'execution reverted: WETH BALANCE REDUCTION'. This transaction will likely revert. If you wish to broadcast, include allow_revert:True as a transaction parameter.
Here is the traction parameters:
   tx_params = {         "from": bot_account.address,        # "from": executor_contract.address,         "chainId": brownie.chain.id,         "gas": TX_GAS_LIMIT,         "nonce": bot_account.nonce,         "maxPriorityFeePerGas":0,         "value":0,     }
Here is the payloads:
TX_GAS_LIMIT= 250_000_000
withdrawal_amount = int(0.2*10**18)
TOKEN_CONTRACT_ADDRESS = "0x82aF49447D8a07e3bd95BD0d56f35241523fBab1" # WETH address
payload_signature = brownie.web3.keccak(text="transfer(address,uint256)")
payload_data = eth_abi.encode_abi(
    ["address", "uint256"],
    [bot_account.address, withdrawal_amount])
payload = payload_signature[:4] + payload_data
# Get the hex value of the payload
payload_hex = '0x' + payload.hex()
# Submit the transaction, with the appropriate token to withdraw
tx = executor_contract.execute_payloads(
    [(TOKEN_CONTRACT_ADDRESS, payload_hex, 0)],
    tx_params
)`

I used brownie and connect the arb-chain network. I could not find the failure reason.

Try passing balance_check = false with your execute_payloads call. I think the latest version of the executor has that True by default

Thanks for your advice. I found that the execute_payloads function has a parameter of balance_check in the newer version, that's my fault.  After modifying the old ABI, and add the balance_check parameter, I succeed. Thank you very much.
`
`


Merge from opendatahub-io/kubeflow:main to red-hat-data-services/kubeflow:master

Thank Jiri for this, you will need to sync upstream/v1.9-branch with downstream/master.
As the v1.9-branch will be the gatekeeper with downstream

Ok, created at

https://github.com/red-hat-data-services/kubeflow/pull/113


Recent Discord UI update messed up CSS for BD settings

For any questions -> https://discord.gg/0Tmfo5ZbORCRqbAd

(my bad, meant to respond to other issue)

I've also got this problem. The UI seems to get fixed (most of it) when you turn off the second option for Minimal Mode. Now the community discord isn't connecting anymore.

https://github.com/mrmaple240/betterdiscord-mini-themes/blob/master/TempBDSettingsPublicServersFix.theme.css works as a temporary fix.

Fixed in 4fc5abe, so closing.


Upgrade safe-node-app package to v0.10.0

Upgrade safe-node-app to v0.10.0 which exposes experimental APIs only with a flag.
Also upgrade safe_authenticator lib to v0.9.0.

@safesurfer you can check that we're pointing to the correct version in the app/package.json

QA verified


Remove duplicate send_mode element in template

Hi!
Was just using the logback configuration templates as a guide and noticed the redundant element.
Thanks for providing this lib 👍

Thanks @cursande, done in #156 so we could merge to the develop branch


VectorPolygonsToRaster issue

whitebox version: 0.9.0
Python version: 3.7.3
Operating System: Windows 10

Description
The whitebox tool "VectorPolygonsToRaster" return a different result compare to the Whitebox GAT -win tool "Vector polygons to raster" . The output .tif has gaps!!!
What I Did
from whitebox import WhiteboxTools

# Set up the environment
wbt = WhiteboxTools()
data_dir = "/../whitebox_issue"
wbt.work_dir = (data_dir)

i_vector = "poly.shp"
fieldZ = "Value"
out_raster = "poly2raster_PYTHON.tif"

wbt.vector_polygons_to_raster(
    i=i_vector,
    output=out_raster,
    field=fieldZ,
    nodata=True,
    cell_size=1,
   # base=None,
   # callback=default_callback
)

@mlavy Thank you for reporting this issue and for providing so much detail in describing the problem. I would ask that, if you are able to, would you mind sending me the file that you are trying to process so that I may perform testing and evaluation?

Thank you Jhon for your quick reply,
attached the file requested.
On Wed, Jul 24, 2019 at 5:01 PM John Lindsay<EMAIL_ADDRESS>wrote:

@mlavy https://github.com/mlavy Thank you for reporting this issue and
for providing so much detail in describing the problem. I would ask that,
if you are able to, would you mind sending me the file that you are trying
to process so that I may perform testing and evaluation?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jblindsay/whitebox-tools/issues/42?email_source=notifications&email_token=AMWMWHSWWYBB5X6EV4JEIMDQBBVFNA5CNFSM4IGQ56F2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2WTZXQ#issuecomment-514669790,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AMWMWHQKVSZJSQINBPEQ34DQBBVFNANCNFSM4IGQ56FQ
.

--
Muriel Lavy
e-mail: murielavy@g <EMAIL_ADDRESS>Skype: muriel.lavy

@mlavy I don't believe you can attach to a Github issue like that. You may have to email me the file directly.

should I use this email<EMAIL_ADDRESS>

Yes, that will work well.

This should be fixed now in the v1.0.1 and so I am closing. Please feel free to re-open the issue if any further problems persist.

Dear John,
thanks for the update.
Installing the whitebox python package with pip install, the WhiteboxTools
version installed along with whitebox 1.0.0 is WhiteboxTools v1.0.0, and
not the v1.0.1
I would need this installation in server, so it would be better to have it
automatically uploaded in the whitebox.
Is that possible?
Thank you,
Muriel
On Sun, Oct 20, 2019 at 4:45 PM John Lindsay<EMAIL_ADDRESS>wrote:

Closed #42 https://github.com/jblindsay/whitebox-tools/issues/42.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jblindsay/whitebox-tools/issues/42?email_source=notifications&email_token=AMWMWHXM2YFZGDR675JGMLDQPRVHHA5CNFSM4IGQ56F2YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGOUKKWEVI#event-2727699029,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMWMWHS4VD42TBJRHJVAHWTQPRVHHANCNFSM4IGQ56FQ
.

--
Muriel Lavy
e-mail: murielavy@g <EMAIL_ADDRESS>Skype: muriel.lavy

@mlavy I am working on it. Stay tuned.

@mlavy The pip package has been updated. https://pypi.org/project/whitebox/

Thank you :)
On Mon, Oct 21, 2019 at 3:03 PM Qiusheng Wu<EMAIL_ADDRESS>wrote:

@mlavy https://github.com/mlavy The pip package has been updated.
https://pypi.org/project/whitebox/
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jblindsay/whitebox-tools/issues/42?email_source=notifications&email_token=AMWMWHRUPD47CAPPTR3NVPTQPWSCDA5CNFSM4IGQ56F2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEB2HWKA#issuecomment-544504616,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMWMWHTCX37MP4BKF57DYYTQPWSCDANCNFSM4IGQ56FQ
.

--
Muriel Lavy
e-mail: murielavy@g <EMAIL_ADDRESS>Skype: muriel.lavy

@giswqs Thanks once again Qiusheng for being so incredibly responsive.

Dear all,
I had no results running the *vector_polygons_to_raster *python tools.
the error received is:
thread 'main' panicked at 'index out of bounds: the len is 1 but the index
is 1',
/rustc/625451e376bb2e5283fc4741caa0a3e8a2ca4d54\src\libcore\slice\mod.rs:2715:10note:
run with RUST_BACKTRACE=1 environment variable to display a backtrace.
I am not sure if this is imputable to the *WhiteboxTools *package or the
Whitebox
Thanks for your support by far
Muriel
On Mon, Oct 21, 2019 at 3:18 PM John Lindsay<EMAIL_ADDRESS>wrote:

@giswqs https://github.com/giswqs Thanks once again Qiusheng for being
so incredibly responsive.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jblindsay/whitebox-tools/issues/42?email_source=notifications&email_token=AMWMWHWKEJSH3XVMAMH2RYDQPWTY3A5CNFSM4IGQ56F2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEB2JCKI#issuecomment-544510249,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMWMWHXF4T4OPOLHZMKWOTDQPWTY3ANCNFSM4IGQ56FQ
.

--
Muriel Lavy
e-mail: murielavy@g <EMAIL_ADDRESS>Skype: muriel.lavy

@mlavy This was the result of an issue with my latest attempt to fix the --flag=False issue that plagued the QGIS front end. This fix ended up breaking non-QGIS front ends with optional flags, for which --flag indicates --flag=True. Anyhow, I've just now committed a series of changes that should fix this 'len is 1 but the index is 1' error. It would otherwise occur quite commonly for any tool with a Boolean flag.


Add inspect metrics in the OS module for Fuchsia.

Adding inspect metrics in the OS module for fuchsia. This will make Fuchsia-specific
changes easier to diagnose in the future, as the inspect metrics will become available
in the bug reports.
This depends on issue #41523 being fixed and rolled out.

I'd like to work on this; please assign me to the issue.

This was fixed a while ago.  See commit d2e4a3c.


Fix release issues, bump version to 1.0.0-rc.2

@tzerrell Yeah, that's probably wise, but I might make some PRs to test this release candidate, but will leave them in draft state until we're all good with finalizing 1.0


Question: Any plans on supporting video?

It's called sharp-image but do you have any plans on supporting video too using ffmpeg.

Hi @superandrew213 yea it's been on my mind. For longer videos, Lambda doesn't work so well due to it's 5 minute execution-time limit. But it could be useful for things like generating GIFs or combining a batch of images together into a time-lapse video. What use case do you have in mind?

@adieuadieu at the moment my use case is for short videos (1 min). To transcode and generate thumbs and gifs. There is 'https://github.com/binoculars/aws-lambda-ffmpeg' but I think it would be a really nice addition to serverless-sharp-image.
For larger files there is AWS Elastic Transcoder, even though it is quite expensive.

@superandrew213 I agree. I'd like to support it. It also aligns with some other work I'm doing with serverless-chrome and screencasts.

@adieuadieu awesome! Will you want to keep the name serverless-sharp-image or rename to something like 'serverless-media-processor`?

@superandrew213 Will probably rename the project at some point. Not sure what, though.


Increase the backlog for local clients

Increase the backlog of clients for unix sockets to 8. This match
the size of TCP sockets backlog.

bors r+


Static export and next-css

When I make a static export (next build && next export), the style.css (generated thanks to withCSS) file is not exported.
Environment :
@zeit/next-css : 0.1.2
next: 5.0.0

Upgrade to next@canary.

Thanks !


Fix unit test failures on Travis

Failures: https://travis-ci.org/google/EarlGrey/jobs/337848947

Will wait for Ruby Test to pass before merging.


Restore v1alpha3 API support

Implement conversion interfaces between v1beta1 and v1alpha3, and install validation webhooks for v1alpha3 requests. The v1alpha3 API is now implemented in terms of v1beta3 types to avoid duplication of business logic.
Resolves #333

@ChunyiLyu does this fix your issue?

Codecov Report
Patch coverage has no change and project coverage change: -0.12% :warning:

Comparison is base (d185b32) 81.53% compared to head (8c67d89) 81.42%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #334      +/-   ##
==========================================
- Coverage   81.53%   81.42%   -0.12%
==========================================
  Files          15       17       +2
  Lines        1446     1448       +2
==========================================
  Hits         1179     1179
- Misses        219      221       +2
  Partials       48       48

Files Changed
Coverage Δ

...beta1/clusterworkloadresourcemapping_conversion.go
0.00% <0.00%> (ø)

.../v1beta1/clusterworkloadresourcemapping_webhook.go
96.33% <ø> (ø)

apis/v1beta1/servicebinding_conversion.go
0.00% <0.00%> (ø)

apis/v1beta1/servicebinding_webhook.go
94.87% <ø> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

@scothis Thanks for the quick fix. I tested with the samples/spring-petclinic example. I can create and delete the following binding:
---
apiVersion: servicebinding.io/v1alpha3
kind: ServiceBinding
metadata:
  name: spring-petclinic-db
  annotations:
    kapp.k14s.io/change-group: binding
    kapp.k14s.io/change-rule.service: "upsert after upserting service"
    kapp.k14s.io/change-rule.service-delete: "delete before deleting service"
    kapp.k14s.io/change-rule.workload: "upsert before upserting workload"
    kapp.k14s.io/change-rule.workload-delete: "delete after deleting workload"
spec:
  # direct Secret reference is used for compatibility, but not recommended for dynamically provisioned services
  service:
    apiVersion: v1
    kind: Secret
    name: spring-petclinic-db
  workload:
    apiVersion: apps/v1
    kind: Deployment
    name: spring-petclinic


use extract_spancontext for the rootspan

Once the SpanContext has been extracted, the 'baggage_items' can be set.

I think this has been solved with: https://github.com/Perceptyx/perl-cgi-application-plugin-opentracing/pull/13


Debug Info for Failed Tests

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker

/test pre-kyma-environment-broker


[Enhancement][opensearch-dashboards] Add k8s readiness probe

Is your feature request related to a problem? Please describe.
At the present time there are no any probes in this chart.  However, for example, this section in values.yaml is presented
Describe the solution you'd like
it would be nice to have a readiness probe in the chart

Duplicate of #44 ?

Duplicate of #44 ?

You are right. But the title of the old issue looks a bit strange imho.
So I've renamed this issue to be more specific

Follow up: hasn't this been already fixed with #329 and #333 and is a duplicate of #117?

Yes I think we can close this. Thanks @faabsen
@Sebor Feel free to re-open if you have further questions.


CockroachDB connector

This feature requests serves as a central place to discuss development and progress for the CockroachDB connector.

This would be great! CockroachDB implements the PostgreSQL wire protocol, almost all of its syntax, and the majority of its data types like jsonb and arrays. As such, as long as no particularly obscure features are used, this should come for free with https://github.com/graphcool/prisma/issues/1641.

Cockroachdb's underlying architecture is a k/v store which leads to poor join performance in the current release. Therefore I'd recommend to currently not invest into this.

Cockroachdb's underlying architecture is a k/v store which leads to poor join performance in the current release.

@jensneuse may be referring to https://www.cockroachlabs.com/blog/cockroachdbs-first-join/, which discusses the performance of CockroachDB's join implementation while it was in beta, about a year and a half ago. A lot has changed since then, and CockroachDB now has fully-distributed hash join, merge join, and lookup join implementations.

@nvanbenschoten tried running Prisma 1.7.1 connecting to Cockroach as if it was Postgres and ran into the following issues:

can't create the user-defined function raise_exception, since CRDB doesn't support UDFs (it's unlikely to anytime soon, so will probaby need to do something different on the Prisma side)
pg_advisory_lock undefined (we can add this on the CRDB side, even if just as a no-op)
CREATE SCHEMA syntax error (CRDB doesn't support multiple schemas (docs); we could add that or maybe Prisma could use multiple databases instead…)

Prisma is a dream to work with. The prospect of pairing it with an infinitely scalable DB like Coackroach and AWS Lamba / Zeit now / Apex Up seems like a dream come true from a developers perspective. Would love to see this implemented!

@vilterp, can you confirm this?

We could probably work around the user-defined function if need be. We are using it to trigger an exception to roll back transactions. Is there another way to get this effect in CRDB? In MySql we started off with just using a hack (returning several values from a select when only one is allowed) to cause a rollback.
select case
when exists( some query )
then 1
else (select COLUMN_NAME
from information_schema.columns
where table_schema = project)end
Maybe you have an idea what we could use to get the same effect in CRDB. We basically need the ability to cause a rollback based on the result of a query.

We basically need the ability to cause a rollback based on the result of a query.

@do4gr CockroachDB has a function called crdb_internal.force_error (documented here) that can be used to force an error. Would this work to accomplish your goal?
@obibring unfortunately I don't know of any updates on our end.

Hey folks i got prisma to run on cockroach with some simple changes today. I am not sure what works yet (needs some testing). If someone is interested i can push my fork do Dockerhub.

can't create the user-defined function raise_exception, since CRDB doesn't support UDFs (it's unlikely to anytime soon, so will probaby need to do something different on the Prisma side)

[x] I used crdb_internal.force_error as suggested by @nvanbenschoten but i am not sure if it works

pg_advisory_lock undefined (we can add this on the CRDB side, even if just as a no-op)

[x] I just made the lock function a noop for now (this is problematic  because it will break stuff i don't really know what)

CREATE SCHEMA syntax error (CRDB doesn't currently support multiple schemas (docs); we could add that or maybe Prisma could use multiple databases instead…)

[x] I made prisma run as root and created databases instead. An other approach i will test is to just use namespacing in table names.

@flexzuu I'd definitely be interested in seeing this. Were all your changes on the Prisma side?

@vilterp yep all changes where made in the postgresql connector for prisma. I have not looked into make production mode of cockroach work with prisma though (only --insecure for now)

Hey @flexzuu, that sounds awesome! If you want you can make a PR against our alpha branch. This will trigger our CI and if you rewrote the Postgres Connector we can tell you which tests still fail and maybe help you out with the ones that are broken.

Is there any high-level timeline for when work will begin on this? I'd really love to see it land especially since its low hanging fruit!

@flexzuu knock knock :)I can help if needed for cockroachdb.

All I want for Christmas is this :(

Has anyone tried using prisma introspect against an existing CRDB database? These are the known issues with introspection of Postgres databases: https://github.com/prisma/prisma/issues/2377

This would be a truly amazing integration, CRDB+Prisma would be a distributed dream.

Any progress or news for this amazing feature?

I think it might be a giveaway if the frigging founder of cockroachdb is speaking on prisma day :]

@flexzuu could you please share the changes you made to get this going?

Hey all, I work at Cockroach Labs - we're definitely interested in helping get this work going!
Who should I talk to about this? Maybe @mavilein?

Hey @jordanlewis 👋 ,
i wonder whether our existing Postgres Connector works with Cockroach out of the box. Could you give that a try? We will happily work an on any bugs you report. 🙏

@mavilein It does not, as we use schemas and CockroachDB does not support creating schemas, it just has the default schema 'public' already available.
❯ go run github.com/prisma/photongo lift save --create-db --name init
Response {"message":"Failure during a migration command: Connector error. (error: Error querying the database: Error querying the database: Error querying the database: db error: ERROR: at or near \"if\": syntax error: unimplemented: this syntax)","backtrace":null} doesn't have an id and I can't handle that (yet)
Got result for unknown id undefined
 ERROR  Oops, an unexpected error occured!
Error in migration engine: Dec 15 13:36:43.413  INFO migration_engine: msg="Starting migration engine RPC server" git_h
ash="4028eec09329a14692b13f06581329fddb7b2876"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:47] "here" = "here"
Dec 15 13:36:43.431  INFO quaint::single: Starting a postgresql pool with 1 connections.
[migration-engine/connectors/sql-migration-connector/src/lib.rs:52] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:60] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:66] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:107] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/error.rs:117] &error = QueryError(
    Error { kind: Db, cause: Some(DbError { severity: "ERROR", parsed_severity: None, code: SqlState("0A000"), message:
 "at or near \"if\": syntax error: unimplemented: this syntax", detail: Some("source SQL:\nCREATE SCHEMA IF NOT EXISTS
\"public\"\n              ^"), hint: Some("You have attempted to use a feature that is not yet implemented.\nSee: https
://github.com/cockroachdb/cockroach/issues/26443"), position: None, where_: None, schema: None, table: None, column: No
ne, datatype: None, constraint: None, file: Some("lexer.go"), line: Some(160), routine: Some("UnimplementedWithIssueDet
ail") }) }

    stack backtrace:
       0: backtrace::backtrace::trace
       1: backtrace::capture::Backtrace::new_unresolved
       2: failure::backtrace::internal::InternalBacktrace::new
       3: <failure::backtrace::Backtrace as core::default::Default>::default
       4: quaint::connector::postgres::error::<impl core::convert::From<tokio_postgres::error::Error> for quaint::error
::Error>::from
       5: <std::future::GenFuture<T> as core::future::future::Future>::poll
       6: <std::future::GenFuture<T> as core::future::future::Future>::poll
       7: <std::future::GenFuture<T> as core::future::future::Future>::poll
       8: std::future::poll_with_tls_context
       9: std::future::poll_with_tls_context
      10: <std::future::GenFuture<T> as core::future::future::Future>::poll
      11: tracing_core::dispatcher::with_default
      12: std::thread::local::LocalKey<T>::with

@steebchen : If Cockroach does not support it you shoud also not try to create the schema. It would try to do this:

Specify the public schema in the connection string in the Prisma schema.
Do not use --create-db in lift save. As it cannot work anyway.

I implemented your suggestions but it still fails with the same error:
datasource db {
	provider = "postgres"
	url      = "postgresql://root@localhost:26257/postgres?sslmode=disable&schema=public"
}

$ prisma2 lift save
Response {"message":"Failure during a migration command: Connector error. (error: Error querying the database: Error querying the database: Error querying the database: db error: ERROR: at or near \"if\": syntax error: unimplemented: this syntax)","backtrace":null} doesn't have an id and I can't handle that (yet)
Got result for unknown id undefined
 ERROR  Oops, an unexpected error occured!
Error in migration engine: Dec 16 11:33:49.232  INFO migration_engine: msg="Starting migr
 ERROR  Oops, an unexpected error occured!
Error in migration engine: Dec 16 11:33:49.232  INFO migration_engine: msg="Starting migr
ation engine RPC server" git_hash="4028eec09329a14692b13f06581329fddb7b2876"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:47] "here" = "here"
Dec 16 11:33:49.247  INFO quaint::single: Starting a postgresql pool with 1 connections.

[migration-engine/connectors/sql-migration-connector/src/lib.rs:52] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:60] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:66] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/lib.rs:107] "here" = "here"
[migration-engine/connectors/sql-migration-connector/src/error.rs:117] &error = QueryErro
r(
    Error { kind: Db, cause: Some(DbError { severity: "ERROR", parsed_severity: None, cod
e: SqlState("0A000"), message: "at or near \"if\": syntax error: unimplemented: this synt
ax", detail: Some("source SQL:\nCREATE SCHEMA IF NOT EXISTS \"public\"\n              ^")
, hint: Some("You have attempted to use a feature that is not yet implemented.\nSee: http
s://github.com/cockroachdb/cockroach/issues/26443"), position: None, where_: None, schema
: None, table: None, column: None, datatype: None, constraint: None, file: Some("lexer.go
"), line: Some(160), routine: Some("UnimplementedWithIssueDetail") }) }

    stack backtrace:
       0: backtrace::backtrace::trace
       1: backtrace::capture::Backtrace::new_unresolved
       2: failure::backtrace::internal::InternalBacktrace::new
       3: <failure::backtrace::Backtrace as core::default::Default>::default
       4: quaint::connector::postgres::error::<impl core::convert::From<tokio_postgres::e
rror::Error> for quaint::error::Error>::from
       5: <std::future::GenFuture<T> as core::future::future::Future>::poll
       6: <std::future::GenFuture<T> as core::future::future::Future>::poll
       7: <std::future::GenFuture<T> as core::future::future::Future>::poll
       8: std::future::poll_with_tls_context
       9: std::future::poll_with_tls_context
      10: <std::future::GenFuture<T> as core::future::future::Future>::poll
      11: tracing_core::dispatcher::with_default
      12: std::thread::local::LocalKey<T>::with
      13: tokio::runtime::threadpool::Runtime::block_on


Change ConcurrentGauge to use new PeriodicExecutor

Environment Details

Helidon Version: 2.x
Helidon SE or Helidon MP SE
JDK version:
OS:
Docker version (if applicable):

Problem Description
ConcurrentGauge depends on statistics reflecting the previous clock minute. The implementation currently computes the current minute from the current system time in ms on every update to the metric. This  can be costly under heavy load.
As part of PR #3385 which addresses issue #3389, a new class is added to metrics/metrics which ConcurrentGauge should use to optimize the calculation of current minute.

See the comments in the PR. Closing as "will not fix" -- at least for now.


Nonomiya Nonono Retirement

Please update this regarding to Nonomiya Nonono
https://twitter.com/nonomiyanonono/status/1301882745602281473
Thank you

There will be the last stream but soon she won't stream again. See ya next time.


Fix how Tooltip renders custom title content

Original Issue:
Updating to HSDS v3 in HSApp, I noticed that a Tooltip which is passed a custom element as the title property, was no longer rendering correctly (it was displaying as "Object object")

Upon investigating, I determined that the Tooltip renders title via a span with dangerouslySetHTML which does work fine with Tippy's render when the title is in fact a string, but was completely breaking for any other type of custom title content.
Solution:
I added a check for whether the title attribute being passed into Tooltip is a string, and if so, go ahead with the implementation as is, but otherwise we pass through the custom content directly to the Tippy render function. This seems to work great but I'm new to Tippy so not sure if there's any downside to doing this.

Storybook:
Two new stories

Input Custom Error state
Tooltip Custom content

@plbabin so this works, but open to however way you want to solve it. Ultimately it wasn't our use of Tippy that was incorrect but more just that the way we passed the title into Tippy's render method, it seems to just assume it will always be a string but we have use cases in HSApp where we pass react elements as the title (errorMessage on Input -> Tooltip title)


vscode-extensions.reditorsupport.r: 2.8.3 -> 2.8.4

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/REditorSupport/vscode-R/releases.
meta.description for vscode-extensions.reditorsupport.r is: A Visual Studio Code extension for the R programming language
meta.homepage for vscode-extensions.reditorsupport.r is: https://github.com/REditorSupport/vscode-R
meta.changelog for vscode-extensions.reditorsupport.r is: https://marketplace.visualstudio.com/items/REditorSupport.r/changelog
Updates performed

Version update

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.8.4 with grep in /nix/store/1s75w29fkv1vcj5lrwkn200l31jibhnz-vscode-extension-reditorsupport-r-2.8.4
found 2.8.4 in filename of file in /nix/store/1s75w29fkv1vcj5lrwkn200l31jibhnz-vscode-extension-reditorsupport-r-2.8.4

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

vscode-extensions.reditorsupport.r

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/1s75w29fkv1vcj5lrwkn200l31jibhnz-vscode-extension-reditorsupport-r-2.8.4 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A vscode-extensions.reditorsupport.r https://github.com/r-ryantm/nixpkgs/archive/ba7b60d078eba3c084f1d1464a29d69300018e1e.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/ba7b60d078eba3c084f1d1464a29d69300018e1e#vscode-extensions.reditorsupport.r

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/1s75w29fkv1vcj5lrwkn200l31jibhnz-vscode-extension-reditorsupport-r-2.8.4
ls -la /nix/store/1s75w29fkv1vcj5lrwkn200l31jibhnz-vscode-extension-reditorsupport-r-2.8.4/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

1 package built:

vscode-extensions.reditorsupport.r

Maintainer pings
cc @Pandapip1 for testing.

Result of nixpkgs-review pr 312582 run on aarch64-linux 1


feat: Add env_var and metavar to --editor argument in args.py

Hello! On my Windows /editor command opens default editor, notepad, I want it to open vscode instead.
aider --editor "C:/Users/popstas/AppData/Local/Programs/Microsoft VS Code/Code.exe" - works, but I prefer to add this to config.

Sorry, I didn't try this code, didn't create a developer environment.
But I've tested it with a command line argument, and it doesn't work either: aider doesn't wait for the file closing, it deletes immediately... Just recorded a video:
https://github.com/user-attachments/assets/68672ca9-0c7b-4b4a-a29c-e60535270a53

I found the workaround, it works with vscode as expected:
aider --editor "C:/Users/popstas/AppData/Local/Programs/Microsoft VS Code/Code.exe --wait"

This doc may be helpful:
https://aider.chat/docs/config/editor.html


Add submodule for Google benchmark

We will use this for writing benchmarks of IREE. The dependency should be limited to the benchmarking code.

Hmmm so I'm confused about this error:
Run git clone https://github.com/$GITHUB_REPOSITORY $GITHUB_WORKSPACE --no-checkout --no-tags
  git clone https://github.com/$GITHUB_REPOSITORY $GITHUB_WORKSPACE --no-checkout --no-tags
  git checkout $GITHUB_SHA
  shell: /bin/bash -e {0}
Cloning into '/home/runner/work/iree/iree'...
fatal: reference is not a tree: 878dbb61141a3d91c59f419f5ea5c99d8f75c387
##[error]Process completed with exit code 128.

 Running git submodule update works fine for me locally. I wonder if this has to do with my use of the populate_reference_repo script?

Dup?

Yeah this one was failing with a mysterious error about being unable to clone on the CI and I wasn't sure if my repo was corrupted or something so I tried again from a clean repo. That had the same errors though.

Can you share the exact git commands you are using?

To do what? To create this PR I just used git add submodule. The error is in the CI

Ah it looks like this failure has been happening for a while, e.g. here's a PR before mine with the same issue https://github.com/google/iree/pull/80/checks?check_run_id=268891759

In fact, I don't think this check has ever worked: https://github.com/google/iree/pull/62/checks

Sorry, I misunderstood: I thought you were saying that you were having trouble cloning with this patch in place. Yes, that ci check has been broken and should probably be disabled, if not ready to fix. I haven't looked into it but please feel free.

Yes, the checks on GitHub aren't fully configured yet.

Filed https://github.com/google/iree/issues/85


Printdhruv deep cnn.md

Typo

Can one of the admins verify this patch?

Thanks for the pull request! Both versions are correct, but since the change is unnecessary, closing.


How to update Toml file if I add new position without recreate file?

I wanted to ask that on Discord, but u don't have it(

Hmm...what is add new position?

My discord: Peanutz_OwO#2750

Hmm...what is add new position?

My discord: Peanutz_OwO#2750

So as example I have in version 1.0 of my app something like this
[server]
ip = "..."
port = 8080

[remote-storage]
user = "..."
password = "..."

and in version 1.1 I changed it to
[server]
ip = "..."
port = 8080
ssl = false

[remote-storage]
user = "..."
password = "..."

How todo correctly for get new param to toml file with out lost already edited values in file.

Do you have a model data class for server? If so to add an ssl property should work.

Do you have a model data class for server? If so to add an ssl property should work.

If I add any new property without ignoreUnknown = true app not start, and if I use it file does not add new param that's created after file is generated first time

If I add any new property without ignoreUnknown = true app not start...

No modification to either model class or TOML file since you want to update in advance by here:

Add new properties with default parameters into model class.
Call Toml.decodeFromString to load existing data.
Call Toml.encodeToString to update TOML file.

Try this.

Okei, I try it at morning. Currently I have 4:35AM and didn't want go up from bed😂

SLEEP bro!

SLEEP bro!

 Refactored to kotlin style. That's is final. I check if the version is new, then update the config.
I know. That's is a piece of shit😂😂

https://github.com/syorito-hatsuki/McStatus/blob/master/DiscordBot/src/main/kotlin/dev/fstudio/mc_discord_bot/utils/ConfigManager.kt

Good, was there something wrong during process?

Good, was there something wrong during the process?

Currently not. But I don't have any idea how to add check -> if some line is deleted, load default

Currently not...

If related property has default, it will read that automatically. This is kotlinx.serialization core feature. But if you want to make it a must, put an @Required annotation on that property.

When I add annotation and remove from file line. I get the next error
Field 'statusUpdateTime' is required for type with serial name 'dev.fstudio.mc_discord_bot.model.Discord', but it was missing

When I add annotation and remove from file line. I get the next error

This is what @Required does. It means that you must provide that annotated value in the file.

When I add annotation and remove from file line. I get the next error

This is what @Required does. It means that you must provide that annotated value in the file.
Maybe I don't get what you want?

Yes. But I found fix :D Thats line check params equals :)
Config.serializer().equals(config) //If not same return false

//So here I inverted it
if (config.version != Build.VERSION || !Config.serializer().equals(config)) {
    writeConfig(config)
}

Yes. But I found fix :D Thats line check params equals :)

Config.serializer() returns KSerializer<Config>, while config is a Config. These two can't be equal, which means the latter condition(with exclamation mark) is always true. 😕❓

Yes. But I found fix :D Thats line check params equals :)

Config.serializer() returns KSerializer<Config>, while config is a Config. These two can't be equal, which means the latter condition(with exclamation mark) is always true. confusedquestion

Oh. You sure... Hmm... Then... How? Equal two objects (not param)

Oh. You sure... Hmm... Then... How? Equal two objects (not param)

May I ask again what is your question or demand? This is importatnt.

May I ask again what is your question or demand? This is importatnt.

Question. Currently, I do in title questing using that
init {
        Toml { ignoreUnknownKeys = true }
        writeConfig(readConfig())
    }

    private fun writeConfig(oldConfig: Config) {
        file.also {
            val newConfig = Toml.encodeToString(
                Config.serializer(),
                oldConfig.copy(version = Build.VERSION)
            )
            it.writeText(newConfig)
        }
    }

    fun readConfig(): Config {
        if (!file.exists())
            writeConfig(Config())
        return Toml.decodeFromString(Config.serializer(), file.readText())
    }

But I'm not sure. That's is best away or not

See if this is what you want:
private val toml = Toml { ignoreUnknownKeys = true }

var config: Config
    private set

init {
    config = readConfig()
    if (config.version != Build.VERSION)
        config = writeConfig(config)
}

private fun writeConfig(old: Config): Config {
    val new = toml.encodeToString(
        Config.serializer(),
        old.copy(version = Build.VERSION)
    )
    file.writeText(new)
    return new
}

fun readConfig(): Config = if (!file.exists()) {
    writeConfig(Config())
} else {
    toml.decodeFromString(Config.serializer(), file.readText())
}

See if this is what you want:
private val toml = Toml { ignoreUnknownKeys = true }

var config: Config
    private set

init {
    config = readConfig()
    if (config.version != Build.VERSION)
        config = writeConfig(config)
}

private fun writeConfig(old: Config): Config {
    val new = old.copy(version = Build.VERSION)
    file.writeText(toml.encodeToString(Config.serializer(), new))
    return new
}

fun readConfig(): Config = if (!file.exists()) {
    writeConfig(Config())
} else {
    toml.decodeFromString(Config.serializer(), file.readText())
}

Not helping. If delete in data class any param and then try to parse for update I get UnknownFieldException

Did you copy exactly what I have written? If so it should be fine.

UnknownFieldException? Can you paste the whole exception stacktrace here?
Did you copy exactly what I wrote? If so it should be fine.
Also what does param mean? Is it property or default value?

So... We can end it with the next words -> I'm bad developer :D

@Peanuuutz So if I just re-write out the new data, will it keep the comments it reads?

@Peanuuutz So if I just re-write out the new data, will it keep the comments it reads?

What do you mean "keep the comments it reads"? Comments are left out during parsing.

@Peanuuutz Ahhh... I'll read a toml that a user already has and make some updates to it, but I want to keep the rest of the original content, like the comments and all that, of course, this is not necessary

@Peanuuutz Ahhh... I'll read a toml that a user already has and make some updates to it, but I want to keep the rest of the original content, like the comments and all that, of course, this is not necessary

Incremental serialization is a bit hard to implement for kotlinx.serialization. However if comments are recognised this issue could be solved at some point.


[wip] Adding secrets as part of task template

Signed-off-by: Ketan Umare<EMAIL_ADDRESS>TL;DR
Please replace this text with a description of what this PR accomplishes.
Type

[ ] Bug Fix
[ ] Feature
[ ] Plugin

Are all requirements met?

[ ] Code completed
[ ] Smoke tested
[ ] Unit tests added
[ ] Code documentation added
[ ] Any pending items have an associated Issue

Complete description
How did you fix the bug, make the feature etc. Link to any design docs etc
Tracking Issue
https://github.com/lyft/flyte/issues/
Follow-up issue
NA
OR
https://github.com/lyft/flyte/issues/

Closing since we added secrets in https://github.com/flyteorg/flyteidl/pull/114 and https://github.com/flyteorg/flyteidl/pull/108


Add support to insert a processor before the defaultProcessors in the CatalogBuilder

I would like to add a CatalogProcessor that is run before the defaultProcessors.
Our company has a custom yaml file type, that we convert to an entity that is emitted, then we can return true.
We would like to use the great ecosystem of processors such as GithubDiscoveryProcessor and BitbucketDiscoveryProcessor, however since they both return a target type of url, the UrlReaderProcessor will attempts to process the file, (and throw an errors) before our Custom Processor is able to make decide if it is a catalog-info.yaml format OR our custom yaml.
Feature Suggestion
Without having to copy / paste / maintain the default set of processors, add support to allow for our custom processors be run before the defaults.
Possible Implementation
current code:
    // These are only added unless the user replaced them all
    if (!this.processorsReplace) {
      processors.push(
        new FileReaderProcessor(),
        BitbucketDiscoveryProcessor.fromConfig(config, { logger }),
        GithubDiscoveryProcessor.fromConfig(config, { logger }),
        GithubOrgReaderProcessor.fromConfig(config, { logger }),
        GitLabDiscoveryProcessor.fromConfig(config, { logger }),
        new UrlReaderProcessor({ reader, logger }),
        CodeOwnersProcessor.fromConfig(config, { logger, reader }),
        new AnnotateLocationEntityProcessor({ integrations }),
      );
    }

    // Add the ones (if any) that the user added
    processors.push(...this.processors);

Option 1)
builder.addProcessor - instead of being is added AFTER the default processors add it BEFORE the defaults.
This might be a breaking change.
    // Add the ones (if any) that the user added
    processors.push(...this.processors);

    // These are only added unless the user replaced them all
    if (!this.processorsReplace) {
      processors.push(
        new FileReaderProcessor(),
        BitbucketDiscoveryProcessor.fromConfig(config, { logger }),
        GithubDiscoveryProcessor.fromConfig(config, { logger }),
        GithubOrgReaderProcessor.fromConfig(config, { logger }),
        GitLabDiscoveryProcessor.fromConfig(config, { logger }),
        new UrlReaderProcessor({ reader, logger }),
        CodeOwnersProcessor.fromConfig(config, { logger, reader }),
        new AnnotateLocationEntityProcessor({ integrations }),
      );
    }

Option 2)
builder.insertProcessor - extend the CatalogProcessor with another method that would, hold another array of processors that will be inserted BEFORE the default processors.
    // Add the ones (if any) that the user needs before the defaults
    processors.push(...this.insertProcessors);

    // These are only added unless the user replaced them all
    if (!this.processorsReplace) {
      processors.push(
        new FileReaderProcessor(),
        BitbucketDiscoveryProcessor.fromConfig(config, { logger }),
        GithubDiscoveryProcessor.fromConfig(config, { logger }),
        GithubOrgReaderProcessor.fromConfig(config, { logger }),
        GitLabDiscoveryProcessor.fromConfig(config, { logger }),
        new UrlReaderProcessor({ reader, logger }),
        CodeOwnersProcessor.fromConfig(config, { logger, reader }),
        new AnnotateLocationEntityProcessor({ integrations }),
      );
    }

    // Add the ones (if any) that the user needs after the defaults
    processors.push(...this.processors);

Context
There has a few issues that are similar, this it feels like replaceProcessors is problematic.
https://github.com/backstage/backstage/issues/5388
https://github.com/backstage/backstage/pull/5414
https://github.com/backstage/backstage/issues/6542
https://github.com/backstage/backstage/issues/7661

@bryce-od was wondering if you are adding any additional default processors outside of the processors defined below?  When i use addProcessors i don't get this error, wasn't sure if i may be missing a processor...
Error: scaffolder error Failed to parse template string: /catalog-info.yaml with error Unexpected token / in JSON at position 0 type=plugin
import {
    AnnotateLocationEntityProcessor,
    BitbucketDiscoveryProcessor,
    CatalogBuilder,
    FileReaderProcessor,
    LocationEntityProcessor,
    UrlReaderProcessor,
  } from '@backstage/plugin-catalog-backend';
  import { ScaffolderEntitiesProcessor } from '@backstage/plugin-scaffolder-backend';
  import { Router } from 'express';
  import { PluginEnvironment } from '../types';
  import { ScmIntegrations } from '@backstage/integration';
  import { customBitbucketRepositoryParser } from './catalog/customBitbucketRepositoryParser';

  export default async function createPlugin(
    env: PluginEnvironment,
  ): Promise<Router> {
    const integrations = ScmIntegrations.fromConfig(env.config);
    const builder = await CatalogBuilder.create(env);

    builder.replaceProcessors([
      new ScaffolderEntitiesProcessor(),
      new FileReaderProcessor(),
      BitbucketDiscoveryProcessor.fromConfig(env.config, {
        parser: customBitbucketRepositoryParser,
        logger: env.logger,
      }),
      new UrlReaderProcessor({ reader: env.reader, logger: env.logger }),
      new LocationEntityProcessor({ integrations }),
      new AnnotateLocationEntityProcessor({ integrations }),
    ]);

    const { processingEngine, router } = await builder.setRefreshIntervalSeconds(600).build();
    await processingEngine.start();
    return router;
  }

@jhaals
I created a PR, let me know what you think:
https://github.com/backstage/backstage/pull/7885
I was not able to make the method static without including the all of the args to wire up the config, logger etc, so I opt-ed to just make it an instance method.

Thanks @bryce-od! Looks good and I just merged it in 👍  Great contribution

@bryce-od how are you adding getDefaultProcessors in your catalog.ts? After this change I am getting the following error when using replaceProcessors:
info.message.replace is not a function type=plugin entity=location:default/generated-3bde7d383af466010592c866ff6e704a05451302`


[Multispecies functionality] Support per-specie searches

This is an epic issue, to group the different tasks that are needed for the following new feature.
In summary, we want the user to be able to select a specie among the ones available in the application dataset and then affected searches should restrict the list of returned genes to those belonging to the selected specie.
When "all" is selected (or no selection is made), the searches shouldn't filter by specie and should keep working as they do right now.
This affects:
The user interface, issue #635

Should have some specie selector (and use the corresponding taxId to invoke the APIs).
Should adjust the chromosome names in chromosome region selection according to the selected specie
Should present the correct chromosome view (map view) based on the selected specie

The API

Should have the taxId parameter where relevant, issue #626.
Should have APIs to allow the client to know specie-dependent information, such as taxId + specie name, chromosome names, data from the map view. Such API should also serve general information that currently are hardwired in the .war files. Issue #641
As a chore improvement, should change the way the configuration is loaded in memory and used to serve the API. Issue #642

KnetSpace

TODO: anything needed?

Lawal and I got my local instance working, so I've made some small comments below.
For a start; I think the only reason the Realease Notes button redirects to the same text page each time is because of the mock dataset being used(?). I see the right TaxID is in the URL.
The rest is really just housekeeping stuff:
Secondly:

Maybe an issue on my end with having dark mode enabled (or maybe high resolution monitor problems?) But white on white isn't working here.
Thirdly:
The formatting of the Species Description box is different to the box right above. Using colon (:) now when dash (-) was used previously doesn't seem right. The font sizes also appear different. Consider capitalising the first letter of each first word too. Lastly, consider adding a hide button to the Species Description box as well.

Fourthly:
I'm wondering if it wouldn't maybe be wise to just remove the background alltogether. Maybe make it some generic network-esk photo or something. I'll speak to you about this though.
Well done with this 👯!

@manlikleo and I discussed using one generic wallpaper. If anyone wants to vote, here are some mockups of quick ideas. If you have any other ideas just say.

I like 1 and 8.

Or something custom like:
9.

Just a reminder that we need to be careful when this is implemented to ensure our F test hasn't broken, as it needs to consider the correct amount of "total genes", not the grand total across all species in the multispecies grouping.
Historical notes for comparison, using Example 3 - Grain colour + PHS:
https://knetminer.com/Triticum_aestivum/

We already discussed this, and we decided that, at least for now, the totals will be about the total no of genes in the dataset. We expect that this won't change the computed pvalues too much, assuming a dataset where there isn't much variation of gene annotations across species.
Technically, the problem is we don't have the per-specie totals, neither at the level of semantic motifs (ie gene/concept associations are not separated per-specie), nor in absolute sense (ie, we don't have a per-specie table about the no of genes in each specie), so it's currently impossible to be specie-specific with estimators like Fisher.


[Removal]: Request Removal from Denylist

Hotspot Name
Flat Carmine Chipmunk
Hotspot b58 Address
112RiswirHVKBtducVULao3zU62JD3buiYyrYNQH2q17Ld1AhP1M
Discord Handle
No response
Hotspot Manufacturer
Heltec Automation
Removal Reason
My hot spot is on the denylist. Now they have been adjusted, corrected previous mistakes, and redeployed on the spot. Hope to be removed from the denylist. Thank you very much!
Modifications
No
Extra forwarders
No
Extra antennas
No
Additional Information

The location of the hot spot is in the UK, but the photo environment is definitely China, please don't waste the administrator's time, you should enjoy the denylist and stay in the denylist forever.


fix bugs when unnormalize with customize mean and std

Fix bugs for #4

[x] change method name
[x] fix set_image_std
[x] add test case

Thank you for the fix! The changes you made looks good. The only thing I'm not sure is the test case where you assert (rgb_img_1==rgb_img).all(). I wonder if this will always be true due to the numerical precision (i.e. there may be a 0.0001 difference when we normalize an image and then un-normalize it).
Can you try something more complicated like mean=[0.485, 0.456, 0.406] and std=[0.229, 0.224, 0.225] and see if this assertion is still true?
If the above test case is fine. How about mean=[0.4851231531212364564, 0.4561231523135436, 0.406123412312452343] and std=[0.2293453455673435, 0.22434531445342, 0.22534534472423]

Done~
Yes, there will be some difference when we normalize an image and then un-normalize it.
In your complicated two cases, np.abs(rgb_img_1-rgb_img_numpy).max() will be 5.9604645e-08

Sorry for the late respond, I went to deal with some other errands. Thank you for your contribution!


Comprehensive service matching with MatchBox

http://dl.acm.org/citation.cfm?id=2803181&CFID=556825173&CFTOKEN=35211747

They contrast their tool to other tools but provide no data set

They contrast their tool to other tools but do not provide a list of relevant tools they contrasted themselves to nor do they provide and data set(s) or direct comparisons to current available tools


Adding Sphinx documentation for PyAbel

Following issue #25, this PR adds a draft documentation for PyAbel using Sphinx.
As suggested by @DanHickstein this setup uses the readthedocs.org theme, and Napoleon for Numpy style docstrings.
In addition, this setup uses the recommonmark package to process either .rst or .md documentation files. Markdown for some parts of the documentation would be nice, and we could then potentially reuse the same files between Sphinx and the github wiki.
To build the documentation locally you need to have Sphinx and recommonmark installed, and the html pages can be generated with:
 cd PyAbel/doc/
 make html

The html files currently produced with this command are accessible at http://r0h.eu/it/static/d/PyAbel/index.html although more work is necessary in order to ensure that all docstings are compatible with Numpy style and to add some general explanations.
In addition, more work would be necessary to automate deployment of the documentation somewhere (for instance to github pages).  I would like to it this latter point before merging this PR.
@DanHickstein Sorry for not responding earlier in issue #25, I completely agree with your comments there.
Edit: sphinx_rtd_theme  also needs to be installed.

Great work @rth!!
What about hosting the docs on readthedocs.org? Not that I have done much research into the options, but this seems like an easy one...
I made an account on readthedocs.org, so now there is a site for PyAbel: http://pyabel.readthedocs.org/en/latest/
I doesn't work quite yet, but I think that it should after things are tweaked.

There is a fair bit of work required for hansenlaw.py as sphinx et al. does not appear to appreciate ascii art. No matter, this change is good.
My attempt at running make html inside of @rth's doc directory (doc branch) gave an error. However, this may be system set-up issue on my Linux system (?).

[vuvpc5:.+/rth/PyAbel/doc]$ make html
sphinx-build -b html -d build/doctrees   source build/html
Running Sphinx v1.2.3
loading pickled environment... not yet created
Exception occurred:
File "/usr/lib/python2.7/dist-packages/sphinx/util/init.py", line 94, in get_matching_docs
suffixpattern = '*' + suffix
TypeError: cannot concatenate 'str' and 'list' objects
The full traceback has been saved in /tmp/sphinx-err-z4ovtb.log, if you want to report the issue to the >developers.
Please also report this if it was a user error, so that a better error message can be provided next time.
A bug report can be filed in the tracker at https://bitbucket.org/birkenfeld/sphinx/issues/. Thanks!
Makefile:55: recipe for target 'html' failed
make: *** [html] Error 1

@DanHickstein  Hosting is readthedocs.org is a good idea. Since now we have not reached the 1.0 yet, and  there is a lot of things that change in the interface, I think we could just update the docs everything we push to the repo (to keep them in sync). This could be apparently acchieved with webhooks. @DanHickstein would you mind activating it in github account if this works for you.
@stggh I think ascii art should still work, but you would probably have to wrap it into some .rst markdown to mark it as code (not sure which though, this need to be looked into). As to the error you are getting, sorry I forgot to tell that  sphinx_rtd_theme also need to be installed. This might be what is causing this error. Otherwise this should work in PY2.7 and PY3. Let me know if this was the issue.

@rth Yes, the webhook sounds awesome. I activated it in the github account. I think that we can also have documentation for each version release, but I'm slightly confused about how exactly this works: http://docs.readthedocs.org/en/latest/versions.html
@stggh, I think that you can achieve a literal block (fixed width text) by using two colons and then indenting the following text:
http://docutils.sourceforge.net/docs/user/rst/quickref.html#literal-blocks
https://github.com/numpy/numpy/blob/master/doc/HOWTO_DOCUMENT.rst.txt#common-rest-concepts

@rth
No joy with spinx_rtd_theme. I have apt-get installed every PY2.7 python-sphinx-* and sphinx*. The error log:

Sphinx version: 1.2.3
Python version: 2.7.10
Docutils version: 0.12 release
Jinja2 version: 2.8
Loaded extensions:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/sphinx/cmdline.py", line 253, in main
warningiserror, tags, verbosity, parallel)
File "/usr/lib/python2.7/dist-packages/sphinx/application.py", line 145, in init
self._init_env(freshenv)
File "/usr/lib/python2.7/dist-packages/sphinx/application.py", line 191, in _init_env
return self._init_env(freshenv=True)
File "/usr/lib/python2.7/dist-packages/sphinx/application.py", line 173, in _init_env
self.env.find_files(self.config)
File "/usr/lib/python2.7/dist-packages/sphinx/environment.py", line 350, in find_files
self.srcdir, config.source_suffix, exclude_matchers=matchers))
File "/usr/lib/python2.7/dist-packages/sphinx/util/init.py", line 94, in get_matching_docs
suffixpattern = '*' + suffix
TypeError: cannot concatenate 'str' and 'list' objects

I am not sure how to initiate the doc build for PY3.
I will test my Mac OSX build at home on the weekend.
@DanHickstein
Thanks.

make html worked on my Mac after following the instructions here:
http://read-the-docs.readthedocs.org/en/latest/getting_started.html
I readthedocs set to automatically synchronize with PyAbel/master. However, you can set up your own readthedocs on your fork in order to test things (make sure that you set the correct branch in Advanced Settings). I did this for my own fork (which I made the same as @rth's latest fork):
http://pyabel-dh-fork.readthedocs.org/en/latest/
It showed up, but for some reason none of the doc strings get imported. My html builds locally, but not on readthedocs.org...

@DanHickstein, @rth,  :: does the job for maintaining the ascii art. The docs build locally and look nice. I have had less joy with readthedocs.org, but I have only skimmed the instructions.

I'm also having trouble getting the docs to work on readthedocs.org. Apparently if you use numpy or other C-based packages, then you need to use a workaround: http://read-the-docs.readthedocs.org/en/latest/faq.html
I tried this, but still can get my docs to build on rtd.org...

@DanHickstein  Yes, there was some issues with C extensions on readthedocs.org
The last few commits should fix that with the approaches proposed in their FAQ. Essentially this removes the requirement to have numpy installed when installing PyAbel on readthedocs, than mocks (with unittest.mock all the scipy/numpy related modules).
The docs should work now, and they build in my fork https://pyabel-rth.readthedocs.org/en/latest/abel.html#module-abel.benchmark
@DanHickstein Also in the PyAbel account on readthedocs.org under Admin>Advanced settings, could you please check the "Install your project inside a virtualenv using setup.py install" option for this to work? Thanks.

@rth, I selected the virtualenv option of readthedocs.org. It still gives an error regarding numpy, but I think that this is just because we have not merged this PR yet.

@DanHickstein Yes, sorry, sure it will not work on the main PyAbel branch as long as this is not merged. We should probably go ahead and merge it. There will be subsequent PRs to fix doc string formatting anyway, so if anything remains to do here, we can add it to those PR.

Fine with me to merge this, but @stggh still has PR https://github.com/PyAbel/PyAbel/pull/68 outstanding, and we usually cause all sorts of problems for him when we update the master branch while he's working on something.
@stggh, are you close to being ready to merge https://github.com/PyAbel/PyAbel/pull/68?

@DanHickstein You are right, we should merge PR #68 first...

@DanHickstein, @rth, @DhrubajyotiDas: I would be very happy for PR #68 to be merged. It contains many changes for the better. I have even taken the trouble to run pep8 ;-)   [not sure that I agree with blank space around % though].

Should we go ahead and merge this one now as well?
@stggh: blank space around % is, indeed, madness! :)


Issue trying to run code from page /notebooks/tutos/tuto_ship_detection.html

Hi,
I run the code provided below with the attached config file in Pycharm on Linux OS and everything works fine. When run in Pycharm on Windows 10, the below error occurs. This error occurs for PEPS and for other providers that the code previously worked for. There does not seem to be any information on this website (or anywhere else online) so it is not possible to to understand then fix the issue. Please can you help me?
All the best
Craig
#############
Code to be run #
#############
Link to SNAP Toolbox
snap_link ="C:\Program Files\snap\bin"
Name of config file
config_file = <same as file provided, it was just converted from .yml to .txt for downloading purposes>
Set coordinates
lonmin = 13.01
lonmax = 13.9
latmin = 45.1
latmax = 45.9
Set start and end date
start_date = "2021-05-01"
end_date = "2021-05-03"
Select product type
product_type = "S1_SAR_GRD"
Install packages
import os
import folium
from folium import plugins
import imageio
import matplotlib.pyplot as plt
import numpy as np
import rasterio as rio
from eodag.api.core import EODataAccessGateway
from eodag import setup_logging
Add absolute path to SNAP bin folder to make the gpt command available
os.environ["PATH"] = snap_link + ":" + os.environ["PATH"]
Set working directory
base_wd = os.getcwd()
os.chdir(base_wd)
Create the workspace folder
workspace = 'eodag_workspace_shipdetection'
if not os.path.isdir(workspace):
os.mkdir(workspace)
Move config file into workspace then start EODAG
if not os.path.isfile(os.path.join(base_wd, workspace, config_file)):
os.rename(os.path.join(base_wd, config_file), os.path.join(base_wd, workspace, config_file))
dag = EODataAccessGateway(os.path.join(base_wd, workspace, config_file))
Search for products in time and space
products, total_count = dag.search(
productType=product_type,
start=start_date,
end=end_date,
geom={"lonmin": lonmin, "latmin": latmin, "lonmax": lonmax, "latmax": latmax}
)
print(f"Got {total_count} products.")
#############
Error message ##
#############
Access violation - no RTTI data!
Error while searching on provider peps (ignored):
Traceback (most recent call last):
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\api\core.py", line 1037, in _do_search
res, nb_res = search_plugin.query(count=count, **kwargs)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\plugins\search\qssearch.py", line 225, in query
qp, qs = self.build_query_string(product_type, **keywords)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\plugins\search\qssearch.py", line 307, in build_query_string
format_metadata(provider_value, product_type, **kwargs)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\api\product\metadata_mapping.py", line 368, in format_metadata
return MetadataFormatter().vformat(search_param, args, kwargs)
File "C:\Users\craig\AppData\Local\Programs\Python\Python38\lib\string.py", line 167, in vformat
result, _ = self._vformat(format_string, args, kwargs, used_args, 2)
File "C:\Users\craig\AppData\Local\Programs\Python\Python38\lib\string.py", line 211, in vformat
obj = self.convert_field(obj, conversion)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\api\product\metadata_mapping.py", line 182, in convert_field
converted = self.custom_converter(value)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\eodag\api\product\metadata_mapping.py", line 204, in convert_to_rounded_wkt
wkt_value = wkt.dumps(value, rounding_precision=COORDS_ROUNDING_PRECISION)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\shapely\wkt.py", line 62, in dumps
return geos.WKTWriter(geos.lgeos, trim=trim, **kw).write(ob)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\shapely\geos.py", line 402, in write
text = string_at(result)
File "C:\Users\craig\AppData\Local\Programs\Python\Python38\lib\ctypes_init.py", line 514, in string_at
return _string_at(ptr, size)
OSError: exception: access violation reading 0x0000000000000000
Exception ignored in: <function BaseGeometry.del at 0x000002369631AD30>
Traceback (most recent call last):
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\shapely\geometry\base.py", line 209, in del
self._empty(val=None)
File "C:\Users\craig\PycharmProjects\Download_process_imagery\venv\lib\site-packages\shapely\geometry\base.py", line 194, in _empty
self._lgeos.GEOSGeom_destroy(self.geom)
OSError: exception: access violation writing 0x0000000000000000
Got 0 products.
eodag_test.txt

Hello @craigmpearce , and thanks for reporting your issue. We'll try to check and reproduce your error and then get back to you

Hi @sbrunato thank you for looking into this for me. I wanted to ask if you have made progress on this?

Hi @sbrunato thank you for looking into this for me. I wanted to ask if you have made progress on this?

Please try to update or re-install shapely to see if this can solve the issue. The issue seems to be related to your environment

Trying several different potential solutions including uninstalling, reinstalling then updating shapely (and some other related packages) did not work. Will persist with this to find a solution. Regarding the issues with the shapefiles, below is a link to the STEP Forum where a successful solution was proposed https://forum.step.esa.int/t/failed-to-import-geometry-with-particular-shapefiles-when-using-eodag-and-xml-config-files/34863/5


ignore the state.u and info.u objects

As explained by WLED Community the 2 objects (and their content) is only relevant for customization of the WLED web interface, meaning there is no benefit to have it in ioBroker.
To avoid issue in future (state definition missing) we will exclude everything from JSON API part of state.u and info.u
related conversation https://github.com/Aircoookie/WLED/issues/2131

implemented 0.6.0-0 https://github.com/DrozmotiX/ioBroker.wled/commit/1c73e93c3aecf491f243675cf0c759e4aabb049a


Race condition while updating notification

The following code updates notification on every new line of the output after pressing <Leader>gs:
local Job = require('plenary.job')

local function run_command()
  local notification
  local output = ''
  local on_data = function(_, data)
    -- output = output .. table.concat(data, '\n')
    output = output .. '\n' .. data
    notification = vim.notify(output, vim.log.levels.INFO, { replace = notification })
  end

  local job = Job:new({
    command = 'git',
    args = { 'status' },
    on_stdout = vim.schedule_wrap(on_data),
    on_stderr = vim.schedule_wrap(on_data),
  })

  job:start()
end

vim.keymap.set('', '<Leader>gs', run_command, { noremap = true })

But on my machine I see a notification with only first line.
But when I run :Telescope notify I have a full message.

So what's actually happening is the window doesn't automatically resize to fit the message. The reason for this is that there can be other notifications on the screen that would get hidden. Of course the rendering logic could attempt to move other windows but that'd mean more complex logic and handling not enough space somehow.
There are two simple workarounds:

Pre-allocate the size with empty lines, but that'd require knowing the content size
Manually resize the window.

Something like this should do
local Job = require("plenary.job")

local function run_command()
  local notification
  local output = ""
  local length = 0
  local win, height
  local on_data = function(_, data)
    -- output = output .. table.concat(data, '\n')
    output = output .. "\n" .. data
    notification = vim.notify(output, vim.log.levels.INFO, {
      replace = notification,
      on_open = function(win_)
        win, height = win_, vim.api.nvim_win_get_height(win_)
      end,
    })

    vim.api.nvim_win_set_height(win, height + length)
    length = length + 1
  end

  local job = Job:new({
    command = "git",
    args = { "status" },
    on_stdout = vim.schedule_wrap(on_data),
    on_stderr = vim.schedule_wrap(on_data),
  })

  job:start()
end

Thanks!

@rcarriga there is another weird behavior with this code. Executing it code twice leads to attempt to perform arithmetic on upvalue 'height' (a nil value).

This is an actual race condition because the height is being set before the window opens.
Just check height is not nil
    if height then
      vim.api.nvim_win_set_height(win, height + length)
    end

Oh, thanks!


Add a pipeline stage that is executed independently of the build/run result

This would be useful if we need to do some cleanup action regardless of the build/run status. E.g remove some temporary directory created outside of the stage dir.

I think that this could be addressed by fixtures, where the creation of the temp directory could be a fixture.


PIP ERROR

pip install quantcrypt
ERROR: Could not find a version that satisfies the requirement quantcrypt (from versions: 0.0.1, 0.0.2, 0.0.3, 0.0.4, 0.0.5, 0.0.6, 0.0.7, 0.0.8, 0.0.9, 0.0.10, 0.1.0, 0.1.1, 0.1.2, 0.1.3, 0.2.0, 0.3.0, 0.3.1, 0.3.2, 0.3.3)
ERROR: No matching distribution found for quantcrypt

Same issue here.

Nevermind, reran and it worked somehow.

@zikzkp QuantCrypt does not currently support any other Python version than 3.12, because doing so would require to compile the source for all Python versions separately, due to differences how CFFI interacts with Python. Maybe it's possible to compile for all Python versions separately and then include the exact binaries that match with the Python version, but that would require either creating separate PyPI packages or cramming all binaries into one package and then selecting them based on Python version. Both solutions have considerable downsides which I'm not willing to accept, so only one Python version is supported at this time. I'm open to ideas how to solve this without considerable downsides.

@zikzkp QuantCrypt does not currently support any other Python version than 3.12, because doing so would require to compile the source for all Python versions separately, due to differences how CFFI interacts with Python. Maybe it's possible to compile for all Python versions separately and then include the exact binaries that match with the Python version, but that would require either creating separate PyPI packages or cramming all binaries into one package and then selecting them based on Python version. Both solutions have considerable downsides which I'm not willing to accept, so only one Python version is supported at this time. I'm open to ideas how to solve this without considerable downsides.

Thanks for the clarification. I probably I'm gonna use the library. How can I email you ?

@zikzkp Unfortunately, I am unable to provide customer support about using this library outside of GitHub, therefore I kindly ask you to either raise a new issue or make a post in the Discussions section, which I have just enabled for this project.

@zikzkp Unfortunately, I am unable to provide customer support outside of GitHub about using this library, therefore I kindly ask you to either raise a new issue or make a post in the Discussions section, which I have just enabled for this project.

Thanks for getting back to me. I don't believe I require support. I'd like to inquire about the license as I'm interested in using it.

@zikzkp This library is licensed under the MIT license.


Error: "Cannot read property 'pins' of undefined" with Swift 5.6

Describe the bug
When updating my tools version to Swift 5.6, the extension no longer presents any package dependencies, just an ellipse ("…"). The error shown in the title of the issue is presented:
Cannot read property 'pins' of undefined

To Reproduce
Steps to reproduce the behavior:

Ensure that you have Xcode 13.3 installed and set as your default CLI tools.
Set your Package description's tools version to // swift-tools-version:5.6.
If it's not already open, open the project using VSCode.
Wait until the Package Dependencies pane opens.
See error

Expected behavior
A list of my project's packages are shown as with previous releases.
Environment

OS: macOS 12.3
Swift version: swift-driver version: 1.45.2 Apple Swift version 5.6 (swiftlang-<IP_ADDRESS>3.62 clang-13<IP_ADDRESS>)
Visual Studio Code version: 1.65.2
vscode-swift version: 0.3.0

I'm happy to provide any additional info that might be helpful.

Hi @tonyarnold
I'm going to need your Package.swift and Package.resolved to work out what is going on here. Is that ok to supply them?
cheers

Sure thing - here they are: https://gist.github.com/tonyarnold/2c28b8f10cd934c9930acfc712ce1cad

I can see what the issue is now. Hopefully be able to get a solution out soon

Thanks, @adam-fowler! Much appreciated. Do you have an ETA on when this might appear in an update to the extension?

Included in v0.4.0

Aargh looks like I messed up the release and that change didn't make it. I'll do a 0.4.1

Ignore that it did make it in