MiniMessage losing style when converting tree to component on input containing only style tags

Adventure: 4.12.0
Creating a component with following code
Component.text("_").mergeStyle(MiniMessage.miniMessage().deserialize("<bold><red>"));

ends in (<bold>_)
TextComponentImpl{content="_", style=StyleImpl{obfuscated=not_set, bold=true, strikethrough=not_set, underlined=not_set, italic=not_set, color=null, clickEvent=null, hoverEvent=null, insertion=null, font=null}, children=[]}

instead of a red colored and bold decorated underscore and a Component in a smiliar way to this (This is )
TextComponentImpl{content="_", style=StyleImpl{obfuscated=not_set, bold=true, strikethrough=not_set, underlined=not_set, italic=not_set, color=NamedTextColor{name="red", value="#ff5555"}, clickEvent=null, hoverEvent=null, insertion=null, font=null}, children=[]}

like in
Component.text("_", NamedTextColor.RED, TextDecoration.BOLD);

but why I think that this is a bug is because when adding any non-space char to the String in the mergeStyle call it is working without problems but I think that should only be a workaround. I included the Parse-Debug-Output of the deserialisation in the mergeStyle part at the end of this issue.
What I wanted to do: I am writing on a plugin for a private server (PaperMC), where a player can input a MiniMessage-Formated String (Like <bold><red>) as a command argument and then the style should be applied to the part of his next messages after the prefix, name and suffix (PREFIX NAME SUFFIX >> FORMAT MESSAGE). The first part until the format (format excluded) is present as String and the message (in the code example represented as _) is present as Component (deseralized MiniMessage) because it is deseralized with an other TagResolver bound to a permission the player has. All things worked except for the thing with the MiniMessage-Color-Tag because it is not included in the Component inside of the mergeStyle call.
[02:23:20 INFO]: Beginning parsing message <bold><red>
Attempting to match node 'bold' at column 0
Successfully matched node 'bold' to tag StylingTagImpl
Attempting to match node 'red' at column 0
Successfully matched node 'red' to tag StylingTagImpl
Attempting to match node 'bold' at column 0
Successfully matched node 'bold' to tag StylingTagImpl
Attempting to match node 'red' at column 6
Successfully matched node 'red' to tag StylingTagImpl
Text parsed into element tree:
Node {
  TagNode('bold') {
    TagNode('red') {
    }
  }
}
==========
treeToComponent
TagNode('red') {
}
    [02:23:20 INFO]:
TextComponentImpl{
    "content" = "",
    "style" = StyleImpl{
        "obfuscated" = not_set,
        "bold" = not_set,
        "strikethrough" = not_set,
        "underlined" = not_set,
        "italic" = not_set,
        "color" = NamedTextColor{
            "name" = "red",
            "value" = "#ff5555"
        },
        "clickEvent" = null,
        "hoverEvent" = null,
        "insertion" = null,
        "font" = null
    },
    "children" = []
}
==========
==========
treeToComponent
TagNode('bold') {
  TagNode('red') {
  }
}
    [02:23:20 INFO]:
TextComponentImpl{
    "content" = "",
    "style" = StyleImpl{
        "obfuscated" = not_set,
        "bold" = true,
        "strikethrough" = not_set,
        "underlined" = not_set,
        "italic" = not_set,
        "color" = null,
        "clickEvent" = null,
        "hoverEvent" = null,
        "insertion" = null,
        "font" = null
    },
    "children" = [
        TextComponentImpl{
            "content" = "",
            "style" = StyleImpl{
                "obfuscated" = not_set,
                "bold" = not_set,
                "strikethrough" = not_set,
                "underlined" = not_set,
                "italic" = not_set,
                "color" = NamedTextColor{
                    "name" = "red",
                    "value" = "#ff5555"
                },
                "clickEvent" = null,
                "hoverEvent" = null,
                "insertion" = null,
                "font" = null
            },
            "children" = []
        }
    ]
}
==========
==========
treeToComponent
Node {
  TagNode('bold') {
    TagNode('red') {
    }
  }
}
    [02:23:20 INFO]:
TextComponentImpl{
    "content" = "",
    "style" = StyleImpl{
        "obfuscated" = not_set,
        "bold" = not_set,
        "strikethrough" = not_set,
        "underlined" = not_set,
        "italic" = not_set,
        "color" = null,
        "clickEvent" = null,
        "hoverEvent" = null,
        "insertion" = null,
        "font" = null
    },
    "children" = [
        TextComponentImpl{
            "content" = "",
            "style" = StyleImpl{
                "obfuscated" = not_set,
                "bold" = true,
                "strikethrough" = not_set,
                "underlined" = not_set,
                "italic" = not_set,
                "color" = null,
                "clickEvent" = null,
                "hoverEvent" = null,
                "insertion" = null,
                "font" = null
            },
            "children" = [
                TextComponentImpl{
                    "content" = "",
                    "style" = StyleImpl{
                        "obfuscated" = not_set,
                        "bold" = not_set,
                        "strikethrough" = not_set,
                        "underlined" = not_set,
                        "italic" = not_set,
                        "color" = NamedTextColor{
                            "name" = "red",
                            "value" = "#ff5555"
                        },
                        "clickEvent" = null,
                        "hoverEvent" = null,
                        "insertion" = null,
                        "font" = null
                    },
                    "children" = []
                }
            ]
        }
    ]
}
==========

The cause: https://github.com/KyoriPowered/adventure/blob/529d407d55ca50e6dee10f5696063f97e34ae9b5/api/src/main/java/net/kyori/adventure/text/ComponentCompaction.java#L176-L203


Added new binning, new plotting, new animation maker

Added the run_withv2.py to reconstruct convergence map with catalogue RA corrections.

Updated for the night, fixed plotting functions in commit 6912a3f, pushed to a new branch called sayan-binning-fix.

I was working in the 'sayan-binning-fix' branch, which was forked off this branch recently. But, I made different changes, and have now integrated it into main using PR #28. I'll close this PR for now, but there are valuable notebooks that @s-Sayan has added in this PR that I don't want to lose, so they will be added back into main at a later date. For now, this PR can be considered closed.


[1473] copy about course content

Context
Copying course content
Changes proposed in this pull request
Add "Copy from" select to enable users to copy content from another course within their org
Guidance to review
Example - /organisations/2AT/courses/3CXD/about

Looking good!

When there's no courses to copy from, the C# version shows the following copy:

Found a couple of problems with this on dev:
After saving, changes shouldn't be published:

After copying and hitting the Save button I shouldn't get this warning:

Can we make the background of the select white?

This line is throwing:
https://github.com/DFE-Digital/manage-courses-frontend/blob/master/app/controllers/courses_controller.rb#L21
undefined method reject' for nil:NilClasson/organisations/2BV/courses/38ZQ/about`

 Add sidebar with Copy functionality to "About this course" edit page


Update SDK version in global.json

Summary of the new feature
Update the SDK version in the global.json file since Microsoft offers no download for the 2.1.101 version or compatible patch release (as far as I could find). See on the downloads page that 2.1.300 is lowest offered version.
Right now I cannot build PSScriptAnalyzer without replacing the global.json with an empty json (removing doesn't work because of this).
Proposed technical implementation details (optional)
Change the global.json to:
{
    "sdk": {
        "version": "2.1.401"
    }
}

This should be no problem since this version is included in the Ubuntu image on AppVeyor (see the software list).
Since 2.1.403 is a patch release of 2.1.401 it should work on systems with 2.1.403 installed. See the matching rules of the global.json.
What is the latest version of PSScriptAnalyzer at the point of writing
v1.17.1

@wilmardo  Just FYI that we have a link to download version  2.1.101 of the SDK here in our main readme here to resolve the issues that you have locally at the moment until the PR gets merged

Yeah thanks saw that when updating the PR #1086 :+1:
When you go to the Microsoft site directly it can't be found under download or the downloads archive.
Also there is no 2.1.1xx Docker image for dotnet this is the main reason why I submitted. I am working on a Dockerized PSScriptAnalyzer

Sounds awesome. We have a Windows docker file here already that we use for the release process btw and simple docker examples are here but a docker image would be nice. But as you said yourself, one can just use a newer version of the version of the SDK and it should still build, the version does not need to be matching, therefore I do not understand the issue that you face

The main issue is that it doesn't seem to build on 2.1.403, when I try to build it throws an error. I do not have the exact error right now but concluded that it was because 2.1.403 wasn't a patch release of 2.1.101. Since the docs say it then fails:

If the specified SDK version is found on the machine, that exact version is used.
If the specified SDK version can't be found on the machine, the latest installed SDK patch version of that version is used. Latest installed SDK patch version can be either release or pre-release - the highest version number wins. In .NET Core 2.1 and higher, the patch versions lower than the patch version specified are ignored in the SDK selection.
If the specified SDK version and an appropriate SDK patch version can't be found, an error is thrown.

The Dockerfile is on my work PC (not accessible at the moment) but I will create reproducible scenario tomorrow morning to explain the issue a bit better :)

Ah, I should have read in more detail, I uninstalled 2.1.101 locally and saw the error. I will try to get your change in as quick as possible once CI systems work again.

P.S. Please also watch PR #1082 because after that buildCoreClr.ps1 will not be there any more, you will need to call build.ps1 instead.

PR has been merged, will therefore close, please re-open if there is an issue


Update Networking docs

This is a...

[x ] Feature Request
[ ] Bug Report

Study this topic and related topics: Cluster Networking.
Bring all of the networking content into a coherent set of topics. Check for accuracy, and update as needed. Put topics into the appropriate templates. Edit topics to comply with our style guide.
Here's one related topic: Network Policies.

The Network Policies page is quite informative. I like the overall layout. I see another issue for creating more examples which would be great, but the main content is mostly very clear. I think there are a few spots that could use an update after reading through it. These are just suggestions, feel free to ignore!
cc @Bradamant3

The second sentence on the Network Policies page makes it sound like Network Policies are only for controlling ingress "...and define rules which specify what traffic is allowed to the selected pods."
Bullet number 3 is a little ambiguous, specifically the "..from any pod in a namespace.."

See also Declare Network Policy

Here is a request from @ahmetb on twitter at https://twitter.com/ahmetb/status/967850257018101760 to add the content that he has created at https://github.com/ahmetb/kubernetes-network-policy-recipes to official Kubernetes docs.

/assign @radhikapc

Related pages:
https://kubernetes.io/docs/concepts/services-networking/network-policies/
https://kubernetes.io/docs/concepts/services-networking/dns-pod-service/
https://kubernetes.io/docs/concepts/services-networking/ingress/
https://kubernetes.io/docs/concepts/services-networking/service/
https://kubernetes.io/docs/concepts/services-networking/dns-pod-service/
https://kubernetes.io/docs/concepts/services-networking/connect-applications-service/
https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/
https://kubernetes.io/docs/concepts/cluster-administration/addons/
https://kubernetes.io/docs/concepts/cluster-administration/network-plugins/


Improve server rendering performance with string templates

Versions
Vue 2.0.1
vue-server-renderer 2.0.1
Windows 7
What is Expected?
vue-server-renderer faster.
server-render is just for rendering html string, reusing code with browser side maybe easier to maintenance, but still cause lower performance which can't be ignore, especially using it with giant number of users(qq qzone hybrid website).
What is actually happening?
Using virtual dom to render html string on server side will cost more time which is about 10-20 times than traditional template engine without using virtual dom.
Reproduction repository
I write a small js called jscHelper to convert vue virtual dom tree to normal render function for improving performance.
But the compatibility is not good.
So I hope there will be an original way to solving it.
https://github.com/jialunguo/vue-server-render-jscHelper.git

Thanks for the suggestion. We are obviously aware of the fact that the virtual-dom-based SSR is slower than string-based ones; but one important reason for Vue's SSR to be virtual-dom-based is so that it fully supports manually written render functions as well. This is critical for advanced components such as <transition>, <keep-alive>, <router-view> etc. to work properly - a lot of these features are simply impossible with plain string templates.
It may be possible to use a hybrid strategy where we render simple components using string concatenation, but advanced ones using the current vdom-based algorithm. If the user's app contains large amount of template-only components this should still result in significant perf win.

Thank you, hybrid strategy is a good idea, we can use it to render most of our simple pages, without affecting other advanced parts. Hope we can use it in next version.

你们英语真棒

有结果么？ 字符串拼接相比  nuxt 的方式性能如何。

So - the hybrid strategy will land in 2.4 with 2~8x raw render perf increase depending on how much of the template can be stringified. Due to the "hybrid-ness", it will not be as performant as pure string templates, but will be pretty close in scenarios where no render-function-based components are involved.
Also note when we talk about "raw render perf" it means benchmarking the render call only. In terms of requests per second in a real app, there are many other aspects involved and raw render perf is only a small portion of the overall time.
@xiaogaofudao this has nothing to do with Nuxt because Nuxt is a wrapper on top Vue, so the improvements benefit Nuxt as well.

The new hybrid strategy will be adopt by VUE automatically? Is there any settings we need before we benefit from it?

Similar question, if we don't use advantage components, will render engine use string concatenation automatically?

It doesn't matter...


Fix typo

Here's a resubmit of #190 but to the develop branch.

This is not right, services/helpers.md has unwanted changes.

Nah, I think I remember@bennothommo merges everything back to develop if needed, so I'll close this pr. Sorry for the trouble.


【witness】restart one tikv every 20min，tpcc report 9005 at  certain fault

Bug Report

What version of TiKV are you using?
./tikv-server -V
TiKV
Release Version:   6.6.0-alpha
Edition:           Community
Git Commit Hash:   ee00d70008562b45bafb0dcd88d70520a18fa742
Git Commit Branch: heads/refs/tags/v6.6.0-alpha
UTC Build Time:    2023-02-08 11:56:04
Rust Version:      rustc 1.67.0-nightly (96ddd32c4 2022-11-14)
Enable Features:   pprof-fp jemalloc mem-profiling portable sse test-engine-kv-rocksdb test-engine-raft-raft-engine cloud-aws cloud-gcp cloud-azure
Profile:           dist_release
2023-02-09T19:04:48.004+0800	INFO	k8s/client.go:132
What operating system and CPU are you using?
8core/16G
Steps to reproduce
https://tcms.pingcap.net/dashboard/executions/plan/1620181
restart one tikv every 20min
[2023/02/09 20:36:34.535 +08:00] [INFO] [util.go:729] ["begin to restart tikv_2."]
What did you expect?
no 9005 error
What did happened?
tpcc report 9005 at  certain fault
[2023-02-09 12:40:58] execute run failed, err exec SELECT c_id FROM customer WHERE c_w_id = ? AND c_d_id = ? AND c_last = ? ORDER BY c_first failed Error 9005: Region is unavailable

/type bug
/severity major
/assign ethercflow

From log:
T0 Leader, witness, voter
T1 Leader, witness learner, voter
T2 Leader, non-witness learner, voter
T3 non-witness learner applied snapshot, but during this period, a snapshot is requested again (in order to prevent the first request from failing, it will be retried, and a judgment should be added here to determine whether the snapshot is being applied), and the leader is notified that the snapshot has been applied;
T4 The leader receives the non-witness notification, thinks it is no longer pending, and reports to pd
T5 After receiving the notification from the leader, pd thinks that the switch to non-witness has succeeded, and sends the next op
T6 pd send non-witness learner -> Voter;
T7 The leader executes conf change, thinking that non-witness has become a Voter, but in fact non-witness is still a learner and is executing snapshot;
T8 leader, Voter (actually still learner), witness learner
Resulting in 3 nodes, 2 leaners, re-election, and finally no leader returns 9005

/remove-label may-affects-4.0
/remove-label may-affects-5.0
/remove-label may-affects-5.1
/remove-label may-affects-5.2
/remove-label may-affects-5.3
/remove-label may-affects-5.4
/remove-label may-affects-6.0
/remove-label may-affects-6.1
/remove-label may-affects-6.2
/remove-label may-affects-6.3
/remove-label may-affects-6.4
/remove-label may-affects-6.5


upgrade to PG 12

Hey thank you for your excellent library. I want to know how to use higher version of pg parser such as pg12?

Thank you! Appreciate the kind words :)
We're currently dependent on https://github.com/lfittl/libpg_query to upgrade to 12. Lucky for us, it's in the works here https://github.com/lfittl/libpg_query/tree/12-latest-develop
The only problem is that I did try it out, while I got it to somewhat "work" locally, it didn't work with npm install because the build tests fail (the C/C++ ones) causing the npm install process to fail.
I will keep this issue up to date for when we do get a 12 version, and if I can hack something together, a 12 branch that could potentially work even if I get it to only work experimentally.

were there specific commands you wanted to parse by chance @Impavidity ? Like generated columns? it is potentially possible that we simply update the deparser, and hack the tests to ignore the fact that the parser cannot parse them, and we can get ahead on a few features for when 12/13 comes

anyone interested in upgrading to 12 please thumbs up the conversation here https://github.com/lfittl/libpg_query/pull/67. ;)
my attempts at upgrading to 12
https://github.com/pyramation/node-pg-query-native/commit/e9e2d035f59bd24044b5f220a682d162157504fa

I am going to use the RANGE + interval (RANGE BETWEEN '10 days' PRECEDING AND CURRENT ROW).

Thanks @Impavidity can you provide a full, complete query/statement example I can use for testing?

sure. Here is one example
WITH timestamp_measurement AS (SELECT count(t1.id) AS count_num
                                    , date_trunc('month', t1.start_date) AS timestamp
                               FROM trip AS t1
                               GROUP BY timestamp)

  SELECT t2.timestamp AS timestamp
       , avg(t2.count_num) OVER (ORDER BY t2.timestamp ASC RANGE BETWEEN '3 months' PRECEDING AND CURRENT ROW) AS moving_count_num
  FROM timestamp_measurement AS t2

Hi @pyramation - so happy somebody is keeping this project moving forward. Regarding versions, given the dependence on libpg_query, would it be possible to support various versions of postgresql?

@ReinsBrain thank you! Very passionate about ASTs and Postgres, it's the least I can do :)
yes! we're working to support PG 12/13 when this merges: https://github.com/lfittl/libpg_query/pull/87

latest work for parser for PG 13 https://github.com/pyramation/node-pg-query-native/tree/13-latest-develop

Just released the PG 13 port! Please test it out and let me know if you find anything. There are a few differences between the old and new parser, which are due to the major change, and also the libpg_query changes.
Likely there are a few test cases still needed, I'm happy to add them as we add specific issues for each one. Currently I've implemented generated columns in the deparser as well as index include fields.


[Feature request] Multipoint cursors

According to frontend docs xi-editor allowing several types of gestures like range_select (Shift+click), multi_word_select and etc, but unfortunately can't support multicursor (cursor shared between several lines but have same x-coordinate) like this:

In most editors this can be selected via (Alt/Option + vertical drag). I tried multi_word_select, multi_line_select and line_select but any of this types not works as I expected.
Do you plan something like that? May be something like new type multi_point_select?

I think this request might cover the alt-drag gesture to extend a cursor across multiple lines. That shouldn't be too hard to add, maybe a "help wanted" feature.

@raphlinus It will be great. Thanks!

@MaxGraey can you clarify the behaviour that you're describing? Is this using the mouse to select multiple lines, with each line in the selection have its own cursor?
Currently you can add a cursor at the same position on the previous or next line with optionshift↑, but you can't add multiple cursors by dragging. This is definitely doable, though.

Yes, selecting with Option or Alt + mouse drag to up or down which create vertical cursors line.

Hmm actually this seems like mostly a client issue? Handling drag gestures and sending new cursor requests to core.

I think of this feature as a special case of rectangle selection (where you can option+drag horizontally as well as vertically). Rectangle selection looks kind of tricky; it'll probably require some width-measurement stuff that I haven't figured out yet. But at some point I think we'll want it to be a type of gesture in the core.


Level.sav overwriiten by Windows-Dedicated Server

I (the Windows-coop host) was doing Step4, logging into the save on the Windows-Dedicated Server, then I found the Level.sav was quickly overwritten (size changed from 6MB to 124KB). After that, I downloaded the whole save folder, followed the other steps correctly and successfully generate the new save with no errors reported. But I was asked to create a new character at the end, and the host save seemed to disappear (Not sure if other players' saves maintain). Everything goes right but it just failed to load my co-op host save on the Server. I guess it might be that After v<IP_ADDRESS> release the PalServer writes the Level.sav more often (maybe overwriting it once a new player joins), and then the host save gets lost. Can anyone figure it out and Please reply here?

This may have been a bug with how the guid fix was originally implemented. If you're still trying to figure this out, try again with the latest version.


Stop asking for a device_token

Resolve #56 by generating a random uuid.

This worked nicely for me

Thanks @savingsandloan


Fix LIS Bratseth autotuning

Description
Modified Bratseth code to include obs flagged by backQC and superstatQC in the OBA files.  This breaks the feedback loop when cyclically autotuning the Bratseth error covariance settings, where obs were progressively being rejected for having large differences from the background or neighbors, leading to smaller error variances, leading to more rejections, etc.
Some bug fixes and tweaks are also included in the autotuning code.

Merge is now pending further discussion with Sujay and Jerry.

Do not merge yet.  More evaluation required.

Code is ready to merge.  We will postpone the decision on whether to reactivate in Ops.


ISPN-10543 server logging docs

https://issues.jboss.org/browse/ISPN-10543

Lotsa conflicts

This needs to be updated with information about the JSON appender

You need to rebase :)

Please add an overview of the logging categories introduced by https://issues.jboss.org/browse/ISPN-10018

Merged, thanks


Quarkus CVE-2023-4853 still being detected

A recent vulnerability CVE-2023-4853 was fixed in the Red Hat Quarkus Build with version 2.13.8.SP2-redhat-00001.
However, when running the dependency check, it still detects the version as vulnerable. Under the hood, the versions being matched are from the quarkus extension processor version 2.13.8.Final-redhat-00005. However, that version also contains the fix as far as I am aware. So why is it still being matched?
dependency-check-report.html.zip

The CVE doesn't say that RHBQ 2.13.8.SP2 also contains the fix. I don't think there's anything ODC can or should do differently here. I don't even know whether RedHat could try to "fix" the CVE as their builds run under the same CPE and the community Quarkus.
-> my comments at https://quarkus.io/blog/cve-2023-4853/

For redhat backports of CVE fixes you'd have to maintain your own suppression files. ODC will always report all CVEs that belong to the given major/minor/revision of the original open source library.


No developer :(

I read the issue posting guidelines.
Since I'm not a developer and willing to jailbreak my iPhone 6, the error message disrupted me tonight:
provision.cpp:81
ios/addDevice =5405
Unable to add device 'xyDevice' because the team has already reached the maximum number of iPhone devices.

What could / should be done?

you have too many idevices with that apple id, click on cydia impactor xcode tab and revoke certificates or use a new apple id!


✨ Enable POST in dropdown

Related to https://github.com/huggingface/moon-landing/issues/1894
This PRs add the possibility for no-JS POST links in dropdowns.

can you take a look at this @beurkinger ?


Errors running bot

Hi i get the following errors running the bot. Please advise.
Error :
'announcements'

Error :
'members'

created channels and no errors now

Hello,
The default Welcome message assumes that the #announcements channel exists. You can modify the Welcoming message by editing the Welcome.txt file. Let me know if that fixes it!

Ah, just saw your last reply. Glad you found a solution :).

Dude, great work. Much respect and thanks.

Thank you!


List View Bad UX

- Do you want to request a feature or report a bug?
Feature/Bad UX Fix
- What is the current behavior?
I am using netlify admin to edit this page https://www.alternativeeducation.in/learning-spaces.
which is a json file like this https://github.com/alteducation/web/blob/gh-pages/_data/learning-spaces.json
The Issue is the add new button for adding new entries is located at the top of the page whereas the input to add new entries show up at the bottom. So for every entry you have to scroll to the bottom to add a new one.  On top of that the entries show up maximized by default this causes the user to scroll down even more and makes the browser lag due to all this content.
Gif:
https://gfycat.com/GrandNeedyDolphin
- If the current behavior is a bug, please provide the steps to reproduce.
Please Create An Object Of Arrays and edit it with netlify Admin.
- What is the expected behavior?

Please Make The Array Items Show Up Minimized By Default like this

When add new is pressed please show the new item on top as opposed to bottom.

Please create an option to hide the preview pane by default on select pages or globally. The Preview Pane Creates Extra Lag on Pages with a lot of content. An Option to have it hidden by default is much needed.
- Please mention your CMS, node.js, and operating system version.
CMS version 1.

So I'm hearing to requests:

You'd like lists to be collapsed by default.
The interface should scroll to the bottom of a list when creating a new entry/list item

Yes :)

Can we have the 'new entry box' appear at the top instead of auto scrolling to the bottom.

An option to turn off live preview (by default) on select pages would be really helpful.

You can already do that, although it doesn't look like it is documented:

  - name: "my-collection"
    label: "My Collection"
    editor:
      preview: false # Turn off the live preview for this collection.
    ...

Regarding the field option name, I believe we should default these to collapsed when an entry is opened, so I'm thinking "expanded" is a good name for the option.
(@erquhart at https://github.com/netlify/netlify-cms/pull/912#issuecomment-352913491)

Should be fixed by #912.

@neutyp Should number 2 be split into a new issue or would you like it left in context here?

@alteducation: When add new is pressed please show the new item on top as opposed to bottom.
@neutyp: The interface should scroll to the bottom of a list when creating a new entry/list item
@alteducation: Can we have the 'new entry box' appear at the top instead of auto scrolling to the bottom.

I've opened a more targeted discussion around this topic here: https://github.com/netlify/netlify-cms/issues/963
Please weigh in with your opinions there :)


Fix soundness issues in Zone generic method signatures

Tracking issue for this work.  @floitschG is working on this:
https://codereview.chromium.org/2691093007/

Has landed with 38bf70d7ac4ea695adc65ae3d7d0fa083b4dcd46.


SSL certificate is not updated when a cluster resize

Certificate not get  alt-names (Dns names) for new brokers when enabled SSL authorization and cluster was by resized
steps to reproduce the issue:

Enable SSL authorization
Enable envoy
Resize cluster
Verify certificate [cluster]-all-brokers

I expect that certificate [cluster]-all-brokers get new alt-name after resize cluster

Hello @MilkyWay-core !
Thank you for reporting this.
It is not a critical but a valid issue.
It is not an easy fix. We will look into it.
If this is problematic for you now I suggest to use the ServerSSLSecret reference: https://github.com/banzaicloud/koperator/blob/8bbde8e9541b7a3b3d7070ac5ad8991ea0ef52bc/api/v1beta1/kafkacluster_types.go#L560
There you can create your own certificates for your listeners.


Accept actual type instead of string representation in Argument class

Needed some refactoring while working on #751.
Submitting this as a separate PR for easy reviewing.

No tests ? 🤔

No tests ? 🤔

I didn't change any behavior. This code is covered indirectly.


Reading xml data Dinoloket

BRO data is now also available via Dinoloket. The BRO data, and also some of the DINO data, is available in xml format. If the data of Dinoloket is requested via a zip, the metadata from the wells is delivered in the map 'Grondwatermonitoringput BRO' and the measurement data in the map 'Grondwaterstandonderzoek BRO'. In the comming years there will be increasingly more BRO data available .
Can you maybe add the functionality of reading this BRO data to your package?

Thanks for posting your issue. This is definitely something we want to add. Unfortunately it is not at the top of our priorities at the moment. So we're open to contributions, for example scripts for the reading of the BRO XML-data. That would save us some time, and that could allow us to include this functionality earlier.
Any updates on this issue will be posted here.

I just started with processing BRO XML-data in Python. I used the existing scripts for BRO data about CPTs (Dutch: sonderingen) in the Geolib-plus package (https://github.com/Deltares/geolib-plus) as example.
I have a first version ready. It reads the GMW-file (Grondwater Monitoring Well), that is send in the BRO-bronhoudersportaal. I will work on a version to read the GMW-file that everyone can download from broloket.nl. Afterwards I will work on the GLD (Groundwater Level Data) files.
Because I used the geolib-plus as example, I will first check whether I can submit my script to the geolib package. Afterwards I will take care for integration with Hydropandas.

Nice Hendrik! I also started a few days ago with reading the GMW and GLD xml data. I know I should have mentioned this here, I forgot that sorry. I plan to finish this in the first week of January.
I noticed that there is many options to read xml data in Python. So if you are still keen on finishing your script it would be nice to compare our approaches and pick the best of both.


FileLoadException: Could not load file or assembly 'Microsoft.EntityFrameworkCore.DynamicLinq, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=974e7e1b462f3693'. Invalid pointer (0x80004003 (E_POINTER))

Hi
I am getting error after upgrade to .NET8.
I am only referencing this:
I also tried newest version. (same exception).
Error is thrown on gropBy on IQueryable
FileLoadException: Could not load file or assembly 'Microsoft.EntityFrameworkCore.DynamicLinq, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=974e7e1b462f3693'. Invalid pointer (0x80004003 (E_POINTER))
TypeInitializationException: The type initializer for 'System.Linq.Dynamic.Core.Parser.PredefinedTypesHelper' threw an exception.
Any suggestions?
Thank you very much.

@MKI-Miro
please provide a full working example project to show this error

This is extremly problematic because its realy big project :(
I hoped for any tip

Isnt it weird that it wants Microsoft.EntityFrameworkCore.DynamicLinq in version 1.4.3 ?

This is extremly problematic because its realy big project :(
I hoped for any tip

In order to analyze this error, I really need an example project which shows this issue.

@MKI-Miro
Can you provide a full working example?

@MKI-Miro
Can you provide a full working example?

Closing..


Typo in docs for returned class name on alarm functions

There's a typo in the iota docs in the GML function page for the name of the returned struct for add_alarm and add_alarm_cycles.
Change __iot_class_alarm to __iota_class_alarm.

Fixed in #19


The split tabs are inconsistent when splitting one HNS blob container under the 'Active and soft deleted blobs/Deleted only' view context

Storage Explorer Version: 1.21.0-dev
Build Number: 20210824.5
Branch: main
Platform/OS: Windows 10/Linux Ubuntu 20.04/MacOS Big Sur 11.4
Architecture: ia32\x64
How Found: Ad-hoc testing
Regression From: Not a regression
Bug Descriptions
The the split blob container tab doesn't auto refreshing when executing split under the 'Active and soft deleted blobs/Deleted only' view context.
Steps to Reproduce

Expand ADLS Gen2 storage account -> Blob Containers.
Create a blob container -> Create a new folder.
Switch the view context to 'Deleted only' -> Split the tab.
Check no item displays in editor of the split tab.

Expected Experience
No item displays in editor of the split tab.
Actual Experience
The active folder displays in editor of the split tab.

Additional Context

The active folder disappears after manually refreshing.

This issue also reproduces following the below steps:

Open one ADLS Gen2 blob container -> Soft delete one item.
Switch to the 'Active and soft deleted blobs/Deleted only' view context -> Split the tab.
Observe the split tab.
Check whether the two tabs are consistent.

Actual:
The two tabs are inconsistent.

Verified this issue on the build main/20210825.3. Fixed.


Xml api map sov

Added details for the sov api to docs

Incorrectly pulled 2 branches into 1 request so closed it.


Point.pixels() different results based on start level.

Lets say we take a coordinate and we try to find its parent 4 levels upper.
So we have coord 200,180 and we would like to know it`s parent 4 levels up which should be 13,12 if we start at 1 or 12,11 if we start at 0.

level
from pix
to pix

1
0
15

2
16
31

3
32
47

4
48
63

5
64
79

6
80
95

7
96
111

8
112
127

9
128
143

10
144
159

11
160
175

12
176
191

13
192
207

14
208
223

15
224
239

16
240
255

However with the code below, we get different results based on our starting zoom level.
We get (12,11 vs 13,11)
from pygeotile.point import Point
from pygeotile.tile import Tile

zoom1 = 4
zoom2 = 8
# 8-4 = 4 (delta)

t1 = Point.from_pixel(200, 180, zoom1)
t2 = Point.from_pixel(200, 180, zoom2)

print(t1.pixels(zoom1),t2.pixels(zoom1))
#(200, 180) (13, 11)

zoom1 = 1
zoom2 = 5
# 5-1 = 4 (delta)

t1 = Point.from_pixel(200, 180, zoom1)
t2 = Point.from_pixel(200, 180, zoom2)

print(t1.pixels(zoom1),t2.pixels(zoom1))
#(200, 180) (12, 11)

Pixel values on different zoom levels result in different tiles.
For a better illustration have a look at: https://developers.google.com/maps/documentation/javascript/examples/map-coordinates
But maybe I miss the point of your issue.
Is there an error in the calculation of pyGeoTile?

Due to no further corespondents this closes #17

This closes #17

Sorry for my very late response.
Yes I do believe there is an issue somewhere. And my issue was solved by using mercantile.tile to convert my latitude and longitudes. Here is where I noticed the difference visible in one pixel but throwing out of bounds for my 256 x 256 tiles that I was generating.
level is set to 5, which maps to level 5+8 = 13 for mercantile.
All of the longitude, latitude in the log below give a difference of 1 pixel between both.
Initially I was thinking all difference is because drawing 1->256 compared to 0->255 but, with pygeotile I have img[0,256] which is effectively 257pixels.

point = Point.from_latitude_longitude(latitude = latitude, longitude = longitude)
pixels2 = point.pixels(zoom=level)

pixels = mercantile.tile(longitude, latitude, level+8)

if pixels2[0] != pixels.x or pixels2[1] != pixels.y:
    print(longitude, latitude, pixels, pixels2)

-19.2117 28.9743 Tile(x=3658, y=3406, z=13) (3659, 3407)
-19.2361 28.9316 Tile(x=3658, y=3407, z=13) (3658, 3408)
-19.1343 29.0724 Tile(x=3660, y=3404, z=13) (3661, 3404)
-19.0179 29.0514 Tile(x=3663, y=3404, z=13) (3663, 3405)
-19.0324 29.0121 Tile(x=3662, y=3405, z=13) (3663, 3406)
-19.076 28.9983 Tile(x=3661, y=3406, z=13) (3662, 3406)
-19.1279 28.9451 Tile(x=3660, y=3407, z=13) (3661, 3407)
-19.0403 28.9908 Tile(x=3662, y=3406, z=13) (3663, 3406)
-18.9975 28.986 Tile(x=3663, y=3406, z=13) (3664, 3406)
-18.9963 28.935 Tile(x=3663, y=3407, z=13) (3664, 3408)
-18.9535 29.4849 Tile(x=3664, y=3393, z=13) (3665, 3393)
-18.8229 29.5255 Tile(x=3667, y=3392, z=13) (3668, 3392)
-18.8555 29.481 Tile(x=3666, y=3393, z=13) (3667, 3393)
-18.9591 29.4273 Tile(x=3664, y=3394, z=13) (3665, 3395)
-18.9285 29.422 Tile(x=3665, y=3394, z=13) (3665, 3395)
-18.8984 29.4166 Tile(x=3665, y=3395, z=13) (3666, 3395)
-18.8641 29.458 Tile(x=3666, y=3394, z=13) (3667, 3394)
-18.8462 29.4375 Tile(x=3667, y=3394, z=13) (3667, 3395)
-18.8533 29.41 Tile(x=3666, y=3395, z=13) (3667, 3395)
-18.7825 29.5161 Tile(x=3668, y=3392, z=13) (3669, 3393)
-18.6453 29.4791 Tile(x=3671, y=3393, z=13) (3672, 3393)
-18.785 29.4456 Tile(x=3668, y=3394, z=13) (3669, 3394)
-18.7449 29.3913 Tile(x=3669, y=3395, z=13) (3669, 3396)
-18.6817 29.4302 Tile(x=3670, y=3394, z=13) (3671, 3395)
-18.6377 29.453 Tile(x=3671, y=3394, z=13) (3672, 3394)
-18.6916 29.3827 Tile(x=3670, y=3395, z=13) (3671, 3396)
-18.6569 29.3858 Tile(x=3671, y=3395, z=13) (3671, 3396)
-18.903 29.3572 Tile(x=3665, y=3396, z=13) (3666, 3397)
-18.9328 29.3171 Tile(x=3665, y=3397, z=13) (3665, 3398)
-18.8611 29.38 Tile(x=3666, y=3396, z=13) (3667, 3396)
-18.8128 29.3446 Tile(x=3667, y=3396, z=13) (3668, 3397)
-18.8174 29.3192 Tile(x=3667, y=3397, z=13) (3668, 3398)
-18.9411 29.2569 Tile(x=3664, y=3399, z=13) (3665, 3399)
-18.8985 29.2392 Tile(x=3665, y=3399, z=13) (3666, 3400)


Feat: Create a light/dark toggle theme

Toggle Light/Dark mode

Currently Issue Finder has dark theme. It would be great to improve accessibility to add a Light theme feature to the app.
Open a new pull request with changes

Do not hesitate to let us know if you have any questions 👋

Hey, I did this one

Please check I think I have pulled request. I'm pretty new, don't know if you got the updated code

Hi, @Maaz4324. Your pull request is not on this repo. Follow this guide to get started and create your first PR


High severity security alert in Lodash via yargs-unparser

Prerequisites

[x] Checked that your issue hasn't already been filed by cross-referencing issues with the faq label
[x] Checked next-gen ES issues and syntax problems by using the same environment and/or transpiler configuration without Mocha to ensure it isn't just a feature that actually isn't supported in the environment in question or a bug in your code.
[x] 'Smoke tested' the code to be tested by running it outside the real test suite to get a better sense of whether the problem is in the code under test, your usage of Mocha, or Mocha itself
[x] Ensured that there is no discrepancy between the locally and globally installed versions of Mocha. You can find them with: node node_modules/.bin/mocha --version(Local) and mocha --version(Global). We recommend that you not install Mocha globally.

Description
Mocha depends on yargs-unparser, which depends on Lodash, which is vulnerable to prototype pollution in versions < 4.17.13.
This does not show in npm audit, rather on GitHub if you publish a repository that depends on mocha (^6.1.4).
Steps to Reproduce

Create a new git repository
npm i mocha --save-dev
Upload to GitHub
Get a message saying "We found a potential security vulnerability in one of your dependencies. "

Expected behavior: No vulnerabilities in Mocha
Actual behavior:

We found a potential security vulnerability in one of your dependencies.
*Only the owner of this repository can see this message. *
1 lodash vulnerability found in package-lock.json
CVE-2019-10744
Affected versions of lodash are vulnerable to Prototype Pollution.
The function defaultsDeep could be tricked into adding or modifying properties of Object.prototype using a constructor payload.

Reproduces how often: Every time
Versions

The output of mocha --version and node node_modules/.bin/mocha --version: 6.1.4 (both)
The output of node --version: v10.13.0
Your operating system

name and version: Windows 10
architecture (32 or 64-bit): 64

Your shell (e.g., bash, zsh, PowerShell, cmd): cmd
Your browser and version (if running browser tests): N/A
Any third-party Mocha-related modules (and their versions): None
Any code transpiler (e.g., TypeScript, CoffeeScript, Babel) being used (and its version): N/A

Additional Information
None

Confirmed. This is also reported in the yargs-unparser repo: https://github.com/yargs/yargs-unparser/issues/35
However, yargs-unparser specifies the dependency as "requires": { "lodash": "^4.17.11" }. Thus, a temporary workaround is making sure a more recent version (>=4.17.13) is installed.


Unity Plugin: Failed to Import MJCF file

Hi,
I'm looking for some help with mujoco unity plugin.
I am working on MacOS with Unity 2021.3.18f1 (Apple Silicon) with mujoco 2.3.5.
I followed the instruction on Unity-Plugin: https://mujoco.readthedocs.io/en/2.3.5/unity.html. Download and run mujoco app, import the unity plugin in, and rename the dylib.

The mjcf file I try to import is Ant.xml: https://github.com/iandanforth/mjcf/blob/master/ant.xml
The error message I got is

Could anyone give me any hints about how to fix it?
Thank you so much.

Was the library imported to the Unity project? (Can you find it in the MuJoCo section of the packages in the project explorer?)

Closing due to inactivity.


[KOGITO-2537] Consume and persist TraceEvents in trusty-service

Related JIRA ticket
Related PR in kogito-apps

Hi @kostola @r00ta I assume it may be best for me to defer too much work until these are merged?

I don't see any related tests for persisting of TraceEvents. Can you please implement some or point me to them if I overlooked it.

@jiripetrlik The only piece of code that persists TraceEvents at the moment is the trusty-service, whose code is in the kogito-app repository. I don't think we should add any test in kogito-runtimes about persistence. Wdyt?

jenkins retest this please


 Tip: run 'phantomjs --version'.

1.5.0
What steps will reproduce the problem?

Create a basic QUnit test suite
Add a syntax error to one of your test modules
Run the suite using https://github.com/ariya/phantomjs/blob/1.2/examples/run-qunit.js
E.g. phantomjs run-qunit.js file://$(PWD)/tests/all.html

What is the expected output? What do you see instead?

Expected:

QUnit should detect the failed load (via window.onerror) and report a failure.
Within phantom script, page.onError should fire.

Observed:

Neither window.onerror or page.onError fire (causing QUnit to erroneously report 0 failed tests)

Which operating system are you using?

OS X.
Did you use binary PhantomJS or did you compile it from source?

Binary.
Please provide any additional information below.

This was working fine in 1.4.1

Disclaimer:
This issue was migrated on 2013-03-15 from the project's former issue tracker on Google Code, Issue #537.
:star2:   9 people had starred this issue at the time of migration.

Fixed in 2.


feat: Mixed Experience Replay 🤝

A simple utility to mix sampling of multiple buffers. Useful for offline-online stuff, and some off-policy variants that include portions of on-policy data (e.g. "combined experience replay," see here).
Important (& intentional) restrictions:

The buffers must be of the same type. Why? We need to concatenate the samples, thus they need the same pytree structure. FlatBuffer returns an ExperiencePair, and this cannot be combined with a PrioritisedTrajectoryBufferSample, etc.
We can ask for any ratio, [x,y,z,...], with a joint sample_batch_size when creating the mixer. We are still constrained by the underlying buffer sample functions, though. Suppose we have buffer_a which returns (4, ...) and buffer_b which returns (16, ...). We could create a mixer [1,1] with the sample_batch_size=6. In that case, we get 3 "batches" from buffer_a, and 3 batches from buffer_b. But if we ask for sample_batch_size=10 with ratio [1,1] (i.e. a batch size of 10/2 = 5 from each buffer), we'll only get the 4 batches from buffer_a, along with the 5 batches from buffer_b—so, a total sample_batch_size = 9. This is the idea of a "best effort"—we'll try grab enough batches of data, but only if possible. If not, we return a smaller batch than desired—as much as we can from each buffer.

It'd be great to test this out in a real system. Perhaps in Stoix, @EdanToledo? I can also look at stitching vaults together, etc.
See example notebook: https://colab.research.google.com/github/instadeepai/flashbax/blob/feat/mixed_experience_replay/examples/mixer_demonstration.ipynb (obviously won't run, unless you pip install the branch version, or run locally on a branch)

Hello, I wanted to say that this is a great functionality. In my case I am interested in distributed RL with experience sharing among agents, so having a buffer where you can sample/add differently for personal use and sharing would be great. Is this a feature you are planning to merge soon? And if so, could you extend the notebook to show how you can add to the two buffers?

@eleninisioti Hey, so yeah ideally we can merge this ASAP. I'm just waiting on one last thing from @callumtilbury but hes quite busy at the moment. If hes unable to complete it in the coming week, I'll take over and finish it. So hopefully sometime this week it will be merged :)


Update the docs to point to v1.1.0

Proposed changes
We want the docs on the website to use the latest available release
Checklist
Before creating a PR, run through this checklist and mark each as complete.

[ ] I have read the CONTRIBUTING doc
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have checked that all unit tests pass after adding my changes
[ ] I have updated necessary documentation
[ ] I have rebased my branch onto main
[ ] I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes
If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

NONE

We typically have the main branch point to the main branch examples and such. The release branch is where we update to point to tags for that release.


repository already exists as a dojo

Dear maintainer, I set up a server with dojo. When I use a test user account to create a dojo, e.g., pwncollege/example-dojo, it works fine. When I try to create a dojo using another test1 user account, it shows the message: " Error: This repository already exists as a dojo ". Is this the right way to create a dojo for everyone?

So you probably don't want to create the same dojo multiple times, this would be creating separate dojo instances. And as you see, you can't, a GitHub repo defining a dojo may only be used one time.
If you want to make the dojo accessible to everyone, you need to make that dojo official. Unfortunately we don't have a frontend for this process yet. You can enter the dojo container, and then run dojo db to bring up a mysql client. You can determine your dojo's ID with select id, dojo_id from dojos. Then, with that <DOJO_ID> you can run something like update dojos set official=1 where dojo_id=<DOJO_ID>.

Thanks for the quick reply. Will try.


Update table names in kaggle notebooks

Make sure that our Kaggle notebooks use the updated names and are currently runnable. Additionally, comment on other users' notebooks to flag the change of table names.

They've been updated!


pull request for e2e test at 11/13/2016 01:26:10

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Can finally add "Start on startup" option to GUI of flatpak package ?

Hi.
From previous knowlage I know this was impossible & only workaround is https://github.com/PurpleI2P/i2pd/issues/1303#issuecomment-466745907
But recently I saw this post which seem to say that flatpak now allow "Start on startup" feature:
https://github.com/flathub/nz.mega.MEGAsync/issues/2
It talking about this:
https://github.com/flatpak/xdg-desktop-portal/blob/master/data/org.freedesktop.impl.portal.Background.xml
Kindly investigate this.

More info: https://github.com/PurpleI2P/i2pd-qt/issues/39


Replace deprecated .size() method with .length attribute

Hi, thank you for your password strength checker.
Unfortunately for me, it doesn't work with jQuery 1.8+ as it contains deprecated .size() method.
See https://api.jquery.com/size/ .
I don't know where you'd merge it but meanwhile I set master as merge target.
Hope to hear from you soon.
PS 日本語でも大丈夫です。

@nerixim さん, PRありがとうございます :smiley:
マージしました :+1:
少ししたら npm にpublishしたいと思います.


HDDS-11947. [Docs] [User Guide] Impala Integration.

What changes were proposed in this pull request?
HDDS-11947. [Docs] [User Guide] Impala Integration.
Adding the doc to the old user doc site.
Please describe your PR in detail:

Add user doc for Impala integration.
Backported from the new site: https://github.com/apache/ozone-site/pull/113

What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-11931
How was this patch tested?
./hadoop-ozone/dev-support/checks/docs.sh passed.
https://github.com/jojochuang/ozone/actions/runs/12364445561

Thanks for the in-depth review! Updated the doc and here's the screenshot:


packages strips nested dependencies and workspaces

Hey @robertohuertasm
Attempting to migrate to this lib instead of rolling my own, but ran into an issue. I'm not sure if this is by design or not.
So for dependencies and v1/2, this works great. But for packages and new v3, it looks like it doesn't parse correctly. In npm, most dep names are in the format of node_modules/<dep>, which this lib handles. But nested deps are in the format of node_modules/<parent>/node_modules/<child>, and these are completely lost (or overwritten by the non-nested one).
Furthermore, there are workspaces/<name> packages that are completely removed. These are useful in knowing what's in the npm workspace.
As an example, I'm attempting to parse this trimmed down file:
{
    "name": "moon-examples",
    "version": "1.2.3",
    "lockfileVersion": 3,
    "requires": true,
    "packages": {
        "node_modules/tap/node_modules/yaml": {
            "version": "1.10.2",
            "dev": true,
            "inBundle": true,
            "license": "ISC",
            "engines": {
                "node": ">= 6"
            }
        },
        "node_modules/yaml": {
            "version": "2.2.2",
            "resolved": "https://registry.npmjs.org/yaml/-/yaml-2.2.2.tgz",
            "integrity": "sha512-CBKFWExMn46Foo4cldiChEzn7S7SRV+wqiluAb6xmueD/fGyRHIhX8m14vVGgeFWjN540nKCNVj6P21eQjgTuA==",
            "dev": true,
            "engines": {
                "node": ">= 14"
            }
        },
        "workspaces/libnpmdiff": {
            "version": "5.0.17",
            "license": "ISC",
            "dependencies": {
                "@npmcli/arborist": "^6.2.9",
                "@npmcli/disparity-colors": "^3.0.0",
                "@npmcli/installed-package-contents": "^2.0.2",
                "binary-extensions": "^2.2.0",
                "diff": "^5.1.0",
                "minimatch": "^9.0.0",
                "npm-package-arg": "^10.1.0",
                "pacote": "^15.0.8",
                "tar": "^6.1.13"
            },
            "devDependencies": {
                "@npmcli/eslint-config": "^4.0.0",
                "@npmcli/template-oss": "4.14.1",
                "tap": "^16.3.4"
            },
            "engines": {
                "node": "^14.17.0 || ^16.13.0 || >=18.0.0"
            }
        }
    }
}

But only node_modules/yaml (as yaml when parsed) is only returned. It may be best to just leave the names as-is?

Here's my PR testing the impl: https://github.com/moonrepo/moon/pull/831

Hey @milesj thanks for reporting this! I'll take a look.

Hi @milesj, nested dependencies are not taken into account for the moment. For what I've seen the dependency that it's effectively used is expressed as a normal dependency.
Regarding workspace dependencies they seem to work. There's a new v0.3.0 version published.


Parameterize MDSD account and namespace names

Which issue this PR addresses:
USER STORY 10098170 - Parameterize Geneva Namespace Targets in ARO RP
What this PR does / why we need it:
This PR allows the RP to read in additional mdsd logging parameters from RP Config files. These new parameters include mdsd log account name, namespace name, and metrics account name for both customer clusters and the rp itself. This was necessary because there are not separate mdsd endpoints for FF INT and PROD. These changes allow different accounts/namespaces to be targeted for different environments at the same mdsd endpoint.
RP Config has already been updated with the name parameters for each environment.
Test plan for issue:
I tested this by deploying these RP changes to FF INT and verifying that the RP log and customer cluster data made it into the Geneva log accounts and namespaces specified in the FF INT config file.
Build | Release | Ev2
Is there any documentation that needs to be updated for this PR?
No. RP Config has already been updated with an explanation of all new parameters.

@jewzaam @troy0820 The commit history for PR-1601 was a bit of a mess, so I abandoned that PR in favor of this one. This PR does not have any changes other than the ones directly relevant to this change.
I will copy over the outstanding comments from the previous PR so that they can be addressed here.

/azp run CI

/azp run E2E

@troy0820 I may be misinterpreting your vendor comment, but I am responsible for all changes in this PR. There is no need to break out any particular piece into a separate commit.

@zacharyljones  We usually break vendor commits (changes that change /vendor folder) into its own commit so they will stand alone from the changes introduced into the repo.  This helps with git history and allows us to target changes introduced by commits/PRs by dependencies, etc.

@troy0820 Ah understood - changes to the vendor folder, not actual vendors.

@troy0820 All changes to the vendor folder have been moved to a separate commit.

Still getting Cluster and RP logs in Geneva after deployment of latest round changes:
Build
Release 294
Ev2 Rollout

/azp run ci
/azp run e2e

/azp run ci

Discussed and we'll get this PR merged and address the outstanding concern / issue with bootstrap node logs in a separate  PR.

/azp run e2e


limit to a triangle

Hello,
multiple_coins_one_exchange.py is working fine on my config, not the other examples.
In multiple_coins_one_exchange.py, I would like to limit the arb path to a triangle (3 transactions). I am new to graph theory and a small help would be great. I guess it would be somewhere in NegativeWeightFinder::bellman_ford but then I'm getting lost.
Thank you

I am not sure if there is an "efficient" way to do this. The easiest solution is, given a list x by bellman_ford, check if len(x) == 4. Unless something goes wrong in an exchange's matching engine, it will never be < 4 (4 indicates 3 transactions).


Add  mention markdown parsing to polls

Fixes #16821
Testing plan:
Manual testing, use of ./tools/lint and ./tools/lint --fix, as well as use of CI testing upon pushing changes
GIFs or screenshots:
Original time poll (time not rendered):

New time poll:

@JacobRoddam You should probably update the PR title to be a bit more descriptive, See other existing PRs for example.

@hackerkid Thank you for the advice! Will do! Should I edit my commit messages as well?

@JacobRoddam Yes. https://zulip.readthedocs.io/en/latest/contributing/version-control.html#commit-discipline has instructions on how to write good commit messages :)

@hackerkid Could use your help, I am new to vi. I've changed my commit messages so that when I check git status I get this:

But when I try to commit them it just reopens vi and I have no idea how to actually make the commits go through:

What do I do?

@hackerkid I thought I may just need to run "git rebase --continue" but that just brings up the message "fatal: could not read log file '.git/rebase-merge/message': No such file or directory
error: could not commit staged changes."

@JacobRoddam Were you able to fix the issue. It looks like you have pushed to the PR after you left the comment.

@hackerkid yes! Thank you!

Closing in favor of https://github.com/zulip/zulip/pull/28079.


[Storage] Improve version_id behavior and ease of use

Description 5/30/23:
All feedback has been incorporated. This includes:

Fixing version_id parsing logic (checks for existence in kwargs, if so take that as source of truth, otherwise can take our self OR None default)
Adjusted testcases to account for no longer auto-parsing out the version_id information from BlobProperties

MOST UP TO DATE TODO: Add in a changelog for when we merge this to main
This PR aims to add more improvements to using versioned blobs on Azure Storage. This proof of concept currently implements the following:

Adds version_id as a client parameter on ContainerClient
Adds a check in get_blob_properties to query for kwargs input, and otherwise default to checking client's self.version_id

TODO:

Propagate change to other APIs that use BlobProperties☑
Propagate change to other client constructors that can get a BlobClient☑
Document in changelog and make it clear that kwargs will take precedence, then auto parsing out of your properties

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-storage-blob

Closing in favor of merging: #30991


New formatting for defining layouts

@eddieantonio Here's a proposal for defining panes. Row and column labels are marked with _ and |, respectively (in comparison to < and ^). Both labels, but in particular the column labels can have a hierarchy, which is used to organize the panes according to available space. One can also use the column labels to refer to the panes. What is not indicated as a label is a reference to an FST-generated form.  Space allowing, the two panes could be presented next to each other, in which case only one set of row labels would be necessary, and the column label for tense could be shared. If space would require the above to be presented in a single column vertically, then it would be a matter of UI design whether tense would be indicated as a column label for both panes, or only once.
Originally posted by @aarppe in https://github.com/UAlbertaALTLab/cree-intelligent-dictionary/issues/167#issuecomment-650919558

This is essential for addressing #568.

This combines:

#567
#568
#581
#582

Also related:

#167
#193


feat: add filtering pid functionality

Description
add filtering pid functionality in kill-process extension
Screencast

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Thanks for the enhancement 🔥
do you mind checking it @rolandleth 😊

@pernielsentikaer Any plan when this pr will be merged ?

@crazyones110 It was my bad, didn't see the notification. Thanks for improving the extension!


Make a swimming pool

Only if we can skateboard in it.

[ ] Make skateboard object
[ ] Make pool object
[ ] win

I think the pool should have water.

No, a pool is a terrible idea.


volumes are updated for deleted storage when delete query executes just after sync

Issue/Feature Description:
When DELETE operation is executed just after a sync operation, the storage is getting deleted but the volume fetch operation tales some time and the volumes are created again in the DB
task synchronization would fix this issue.but need to test after the syncronization is implemented.
Why this issue to fixed / feature is needed(give scenarios or use cases):
User do not want to store any reources of a storage after removing storage from SIM
How to reproduce, in case of a bug:
POST v1/storages/<storage_id>/sync
DELETE v1/storages/<storage_id>/sync
Other Notes /  Environment Information: (Please give the env information, log link or any useful information for this issue)

PR #166 would be able to solve this issue.

sync lock operation #166 is fixed. need to verify and close

Fixed with #166


How do I use this augment data?

I have successfully run your program. Now I want to know how to use the data， to train the model directly, or to save the data and train the model with the original data?

This repo just implements the augmentation. Hopefully these resources are useful to you:
Albumentations for pytorch: https://albumentations.ai/docs/examples/pytorch_semantic_segmentation/
Albumentations for Tensorflow: https://albumentations.ai/docs/examples/tensorflow-example/

This repo just implements the augmentation. Hopefully these resources are useful to you:
Albumentations for pytorch: https://albumentations.ai/docs/examples/pytorch_semantic_segmentation/
Albumentations for Tensorflow: https://albumentations.ai/docs/examples/tensorflow-example/

thanks a lot

thanks a lot

Hello, Did you manage to use this augmented data ?


Miscellaneous: Simple ToDo app with NodeJs

Simple ToDo app using Express Server with NodeJs

[ ] Creates new server using Express
[ ] Listens for GET & POST requests on defined port
[ ] Creates local ToDo app db
[ ] Responds to GET requests, with all existing ToDo's
[ ] Responds to GET request with ID, with specific todo
[ ] Creates new ToDo using POST requests with json data

Hi @orvil1026 ,
I've worked on this issue and all 6 tasks, please assign this issue to me; if this app is not there already.

Hi @orvil1026 👋,
✅ This PR has passed all checks, please review and merge✨.
🚀


Update ISSUE_TEMPLATE to include Design/Wiki Reference

This issue is for a: (mark with an x)
[ ] bug report -> please search issues before submitting
[x] feature request
[ ] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

Description
Please include any relevant information, including repro steps for a bug (with log messages, version, OS, etc..)

Updating the issue template to include a design section

Expected/desired behavior
Please include any acceptance criteria here (should look like tasks to complete for the issue to be resolved)

[ ] When creating a new issue, should see section ### Design/ Wiki References

Mention any other details that might be useful

N/A

Merged, closing out


SAK-31198 Upgrade CAS Client to allow new CAS 4 servers.

The changes are based in the AuthenticationFilter original class from 3.4.1 client:
https://github.com/apereo/java-cas-client/blob/cas-client-3.4.1/cas-client-core/src/main/java/org/jasig/cas/client/authentication/AuthenticationFilter.java
By default Sakai will keep using CAS2 protocol to allow people update without change anything, CAS3 only works for CAS servers v4. I've added a new cas3.xml file to show you how to use CAS3 protocol in case you have a CAS v4 server available.

This looks good to me. @ern you want to review?

You looks very good, nice job Juanjo.


[TX-Builder] Long numbers cause overflow

Description
When inputing long nombers without wrapping as string they cause overflow.
This needs to be tested on an input that  gets u/int values. Same case can happen for [u/int] or any other complex structure getting numbers
Environment

App: TX-Builder
Browser: All
Safe: All
Environment:

all

Steps to reproduce

Go to TX-Builder, using an ABI that requires uint, int or [uint], [int]
Try to submit the form but an error will prevent with cause "overflow"

Expected result
Transaction can be submited without issues
Obtained result
Transaction is not possible to submit unless wrapping the values into strings
Screenshots

I think for uint we have correct handling in place, but not for uint arrays https://github.com/gnosis/safe-react-apps/blob/150b5bc01f1cdc4374204dbc873c74c6db4f1c2f/apps/tx-builder/src/utils.ts#L57


Keyboard Manager:  'Grouping' feature with toggle (on/off) for remapped keys & shortcuts.

Description of the new feature / enhancement
This idea is about adding a 'Grouping' feature to Keyboard Manager. It will allow users to group many shortcuts and remapped keys into one easily toggled group. The toggle would be at the individual key/shortcut level, as well as Group level.
It would also be convenient to have a way to access custom groupings in the quick access menu (tray icon) to quickly toggle them on/off.
Scenario when this would be used?
This will allow more efficient use of Keyboard Manager when switching to different keyboard layouts, languages, or different users.
Supporting information
Currently Keyboard manager does not have a way to recognize when there is a different language being used.

This would facilitate solving issue #34383. Solving issue #34893 would help solving this one.
Please rename this ticket as an issue report, for example:

Keyboard Manager: No feature to group key/shortcut remappings and toggle them (on/off)


trigger tmux-fzf then press ESC got an warning

What's more how to reverse fzf like pic in README.md?
I change setting to TMUX_FZF_OPTIONS="--height 35% --reverse", got same warning above.
But --reverse works for fzf-tmux.
Thanks in advanced!

This should be fixed via f358fb7.

Fixed! Thanks.


WIP: renewBefore sanity checks

Fixes: #3486
NONE

Nice!
Quick question: off the list of edge cases described in https://github.com/jetstack/cert-manager/issues/3486#issue-754299165, which ones are we addressing in this PR? All of them?

/milestone Next


[Core] Updates to multipart support

Includes fixes for #10484 and #10485
Also contributes to #9534

Can one of the admins verify this patch?

FYI @pakrym

Separated first part out into separate PR to be merged first:
https://github.com/Azure/azure-sdk-for-python/pull/10616

Is this one done or still needed? I saw it referenced in another bug that sounded completed.

Thanks @Petermarcu - this is still needed (though part of it was moved out into another PR and merged). I will get this one updated and ready for review.


Track Requests for Beta

Now that the project builder is live, and the policy page states that builders can submit their projects for review by hitting the "Apply for Beta" button, we need a way to see when projects have requested review (e.g. https://www.zooniverse.org/#/talk/18/1239?page=1&scrollToLastComment=true)
Ultimately I think we'll want some sort of automatic checks for basic completeness, as well as a plan for community-based review, but for now, I think we need some sort of alert system for Zooniverse team members who can authorize a project for beta testing. For example, an automated email that goes out to the team when a project has requested beta testing?
Thoughts, @camallen @edpaget @chrissnyder @mrniaboc @DarrenMcRoy ?

You already can. Make sure you check "Admin Mode", then goto https://www.zooniverse.org/#/projects?beta_requested=true

That said, a more thorough system to sheperd these proejcts these their lifecycles is needed.

We need some type of alert when a new project is submitted for beta, at least, right?

I don't think it's that important right now. Occasionally checking manually does the job just fine when there's only a handful of projects at that stage. When we actually have more projects coming through the system, then we are going to need something better than an email anyway.

@chrissnyder FYI - admin mode won't "survive" a page reload. It's something that needs some work possibly with local storage backing.
So that using the URL above ends up sending this https://panoptes.zooniverse.org/api/projects?include=owners,avatar&launch_approved=true&beta_requested=true which will return and empty set.

Sorry, copy-pasting the URL should be fine then. The page will react to query param changes.

hmm - still got https://panoptes.zooniverse.org/api/projects?include=owners,avatar&launch_approved=true&beta_requested=true when copying and pasting.
The launch_approved=true & beta_requested=true would not meet any projects that are requesting beta.

Even if you click Admin Mode first? I get https://panoptes.zooniverse.org/api/projects?admin=true&include=owners,avatar&beta_requested=true which is correct

yep - will PM you to try and replicate what you're doing.

@chrissnyder who's checking this? Are they checking every day? Every two days? Once a week? I agree an email isn't going to cut it once we're getting 10 (or 100) beta requests every day, but if it's easy to set up, it would remove the onus from one of you guys to have to remember to check for this every day. Just one less thing to have to remember to remember to do.

...and who's making the final decisions on whether a project is legit or
not just now?
On 27 July 2015 at 23:31, ali<EMAIL_ADDRESS>wrote:

@chrissnyder https://github.com/chrissnyder who's checking this? Are
they checking every day? Every two days? Once a week? I agree an email
isn't going to cut it once we're getting 10 (or 100) beta requests every
day, but if it's easy to set up, it would remove the onus from one of you
guys to have to remember to check for this every day. Just one less thing
to have to remember to remember to do.
—
Reply to this email directly or view it on GitHub
https://github.com/zooniverse/Panoptes/issues/1190#issuecomment-125367141
.


Electricity supply and demand do not balance in some scenarios

In this scenario the electricity sankey does not balance. Production on the left is 65 PJ higher than demand on the right. I cannot figure out what the reason is:

I did figure out part of the reason: solar pv curtailment is included in the 'flexibility' node on the right. However, it is already subtracted from the 'solar' production node on the left. I've removed solar pv curtailment from the 'flexibility' query on this branch. This is 9 PJ, so there is still a difference of 56PJ
I've checked the queries, so I am guessing there's something going on in the graph, but not sure. I thought there was already a GitHub issue about the calculation of excess electricity, but couldn't find it in any repository on GitHub, so probably it's closed. @antw @michieldenhaan

Electricity [...] does not balance

I don't know if it's related, but there's a large imbalance in the HV node as well.

It never ends. :cry:

I don't know if it's related, but there's a large imbalance in the HV node as well.

Perhaps this isn't a (huge?) problem. It's because of:
capacity_of_energy_hydrogen_flexibility_p2g_electricity: 42000.0

I guess P2G isn't connected to the HV network, so the electricity is produced but disappears from the HV node and then reappears in the flexibility node.

I guess P2G isn't connected to the HV network, so the electricity is produced but disappears from the HV node and then reappears in the flexibility node.

It seems that P2G is connected to the HV net.
However, the three P2H options in this scenario are connected to the MV net, for example P2H in chemical industry. These technologies use 45 PJ excess electricity in this scenario, so that does not explain the imbalance in the HV node.

Here is an overview of total electricity production and demand in this scenario:

Here's the file: checking sankey.xlsx
Maybe this will help with figuring out why electricity demand is higher than production in this scenario!

It seems that P2G is connected to the HV net.

It's not connected to the HV node: its input is energy_production_excess_electricity, which doesn't have any input. The merit_order.level value is used in the network calculation only, and has no effect on the flow of energy in the graph. Energy disappears from the HV node, and reappears in the excess node, causing an imbalance there. The tendency for excess energy to "jump" around the graph without flowing through edges makes this harder to debug.
However, as long as the excess flexibility options are accounted for in the sankey chart, I doubt this is the reason for the missing 56.1PJ. My first guess would be that some production technology is absent from the chart, or a demand has been accidentally counted twice.

It's not connected to the HV node: its input is energy_production_excess_electricity, which doesn't have any input. The merit_order.level value is used in the network calculation only, and has no effect on the flow of energy in the graph. Energy disappears from the HV node, and reappears in the excess node, causing an imbalance there. The tendency for excess energy to "jump" around the graph without flowing through edges makes this harder to debug.

Thank you. I did not know that there is a difference between the merit_order.level value for flexibility options and the connection to nodes in the graph. So all excess electricity for flex technologies disappears from the HV node in the graph regardless of their merit_order.level?
I had another look at the scenario I had sent (without the solar pv curtailment fix because I don't have the scenario locally) and I found:

the imbalance on the HV net is 262.6 PJ (= 1079.05 - 816.45)
the excess electricity going to flex technologies is 318.72 PJ (= V(energy_production_excess_electricity,demand))

From your explanation I expect these two numbers to be the same, because the HV net imbalance is caused by the disappaerence of excess electricity to the energy_production_excess_electricity node. However, excess electricity going to flex is higher than the imbalance on the HV-net node. And the mismatch is exactly 56.1 PJ (318.7 - 262.6 PJ), which is the same imbalance that the sankey reflects!
Why is there a difference between the imbalance on the HV net and the demand of the energy_production_excess_electricity node? Does this have anything to do with losses?

Why is there a difference between the imbalance on the HV net and the demand of the energy_production_excess_electricity node? Does this have anything to do with losses?

I'm not sure. Perhaps because some of the flexibility technologies are storing energy from sources which aren't connected to the HV network? For example, energy from solar panels stored in a household P2P would not have energy flowing through the HV node.
One way to narrow this down is to go through the scenario inputs, remove whole chunks of them at a time and see if it fixes the imbalance in the sankey.

If the imbalance is still present, add the removed inputs back in and remove the half you didn't remove.
If the imbalance goes away you know one (or more) of them are responsible. Then you can add half of them back in and continue the process.

Attempt one:
input_one: 1
input_two: 2
input_three: 3
input_four: 4

Result: Imbalance. The problem could be caused by any input. Let's remove half.
Attempt two:
input_one: 1
input_two: 2

Result: No imbalance. Inputs one and two are unlikely to be the cause. Add them back in and remove half of those that weren't removed (add one and two, keep three, remove four).
Attempt three:
input_one: 1
input_two: 2
input_three: 3

Result: No imbalance. The problem is caused likely caused by input four.
Attempt four:
input_one: 1
input_two: 2
input_four: 4

Result: Imbalance. We've confirmed that input four is the cause, or an interaction between one, two, and four. We can try removing one and two and see if the problem is still present. If it is, then input_four is the sole reason for the issue. If the problem goes away then some interaction between one, two, and four is the reason.
Attempt five:
input_four: 4

Result: Imbalance. Input four is the reason for the problem.
With this kind of process you can fairly quickly narrow down which input(s) are responsible.

Thank you, I'll try that!

Perhaps because some of the flexibility technologies are storing energy from sources which aren't connected to the HV network? For example, energy from solar panels stored in a household P2P would not have energy flowing through the HV node.

The only flex technologies installed in the scenario are P2H in industry and P2G and both technologies convert energy from sources that are connected to the HV network (I suppose). So I think this doesn't explain the difference between the imbalance on the HV net and the demand of the energy_production_excess_electricity node.
I was wondering if this question in my previous post is true (I guess not on the basis of your above post ;) ):
So all excess electricity for flex technologies disappears from the HV node in the graph regardless of their merit_order.level?

The only flex technologies installed in the scenario are P2H in industry and P2G and both technologies convert energy from sources that are connected to the HV network (I suppose)

I don't think it matters which level the P2H and P2G are at. If they were to take excess energy from an MV or LV source, then this might explain why they appear to have more energy than is missing from the HV node. There do indeed appear to be hours where solar production might be used:

I think this might be one of those cases where the graph not being time-resolved results in wonky numbers in the graph (households are likely not supplied almost exclusively by solar PV, but that's what happens in the graph when we convert hourly loads back to an annual demand).

Thank you. I did not know that there is a difference between the merit_order.level value for flexibility options and the connection to nodes in the graph. So all excess electricity for flex technologies disappears from the HV node in the graph regardless of their merit_order.level?

Energy produced by technologies attached to the HV node, and then used for flexibility, will disappear from the HV node. But electricity production at the MV or LV level won't disappear from the HV node, because it was never there in the first place.

Two findings:

The electricity imbalance is only present when the interconnector-toggle is switched ON and disappears when the toggle is switch OFF.

The imbalance of 56 PJ is not only present in the electricity sankey and in the graph, but is also in visible when comparing the 'Electricity production' chart and the 'Use of excess electricity' chart.

So it probably has something to do with the new electrical interconnectors functionality.

This query can be used to quickly calculate the imbalance:
Q(total_electricity_produced)/BILLIONS - Q(demand_in_source_of_electricity_production) - Q(electricity_exported) - Q(electricity_curtailed) - V(energy_production_excess_electricity,demand)/BILLIONS
What this query does: TOTAL ELECTRICITY PRODUCTION - TOTAL ELECTRICITY DEMAND
In the scenario discussed above it starts with - 56PJ: which means 56 PJ more electricity is used than produced
To explore the dependencies of the imbalance, I started with a fresh NL scenario and took the following steps:. For each step I calculated the imbalance:

50 GW offshore wind -> imbalance is: 9.4e-10 (= nothing)

interconnector toggle ON -> imbalance is: 9.4e-10 (= nothing)

implement several combinations of flex technologies and interconnectors settings one by one:

50 GW Underground pumped hydro storage  -> imbalance is: -51.0 PJ
50 GW Underground pumped hydro storage  + IC toggle OFF  -> imbalance is: -49.8 PJ
50 GW Underground pumped hydro storage  + 0 GW IC capacity -> imbalance is: -49.8 PJ
50 GW Large-scale batteries  -> imbalance is: -23.5 PJ
50 GW Large-scale batteries  + IC toggle OFF  -> imbalance is: -19.6 PJ
50 GW Large-scale batteries  + 0 GW IC capacity -> imbalance is: -19.6 PJ
50 GW P2G -> imbalance is: -9.8 PJ
50 GW P2G + IC toggle OFF -> imbalance is: 9.4e-10 (= nothing)
50 GW P2G + 0.0 IC capacity ->  imbalance is: 9.4e-10 (= nothing)
3 GW P2H in food industry -> imbalance is: -4.2 PJ
3 GW P2H in food industry + IC toggle OFF -> imbalance is: 9.4e-10 (= nothing)
3 GW P2H in food industry + 0.0 IC capacity -> imbalance is: 9.4e-10 (= nothing)

What I learn from this is that:

The electricity imbalance is only present when the interconnector-toggle is switched ON and disappears when the toggle is switch OFF.

The statement in my previous post is not true! The imbalance also occurs when the IC toggle is switched OFF
When the IC toggle is switched OFF, the imbalance occurs when installing underground pumped hydro storage and large-scale batteries. It does not occur when using P2G and P2H. The former are storage technologies and the latter are conversion technologies, maybe it has something to do with that!
When the IC toggle is switched ON, the imbalance occurs for all flex technologies above

@antw , I think it's important for us to investigate the origin of the imbalance as it also happens when the IC toggle is switched OFF. Would you have time to look into this? And do you have enough input with this comment to start investigating?

Would you have time to look into this?

I haven't had the time to do so yet, sorry I haven't been much help yet. I can look into this once "featured scenarios" are complete; likely sometime next week.

I've not had much luck with this yet, so I'm still investigating.
The load curves in Merit, and the demand of the corresponding nodes in the graph, do match. Therefore, as far as I can tell, there is no disagreement between Merit and the graph.
I have noticed that energy_flexibility_hv_opac_electricity has an electricity output capacity, but does not have any outgoing electricity links. This is almost certainly incorrect. Either the node should have electricity edges – so that the stored energy may be used – or it should have zero electricity output capacity. The non-zero capacity means that Merit treats the stored electricity as useable for meeting demand.

I have noticed that energy_flexibility_hv_opac_electricity has an electricity output capacity, but does not have any outgoing electricity links. This is almost certainly incorrect.

Is this a related issue? It seems to me that @marliekeverweij has shown that the discrepancy occurs even when nog OPAC is installed.

Is this a related issue?

Nope; just something I noticed while investigating yesterday. Though it did lead me down the wrong path yesterday: I thought that the cause of this issue might be incorrect capacities for other technologies, but I no longer believe this is the case.

I have noticed that energy_flexibility_hv_opac_electricity has an electricity output capacity, but does not have any outgoing electricity links. This is almost certainly incorrect. Either the node should have electricity edges – so that the stored energy may be used – or it should have zero electricity output capacity. The non-zero capacity means that Merit treats the stored electricity as useable for meeting demand.

I think this issue is related!
The imbalance occurs both when the IC toggle is switched OFF and ON. I think this issue is related to the imbalances that are present when the IC toggle is switched OFF and here's the reasoning:
From my example above: when the IC toggle is switched OFF, the imbalance is present for large-scale batteries ánd OPAC. For P2G and P2H there is no imbalance when the IC toggle is switched OFF! And large-scale batteries en OPAC both do not have electricity output edges:

As you can see, this also goes for pumped hydro storage. I have checked the imbalances for pumped hydro storage and they also appear when the IC toggle is switched OFF! (Test: open Germany scenario -> 100 GW offshore wind + 50 GW pumped hydro storage -> imbalance = -65.8 PJ)
So it could be that if we add the electricity output edges to these three technologies, that the imbalance could not appear when the IC toggle is switched OFF. I think we should try that!
For the imbalances that occur when the IC toggle is switched ON, I do not know have possible cause unfortunately.....

So it could be that if we add the electricity output edges to these three technologies, that the imbalance could not appear when the IC toggle is switched OFF. I think we should try that! That could fix half of this issue ;)

I tried this locally, by setting the output capacity of the two storage technologies to zero, and turning off the dispatchable toggle. There is indeed no imbalance with these settings.
Adding edges to route the electricity to the appropriate place in the graph should help.

For the imbalances that occur when the IC toggle is switched ON, I do not know have possible cause unfortunately.....

"Unfortuantely", but also fortunately. 😄 This at least helps narrow down where the cause might be.

The more I look at this, the less convinced I am that there is a genuine electricity imbalance. Every node demand exactly matches the merit order load curve. It is of course possible that Merit is wrong, and that some technologies are calculated incorrectly, but I don't believe this is the case as the merit supplies and demands are perfectly balanced.
I created a scenario with excess solar and household P2P, and the sankey again shows missing production:
capacity_of_energy_power_solar_pv_solar_radiation: 150000.0
households_flexibility_p2p_electricity_market_penetration: 100.0

Except... I don't think this is missing production. I think P2P energy is being counted as consumption twice: it is included in "Flexibility" and in whatever sector the electricity is eventually used in. P2P is not a destination for electricity: it passes through and ends up somewhere else.
If I remove household P2P from the "flexibility" part of the Sankey, we get something that looks much more reasonable:

Actually it looks like there's slightly too much production. I think this can be explained by the battery storing more energy than is actually used. Roughly 5PJ more energy flows into the battery than leaves (99PJ in vs 94PJ out).
We don't do a good job of representing unused and decayed energy from (electricity) storage technologies; Merit accounts for them but the graph does not. We should almost certainly update our storage nodes to be like the heat network storage node. That node has two outputs edges: one for heat which is used, one ("dumped") for heat which decays and remains in the buffer at the end of the calculation year.
The query from Marlieke shows a significant imbalance still:
Q(total_electricity_produced) / BILLIONS -
    Q(demand_in_source_of_electricity_production) -
    Q(electricity_exported) - Q(electricity_curtailed) -
    V(energy_production_excess_electricity,demand) / BILLIONS

# => -94.60263934538163

This number is almost exactly the P2P output (ignoring conversion losses):
PRODUCT(
  SUM(V(households_flexibility_p2p_electricity, electricity_output_curve)),
  MJ_PER_MWH
)

# => 94.60169386815615

My guess is the query is also counting P2P twice: both as Q(demand_in_source_of_electricity_production), and again in V(energy_production_excess_electricity, demand).

Note! The P2P electricity output curve fails to account for the conversion losses. This should probably be fixed at the same time as we add a "dumped" output (otherwise the curve will still be wrong, as it will include energy that isn't actually used).

I think P2P energy is being counted as consumption twice: it is included in "Flexibility" and in whatever sector the electricity is eventually used in.

Eureka! This is a very promising observation indeed. Would this mean that we can solve this at the GQL level (and the graph was actually correct)?

Note! The P2P electricity output curve fails to account for the conversion losses. This should probably be fixed at the same time as we add a "dumped" output (otherwise the curve will still be wrong, as it will include energy that isn't actually used).

Yes. Very sharp. 👍

Would this mean that we can solve this at the GQL level (and the graph was actually correct)?

Indeed. I think the solution is as simple as not including P2P in the "flexibility" series.

Thanks for looking into this Anthony and finding the solution!!!
It's nice that the solution is as simple as that, but it's also a bit painful that I haven't thought of this earlier...
So we should:

[ ] not include P2P in the flexibility series
[ ] add the output electricity edges to OPAC, MV batteries, pumped storage

One more question: this does not explain the imbalances that show up when using P2G and P2H right?
50 GW offshore wind + IC ON + 50 GW P2G -> imbalance is: -9.8 PJ
50 GW offshore wind + IC ON 3 GW P2H in food industry -> imbalance is: -4.2 PJ

One more question: this does not explain the imbalances that show up when using P2G and P2H right?

Good point. I'll look into these.

50 GW offshore wind + IC ON + 50 GW P2G -> imbalance is: -9.8 PJ

Ah I think that for P2G the same kind of double-counting issue could occur. The produced hydrogen with P2G could be used to produce electricity and that's counted as final demand. So this should also be included in the flexibility query somehow 😅 However, in my test I did not install any hydrogen power plants.

50 GW offshore wind + IC ON + 50 GW P2G -> imbalance is: -9.8 PJ
50 GW offshore wind + IC ON 3 GW P2H in food industry -> imbalance is: -4.2 PJ

This is a bug in Merit. It's taking energy out of P2G and P2H to export as electricity. It happens because export is allowed to take energy from other flexible technologies when the dispatchable toggle is on. We calculate how much energy can be taken from the flexible technology like this:
available = max_load - current_load

This makes sense for dispatchables where both the max load and current load are always zero or larger. For example, a dispatchable may have a max load of 100, and a current load (used to satisfy other demands) or 10.
available = 100 - 10 = 90

This doesn't work for flexible where we represent inputs (charging) with negative numbers and output (discharging) with positives. P2G has a max load of 0 as it is not allowed to discharge, but if it has received electricity to convert into gas, its current load will be negative.
available = 0 - (-10) = 10

The calculation thinks P2G can discharge 10 energy to be exported. The price-sensitive export is tested with always-on and dispatchables (and both together), but not with flexibles. 🤦
A really simple fix would be to disallow exporting energy stored in flexibles. This would make some sense considering household P2P, but perhaps not so much for larger-scale P2P options. I suspect I need to create a proper fix.
This has also inadvertently revealed that the load curves of P2P will be incorrect if the P2P tech is used to satisfy "normal" demand and for price-sensitive export. I think I can fix this by preventing storage from discharging in the same hour as it charges.

Nice work!!! We can close this issue now :D


amundsendatabuilder -> hive_sample_dag is broken since incorrect sql query

This sample sql is not gonna work anymore
https://github.com/lyft/amundsendatabuilder/blob/21a763add3c00c34b4f4c2d9809f59e50fb264c8/example/dags/hive_sample_dag.py#L65-L79
Expected Behavior
It loads the watermarks to neo4j
Current Behavior
query breaks because of incorrect line :
https://github.com/lyft/amundsendatabuilder/blob/21a763add3c00c34b4f4c2d9809f59e50fb264c8/example/dags/hive_sample_dag.py#L78
SINCE, IN THE SELECT PART WE ARE USING CREATE_TIME, THEN IT SHOULD BE PART OF GROUP BY KEYS.
Possible Solution
Add CREATE_TIME in the group by part

  AND B0.TBL_TYPE IN ('EXTERNAL_TABLE', 'MANAGED_TABLE')
  AND A0.PART_NAME NOT LIKE '%%__HIVE_DEFAULT_PARTITION__%%'
GROUP BY C0.NAME, B0.TBL_NAME, A0.CREATE_TIME -- <<<<<<<<<<<<< Solution
ORDER by A0.CREATE_TIME desc;

Steps to Reproduce
Just run the dag with your metastore db
Screenshots (if appropriate)
Context
Your Environment

Amunsen version used:
dockerimages :
neo4j:3.3.0
elasticsearch:6.7.0
amundsendev/amundsen-search:2.4.0
amundsendev/amundsen-metadata:2.5.4
amundsendev/amundsen-frontend:2.1.1
Pypi:
amundsen-databuilder==2.6.4

Data warehouse stores:  hive metastore 2.3.7 on mysql by cloudsql

Deployment (k8s or native): docker-compose

Link to your fork or repository:

Hi can pick this up .


Each revision re-lists all commits

From @JChrist :

Further revisions show again all the commits from the first revision plus the new commits.
Perhaps it would make sense to filter these out.
For example, let's assume I'm creating a patch with commits: A, B and C. Then (e.g. after review), I add commit D.
This will show revision 1 with commits A, B and C and revision 2 with commits: A, B, C and D.

@Stelios123 we've fixed this now, right?


Update

@bharney : Thanks for your contribution! The author, @bharney, has been notified to review your proposed change.

@bharney : Thanks for your contribution! The author, @bharney, has been notified to review your proposed change.


Bug 1643303 - Fixed in bundle-lib 0.2.17

Coverage remained the same at 40.97% when pulling d41a5a19fa1228feb87a6095362c8ce271a5efd7 on bump-bundle-release into 3e63c7e0ff186fe7b53dfb9655f9aff63ff2d612 on master.


Change SignInManager's private helper methods to protected.

I have to implement a "PinSignInAsync" method on my SignInManager.  This will basically be (almost) exactly like the PasswordSignInAsync" method, but will be calling a new "UserManager.CheckPinAsync" method and does not have to deal with TwoFactor code.
To implement this I looked at the existing password method, and there are 4 private methods that it uses.  If these were protected, then I could use them in my own derived class so code is reused and not duplicated.
    private async Task<bool> IsLockedOut(TUser user)
    private async Task<SignInResult> LockedOut(TUser user)
    private async Task<SignInResult> PreSignInCheck(TUser user)
    private Task ResetLockout(TUser user)

I would also suggest reviewing the other private and internal methods/classes to see if the would benefit from being protected/protected internal.

dbec1c6236ac5cc6bc31db52686259c64c89a7d3


[feature]: Make 6 block target requirement for lnd sweeps as configurable parameter

Is your feature request related to a problem? Please describe.
In high mempool fees times, it is painful to pay high fees to sweep your own outputs (stage 2 HTLC/FC outputs/etc). Sometimes as high as 100 sat/vb
This is because lnd uses 6 blocks target to sweep the outputs and that parameter is not configurable.
Work around to use high sweeper batch window (to club multiple outputs and potentially reduce fees) works but it suffers from its own limitations. See #7700
Describe the solution you'd like
lnd.conf can allow a max_sweep_fee_rate (default 69 sats/vb or a suitable value) which a node runner can configure to their desired setting. Setting this to 0 should revert back to 6 block target (used currently). If the estimated fees for 6 blocks is > max_sweep_fee_rate then the sweep should be sent with the max_sweep_fee_rate.
If node runner later on wants to speed up the sweep they can always use CPFP the sweep output.
Describe alternatives you've considered
Raising sweeper batch window to 1000 h or higher. But you need to restart lnd (with reduced batch window) to sweep and then again restart to increase batch window again. This is cumbersome and requires manual monitoring of mempool.
Additional context
This will help node runners optimise on on-chain costs.

Obsolete with the new sweeper logic, see https://github.com/lightningnetwork/lnd/pull/8613


Feature/95/archive project

What does this PR do?
I added the option of archive and unarchived projects. Admins and project members could archive and unarchived projects.
The archive projects will be hidden in the active list of projects. But you will find it on your proposal list.

How should this be manually tested?

Go to the main page of a project
Click on the archive button
Confirm the action
Go to the active projects list, you will not find it
Go to the my proposal list projects
Look for the archive project and select it
Click on the unarchive project
Confirm the action
Go to the active projects list, you will find it

What are the relevant tickets?
#95

Screenshots

Checklist

[ ] I added the necessary documentation, if appropriate.
[ ] I added tests to prove that my fix is effective or my feature works.
[ ] I reviewed existing Pull Requests before submitting mine.

By @LuisTejedaS 's comment here (and I agree), seems like we should just change how we display this feature. Instead of an archive button, that seems somewhat complicated, it could be displayed just like the admin-only delete button, but for owners of the project who are not administrators. The functionality would be similar, we activate a boolean column, and hide it from most views.
We would also have an admin-only view of soft-deleted projects so we can delete them completely.