AMA Migration Helper.workbook - Unable to pull information from Subscriptions without LAW

Hi, We have a single Log Analytics Workspace configured inside our management subscription. This management subscription contains very few resources with the majority of our resources stored in our production subscription (where no LAW exists). Currently the agents in this subscription connect to the LAW in the management subscription where events are received successfully.
When running the AMA Migration Helper workbook it only identifies the management subscription with the LAW and ignores the other subscriptions. This means the only VMs analyzed are those in the management subscription ignoring the majority that are in other subscriptions.
Is this a known limitation? Are there plans/patches available to support resources in subscriptions without their own LAW?

The workbook was recently updated to provide a more at-scale experience and this is now live in the portal.


New ui extension union schema

WHY are these changes introduced?
Fixes #0000

WHAT is this pull request doing?

How to test your changes?

Post-release steps

Measuring impact
How do we know this change was effective? Please choose one:

[ ] n/a - this doesn't need measurement, e.g. a linting rule or a bug-fix
[ ] Existing analytics will cater for this addition
[ ] PR includes analytics changes to measure impact

Checklist

[ ] I've considered possible cross-platform impacts (Mac, Linux, Windows)
[ ] I've considered possible documentation changes
[ ] I've made sure that any changes to dev or deploy have been reflected in the internal flowchart.

Ok, I thought Function had metafields too but it turned out to be input.metafields: https://shopify.dev/docs/apps/functions/input-output/variables-queries#step-1-specify-the-metafield-to-use
@isaacroldan I think in summary these are all the fields that should be present, some of which need to be inherited either from the top-level or the extension-level.
api_version = "2023-04"
name = "Google maps validation"
description = "Validates location on Google maps"

[[extensions]]
handle = "google-maps-function"
type = "function"
# inherits top-level global api_version if not set
# inherits top-level global name if not set
# inherits top-level global description if not set
  [extensions.build]
  command = "cargo wasi build --release"
  path = "google-maps-function/dist/function.wasm"

  [[extensions.targeting]]
  export = "fetch"
  input_query = "google-maps-function/fetch.input.graphql"
  target = "purchase.validation.fetch"

  [[extensions.targeting]]
  export = "validate"
  input_query = "google-maps-function/fetch.validate.graphql"  target = "purchase.validation.validate"

[[extensions]]
handle = "google-maps-ui"
type = "ui-extension"
# inherits top-level global api_version if not set
# inherits top-level global name if not set
# inherits top-level global description if not set

[[metafields]]
namespace = "my-namespace"
key = "my-key"

  [[extensions.targeting]]
  module = "google-maps-ui/settings.jsx"
  target = "purchase.validation.render-settings"
  # inherits extension-level metafields if not set

Updated! The ui_extension schema now supports either a targeting or a extension_points array.
If using targeting then it is transformed to extension_points internally. Extension level metafields are inherited in the target if not present.
All other top-level fields are flattened and included in the config of each extension in the array when parsing it. (name, description, api_version...)
I'll update the tests later today

@isaacroldan you're correct, I got the TOML wrong. Using this works as expected
name = "action-extension"
api_version = "internal"
[[extensions]]
  type = "ui_extension"
  [[extensions.metafields]]
  namespace = "my-namespace"
  key = "my-key"
  [[extensions.metafields]]
  namespace = "my-namespace"
  key = "my-other-key"
  [capabilities]
  network_access = true
  block_progress = true
  api_access = true
  [settings]
    [[settings.fields]]
    key = "field_key"
    type = "boolean"
    name = "field-name"
    [[settings.fields]]
    key = "field_key_2"
    type = "number_integer"
    name = "field-name-2"
  [[extensions.targeting]]
  target = "admin.product.item.block"
  module = "./index.jsx"
  [[extensions.targeting]]
  target = "admin.product.index.action"
  module = "./index.jsx"
  [[extensions.targeting.metafields]]
  namespace = "my-specific-namespace"
  key = "my-specific-key"

I think the only thing left to do is to drop support for setting the metafields at the top-level as this is a ui-extension concept only


Resuming / partial download when outputting to stdout?

Checklist

[X] I'm reporting a feature request
[X] I've verified that I'm running youtube-dl version 2021.01.03
[X] I've searched the bugtracker for similar feature requests including closed ones

Description
youtube-download can resume downloads (by default and / or by using -c), but this logically only works when outputting to a proper file. When using -o - and outputting to stdout (e.g. scripting around ydl) there seems to be no way to provide ydl with a "resume offset".

It's not supposed to support resume when outputting to stdout.

It's not supposed to support resume when outputting to stdout.


global-message module: refactor public accessors into functions and rename functions

Originating from #272 and discussed in Nov 29 refinement.

Refactor public accessors into functions.
If needed, rename functions to be short and into context
i.e. productService.get() instead of productService.getProduct()
Avoid redundancy.
Additionally we are allowed to not mirror the commerce platform.

There is a follow up ticket for facades to load once in the store (epic/loadonceinstore).

All facades work will be tested with one ticket, #6.

All facades work will be tested with one ticket, #6.

All facades work will be tested with one ticket, #6.

PR: https://github.com/SAP/cloud-commerce-spartacus-storefront/pull/559


Fix typos in changelog

Simple typo fix :smile:

Eh.. sorry had to rebase. @syscll & @JoelSpeed one of you mind re-reviewing?


[Request] output format without lat/lon/name

I have a request, or somebody knows how to change it easily in the code.
right now the output format of the made accounts is
PTC,ACCOUNTNAME,PASSWORD,LAT,LON,ACCOUNTNAME
can it be made like
PTC,ACCOUNTNAME,PASSWORD
??
that way we can use the output right away in the pogom map.

pretty sure if you just edit line 54 of index.js
var outputFormat = "ptc,%NICK%,%PASS%,%LAT%,%LON%,%UN%\r\n"; // Format used to save the account data in outputFile. Supports %NICK%, %PASS%.
and remove unwanted output it should do what you want

thanks, it kinda works, i do get an error though, the account is kinda active and i can login but i still need to accept the tos, maybe thats whats the error is about.
ptc-acc-gen v2.8.0 by Sébastien Vercammen and Frost The Fox (and Github contribs)
Creating account 0 of 1
Start recaptcha solving
Creating account 1 of 1
Start recaptcha solving
, Location: undefined,undefinedlszr0, Password: djfhkshjkgdf
, Location: undefined,undefinedlszr1, Password: jdhfkghjkdfg
Failed to initialize client for hfgdj... ERROR: [Error: Invalid response received from PTC login]
Failed to initialize client for uriewo... ERROR: [Error: Invalid response received from PTC login]
Find the generated accounts in PogoPlayer/accounts.csv

ah yeah I failed to think about the TOS part of the script.

This is required for the ToS portion of the script.

I suppose I can leave this open, I'll see what @sebastienvercammen thinks, but personally i'd leave it.

You can change the outputFormat and lat/lon are required for account validation with PogoPlayer. This is a non-issue.


Update README.md (typo)

typo: wheather -> whether
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

too old - disregard


Support WebGL

Per Title.

Not sure if this is a useful example of working WebGL Go code, but just in case:
    https://github.com/bobcob7/wasm-stl-viewer


Missing benchmark data files.

Hello,
It seems that dft_orig.bench and idft_orig.bench are not in ./bench_openabcd/. Do you know where I could find them, or if I missed something?
Thanks!

Hi @AntGro,
I missed uploading the bench files directly into the repository. I have added them now. Please check.
Best regards,
Animesh

Thank you.


A SEARCHABLE Transact-SQL Reference Manual Please!

I don't want to attack the people who wrote this particular page but... This reference keeps getting worse and worse instead of better and better.  (1) The title in the topic list at left named "Transact-SQL (T-SQL)" Cannot be selected.  (2) It can never be the "top" so that search results do not include a flood of completely irrelevant results.  (3) Choosing the topic directly below the topic title of the same name sends you to this reasonably meaningless page in a different place in the topic hierarchy that does not give you reasonable access to the T-SQL topics, only links to other references!  (4) just try as an obvious example, searching for CONVERT, a T-sql function name. CROSS JOIN? FULL OUTER JOIN?   Ridiculous.  (5) You can't make ANY of the topics at left sticky or bookmark it, such as the "Functions" category.  None of them.  Every time I want to find something I have to wade through the topics and subtopics and subtopics because (a) this page has no direct links to its subtopics, (b) subtopics can't be bookmarked, and (c) entering search text in "Filter by title" is worthless. Hey, I guess it could be worse.  At least stuff a pile of links in here to the subtopics of Transact-SQL please.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c90a9561-bef5-25e8-e672-ed0d4493a383
Version Independent ID: 16c705c1-55be-d339-8326-51d57cb0fd69
Content: Transact-SQL Reference (Database Engine) - SQL Server
Content Source: docs/t-sql/language-reference.md
Product: sql
Technology: t-sql
GitHub Login: @MikeRayMSFT
Microsoft Alias: mikeray

There's a lot of issues and (shared) frustrations noted in your comment.  In the meantime, I've found that Bing does a very good job of delivering the page I'm looking for when I search for 'tsql <my topic | page>'.
For me, the biggest pain point is the inaccuracy of the search/filter bar.  If that can be resolved, the need to navigate manually would be 95% gone, and any bugs or design limitations in the topic tree would be far less frustrating.
The fundamental flaw with the search/filter bar is its lack of scope.  Aside from unsociable bad breath, it does not prefer search results for the current page's branch of the topic tree.  I think users expect that when they are already detailed into 'Docs/SQL/Reference/Transact-SQL (T-SQL) Reference', the results will be- if not strictly scoped to the current branch- then at least sorted from current branch to root.  If a user needs to broaden the search, links to each root level are already close-by.

In the example below, I'd like the results sorted as:
a. Page scope- the leaves within ./Queries (result #34)
b. Search box scope- other branches of ./Reference/Transact-SQL (T-SQL) Reference (result #33)
c. Larger scope (by special dispensation or algorithm?)- other branches of ./Reference when it makes sense

I would also like to have preference for full string matches over partial string matches, and start-of-string matches over any-position matches.
Finally, a picky comment- the 'filter by title' text is misleading, because the filter is an ephemeral search results overlay, not a true filter of the topic tree.  I typically don't want to filter the topic tree anyway; I want to traverse it.
Thanks for considering!  FYI, docs.Microsoft.com is streets ahead of Oracle and other developer reference sites.  Thank you for all the careful thought and investment you've put into such a tremendous product!

MightyPen is DEAD ON. Please consider his suggestions for making this huge investment in documentation, especially this Transact-SQL Reference, the useful tool it should and could be.

@sudeepku Hi Sudeep, Last week this Issue 2267 had screenshots added to explain suggestions for how the TOC Search textbox feature might be changed.  The screenshots build on the points made by the original poster.
You may like to consider these ideas.
@rlhane @RegexPro
I am now Closing this Issue 2267, as a successful Issue. These ideas are interesting, and they have been communicated to the proper people within Microsoft.
Thank you for submitting this interesting Issue. We hope to hear from you again.
The @ notification mechanism continues to work even after an item is Closed, in case further communication is needed.
CC: @MashaMSFT

Related:

AzBoards > CeApex > Engineering > 92405


Support TransactionID and Idempotence Consumer/Producers in the Topology

As a user of KTB i would love to setup as well consumers and producers that require transactions and idempotence producing. For this, we need.

For a producer the DESCRIBE and WRITE operations are given on the topic. The following could be needed as well:
TransactionalId: WRITE, DESCRIBE
Cluster: IDEMPOTENT_WRITE

For a consumer the READ and DESCRIBE operations are supported on the topic and READ on given consumer group (or default all groups). Not exactly sure at the moment what more we need, but these are possible candidates:
TransactionalId: DESCRIBE
Group: DESCRIBE

The Group: DESCRIBE doesn't really relate to this issue (support transactionalId/Idempotence).
Actually when looking a bit more into it DESCRIBE is not needed at all for the group, since READ also implies DESCRIBE permission.
https://docs.confluent.io/5.2.0/clients/javadocs/index.html?org/apache/kafka/common/acl/AclOperation.html
The AclOperation docs also seems to suggest that adding DESCRIBE ACL is not needed when you have READ AND WRITE ACL on the topic? And the same goes for suggested change on transactionalId?


add general sql layer and mysql support

adds support for general sql support. including

kit-sql-general - General sql layer, just contains connection pooling (via hikari-cp) and jdbc wrapper (via next.jdbc).
kit-mysql - JDBC Driver working with MySQL8+

daily sql stack here: MySQL8, hikaricp for connection pooling, next-jdbc for DB sql talking, honeysql for sql manipulating.

Thanks for the PR!
I'll have more time on the weekend to review this, but some initial thoughts:

kit-mysql probably doesn't need to be a library, since all it is is pulling in a dependency. It is clearer to have this dependency explicit in your deps.edn rather than transient through a library if that library does nothing else. The difference between with kit-postgres library is it has are extensions to some next-jdbc protocols
Decoupling the migrations from the general sql edge might be useful... We probably don't need to tie these two together, i.e. right now kit-sql bundles both conman and migratus together, but it probably doesn't need to... Perhaps we can keep conman, since you can still use it for the convenience when integrating with hikari-cp, but you don't need to explicitly use the Hugsql binding generation (the query-fn integrant component can just be removed).

It is clearer to have this dependency explicit in your deps.edn rather than transient through a library if that library does nothing else.
agree. and will add some java-8 types extension for mysql.

Perhaps we can keep conman, since you can still use it for the convenience when integrating with hikari-cp, but you don't need to explicitly use the Hugsql binding generation
conman bundled with a lot unused dependencies. such as hugsql.

A general sql layer should ship with  connection pooling and jdbc wrapper.
conman and hugsql shoud live above this general layer, maybe as "sql manipulation layer".

I agree with the rationale regarding conman, we also might want to look at updating the sqlite module to match the changes as well as adding mysql and postgres modules.

Makes sense. How does this approach sound @yogthos @sound2gd :

Separate current kit-sql library into four, with kit-sql remaining as a means of backwards compatibility:

kit-sql pulls in kit-sql-conman and pulls in kit-migratus as a dependency. It doesn't do anything fancy beyond being a wrapper for both. This is to avoid breaking changes for anyone relying on the kit-sql library to provide both.
kit-sql-conman is the sql library with conman/hugsql and next-jdbc.
kit-sql-hikari is the sql library with hikari-cp and next-jdbc (i.e. from @sound2gd's PR as kit-sql-general)
kit-sql-migratus adds migratus. This decouples migrations from the core sql library. Can be handy if people want to pull in their own migrations tool.

The lein-template will not generate new projects with kit-sql, but instead explicitly call whichever ones are necessary. We should figure out how the profile rules will apply for code generation / combinations.

Separately: with 21c624fd0a463844c7493fcd0321fe36cbd48a01, it makes sense now have the kit-mysql library as well.

@nikolap sounds reasonable, will do some coding later this week

Resolved with https://github.com/kit-clj/kit/pull/25


utils: center_mass_exp has no tests

Hi, I am learning about Brainiak. I might be able to contribute every once in awhile, so I am interested in solving this issue to get familiarized with the process.
I am slightly confused about the way center_mass_exp  deals with negative a and/or b. For example, when a and b to be negative, exponential should have zero mass. I thought this function should return (a+b)/2, or simply return some warning. Currently, center_mass_exp(-2,-1) = -1.58197670687. Am I misunderstanding something?

Hello, @QihongL! Thank you for your interest in BrainIAK. Any contribution is appreciated.
@lcnature, could you please chime in?

@QihongL
Thanks for pointing this out! I forgot to consider the case.
So I think if b is smaller or equal than zero, then an error should be thrown out.
If a is smaller than 0 but b is not, then this seems fine, we can set a to 0 and do the same calculation as before.

Ah, I thought you wouldn't allow a<0. I see... Still, if a < 0, it might suggest the user doesn't know what this function is trying to do. I guess it makes sense to at least throw a warning in this case? For example, the warning message can remind the user to simply set a = 0.

@QihongL Good point! In that case, maybe we should just enforce a>=0 and throw an error if not.

fixed!


Fix a theoretical copy forwarding bug.

Reviewing the code with Arnold revealed a corner case where forward propagating
a copy into multiple operands of the same instruction wasn't properly detected.
I don't think this case was possible given the language rules, but nonetheless
it is valid SIL and needs to be handled.
This is confusing because in some cases we optimize that situation correctly,
and in other cases we try to assert that it doesn't happen. So, I simplified the
code to bailout anywhere that we see multiple operands of the same value. This
isn't an expected situation that needs to be optimized anyway.

@swift-ci test and merge.


Team 04 - HA Review - Security Requirement to prevent database overwriting

I think for a few of the hazards, such as user being unable to login or incorrect data returned in the reports, etc. You mention that there can be a failure in the database.
I think adding a new security requirement for this is beneficial. It should explicitly mention that the system shall prevent any data from being overwritten. This will add a new layer of security that prevents any incorrect data being returned and/or the user's data being removed from the database.

@samm82


c++ how to predict for a couple of images

when use c++ to deploy, MXPredSetInput only support a constant size, is there a way that I can forward a few images at once, and the number of images is changing @mli @piiswrong

Thanks, seems cpp-package is more sense

@nswamy @sandeep-krishnamurthy Please label this - "Question" and close this issue.


show license info on website

It will be more clear and descriptive to show lucide package license on website.

@mittalyashu good idea!


RtAudio warning while game is running, and audio has sound pops

Operating system or device, Godot version:
Windows 10 64bit - Godot 2.1.4 RC
Issue description:
The warning "RtAudio output underflow!" shows up in the error log a few times per second while the game is running. And audio (specifically tested using the Platformer demo with the music) has a popping sound almost in sync with the warnings.
This was not present in 2.1.4 2017-08-17, the audio sounds completely normal in that build and there was no warnings.
Steps to reproduce:
Open any project or create a new project and run it.

Duplicate of #7288, and I suspect of some other programs (like browsers) that triggers the annoying warning on Windows.

This was not present in 2.1.4 2017-08-17, the audio sounds completely normal in that build and there was no warnings.

Can you confirm that the issue is systematically reproducible in the RC build but doesn't appear if testing the 2017-08-17 build in the same conditions?

Yes it happens every time I run the RC build, even just launching the RC editor, the warnings start appearing in the console.

But with the 2017-08-17 build and earlier I've never seen the warning.

@CowThing: That must have been a fluke, the warnings happen on Windows all the time, as I pointed out in #7288.

In the official Godot 3.0 alpha1 I don't see this warning. But in a more recent unofficial 3.0 build (from 8-22) I do see the same exact warning as I'm seeing in the 2.1.4 RC build.

Seems to be a regression from #10406.

For 2.1, the regression (this bug) is fixed with cf80fbc9, though it does not address the previous #7288 bug.
For master, #10683 aims at fixing both bugs, but since it seems non-trivial, I went the safe route for 2.1.4.


Is there any kind of "reset()" or "clear()" function ?

For my use case I loading jquery and the jquery-turtle library one time and want to reused it for several movements.
$(q).home() works great to reset the position, but I don't found any function which remove the drafted lines / shapes or everything besides the turtle so that I could start with an clean screen without reloading the window or content.

There is a cs() "clear screen" function.  Does it do what you want?

Unfortunately its killing the turtle (custom image) as well.
Is there an easy way to regenerate the custom turtle image ?
Basically I need cs() with the option to keep the turtle (custom image).

There is a cg() to just clear the "graphics" surface, which leaves text and
turtles alone.  Does that do the trick for you
On Tue, Jan 19, 2016 at 2:10 PM, Markus Bordihn<EMAIL_ADDRESS>wrote:

Unfortunately its killing the turtle (custom image) as well.
Is there an easy way to regenerate the custom turtle image ?
Basically I need cs() with the option to keep the turtle (custom image).
—
Reply to this email directly or view it on GitHub
https://github.com/PencilCode/jquery-turtle/issues/103#issuecomment-172954833
.

Does the trick. Thanks a lot. ;)


Added art gobbler, diff reporter and solplot

Please check if what you want to add to awesome-foundry list meets quality standards before sending pull request. Thanks!

Please provide package links to:

repo link (github.com, gitlab.com, etc):
coverage service link (codecov, coveralls)

Note: that new categories can be added only when there are 3 packages or more.
Make sure that you've checked the boxes below before you submit PR:
not every repository (project) will fit into every option, but most projects should

[x] I have added my package in alphabetical order.
[x] I have an appropriate description with correct grammar.
[x] I know that this package was not listed before.
[x] I have added link to the repo and to my pull request.
[x] I have added coverage service link to the repo and to my pull request.
[x] I have read Contribution guidelines, maintainers note and Quality standard.

Thanks for your PR, you're awesome! :+1:

Merged! thanks


Define keyboard highlighting with open/close feature

This PR closes #324
Adds accessibility into collapsible fields by allowing navigation using the keyboard.

echo all nits by will, and click to open should be the whole bar not just the arrow if we're updating anyway.

currently validating the latest iteration

just test with jodom, approving and merging


No video names in history in Late 2009 layout(1.2.0 beta 2

Okay, will look into fixing that for the next beta.

Should be fixed in 1.2.0 Beta 3.


Can not get autofilled value in v6 and v7?

What is the current behavior?
Field autofilled by browser can not read in handleSubmit in v6.0.5. I googled a post to solve this problem, but only works for v5.
What is the expected behavior?
Get the autofilled value in handleSubmit.
What's your environment?
React: 15.1.0
Redux-Form: 6.0.5

While I'm sympathetic to this problem, because reacts synthetic events not matching up with dom's synthetic events makes life tricky sometimes, I'm not convinced the issue your facing is a general problem.
For example I am able to autofill http://redux-form.com/7.0.3/examples/simple/ without any issues.

Yes, the simple example is ok. Maybe it's my usage caused.


Data flow: generalize flow-through summaries

Summary
The essence of this PR is to generalize the predicate
argumentValueFlowsThrough(ArgumentNode arg, OutNode out)

to
argumentValueFlowsThrough(
  ArgumentNode arg, Node out, ContentOption contentIn, ContentOption contentOut
)

The extra parameters ContentOption contentIn and ContentOption contentOut describe the contents (if any) of arg that can flow through to the contents (if any) of out. This gives four combinations:

contentIn
contentOut
Type
Count on mono

None
None
Normal flow through (as before this PR)
102.312

Some(f)
None
An f getter
1.022.730

None
Some(f)
An f setter
281.193

Some(f1)
Some(f2)
An f1-getter + f2-setter
1.620.922

Getters and setters were handled prior to this PR as well, but they were defined as special cases. The new type getter+setter means we are able to handle summaries for e.g. clone methods:
class A
{
    object Field;

    public A Clone() // a getter+setter
    {
        var ret = new A();
        ret.Field = this.Field;
        return ret;
    }
}

Implementation details
DataFlowImplCommon.qll

The old implementation contained two modules FlowThrough_v1 and FlowThrough_v2 for computing flow summaries. The latter was used to calculate getters and setters, which was used as input to the second calculation.
The new implementation calculates generalized flow summaries, so getters and setters (and getter-setters) are computed as part of the recursion, which means we no longer need two phases.
Call contexts are no longer needed, since we now reconstruct all flow-through summaries as part of pathStep in DataFlowImpl.qll.

DataFlowImpl.qll

nodeCandFwd1, nodeCand1, and parameterFlow no longer use flow summaries, as they are able to reconstruct the summaries.
Getter-setter steps are simulated by synthesizing a new ReadStoreNodeExt n node; n1 -read-> n -store-> n2. Consequently, all pruning steps (except those above), use a new NodeExt type instead of Node.
pathStep now reconstructs all flow summaries (not just those involving taint steps). In particular, pathStep works with normal Nodes and not NodeExts.

Performance
C#
Dist-compare report is here. In order to get acceptable performance, I had to restrict flow-through to access path of length at most 3.
Java
Java-Differences job is here (internal link).
C++
CPP-Differences job is here (internal link).
Follow-up work
Taint-getters and taint-setters will be generalized along the same lines, and the various pruning steps can be simplified by introducing new synthesized NodeExts, like for getter-setters.
Notes for the reviewer
Commit-by-commit review is strongly encouraged, and I suggest reviewing 7678cb0349f6e316c0bd241af42a6b734783f43e with the feature Hide whitespace changes enabled.

Could you investigate performance of TaintedPath.ql on geogebra/geogebra?  It seems that the additional fan-out in readExt/storeExt steps is causing some trouble there.

Could you investigate performance of TaintedPath.ql on geogebra/geogebra? It seems that the additional fan-out in readExt/storeExt steps is causing some trouble there.

It's probably best to tackle this in follow-up work.

For the record, the latest Java-Differences job in the PR description indicated a performance impact of ca. +7% on JDK 11.
Did someone sanity-check the query result changes? (I don't see a PR comment to that effect.)

Did someone sanity-check the query result changes? (I don't see a PR comment to that effect.)

No, I don't think so.  @hvitved is there a Java-Differences job using the final state?  I don't think we should see results disappearing, so perhaps this was merged a bit prematurely.

No, I don't think so. @hvitved is there a Java-Differences job using the final state? I don't think we should see results disappearing, so perhaps this was merged a bit prematurely.

I have started a new job here: https://jenkins.internal.semmle.com/job/Changes/job/Java-Differences/581/. Results could disappear as we are now reconstructing all flow summaries in pathStep, taking types and call contexts into account.

I've investigated the two missing results for java/hardcoded-credential-api-call on hadoop.  The reason for the disappearance of these results is the fieldFlowBranchLimit, as some of the refactoring on this PR means that this is now observed for getters and setters.  It is quite likely that this effect is also the cause of the other disappeared results.  Incidentally, the two hadoop results are back in latest master due to improvements in the first pruning step.

Thanks for looking into this Anders.

For the record, the result changes from Java-Differences # 583 were:
=== Changes per project (+new -fixed) ===

g/apache/hadoop-common                                                      +0 -2
g/AdoptOpenJDK/openjdk-jdk11u                                               +63 -275

=== Changes per query (+new -fixed) ===

java/hardcoded-credential-api-call                                          +0 -3
java/improper-validation-of-array-index                                     +0 -14
java/path-injection                                                         +1 -6
java/similar-file                                                           +2 -2
java/tainted-arithmetic                                                     +60 -74
java/tainted-numeric-cast                                                   +0 -28
java/uncontrolled-arithmetic                                                +0 -139
java/xxe                                                                    +0 -1
java/zipslip                                                                +0 -10


uninitialized constant #Class:RelatonIso::IsoBibliography::Iecbib (NameError)

During https://github.com/metanorma/ogc-wfs/pull/3 was discovered issue for Windows https://ci.appveyor.com/project/ribose/ogc-wfs/builds/25406858/job/if51k7cu51y7cxr5
C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/relaton-iso-0.5.0/lib/relaton_iso/iso_bibliography.rb:41:in `get': uninitialized constant #<Class:RelatonIso::IsoBibliography>::Iecbib (NameError)
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/relaton-iso-0.5.0/lib/relaton/processor.rb:14:in `get'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/relaton-0.4.0/lib/relaton/db.rb:172:in `new_bib_entry'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/relaton-0.4.0/lib/relaton/db.rb:152:in `check_bibliocache'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/relaton-0.4.0/lib/relaton/db.rb:42:in `fetch'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:107:in `fetch_ref'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:50:in `isorefmatches'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:186:in `reference1'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:195:in `block (2 levels) in reference'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:194:in `each'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:194:in `block in reference'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:293:in `initialize'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `new'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `with'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:116:in `noko'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/ref.rb:193:in `reference'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/lists.rb:18:in `ulist'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:96:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:75:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/list.rb:30:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `block in content'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `map'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `content'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/section.rb:187:in `block in norm_ref_parse'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:391:in `insert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:375:in `method_missing'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/section.rb:185:in `norm_ref_parse'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-ogc-0.1.0/lib/asciidoctor/ogc/converter.rb:94:in `bibliography_parse'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/section.rb:60:in `block in section'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:293:in `initialize'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `new'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `with'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:116:in `noko'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/section.rb:36:in `section'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:96:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:75:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `block in content'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `map'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/abstract_block.rb:84:in `content'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/document.rb:1261:in `content'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/base.rb:185:in `block in middle'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:391:in `insert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:375:in `method_missing'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/base.rb:184:in `middle'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-ogc-0.1.0/lib/asciidoctor/ogc/converter.rb:25:in `block in makexml'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:293:in `initialize'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `new'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/nokogiri-1.8.5-x86-mingw32/lib/nokogiri/xml/builder.rb:254:in `with'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:116:in `noko'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-ogc-0.1.0/lib/asciidoctor/ogc/converter.rb:25:in `makexml'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-ogc-0.1.0/lib/asciidoctor/ogc/converter.rb:48:in `document'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-standoc-1.2.0/lib/asciidoctor/standoc/utils.rb:96:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor/document.rb:1190:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/asciidoctor-1.5.8/lib/asciidoctor.rb:1521:in `convert'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-0.3.12/lib/metanorma/input/asciidoc.rb:8:in `process'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-ogc-0.1.0/lib/metanorma/ogc/processor.rb:26:in `input_to_isodoc'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-0.3.12/lib/metanorma/compile.rb:102:in `process_input'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-0.3.12/lib/metanorma/compile.rb:17:in `compile'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/lib/metanorma/cli/compiler.rb:23:in `compile_file'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/lib/metanorma/cli/compiler.rb:11:in `compile'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/lib/metanorma/cli/compiler.rb:15:in `compile'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/lib/metanorma/cli/command.rb:33:in `compile'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/thor-0.20.3/lib/thor/base.rb:466:in `start'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/lib/metanorma/cli.rb:55:in `start'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/gems/metanorma-cli-1.2.0/exe/metanorma:14:in `<top (required)>'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/bin/metanorma:23:in `load'
	from C:/projects/ogc-wfs/vendor/bundle/ruby/2.5.0/bin/metanorma:23:in `<main>'
[relaton] processor "relaton_gb" registered

@ronaldtse please triage how critical this is

@CAMOBAP795 critical, we ought to fix this ASAP.

@ronaldtse just to be on the same page this happens on windows only, but ok I will have look at it

@CAMOBAP795 yes I realize this. Apparently many of our users use Windows, and our support for Windows has been dismal...

Don't reproduce anymore


file handle read 404 Not Found, missung file chunk after upload via filer.copy

Describe the bug
Continuation of #2154
So, this time I had uploaded 11k files via filer.copy and once again a few files error out.
weed -v 4 -logdir /tmp/wlogs filer.copy * http://localhost:8888/buckets/client_files/ >> /tmp/wlogs/somelog.log
from log:
Log file created at: 2021/06/27 15:47:36
Running on machine: suika
Binary: Built with gc go1.16.5 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss threadid file:line] msg
I0627 15:47:36 23621 config.go:31] Reading : Config File "security" Not Found in "[/snapraid/storage_c2/client_files /root/.seaweedfs /usr/local/etc/seaweedfs /etc/seaweedfs]"

From filer.copy:
uploading 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png in 6 chunks ...
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-2 to http://<IP_ADDRESS>:8080/187,0671b908f6fb6de1 [4194304,8388608)
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-1 to http://<IP_ADDRESS>:8080/187,0671b9057a844c4c [0,4194304)
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-6 to http://<IP_ADDRESS>:8080/187,0671b9049ca2abd9 [20971520,22320198)
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-3 to http://<IP_ADDRESS>:8080/187,0671b9076770557b [8388608,12582912)
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-4 to http://<IP_ADDRESS>:8080/187,0671b909236e4258 [12582912,16777216)
uploaded 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png-5 to http://<IP_ADDRESS>:8080/187,0671b90a1e5eea3b [16777216,20971520)
copied f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png => http://localhost:8888/buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png

From mount:
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 reader_at.go:146] fetching chunk &{FileId:187,0671b9057a844c4c Offset:0 Size:4194304 LogicOffset:0 ChunkSize:4194304 CipherKey:[] IsGzipped:false}: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
E0627 16:44:08 15798 filehandle.go:150] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found
W0627 16:44:08 15798 filehandle.go:90] file handle read /buckets/client_files/f59/599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png 0: http://<IP_ADDRESS>:8080/187,0671b9057a844c4c?readDeleted=true: 404 Not Found

I did not use other tools, I uploaded it in one go. So something is not right. If this is happening now, I wonder if this happens with S3 and other parts. But will only be able to check on the next version.
System Setup

Seed Docker setup in #1594 but with newer seaweed version
Debian 9
version 8000GB 2.55 05af54a linux amd64
default filer.toml
FUSE: weed mount -filer=localhost:8888 -dir=/mnt/weed -cacheDir=/snapraid/storage_c2/test/seaweed-cache -cacheCapacityMB=0

Expected behavior
File to no have errors when uploaded via filer.copy. If needed, double check if the uplaoded chunk is really uploaded.
Sure, will slow down the whole process, but data loss is kinda bad. Tho I will only be able to say it in the next release.

To confirm:

Are there any updates or deletions at the same time?
Are the files copied mostly more than 4MB? What is the average size?
Do you have volume server logs?

Are there any updates or deletions at the same time?

If you mean that another application is uploading files to seaweed, then yes. There is an application that is pushing files via S3 every other second.

Are the files copied mostly more than 4MB? What is the average size?

Highly variable. Range from a few kb to 300mb, but most ranges are between 1 and 6mb.

Do you have volume server logs?

Yes, checked them for any new entreis at the time of the uplaod, but nothing to be found there. That's why I didn't include them. And I mean that there was nothing.
Running volume.fsck right now. Will reply in ~12h.

> volume.fsck
volume:5        entries:466072  orphan:4        0.00%   4769883B
volume:11       entries:449755  orphan:18       0.00%   28946002B
volume:7        entries:455311  orphan:8        0.00%   11050412B
volume:32       entries:337661  orphan:21       0.01%   32366239B
volume:14       entries:619639  orphan:32       0.01%   44208469B
volume:28       entries:134106  orphan:2        0.00%   2182196B
volume:29       entries:142691  orphan:4        0.00%   6697815B
volume:41       entries:320197  orphan:2        0.00%   1416169B
volume:6        entries:454435  orphan:7        0.00%   7646521B
volume:8        entries:455980  orphan:10       0.00%   17340541B
volume:174      entries:113130  orphan:1        0.00%   373592B
volume:12       entries:439289  orphan:6        0.00%   5093745B
volume:19       entries:587281  orphan:3        0.00%   4205545B
volume:21       entries:582048  orphan:2        0.00%   3460775B
volume:13       entries:497765  orphan:24       0.00%   33330143B
volume:183      entries:327244  orphan:2        0.00%   4194333B
volume:34       entries:367142  orphan:33       0.01%   52605823B
volume:2        entries:466767  orphan:8        0.00%   9523889B
volume:10       entries:447580  orphan:19       0.00%   20058589B
volume:26       entries:134067  orphan:7        0.01%   13184032B
volume:22       entries:564770  orphan:6        0.00%   11518666B
volume:44       entries:320326  orphan:1        0.00%   2342469B
volume:23       entries:226212  orphan:4        0.00%   8244137B
volume:20       entries:589109  orphan:3        0.00%   3186914B
volume:15       entries:620767  orphan:7        0.00%   8951507B
volume:30       entries:133763  orphan:2        0.00%   4047186B
volume:36       entries:460390  orphan:83       0.02%   127218576B
volume:18       entries:604574  orphan:4        0.00%   4836475B
volume:27       entries:132598  orphan:8        0.01%   12605766B
volume:181      entries:337697  orphan:2        0.00%   8388666B
volume:33       entries:343184  orphan:1        0.00%   883660B
volume:24       entries:136207  orphan:3        0.00%   5935481B
volume:35       entries:360159  orphan:29       0.01%   49237044B
volume:42       entries:320821  orphan:3        0.00%   978574B
volume:40       entries:308500  orphan:33       0.01%   47597002B
volume:39       entries:403129  orphan:28       0.01%   45658789B
volume:4        entries:476477  orphan:7        0.00%   8935252B
volume:48       entries:46649091        orphan:8        0.00%   28766B
volume:37       entries:500886  orphan:83       0.02%   136111080B
volume:175      entries:347687  orphan:24       0.01%   20283307B
volume:17       entries:602162  orphan:2        0.00%   1978152B
volume:38       entries:501009  orphan:90       0.02%   141566157B
volume:31       entries:276014  orphan:21       0.01%   35448827B
volume:25       entries:133963  orphan:3        0.00%   5870478B
volume:16       entries:603781  orphan:7        0.00%   9325909B
volume:184      entries:328584  orphan:1        0.00%   4194333B
volume:9        entries:454736  orphan:7        0.00%   10191176B
volume:3        entries:478338  orphan:3        0.00%   4127425B

Total           entries:98329766        orphan:686      0.00%<PHONE_NUMBER>B

It would also be nice to know what files are broken, so I can try and see if they can be repaired.

Use the 2.56 version, and run this to see which file has missing chunks:
volume.fsck -findMissingChunksInFilerPath=/ -findMissingChunksInFiler -v

Ran the volume.fsck -findMissingChunksInFilerPath=/ -findMissingChunksInFiler -v, greped the log for 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d and it came out empty.
The file 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d.png is still giving me (Input/output error). The logs never show any errors from the directory that contains 599b49d0abe3b569748a15598744d1a648d368bec806bce9e63d10453f94087d0.

I've run volume.fsck against the directory where the broken file is and it retruned nothing. No error. This is not good. Will hop on slack later on.

The files are readable once again.


[Feature] Update TableOfContent molecule

The previous version was not working as expected, this is a rework of the feature.
To-do

[ ] Test feature with some advanced and real-world examples
[ ] Prepare changelog
[ ] Update doc

See #185 instead.


the SQL generated is different if DeclaringType != ReflectedType

I have a custom 'RelationalCommand' for the 'INSERT INTO' and 'DELETE' execute.
I detect a problem in the SQL generated.
Steps to reproduce
EFCoreInherits.zip
public interface IMyInterface
{
        int Column1 { get; set; }
}

[Table("Table1")]
public class Row : IMyInterface
{
   [Key] public int ID { get; set; }
   public int Column1 { get; set; }
}

[NotMapped]
public class RowModel : Row
{
   //...
}

var query = Table1DbSet.Select(r => new RowModel()
{
   ID = r.ID,
   Column1 = r.Column1
   //...
});

//Sample1:
//====================
var result1 = query.Where(r => r.Column1 == 123).ToList();
//SQL Execute: "SELECT [ID], [Column1] FROM [Table1] WHERE [Column1] = 123"

//dynamic 'Where' or 'Select' By the columnName
var param = Expression.Parameter(typeof(RowModel));
var body = Expression.Equal(
   Expression.Property(param, "Column1"),
   Expression.Constant(123));

var lambda = Expression.Lambda<Func<RowModel, bool>>(body, param);
var result2 = query.Where(lambda).ToList();
//SQL Execute: "SELECT [ID], [Column1] FROM [Table1]"
//but result1 == result2 !

//Sample2:
//====================
var result1 = query.Select(r => r.Column1).ToList();
//SQL Execute: "SELECT [Column1] FROM [Table1]"

//dynamic 'Where' or 'Select' By the columnName
var param = Expression.Parameter(typeof(RowModel));
var body = Expression.Property(param, "Column1");
var lambda = Expression.Lambda<Func<RowModel, int>>(body, param);
var result2 = query.Select(lambda).ToList();
//SQL Execute: "SELECT [ID], [Column1] FROM [Table1]"
//but result1 == result2 !

//Sample3:
//====================
public static IQueryable<T> MyWhere<T>(this IQueryable<T> query)
   where T : class, IMyInterface, new()
{
   return query.Where(r => r.Column1 == 123);
}

var result1 = query.Where(r => r.Column1 == 123).ToList();
//SQL Execute: "SELECT [ID], [Column1] FROM [Table1] WHERE [Column1] = 123"

var result2 = query.MyWhere().ToList();
//SQL Execute: "SELECT [ID], [Column1] FROM [Table1]"

//etc...
//====================
//Please review the zip package

//This code runs without problems
public static IQueryable<T> WhereOK<T>(this IQueryable<T> query, string propertyName, object value)
     where T : class, new()
{
     var property = typeof(T).GetProperty(propertyName);
     if (property.DeclaringType != property.ReflectedType)
          property = property.DeclaringType.GetProperty(property.Name);

     var param = Expression.Parameter(typeof(T));
     var body = Expression.Equal(
          Expression.Property(param, property),
          Expression.Constant(value));

     var lambda = Expression.Lambda<Func<T, bool>>(body, param);
     return query.Where(lambda);
}

Further technical details
EF Core version: 2.0.0-preview2-24803
Target framework: net462
Database Provider: SqlServer
dotnet --version: 1.0.2
I'm sorry for my English grammar.
Thanks.

This is working as expected (as a consequence of Re-Linq).
It happens due to re-ordering of Select & Where for optimized query. When you Select into RowModel objects but if your Where can be defined on the type before projection, you can move Where before projection. So the Where becomes on type Row instead of RowModel. Re-Linq does this optimization. It is optimization because results will be the same & you will have to create lesser RowModel objects in projection.
When you use method calls based on reflected types, you bring in explicit type instead of inferred one. So query cannot be optimized. Following are some query models generated.
var r11 = db.Table1.Select(r => new RowModel()
                                {
                                    ID = r.ID,
                                    IsDelete = r.IsDelete,
                                    Column1 = r.Column1,
                                    Column2 = 123
                                })
    .Where(r => r.Column1 == 123)
    .Select(r => r)
    .ToList();

//Query model:
from Row r in DbSet<Row>
where [r].Column1 == 123
select new RowModel{
  ID = [r].ID,
  IsDelete = [r].IsDelete,
  Column1 = [r].Column1,
  Column2 = 123
}

var r12 = db.Table1.Select(r => new RowModel()
                                {
                                    ID = r.ID,
                                    IsDelete = r.IsDelete,
                                    Column1 = r.Column1,
                                    Column2 = 123
                                })
    .My_Where_1()
    .ToList();

//Query model:
from Row r in DbSet<Row>
where new RowModel{
  ID = [r].ID,
  IsDelete = [r].IsDelete,
  Column1 = [r].Column1,
  Column2 = 123
}
.IsDelete
select new RowModel{
  ID = [r].ID,
  IsDelete = [r].IsDelete,
  Column1 = [r].Column1,
  Column2 = 123
}

When the predicate is defined on the type which is in model, we can translate it to server. But when there is unmapped type followed by property access, we don't have information about the nonmapped type to do any translation. Hence it is evaluated on client. Therefore the generated SQL does not contain Where clause.


[Bun] Module importing error

Hello, I am using Bun 1.0.13 and youtube-sr 4.3.9, importing with import { YouTube } from "youtube-sr"; gives the following error:
Could not find a declaration file for module 'youtube-sr'. '[REDACTED]/node_modules/youtube-sr/dist/mod.mjs' implicitly has an 'any' type.
There are types at '[REDACTED]/node_modules/youtube-sr/dist/mod.d.ts', but this result could not be resolved when respecting package.json "exports". The 'youtube-sr' library may need to update its package.json or typings.ts(7016)

What is the correct way to import the library using Bun?
Thanks in advance.

Hi, this seems to be caused by the exports field in package.json file, I will fix this soon.

Thanks, any ETA on the fix release? How can I import the library in the meantime?

@8549 hi this should be fixed now with v4.3.10


Remove Archive directory creation from Import

Now that the ASSET_REF concept has been proven stable, we should remove the old directory-based archiving from VcsArchiver.
This causes complications with dynamic Java startup services.
For example:
@RegisteredService(StartupService.class)
public class AutoTestWebSocketClient

was removed from package com.centurylink.mdw.testing.  However because it still lives in the Archive it continues to get compiled (and shows errors because it's dependencies no longer exists).
This also causes potential confusion as to where to look for old asset versions (Git commit vs directory).
Also, directory archiving consumes extra (wasted) time during import.  For the time being, we will retain compatibility for loading from the Archive if it exists.

The spring asset from deleted package still gets loaded on tomcat server start up as it is still present in Archive.


It is impossible to create endless slider

Hello!
I want to create endless slider. When I use a :loop directive it always returns me to the first slide, but I want to see the first slide as a next slide.
For example it works in the "slick" carousel, with a parameter "infinite: true".
Could you add it in an API?
Thank you.

Dupe of #96

@DanSorahan in the #96 issue a topic starter told about ":loop", but "imbolc" told about my topic. I'm not sure that it is a dupe.

@NBAH1990 I think @DanSorahan is correct and would consider it a duplicate of the feature request in #96. I'm going to close this in favor, but feel free to make a comment on #96 if you have any questions!


Explore entrypoint binary redacting secrets from logs

Stemmed from https://github.com/tektoncd/pipeline/issues/3365 though there have been other cases it's come up.
Today, if the user specifies a script: without shebang, we assume #!/bin/bash and set -euxo pipefail -- we consider this a reasonable default script preamble, but set -x especially can surprise some users that might be using secrets in their script, and don't expect those to be emitted to output logs. One solution (as described in #3365) is to set your own preamble  or to otherwise disable -x so commands aren't logged.
But we might be able to do better. The entrypoint binary we inject to run the user's command (including scripts), today passes the sub-command's stdout directly to its own stdout (same with stderr). It could consider doing something smarter in this case, and take a set of byte sequences to redact from stdout/stderr, which could be passed as secret references into the Pod.
The entrypoint binary could then place this filter around stdout and stderr to replace detected secrets with some descriptive  placeholder like [REDACTED], instead of passing through potentially sensitive valeus to logs.
Considerations:

Performance overhead passing all user logs through our filter
Limitations we should impose on filtering -- the target is presumably short-ish byte sequences (passwords and keys), not gigabytes of sensitive text
Use cases where a user might  want some secret value to be emitted through stdout/stderr, or would otherwise be surprised to find it being redacted
User configuration to disable filtering, including rollout strategy to make it opt-in (and eventually opt-out?) -- should it be a per-run configuration, or per-installation feature flag?
e2e tests we could write to check that filtering works

/kind feature

/remove-lifecycle stale
This still needs investigation

/remove-lifecycle stale
This still needs investigation

@ImJasonH I'm not sure where this discussion would belong, but would be nice if Tekton also considers "secret parameters".
e.g. so that if I have a task whose output is a token (secret) I can pass to the next step seamlessly without having to create a k8s secret in order to have it [REDACTED] later.

@renannprado I think "secret params" (or results) would be a separate issue, though it might end up sharing the same redaction code. Results today are very much not secret, and shouldn't be treated as such. Anybody who can view a TaskRun's underlying Pod status can see results data, whether or not they have access to the TaskRun, etc. Redacting from logs could be useful, but we'd need to close that hole too before we recommend people put sensitive data in results.

@ImJasonH do you have interesting in developing this feature? it doesn't seem very complicated to develop (I guess it depends on how hard is it to get the metadata to the pipeline inside of this method hehe), maybe I could develop it if some guidance/mentoring is provided. Of course, after developing it, I would love to contribute to a feature like the "secret parameters" too, but that's another story :)

A small suggestion but it might go a long way in enterprise adoption. Rather than show a static "redacted" message, why not show the key of the secret itself. That way, the users have a way of identifying which secret it is.
Secrets can differ across environments. Typically you may have different secrets driven by DBs for specific environment such as Dev, staging prod.
Would love to hear more on this!

IMHO redacting secrets is important and has to be implemented.
/reopen

/remove-lifecycle rotten
/lifecycle frozen
/reopen


Update cardinality for Discovery Interface

The Discovery Interface allows for multiple Specific Asset Ids, thus the specification for the operation should reflect that.
I believe this was a typo in the specification as it is reflected in the swagger api https://app.swaggerhub.com/apis/Plattform_i40/DiscoveryServiceSpecification/V3.0_SSP-001#/Asset Administration Shell Basic Discovery API/PostAllAssetLinksById

I think you're targetting the wrong merge target - for version 3.1 everything looks fine to me...
https://app.swaggerhub.com/apis/Plattform_i40/DiscoveryServiceSpecification/V3.1.0_SSP-001#/Asset Administration Shell Basic Discovery API/SearchAllAssetAdministrationShellIdsByAssetLink

@alexgordtop
Sorry for the confusion, I meant that in the swagger api everything is correct in my opinion.
The error lies in the change I made, the cardinality in the Documentation is not correct.
See the screenshot from the 3.0 Documentation

This I changed from 1 to 1..* as it is specified in the corresponding swagger documentation
https://app.swaggerhub.com/apis/Plattform_i40/DiscoveryServiceSpecification/V3.1.0_SSP-001#/Asset Administration Shell Basic Discovery API/PostAllAssetLinksById

Thanks for pointing this out!


localisation in mini-cart count and total

Some customers (often in b2b) like to be more descriptive in the mini-cart, and add some text to the count or total. A small non-breaking change in Spartacus that will help customers to avoid customising the mini-cart.

QA

customise the text of the miniCart.count text in the common.ts file.
ensure that the text appears in the minicart


Full config files for deposition 10307 (Datasets 10436, 10437, 10438)

Description
This PR adds the full config files for Datasets 10436, 10437, 10438 (preprint)

Just resolved some merge conflicts for the validation exclusion list, I think the dataset validation workflow is bugged, will try to fix with the folder restructure changes.


Docker

To do:

[x] lock all packages in requirements.txt to a version
[x] finish running through all make scripts to see if any dependencies are missing

This is ready for review. Here are instructions for running the container.
As I was setting this up, I realized that the photo paths have moved, so you may want to skip congress_photos in the sources/Makefile until we are able to update these paths.
If you've never run the source scripts, you'll need to run make from the following places:

/sources (but comment out congress_photos from the sources makefile temporarily)
/data
/elections-api-private
root of repo/

I have some suggestions for documentation  for how to run docker (I am on <IP_ADDRESS>, and had to edit the paths that Docker has access to), but this works 🥳 yayayay!

Thanks for reviewing! I updated the make election_races command so that it should work inside or outside docker, provided you have the DATABASE_URL environmental variable set.
I also updated the docks with some more info about docker preferences and a few other things.
I also noticed that /v2/geoip won't automatically detect your IP address. We need to set up x-forwarded-for, which is it a little bit out of my wheelhouse here (maybe setting up nginx would help, but it would take me a while to figure it out). There's a workaround where you can still test the endpoint locally by adding your IP as a query param (/v2/geoip?ip=xx.xxx.xxx.xx), so I think we can leave things as is for now and address later.

cool, i ran make election_races inside/outside the container and it worked
for what it's worth the geoip endpoint wasn't working when I ran the server locally (without docker) either. you might have seen this already but on the aws machines it probably has to do with https://github.com/aclu-national/elections-api/blob/a157c088118c76396211561ef781e55d04934750/server/nginx.conf


Window too small on HiDPI screens

Describe the bug
A clear and concise description of what the bug is.
System:

OS: [e.g. Ubuntu 23.10 with Gnome] Fedora 40 with Gnome 46 / Wayland / 4K Monitor
Browsers Version [e.g. 0.22.1] ⋮ -> About

Hey, sorry for very late reply, but if there is a screenshot available with full desktop and browsers visible, that could help a b it.

@liias Here is a screenshot. My desktop has 175% scale. Environment: GNOME 46, Arch Linux (also Fedora). Wayland.

Hmm, I think the font really is simply a bit too small then, as it looks pretty correct from the screenshot actually. I'll play around with this one day.


Updated Accessibility review features and dead link in Glossary

https://github.com/open-telemetry/opentelemetry.io/issues/497
Kindly review, tried resolving the above issue

Thank you. I have no idea what I'm doing trying to launch a research business. Can you help me?

https://github.com/open-telemetry/opentelemetry.io/issues/497
Kindly review, tried resolving the above issue

Help me please


Implement const for all BigInteger and Field methods via const generics

This should be investigated.

Note that this still wouldn't enable const for many Field related things, because FpParameters can't be used in a const context


Update BPMN model for Camunda Modeler

https://github.com/camunda-cloud/camunda-cloud-get-started/blob/master/process/send-email.bpmn
BPMN model needs to be updated for Camunda Modeler -> https://github.com/camunda-cloud/camunda-cloud-documentation/issues/366

fixed by #27


OIDC on AWS documentation improvement

Code of Conduct

[X] I have read and agree to the GitHub Docs project's Code of Conduct

What article on docs.github.com is affected?
https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/configuring-openid-connect-in-amazon-web-services
What part(s) of the article would you like to see updated?
IAM policy currently only shows a snippet and should have a full almost-working example
Additional information
No response

I've submitted a PR, the build is failing because it is modifying restricted files.
However this issue requires those files to be modified... Happy for suggestions

Relates to #15324

@baolsen Thanks for opening an issue and PR!

plz


import osmnx error: ImportError: cannot import name 'GEOSException' from 'shapely.errors'

Read these instructions carefully. Use the template below and fill out every section. Your issue will be automatically closed if you don't provide all of the information requested in the template, because we need this information to assist you. Before you proceed, review the contributing guidelines in the CONTRIBUTING.md file.
Please don't use the issue tracker to ask "how-to" or usage questions. If asked here, they will be closed automatically. Instead, ask "how-to" and usage questions on StackOverflow. If you installed OSMnx via conda and are experiencing installation problems, please open an issue at its feedstock instead.
Bug reports are for reporting a bug you have found in OSMnx's codebase. First search the open/closed issues and StackOverflow to see if the problem has already been noted. If it hasn't, fill in the bug reporting template below.
Do not delete the following template. Fill it out completely.

[ ] I have read the OSMnx contributing guidelines
[ ] I have read the OSMnx documentation and usage examples
[ ] I have searched the open/closed issues and StackOverflow for problems similar to mine

Problem description

What did you do?
What did you expect to happen?
And what actually happened instead?

Environment information

What operating system are you using?
What Python version are you using?
What OSMnx version are you using?
Provide a complete list of your environment's packages and their versions (for example, run conda list or pip list then paste the output between the two "details" tags below)

# paste the output of your Python packages/versions here between these two "details" tags

Provide a complete minimal reproducible example
Your example code snippet here must be minimal so it doesn't contain extraneous code or data unrelated to your specific problem and it must be complete so we can independently run it from top to bottom by copying/pasting it into a Python interpreter. That means all imports and all variables must be defined. If you're unsure how to create a good reproducible example, read this guide. Do not post a screenshot of your code or error message: provide it as text.
# your code goes here

import osmnx as ox

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In [1], line 1
----> 1 import osmnx as ox
...

File ~\miniconda3\envs\django\lib\site-packages\osmnx\geometries.py:17
     15 import numpy as np
     16 import pandas as pd
---> 17 from shapely.errors import GEOSException
     18 from shapely.errors import TopologicalError
     19 from shapely.geometry import LineString

ImportError: cannot import name 'GEOSException' from 'shapely.errors' (C:\Users\YM\miniconda3\envs\django\lib\site-packages\shapely\errors.py)

===================================================================
Version information:
(django) C:\Users\YM>conda list osmnx
packages in environment at C:\Users\YM\miniconda3\envs\django:

Name                    Version                   Build  Channel
osmnx                     1.3.1                    pypi_0    pypi
(django) C:\Users\YM>conda list shapely
packages in environment at C:\Users\YM\miniconda3\envs\django:

Name                    Version                   Build  Channel
shapely                   2.0.1                    pypi_0    pypi
===================================================================
Found:
shaply/error.py:
There is not a "GEOSException" class exist.

Please fill out the complete new issue template. We cannot troubleshoot without that information. Second, how did you install OSMnx?

Unable to troubleshoot without all the requested details. Can re-open if the details are fully provided in the future.


X509 app srl file path detection detects first "." rather than last causing problems with some CA file paths

The x509 app when determining the filename for the SRL file makes the assumption that the period "." character is only used for the file extension. If the CA file is specified as a path that contains a period or the CA file name itself contains a period other than as a file extension separator then this causes unexpected end user behaviour.
strrchr is expected to be used rather than strchr on:
https://github.com/openssl/openssl/blob/2d1b5717b9fd3ed54b663334e18c006d34776328/apps/x509.c#L919
Examples CA files/paths that cause issues:
/home/ca.root/certs/ca.crt  (looks for an srl of /home/ca.srl)
ca.root.crt (looks for an srl of ca.srl)
Expected behaviour would be that the last period is used to remove the extension from the CA certificate filename and substitute it with .srl

#6580

This is not a just-in-1.1.1 issue, so removing that milestone.

This issue has been fixed by #6566 for all CAFiles which have a file extension. The only case which still breaks is the rather exotic case where the CAFile does not have an extension but one of the path components contains a dot. So #6566 is a good-enough fix to close this issue, just like #6489 has already been closed.
@beldmit, closing this issue is not meant to discourage you from pursuing your improvement #6580 :-).


Support rendering to markdown

I would like to be able to:

Parse markdown
Rewrite parts of the document (just links in my case)
Render back to markdown

Maybe you should try https://github.com/Byron/pulldown-cmark-to-cmark. I think it does what you want.

This looks like exactly what I wanted, thanks!


Shield appears when placing bridged blocks

When you're bridging with the mod's mechanics the shield pops up repeatedly - supposedly off-hand actions aren't being cancelled the same way vanilla placing does.

Fixed :) - will drop in v2.3.0 soonish


I cant apply my code modification directly

I fixed my code and reload, but my application is not accepted directly.
when i change my code, i have to rebuild.
it is very hard work and low performance.
please help me.

Are you changing native (ObjC/Java) code or JavaScript? If it's native, then (to the best of my knowledge) there's nothing you can do. If you're changing JavaScript, though, it should be reloadable - in the simulator press Cmd+R or R twice and it should update the javascript.

Feel free to re-open this if you have more details.
If you're having troubles reloading the JS in your app, make sure the simulator/device connect to the RN packager, and restart the packager if you're having troubles.


Fix sql format documentation

fixes #1487

Please make sure that all the checks pass. Please add here any additional information regarding this pull request. It's highly recommended that you link this PR to an issue (please create one if it doesn't exist for this PR)

@roll Thank you!. I have made the changes.

Thanks!


[improve][broker] Add log to track issue when handleGetTopicsOfNamespace

Motivation

Documentation

[ ] doc
[ ] doc-required
[x] doc-not-needed
[ ] doc-complete

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 74.34%. Comparing base (bbc6224) to head (a44e14c).
Report is 663 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #23434      +/-   ##
============================================
+ Coverage     73.57%   74.34%   +0.76%
- Complexity    32624    34456    +1832
============================================
  Files          1877     1953      +76
  Lines        139502   147177    +7675
  Branches      15299    16204     +905
============================================
+ Hits         102638   109414    +6776
- Misses        28908    29328     +420
- Partials       7956     8435     +479

Flag
Coverage Δ

inttests
27.71% <0.00%> (+3.13%)
:arrow_up:

systests
24.37% <100.00%> (+0.04%)
:arrow_up:

unittests
73.69% <100.00%> (+0.85%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines
Coverage Δ

...va/org/apache/pulsar/broker/service/ServerCnx.java
72.53% <100.00%> (+0.39%)
:arrow_up:

... and 636 files with indirect coverage changes


Help me understand how to persist log state

Hi!
I am building an app with multiple client and a single server. It’s all working good mostly, but there is an issue that I cant figure out.
clients initialise their client as:
client = new Client({
  server: wsHost,
  subprotocol,
  userId: localStorage.getItem('user-id') ?? 'anonymous',
  store: new IndexedStore()
});

server initialises client as:
const server = new Server({
  subprotocol,
  port: argv.port,
  host: argv.host,
  supports: subprotocol,
  store: jsonStore('./log.dev.json'),
  logger: {
    type: process.env.NODE_ENV === 'production' ? 'json' : 'human'
  }
});

jsonStore  here is a wrapper over your MemoryCore, but with persistence.
As I understand, client and server must maintain their own logs and sync them, however that doesn't seem to be the case.
Every time a client connects to the server, it receives the data from scratch, even if it did get some data before. data is transferred as “changed” actions.
Server also doesn't persist any log as a result, the only fields that is stored to the disk is lastReceived
{
  "entries": [],
  "added": [],
  "indexes": {},
  "lastReceived": 8478,
  "lastAdded": 0,
  "lastSent": 0
}%

Am I missing/misunderstanding something? why logs are not synced?
here is the full source: https://github.com/ngalaiko/eligo

@logux/server was not created to store state in the log, since I think it is not the best format for the server (where state could be enormous and could not fit to in one server).
The standard way is to request it from some well-known persistence storage in server.channel() or addSyncMap() callbacks.
If you have good rational reasons to use log here, what you need to do:

You need to set meta.reasons (and find good strategies to remove reasons from outdated log entries) on the server to keep actions in the log.
Add callback to server.channel() to load actions from the log during subscription.

@ai
Thank you the prompt response.
I see. That's what I am doing now, mostly following your example in http://github.com/logux/examples when the server uses addSyncMapFilter and addSyncMap callbacks to store and return data from the server. example
The issue that I'm having is that every time a client reconnects to the server, it receives all the state from the sever like it never had any. I thought it happened because I was using MemoryStore on the client, but switching to the IndexedDB didn't help. here is how I initialise frontend client and here is how I subscribe to a list with createFilter
I was under an impression that a client should prioritise state from the IndexedDB store, and later update it according to a new events coming from the server if there are any. Is that right? Or do I need to implement that manually?

Don’t forget offline option in syncMapTemplate for offline mode. https://logux.io/web-api/#globals-syncmaptemplate

Yes, I didn’t add offline support to SyncMap yet 😥
The protocol has since key in logux/subscribe action, which is used to request updates.
But we are not using it mostly because:
a. I have no time to implement it
b. The changes between since and the current time for offline mode will be big and this optimization will not be very helpful.

If you have a reason to use it right now, I can help you adding this feature to SyncMap.


Add fixpoint function

From the docs:

Finds the fixed point of ``x`` under ``f``, i.e. the ``y`` such that ``y = f^n(x) = f^(n+1)(x)``.  NB: it will not terminate if no fixed point exists.```

looks like CI is failing on 2.7 with: tests/test_interface.py:67:20: W504 line break after binary operator.  Doesn't seem obviously related to this PR but would be grateful for advice?

funcy is not about math.

Neither were any of the use cases in which I've needed it.  The function is an ancillary function to iterate that covers the common pattern: "repeatedly apply the function until you get the same thing out as you put in".  Many functions in the library, such as flatten, are actually examples of this pattern.  The only necessary mathematical concepts are function application and equality.

fixpoint is a very general function that captures the notion of "applying a function repeatedly until you can't meaningfully apply it any more".  It may be most helpful to think of it in terms of iterate(f, x), which gives you the infinite sequence x, f(x), f(f(x)), f(f(f(x)))....  Often, f and x are such that this sequence will be of the form x_0, x_1, x_2, ..., x_n, x_n, x_n, ..., with an infinitely repeating terminal value x_n.
fixpoint gives you x_n.
To take a practical example, suppose you have a comment thread represented as a dictionary d where the keys are comment ids and the values are the ids of the respective parent comments.  Each comment can have multiple children, and some comments are top-level comments with no parent.  Suppose that, given an arbitrary comment, we want to find its top-level ancestor.  Then, given the comment_id of an arbitrary comment, we can find its top-level ancestor by writing:
top_level_ancestor = fixpoint(lambda cid:d.get(cid, cid), comment_id)
That is, we trace the parents through the dictionary until we can't go any further, whereupon we return the last comment_id we traversed.
Or suppose that we were trying to define lflatten.  Let's say that we could only manage to flatten a nested list by one level:
def lflatten1(xs): ys = [] for x in xs: if type(x) is list: for elem in x: ys.append(elem) else: ys.append(x) return ys
we could still define a full-fledged lflatten in terms of fixpoint.  In particular, we have:
def lflatten(xs): return fixpoint(lflatten1, xs)
That is, you can flatten an arbitrarily nested list by repeatedly flattening it one level at a time until you can't flatten it any further.  Many recursive functions are more natural to write in the fixpoint idiom, especially when they're somehow related to the notion of transitive closure.
The previous two examples show concrete use cases, but I also want to suggest that fixpoint is a quite generically powerful higher order function.  To see this, let's define fold in terms of fixpoint.  We can write a left fold (right fold is necessarily similar) as follows:
def foldl(acc, f, xs): def fp(_acc_xs): _acc, _xs = _acc_xs if _xs == []: return (_acc, _xs) else: return (f(_acc, first(_xs)), rest(_xs)) return first(fixpoint(fp, (acc, xs)))
The only trick here is to lift the function f into a function fp that accepts the accumulator and input list as a tuple, and then extract the accumulator at the end.

More natural solution for first:
top_level_ancestor = last(takewhile(bool, iterate(d.get, comment_id)))

Way more efficient lflatten() is already implemented.
There is no need to reinvent reduce(). And your implementation doesn't need fixpoint():
def foldl(acc, f, xs):
    if not xs:
        return acc
     else:
        return foldl(f(acc, first(xs)), f, rest(xs))
        # The last line won't work for iterator xs BTW

There is no goal of implementing all FP in funcy, there is a goal to borrow FP ideas while practical and pythonic.

Ok, thanks for the feedback.


./scripts/act-bootstrap.sh: function: not found

Hi
When I run following command, I got the "function: not found" error message.
/opt/act-bootstrap# ./scripts/act-bootstrap.sh 1 http://localhost:8888
./scripts/act-bootstrap.sh: 5: ./scripts/act-bootstrap.sh: function: not found
Then I changed ./scripts/act-bootstrap.sh as following:
Line:1
(Before change) #!/bin/sh
(After change)  #!/bin/bash
And also I found a typo on ./scripts/act-bootstrap.sh as following:
Line:28
(Before change) mkdir ${LOGDIDR}
(After change)  mkdir ${LOGDIR}
Kind regards,
Yuki

Please update your repository again and rerun, as I've merged PR#15 linked above.

Thanks a lot.  :)


Title bar: show git branch information

Related to https://github.com/Microsoft/vscode/issues/1723, make it possible to show the current branch name in the window title.

I know TFS isn't a first-class citizen in the VS Code world, but it would be nice to have similar functionality for TFS as well

I think this is similar to being able to show some SCM status in the explorer: We need a generic enough ISCMService that we can use everywhere to make these calls.
/cc @joaomoreno

Also it would be nice to see current branch name in title of "Source Control" panel, before "Commit" button.
Sometimes when work with few branches at the same time can make changes in wrong branch. This information has to be before eyes on commit. Looks at bottom of window or any other place not always work.

Is there any update on this item? Showing the current branch name in the title of source control panel will be very helpful. In Git, people typically work with multiple branches. @bpasero

@Deathhush Not great, but solution - new setting "scm.alwaysShowProviders": true

Going for "scm.alwaysShowProviders": true instead, in this way you always have that information at a glance as well as a few useful context actions. 👍

I am a free lancer, and sometimes I do multiple projects to the same company (in different efforts) and need to be able to properly track the amount of time I spent in each project.
RescueTime/ActivityWatch/ProcrastriTracker among others track my time usage true capturing my active window name regularly.
Would be great if we could have some free form terminal command to be run regularly (once a few minutes) and updating a variable to be included in the customized tittle bar. I recognize that I have a very edge use case, but would be great if we could embrace it.
Thoughtfully


Help to build with different static file paths

Command (mark with an x)
- [ ] new
- [x] build

Versions
Node v 8.11.3 , Linux machine
Repro steps
start an application, build with
ng build --base-href=/whatever/ --deploy-url=/whatever/  --prod --build-optimizer
Host on nginx with
location /whatever {
root /usr/share/nginx/html;
index index.html index.htm;
try_files $uri $uri/ /index.html =404;
}
The log given by the failure
runtime.c88d7988090c0cf17003.js:1 Uncaught SyntaxError: Unexpected token <
polyfills.c6871e56cb80756a5498.js:1 Uncaught SyntaxError: Unexpected token <
main.f6db57f5db3471ef76b6.js:1 Uncaught SyntaxError: Unexpected token <
Desired functionality
I want to be able to use ng build and have different paths for different versions of the application such as:

localhost:xxxx/master/
localhost:xxxx/testing

I realize this is a help request not an issue per se, but I assume this is the best place to write to anyway.

Hello, we reviewed this issue and determined that it doesn't fall into the bug report or feature request category. This issue tracker is not suitable for support requests, please repost your issue on StackOverflow using tag angular-cli.
If you are wondering why we don't resolve support issues via the issue tracker, please check out this explanation.


sourcemap support does not work out of the box

Hello and thanks for the helpful tool.
According to #286, it looks like unbuild supports generation of source maps.
However, this does not seem to happen automatically, even if "declarationMap": true is set in the project's tsconfig.json file.
Shouldn't unbuild automatically read the TypeScript config and generate a source map if this is set to true?

Same problem here. Thanks,

Hi, dear @Zamiell. You should set sourcemap: true in build.config to enable sourcemap support. unbuild does not infer from tsconfig.json


[RDBMS] Remove duplicate (y/n) in first prompt from prepare_public_network as prompt_y_n already adds that

Related command

az mysql flexible-server create
Description

To avoid the redundant (y/n) in the prompt in which user is asked to confirm adding client IP address to the firewall, like in:
Do you want to enable access to client <IP_ADDRESS> (y/n) (y/n)
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[X] The PR title and description has followed the guideline in Submitting Pull Requests.

[X] I adhere to the Command Guidelines.

[X] I adhere to the Error Handling Guidelines.

RDBMS

duplicated with https://github.com/Azure/azure-cli/pull/28011


Error after saying loaded one event

It says loaded one event then giving error missing permission here is a attachment for more clarification

your bot is missing access, give your bot correct access

Ohh thanks its worked perfectly fine i invited the bot with proper permission but while i was setting up it got kicked cause of not verified so i got error thanks for help man


View Overriding

The docs for Theme View Overriding say this:

"The theme engine also has view overriding. A good example of this is the default metro theme that comes with the forum, if you open up the Metro theme folder in the views sub folder you will see it has its own '_Layout.cshtml' this overrides the root _Layout.cshtml in the root views folder.
You can do this for any view you want to change, so if you wanted to change the default view for the Private Messages. Just copy and paste the view into your Theme folder, making sure its mimicking the structure of where the original is placed i.e."

Do these instructions still apply? I can't seem to find any Metro theme folder within the Views folder. Using _Layout.cshtml as an example, does the pattern for overriding look like:
Views --> Metro --> Views --> Shared --> _Layout.cshtml
Or is the pattern:
Themes --> Metro --> Views --> Shared --> _Layout.cshtml
Or is it some other pattern I am missing?
Thanks.

Always from the theme folder, as it states in the description.

Just copy and paste the view into your Theme folder, making sure its mimicking the structure of where the original is placed


Adding tape and some sample unit tests for models

I've added Tape. It's the unit testing framework used by the main FreeCodeCamp site, so I figured that would be a good choice. It's pretty straightforward to use, and I've enjoyed it so far!
Included are two samples of testing the models to make sure the have the right fields. If you think this would be useful, I can continue on testing all the other models as well, and we can expand the unit tests to other parts of the codebase after.
Here are the design decisions I've made that I wanted to run by you both to get your feedback:

I chose the pattern of adding a __tests__ folder to each directory, so that tests live near the code they are testing. It's a common pattern I've seen, but I'm open to switching it to something else (like a dedicated tests folder) if desired.
I've also added the npm run test command that will run all the test files (which need to be named _something_.test.js in the __tests__ folder).
Tests won't run if the linter doesn't pass, so we'll have to make sure we fix the outstanding linter issues and keep those clean. Once we have TravisCI set up, it will be really easy to catch those issues on PRs.

Let me know if you'd like to take a different approach with any of the above!

It seems like a very good choice! I like the idea of keeping tests in the directory of the code their testing. That would make the most sense to keep it grouped.
I do have a question though. I was looking through the docs for Tape and shouldn't we be using the babel supported version of it since we are using ES6 features?
Also, I talked to @CodeNonProfit and he is going to talk to the guy that is in charge of maintaining all the repos of FCC and get TravisCI turned on for us.

Good point on babel. I think since the tests are all on the Node side they work fine. But it would be good to set it up so the client side tests get compiled correctly when we have them. I'll take a look at it tomorrow and update the PR.

So looking into it, I don't think we need the babel flag at this point. All the tests are being run in the Node environment, so the ES6 features in the test files will just work.
I tried running some tests in the client folder and it worked just fine, so my initial assumption was off (that's what happens when I try diagnosing something from bed haha)
I'm not 100 percent sure on the use case for the babel loader (perhaps for hot loading or for projects just using webpack and not Node, but we don't need that change at this point.
All this means this PR should be ready to go. If we have issues with the tests in the future we can fix it then, but for now it appears that they're running just fine without the flag.

Sounds good, we are supposed to be getting another camper to help us with writing tests soon, so I'm glad we got this set up.


Error with settings

Contact Details (optional)
No response
Description. What happened?
When trying to pass values using settings i got an error.
Steps to reproduce
  settings = {
    nodeSelector = {
      OnDemand = "true"
    }
  }

Expected behavior
No response
Actual behavior
│ Error: error getting values for a diff: ---> error unmarshaling JSON: while decoding JSON: json: cannot unmarshal string into Go value of type map[string]interface {} "{\"nodeSelector\":{\"OnDemand\":\"true\"}}"
│
│
│   with helm_release.kubernetes_efs_csi_driver[0],
│   on helm.tf line 1, in resource "helm_release" "kubernetes_efs_csi_driver":
│    1: resource "helm_release" "kubernetes_efs_csi_driver" {
│
╵
Releasing state lock. This may take a few moments...

Occurrence
Frequently
Relevant log output
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

I am also struggling to set the nodeSelector in the helm deployment.
I'd be happy to add to the documentation an example of how to set values through the settings object as it is a bit vague at the moment but I'm fairly convinced that it cannot do what I need so I'm following this bug .
Issue could lead me to abandoning this module and rolling my own as this functionality is essential for my use case.


chore: safe delete

Codecov Report
Attention: 11 lines in your changes are missing coverage. Please review.

Comparison is base (7fcf04b) 78.27% compared to head (474a8e2) 78.16%.

Files
Patch %
Lines

util/fibers/listener_interface.cc
67.64%
11 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #174      +/-   ##
==========================================
- Coverage   78.27%   78.16%   -0.12%
==========================================
  Files          98       98
  Lines        7265     7281      +16
==========================================
+ Hits         5687     5691       +4
- Misses       1578     1590      +12

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Add the regular stdlib, picasso and sqldelight

Adding a few more libs to the dependencies

Hello, new development is happening on the develop branch (this PR points to master). The dependencies plugin is getting renamed to refreshVersions (and future old refreshVersions will be named refreshVersions-core). That means I cannot merge this PR.
Do you want to make a new one in the new directory (plugins/refreshVersions) or shall I do it myself as part of #138?

Go for it, looks like there's already a checkbox in #138 for most of these.

They are now all available on the develop branch, I marked you as co-author.

FYI, I replaced Kotlin.stdlib.base by Kotlin.stdlib in dev version 0.9.5-dev-011 (just published on bintray).


Wrong formatting for options in docs for pp commands

Noticed that few pp commands have option descriptions which are not well formatted.
Example: https://pnp.github.io/cli-microsoft365/cmd/pp/dataverse/dataverse-table-list
Every description should start on a new line.
Affected commands

pp dataverse table list
pp environment list

Is this the kind of fix you're looking for those files @milanholemans ? https://github.com/Conor0Callaghan/cli-microsoft365/commit/0f9024740e111985d2722dac0bd768aab17eaaaf

Yes that's it! 😃 Willing to take this PR?

Sure no worries @milanholemans  👍

Thank you! 👏


Container Scanning

Discuss with Nick Corcoran about container scanning.
This will scan the OS level code that we have imported.

Discuss with Nick Corcoran about container scanning

Blocked until I talk to Nick about this

@wenzowski  container scanning results = Redhat ACS right?

3 things were decided from meeting with Nick:

Dev team should monitor the ACS dashboard
Action:  Mars to facilitate getting access for all developers on our team
Scrum team responsible for managing the vulnerabilities and violations
Action: Mars to set aside a portion of the sprint devoted to addressing the highest priority vulnerabilities and violations.
Action:  Team to agree on how we are going to bring these into the sprint


Remove unnecessary memset after PR #2583

Remove unnecessary memset after PR #2583 avoids accessing the uninitialized
data after the session_id_length now.
This seems to be a previous attempt to fix the uninitialized session_id.

Oh! My bad, I should have been paying more attention. I guess PR #2583 only actually affected 1.0.2 then since 947f3156ecedbc62e21da3569fc291166b3bc086 didn't make it there. Though I think fixing it in ssl_session_hash is probably a little tidier.

Hey, is this also a "code cleanup"  :)

yes it is.

only for master; 1.1.0 is too different.  thanks.


How to specify arbitrary custom properties?

For boolean (checkbox) fields, I need to add, instead of "title", a property called "inlinetitle" as a hint for the frontend renderer, in this case jsonform.
How can I specify these sorts of custom properties?

Please use mailing lists for question. Issue tracker is for filing issues, or RFEs.