fix competitions leaderboard download for stream contents

kaggle competitions leaderboard favorita-grocery-sales-forecasting -d returns stream data and it raises a key error on size = int(response.headers['Content-Length']) because server doesn't return  'Content-Length' in headers.

@pizzaz93 @jplotts, please review this pull request which fixes the bug. We have a bug in kaggle cli in a stable version that is unable to download leaderboard data.

@marscod @sanjaydatasciencedojo, here is my work-around for the recent competition, chaii - Hindi and Tamil Question Answering.

go to the competition leaderboard
right-click on the "Raw-Data" button
copy the link address
use curl, wget, requests etc. to download programmatically

!wget https://www.kaggle.com/c/30060/publicleaderboarddata.zip
!unzip publicleaderboarddata.zip

@nbroad1881 thank you for sharing that solution. But we will also need a use-case for limited participation use case.

I added the Content-Length header to the response so it should work natively now without updating the 'kaggle' tool.


Delete nms and tracker

This will delete some of post processing steps since they are irrelevant duo to adding high accuracy pedestrian detectors.

What was the harm? :D
I think keeping them is beneficial as some one may needed to use simpler/weaker detectors on less powerful platforms.
Instead, we can add a configuration flag for enable/disable it.
What do you think? @mhejrati

@alpha-carinae29 I've implemented a new tracker and remove the centroid tracker class.


rust-geom API changes

Shouldn't be merged until https://github.com/servo/rust-geom/pull/81 has merged

There are a few more changes that need to be done in platform-specific code, by I'll take care of them :)
I'll PR your PR and merge this when the changes land :P

https://github.com/servo/rust-layers/pull/178 and https://github.com/servo/rust-geom/pull/81 have been merged

There are a few more changes that need to be done in platform-specific code, by I'll take care of them :)

I think I got all of them in my latest force push

Yep, looks good :)
Thanks!


Thoughts on allowing callback for destination?

Just started integrating this library in a project and it's really fantastic. One thing I've run into is a need to create an unknown amount of fields that include an iterator based on the count of items in source data.
So say one source field has a count of 10 arrays, I'd want to flatten them into 10 indexed field names, but definitely a dynamic amount based on the source data, e.g.
'destination_0_field' => '';
'destination_1_field' => '';
'destination_2_field' => '';
etc...

While I could probably create a custom transformer that implements the proper interface, was curious on your thoughts on maybe solving it directly in the library as I'm sure others will have this need in the future.
Thanks!

Hi @defunctl Thank you for your feedback. In my experience.
I never needed to do it that way and this library was not built with that feature in mind. Conceptually, the target field is always static. There is also no built-in support for dynamic targets. Even with a custom transformer, it is not possible because the transformer only handles the source rules and not the target. Perhaps this library is not the right tool for this particular purpose.

Hey @odan,
Totally understandable, I'm normalizing the data after the fact now after initial mapping. I appreciate the quick response either way.


Add kait20.txt

The college official website URL
http://kait20.mskobr.ru/
a URL of a page on the official website where a long-term (>1 year) IT related course is offered by the college
http://kait20.mskobr.ru/info_edu/education/
a URL of a page or some other proof (.pdf or a screenshot are OK) showing that the university recognizes the domain which you are submitting as an official email domain for the teachers.
http://kait20.mskobr.ru/prof_edu/1m/obwie_svedeniya/pedagogicheskij_kollektiv/prepodavateli/krichfalushi_vladimir_ivanovich/
http://kait20.mskobr.ru/prof_edu/1m/obwie_svedeniya/pedagogicheskij_kollektiv/prepodavateli/sokolovskaya_natal_ya_ivanovna/
http://kait20.mskobr.ru/prof_edu/1m/obwie_svedeniya/pedagogicheskij_kollektiv/prepodavateli/miroshnichenko_georgij_igorevich/

@mobikat20 Pull request merged. Thank you!


feeds: W3C feed validator report

I can't create a new issue in your fork of feeds, so I report problems here.
According to the report from W3C feed validator https://validator.w3.org/feed/#validate_by_input of my feed output at /rss/,

Line 1: there should be a line break after <?xml version="1.0" encoding="UTF-8"?>

The validator says guid must be a full URL, unless isPermaLink attribute, so all <guid> should become <guid isPermaLink="false">

It says pubDate must be an RFC-822 date-time. Replacing UTC with GMT in Mon, 27 Jul 2015 15:49:30 UTC fixes the issue. See https://validator.w3.org/feed/docs/error/InvalidRFC2822Date.html

Don't output something like <author>Tom Kwok</author>. Ghost doesn't do this. The validator says Tom Kwok is an invalid email address. https://validator.w3.org/feed/docs/error/InvalidContact.html. Follow Ghost's engine. Output something like <dc:creator><![CDATA[John O'Nolan]]></dc:creator>

<media:content medium="image" url="http://<IP_ADDRESS>:9084/images/2015/06/test.png"><title>blah</title></media:content>: remove the title tag

Fixing all of the above issues will make the feed validate.
It also give the following recommendations: (if we are not following these, the feed still validates)

See https://validator.w3.org/feed/docs/warning/MissingAtomSelfLink.html
See https://validator.w3.org/feed/docs/warning/ContainsRelRef.html

I've discovered one more problem:

Line 6: <pubDate>Mon, 27 Jul 2015 15:49:30 HKT</pubDate>
thepubDate tag should be replaced by a lastBuildDate tag,

I'm on it. Thanks for validating it :)

Line 1: there should be a line break after <?xml version="1.0" encoding="UTF-8"?>

Interesting. gorilla/feeds specifically does this by overriding the Go xml package's defaults. I wonder what the reasoning behind that is.
See here:
https://github.com/kabukky/feeds/blob/master/feed.go#L84

Should be all done now :)


Error when importing Swate Templates

OS and framework information (please complete the following information):

OS Windows 10

Describe the bug

[When Trying to open a template for sampel description (community or curated template) error occurs ] A clear and concise description of what the bug is
[add assay, add newTable, pick template , add template - Error: "Specified index is out of table range! Table contains only 0 columns." Occurs with template icon on top and with template picker on right hand Swate menue

But sometimes not reproducible... ] Steps to reproduce
[

] Screenshots
[add template table ] Expected behavior
[none ] Ideas for solution

Done! This will be part of the next release!


Rendering issue when switching screen using react-navigation in combination w/ react-native-web

When switching to the page it looks like this:

When refreshing the page it looks like this (and this is how it supposed to be):

Code:
      <Text style={tw`mt-4 mb-1`}>Nodes</Text>
      <Tiles style={tw`max-w-lg`} space={4} columns={10}>
        <Icon name="at-line" />
        <Icon name="code-s-slash-line" />
        <Icon name="double-quotes-l" />
        <Icon name="heading" />
        <Icon name="h-1" />
        <Icon name="h-2" />
        <Icon name="h-3" />
        <Icon name="h-4" />
        <Icon name="h-5" />
        <Icon name="h-6" />
        <Icon name="indent-decrease" />
        <Icon name="indent-increase" />
        <Icon name="list-check" />
        <Icon name="list-check-2" />
        <Icon name="list-ordered" />
        <Icon name="list-unordered" />
        <Icon name="paragraph" />
        <Icon name="table-2" />
        <Icon name="text" />
      </Tiles>

This seems like a general issue with the library. I also noticed it on other pages. Any ideas?

@mobily seems like it's an issue with react-native-web itself or react-navigation because I noticed it also happens on screens where stacks is not used

Actually realized we used stacks more than I thought and all cases were stacks related.
For a horizontal stack I nailed down the issue to a broken flex-ba

sis setting.
This might be related: https://github.com/necolas/react-native-web/issues/1264

hello @nikgraf! 👋 thanks for posting this issue, could you try with v2.1.0, please? also, if this still occurs, a repro repo would be helpful! 🙏

@mobily still happening :(

sorry, don't have time to setup a full repro. we are using react-navigation and after switching between screens it sometimes happens. Could be something wrong with our setup

@nikgraf I replaced all instances of <Stack/> and <Inline/> with <Box/>, and removed flex='content'. This seems to have solved the problem. Not ideal, but it works.

I was update react-native-web to latest version (0.18.1) and all works correctly now. But I don't know, can I upgrade RNW without Expo migration guide?


Clean exit when running app.js without DB running

I've just tried running app.js on a fresh install using the CLI tool.  Turns out MongoDB wasn't running.  Starting the database server fixes the problem but without the process has exited cleanly without reporting any error.
Config.js generated via the CLI tool:
"use strict"

module.exports = {
  "api_connections": {
    "host": "localhost",
    "port": 1811,
    "routes": {
      "cors": true
    },
    "router": {
      "stripTrailingSlash": true
    }
  },
  "api_server": {
    "connections": {
      "routes": {
        "security": true
      }
    },
    "debug": {
      "request": [
        "error"
      ]
    }
  },
  "auth": {
    "password": "abUiq9nrbXrmEFLrHoEWkUDViz+OArhsb5t4RWXIqxOyS9kKwXFFcIL5xql0UvH0YAwSJUVSL126hS33plbvc4DTDKMhU3cbyb5eYdWi95b5ThGprEn2WJyj4dUpAyh2WGLndQ==",
    "providers": []
  },
  "content": "./content",
  "db": {
    "adapters": {
      "development": require("sails-mongo")
    },
    "connections": {
      "development": {
        "adapter": "development",
        "host": "localhost",
        "database": "multicolour",
        "port": 27017
      }
    }
  }
}

Since the DB is required, this will hard fail with the error.

Turns out this is a regression related to #26


Enforce static code analysis checks for pull requests.

This includes proper formatting and clippy warnings.

bors r+


Get rid of proto approach in order to add the update method

Implement an updateTable method in the DataSourceFactory. The returned tableDataSource should implement an update method , right after the initialization phase.

all good


Ability to show and set outputs state

Is your feature request related to a problem? Please describe.
When I listen to music on my eversolo I like to switch the output to USB so it is fed into my DAC.
after I switch back to XLR which is used to listen to TV (input is then optical).
There doesn't appear to be an entity/attribute that allows be to view, set and display output state.
At the moment I am doing this with a rest call:
http:///ZidooMusicControl/v2/setOutInputList?tag=USB
For TV I switch back to XLR
http:///ZidooMusicControl/v2/setOutInputList?tag=XLR
Describe the solution you'd like
I would like an an entity / attribute that can show and set outputs (tag).  Similar to inputs for source.
The attribute may already exist. If so I can't find it.
Describe alternatives you've considered
At the moment I am doing this with a rest call:
http:///ZidooMusicControl/v2/setOutInputList?tag=USB
For TV I switch back to XLR
http:///ZidooMusicControl/v2/setOutInputList?tag=XLR
problem with this approach is the state is not reflected in the mediaplayer or other HA entity.
Additional context
I'm using a combination of inputs and outputs to control input from internal player and TV (via optical)
when using internal player and listening to my on music I like to switch output to DAC.
Having the ability to control both inputs and outputs would mean I can setup all scenario's as 1 button automations.

Perhaps this could be added to mediaplayer  "select_sound_mode"? appears to be the only option for managing outputs in mediaplayer?
otherwise could be managed similar VUmeter

Hi @therobster121! Thank you for the request. I will integrate this. I can't tell you exactly when but I'll try and do it as soon as I find some time.

Hi Chris,
Let me know if you need any assistance with testing etc. I know python but
have close to 0 HA experience. If. I can help I will.
On Fri, 15 Dec 2023 at 9:19 am, Christian Horn @.***>
wrote:

Hi @therobster121 https://github.com/therobster121! Thank you for the
request. I will integrate this. I can't tell you exactly when but I'll try
and do it as soon as I find some time.
—
Reply to this email directly, view it on GitHub
https://github.com/hchris1/Eversolo/issues/25#issuecomment-1856787685,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMB3GFOV5MNDWMDKRN7DFODYJN3QXAVCNFSM6AAAAABAVNSWUOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJWG44DONRYGU
.
You are receiving this because you were mentioned.Message ID:
@.***>

Sorry, didn't want to close the issue straight away. It was automatically done because of the pull request.

@therobster121 Check out the new update! There is an output selector available. I didn't use select_sound_mode because it seemed like it's not as easy to operate from the UI.
Let me know if it works for you!

Hi Chris,
Wow fast turnaround!!!
I tested this on my DMP-A06 and it works well.
sorry about closing the ticket. I forked the repo so I could understand how
the integration works and tinker.
Rob
On Sat, Dec 16, 2023 at 4:06 AM Christian Horn @.***>
wrote:

@therobster121 https://github.com/therobster121 Check out the new
update! There is an output selector available. I didn't use
select_sound_mode because it seemed like it's not as easy to operate from
the UI.
Let me know if it works for you!
—
Reply to this email directly, view it on GitHub
https://github.com/hchris1/Eversolo/issues/25#issuecomment-1858206022,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMB3GFJCZSDJ5LJGUW7VOOLYJR7RVAVCNFSM6AAAAABAVNSWUOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJYGIYDMMBSGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

@therobster121 Nice! The integration could need some refactoring at some places but well... I'll work on that when I have some more time.
In case you like the integration and you want to help me out: https://www.buymeacoffee.com/hchris1
Cheers
Chris


fix plural typo in usage output

fix plural typo in usage output

@ideadapt Looks like we forgot about this. Can you please update your pull request by updating the README?


Build error related to okhttp3 as soon as I include firebaseui

Hello,
I would like to start using firebaseui-auth in my  app but as soon as I include the lib
compile 'com.firebaseui:firebase-ui-auth:1.0.0' (or 1.0.1, it's the same)
I cannot build my app anymore I get these kind of errors:
Error:(96, 20) error: cannot find symbol method close()
Error:(35, 21) error: incompatible types: try-with-resources not applicable to variable type
(Response cannot be converted to AutoCloseable)
All these line are related to okhttp3.Response class.. It doesn't fid .close()? I can perfectly see a .close() on it.. and it's owkring fine without firebase-ui lib
I dont know what it does this but for some reason it's getting confused?

@Frantch can you show the rest of your build.gradle file?

apply plugin: 'com.android.application'
apply plugin: 'realm-android'
android {
compileSdkVersion 24
buildToolsVersion "25.0.1"
defaultConfig {
    applicationId "com.alert.poke"
    minSdkVersion 19
    targetSdkVersion 24
    versionCode 1
    versionName "1.0"
    multiDexEnabled true
}

buildTypes {
    release {
      //  minifyEnabled true
        proguardFiles getDefaultProguardFile('proguard-android.txt'), 'proguard-rules.pro'
        zipAlignEnabled true
    }

    debug {
       // minifyEnabled true
        proguardFiles getDefaultProguardFile('proguard-android.txt'), 'proguard-rules.pro'
        zipAlignEnabled true
    }
}

lintOptions {
    disable 'MissingTranslation'
}

dexOptions {
    javaMaxHeapSize "4g"
}

productFlavors {
    lite {
        applicationId = 'xxxxx'
        versionCode xx
        versionName = "xxx"
    }
}

}
dependencies {
//compile fileTree(include: ['*.jar'], dir: 'libs')
compile ('com.google.android.gms:play-services-maps:9.8.0')
compile ('com.google.android.gms:play-services-location:9.8.0')
compile 'com.google.android.gms:play-services-places:9.8.0'
compile ('com.android.support:appcompat-v7:24.2.0')
compile ('com.android.support:design:24.2.0')
compile ('com.android.support:cardview-v7:24.2.0')
compile ('joda-time:joda-time:2.9.4')
compile ('com.google.firebase:firebase-ads:9.8.0')
compile ('com.android.support:multidex:1.0.1')
compile group: 'com.google.maps.android', name: 'android-maps-utils', version: '0.4.3'
//This is jar is a JAR is a lib I build myself and this is the one that contains Okhttp3 3.4.1
compile files('libs/a-third-party-jar.jar')

compile 'ch.acra:acra:4.9.0'
compile 'com.squareup:otto:1.3.8'
compile 'com.github.amlcurran.showcaseview:library:5.4.3'
compile 'com.github.clans:fab:1.6.4'
compile 'com.bignerdranch.android:recyclerview-multiselect:+'
compile 'com.firebaseui:firebase-ui-auth:1.0.0'

}
apply plugin: 'com.google.gms.google-services'
//apply plugin: "maven"

@Frantch FirebaseUI already includes OkHttp (v3.2.0) so you can remove your custom jar. If you really need a newer version, you can manually override FirebaseUI's dependency by including the following: compile 'com.squareup.okhttp3:okhttp:3.5.0'.

Oh I see.. I have tried looking into FirebaseUI repo to see if that lib was somehwere but couldn't find. In that case this worked:
compile ('com.firebaseui:firebase-ui-auth:1.0.0') {
        exclude group: 'com.squareup.okhttp3', module: 'okhttp'
    }

Only using this
compile 'com.squareup.okhttp3:okhttp:3.5.0'.
didn't work for me as I was getting a ZipAlign error saying some okhttp3 class were duplicated

@Frantch Glad to hear it worked!
Note: If you are using Twitter, you might want to check that things are working properly because they rely heavily on retrofit and okhttp. (Also, please upgrade to FirebaseUI 1.0.1! 😄 There were a ton of bugs fixes especially related to Twitter and memory leaks.)

I believe this has been resolved?  Closing the issue, please re-open if I am incorrect


Introduce insertion of the usage records in case of vertical scaling of VM

@schaubl in milestone v2.20 you've demoed https://github.com/slipstream/SlipStreamServer/pull/569, does it cover the vertical (and horizontal) scaling actions as well?

This was done in #643.
Closing.


Add location information to errors

This looks very sensible, thanks! Sorry for the long delay taking a look at it, this project fell of the radar for me a little bit...


chore: fork penumbra storage, tower-trace

Summary
This patch forks penumbra-storage and penumbra-tower-trace to astria-storage and astria-tower-trace, respectively.
Background
Penumbra's crates are written for penumbra at their own pace and primarily with their own ecosystem in mind. Contributing PRs to penumbra has potential ripple effects to their ecosystem of crates, needing larger changes. Since we want to update our dependencies at our pace (including tendermint), it is easier to fork these two limited crates and add our changes on top of them.
Astria is already using a fork of tendermint at https://github.com/astriaorg/tendermint-rs/tree/from-str-fix as a [patch] in Cargo.toml because penumbra is still on tendermint 0.32. Forking penumbra-tower-trace allows us to update tendermint to upstream independently.
Furthermore, penumbra-storage contains penumbra-specific strings which (as in their metrics module), which wouuld need to be renamed for astria purposes.
Changes

copied/forked penumbra-{storage,tower-trace} to astria-{storage,tower-trace} 0.1.0 at tag v0.59.0, sha a9ce1e4
removed all mention of penumbra from the crate
put storage metrics behind a feature gate
made all tests pass by lazily initializing a global tracing subscriber
changed astria-sequencer to use penumbra-storage, astria-tower-trace
changed uses of nonconsensus_* methods to nonverifiable_* methods (this was a breaking change in penumbra-storage 0.57)
replace all shared dependencies by workspace dependencies
remove all unused dependencies
apply pedantic clippy to new crates
vendor rocksdb in container builds to ensure the correct versions are built (thus no longer installing it from the debian bookworm repos)

Testing
No actual code changes took place, all astria tests still pass
Breaking Changelist

astria-sequencer now depends on rust-rocksdb v0.21.0, which pulls in rocksdb 8.3.2. This might be a breaking change for persistent rocksdb storage (although as far as I know rocksdb guarantees compatibility)
all other changes do not constitute observable breaking changes for astria services/binaries.

Honestly, I don't think we should even to keep this synchronized.
If you look at their storage crate (the metrics module) this is seen as a deep dependency of their stack and not really to be used publicly.

@SuperFluffy I think it's worth messaging them about how we can keep these synced - are there any other breaking changes expected except for tendermint-rs updates? I can't think of any, so if that's the only change, they are going to make that update eventually. either way I think forking like this is fine for now

@noot Talked to @joroshiba. Don't feel very convinced about this PR myself.
Penumbra is tracking the move to tendermint-0.33 in https://github.com/penumbra-zone/penumbra/pull/2961

Hey there! Is there a way we can convince you not to fork? We just merged our<EMAIL_ADDRESS>integration, it includes a restructuring of tower-trace and tower-actor to make it easy and stable to support multiple versions (v034 and v037) of cometbft side-by-side. This was done with y’all in mind (we use 34)!
I also added a “metrics” feature to penumbra_storage, it can be disabled by specifying default-features = false in your cargo files, see #3007.
We built the different parts of the penumbra stack to be generic building blocks to create blockchains in rust. The current design is the third iteration on this idea and is getting mature. So for us, supporting a more diverse set of use-cases is definitely a priority, and something we want to collaborate with you on!
I think the best way forward is to connect directly on discord (invite here) so that we have direct channels with each other. All our processes are public, and our goal is to make it very legible what our roadmap is and what technical priorities drive this process.

@erwanor yeah, I think we are actually not at all convinced that our fork is the right way to go about things.
I had a look at your open PRs after I created this when I saw your work on integrating tendermint 0.33. I should have done that first and synced with you. 😅
Thank you for giving a ping on it being merged. I'll integrate it ASAP!

@erwanor yeah, I think we are actually not at all convinced that our fork is the right way to go about things.
I had a look at your open PRs after I created this when I saw your work on integrating tendermint 0.33. I should have done that first and synced with you. 😅
Thank you for giving a ping on it being merged. I'll integrate it ASAP!

Oh no worries, generally speaking we try to keep up with the tip of tendermint-rs. And if there are other things you need or want to chat about then really please do feel free to either open a ticket or ping me on discord, I think @noot is already there too.


Some updates to forc's README.md

Is that plan to keep maintaining this README.md? Or do we want to consolidate the information into the Sway book?

Yeah I like the idea of removing any examples from the README in favour of pointing to the book, particularly in the case that we have no automated way of testing the README.

I think this PR can be closed in favor of the above-linked PR

Yeah that's more sensible. Closing.


Automatical generator of nut files

It is a generator of nut files based on the nut grammar.
It is writting in Java.
It is updated on generator_nut branch.

Good idea. Do all your project in a subdirectory in prog_urils, called nut_generator_files for example. ^^

This is the idea, however, i don't see my commit ? i don't know if it is normal ?

ok, it is done.

Hey, that's great ^^.
Just a few things :

code in english
you use **/.java notation, doesn't work on every system. Use 'find -name ".java" instead
you use hard coded colors... and you use echo. Echo has not the same behaviour in every systems. See what i have written things in the root Makefile.
remove the .gitkeep
'lancement jeu' line 46. Copy paste is a bad thing xD
you declare FLAG_1 and FLAG_2, put some more explicit names, we can't understand...
FLAG_2 is not used, and we don't need a variable for javac options
You put a copyright in the makefile, we have no license yet and globally heijix will have a opensource license. You cannot use a copyright...

The program also crash if we don't call the program with the good amount of parameters.

I don't fix anything, because you are maybe working on it. and because that is your idea, and your baby. Tell me if you want some help ^^

You need to write that we need to code in english in the code of conduct file.

updated ^^


Data Catalog Taxonomy

Creates the initial taxonomy containing the data catalog related terms.  These terms are used in other components as well (ex: policy manager, modules, etc) and thus the taxonomy is the mechanism via which common terms are managed and validates.
Currently this taxonomy is manually created.  In the future it should be generated by querying the relevant data catalog - probably as part of the catalog connector.
Includes tests, which also show how to use the json schema validator.

I'm writing a document for writing taxonomy specification (focus on schema objects) to have what we discussed verbally written down. I'll validate the schema here against it when done.

looks good.
The taxonomy should move out f 3rd party and be split into config? and samples (or similiar) in the repo, and be built into config/taxonomy during install.

Can we just put it in config/taxonomy directly in this PR?

BTW the structure for resource need to change in a follow-up PR to match the design (i.e., tags as a map like in the current implementation for performance and easier policy writing).


Update fsevents to fix prototype pollution attack

https://nodesecurity.io/advisories/566
https://github.com/strongloop/fsevents/pull/201
https://github.com/mapbox/node-pre-gyp/pull/347

A 2.0.4 release with this would be great :)

Coverage decreased (-0.05%) to 98.5% when pulling fb0136f67b9d3dee5dcd0c97190ef6a9be942a6d on fenichelar:master into 925b534d63743c941b98bbd1855e12272ce71720 on paulmillr:master.

This is already handled by the caret semver operator, making this PR unnecessary. Just do a fresh install.

It is best practice to release a new patch version to address a vulnerability because it forces commands like npm update -S to grab the new release without requiring a fresh install. When you have many applications to manage, it is really annoying to do fresh installs all over the place. I understand that this is not actually a security risk, but I think all vulnerabilities should be treated the same. Is there a reason that you seem to be so against making a new releases?

My main concern is that I do not yet know the fallout of the node 0.12 breaking change, and forcing<EMAIL_ADDRESS>here makes that a less reconcilable situation for any users affected.
Sorry to cause you annoyance, but you do already have the means to resolve it at your disposal.


Add frame URL's

When you click on the frame links, they redirect back to the main site. Adding the URL's to the list should make them redirect to the wiki.
I wrote a quick python script to add the links automatically. The script outputs the .json indented with spaces, but I used VSCode's convert to tabs feature to turn it back.
Script:
import sys
import codecs
import json

listpath = sys.argv[1]

with codecs.open(listpath, 'r', encoding='utf-8') as list_file:
    list_data = json.load(list_file)

for _, frame_data in list_data['Frames'].items():
    frame_data['url'] = f'http://warframe.wikia.com/wiki/{frame_data["frameName"]}'

with codecs.open(listpath, 'w', encoding='utf-8') as list_file:
    json.dump(list_data, list_file, indent=4, ensure_ascii=False)

Let me know if you guys have any questions or want to make any changes.
Cheers,
Oxymoren

This is great, thanks @Oxymoren! Just before we merge I want to make sure that @sakai4eva can update this into his spreadsheet (he doesn't edit the JSON data by himself).
Alternatively, I can implement an Angular filter that automatically looks up the URL, but having them be statically encoded is probably better. @nader thoughts?

Hey @sakai4eva just want to check in, have you had a chance to look at this yet?

I'm ok with it, but you need to let me know what is the name of the JSON field to use so that I can add it to my worksheet.

I'm ok with it, but you need to let me know what is the name of the JSON field to use so that I can add it to my worksheet.

It's url, under Frames. We had already implemented the Angular code for this somewhere, so I think it got lost in translation.
Should be mostly static, so I can't imagine things changing. Then, when a new frame comes out, the idea is just to add its wiki URL.

If that's good I'm going to merge this PR. Thanks for the help @Oxymoren!


Support pbcopy command

User Story
As a user, I want to be able to use pbcopy command to copy image to clipboard.
Technical Requirements and Implementation Details
No response
Business Requirements
No response
Resources
No response
Acceptance Criteria

[ ] pbcopy command can be used to copy image to clipboard.

Blocked by #9

It looks like pbcopy cannot be used to copy images.


implement bootstrap mode

Currently, there is a small race condition if multiple nodes are started too quickly.  Need to implement a bootstrap mode where huton waits for a cluster of n nodes, where n is configurable, in the serf cluster before configuring the raft cluster. Consul does something similar, albeit they are (ironically) using a super old version of the raft library, so the way they do it won't really work here.

This is being taken care of along with #14


Ansible playbooks to configure development and testing machines

As part of #2647, we need a way to configure servers consistently on potentially any OS, locally via Vagrant or on any cloud provider via Terraform.
A good, declarative and portable way to do so is to use Ansible.
We could therefore have various "playbooks" to configure:

Docker + Weave Net
Docker + Kubernetes + Weave-Kube

and use these for development and testing.

Closing, as change is part of: weaveworks/build-tools#53.


fatal: Not a git repository, when using "vcs" element, in every non-git directory

Setup:

macOS 10.12.6
git version 2.14.1
zsh 5.2 (x86_64-apple-darwin16.0)
oh-my-zsh commit 2ff956
powerlevel9k commit afb738

If I include "vcs" in my list of prompt elements -- for instance, in my .zshrc file:
POWERLEVEL9K_LEFT_PROMPT_ELEMENTS=(ssh context dir dir_writable vcs)
In any directory that is not a git repo, I get the following error message printed twice at every prompt:

fatal: Not a git repository (or any of the parent directories): .git

Now it certainly makes sense that folders that have no git repo initiated (no .git subdirectory) have no information to pass to the vcs element.
But is there a way to do an "if" check to conditionally show this element when the current directory is in a git repo, rather than erroring? It seems like it's also slowing down the prompt a bit, in addition to being a lot of visual noise.
Thanks!

@rootwork - That's actually the way the segment is supposed to work (it only checks if you're actually in a git repo), and I've never seen it behave the way you describe. Something is strange. Our systems are fairly similar, although I do have slightly more recent versions of most of the SW.
Anyway, something really seems to be going bad, here. Are you using any OMZ plugins that might affect git? You're at the HEAD of master, so if this issue was widespread, there would be thousands of people with the same problem. I have a feeling this is some corner case in versioning or config.

Hey @rootwork - just a ping, here! @Jahhein's suggested debug steps are good. Any luck?

My best guess is that you have some git wrapper script that causes that error. Luckily @guicassolato addressed this issue in #797 . It would be super helpful if you could try out that branch and see if your error goes away.

Going to close this one out due to inactivity!


Load navmesh from .bin?

Hello!! And Thanks for this awesome library. I hope I can implement this in my project!
Is there any way to load a Recast Navmesh from a .bin file?
I want to use detour to get some walkable paths for my game.
Thanks!!

Hi, thank you.
When I've implemented this, it was possible to read Detour navigation meshes with
https://github.com/arl/go-detour/blob/master/detour/mesh.go#L68.
Don't know if the format has evolved and I haven't tried recently, but recent navmeshes may be backward compatible.
this project needs a bit of love (documentation is not showing at the moment on https://pkg.go.dev/github.com/arl/go-detour due to the LICENSE not being recognized. I'll have to fix that.
@pacarevolution


connectionpool_inPool gauge not correcly reflecting connections in pool as it never decreases

We are logging the connectionpool_inPool metric every minute to track open connections.  Unfortunately, this metric appears to increase with each new connection created and does not decrease when the connection is closed as the metric only increases over time.  We can use netstat to see that there are nowhere near as many open connections as reported by connectionpool_inPool.
The connectionpool_inUse metric seems to be accurate.
Here is the code we use to register the metric colleciton in our Bootstrap.java:
// codahale metrics registry
var codahaleRegistry = new MetricRegistry();
bind(MetricRegistry.class).toInstance(codahaleRegistry);
Registry spectatorRegistry = new MetricsRegistry(Clock.SYSTEM, codahaleRegistry);
bind(Registry.class).toInstance(spectatorRegistry);

We are using Zuul 2.4.0.  We saw the same behavior in 2.3.0.  I attempted to look at the code that tracks these metrics but the increment/decrement logic for the connection tracking was hard for me to follow as it appeared to be sprinkled across many methods.

I'm still interested in whether anyone has ideas about how to fix the connectionpool_inUse metrics.  We are starting to implement connection limits and having better insight into connection use is important in being able to tweak and monitor connection behavior.

I don't see the same issue in our internal inUse metrics. The counter should be decremented by DefaultClientChannelManager.release() which will be called when a pooled connection is no longer in use

Sorry, @jguerra.  I had a typo in my coment yesterday.  It should have said inPool and not inUse.  I edited the comment to fix that.  The inUse metrics are working well.  It is the inPool ones (as mentioned in the issue title) that are not reporting properly.


⚠ Bofrost.be has degraded performance

In 34a8f57, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 972 ms

Resolved: Bofrost.be performance has improved in 209f19d.


Consider NFC normalization of idents?

Raised by @Jules-Bertholet in https://github.com/rust-lang/rust/issues/120697
It could be desirable to NFC-normalize identifiers so as to remove these kinds of inconsistencies.
However, it seems plausible that this may cause issues if the identifiers are not local, e.g. they come from another crate that does not run rustfmt.
It may make sense, however, if rustc itself linted against non-NFC-normalized idents?

this may cause issues if the identifiers are not local, e.g. they come from another crate that does not run rustfmt

I don't see how?

@Jules-Bertholet Wait, maybe my brain is just slow (I'm overdue for lunch...), does rustc fully NFC-normalize idents internally when resolving them?

@Jules-Bertholet Wait, maybe my brain is just slow (I'm overdue for lunch...), does rustc fully NFC-normalize idents internally when resolving them?

Yes.

Oh, no issue then!

@Jules-Bertholet @workingjubilee Do either of you know if there are crates that already implement the normalization?

Rustc uses unicode-normalization

@Jules-Bertholet Ahhh nice! Very good to know that something like this already exists. Thanks for the link.

However, it seems plausible that this may cause issues if the identifiers are not local, e.g. they come from another crate that does not run rustfmt.

Just want to make sure I understand correctly. Neither of you think this would be an issue?

Just want to make sure I understand correctly. Neither of you think this would be an issue?

Correct, AIUI. Even if a dependency uses non-NFC idents internally, they can be referred to by dependents with their NFC forms.

Just want to make sure I understand correctly. Neither of you think this would be an issue?

Yes. I was a bit slow on the uptake and hadn't remembered yet that we NFC idents (because of course we should). Applying NFC on format means that the visual appearance of the normalized identifiers will not be changed as a result.


Header links in basic types are broken

Header links on the basic types page are broken, they link to nonexistent pages instead of sections in the current page.
Ex: The link on Boolean is: 'Boolean'. Leading to https://www.typescriptlang.org/docs/handbook/Boolean.
From what I can see #838 added these links but they probably should point to ids in the page (#Boolean not Boolean).

I would like to submit a PR for this, but I would like to be able to test it properly. Since linking to sections would use generated ids I would like to test with the generated HTML but I am not sure what tool you use to convert markdown to html.


[FW]Fixed wing can't land to home point when I choose RTL mode

Run make px4_sitl_default gazebo_plane
My operation flow: start gazebo FW simulation --> upload a FW landing point ---> send take off command ---> switch mode to RTL
FW can't land  after I use the latest master branch.
sitl log : https://logs.px4.io/plot_app?log=e409a27b-aa70-4ddd-a7b0-f3118a4e6a41  （I added some debug code for debugging.）
EDIT : Please use this same log link as the master branch:    https://logs.px4.io/plot_app?log=5c633144-1470-4bd1-af18-68d189d75a7e
What parameters can be set, when I choose RTL mode, the fixed wing can automatically land to the ground.
I have read this carefully: https://docs.px4.io/master/en/flight_modes/return.html#fixed-wing-fw

@RomanBapst  Do you know the correct parameter configuration? Thank you

RTL_TYPE =1 is typically the best option for fixed wing. It uses the mission landing pattern to RTL.

@Antiheavy  thanks your replay
I also try set RTL_TYPE =1, but still not land when I switch RTL mode.
How should I set the mission land?

Huh. Did you upload a mission with a landing pattern?  See https://docs.px4.io/master/en/flight_modes/return.html

@Antiheavy  FW can land when I choose mission mode and add a landing point.
just like this:

But when I choose RTL mode, FW will not land but hover.
Sorry, I still don't understand what I should do, I just want to get an RTL similar to the rotor (automatic landing to the takeoff point).

Are you simulating a fixed wing or a VTOL aircraft?  I don’t understand how a forced wing could hover. There must be something strange with your setup, I just can’t tell what.

Are you simulating a fixed wing or a VTOL aircraft?

FW

There must be something strange with your setup,

maybe,But I have not changed other parameters.
Anyway, thank you again for your reply.

@xdwgood I notice that you are using the very latest daily build versions of QGC.  I know there are a lot of changes happening right now with the mission planning section.  Have you tried this with the official released version?  Maybe there is a bug with the landing pattern in the daily builds?
http://qgroundcontrol.com/downloads/

@Antiheavy  I tried to use the released version of qgc. After executing rtl, the drone will not land, and do circular motion at 100 meters.

and do circular motion at 100 meters.

does it do this around the Home location or somewhere else?

does it do this around the Home location or somewhere else?

@Antiheavy  it around the Home location

do you get errors when trying to upload the mission to the autopilot?

I have not updated the mission. My operation flow is: commander take off--> switch RTL mode

Or currently px4 does not support automatic landing in rtl mode, we have to upload a mission and then execute rtl?

huh... i'm unfamiliar with these new log messages:

I wonder if something is broken with the new RTL stuff around safe points.  @sfuhrer can you take a look at this?

@sfuhrer   @Antiheavy
My operation flow: start gazebo FW simulation --> upload a FW landing point ---> send take off command ---> switch mode to RTL
log link：  https://logs.px4.io/plot_app?log=5c633144-1470-4bd1-af18-68d189d75a7e

In the log print information, the landing has been prompted, but in the simulation, the drone has been flying forward without landing.

Hi @xdwgood,
I've just tried it with the same setup as you described, and it worked for me as expected (landing at mission landing).
https://review.px4.io/plot_app?log=693a3338-5cb1-4059-9f0e-48a261ff8146
https://review.px4.io/plot_app?log=c8686c3f-23c4-4090-bfb0-b62cc32df9c4
Looking at the logged messages of your flight I can only think of that the mission (in your case landing point) upload failed for some reason. It looks like it has no mission landing, and thus chooses Home to go to in the RTL. Ofc it doesn't land there, but circles. I'm wondering though why it then says "Landing at destination" - it should instead should say "RTL: completed, loitering". I just checked, that's what you get when you RTL in a flight without any mission planned.
Did you check if you get any mission feasibility errors while uploading or when starting the flight? And did you also try with a complete mission, meaning with takeoff, normal wp and then the mission landing?

If you were using RTL_TYPE 1 it should force you to use the mission landing in all except certain cases like you deleted the mission mid-flight or something.
Another weird thing is I’d expect to see a logged message that says something like “unable to use mission landing, returning to Home”
Also, the weird thing is that you should not even be able to takeoff in an auto mode if the vehicle does not have a valid mission.

Also, the weird thing is that you should not even be able to takeoff in an auto mode if the vehicle does not have a valid mission

That was the case, I had to trigger takeoff over the command line as the mission was not valid (only had a landing pattern but no takeoff). What was your exact procedure @xdwgood ?

That was the case, I had to trigger takeoff over the command line as the mission was not valid (only had a landing pattern but no takeoff). What was your exact procedure @xdwgood ?

@sfuhrer   I send the takeoff through the command line:
Commander takeoff

And did you also try with a complete mission, meaning with takeoff, normal wp and then the mission landing?

yes，I have tried a mission(wp) and will land automatically when the drone is executed.
Clarify my detailed operation again:  start gazebo FW simulation -->open qgc---> upload a FW landing point ---> send take off command by commander takeoff ---> switch mode to RTL--->FW can't land
@Antiheavy @sfuhrer  Thanks Reply

@xdwgood this was the exact same procedure I used in this flight. In your first log you seem to have RTL_TYPE=0, in which case it is normal that it will go to home and loiter there. In your second log though, with RTL_TYPE=1, the logged messages indicate that it actually did go to the mission landing. Was this not the case?

the logged messages indicate that it actually did go to the mission landing. Was this not the case?

But the FW did not land, but continued to fly straight.

@xdwgood could you maybe try again? To see if it reproducible. As I couldn't reproduce it so far.

@Antiheavy @sfuhrer
I updated the code and tried again, everything worked fine, FW landed on the ground. I am sorry to bother you, thank you for your reply, thank you.


PR: Move dock attributes from plugin to dockwidget

Description of Changes
This simplifies a bit the logic moving fowrard with the new API

Affirmation
By submitting this Pull Request or typing my (user)name below,
I affirm the Developer Certificate of Origin
with respect to all commits and content included in this PR,
and understand I am releasing the same under Spyder's MIT (Expat) license.

I certify the above statement is true and correct:

Do we need this for Spyder 4?

If so, why?

If so, why?

We don't but it will make merging to 5 easier. I can move to master 🤷♂

Ok, it's not a big deal. So we can leave it for Spyder 4 :+1:


Conveyor belt obstacle/ tiles

=
Description
Adding a conveyor belt as an obstacle can introduce an interesting dynamic to game, adding both challenge and variety. Using a simple sprite sheet for the conveyor belt and determining its behavior based on map placement (<<< or >>>).
Main consideration though is if it should be an actor and not "background" (level) tile. Creating the conveyor belt as an actor could be beneficial for several reasons, particularly when I want it to have an animated effect and interact with other actors in the game.
When designing levels, I will place conveyor belt tiles where needed, and the game logic will automatically determine their direction based on their placement. This should keep level design flexible and minimizes the need for multiple tiles for different conveyor belt states.
Primary function is to affect the movement of other actors that come into contact with it. The conveyor belt stays in a fixed position but has an animated appearance to convey the sense of motion, and it "drags" or influences the position of other actors that stand on it.
The update method of the conveyor belt would mainly handle its animation cycle, giving the appearance of movement, but the belt's position on the game map remains constant. The interaction effect – the "dragging" of other actors – is handled through collision checks and modifying the positions of the actors that are on the conveyor belt, as they would be influenced by the belt's motion direction and speed.
Rough implementation outline:
Conveyor Belt Actor
ConveyorBelt class that extends the Actor class. This actor will be responsible for the animation and the "dragging" effect of entities that stand on top of it.
class ConveyorBelt extends Actor {
  constructor(pos, speed, direction) {
    super(pos, new Vec(speed * direction, 0));
    this.animationFrame = 0;
    this.direction = direction; // 1 for right, -1 for left
  }

  get type() {
    return "conveyorBelt";
  }

  static create(pos, ch) {
    // Determine direction based on the character used in the level map
    let direction = (ch === '<') ? -1 : 1;
    return new ConveyorBelt(pos, 1, direction);
  }

  update(time) {
    // Update animation frame
    this.animationFrame = (this.animationFrame + time * 10) % 4; // Cycle through 4 frames
    return new ConveyorBelt(this.pos, 1, this.direction);
  }
}

dragging effect:
I have no idea yet how to implement this yet. However it should be triggered by collision similar to Hoopa and Kegga- "top collider"
considerations:

synchronisation
actorOverlap update
specific behavior (actor should be slowed down when moving against the 'stream' and speed up when going 'with' the stream)

drawing the conveyor belt

I would like to use approximately 3-4 tiles for animation sake only. There will be no idle frame for conveyor belt.
it would require just one new conditon to drawActors

else if (actor.type == "conveyorBelt") {
  let tileX = actor.animationFrame * gameSettings.scale;
  // Adjust tileX based on the direction
  if (actor.direction === -1) {
    tileX += someOffset; //  To adjust this based on spritesheet layout
  }
  this.cx.drawImage(otherSprites, tileX, conveyorBeltYPosition, gameSettings.scale, gameSettings.scale, x, y, gameSettings.scale, gameSettings.scale); // I am thinking if easier wont be to add small tile sheet for ConveyorBelt instead of messing up with OtherTiles
}

add to levelChars new lines regarding ConveyorBelt
levelChars["<"] = ConveyorBelt; // for left direction
levelChars[">"] = ConveyorBelt; // for right direction

prototype.update has to at least return this if actor is immovable.

For future reference to avoid again try and error
Add conveyor belt sprite to drawActors function in DEBUG MODE
else if (actor.type == "conveyorBelt") {
      // Assuming the first sprite is at the top-left corner of the sprite sheet
      let sx = 0; // Source x-coordinate on the sprite sheet
      let sy = 0; // Source y-coordinate on the sprite sheet
      let sWidth = 20; // Source width (sprite width)
      let sHeight = 20; // Source height (sprite height)
      let dx = x; // Destination x-coordinate on the canvas
      let dy = y; // Destination y-coordinate on the canvas
      let dWidth = width; // Destination width (same as the sprite width, adjusted for scale if necessary)
      let dHeight = height; // Destination height (same as the sprite height, adjusted for scale if necessary)

      // Draw the sprite
      this.cx.drawImage(conveyorBeltSprites, sx, sy, sWidth, sHeight, dx, dy, dWidth, dHeight);
    }

OKi doki almost done.
Here it is how it works:

https://github.com/karl5252/Toolio/assets/32590103/392ed763-62bc-4c9b-9d0f-3903a51a0246

One issue. Collision detection is not working properly for Kegga na Hoopa.
This will go to TODO list.

overlap- works and logs overlap
collision- not working
update of actor other than player - not working


gulp 4 doesn't move files

Recently upgraded system to Windows 7 64x and then updated to Node 10.x
All gulp projects fell down working.
I think that gulp 4 will be better for Node 10.x, so I'm showing example with all updated config:
E:\[WEB]\PROJECTS\test-project>node -v
v10.15.1

E:\[WEB]\PROJECTS\test-project>gulp -v
[15:31:29] CLI version 2.0.1
[15:31:29] Local version 4.0.0

Project structure

Gulpfile.js

After running  gulp comand - nothing being put into prod folder
Reinstalling Windows or rollback to Node 8.x didn't help.
Tried both 3 and 4 gulp versions, installed glob package - same effect.
I've been trying to debug, read issues, created stackoverflow issue(no one left a comment) - nothing can help.

@davegahn why do you have glob installed as a devDep?

Somitemes feel confusing if I have to install as Dep
Oh, forgot to show console )))

Recently I thought that there's something with my Windows or Nodejs, but after I ran a webpack project and it worked well, I decided to write here.

I'd say that you should remove the glob dependency (gulp handles that for you), any package-lock or yarnlock file you have, remove node_modules and reinstall.
Also, delete the prod directory in your project.

Deleted packege.lock and prod directory
npm prune & rm -r node_modules
npm cache clear --force
npm i
gulp
Fail((

That's beyond weird. None of the core devs have Windows to recreate this. Can you add gulp-debug in between src and dest?

npm install --save-dev gulp-debug

I'm not shure which parameters to apply for gulp-debug

That's helpful.  It means no items are picked up by src.  I'm still curious as to why, but can you switch dev/index.html to dev/*.html and run it again?

I'm a little curious actually.  what if you renamed your [WEB] directory to just WEB (or just create a new directory and copy the gulp project over to it).  I'm thinking the square-brackets might be messing up some pathing stuff.

Amazing!!!
I think this was a reason!!!!
It worked in E:\WEB directory!!!!

@davegahn thanks for taking the time to debug, I'll create a follow up issue about those characters.

Follow up issue created and linked above.


docs: remove extra newline from Contributing.md

I'm pretty sure the newline isn't doing anything bad. Especially because some text editors/users prefer newlines at the end of files especially vim users.


The particles are not working properly

CI'm using the latest version of the plugin and 1.21.1.
When I start the GPS the particles don't appear if I put colours in addition to the default ones or other types of particles.

This is actually easily fixable. In newer Minecraft versions, the particle for redstone dust changed from redstone to dust. Simply change the particle type in your config from redstone to dust and that should solve the problem.

Reopening for work to be backwards-compatible with earlier configs and change the default config


Fix documentation link in README

cheers Tim, I think there might be a few more as well though. Will search them out


Enhancement Request   Input &  TextArea  .. allow for spellcheck=false

All versions..
Any chance you can add the html5 attribute spellcheck to the Input and TextArea controls ?  I would like to disable the browsers spell checking for specific controls.  An alternative would be to implement it via css.
Thanks,
Kurt

Question is forwarded via #2070083036

Hello @kvandelden ,
May I ask you to explain in details your real use case and how will you benefit from such a functionality?  I ask this question in order to have better understanding and background in evaluating the implementation of such feature.
Thank you in advance!
Kind Regards,
Niya

Hello,
We use text fields to input formulas that are not words...
   TOTAL_ADJ + PY_VOLUME +...

Wanting to eliminate the red underline

We also use inputs for inputs that are ids..  Non-english words.

Hello @kvandelden,
Thanks for the information provided!
We made a Jira Backlog Item for evaluation. We will start discussion with UX designers and Architects.
When we taka a decision, if the implementation could be done, we will update you.
Kind Regards,
Niya

Hello @kvandelden,
Thanks for your request.
We have checked the requirement together with UX and there are no real needs for this at the moment.
We also have not received also further requests about this since the issue was opened.
Therefore, we are rejecting the feature request.
Best Regards,
Nikolay

Do we now have a severe security issue in all openui5 applications worldwide because of not using spellcheck="false" as default (and missing support to set it)?
see
https://www.bleepingcomputer.com/news/security/google-microsoft-can-get-your-passwords-via-web-browsers-spellcheck/
https://www.otto-js.com/news/article/chrome-and-edge-enhanced-spellcheck-features-expose-pii-even-your-passwords

@carstenartur Does this answer help? https://answers.sap.com/answers/13782891/view.html

@carstenartur Does this answer help? https://answers.sap.com/answers/13782891/view.html

Not really. The same requirement not to send anything to the cloud for spellchecking might be true for non-password fields as well. This makes the feature requested here a must have. And the question is what is with users working with old browsers.

AFAIK the "enhanced" spell check has to be selected explicitly by the user or the company. In my view, that is rather an administrative issue than an issue in OpenUI5. The "basic" spell check, on the other hand, is performed locally only.
If the user is somehow forced to keep the "enhanced" spell check in the browser settings, app developers can easily add spellcheck="false" to an extended Input renderer. Here is an example: https://embed.plnkr.co/ik9PIdHKvK8udpQt
Regarding old browsers: apart from OpenUI5 supporting only specific platforms and the latest browser versions as mentioned in the table at https://sdk.openui5.org/nightly/#/topic/74b59efa0eef48988d3b716bd0ecc933, I think using an outdated browser is a bigger issue if the security has any value to the user.

AFAIK the "enhanced" spell check has to be selected explicitly by the user or the

The problem here is that Microsoft changed the default to "on" without further notice in an update which caused to have a lot of installations with the combination enhanced spell check on in the browser suddenly and the missing feature to use spellcheck off in openui5. This combination is seen as a security issue. It does not help to blame Microsoft alone. Now this spellcheck off feature is missing in a lot of applications based on openui5. Nice to see there are ways to get what is needed though.
company. In my view, that is rather an administrative issue than an issue in OpenUI5. The "basic" spell check, on the other hand, is performed locally only.

If the user is somehow forced to keep the "enhanced" spell check in the browser settings, app developers can easily add spellcheck="false" to an extended Input renderer. Here is an example: https://embed.plnkr.co/ik9PIdHKvK8udpQt
Regarding old browsers: apart from OpenUI5 supporting only specific platforms and the latest browser versions as mentioned in the table at https://sdk.openui5.org/nightly/#/topic/74b59efa0eef48988d3b716bd0ecc933, I think using an outdated browser is a bigger issue if the security has any value to the user.


Pool JsonSerializer instances

Fixes #3550

Before

After

cc @rynowak

Those results are pretty crazy

:watch:

Updated

:shipit:


Upgrade to JGit 6 to patch CVE-2023-4759

What's changed?
Fixes #3620
Anything in particular you'd like reviewers to focus on?
I was unable to get a local build running properly so let's see if the CI tests validate that this is a non-breaking change that doesn't require any additional code changes beyond the library upgrade🤞
Checklist

[ ] I've added unit tests to cover both positive and negative cases
[ ] I've added the license header to any new files through ./gradlew licenseFormat
[ ] I've used the IntelliJ IDEA auto-formatter on affected files

Thanks for getting this started! We had an earlier suggested recipe addition that could help with the required changes:

https://github.com/openrewrite/rewrite-migrate-java/pull/239

Haven't yet found the time to apply those to the OpenRewrite repositories, but imagine we should.

We have to be pinned to the old version of jgit because newer don't support java 8 anymore. CI tests may not have revealed it because the only tests which still run on a jdk 8 are those for the java 8 parser, and those tests do not exercise jgit.
I appreciate the contribution! Unfortunately our commitment to supporting java 8 means we are unable to accept it.


Support configuration update at runtime for some configs

Support execution of configuration related ISIs for:
Sumeragi configuration
Kura configuration

this is long outdated, we now have SetParameter and NewParameter ISI


importHelpers: only import direct dependencies with ESM

Fixes #41515.
Also orta told me to ping @rbuckton on this PR 😄

This probably needs some perf testing because of the type change of emit helpers.

When rebasing to fix the merge conflict this had, I noticed that this PR has no impact on any output anymore at the current time.
The main reason I created the PR is that I saw that the __spread helper depended on the __read helper. With CommonJS this isn't a problem because we require() the whole tslib anyway, and with importHelpers: false this isn't a problem because all helpers and its dependencies need to be inlined for the code to work. But with ESM (and importHelpers: true), we import the helpers directly, and we don't need to import their dependencies (because they internally call each other), but we currently do. This is what I wanted to change.
The reason this now seemingly has no impact is because __spread was deleted (#41523) and there is no other helper this has any impact on. __importStar and __exportStar both depend on __createBinding, but are only used with CommonJS, and __asyncGenerator and __asyncDelegator both depend on __await, but are both emitted only from code that also directly depends on __await itself.
For now, I removed the test because I can't imagine a test case that properly tests this with the current set of helpers.
...but the future!
There may be other helpers with internal dependencies in the future this does have impact on.
Now, how do we continue with this PR? Do we still merge it without tests to be future-proof for any new helpers this may have an impact on?
Alternatively, is there some edge case I'm overlooking, and this does currently have an impact we can test?

When rebasing to fix the merge conflict this had, I noticed that this PR has no impact on any output anymore at the current time.
The main reason I created the PR is that I saw that the __spread helper depended on the __read helper. With CommonJS this isn't a problem because we require() the whole tslib anyway, and with importHelpers: false this isn't a problem because all helpers and its dependencies need to be inlined for the code to work. But with ESM (and importHelpers: true), we import the helpers directly, and we don't need to import their dependencies (because they internally call each other), but we currently do. This is what I wanted to change.
The reason this now seemingly has no impact is because __spread was deleted (#41523) and there is no other helper this has any impact on. __importStar and __exportStar both depend on __createBinding, but are only used with CommonJS, and __asyncGenerator and __asyncDelegator both depend on __await, but are both emitted only from code that also directly depends on __await itself.
For now, I removed the test because I can't imagine a test case that properly tests this with the current set of helpers.
...but the future!
There may be other helpers with internal dependencies in the future this does have impact on.
Now, how do we continue with this PR? Do we still merge it without tests to be future-proof for any new helpers this may have an impact on?
Alternatively, is there some edge case I'm overlooking, and this does currently have an impact we can test?

Unfortunately, we never finished reviewing this PR. It is pretty old now, so I'm going to close it to reduce the number of open PRs.


Data-Aware Calibration

The current calibration algorithm use global_scale to estimate the scale of intermediate result, which is configured by user. For better accuracy loss, we need to implement data-aware calibration algorithm: given a small calibration dataset (like 100 samples), to achieve better scale estimation.
Implementation
Collecting Intermediate Results
To collect intermediate results of every operation in the graph, we may need to implement a Visitor to return every Call as output. The API would be: stats = collect_stats(graph, data)
Modification for SimulatedQuantize
It is kinds of hard to save the mapping from origin operator to the operator after annotation. So we may need to add an option for simulated_quantize, like mode='origin', which denotes that sq will not simulate the rounding error/saturated error, instead, just return the input directly. With this, we can collect the intermediate result of the original graph.
Calibration Procedure
Having the calibration data, we can adjust the scale according to the output of the annotated graph. It is actually an optimization problem. The target can be the KL divergence between outputs of original graph and annotated graph, and the adjustment method can be simply search-based or learning-based. There should be lots of room for exploration.

I am very interested in this problem, and I have a few different approaches I want to try out. However, I wonder if requiring intermediate results to be collected is too labor intensive or unnecessary. In the AutoTVM setting, we use domain specific features as they are powerful and allow for transfer learning. However, transfer learning is not as important in this setting, and it could be that blackbox features (e.g., just the scale configuration) may be enough to build a usable machine learning model (just as knob features are usable in AutoTVM). I think if that turns out to already work then we can save a significant amount of effort. It seems slightly expensive to compute both the original graph and annotated graph every time we want to do try a different calibration configuration, so I think it would be great if we could get away with doing even less work :).
I'll send updates on this approach as I get results. You may have already guessed that performance is important as I am first tuning the workloads required for quantization so trying many calibration configurations is not too slow.

FWIW we've got some experience with this kind of thing, and one observation is that you don't need a sophisticated calibration procedure — that is, simple L2-minimization (i.e. not L \infty i.e. min/max calibration) performs completely fine (on par/better than much more sophisticated algorithms). cf. https://github.com/pytorch/pytorch/blob/master/caffe2/quantization/server/norm_minimization.cc, etc.

Can we have a hard-coded quantile-based simple & quick solution for this feature as a first step? Then more reliable solutions (either search-based, or learning-based) can be added later, so that we can implement this feature in a progressive way.

@ajtulloch Haha, I was about to say that we have independently discovered the same thing. There is some literature that seems to try some more complex (or efficient?) methods (e.g., https://arxiv.org/abs/1810.05488) but I am not sure that the results are better than just plain old mean-squared error.
@liangfu #2753 is a WIP to add part of the support for this; basically the remaining steps, at a high level are:
[ ] profiling activation support (Relay makes this easy and I have an internal branch that does this)
[ ] per-channel scales (needed for MobileNet, possibly DenseNet)
The second part is a bit more involved as it essentially requires setting up/inferring the number of scales we need for each operator and then tacking them to the graph. It seems the data-aware calibration method will also require some API changes as it will be done after a first version of the graph has already been constructed, as it requires profiling the intermediate activations (e.g., to compute L2/MSE).

#3294 provides an initial implementation of data-aware calibration
Currently, the support focuses on vision models and likely makes many assumptions that will break down with other types of models. Similarly, part of per-channel scale rely on brittle heuristics, but we expect to improve these over time as we evaluate more models and understand more about the general patterns in quantization.
The previous quantization process used three passes: annotate, "calibrate" (which only calibrated weights), and realize, which materializes concrete domain scale compensations between layers and the required casts between int8 and int32.
At a high level, this PR changes the pass order/structure slightly to:

annotate (same as before, with a few additional properties of the graph captures, such as data layout). Data layout is important for inferring the number of channels and the channel dimension in data/weight tensors.
First calibration. This first calibration step calibrates weights as before, but also marks intermediate activations as outputs of the graph so that they can be profiled.
Profiling/evaluation: the network is executed on a small set of training data (currently on the order of a small mini batch or 32 samples) so that the intermediate activations can be profiled.
Second calibration. We use MSE to choose a domain scale to calibrate each of the profiled activations.
Scale matching (only for per-channel scale). Due to the fact that quantization relies on integer hardware, scales must match in the middle of a kernel. Here, we manipulate the per-channel scales to compensate for any differences after the multiply phase of the convolution and tune them so that scales are matched during accumulation.
realize is the same as before but can handle vector domain scales instead of scalar domain scales.

Some issues with currently include:

Inferring the correct number of channels and the channel dimension becomes very difficult with arbitrary data layouts.
Inferring the number of channels can also be tricky with a wide variety of operators and operator broadcasting conventions (e.g., how many channels should be given the constant tensor in an add(activation, constant) operator when the constant has shape (1,1000)?). In many cases, more than local information is needed.
Concatenating multiple tensors currently simply results in the maximum scales across all tensors being used with per-layer scales.
We require a dataset for calibration and a uniform API for passing this data. Currently, this is relatively straightforward for vision models (e.g., we can use MxNet format and MxNet iterators), but it is not clear how we want to support other domains.

I have implemented KL divergence based calibration (ported from MXNet) in my branch https://github.com/vinx13/tvm/tree/feature/calibration.
Similar to #3294, it first run on a few samples and collect profiles. Scales of activation are chosen to minimize KLD between original and quantized distributions.
Scales of weight can be either power-of-2 or taking maximum directly without rounding.
It also allows special handling of bias by introducing a new kind QAnnotateKind.BIAS. Some experiments showed that increasing nbits of bias from 8 to 16 can be helpful. But the optimal number of bits for bias is still unclear.
Currently it stored profile results in memory. This may cause memory issue when #layers or #samples in calibration set grow.
@eqy I plan to adopt to the calibrate interface in #3294 and prepare a PR.
Any comments are welcomed.

#3538 is now merged. @vinx13 @ZihengJiang  it would be great to create followup tutorials to demonstrate the usage of quantize pass.

closed by #3538 let us open new thread for tutorials