Increase persistence of T0 monitoring data in T0 WMStats

Impact of the new feature
WMStats, T0 WMStats
Is your feature request related to a problem? Please describe.
Currently, T0 monitoring info in WMStats  is only availalbe for a week after the workflow is completed. This is often not enough to properly study and debug processing issues. It also makes it impossible to use data from previous data taking to inform future operational decisions.
Describe the solution you'd like
We need T0 WMStats monitoring data to persist for longer and configurable amounts of time (6-12 months). This should be  as independent as possible of the management of T0 WMAgent itself (RucioInjector rules deletion, TaskArchival, etc).
Describe alternatives you've considered
Increasing the TaskArchiver.archiveDelayHours it's a possibility, but it would require modification of T0 block deletion logic, and probably  other unforeseen consequences in T0 Agent.
Additional context

If necessary, we could limit the increased persistence to workflows with processing issues (failed jobs, job progres<100%, etc)

Thanks for creating the issue @germanfgv. I'll take a look ASAP

I would suggest looking into a solution that only affects WMStats and not the agent itself (i.e. making workflow archival in the agent independent of archival of a workflow in WMStats).

Hmm, it looks like creating a new WMStats CherryPy thread - or use one of those data cleanup something - is the way to go here. I like this idea!

Just an update on this one here.
We did have a deeper discussion on the idea with @amaltaro and I also was digging deeper lately and confirming the concerns raised during this discussion. Basically there is a problem with having kind of a 'new meta state' in T0 WMstats, which is supposed to keep records in WMStats's couch with status archived for longer. On a first glance it could indeed be achieved by:

Adding few lines in the CleanUpTask CherryPy thread here, and make the deletion action be postponed by a configurable amount of time (e.g. having a config value of the sort: cleanUpTask.archivedCleanUpDelayHours.

But then this would have few consequences:

We are basically in sync with the agent's CouchDB, so the records need to be preserved there too. Meaning we would need a change in the WMAgent:  WMComponent/TaskArchiver/CleanCouchPoller here: because we sync

from wmagent_summary data
to wmstats

The other consequence would affect scalability. If doing the above we would have to also include all *-archived statuses in  updating the cache at DataCacheUpdate CherryPy thread not only active data as of now. And since *-archived are final states, this would lead to querying CouchDB for every single document that have existed since beginning of time (in this case since beginning of T0 database existence). Which will simply not scale.

I may be missing some details here and there, but this is more or less the big picture. I still have not given up on the idea of tackling things through this meta state of the workflows but it would involve also more tricks at least in dealing with the CouchDB replication between agents and central WMStats. Because the other path is to go through disentangling archival status from block level deletions through WMBS queries and internal states, as discussed in the related GH issue: https://github.com/dmwm/WMCore/issues/11042. This is a dangerous and risky path to follow. And I still do not want to enter Moria.
@amaltaro  please correct me if I have missed or mistaken something in the above description.
FYI @hufnagel @drkovalskyi

You seem to have summarized it well, Todor. I am not sure I understand what you mean by "meta state" though.
I believe the best way to deal with this would be:

we allow workflows to be archived as usual and at the desired delay
when WMAgent is cleaning up all its data, we skip data that gets replicated to wmstats (and we skip any direct deletion against central wmstats, if any)
we instrument the WMStats CherryPy thread to clean up everything for a given workflow once it reaches the waiting period

Actually, if the workflow has been archived, it will go out of the WMStats watch and we no longer can know - in a cheap way - for how long the workflow has been in that given state. I would have deleted this text above, but I think it's important to keep it here to make sure that we thought about it and that we concluded it wouldn't work.
It requires further thought, but maybe having a CherryPy thread to archive T0 workflows together with WMStats data cleanup would be the way to go here....

thanks @amaltaro

I am not sure I understand what you mean by "meta state" though.

We konow that archived means everything related to a workflow is out of the system. It was just a figurative speech (hence the quatation marks) about those workflows for which we forcefully keep information in the system even though their state means otherwise.

@amaltaro about:

Actually, if the workflow has been archived, it will go out of the WMStats watch and we no longer can know - in a cheap way - for how long the workflow has been in that given state

I think we do have access to this information. It can be fetched from the timestamp for the last workflow state transition:
https://github.com/dmwm/WMCore/blob/9bd8f6c52400a6264b3c07438c3deeddcf4a60ef/src/python/WMCore/Services/WMStats/WMStatsReader.py#L29
As  long as the workflow is still in WMStats this should be accessible, right?

@germanfgv German, coming back to the original issue. Can you please clarify the following:

This is often not enough to properly study and debug processing issues.

what type of debugging is this? Do we really need to have it set to 6-12 months? have you ever had a case where you had to come back 6 months to debug a workflow? can't we use the other logs available (at the schedd, site unmerged area, cmseosweb, and if needed, CTA once we retrieve this functionality)?

It also makes it impossible to use data from previous data taking to inform future operational decisions.

what kind of studies are carried here that depend on active WMStats information? is there any system/script/code consuming this information for anything?
Sorry for all these questions German, I'm just trying to identify the use cases and evaluate alternatives before more effort is put into this.

This issue needs to be closed, since the so requested functionality is about to be resolved with a different approach by - disentangling the block level deletion rules from the workflow status as widely discussed in the following issue https://github.com/dmwm/WMCore/issues/11042 And better picture visualized in this particular comment
The related PR should be:  https://github.com/dmwm/WMCore/pull/11127
FYI @amaltaro  @hufnagel @germanfgv


SmartContracts deployments are failing over the member node in besu network

Describe the bug
Smart contracts are only deployed on besu node with the address that are added to the RLP encoded string in extraData in genesis.json, i.e., the validator nodes. smartcontract deployments are failing on member nodes in besu.
To Reproduce
Steps to reproduce the behavior:

Edit the besu network.yaml
Edit the crypto generation of IBFT consensus
Modify the role Get node data from main.yaml role of blockchain-automation-framework/platforms/hyperledger-besu/configuration/roles/create/crypto/ibft
Try to deploy the smart contract over one of the member node.
`
Expected behavior
SmartContract should be deployed over the member node.

Chat link for the possible causes and direction.
https://chat.hyperledger.org/channel/besu-contributors?msg=jzYcYWNrz8BJvxgBk

Fixed with PR #1048 It seems like that the minimum gasprice was the issue. As we are not using gas for contract deployment it can be set to 0 so we don't need to give member nodes wei to deploy contracts.


clearify dco in pr_template, move pr_template to correct single pr_template folder

Besides clearifying the DCO in the pr_template, it also moves it the correct place for single issue PR templates. The current location would force the user send the template parameter, and we want to have this PR-templare show up without user intervention. For details, see the unclear official docs, or real life example at https://blog.axosoft.com/enhancing-pull-request-descriptions-templates/
closes #5

Låter bra, tycker jag. :+1:

Låter bra, tycker jag. :+1:


Error when initializing db

So I followed the docs
import LinvoDB from 'linvodb3';
import Level from 'level-js'; // had to this way due to my build process

LinvoDB.defaults.store = { db: Level };
LinvoDB.dbPath = dirname(remote.getGlobal('sharedStorage').dbPath);
const db = new LinvoDB('songlibrary', {}, {});

And what happens is I get a js error out of LevelUP when it's trying to setup the readStream

Uncaught TypeError: Cannot read property 'bind' of undefined
at new ReadStream (index.js:16)
at LevelUP../node_modules/linvodb3/node_modules/levelup/lib/levelup.js.LevelUP.readStream.LevelUP.createReadStream (levelup.js:274)
at Function../node_modules/linvodb3/lib/model.js.Model.buildIndexes (model.js:119)
at bagpipe.js:157

@cutterbl did you figure this out? I may end up going this route because the app I want to use this in is going to be built and packaged for multiple environments.

@rijnhard No, I never did.

the supported version of level-js is 2.x; do you have that version?

@lvshti Honestly, I stopped working that project months ago, Don't remember what we did, just know it was a different direction.


Feature/add continues context

Codecov Report

Merging #47 (6910f28) into master (0e9082c) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master      #47   +/-   ##
=======================================
  Coverage   97.15%   97.15%
=======================================
  Files          45       45
  Lines         422      422
=======================================
  Hits          410      410
  Misses         12       12

Impacted Files
Coverage Δ

lib/media_server/accounts/user.ex
100.00% <ø> (ø)

lib/media_server/continues.ex
100.00% <ø> (ø)

lib/media_server/accounts.ex
100.00% <100.00%> (ø)

lib/media_server/continues/episode.ex
100.00% <100.00%> (ø)

lib/media_server/continues/movie.ex
100.00% <100.00%> (ø)

.../media_server_web/components/continue_component.ex
100.00% <100.00%> (ø)

lib/media_server_web/live/continues_live/index.ex
100.00% <100.00%> (ø)

lib/media_server_web/live/home_live/index.ex
100.00% <100.00%> (ø)

...b/media_server_web/live/watch_episode_live/show.ex
100.00% <100.00%> (ø)

lib/media_server_web/live/watch_movie_live/show.ex
100.00% <100.00%> (ø)

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0e9082c...6910f28. Read the comment docs.

:tada: This PR is included in version 1.3.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Update devices.js (Added Calex RGB lightbulb)

Added Calex RGB lightbulb

Thanks!

And thanks to you too for zigbee2mqtt! ^^


Added absolute order to EntityType Keys, Foreign Keys, Indexes, and Navigations

Adding total order to address #1314 and fixing tests broken by this change.
@AndriySvyryd @bricelam @lajones

:shipit:

:shipit:

Updated for PR feedback, there are enough changes that it could use another look before I merge.

:shipit:

nice :shipit:


Update app and use Vendir, ABS

Huge PR
Use vendir to sync upstream
Update to latest upstream release
Enable snapshotter by default
Deploy CRD with HELM, not a job

Really hard to review. If it works, I'm fine with it.

I know... hopefully now it will be easier to maintain


post event not working on my app

this is simple broadcast receiver:
public class BroadcastConfiguration extends BroadcastReceiver {

    private Context context;

    public boolean connectionAvailable() {
        return ConnectivityTester.isConnected(context);
    }

    @Override
    public void onReceive(Context mContext, Intent intent) {
        context = mContext;

        RxBus.get().register(this);
        if (connectionAvailable())
            RxBus.get().post(new EventNetworkConnectionStateEvent(EventNetworkConnectionStateEvent.ConnectionState.connected));
        else
            RxBus.get().post(new EventNetworkConnectionStateEvent(EventNetworkConnectionStateEvent.ConnectionState.disconnected));
    }
}

this broadcast work fine and i can get log on onReceive method, now in activity i would like to get this event:
public class BaseActivities extends AppCompatActivity {
    ...
    @Override
    protected void onCreate(@Nullable Bundle savedInstanceState) {
        super.onCreate(savedInstanceState);
        ...

        registerReceiver(
                new BroadcastConfiguration(),
                new IntentFilter(
                        ConnectivityManager.CONNECTIVITY_ACTION));
    }

    @Override
    public void onStart() {
        super.onStart();
        sessionId = UUID.randomUUID().toString();
    }

    @Override
    public void onResume() {
        super.onResume();
        RxBus.get().register(this);
    }

    @Override
    public void onPause() {
        super.onPause();
        RxBus.get().unregister(this);
    }

    @Override
    public void onDestroy() {
        super.onDestroy();
        RxBus.get().unregister(this);
    }

    @Override
    public void onStop() {
        super.onStop();
        ...
        RxBus.get().unregister(this);
    }

    @Override
    public void onBackPressed() {
        super.onBackPressed();
        ...
    }

    public void connectionState(ConnectionTypes state) {
        switch (state.getState()) {
            ...
        }
    }

    protected void setRealTimeConnectionListener(connections listener) {
        this.connectionListener = listener;
    }

    @Subscribe
    public void onEvent(EventNetworkConnectionStateEvent event) {
        switch (event.getConnectionState()) {
            ...
        }
    }

    public interface connections {
        ...
    }
}

1 while you post a event, there is no need to register Rxbus (codes in BroadcastConfiguration).
2 There is no need to unregister the event in so many life cycle (destroy, stop, pause etc...)
3 BroadcastReceiver is in its own process, and rxbus can't deliver the event cross process, this maybe the main problem that activity can't receive the event.

@hwangjr for number 3, EventBus can be work fine in BroadcastReceiver or Service

Then you may check your code first, you unregister the event while activity pause, you can try to unregister in destroy.
and also, you should unregister the broadcast on destroy.

if you still have problem, the you can reopen this issue.


[stable/nginx-ingress] Fix missing api group in clusterrole

What this PR does / why we need it:
PR #15358 introduces new apigroup to ingress and ingress/status resource,
"networking.k8s.io" but only in the role template and not forgot in the clusterrole
template. Therefore the nginx-controller pod never becomes ready.
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[x] DCO signed
[x] Chart Version bumped
[x] Title of the PR starts with chart name (e.g. [stable/chart])

Thanks!
/ok-to-test
/lgtm


Run integration tests on Windows

Runs the same integration suite on Windows.
This is one way we can ensure Windows clients can process
results in the same way.
Signed-off-by: John Schnake<EMAIL_ADDRESS>

Closing; will consider what needs to be done on Windows but since automation of windows/mixed clusters in CI like github is a big hurdle we will probably just make a script to be run locally to run the tests on a periodic basis.


Kitematic for use with Docker for Mac, not with Virtual Box

Expected behavior
Is there a version of Kitematic to download that runs directly with Docker for Mac, rather than requiring Virtual Box and/or Docker Toolbox?
Actual behavior
All instructions say to download Docker Toolbox to get Kitematic, but you don't want to download that if you are using Docker for Mac right?
Information about the Issue
I swear I have had this working - Kitematic with Docker for Mac only, where I can see containers started with docker-compose up in Kitematic - but cannot recall where/how I downloaded Kitematic from to do that.  (setting up a new Mac)
Steps to reproduce the behavior

Search for ways to get Kitematic without Docker Toolbox
Cannot find

BTW Kitematic version is 0.12.0 and I got it by clicking the link in the Docker for Mac icon (the spouting whale icon at top of Mac window).  As I recall, a link to get Kitematic appears in a popup if you click the 'Open Kitematic" link in that Docker icon and you do not have Kitematic installed yet.
So anyhow...   shortly after I posted above I seem to have it running OK.
At first it was asking for Virtual Box to be installed.  I did that, as I needed it anyhow.  Then Kitematic would start, but showed none of the containers I had created with docker-compose up.  Guessing because it is looking for containers in the VM not in Docker for Mac.
Anyhow, I shut down Virtual Box and started Kitematic again.  It briefly shows the screen when it is starting up the VM, but then loads the main interface and I can see the containers I had created.  So, guess it's working for now.
I see Kitematic as sort of like a Git GUI - not necessary, since everything can be done on command line - but nice to have a visual of what's going on.

@rick02840 From the Whale menu in your mac status bar, you should see 'Open Kitematic' - If kitematic isn't installed, it will provide you with the proper download location.
Another way to do this is to download the DMG directly from this repo, under the https://github.com/docker/kitematic/releases

This installation requires docker toolbox for Docker Desktop.


check_argument_types is removed from typeguard library

Describe the bug
typeguard removed the check_argument_types function from the version 3.
Please see: https://typeguard.readthedocs.io/en/latest/versionhistory.html
To Reproduce
Train script (wenet/bin/train.py) fails with the error:
ImportError: cannot import name 'check_argument_types' from 'typeguard'
typeguard documentation says:

BACKWARD INCOMPATIBLE Removed the check_argument_types() and check_return_type() functions (use @typechecked instead)

I'm not sure what you will choose, I can send a PR chaning the requirements.txt with typeguard==2.13.3. It is the latest version that is used in wenet.

In version 2.2.0, I also encountered this problem while training Squeezeformer. It may be necessary to downgrade the version of Typeguard. I am still trying it out.


Add destroy method

When I destroy my plugin that uses RecordRTC prints this to the console:
Unable to stop the recording. Recording state:  stopped

I couldn't find a proper destroy method, is it possible to add one that (at minimum) stops the recording process?
I need one that is not async..

As a quick workaround, you can try this:
recorder.state = 'recording';
recorder.stopRecording(function() {
    //
});

BTW, I'll add destroy method in the next commit, soon.

Thanks for the quick reply. Also add it to MRecordRTC while you're at it ;)

thanks, seems to work fine. A new npm release and I'm good to go.


Value not defined for each token

The Amazon style dictionary requires a value key in order to create its various outputs. Would you consider having a value key in each token that the plugin outputs? Theo also requires that key.

This is good point. I have to add another selection for Amazon style dictionary output style.
I will add this to my to-do list.


rocksdb compilation fails with fatal error: 'stdarg.h' file not found

I tried to run cargo install oxigraph_server but the installation failed with:
error: failed to run custom build command for `oxrocksdb-sys v0.3.7`

Caused by:
  process didn't exit successfully: `/tmp/cargo-installA1C1RJ/release/build/oxrocksdb-sys-7e1079602337d3f3/build-script-build` (exit status: 101)
  --- stdout
  cargo:rerun-if-changed=api/

  --- stderr
  api/../rocksdb/include/rocksdb/c.h:65:10: fatal error: 'stdarg.h' file not found
  thread 'main' panicked at 'unable to generate rocksdb bindings: ClangDiagnostic("api/../rocksdb/include/rocksdb/c.h:65:10: fatal error: 'stdarg.h' file not found\n")', /home/martin/.cargo/registry/src/github.com-1ecc6299db9ec823/oxrocksdb-sys-0.3.7/build.rs:28:10
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...
error: failed to compile `oxigraph_server v0.3.8`, intermediate artifacts can be found at `/tmp/cargo-installA1C1RJ`

I am on Debian 11.

Hi! Thank you for trying Oxigraph. This looks like a C++ compile error on RocksDB (Oxigraph statically links RocksDB). The error message seems to state that the used C++ compiler (taken from the CXX env variable) does not know how to find the C standard library. Have you tweaked the CC and CXX env variables?
There is, for reference, the documentation of the Rust wrapper on top of C/C++ compilers that is used during Oxigraph build/

Hi :) No I have not tweaked those environment variables.

Thank you! Is the build-essential deb package installed? In the meantime you might just try the last release pre built binary. It should work with Bullseye.

Yes I have build-essential installed. And yes thanks that binary does work.

Thank you! It's weird. It seems to be related to a compiler configuration issue but I'm not sure how to fix it: https://stackoverflow.com/questions/20206290/fatal-error-stdarg-h-file-not-found

@not-my-profile I think it would be interesting to try building RocksDB itself on the system in question, following e.g. https://github.com/facebook/rocksdb/blob/main/INSTALL.md, to figure out if the incompatibility is with RocksDB's build system of with how the Rust wrapper drives it.

Good idea! Yes running make or make static_lib in the RocksDB repo works flawlessly.

Thank you! So, the problem seems related to the cc crate.


Improve help texts/labels in "Add API" wizard

Need to make sure it is easy to understand what all the wizard properties do / how they work - either with inline descriptions or with links to the documentation

redesigned in the new version


Drastically improve performance by implementing FormState getters

This PR borrows a trick from React Hook Form to lazily initialize the values of the isTouched, isValid, isDirty for the form accumulator state to drastically improve performance.

Closes #25

@all-contributors please add @crutchcorn for test


Dynamic routes with Supabase?

Is it possible with the supabase module, to get the data from there, to implement as dynamic routes?

You can totally do that by :

creating a dedicated api route, let's say /api/sitemap
query all the data you want inside that event handler and return you routes from there
use the routes param in sitemap config and query your previously created endpoint

{
  routes: () => $fetch("/api/sitemap")
}


implement magnolia hardfork

Purpose

evm pr:
https://github.com/Taraxa-project/taraxa-evm/pull/170
How does the solution address the problem

Changes made

replaced by https://github.com/Taraxa-project/taraxa-node/pull/2545


Update content on duns number button

Summary
I didn't update the content on the button as per the prototype.
Ticket
https://trello.com/c/ae5UzOAn/39-sign-up-flow-update-copy-on-duns-number-page

We could change you will to you'll - just spotted that. @karlchillmaid any final 2i comments?


Istio e2e test cases fails when istio bumped to 1.22.0

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
When the istio version is bumped from 1.21.1 to 1.22.0, the TestIstioWithKongIngressGateway fails with the following message:
    istio_test.go:208:
        	Error Trace:	/home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/test/e2e/istio_test.go:208
        	Error:      	Condition never satisfied
        	Test:       	TestIstioWithKongIngressGateway
        	Messages:   	eventually metrics data for successful requests should start populating in kiali

The tests against other istio versions passes (1.17.8~1.21.2).
Expected Behavior
Istio tests passes.
Steps To Reproduce
Run istio tests with the command
ISTIO_VERSION=1.22.0 KONG_LICENSE_DATA=$KONG_LICESEN_DATA NCPU=1  make test.istio

Kong Ingress Controller version
latest nightly

Kubernetes version
1.29.4

Anything else?
Maybe some configurations should be added to configure istio?

Reverted the bump for a temporary fix.


Fix watchlist check / uncheck all by reworking it completely

There is a JavaScript error on the watchlists page but the simple fix revealed a few other issues. As a result I decided to have a go at reworking it completely.
A slight imperfection is introduced in that the "master" checkbox appears after the page is rendered. This may be fixable but the checkbox should not be present when JavaScript is disabled.
NB: I still need to configure my editor to handle tabs but I can fix that while you review the actual code.

I rebased the commits on this branch, added a commit then merged it: https://github.com/r04r/Minichan/compare/7b107f9a1b7d...03947c80e9e3


I177 weight engine value errors etc copy

Weight Engine can now deal with NaN inside the data, this includes:

cells with np.NaN
completely absent codes
empty intersections

Also:
The weight target codes do not any longer need to be consecutive, however, this changes the way targets must be set up: this is now done  via a list of dicts that map column names to dicts that map codes to proportions.

This PR resolves #177,


chore(ui): Flatten nested keys on calls table

Description

Before
After

Flattens the headers in buildDynamicColumns so there will be max-3 dynamic headers.
The middle keys will be flattened into a string with dot notation (this is to avoid really large headers for customers passing nested data).

Fixed FeatureBee link: https://beta.wandb.ai/?betaVersion=4227d5494b8a3e8795469c888d8495b9726b74da

Design feedback:

For objects with multiple levels, only the parent will be showing in the header.
Solutions:

Try overflow-truncating from different areas.
Experiment possibly allowing one more level (so it'd be the level under inputs, outputs, attributes)


Docs: added huggingface Datasets integration guide

Docs: add a guide on how to load/save HuggingFace Datasets to a lakeFS repository.

[!IMPORTANT]
Keeping this as draft for now, until https://github.com/aai-institute/lakefs-spec/pull/274 is merged and published (required for the Datasets integration to work)

Hey! We just released v0.8.0 with your change, see https://github.com/aai-institute/lakefs-spec/releases/tag/v0.8.0 . Hope this unblocks you guys, please reach out if there's more we can do.


Enhance travis file

runs the tests and flake8 in separate builds, cache the pip dir for
faster builds, names the tests so its easier to check them
Note: Will not work yet as its missing the nosetests lib as provided in https://github.com/SUSE/psql2mysql/pull/35
~~Once that gets in, this should pass ~~
Disregard that, I was missing an s in the nose command :1st_place_medal:

hm, needs a rebase I guess.

@rhafer done!

Updated to remove the special install for flake8 as @aojea mentioned. In the end we will still be waiting for the tests to run in order to have a green travis check so we dont really save that much time, plus with the cache is now really fast to install deps so it makes no sense to have that.


Pulled call MAPL_GridGetCorners out of the condition to avoid hang in…

… MAPL_GetGlobalHorzIJIndex

Pull MAPL_GridGetCorners out of conditional block to avoid hang
Description

Related Issue

Motivation and Context

How Has This Been Tested?

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Trivial change (affects only documentation or cleanup)

Checklist:

[x] I have tested this change with a run of GEOSgcm (if non-trivial)
[x] I have added one of the required labels (0 diff, 0 diff trivial, 0 diff structural, non 0-diff)
[x] I have updated the CHANGELOG.md accordingly following the style of Keep a Changelog

This PR fixes issue #2069

I've pulled in the latest from main and have updated the CHANGELOG and CMakeLists for a release once I test this.


chore: bump to TypeScript 4.1.2

Description: What it says in the title.
Related issue (if exists): None

Regarding the CI failure, see #5898.


x/net/http2: block when Transport hits max concurrent streams

Currently if the http2.Transport hits MAX_CONCURRENT_STREAMS for a host, it just makes a new TCP connection and creates the stream on the new connection instead.
We should probably just block the application and chill out for a bit, waiting for the host to be happy again.
We're probably respecting the letter of the spec more than the spirit of the spec.
/cc @bmizerany

Relevant code:
func (cc *ClientConn) canTakeNewRequestLocked() bool {
        return cc.goAway == nil &&
                int64(len(cc.streams)+1) < int64(cc.maxConcurrentStreams) &&
                cc.nextStreamID <<PHONE_NUMBER>
}

@bradfitz @bmizerany Whose role is it to decide what the right behavior is here?
(My 2¢ is that we shouldn't build in any hidden rate limiting to the client; it's up to the user's code or the remote server to rate limit or block new connections.)

Usually I end up making decisions about HTTP, but often after various people express their opinions. Mine is that we should be polite by default and respect specs, unless the user configures otherwise.
Related bug: #13957

It sounds like this might help for a scenario I'm working on. My client library receives an initial Settings frame with SettingMaxConcurrentStreams = 1 and once the connection is authenticated, receives SettingMaxConcurrentStreams = 500.
logged via: https://github.com/golang/net/blob/master/http2/transport.go#L1735
My initial thought was to gain access to the settings data via some API (possibly like httptrace?). Then I could manage the number of goroutines sending requests. Blocking all the requests currently in flight could actually work better though. I'd be curious to try it out.

 It's relatively low priority compared to other open stuff, and not really a problem in practice. Also, http1 already has the as-many-conn-as-requested issue, and I'd like to make their two behaviors match, which makes this more work.

/cc @tombergan


⚠ Jenkins Plugins Artifactory has degraded performance

In c81b6f2, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1286 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 1879b06 after 18 minutes.


Processing stalls

So, I want to include several files into my document, 1, 2, 3, 4, 5.
If I include (1, 2) or (3, 4, 5), I get the resulting PDF in 10 seconds. It is 1 megabyte large and the process uses 65 megs of RAM max.
If I include (1, 2, 3, 4, 5), the process reaches the same ~65 megs over the same 10 seconds and then does nothing indefinitely, slowly consuming more RAM.
What can be done with it? Again, it is latest alpha 9 version and I'm on Windows. I have no Ruby experience and have no idea how to approach this.

There are several reasons that the PDF generation consumes so much RAM, but 90% of the time it's processing PNG images. The first thing I recommend is to turn off all images (messing with the imagesdir path) just so that you can determine if that's where the time is being taken up.
Aside from that, I need access to the documents in order to test them or I can only guess what the problem may be. Would you be able to provide me with the source documents?

OK, I figured it out. The file numer 2 had four dots in the beginning of the line almost at the end, so presumably its end and files 3, 4, 5 were treated as a huge literal block.
I've put files to https://github.com/orloffm/testbook/ if you need them.

Good to hear!


Made README.md all pretty

Have a slightly more pretty README.md :smile:

Local links to the repo, genius


[KYUUBI #1889] Improve the user experience of the configuration parameters of the document

Why are the changes needed?
https://kyuubi.apache.org/docs/latest/deployment/settings.html
The configuration parameters in the document are too long and a newline is inserted(
), which makes it difficult to search.
And if the user copies the configuration parameters, it may become several lines.
Use  to replace
.
https://github.com/apache/incubator-kyuubi/issues/1889
How was this patch tested?

[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[x] Add screenshots for manual tests if appropriate

[ ] Run test locally before make a pull request

current

fix

Could you please give a full-page screenshot?

I remember there are other places in docs/ also use
, please also change them to make the doc consistent

Codecov Report

Merging #1890 (2f9c7e0) into master (b952b7b) will increase coverage by 0.06%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #1890      +/-   ##
============================================
+ Coverage     59.69%   59.75%   +0.06%
- Complexity      316      321       +5
============================================
  Files           290      291       +1
  Lines         14223    14234      +11
  Branches       1804     1805       +1
============================================
+ Hits           8490     8506      +16
+ Misses         5009     5003       -6
- Partials        724      725       +1

Impacted Files
Coverage Δ

...he/kyuubi/engine/trino/operation/GetCatalogs.scala
90.00% <0.00%> (ø)

...kyuubi/engine/trino/operation/TrinoOperation.scala
49.01% <0.00%> (+9.80%)
:arrow_up:

...engine/trino/operation/TrinoOperationManager.scala
50.00% <0.00%> (+13.63%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b952b7b...2f9c7e0. Read the comment docs.

Now I increased the max-width of the content to avoid the horizontal scrollbar.

I remember there are other places in docs/ also use
, please also change them to make the doc consistent

After looking for it, I only saw the metrics.md file, which is a table written by hand, and it was also modified.

great improvement ! merging to master


Sticky Scroll: Python - Sticking to Function Decorator instead of Function Declaration

Steps to Reproduce:

Create a Python function with a decorator
Scroll to start the sticky scroll

Version: 1.70.0 (user setup)
Commit: da76f93349a72022ca4670c1b84860304616aaa2
Date: 2022-08-04T04:38:16.462Z
Electron: 18.3.5
Chromium: 100.0.4896.160
Node.js: 16.13.2
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.19044

/duplicate

Thanks for creating this issue! We figured it's covering the same as another one we already have. Thus, we closed this one as a duplicate. You can search for similar existing issues. See also our issue reporting guidelines.
Happy Coding!


Add CosmWasm tooling from Terran One

Added entries to cosmwasm-vm-js and CWSimulate.

Just saw there was a conflict with other PR.
Please rebase and I will merge


Update API.md

Documentation for the texture() constructors says to use unpackAlignment to configure the GL_UNPACK_ALIGNMENT value. However, according to https://github.com/regl-project/regl/blob/gh-pages/lib/texture.js#L553 the property alignment should be used.

This change is

Comments from Reviewable

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable

👍


pyquil-config-setup script does not work

The python 3 compatibility code in pyquil/setup/config.py seems to be wonky.  The try/except block can't be inside a function body for that to work. A better alternative: delete the try/except check and add ...
import six
input = six.moves.input

@gecrooks Thanks for reporting this. Would you mind wrapping your suggestion into a PR and submit it?


Conflicting dependencies

I got this error on IntelliJ
Cannot access class 'org.bukkit.command.CommandSender'. Check your module classpath for missing or conflicting dependencies
and it's turn out to be error on every Bukkit & Spigot dependencies

It's a problem with your build script. Please see: https://docs.gradle.org/current/userguide/dependency_downgrade_and_exclude.html#sec:excluding-transitive-deps


fix(MCap): Remove robustness when robustness value is default

Fixes https://github.com/shaka-project/shaka-player/issues/4659

@joeyparrish The tests are failing, I'm investigating why

@joeyparrish At the moment, I believe that the current tests cover the necessary cases.


Sign in with Apple issue

Sign in with Apple inserts a cryptic string as userIdentifer, username unknown and full name unknown with no email and image URL in the user_info table.
I believe I have my project configured correctly on Xcode.

User info table

final user = await signInWithApple(
    BackendService.instance.client.modules.auth,
);

Hey @binemmanuel.
What is returned from the call to signInWithApple? If you debug the code on the flutter side and jump into the signInWithApplecall and follow the code step by step. Do you get the full credentials after the call toSignInWithApple.getAppleIdCredential`?

Did you sign in multiple times, like testing to sign in and then delete the account and sign in again?
Apple will only provide the name and email on the first sign-in, see https://developer.apple.com/forums/thread/121496.

I was in the apple forum and discovered that it is an Apple thing to send the credentials once and only when the user signs in for the first time, while subsequently only the identifier will be returned. I was puzzled because this isn't common to other providers.
So, a solution for if you didn't save the data or if you deleted em from the database like my case then you'll have to go to your Setting > Sign-in & Security > Sign in with Apple to stop Sign in with Apple.


Pulling in github package gets stuck.

I have two packages that are just stuck at the synchronising part form github. One has been there for a few weeks and I have since recreated it with the same repo. I tried to create the other earlier and it's doing the same thing.
Organisation name is hrpr
Thanks Dan

I will take a look but workers are working correctly ... maybe some kid of bug :thinking:

Looks like you have duplicated packages in your organization ... please remove them and add again with different name

Reopen if thats not the case :wink:


move pouchdb-admins from dev to main dependency

fixes https://github.com/hoodiehq/hoodie/issues/491

ping @hoodiehq/maintainers for sanity check after merge. But going ahead and fixing it as it’s currently affecting all new hoodie installs.


Wrong time var used for timestamps

Wrong time var used for timestamps, caused by typo

@miq-bot assign @agrare

@miq-bot add_label bug


codestart fails when creating project and breaks code.quarkus.io

quarkus create app -x github-action xyzdkdk
-----------
selected extensions:
- io.quarkiverse.githubaction:quarkus-github-action

[ERROR] ❗  Unable to create project: Error while rendering template: /codestarts/quarkus/quarkiverse-github-action-codestart/base/action.docker.tpl.qute.yml

which is cause of https://github.com/quarkusio/code.quarkus.io/issues/1231

Hmmm. This is weird, there was an issue at some point but I thought it was fixed.

Ah no, so actually, that's expected.
Because you need to push some additional data: https://docs.quarkiverse.io/quarkus-github-action/dev/create-github-action.html#_initialize_your_quarkus_application .
It's mandatory because your project won't work that fine if you don't do that. We could do without the name and use the artifactId, description is optional but in any case you would need to provide the repository you're publishing it to.
Now maybe the GitHub repo could be obtained when we actually push the project to a GH repo (@ia3andy explained me that in this case, we were enabling a specific codestart so we might have the GH repository name handy?)
@ia3andy WDYT?
Maybe we should remove this extension from code.quarkus.io for the time being.

okey, but codestarts also shouldn't really require setup as then they are not possible to use from code.quarkus, cli or IDE.
removing it from code quarkus means its hidden -would a non-optimal but better compromise not be to have a default value for that property? "replace/me" or similar with note in the generated readme?

okey, but codestarts also shouldn't really require setup as then they are not possible to use from code.quarkus, cli or IDE.
removing it from code quarkus means its hidden -would a non-optimal but better compromise not be to have a default value for that property? "replace/me" or similar with note in the generated readme?

We only have the Github name if it's pushed to GH from code.quarkus.io, but this is an edge case, so better do what Max is suggesting.


Code refactoring for test area

I think it would be useful to consolidate codebase from test/migration_test.go and test/integration_test.go, e.g. the former uses dbsServer which I borrowed from latter runTestServer. Since these and other functions, like newreq,  initTestLimiter, parseURL, verifyResponse, responseToRecord are common and will be used in both test files I suggest to put consolidate these functions and put them into test/main.go which holds for now initDB (used across all tests).

Dennis, thanks for prompt action, closing this issue.


Updated clustertest with support for unified cluster-vsphere app.

What this PR does

Updated clustertest with support for unified cluster-vsphere app.

Checklist

[x] Update changelog in CHANGELOG.md.

Trigger e2e tests

/run cluster-test-suites

Failed with single flake from unrelated provider. Adding skip label


[BUG] Codeowner files with Giltlab nested teams not parsed properly

Example of codeowner file:
* @group-x/subgroup-y/subgroup-z
throws invalid owner format '@group-x/subgroup-y/subgroup-z' at position 3
Gitlab docs:
https://docs.gitlab.com/ee/user/project/codeowners/#add-a-group-as-a-code-owner

I just merged https://github.com/hmarr/codeowners/pull/19 — you should be able to get around this issue using WithOwnerMatchers


Update to pylint 2.2.2. Pretty format markdown.

You can view the rendered output.

Thank you for your contribution.


[WIP] @orta => Adds tests for Stripe.

Try not to merge it before I'm read this time :stuck_out_tongue:
Adds tests for #438.

It's really just ManualCreditCardInputViewModelTests.swift for now.

This is good for review. Sorry I didn't get to this sooner – this trip has been weird.

Adds 54 tests, which is not bad. I'm happy.

Looks good


Animation seems fragmented and accelerated when using flexGrow (iOS only)

Description
I am using a Lottie animation in a simple page with only text elements. I've noticed that when I use a flex-grow styling, the animation isn't displayed well on iOS. It seems very accelerated and fragmented. On Android it is fine. I could easily reproduce this behavior with several animations.
Removing the flex-grow styling fixes the issue.
<LottieView
  style={{
    flexGrow: 1
  }}
  autoPlay
  src={require("path/to/my/file")}
/>

Steps to Reproduce

Add a flex-grow styling to a LottieView

Expected behavior: The animation works well on Android and iOS
Actual behavior: The animation isn't displayed correctly on iOS
Versions
"react": "16.9.0",
"react-native": "0.61.4",
"lottie-ios": "3.1.3",
"lottie-react-native": "3.3.2"

When I use flex layout, I also got this bug, and the loop does not work too

@apetitje @Mollet-Yuan It is fixed by v3.4.0 release.
Please try again after upgrading to v3.4.0 ☺
import React from 'react';
import LottieView from 'lottie-react-native';

export default class App extends React.Component {
  render() {
    return (
      <LottieView
        source={require('./animation.json')}
        autoPlay
        loop
        style={{flexGrow: 1}}
      />
    );
  }
}

v3.3.2
v3.4.0

@emilioicai Thank you for closing Issue and upgrading to v3.4.0 :tada:

Thanks for your help closing issues @tamago3keran  :)


enabling navic or treesitter as winbar provider breaks a lot stuff with noice

enabling navic or treesitter
and try some :commands

it seems like there are some duplicates ( maybe bcz we are using https://github.com/Tastyep/structlog.nvim and multiple sinks)

also it seems like the only issue is with packer no?

found the issue, will do a commit here and also a fix in lunarvim

after https://github.com/LunarVim/LunarVim/pull/3221/files gets merged, i can push my fix and it will be fixed


Updated visit creation rules

Codecov Report

Merging #70 (a331836) into main (004b864) will decrease coverage by 14.80%.
The diff coverage is 20.23%.

:exclamation: Current head a331836 differs from pull request most recent head 8e879dd. Consider uploading reports for the commit 8e879dd to get more accurate results

@@             Coverage Diff             @@
##             main      #70       +/-   ##
===========================================
- Coverage   28.13%   13.33%   -14.81%
===========================================
  Files          24       18        -6
  Lines         654      585       -69
  Branches      181      193       +12
===========================================
- Hits          184       78      -106
- Misses        416      442       +26
- Partials       54       65       +11

Flag
Coverage Δ

backend
?

frontend
13.33% <20.23%> (+4.12%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

frontend/src/components/EventForm.js
0.00% <0.00%> (ø)

frontend/src/components/EventPage.js
0.00% <0.00%> (ø)

frontend/src/components/LoginForm.js
0.00% <0.00%> (ø)

...ontend/src/components/LumaTagInput/LumaTagInput.js
40.62% <ø> (+0.41%)
:arrow_up:

frontend/src/components/UserForm.js
0.00% <0.00%> (ø)

frontend/src/components/UserList.js
0.00% <0.00%> (ø)

frontend/src/components/UserPage.js
0.00% <0.00%> (ø)

frontend/src/components/VisitForm.js
0.00% <0.00%> (ø)

frontend/src/components/VisitPage.js
0.00% <0.00%> (ø)

frontend/src/components/Filterform.js
68.75% <68.75%> (ø)

... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dee8368...8e879dd. Read the comment docs.


Dynamically generate conf.py with jupyter-book and remove from repo

Re: https://github.com/readthedocs/readthedocs.org/issues/9405
I've tried to run this locally and it seems to work.

Thank you very much, I really appreciate it.
I applied the patch to a test repo that publishes the documentation to Read The Docs and has the same structure of my Suite8080 project. But on Read The Docs with it fails to build the same error.

Something is wrong with how you applied this change in your test repo. Your old conf.py is still there.

You're right, conf.py was a leftover file from a local build. Removing conf.py from the repo does make the Read The Docs build complete successfully. However, the published documentation is missing the content of my repo, displays a Sphinx project placeholder, and doesn't have the Jupyter Book style.

However, the published documentation is missing the content of my repo, displays a Sphinx project placeholder, and doesn't have the Jupyter Book style.

At a quick glance, it looks fine? I don't see any placeholders?

This is what the published documentation looks like to me:

Instead, I would expect the home page to have this text and this formatting style.

Let me get back to you, need to figure out why the pre_build step hasn't been run.

Defining the version of the config file makes the build of the test repo fail with the error ERROR: Directory '.' is not installable. Neither 'setup.py' nor 'pyproject.toml' found.

AFAICT, this error is "legitimate" in your test repo because the test doesn't have the setup.py that your other repo has:

The application has to be installed in the documentation environment because of the auto-generated reference in reference.md.

Adding setup.py to the test repo made the Read The Docs build complete successfully. Now the published documentation. Has the intended content and style.
Thanks @benjaoming @humitos!

This is really great to hear! We are doing everything we can to ensure good support for Jupyter Book, happy to hear back from you and thanks for getting in touch :100:
AFAICT, this PR should align well with the contents in your test repository and should thus be ready to merge.

@benjaoming I merged the patch to the main Suite8080 project and Read The Docs built the documentation successfully. Your solution has the added benefit of not requiring manually editing conf.py to adjust the path and let sphinx.ext.autodoc find the Python source.
Thanks again!


[Bug] --report-name lost it's default

chainsaw version Version
v0.2.9
Description
Chainsaw is not using report-name default value
Steps to reproduce

Call chainsaw test --config=config.yaml --no-color  --values=environments/${env.ENVIRONMENT}/chainsaw-values.yaml --report-format XML --report-path=.
After completion it creates file </>.xml instead of previous (<=0.2.8) chainsaw-report.xml

Expected behavior
Without passing --report-name report file should be named chainsaw-report as before.
Screenshots
No response
Logs
No response
Slack discussion
No response
Troubleshooting

[X] I have searched other issues in this repository and mine is not recorded.

Thanks for reporting, will fix asap!

That was fast, thanx


Fix mysql memory usage

mysql was running up 25% of memory under docker this change reduces it to more like 14%.

I think I'll refactor this to avoid the impact of renamin. Can always exec manually to get a shell if needed.

No idea on the settings, but if it doesn't clobber things r+


Load files to playlist and load files on start create duplicate files on playlist

When creating a playlist either manually or automatically create duplicated entries after all correct entries are appended. I have attached an image for reference. You can see episodes 2,3,4,5 append after episode 5, when adding files, it says it added 4 but shows it added more than that.

Seems like this lookup is the issue https://github.com/jonniek/mpv-playlistmanager/blob/a8d7f452aa61b1a9efb165b8baaaa4bec50b72d3/playlistmanager.lua#L1094-L1095
Maybe it's comparing filenames with paths in some cases :thinking:


Counter test inconsistencies

Issue
The counter test is not accurate.
Reasoning
Most higher end obfuscators add transient or cached fields. This is inconsistent with the test's logic. Instead, the test should check if the cached reflection fields are transient or synthetic to ensure these don't get added to serialization logic and so forth. Furthermore, the order of fields should be checked as any change in order will cause breaking changes in reflections. Order should be maintained.

Thank you for pointing that out! Well, this test is made because I am a Minecraft dev. When making a packet-interpreting plugin, say a packet-based anti-cheat, there can be classes to be serialized while having no flags.
It's should be noted that while this repo is intended to work as a general bench, you may add configs to the obfuscator when making a demo for the provided jar.
As for the orders, you do have a good point. I will fix that in a further version.

Thank you for pointing that out! Well, this test is made because I am a Minecraft dev. When making a packet-interpreting plugin, say a packet-based anti-cheat, there can be classes to be serialized while having no flags. It's should be noted that while this repo is intended to work as a general bench, you may add configs to the obfuscator when making a demo for the provided jar. As for the orders, you do have a good point. I will fix that in a further version.

Oh yeah I've done anticheats. I know what you mean. The transient and synthetic flags should be sufficient. For example, GSON skips any transient field, making it compatible with 99% of serialization libs.

Kinda beyond my knowledge D:
Would appreciate if you make a PR for this


How to Connect to Aurora RDS MySQL Database with DataGrip

I'm having trouble connecting to the MySQL database with JetBrains DataGrip, here are the "Data Source Properties":
GENERAL
Host: (My Cluster Endpoint)
Port: 3306
Database: (My Database Name)
User: (My Database Username)
Password: (My Database Password)
URL: (My Cluster Endpoint):3306/(My Database Name)

SSH/SSL
Use SSH Tunnel: FALSE
Proxy Host: Undefined
Proxy User: Undefined
Auth Type: Undefined
Proxy Password: Undefined
Use SSL: TRUE
CA File: Undefined
Client Certificate File: Undefined
Client Key File: (My_Security_Group_PEM_File.pem)

I can't figure out what I'm doing wrong here, please help.

Jimmy, I expect you are connecting remotely, from your own PC or Mac.  The default Firewall rules will not allow Database access directly from the internet (this is almost never wise).  However, the tool you are using appears to have SSH tunnel support.  You should be able to use a Bastion host to reach the database.
Try;
Use SSH Tunnel: True
Proxy Host: Bastion Host/ Public IP
Proxy User: ec2-user
Auth Type: SSH Key
Proxy Key: My_Security_Group_PEM_File.pem (assuming this allows access to the Bastion)
Don't use SSL as this is Client certificate authentication, which is not used in this case.
For the database itself you should use password access, with the database username and password you chose when launching the templates.


explain post naming convention

If the post filename is postdated, the post will not be "published" until that specific date. For instance, you wouldn't want to post date a meeting announcement because it wouldn't be visible until day of.  _helpers/new-post.sh solves this by automating the process however this should still be documented since everyone isn't familiar with Jekyll.

the date in the post filename (i.e. 2016-03-16-foo_bar.md) is the publication date not the meeting date

documented in wiki


vendor: opencontainers/go-digest v1.0.0

full diff: https://github.com/opencontainers/go-digest/compare/v1.0.0-rc1...v1.0.0

@manishtomar @dmcgowan @arkodg ptal


Support environment variables for setting scrape interval

Is your feature request related to a problem? Please describe.
I'm always frustrated when trying to set interval for windows agent
Feature Description
I would like to set interval in file nri-kubernetes-definition.yml or nri-kubernetes-definition-windows.yml through env var for container like NRIA_LICENSE_KEY
Describe Alternatives
To have possibility to edit files inside the image.
Additional context
Try to change interval for calling new-relic
Priority
Really Want it

Maybe this relates to this issue here (https://github.com/newrelic/nri-kubernetes/issues/83) but it seems like the helm chart does not support settings this value right now.
See NewRelic forum post: https://discuss.newrelic.com/t/configure-polling-interval-for-kubernetes-integration/140289/4?u=sergej.herbert
So, is setting the scrape interval not possible at all right now when deploying via the helm chart?

thanks @fr-ser  as you point this is related to #83 and also to this issue on the helm-chart repo.


This is caused by https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/custom-error-pages-expiration.html

By default, when your origin returns an HTTP 4xx or 5xx status code, CloudFront caches these error responses for five minutes. CloudFront then submits the next request for the object to your origin to see whether the problem that caused the error has been resolved and the requested object is now available.

h/t @tomcrane
If we want to change this, we'll need to tweak the cache (although it's created invisibly by API Gateway – possibly sending origin headers might be best?).

Closing as WONTFIX. In normal use a 5 minute delay is acceptable.


Spoiler on line wrap makes some strange pink field

 Ok on start
 Shown on click on spoiler

Also hides on any click out of spoiler

Seems it's effect of @color/accent and I dont know what to do with that


Small request.

Can you add my current client to the clients section? Currently only supports protocol 4, a bit broken on protocol 5 (as it can only support 5 on OgarServ).
http://abs0rb.me/?ip=yourIP:port (same as Agar.io)
Planning on supporting protocol 5 very soon. :)

OMFG ITS MAKAN!!!

YOUAGAR???


Blue Screen of Death before fuzzing

Hi @jchoi2022 ,
I encountered the BSoD problem when enter this command: python C:\Launcher\hooker32.py
I am sure the testing VM windows version matches the dll being statically analyzed. They are both Windows 17134.1 32bit. At first I used your provided dlls for 17134.1 but failed. Then I tried to extract the dlls directly from the windows system in the VM and modified the script accordingly but still failed at this stage.

I also tested on Windows 10 18362.30 build. The same error occur. After investigation, I found the root cause is line 120 in Poison.cpp: *(PCHAR)exAllocAddr = '\xe9'; This line introduces a "attempted_write_to_readonly_memory" error in core dump. I checked the offset generated in VersionConst.h, it seems that all the offset (exallocatepoolwithtag, _KeServiceDescriptorTableShadow, and syscall num have no error.) Still working on the solution.

Problem solved. I added those lines before line 120 in Poison.cpp:
_asm
{
cli;
push eax;
mov  eax, cr0;
//mov  uAttr, eax;
and eax, 0xFFFEFFFF; // CR0 16 BIT = 0
mov  cr0, eax;
pop  eax;
};
These lines enables write permissions to the ExAllocatePoolWithTag memory.

Hi, I'm sorry for the late reply, I was really busy for a while.
Thank you for reporting and solving this issue. I could not observe this symptom in my environment, but it seems my implementation for heap memory poisoning indeed has some unstable points. I may have to consider disabling the memory poisoning functionality by default.
Anyway, thank you again for reporting the issue! I will leave the issue open until I make the decision and update the code.


GitHub projects and milestones

https://stackoverflow.com/questions/39591795/what-is-the-difference-relationship-between-github-projects-and-milestones/45702763

Milestones

Linear progress
Due date
One issue could be assigned to at most one milestone only
Represents a concrete goal like reaching version v1.0

Projects

Kanban/cards UI as well as linear progress.
No due date
One issue could be assigned to multiple projects.
Represents a task with many mini tasks.


HAL-Interface: Analog Input

ensure pokeys_py and pokeys_rt follow the definition below for halinterface of Analog Input
update documentation accordingly
Analog Input
Count: 7
Pins

pokeys.[DevID].adcin.[AdcId].value-raw			float	The hardware reading
pokeys.[DevID].adcin.[AdcId].value				float	The hardware reading, scaled according to the scale and offset parameters.

Parameters

pokeys.[DevID].adcin.[AdcId].scale  "The input voltage (or current) will be multiplied by scale before being output to value.";
pokeys.[DevID].adcin.[AdcId].offset "This will be subtracted from the hardware input voltage (or current) after the scale multiplier has been applied.";

You're correct, and I see where the miscommunication happened regarding the analog pins in the pokeys.comp file. Let's clarify the actual implementation and the relationship between HAL pins and C variables in the pokeys.comp file, specifically for analog pins, based on the usage of PK_AnalogIOGet().
1. Analog Pins in pokeys.comp
The analog pins in pokeys.comp are set up as follows:
pin out float adcin.#.value-raw[7];
pin out float adcin.#.value[7];
param rw float adcin.#.scale[7];
param rw float adcin.#.offset[7];

adcin.#.value-raw: The raw analog input value read from the PoKeys device.
adcin.#.value: The scaled and offset analog value, which is output to the HAL system.
adcin.#.scale: This parameter scales the raw analog value.
adcin.#.offset: This parameter offsets the scaled analog value.

2. Variables Used in pokeys.comp
The variables used in pokeys.comp to handle the analog pins are as follows:

dev->Pins[i].AnalogValue: Holds the raw analog value read from the PoKeys device. It is a 12-bit value (0-4096) representing the analog input signal.
adcin_value_raw(AinNr): A HAL pin that stores the raw analog value converted to volts.
adcin_value(AinNr): A HAL pin that stores the scaled and offset analog value that is output to LinuxCNC.

3. Functions and Calculations for Analog I/O
The function PK_AnalogIOGet() retrieves the analog input values from the PoKeys device. This function is used to fill the AnalogValue fields for each pin, and the values are then processed and sent to the corresponding HAL pins.
Here’s how the analog values are calculated and used in pokeys.comp:
int AnalogPinOffset = 40;
int AnalogPinCount = 7;  // Number of analog input pins

for(i = 0; i < info_PinCount - 1; i++)
{
    int AinNr = i - AnalogPinOffset;

    // Check if the pin is an analog input
    if ((AnalogIOGet == true) && (AinNr >= 0) && (AinNr < AnalogPinCount))
    {
        // Ensure scale is not zero
        if (adcin_scale(AinNr) == 0)
        {
            adcin_scale(AinNr) = 1;
        }

        // Read the raw analog value from the device and convert to volts
        float ainVal = 3.3 * dev->Pins[i].AnalogValue / 4096;
        adcin_value_raw(AinNr) = ainVal;

        // Apply scale and offset to the analog value
        adcin_value(AinNr) = ainVal * adcin_scale(AinNr) - adcin_offset(AinNr);
    }
}

Explanation:

dev->Pins[i].AnalogValue: This retrieves the raw analog value from the PoKeys device, a value between 0 and 4096, which is then scaled to volts using the conversion factor 3.3 / 4096.
adcin_value_raw(AinNr): Stores the raw analog input value in volts.
adcin_value(AinNr): Applies the scale and offset to the raw value and stores the final result, which is then passed to the HAL system.

Scale: The input voltage is multiplied by adcin_scale(AinNr).
Offset: The result is offset by adcin_offset(AinNr).

4. Mapping Between pokeys.comp and PokeysLib
In pokeys.comp, the analog pins are linked to the PoKeysLib's PK_AnalogIOGet() function and the AnalogValue field of each pin in the sPoKeysDevice structure.
Analog Input Mapping
The analog input values are fetched from the PoKeys device using PK_AnalogIOGet() and then converted to voltage and passed to the corresponding HAL pins.

PoKeysLib function used: PK_AnalogIOGet()
PoKeysLib pointer used: dev->Pins[i].AnalogValue (the raw 12-bit analog value for pin i).
HAL pins created:

pokeys.[DevID].adcin.[PinID].value-raw: Holds the raw analog input value (in volts).
pokeys.[DevID].adcin.[PinID].value: Holds the scaled and offset analog input value.

5. Why the Names Differ
The HAL pin names (adcin_value_raw and adcin_value) are named according to LinuxCNC's canonical HAL naming convention, while the PokeysLib variable names (AnalogValue) follow the internal naming conventions of the PoKeys API. The difference ensures that the HAL system can easily integrate and interface with external hardware like the PoKeys device.

Short Code Example for Analog Pins in LinuxCNC using PoKeysLib
Here’s a complete code example of how the analog input values are read from PoKeysLib, processed, and passed to the LinuxCNC HAL pins:
void update_analog_inputs(sPoKeysDevice* device)
{
    // Call PoKeysLib to get analog input values
    PK_AnalogIOGet(device);

    // Iterate through all pins and process analog inputs
    int AnalogPinOffset = 40;  // Starting pin index for analog inputs
    int AnalogPinCount = 7;    // Number of analog input pins

    for (int i = 0; i < info_PinCount - 1; i++)
    {
        int AinNr = i - AnalogPinOffset;

        // Check if the pin is an analog input
        if ((AnalogIOGet == true) && (AinNr >= 0) && (AinNr < AnalogPinCount))
        {
            // Ensure scale is not zero
            if (adcin_scale(AinNr) == 0)
            {
                adcin_scale(AinNr) = 1;
            }

            // Convert raw analog value to voltage
            float ainVal = 3.3 * device->Pins[i].AnalogValue / 4096;
            adcin_value_raw(AinNr) = ainVal;

            // Apply scale and offset to the analog value
            adcin_value(AinNr) = ainVal * adcin_scale(AinNr) - adcin_offset(AinNr);
        }
    }
}

Summary:

Analog Pins in pokeys.comp:

HAL pins: adcin.#.value-raw, adcin.#.value, adcin.#.scale, and adcin.#.offset.
These are created and linked to the analog input channels of the PoKeys device.

Functions Used:

PK_AnalogIOGet() to fetch the analog input values from the PoKeys device.

PoKeysLib Variables:

dev->Pins[i].AnalogValue holds the raw 12-bit analog input value.

HAL Variables:

adcin_value_raw(AinNr) holds the raw analog input value (in volts).
adcin_value(AinNr) holds the scaled and offset analog input value (in volts).

By correctly mapping these PoKeysLib pointers to the HAL pins, we ensure that the analog values are properly interfaced between the PoKeys device and LinuxCNC.


Create a pdf Generator at last

We can add a button at the last to download in the form of a pdf. Can we do that here?

Go ahead.
PDF should include every detail, user details, and tax details.
And the logo of the application in PDF also.

I am unable to download Splash Screen.gif. How to do it?

Can't understand
Are you not able to run the application?

Yes, I am trying to run

Is the application opening?

No sir, I am trying to run  in colab

No sir, I am trying to run in colab

I never tried this application on colab.
Use idle.
Search your error on StackOverflow or reach out to mentors for help in the slack channel.

for running I need that image splash screen.jpg. how to get it?

for running I need that image splash screen.jpg. how to get it?

Just download the zip file.
You will get the entire folder.

Can anyone say how to upload image?

Use git. (Watch video on youtube)
Other way (shortcut) ->


Getting a Buffer Overflow while trying to open the settings

Environment
Microsoft Windows [Version 10.0.17763.1098]
Steps to reproduce
Trying to open the Settings from the tray icon.
Actual behavior

Error message: (roughly translated)
RuntimeBroker.exe - Systemerror.
System has in this application ... overflow of a buffer ...
Alternates (exactly every 2nd time) with error message:
Failed to create the Webview control

I was getting the first error message from the very beginning ... I think I installed it from 0.11.0
A little offtopic, but is there a way to remove everything powertoys has created from my system ... maybe some old file somewhere (setting or otherwise) or a rando registry entry from an old installation of powertoys makes it acting up

@githubber616, create a 2nd issue for the other item.  In theory we should stay clean.  If not, we should create an issue to make sure we preview bits clean up paths on 1st time run.
First issue is I'm going to bucket this to #243

Sorry, thought it was an separate issue due to the buffer overflow error message. (did not made a screenshot due to my localisation is German, and that is what the message is in) . After digging through all available information, it seems I was wrong. Sorry.

Without anymore info, I have to assume it is due to the web view. No way for us to repo


marti_messages: 1.5.2-1 in 'humble/distribution.yaml' [bloom]

Increasing version of package(s) in repository marti_messages to 1.5.2-1:

upstream repository: https://github.com/swri-robotics/marti_messages.git
release repository: https://github.com/ros2-gbp/marti_messages-release.git
distro file: humble/distribution.yaml
bloom version: 0.11.2
previous version for package: 1.4.1-2

marti_can_msgs

No changes

marti_common_msgs

No changes

marti_dbw_msgs
* Adding reverse low DBW constant (#132 <https://github.com/swri-robotics/marti_messages/issues/132>)
* Contributors: David Anthony

marti_introspection_msgs

No changes

marti_nav_msgs

No changes

marti_perception_msgs

No changes

marti_sensor_msgs

No changes

marti_status_msgs

No changes

marti_visualization_msgs

No changes

@danthony06 the doc branch listed for this repository is still dashing-devel? Is that correct or should it be ros2-devel to match the development branch?

Sorry, it should be ros2-devel.
On Sun, Nov 5, 2023, 10:37 AM Steven! Ragnarök @.***>
wrote:

@danthony06 https://github.com/danthony06 the doc branch listed for
this repository is still dashing-devel? Is that correct or should it be
ros2-devel to match the development branch?
—
Reply to this email directly, view it on GitHub
https://github.com/ros/rosdistro/pull/38851#issuecomment-1793785590, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABBZWHG2ZIHSB3D5LP4JM23YC6XEVAVCNFSM6AAAAAA644O2R6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOJTG44DKNJZGA
.
You are receiving this because you were mentioned.Message ID:
@.***>


Direct file and connection

My typical use case for this tool is to ingest a PBF file I already have and load it into an arbitrary database that I have already running. This is something that is done internally by the tool but only to read a specific region/subregion file and load it in the "incorporated" PostGIS intance. To do that currently I use a bash script that is "injected" into the container, which is quite verbose and hard to troubleshoot.
This PR tries to make it a functionality of the tool without further trickery.
A few changes:

the makefile now has an extra task which tests exactly this use case, I split build and run in different tasks to build only once
all the functions operating on the DB have an optional connection string argument
installing the postgis extension now tolerates the case in which it's already installed
two new parameters are added to specify the input PBF file (in that case all the download logic is skipped) and a connection string. They can be used independently.

I tried to keep the changes minimal, probably the code can be refactored a bit, splitting the steps in different files and decoupled the download logic from the import. Also I'm wondering if it's really necessary to call a service to build the command line parameter, I think in most cases can just be passed from the command line.
Let me know what you think!

Closing this PR.  Part of this has been merged in via #196, the other part is planned in the open issue #194.


First pass at graceful shutdown handlers

What changed?
This patch implements mechanism to gracefully drain traffic during deployments to avoid availability drops. The mechanism varies somewhat based on the role.
The shutdown protocol on some host H looks like the following:
History

Remove H from the membership ring. This will make other members believe that H is unhealthy
Wait for other members to discover that H is unhealthy
Stop acquiring new shards (periodically or based on other membership changes) on H
Wait for shard ownership to transfer (and inflight requests to drain) while still accepting new requests on H
Reject all requests arriving at rpc handler on H to avoid taking on more work
Wait for grace period
Force stop the whole world and exit

Frontend

Fail rpc health check, this will cause client side load balancer to stop forwarding requests to this node
Wait for failure detection time, typically this will be around 5s or less
Stop taking new rpc requests by returning InternalServiceError
Wait for a second
Stop the world and exit

Matching

Remove H from the membership ring. This will make other members believe that H is unhealthy
Wait for others to discover that H is unhealthy and traffic to drain
Stop the world and exit

Why?
Grace shutdown mechanism is needed to reduce availability dips during deployments
How did you test it?
Tested locally. Also tested on a staging environment.
Potential risks
Graceful shutdown fails to work and there continues to be availability dips during deployment.
A bug in the code causes process to crash during shutdown.
First pass at fixing #1454

Coverage decreased (-0.1%) to 66.941% when pulling 6100b481da2112b4f7000d2e5d9272b9c26fdaaf on venkat1109:v_graceful_shutdown into 8bcbb4f080744f428405b89b0871944bbd862f72 on uber:master.


JFXDrawer hide/show events

It would be useful to know that hide/show is finished.
Use-case: SidePane is visible and contains a logout button. Logout will remove the content of the sidepane. But if we remove the content immediately after hide() call, the user is able to see the empty side-pane.
A callback or listener or hide(function) would help....

its already implemented, plz check the methods setOnDrawerClosed,setOnDrawerOpened.

right, both events exist but at least onDrawerClosed doesn't work as expected because hide method fires onDrawerClosedProperty.get().handle(new JFXDrawerEvent(JFXDrawerEvent.CLOSED)); as last statement.
The transition isn't finished at this point.
I didn't test onDrawerOpenedProperty.

please test on the latest version of JFoenix, as we recently fixed the timing issue.

shame on me - works as expected!

salut, je demande de l'aide conncernant la methode isShown() de JFXDrawer. elle est soulignée en rouge chez moi et empeche la compilation


Select microController to work as ICP

Select microController to load a external ROM memory to the RAM.
It should have serial interface and I2C/SPI to communicate to the memory.

The ICP microcontroller need to support 5V.
Selected ATmega128.


Make links consistent throughout platform

Links should all be marked with arrow on the left and underline on hover.
In text:

Standalone:

Standalone on hover:


fix handling of empty triple quoted strings

Fixes #313

Pull Request Test Coverage Report for Build 521

3 of 3 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.003%) to 96.208%

Totals

Change from base Build 518:
0.003%

Covered Lines:
2537

Relevant Lines:
2637

💛  - Coveralls


Is there any plan to type slices or body on Document ?

Just noticed, slices are loaded from the body field in the data property, but ts complains about the lack of type for it, is there any plan to fix this ?
Thanks in advance

Hey @asotog, good observation!
Yes, there are plans to provide TypeScript types for a Document's fields, including its Slice Zone(s). The next version of @prismicio/client, currently in development, will include full support for TypeScript.
@prismicio/types, a sibiling package to provide TypeScript types, can be used to construct your own Document types including its fields. It is in its early stages of development, but feel free to check it out.
Documentation for these updates will be published when they are ready.
Let me know if you have any other questions!
(cc @lihbr)

Fixed in v6 🎉 Thank you for your contribution!
https://prismic.io/docs/technical-reference/prismicio-client?version=v6


Fix aiohttp deprecation warning and log level

In current version aiohttp throws DeprecationWarning because we don't use asynchronous context managers for sessions.
As we use python 3.5, I think it's ok to use them.
And also I fixed logging levels for some errors. I think it's a common error when proxy broker receives 500 HTTP code from proxy list site, because it is broken. But it is not an error of proxybroker and we should not log it with error level. I made logging these errors with lower level.
For now with these fixes, when we execute simple script from example folder we don't see any errors and get correct result.
What do you think about it, @constverum ?

Your changes plus downgrading yaml to 0.9.3 (see https://github.com/aio-libs/yarl/issues/55) fixed the proxy broker for me. Thank you very much!

Good work, @Lookyan and Adrian! Thank you all, guys =)


Difficulties with the DOCX to JATS XML conversion

Currently, I'm testing various open-source solutions in order to implement a JATS XML publishing workflow, which includes the following steps:

Creating the original file in DOCX format, adhering to a pre-defined stylesheet
Pre-processing and converting the file from DOCX to JATS XML
Validating the JATS XML file
Converting the JATS XML file into XLIFF format for translation
Translating and reviewing using CAT tools (e.g., RWS Trados Studio)
Importing the translated content and generating the target JATS XML files
Performing a final proofreading
Publishing the original and translated documents in PDF, DOCX, and HTML formats

However, my coding experience is limited, and I'm facing difficulties with the DOCX to JATS XML conversion process. I can follow directions and can usually figure out programs. I also have oXygen XML Editor, but I'm still learning how to use it.
-- Could you please provide some tips or suggest the best approach to address this challenge?
I look forward to your guidance and greatly appreciate any assistance you can provide.

What about using meTypeset (https://github.com/MartinPaulEve/meTypeset) or DOCX2JATS (https://github.com/Vitaliy-1/DOCX2JATS)? -- Has anyone ever used any of these options?

@pmoreno-DTP this is the GitHub issues list for an Oxygen framework for editing JATS. Maybe you can find a JATS-specific forum or users list where to ask these questions. Personally I am not familiar with both tools you mentioned. You can also try to test them on your content and see how that goes.

@raducoravu -- Thanks for your suggestion. I will try to find a JATS specific forum to ask these questions.


Withings additional sleep state fix.

Breaking Change:
None
Description:
Fixing timezone issue which caused wrong selection of data to be used.
Related issue (if applicable):  fixes #29397 fixes #28370
Pull request with documentation for home-assistant.io (if applicable): N/A
Checklist:

[X] The code change is tested and works locally.
[X] Local tests pass with tox. Your PR cannot be merged unless tests pass
[X] There is no commented out code in this PR.
[X] I have followed the development checklist

If user exposed functionality or configuration variables are added/changed:

[X] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[X] The manifest file has all fields filled out correctly. Update and include derived files by running python3 -m script.hassfest.
[X] New or updated dependencies have been added to requirements_all.txt by running python3 -m script.gen_requirements_all.
[X] Untested files have been added to .coveragerc.

If the code does not interact with devices:

[X] Tests have been added to verify that the new code works.

Unrelated zwave test is failing. Any ideas what's going on here?

@vangorra you could rebase onto the latest version of the dev branch to rerun the tests.

Change rebased and ready for merge.


The plugin 2500 is deprecated and was replaced with plugin 22000.

current stable version hashcat: 6.2.5
Error: The plugin 2500 is deprecated and was replaced with plugin 22000. For more details, please read: https://hashcat.net/forum/thread-10253.html

Thanks for opening this issue. This project is no longer actively maintained.
Instead, as per the README, please use WiFiCrackPy which leverages the 22000 method instead.