[Feature] Support for Jetbrain IDE

Plugin support for Jetbrain IDEs.

I don't use Jetbrain. Feel free to port it.


Cannot bootstrap on windows

Git is using linux filepath separators which isn't accounting for windows filepath separators during the bootstrap process.
https://cloud-native.slack.com/archives/C0207C47D0X/p1641306239049200.

Hi, I encountered the same issue today.  Changed "" into "/" in the file: ./bootstrap/argo-cd.yaml
...
  source:
    path: bootstrap/argo-cd
...


Enable Collapse/Expand of HEREDOC Bash Syntax

I searched for an existing issue, i couldnt find anything that matched.

I love vscode, its my favorite tool for the job.
I have an issue with the bash syntax engine. It does not recognize the HEREDOC as capable for collapse/expansion. I would find this feature very useful.
Here is a screenshot:

VSCode ships only with basic support  for bash. Folding is based on indentation. A folding region starts when a line has a smaller indent than one or more following lines, and ends when there is a line with the same or smaller indent.
To support folding ranges for HEREDOC, a proper parser for bash is required. This has to come from an extension. https://marketplace.visualstudio.com/items?itemName=mads-hartmann.bash-ide-vscode is such an extension but unfortunately it also doesn't support folding yet.  https://github.com/bash-lsp/bash-language-server/issues/18 is the feature request.


Constrain pydantic version

Checklist

[x] Used a static YAML file for the patch if possible (instructions).
[x] Only wrote code directly into generate_patch_json.py if absolutely necessary.
[x] Ran pre-commit run -a and ensured all files pass the linting checks.
[x] Ran python show_diff.py and posted the output as part of the PR.
[x] Modifications won't affect packages built in the future.

@conda-forge-admin Should be ready for review! Thanks.

is there a new version of feflow?

@hmaarrfk No, just 0.1.0 for now. But there will be a new one coming soon (patch release supporting pydantic 2).

@hmaarrfk Oh do you mean that this could have been done in the feflow feedstock itself? Maybe with a different build number, right?

I guess we typically like to patch once the underlying problem has been resolved in the feedstock itself.

so either a new build number with the constraint (that will be removed "momentarily") or a new version that makes the constraint obsolete.

@hmaarrfk understood, let me do that!

you can also backport the "small patch"

@hmaarrfk The feedstock should be fixed now https://github.com/conda-forge/feflow-feedstock/pull/1 is that enough to unblock this? Please let me know. Thank you for your support!


Replace deprecated AppCache with ServiceWorkers

Important note:
ServiceWorkers are still a working draft, though all the browsers we support (and for each browser at least the 2 latest versions) seem to be supported by default. Nonetheless, most of the (if not all) features of the ServiceWorker and related API's (Cache, CacheStorage etc.) are experimental and their behavior might change in the future.
Description
In order to have a modern, not deprecated offline caching mechanism, Room Display should replace the currently used Application Cache (AppCache) with the ServiceWorkers.
Origin and motivation
The application is caching content for offline usage by using HTML manifest AppCache. In our case this is the manifest.appcache file that is being used in the HTML: <html manifest="manifest.appcache">.
This feature is deprecated since Firefox 44+ and is in the process of being removed from the web platform. It is recommended to move to a modern approach for offline content caching with the ServiceWorker and the related ServiceWorker API.
Subtasks

[ ] Investigate how the ServiceWorkers can be used for content caching
[ ] Identify potential important differences between the AppCache and the ServiceWorkers
[ ] Create a sample PR which showcases ServiceWorkers in action
[ ] Replace the deprecated AppCache with ServiceWorkers completely

Acceptance criteria

[ ] AppCache has been replaced by ServiceWorkers.

Ik heb hier blijkbaar ooit eens mee lopen rommelen. Zie wat code hieronder, geen idee of het werkt. Belangrijk is om in ieder geval de appcache eerst te verwijderen en dat aan je browser te leren, anders gaat het door elkaar werken.
service-worker.js:
const cacheVersion = '@timestamp@';

self.addEventListener('install', (event) => {
    // Force immediate activation
    self.skipWaiting();

    // Cache all required assets
    event.waitUntil(async function () {
        const cache = await caches.open(cacheVersion);

        await cache.addAll([
            '/',
            '/config.json',
            '/css/style.css',
            '/error/index.html',
            '/index.html',
            '/js/app.js',
            '/provision/index.html',
            '/settings/index.html',
            'images/favicon.ico',
            'images/favicon-60px.png',
            'images/favicon-76px.png',
            'images/favicon-120px.png',
            'images/favicon-152px.png',
            'images/favicon-180px.png'
        ]);
    }());
});

self.addEventListener('activate', (event) => {
    event.waitUntil(async function () {
        // Remove old caches
        const cacheNames = await caches.keys();

        await Promise.all(
            cacheNames.filter((cacheName) => {
                return cacheName !== cacheVersion;
            }).map(cacheName => caches.delete(cacheName))
        );

        // Claim the service work for this client
        await self.clients.claim();
    }());
});

    // return self.clients.claim();

self.addEventListener('fetch', (event) => {
    // Return response for cache. Otherwise, fallback to network.
    event.respondWith(async function() {
        const response = await caches.match(event.request);

        return response || fetch(event.request);
    }());
});

updater.js fragment:
app.eventBus.on("app:start", function() {
    // Register the service worker to cache assets for offline usage
    if ('serviceWorker' in navigator) {
        navigator.serviceWorker.register('service-worker.js')
            .then(function (registration) {
                if (registration.active) {
                    console.log('Service Worker activated with scope: ' + registration.scope);
                }

                registration.addEventListener('updatefound', () => {
                    const newServiceWorker = registration.installing;

                    newServiceWorker.addEventListener('statechange', () => {
                        if (newServiceWorker.state === 'activated') {
                            console.log("New Service Worker activated. Reloading page.");

                            app.updater.onUpdateReady();
                        }
                    });
                });

                // Set a repeating timer which checks for service worker updates.
                setInterval(() =>  {
                    console.log("Checking for new Service Worker");

                    registration.update().catch(function (error) {
                        console.log('Update failed with ' + error);
                    });
                }, app.config.updateCheckInterval * 1000);
            }).catch(function (error) {
            // registration failed
            console.log('Registration failed with ' + error);
        });
    }

    // Set a repeating timer which checks for application configuration updates.
    setInterval(() => {
        app.updater.check();
    }, app.config.updateCheckInterval * 1000);
});


more test envs

Coverage remained the same at 100.0% when pulling 214473c30b1c2d529ca53bf160d255213ae22e0b on more-test-envs into d7fca5c8d7cff7ae05f9005606e84a55ae270557 on master.


Workflow with ESDL

Discussed in https://github.com/TulipaEnergy/TulipaEnergyModel.jl/discussions/56

Originally posted by datejada August 22, 2023
I can foresee three data files in the model that need to be considered as inputs and outputs for the model; see Figure below.

ESDL files (.esdl): These files will contain the available information that can be stored in this format. Generally speaking, it is capacities, efficiencies, investment costs, operational costs, and commission and decommissions dates.
Complementary information files (.csv?): Here we have two categories

Extra information for assets: Information not available in the ESDL format, e.g., unit-commitment parameters.
Configuration parameters: setting parameters such as the years to run, type of simulation (only dispatch or with investment), etc.

Profiles database (.sqllite?): This file/DB will contain a large amount of input data (e.g., availability profiles) and results (e.g., production profiles for each asset).

Maybe we need more types of files; I'm not sure. In addition, the pre-processing and post-processing can be either in Julia or Python; these steps should be able to link the information in all the data sources with the optimization model.
I hope these comments and general overview help in the discussion for next week's meeting to talk about the design of the model.

This is now containted within the Epic: ESDL to GML + CSV


Bug on query bound

For single predicate x < 10 with RTree index, the IndexedRelationScan will transfer the predicate to a MBR with equality bound, which cause the x = 10 will be the final result.

Resolved, pls refer to PR #51.


1.0.4 not available

The latest version is '1.0.4'. However we can't sync it by adding:
implementation 'net.authorize:accept-sdk-android:1.0.4']
in build.gradle file.

@darkengine Did you find any solution?

I was able to get the latest version from github using jitpack.


Fails to run on custom port

as 8080 is taken by nupic-history.
cell-viz$ npm start 8081

><EMAIL_ADDRESS>start /mnt/store/devel/HTM/htm_schools/cell-viz
> webpack-dev-server "8081"

/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack/bin/convert-argv.js:558
                                var i = content.indexOf("=");
                                                ^

TypeError: content.indexOf is not a function
    at /mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack/bin/convert-argv.js:558:21
    at Array.forEach (native)
    at processOptions (/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack/bin/convert-argv.js:557:11)
    at processConfiguredOptions (/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack/bin/convert-argv.js:104:4)
    at module.exports (/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack/bin/convert-argv.js:83:9)
    at Object.<anonymous> (/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack-dev-server/bin/webpack-dev-server.js:68:48)
    at Module._compile (module.js:410:26)
    at Object.Module._extensions..js (module.js:417:10)
    at Module.load (module.js:344:32)
    at Function.Module._load (module.js:301:12)

npm ERR! Linux 4.10.0-20-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start" "8081"
npm ERR! node v4.2.6
npm ERR! npm  v3.5.2
npm ERR! code ELIFECYCLE
npm ERR<EMAIL_ADDRESS>start: `webpack-dev-server "8081"`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script 'webpack-dev-server "8081"'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the cell-viz package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     webpack-dev-server "8081"
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs cell-viz
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!     npm owner ls cell-viz
npm ERR! There is likely additional logging output above.

Wait a minute. I was mistaken when I told you to install webpack locally. npm uninstall webpack to get rid of it.

so only global?
Uninstalled both, installed only global, still get on custom port:
><EMAIL_ADDRESS>start /mnt/store/devel/HTM/htm_schools/cell-viz
> webpack-dev-server "8081"

module.js:328
    throw err;
    ^

Error: Cannot find module 'webpack'
    at Function.Module._resolveFilename (module.js:326:15)
    at Function.Module._load (module.js:277:25)
    at Module.require (module.js:354:17)
    at require (internal/module.js:12:17)
    at Object.<anonymous> (/mnt/store/devel/HTM/htm_schools/cell-viz/node_modules/webpack-dev-server/bin/webpack-dev-server.js:17:15)
    at Module._compile (module.js:410:26)
    at Object.Module._extensions..js (module.js:417:10)
    at Module.load (module.js:344:32)
    at Function.Module._load (module.js:301:12)
    at Function.Module.runMain (module.js:442:10)

npm ERR! Linux 4.10.0-20-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start" "8081"
npm ERR! node v4.2.6
npm ERR! npm  v3.5.2
npm ERR! code ELIFECYCLE
npm ERR<EMAIL_ADDRESS>start: `webpack-dev-server "8081"`
npm ERR! Exit status

I see. You don't need to run the webpack server. Just go to root and type webpack. This bundles the file for you offline.

Just to be clear, ignore the local server in cell-viz. It was just to show examples. Just run webpack and soft link to the file from htm-school-viz.

I know. Just a separate report that it cannot run on custom port, if that's non-issue we can close this.

[x] got the webpack running in this thread


Update to Node.js 16

I'm calling this a major version bump due to the requirement that the AWS provider be recent.

Deploy using nodejs16.x (and test in CI using Node.js v16)
Bump dependencies
Explicitly list standard as a devDependency so that IDEs can pick up on it

The older version of TF being used in this module was unable to connect to the registry to get the newer AWS provider.


Task - Use API Gateway

Content: I have to allow users send requests to my nodejs server inside a private subnet. So I need to setup API Gateway, VPC Link and Network Load Balancer.

Result: usse API Gateway with public EC2. Another case is use API Gateway, VPC Link, Network Load Balancer and private EC2


MTP-1838: Simplify 'Contact us' form

Remove lead paragraph
Changed textarea label to 'Please give details'

Also

Made 'Your email address' field mandatory.

Ticket: https://dsdmoj.atlassian.net/browse/MTP-1838
NOTE: As part of this ticket we're reviewing the exact copy of the pre-populated text which comes from the FAQ. This is independent from this change set and I could either add to this PR later on or make that change in a separate PR.

Thanks @ushkarev


Creating a new flow - CRD what does it mean

When creating a new flow, there is a [x] for CRD.
I think end users will not understand what it means. We should have a description what it means to turn this on or off.

Description added


How to change :) to :smile:?

sorry ... what?

I want users to be able to type in :) and automatically render it as
:smile:. Like the common chat applications.
On Mon, Feb 16, 2015 at 6:20 PM, Andrea Giammarchi<EMAIL_ADDRESS>
wrote:

Closed #46 https://github.com/twitter/twemoji/issues/46.
—
Reply to this email directly or view it on GitHub
https://github.com/twitter/twemoji/issues/46#event-236281634.

--
Fardeem Munir
www.erubai.com
@awesomerubai

Those are "emoticons", quite a different thing.
Here is about emoji, something new for most old chat apps out there.
Check your phone, as example, you most likely have a button to insert emoji instead of :)
In few words you probably need a panel with a list of emoji so that once you click one that gets inserted in the textarea or you need your own parser that changes :) and who knows what else into emoji.
This project is about emoji, not conversion from Unicode standard emoji to some "random" bb-code style emoticon implementation so this is not a bug, an issue, or anything emoji related.
Thanks for your understanding.

Oh ok. Thanks for the detailed answer. I leaned something today :smile:


[Question] OCR

Context / Scenario

I referred to this example and wrote an implementation of OCR. Attempting to scan PDF and PDF containing images did not trigger it. I'm not sure if there was anything wrong with the operation
Question

I referred to this example and wrote an implementation of OCR. Attempting to scan PDF and PDF containing images did not trigger it. I'm not sure if there was anything wrong with the operation

Looks like this is currently not possible, see code:
https://github.com/microsoft/kernel-memory/blob/main/service/Core/DataFormats/Pdf/PdfDecoder.cs
Altough we already have (https://github.com/microsoft/kernel-memory/blob/main/service/Abstractions/DataFormats/IOcrEngine.cs) in place, which would be enough for simple text extraction, and UglyToad.PdfPig is able to extract images as experimental feature.
@dluc Wouldn't it be possible to extend "FileContent" with a Array of found Images in the PDF described GPT-4 Vision Api if enabled?

I think that you can support this scenario when the issue https://github.com/microsoft/kernel-memory/issues/379 will be completed (currently there is a PR in preview).
With that, you will be able to inject a custom decoder for PDF files.

Given that now custom content decoders can be injected, I would first try creating one that replaces the default PDF decoder, and internally does all the work of extracting text and text from images. E.g. you can create a decoder that depends on the existing image decoder to parse images, and return all the text at the end, without the need to revisit the FileContent class (for now).


CI: K8sFQDNTest BeforeAll failure (ginkgo DNS timeout)

/home/jenkins/workspace/Cilium-PR-K8s-oldest-net-next/k8s-1.11-gopath/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:459
Error obtaining IPs for test: error looking up vagrant-cache.ci.cilium.io: lookup vagrant-cache.ci.cilium.io on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:46575-><IP_ADDRESS>:53: i/o timeout
Expected
    <*errors.errorString | 0xc00190a7f0>: {
        s: "Could not get vagrant-cache.ci.cilium.io and jenkins.cilium.io IPs: 30s timeout expired",
    }
to be nil
/home/jenkins/workspace/Cilium-PR-K8s-oldest-net-next/k8s-1.11-gopath/src/github.com/cilium/cilium/test/k8sT/fqdn.go:68

808a676b_K8sFQDNTest_Validate_that_multiple_specs_are_working_correctly.zip

We probably want retries and/or make these resolutions optional:
https://github.com/cilium/cilium/blob/40b6f58af21aa16925cdd3d11e55951c66810386/test/k8sT/fqdn.go#L49-L68
We already have the IPs hardcoded above and they're quite stable. Probably okay to use if the resolutions fail.

hit again: https://jenkins.cilium.io/view/PR/job/Cilium-PR-K8s-newest-kernel-4.9/734/testReport/junit/Suite-k8s-1/18/K8sFQDNTest_Restart_Cilium_validate_that_FQDN_is_still_working/

This is a BeforeAll failure, not a fail in the "multiple specs" test, will edit the title.

This is a DNS timeout from ginkgo itself, not subject to the DNS proxy, which is not even set up yet, and would not affect ginkgo anyway.

This seems to be resolved, didn't see an occurence in last month.


Patch operation error on startup (when Sexperience is not enabled?)

RJW-Genes generates a patching operation error on game start. I assume this is caused by lack of Sexperience mod:
[RJW Genes] Patch operation Verse.PatchOperationConditional(Defs/ThingDef[defName="GatheredCum"]/ingestible/outcomeDoers) failed
file: C:\Program Files (x86)\GOG Galaxy\Games\RimWorld\Mods\rjw-genes\Common\Patches\ThingDefs\Sexperience_Cum.xml

Sadly, I don't know the patching syntax well enough to know how to add optional mod dependency to a patch that already has different conditional operation class :<

Hmm, I can reproduce. Sorry for the inconvenience.
But why does not everybody play with the same mods that I do?? smh.


Add presentation slides and posters

Add a chapter with slides and posters for the project detailed by conference or event and date.
TODO:

[x] set up a new section after/before references in the documentation point
[x] add all available materials to highlight the workflow and progress of the project
[ ] make iframe of the one poster a little bit wider and adjust for a good haptic without scrolling
[ ] check if there is some material left to implement? --> maybe the CADS presentation @berntpopp?

Fix the current error: "The page you requested cannot be found (perhaps it was moved or renamed). You may want to try searching to find the page's new location, or use the table of contents to find the page you are looking for."
--> it probably happened after the automated documentation build with GitHub actions


Provide Ability to pass results from pre-events to the model query

Describe the feature
I would be very useful to be able to set a variable with the scalar result from pre-event or post event query for use later in the model or subsequent steps in the the process.
This would be very useful when using an audit table to store the floor to be used in the next run of your model
Who will this benefit?
This will benefit any process that is moving large incremental loads that does not want to suffer the overhead of a max sub query of {{ this }} in the predicate. It will also allow logging of the max update date or id on post-event

Thanks for making this feature request @richmintz!
How do you imagine dbt capturing the max date in a table in a pre- or post- hook? If the idea is that you'd query for the max(timestamp), then you're going to need to incur this cost somewhere, right? My instinct is that any query planner worth its salt will execute the following query patterns in similar amounts of time:
select
  ...
from source_table
where timestamp > (select max(timestamp) from {{ this }})
group ...

vs.
-- store this result in a variable $MAX_TIME
select max(timestamp) from some_big_table;

select
  ...
from source_table
where timestamp > $MAX_TIME
group ...

I do buy that "caching" the results of this max(timestamp) query to re-use across different models could result in a model build time improvement, but managing a cache like this in a parallelized dbt run could be pretty tricky!
I'll also say: I think it's a bad idea to try to store this data in the database directly. You might be able to get away with this on a database like Postgres, but Redshift/Snowflake/BigQuery/Presto/Spark are not going to be super happy running individual insert/update statements to keep an audit table up-to-date in a parallelized fashion.
You identified two use cases here:

caching results from a model hook to re-use in a downstream model of the same build
caching results from a hook to re-use in a subsequent invocation of dbt

If we were going to support one of these things, I think the first one would be a lot more tractable than the second. dbt doesn't have a good way of persisting data between invocations, and that's sort of a feature -- the entire state of the run is stored in the tables and views in the database. Adding an external cache could lead to inconsistency between the tables in the database and the cached data (whether stored on disk, or stored in a database table).
Ultimately, I don't totally see the merit to supporting this feature -- if you have a sort key / partition key / clustering config defined on your incremental timestamp field, then the database should be able to find the max() value of that field super quickly.
Last, if you do want to execute a post-hook to grab the max timestamp/id for a model and insert it into a database table, you can certainly already do that today! I think this a super cool idea and one that's worth doing if your requirements demand it. I don't think I'd recommend this, but if you did want to join to that table to find the max timestamp for an incremental model, I imagine you could already do that today as well, right?
I'm going to close this issue because I don't imagine accepting a PR for something like this in the near-to-medium-term future, but I am super happy to discuss this further! We can always re-open it. Let me know if I missed something important, or if you have other ideas about how this could work.
Thanks again!


error-in-scipy-wilcoxon-signed-rank-test-for-equal-series

Hello
As presented here:
http://stackoverflow.com/questions/38454893/error-in-scipy-wilcoxon-signed-rank-test-for-equal-series?noredirect=1#comment64315624_38454893
(without no answer to disprove it as a mistake from me),
I wish to report that maybe there is a problem with the results of scipy.wilcoxon signed rank test;
import scipy as sp
x1=[29.39958, 29.21756, 29.350915, 29.34911, 29.212635]
sp.wilcoxon(x1,x1,zero_method="wilcox",correction=True)
returns statistic=0.0, pvalue=nan
But with zero_method="pratt", it returns statistic=0.0, pvalue=0.043114446783075355 instead.
I think there is a mistake there. The statistics (for z-score, if I am not mistaken) are the same, but the results are different for the p-value, while they should not, actually.
When both series are identical, there should be no good p-value, but this is confident with alpha=0.05.
Maybe "pratt" zero_method is wrongly implemented. It is said to be more conservative, but instead it has also constantly given better /lower p-values on a large array of test values.
edit josef
It looks like there are two issues

corner case when all differences are zero needs special handling to return nan p-value
current implementation of Pratt method is wrong if there are "zeros", if (x == y).sum() > 0

R package coin raises an exception if diff is zero. I guess we could set the pvalue to nan to match the "wilcox" case, so users still get the zero for the diff instead of an exception.
(Briefly reading the code, I'm not sure whether r is empty in "pratt". )
> library(coin)
> zz = c(1,2,3,4.5)
> zz2 = c(1,2,3,4.50000001)
> wilcoxsign_test(zz ~ zz2, zero.method="Pratt")

        Asymptotic Wilcoxon-Signed-Rank Test (zeros handled a la Pratt)

data:  y by x (neg, pos)
Z = -1, p-value = 0.3173
alternative hypothesis: true mu is not equal to 0

> wilcoxsign_test(zz ~ zz, zero.method="Pratt")
Error in wilcoxsign_test.IndependenceProblem(object = <S4 object of class "IndependenceProblem">,  :
  all pairwise differences equal zero

I'm not sure about small differences in the two arrays, the pratt version looks a bit strange.
>>> stats.wilcoxon(np.array([1,2,3,4.5]), np.array([1,2,3,4.50000001]), zero_method="wilcox", correction=False)
WilcoxonResult(statistic=0.0, pvalue=0.31731050786291415)
>>> stats.wilcoxon(np.array([1,2,3,4.5]), np.array([1,2,3,4.50000001]), zero_method="pratt", correction=False)
WilcoxonResult(statistic=0.0, pvalue=0.06788915486182899)
>>> stats.wilcoxon(np.array([1,2,3,4.5]), np.array([1,2,3,5.0]), zero_method="pratt", correction=False)
WilcoxonResult(statistic=0.0, pvalue=0.06788915486182899)
>>> import scipy
>>> scipy.__version__
'0.17.0'

In R pratt and wilcoxon give the same pvalue in the example (?)
> wilcoxsign_test(zz ~ zz2, zero.method="Pratt", distribution="asympt")

        Asymptotic Wilcoxon-Signed-Rank Test (zeros handled a la Pratt)

data:  y by x (neg, pos)
Z = -1, p-value = 0.3173
alternative hypothesis: true mu is not equal to 0

(R commands taken from here, found by google)
https://stat.ethz.ch/pipermail/r-help/2011-April/274931.html

I actually am not well versed enough in R to say whether they made a mistake too, but the behavior seemed more regular than scipy's, hence my report. Sorry that I can't help more (except by doing tests, if you suggest these)

Based on a quick look, pratt doesn't have unit tests where some values in x and y are identical.
What I find a bit strange in pratt is that the mean mn uses count (i.e. number of observations) and not non-identical count len(d[d!=0]).
Also, checking a few more examples with R, scipy agrees if there are no common values, but not if there are common values between x and y.
(bug is starting to look more likely. However, if all d = x - y are zero, then we should just get nans independent of any calculations.)

That was more or less what I observed;)

I think I found the bug, it took me some time to find a reference with the formulas for the normal approximation for the p-values
https://github.com/scipy/scipy/blob/master/scipy/stats/morestats.py#L2409
both mn and se need to be adjusted for the zeros. However, because rank are assigned when zeros are still included, it is not just changing count
if zero_method == "pratt":
    ...
    countz = len(d == 0)
    mn -= countz * (countz + 1.) * 0.25
    se -= countz * (countz + 1.) * (2. * countz + 1.)

where countz is the number of zeros
I will add references (they are on another computer)
A PR to verify and change this would be welcome with unit tests against R wilcoxsign_test
(I'm not eager enough to get back on the contributor list with commits to set up scipy for development again : )

BTW: this issue is a duplicate of #6398 which should be closed
(I guess I didn't see it or didn't pay attention during vacation)

Awesome research;)
Sorry for the duplicate, could not find it before posting...

@josef-pkt could you send me the article by Cureton if you have access? I would like to fix this issue


Add initial support for lumen

Initial support for lumen.

Codecov Report

Merging #40 into master will decrease coverage by 3.16%.
The diff coverage is 81.25%.

@@             Coverage Diff              @@
##             master      #40      +/-   ##
============================================
- Coverage     97.70%   94.54%   -3.17%
- Complexity      105      109       +4
============================================
  Files            23       24       +1
  Lines           262      275      +13
============================================
+ Hits            256      260       +4
- Misses            6       15       +9

Impacted Files
Coverage Δ
Complexity Δ

src/helpers.php
0.00% <0.00%> (ø)
0.00 <0.00> (?)

src/Worker.php
91.46% <78.57%> (-3.35%)
24.00 <13.00> (+2.00)
:arrow_down:

src/Listeners/RebindRouterListener.php
90.47% <88.23%> (-9.53%)
7.00 <3.00> (+2.00)
:arrow_down:

src/Events/AfterLoopIterationEvent.php
100.00% <100.00%> (ø)
4.00 <2.00> (ø)

src/Events/AfterLoopStoppedEvent.php
100.00% <100.00%> (ø)
2.00 <2.00> (ø)

src/Events/AfterRequestHandlingEvent.php
100.00% <100.00%> (ø)
4.00 <2.00> (ø)

src/Events/BeforeLoopIterationEvent.php
100.00% <100.00%> (ø)
3.00 <2.00> (ø)

src/Events/BeforeLoopStartedEvent.php
100.00% <100.00%> (ø)
2.00 <2.00> (ø)

src/Events/BeforeRequestHandlingEvent.php
100.00% <100.00%> (ø)
3.00 <2.00> (ø)

src/Listeners/RebindHttpKernelListener.php
100.00% <100.00%> (ø)
2.00 <0.00> (ø)

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 984cba6...74039f1. Read the comment docs.

And unit-tests for yhour changes?


Boilerplate: Update to d4133d4d7f93ae41bdcc36526cf8c2fe848e5899

Conventions:

openshift/golang-osd-operator: Update ---
https://github.com/openshift/boilerplate/compare/84518ed16af54fb1713bc169753c161412c7c78d...d4133d4d7f93ae41bdcc36526cf8c2fe848e5899

commit: 333fc3eb933631294c2a1ad44df1b441b0c20825
author: Christoph Blecker
Update boilerplate SREP TL list
commit: e1409eabf6deecff9649d4c8e250417accb56d70
author: Ravi Trivedi
Updating Hulk members and FL list
commit: b79dfcb57358bd3a04b063e6b57fc189e30595e9
author: Michael Shen
Accept the latest ubi-minimal version
Specifically, version differences after the last period were previously excluded from consideration.
Signed-off-by: Michael Shen<EMAIL_ADDRESS>commit: 889a9f5aef2b89750d7bafdea6e146213db7d944
author: Karthik Perumal
Update OWNERS_ALIASES with recent team changes (#311)

Update OWNERS_ALIASES with recent team changes

Add Sam to FL list

commit: 60617bc64af03d910d8554957a262c8c0a16f114
author: Ritu Mundhe
sdcicd-1139 added osde2e tekton job openshift template generation (#309)

sdcicd-1139 added osde2e job template generation

added operator name to job name in e2e template to distinguish from other jobs

nit - fix "hyphen" to "underscore"

/lgtm


Add new migration

Added new migration for delete unnesessary columns and add new columns for billing

@Sergey-weber rename this PR before merging plz.
"Preparing for billing migrations" would be better.


[Feature] Alloy ThrottleLayer

Component
rpc, transports
Describe the feature you would like
In some instances, it would be useful to have a ThrottleLayer to not flood the node with requests all at once. While the RetryLayer works perfectly for retrying requests that exceed RPC provider limits, the ThrottleLayer could throttle outbound requests before they are sent.
The following snippet shows an example that fetches 100k blocks concurrently. In this example a ThrottleLayer would be helpful to limit n requests per second.

#[tokio::main]
async fn main() -> eyre::Result<()> {

   // --snip--

   // Init the provider
    let client = ClientBuilder::default()
        .layer(RetryBackoffLayer::new(10, 300, 330))
        .http(rpc_endpoint.parse()?);
    let provider = ProviderBuilder::new().on_client(client);

    let futures_unordered = FuturesUnordered::new();

    // Get 100_000 blocks
    let block_number = provider.get_block_number().await?;
    for i in block_number - 100_000..block_number {
        let provider = provider.clone();
        futures_unordered.push(async move {
            provider
                .get_block(i.into(), BlockTransactionsKind::Hashes)
                .await
        });
    }

    // Await the results
    let res = futures_unordered.collect::<Vec<_>>().await;

    Ok(())
}

We currently have a working version of a ThrottleLayer built and I would be happy to open a draft PR with this if you think it would be useful to add to alloy.
Additional context
No response

Hi @0xKitsune thanks for your suggestion
I think this could be useful addition, would be added to https://github.com/alloy-rs/alloy/tree/main/crates/transport/src/layers
cc @yash-atreya / @mattsse

Would be great if https://github.com/alloy-rs/alloy/issues/1147 is also considered as part of this scope / tested with wasm32-unknown-none


Refactor codebase to use isType() instead of checking BasicType lists

The codebase has a lot of uses of the allScalarTypes()/allVectorTypes()/allMatrixTypes() functions in the context of finding whether a given type is a scalar/vector/matrix or not - for example,
if (!allScalarTypes().contains(elementType)) {
      throw new UnsupportedOperationException(
          "Cannot make vector type from element type " + elementType);
    }

We have isScalar()/isVector()/isMatrix() methods that do the same thing in a more concise and centralized form. We should probably use those methods anywhere that we can.

Fixed by #537.


can we send MOT (משרד התחבורה) complaint using POST request?

Intro
I made this PR:
https://github.com/hasadna/open-bus-backend/pull/2
to let peoples submit complaints using an API.
My implementation is very naive and straightforward - I open an actual browser and submit the request :laughing:

I assumed we have no resources problem, so quick and dirty approach would be a great way to achieve what we want. @OriHoch said (and he's right) that's it's very resource intensive, and maybe even a little risky.
Task:
go here
see that they have an "import" button

I suspect that we can make a POST request directly to their servers. They don't use CAPTCHA :facepalm: ...
Let us know what's your thoughts about it in the comments

Seems like a great approach to save some resources.

Attached:

exported xml of a report
har file recording of submitting a report to mot.gov.il

I've replaced my ID to 123456789. I'm ok with sharing my full name, address and email. In case you see any personal data not listed here, please report to me<EMAIL_ADDRESS><EMAIL_ADDRESS>forms.gov.il.clean.har.json

can i take it?

@SariHop sure!

@SariHop Are you working on this issue?

No, I am no longer working on this issue

@SariHop Thanks for your quick reply!
There's someone else who've asked about helping us with node issues, so I'll ask her if she's interested in taking it. Feel free to share and collaborate if you'll have any tips, advices or ideas.
Have a great week!


Build(deps-dev): Bump eslint-import-resolver-typescript from 3.2.6 to 3.2.7 (#3763)

Pull request opened by the merge tool on behalf of #3763

Merged in aee1c4ab7aae85190d71d5ade665dc785a1d7a05


Tiny-Small networks load failure & training issue

Hello,
thanks a lot for providing the code of your article.
I'm working on something similar and I'm trying to make a comparison with your work. When I try to evaluate on the Stanford2D3DS dataset the error attached appears. It only appears on the Trans4PASS network small and tiny (not in Trans4PASS+). As I guess, is a failure when loading the network's weights, so the results are far from reliable (they look random, with a mIoU=2.7)
Have you any insight of what may be happening here?
Also, I re-trained the "tiny" network from scratch on the Stanford dataset and some other problem may appear since the results I get are far from the ones you provide (also, my resources are limited). I'm also attaching the log of the training. May you guess why there is such a difference in performance?
Thanks
eval_error.txt
2023-02-24-06-40_Trans4PASS_trans4pass_v1_stanford2d3d_pan_log.txt

Hi,
thanks for your interest. About loading the model weight, you can modify the DMLP module for the Trans4PASS version. Please check here.
About the training issue, the batch size is an important factor. If to train on limited resource, you can check and try gradient accumulation. We did not test it with this. It might help.


Fix flaw in Drag/Drop processing when dropping outside the view

(Issue extracted from PR https://github.com/CyberBoardPBEM/cbwindows/pull/95)
Using this attached test file:
big-and-small-boards.zip
Drag the markers from the big board to the small board, but do NOT actually drop the markers there.  Continue dragging until the mouse cursor is in the big board's CSelectPieceView.  The mouse cursor changes to show that dropping there is forbidden, but release the mouse anyway.  This seems to put CB in a strange state.  The CSelectPieceView shows the markers as selected, but the board does not (re)draw the markers with handles.  Also, the markers can still be dragged despite not showing handles, but if they are dragged, the tracking rectangles don't properly follow the mouse cursor.  If I switch the big board to its tiny view, I can see that dragging the markers shows the tracking rectangles for the markers far away from the mouse cursor.  So apparently drag-drop doesn't properly clean up a forbidden drop.
Another easier way to see this is:

Start with the original .gsn.
Select just the rightmost marker.
Drag the marker approximately two big-board cells to the right, so that the mouse is in the big board's tiny board window, and drop the marker in this forbidden window.
The result is that the marker stays displayed in its original location, and the CSelectPieceView shows the marker still selected, but the marker is displayed with no handles.  Also, if I drag the marker again, the tracking rectangle is in the wrong place.  Note that to see the tracking rectangle located incorrectly, the second drag has to be performed without unselecting and then reselecting the marker.

I don't think this has been resolved yet.
-Dale

I don't think this has been resolved yet.
-Dale

Can you give more detail on what isn't working here?  I just tried the master branch, and I'm not seeing a problem.

Can you give more detail on what isn't working here? I just tried the master branch, and I'm not seeing a problem.

I just tried master as well. It's good. I'm reclosing.


Question about out_a and out_b

In Figure2 in the paper, it seems you directly get two new feature('X1','X2') by split the 'InputX' in two portions without extra params. But in the code, you get them by two convolutions.
https://github.com/MCG-NKU/SCNet/blob/c0b5bd6aa919c00afb5815b2810e645e6a4a5976/scnet.py#L103
There are any differences between the two approaches?

The operation of two separate convolutions in the code is identical to a convolution firstly and then followed by splitting.
The only difference is that now it requires two different BN layers rather than only one.

Actually, this two implementations have different computational complexity. BTW, I wonder that the computational complexity and accuracy reported in the paper is based on which implementation? Thanks.

This is a misunderstanding. In Figure.2, the 1x1 convolutions before and after the 3x3 convolution in the bottleneck structure are omitted. Self-calibrated convolution is to replace the 3x3 convolution. Thus the implementation is identical to the paper and the computational complexities are roughly the same. The computational complexity and accuracy reported in the paper are obtained with exactly the same code we released here.

Okay, I see. You mean this implementation splits the first 1x1 convolution in the original bottleneck into two 1x1 convolutions. In this way, two BN+ReLU layers are required. Thanks for your reply and now it's clear to me.
Besides, if someone want to apply SCConv to other structures without pre-convolution layer, feature splitting would be a more general way to do it, right?


stop creating new FlxPoints!!! (fr this time)

So I was actually going to just replace new FlxPoint() with FlxPoint.get() (same with FlxRects), but decided to add some more tweaks and (maybe) optimizations
Full changelog:

FlxPoint/FlxRect fields now use get() function instead of creating a new instance (+ they also go back into pool after destroy call).
Bar.bounds are now FlxBounds instead of a Dynamic with anonymous structure as their value.
WeekData.songs are now Array<EitherType<String, Array>> instead of a Dynamic. (thx detective_baldi)
PlayState.ratingStuff are now Array<EitherType<String, Float>> instead of a Dynamic. (thx detective_baldi again)
Rating are now recyclable (horray!!), inspired by #12468 but actually do work this time.
Change Scroll Speed event now use NumTween for optimization purposes.
PlayState.health now have a setter that bounds HP to the healthBar.bounds.max possible value. Also doDeathCheck() now uses healthBar.bounds.min as the lowest (gameover) point.
Changing character's idleSuffix now automatically calls recalculateDanceIdle() if it was really changed.
Character dance now can be forced (via lua too).
Better flashing for MenuItem. (w/ help of ShadowMario)
Menus now use FlxMath.wrap() to wrap around possible values (instead of if/else thing).
FINALLY fixed followLerp for new flixel versions.
(Slightly) Better formatting, less mess.
Removed one second timer in TitleState (if it's removal will break smth i swear to god...).


[Feature Request] Auto switch back after block is broken

Add option to switch back to previous hotbar item after block is broken.
For example: While mining, I could select active hotbar item to steak. Then when I start breaking a stone block, best tools switches to diamond pickaxe. Then when stone block is broken, hotbar switches back to steak.
Or with any other item that was selected before the switch. Like torches, or redstone, fences, etc.

@Cazcez Add to Todo list pls

Add option to switch back to previous hotbar item after block is broken.
For example: While mining, I could select active hotbar item to steak. Then when I start breaking a stone block, best tools switches to diamond pickaxe. Then when stone block is broken, hotbar switches back to steak.
Or with any other item that was selected before the switch. Like torches, or redstone, fences, etc.
Added
https://todo.jeff-media.com/b/pYm2EQvehygM33dfo/besttools/F5fSajMMx8BS8Znmj


Configure Disposal for a not NaluShell

Describe the bug
Using the Extension Method "ConfigureForPageDisposal" for a not NaluShell always throws the Exception "Nalu navigation already handles page disposal."
I think the Exception should be thrown if the user tries to call this Method on a NaluShell Object.
The condition is the wrong way around.
Steps to reproduce

call the ConfigureForPageDisposal Extension Method on a used Shell Object in a .net Maui Application
Start the Program -> Exception is thrown

Expected behaviour
No Exception is thrown since it is not a NaluShell Object.

@georg1592 thanks for catching this error: this should be fixed in 1.2.1 (available in a few minutes).
Please note that ShellContents won't be disposed due to the way Shell works.

@georg1592 version 1.3.0 now contains a new flag to provide automatic dispose ShellContents too.
See more here: https://nalu-development.github.io/nalu/#call-dispose-on-page-and-viewmodel-when-the-page-is-popped

@georg1592 version 2.0.0 will be soon released and I had to remove the disposal of ShellContents because there are some use cases where it shouldn't be disposed (i.e. tabs) unless the user leaves the ShellSection.
Given that it's not obvious what the consumer desires, I choose to remove the flag I added in 1.3.0.
On the other hand, I've improved the Nalu navigation abstraction to take into consideration a lot of special use cases, and also to support people who don't want to use MVVM pattern.


Hello, how can I do if I want to test my data? Do I need to retrain?

@wudizuixiaosa sorry for the late reply. Can first infer on your test images using the trained weights provided here https://github.com/rowantseng/FUnIE-GAN-PyTorch/tree/master/evaluation


Update description and tests for step 34 of music player

Describe the Issue
The step asks campers to check if userData?.currentSong is null.
But I don't see why we need to just check for null here.
This should also be an acceptable answer
if (!userData?.currentSong) {
    playSong(userData?.songs[0].id);
}

I don't see the need to only check for null.
We should just check if userData?.currentSong is falsey. That will allow for multiple correct answers instead of one.
Update the description and tests here to allow for multiple valid conditions instead of just one.
Affected Page
https://www.freecodecamp.org/learn/javascript-algorithms-and-data-structures-v8/learn-basic-string-and-array-methods-by-building-a-music-player/step-34
Your code
see explanation above
Expected behavior
see explanation above
Screenshots
No response
System

Device: [e.g. iPhone 6, Laptop]
OS: [e.g. iOS 14, Windows 10, Ubuntu 20.04]
Browser: [e.g. Chrome, Safari]
Version: [e.g. 22]

Additional context
No response

Uhm, is changing seed code for further steps required? It's not mentioned, but changing description to falsey kind of implies that.

The goal of this issue is to allow for multiple correct answers instead of just userData?.currentSong === null
So it is fine if the rest of the steps use the userData?.currentSong === null in the seed code as long as campers are allowed to have answers like this
if (!userData?.currentSong) {
    playSong(userData?.songs[0].id);
}


EPIC: Create Block Stream Simulator

This issue will descibe and capture the work needed to Block Stream Simulator and it's integration with Block Node.

May have to be created in Services.

### Block Stream Simulator
- [ ] https://github.com/hashgraph/hedera-block-node/issues/76
- [ ] https://github.com/hashgraph/hedera-block-node/issues/106
- [ ] https://github.com/hashgraph/hedera-block-node/issues/108
- [ ] https://github.com/hashgraph/hedera-block-node/issues/158
- [ ] https://github.com/hashgraph/hedera-block-node/issues/159
- [ ] https://github.com/hashgraph/hedera-block-node/issues/107
- [x] Create Test Plan
- [ ] https://github.com/hashgraph/hedera-block-node/issues/120
- [ ] https://github.com/hashgraph/hedera-block-node/issues/121

Requirements

Should be able to use real data provided from a pre-defined directory.
Should be able to integrate as a test-client and be used to support E2E Block Node testing.

Check with Michael Tinker in the Block Node slack channel.

EPIC describing the implemented test plan can be found here https://github.com/hashgraph/hedera-block-node/issues/183

@AlfredoG87 and @georgi-l95 noted this is complete and phase 2 work has a different EPIC


Upgrading datastore emulator to work with gRPC

This change ended up "inspiring" a few related changes, see commit messages for details.

@pcostell Do I need to make a note about the minimum version of the gcloud CLI needed for

The existence of the cloud-datastore-emulator (over the legacy gcd-emulator)
The support in the emulator for v1 of the API

👍
The emulator supports v1 gRPC since 111.0.0 with the --no-legacy flag. Starting with 125.0.0, the --no-legacy flag is no longer necessary (although note that there are some issues with emulator persistence in 124.0.0 and 125.0.0, it may be best to disable persistence with the --testing flag).
The command to run is gcloud beta emulators datastore start --no-legacy.

@pcostell Is it worth mentioning the version in our CONTRIBUTING doc? I added the --no-legacy flag here in the script for spawning it and in the note in the CONTRIBUTING doc.

Let's wait for 126.0.0 to come out and then there shouldn't be any issues
and we can recommend all users upgrade past that point.
On Sat, Sep 3, 2016 at 12:54 PM Danny Hermes<EMAIL_ADDRESS>wrote:

@pcostell https://github.com/pcostell Is it worth mentioning the
version in our CONTRIBUTING
https://github.com/GoogleCloudPlatform/gcloud-python/blob/d586990f80501d625b8e6a4e7af9177d039be8e0/CONTRIBUTING.rst
doc? I added the --no-legacy flag here in the script for spawning it and
in the note in the CONTRIBUTING doc.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/gcloud-python/pull/2244#issuecomment-244566624,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABpeM6o38U5VPuN2do_zlD2PzvmLziVyks5qmdB2gaJpZM4J0YUQ
.

--
Patrick Costello |  Cloud Datastore |  Software Engineer |
<EMAIL_ADDRESS>

@tseaver @daspecster this is ready to review

@tseaver @daspecster this is ready to review

Is the insecure stub bit is a hard requirement for using the emulator?

@tseaver Yes. The emulator doesn't speak encrypted requests.

@tseaver Yes. The emulator doesn't speak encrypted requests.

OK, LGTM.

Similarly, I'll hold off merging this until #2223 is in.

Still LGTM. :)

@tseaver Sorry for the delay.


feat: add japanese language support

Description
This PR adds translations for Japanese. There are 2 missing translations in error.json but they'll be translated in a future commit too. Translations here are made by Enes Kağan Düzdağ (can be found as rrat#2626 on Discord) from Ankara University Japanese Language & Literature department.
discord username: nikneym#7666
closes #issue
Please describe your changes. Also describe your aim and content. Do not forget to list the dependencies required caused by those changes.
## Things to check before creating a PR

[ ] I have inspected my topic, checked.
[ ] If it is a core feature, executed detailed tests.

Creating PR rules

[ ] PR must be created for an issue with approved tag. Otherwise PR will be rejected.
[ ] Relevant issue number: The issue number related to PR must be attached to head of PR header, after prefix after prefix # must be attached in parenthesis. A header like this could be used "prefix(#issue_number): PR header" .
[ ] A descriptive and understandable title: The PR title should clearly describe the nature and purpose of the changes. The PR title should be the first thing displayed when the PR is opened. And it should follow the semantic commit rules. For example, a title like "docs(#issueId): Add README.md" can be used.
[ ] Related file selection: Only relevant files should be touched and no other files should be affected.
[ ] Format and Lint Suitability : The code should be made in accordance with a certain format standard and examined according to the lint rules.
[ ] Clean commit history: The commits where the changes are made should be clear and organized.
[ ] Opening PR when job is completed: PR should be opened when job is completed and sent for review by other team members.

Changes

[ ] A new feature (a change that adds a new feature, not a breaking change)
[ ] A new refactor (a change that is not a breaking change, that improves the readability or performance of the code)
[ ] A breaking change
[ ] Documentation change

How were these changes tested?
Please describe the tests you did to test the changes you made. Please also specify your test configuration.
Test Configuration:

Firmware version:
Hardware:
Toolchain:
SDK:

we have urgent problems. please keep this work in your locale. we will announce when we need this features.


Store associations between components

Closes #22

Codecov Report
Attention: Patch coverage is 96.61017% with 4 lines in your changes missing coverage. Please review.

Project coverage is 95.12%. Comparing base (1603653) to head (18fa3a6).

Files
Patch %
Lines

src/infrasys/component_manager.py
91.30%
2 Missing :warning:

tests/test_system.py
94.59%
2 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #42      +/-   ##
==========================================
+ Coverage   95.07%   95.12%   +0.05%
==========================================
  Files          32       33       +1
  Lines        2556     2668     +112
==========================================
+ Hits         2430     2538     +108
- Misses        126      130       +4

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


fix(motion_velocity_smoother): fix stop point (#1694)

Description
https://github.com/autowarefoundation/autoware.universe/pull/1694 のbackport
Related Links
https://tier4.atlassian.net/browse/AEAP-508
Tests performed

上記チケットにて確認
Effects on system behavior

Not applicable.
Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[ ] I've confirmed the contribution guidelines.
[ ] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

Codecov Report

:exclamation: No coverage uploaded for pull request base (beta/v0.3.16@7507f0e). Click here to learn what that means.
Patch has no changes to coverable lines.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@              Coverage Diff               @@
##             beta/v0.3.16    #567   +/-   ##
==============================================
  Coverage                ?   4.81%
==============================================
  Files                   ?      80
  Lines                   ?    7232
  Branches                ?     576
==============================================
  Hits                    ?     348
  Misses                  ?    6666
  Partials                ?     218

Flag
Coverage Δ

differential
4.81% <0.00%> (?)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Errors!

My console error: https://hastebin.com/pogoveyane.lua
Class with the error ( Packets Manager ): https://hastebin.com/aseyesepex.swift
Class with the error ( ProxyMain ): https://hastebin.com/eduqikoruz.java
PLEASE HELP ME :)

This section is for reporting library bugs, not asking for help solving problems with your own code.

For even the code from ptproxy which has my code I found japierdole
there are also unnecessary exceptions in the code that do not suggest anything and the code goes on, really seriously?

"WARNING: Failed to find a usable hardware address from the network interfaces; using random bytes: 2a: 6f: b7: 51: 49: c2: 8e: 57
SXProxy - Proxy By Xores & SuNNyTM <3 "enabled
If I see you on the floor, it will give you a full working proxy so that no one has to buy your shit, and of course a proxy is also a fix that works from 1.7 to 1.12.

This isn't the place for your Polish proxy arguments. Sometimes I wonder if you guys are even on the right website.

@phase One people make proxy with this lib and "polish scums" want to copy that proxy and make $$$ but they don't know java :/ Owner should block those people in repo, thats my opinion

I can make $$$ from a Minecraft bot? Where can I sign up for that?

@phase You need good marketing skills. That's all.

popieram


defaultNodeOptions

Please describe the feature that you want to propose
defaultEdgeOptions is a great feature for extending all edges from a common set of properties. Would it be possible to do the same for defaultNodeOptions? Specifically I want all of my nodes to share a dragHandle className. Currently I'm just mapping over the array and setting the property in the return but it would be cleaner to do this the same way I can for edges. Thanks!

We are trying to be a little cautions about adding new props to the main component, because there are already quite a number of them.
Because edges are automatically created in an uncontrolled flow, there needs to be a way to configure them. The same is not true for nodes: if you want to add nodes you have to add them programmatically anyway, where you can spread some default properties.

Alrighty. Understandable, thanks. I do wish this prop were able to be passed to some default options though (even if not defaultNodes). I'll close but hope you'll revisit. Thanks


Is Echarts 3 responsive ?

Im trying to switch from chartjs to Echarts.
Chartjs resize automatically when i resize the window by default which is not the case for Echarts. Is there any option for that ?
Thank you.

You can use chart.resize() whenever the container size is changed

What if I have multiple charts on the page (inside panel/card) like dashboard? For example I have a panel. Inside panel body, I am showing a bar chart. Since I have specified fix height in px, chart.resize() will not cover the whole panel body. Is there a solution to get the height and width of panel?

@hbthanki Do you mean you fix the height of chart? If you have a flexible panel, don't fix the height of the chart. And resize() when panel changes the size.

Thanks for your reply. I got that working now. However, I have strange observation. If the container(panel)'s only width is changed, and I call .resize() nothing happens. But if I change height and width both and call resize(), chart is resizing properly.

SVG renderer or Canvas renderer ?

Yes I used svg renderer.

SVG renderer had this problem. Already fixed in https://github.com/ecomfe/zrender/pull/303

I have installed echarts from npm i echarts just now. Do I need to refer any branch for this change? Please bear with my little knowledge. And Thank you so much for your replies. I could find below code in echarts.js file:

You need to checkout the latest code of zrender and put it under node_modules

Do I need to specifically import zrender? Because after npm install zrender it is still not working. Either something wrong with my setup or I am missing some other lib?
curiosity question: Without installing zrender, and making renderer: 'svg', it was creating svg. Why do we need extra lib for svg?
Thanks once again.


[7.x] Refactor route caching

The past couple of weeks I've been trying to update the route caching system by using the new Symfony CompiledUrlMatcherDumper and CompiledUrlMatcher in order to get faster route resolving. Unfortunately, the benchmarks that I did so far haven't been very promising. The speed of route resolving vs the old system has almost no difference. By opening a PR here I'm hoping to see if anyone's able to chip in and help out to see if there's anything I'm missing or doing wrong. I've left some comments on the PR itself on some of the parts I'm doubting or where I believe we could do better.
Would love to get some feedback here 🙏
Big thanks to @frankdejonge for the initial inspiration with his work on this! https://github.com/frankdejonge/framework/pull/1

I won't be able to check out soon, but this looks good so far!

@driesvints there is some broken behavior here when using Route::fallback. (https://laravel.com/docs/6.x/routing#fallback-routes). You can see that the normal Route collection has some specific partitioning happening around these routes whereas cached routes don't.
You can see the bug if you define a route setup like this (the domain part is irrelevant as I was testing that as well):
Route::domain('foo.laravel.test')->group(function () {
    Route::fallback(FooFallbackController::class);
    Route::get('/', FooDomainTestController::class);
});

Route::domain('bar.laravel.test')->group(function () {
    Route::fallback(BarFallbackController::class);
    Route::get('/', BarDomainTestController::class);
});

Without route caching, the fallback response is correctly only returned when no other routes match... with route caching enabled, the fallback route's response will over-shadow the / route and will be returned when you hit that route (as well as any other route).

It is likely worth adding tests for CompiledRouteCollection and its various methods as well as RouteCollection (if we don't have tests for that class already).

@driesvints

I've pushed some more changes. This is pretty much the version I intend to send in. Seeing very promising results here (165rps for the new caching vs 85rps for the old way with ab -n 500).

Can you clarify what the speed is WITHOUT any caching at all? From previous testing in our application when caching is enabled it actually has a negative effect due to the large deserialization of the route payload - I'm sure this PR is an improvement over that but is it that much quicker than no caching at all? Registering 1000 routes is actually pretty quick in Laravel without any caching.

@garygreen I get 145 requests per second totally uncached and 517 requests per second cached on an application with 800 GET routes.

Just done some testing with this in our real world app with around 400 routes and I'm actually seeing a negative impact on speed with this PR. There also appears to be a slight regression in speed between Laravel 6 and 7 even without caching.
Laravel 6 (without caching): 130 rq/s
Laravel 7 (without caching): 105 rq/s
Laravel 7 (with caching): 85 rq/s
Very odd. I've double checked that it's definitely using the new caching file on local by adding a random debug statement in routes.php and making sure it doesn't fire.
@taylorotwell how did you manage to go from 145 requests to 517 requests a second? Would it be worth sharing a fork of your setup?

No I'm not preloading anything. Both @driesvints and I are seeing the improvements. I just took this branch and did this in a routes file:
for ($i = 0; $i < 800; $i++) {
    Route::get('/test-'.$i.'/{foo}', 'TestController');
}

class TestController extends Controller
{
    public function __invoke($foo)
    {
        return 'Invoked - '.$foo;
    }
}

Then php artisan route:cache and ab -t 10 -c 1 http://laravel.test/test-799/foo on the command line.

@taylorotwell thanks for the information. Just tested using your benchmark and it does indeed speedup with caching:
22 rq/s without caching
58 rq/s with caching
One thing I have noticed is in the compiled caching file there is a big block of what looks like optimized regex:

However in our apps compiled route caching file there doesn't appear to be any of these kind of optimizations:

I'm wondering if the repetitive nature of test-X is allowing Symphony to do optimizations on those routes and that's why in your benchmark it's quicker - however in our real world app such optimizations haven't been applied so we're not seeing any speed difference.

What's odd as well is in our app we do have repetitive urls that start with "/profile/some-action" "/profile/another-action" so I would of thought we would get some kind of optimized routing on those.

@garygreen you might want to read<EMAIL_ADDRESS>and<EMAIL_ADDRESS>to know how this works.

@nicolas-grekas interesting links. I can't claim to understand all the implementation details of how Symphony is optimizing routes but it does seem like in our application it's not optimizing any of the routes even though according to those articles it should be generating a optimized regex for repeating patterns/prefixes.
Wondering if maybe this PR hasn't called Symphony api correctly to optimize the routes?

@garygreen:

22 rq/s without caching
58 rq/s with caching

That's a huge improvement. I don't know what makes you think routes are not optimized in your case, but that's just not possible as all routes are. The screenshot you posted shows some static routes. The regexp is used only for dynamic routes (the one which contains placeholders). If all/most your routes are static, they were already quite optimized and the diff won't but as big as with dynamic routes. That's maybe why you're seeing a lower diff. But be assured, all works as expected, this is battle tested :)

Verified that the fallback issue isn't present in this pr. Think except for tests that we're pretty much there then.
@nicolas-grekas I'm wondering if it makes a difference if we just returned an array from the compiled routes file and do the setCompiledRoutes call in the service provider instead. Not sure if that makes a difference for opcache?
https://github.com/laravel/framework/pull/31188/files#diff-285965dba4ad1f52b822bbae17e94ca6R14

Not preference in terms of opcache: both ways would provide equal opcache-ability. As fits best for you.

Thank you ALL for helping getting this merged in! Especially @nicolas-grekas and @frankdejonge 👏👏

Hi @driesvints
Thanks for the efforts of this!
But, now you can't set your own validators....
Before this PR, you can replace the validators so we can control the validation rules of routes.
Route::$validators = [
    new MethodValidator,
    new SchemeValidator,
    new HostValidator,
    new UriValidator,
];

This PR completely breaks my code if I cached the routes.
Can we have a change to choose one of them?

@yaquawa this was never documented or publicly supported sorry. You can technically still use that (although I don't recommend to) if you don't use route caching.

Hi @driesvints, but I don't think it's a good idea to change the behavior of how router works just because caching is applied or not. Why not just use one of them? Two implementations works together feels so weird.

@yaquawa sorry we have no plans to change this.

@driesvints
I think the only way to workaround is to use a fallback route now, then I found this piece of code, which I don't know what's the point of this.
https://github.com/laravel/framework/blob/7.x/src/Illuminate/Routing/CompiledRouteCollection.php#L132-L142
The try block always thrown because $this->routes always is an empty collection of routes right? If that's true, why will you need such piece of code?
Could you give me some information about this? Thanks.

@driesvints By the way, do you know if there is a way to use my own match strategy against the request after this PR?

then I found this piece of code, which I don't know what's the point of this.

To handle dynamic route arguments properly. We have tests to back that.

why will you need such piece of code?

The framework supports dynamically added routes at runtime. This collection holds those routes.

By the way, do you know any other ways to use my own "match strategy" against the request after this PR?

Not at the moment no.

@driesvints Thanks! Got it 👍🏼

@driesvints

The framework supports dynamically added routes at runtime. This collection holds those routes.

But I think the "dynamic" ones will never get checked through the CompiledUrlMatcher, which means it never get matched, anything I've missed?

We have tests that verify exactly that.


feat: add span.Warnings to cassandra schema

Which problem is this PR solving?

Resolves #704

Short description of the changes

added Span.Warnings to Cassandra dbmodel.Span

@albertteoh do I also need to include some sort of migration for cassandra schema

Replaced by #4313


nginx doesn't work when load CDM

Hi!
I have followed point to point this tutorial but I encounter some issue... (https://www.nginx.com/blog/compiling-and-installing-modsecurity-for-open-source-nginx/)
When I load the NGINX ModSecurity Connector Dynamic Module and add the modsecurity and modsecurity_rules_file directives to the NGINX configuration to enable ModSecurity my nginx webserver doesn't work anymore.
running journalctl -xe I get:
Subject: Unit nginx.service has begun start-up
-- Defined-By: systemd
-- Unit nginx.service has begun starting up.
Dec 28 00:15:25 user nginx[1593]: nginx: [emerg] dlopen() "/usr/share/nginx/modules/ngx_http_modsecurity_module.so" failed (/usr/share/nginx/modul
Dec 28 00:15:25 user nginx[1593]: nginx: configuration file /etc/nginx/nginx.conf test failed
Dec 28 00:15:25 user systemd[1]: nginx.service: Control process exited, code=exited status=1
Dec 28 00:15:25 user systemd[1]: nginx.service: Failed with result 'exit-code'.
Dec 28 00:15:25 user systemd[1]: Failed to start A high performance web server and a reverse proxy server.
Can you help me?
Where I got wrong?
Thanks

Hi @n0sign4l,
It seems like the ngx_http_modsecurity_module.so is not installed in the directory that it suppose to be. There was any error during the compilation process? Is this file was ever generated?

Running the command locate ngx_http_modsecurity_module.so nothing came up like if the file is not present in the server.. During the build process I didn't see any problem. How should I proceed?
Thx,
Leonardo 'n0sign4l' Porpora
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
Il venerdì, dicembre 28, 2018 1:52 AM, Felipe Zimmerle<EMAIL_ADDRESS>ha scritto:

Hi @n0sign4l,
It seems like the ngx_http_modsecurity_module.so is not installed in the directory that it suppose to be. There was any error during the compilation process? Is this file was ever generated?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

No, I have found it, it's in /root/ModSecurity/nginx-1.14.0/objs/ngx_http_modsecurity_module.so is it well located?

The file is in /etc/nginx/modules/ngx_http_modsecurity_module.so
i get this error
-- Unit nginx.service has begun starting up.
Dec 28 11:35:38 user nginx[20600]: nginx: [emerg] dlopen() "/usr/share/nginx/modules/ngx_http_modsecurity_module.so" failed (/usr/share/nginx/modules/ngx_http_modsecurity_module.so: cannot open shared object file: No such file or directory) in /etc/nginx/nginx.conf:2
Dec 28 11:35:38 user nginx[20600]: nginx: configuration file /etc/nginx/nginx.conf test failed
Dec 28 11:35:38 user systemd[1]: nginx.service: Control process exited, code=exited status=1
Dec 28 11:35:38 user systemd[1]: nginx.service: Failed with result 'exit-code'.
Dec 28 11:35:38 user systemd[1]: Failed to start A high performance web server and a reverse proxy server.
-- Subject: Unit nginx.service has failed

Can you share the output of ldd?
$ ldd /etc/nginx/modules/ngx_http_modsecurity_module.so

I have the same issue can you help me?

Hi @n0sign4l,
I see now that your nginx is trying to load the module in a different directory. You may want to move the file to /usr/share/nginx/modules/ngx_http_modsecurity_module.so or use the full path to load the module in nginx configuration.

@leonardoporp if you have the exactly same problem, the suggestions above should work for you as well. If not, please file a new issue.

HI @zimmerle im having a similar problem im hoping you can help me with. I added the full path but i get the following error:
nginx: [emerg] module "/etc/nginx/modules/ngx_http_modsecurity_module.so" is not binary compatible in /etc/nginx/nginx.conf:6
this is the output i get when i run ldd
$ ldd /etc/nginx/modules/ngx_http_modsecurity_module.so
	linux-vdso.so.1 (0x00007fff209c3000)
	libmodsecurity.so.3 => /usr/local/modsecurity/lib/libmodsecurity.so.3 (0x00007f783abe3000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f783a7f2000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f783a5ea000)
	libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f783a378000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f7839fef000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f7839c51000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f783b212000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f7839a39000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f783981a000)

Thank you!

Hello,
I followed the manual to the letter but I throw the following error
nginx: [emerg] dlopen() "/usr/share/nginx/modules/ngx_http_modsecurity_module.so" failed (/usr/share/nginx/modules/ngx_http_modsecurity_module.so: cannot open shared object file: No such file or directory) in /etc/nginx/nginx.conf:5
additional to this send
ldd: /etc/nginx/modules/ngx_http_modsecurity_module.so: No such file or directory
don't create that file

help me !!!

Disable SELINUX that worked for me

@Mar1on1 please double check if ngx_http_modsecurity_module.so was generated, if not please share the related error message.

still not working for me.  that file is there

I'm also seeing issues with this.  I upgraded to the CRS 3.3.0 and NGINX Plus does not load:
I0401 13:56:26.676724       1 main.go:257] Starting NGINX Ingress controller Version=1.10.1 GitCommit=ba03a73d
W0401 13:56:26.714428       1 main.go:296] The '-use-ingress-class-only' flag will be deprecated and has no effect on versions of kubernetes >= 1.18.0. Processing ONLY resources that have the 'ingressClassName' field in Ingress equal to the class.
W0401 13:56:26.720397       1 warnings.go:70] networking.k8s.io/v1beta1 IngressClass is deprecated in v1.19+, unavailable in v1.22+; use networking.k8s.io/v1 IngressClassList
2021/04/01 13:56:26 [emerg] 11#11: dlopen() "/etc/nginx/modules/ngx_http_modsecurity_module.so" failed (/etc/nginx/modules/ngx_http_modsecurity_module.so: cannot open shared object file: No such file or directory) in /etc/nginx/nginx.conf:9
nginx: [emerg] dlopen() "/etc/nginx/modules/ngx_http_modsecurity_module.so" failed (/etc/nginx/modules/ngx_http_modsecurity_module.so: cannot open shared object file: No such file or directory) in /etc/nginx/nginx.conf:9
F0401 13:56:30.794283       1 manager.go:284] Could not get newest config version: could not get expected version: 0 after 4000 ms

@johnjbateman can you paste the output of ldd /etc/nginx/modules/ngx_http_modsecurity_module.so here?

@johnjbateman can you paste the output of ldd /etc/nginx/modules/ngx_http_modsecurity_module.so here?

In my case, this was an issue where the file actually did not exist.  I made sure I downloaded mod sec and all was well.

@johnjbateman did you got any error during the build process? have you installed ModSecurity connector?

no, i didnt get an error building.  just when running the container.  My issue was i missed actually downloading and installing modsecurity

@johnjbateman I am not were of the details for nginx plus; @defanator may be able to help you better on this issue.

you mis-understood.  My issue is resolved @zimmerle

you mis-understood. My issue is resolved @zimmerle

oh, I see. my bad.

ldd /etc/nginx/modules/ngx_http_modsecurity_module.so
linux-vdso.so.1 (0x00007ffd249cd000)
libmodsecurity.so.3 => not found
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f16dde36000)
/lib64/ld-linux-x86-64.so.2 (0x00007f16de009000)
Help me please...


xfce4-terminal: keyboard input of non-english characters doesn't work

xubuntu 16.04, xfce4-terminal 0.6.3, suplemon 0.1.56
Non-english letters (russsian language) already existent in file are displayed, but when I try to input non-english characters with keyboard, nothing happens, cursor doesn't move. File can be saved, new non-english characters don't go to file.
Nano editor handles non-english charracters perfectly fine.
How can I debug the issue?

Hi!
Thanks for reporting this. What Python version are you using? If it's not Python 3 special characters aren't supported (I know that sucks but that's how the curses lib works 😞  ) If you're using Python 3.4 or higher it's probably a bug in suplemon.

I installed suplemon from cloned repository by sudo python3 setup.py install command.
% python3 --version
Python 3.5.2

I did some testing, and found the bug. For some reason the key code is a string for some characters and an int for others. It's a bit messy since curses is so weird and I'm trying to support both python versions as well as possible.
I pushed the fix to the dev branch. Could you verify it's working correctly? If it's fine I recommend using the dev branch until I get a new version released. The dev branch is usually very stable as I avoid pushing any work-in-progress code to it.
I hope this helps!

Awesome, @richrd, you totally fixed it! :sparkles: Thanks a lot!


DigitalOcean : Create Droplet from snapshot using doctl command line CLI – Here are the steps to do it

DigitalOcean : Create Droplet from snapshot using doctl command line CLI – Here are the steps to do it
https://bobcares.com/blog/digitalocean-create-droplet-from-snapshot/
DigitalOcean : Create Droplet from Snapshot – 2 important steps
Here are 2 important steps to create a DigitalOcean Droplet from a snapshot.
1) Take a Droplet snapshot
Firstly, our Support Engineers create a snapshot of the existing Droplet to save all the current contents of the Droplet.
If you already have a working snapshot, skip this step.
This involves 2 steps.
a) Power off the Droplet
We always power off the Droplet before taking the snapshot to avoid data inconsistency.
For instance, when taking a snapshot on a running Droplet, databases don’t guarantee consistent data.
That is, it takes a while to copy a file and the files may change as you copy them, so your backup file become an inconsistent snapshot.
So, as a precaution, we always poweroff the Droplet before taking the snapshot.
Users can poweroff the Droplet from Power >> Poweroff option in the DigitalOcean control panel.
However, we always poweroff the server via SSH, because this ensures that all the services are stopped before the server is shutdown.
For instance, we use the below command to shutdown the server from command line.
shutdown -h now

b) Take a snapshot of the Droplet
The next step is to take the Droplet snapshot.
Our Support Engineers usually take the snapshot from Snapshots > Take Snapshot option in DigitalOcean control panel.
digitalocean create droplet from snapshot
How to take snapshot from DigitalOcean panel?
Alternatively, in some cases, we have to take the snapshot of a running Droplet.
In such cases, we take the snapshot from Snapshots > Take Snapshot > Take live Snapshot in DigitalOcean control panel.
2) Create a new Droplet from snapshot
The second step is to create a new Droplet from the snapshot.
Our Support Engineers follow the below steps to create a new droplet from the snapshot.
Click Create > Droplets.
Click on Snapshots.
Select the snapshot.
Select the size, Droplet region and additional parameters.
Click on Create.
Alternatively, when we need to create multiple Droplets from the snapshot, we use the command line utility to speed up the process.
For that, we use the DigitalOcean doctl command line client. It uses the DigitaOcean API to access Droplet features.
For instance, we use the below command to create a Droplet from snapshot.
doctl compute droplet create testserver --size 1gb --image debian-8-x64 --region nyc1

Here testserver is the Droplet name, Droplet size is 1GB, snapshot name is debian-8-x64 and Droplet region is nyc1.

Create droplets from image: Common failure points
Most importantly, when creating a new Droplet from snapshot, we ensure that the disk space of the new Droplet is equal to or larger than the Droplet used in snapshot.
This ensures that there is no loss of data during this process.
Also, when a new Droplet is created, it transfers all SSH keys and user accounts from the time the snapshot was created.
Once we create the new Droplet from the snapshot, we always test the services on the new instance as there may be chances that some services will not set to start at boot.
DigitalOcean : Create Droplet from Snapshot – Common failure points
Although creating Droplet from snapshot is a pretty straight forward process, we’ve seen that this can sometimes fail.
Let’s discuss some common scenarios here.
1) Create Droplet from snapshot in different region
We’ve seen customers complain that they get the below error when creating a Droplet from a snapshot in a different region.
The image you specified is not available in the selected region, you can make it globally available by initiating an image region transfer from the images tab.
In order to create a Droplet from a snapshot taken in another datacenter, this snapshot should be transferred to the region where the new Droplet should be created.
Our Support Engineers transfer the snapshot to other regions from Snapshots > Droplet snapshots > More > Add to region > Click on region name. to fix this issue.
2) Create Droplet from command line
Droplet owners usually create Droplets from command line using the snapshots with image slug (for example, centos-6-5-x32, centos-6-5-x64, etc).
However, in some cases, the snapshots don’t come up with a slug to uniquely identify it.
So, in such cases, our Support Engineers get the unique image ID and use it for Droplet creation.
For instance, to create a new Droplet from an image, we first get the unique image ID using the below command.
doctl compute image list-user

After that, we create a new Droplet from the image with this image ID.
doctl compute droplet create testserver --size 1gb --image imageID --region nyc1

Replace imageID with the unique image ID.
Conclusion
In short, create DigitalOcean Droplet from snapshot is useful when there is unexpected server crashes, migration to a new location, and more. Today, we’ve discussed the steps to create a DigitaOcean Droplet from snapshot and the common failure points


Add response flags into cel expression context

For an explanation of how to fill out the fields, please see the relevant section
in PULL_REQUESTS.md
Description: Add response flags into expression context
Risk Level: low
Testing: unit test
Docs Changes:
Release Notes:
[Optional Fixes #Issue]
[Optional Deprecated:]
cc @kyessenov

@lizan ptal? Thanks!


add license

it's a very interesting project!
Would you consider adding a license to this repository to specify under which terms this code can be used or if its possible to consider adding a permissive license?

Yes, I added a license on your post.


Revert "Revert "Implement GetHosts, GetPorts, add tests and revamp (#…

…675)" (#680)"
This reverts commit f1c6daecea6e5b2393c5f6bfbb2672683bf62b28.
What does this PR do?
revert the revert
Motivation
Same as #675
Additional Notes
Anything else we should know when reviewing?

@mfpierre 👍 ?

yeah, ping too soon sorry. I'm on it


Nix: fix invalid default value and extend documentation

Previous default value of date creates null option in gBar config and crashed the bar, removes null as accepted option in SNIIcon* options as that also crashes the bar. I also felt like documentation lacked so wrote this.

Thanks again!


When I create a plugin...

"Call to undefined method System\Classes\VersionManager::listNewVersions()" on line 106 of /usr/share/nginx/html/phpdev/plugins/rainlab/builder/widgets/VersionList.php
This error

Please make sure that you use the latest build of October.

I will try later ,Thinks


Interior face integrator

Hi all,
I want to implement a LinearFormIntegrator only on selected interior (not boundary) faces (for 3D mesh).
For BilinearForm blf, I can
blf.AddDomainIntegrator(),
blf.AddInteriorFaceIntegrator(),
blf.AddBdrFaceIntegrator(),

But for LinearForm lf, it only has
lf.AddDomainIntegrator(),
lf.AddBoundaryIntegrator(),
lf.AddBdrFaceIntegrator().

There is no lf.AddInteriorFaceIntegrator, right?
Thanks in advance!

Yes, LinearForm does not have an InteriorFaceIntegrator. You will have to implement it yourself.

Thanks @vikramsg for your reply,
Did you implement this before? Or can you give some suggestions? I just don't know how and where to start.

Yes, I did implement it some time ago. Essentially you need to copy what is done for the BoundaryFaceIntegrator in linearform.cpp/hpp and that should be good. However, in lininteg.cpp it will be slightly different since the integrator itself will require faceElementTransformation for both right and left hand side unlike the boundary integrator which requires this on only one side.

Hi @vikramsg ,
Sorry to disturb you again. Which MFEM edition do you use? I could not find BoundaryFaceIntegrator in linearform.cpp/hpp. And could you please provide more info about implementing? Thanks a lot.

You can find the function
void AddBdrFaceIntegrator(LinearFormIntegrator *lfi,
                             Array<int> &bdr_attr_marker);

in linearform.hpp.
It can be taken as a template for how you should implement InteriorFaceIntegrator.
Regarding implementation the integrator itself, you can get ideas from bilinteg.cpp such as say void DGDiffusionIntegrator::AssembleFaceMatrix(    const FiniteElement &el1, const FiniteElement &el2,    FaceElementTransformations &Trans, DenseMatrix &elmat).
What you need to do is replace the DenseMatrix &elmat with Vector &elvec, since finally you are going to be sending back a vector of values. Of course the linear integration itself will depend on what you are trying to do.

Thanks @vikramsg a lot.
I think I understand your detailed explanation, but I must take some time to try it. Thanks again.

Hi @vikramsg ,
Sorry to disturb you again. I finished by your explanation, but the result is not right. So I opened another issue Face Integral. Could you please take a look if you have some time?


Nginx crash loop in Kubernetes deployment

Bug description
My (slightly custom) kubernetes deployment works well, except when I try to access System settings.
Steps to reproduce
Steps to reproduce the behavior:

Go to https://defectdojo.XXX.TLD/dashboard
Click on 'Configuration > System settings'
After a long time, the nginx responds with a 503 error

Clicking on System settings totally break nginx container which make DefectDojo unusable. The only workaround is to replace the pod and not use System settings.
I built the Docker containers from the master branch
The modifications I did on my Kubernetes deployment are related to:

Adding a new parser
Activating SSO authentication
Using AWS RDS for database

I did not change nginx configuration or anything related to the core of DefectDojo.
Expected behavior
DefectDojo works well in my Kubernetes environment except the 'System settings' page
Deployment method

[X] Kubernetes
[ ] Docker
[ ] setup.bash / legacy-setup.bash

Environment information

Operating System: Debian GNU/Linux 10

Console logs (optional)
These are logs from the nginx containers on defectdojo-django-* pods:

2020-03-18T19:05:56.952110811Z XX.XX.XX.XX - - [18/Mar/2020:19:05:56 +0000] "GET / HTTP/1.1" 499 0 "-" "kube-probe/1.14" "-"
2020-03-18T19:05:57.646882395Z XX.XX.XX.XX - - [18/Mar/2020:19:05:57 +0000] "GET / HTTP/1.1" 499 0 "-" "kube-probe/1.14" "-"
2020-03-18T19:05:06.952222877Z XX.XX.XX.XX - - [18/Mar/2020:19:05:06 +0000] "GET / HTTP/1.1" 499 0 "-" "kube-probe/1.14" "-"
[...]
XX.XX.XX.XX - - [18/Mar/2020:19:06:35 +0000] "GET / HTTP/1.1" 502 494 "-" "kube-probe/1.14" "-"
2020/03/18 19:06:43 [error] 16#16: *21 connect() to unix:///run/uwsgi.sock failed (11: Resource temporarily unavailable) while connecting to upstream, client: XX.XX.XX.XX, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/uwsgi.sock:", host: "defectdojo.XXX.TLD"
XX.XX.XX.XX - - [18/Mar/2020:19:06:43 +0000] "GET / HTTP/1.1" 502 494 "-" "kube-probe/1.14" "-"
XX.XX.XX.XX - - [18/Mar/2020:19:06:45 +0000] "GET / HTTP/1.1" 502 494 "-" "kube-probe/1.14" "-"
2020/03/18 19:06:45 [error] 16#16: *23 connect() to unix:///run/uwsgi.sock failed (11: Resource temporarily unavailable) while connecting to upstream, client: XX.XX.XX.XX, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/uwsgi.sock:", host: "defectdojo.XXX.TLD"
2020/03/18 19:06:53 [error] 16#16: *25 connect() to unix:///run/uwsgi.sock failed (11: Resource temporarily unavailable) while connecting to upstream, client: XX.XX.XX.XX, server: , request: "GET / HTTP/1.1", upstream: "uwsgi://unix:///run/uwsgi.sock:", host: "defectdojo.XXX.TLD"

Additional context (optional)
There are additional errors at Kubernetes level:
Events:
  Type     Reason     Age                     From                                    Message
  ----     ------     ----                    ----                                    -------
  Warning  Unhealthy  7m27s (x161 over 153m)  kubelet, ip-XX-XX-XX-XX.ec2.internal  Liveness probe failed: HTTP probe failed with statuscode: 502
  Warning  BackOff    2m48s (x360 over 161m)  kubelet, ip-XX-XX-XX-XX.ec2.internal  Back-off restarting failed container

As the error seems related to the uwsgi socket, here is the content of related files:
I have no name!@defectdojo-django-xxxxxxxxxx-xxxxx:/$ cat /run/uwsgi_pass
uwsgi_pass unix:///run/uwsgi.sock;
I have no name!@defectdojo-django-xxxxxxxxxx-xxxxx:/$ cat /run/uwsgi_server
server localhost:3031;

and ENV variables:
I have no name!@defectdojo-django-xxxxxxxxxx-xxxxx:/$ env | grep -i uwsgi
DD_UWSGI_PORT=3031
DD_UWSGI_HOST=localhost
DD_UWSGI_ENDPOINT=/run/uwsgi.sock
DD_UWSGI_PASS=unix:///run/uwsgi.sock

Please let me know if you need more details

I'm closing this issue. I don't know where the problem was coming from, but a redeployment of the Helm chart fixed it...

@sbarbeau-od Did you figure out the reason? I tried redeployment with Helm but  it didn't work for me


Display configuration for Asus tuf A14 FA401WV

Hello there,
Just received a new laptop that I am setting up and trying to get it to work with nixos. I had some issue with the amdgpu igpu but I believe it might too too recent to I disabled it in the BIOS to solely use Nvidia dgpu.
I am importing the configuration like so
  imports =
    [ # Include the results of the hardware scan.
      /etc/nixos/hardware-configuration.nix
      "${builtins.fetchGit { url = "https://github.com/NixOS/nixos-hardware.git"; }}/common/gpu/nvidia"
      "${builtins.fetchGit { url = "https://github.com/NixOS/nixos-hardware.git"; }}/common/hidpi.nix"
    ];

This seems to be almost working, the main issue I have is that all GTK windows are zoomed in like so

Terminal and status bar have normal size but the browser is super zoomed in which is odd.
To make it work I found that issue that is adding
  services.xserver.dpi = 97;
  environment.variables = {
    GDK_SCALE = "0.5";
  };

to the configuration and it is actually working but seems like a weird workaround.
One more weird behavior is that I have only one resolution available on xrandr for the main display (laptop screen)
$ xrandr
Screen 0: minimum 8 x 8, current 6000 x 1600, maximum 32767 x 32767
DP-0 disconnected (normal left inverted right x axis y axis)
DP-1 disconnected (normal left inverted right x axis y axis)
HDMI-0 connected primary 3440x1440+2560+0 (normal left inverted right x axis y axis) 800mm x 334mm
   3440x1440     84.96*+  49.95
   3840x2160     59.94    50.00    29.97    25.00    23.98
   2560x1440    120.00
   2560x1080    119.88   100.00    59.94    50.00
   1920x1080     60.00    59.94    50.00
   1280x720      59.94
   1024x768      60.00
   800x600       60.32
   720x576       50.00
   720x480       59.94
   640x480       59.94    59.93
DP-2 connected 2560x1600+0+0 (normal left inverted right x axis y axis) 302mm x 188mm
   2560x1600     60.00*+ 165.00

DP-2 corresponds to the main laptop screen and is only available in 2560x1600.
Any idea of what could be optimized in the configuration?

Firefox has its own dpi option called layout.css.devPixelsPerPx in about:config.
I think this is a software issue, not a hardware one. It works these days if you use wayland-based compositors for example i.e. I don't see this problem in KDE, but I remember having it before.

I does not seem to be specific to firefox

Every gtk application are zoomed in like 200%. Here there's also qgit, keepassxc and even the i3 tabs that are bigger that they should be. Only the terminal and the status bar are displayed correctly.
Even when logging in, the logging screen is way bigger (I use lightdm). There's probably a misconfiguration, the only thing that works for me is to add
  services.xserver.dpi = 97;
  environment.variables = {
    GDK_SCALE = "0.5";
  };

Only then will I have the correct size for all windows, browser, i3 tabs, gtk app etc and not only the terminal + status bar

Okay. We cannot have environment variables though by default. They are not working correctly when people use wayland and there is no way to detect this.


avoid endless loop between body and primaryReader

avoid endless loop between body and primaryReader, when mirrorPool is used

Codecov Report

Merging #663 (9f77b07) into main (ce53b79) will decrease coverage by 0.20%.
The diff coverage is 57.14%.

@@            Coverage Diff             @@
##             main     #663      +/-   ##
==========================================
- Coverage   80.03%   79.83%   -0.21%
==========================================
  Files          95       95
  Lines       11007    11013       +6
==========================================
- Hits         8810     8792      -18
- Misses       1715     1738      +23
- Partials      482      483       +1

Impacted Files
Coverage Δ

pkg/filter/proxy/primarysecondaryreader.go
82.75% <57.14%> (-3.78%)
:arrow_down:

pkg/object/mqttproxy/session.go
74.23% <0.00%> (-7.98%)
:arrow_down:

pkg/object/httpserver/runtime.go
61.13% <0.00%> (-2.85%)
:arrow_down:

pkg/filter/validator/basicauth.go
78.89% <0.00%> (-1.84%)
:arrow_down:

pkg/object/mqttproxy/client.go
80.54% <0.00%> (+0.90%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ce53b79...9f77b07. Read the comment docs.


Add some examples/*.json w new optimizers (natural_gradient, evolutionary, etc)

Per the latest blog post, those look cool! Would be nice to see them in context w/ their best-fit agents & the sort.
Some personal confusion this would mitigate: the way ppo_agent.json uses an adam step_optimizer is confusing as to whether that replaces a natural_gradient optimizer or augments it, or whether natural_gradient is kind of "assumed" w/ ppo_agent under the hood or needs to be specified. Same for dqn + evolutionary; does that go with adam, or replace it?

Good idea to add some interesting configs which we want to emphasize.
PPO does not use the natural_gradient optimizer, PPO uses MultiStep(Adam) while TRPO uses OptimizedStep(NaturalGradient). The MultiStep part is considered specific to PPO, while whether the internal optimizer is Adam or RMSProp or so is not specified (although we should maybe just fix it for clarity).
Evolutionary is a different optimizer (not using gradient information), so does not combine with Adam. In the blogpost, we put this optimizer overview diagram, which hopefully gives an intuition how optimizers work -- only MetaOptimizer modify another optimizer, all others are atomic but interchangeable.
Hope that clarifies things... :-)

Outdated


matchicons.lua:1034: bad argument #1 to 'tonumber' (value expected)

Hi,
as early adopter I tried the new matchicons.lua this morning.
After enabling it (clink set matchicons.enable true) and restarting my shell, I got following error after the first keystroke:

I was trying to cd into an directory.
clink version: <IP_ADDRESS>dd7ec
I'm disabling it for now.

Thanks for trying it and reporting the error.
I pushed a fix.
The error happened when the DIRX_NERD_FONT_VERSION and DIRX_ICON_SPACING environment variables were not set.  They're related to dirx, and I have them set on my machine because I've been testing the dirx program.


fix / more diagnostics for slow dashboard endpoint

We have noticed a number of requests resulting in a 502 error because stagecraft
is timed out by gunicorn. This is usually requesting the config for an individual
dashboard. Profiling this endpoint showed a lot of queries being generated - the
change to the module manager reduces this significantly. This also adds some
timings to that endpoint, and uses dogslow to give a stack trace of a slow request

Do we have numbers of typical reduction in database queries?

Is 25 seconds (the dogslow threshold) low enough that a worker timeout will trigger it?

Sorry, just noticed it's set to 1. If a worker timeout is 2 that should be fine.

@jabley I've attached the db-queries for a request for the carers-allowance dashboard before and after - https://gist.github.com/timmow/119700ace203f601ca58
Before - 57 queries
After - 17 queries
This could be reduced even further if we used django 1.7 - under 1.6, prefetch_related cannot be used to fetch child modules as we rely on the ordering of child modules. in 1.7, you can supply a custom queryset to prefetch_related which would allow the prefetching of child modules with order.

:+1:
I'm wondering about something that measures how many SQL queries are made per HTTP request. If it's over X, flag it earlier in our deployment pipeline.
plants seed


Marvell PR - R8 release - August 13 2019

Marvell PR - R8 release - August 13 2019
Description
First Marvell PR. August 13 2019.
This PR includes Marvell SDK R8
Our changes have been applied on top of 201906.00_Major tag from the amazon repository (changelist below). Before uploading to our fork, I made sure that the SDK was building without any issue.
Main changes:

Created binary modules for psm, rfget, partition, wifidriver and wlcmgr.
Additional mdev drivers added:

Checklist:

[x] I have tested my changes. No regression in existing tests.
[ ] My code is Linted.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

This is a predecessor of  https://github.com/aws/amazon-freertos/pull/1163


Update Figma Design for User Authentication Workflow

Identified existing designs in the "Low-fi Mockups" project and executed something similar.


Change features and disease API calls for search filter

The phenotypic feature and disease search UIs shouldn't load the whole corresponding ontologies, and just do an API call on a per typed character basis and return a list of 10 options/terms

Works fine


Support for longer videos

Also, would be awesome if the bot would tell what's video length limit, seems like it is about 45-50 minutes

The bot says about the limit if the video is too long (>50 min). Soon I will release a feature that will allow downloading long audio. I think, 3 or 4 hours is enough.

Done in 7eac60e. Now we can download really long files — up to 5 hours.

Woohoo!