inf breaks scipy.stats.norm.cdf for array size >= 4

from jax.scipy.stats import norm
import jax.numpy as np
print(norm.cdf(np.array([np.inf])))
print(norm.cdf(np.array([np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf, np.inf, np.inf])))

breaks for arrays of 4 elements or more on CPU:
[1.]
[1. 1.]
[1. 1. 1.]
[nan nan nan nan]
[nan nan nan nan nan]

For comparison,
from scipy.stats import norm
import numpy as np
print(norm.cdf(np.array([np.inf])))
print(norm.cdf(np.array([np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf, np.inf])))
print(norm.cdf(np.array([np.inf, np.inf, np.inf, np.inf, np.inf])))

gives the expected result:
[1.]
[1. 1.]
[1. 1. 1.]
[1. 1. 1. 1.]
[1. 1. 1. 1. 1.]

Ah, my old friend: fast math mode.
If you set the environment variable XLA_FLAGS=--xla_cpu_enable_fast_math=false the nans go away. I'll need to dig into it a bit further to figure out why, but the size of 4 strongly suggests an issue with vectorization.

We updated XLA to a new version that turns off approximate semantics for reciprocals by default. This fixes the problem in this issue, although it requires that you either rebuild Jaxlib from source or wait for us to make a new release. Hope that helps!


fetchmail: 6.4.12 -> 6.4.13

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/fetchmail/versions.
meta.description for fetchmail is: "A full-featured remote-mail retrieval and forwarding utility"
meta.homepage for fetchmail is: "https://www.fetchmail.info/"
meta.changelog for fetchmail is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 6.4.13 with grep in /nix/store/70yv47148gmypw3k1kwzxqgk91b2jqhq-fetchmail-6.4.13

directory tree listing: https://gist.github.com/7dd6eab39fb949474850a698250d535d

du listing: https://gist.github.com/ccc9901eded0d283df972b38281bad1e

Rebuild report (if merged into master) (click to expand)

4 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
1 i686-linux rebuild(s)
1 x86_64-darwin rebuild(s)
1 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
fetchmail

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/70yv47148gmypw3k1kwzxqgk91b2jqhq-fetchmail-6.4.13 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A fetchmail https://github.com/r-ryantm/nixpkgs/archive/3bf5162b09cdca19d10145324e16fb368db3ca68.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/70yv47148gmypw3k1kwzxqgk91b2jqhq-fetchmail-6.4.13
ls -la /nix/store/70yv47148gmypw3k1kwzxqgk91b2jqhq-fetchmail-6.4.13/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review 1

1 package built:

fetchmail

Maintainer pings
cc @peti for testing.

Result of nixpkgs-review pr 102262 run on x86_64-darwin 1

1 package built:

fetchmail


Extension not archiving everything automatically I visit to my archivebox instance

I can archive a page manually by clicking "Archive Current Page", I can see it in my archivebox instance, but it does not send archive everything I visit automatically. I see no entries of visited webpages.
I've set the config to blocklist, and my blocklist only ignores "*.youtube.com".
I am logged in the browser and the archivebox instance url is set correctly.
Firefox version 127.0.1
Extension version 1.3.1
ArchiveBox v0.7.2 (docker/kubernetes)
with PUBLIC_INDEX/SNAPSHOTS/ADD_VIEW set to false
I'm not sure if I am just misreading the documentation on how it should work (send everything I visit except from the blocklist domains) or if there's an issue.

Small update.
It appears to be working, but very inconsistent. I now see some pages appearing as snapshots that I didn't add, but not everything I visit.
I suspect that my instance is starved for resources, which might be resulting in the api being unresponsive? will report back with more info

Same issue here. The auto-archiving part plainly does not work. I've checked with Wireshark, there is no indication of any attempted network request, and it's not clear to me what is supposed to trigger it. Is  a refresh of the page enough? Open new tab? Nothing helps, and there are no logs. Manual Archive Current Page works fine.

You have confirmed there are no service worker / background.js logs for the extension, or do you mean no logs inside a page's normal devtools console?
If possible could you screenshot the background logs for me while opening a new tab and visiting a page? I can provide instructions to get it on Firefox if needed.

There are no logs at all in Developer Tools for the extension (followed the instructions here) or the devtools for the website itself. The console and network tab is entirely empty.
I do see the network calls in devtools when I explicitly archive a page (that part works fine), but that feature doesn't print anything to console either (I have checked my log-level filters)
One website I'm trying with is derstandard.at. Initially I thought the extension must have concluded that the current website does not match the rules, but "Add current site to domain" also doesn't take effect, and neither does adding a total wildcard regex like .* or .*derstandard.*.

Ok I'll take a look, the extension is overdue for a UI improvement anyway.

I'm also seeing it work very inconsistently when in "allowlist" mode. I've added a few domains and pages aren't being archived consistently.

I recently installed Archivebox and the extension. The adding pages by allowing domain name and visiting pages of that domain name feature is not working for me either. But adding just a single page url by extension works.
Server:
Proxmox 8.2; Debian 12 VM with kernel 6.1.0-26-amd64; Docker 27.3.1. Archivebox running under Portainer.
Clients:
Tested extension running on Firefox 18.4.0esr on the Debian VM, And Windows 11 with browsers Vivaldi 7.0.3495.10, and Firefox 132.0. All running extension version: 1.3.0. Logged into the Archivebox web page on all browsers. PUBLIC_ADD_VIEW set to true.


feat: add dsl router

refer #1535

Codecov Report

Merging #1540 (27b8965) into master (dc3e634) will decrease coverage by 0.15%.
The diff coverage is 54.54%.

@@            Coverage Diff             @@
##           master    #1540      +/-   ##
==========================================
- Coverage   59.42%   59.26%   -0.16%
==========================================
  Files         346      347       +1
  Lines       27628    27659      +31
==========================================
- Hits        16417    16393      -24
- Misses       9386     9432      +46
- Partials     1825     1834       +9

Impacted Files
Coverage Δ

pkg/config/v2/route.go
69.44% <ø> (ø)

pkg/router/virtualhost.go
68.96% <0.00%> (-6.35%)
:arrow_down:

pkg/router/variable_rule.go
80.43% <50.00%> (ø)

pkg/router/dsl_rule.go
68.00% <68.00%> (ø)

pkg/stream/stream.go
34.78% <0.00%> (-13.05%)
:arrow_down:

pkg/stream/xprotocol/connpool_pingpong.go
37.28% <0.00%> (-13.00%)
:arrow_down:

...ream/faulttolerance/regulator/default_work_pool.go
85.71% <0.00%> (-5.72%)
:arrow_down:

pkg/mtls/sds/subscriber.go
74.84% <0.00%> (-2.52%)
:arrow_down:

pkg/upstream/cluster/strict_dns_cluster.go
69.50% <0.00%> (-1.42%)
:arrow_down:

pkg/module/http2/transport.go
76.44% <0.00%> (-0.33%)
:arrow_down:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dc3e634...27b8965. Read the comment docs.

Codecov Report

Merging #1540 (27b8965) into master (dc3e634) will decrease coverage by 0.15%.
The diff coverage is 54.54%.

@@            Coverage Diff             @@
##           master    #1540      +/-   ##
==========================================
- Coverage   59.42%   59.26%   -0.16%
==========================================
  Files         346      347       +1
  Lines       27628    27659      +31
==========================================
- Hits        16417    16393      -24
- Misses       9386     9432      +46
- Partials     1825     1834       +9

Impacted Files
Coverage Δ

pkg/config/v2/route.go
69.44% <ø> (ø)

pkg/router/virtualhost.go
68.96% <0.00%> (-6.35%)
:arrow_down:

pkg/router/variable_rule.go
80.43% <50.00%> (ø)

pkg/router/dsl_rule.go
68.00% <68.00%> (ø)

pkg/stream/stream.go
34.78% <0.00%> (-13.05%)
:arrow_down:

pkg/stream/xprotocol/connpool_pingpong.go
37.28% <0.00%> (-13.00%)
:arrow_down:

...ream/faulttolerance/regulator/default_work_pool.go
85.71% <0.00%> (-5.72%)
:arrow_down:

pkg/mtls/sds/subscriber.go
74.84% <0.00%> (-2.52%)
:arrow_down:

pkg/upstream/cluster/strict_dns_cluster.go
69.50% <0.00%> (-1.42%)
:arrow_down:

pkg/module/http2/transport.go
76.44% <0.00%> (-0.33%)
:arrow_down:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dc3e634...27b8965. Read the comment docs.

add example to https://github.com/mosn/mosn/tree/master/examples/cn_readme/dsl-sample

add example to https://github.com/mosn/mosn/tree/master/examples/cn_readme/dsl-sample

如果只是为了实现 bool 表达式，为什么不直接复用 Go 内置的 ParseExpr，还要引入 cel 这种外部依赖

如果只是为了实现 bool 表达式，为什么不直接复用 Go 内置的 ParseExpr，还要引入 cel 这种外部依赖


SCM vielwet should by default offer Open File on a SCM Resource

Tests: #23311

Since a SCMResource has a sourceURI which should point to the file location in the workspace we should offer an Open File action on it.

Any idea how we could provide this? As an option? What if the sourceURI isn't a file? What if it isn't even an FS resource?

But the comment says:
	/**
	 * The [uri](#Uri) of the underlying resource inside the workspace.
	 */
	readonly sourceUri: Uri;

So it should be a workspace URI which we can open :-)

Touché!

Closing as every SCM provider seems to implement this command without stress.


ci: use latest dart version on Windows again

Since https://github.com/dart-lang/sdk/issues/55745 has been resolved in the meantime, the changes introduced by https://github.com/JKRhb/dtls2/pull/101 can now be reverted.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 83.24%. Comparing base (317b92f) to head (aa529f5).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #120      +/-   ##
==========================================
- Coverage   83.37%   83.24%   -0.14%
==========================================
  Files          11       11
  Lines         740      740
==========================================
- Hits          617      616       -1
- Misses        123      124       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


SCSS linter has been failing

Describe the bug
When linting something other than CSS, you should install an appropriate syntax, e.g. "postcss-scss", and use the "customSyntax" option

To Reproduce
Steps to reproduce the behavior:

Generate new repo
Run npm run linters
See error

Expected behavior
Inters to work

With the release of stylelint 14, they dropped support for non-css languages.
The fix is to install these definitions back and update the config.

See this commit for the fix.
https://github.com/AlaskaAirlines/WC-Generator/pull/265/commits/5b7faa5f6bb5977b9413330d9d162f57ab9a27a1


Configure shadow-rs to run only once during development

After using shadow-rs, even if no code is modified, the code generated by shadow-rs will cause the code that depends on shadow-rs to be recompiled, which is very bad in large projects. If shadow-rs can be configured to run only once during local development, the user experience will be better.

Thank you for the feedback. It should need to solve it.

Hi @leaf-potato  ,apologies for the delayed response to this question. Additionally, the desired solution has finally arrived.
New version publised, please use :
shadow-rs = "0.37.0"

The code in build.rs, use BuildPattern::Lazy.Please see detail:https://github.com/baoyachi/shadow-rs?tab=readme-ov-file#buildpattern
fn main() {
	ShadowBuilder::builder()
+		.build_pattern(BuildPattern::Lazy)
		.build().unwrap();
}

I will close it. If there is a problem, it can be reopened.

@baoyachi This is very good, thank you very much!


[Bug]: youtube search page is much bigger than normal (happened in google chrome)

Describe the bug
for some reason my youtube search page is become bigger by unknown reason (which just happened in google chrome) which is only happened in youtube search page. i'm not sure if others have the same problem as mine. (also turned off style doesn't effect too or this issue maybe nothing to do with this style)
Screenshots
normal

bugged? (i don't know if it bugged or changed)

What browser are you using?
Google Chrome 113
What version of AdashimaaTube are you using?
v2.2.9

I've experienced this problem before, refreshing helped though, I think it's just YouTube


Reconcile and enable monitoring even after virt-operator startup

Is this a BUG REPORT or FEATURE REQUEST?:
/kind enhancement
What happened:
virt-operator deteremine whether or not to enable monitoring by checking the existence of sevicemonitor CRD. However it only occurs during startup. This is somehow limited since a user may deploy prometheus monitoring stack after virt-operaetor startup.
What you expected to happen:
Whenever a user deploy prometheus monitoring CRD, virt-operator must enable monitoring functionality.
How to reproduce it (as minimally and precisely as possible):

Deploy KubeVirt in a cluster
Wait a moment
Deploy prometheus-operator CRD. Then there is no servicemonitor for KubeVirt being created.

Environment:

KubeVirt version (use virtctl version): v0.45.0

/reopen

/reopen since this issue still exists.

/reopen
Does deleting the operator pod resolve this issue?

Yes, but we are more looking for a proper solution like a reconciliation check instead of just a manual workaround fix, thanks for the consideration.

FYI: the workaround in Harvester to recover this issue:
check the virt-operator pod
$ kubectl get pods -n harvester-system | grep "virt-operator" | awk '{print $1}' | xargs kubectl get pods -n harvester-system

NAME                             READY   STATUS    RESTARTS   AGE
virt-operator-78b84587c9-zw2cd   1/1     Running   0          4m51s

delete the virt-operator pod, and wait a while
$ kubectl get pods -n harvester-system | grep "virt-operator" | awk '{print $1}' | xargs kubectl delete pod -n harvester-system

verify the newly replaced virt-operator pod log to confirm prometheusrule is defined
$ kubectl get pods -n harvester-system | grep "virt-operator" | awk '{print $1}' | xargs kubectl logs -n harvester-system | grep "prometheusrule is defined"

{"component":"virt-operator","level":"info","msg":"prometheusrule is defined","pos":"application.go:262","timestamp":"2022-07-12T15:58:40.080472Z"}

The log shows, virt-operator assumes prometheusrule is defined. It's OK now.

Most of the time I would expect to have the monitoring stack deployed before Kubevirt therefore I am not sure we need to dynamically watch this. Maybe others will have a different opinions. @davidvossel wdyt?

I would like to say, unless some software takes care of this, it's diffcult make sure that the monitoring stack is ready before deploy kubevirt.
Or user should add init pod to kubevirt to check this kind of dependency.

we can follow the same pattern we used for cdi in virt-controller.
https://github.com/kubevirt/kubevirt/blob/c568549898a5130fbc32d57b7cc7f3ba7d203920/pkg/virt-controller/watch/application.go#L422
We start the controller, if we see the cdi api comes online during the runtime, then we re-initialize the controller.  We coudl do the same thing for virt-operator. If the prometheus APIs come online after initialization, force a restart.

/reopen

/reopen

/reopen, the PR is pending on review https://github.com/kubevirt/kubevirt/pull/8914, can we please take a review of it, thanks.


DynamoDB: Update item doesn't validate against attributes

Might be related to https://github.com/spulec/moto/issues/2396
Moto doesn't return an error when using putting the wrong attribute type.
Example:
When updating an attribute defined as:
table = dynamodb.create_table(
    ...
    AttributeDefinitions = [{
        'AttributeName': 'this_is_a_number',
        'AttributeType': 'N'
    }]
)

with "put item", using a string value such as "123123jkasdfsdf", moto doesn't return a 400 with a client error.
Expected:
"400 status" and a "The parameter cannot be converted to a numeric value" message (or similar)
Actual:
2xx status
Version: 1.3.15.dev1023
Using through pynamodb
Installed as a mock, boto versions:
boto3==1.14.30
boto==2.48.0
botocore==1.17.30

Thanks for raising this @meshuamam - marking this as an enhancement


Add "query_global_state" query RPC to node

CHANGELOG:

Added a new "query_global_state" RPC endpoint that takes either a BlockHash or state_root_hash param to make query to GlobalState
Added a new GlobalStateIdentifier enum to the rpcs to support the query
Added a new query-global-state command the rust client that takes in a hash which is identified as either a block hash or state root hash along with a key and path arg (similar to the preexisting) query

PS: We could use a better distinction between the "state_get_item" query and the newly added with one this PR on the client side. I am open to suggestions for names that are more distinct
Closes: 1608

bors r+

bors try

bors r+


Inconsistency between Unified and MSTransferor for the Out of Space Disk Sites Information

Impact of the bug
Unified Assignment & Weekly Reporting of Disk Space Information
Describe the bug
Currently, there are two data sources to get a list of out of space disk sites:

Unified Link which uses http://t3serv001.mit.edu/~cmsprod/IntelROCCS/Detox/SitesInfo.txt
MSTransferor Link

This information is used by unified in the assignment of workflows and it is also reported in the weekly CompOps meeting, therefore it is important to have the correct information.
There are sites which is included in the Unified list, but not included in the MSTransferor list and vice versa.
Here is how unified calculates this information:
https://github.com/CMSCompOps/WmAgentScripts/blob/c78be9aea4a374b5b021fc8688a48ceb94ad1eb1/Unified/htmlor.py#L1172-L1190
https://github.com/CMSCompOps/WmAgentScripts/blob/master/utils.py#L2436-L2440
In plain English, it gets the quota and locked/lastCopy from here  and it gets buffer_level information from Unified Configuration which is set to 0.8 currently and if quota*buffer_level - locked < 0 it marks the site as not available.
We do not have a good knowledge how MSTransferor gathers this information. Therefore your comments are important here @amaltaro and @todor-ivanov
How to reproduce it
See the two data sources and compare.
Expected behavior
We need to have a reliable source for Disk space information.

Hi @haozturk , MSTransferor has a similar logic for calculating the available space at the sites, however it is not an original copy of the Unified logic, thus it can indeed have different sites listed as out-of-space. One of those current differences at the moment, is that MSTransferor is supposed to use up to 90% of the quota available (while Unified is set to 80%).
About the MSTransferor logic, these are the 3 WMCore APIs to collect the site quotas and calculate the remaining space for DataOps:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/MicroService/Unified/MSTransferor.py#L125-L127
which are taken from this module:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/MicroService/Unified/RSEQuotas.py
In plain english, the logic is:

get the DataOps quota from Detox
apply a configurable usage fraction (0.9 at the moment)
subtract from the dest_bytes, basically what has been already allocated to DataOps on that site.

Can you please clarify what this information is used for in the workflow assignment?
In my opinion, these numbers do not need to be exactly the same because they are different systems and not meant to be a mirror of each other. In addition to that, I'd say that reporting Storage information in the CompOps meeting should be carried by the Data Management team, not P&R.
BTW, you probably don't know yet, but the WMCore team is working to own all the data management features from Unified, which means Unified will not need to know data location, to know storage status, transfer progress, etc.

@haozturk @amaltaro @todor-ivanov https://github.com/CMSCompOps/WmAgentScripts/issues/623 fyi

@amaltaro if you remember, unified is the one to give a sitewhitelist and the noncustodial site and therefore, it does checks the availability of disk space before assigning that site, if that makes sense to you.

For the SiteWhitelist, this information should not make any differece.
For the non-custodial site, I'm in favor of stopping this during assignment. Maybe we could stop right away? Or we could stop once we have Rucio completely in production (such that we can leave that decision to Rucio)? Perhaps Nick @nsmith- has an input here.

In the case that unified does not fill NonCustodialSites, does it instead create a phedex subscription for the output to a specific site? I cannot recall..

AFAIK Unified does a DDM (NonCusdodial) output data placement when closing-out a workflow (in addition to the tape (PhEDEx?) subscription).
If NonCustodialSites sites is not provided, then the agent will certainly not make any container level disk data placement.

Can we check what fraction of workflows currently do set NonCustodialSites? If I understand correctly, I expect it to be the majority. In which case we should probably make sure it is always set and then during the transition to rucio we can simply start to ignore this parameter, at least for the purposes of satisfying the "grouping=DATASET" rule (#2 in our list).

@nsmith- Is this something that folks on the Unified side can look into?  @haozturk or @z4027163?

@nsmith- @klannon As for now, all the WFs have NonCustodialSites set by the unified.

Given that we have started migrating the DM system to Rucio, and that Unified no longer knows anything about quota, space used and available; shall we close this issue?
If not yet, then could someone please clarify what the actionable from this item is?

Hi Alan, I also do not see any reason to keep this issue after the Rucio transition. We can close it.

I'm closing it then, thanks Hasan.


Instructions

So I followed the instructions. The app ran showed it was finding songs, but for some odd reason in VLC I don't know how to get it to play.

The issue resolved itself


Added badges

Rust version
CI passing
Code coverage
Docs

ALright I'm closing #250 - we opened these simultaneously


Add dynamic disk resource allocation for rnaseq_cgl

Blocked on promises.

Depends on https://github.com/BD2KGenomics/toil/issues/729

Depends on #216

Depends on #267

@jpfeil — You mind giving me a brief tutorial when you get in?  I should really implement this in all the production pipelines.


[JOSS review] Installation on Linux fails due to PyOpenGL_accelerate dependency

Hi there,
second JOSS reviewer here. I ran into a small issue installing the software via pip install patchview. The dependecy list refers to PyOpenGL_accelerate>=3.1.6, but this version is only installable on Windows (only wheels for Windows here: https://pypi.org/project/PyOpenGL-accelerate/#files). Earlier versions also provided a source package, not sure whether they would have been installable. Either way, patchview seems to be working fine without it (as the name suggests, I guess the package is only for optional acceleration). Maybe consider making the dependency optional or add something like ; sys_platform == 'win32' (see PEP 508).

Hi Marcel,
Thanks for reviewing my code.
I've added platform dependent flag as you suggested.  Git repo and PyPI package has been updated accordingly.


add license to documentation

In the context of OSGeo incubation, suggest to add a license for documentation (see pygeoapi for an example https://github.com/geopython/pygeoapi/blob/master/docs/source/conf.py#L98-L101)

The documentation license is here: https://zoo-project.github.io/docs/contribute/howto.html#licensing

Done in 0a265d1.


Functionality to distinguish steps with same name

Issue: Need functionality to distinguish steps with same name but different functionality located in a separate class or package
Summary
Need functionality to distinguish steps with same name but different functionality located in a separate class or package.
Expected Behavior
Cucumber should be able to distinguish steps not just based on the uniqueness of its name but also it's path.
Current Behavior
Currently cucumber does not support multiple steps with the same name even if they are separated by classes or packages.
This forces users to give steps long names which are inconsistent, non-standard and unreadable.
Example:
And user enters <accountNumber> in debit account field in Payments page in Netbank
Possible Solution
A possible solution is to use a new keyword("IN" or "AT") to distinguish steps by a particular class with it's relative path.
Example: IN
And user enters <accountNumber> in debit account field In Netbank/PaymentSteps
Example: AT
Given user has opened Netbank
...
And user clicks Make transfer option
At Netbank/PaymentSteps
And user enters <accountNumber> in debit account field
...
Context & Motivation
I am using Cucumber and selenium for automated testing of a website. This website has multiple pages whose functionalities need to be tested. Some of these pages have similar overall sub functions or design, this warrants steps with identical names even though they are separated using the Page Object model.

You would solve this in one of two ways (I have a similar problem)

You amend the step name to - I enter the accountNumber on the registration page account field (This is the approach I use).

You amend your POM to pass through the concept of a current page. And always activate based on current page (This was the former approach at my company which I've got rid of)

@luke-hill Option 1 would not work as we have created a framework for automated testing of multiple websites. Most of them have a registration page.
Option 2 is not clear for me, could you elaborate or point me to a resource for lookup.
These are messy roundabouts to solve the issue, I'd rather make this a feature that adds value.

For option 1) You alter the text as mentioned. It would work by simply amending your step to be more descriptive.
For option 2) You simply pass in some flag either in a before step, a hook step, a tag. Or some discernible piece of logic. Then you can through any of these means target a specific POM class.
Essentially this logic already exists in a multitude of ways. It's not something we would add additional logic for. On the docs site we have examples of BeforeSteps (In some languages, NOT all), as well as using naming to be more verbose.
Cucumber tags have existed for years, so you can use a tagged step to triage something. Or you could directly use a background step to load the page you wish to test as an instance variable, and then use that concept to be tested.


[Suggestion] Methodmap recognition on variable type

Detect the object handle methodmap on "new" keyword.

This is an example where "new Menu()" doesn't show the methodmap initialization intellisense.

This is another example where the "menu" object doesn't recognize its own methodmap functions but others.
Also, if i type "menu." no intellisense is popped unless I start typing.

Proper methodmap support is on the way, I've just finished refactoring the autocompletion code, I should have everything I need to start implementing this without issues.

Proper methodmap support is on the way, I've just finished refactoring the autocompletion code, I should have everything I need to start implementing this without issues.

🙏🙏🙏

@dran1x @aleeperezz16
This has been implemented in 2.0.0


multiple user/password stanzas

Are multiple authorization stanzas supported by the gnatsd config file?  To upgrade a cluster's credentials incrementally, without full restart at once of all nodes, multiple accounts will be needed.
e.g. to support login by either alice or bob:
authorization {
  user:     alice
  password: T0pS3cr3t
  timeout:  1
}
authorization {
  user:     bob
  password: FinickyNoodle
  timeout:  1
}

The options block in github.com/nats-io/gnatsd/server/opts.go suggests only a single username and pw are supported at present.
// Options block for gnatsd server.
type Options struct {
    ...
    Username           string        `json:"user,omitempty"`
    Password           string        `json:"-"`
    ...
}

So something like this would be needed
type Account string {
 Username string
 Password string
}
...
// Options block for gnatsd server.
type Options struct {
    ...
    Accounts []Account
    ...
}

Not at this time bit are on the roadmap for sure.

@glycerine can you outline/confirm your goal vs a solution if that makes sense.
Here is what I understand from your description above:
You would like support to upgrades to a nats cluster without causing availability loss to nats clients using the cluster. An upgrade could be any change, whether a new version of gnatsd, or a config change (e.g., to change auth tokens)

@camros, right, your description seems spot on to me.

Duplicates #129 -- We'll address this as part of that requirement.


Admin changes search paths

This PR is in progress and is based on prior PR's  (#216)
To review this PR, its probably best just to look at 5cd5352
Portal Admins can change the search destination path (where 'search' links go)
There are portal settings that can be changed by the portal admin which change where 'search' links go to.
Default path will be /search
Learn - path will be /
https://www.pivotaltracker.com/story/show/114576939

Closing this, opening a new one for all of the home-page changes.


Type-safe version of StreamEx.select?

Hello, Tagir.
What do you think about adding type-safe version of select method?
Something like:
public <TT extends T> StreamEx<TT> selectStrictly(Class<TT> clazz) {...}

Literally, the same it was in the old revision before #28, but as a separate method.
Rationale is to prevent cases when you may accidentally forget to perform map to desired type before using select and end up with empty stream without any clue about it.

I doubt people would actually use a new method with a longer name just to add some type safety... Probably it would be better to make a separate unsafe method with a longer name, but what's done is done. Now, this would look more like API pollution...


Lint js files

Do we already have a standard how to lint our js file(s)? E.g.  /src/zabapgit_js_common?

Good idea to lint js. Today's recommendation is to use eslint (not jshint). Though I cannot ground myself - I just used eslint. I'd just stock to one of ruleset e.g. "eslint:recommended" + some specifc rules. Here is my example I use. If no objections I can add a package.json command
extends:
  - eslint:recommended
rules:
  quotes: ['error', 'single', { 'avoidEscape': true }]
  semi:   ['error', 'always', { 'omitLastInOneLineBlock': true}]
  no-console: off
  indent: ['error', 4]
  no-trailing-spaces: ['error']

eslint sounds good

Yeah ........ how many warnings did jshint show ? :)

proposed config
parserOptions:
  ecmaVersion: 5
env:
  browser: true
extends:
  - eslint:recommended
rules:
  quotes: ['warn', 'single', { 'avoidEscape': true }]
  semi:   ['error', 'always', { 'omitLastInOneLineBlock': true}]
  no-console: off
  indent: ['error', 2]
  no-trailing-spaces: ['error']

doubts/questions:

quotes ... since abapmerge escapes singlequotes - both are OK. I like single quotes ... but wrote most of the code with double (because initially there was no escaping)
any other preferences to add ?

https://github.com/larshp/abapGit/compare/master...sbcgua:eslint?expand=1


[AIRFLOW-1529] Support quoted newlines in Google BigQuery load jobs

Dear Airflow maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[x] My PR addresses the following Airflow JIRA issues and references them in the PR title.

Description

[x] Here are some details about my PR, including screenshots of any UI changes:
Support quoted newlines in Google BigQuery load jobs as described in REST API: https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs#configuration.load

Tests

[x] My PR does not need testing for this extremely good reason:
Tested manually on Google Cloud project.

Commits

[x] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Failed some non-deterministic test in one of the runs. Unrelated to this code change.

LGTM merging


Add display name to options

See JIRA: https://issues.apache.org/jira/browse/CAMEL-10847

@gashcrumb @jimmidyson the json schema now includes a displayName field that has the human label you can use in the UI.
See the commit for example

The display name is auto generated base on option name. So if we find some display names that look ugly, then we can override that in the camel source code.
I had to do that for a few of the salesforce names.


scala-steward attempts to upgrade to an nonexistent version

In this pull request, scala-steward attempt to upgrade from 1.2.0+14-7a373cbd to 1.3.0+14-7a373cbd, which is an nonexistent version.

Thanks for the report @Atry. The diff looks good now because @scala-steward updated the PR in the meantime but the erroneous commit is still there: https://github.com/ThoughtWorksInc/Dsl.scala/commit/cb487d1b4cf5060210988d29c255627692519373


Double call of close()

Repro steps: open new editor, type "abc", ⌘-Q to quit, say "don't save".
thread 'main' panicked at 'missing buffer id when closing view', /Users/rustbuild/src/rust-buildbot/slave/stable-dist-rustc-mac/build/src/libcore/option.rs:715

Doing a little debugging, it looks like the close() method in Document.swift is being called twice. I don't know whether this is expected behavior (in which it should null out some of its own state on the first call and skip the second), or whether the NSDocument lifecycle is doing something dodgy to make this double call happen.
Should be an easy issue for someone who understands Cocoa.

Yea this wasn't super heavily tested, and we're doing some weird stuff with NSDocument. I'll take a look in the next couple days if nobody beats me to it.


Using probot without building a Github App

I am planning to use probot internally at work. We have our own enterprise github installation. I am planning to build a server for my team so that all the repos under our org can just link to a common server using webhook.
Is thier way to achive this using probot?
I did try but I was not able to achieve this. Just wondering if their are future plans for this.
Enterprise Github doesnt have support for Github Apps (maybe its just my company)

Hey @gyandeeps, at the moment Probot is built around GitHub Apps. If there are good use cases and demand for making it work for OAuth Apps and plain ol' webhooks, I would not be opposed to it.
In the mean time, I'll point you to some of the libraries that Probot uses under the hood so you can look at wiring them together yourself:

github-webhook-handler is the node module for receiving and verifying webhooks. The README has some sample code to get you up and running with a web server
node-github is the github client that allows you to make REST API requests.

Enterprise Github doesnt have support for Github Apps (maybe its just my company)

GitHub Apps support should be shipping in Enterprise in the next release or two. I know the team is working on it.

Thanks for the input @bkeepers .
I might fork probot and modify to be webhook based if you are ok with that. Thanks again.

@gyandeeps yeah, ping me when you have changes made and we can talk about merging them back in.


Torch max function update

Hi Alejandro,
I guess you updated the training code to work with the updated 'max' function which doesn't return index anymore. (with this commit)
But it doesn't seem to be updated in this demo repository. I haven't ran it myself, I just realized looking at the code.

Thanks for pointing that out, I think I didn't change it here since the bug only affected the on-the-fly accuracy calculation which doesn't get computed here. I've updated it to keep things consistent.

@anewell I think that your update addressing this issue is affecting the results adversely. See https://github.com/anewell/pose-hg-demo/pull/14.


US 02.01.04

ItemList Class
Need to implement the container class ItemList. Needed for containing Items. Foundational to the program.
Requirements

[ ] Sorting
[x] Add, remove, etc

User Story
#12 is the link to the user story for this task.

Sorting not part of the current sprint. Moving to done for now


Webpack is too slow

Note: for support questions, please use one of these channels:
https://forum.ionicframework.com/
http://ionicworldwide.herokuapp.com/
Short description of the problem:
I am using v1.3.7 of ionic-app-scripts and webpack is taking too long. Approximately 80 -100 seconds each time for dev build. Even livereload is taking the same time for webpack
What behavior are you expecting?
Faster webpack time
Steps to reproduce:
I am working on an enterprise project. So would not be able to share code repo here. I even tried the following configs
"ionic_build_to_es5": false,     "ionic_source_map_type": "eval"
package.json
{
   "name":"MyApp",
   "private":true,
   "scripts":{
      "ionic:build":"ionic-app-scripts build",
      "ionic:serve":"ionic-app-scripts serve"
   },
   "dependencies":{
      "@angular/animations":"^4.0.0",
      "@angular/common":"^4.0.0",
      "@angular/compiler":"^4.0.0",
      "@angular/compiler-cli":"4.0.0",
      "@angular/core":"^4.0.0",
      "@angular/forms":"^4.0.0",
      "@angular/http":"^4.0.0",
      "@angular/platform-browser":"^4.0.0",
      "@angular/platform-browser-dynamic":"^4.0.0",
      "@angular/platform-server":"4.0.0",
      "@ionic-native/core":"3.6.1",
      "@ionic-native/google-analytics":"3.6.1",
      "@ionic-native/in-app-browser":"3.6.1",
      "@ionic-native/splash-screen":"3.6.1",
      "@ionic-native/status-bar":"3.6.1",
      "@ionic/cloud-angular":"^0.11.0",
      "@ionic/storage":"2.0.1",
      "@types/dragula":"2.1.29",
      "@types/js-base64":"2.1.4",
      "angular2-jwt":"0.1.28",
      "angular2-logger":"0.5.1",
      "angular2-text-mask":"8.0.1",
      "badwords":"^1.0.0",
      "class-transformer":"0.1.2",
      "core-js":"2.4.1",
      "dragula":"3.7.2",
      "es6-shim":"0.35.1",
      "ionic-angular":"3.1.1",
      "ionicons":"3.0.0",
      "js-base64":"2.1.9",
      "jsonexport":"1.3.2",
      "moment":"2.15.1",
      "moment-timezone":"0.5.6",
      "mydatepicker":"1.10.1",
      "ng2-cookies":"^1.0.3",
      "ng2-dragula":"1.3.0",
      "ng2-pagination":"0.5.1",
      "ng2-translate":"3.1.2",
      "ramda":"^0.23.0",
      "reflect-metadata":"0.1.8",
      "rxjs":"5.1.1",
      "sw-toolbox":"3.4.0",
      "zone.js":"^0.8.4"
   },
   "devDependencies":{
      "@angular/cli":"1.0.0",
      "@ionic/app-scripts":"1.3.7",
      "@ionic/cli-plugin-cordova":"1.0.0-rc.1",
      "@ionic/cli-plugin-ionic-angular":"1.0.0-rc.1",
      "@types/jasmine":"2.2.34",
      "@types/node":"6.0.42",
      "codelyzer":"~0.0.26",
      "copyfiles":"1.0.0",
      "gulp":"3.9.1",
      "jasmine-core":"2.5.2",
      "jasmine-spec-reporter":"2.5.0",
      "karma":"1.2.0",
      "karma-chrome-launcher":"2.0.0",
      "karma-cli":"1.0.1",
      "karma-jasmine":"1.0.2",
      "karma-mocha-reporter":"2.1.0",
      "karma-remap-istanbul":"0.2.1",
      "portfinder":"1.0.9",
      "protractor":"4.0.9",
      "protractor-jasmine2-screenshot-reporter":"0.3.2",
      "run-sequence":"1.2.2",
      "sw-toolbox":"3.4.0",
      "ts-node":"1.3.0",
      "tslint":"3.15.1",
      "tslint-eslint-rules":"1.5.0",
      "typescript":"~2.2.1",
      "yargs":"^6.4.0"
   },
   "description":"An Ionic project",
   "cordovaPlugins":[
      "cordova-plugin-device",
      "cordova-plugin-console",
      "cordova-plugin-whitelist",
      "cordova-plugin-splashscreen",
      "cordova-plugin-statusbar",
      "cordova-plugin-geolocation",
      "ionic-plugin-keyboard",
      "ionic-plugin-deploy"
   ],
   "cordovaPlatforms":[

   ],
   "config":{
      "ionic_build_to_es5":false,
      "ionic_source_map_type":"eval",
      "ionic_bundler":"webpack",
      "ionic_parse_deeplinks":true,
      "ionic_start_watch_timeout":20000
   }
}

Which @ionic/app-scripts version are you using?
v1.3.7
Ionic 3 lazy loading
One more point to be noted is that we are using ionic 3 lazy loading. We have nearly 166 odd modules. We get around 166 odd *.main.js files inside www/build/
Other information: (e.g. stacktraces, related issues, suggestions how to fix, stackoverflow links, forum links, etc)
> ionic-app-scripts serve "--v2" "--address" "<IP_ADDRESS>" "--port" "8100" "--livereload-port" "35729"

[08:19:11]  ionic-app-scripts 1.3.7
[08:19:12]  watch started ...
[08:19:12]  build dev started ...
[08:19:12]  clean started ...
[08:19:12]  clean finished in 22 ms
[08:19:12]  copy started ...
[08:19:12]  transpile started ...
[08:19:18]  transpile finished in 6.58 s
[08:19:18]  preprocess started ...
[08:19:18]  deeplinks started ...
[08:19:19]  deeplinks finished in 783 ms
[08:19:19]  preprocess finished in 785 ms
[08:19:19]  webpack started ...
[08:19:19]  copy finished in 7.78 s
[08:20:39]  webpack finished in 80.33 s
[08:20:39]  sass started ...
[08:20:41]  sass finished in 1.51 s
[08:20:41]  postprocess started ...
[08:20:41]  postprocess finished in 6 ms
[08:20:41]  lint started ...
[08:20:41]  build dev finished in 89.45 s
[08:20:41]  watch ready in 89.77 s
[08:20:41]  dev server running: http://localhost:8100/

[08:20:53]  lint finished in 12.21 s

Can you provide me access to the project so I can trouble shoot?
Thanks,
Dan

@danbucholtz  Thanks for looking into it. This is a enterprise project and as a consultant I would not be able to share the code repo. Let me know what more details I can provide you.
@ztecharoberts Is the tech architect for this project.
Let us know a convenient time for you if we can do a screenshare that will help you identify the issue.

I also am having an extremely hard time during development because of slow build times. Mine is around 155s to complete the build step.
@danbucholtz is there any guide or steps that we may take to debug where the majority of time is being spent?

Can I have access to your repo to figure it out?
Thanks,
Dan

Hi @danbucholtz Yes. We are using lazy loading.
After building, the www/build folder is about 23.4MB in size.
The apk under /platforms/android/build/outputs is around 14 MB in size.
There are around 150 to 160 odd NgModules in our app.
Unfortunately, the repo is at the client side and I will not be able to share the code :(

Those build times are crazy. How long were the build times before lazy loading?
I simply do not have time to create a huge app to test and fix. If you can grant me access, I can investigate and fix the issue. Another option would be creating an open source large project. You could use ionic generate to spin something up quickly.
Thanks,
Dan

Thanks for the tip @danbucholtz
I used the ionic 3 lazyLoadTabs example repository and used ionic generate and created nearly 200 pages. Each in their own NgModule.
Here is the test repo
https://github.com/vigneshmahalingam/test
It took 40 - 50 seconds for webpack to finish. These are just empty pages and simple Modules. But I think this demo achieves what we were trying to show you.
> ionic-app-scripts serve "--v2" "--address" "<IP_ADDRESS>" "--port" "8100" "--livereload-port" "35729"

[17:25:06]  ionic-app-scripts 1.3.4
[17:25:06]  watch started ...
[17:25:06]  build dev started ...
[17:25:06]  clean started ...
[17:25:06]  clean finished in 39 ms
[17:25:06]  copy started ...
[17:25:06]  transpile started ...
[17:25:08]  transpile finished in 2.52 s
[17:25:08]  preprocess started ...
[17:25:08]  deeplinks started ...
[17:25:08]  deeplinks finished in 210 ms
[17:25:08]  preprocess finished in 212 ms
[17:25:08]  webpack started ...
[17:25:09]  copy finished in 2.85 s
[17:25:54]  webpack finished in 45.27 s
[17:25:54]  sass started ...
[17:25:54]  sass finished in 716 ms
[17:25:54]  postprocess started ...
[17:25:54]  postprocess finished in 47 ms
[17:25:54]  lint started ...
[17:25:54]  build dev finished in 48.82 s
[17:25:55]  watch ready in 48.95 s
[17:25:55]  dev server running: http://localhost:8100/

[17:25:58]  lint finished in 3.19 s

Sweet, thank you. Good idea! I'll check it out.
Thanks,
Dan

Thanks @danbucholtz
This is a very big sized project and we are actively developing it. The development times are stretching because of this. Help for this issue from your side is greatly appreciated.

@danbucholtz Any findings ? The dev team is eagerly waiting for a fix.

I have the exact same problem, only that my app is insignificantly small.

@danbucholtz Hi. Just checking to see if there are any improvements ? Thanks.

@danbucholtz  i am facing the same problem, can you help?

I am also facing the same issue. Webpack build time is around 110 secs and webpack update is even slower than the original build.

@danbucholtz I'm facing the exact same issue. More over one additional issue is that the build starts consuming a lot of memory. I have had issues where the memory utilisation spiked up to 103% on my Mac and my system hung with a warning from the OS stating it is out of memory. Kindly let us know if there is any fix for this in progress?

I had the same issue, but when I downgraded to lower versions of ionic-app-scripts it was still slow. It turned out that it was a problem with windows 10 which occured since I installed the Creators update. I could fix it by updating my Nvidia Geforce driver and restarting my computer. My build times are now 6-10 seconds, before it was about 60 seconds.

@Maxeh I am also on Windows 10 Creator and use Nvidia. Can't understand what the correlation would be. Let me try it out

Am trying to run ionic serve --debug to see if the problem is making some sense but I got stuck here
[ DEBUG! ]  [Webpack] transpileLoader: processing the following file: D:\GM Work
            Box\dataon\SunFishGo-Project\sunfishgo-app\node_modules\core-js\library\modules\_to-length.js  MEM:
            1006.2MB
[ DEBUG! ]  [Webpack] transpileLoader: processing the following file: D:\GM Work
            Box\dataon\SunFishGo-Project\sunfishgo-app\node_modules\core-js\library\modules\_to-index.js  MEM:
            1006.2MB

Trying to let it run and see what the console is going to tell me.
FYI latest Production run is taking 39 minutes long:
[21:37:31]  build prod started ...
[21:37:31]  clean started ...
[21:37:31]  clean finished in 1 ms
[21:37:31]  copy started ...
[21:37:31]  ngc started ...
[21:38:48]  ngc finished in 77.06 s
[21:38:48]  preprocess started ...
[21:38:48]  deeplinks started ...
[21:39:02]  deeplinks finished in 13.42 s
[21:39:02]  optimization started ...
[21:39:03]  copy finished in 91.50 s
[21:55:45]  optimization finished in 1003.12 s
[21:55:45]  preprocess finished in 1016.55 s
[21:55:45]  webpack started ...
[22:14:41]  webpack finished in 1135.66 s
[22:14:41]  sass started ...
[22:14:41]  uglifyjs started ...
[22:14:46]  sass finished in 5.28 s
[22:14:46]  cleancss started ...
[22:14:49]  cleancss finished in 3.19 s
WARN: Output exceeds 32000 characters
[22:16:30]  uglifyjs finished in 109.47 s
[22:16:30]  postprocess started ...
[22:16:30]  postprocess finished in 52 ms
[22:16:30]  lint started ...
[22:16:30]  build prod finished in 2338.90 s

So this is the part afterwards, everything after that is working quite fast:
[ DEBUG! ]  Webpack Bundle Updated  MEM: 1367.5MB
[ DEBUG! ]  handleWebpackBuildSuccess: Resolving with Webpack data  MEM: 1367.6MB
[ DEBUG! ]  An WebpackFilesChanged event occurred  MEM: 1367.6MB
[22:49:25]  webpack finished in 615.49 s MEM: 1372.3MB
[22:49:25]  sass started ... MEM: 1372.3MB

@dmastag Yeah production build will take so long with those many lazy loaded components. We are currently in development phase and we are doing a "Dev" build in our local machines.
@Maxeh I am sorry but I don't get the correlation between Nvidia driver and webpack build time. I am currently doing development on a macbook pro.

I strongly think it has something to do with sending an Array of files to webpack. I tried to read the ionic-app-scripts source code to understand how it works or when its sent to webpack with no avail.
But I believe that @danbucholtz is working on it, lets hope he finds a fix for it soon.

I'm seeing slow webpack rebuild times. Initial ionic serve takes 12+ seconds to build, and if I touch a .ts file, the webpack rebuild takes another 6+ seconds with zero actual change (ie just the .ts file was date stamp modified).... ???
global packages:
@ionic/cli-utils : 1.3.0
Cordova CLI      : 7.0.1
Ionic CLI        : 3.3.0

local packages:
@ionic/app-scripts              : 1.3.7
@ionic/cli-plugin-cordova       : 1.3.0
@ionic/cli-plugin-ionic-angular : 1.3.0
Cordova Platforms               : ios 4.4.0
Ionic Framework                 : ionic-angular 3.3.0

Interesting thing I've found is that adding this to the package.json cuts the initial build down to 7 seconds and 500ms for a rebuild (same test). So source maps are where the time is spent !!
"config": {
"ionic_source_map_type": "eval"
}

The difference in our build adding and removing the eval is below.
[09:01:16]  webpack finished in 136.90 s
[09:04:40]  webpack finished in 172.04 s

@ztecharoberts is that difference initial build when starting ionic -serve or incremental build due to change of touching a .ts file?

@gslender initial build

@ztecharoberts would be good to get a time compare for incremental build - that's where I saw the biggest improvement when changing source maps

[16:57:15]  webpack update finished in 281.46 s -- eval
[17:05:13]  webpack update finished in 125.38 s -- no eval

:-(  WOW!  I'll have to stop using Ionic if the incremental build step takes over 2 mins to complete !!!

Well with my research I seem to be running into the same issue as most people with webpack build issues. RemoveParentModulesPlugin seems to run really long.
The biggest issue I have is that the incremental build is not incremental. I am trying to pin down anything I can do to cut that down. My next step will be looking into DLL's to help out builds but would like to hear other ideas.

Here is what I am seeing... RemoveParentModules has to loop through many chunks and many modules

@ztecharoberts based on googling what you just said, this seems to be a webpack problem.
Is there a temporary work around we could do to fix this?

Not that I have found so far.

Maybe swap out webpack for something better?? https://github.com/trivago/parallel-webpack

Swapping it out doesn't sound like an easy task that someone can do a PR for

Just to follow up with some data. I ran a profile as well and you can see where the most time is being spent.

@danbucholtz any thoughts on this? I know that the IonicPage design gets us into a spot where we have a large number of chunks. Any ideas how we may be able to alleviate this in dev mode or all together?

@ztecharoberts curious?? ... what do you mean by "I know that the IonicPage design gets us into a spot where we have a large number of chunks"... is this a design approach that you now wish you'd avoided or something that Ionic itself is encouraging and causing this problem to manifest in TS / Angular based projects???

Where each page is its own module it allows you to have a large number of chunks you need to check the dependencies of, we have over 100 pages right now. As of now Lazy loading is the only way I could get the app I am working on in a state that I could use it as a production website. The one draw back all of our developers are facing right now is the 200s+ build and rebuild times. Which is why I am looking for a solution that will help speed up the incremental or just development only builds unless there is a better solution I am missing.

@ztecharoberts I wonder if the issue is the volume of files, or Angular structure - ie if we pushed the content into less number of folders/files etc but still retained the Class objects templates etc I wonder if the performance of the transpile/webpack would be the same?? Might see if I can test that...

@danbucholtz I am facing the same problem, can you help?

I wonder what would happen if I try to upgrade webpack to version 3
https://medium.com/webpack/webpack-3-official-release-15fd2dd8f07b

It should be an incremental build when running ionic serve. That is strange if you're seeing super long build times or NOT an incremental build in that case. I wonder what is causing that.
Thanks,
Dan

So for me it actually calls the incremental build part of the script. The issue is that it goes through all the dependencies every time it runs the incremental build.

This is a huge issue. I'm in the same boat and am starting to second guess the choice to go with Ionic. Much of the cross-platform coding savings go out the window if I have to twiddle my thumbs for a full minute for every incremental build--and my project is still growing. My two cents: fixing this is far more important than any bug fixes or new features at this point.

Looking into this now.
Thanks,
Dan

Help me out, how do I trigger the long, slow builds?

I am using the test repo from @vigneshmahalingam above. Much appreciated for providing this!
Here's my build folder so I am confident it is building correctly.

Thanks,
Dan

FWIW, I did cheat and use the latest everything related to Ionic. Angular 4.1.3, Ionic 3.5.0, a nightly release of app-scripts, etc. No custom config at all.
{
  "name": "ionic-hello-world",
  "version": "0.0.0",
  "author": "Ionic Framework",
  "homepage": "http://ionicframework.com/",
  "private": true,
  "scripts": {
    "clean": "ionic-app-scripts clean",
    "build": "ionic-app-scripts build",
    "ionic:build": "ionic-app-scripts build",
    "ionic:serve": "ionic-app-scripts serve"
  },
  "dependencies": {
    "@angular/common": "4.1.3",
    "@angular/compiler": "4.1.3",
    "@angular/compiler-cli": "4.1.3",
    "@angular/core": "4.1.3",
    "@angular/forms": "4.1.3",
    "@angular/http": "4.1.3",
    "@angular/platform-browser": "4.1.3",
    "@angular/platform-browser-dynamic": "4.1.3",
    "@ionic-native/core": "3.4.2",
    "@ionic-native/splash-screen": "3.4.2",
    "@ionic-native/status-bar": "3.4.2",
    "@ionic/storage": "2.0.1",
    "ionic-angular": "3.5.0",
    "ionicons": "3.0.0",
    "rxjs": "5.1.1",
    "sw-toolbox": "3.4.0",
    "zone.js": "^0.8.4"
  },
  "devDependencies": {
    "@ionic/app-scripts": "nightly",
    "@ionic/cli-plugin-ionic-angular": "1.3.1",
    "typescript": "~2.2.1"
  },
  "description": "lazyLoadTabs: An Ionic project"
}

@danbucholtz let me try with that setup and let you know what I see. My quick guess is that the number of dependencies the example app has between modules does not provide a good example for a larger project.

Okay, I think this is just a Webpack bug, I'm not sure. If I revert to app-scripts 1.3.7, I can see significantly longer build times.

I think the fix is to use nightly for now, and I will publish a proper release in the next few days.
Thanks,
Dan

@danbucholtz
Btw we are using Ionic CLI v2.
Your system information:
Cordova CLI: 7.0.0
Ionic Framework Version: 3.3.0
Ionic CLI Version: 2.2.3
Ionic App Lib Version: 2.2.1
Ionic App Scripts Version: 1.3.7
ios-deploy version: Not installed
ios-sim version: 5.0.8
OS: macOS Sierra
Node Version: v6.9.1
Xcode version: Xcode 8.3.3 Build version 8E3004b

@ztecharoberts,
It is a really large sample project, 200 pages. Are you on worldwide Ionic slack? Shoot me a msg if so. Let's resolve this. I'll be awake for another hour or so.
Thanks,
Dan

Here's a screenshot of 1.3.12. It sure seems like this is a webpack issue that was fixed in 3.x.

Thanks,
Dan

With the updated config I get better results.
I went from 200s incremental and initial build times to a 52s initial and a 15s incremental as seen below. Thanks Dan for checking in on this! I think you are correct on that this is a webpack issue.
[00:47:48]  ionic-app-scripts 1.3.12-201707060514
[00:47:48]  watch started ...
[00:47:48]  build dev started ...
[00:47:48]  clean started ...
[00:47:48]  clean finished in 37 ms
[00:47:48]  copy started ...
[00:47:48]  transpile started ...
[00:47:59]  transpile finished in 10.44 s
[00:47:59]  preprocess started ...
[00:47:59]  deeplinks started ...
[00:48:00]  deeplinks finished in 1.07 s
[00:48:00]  preprocess finished in 1.45 s
[00:48:00]  webpack started ...
[00:48:00]  copy finished in 12.00 s
[00:48:39]  webpack finished in 39.24 s
[00:48:39]  sass started ...
[00:48:40]  sass finished in 1.26 s
[00:48:40]  postprocess started ...
[00:48:40]  postprocess finished in 4 ms
[00:48:40]  build dev finished in 52.52 s
[00:48:41]  watch ready in 53.13 s
Running live reload server: http://localhost:35729
Watching:
√ Running dev server:  http://localhost:8100
Ionic server commands, enter:
restart or r to restart the client app from the root
goto or g and a url to have the app navigate to the given url
consolelogs or c to enable/disable console log output
serverlogs or s to enable/disable server log output
quit or q to shutdown the server and exit
ionic $ [00:49:45]  build started ...
[00:49:45]  transpile update started ...
[00:49:45]  transpile update finished in 24 ms
[00:49:45]  deeplinks update started ...
[00:49:46]  deeplinks update finished in 961 ms
[00:49:46]  webpack update started ...
[00:50:01]  webpack update finished in 14.50 s
[00:50:01]  build finished in 15.55 s

I am going to close this issue. Please try npm install @ionic/app-scripts@nightly and let me know how it goes. This should have scope hoisting too so your apps should start up faster. I will publish the official fix tomorrow most likely. I am going to look into splitting out the vendor code to make the incremental build even faster. Will likely result in semver-ing to 2.0.0. Gotta chat with the team before doing that.
Thanks,
Dan

Great news, I am going to run some tests to see if this is working and will let you all know how it goes

Thanks a lot @danbucholtz
The incremental builds are now fantastic. It got reduced from 100 seconds to 10 seconds.

Moving to the nightly stuffed up the proxy for me... so can't use it...

I was testing it and ionic serve is now much faster than before which is awesome.
Having a different problem with the nightly regarding angular2-moment though which prevents me to production build and will create a separate issue for it.

So the Dev Build is at 69 secs now, which is awesome. But when doing any updates on the .ts files I am gettings this error.
<--- Last few GCs --->

[26200:000001915F275E60]   226469 ms: Mark-sweep 1406.1 (1520.3) -> 1406.0 (1520.3) MB, 1179.8 / 0.0 ms  last resort

<--- JS stacktrace --->

==== JS stack trace =========================================

Security context: 00000023F10A9891 <JS Object>
    1: decode(aka base64VLQ_decode) [D:\project\node_modules\source-map\lib\base64-vlq.js:138] [pc=0000011DC6FDD1F8](this=0000013EC7910BD9 <an Object with map 000000BED9687BB9>,aStr=0000005C58815259 <String[34]: AAAA,OAAO,EAAE,UAAU,EAAE,MAAM,eAAe>,aIndex=1,aOutParam=0000005C58815571 <an Object with map 0000015AC1B031D1>)
    2: _parseMappings(aka Sou...

FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory

Yes I found despite the build being much quicker, when updating my .ts files the rebuild wasn't including my changes. So something is still not quite right.

Yeah @dmastag Some of our team members are facing the same error
JavaScript heap out of memory
@danbucholtz any idea why ?

Can you try giving ionic more heap space?
node --max_old_space_size=4096 $(which ionic) serve on linux/mac.
Thanks,
Dan

Would you know the same command for Windows ?

I don't, but it should be the same concept. node --max_old_space_size=4096 /path/to/ionic serve

That helped to solve the memory issue. Thanks @danbucholtz

Good news folks, apparently Webpack 3.1 coming soon is supposed to be significantly faster than 3.0 🎉
So expect to see a further reduction in build times! Truthfully, we are pretty unhappy with the long build times but our hands are sort of tied right now.
Thanks,
Dan

Hello,
Can you all test @ionic/app-scripts@nightly? The changes required will be adding a <script src="build/vendor.js"></script> to the src/index.html like so:
body>

  <!-- Ionic's root component and where the app will load -->
  <ion-app></ion-app>

  <!-- The polyfills js is generated during the build process -->
  <script src="build/polyfills.js"></script>

  <script src="build/vendor.js"></script>

  <!-- The bundle js is generated during the build process -->
  <script src="build/main.js"></script>

</body>

This will be app-scripts 2.0.0.
Thanks,
Dan

Ok so playing with it build and rebuild times seem to be the same.
[11:55:38]  ionic-app-scripts 1.3.12-201707071538
[11:55:38]  watch started ...
[11:55:38]  build dev started ...
[11:55:38]  clean started ...
[11:55:38]  clean finished in 37 ms
[11:55:38]  copy started ...
[11:55:38]  transpile started ...
[11:55:49]  transpile finished in 10.69 s
[11:55:49]  preprocess started ...
[11:55:49]  deeplinks started ...
[11:55:50]  deeplinks finished in 1.16 s
[11:55:51]  preprocess finished in 1.56 s
[11:55:51]  webpack started ...
[11:55:51]  copy finished in 12.37 s
[11:56:31]  webpack finished in 40.87 s
[11:56:31]  sass started ...
[11:56:33]  sass finished in 1.62 s
[11:56:33]  postprocess started ...
[11:56:33]  postprocess finished in 4 ms
[11:56:33]  build dev finished in 54.87 s
[11:56:34]  watch ready in 55.55 s
Running live reload server: http://localhost:35729
Watching:
√ Running dev server:  http://localhost:8100
Ionic server commands, enter:
restart or r to restart the client app from the root
goto or g and a url to have the app navigate to the given url
consolelogs or c to enable/disable console log output
serverlogs or s to enable/disable server log output
quit or q to shutdown the server and exit
ionic $ [11:56:45]  build started ...
[11:56:45]  transpile update started ...
[11:56:46]  transpile update finished in 26 ms
[11:56:46]  deeplinks update started ...
[11:56:46]  deeplinks update finished in 948 ms
[11:56:46]  webpack update started ...
[11:57:07]  webpack update finished in 20.53 s
[11:57:07]  build finished in 21.58 s
[11:57:45]  build started ...
[11:57:45]  transpile update started ...
[11:57:45]  transpile update finished in 16 ms
[11:57:45]  deeplinks update started ...
[11:57:49]  deeplinks update finished in 3.84 s
[11:57:49]  webpack update started ...
[11:58:03]  webpack update finished in 14.32 s
[11:58:03]  build finished in 18.17 s

OMG its so fast now.
Too bad that the angular2-moment problem is still persistent.

@ztecharoberts could you check into your<EMAIL_ADDRESS>file and see what webpack dependency you have? I had a similar problem yesterday where it was still on 2, so what I did was run npm uninstall @ionic/app-scripts and then npm install @ionic/app-scripts@nightly --save-dev --save-exact

@dmastag I am getting a separate vendors js atm. Also seeing webpack 3.1

So after using the latest Nightly (1.3.12-201707071759) I can show you the comparison between before and after:

Also the other issue regarding angular2-fire has been solved also.
Am very happy now :-)

I had similar issues on a large project (200 pages +) and was able to fix by doing the following:
Upgrade dependencies (specifically, Ionic app-scripts):
-        "@ionic/app-scripts": "1.3.12",
-        "@ionic/cli-plugin-cordova": "1.4.1",
-        "@ionic/cli-plugin-ionic-angular": "1.3.2",
+        "@ionic/app-scripts": "^2.1.3",
+        "@ionic/cli-plugin-cordova": "1.5.0",
+        "@ionic/cli-plugin-ionic-angular": "1.4.0",

REQUIREMENT:  After upgrading I had an error "webpack json" on trying to run ionic serve.  You MUST make sure to add the following to your index.html if its not there.
<!-- With update of ionic scripts we need to add build/vendor -->
<script src="build/vendor.js"></script>

And also upgrading to latest ionic actually puts the version in your local repository, so worth mentioning.
"ionic": "3.6.0"
Best Regards,
@jedihacks

{
"name": "SDSM",
"version": "0.0.2",
"author": "Ionic Framework",
"homepage": "http://ionicframework.com/",
"private": true,
"scripts": {
"clean": "ionic-app-scripts clean",
"build": "ionic-app-scripts build",
"lint": "ionic-app-scripts lint",
"ionic:build": "ionic-app-scripts build",
"ionic:serve": "ionic-app-scripts serve"
},
"dependencies": {
"@angular/animations": "5.2.10",
"@angular/common": "5.2.10",
"@angular/compiler": "5.2.10",
"@angular/compiler-cli": "5.2.10",
"@angular/core": "5.2.10",
"@angular/forms": "5.2.10",
"@angular/http": "5.2.10",
"@angular/platform-browser": "5.2.10",
"@angular/platform-browser-dynamic": "5.2.10",
"@ionic-native/core": "4.7.0",
"@ionic-native/firebase-analytics": "^4.7.0",
"@ionic-native/google-plus": "^4.7.0",
"@ionic-native/native-page-transitions": "^4.7.0",
"@ionic-native/splash-screen": "4.7.0",
"@ionic-native/status-bar": "4.7.0",
"@ionic-native/themeable-browser": "^4.7.0",
"@ionic/pro": "1.0.20",
"@ionic/storage": "2.1.3",
"angularfire2": "^5.0.0-rc.10",
"com.telerik.plugins.nativepagetransitions": "^0.6.5",
"cordova-android": "7.0.0",
"cordova-plugin-device": "^2.0.2",
"cordova-plugin-firebase-analytics": "^0.14.0",
"cordova-plugin-googleplus": "^5.3.0",
"cordova-plugin-ionic-keyboard": "^2.0.5",
"cordova-plugin-ionic-webview": "^1.1.19",
"cordova-plugin-splashscreen": "^5.0.2",
"cordova-plugin-whitelist": "^1.3.3",
"cordova-support-android-plugin": "^0.3.7",
"cordova-support-google-services": "^1.1.0",
"firebase": "^5.0.4",
"ionic-angular": "3.9.2",
"ionicons": "3.0.0",
"rxjs": "5.5.10",
"sw-toolbox": "3.6.0",
"zone.js": "0.8.26"
},
"devDependencies": {
"@ionic/app-scripts": "^3.1.7-201801172029",
"typescript": "~2.6.2"
},
"description": "An Ionic project",
"cordova": {
"plugins": {
"cordova-plugin-whitelist": {},
"cordova-plugin-device": {},
"cordova-plugin-splashscreen": {},
"cordova-plugin-ionic-webview": {},
"cordova-plugin-ionic-keyboard": {},
"com.telerik.plugins.nativepagetransitions": {},
"cordova-plugin-googleplus": {
"REVERSED_CLIENT_ID": ""
},
"cordova-plugin-firebase-analytics": {
"FIREBASE_CORE_VERSION": "16.0.+"
}
},
"platforms": [
"android"
]
}
}
i have 13 pages and 10 are lazy loaded
it is taking too long still while using  ionic cordova build --prod --release android

I have waited 2 hr CPU at full speed still no progress after webpack


Initial version

Initial version of the library

One small comment above, and some lint issues, but otherwise LGTM 👍


RC4 Crashes on response for HTTP Webhook!!!

Same on my machine.
The last successfull log is done here: https://github.com/deepstreamIO/deepstream.io/blob/91054a1571d95db7257534e57c3c49d09b676780/src/message/connection-endpoint.js#L267
I tried to back track where the last successfull log comes from to determine where the TypeError come from, but this stack trace doesn't help me.
    at ConnectionEndpoint._authenticateConnection (/Users/awilhelm/dev/deepstreamio/deepstream.io/src/message/connection-endpoint.js:266:89)
    at emitOne (events.js:77:13)
    at Socket.emit (events.js:169:7)
    at Socket.onPacket (/Users/awilhelm/dev/deepstreamio/deepstream.io/node_modules/engine.io/lib/socket.js:102:14)
    at emitOne (events.js:77:13)
    at WebSocket.emit (events.js:169:7)
    at WebSocket.Transport.onPacket (/Users/awilhelm/dev/deepstreamio/deepstream.io/node_modules/engine.io/lib/transport.js:104:8)
    at WebSocket.Transport.onData (/Users/awilhelm/dev/deepstreamio/deepstream.io/node_modules/engine.io/lib/transport.js:115:8)
    at WebSocket.onData (/Users/awilhelm/dev/deepstreamio/deepstream.io/node_modules/engine.io/lib/transports/websocket.js:76:30)
    at /Users/awilhelm/dev/deepstreamio/deepstream.io/node_modules/uws/uws.js:379:20

Cheers, found the issue: handleAuthStrategy in config-initialiser only passes the options on. Will send PR in a moment, but there is also an issue with socket's being disconnected whilst HTTP request in flight


update pre code color

Don't commit code into main branch, it's a producation release way after test watching, so you can submit the code pull request into develop branch.


Create distribution badges to mark features specific to a distribution

Summary

Add badges for the different The Things Stack distributions. Looks like this, with a tooltip on hover:

Clicking the badges takes you to a page that explains what they are:

@pierrephz, PR needs a TTN frame. Is this a colored square or the TTN logo? @johanstokking ?
Changes:

Add distribution icons
Remove distributions-inline shortcode (only distributions shortcode exists now, always produces the icons)
Rename Marketplace launcher to AWS launcher
Rename Community to The Things Network

Checklist

[x] Scope: The referenced issue is addressed, there are no unrelated changes.
[x] Run Locally: Verified that the docs build using make server
[ ] New Features Marked: Documentation for new features is marked using the new-in-version shortcode, according to the guidelines in CONTRIBUTING.
[x] Style Guidelines: Documentation obeys style guidelines in CONTRIBUTING.
[x] Commits: Commit messages follow guidelines in CONTRIBUTING, there are no fixup commits left.

I also left the inline distribution shortcode untouched because sometimes it has to fit in tiny tables, but @pierrephz maybe you can think of an aesthetic way to integrate it here?:

regarding this, I am thinking about an. "information" label that you can hover to get the info (see screenshot below):

I also left the inline distribution shortcode untouched because sometimes it has to fit in tiny tables, but @pierrephz maybe you can think of an aesthetic way to integrate it here?:

regarding this, I am thinking about an "information" label that you can hover to get the info (see screenshot below):

I like this idea, but maybe we use a tiny colored stack of icons instead of the bubble? @htdvisser also suggested wrapping sections to fix https://github.com/TheThingsIndustries/lorawan-stack-docs/issues/139

@pierrephz @kschiffer how about something like this for inline? we could also even minimize all the badges

and for the badges @pierrephz ? or we can just change everything to the stacked icons

@pierrephz @kschiffer how about something like this for inline? we could also even minimize all the badges

Just the (stacked) icons is too implicit. I think this only works in conjunction with a descriptive label, e.g. All deployment models.

Yea could be
What is the purpose? save some space?

Actually, I think for inline, this can work, if it shows the tooltip on hover. I still think the stacked icon needs to be a bit clearer though.

yes, should be a bit larger, and more space in-between if we go for this

Yea could be
What is the purpose? save some space?

Actually, I think for inline, this can work, if it shows the tooltip on hover. I still think the stacked icon needs to be a bit clearer though.

yes, should be a bit larger, and more space in-between if we go for this

Yep, especially for places with no space. It is also much less intrusive.

ok @pierrephz here's what I have today:
On cards:

Inside page and inline:

@kschiffer the frustrating issue i'm encountering is that the image span isn't lining up with the text. There's no up or down margin or anything on the spans, I can't understand why they are moving vertically?

Decided to go with the stacked icons because it's clean, simple, fits everywhere, and is nearly fixed size. @pierrephz please take a look. Also, we need an icon for The Things Network. Maybe a little cloud or something?

Decided to go with the stacked icons because it's clean, simple, fits everywhere, and is nearly fixed size. @pierrephz please take a look. Also, we need an icon for The Things Network. Maybe a little cloud or something?

Looks great, good job! Here are some remarks:

I had to change @import<EMAIL_ADDRESS>to @import<EMAIL_ADDRESS>in order to make this work
I'm not seeing tooltip on hover

Should be fixed now, the I added the bulma-tooltip package with npm when I should have used yarn, so it wasn't in yarn.lock and make deps didn't install it for you.

@benolayinka that works
find here the cloud icon for ttn:
ttn.svg.zip

With the ttn frame it looks like this:

Is that okay or we do something else?


[feature]: sweep: implement alternative fee functions

The current LinearFeeFunction is reasonable for short deadlines (e.g., < 10 blocks) where it is critical to confirm things quickly, but it may be overly aggressive for longer deadlines (e.g., 80+ blocks).
By implementing other fee curves we can optimize for different deadlines and save fees.  See @yyforyongyu's thorough evaluation of several curves.

Fixed link ("overly aggressive"): https://github.com/lightningnetwork/lnd/pull/8424/files#r1543560104

Hello Matt,
would like to hijack the issue, as I also have methodological concerns about the LinearFeeFunction, which I have illustrated below with another alternative.
I'd be interested in feedback from those reading along on the alternative. If there are no objections, I would like to start a first implementation draft in the coming weeks.
Btw: Regardless of the methodology, there still seems to be an issue with calling the fee function. Otherwise it is not possible to explain why this pleb ended up at 1000 sat/vb although he was permanently online and onchain fees were low.
https://mempool.space/tx/2a5b92a5be69799f9eb919e54426248c6fcb9c85e44692711761e34b1b1b2068
Downsides of the LinearFeeFunction
The LinearFeeFunction is initialized with a maxFeeRate, which is set by default to 1000 sat/vbyte, and can be adjusted via configuration down to 100 sat/vbyte. I see some downsides. If I have misunderstood something, don't hesitate to correct me.

When using the default setting, the function becomes very steep depending on CLTV. With a CLTV of 40 blocks, the linear fee function increases by about 25 sats/vbyte per block. At 144 blocks, the increase is around 7 sats/vbyte per block.

The function becomes steeper if it is initialized at a later stage, such as when a node comes back online after an extended downtime. In the extreme case where we need to sweep a pending HTLC that has already exceeded its deadline, we are forced to pay the maxFeeRate.

This also means that two fee functions that were initialized with the same absolute deadline but at different times due to different CLTVs have different values and steepnesses for the same conf_target.

Node runners can only control the steepness of the function by lowering the maxFeeRate via configuration. While they may do so, with a 100 sat/vbyte floor, people risk losing their funds in a high-fee environment because the linear fee function is capped at this value. But people are more likely to forget.

Alternatives
endingFeeRate depending on on-chain fees
We could make the endingFeeRate dynamic by using the current on-chain fee rate for a conf_target of 1 or 2. However, this approach risks a sweep not getting confirmed if on-chain fee rates increase very slowly.
Model with a limited exponential fee function
We define a function $g(x)$, which depends on the current conf_target $x$. The actual fee function is min(maxFeeRate; g(x)).
For the definition of $g$, we need the following parameters:

$\lambda \in [0;1]$
$m \geq 0$
The current on-chain fee $f(x)$ at the time the function is called

Now we can define:
$$
g(x):=(m\lambda^{x-1} + 1)\cdot f(x)
$$
This function has the following properties:

$g(x) \geq f(x)$, meaning it always returns values at or above the current on-chain fees.
$g(x) \leq (m+1)\cdot f(x)$ and $g(1)=(1+m)\cdot f(1)$, which means our fee function has an upper limit with a safety buffer capped at $m\cdot f(x)$. This buffer is dynamic and scales with the current on-chain fees.
$\lambda$ allows us to control the speed at which we approach the maximum of $(m+1)\cdot f(x)$.

Let's examine how the factors $m\lambda^{x-1} + 1$ behave for different scenarios of conf_targets $x$ and various $\lambda$ values. We assume $m=1$, meaning we pay a maximum of twice the current on-chain fees.

0.9
0.95
0.975
0.99

1
2
2
2
2

6
1.59
1.77
1.88
1.95

40
1.02
1.14
1.37
1.68

144
1
1
1.03
1.24

With $\lambda=0.975$, we see a surcharge of 37% on top of the on-chain fees 40 blocks before the deadline, making it less likely that confirmation will not occur before this time. If $m=2$, the surcharge is doubled.
Overall, the likelihood of not getting a confirmation with the model is very unlikely. This is actually only possible if the fees increase faster from block to block than the risk buffer at the time.

The LinearFeeFunction is initialized with a maxFeeRate, which is set by default to 1000 sat/vbyte

This is incorrect. A fee func is always initialized with an ending feerate derived from the budget. Only when the budget feerate exceeds the maxFeeRate will the default 1000 sat/vb be used. This is detailed in the readme.
As for the budget, you can already configure it as detailed in this section.
The whole point of the budget-based design is to move away from fee estimators, instead, we want to limit how much fees we want to pay in sats, as it's more accurate than using fee rate to restrict the onchain cost.
I do think the fee func can be expanded, this is why there's this report as a starting point. If we want to implement more algorithms, I think we need to update the report, run the simulations, and update our knowledge about the effects of the different algorithms.

The LinearFeeFunction is initialized with a maxFeeRate, which is set by default to 1000 sat/vbyte

This is incorrect. A fee func is always initialized with an ending feerate derived from the budget. Only when the budget feerate exceeds the maxFeeRate will the default 1000 sat/vb be used. This is detailed in the readme.

Sorry, it was not my intention to portray anything as incorrect. With the usual htlc sizes and with the default settings of the budgets, however, it will usually always run out to 1000 sat/vb as initial param. An HTLC of 300k is completely sufficient.
I also think a budget-based approach is very good. However, I would only see a budget as a final cap on the output and not as a target value for the algorithm. The cap should be preceded by a function that returns a very risk-averse value based on the current on-chain fee estimates. I have described a possible model approach above.

however, it will usually always run out to 1000 sat/vb as initial param. An HTLC of 300k is completely sufficient.

Suppose we are sweeping an incoming HTLC in a tx, the estimated weight is 1142 wu, given the max fee rate of 1000 sat/vb, which is 250 sat/wu, and a default budget conf of 50%, the HTLC must be greater than 571k sats to reach the max fee rate, since the ending fee rate is calculated using 571000 * 0.5 / 1142.
For outgoing it's a similar value, around 533k. But due to a temp issue this is 4x smaller until #7683 is fixed.
On the other hand, if the HTLC has a large value, it's recommended to cap the budget using --sweeper.budget.deadlinehtlc to a desired value.

The cap should be preceded by a function that returns a very risk-averse value based on the current on-chain fee estimates.

Aside from being budget-based, the sweeper is also deadline-based, which means it has already considered the timeout risk. For every block the tx is unconfirmed, there's always a tradeoff - spend more to wait for fewer blocks, or spend less but wait a few more blocks. And the idea here is, the user specifies the max fees he/she is willing to pay to get it confirmed before the deadline hits.
As for the model, the important question is, given the current reliability of fee estimators, how do you know "the current on-chain fees"? If the fee estimators can accurately tell us the network feerate, we don't even need the fee function.

For outgoing it's a similar value, around 533k. But due to a temp issue this is 4x smaller until #7683 is fixed.

I had this example in my mind. Maybe the issue was the reason that 315k were enough
https://mempool.space/address/bc1qsqdgl7kh5krwrh0jfncjgd93uxmeuapf7p403asxrwlseyvxwswqfm5l7f

As for the model, the important question is, given the current reliability of fee estimators, how do you know "the current on-chain fees"? If the fee estimators can accurately tell us the network feerate, we don't even need the fee function.

By “current on-chain fees” I meant the current return values of the estimator for the number of blocks until deadline. However, this can only be a lower limit on which a multiplier must be applied as a risk buffer in order to be really safe. To determine the multiplier, the noderunner can surgically analyze the historical on-chain data or simply make a conservative expert estimate.


I am trying to use Database Inspector in Android Studio. always showing my application database (highlighted in the image) as "closed".

Any word on this issue?

@deepakjsr7979 No idea, i tried on one of my App running on an Emulator Pixel 3a XL API29 and when i opened the Database Inspector, i could not see any of the databases, i got Nothing to show. I am running Android Studio 4.1.2. i look at other apps ie com.google.android.calendar , there i can see the all the dbs. Looking at the Device File Explorer the only difference i can see it that the permissions for the databases for the com.google.android.calendar are -rw-rw---- where for my dbs the permissions are -rw------- Can you check on yours and tell me.

@deepakjsr7979  I changed the permissions of my dbs to -rw-rw---- but it does not change anything i still cannot see the databases in the Database Inspector So i cannot help more on this, sorry for this.

@deepakjsr7979 I changed the permissions of my dbs to -rw-rw---- but it does not change anything i still cannot see the databases in the Database Inspector So i cannot help more on this, sorry for this.
Have you seen the answer there ? Or can suggest any thing from this link

https://stackoverflow.com/questions/65058335/android-studio-database-inspector-always-showing-database-as-closed

@deepakjsr7979 I had a look but it does not change anything from my side. I do not see the databases even when i start in the debug mode. Did you do something to see them any preferences ? I am running the emulator in Android Studio.

@deepakjsr7979 I had a look but it does not change anything from my side. I do not see the databases even when i start in the debug mode. Did you do something to see them any preferences ? I am running the emulator in Android Studio.

i am ruining on android device.  and if  device android ver > 26 then u can see all the data base in android studio.

@deepakjsr7979 I am running API 29 and I cannot see them. Why do you not use DB Browser to look at your DB's. It is free and works. You can also address this point to Android Studio.

@deepakjsr7979 I am running API 29 and I cannot see them. Why do you not use DB Browser to look at your DB's. It is free and works. You can also address this point to Android Studio.

I don't know if db browser will so live device database change .. as android studio will so

@deepakjsr7979 As i cannot do too much i close the issue

Is there any new info on this issue (asking just in case someone has any updates) ?

@jjkavalam
Click on your close database icon
Enable (keep open) by clicking on the icon surrounded by the black rectangle  see picture

Now you should see your database

@jjkavalam it seems that you can access them only when the app is not running and not during the debugging process but i could not find the reason for it

I faced a similar issue when I was working with Room, the latest SQLite-based DB.
I solved this by adding the following to the Manifest
<uses-permission android:name="android.permission.INTERNET" />

It makes sense to me as the application may need internet access to reach the Inspector.

how to open the database in andoid studio koala version using java


Improve StringEncoding

Strings of IR modules coming from SIL may now be obfuscated.

Added test coverage in 013943fbe67d733d2bf31574f6aba7fb683b5af8 too, thanks.


stuck after running waagent -deprovision+user -force

I wanted to give VHD export a try (taking a working Azure based Ubuntu (18.04)  and exporting it) but when I ran the commands from this resource It dawned on me that I had deleted / removed my user account that I previously was able to use to SSH into the VM.
What do I need to do to recover from this?  I had no backups running unfortunately.
commands used:
ssh azureuser@<publicIpAddress>
sudo waagent -deprovision+user -force
exit
more details can  be found here: https://stackoverflow.com/questions/53965828/add-new-ssh-user-account-for-azure-ubuntu-vm

@aamakerlsa please link the document which you are following so that we can properly respond.

@MarileeTurscak-MSFT https://docs.microsoft.com/en-us/azure/virtual-machines/linux/download-vhd
Update: I've since deleted the resource group and re-created it from scratch.  But my question after dealing with all that is this -- is there a way to have an UBUNTU (16.04) LEMP stack as an Azure VM, while KEEPING the vm user account and the Azure VM, export to .VHD or .VHXD?  Or is the act of exporting the VM always going to mean deprovisioning the user account and deallocating the vm from Azure?

@jakaruna-MSFT - thanks.  That makes perfect sense.  No, I can't think of a use case where the user info would need to be retained -- it would actually make migration harder probably.  Its far more convenient to have a process where (upon installation of the VHD) you're presented with all the dialogs to populate with  user account info.  Is there some formal documentation on generalizing a VM that I might be able to read up on?  Or is it the sort of thing where its spread out and will require a broad search (as opposed to a laser focus on a particular document  /  set of documents)?


Rendering Issue fixed

Fixes issue #17 wherein widgets overflowed.

Additional commits are previous ones which haven't been closed yet!

This was supposed to be fixed in https://github.com/CCExtractor/ccextractorfluttergui/pull/8/files not sure how it came back, I will look into this later myself. Also don't need the doc changes here again

It was but on small screens there still was overflowing. Fixed that by changing values. Moreover, different values were giving a bit informal look. Keeping both the widths same seemed better!

About the doc changes, I mistakenly applied that through my main branch. It needs to be merged before any other PRs by me. I am sorry for the mistake but you'll need to merge it first.


enhance sdl2 pixelformat selection

fixes #202 and #201

this is a nice improvement. I think the long list of pixel formats can be shorter.
we also need to update the code that copies pixels from vidframe into the SDL texture:
https://github.com/alfredh/baresip/blob/master/modules/sdl2/sdl.c#L174
the code assumes YUV420P. it needs to handle that data[i] and linesize[i]
is zero for some formats.
for example when I tested your patch locally, an input frame with NV12
causes a crash in the pixel copying code.

Dear Alfred,
to be honest, in this shape this shouldn't have appeared as pull request. The patch wasn't even working.
I've tried to fix the issue in a rush, and have overlooked that h264_decoder was not set properly to h264_cuvid. Therefore I thought everything was working during the test, but it simply wasn't as there where no NV12 frames input to the sdl2 module.
Thank you for your efforts to fix it!


bug(mat-select): Support for selection through Alpha/Numeric keys broken

Reproduction
It seems that the support for skipping to a select item by typing, similar to the native select in MatSelect has been removed in recent updates. This support was added in https://github.com/angular/components/pull/2907
Steps to reproduce:
Open https://stackblitz.com/edit/angular-a9vnec?file=src/app/select-custom-trigger-example.html
Set focus on the select list and quickly press few keys corresponding to a country name for example just type PAK, ideally it should set focus on Pakistan, but you will notice the focus is set to a new list item after each key press and you will end up selecting Kazakhstan from the list.
Expected Behavior
mat-select should support skipping to a select item by typing, a behavior similar to the native select.
It's really helpful especially in case of large lists.
Actual Behavior
Although pressing any key takes user to the first element of the list that starts with that key but quickly pressing subsequent key doesn't further filter the selection.
Environment

Angular:11.0.3
CDK/Material:11.0.2
Browser(s): Chrome
Operating System (e.g. Windows, macOS, Ubuntu): Windows

Duplicate of https://github.com/angular/components/issues/21242. It should be resolved in the next minor release. If you don't want to wait until then, you can work around it by passing in a typeaheadDebounceInterval.


Issue #364 fixed by PR #470 has now regressed

Issue #364 fixed by PR #470 has now regressed.
The code has changed quite a bit since, so right now I am not too sure where to intervene to address the regression. Anyone?

Fixed in the latest version. Please let us know if you still have that issue, then we reopen it!


How to solve 2 libraries with same package name in my dependencies??

I have below  dependencies
   compile 'com.google.android.gms:play-services:6.5.87'
    compile('com.google.maps.android:android-maps-utils:0.3.4')

Now i am getting below error:
Error:Execution failed for task ':app:processDebugResources'.

Error: more than one library with package name 'com.google.maps.android'
You can temporarily disable this error with android.enforceUniquePackageName=false
However, this is temporary and will be enforced in 1.0

How to solve it??

(More info on targetting google play depdencies is here: https://developers.google.com/android/guides/setup)


Something going wrong.

Hello! I am spring up again. When I run the code of feature_condensation,It tell me that (layer L4)command not found.I am confused.Can you explain the reasons for the occurrence of this problem?(The detailed question is in the picture at the end of the text.)
Thank you in advance!

Hi, the problem here is how you copied the command into the terminal, I think. It stopped after the last \ and the last line (--layer L4) is not used for the command (and creates a second error in bash, not the python script). Try removing the comment after the imagenet line (the # or e.g. …) or typing it out by hand.
Also, make sure that you have a GPU available and the gpu-version of pytorch installed (your env name indicates otherwise, but maybe you did it by hand, then don’t worry). If you want to run it on CPU only, put in --dev cpu instead, but it will be very slow.

Thanks for your prompt reply!
Hope you have a nice weekend!


Method Illuminate\Http\Request::validate does not exist

Laravel Version: 5.7.28
PHP Version: 7.2
Database Driver & Version: MySQL

Description:
I'm try to login in Voyager admin panel.
In Illuminate\Foundation\Auth\AuthenticatesUsers i found method:
  protected function validateLogin(Request $request)
   {
       $request->validate([
           $this->username() => 'required|string',
           'password' => 'required|string',
       ]);
   }

but Request doesn't exist method validate!
And i have a error:
Method Illuminate\Http\Request::validate does not exist
Please help!

Hey there,
Unfortunately we don't support this version anymore. Please check out our support policy on which versions we are currently supporting. Can you please try to upgrade to the latest version and see if your problem persists? We'll help you out and re-open this issue if so.
Thanks!


New version: Microsoft.PowerToys version 0.83.0

Checklist for Pull Requests

[ ] Have you signed the Contributor License Agreement?
[ ] Is there a linked Issue?

Manifests

[ ] Have you checked that there aren't other open pull requests for the same manifest update/change?
[ ] This PR only modifies one (1) manifest
[ ] Have you validated your manifest locally with winget validate --manifest <path>?
[ ] Have you tested your manifest locally with winget install --manifest <path>?
[ ] Does your manifest conform to the 1.6 schema?

Note: <path> is the directory's name containing the manifest you're submitting.

This package installs and launches normally on a Windows 10 VM.


Refact documentation to leverage jupytext

Another WIP in parallel of #3940 to test a new approach and keep the old one untouched ftm.

@jorgepiloto @dcrawforAtAnsys  In the end I played a bit with the hooks and I added two functions to:

add ipython magic %%time to every code cell in the sources used by sphinx (this leave our examples clean while allowing us to retrieve the execution time of each cell)
remove ipython magic %%time from the html files which could be confusing for our users.

This is the resulting html page

@SMoraisAnsys , @jorgepiloto : This looks good, but I cannot build local documentation. There seem to be import errors for PyAedt. Further investigation is needed.

@SMoraisAnsys , @jorgepiloto : This looks good, but I cannot build local documentation. There seem to be import errors for PyAedt. Further investigation is needed.

Cleaning the build folder fixed the problem :)

@SMoraisAnsys : There are two issues that I see:

The relative path to the image doesn't work. This could be solved by putting _static content into the Examples folder.
Equations are not rendered at all. See the updated 00_EDB_Create_VIA.py. Still need to investigate this but I think we're on the right path.

@SMoraisAnsys The image copying works. *.py files are still not rendered in HTML as they are in Jupyter Lab using Jupytext. I added some examples in the folder 00-EDB and also created a _static folder.

I would avoid centering the output of the cells. This breaks the custom formatting that an input cell may impose.
If it is fine by you, I will upload in a single commit the friendly CSS style that removes the cell numbers and ensures the proper space and font size.

I would avoid centering the output of the cells. This breaks the custom formatting that an input cell may impose.
If it is fine by you, I will upload in a single commit the friendly CSS style that removes the cell numbers and ensures the proper space and font size.

I just collected all CSS files under doc/source/_static/css in https://github.com/ansys/pyaedt/pull/4064/commits/1ba25b6807e5bf27dc1c954f7740283bf10e7752

@dcrawforAtAnsys I changed the modification you did to a previous commit.
I don't have issues with equations, see

and

@SMoraisAnsys *.py files are still not rendered in HTML as they are in Jupyter Lab using Jupytext.

From my laptop, the changes seems to be minor, what would you want to modify ?
Note: it seems that the logic I added to put the %%time label isn't working on some text cells (which explains why the previous example was failing)

Closing this PR as we re moving the examples into another repo.


Screen cheese with "Open file" icon

open SCM viewlet
hover over a change

Sorry about that, fixed the screen 🧀


Master

Sorry about that.
Trying to setup my fork as a VCS so that I can user it in my project and I was a bit too hasty in my doings.


Download symbol successfully, but not source code inside

Good afternoon, I'm trying to find the source code of the "Dynamics GP Intelligent Cloud" and "Business Central Cloud Migration - Previous Release".
I included them in app.json file and download symbol successfully, then I extracted .app files. No source code inside except SymbolReference.json file.  Please help.
Regards,
Kelly

I am sorry, but that doesn't seem like a docker problem.
The apps we ship are as .app files inside the container and on the DVD - I don't know whether this app is there.

The cloud migration apps are no longer on the DVD as they are not supposed to be installed locally.
They are to be installed in cloud and connect to local database.