chore(remix-node): bump @remix-run/web-fetch to latest

fixes TypeError: Value of "this" must be of type URLSearchParams on Node 20

Closes: #

[ ] Docs
[ ] Tests

Testing Strategy:

@MichaelDeBoey when it will in released version?


[SPARK-10065][SQL] Avoid triple copying of var-length objects in Array in tungsten projection

JIRA: https://issues.apache.org/jira/browse/SPARK-10065
Currently we do unnecessary copying of objects in the array. We should avoid them.

/cc @JoshRosen @davies

Merged build triggered.

Merged build started.

Test build #41685 has started for   PR 8484 at commit 9e118c2.

Test build #41685 has finished for   PR 8484 at commit 9e118c2.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41685/
Test FAILed.

Merged build triggered.

Merged build started.

Test build #41687 has started for   PR 8484 at commit 9f88786.

Test build #41687 has finished for   PR 8484 at commit 9f88786.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41687/
Test FAILed.

Merged build finished. Test FAILed.

retest this please.

Merged build triggered.

Merged build started.

Test build #41691 has started for   PR 8484 at commit 9f88786.

Test build #41691 has finished for   PR 8484 at commit 9f88786.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class LogisticRegressionModel @Since("1.3.0") (
class SVMModel @Since("1.1.0") (
class GaussianMixtureModel @Since("1.3.0") (
class KMeansModel @Since("1.1.0") (@Since("1.0.0") val clusterCenters: Array[Vector])
class PowerIterationClusteringModel @Since("1.3.0") (
class StreamingKMeansModel @Since("1.2.0") (
class StreamingKMeans @Since("1.2.0") (
class BinaryClassificationMetrics @Since("1.3.0") (
class MulticlassMetrics @Since("1.1.0") (predictionAndLabels: RDD[(Double, Double)])
class MultilabelMetrics @Since("1.2.0") (predictionAndLabels: RDD[(Array[Double], Array[Double])])
class RegressionMetrics @Since("1.2.0") (
class ChiSqSelectorModel @Since("1.3.0") (
class ChiSqSelector @Since("1.3.0") (
class ElementwiseProduct @Since("1.4.0") (
class IDF @Since("1.2.0") (@Since("1.2.0") val minDocFreq: Int)
class Normalizer @Since("1.1.0") (p: Double) extends VectorTransformer
class PCA @Since("1.4.0") (@Since("1.4.0") val k: Int)
class StandardScaler @Since("1.1.0") (withMean: Boolean, withStd: Boolean) extends Logging
class StandardScalerModel @Since("1.3.0") (
class FPGrowthModel[Item: ClassTag] @Since("1.3.0") (
  class FreqItemset[Item] @Since("1.3.0") (
  class FreqSequence[Item] @Since("1.5.0") (
class PrefixSpanModel[Item] @Since("1.5.0") (
class DenseMatrix @Since("1.3.0") (
class SparseMatrix @Since("1.3.0") (
class DenseVector @Since("1.0.0") (
class SparseVector @Since("1.0.0") (
class BlockMatrix @Since("1.3.0") (
class CoordinateMatrix @Since("1.0.0") (
class IndexedRowMatrix @Since("1.0.0") (
class RowMatrix @Since("1.0.0") (
class PoissonGenerator @Since("1.1.0") (
class ExponentialGenerator @Since("1.3.0") (
class GammaGenerator @Since("1.3.0") (
class LogNormalGenerator @Since("1.3.0") (
case class Rating @Since("0.8.0") (
class MatrixFactorizationModel @Since("0.8.0") (
abstract class GeneralizedLinearModel @Since("1.0.0") (
class IsotonicRegressionModel @Since("1.3.0") (
case class LabeledPoint @Since("1.0.0") (
class LassoModel @Since("1.1.0") (
class LinearRegressionModel @Since("1.1.0") (
class RidgeRegressionModel @Since("1.1.0") (
class MultivariateGaussian @Since("1.3.0") (
case class BoostingStrategy @Since("1.4.0") (
class Strategy @Since("1.3.0") (
class DecisionTreeModel @Since("1.0.0") (
class Node @Since("1.2.0") (
class Predict @Since("1.2.0") (
class RandomForestModel @Since("1.2.0") (
class GradientBoostedTreesModel @Since("1.2.0") (

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41691/
Test FAILed.

Merged build triggered.

Merged build started.

Test build #41700 has started for   PR 8484 at commit 451971c.

Test build #41700 has finished for   PR 8484 at commit 451971c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41700/
Test PASSed.

Merged build finished. Test PASSed.

Merged build triggered.

Merged build started.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41710/
Test FAILed.

retest this please.

Merged build triggered.

Merged build started.

Test build #41714 has started for   PR 8484 at commit 35371fb.

Test build #41714 has finished for   PR 8484 at commit 35371fb.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41714/
Test PASSed.

Merged build finished. Test PASSed.

Hi @viirya , thanks for looking into this!
The reason for this extra copy is that we iterate the array twice: calculate elements data size and copy elements to array buffer.
A simple solution is to follow createCodeForStruct, we can dynamicly grow the buffer when needed and thus don't need to know the data size ahead.
I have opened https://github.com/apache/spark/pull/8496 to fix it, do you mind take a look?

Merged build triggered.

Merged build started.

Test build #41736 has started for   PR 8484 at commit fe7b7bf.

Test build #41736 has finished for   PR 8484 at commit fe7b7bf.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41736/
Test PASSed.


Kubernetes environment stuck at "Waiting for Kubernetes API" after change ldap auth from user to group

Rancher versions: 1.6.5
Docker version: (docker version,docker info preferred) 1.12.6
Operating system and kernel: (cat /etc/os-release, uname -r preferred) Ubuntu 16.04
Type/provider of hosts: (VirtualBox/Bare-metal/AWS/GCE/DO) Bare-metal
Setup details: (single node rancher vs. HA rancher, internal DB vs. external DB) Single
Environment Template: (Cattle/Kubernetes/Swarm/Mesos) Kubernetes
Steps to Reproduce:

Enable access control with openldap, create one Kubernetes environment, and grant access to one ldap user with owner role.
Add hosts
Kubernetes environment works fine.
Disable access control, change some settings for group search, then enable access control again
Delete the user above from Kubernetes environment, add the user's group instead
Login Kubernetes environment, found environment stuck at "Waiting for Kubernetes API"

Reference:
https://github.com/rancher/rancher/issues/9442
Add:
Recreated the whole environment, issue persists, error logs here:
7/28/2017 10:14:49 AME0728 02:14:49.142579       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:14:49 AME0728 02:14:49.163340       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:14:55 AME0728 02:14:55.025851       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:14:55 AME0728 02:14:55.569272       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:15:00 AME0728 02:15:00.855652       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:15:06 AME0728 02:15:06.153319       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]
7/28/2017 10:15:11 AME0728 02:15:11.437003       1 authentication.go:58] Unable to authenticate the request due to an error: [invalid bearer token, [invalid bearer token, invalid bearer token]]

You are hitting this issue: https://github.com/rancher/rancher/issues/9150
Groups don't work with k8s RBAC in k8s 1.6.5 but it will be fixed in the next Rancher release with our k8s v1.7.


Discuss new tests

I think we should make our tutorial examples into tests as it was suggested

[ ] test for the kl-divergence estimators (todo @pjdaly )
[ ] test for the mutual information estimators (todo @raulpardo )


FiberRef<A> subtype of Effect<A>

Type

[ ] Refactor
[x] Feature
[ ] Bug Fix
[ ] Optimization
[ ] Documentation Update

Description
The FiberRef<A> is now a subtype of Effect<A>. This change simplifies handling of deferred values, removing the need for explicit call FiberRef.get.
import { Effect, FiberRef } from "effect"

Effect.gen(function* () {
  const fiberRef = yield* FiberRef.make("value")

  const before = yield* FiberRef.get(fiberRef)
  const after = yield* fiberRef
})

Related

Related Issue #
Closes #

Hmm, Micro tests looks flaky

Hmm, Micro tests looks flaky

Seems like it, will take a look in another PR. Thanks!


Clicking on settings before sync bar appears after startup causes an app error.

Still an issue with 0.0.6.RC5 - Windows 10 home.


Trouble Installing TRFL 1.0.1 in Colab

I tried installing trfl version 1.0.1 in Colab and am getting an error:
import trfl
---------------------------------------------------------------------------
NotFoundError                             Traceback (most recent call last)
<ipython-input-2-dd69192d7d7c> in <module>()
----> 1 import trfl

/usr/local/lib/python3.6/dist-packages/trfl/__init__.py in <module>()
     29 from trfl.discrete_policy_gradient_ops import discrete_policy_gradient_loss
     30 from trfl.discrete_policy_gradient_ops import sequence_advantage_actor_critic_loss
---> 31 from trfl.dist_value_ops import categorical_dist_double_qlearning
     32 from trfl.dist_value_ops import categorical_dist_qlearning
     33 from trfl.dist_value_ops import categorical_dist_td_learning

/usr/local/lib/python3.6/dist-packages/trfl/dist_value_ops.py in <module>()
     31 import tensorflow as tf
     32 from trfl import base_ops
---> 33 from trfl import distribution_ops
     34
     35 Extra = collections.namedtuple("dist_value_extra", ["target"])

/usr/local/lib/python3.6/dist-packages/trfl/distribution_ops.py in <module>()
     28 import tensorflow as tf
     29 import tensorflow_probability as tfp
---> 30 from trfl import gen_distribution_ops
     31
     32

/usr/local/lib/python3.6/dist-packages/trfl/gen_distribution_ops.py in <module>()
      1 import tensorflow as tf
----> 2 _op_lib = tf.load_op_library(tf.resource_loader.get_path_to_datafile("_gen_distribution_ops.so"))
      3 project_distribution = _op_lib.project_distribution
      4 del _op_lib, tf

/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/load_library.py in load_op_library(library_filename)
     58     RuntimeError: when unable to load the library or get the python wrappers.
     59   """
---> 60   lib_handle = py_tf.TF_LoadLibrary(library_filename)
     61
     62   op_list_str = py_tf.TF_GetOpList(lib_handle)

NotFoundError: /usr/local/lib/python3.6/dist-packages/trfl/_gen_distribution_ops.so: undefined symbol: _ZN10tensorflow14kernel_factory17OpKernelRegistrar12InitInternalEPKNS_9KernelDefEN4absl11string_viewESt10unique_ptrINS0_15OpKernelFactoryESt14default_deleteIS8_EE

I was able to install TRFL previously with Colab. As discussed in earlier issues I installed TF 1.12, reset the runtime, installed TF prob 0.5, and installed TRFL. This was working until recently (past week or so?):
https://colab.research.google.com/drive/1h5QdpZZ-Vz2KdTiiidS4O28b-pU0ihgn
If I specify the TRFL version as 1.0, I am still able to run TRFL and install as I used to:
https://colab.research.google.com/drive/1YoITxCmP-3v-WWKqQxJMR1w3Kyc5nKjw

Nevermind, looks like TRFL version 1.0.1 works with TF 1.13.1 in Colab but not  version 1.12.


Point to godoc.org in the README.

Thanks for the library. I went through the example and used simple as reference: https://github.com/kardianos/service/blob/master/example/simple/main.go
Here is my run function:
// run the program
func (p *program) run() {
configuration := InitConfiguration()
log.Printf("Running Web Socket Server")

c := wsServer.NewServer()
c.Run(port)

}
When I run my app using:
$GOROOT/bin/myApp
My app seems to block the run call forever, I was expecting Run to be executed in the background. Am I missing something here?
It would be great if you can update the README.md with additional information on usage.
Thanks once again.

Have you read https://godoc.org/github.com/kardianos/service ?
From the docs:
type Service interface {
    // Run should be called shortly after the program entry point.
    // After Interface.Stop has finished running, Run will stop blocking.
    // After Run stops blocking, the program must exit shortly after.
    Run() error
...
}

From this I can see that (a) Run blocks, (b) when Run returns, the program should exit.
Your work should be done in:
type Interface interface {
    // Start provides a place to initiate the service. The service doesn't not
    // signal a completed start until after this function returns, so the
    // Start function must not take more then a few seconds at most.

    // It should not take more then a few seconds to execute.
    // Stop should not call os.Exit directly in the function.
    Stop(s Service) error
}

Pay attention to "Start function must not take more then a few seconds at most.", meaning you need to run go doRealWork() in Start().

I think that one can be closed.


Syntax Highlighting

options syntax highlighter when the document ddn't save yet, same like notepad++ or sublime text

You can change the syntax highlighting mode by clicking the dropdown menu icon in the bottom (by default it says Text

Feature already available. Closing.

@abose If you create a new file without saving it you can't change the syntax highlight.
I think @dhanyn10 meant that.
This should be reopened (I think there is already a similar issue).

@ficristo I remember that issue too, couldn't find it (it was about new files having a other default than Text, right?). However, the current syntax highlighting currently works as same as Notepad++ mentioned in the OP - mode being changed after file was saved, but it can be changed without file being saved too (manually).
If this issue is about having an other default than Text, then this can be reopened or continued in the old issue (if I could find it, that is... :ghost: )

@petetnt I think I saw a different issue.
The point here is it should be possible to change syntax highlighting without saving the file.
Sometimes you want to copy a piece of code from somewhere else in a new file in Brackets, then syntax hightlighting it, have the ability to code collapse and so on without saving the file because you do not need the file but only the content.
If it is already possible to change the language how can you do?
To me seems possible only after I save the file.

PS: @dhanyn10 let me know if I totally misunderstood your issue.

We're tracking the work needed to enable that dropdown on our feature backlog, here: Fix JS Code Hints problems with untitled documents (enable language switcher).  Please upvote that item to help raise its priority.
duplicate #9409

ok, it same with the issue #9409

Well it has been a few months and there's been new releases. This still isn't fixed or added. Any updates?

Still no progress on this one? Albeit it small, it's a real niggly one.


Adding Mac to Mesh

I just tried using this script to add two Intel MacBook Pros to Tactical RMM / Mesh Central. It added them to TacticalRMM fine, but they did not get added to Mesh.

It may have been an issue on my end. I was away for a few hours and now one of the two is showing up.


refactor: intro NodeMeta and ScheduleInfo

replace https://github.com/projecteru2/core/pull/283

conflict


Comparison Score

Check extracted content against other extraction techniques to create a comparison score:

[x] Target elements in json
[x] OCR PDF pages converted to images
[x] Extract text from PDF files with PyMuPDF
[x] Compare JSON, OCR, PyMuPDF extracted text and give ratio/score
[x] Handle zero division errors

Task list complete, closing issue. Can be reopened if more features/tasks are required.


Datatype mismatch error while visualizing Marker object

Hi!
I'm trying to visualize Marker objects of type cube list that are being published on my Odroid SBC running ROS Kinetic Kame, on my laptop running ROS Indigo. Both are using the same ROS master.
But I get the following error,
[ERROR] [1488184609.243649838]: Client [/rviz_1488184582080327521] wants topic /visualization_marker to have datatype/md5sum [visualization_msgs/Marker/18326976df9d29249efc939e00342cde], but our version has [visualization_msgs/Marker/4048c9de2a16f4ae8e0538085ebf1b97]. Dropping connection.
Is this a case of no backward compatibility?

Yeah, a define was added in ROS Jade:
https://github.com/ros/common_msgs/commit/7e116353e9562885cb5e0e568864971fa27d65df


Improve utils#draw_motif

perhaps a nx API change(?) has resulted in no edges being rendered with default params

#79


Numbered + bulleted lists

[x] Design numbered lists, considering text treatment of numbers (type size, weight, color, etc)
[x] Design bulleted lists, consider bullet disc shapes, whether numbers can be right-aligned!
[x] For both, consider
indentation depths
spacing between bullet and following text

Here are links to the bulleted list design and the numbered list design.

The red dashed lines show how the indented bullets should align to the content of the bullet above.
For the numbered bullets, they should be right-aligned with other numbered bullets of the same indentation level, shown with blue dashed lines (I think this is how it is by default in HTML?). Let me know if there's any questions about this, or if it's not feasible how I have it shown in the designs!

These look so good! The only thing that is a tiny bit off is the alignment of the disc bullets: they should be directly below the left-edge of the text above, but right now they are bumped over a little too far to the left:
What it looks like now:

What it should look like:

hmm, I'll use a padding unit of 20px, but if you can come up with one could you let me know? CSS is cascading, so the padding is used on top of each other.
In this case, the first list item has padding of 20px, the 2nd nested list item has padding of 40px, and so on.

@codemonkey800 I just checked the spacing I used in the Figma mockup, and it's almost exactly 20px! So 20px should work well! Thanks!

Looks lovely to me! 🍡🍢🐛


Fixes admin dropdown arrow.

This has been bugging me for a while.
Before, on Chrome:

After, on Chrome:

There was a useless background rule on the select + span::after arrow, which was sometimes overlapping with the select border, probably because of some non-integer pixel height.

@BertrandBordage I can't reproduce the issue, did this only affect specific dropdowns or did you see this on all of them?

It’s only on Chrome, as far as I can tell.
It depends on the screen size and the layout, especially on large screens. Sometimes all dropdowns are OK, sometimes none, or a few of them.
The vertical border can also be affected:

To force the issue to appear, zoom or unzoom your page in Chrome, it should appear more often as Chrome has some issues with pixel approximations while zooming.
I thought this change had no effect on the current styling, but turns out there is a small effect when hovering the select: the left part of the select gets a white background while the arrow keeps the grey background. With this change, the arrow part also gets a white background on hover, which is fine too.

Even though this is super small it cropped up in some of the recent user testing about understandability of the select field inputs so cool to have it fixed!

@heymonkeyriot Since you know a lot about the admin CSS, could you review this 1-line pull request please? :p

It looks good to me testing here. Hopefully one of the core team can merge in?


Update FreeRTOS+TCP submodule pointer

Description

Test Steps

Related Issue

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

This is no longer required.


osx boa problems in ci, not sure if widespread

Solution to issue cannot be found in the documentation.

[X] I checked the documentation.

Issue
https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=556707&view=results
cc @wolfv @isuruf
Installing ['conda-forge-ci-setup=3', 'conda-forge/label/lief_dev::py-lief', 'conda-forge/label/lief_dev::liblief'] and conda-build.
+ mamba install --update-specs --quiet --yes --channel conda-forge conda-build pip boa conda-forge-ci-setup=3 conda-forge/label/lief_dev::py-lief conda-forge/label/lief_dev::liblief
Encountered problems while solving:
  - package boa-0.10.0-pyha770c72_0 requires conda-build >=3.20,<3.22, but none of the providers can be installed

##[error]Bash exited with code '1'.
Finishing: Run OSX build

Installed packages
n/a

Environment info
n/a

Should be fixed with https://github.com/conda-forge/boa-feedstock/pull/47
I've pulled the miniforge release for now.

Removing https://github.com/conda-forge/jaxlib-feedstock/blob/main/conda-forge.yml#L11-L14 and rerender should fix this issue


chore(TDI-40554): bump marklogic libs to latest

What is the current behavior? (You can also link to an open issue here)
https://jira.talendforge.org/browse/TDI-40554
What is the new behavior?
upgraded to latest releases.
Please check if the PR fulfills these requirements

[X] The commit message follows Talend standard
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features) ?
[ ] The code coverage on new code >75%
[ ] The new code does not introduce new technical issues (sonar / eslint)

What kind of change does this PR introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build / CI related changes
[ ] Other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[X] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

Pull request test result: success :star:
Sonar results

QA OK. Merging


Rules with $mp4 modifier don't work

For example here - https://www.filmmodu.org/american-woman-altyazili-izle
In Turkish filter is this rule:
||filmmodu.com/uploads/*.mp4$mp4
and it seems that it doesn't work.
I tried also (with disabled Turkish filter and checking rules below one by one):
||filmmodu.com/uploads/*.mp4$mp4,important
||filmmodu.com/uploads/*.mp4$mp4,media
||filmmodu.com/uploads/*.mp4$mp4,media,important
but without success.
https://github.com/AdguardTeam/CoreLibs/issues/1146#issuecomment-537866389

AdGuard for Windows nightly 7.2.2943 (CL 1.5.60)

core/pull-requests/1545


Support OpenID Connect Discovery to pull in endpoint urls and keysets

All OpenID Connect standard compliant servers implement .well-known endpoints for discovering underlying endpoint urls and public keys (multiple for issues like rotation)
There is complexity is in converting the keysets from JWK format to PEM
If implementing discovery, provider configuration would then be at the minimum:

issuerUrl - The url of the IdP, which underneath sits .well-known/openid-configuration
clientId - (if authenticating, not required for validation if allowedAudience supplied)
clientSecret - (if the IdP server requires it for authenticating)
allowedAudience - (optional for validation, matching either the string aud claim, or if aud claim is an array, one of the array entries)

note azp should not need to match clientId or audience if the service using the client is a resource server validating the access token, as another client could be entitled to access the resource server via a matching allowedAudience

FYI: https://github.com/acodercat/php-jwk-to-pem
The thing is that we should use an HTTPClient dependency to retrieve them. I suggest to use a PSR18 client so we are able to use any HTTP client we want.


Another jenkins test

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this

test this


feat(sync) Retry sync operations

Admin API calls to Kong can fail for a number of reasons, some permanent (e.g. configuration syntax error). Others are transient, e.g.:

Kong - or rather the underlying configuration database - gets overloaded with too many requests and will start returning 500 errors. I found this almost certain to happen with very large configurations of thousands or tens of thousands of entities.
Plugins can have race conditions, e.g. on setup when several plugin instances are created at once by decK. I have seen this just today.

When these transient errors happen a decK run will abort since the current behavior is for each decK worker to stop when it encounters any error whatsoever. Having to restart decK for transient reasons either manually or automatically is not ideal - esp. when it's a large configuration it will have to re-query all configuration, and potentially re-sync a lot of content (e.g. when using a decK config without default values specified).
This PR adds a --retry and --retry-delay parameter to the deck sync command. Default values are 1 retry and no delay. This should solve the most obvious transient problems by default without adding a lot of execution time (adding a delay can, since then each worker might have to wait for that time before shutting down, which could be a long time if there are a lot of errors).
To test this, what I've seen work well is to run deck with a very high number of workers, e.g. deck sync -s kong.yaml --parallelism 10000 --retries 0. With any reasonably large Kong configuration, this will likely fail (it does for me with about 120 entities). With deck sync -s kong.yaml --parallelism 10000 --retries 1 --retry-delay 2 (retry delay set to 2s here) it should work.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@hbagdi Thanks for the review, I finally had time to look at this again and rewrote the implementation to use the cenkalti/backoff exponential backoff library.
The tricky part is that to have a successful default retry policy the potential maximum backoff is very long. In my tests, to be able to load several thousand Kong entities with --parallelism 100 (trying to approximate a very large, complex and frequently automatically changed Kong deployment) a backoff of up to 10 seconds was required.
This is annoying when the errors are not retryable, e.g. wrong plugin configuration, access not authorized, etc. If all classes of errors are retried, decK will run through all retries even when the error is permanent and take a long time (15-20 seconds) doing nothing before finally exiting with the error.
So I needed to add some logic for which errors are retryable. In my tests, Kong will usually return a 500 Internal Server Error in those cases, e.g. when its database connection gets overloaded. Bad plugin configuration is a 400 Bad Request, missing access rights is 401 Unauthorized, etc.
Unfortunately, go-kong does not currently expose the status code in an easily consumable way. We could change it to do that, what do you think? For now I made it work by checking the error message returned from go-kong.

Holding this merge until #250 gets merged in and released. That keeps the release process simpler.

Holding this merge until #250 gets merged in and released. That keeps the release process simpler.

@mflendrich Can I request you review this patch?

@mflendrich Can I request you review this patch?

Thanks @mflendrich, helper function implemented!

Thanks @mflendrich, helper function implemented!

Is there any reason why the flags are not listed in the general documentation?

As best I can tell, per https://github.com/Kong/deck/pull/226#discussion_r513654575 we actually removed the flags from the final version, but forgot to omit them from the commit message. The actual functionality just always retries with a set count and delay configuration.
Asked around to see if someone else with more history on this feature knows more, but that's what looks to be the case based on what I can glean from the PR discussion.

Right now I'm experiencing 502 errors ( #526 ) and was hoping that this retry functionality would solve something like that.


How to predict the class of a new image without sending the label

i want to use the trained model to predict the class of a test image without sending the label, is it possible?
currently, the implementation required sending the Keras "predict" function a tuble of (X_test, y_test)
Is their a way to use "predict" only with the test image as input and gets the label as output?

how to predict the class probability? when I set the output to arcface output (softmax) w.r.t number of class, I got an error when doing prediction
model = Model(inputs=model.input[0], outputs=model.layers[-1].output) ,-1 instead of -3
[-1].output :
<tf.Tensor 'class_output/Softmax_3:0' shape=(None, 10) dtype=float32>

Hi @almoghitelman ,
Here is my solution,
class DNN(tf.keras.models.Model):
def init(self, num_classes=10):
super(DNN, self).init()
weight_decay = 1e-4
self.layer_1 = tf.keras.layers.Dense(32, activation='relu')
self.layer_2 = tf.keras.layers.Dense(10)
self.out = ArcFace(n_classes=num_classes, regularizer=regularizers.l2(weight_decay))
def call(self, x, training=False):
    if training:
        x, y = x[0], x[1]
    x = self.layer_1(x)
    x = self.layer_2(x)
    if training:
        out = self.out([x, y])
    else:
        # Prediction
        # Thanks to this, you don't need to pass labels to model when you predict
        out = tf.nn.softmax(x @ self.out.W)
    return out

Sample code is following;

odel = DNN()
optimizer = tf.keras.optimizers.Adam()
loss = tf.keras.losses.categorical_crossentropy
model.compile(loss=loss, optimizer=optimizer, metrics=['acc'])
model.fit([x_train, tf.keras.utils.to_categorical(y_train, 10)], tf.keras.utils.to_categorical(y_train, 10), batch_size=512, epochs=10)
pred = model.predict(x_test)

I hope it works in your situation.

I implemented my own ArcFace.
https://github.com/ozora-ogino/asoftmax-tf
This works correctly and I believe this can solve your problem.

Why not use [0, 0, 0......0] as laber


License ?

Hello, under what license is this project released under ? I would like to study it to learn more about PyBullet.

This project is under an MIT license. I just added within the repo.


TestHealthCheck failed

go test -v -run=HealthCheck
=== RUN   TestHealthCheck
--- FAIL: TestHealthCheck (15.06s)
upstream_test.go:18: Expected first host in testpool to not fail healthcheck.
FAIL
exit status 1
FAIL    github.com/mholt/caddy/middleware/proxy 15.067s
google.com is forbidden in my country,sigh... so this test is failed on my local environment

Thanks for the fix :smile:


problem building app

Hello ,
What version of Go are you using (go version)?

What operating system and processor architecture are you using (go env)?

What did you do?
I'm using   go-wca  inside persona project
I use Visual studio code as IDE
but  in  the building phase   go build -o bin/hello   I got:
What did you expect to see?
app build without problem
What did you see instead?
go: finding module for package github.com/moutend/go-wca
....\pkg\mod\github.com\talkkonnect\volume-go@v0.0.0-20200223011643-173f1ce653ed\volume_windows.go:8:2: module github.com/moutend/go-wca@latest found (v0.2.0), but does not contain package github.com/moutend/go-wca
thanks in advance

I think you are trying to import "github.com/moutend/go-wca" instead of import "github.com/moutend/go-wca/pkg/wca".
I guess you have solved the problem after such a long time, but I hope somebody finds it useful.

I think you are trying to import "github.com/moutend/go-wca" instead of import "github.com/moutend/go-wca/pkg/wca". I guess you have solved the problem after such a long time, but I hope somebody finds it useful.

This is absolutely right.  @MirkoUgoliniDev if this issue is no longer outstanding, I recommend closing this issue, or updating it to reflect current state if it does persist.  ❤


Line tool: starting/ending point parameters do not handle coordinates entered in Longitude Latitude order (ArcGIS Pro)

The Coordinate Conversion tool was modified to allow users to enter in coordinates in both Lat Long and Long Lat order. All other tools that allow user to type in coordinates should allow the same.
Tool accepts coordinates to be entered in Lat Long...

Tool does not accept coordinates to be entered in Long Lat...

I have a fix for this locally, can make pull request when possible if necessary (see #223).

Note: This still seems to be an issue after #494 - I tested with:
Works:
34.73N 116.94W
60.23N 110.89W
Doesn't work (Red validation error box):
116.94W 34.73N
110.89W 60.23N

Picking this up since this ties in with CC library stuff I worked on.

Applied fix and submitted PR

This is no longer an issue in Distance and Direction, but it is still an issue in Visibility.

Verified

This cannot be finished until the Distance and Direction documentation topics are versioned and released

Added to "Issues Addressed" section in Distance and Direction Release notes. Assigning to @dfoll for review.

Removing "Known Issue" label as this has now been addressed and is listed in the "Issues Addressed" section of our release notes.

@topowright This issue still has a task to QC the Doc. Has that been completed. Cannot close or add a closing E-label to item that still has tasks remaining.

Removed the doc label as this has been documented.

@topowright I just checked on the dev site for documentation. This has been documented for ellipse and circle, but not for lines as indicated by this issue. If we are calling out some, we should call out all areas of functionality and issue #217 should be added to the issues addressed.


Get followers

New feature to get followers of an account

@adam-szabo thank you for contribution.
New release will be available later today


Spec refactoring for v2 provider request specs

Context
Was going to add to this spec so was improving the spec before I added to it. Leaving the camp a bit tidier on passing through.
Specs on this project are a bit on the slow side and it's death by 1000
papercuts, so adding a small improvement.
Changes proposed in this pull request

Spec refactor - don't repeat request for status code check
Spec refactor - split provider spec in two

before
bundle exec spec/requests/api/v2/providers_spec.rb
...
Finished in 9.67 seconds (files took 3.35 seconds to load)
17 examples, 0 failures

after
bundle exec spec/requests/api/v2/providers/providers_s*
...
Finished in 6.68 seconds (files took 3.1 seconds to load)
13 examples, 0 failures

That's a [very unscientifically measured] 30.9% faster :muscle:
Guidance to review
Read the individual commits. First commit just splits the file in two.
:eyes:
Checklist

[ ] Make sure all information from the Trello card is in here
[ ] Attach to Trello card
[x] Rebased master
[x] Cleaned commit history
[x] Tested by running locally

Added another cleanup, squashed in

rebased