allow overriding the used parsers for binary, css, plain text

Fixes https://github.com/rzo1/crawler4j/issues/89 .
At the moment I'm using a custom css parsing solution based on https://github.com/phax/ph-css . This update would allow me to avoid copying logic from the Parser class.
The reason for the custom css parser is that the current regex solution can 't cope with urls like: background-image: url('leaves-medium (1920x1280).jpg'). When not crawling binary data, this parsing might be irrelevant, so adding a dependency might not be in everyone's interest. I'll continue this train of thought in a separate comment.

Custom css parser:
ph-css was chosen because it is actively developed and is used by Apache JMeter since version 3 (and still is used in the current version 5). It can cope with urls in a way that regexes can't, for example for background-image: url('leaves-medium (1920x1280).jpg') it correctly extracts leaves-medium (1920x1280).jpg, while the currect regex approach can't distinguish between a ')' in the content or as the end of the url()-statement => current implementation extracts leaves-medium (1920x1280.
The current implementation could be replaced by it (ph-css doesn't pull a lot of extra dependencies with it), but maybe you want to offer the choice of css parsing solution through a Service Provider Interface?

Thanks for the PR!
I have no objection in using an additional css parser library, if it helps to make  the previous home-crown code better. Don't know, if the majority of users now how to handle SPI but would be a nice solution for exchanging the HTTP or CSS parser. Would you mind to create an issue for it?

My bad, I thought the frontiers where also using SPI (forgot how it was instantiated). There are other ways to get rid of the dependency if people don't want it, so no need to make things more confusing :-).


[Feature] refactor pdml

Conflicts:
src/backend/px_optimizer/libgpopt/include/gpopt/engine/CHint.h

/rebase-and-merge


PREP: first pass at pathogenome distro

closing in favor of https://github.com/qiime2/distributions/pull/366


fix(workflow): hotfix remove old nodejs version [NOTICKET]

Also @ArmandoShala please delete the hotfix-nodejs branch since I don't have the permission to do that.


Adding for ... in loop in Looping section

@sumn2u  Please assign me.

@sumn2u Please assign me.

Hi @SusheelThapa , we already have some introduction about for ... in loop here. Are you planning to add more content here?

Yeah I can write in about for in below format.
For
For in
Or shall I create different page of for ... in.

I think it's better to put it in same place as the introductory part is done there .

Okay i will keep for loop and for .. in in same files. Will that be ok?

This issue has been address in #113 PR


Fix debug argument parsing

This is to fix multiple debugger arguments when using WindowsDebugLauncher.

What was the issue you were seeing? Is there a bug to reference?

@paulmaybee

What was the issue you were seeing? Is there a bug to reference?

This is when I did testing with a value in miDebuggerArgs and it was causing gdb to hang as it parsed it as an entire value.


Pushbullet has a high-risk vulnerability

Description
After running "npm install" on the latest commit, there was a high risk vulnerability discovered. It has to do with the version of "node-forge" that is required by pushbullet. The npm audit log is as follows:
`  High            Prototype Pollution in node-forge
Package         node-forge
Patched in      >= 0.10.0
Dependency of   pushbullet
Path            pushbullet > node-forge
More info       https://npmjs.com/advisories/1561
found 1 high severity vulnerability in 963 scanned packages
1 vulnerability requires manual review. See the full report for details.`
Possible solution
I modified the code to completely remove pushbullet for now. I can push that if needed, but I imagine that is not ideal.
Alternatively some tweaks could probably be made to ensure pushbullet requires a version of node-forge >= 0.10.0

I also have this same problem. Should I roll back for now?

I also have this same problem. Should I roll back for now?

I noticed that this version of pushbullet, which uses the high-risk version of node-forge has been in this repo for at least 7 days. The reason this was only detected now was because the vulnerability was not reported until today, 09/30. So rolling back won't help unless you go far enough back to before pushbullet was added. But at that point I'm sure other issues have been fixed and it probably wouldn't even be worth it.

yep have the same issue not sure what to do

Also getting this, if someone could let me know what to do I would appreciate it.

ok guys i figured it out, that risk doesnt matter just ignore that completely and move to the next step watch the video carefully https://www.youtube.com/watch?v=bVgIpjBkRLY

Updated in #406


Update "Slack Info" in Docs

Page
Master docs & latest release docs.
Summary
Update "slack info" in docs as the README.md

not sure what this ticket targets. please be more specific on this issue

On each doc page, there is a button to link to Slack. Update that button's looking to show # of current online members &  # of total members, like the one in the README.md file.


Add: remove_repeat_consonants()

What does this changes
Add removement method of repeating consonants by dictionary-based method.
How this fixes it
Add pythainlp.utils.remove_repeat_consonant(text, dictionary)
Find words in the dictionary that has repeating consonant at the last, and find the match with the end of the sentence. If there is none, make the repetition to one; if there is, make the repetition to that one.
Fixes #860
Your checklist for this pull request
🚨Please review the guidelines for contributing to this repository.

[ ] Passed code styles and structures
[x] Passed code linting checks and unit test

Hello @konbraphat51! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file pythainlp/util/normalize.py:

Line 229:49: W291 trailing whitespace
Line 281:18: W503 line break before binary operator
Line 282:18: W503 line break before binary operator
Line 317:25: W503 line break before binary operator

Hmm... I cannot find more PEP8 error,,,
I will try more next morning. Good night!

coverage: 5.364% (+5.4%) from 0.0%
when pulling 16c3154aa2893236553ac74d836421f82b8768d2 on konbraphat51:dev
into edb52b32c4dee034bba9b3f89294a9d73c5ef02d on PyThaiNLP:dev.

Lint issue of normalize.py solved

Okey, Lint problem and CodeClimate problem are basically solved, and the test for this passed.
It seems that the code length of a single file is set to 250 lines, but should I separate this method from normalize.py?

It seems that the code length of a single file is set to 250 lines, but should I separate this method from normalize.py?

Maybe a good idea. Separate it.
Additional rational apart fro the line limit is that the new function is a bit different from other existing normalization functions as well, in a way that it is no longer rule-based but need a kind of word list --> which means the normalization output will depend on what dictionary each user use each time.
From that fact, I think we shouldn't put this remove_repeat_consonant() in the list of functions to be perform inside normalize(). To keep the output of normalize() consistent all the time and independent from the provided dictionary.

Thanks, OK

BTW, the proposed name of the function: remove_repeat_consonants() is a bit inaccurate - if compare with a similar name function: remove_repeat_vowels(). The latter remove repeating chars anywhere in the string but the former only remove it at the end of the string.
Naming ideas:

remove_trailing_repeat_consonants() - descriptive, and long

consistent with remove_repeat_vowels()*

remove_trailing_dup_consonants() - descriptive, 3 chars shorter

consistent with remove_dup_spaces()**

rstrip_consonants() - sounds bold

borrowed from rstrip()

others?

*, **  gotcha. the current code has naming inconsistency, need to clean up.

remove_trailing_repeat_consonants() sounds good to me, so I changed the name to that.
I think I clarified names in the script, but if there are still name inconsistencies, please specify them.
I revert normalize.py to what it was, so the Lint is pointing it out now
Not sure why pylance saying "pythainlp.util.remove_trailing_repeat_consonants.remove_trailing_repeat_consonants' imported but unused." Any idea?

I think I clarified names in the script, but if there are still name inconsistencies, please specify them.

Sorry. I was meant to say that the existing remove_repeat_vowels() and  remove_dup_spaces() have naming inconsistency issue. Not from the new function you're now contributing.

Neat contribution. I think that's all. I can approve after few suggested fixes above.

Sorry, mistakely “start review” button pushed please wait🥲

Accidentally pushed “start review” button, sorry, please wait for a while🥲

Ok, all done.
Review please :)

I have a last minute thought about which name we should go with,
between:

remove_trailing_repeat_xxx vs
remove_repeat_trailing_xxx

(try to think what it will like in the context of code completion, when ppl type remove_ .. which char they)
But I will merge this first.
We can later thinking more about consistent names (together with that remove_dup_xxx) and change this again when appropriate.
Thank you for your contribution.
(the test on Windows is now running for 58 minutes and counting, this shouldn't be the norm :( )


0.8.2 was released but documentation link is broken

Body of the issue
Navigate to: https://inventree.readthedocs.io/en/0.8.2/

@eeintech thanks for reporting, I've addressed this now.


Speedup log10

Hello, thanks for the awesome library!
I was looking for something to optimize, so here it is:
Bit twiddling hacks page has simple algorithm for calculating log10 of an integer:
https://graphics.stanford.edu/~seander/bithacks.html#IntegerLog10
Implement it here.
   goos: linux
   goarch: amd64
   pkg: github.com/holiman/uint256
   cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz
                         │     old      │                 new                 │
                         │    sec/op    │   sec/op     vs base                │
   Log10/Log10/uint256-8   1016.5n ± 6%   762.9n ± 1%  -24.95% (p=0.000 n=10)
   Log10/Log10/big-8        27.66µ ± 5%   28.56µ ± 5%        ~ (p=0.393 n=10)
   geomean                  5.303µ        4.668µ       -11.97%

                         │      old       │                  new                  │
                         │      B/op      │     B/op      vs base                 │
   Log10/Log10/uint256-8     0.000 ± 0%       0.000 ± 0%       ~ (p=1.000 n=10) ¹
   Log10/Log10/big-8       22.88Ki ± 0%     22.88Ki ± 0%       ~ (p=1.000 n=10) ¹
   geomean                              ²                 +0.00%                ²
   ¹ all samples are equal
   ² summaries must be >0 to compute geomean

                         │     old      │                 new                 │
                         │  allocs/op   │ allocs/op   vs base                 │
   Log10/Log10/uint256-8   0.000 ± 0%     0.000 ± 0%       ~ (p=1.000 n=10) ¹
   Log10/Log10/big-8       510.0 ± 0%     510.0 ± 0%       ~ (p=1.000 n=10) ¹
   geomean                            ²               +0.00%                ²
   ¹ all samples are equal
   ² summaries must be >0 to compute geomean

CI benchmarks agree (about the same ~20% improvement):
BenchmarkLog10/Log10/uint256-36                           969393              1241 ns/op               0 B/op          0 allocs/op

From #136
BenchmarkLog10/Log10/uint256-36                     	  705776	      1597 ns/op	       0 B/op	       0 allocs/op


upgrade support to opencensus 0.9

Codecov Report

Merging #13 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master    #13   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           3      3
  Lines          14     12    -2
=====================================
- Hits           14     12    -2

Impacted Files
Coverage Δ

lib/opencensus/plug/trace.ex
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 988fcd9...f07dffd. Read the comment docs.


operators [R] routernetes-operator (0.0.2 0.0.3)

Thanks submitting your Operator. Please check below list before you create your Pull Request.
New Submissions
N/A
Updates to existing Operators

[x] Did you create a ci.yaml file according to the update instructions?
[x] Is your new CSV pointing to the previous version with the replaces property if you chose replaces-mode via the updateGraph property in ci.yaml?
[x] Is your new CSV referenced in the appropriate channel defined in the package.yaml or annotations.yaml ?
[x] Have you tested an update to your Operator when deployed via OLM?
[x] Is your submission signed?

Your submission should not

[x] Modify more than one operator
[x] Modify an Operator you don't own
[x] Rename an operator - please remove and add with a different name instead
[x] Modify any files outside the above mentioned folders
[x] Contain more than one commit. Please squash your commits.

Remember that you can preview your CSV here.
--
1 If you feel your Operator does not fit any of the pre-defined categories, file an issue against this repo and explain your need
2 For more information see here

/merge possible

/merge possible


build.md : just fixing a typo

Hi there,
As title says: fixing 1 typo
Didier

Thank you @didier-durand

@ktsakalozos : you're welcome! My pleasure to collaborate. Didier


Restore StreamPackage functionality from 0.4.x in python

Is your feature request related to a problem? Please describe.
As part of the migration from 0.4.x, the StreamPackage class was not yet fully implemented. This issue is to track that functionality restoration.
Describe the solution you'd like
Work as in 0.4.x
Additional context
At the time being it is not included in the automatic imports, so previous code using it would have to reference it Like this: https://quix.discourse.group/t/streampackage-class-not-recognized/57

No longer relevant with new pyhon. C# SDK moved to https://github.com/quixio/quix-streams-dotnet


[RFC] Put the generic configuration options in a separate page, to allow for shorter module specific man pages.

This should also be done for the GitHub wiki 😃

Sorry for the delay! This is now updated with the new pages.


made the change in code to work the googleSignInbtn and facebookBtn properly

Related Issue
[Cite any related issue(s) this pull request addresses. If none, simply state “None”]
Fixes:  1
Description
The issue i solved is to work the google authentication button and facebook authentication button work independently but the popUp is not showing because it is need to configure by the admin in Firebase. When we inspect it is going to popup with error.
issue Number: #4645
Type of PR

[x] Bug fix

Screenshots / videos (if applicable)
-Before fixing

-After fixing the button working

Checklist:

[x] I have made this change from my own.
[ ] I have taken help from some online resources.
[x] My code follows the style guidelines of this project.
[ ] I have performed a self-review of my own code.
[ ] I have commented my code, particularly in hard-to-understand areas.
[ ] I have made corresponding changes to the documentation.
[ ] My changes generate no new warnings.
[ ] I have tested the changes thoroughly before submitting this pull request.
[x] I have provided relevant issue numbers and screenshots after making the changes.

create demo video to show working ...
i am still getting Firebase: Error (auth/popup-blocked).

@sharath778 today is the last date to contribute


Support for CORIOmaster 1 (C3-540)

Would it be possible to add support for CORIOmaster Version 1 (C3-540)?
I tried this module, but i was unable to control my C3-540.
Kind regards
Dom

Adding to request for C3-540 support.
Simple preset and source change commands would be extremely helpful.
Thanks!

Corio Master API is different to that used for the C2 range, and would be best placed in a new separate module.


Don't show recipe index in Strategy Explorer by default

As it is of no use to 99% of people and can be confusing.

Currently it will just be invisible. I don't expect this will be a problem short term, as even I have never used it beyond coalescing work back in May-June or so... Longer term we do need it, but I think there will be some bigger redesign in SE some day and we will bring it back at that point I think. Right now I just wanted a simplest thing to make SE less confusing.


Folding of blocks in response doesn't work

I have checked the following:

[X] I use the newest version of bruno.
[X] I've searched existing issues and found nothing related to my issue.

Describe the bug
Version: v1.20.4
Folding of blocks in response doesn't work.
There is no error in console as well.
.bru file to reproduce the bug
No response
Screenshots/Live demo link

Duplicate of https://github.com/usebruno/bruno/issues/2580


[cmake] fix install without gRPC_BUILD_CODEGEN

When compiling without codegen cmake give the following error: CMake Error: INSTALL(EXPORT) given unknown export "gRPCPluginTargets".
Check gRPC_BUILD_CODEGEN variable is before trying to install gRPCPluginTargets.
Fix https://github.com/grpc/grpc/issues/32885
@herbrechtsmeier ok with this fix ?

One other potential use case to consider is if gRPC_BUILD_CODEGEN=ON but every gRPC_BUILD_GRPC_*_PLUGIN=OFF (e.g., gRPC_BUILD_GRPC_CPP_PLUGIN, gRPC_BUILD_GRPC_PYTHON_PLUGIN), I think you would still end up with the gRPCPluginTargets export being unknown.
It looks like the export is only set in the blocks like:
if(gRPC_BUILD_CODEGEN AND gRPC_BUILD_GRPC_CPP_PLUGIN)

I'm not sure if there is a use case for that or not where some of the codegen stuff is built but none of the plugins.

One other potential use case to consider is if gRPC_BUILD_CODEGEN=ON but every gRPC_BUILD_GRPC_*_PLUGIN=OFF (e.g., gRPC_BUILD_GRPC_CPP_PLUGIN, gRPC_BUILD_GRPC_PYTHON_PLUGIN), I think you would still end up with the gRPCPluginTargets export being unknown.
It looks like the export is only set in the blocks like:
if(gRPC_BUILD_CODEGEN AND gRPC_BUILD_GRPC_CPP_PLUGIN)

I'm not sure if there is a use case for that or not where some of the codegen stuff is built but none of the plugins.

if (TARGET gRPCPluginTargets) maybe ?

Superseded by https://github.com/grpc/grpc/pull/32986


Add option to unload kernel modules before running leapp upgrade.

Add kernel_modules_to_unload_before_upgrade, an empty list by default.
kernel_modules_to_unload_before_upgrade: []
Can be useful for pesky kernel modules that get reloaded mysteriously, for example pata_acpi.

Addresses https://github.com/redhat-cop/infra.leapp/issues/165.

Did you test against RHEL 6-7?

I've been testing 6-7, 7-8, and 8-9 in parallel.


Schedule Refresh Fails for Custom Connector

we have created a custom data connector for Oracle NetSuite and it works perfectly fine on Power BI desktop. However, when we publish it on PBI service and tries to set up a scheduled refresh using OnPrem personal gateway we get the following errors.

"Test Connection" method is implemented and working as expected in the visual studio.

Gateway Network port test completed successfully

Gateway service account has access on Custom Data connector folder

Error message on PBI service

Logs from Personal Gateway:
DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2562493Z DM.PersonalGateway	7c7a38f4-3bc8-4d2e-a962-08609e1e442d	530cc648-e0f3-26e0-d595-da4373d450b0	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	53695871-5f29-4f2d-8d69-7e81826a1ae2	53695871-5f29-4f2d-8d69-7e81826a1ae2	3F021848 [DM.GatewayCore] Failed to login using OAuth token. Exception: Microsoft.Mashup.OAuth.OAuthException: [Expression.Error] The field 'code' of the record wasn't found. ---> Microsoft.Mashup.Engine1.Runtime.ValueException: [Expression.Error] The field 'code' of the record wasn't found.
at Microsoft.Mashup.Engine1.Runtime.RecordValue.IndexOf(String field)
at Microsoft.Mashup.Engine1.Runtime.RecordValue.get_Item(String field)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.Instruction.Execute(MembersFrame1& frame, Instruction[] instructions)
at Microsoft.Mashup.Engine1.Language.InstructionInvocationInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.MembersFunctionValue1.Invoke(Value arg0)
at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.Force(Int32 index)
at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.get_Item(Int32 index)
at Microsoft.Mashup.Engine1.Language.RuntimeFunctionValueN.Invoke(Value[] args)
at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)
--- End of inner exception stack trace ---
at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2660865Z DM.PersonalGateway	7c7a38f4-3bc8-4d2e-a962-08609e1e442d	530cc648-e0f3-26e0-d595-da4373d450b0	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	53695871-5f29-4f2d-8d69-7e81826a1ae2	53695871-5f29-4f2d-8d69-7e81826a1ae2	C232D8F3 [DM.Pipeline.Diagnostics] Exception object created [IsBenign=False]: Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException: Failed to call FinishLogin with OAuth token or failed with StartLogin, exception: ; ErrorShortName: OAuthTokenLoginFailedException/OAuthException[HResult=-2146233088]/ValueException[HResult=-2146233088]
DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2723525Z DM.PersonalGateway	7c7a38f4-3bc8-4d2e-a962-08609e1e442d	530cc648-e0f3-26e0-d595-da4373d450b0	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	53695871-5f29-4f2d-8d69-7e81826a1ae2	53695871-5f29-4f2d-8d69-7e81826a1ae2	84CEB009 [DM.Pipeline.Diagnostics] StackTrace:    at Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException.TraceConstructor()
at Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException..ctor(String message, Exception innerException, PowerBIErrorDetail[] errorDetails)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorUtils.OAuthFinishLoginOnGateway(OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessor.d__20.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessor.OAuthFinishLoginOnGateway(GatewaySerializationContext serverContext, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.<DispatchImpl>d__1.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.DispatchImpl(GatewaySerializationContext responseContext, OperationRequestBase requestObj)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.d__0.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.Dispatch(GatewaySerializationContext serializationContext, OperationRequestBase requestObj)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<DeserializeImpl>d__10.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.DeserializeImpl(GatewayRelayContext requestContext, GatewaySerializationContext responseContext)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<>c__DisplayClass9_0.<b__0>d.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<>c__DisplayClass9_0.<Deserialize>b__0()    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayPipelineTelemetry.PipelineTelemetryService.<ExecuteInActivity>d__71.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayPipelineTelemetry.PipelineTelemetryService.ExecuteInActivity[T](PipelineActivityType pipelineActivityType, Func1 action)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.d__9.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.Deserialize(GatewayRelayContext requestContext)
at System.Threading.Tasks.Dataflow.ActionBlock1.ProcessMessageWithTask(Func2 action, KeyValuePair2 messageWithId)    at System.Threading.Tasks.Dataflow.ActionBlock1.<>c__DisplayClass7.<.ctor>b__1(KeyValuePair2 messageWithId)    at System.Threading.Tasks.Dataflow.Internal.TargetCore1.ProcessMessagesLoopCore()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()
DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2743468Z DM.PersonalGateway	7c7a38f4-3bc8-4d2e-a962-08609e1e442d	530cc648-e0f3-26e0-d595-da4373d450b0	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	53695871-5f29-4f2d-8d69-7e81826a1ae2	53695871-5f29-4f2d-8d69-7e81826a1ae2	C20501EA [DM.Pipeline.Common.TracingTelemetryService] Event: FireActivityCompletedWithFailureEvent (duration=129, err=OAuthTokenLoginFailedException, rootcauseErrorEventId=0)
DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2813271Z DM.PersonalGateway	a8daf7a6-a296-4891-b277-ad0a94bbd0c7	530cc648-e0f3-26e0-d595-da4373d450b0	MDSR	a0613b9e-efcd-44ae-9870-6847e90aa998	53695871-5f29-4f2d-8d69-7e81826a1ae2	53695871-5f29-4f2d-8d69-7e81826a1ae2	5C61E30C [DM.GatewayCore] Error processing request: [0]Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException: Failed to call FinishLogin with OAuth token or failed with StartLogin, exception:
GatewayPipelineErrorCode=DM_GWPipeline_Client_OAuthTokenLoginFailedError
GatewayVersion=
FailureMessage= --->
Inner exception chain: Microsoft.Mashup.OAuth.OAuthException > Microsoft.Mashup.Engine1.Runtime.ValueException
Microsoft.Mashup.OAuth.OAuthException: [Expression.Error] The field 'code' of the record wasn't found. ---> Microsoft.Mashup.Engine1.Runtime.ValueException: [Expression.Error] The field 'code' of the record wasn't found.
at Microsoft.Mashup.Engine1.Runtime.RecordValue.IndexOf(String field)
at Microsoft.Mashup.Engine1.Runtime.RecordValue.get_Item(String field)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.Instruction.Execute(MembersFrame1& frame, Instruction[] instructions)
at Microsoft.Mashup.Engine1.Language.InstructionInvocationInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)
at Microsoft.Mashup.Engine1.Language.MembersFunctionValue1.Invoke(Value arg0)
at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.Force(Int32 index)
at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.get_Item(Int32 index)
at Microsoft.Mashup.Engine1.Language.RuntimeFunctionValueN.Invoke(Value[] args)
at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)
--- End of inner exception stack trace ---
at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
--- End of inner exception stack trace ---
([0]Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException.StackTrace:)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorUtils.OAuthFinishLoginOnGateway(OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessor.d__20.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.d__10.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<>c__DisplayClass9_0.<b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayPipelineTelemetry.PipelineTelemetryService.d__71.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<Deserialize>d__9.MoveNext() DM.PersonalGateway Error: 0 : 2020-08-28T09:45:38.3098042Z DM.PersonalGateway	18cb0800-cab9-473e-a71c-ddaba2595ccf	ed06b21a-d4af-8b2a-914b-398154a01a76	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	3F021848 [DM.GatewayCore] Failed to login using OAuth token. Exception: Microsoft.Mashup.OAuth.OAuthException: [Expression.Error] The field 'code' of the record wasn't found. ---> Microsoft.Mashup.Engine1.Runtime.ValueException: [Expression.Error] The field 'code' of the record wasn't found.    at Microsoft.Mashup.Engine1.Runtime.RecordValue.IndexOf(String field)    at Microsoft.Mashup.Engine1.Runtime.RecordValue.get_Item(String field)    at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)    at Microsoft.Mashup.Engine1.Language.Instruction.Execute(MembersFrame1& frame, Instruction[] instructions)    at Microsoft.Mashup.Engine1.Language.InstructionInvocationInstruction.Execute(MembersFrame1& frame)    at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)    at Microsoft.Mashup.Engine1.Language.DebugInstruction.Execute(MembersFrame1& frame)    at Microsoft.Mashup.Engine1.Language.MembersFunctionValue1.Invoke(Value arg0)    at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.Force(Int32 index)    at Microsoft.Mashup.Engine1.Language.RecordInstruction.RuntimeRecordValue.get_Item(Int32 index)    at Microsoft.Mashup.Engine1.Language.RuntimeFunctionValueN.Invoke(Value[] args)    at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)    --- End of inner exception stack trace ---    at Microsoft.Mashup.Engine1.Runtime.Extensibility.ExtensionOAuthFactory.Provider.Microsoft.Mashup.OAuth.IOAuthProvider.FinishLogin(Byte[] serializedContext, Uri callbackUri, String state)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest) DM.PersonalGateway Error: 0 : 2020-08-28T09:45:38.3098042Z DM.PersonalGateway	18cb0800-cab9-473e-a71c-ddaba2595ccf	ed06b21a-d4af-8b2a-914b-398154a01a76	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	C232D8F3 [DM.Pipeline.Diagnostics] Exception object created [IsBenign=False]: Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException: Failed to call FinishLogin with OAuth token or failed with StartLogin, exception: ; ErrorShortName: OAuthTokenLoginFailedException/OAuthException[HResult=-2146233088]/ValueException[HResult=-2146233088] DM.PersonalGateway Error: 0 : 2020-08-28T09:45:38.3108021Z DM.PersonalGateway	18cb0800-cab9-473e-a71c-ddaba2595ccf	ed06b21a-d4af-8b2a-914b-398154a01a76	MGPP	a0613b9e-efcd-44ae-9870-6847e90aa998	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	dee93d9b-11f3-4dfc-b0b3-abead2afa37a	84CEB009 [DM.Pipeline.Diagnostics] StackTrace:    at Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException.TraceConstructor()    at Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException..ctor(String message, Exception innerException, PowerBIErrorDetail[] errorDetails)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayOAuthUtils.GetOAuthFinishLoginOnGatewayResult(IOAuthProvider provider, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorUtils.OAuthFinishLoginOnGateway(OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessor.<OAuthFinishLoginOnGateway>d__20.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessor.OAuthFinishLoginOnGateway(GatewaySerializationContext serverContext, OAuthFinishLoginOnGatewayRequest oAuthFinishLoginOnGatewayRequest)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.d__1.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.DispatchImpl(GatewaySerializationContext responseContext, OperationRequestBase requestObj)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.<Dispatch>d__0.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.GatewayProcessorDispatcher.Dispatch(GatewaySerializationContext serializationContext, OperationRequestBase requestObj)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.d__10.MoveNext()
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.DeserializeImpl(GatewayRelayContext requestContext, GatewaySerializationContext responseContext)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<>c__DisplayClass9_0.<<Deserialize>b__0>d.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<>c__DisplayClass9_0.b__0()
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayPipelineTelemetry.PipelineTelemetryService.d__71.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.Start[TStateMachine](TStateMachine& stateMachine)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayPipelineTelemetry.PipelineTelemetryService.ExecuteInActivity[T](PipelineActivityType pipelineActivityType, Func1 action)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.<Deserialize>d__9.MoveNext()    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[TStateMachine](TStateMachine& stateMachine)    at Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.Serialization.GatewayDeserializer.Deserialize(GatewayRelayContext requestContext)    at System.Threading.Tasks.Dataflow.ActionBlock1.ProcessMessageWithTask(Func2 action, KeyValuePair2 messageWithId)
at System.Threading.Tasks.Dataflow.ActionBlock1.<>c__DisplayClass7.<.ctor>b__1(KeyValuePair2 messageWithId)
at System.Threading.Tasks.Dataflow.Internal.TargetCore`1.ProcessMessagesLoopCore()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()

@CurtHagenlocher your thoughts on this issue!

DM.PersonalGateway Error: 0 : 2020-08-28T09:34:20.2660865Z DM.PersonalGateway 7c7a38f4-3bc8-4d2e-a962-08609e1e442d 530cc648-e0f3-26e0-d595-da4373d450b0 MGPP a0613b9e-efcd-44ae-9870-6847e90aa998 53695871-5f29-4f2d-8d69-7e81826a1ae2 53695871-5f29-4f2d-8d69-7e81826a1ae2 C232D8F3 [DM.Pipeline.Diagnostics] Exception object created [IsBenign=False]: Microsoft.PowerBI.DataMovement.Pipeline.Diagnostics.OAuthTokenLoginFailedException: Failed to call FinishLogin with OAuth token or failed with StartLogin, exception: ; ErrorShortName: OAuthTokenLoginFailedException/OAuthException[HResult=-2146233088]/ValueException[HResult=-2146233088]

This appears to be the issue. I'd suggest that you check your published function and make sure that the parameters used in it are being taken in consideration for your Data Source Path, otherwise your TestConnection will fail every time.

@migueesc123 i have created the Published function as per documentation.

i tried both UI and Publish function for publishing data connector and none of them works.
Although, I believe the problem is with getting Authorize_code from redirect_url in the FinishLogin method.
Error:7e81826a1ae2 53695871-5f29-4f2d-8d69-7e81826a1ae2 3F021848 [DM.GatewayCore] Failed to login using OAuth token. Exception: Microsoft.Mashup.OAuth.OAuthException: [Expression.Error] The field 'code' of the record wasn't found. ---> Microsoft.Mashup.Engine1.Runtime.ValueException: [Expression.Error] The field 'code' of the record wasn't found.
i tried following redirect_urls but still no luck.
redirect_uri ="https://preview.powerbi.com/views/oauthredirect.html";
redirect_uri =  "https://oauth.powerbi.com/views/oauthredirect.html";
it seems like when Power BI service opens OAuth code flow window for authentication and it expects preview.powerbi.com as  redirect_url.

You'd need to monitor your calls to see what's actually happening and if the correct redirect uri is being used or not.
The error that I quoted basically states:

Failed to call FinishLogin with OAuth token or failed with StartLogin

Meaning that either one of those parts is not working as intended. There are some things that might work in your own environment but might not fully work in the service and there are even some limitations specific to the standard gateway that are different to the ones in the personal gateway. The personal gateway, as you're using it, it's the best place to test your connector, but there's something wrong with the calls being made.
You can use Fiddler on the computer that's running the gateway to monitor those requests coming out of it and see what specific error you're getting from the API

@migueesc123 Thanks for the response.
While investigating web calls on Fidler I came across a strange "authorize_code" call by PBI service.
When users initiate the OAuth process on PBI service. it sends "authorize_code" request with preconfigured parameters, for instance, PBI service changes "state" param with "app.powerbi.com" although I set it to random 24 digit code.
Fiddler:

Browser's Network Traffic:

Oracle expects a 24 digit code in the "authorize_code" request and without this information, it gives an invalid_request error in response.
How can I force Power BI service to use my "state" param instead of using "app.powerbi.com"?

@migueesc123 Can you please shed some light on this issue?

I believe this requires some more digging and testing to make sure that you can use the state parameter of your choice. Probably using the context parameter of the StartLogin / FinishLogin.
Haven't been in this situation before, so I wouldn't be able to tell you anything else other than keep working on your code

The state parameter is set by the host process, and should never be manipulated by the connector (or the auth server you're interacting with).
If you need to pass information from StartLogin to FinishLogin, you'd use the Context field in the record you return in StartLogin.

Yes, unfortunately I believe you've hit a dead end. There is no way for the connector to override the state parameter in the Power BI service. It's something you could open an issue for on ideas.powerbi.com, but at this point I'm not aware of any plans to change the current logic.
In Power BI Desktop, the OAuth flow takes place on a single machine. The OAuth host sets a default state value (a GUID), but allows the connector to override it.
In the Power BI service, the OAuth flow involves multiple locations (client browser, power bi service frontend, power bi service backend, the connector host, and potentially a gateway). The state value is used to redirect the user to the correct Power BI service backend endpoint. An alternate CSRF mechanism (client side session state) is used.

@mattmasson thanks for sharing details.
is it possible to mark this request as an open bug?

@muhammadawaisaslam i wouldn’t consider this a bug. It’s by design this way, but def should be documented somewhere. You can also go into the documentation provided by Microsoft and submit your own feedback to any articles that you think are missing anything important. Here’s one of those articles:
https://docs.microsoft.com/en-us/power-query/installingsdk
Your best bet is to raise a new idea on the Power BI UserVoice as stated by Matt.

Hello @muhammadawaisaslam ,
Did you raise an idea on power bi community regarding to this issue?
Can you please send a link to that?
I'll vote for this idea as I faced with the same thing


add analyze the token segment info function

Please provide Issues links to:

Issues: #1, #68

Provide test code:

Description
...

Codecov Report

Merging #105 (5e9401f) into master (6394006) will decrease coverage by 1.71%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master     #105      +/-   ##
==========================================
- Coverage   92.32%   90.60%   -1.72%
==========================================
  Files          12       12
  Lines         951      969      +18
==========================================
  Hits          878      878
- Misses         47       65      +18
  Partials       26       26

Impacted Files
Coverage Δ

dag.go
84.00% <0.00%> (-8.31%)
:arrow_down:

seg.go
100.00% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6394006...5e9401f. Read the comment docs.


Http2 loadbalancing not working

Bug Description
We have http2 traffic coming in through istio ingress gateway and getting routed to our service.
Initially we have 1 istio ingress gateway pod and everything is fine and when load increases the autoscaler scales up the ingress gateway pod to 2.
But even if the second pod comes up it doesn't take any http2 traffic from client and only the first one continues to take all http2 load.  Seems the http2 persistent connections are made between the first pod and all traffic is flowing there.
How can we make the request level load balancing happen here , rather than connection level which is happening today.
Our gateway
apiVersion: networking.istio.io/v1beta1
kind: Gateway
metadata:
  annotations:
    meta.helm.sh/release-name: shared-istio-gateway
    meta.helm.sh/release-namespace: sps-ig2
  creationTimestamp: "2022-07-29T13:43:10Z"
  generation: 4
  labels:
    app.kubernetes.io/component: Ingress-Egress-and-LoadBalancers
    app.kubernetes.io/instance: shared-istio-gateway
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: shared-istio-gateway
    app.kubernetes.io/part-of: NCC
    app.kubernetes.io/version: 22.7.1-80
    chart: shared-istio-gateway-22.7.1-80
    heritage: Helm
    namespace: sps-ig2
    release: shared-istio-gateway
  name: shared-istio-gateway
  namespace: sps-ig2
  resourceVersion: "39314270"
  selfLink: /apis/networking.istio.io/v1beta1/namespaces/sps-ig2/gateways/shared-istio-gateway
  uid: bc755e11-3f47-4b2a-86a5-570f7f6e4c35
spec:
  selector:
    istio: istio-system
  servers:
  - hosts:
    - nc0231-tls.dyn.nesc.nokia.net
    port:
      name: http2-0
      number: 8082
      protocol: HTTP2
    tls:
      httpsRedirect: false

Please note that we have a gateway object in different namespace binding to gateway pods in istio-system namespace.
virtual service is as follows
apiVersion: networking.istio.io/v1beta1
kind: VirtualService
metadata:
  annotations:
    meta.helm.sh/release-name: ig-chf-routing
    meta.helm.sh/release-namespace: sps-ig2
  creationTimestamp: "2022-07-29T13:41:07Z"
  generation: 2
  labels:
    app.kubernetes.io/component: Charging
    app.kubernetes.io/instance: ig-chf-routing
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: chf-routing
    app.kubernetes.io/part-of: NCC
    app.kubernetes.io/version: 22.7.1-80
  name: chf-routing-charging-vrs
  namespace: sps-ig2
  resourceVersion: "39368897"
  selfLink: /apis/networking.istio.io/v1beta1/namespaces/sps-ig2/virtualservices/chf-routing-charging-vrs
  uid: ae718ef8-d416-48e8-bdcc-e51a418da433
spec:
  gateways:
  - shared-istio-gateway
  hosts:
  - nc0231-tls.dyn.nesc.nokia.net
  - nc0231-oam.dyn.nesc.nokia.net
  - nc0231-prov.dyn.nesc.nokia.net
  http:
  - match:
    - uri:
        prefix: /npcf-smpolicycontrol
    - uri:
        prefix: /nfmgmt
    - uri:
        prefix: /nchf-spendinglimitcontrol
    - uri:
        prefix: /nchf-convergedcharging
    - uri:
        prefix: /npcf-am-policy-control
    - uri:
        prefix: /npcf-ue-policy-control
    - uri:
        prefix: /rest-services
    - uri:
        prefix: /nchf-proxy-request
    route:
    - destination:
        host: ig-charging-service
        port:
          number: 8081

Version
istioctl version
client version: 1.13.1
control plane version: 1.13.1
data plane version: 1.13.1 (12 proxies

 kubectl version --short
Client Version: v1.21.10
Server Version: v1.21.10

Additional Information
No response

The client determines load balancing. If you want clients (outside the mesh) to balance load to your ingressgateways, you either need to make them smarter, put an intermediate layer, or have a mechanism to tell the clients to close the connection and retry.

Thanks @howardjohn . So for http2 traffic do you mean that the client has to some how stop and reconnect when autoscaling of ingress gateway pods happen ?

Ingress gateway will load balance between ingrss gw and your workload. It sounds like you want to load. balance between client and ingress gw.
fundamentally the client must be the thing providing load balancing. So you can insert middle boxes that add load balancing for lower layers but at some point you will still have uneven load if the client doesn't do it.

ok make sense. For http1 client is making separate connections and hence autoscaled ingress pods do get the new request automatically without any special load balancing in front of ingress gw, but i guess for http2 this wont work then as connections are persistent.

What happens if we use http2 streaming ? Will ingress gw still balance http2 streamed connections to new pods which scale up ?

No, streams are stateful. That is impossible for a proxy to do.
On Thu, Aug 4, 2022 at 2:07 PM arunpmohan @.***> wrote:

What happens if we use http2 streaming ? Will ingress gw still balance
http2 streamed connections to new pods which scale up ?
—
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/issues/40213#issuecomment-1205768067, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEYGXMVGFMHXHR3S5XGNKLVXQWHJANCNFSM55IWSGLA
.
You are receiving this because you were mentioned.Message ID:
@.***>

We can close it as http2 uses long running connections


Django 2 fixes: urlresolvers to urls & on_delete on ForeignKey fields

Hey @milossh! Thank you for making this pull request, I have been pretty slow to review pull requests in this repository and pull request #13 already solved this issue, so I merged that. I appreicete your effort and sorry that I couldn't merge your pull request. Thank you!


How can I add DevTools extensions to Atom?

Prerequisites

[X] Put an X between the brackets on this line if you have done all of the following:

Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
I would like to be able to use devtools extensions like React Developer Tools to Atom in dev mode. How can I do that?
The official Electron documentation mentions a way to load devtools extensions in an Electron window, but I haven't been able to apply it to Atom.
I've tried variations of the following code in the init.coffee script of my .atom folder, but they all fail with some variant of "This method you're trying to access doesn't exist".
# Your init script
#

BrowserWindow = require('electron').remote.BrowserWindow
BrowserWindow.addDevToolsExtension("~/.config/chromium/Default/Extensions/fmkadmapgofadopljbjfkapdkoienihi/3.2.1_0/")

Which leads me to think I'm missing something. Is there a way to load devtools extensions from init.coffee, or should I try so other method? Either way, which is the simplest way to proceed?

Secondary question: I've also found this npm package that provides a simplified way to load devtools extensions in Electron. Is it possible at all to use it in Atom? I don't think you can add node modules to init.coffee.
Versions
Atom : 1.23.3
Electron: 1.6.15
Chrome : 56.0.2924.87
Node : 7.4.0

You may want to see how Devtron injects itself since that works in Atom.
Because we treat our issues list as the Atom team's backlog, we close issues that are questions since they don't represent a task needing to be completed. For most questions about Atom there are a lot of options, check out:

The Atom Flight Manual
The Atom FAQ on Discuss
Discuss, the official Atom and Electron message board
Join the Atom Slack team

On Discuss and in the Atom Slack team, there are a bunch of helpful community members that should be willing to point you in the right direction.


Rimraf+commander

@watilde
Hi.
Quite a few changes squashed in a single PR.
My bad for not creating a separate PR for adding commander.js, but I was already working with a dirty repository and it was too late to break things apart. I hope it's OK this time.
Now, I don't know what you think about commander.js, but it's really intuitive for parsing arguments. npmbrew uses what commander.js calls subcommands which requires adding a file with the npmbrew.<command> call to the bin/ directory.
This may seem a bit unattractive at first, but in the future, adding options to subcommands will be very easy.
Besides that, I added rimraf, removed the files no longer needed since we are using rimraf and commander.
Let me know if there's anything strange and request specific changes and I will update this PR.

Thanks for your nice Pull Request! I've commented some minor point. Well, could you please separate this Pull Request including Rimraf, commander?

Yes, it's my fault like I commented earlier.
Sure, will do.


InvalidEngineError: Cannot connect to the WebSocket server (reason: undefined)

I am getting InvalidEngineError while const fingerprint = await plugin.fetch({ tags: ['Desktop'] }) is running after waiting for these:
The browser is downloading - this may take some time.
The browser is installing - this may take some time.

This is the error after browser installation is done (or stopped?):
InvalidEngineError: Cannot connect to the WebSocket server (reason: undefined)
This could be due to the fact that the engine was not downloaded or unpacked correctly.
Try completely deleting the engine folder and restarting the code until it completes.
If this does not help, open an issue with a detailed description of the problem.
    at C:\Users\User\Projects\newproject\node_modules\bas-remote-node\src\services\socket.js:51:18
    at Timeout._onTimeout (C:\Users\User\Projects\newproject\node_modules\chnl\dist\channel.cjs.js:2:4848)
    at listOnTimeout (node:internal/timers:594:17)
    at process.processTimers (node:internal/timers:529:7)

I am running this with paid Bablosoft key, on Windows Server 2019. I have tried reinstalling my npm packages and deleting the data folder multiple times. This setup was working for me before but not anymore. There is more than enough space in my disk. Here are some version info:
PS> node -v
v22.8.0
PS> npm -v
10.8.2

  "dependencies": {
    "puppeteer": "^22.15.0",
    "puppeteer-with-fingerprints": "^1.6.3"
  },

I have created a new project with this code:
const { plugin } = require("puppeteer-with-fingerprints");

plugin.setServiceKey("");

(async () => {
  const fingerprint = await plugin.fetch({
    tags: ["Microsoft Windows", "Chrome"],
  });

  plugin.useFingerprint(fingerprint);

  const browser = await plugin.launch({ headless: false });

  const page = await browser.newPage();
  await page.goto("https://example.com");

  console.log(
    "Viewport:",
    await page.evaluate(() => ({
      deviceScaleFactor: window.devicePixelRatio,
      width: document.documentElement.clientWidth,
      height: document.documentElement.clientHeight,
    }))
  );

  await browser.close();
})();

And the issue persists:
PS> node .\index.js
The browser is downloading - this may take some time.
The browser is installing - this may take some time.
C:\Users\User\Projects\puptest\node_modules\bas-remote-node\src\services\socket.js:51
          reject(new InvalidEngineError(`Cannot connect to the WebSocket server (reason: ${error.reason})`));
                 ^

InvalidEngineError: Cannot connect to the WebSocket server (reason: undefined)
This could be due to the fact that the engine was not downloaded or unpacked correctly.
Try completely deleting the engine folder and restarting the code until it completes.
If this does not help, open an issue with a detailed description of the problem.
    at C:\Users\User\Projects\puptest\node_modules\bas-remote-node\src\services\socket.js:51:18
    at Timeout._onTimeout (C:\Users\User\Projects\puptest\node_modules\chnl\dist\channel.cjs.js:2:4848)
    at listOnTimeout (node:internal/timers:594:17)
    at process.processTimers (node:internal/timers:529:7)

Node.js v22.8.0

Please try using an earlier version of the plugin (for example 1.5.0), if you say that it worked before, then we can try to understand what could have influenced the occurrence of the error.
Among other things, there is a chance that an antivirus or firewall may block the engine's operation - please check this point too. The error is related to the websocket, it cannot connect to the engine (it takes 60 attempts and 1 minute). Maybe a firewall, network settings, security policy, or something else prevents you from using the ports generated for websocket or it does not allow the engine to start at all.

First tried version 1.5.0 and reverted recently added plugin.setServiceKey method but the issue persisted.
Windows defender firewall is disabled at the moment. Also disabled virus protection options from Windows Defender but unfortunately the issue persists. There is no other antivirus software running.
On a relatively unrelated note, one of the things I did between the last successfully working state of the project and now was uninstall Windows IIS (Internet Information Services) and install Nginx via Chocolatey. I didn’t think it would cause any port-related issues, but to be safe, I stopped the Nginx service. However, the issue still persists.

If you have the opportunity, you can send the server data to the mail<EMAIL_ADDRESS>I would try to look for the reason.

I could finally pinpoint the issue by debugging different configurations after formatting the server to the factory settings once or twice and skipping some the steps I took every time. It turns out the openssl package I installed through Chocolatey to generate self-signed certificates was causing this problem even if I don't use it. I uninstalled the program for now and it works now. I don't really know exactly why it would cause this issue, I would be happy to read through you guys brainstorming. Anyway, thanks @CheshireCaat for the effort.


[must-gather]Collect SOS reports from EDPM nodes

To facilitate CI troubleshooting this PR enabled SOS report gathering from all EDPM nodes.
Depends-On: https://github.com/openstack-k8s-operators/openstack-must-gather/pull/33
As a pull request owner and reviewers, I checked that:

[ ] Appropriate testing is done and actually running
[ ] Appropriate documentation exists and/or is up-to-date:

[ ] README in the role
[ ] Content of the docs/source is reflecting the changes

could you also add it for data-plane-adoption-github-rdo-centos-9-extracted-crc?

@gibizer have you tested locally? Cause right now we skip calling mus-gather if all goes OK. I was talking with @fmount to enable it always after ensuring it doesn't eat too much time.

@gibizer have you tested locally? Cause right now we skip calling mus-gather if all goes OK. I was talking with @fmount to enable it always after ensuring it doesn't eat too much time.

I did not tested it locally. I can try to push a commit top of this that triggers a ci failure to see the gathered logs

@gibizer have you tested locally? Cause right now we skip calling mus-gather if all goes OK. I was talking with @fmount to enable it always after ensuring it doesn't eat too much time.

I did not tested it locally. I can try to push a commit top of this that triggers a ci failure to see the gathered logs

@gibizer sounds good, run a dummy failure, just to check we don't break the failure path :)

@pablintino @gibizer btw I'm ok to always enable sosreports run by must-gather: I have a patch that is supposed to disable them, but we can talk more about that and define the use cases when we don't want to gather them.
My current patch [1] always skips them, but we can either reduce this action to the edpm-nodes only, or skip sosreports entirely under certain circumstances.
It would be idea to be able to define this behavior at job level, maybe something to explore.
[1] https://github.com/openstack-k8s-operators/ci-framework/pull/843

@pablintino @gibizer btw I'm ok to always enable sosreports run by must-gather: I have a patch that is supposed to disable them, but we can talk more about that and define the use cases when we don't want to gather them. My current patch [1] always skips them, but we can either reduce this action to the edpm-nodes only, or skip sosreports entirely under certain circumstances. It would be idea to be able to define this behavior at job level, maybe something to explore.
[1] #843

@fmount one question, that may simplify the entire decision. How long does the entire must-gather takes with one single compute?

I think we should trigger the CI to get those numbers, so we can use it as a reference

recheck

@cjeanner I believe the failure on this patch is on purpose (ansible.builtin.fail:) to see the must-gather output with SOS reports, so I'm not sure if we should be rechecking.
On another topic, it seems like either the openstack-must-gather container image that is being used doesn't include the SOS EDPM gathering code or there are no openstackdataplanenodesets objects in openshift, because there are no messages related to the gathering of EDPM SOS reports.  There should be either a message of skipping or generating the tests.

Hey @Akrog we run the recheck to old a node and investigate the reason of [1]:
[must-gather-mm48w] POD 2023-11-28T16:35:02.456999352Z error: non-zero exit code from debug container
[must-gather-mm48w] POD 2023-11-28T16:35:02.462178059Z xz: (stdin): File format not recognized
[must-gather-mm48w] POD 2023-11-28T16:35:02.463251775Z tar: Child returned status 1
[must-gather-mm48w] POD 2023-11-28T16:35:02.463251775Z tar: Error is not recoverable: exiting now
[must-gather-mm48w] POD 2023-11-28T16:35:02.463970242Z Failed to download and decompress sosreport-crc-74q6p-master-0.tar.xz not deleting file

I'm wondering if the xz-utils pkg is present in the edpm nodes in CI, and I wanted to hold a node to check what's going on.

The xz package should not be the issue, because the tar command is run in the openstack-must-gather container where we already install the package in our Dockerfile.
The xz complain is probably caused by the stdout from the cat command that is run on the debug container having things that are not part of the compressed file itself.
And the reason why stdout could have garbage (or could be just empty) is probably related to this the debug container returning an error on the cat command:
must-gather-mm48w] POD 2023-11-28T16:35:02.456999352Z error: non-zero exit code from debug container

One thing we could try to do is use the tee command to see what the cat command is returning.

@fmount This is what I was referring to with the tee command: https://github.com/openstack-k8s-operators/openstack-must-gather/pull/28

@fmount This is what I was referring to with the tee command: openstack-k8s-operators/openstack-must-gather#28

as per the troubleshooting session, PR#28 should fix the issue we've seen when the sos report is collected from the master nodes.

recheck
as https://github.com/openstack-k8s-operators/openstack-must-gather/pull/28 merged, lets see how this looks now

recheck as openstack-k8s-operators/openstack-must-gather#28 merged, lets see how this looks now

The SOS report from the k8s node is now included https://logserver.rdoproject.org/47/847/3e562597a505beeab15be3020cf5a0e211fba2f7/github-check/podified-multinode-edpm-deployment-crc/ee59e59/controller/ci-framework-data/logs/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-2daad7cf46a535be158ee37d2e34e9d127353d2deaad1327d6492e3b013ce437/sos-reports/_all_nodes/
But I don't see any EDPM node SOS reports.
... Maybe I forced the error too early?

I tested it with Nova adoption FFU job, and it worked https://logserver.rdoproject.org/92/192/93526b893a7944fe8af2e158446cae8477dac1c6/github-check/data-plane-adoption-github-rdo-centos-9-extracted-crc/db7b697/controller/ci-framework-data/logs/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-2daad7cf46a535be158ee37d2e34e9d127353d2deaad1327d6492e3b013ce437/sos-reports/_all_nodes/

although there is no /var/log/containers collected - perhaps some sos plugin wasn't enabled?

That's a great point. I believe that once we merged the SOS PR, it gets released, and we add the openstack_edpm profile to the default list of profiles gathered on EDPM nodes. There is a TODO item at the top of the file to remind us to do it.
@fmount Do you think it's worth modifying the gather_edpm_sos script to accept not only the list of profiles to collect like we do now, but also accept a list of SOS plugins, and default it to the ones from the openstack_edpm profile? That way we'll be getting the data we need until it's released, and once it's released we add the profile to the script and default to an empty plugin list.

Hey,
yes, It's exactly what I had in mind.
I think there's value in having that kind of flexibility: even though the SOS_PR merged we still no have a (clean) way to consume in C9s until new builds appear in cbs [1].
We can try to speedup that process but it's not definitely under our control (CentOS storage SIG), and this is yet another reason to have the SOS_PLUGINS array that defaults to what is gathered by the edpm profile.
+1 from me
[1] https://cbs.centos.org/koji/packageinfo?packageID=11031

OK so we have the SOS report from the compute https://logserver.rdoproject.org/47/847/ee044ccea6b917c95444e36c3fb252a00df95e43/github-check/podified-multinode-edpm-deployment-crc/97eca9d/controller/ci-framework-data/logs/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-206e6f463855943ce5f128d1731718c7a7e0faf5bb2cc0fda0ddeb567abeb18d/sos-reports/_all_nodes/sosreport-compute-0.ci-rdo.local/ But it does not have /var/log/containers or /var/lib/openstack gathered. I guess we missing some profile / plugin

OK so we have the SOS report from the compute https://logserver.rdoproject.org/47/847/ee044ccea6b917c95444e36c3fb252a00df95e43/github-check/podified-multinode-edpm-deployment-crc/97eca9d/controller/ci-framework-data/logs/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-206e6f463855943ce5f128d1731718c7a7e0faf5bb2cc0fda0ddeb567abeb18d/sos-reports/_all_nodes/sosreport-compute-0.ci-rdo.local/ But it does not have /var/log/containers or /var/lib/openstack gathered. I guess we missing some profile / plugin

My PR which contains new files/folders to gather has been merged in the sos repo, but new version of the tool hasn't been released since then.

recheck
see if adding openstack_edpm via Depends-on: works or not  https://github.com/openstack-k8s-operators/openstack-must-gather/pull/33

OK so we have the SOS report from the compute https://logserver.rdoproject.org/47/847/ee044ccea6b917c95444e36c3fb252a00df95e43/github-check/podified-multinode-edpm-deployment-crc/97eca9d/controller/ci-framework-data/logs/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-206e6f463855943ce5f128d1731718c7a7e0faf5bb2cc0fda0ddeb567abeb18d/sos-reports/_all_nodes/sosreport-compute-0.ci-rdo.local/ But it does not have /var/log/containers or /var/lib/openstack gathered. I guess we missing some profile / plugin

My PR which contains new files/folders to gather has been merged in the sos repo, but new version of the tool hasn't been released since then.

Ahh. Thanks for the hint.

/recheck

recheck
openstack-operator failed to build

we really need this merged

@gibizer care to rebase and revive this PR?

@gibizer care to rebase and revive this PR?

It is on my todo list but with a fairly low priority compared to my other tasks. So if this is important then feel free to grab it.

I thought this patch was waiting for the new version of SoS to be released that contains @rebtoor patch. [1]
@fmount Has created an unofficial build [2], maybe we could use that in the mean time because we (CI) also want this patch in ASAP
[1] https://github.com/sosreport/sos/pull/3414
[2] https://cbs.centos.org/koji/taskinfo?taskID=3768636

so we only need to rebase, and prolly https://github.com/openstack-k8s-operators/openstack-must-gather/pull/33 landed as well?

I don't know how to rebase it in-place, created https://github.com/openstack-k8s-operators/ci-framework/pull/1315

abandoning in favor of #1315

I don't know how to rebase it in-place, created #1315

for the future: you can simply push patches to the branch the PR is created from even if it is in my fork. Github is opening up the access to the branch a PR is created from for others to update.

I don't know how to rebase it in-place, created #1315

for the future: you can simply push patches to the branch the PR is created from even if it is in my fork. Github is opening up the access to the branch a PR is created from for others to update.

I tried that, however it was non trivial to cherry-pick it on top without bringing in a bunch of unrelated commits


Use global stack resolver if explicitly configured

Prefer explicitly configured global stack resolver
Bump default resolver to lts-5.12

Thanks, this is better than hardcoding some old version.


Font can't be read because of non-Unicode charmap

there seems to be a small issue regarding the specific font names not being checked.
Lets say for instance i use: EPSON 太丸ゴシック体Ｂ this wont work because of Ｂ.
If i remove it then it'll work, im not sure what other characters are affected but that's the first instance i found.

Merged into #63 since it has more samples.

Correction: This has not directly something do to with the name but the font's encoding. It uses “SIJS” as encoding (which affects not only the name, which is read as FjïΩê¨ã…ëæä€ÉSÉVÉbÉNëÃ but also the charmap making it unusable). All modern fonts use Unicode and that's the only font encoding libass currently supports. See: https://github.com/libass/libass/issues/531
You can recode the font with eg fontforge (remember to also sanitise the name) or use a native Unicode font.


gaussian_ei() causes underflow in norm.pdf()

When I run BayesSearchCV() I sometimes get a crash caused by gaussian_ei() passing a value of excessive magnitude to norm.pdf(). This occurs when scaled contains a value that is (roughly) less than -37 or greater than 37.
I am running scikit-optimize 0.7.4, scikit-learn 0.23.1, and scipy 1.5.0.

I can also see a large number of underflows:
~/Venvs/Jampp/lib/python3.9/site-packages/skopt/acquisition.py in _gaussian_acquisition(X, model, y_opt, acq_func, return_grad, acq_func_kwargs)
     49     elif acq_func in ["EI", "PI", "EIps", "PIps"]:
     50         if acq_func in ["EI", "EIps"]:
---> 51             func_and_grad = gaussian_ei(X, model, y_opt, xi, return_grad)
     52         else:
     53             func_and_grad = gaussian_pi(X, model, y_opt, xi, return_grad)

~/Venvs/Jampp/lib/python3.9/site-packages/skopt/acquisition.py in gaussian_ei(X, model, y_opt, xi, return_grad)
    297     improve = y_opt - xi - mu[mask]
    298     scaled = improve / std[mask]
--> 299     cdf = norm.cdf(scaled)
    300     pdf = norm.pdf(scaled)
    301     exploit = improve * cdf

~/Venvs/Jampp/lib/python3.9/site-packages/scipy/stats/_distn_infrastructure.py in cdf(self, x, *args, **kwds)
   1961         if np.any(cond):  # call only if at least 1 entry
   1962             goodargs = argsreduce(cond, *((x,)+args))
-> 1963             place(output, cond, self._cdf(*goodargs))
   1964         if output.ndim == 0:
   1965             return output[()]

~/Venvs/Jampp/lib/python3.9/site-packages/scipy/stats/_continuous_distns.py in _cdf(self, x)
    313
    314     def _cdf(self, x):
--> 315         return _norm_cdf(x)
    316
    317     def _logcdf(self, x):

~/Venvs/Jampp/lib/python3.9/site-packages/scipy/stats/_continuous_distns.py in _norm_cdf(x)
    256
    257 def _norm_cdf(x):
--> 258     return sc.ndtr(x)

It surprises me few people are reporting this one given how easy it is to reproduce:
import numpy as np
from scipy import special as sp_special
from sklearn.linear_model import Ridge
from skopt import BayesSearchCV

sp_special.seterr(underflow="raise")

n = 1000
d = 10
X = np.random.normal(size=(n, d))
y = np.random.normal(size=n)
BayesSearchCV(Ridge(), dict(alpha=(0, 10))).fit(X, y)


Tests with passwords are mocked out -> docker containers

Because the actual command to the database is mocked out we don't get an end to end test, which is quite useful in a case like this.
To be able to get to an end to end testcase you'd need to make certain configurations for the databases themselves. Which leads to docker. We'd need to create some kind of testing container for the databases.

Hi @jonathan-s
You removed Travis CI, but there were functional tests:
https://github.com/django-dbbackup/django-dbbackup/blob/master/dbbackup/tests/functional/test_commands.py

In travis the functional tests were only ever tested for sqlite from what I understand. Ideally the functional tests should be ran for all types of databases since it could technically fail for one database but suceed for another.


Disable PlaygroundSupport when building with Xcode.

Right now, build-script-impl always tries to build all PlaygroundSupport targets even if some SDKs are disabled. (That isn't going to work, of course.) The right fix is to figure out which
targets should be built given the SDKs that are enabled, but today's fix is just to remove it from the preset that uses Xcode (which can only build for macOS).
(The irony of disabling a subproject that only builds with Xcode when we use Xcode to build another subproject is not lost on me.)

Before merging this pull request to apple/swift repository:

[ ] Test pull request on Swift continuous integration.

Triggering Swift CI
The swift-ci is triggered by writing a comment on this PR addressed to the GitHub user @swift-ci. Different tests will run depending on the specific comment that you use. The currently available comments are:
Smoke Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please smoke test
    All supported platforms     | @swift-ci Please smoke test and merge
    OS X platform               | @swift-ci Please smoke test OS X platform
    Linux platform              | @swift-ci Please smoke test Linux platform

A smoke test on macOS does the following:

Builds the compiler incrementally.
Builds the standard library only for macOS. Simulator standard libraries and
device standard libraries are not built.
lldb is not built.
The test and validation-test targets are run only for macOS. The optimized
version of these tests are not run.

A smoke test on Linux does the following:

Builds the compiler incrementally.
Builds the standard library incrementally.
lldb is built incrementally.
The swift test and validation-test targets are run. The optimized version of these
tests are not run.
lldb is tested.

Validation Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please test
    All supported platforms     | @swift-ci Please test and merge
    OS X platform               | @swift-ci Please test OS X platform
    OS X platform               | @swift-ci Please benchmark
    Linux platform              | @swift-ci Please test Linux platform

Lint Testing
    Language     | Comment
    ------------ | -------------
    Python       | @swift-ci Please Python lint

Note: Only members of the Apple organization can trigger swift-ci.

@swift-ci Please test OS X platform

Now that #3958 is in,
@swift-ci Please test OS X platform


Is notebook.scrolling.anchorToFocusedCell really necessary?

Testing #194069
This setting seems like overkill to me and there is a good behavior we should be aiming towards which is notebook.scrolling.anchorToFocusedCell = auto. You could also do something clever like disable the anchoring when a user starts scrolling, and when they focus a cell or type it re-enables the anchoring. I rarely use notebooks but to me this seems like a setting that will see very low usage and is not worth the cost of an extra setting imo.
Note that anchorToFocusedCell = auto doesn't work as expected currently, the setting only seems to do anything after I scroll:

🤷

I can change the setting to be experimental to give more leniency to change/remove it, but the behaviors are very different, so we'd like to give users a way to both experiment and revert back in case we missed some case of bad behavior

@amunger I like the idea of using experimental and seeing how many users change it to see if it's worth a setting


Shortcodes and Tailwind

I can't seem to find a way to include tailwind utility classes in my shortcodes. I've poked around in your theme and see it all setup, I suppose I'm just wondering, do things have to be built within your theme in order for tailwind classes to be picked up? So that would mean all shortcodes created from the consumer of the theme wouldn't be able to utilize tailwind classes.
To Reproduce

Install Hugo
Install blowfish
Make a shortcode
Try to apply shortcode with a tailwind css
nothing...

Desktop (please complete the following information):

OS: Nixos
Browser firefox

Hugo & Blowfish versions
Hugo v0.104.3
Blowfish v2.4.5
Edit
Awesome theme btw. This almost EXACTLY what I was looking for!

Doh! I can't believe I didn't see this!
https://nunocoracao.github.io/blowfish/docs/advanced-customisation/#building-the-theme-css-from-source
Clearly if I RTFM I'd know how to do what I want to do. Sorry if I wasted your time!

No issues 👍


add empty judgment for sharding-jdbc statements

As a supplement to #3450 , add empty judgment for sharding-jdbc statements.
Changes proposed in this pull request:

add empty judgment for sharding-jdbc statements
add test case

Pull Request Test Coverage Report for Build 824

18 of 29 (62.07%)  changed or added relevant lines in 7 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.1%) to 68.67%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

sharding-jdbc/sharding-jdbc-core/src/main/java/org/apache/shardingsphere/shardingjdbc/jdbc/core/constant/SQLExceptionConstant.java
0
1
0.0%

sharding-jdbc/sharding-jdbc-core/src/main/java/org/apache/shardingsphere/shardingjdbc/jdbc/core/statement/EncryptPreparedStatement.java
7
11
63.64%

sharding-jdbc/sharding-jdbc-core/src/main/java/org/apache/shardingsphere/shardingjdbc/jdbc/core/statement/MasterSlavePreparedStatement.java
2
8
25.0%

Files with Coverage Reduction
New Missed Lines
%

sharding-jdbc/sharding-jdbc-core/src/main/java/org/apache/shardingsphere/shardingjdbc/jdbc/core/statement/EncryptPreparedStatement.java
2
82.35%

Totals

Change from base Build 545:
0.1%

Covered Lines:
11518

Relevant Lines:
16773

💛  - Coveralls


Is it possible to create resource from secure arcgis service url that require user&pw to access?

I need to register metadata from secure arcgis service that require user and password.
How I do that?
thanks you.

you would have to fill in metadata for the service using the online editor or upload an XML. The geoportal server does not store passwords to secure services or such. Using the editor (or XML upload) you can register the link.

Thank @mhogeweg


Fix for meeting settings default groups

Resolve #3382

As far as understand the code, the _compareForm flag is set, after the first compare. So the onChange code is used then, because _compareFlag is true. @luisa-beerboom  can you verify this?

Ah right, my bad.
I think this looks fine then.


Loc Automation - Updating ETA of loc job: 1223

Loc Automation Updating ETA of loc job: 1223

:x: Validation status: errors

File
Status
Preview URL
Details

:x:Error

Details

Line 111: [Error] W:\tzrn-s\jobs\100\Pages\Pricing\docfx.json for docset Pricing doesn't exist

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Feature: is there any integration with grammar checking functions?

is there any integration with grammar checking functions?

This level of plugins is out of the scope of the core framework. You can join the Discord chat and discuss this such a plugin with the community if someone else has approached solving this.


fix StridesIterator offsets to properly support negative values

Changed pos to offsets and the type from size_t to int64_t to match how negative values are used with negative strides in the case of negative steps in ElementsAttrBuilder::slice()

Jenkins Linux ppc64le Build #10013 [push] fix StridesIterator offs... started at 22:19

Jenkins Linux amd64 Build #10957 [push] fix StridesIterator offs... started at 21:15

Jenkins Linux s390x Build #10966 [push] fix StridesIterator offs... started at 22:15

Jenkins Linux amd64 Build #10957 [push] fix StridesIterator offs... passed after 1 hr 27 min

Jenkins Linux s390x Build #10966 [push] fix StridesIterator offs... passed after 1 hr 45 min

Jenkins Linux ppc64le Build #10013 [push] fix StridesIterator offs... passed after 1 hr 56 min


ci: adding more label to support list

Add more labels to support list https://github.com/tungbq/devops-toolkit/blob/main/.github/workflows/auto-labeler.yml#L28 :

enhancement
sample
usage

I'll handle this!

I'll handle this!

thanks @Abdelhamid-khamis assigned it to you


CoreDNS upgrade process fixed

Related to the bug #1218

We need to upgrade CoreDNS during every single k8s version upgrade, not only during the latest part of update for latest version of k8s.
Added comment to config file of CoreDNS
Upgrade CoreDNS for k8s version - 1.17.4 or greater, since we use 1.17.4 k8s version in 0.6.0 version of epiphany. In lower version, we don't user such application as pgpool or pgbouncer.

/azp run


Useful repr(s)

Including an attempt to include the actual class in a repr_html.
It is useful to know that SkillTable is a different class pandas.Dataframe, but if you want to use the html output in a report, it is not that useful. 🤔

I like the idea, but I think I prefer skill() without "" text


🚨 DO NOT MERGE 🚨 adapt RegularCard from creativeTim

This adapts the regularCard component from the creative tim material
template. It also adds the necessary JSS files and the dependencies.
The problem with it is though that I couldn't find out how to get
"withStyles" to work. -> There's a problem with the types.
There is some documentation here
but even with that I couldn't get it to work.
Help is definitely wanted and needed to finish this.
Error:(82, 27) TS2345: Argument of type
'{ card: { display: string; position: string; width: string; margin: string; boxShadow:
string; bo...' is not assignable to parameter of type 'Record<"card"
| "cardPlain" | "cardHeader" | "cardPlainHeader" | "orangeCardHeader" | "greenCardH...'.
  Type '{ card: { display: string; position: string; width: string; margin: string;
boxShadow: string; bo...' is not assignable to type 'StyleRulesCallback<"card" |
"cardPlain" | "cardHeader" | "cardPlainHeader" | "orangeCardHeader" |...'.
    Type '{ card: { display: string; position: string; width: string; margin: string;
boxShadow: string; bo...' provides no match for the signature '(theme: Theme):
Record<"card" | "cardPlain" | "cardHeader" | "cardPlainHeader" | "orangeCardHeader"
| "greenCardHeader" | "redCardHeader" | "purpleCardHeader" | "blueCardHeader" | "cardTitle" |
 "cardSubtitle" | "cardActions", CSSProperties>'.

I've tried to fix it but I couldn't get it running. I think we should use the other template

Agreed.


WebServer on another port than 80

I tried configure WebServer on port 60 for example, WebServer connect but not receive data, arrow button is red

Now I use TelnetStream2.h and puttytel on Windows. I still have to find a suitable app for Android.


Grammatical Error in naming.js

https://github.com/getbem/getbem.com/blob/master/src/views/naming.js#L49
"Parts of a block and have no standalone meaning. Any element is semantically tied to its block."
What does this sentence mean?

It’s possible that it might read better as follows:
“Children of a block element have no standalone meaning — every child of a block is semantically tied to its block.”


Add react_ru russian telegram community

Thanks, but we try to keep this page focused on English-speaking communities.
(Otherwise the list would be huge.)
I do think it might make sense to have some local links after we add localization to the docs though.
Maybe let's revisit after we do that.
Thanks!

Thanks You for quick response.
If I help You with localizations, may I post link than? And do You accept
PR with it?
пт, 22 июня 2018 г., 2:30 Dan Abramov<EMAIL_ADDRESS>
Closed #983 https://github.com/reactjs/reactjs.org/pull/983.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/reactjs/reactjs.org/pull/983#event-1694874398, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFDqSPdJaf8UlwzAHi0ughRAxensR14Iks5t_CyfgaJpZM4Uy30t
.

--
С уважением, Чеботаев Юра, фронтенд-разработчик с react.

Thanks you for quick reply.

In order to better respect your users it's better to start makinh huge list
of links to all languages.
сб, 23 июня 2018 г., 2:15 Yury Chebotaev<EMAIL_ADDRESS>
Thanks You for quick response.
If I help You with localizations, may I post link than? And do You accept
PR with it?
пт, 22 июня 2018 г., 2:30 Dan Abramov<EMAIL_ADDRESS>
Closed #983 https://github.com/reactjs/reactjs.org/pull/983.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/reactjs/reactjs.org/pull/983#event-1694874398, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFDqSPdJaf8UlwzAHi0ughRAxensR14Iks5t_CyfgaJpZM4Uy30t
.

--
С уважением, Чеботаев Юра, фронтенд-разработчик с react.

--
С уважением, Чеботаев Юра, фронтенд-разработчик с react.


Create LICENSE

General
Create LICENSE

[x] Fix #2

@octref if you have time, please check this PR.

Thanks!


fix: display correct receive amount

You can apply this utils later https://github.com/OtterClam/otto-app/pull/118


Unable to use the library. co.touchlab:stately-common missing

Although my project compiles up just fine and I have both RevenueCat Pods installed and have set up my gradle as given in your Blog post, I get the following gradle error as soon as I add the kmprevenuecat-purchases dependency to Common:
Could not find "co.touchlab:stately-common" in [/Users/cbnewham/Desktop/KeyholderKMP/shared, /Users/cbnewham/.konan/klib, /Users/cbnewham/.konan/kotlin-native-prebuilt-macos-x86_64-1.9.23/klib/common, /Users/cbnewham/.konan/kotlin-native-prebuilt-macos-x86_64-1.9.23/klib/platform/ios_arm64]

@realcbnewham Do you use kotlin version 1.9.23?
This library uses kotlin version 1.9.21. Maybe it is related to that I am not sure that.

Thanks for the quick reply.  Yes, I am using the latest version of all libraries.
I did a Google search for that error - there is one thread in another github project and it may well be that you are correct and that it is due to using an older library.
I am looking forward to using your library - I signed up with RevenueCat today.

As a temporary solution please, check if it works with kotlin version 1.9.21. I'll bump kotlin version to 1.9.23 for next release

Thanks, although my project is nearing completion and all I need is payments.  I have loads of libraries - not sure I could roll it back to that version. I'm also going away for a week. Anyway, I will have a look with a test project when I return, if you have not released another version by then. Thanks!

This is fixed in koin version 3.5.4 actually. Looks like it is not related kotlin version. As soon as koin 3.5.4 is in release, I'll bump koin version here.
https://github.com/InsertKoinIO/koin/pull/1786


Executable takes a very long time to start up

Hi.
I've used build_executable to compile a very simple program:
function main()
    for x in ARGS
        println("Hi: $x")
    end
end

The produced executable takes over 6 seconds to run!
What is happening in those 6 seconds? Is it compilation? Is there a way to precompile everything I need?

This is a follow up from this reddit post

The issue is that the output of BuildExecutable does not actually load the precompiled image it creates. You can get normal startup by specifying the image manually:
JULIA_SYSIMAGE=libapp.dylib ./app Hello
(from the build directory, using the build command from your reddit post)

It works! Thank you very much. You may want to consider adding it to the README.
Could this be automatic?

Hi,
I am also very new to Julia (have been using Matlab/Python for many years). I am using Julia 0.5.0 64bit on Windows and have tried to compile a simple program using build_executable, but I have not been successful - the process always breaks with a Load Error:
ERROR: LoadError: failed process: Process('C:\Users\merdmann\.julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin\gcc.exe' '-LC:\Julia-0.5.0\bin' -shared -ljulia -lssp -o 'C:\Julia-0.5.0\bin\libapp.dll' 'C:\Julia-0.5.0\bin\libapp.o', ProcessExited(1)) [1]
in pipeline_error(::Base.Process) at .\process.jl:616
in run at .\process.jl:592 [inlined]
in link_sysimg(::String, ::String, ::Bool) at C:\Users\merdmann.julia\v0.5\BuildExecutable\src\build_sysimg.jl:151
in (::##2#3{Bool,String})() at C:\Users\merdmann.julia\v0.5\BuildExecutable\src\build_sysimg.jl:80
in cd(::##2#3{Bool,String}, ::String) at .\file.jl:48
in #build_sysimg#1(::Bool, ::Bool, ::Function, ::String, ::String, ::String) at C:\Users\merdmann.julia\v0.5\BuildExecutable\src\build_sysimg.jl:38
in (::#kw##build_sysimg)(::Array{Any,1}, ::#build_sysimg, ::String, ::String, ::String) at .<missing>:0
in include_from_node1(::String) at .\loading.jl:488
in process_options(::Base.JLOptions) at .\client.jl:262
in _start() at .\client.jl:318
while loading C:\Users\merdmann.julia\v0.5\BuildExecutable\src\build_sysimg.jl, in expression starting on line 187
Would you mind to help me with this problem? Thanks a lot!

Julia just says that the command has failed and does not give more info.
Could you run the command (i.e. C:\Users\merdmann\.julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin\gcc.exe' '-LC:\Julia-0.5.0\bin' -shared -ljulia -lssp -o 'C:\Julia-0.5.0\bin\libapp.dll' 'C:\Julia-0.5.0\bin\libapp.o) in a terminal and tell us the output ?

Unfortunately, the command does not produce any output - the command syntax seems to be incorrect.
The final Julia error message is:
LoadError: failed process: Process('C:\Julia-0.5.0\bin\julia'  'C:\Users\merdmann\.julia\v0.5\BuildExecutable\src\build_sysimg.jl' 'C:\Julia-0.5.0\bin\libapp' native   'C:\Users\merdmann\AppData\Local\Temp\jl_D63E.tmp\userimg.jl' --force, ProcessExited(1)) [1]
in pipeline_error(::Base.Process) at .\process.jl:616
in run at .\process.jl:592 [inlined]
in #build_executable#1(::Bool, ::Bool, ::Function, ::String, ::String, ::String, ::String) at C:\Users\merdmann.julia\v0.5\BuildExecutable\src\BuildExecutable.jl:116
in build_executable(::String, ::String, ::String, ::String) at C:\Users\merdmann.julia\v0.5\BuildExecutable\src\BuildExecutable.jl:54
in include_string(::String, ::String) at .\loading.jl:441
in include_string(::Module, ::String, ::String) at C:\Users\merdmann.julia\v0.5\CodeTools\src\eval.jl:32
in (::Atom.##61#64{String,String})() at C:\Users\merdmann.julia\v0.5\Atom\src\eval.jl:81
in withpath(::Atom.##61#64{String,String}, ::String) at C:\Users\merdmann.julia\v0.5\CodeTools\src\utils.jl:30
in withpath(::Function, ::String) at C:\Users\merdmann.julia\v0.5\Atom\src\eval.jl:46
in macro expansion at C:\Users\merdmann.julia\v0.5\Atom\src\eval.jl:79 [inlined]
in (::Atom.##60#63{String,String})() at .\task.jl:60
while loading C:...\julia_sandbox\compilejulia.jl, in expression starting on line 2
My Julia version is 0.5.0 release x86_64-w64-mingw32 - but why mingw32? Does this point to a 64bit/32bit conflict?

What I meant is executing the gcc command outside julia. If this commands has now output it means that it succeeded. Did you run
gcc.exe '-LC:\Julia-0.5.0\bin' -shared -ljulia -lssp -o 'C:\Julia-0.5.0\bin\libapp.dll' 'C:\Julia-0.5.0\bin\libapp.o

?

Ok - indeed, when leaving out all single quotation marks (but only then),
gcc.exe -LC:\Julia-0.5.0\bin -shared -ljulia -lssp -o C:\Julia-0.5.0\bin\libapp.dll C:\Julia-0.5.0\bin\libapp.o
does succeed (has no output).

Good catch ! Let's see what @dhoegh thinks about it. Could you use the "Insert code" button to format the codes in your posts ? it makes it a lot more readable ;)

Ok, By the way, I just tried compiling under Linux (Ubuntu 16.04) and got a similar error.

@MatthiasErdmann I have looked into the issue you are having and it is not related to this issue. The main issue you are having is probably related to the issue I am displaying below. If I am trying to run the command manually in CMD on windows I get the following error:

@MatthiasErdmann I suspect that when you execute the command manually you use a globally installed GCC while BuildExecutable uses a local one, installed by WinRPM in something like C:\Users\d-hoe\.julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin\gcc.exe.
Do any one have an idea what is causing the build to fail with missing libwinpthread-1.dll? I suspect it is caused by an newer GCC. Appveyor has just begun failing, while a month old build succeeded.

From http://download.opensuse.org/repositories/windows:/mingw:/win64/openSUSE_Factory/x86_64/ it seems the GCC version was updated 2016-12-30.

Actually, I have used the local gcc installed by WinRPM - Pkg.add("BuildExecutable") leads to the installation of gcc version 6.3.0 under C:\Users\"me"\.julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin.
However, I get no error message concerning libwinpthread-1.dll. I don't know if this might give hint, but during installation of the BuildExecutable package there is an INFO: "Multiple package candidates found for mingw64-unistd-pthread-devel, picking newest".

Hi,
@MatthiasErdmann, I have the same problem.
You need to path your "C:\Users"me".julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin" in order to run the libwinpthread-1.dll. But after running, nothing happen.

Seem like the system execute the comment but there are not .exe file generated.

I'm experiencing the same problem as @MatthiasErdmann on Windows. I'll report more details tomorrow.

Good news, I have a fix for the windows issue in #30.

Thank you! Adding the bin dir of the local gcc (C:\Users\"me"\.julia\v0.5\WinRPM\deps\usr\x86_64-w64-mingw32\sys-root\mingw\bin) to $PATH works for me.

Thanks dhoegh.

I have now changed so BuildExecutable to use precompiled image in #32. Please do a Pkg.checkout("BuildExecutable") and verify it fixes the problem.

It works (at least on Mac). Thank you very much for the quick fix!


Add Alexu, EG University

@marwa5861 alexu.txt I am sorry, I have to close the request without merging, because you made a mistake in a request and did not specify any filepath. Please ensure that you are familiar with this repository rules located at the bottom of this page and make a new correct request. Thank you for your understanding!