(filezilla) File links are invalid

Discussed in https://github.com/chocolatey-community/chocolatey-packages/discussions/1880

Originally posted by uwemolnar May  9, 2022
As requested by the maintainer of filezilla: the installer-links for filezilla seem to be outdated. Can you please check and fix them:
https://github.com/chocolatey-community/chocolatey-packages/blob/master/automatic/filezilla/legal/VERIFICATION.txt
Would be great - thanks!

@AdmiringWorm As the author seems to be going out of their way to make this difficult to package (assuming I understand this correctly) if this is a package we want to stop maintaining here? I'm happy to raise an RFM request for it.

Submitted PR #2166 to fix this.

Sure.

Submitted PR #2316 to fix this.


[ERROR] - <minecraft won't load>

Description
when i try to open the version of minecraft with the mod on it won't open, and the only things that pop up is the fabric loader error
To Reproduce
just try to install carpet and carpet addon not found and it will crash
Expected behavior
the game runs normally
Screenshots
crash_log_carpet_addon_not_found.txt
the log written on the fabric loader error
Version (please complete the following information):

Minecraft version: 1.21
Carpet version: 1.21-1.4.147+v240613
Mod version: 1.20.6-1.3.1
fabric loader version: 0.16.9

Additional context
i tryed to replicate the bug with the step in the "to reproduce" section but there the fabric loader error doesn't appear, if can help this is my mod list
mod_list.txt

Hi, thanks for your issue.
You need to use the 1.21 version of the mod not 1.20. Here is a link:
1.21.1-v1.3.1

So why on modrinth the .20.6 is also for 1.21? And the .21.1 is just for the 1.21.1

So why on modrinth the .20.6 is also for 1.21? And the .21.1 is just for the 1.21.1

Modrinth is wrong unfortunately but I’ll take a look into it when I have a chance

Gilly7CE there's a problem:
Incompatible mods found!
net.fabricmc.loader.impl.FormattedException: Some of your mods are incompatible with the game or each other!
A potential solution has been determined, this may resolve your problem:
- Replace mod 'Carpet Addons Not Found' (carpet-addons-not-found) 1.3.1 with any version that is compatible with:
- minecraft 1.21
More details:
- Mod 'Carpet Addons Not Found' (carpet-addons-not-found) 1.3.1 requires version 1.21.1 or later of 'Minecraft' (minecraft), but only the wrong version is present: 1.21!
at net.fabricmc.loader.impl.FormattedException.ofLocalized(FormattedException.java:51)
at net.fabricmc.loader.impl.FabricLoaderImpl.load(FabricLoaderImpl.java:196)
at net.fabricmc.loader.impl.launch.knot.Knot.init(Knot.java:146)
at net.fabricmc.loader.impl.launch.knot.Knot.launch(Knot.java:68)
at net.fabricmc.loader.impl.launch.knot.KnotClient.main(KnotClient.java:23)
the error appear again but this time says that the mod is for 1.21.1 and not 1.21

You need Minecraft 1.21.1 not 1.21. We don’t support Minecraft 1.21


Adding warnings when no email will be sent as part of updating a program's status

Description
Screenshots
No email configured for the status:

No email provided by applicant:

Release notes:
Adding warnings when no email will be sent as part of updating a program's status
Checklist

[ ] Added the correct label: < feature | bug | dependencies | infrastructure | ignore-for-release >
[ ] Created tests which fail without the change (if possible)
[ ] Extended the README / documentation, if necessary

Issue(s)
Fixes #<issue_number>; Fixes #<issue_number>; Fixes #<issue_number>...

Codecov Report

Merging #3277 (6c4d365) into main (f056284) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##               main    #3277   +/-   ##
=========================================
  Coverage     79.65%   79.65%
  Complexity     2314     2314
=========================================
  Files           285      285
  Lines          9102     9102
  Branches        607      607
=========================================
  Hits           7250     7250
  Misses         1618     1618
  Partials        234      234

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Document transaction fees

Details here:
https://github.com/paritytech/substrate/pull/3796
Need to figure out the right place to document this, probably transaction weight.

But do allow free transactions from accounts with zero balance.

Another relevant PR: https://github.com/paritytech/substrate/pull/3816 Where transaction fees are separated into another module.
Let's make this issue about documenting transaction fees in general and filling in https://substrate.dev/docs/en/next/development/module/weight which should be renamed from weight to fees.

Just make sure we don't miss addressing this specific point Gav wanted pointed out :)

The specific point being:

Runtime practitioners will need to conscious not to allow free transactions from arbitrary accounts that do not aware at least the ED, since each such transaction will result in storage leakage.

@kianenigma We still need to capture this tip about free transactions from accounts that don't have existential deposit. I'm not totally clear what domain this applies to. Only when we're using the balances module to collect transaction fees?

done


Use feature flags to optionally make charon-lib completely independent from rustc

As of today, charon-lib is almost independent from rustc: it still uses rustc because it preserves the original Rust spans (here). We should use the cfg macro to (optionally) hide this, so that we can build projects which retrieve the (serialized) output of Charon and are completely independent of rustc.

As discussed, the only thing this requires is a way to display error messages that point to source files withotu using rustc.

Fixed in #408


Remove unwraps in node::input::area.rs

This task is automatically imported from the old Task Issue Board and it was originally created by Ilya Bogdanov.
Original issue is here.

There are two unwraps in the graph-editor/src/component/node/input/area.rs module. They need to be removed.

The related code is being removed from repository.


Add airlines

work in progress...
Not an exhaustive list but most of the biggest / most well known - I tried adding Ryanair but for some reason it wouldn't load the widget 🤷♂

That's great! Thanks for contributing. I cannot merge it until it's a draft. Can you post this PR?
And let's definitely add Ryanair http://facebook.com/ryanair

I puzzled over Ryanair for a bit but I can't figure it out.
I had the code below which follows the same format as the rest but it just wouldn't load...
<iframe src="https://www.facebook.com/plugins/page.php?href=https%3A%2F%2Fwww.facebook.com%2Fryanair%2F&tabs&width=340&height=150&small_header=true&adapt_container_width=true&hide_cover=true&show_facepile=true&appId=110203902358957" width="340" height="150" style="border:none;overflow:hidden" scrolling="no" frameborder="0" allowTransparency="true" allow="encrypted-media"></iframe>

Tested on the social plugin page - https://developers.facebook.com/docs/plugins/page-plugin
and it also didn't work - maybe its due to the configuration of the page - privacy settings maybe?

Ah could be. Good catch. Well, let’s already publish this then. Thank you!


Windows refuses LND's connection

Hello! I haven't encountered this before - shortly after upgrading to 0.9.2-beta I get this error when starting LND: dial tcp <IP_ADDRESS>:9050: connectex: No connection could be made because the target machine actively refused it. I run Bitcoin Core 0.19.1 and Windows 10. I tried running lnd with the firewall disabled with no success. Any help would be appreciated!

The port 9050 is usually used for Tor. Did you activate anything Tor related in lnd? Could you perhaps post your configuration and/or command line parameters?

You just gave me a huge clue, thanks. I've configured LND to run over Tor. However my tor client is not running properly (I think) so I stopped it. I get this warning message (sorry if it's off topic):
Guard  is failing a very large amount of circuits. Most likely this means the Tor network is overloaded, but it could also mean an attack against you or potentially the guard itself. Success counts are 123/258. Use counts are 84/84. 215 circuits completed, 0 were unusable, 93 collapsed, and 6 timed out. For reference, your timeout cutoff is 60 seconds.
Is it safe to run Tor with this warning? Not running it is probably the reason why lnd is not starting up. Thanks again!

I'm not sure how lnd uses Tor exactly or what the error means in detail. But I know that lnd tends to open many circuits and that this can be challenging for the Tor client. So my guess is, it's a load issue. But as I said, I'm not too familiar with the internals.

Closing as this is resolved. Opening a new issue to possibly tune the amount of circuits we use.


RuntimeError: The size of tensor a (50) must match the size of tensor b (2) at non-singleton dimension 3

Hi,
I met a runtime error when I try to run this code:
File "/home//AD-NeRF/data_util/face_tracking/render_3dmm.py", line 75, in forward
images = softmax_rgb_blend(
File "/home//envs/pytorch3d/lib/python3.8/site-packages/pytorch3d/renderer/blending.py", line 188, in softmax_rgb_blend
z_inv = (zfar - fragments.zbuf) / (zfar - znear) * mask
RuntimeError: The size of tensor a (50) must match the size of tensor b (2) at non-singleton dimension 3
I use pytorch3d 0.4.0 version.
Is there any information to solve this issue?

Hi, this is a bug in old pytorch3d version. You can follow this instruction to fix it.

Thanks, it seems that the issue has been resolved.


[master] Replace legacy MyGet feeds

MyGet feeds have been deprecated and replaced with new feeds.
This PR updates source-build infrastructure in cases where MyGet feeds were used and adds a task to update repo's NuGet.Config file(s) to replace feeds before building.
See #1971

Bootstrapping is a known issue.  #1979

Bootstrapping is a known issue.  #1979


Training Time

Could you provide your total training time ?

I use a server (a V100 with 8 GPUs ) to train the model. It takes 2 days to train SimTrack with VIT-b/16 and about 53 hr to train a SimTrack with VIT-L/14.

BTW, the training pipeline I used is similar to the pysot pipeline. I am not sure if the new pipeline will be faster or slower.

Is the code version released now(Sep 21st) the final Stark-based version?

I

Is the code version released now(Sep 21st) the final Stark-based version?

Sorry. I am afraid I won't have enough time to release the new version before CVPR DDL.


cube-network hook:  Remove sleep and loop

The network hook no longer has a race condition so the sleep loop is
no longer needed.  The pflask network hooks are called as a part of
the pflask execution context.
Signed-off-by: Jason Wessel<EMAIL_ADDRESS>

begone sleeps!
merged


Add support for Route 53 DNS updates

Creates a CustomActionNode to update the Route 53 public hosted zone record for the configured PublicHostedZoneName using the application server stack's Elastic Load Balancer (ELB) endpoint.

Testing
Ensure that default.yml has at least the following contents:
[staging]
Region: 'us-east-1'
StackType: 'Staging'
KeyName: 'rf-stg'
IPAccess: '<IP_ADDRESS>/32'
AvailabilityZones: 'us-east-1a,us-east-1b'
NATInstanceType: 't2.micro'
BastionHostInstanceType: 't2.micro'
PublicHostedZoneName: 'rf.azavea.com'
PrivateHostedZoneName: 'rf.internal'
RDSDbName: 'rasterfoundry'
RDSUsername: 'rasterfoundry'
RDSPassword: 'secretsecret'
GlobalNotificationsARN: 'arn:aws:sns:...'
AppServerInstanceType: 't2.micro'
AppServerInstanceProfile: 'AppServerInstanceProfile'
AppServerAutoScalingDesired: '1'
AppServerAutoScalingMin: '1'
AppServerAutoScalingMax: '1'
SSLCertificateARN: 'arn:aws:iam...'
WorkerInstanceType: 't2.micro'
WorkerInstanceProfile: 'WorkerInstanceProfile'
WorkerAutoScalingDesired: '1'
WorkerAutoScalingMin: '1'
WorkerAutoScalingMax: '1'

Then, run the following command:
$ ./rf_stack.py launch-stacks --aws-profile rf-stg --rf-config-path default.yml --rf-profile staging

Note: This process makes use of the rf-stg API keys, which is different than the API keys associated with rf-dev. You can find the rf-stg keys on the file share.

@azavea-bot rebuild

Confirmed the creation of the A record in the public hosted zone.
+1


GA Operations: (Scalability) Optimize load induced on management cluster API Server

Our perf squad after running with 440 clusters for a couple days noticed the API Server of the management cluster is repeatedly getting OOMKilled:

management cluster master components  were on
16 core 64 gig dedicated machines.
3 master components running in each AZ (one per AZ).
Etcd was also on a dedicated 16 core 64 gig machine with one instance running in each AZ

The current ratio we have in production is
116 nodes per zone * 3 zones = 348 nodes (dedicated 16 core 64 gig machines)
440 clusters (cluster components have instances in multiple AZs).
so that is a 1.26 cluster per node density on average.

Currently at 54 hosted clusters

The growing lines are the kube-apiserver containers the rest are all the other containers in the system.

However: Things do appear to be stabilizing and if anything I am seeing the larger jumps correspond not to more management clusters but instead to adding more worker nodes into the cluster to hold the hosted control plane componets
An example of this is shown below:

That time of increase was actually corresponding to when I scaled the cluster from a total of 120 nodes to 225 nodes. The rest of the graph is when I scaled from 82 to 175 hostedclusters. In that time I see no significant uptick trends of memory utilization of API Servers.

/assign @relyt0925

pprofresults_30plusGB_afterrestart.zip

Secrets then spikes extremely large (1.4K watch requests) which seems really large

after that flux things seem to stabilize:

nothing major on the controller side of things during this time:

Dropping
--default-watch-cache-size to 33 significantly helps the load (default is 100)

@sttts @deads2k any thoughts on optimal tuning of api-server to handle a thundering herd of re-establishing watch connections?

@sttts @deads2k any thoughts on optimal tuning of api-server to handle a thundering herd of re-establishing watch connections?

We added a patch in 4.8 to address the infinite concurrency of watchers in prior releases.  We noticed it for clusters with many kubelets and pods trying to rewatch lots of secrets.  The change charges watchers during the establishment of their watch connections, so it improves cases where many watchers all attempt to watch at the same time.  It does not improve cases of wide fanout when an update to a single secret is observed by a large number of watchers.
The PR (linked to the upstream that landed in  1.22) is https://github.com/openshift/kubernetes/pull/773.
@tkashem if you have more comments.

thank you for this @deads2k !

any thoughts on optimal tuning of api-server to handle a thundering herd of re-establishing watch connections?

in addition to openshift/kubernetes#773, on the management cluster you can add a new priority & fairness rule to set a  concurrency limit for these watch requests (watch initialization only).
Also, the default values for max-requests-inflight and max-mutating-requests-inflight are too high for the management cluster, since the management cluster is managed by us, i would recommend lowering these values as well (depending on the number of cpu cores the master node has)
https://github.com/openshift/cluster-kube-apiserver-operator/blob/master/bindata/assets/config/defaultconfig.yaml#L117-L121

/remove-lifecycle stale

Running performance tests with updates as well......

https://github.com/openshift/multus-admission-controller/issues/40
We've also raised the above issue that highlights instabvilities following kube-apiserver restarts that are triggered by the multus admisson controller running on each node in the management cluster.


Use Startup Tracing to improve Android startup time

Proposal
Use the new Startup Tracing feature to improve startup time on Android
Goals
App should startup faster.
Source
Recent blog by Xamarin team.

Just noticed full AOT is already used, not necessary then :-) .


Fixed issue where it was trying to save screenshots for non-request type...

... tests

Thanks, will do some tests and integrate shortly

Just found out this is actually not working properly. If you can find where is the type option, let me know

I got it. Fixing the pull

Fixed.

Hi Felipe
Had an issue merging this so did it manually.  Thanks for the input.
Matt


Calculator layout using components

In this part of my project, I developed the UI and layout, I did it using React components, I did not add the math logic to make it work, that will be added later.
Project requirements

Delete the boilerplate from create-react-app (text, images, styles)
Create a directory called components
Inside components, create Calculator.js file
In Calculator.js, create a React component that matches the design
Use JSX, and CSS to implement the design
Use functional components
Create at least 1 child component
Use the Calculator component in the top-level (App.js)
Make sure the App works properly (Open it in the browser)

General requirements

Follow JavaScript best practices
Use correct Gitflow
Document my work in a professional way.
Check linter errors
Open Pull request and ask for review

@rloterh thank you so much

Hi @Jord4N-AC,  👋🏻👋🏻
Your project is complete!  There is nothing else to say other than... it's time to merge it :shipit:
Congratulations! 🎉

Highlights

[ ] Great job on the funtionality for component💯
[ ] Followed Gitflow 🔥
[ ] No Linters error ✅
[ ] Kudos on the design⭐

Optional suggestions
Every comment with the [OPTIONAL] prefix won't stop the approval of this PR. However, I strongly recommend you to take them into account as they can make your code better. Some of them were simply missed by the previous reviewer and addressing them will really improve your application.
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.

As described in the Code reviews limits policy  you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.


no changes in state

Tweening not working for me. Something as simple as this has no effect on the state of my component. Any suggestions?
var Start = React.createClass({
	getInitialState: function(){
		return {width: "50px"};
	},
	handleClick: function(){
		this.props.startTimer();
		TweenLite.to(this, 1, {state: {width: "100px"}});
		// this.setState({width:"50px"});
	},
	render: function(){
		return (
			<RaisedButton label="Start" onClick={this.handleClick} style={{width: this.state.width}} />
			);
	}
});

Hi @jorda0mega, I think i see what the problem is–the plugin doesn't understand the string "100px".
You should get the behavior you're looking for if you use a number value instead, and then build your style string in your render function:
var Start = React.createClass({
    getInitialState: function(){
        return {width: 50};  // Use a number instead of a string here
    },
    handleClick: function(){
        this.props.startTimer();
        TweenLite.to(this, 1, {state: {width: 100}});  // Tween that number here
        // this.setState({width:50});
    },
    render: function(){
        return (
            <RaisedButton label="Start" onClick={this.handleClick} style={{width: this.state.width + 'px' /* Make your style string at the last moment here */ }} />
            );
    }
});

Hope that helps! I'm going to close this issue, but feel free to continue with the thread if you continue to have problems with the plugin.

thanks, that worked.


[Landcover Toolkit] Treat Datasets as immutable

This allows references to Dataset, Landsat8, etc. to behave as we would expect; like EE API, objects are considered immutable, and mutators return a new instance, allowing us to do things like this:
var l8 = lct.Landsat8();
var cloudFreeL8 = l8.fmaskCloudsAndShadows();
Map.addLayer(l8, l8.getDefaultVisParams(), 'Raw Landsat8');
Map.addLayer(cloudFreeL8, cloudFreeL8.getDefaultVisParams(), 'Cloud-free Landsat8');

Abandoning this PR for now until we decide we actually want these classes to be immutable.


EmbedMultipleConfs Seed Zero

Description:

RDKit Version: 2017.09.3
Platform: CentOS 7, gcc 6.2.0

If the seed is set to zero, ten identical conformers are generated.
This was not the case in 2017.09.1. Is this the intended behaviour?

  auto mol = std::unique_ptr<RDKit::RWMol>(RDKit::SmilesToMol("N[C@@H](CCCNC(N)=N)C(O)=O"));

  int seed = 0;
  RDKit::DGeomHelpers::EmbedMultipleConfs(*mol, 10, 30, seed);

  for (unsigned int i = 0; i < mol->getNumConformers(); i++) {
    std::cout << mol->getConformer(i).getAtomPos(0).x << ", " << mol->getConformer(i).getAtomPos(0).y << ", "
              << mol->getConformer(i).getAtomPos(0).z << std::endl;
  }

Hi. It is expected that the behavior changed relative to older releases when a seed of zero is provided. The documentation indicates that zero should be a valid seed, but it was not being used (i.e. providing a seed of zero was equivalent to providing a seed of -1). This was part of the fix for #1635.
What is not expected, and is definitely a bug in the current version, is that using a seed of zero results in the same conformation always being generated. I'll fix that, thanks for reporting it.


doc: Currently installing on Python 3.11 does not work from pip/source with the given dependencies.

We should clearly state that currently only Python 3.10 is supported.

It is likely the source of #37 and #38 as well. I ran also into a similar issue when installing the specified version of scikit-image


Close HTTP response body and empty it to avoid resource leaks and make use of keep-alive

As per documentation:
When err is nil, resp always contains a non-nil resp.Body. Caller should close resp.Body when done reading from it.

Thanks for the contribution! Leaking those response bodies is definitely not good. I wrote this network code early in my Go career, and I'll more thoroughly refactor it to hold less response data in memory when I have some free time.
One quick comment:
I believe Go now finishes reading the bodies when the connection can be re-used:
https://golang.org/src/net/http/transfer.go#L924
https://golang.org/src/net/http/transfer.go#L670
So I think this is not necessary.

You are correct. That must be a fairly recent change, I remember it needing the full read to get keep-alive. I removed it.


[Bug]: this.ShinyOnCreate method not accessible from versions <IP_ADDRESS>06 on Xamarin.Android project

Component
Core (Settings, Startup)
What platform(s) are effected?

[ ] iOS 12
[ ] iOS 13
[ ] iOS 14
[ ] iOS 15
[X] Android 8
[X] Android 9
[X] Android 10
[X] Android 11
[X] Android 12
[ ] UWP (Sponsors ONLY)

Steps To Reproduce
Updated Shiny from <IP_ADDRESS>06 to <IP_ADDRESS>58/<IP_ADDRESS>60.
After update, this.ShinyOnCreate method (and all other methods from AndroidHooks) is no longer accessible on Xamarin.Android projects:
Xamarin.iOS project is working as expected.
Happens on all projects, including an empty project created from Prism template pack.
Expected Behavior
Methods should be accessible the same way they used to in previous versions.
Actual Behavior
Methods are no longer accessible.
Exception or Log output
No response
Code Sample

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Please review the release notes in the future (although the latest 2.3 should have been filed as 2.4).  https://shinylib.net/release-notes/v240
The major android target is now 11.

Thank you for the quick response.
We did check release notes, but GitHub is showing only 2.3, which is the reason why we missed on this:
https://github.com/shinyorg/shiny/releases
Issue has been resolved, keep up the excellent work!


[pybond] How to serialize object instances

In the old Bond I have a custom serializer that the json module invokes when it cannot serialize the object. Then I look for a special method toJSON, and if I find it then I serialize. What should we do in the new version?

I like objects having their own toJSON method, but it might be nice to additionally make it so you can specify a serializer in the test (though maybe formatter can take this role?). toJSON generally provides nice OOP-style encapsulation but if it's only for testing purposes then you're doing a small amount of production code pollution.
Is toJSON standard in Python (e.g. to_json is standard in Ruby because the json stdlib uses it)? If not then I don't feel quite as good about it

Unfortunately there is nothing standard for this purpose in Python. And you
are right that the formatter can play this role.
George.
On Tue, Oct 13, 2015 at 1:13 PM, Erik<EMAIL_ADDRESS>wrote:

I like objects having their own toJSON method, but it might be nice to
additionally make it so you can specify a serializer in the test (though
maybe formatter can take this role?). toJSON generally provides nice
OOP-style encapsulation but if it's only for testing purposes then you're
doing a small amount of production code pollution.
Is toJSON standard in Python (e.g. to_json is standard in Ruby because the
json stdlib uses it)? If not then I don't feel quite as good about it
—
Reply to this email directly or view it on GitHub
https://github.com/necula01/bond/issues/5#issuecomment-147838901.

We can also just call str() on the object as a default? And if you want something more expressive then you can specify it in the formatter?

I think that it is actually reasonable to write a to_json method on objects for the purpose of testing. It is true that it is in production code but this code really belongs in that class. Let's use the name "to_json" the same one for both Ruby and Python.

I had to bite this bullet for the project I just converted. I am using to_json. Let's use the same for Ruby.

Not yet sure how to do this in Ruby, since the built-in JSON serializer doesn't have the same option as Python for accepting a custom serializer. I will investigate further when I have a chance.

I thought that you said in a past message that the serializer will use
to_json if it exists.
George.
On Mon, Oct 19, 2015 at 2:09 PM, Erik<EMAIL_ADDRESS>wrote:

Not yet sure how to do this in Ruby, since the built-in JSON serializer
doesn't have the same option as Python for accepting a custom serializer. I
will investigate further when I have a chance.
—
Reply to this email directly or view it on GitHub
https://github.com/necula01/bond/issues/5#issuecomment-149348241.

Okay, that's true, I just got confused for a bit because to_json needs to have an argument. Things will work out of the box in Ruby; I'll update the documentation to reflect this.


Add maven dependency for gcloud NIO

Resolve google file system loading issues in mango-python.
Changes for mango-cli will be completed in a different PR.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/536/
Test PASSed.

The reads files don't contain the format the we quite expect -- here's a sample snippet for a bam file loaded in gfs:
 Row(readInFragment=1, contigName=None, start=None, oldPosition=None, end=None, mapq=None, readName=u'H06JUADXX130110:1:1101:10000:12522', sequence=u'TTTGATGAAGTTGCTTATCAGCTTAAGAAGCTTTTGGGCTGAGATGATGGGATTTTCTAGATATAGAATCATGTCATATGCAAACAAAGACAATTTGCTTACAGTCTTCCTATATGAATGCCTTTTACTTCTTTCTCTTGCCTGATTCCCCTGGTGGGAAGTTCCAATACTATGTTGAATAGGAGTGGTGAGAGAGGGCATTCTGAACTCTGCCAGTATTCAAAGTGAATGCTTCCAGCTATTGTGCATT', qual=u'>><@ABCB<@A@BBA@AAAB@?B@BA@BAABB@@@BAABBB?ABBCABCAACBA@ABBBBBCCBABCBCBCBCBBDCCDEEEDCDFE>DCDE=FABEEFAD@FDECCACEFDEDEEFFFEDDFBBD?BEDCFDADEDFACEEDCADDE(>BF?BEFDA:A>CCDDECC?CAABCA@B*>?7;5=;=################################################################', cigar=u'*', oldCigar=None, basesTrimmedFromStart=0, basesTrimmedFromEnd=0, readPaired=True, properPair=False, readMapped=False, mateMapped=False, failedVendorQualityChecks=False, duplicateRead=False, readNegativeStrand=False, mateNegativeStrand=False, primaryAlignment=True, secondaryAlignment=False, supplementaryAlignment=False, mismatchingPositions=None, origQual=None, attributes=u'RG:Z:C', recordGroupName=u'C', recordGroupSample=u'NA12878', mateAlignmentStart=None, mateContigName=None, inferredInsertSize=None),```

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/537/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/538/
Test PASSed.

I don't think we should add a jar to the repo. There can be a separate script that adds --packages with the jar if the user needs it

Adding a separate --packages would be ideal except that the NIO file readers rely on Guava 20.0+.
hadoop 2.6+ breaks with guava 17.0+ (https://github.com/bigdatagenomics/adam/blob/49cbdb72e7b4090d4b2840dc72d06b9c68618a3a/pom.xml#L600)
So using the shaded jar is the only way to prevent naming conflicts.
I don't believe we can shade using the --packages flag which is why I've added the jar in this repo.

where is the jar downloaded from?

https://oss.sonatype.org/content/repositories/releases/com/google/cloud/google-cloud-nio/0.22.0-alpha/google-cloud-nio-0.22.0-alpha-shaded.jar


utils: use typeof() in NGLI_SWAP()

Closing for now, MSVC does not support typeof, so better wait for c23 !


https GET request fails with "handshake failure"

Related to #1083, perhaps. Standard requests.get() for this particular site/page https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html results in:
>>> import requests
>>> requests.get('https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/api.py", line 55, in get
    return request('get', url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/api.py", line 44, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/adapters.py", line 385, in send
    raise SSLError(e)
requests.exceptions.SSLError: [Errno 1] _ssl.c:504: error:14077410:SSL routines:SSL23_GET_SERVER_HELLO:sslv3 alert handshake failure

Using request-toolbelt's SSLAdapter to try various ssl versions, they all fail, it would seem... see following tracebacks.
TLSv1:
>>> adapter = SSLAdapter('TLSv1')
>>> s = requests.Session()
>>> s.mount('https://', adapter)
>>> s.get('https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 395, in get
    return self.request('GET', url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/adapters.py", line 385, in send
    raise SSLError(e)
requests.exceptions.SSLError: [Errno 1] _ssl.c:504: error:14094410:SSL routines:SSL3_READ_BYTES:sslv3 alert handshake failure

SSLv3:
>>> adapter = SSLAdapter('SSLv3')
>>> s = requests.Session()
>>> s.mount('https://', adapter)
>>> s.get('https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 395, in get
    return self.request('GET', url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/adapters.py", line 385, in send
    raise SSLError(e)
requests.exceptions.SSLError: [Errno 1] _ssl.c:504: error:14094410:SSL routines:SSL3_READ_BYTES:sslv3 alert handshake failure

SSLv2:
>>> adapter = SSLAdapter('SSLv2')
>>> s = requests.Session()
>>> s.mount('https://', adapter)
>>> s.get('https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 395, in get
    return self.request('GET', url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/adapters.py", line 378, in send
    raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='docs.apitools.com', port=443): Max retries exceeded with url: /2014/04/24/a-small-router-for-openresty.html (Caused by <class 'socket.error'>: [Errno 54] Connection reset by peer)

Note the last one gives a Connection reset by peer error, which differs from the others, but I'm pretty sure SSLv2 isn't supported by the server anyhow.
For fun, I tried to pass through some more appropriate headers through on the last request as well:
>>> headers = {
...     'Accept': u"text/html,application/xhtml+xml,application/xml",
...     'User-Agent': u"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.131 Safari/537.36",
...     'Accept-Encoding': u"gzip,deflate",
...     'Accept-Language': u"en-US,en;q=0.8"
... }
>>> adapter = SSLAdapter('SSLv2')
>>> s = requests.Session()
>>> s.mount('https://', adapter)
>>> s.get('https://docs.apitools.com/2014/04/24/a-small-router-for-openresty.html', headers=headers)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 395, in get
    return self.request('GET', url, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/Users/jaddison/.virtualenvs/techtown/lib/python2.7/site-packages/requests/adapters.py", line 378, in send
    raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='docs.apitools.com', port=443): Max retries exceeded with url: /2014/04/24/a-small-router-for-openresty.html (Caused by <class 'socket.error'>: [Errno 54] Connection reset by peer)

No dice there either. Here's what the HTTPS connection info in Chrome on Mac looks like:

I'm not positive, but some googling indicates it's likely a cipher list issue, which is more urllib3, I think?
I tried to modify DEFAULT_CIPHER_LIST in pyopenssl, but started running into import errors. At this point it seemed like things were just broken, and there wasn't really a proper way to approach fixing this yet.
Version information:
OSX Mavericks
Python 2.7.5
OpenSSL 0.9.8y 5 Feb 2013 - (from python -c "import ssl; print ssl.OPENSSL_VERSION")
requests 2.2.1
requests-toolbelt 0.2.0
urllib3 1.8

Just want to chime in and say that I experienced this issue on OS X 10.9.5, Python 2.7.7 and OpenSSL 0.9.8zc.
I was able to fix my handshaking issue by:

Installing a newer-than-stock OpenSSL on my machine via brew install OpenSSL
Compiling and installing the cryptography package linked against the new OpenSSL (env ARCHFLAGS="-arch x86_64" LDFLAGS="-L/usr/local/opt/openssl/lib" CFLAGS="-I/usr/local/opt/openssl/include" pip install cryptography)
Installing requests with SNI support by doing pip install requests[security]

Thanks, @Microserf. I'm pretty much running the same specs (10.9.5, Python 2.7.6, OpenSSL 0.9.8zg) and this was my entire process for getting `requests

Is there a definitive answer on how to get this working on ubuntu? I'm running into this issue again, and it looks like the only answer here concerns how to get this working on a Mac.

OK, I may have just answered my own question.  I tried it on Ubuntu 15.10 and it still doesn't work with Python 2.7.10.
It works with Python 2.7 on Travis CI:
https://travis-ci.org/playing-se/swish-python

Got it to work now! I simply uninstalled pyOpenSSL:
pip uninstall pyOpenSSL

Maybe we should only pyopenssl.inject_into_urllib3() if Python version is less than 2.7.9? pyOpenSSL seems to break stuff on Ubuntu and Windows if Python version is 2.7.10.

PyOpenSSL should not be breaking anything. If it does, that's a bug that should be reported.

I will have to look into this, but is there any good reason to inject pyopenssl into urllib3 if Python version is 2.7.9 or newer?
I am thinking of something like this:
# Check if Modern SSL with SNI support
try:
    from ssl import SSLContext
    from ssl import HAS_SNI
except ImportError:
    # Attempt to enable urllib3's SNI support, if possible
    try:
        from .packages.urllib3.contrib import pyopenssl
        pyopenssl.inject_into_urllib3()
    except ImportError:
        pass

Yeah, frequently there is. For example, on OS X most Pythons link against the system OpenSSL, which is version 0.9.8zg. PyOpenSSL, however, will link against a much newer OpenSSL (1.0.2). That makes using PyOpenSSL a substantial security improvement.
Additionally, PyOpenSSL gives us much better access to OpenSSL, allowing us to secure it more effectively.

OK, I have played around a with this a little now.
It WORKS with pyopenssl BUT not if ndg-httpsclient is installed.
Hover, I can get it work with ndg-httpsclient if I uninstall pyasn1 giving me these warnings:
/usr/lib/python2.7/dist-packages/ndg/httpsclient/subj_alt_name.py:22: UserWarning: Error importing pyasn1, subjectAltName check for SSL peer verification will be disabled.  Import error is: No module named pyasn1.type
  warnings.warn(import_error_msg)
/usr/lib/python2.7/dist-packages/ndg/httpsclient/ssl_peer_verification.py:25: UserWarning: SubjectAltName support is disabled - check pyasn1 package installation to enable
  warnings.warn(SUBJ_ALT_NAME_SUPPORT_MSG)
/usr/lib/python2.7/dist-packages/ndg/httpsclient/subj_alt_name.py:22: UserWarning: Error importing pyasn1, subjectAltName check for SSL peer verification will be disabled.  Import error is: No module named pyasn1.type
  warnings.warn(import_error_msg)

Same behavior on Ubuntu 15.10 and Windows 10 with Python 2.7.10 installed.

That's because without ndg-httpsclient the PyOpenSSL support isn't used.

Yes, I will have to dig into why it works if SubjectAltName is disabled. Any idea?

Almost certainly the problem is that you're using different OpenSSLs in each case.

I had the same issue on my Ubuntu 14.04 box and Python 2.7.11
It's from SNI
What worked for me was this:

uninstall requests
uninstall urllib3
install the various crypto dependencies
install urllib3
install urllib3[secure] # just to be safe
install requests

I think there was an installation-time check on urllib3 or requests which kept things from working without the uninstall

@jvanasco what are you using to install those packages? I assume pip. Why are you installing urllib3 and requests separately?

Well I needed urllib3 in the virtualenv... but I installed it to try and get the requirements installed by pip and easy_install.  (I used both)
I have a web indexer and a few urls broke.  I wrote a quick script to try the broken ones, and kept reinstalling/delete+installing the packages in the urllib3 instructions on ssl issues until they worked.
On May 31, 2016, at 7:25 PM, Ian Cordasco<EMAIL_ADDRESS>wrote:
@jvanasco what are you using to install those packages? I assume pip. Why are you installing urllib3 and requests separately?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.￼

I'm still seeing this issue and i've tried the suggested work arounds.
I updated my python version to 2.7.11
I installed the 3 additional packages.
I tried the uninstall/install sequence @jvanasco  suggested and still got the SSLError
Also using Ubuntu 14.04 unfortunately there's no OpenSSL update so i have to use the workarounds posted here and i'm having no luck.
Any extra steps you guys possibly took?
Thanks

@Lekinho I found that making a short test-script that tested the domain I was having problems with helped.
it was just:
 import requests
 r = requests.get(bad_url)
 print r.__dict__

@Lekinho You can extract pyopenssl from requests in your code:
try:
    from requests.packages.urllib3.contrib import pyopenssl
    pyopenssl.extract_from_urllib3()
except ImportError:
    pass

@Lekinho If you're still encountering this problem with Python 2.7.11 it's highly likely that the remote server doesn't support the TLS settings being used by requests. Is the server in question available on the public internet? If so, can you provide me with the URL?

i've tried the pyopenssl import as suggested.
Unfortunately this is not accessible publicly.
However I have the exact details of what openSSL version the server has.
Basically, we run on a redhat virtual machine, I had this openSSL when everything was working : openssl-1.0.1e-42.el6_7.4.x86_64
Then we did a redhat upgrade and there was an update for openssl : openssl-1.0.1e-48.el6_8.1.x86_64
This version always has the bad handshake issue when using openssl on ubuntu 14.04.
Do you guys have any public URLs i can try with, to see if the work arounds helped resolve the issue and its just this unique combination that I have that's the problem?
The same machine is fine when REST requests are sent through the browser(i.e. without the ubuntu openssl )
Thanks

Can you provide the output of rpm -q --changelog openssl, please?

It looks like @Lekinho deleted their github account?  For the next person who has issues - it's possible that their upgrade of OpenSsl or Python broke some compiled c bindings.  Whenever I have an upgrade like that, I trash my virtualenv or all packages and then build a new one.

Have the same issue... ARG...

@lukas-gitl frustration will not help you solve the problem. Providing us with information about your environment (preferably some - if not all - of the information that we asked Lekinho above) will help.

@sigmavirus24 Apologies. I meant to provide more information and then got side tracked (since I had no time for this). I'm using Ubuntu 14.04, python 2.7.6 and the latest requests version on pip. This happens when I try to access as API Gateway endpoint (they might be quite restrictive).
I tried removing the virtualenv and regenerating it but unfortunately that didn't solve it.
Let me know what else you need. I switched to nodejs for the time but would be happy to help with a resolution.

@lukas-gitl It's highly likely that the server you're contacting requires ciphers you aren't offering, or TLS versions you aren't offering. This can be related to the OpenSSL you have installed. You should also try running pip install requests[security]: you may be encountering problems with SNI.

Yeah, I already tried that too. Let me put a quick test script together here so we are on the same page.

virtualenv -p /usr/bin/python2.7 env
source env/bin/activate
pip install requests
pip install requests[security]
echo 'import requests' >> test.py
echo 'requests.get("https://API_ID.execute-api.us-west-2.amazonaws.com/ENV/ENPOINT")' >> test.py
python test.py

And what specific error are you seeing?

.../env/local/lib/python2.7/site-packages/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
SNIMissingWarning
.../env/local/lib/python2.7/site-packages/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
Traceback (most recent call last):
File "test.py", line 2, in
requests.get("https://sbsz8eqowe.execute-api.us-west-2.amazonaws.com/dev/segment_to_s3_webhook")
File ".../env/local/lib/python2.7/site-packages/requests/api.py", line 71, in get
return request('get', url, params=params, **kwargs)
File ".../env/local/lib/python2.7/site-packages/requests/api.py", line 57, in request
return session.request(method=method, url=url, **kwargs)
File ".../env/local/lib/python2.7/site-packages/requests/sessions.py", line 475, in request
resp = self.send(prep, **send_kwargs)
File ".../env/local/lib/python2.7/site-packages/requests/sessions.py", line 585, in send
r = adapter.send(request, **kwargs)
File ".../env/local/lib/python2.7/site-packages/requests/adapters.py", line 477, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: [Errno 1] _ssl.c:510: error:14077410:SSL routines:SSL23_GET_SERVER_HELLO:sslv3 alert handshake failure

So I'm basically required to update to a later version of python?

Ok, both of those warnings suggest that your requests is not actually using the extensions from requests[security]. It strongly suggests that whatever Python you are executing is not the one you installed in your virtual environment: the requests[security] extension should remove those warnings.

Ok, now I'm really confused. The error message are coming from the virtual environment. So how could those come from there while I execute from a different python environment?

So I tried pip install pyopenssl ndg-httpsclient pyasn1 instead of pip install requests[security] and that worked...

Aha, I suspect your pip is too old to handle the extras.

Ah, damn. That explains a lot. Thank you very much for your help!

I encountered the same trouble here, I was to send a GET request by following code:
requests.get('https://mdskip.taobao.com/core/initItemDetail.htm?itemId=530444505608&showShopProm=false&queryMemberRight=true&isRegionLevel=false&tmallBuySupport=true&addressLevel=2&sellerPreview=false&isForbidBuyItem=false&cachedTimestamp=1466835924196&offlineShop=false&household=false&tryBeforeBuy=false&isSecKill=false&service3C=false&isApparel=true&isUseInventoryCenter=false&cartEnable=true&isAreaSell=false&callback=setMdskip&timestamp=1466841669969&isg=Al9faN3XWRpIf6UEoQ88UH/1b7np0rNm&ref=https%3A%2F%2Fs.taobao.com%2Fsearch%3Fq%3D%25E6%258B%2589%25E5%25A4%258F%25E8%25B4%259D%25E5%25B0%2594%26imgfile%3D%26commend%3Dall%26ssid%3Ds5-e%26search_type%3Ditem%26sourceId%3Dtb.index%26spm%3Da21bo.50862.201856-taobao-item.1%26ie%3Dutf8%26initiative_id%3Dtbindexz_20160625')
unfortunately I was given the error info:
Traceback (most recent call last):   File "<stdin>", line 1, in <module>   File "/Library/Python/2.7/site-packages/requests/api.py", line 71, in get     return request('get', url, params=params, **kwargs)   File "/Library/Python/2.7/site-packages/requests/api.py", line 57, in request     return session.request(method=method, url=url, **kwargs)   File "/Library/Python/2.7/site-packages/requests/sessions.py", line 475, in request     resp = self.send(prep, **send_kwargs)   File "/Library/Python/2.7/site-packages/requests/sessions.py", line 585, in send     r = adapter.send(request, **kwargs)   File "/Library/Python/2.7/site-packages/requests/adapters.py", line 477, in send     raise SSLError(e, request=request) requests.exceptions.SSLError: ("bad handshake: Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'sslv3 alert handshake failure')],)",)
I tried to brew install openssl, brew upgrade openssl, pip install --upgrade pip, pip install requests, pip install request[security], but they didn't work.
However when I type openssl version I got OpenSSL 0.9.8zh 14 Jan 2016, I don't know if it's all right.
Is there anyone who could help me with it?

@jschwinger23 Can you run pip install pyopenssl ndg-httpsclient pyasn1 as well please?

@Lukasa Thanks for your reply. I reconfirmed that I did install them:
$ pip install pyopenssl ndg-httpsclient pyasn1 Requirement already satisfied (use --upgrade to upgrade): pyopenssl in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python Requirement already satisfied (use --upgrade to upgrade): ndg-httpsclient in /Library/Python/2.7/site-packages Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /Library/Python/2.7/site-packages
but code still down.
Anyway, I figured out that everything goes well in Python3, and I am glad to be able to code in python3.
Thank you very much.

I get
sudo pip install requests[security]
zsh: no matches found: requests[security]

any ideas?

Followed above instructions but still running into this issue
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Library/Python/2.7/site-packages/requests/api.py", line 71, in get
    return request('get', url, params=params, **kwargs)
  File "/Library/Python/2.7/site-packages/requests/api.py", line 57, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 475, in request
    resp = self.send(prep, **send_kwargs)
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 585, in send
    r = adapter.send(request, **kwargs)
  File "/Library/Python/2.7/site-packages/requests/adapters.py", line 477, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: ("bad handshake: Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'sslv3 alert handshake failure')],)",)```

any ideas?

@rohanpai It is likely that you have either no cipher overlap, or that the remote server is unhappy with the versions you're offering, or that you're expected to provide a client cert and are not. It's hard to give more specific advice. Try this to investigate the issue.

On ubuntu 14.04LTS I needed to do this:
sudo pip install  ndg-httpsclient pyasn1 --upgrade
Note that in Ubuntu it's not possible to upgrade/remove pyopenssl as it's owned by the OS.

markstrefford's solution worked for me on mac os sierra too

@markstrefford 's solution also worked for me.

Just a heads up for anyone using OpenSSL 1.1:
You'll run into this issue as well, even when forcing TLS adapters, when the remote server offers Elliptic Curves as the first option.
The cause is: http://bugs.python.org/issue29697

Hey guys! I'm having the same issue with the following server https://<IP_ADDRESS>/SID/Service.svc?wsdl. I've tried everything and I jump from and to the same 2 errors:

requests.exceptions.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)
requests.exceptions.SSLError: EOF occurred in violation of protocol (_ssl.c:661)

Any ideas? @Lukasa, I see a few issues with the Certificate, but seems like it shouldn't be that bad: https://sslanalyzer.comodoca.com/?url=<IP_ADDRESS>

The certificate won't usually cause this problem: this problem is caused by the server hanging up on us, so usually it's the result of a cipher suite mismatch. In this case, that's exactly what's going on as you can see here.
This is a server that, frankly, should never be exposed to the open internet. There are no secure methods of communicating with this server: none, zero. This is why the handshake fails: Requests only accepts modern cipher suites, and there are no modern cipher suites available to this server. The best option is TLS_RSA_WITH_3DES_EDE_CBC_SHA, an option we removed because it is vulnerable to practical attacks on large-scale data transfer.
If this server is yours, please upgrade it to a better TLS implementation or change the settings. Otherwise, my first bit of advice is to reconsider ever speaking to this server. If you must, then you can use the code here, but I strongly recommend that you put pressure on the server operator to fix this mess.

@Lukasa -- thanks for working through this with everyone! Ive read through and tried most of this
Issue
When running script on Windows it all works.
When running script on OSX receive:
raise SSLError(e, request=request)
requests.exceptions.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)

Im not convinced it is not the server itself, but would appreciate any additional help to confirm and/or pop me out of this rabbit hole. Would be a huge win to get it to work.
OSX specifics:

Python Python 2.7.10
OpenSSL OpenSSL 1.1.1-dev  xx XXX xxxx (compiled via GitHub)
using PIP to install

Attempts made

uninstalled pyopenssl, requests, requests[security], cryptography
installed against env ARCHFLAGS="-arch x86_64" LDFLAGS="-L/usr/local/opt/openssl/lib" CFLAGS="-I/usr/local/opt/openssl/include" pip install --force-reinstall --no-cache-dir {PACKAGE}

I am not 100% sure that installing against the openssl actually did anything, as it seemed to act the same as installing without (such as, speed and messaging all appeared the same)
As directed in another thread (above) connecting directly via openSSL appears to be happy?
openssl s_client -connect XXX.102.7.147:443
CONNECTED(00000003)
write:errno=0
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 0 bytes and written 198 bytes
Verification: OK
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    Protocol  : TLSv1.2
    Cipher    : 0000
    Session-ID:
    Session-ID-ctx:
    Master-Key:
    PSK identity: None
    PSK identity hint: None
    SRP username: None
    Start Time:<PHONE_NUMBER>
    Timeout   : 7200 (sec)
    Verify return code: 0 (ok)
    Extended master secret: no
---

Uh...OpenSSL is technically fine, but that OpenSSL negotiated no cipher (that is, it appears to have negotiated SSL_NULL_WITH_NULL_NULL. Can you run ssllabs against your server and check what cipher suites it supports?

@Lukasa Its not exposed on the internet, is there some command line probe that I could fire off that could provide adequate insight for you?

You could try cipherscan.

@Lukasa got it installed ... its acting wonky (no output, watching it) ... will post back if I come up with anything that could be passed along. Thanks for the guidance!

@Lukasa thanks so much for your help - never actually got cipherscan working - but corrected our issues. It had nothing to do with any of this, and was a silly IP mismatch across our environments ... lessons learned! thank you ...

No problem at all, glad you got it sorted!

I'm using python 3.5 on windows and I get The following Error while trying to send a head or get request to a webpage:
Here is my Traceback:

Traceback (most recent call last):
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\contrib\pyopenssl.py", line 436, in wrap_socket
cnx.do_handshake()
File "C:\Users\aran\Anaconda3\lib\site-packages\OpenSSL\SSL.py", line 1426, in do_handshake
self._raise_ssl_error(self._ssl, result)
File "C:\Users\aran\Anaconda3\lib\site-packages\OpenSSL\SSL.py", line 1166, in _raise_ssl_error
raise SysCallError(errno, errorcode.get(errno))
OpenSSL.SSL.SysCallError: (10060, 'WSAETIMEDOUT')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\connectionpool.py", line 600, in urlopen
chunked=chunked)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\connectionpool.py", line 345, in _make_request
self._validate_conn(conn)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\connectionpool.py", line 844, in validate_conn
conn.connect()
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\connection.py", line 326, in connect
ssl_context=context)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\util\ssl.py", line 324, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\contrib\pyopenssl.py", line 443, in wrap_socket
raise ssl.SSLError('bad handshake: %r' % e)
ssl.SSLError: ("bad handshake: SysCallError(10060, 'WSAETIMEDOUT')",)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\adapters.py", line 423, in send
timeout=timeout
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\packages\urllib3\connectionpool.py", line 630, in urlopen
raise SSLError(e)
requests.packages.urllib3.exceptions.SSLError: ("bad handshake: SysCallError(10060, 'WSAETIMEDOUT')",)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "Z:/my files/projects/programing/python/courseAssist/ce_course_crawler.py", line 137, in
response = requests.get('https://sites.google.com/a/aims-senegal.org/scipy/roots-finding-numerical-integrations-and-differential-equations')
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\api.py", line 70, in get
return request('get', url, params=params, **kwargs)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\api.py", line 56, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\sessions.py", line 488, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\sessions.py", line 609, in send
r = adapter.send(request, **kwargs)
File "C:\Users\aran\Anaconda3\lib\site-packages\requests\adapters.py", line 497, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: ("bad handshake: SysCallError(10060, 'WSAETIMEDOUT')",)

And Here is my code:
response = requests.head(https://sites.google.com/a/aims-senegal.org/scipy/roots-finding-numerical-integrations-and-differential-equations)

streamlink -l debug httpstream://https://www.arconaitv.us/stream.php?id=43 worst
[cli][info] streamlink is running as root! Be careful!
[cli][debug] OS:         Linux-4.14.0-041400-generic-x86_64-with-Ubuntu-14.04-trusty
[cli][debug] Python:     2.7.6
[cli][debug] Streamlink: 0.13.0+27.g2ff314c
[cli][debug] Requests(2.19.1), Socks(1.6.7), Websocket(0.48.0)
[cli][info] Found matching plugin http for URL httpstream://https://www.arconaitv.us/stream.php?id=43
[plugin.http][debug] URL=https://www.arconaitv.us/stream.php?id=43; params={}
[cli][info] Available streams: live (worst, best)
[cli][info] Opening stream: live (http)
[cli][debug] Pre-buffering 8192 bytes
[cli][info] Starting player: /usr/bin/vlc
[cli][debug] Writing stream to output
[cli][info] Stream ended
[cli][info] Closing currently open stream..
tried  but no luck

Hi @maanich, this doesn’t appear to be directly related to this issue, or to be a defect report for Requests which is what this issue tracker is reserved for. If you have questions about system configuration, those will be best addressed on a platform like StackOverflow. Thanks!

streamlink --https-proxy  "http://8xxxx:8000/" --tvplayer-email<EMAIL_ADDRESS>--tvplayer-password vcvdf3 --http-no-ssl-verify https://tvplayer.com/watch/itv best --player-no-close --stdout | /var/tmp/youtube/ffmpeg -y -i pipe:0 -vcodec copy -acodec copy -flags -global_header -hls_flags delete_segments -hls_time 10 -hls_list_size 6 /mnt/hls/arc.m3u8
ffmpeg version 4.0-static https://johnvansickle.com/ffmpeg/  Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 6.3.0 (Debian 6.3.0-18+deb9u1) 20170516
configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-6 --enable-libxml2 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg
libavutil      56. 14.100 / 56. 14.100
libavcodec     58. 18.100 / 58. 18.100
libavformat    58. 12.100 / 58. 12.100
libavdevice    58.  3.100 / 58.  3.100
libavfilter     7. 16.100 /  7. 16.100
libswscale      5.  1.100 /  5.  1.100
libswresample   3.  1.100 /  3.  1.100
libpostproc    55.  1.100 / 55.  1.100
[console][info] streamlink is running as root! Be careful!
[console][info] Found matching plugin tvplayer for URL https://tvplayer.com/watch/itv
error: Unable to open URL: https://live.tvplayer.com/stream.m3u8?id=204&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cCo6XC9cL2xpdmUudHZwbGF5ZXIuY29tXC9zdHJlYW0ubTN1OD9pZD0yMDQiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1MjkwNTc0OTR9LCJJcEFkZHJlc3MiOnsiQVdTOlNvdXJjZUlwIjoiNjIuMjEwLjE0Mi42NlwvMzIifX19XX0_&Signature=mHOteYcUu4QsbGDn0e~7meDUGT8VN7bVOBAHa-0Mk6ROA9XHYx3aIAZMAo3dFjOGuWk-3MszJzRFHdv~-CCsmX3D8XQa2zvzfuIWfMAT~yDshroXBN25iW6ZJ0-7lGla00jMTUpm5sW-uDy18OkiBWgGvDVas2Lz-EW~5-LTw2YWvEpqkvRB9OpcsHJj9RRQLuDVjwYKXwKvHTJmB1J~sGE3aigaL7AZyBaIAUMcpk-xYMpDuPV9BsBN9AT397lFfRPFt155u~yeBHZ4JlUN2GINUBt0-CzGuYVq3dsOkYYEZJo9cQTVhArpo7ek03VbDP5egtCM8obN63AEkA__&Key-Pair-Id=APKAJGWDVCU5SXAPJELQ (403 Client Error: Forbidden)
pipe:0: Invalid data found when processing input
advice please n what proxy server is good for streamlink if any


Support Windows agents in SAVE-cloud cluster

Right now the save-agent is build with Linux64 target.
This sometimes leads to a confusion: some of tools that we can check can be native applications built for Windows.
In this case it is very important to be able to run container with an agent on Windows.
Probably it can be linked with Kubernetes related tasks, @petertrr? or it can be solved by docker only?

No way, neither Docker nor Kubernetes will support this out of the box. This would require a container runtime that runs a virtual machine and still has the same interface as usual CRI compliant container. Moreover, running a VM will require additional setup for system components and maybe even some restrictions on hardware. I'm not familiar with technologies that combine VMs and containers, but I'm sure those exist.

Oh, my bad, of course Docker does not support Windows host.
Never will be implemented. But may be there will be some VMs one day for such purposes...

Won't be done


PubSub - Error message on subscription.close()

Python version: 2.7.14
API Client version: 0.33.0
While closing a subscription, the following message is printed to stderr but no exception is thrown:
ERROR:root:Exception serializing message!
Traceback (most recent call last):
  File "/miniconda/lib/python2.7/site-packages/grpc/_common.py", line 87, in _transform
    return transformer(message)
TypeError: descriptor 'SerializeToString' requires a 'google.protobuf.pyext._message.CMessage' object but received a 'UUID'

Recreated by creating a topic+subscription and running the following script:
import google.cloud.pubsub

sub_client = google.cloud.pubsub.SubscriberClient()
sub_name = sub_client.subscription_path('[PROJECT]', '[SUBSCRIPTION]')

sub = sub_client.subscribe(sub_name)
sub.open(lambda x: x.ack())
sub.close()

Hrm, I haven't been able to reproduce this. Does this happen consistently for you?

Ah okay, I got it reproduced. Will investigate.


Finalize schema vs schemata naming structure

We need to be clear about when to use the word schema vs schemata. We should also add a glossary that documents this.

Conventions

schemata = file or full file contents

schemata, _schemata_manager
dataset_schemata, dataset_schemata_file, DATASET_SCHEMATA_URL

schema & schemas = partial file contents

dataset_schemas, license_schemas, format_schemas
dataset_schema, gmb_schema, subdataset_schema

_config.py

DATASET_SCHEMA_URL → DATASET_SCHEMATA_URL
FORMAT_SCHEMA_URL → FORMAT_SCHEMATA_URL
LICENSE_SCHEMA_URL → LICENSE_SCHEMATA_URL

schema_retrieval.py

retrieve_schema_file → retrieve_schemata_file

_schema.py

Schema → BaseSchemata

_schema
_load_retrieved_schema

DatasetSchema → DatasetSchemata
FormatSchema → FormatSchemata
LicenseSchema → LicenseSchemata
SchemaManager → SchemataManager

add_schema → add_schemata

_high_level.py

_schemata → _schemata_manager
export_schemata → export_schemata_manager

export_schemata() → schemata_manager
return export_schemata()

_get_schemata - > _get_schemata_manager

_get_schemata() → schemata_manager

How do we want to handle SchemaDict which is also being used for schemata?

Decided to leave SchemaDict the way it and let it be a custom type for both schemata and schema scenarios

Do we rename _schema.py to _schemata.py?

Decided to leave this file named the way it is in case we add more schema functionality to it in the future


Use static images for Ember

Overview

Uses ember build to deploy static assets behind nginx
Bakes in relative URIs to ember build config

To test:

docker-compose pull (the ember image is pushed)
docker-compose up
Once up, go to https://pass

Known issues

It is desired to put ember at /app rather than /.  This cannot happen until OA-PASS/pass-ember#526 is resolved.  Until then, this retains the current behavior of having ember at /
We need to add static PASS content to pass-docker at some point.  This is out of scope of this PR

Resolves #44

@birkland those admin user request seem to be for [object Object] so if one is fixed probably the other will be too.


Add basename support for crawl mode

👋
I tried out the new crawl mode today, and it's awesome!
My app uses basename with React Router to handle deployment to GitHub pages, so my routes look like /about, but the deployed URLs look like username.github.io/project-name/docs/about. This broke the crawler, understandably. It generated the pages but put all of them after the index in a nested subdirectory that matched the basename.
This change lets you pass in a basename so that the crawler will disregard it, and all of the pages get built correctly. If you're interested in something like this let me know and I can add some tests.

Coverage decreased (-0.9%) to 99.107% when pulling 7a6e5928e38e6b48502fabff3db0d91f15a5bca4 on alexlande:feature-basenameCrawling into 09001fe4ba442c43a747e5162fbac37e5cb0ddf2 on markdalgleish:master.


bugfix the definition number should consistent with master branch

Proposed changes
introduced by pr https://github.com/apache/doris/pull/35103

run buildall


exe doesnt work for me

Describe the bug
when I open the exe, the exe opens normally but nothing happens in discord I Have all intents on but the bot is offline, And I didnt add the folder name because idk what it is if someone could tell me and I also get an error when compiling
Screenshots

OS: [, Windows 10]
Python Version: [e.g. 3.11.5] latest version

If someone could help I would apppreciate it thanks

UPDATE : OK so i understand the folder is the path so after putting the path and executing a new exe file i get this message

Which path? Can you tell me?

Yeah I added The path C:\Temp


(PDB-3359) fix regex queries on nested resource params

Corrects an issue where resource parameters specified via dot notation
could not be queried via regex.

Test PASSed

CLA signed by all contributors.

reopened under the correct name https://github.com/puppetlabs/puppetdb/pull/2218


rstudio and r-sjplot-feedstock

Comment:
Hello - I'm having trouble installing r-sjplot-feestock and rstudio in the same anaconda environment?
Its showing unsolvable conflicts - I'm using Windows 10.

Currently, I would not recommend Windows users to install RStudio through Conda. The only build that is available (from defaults channel) is restricted to R 3.x.  If you are okay with that, then the following appears sufficient to co-install:
mamba create -n foo -c conda-forge -c defaults -c msys2 rstudio r-sjplot

This resolves to R 3.6.3 and sjplot v2.8.8.
Conda Forge does have a newer RStudio build (rstudio-desktop), but currently it does build for win-64.
If you would like it built for Windows, I'd encourage you to file an issue on the conda-forge/rstudio-feedstock requesting it.

So, what do I recommend in practice? Install a standalone version of RStudio, then launch it from the Conda R environment you wish to use with it. Something along these lines is outlined in this StackOverflow thread.

@andreifoldes sounds like you still have an issue, so I'm reopening this. Could you please add debugging info about the setup that fails? Helpful things are:

output of conda list from the environment
output of conda info
exact commands leading to issue (environment activation, launching of RStudio, R commands)
error output

Closing as stale.


Integration test running in ~1min

Runs in ~1min on 2 cores of Intel(R) Core(TM) i7-3740QM CPU @ 2.70GHz, for issue #40.
Integration test passed on CircleCI in 1min 28s.
If this pull request is accepted my username on numer.ai is sovaa.

concordance checked locally using methods from the module, skipping upload to server
only first 50% of features used (doesn't seem to hurt concordance)
using solver sag insted of liblinear since liblinear can't be parallelized with n_jobs
using xgboost instead of gradiantboosting from sklearn since it's same principle but much faster
removed AdaBoostClassifier since no base_estimator was chosen, and the default is DecisionTreeClassifier which was already in the list
not using KNN, took magnitudes longer to predict than others
save to csv and check concordance asynchronously
only doing half the permutations for mixing predictions to test failing concordance; and not doing double-check for clf1+clf2 then later clf2+clf1

Seems more worth to first refactoring the submission-criteria module to decouple the managers and db connections from the business logic to allow setting and in-memory db for the tests via SqlAlchemy than to try to monkey patch the current code. Thus the wrapper; it bypasses the http calls and uses the existing methods in the module as much as is possible, though it's now more of a functional test than an integration test. Running this kind of exhaustive integration test against an actual database over the network won't really give us any benefits compared to being able to inject an in-memory database for submission-criteria and a "mock handler" for NumerAPI to call the mock the requests directly to the relevant endpoints instead of doing an actual http call.
$ time python tests/integration_test.py
/home/scorch/miniconda3/envs/subcrit2/lib/python3.6/site-packages/sklearn/cross_validation.py:41: DeprecationWarning: This module was deprecated in version 0.18 in favor of the model_selection module into which all the refactored classes and functions are moved. Also note that the interface of the new CV iterators are different from that of this module. This module will be removed in 0.20.
  "This module will be removed in 0.20.", DeprecationWarning)
2017-12-04 07:11:46,063 INFO integration_test: Found old data to use.
2017-12-04 07:11:53,865 INFO root: New competition, clustering dataset
2017-12-04 07:11:57,323 INFO root: Finished clustering
2017-12-04 07:12:03,208 INFO integration_test: fit() took 5.83s     (RandomForestClassifier)
2017-12-04 07:12:11,756 INFO integration_test: fit() took 14.37s    (XGBClassifier)
2017-12-04 07:12:13,525 INFO integration_test: fit() took 10.32s    (DecisionTreeClassifier)
2017-12-04 07:12:13,794 INFO integration_test: fit() took 0.27s     (GaussianNB)
2017-12-04 07:12:14,957 INFO integration_test: fit() took 1.16s     (QuadraticDiscriminantAnalysis)
2017-12-04 07:12:22,456 INFO integration_test: fit() took 10.70s    (MLPClassifier)
2017-12-04 07:12:27,545 INFO integration_test: fit() took 12.59s    (LogisticRegression)
2017-12-04 07:12:27,546 INFO integration_test: await fitting took 30.16s
2017-12-04 07:12:27,546 INFO integration_test: all clfs fit() took 30.17s
2017-12-04 07:12:27,800 INFO integration_test: predict_proba() took 0.25s     (tests/test_csv/RandomForestClassifier-legit.csv)
2017-12-04 07:12:27,801 INFO integration_test: predict_proba() took 0.25s     (tests/test_csv/XGBClassifier-legit.csv)
2017-12-04 07:12:28,022 INFO integration_test: predict_proba() took 0.22s     (tests/test_csv/DecisionTreeClassifier-legit.csv)
2017-12-04 07:12:28,308 INFO integration_test: predict_proba() took 0.50s     (tests/test_csv/MLPClassifier-legit.csv)
2017-12-04 07:12:29,184 INFO integration_test: predict_proba() took 1.16s     (tests/test_csv/GaussianNB-legit.csv)
2017-12-04 07:12:29,338 INFO integration_test: predict_proba() took 0.13s     (tests/test_csv/LogisticRegression-legit.csv)
2017-12-04 07:12:29,511 INFO integration_test: predict_proba() took 1.20s     (tests/test_csv/QuadraticDiscriminantAnalysis-legit.csv)
2017-12-04 07:12:29,554 INFO integration_test: await legit predictions took 2.01s
2017-12-04 07:12:29,554 INFO integration_test: all legit clfs predict_proba() took 2.01s
2017-12-04 07:12:36,086 INFO integration_test: pred mix took  4.69s      (tests/test_csv/RandomForestClassifier-XGBClassifier-mix.csv)
2017-12-04 07:12:36,138 INFO integration_test: pred mix took  4.72s      (tests/test_csv/RandomForestClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:37,481 INFO integration_test: pred mix took  1.39s      (tests/test_csv/XGBClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:37,486 INFO integration_test: await mix predictions took 6.04s
2017-12-04 07:12:37,509 INFO integration_test: all mix clfs predict_proba() took 7.95s
2017-12-04 07:12:40,467 INFO integration_test: await legit uploads took 2.95s
2017-12-04 07:12:41,774 INFO integration_test: write csv took 5.12s      (tests/test_csv/RandomForestClassifier-XGBClassifier-mix.csv)
2017-12-04 07:12:42,026 INFO integration_test: write csv took 4.03s      (tests/test_csv/XGBClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:42,113 INFO root: Noticed score 0.03232624037022035
2017-12-04 07:12:42,175 INFO root: Noticed score 0.026764304225627433
2017-12-04 07:12:42,197 INFO integration_test: write csv took 5.49s      (tests/test_csv/RandomForestClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:42,207 INFO integration_test: await mix uploads took 1.74s
2017-12-04 07:12:44,368 INFO root: Noticed score 0.039570871223514235
2017-12-04 07:12:44,376 INFO root: Noticed score 0.039130790224112415
2017-12-04 07:12:46,523 INFO root: Noticed score 0.032856826039064826
2017-12-04 07:12:46,540 INFO root: Noticed score 0.041891372103993726
2017-12-04 07:12:48,596 INFO root: Noticed score 1.0
2017-12-04 07:12:48,601 INFO root: Noticed score 0.03577434137578774
2017-12-04 07:12:50,682 INFO root: Noticed score 1.0
2017-12-04 07:12:50,698 INFO root: Noticed score 1.0
2017-12-04 07:12:50,702 INFO integration_test: all legit tests passed!
2017-12-04 07:12:50,702 INFO integration_test: all mix tests passed!

real	1m6.915s
user	1m28.828s
sys	0m8.353s

Using a wrapper for the api to calculate the concordance locally instead of having to upload hundreds of MB each time:
$ time python tests/integration_test.py
/home/scorch/miniconda3/envs/subcrit2/lib/python3.6/site-packages/sklearn/cross_validation.py:41: DeprecationWarning: This module was deprecated in version 0.18 in favor of the model_selection module into which all the refactored classes and functions are moved. Also note that the interface of the new CV iterators are different from that of this module. This module will be removed in 0.20.
  "This module will be removed in 0.20.", DeprecationWarning)
2017-12-04 07:11:46,063 INFO integration_test: Found old data to use.
2017-12-04 07:11:53,865 INFO root: New competition, clustering dataset
2017-12-04 07:11:57,323 INFO root: Finished clustering
2017-12-04 07:12:03,208 INFO integration_test: fit() took 5.83s     (RandomForestClassifier)
2017-12-04 07:12:11,756 INFO integration_test: fit() took 14.37s    (XGBClassifier)
2017-12-04 07:12:13,525 INFO integration_test: fit() took 10.32s    (DecisionTreeClassifier)
2017-12-04 07:12:13,794 INFO integration_test: fit() took 0.27s     (GaussianNB)
2017-12-04 07:12:14,957 INFO integration_test: fit() took 1.16s     (QuadraticDiscriminantAnalysis)
2017-12-04 07:12:22,456 INFO integration_test: fit() took 10.70s    (MLPClassifier)
2017-12-04 07:12:27,545 INFO integration_test: fit() took 12.59s    (LogisticRegression)
2017-12-04 07:12:27,546 INFO integration_test: await fitting took 30.16s
2017-12-04 07:12:27,546 INFO integration_test: all clfs fit() took 30.17s
2017-12-04 07:12:27,800 INFO integration_test: predict_proba() took 0.25s     (tests/test_csv/RandomForestClassifier-legit.csv)
2017-12-04 07:12:27,801 INFO integration_test: predict_proba() took 0.25s     (tests/test_csv/XGBClassifier-legit.csv)
2017-12-04 07:12:28,022 INFO integration_test: predict_proba() took 0.22s     (tests/test_csv/DecisionTreeClassifier-legit.csv)
2017-12-04 07:12:28,308 INFO integration_test: predict_proba() took 0.50s     (tests/test_csv/MLPClassifier-legit.csv)
2017-12-04 07:12:29,184 INFO integration_test: predict_proba() took 1.16s     (tests/test_csv/GaussianNB-legit.csv)
2017-12-04 07:12:29,338 INFO integration_test: predict_proba() took 0.13s     (tests/test_csv/LogisticRegression-legit.csv)
2017-12-04 07:12:29,511 INFO integration_test: predict_proba() took 1.20s     (tests/test_csv/QuadraticDiscriminantAnalysis-legit.csv)
2017-12-04 07:12:29,554 INFO integration_test: await legit predictions took 2.01s
2017-12-04 07:12:29,554 INFO integration_test: all legit clfs predict_proba() took 2.01s
2017-12-04 07:12:36,086 INFO integration_test: pred mix took  4.69s      (tests/test_csv/RandomForestClassifier-XGBClassifier-mix.csv)
2017-12-04 07:12:36,138 INFO integration_test: pred mix took  4.72s      (tests/test_csv/RandomForestClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:37,481 INFO integration_test: pred mix took  1.39s      (tests/test_csv/XGBClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:37,486 INFO integration_test: await mix predictions took 6.04s
2017-12-04 07:12:37,509 INFO integration_test: all mix clfs predict_proba() took 7.95s
2017-12-04 07:12:40,467 INFO integration_test: await legit uploads took 2.95s
2017-12-04 07:12:41,774 INFO integration_test: write csv took 5.12s      (tests/test_csv/RandomForestClassifier-XGBClassifier-mix.csv)
2017-12-04 07:12:42,026 INFO integration_test: write csv took 4.03s      (tests/test_csv/XGBClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:42,113 INFO root: Noticed score 0.03232624037022035
2017-12-04 07:12:42,175 INFO root: Noticed score 0.026764304225627433
2017-12-04 07:12:42,197 INFO integration_test: write csv took 5.49s      (tests/test_csv/RandomForestClassifier-DecisionTreeClassifier-mix.csv)
2017-12-04 07:12:42,207 INFO integration_test: await mix uploads took 1.74s
2017-12-04 07:12:44,368 INFO root: Noticed score 0.039570871223514235
2017-12-04 07:12:44,376 INFO root: Noticed score 0.039130790224112415
2017-12-04 07:12:46,523 INFO root: Noticed score 0.032856826039064826
2017-12-04 07:12:46,540 INFO root: Noticed score 0.041891372103993726
2017-12-04 07:12:48,596 INFO root: Noticed score 1.0
2017-12-04 07:12:48,601 INFO root: Noticed score 0.03577434137578774
2017-12-04 07:12:50,682 INFO root: Noticed score 1.0
2017-12-04 07:12:50,698 INFO root: Noticed score 1.0
2017-12-04 07:12:50,702 INFO integration_test: all legit tests passed!
2017-12-04 07:12:50,702 INFO integration_test: all mix tests passed!

real	1m6.915s
user	1m28.828s
sys	0m8.353s

At first glance these changes look great.  No linter errors.  The integration test successfully runs in CI.  Thanks!  I haven't yet had the time to read your posts above or think about the validity of the integration test, will do soon.

@xanderdunn great! In short I feel this is "good enough" until the this has been done (since the integration tests is not running at all on the CI now):

API can be injected with a db manager that can run in-memory during tests to avoid network calls (https://github.com/numerai/NumerAPI/issues/16),
API is versioned (pypi) so the same version to be deployed in production can be tested against (https://github.com/numerai/NumerAPI/pull/15),
submission-criteria is versioned (pypi) so we know which submission-criteria version is dependent on which API version.

This way we can at least get the "integration" tests running on the CI as soon as possible; and when the API tickets are done it can be improved further.

Great, thanks.  It's merged, passed CI, and deployed to production.  We'll send 200NMR to your numer.ai account sovaa.


Comments field in BGP objects

First of all, many thanks for this plugin!
In the current netbox-bgp version=0.11.1, objects have a Description field with a length limit of 200 characters and plain text constraints.
Starting with Netbox-3.4 a Comments field has been added to all primary models.
This field has no character limit and supports the reStructuredText format.
I've found the Comments field to be highly useful for documenting network infrastructure in a user-friendly format.
The Comments field is also useful when the Description is part of the device configuration and there is a need to add extra documentation unrelated to the configuration.
Could you please implement the Comments field in BGP objects?

#181


Add doc of conv3d_transpose

This PR add the API doc of conv3d_transpose.

Can one of the admins verify this patch?

I signed it!

The way to add documentation is to call it out here: https://github.com/tensorflow/tensorflow/blob/f974e8d0c2420c6f7e2a2791febb4781a266823f/tensorflow/python/ops/nn.py#L111
Just add @conv3d_transpose there and our doc generator will update afterwards

@vrv thanks, PR updated.

@tensorflow-jenkins test this please


Storage Class as Option

Added the possibility to use a given StorageClass
The use case is: non AWS environments like bare metal or, as in my case, other cloud provider without something similar to EBS. The ability to provide a storage class is a great more on flexibility without disturbing other configurations.
f.e. using it with GlusterFS
apiVersion: enterprises.upmc.com/v1
kind: ElasticsearchCluster
metadata:
  name: es-suchen
  namespace: suchen
spec:
  client-node-replicas: 1
  master-node-replicas: 1
  data-node-replicas: 3
  elastic-search-image: upmcenterprises/docker-elasticsearch-kubernetes:5.3.1_3
  zones: []
  data-volume-size: 2Gi
  java-options: "-Xms256m -Xmx256m"
  storage:
    storage-class: distributed

for storage class:
apiVersion: storage.k8s.io/v1beta1
kind: StorageClass
metadata:
  name: distributed
provisioner: kubernetes.io/glusterfs
parameters:
  resturl: "http://<IP_ADDRESS>:8080"
  volumetype: none

generates:
apiVersion: apps/v1beta1
kind: StatefulSet
. . .
  volumeClaimTemplates:
  - metadata:
      annotations:
        volume.beta.kubernetes.io/storage-class: distributed
      creationTimestamp: null
      labels:
        component: elasticsearch
        name: es-data-log-distributed
        role: data
      name: es-data
    spec:
      accessModes:
      - ReadWriteOnce
      resources:
        requests:
          storage: 10Gi

Thanks for the PR @FaKod!


Dialog v2 is missing the sx prop

Description
Based on the dialog v2 prop docs, there is an sx prop to control the style of dialog. However, this is missing from the component.
Steps to reproduce

Apply an sx prop to the Dialog v2 component
Notice that the styles are not applied

Sandbox: https://codesandbox.io/s/interesting-platform-799dti
Version
v35.14.2
Browser
Chrome

Hi 👋🏻 Thanks for filing! This seems like something we should fix. @ajhenry do you want to try giving this a go and contributing back? Feel free to drop into #primer on Slack or attend our weekly Office Hours if you'd like support!

That should be an easy fix (I think). It seems we don't pass the sx props to the StyledDialog wrapper:
https://github.com/primer/react/blob/main/src/Dialog/Dialog.tsx#L297

I’m happy to take this one on!


Sticky Header Mat Sort Bug on scroll

What is the expected behavior?
Sort should be working on sticky header after scrolling
What is the current behavior?
Sort is not working on sticky header after scrolling
What are the steps to reproduce?

Click sort on any column header
Scroll table
Hover to header (sort is not working anymore)
https://stackblitz.com/edit/angular-1vg9gn-trp98z?file=app%2Ftable-basic-example.html

Which versions of Angular, Material, OS, browsers are affected?
Angular: 5.2.6
Angular Material: 5.2.2
OS: Mac OS High Sierra 10.13.4
Browser: Chrome (Haven't tried on Firefox, Working on Safari)

@Necromancerx You should add .sort to your data source. Sort is not working on your table even before scrolling.
Here's a working example: https://stackblitz.com/edit/angular-1vg9gn-5ve3hj?file=app/table-basic-example.ts

Sorry for the late reply.
@tinayuangao Sort is working on my end even before scrolling. Don't know why it's not working on Firefox.
OS: Mac OS High Sierra 10.13.4
Browser: Chrome, Safari (Not Working on Firefox)

@tinayuangao in the stackblitz you linked the table scrolls down to the bottom as you play around with different column's sort buttons, why is this happening?


Yii recipe is missing migrate

I'm using Deployer v7 in a Yii2 application and the yii recipe seems to be missing a migrate task.
I added this to my deploy.php for now:
after('deploy:vendors', 'deploy:migrate');
task('deploy:migrate', function () {
    run('cd {{release_path}} && php yii migrate');
});

Shouldn't something like this be part of the recipe?

Yes, I think so. PR?


fix: Address compilation errors when using the agent with Typescript

fixes: #367

Additional nit -- PR title should be fix:, not bug:, right?

@kjin I uploaded a new commit that added additional installation tests.


add request factory

Move to a factory model making request classes so that we can change classes easily in the future

test this please


RUM-6324: Add MaterialCardView support in Material SR extension

What does this PR do?
MaterialCardView is a widely used material component, this PR adds MaterialCardView support in Material SR extension
Motivation
RUM-6324
Demo

Sample
Before
After

Anything else we should know when reviewing?
Review checklist (to be filled by reviewers)

[ ] Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
[ ] Make sure you discussed the feature or bugfix with the maintaining team in an Issue
[ ] Make sure each commit and the PR mention the Issue number (cf the CONTRIBUTING doc)

Codecov Report
Attention: Patch coverage is 34.28571% with 23 lines in your changes missing coverage. Please review.

Project coverage is 69.91%. Comparing base (64ffa00) to head (9ea8280).
Report is 3 commits behind head on develop.

Files with missing lines
Patch %
Lines

...ionreplay/material/internal/CardWireframeMapper.kt
17.86%
23 Missing :warning:

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #2290      +/-   ##
===========================================
- Coverage    69.93%   69.91%   -0.02%
===========================================
  Files          732      733       +1
  Lines        27176    27231      +55
  Branches      4574     4570       -4
===========================================
+ Hits         19003    19037      +34
- Misses        6894     6918      +24
+ Partials      1279     1276       -3

Files with missing lines
Coverage Δ

...sessionreplay/material/MaterialExtensionSupport.kt
100.00% <100.00%> (ø)

...ionreplay/material/internal/CardWireframeMapper.kt
17.86% <17.86%> (ø)

... and 30 files with indirect coverage changes


add login/logout buttons to navbar

After login:

Steps to try out locally:
# set ENV secret and client id from cloud project (I'm using a personal one for now until Gaurav gives us one)
./dev/run_stack.sh
Then go to http://localhost:3001/auth/google, accept the oauth prompt.
Then go to http://localhost:3002 to access the UI.

Because we run the server and the UI on different ports, clicking the login button doesn't work and you have to go to the localhost:3001/auth/google manually now , it will work in prod because they will be served from the same domain but until I find a better solution this manual step is needed.
Logout works as expected.

 Set up a login and auth mechanism.

No login isn't required anywhere yet. I'll add instructions once it's required.


[BUG] Longhorn setting page toggles with blank page.

Describe the bug
The setting page of longhorn is going blank in interval of about 21 seconds.
To Reproduce
Steps to reproduce the behavior:

Deploy Longhorn UI - master 3c287b3
Go to setting page.
The page is blank initially and periodically shows the settings.

https://user-images.githubusercontent.com/60111667/113332448-d07c6200-933e-11eb-81ab-ea1e24274f2a.mov
Log
WebSocket connection to '' failed: WebSocket is closed before the connection is established.
longhorn-support-bundle_a0e5c5da-f57e-4dec-a9ce-a12809944031_2021-04-01T17-31-04Z.zip
Environment:

Longhorn version: Longhorn-master 04/01/2021

Because the websocket has been updated on the back end, the ui has been updated in line with the changes on the back end. The reason for the bug is that the ui version is not up to date.
https://github.com/longhorn/longhorn/issues/2372


Anybody interested should contact me at<EMAIL_ADDRESS>


Instead of fixed way, make the cores used for block sort confiugrable.

The user can configure this num according to the configuration of the machine, and sometimes if the machine still has enough cores after exclude "carbon.number.of.cores.while.loading", we can set this value "carbon.number.of.cores.block.sort" to larger to avoid RejectedExecutionException, but if the machine has not enough cores we can reduce it.

@Vimal-Das @QiangCai @manishgupta88 pls review this code, thank you!

LGTM, But at the same time I am wondering whether we can avoid introducing one more configurable property.
Can we reuse the MDK sort thread count property as when block sort is happening, MDK sort is already completed, can we keep the thread count same as MDK sort?

@Vimal-Das I think that while final merger read rows from files, the Producer will generate mdk and try to start block sort thread who is responsible for RLE and inverted index, meanwhile the Consumer will write the blocklet files, they are concurrent streaming like procedure. Here the "block sort " means RLE and inverted index.

@Vimal-Das Hi vimal, what's your opinion?

@ravipesala pls check this code，thank you.

@ravipesala Done, pls check again.

LGTM. merge to master.


Add github.com/Shixzie/nlp

Fix github.com/Shixzie/ly description
Removed github.com/Shixzie/analytics temporally

LGTM.  Thanks.


p100 corrected > p100 uncorrected

IIRC, a corrected histogram injects additional values between the higher observed value and the expected interval. So it makes sense that the p100 of the uncorrected histogram should be the same as the p100 in the corrected version.  I've played with HDRHistogram in java and it does appear to behave as I expect, but wrk2 sometimes produces corrected p100s much higher than the uncorrected version.
Final few lines of the corrected version:
2306.047     1.000000    691130114 447392431.11
2306.047     1.000000    691130114 536870912.00
2306.047     1.000000    691130114 596523251.36
2306.047     1.000000    691130114 671088630.00
2308.095     1.000000    691130115 766958458.78
2308.095     1.000000    691130115          inf
#[Mean    =        1.335, StdDeviation   =        4.240]
#[Max     =     2306.048, Total count    =    691130115]
#[Buckets =           27, SubBuckets     =         2048]
Final few lines of the uncorrected version:
201.471     1.000000    691130114 383479229.39
201.471     1.000000    691130114 447392431.11
201.471     1.000000    691130114 536870912.00
201.471     1.000000    691130114 596523251.36
201.471     1.000000    691130114 671088630.00
203.775     1.000000    691130115 766958458.78
203.775     1.000000    691130115          inf
#[Mean    =        0.483, StdDeviation   =        0.758]
#[Max     =      203.648, Total count    =    691130115]
#[Buckets =           27, SubBuckets     =         2048]
[The command line used was: wrk -t5 -c32 -d24h -R8000 -U -sSCRIPT URL DATAFILE
version string: wrk 4.0.0 [epoll] Copyright (C) 2012 Will Glozer]

Ignore me - I see it does not actually use HDR_histogram for calculating the corrected value :)


Start independent move

Create features for starting moving a plate independently.

#70 Broke this
Need to be reimplemented

Get the plate ID of the selected plate somehow (maybe new window New windows needed #6, maybe other way)
Get the timestamp of the separation
Create new entry above the last entry with the same coordinates but with the new timestamp (beware! the .rot is written from bottom to top), comment: end following conjugateID
Create a new entry above the "end following" entry, with the coordinates of the conjugate plate's at the separation timestamp
Change the 0.0 entry to reflect that there is no conjugate ID
Generate drift correction (maybe unnecessary, can be done with hand)

One unit.

Data to start this transaction:
ID, timestamp

Improvement:
when a plate starts a new movement, some plates will follow this new plate. Make it possible to link plates from one to another plate.


Added isObject to SealedTrait.Subtype

Fixes #164
This adds isObject as a parameter to Subtype.
One thing I was not sure on, is why the fallback implicit is required in traits used for testing (I see TypeNameInfo has it). This is only required for sealed traits which have a mixture of case classes and case objects.

Thanks!

Cool. Is there an auto snapshot ?

Snapshot - no, but there's a release being built: https://github.com/softwaremill/magnolia/actions/runs/922133541

Even better :)
On Wed, 9 Jun 2021 at 09:58, Adam Warski @.***> wrote:

Snapshot - no, but there's a release being built:
https://github.com/softwaremill/magnolia/actions/runs/922133541
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/softwaremill/magnolia/pull/303#issuecomment-857769834,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFVSGWOWIFFUOWEF4DF6B3TR56SVANCNFSM46IBOCIA
.


Upgrade CSI to v0.2 and set PluginVersion to 0.2.0

This PR upgrades the csilvm plugin to CSI v0.2.
The plugin version situation is a bit of a mess. I tagged v0.1.0 but forgot to change the PluginVersion to 0.1.0. This means that v0.1.0 of this plugin reports is version as '1.11.0'. Sigh.
I'm proceeding to "reverse" the version to v0.2.0 in this PR. Again, sigh. Not sure what else to do here, what's done is done.
Fixes https://jira.mesosphere.com/browse/DCOS_OSS-3309

I think this logic might make sense as part of the startup sequence vs. Probe. If the startup sequence fails, then the program can either crash (read: fail-fast, preferred) or can linger and just return unhealthy (less preferred).

I've moved the create/remove logic from Probe to a new (*Server).Setup() method.

I changed Probe to run pvck and vgck.

CI errors

pkg/csilvm/csilvm_test.go:2092::warning: declaration of "err" shadows declaration at csilvm_test.go:2087 (vetshadow)

pkg/csilvm/csilvm_test.go:2096::warning: declaration of "err" shadows declaration at csilvm_test.go:2087 (vetshadow)

Hmm - that's a good point I didn't know there was a timeout, although it makes sense.
If we have an explicit grpc error to return from Probe that would help immensely.

Can you elaborate on what the status code would indicate? I'm wondering if,
instead of an error code, we should include a field in the ProbeResponse
that indicates "readiness". "healthy" is indicated by Probe NOT returning
an error.
On Wed, May 9, 2018 at 11:52 AM, Gustav Paul<EMAIL_ADDRESS>wrote:

Hmm - that's a good point I didn't know there was a timeout, although it
makes sense.
If we have an explicit grpc error to return from Probe that would help
immensely.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/mesosphere/csilvm/pull/73#issuecomment-387786264, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ACPVLKTsrRWBjlbRef18meFSO9I6hTlSks5twxC5gaJpZM4T0ztt
.

include a field in the ProbeResponse that indicates "readiness"

This is very cool. It basically captures my intent, just without piggy-backing on errors.

I took an action item today in the CSI sync to propose changes to the Probe
API
On Wed, May 9, 2018 at 12:12 PM, Gustav Paul<EMAIL_ADDRESS>wrote:

include a field in the ProbeResponse that indicates "readiness"
This is very cool. It basically captures my intent, just without
piggy-backing on errors.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/mesosphere/csilvm/pull/73#issuecomment-387792497, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ACPVLPs2Ti14_u5Ci9c_iLWpI_F_oezRks5twxVogaJpZM4T0ztt
.

I merged this PR with the understanding that we'll revisit this when https://github.com/container-storage-interface/spec/pull/228 lands or the Initialization / Probe timeout issue is addressed.

https://jira.mesosphere.com/browse/DCOS-34540