Support for self signed certificates

Description of the issue:
When (internal) Docker registry is using self signed certificates (or certificates signed with corporation's own root certificate, that's not trusted by Java), jib tries immediately http-connection (according https://github.com/GoogleContainerTools/jib/blob/master/jib-core/src/main/java/com/google/cloud/tools/jib/registry/RegistryEndpointCaller.java#L219), that's not available in registry.
Current implementation throws error:

[ERROR] Failed to execute goal com.google.cloud.tools:jib-maven-plugin:0.9.2:build (default-cli) on project jib-test-project: Build image failed, perhaps you should use a registry that supports HTTPS or set the configuration parameter 'allowInsecureRegistries': Only secure connections are allowed, but tried to reach URL http://openshift-redhat-registry/v2/testProject/test-container/manifests/latest -> [Help 1]

Expected behavior:
allowInsecureRegistries -parameter should allow also https connections with self signed certificates, and not directly drop to http.
Steps to reproduce:
mvn compile jib:build with configuration set to point to registry using self signed certificates.
Environment:
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T22:39:06+03:00)
Java version: 1.8.0_131, vendor: Oracle Corporation
Default locale: en_US, platform encoding: Cp1252
OS name: "windows 7", version: "6.1", arch: "amd64", family: "windows"
jib-maven-plugin Configuration:
<configuration>
	<from>
		<image>openshift-redhat-registry/testProject/test-container</image>
	</from>
	<to>
		<image>openshift-redhat-registry/testProject/${project.artifactId}:${project.version}</image>
	</to>
	<container>
		<jvmFlags>
			<jvmFlag>-Xms512m</jvmFlag>
		</jvmFlags>
	</container>
</configuration>

Log output:

[ERROR] Failed to execute goal com.google.cloud.tools:jib-maven-plugin:0.9.2:build (default-cli) on project jib-test-project: Build image failed, perhaps you should use a registry that supports HTTPS or set the configuration parameter 'allowInsecureRegistries': Only secure connections are allowed, but tried to reach URL http://openshift-redhat-registry/v2/testProject/test-container/manifests/latest -> [Help 1]

Additional Information:
The actual error causing change to http is:
[ERROR] Failed to execute goal com.google.cloud.tools:jib-maven-plugin:0.9.4-SNAPSHOT:build (default-cli) on project jib-test-project: Build image failed: peer not authenticated -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.google.cloud.tools:jib-maven-plugin:0.9.4-SNAPSHOT:build (default-cli) on project jib-test-project: Build image failed
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Build image failed
	at com.google.cloud.tools.jib.maven.BuildImageMojo.execute(BuildImageMojo.java:132)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
	... 20 more
Caused by: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated
	at sun.security.ssl.SSLSessionImpl.getPeerCertificates(SSLSessionImpl.java:431)
	at org.apache.http.conn.ssl.AbstractVerifier.verify(AbstractVerifier.java:128)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:339)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:123)
	at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:147)
	at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:108)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:415)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:641)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:576)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:554)
	at com.google.api.client.http.apache.ApacheHttpRequest.execute(ApacheHttpRequest.java:65)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:981)
	at com.google.cloud.tools.jib.http.Connection.send(Connection.java:124)
	at com.google.cloud.tools.jib.registry.RegistryEndpointCaller.call(RegistryEndpointCaller.java:169)
	at com.google.cloud.tools.jib.registry.RegistryEndpointCaller.call(RegistryEndpointCaller.java:139)
	at com.google.cloud.tools.jib.registry.RegistryClient.callRegistryEndpoint(RegistryClient.java:321)
	at com.google.cloud.tools.jib.registry.RegistryClient.pullManifest(RegistryClient.java:196)
	at com.google.cloud.tools.jib.registry.RegistryClient.pullManifest(RegistryClient.java:204)
	at com.google.cloud.tools.jib.builder.steps.PullBaseImageStep.pullBaseImage(PullBaseImageStep.java:146)
	at com.google.cloud.tools.jib.builder.steps.PullBaseImageStep.call(PullBaseImageStep.java:105)
	at com.google.cloud.tools.jib.builder.steps.PullBaseImageStep.call(PullBaseImageStep.java:51)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:127)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:80)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

@Hi-Fi , thanks for reporting this issue! We will investigate and see what the best solution here is to support self-signed certificates.

Workaround:  use http://keystore-explorer.org to add self signed cert to java cacerts, remove allowInsecureRegistries and enjoy.

I think that relying on Docker certs is not necessarily the good thing, as at least our use case is to use JIB on the env that are not so easy to make to build docker containers (e.g. Jenkins slaves running on Openhift and developer computers with Windows without admin rights). So best would be some maven configuration parameter, that goes all the way down to used httpClient and ignores the incorrect and also insecure certificates (e.g. SHA-1 using).
@velo That seems to work (tried that yesterday with keytool and it wasn't working for some reason). This helps checking of things more, but still requires that custom cacerts injection to slave. Thank you for that tool, it's nicer to use than CLI one.

@velo Thanks for the workaround! This sounds like something we could add to our documentation or as a guide to help anyone else using a self-signed certificate.
@Hi-Fi Glad it works well now!

@coollog could you point me to the right README file?

@velo I'd recommend writing a new page (page_name.md) in the docs/ directory, which generates pages like https://googlecontainertools.github.io/jib/configure-gcp-credentials. We can then link to generated page whereever applicable.

Instructions doc for self-signed certificates is merged! Thanks @velo and other contributors to the PR #618

Is it so, that there's not going to be any Maven side configuration for trusting the self-signed certificates? Documentation is OK, when user really has access to cacerts, but if e.g. builds are running on Jenkins (or Jenkins slaves) without access to host itself, only way to make things work with self signed certs is some Maven configuration (or keeping keystore within each repo and injecting that at the start).

You should be able to set the javax.net.ssl.trustStore property to point to your own cacerts file.

You should be able to set the javax.net.ssl.trustStore property to point to your own cacerts file.

Ah, yeah, this will be nice to document too, along with javax.net.ssl.trustStorePassword. Must not be confused with the keystore (javax.net.ssl.keyStore and javax.net.ssl.keyStorePassword).

Will do.

FTR, #643 will fix this.
@Hi-Fi


No errors, but does not insert anything

hi guys.
I have the following problem, the JDBC runs, shows data on the screen but does not insert large amounts of records.
If I try to insert 10,000 records it works but i need to migrate 25 million record, there at this point it does not insert and not show any errors.
execution appears as:
´´´
17:18:18,282][INFO ][metrics.source.plain     ][pool-4-thread-1] totalrows = 0, 10 minutes 29 seconds = 629989 ms, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:18:18,282][INFO ][metrics.sink.plain       ][pool-4-thread-1] 10 minutes 29 seconds = 629456 ms, submitted = 0, succeeded = 0, failed = 0, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:18:48,282][INFO ][metrics.source.plain     ][pool-4-thread-1] totalrows = 0, 10 minutes 59 seconds = 659989 ms, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:18:48,282][INFO ][metrics.sink.plain       ][pool-4-thread-1] 10 minutes 59 seconds = 659455 ms, submitted = 0, succeeded = 0, failed = 0, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:19:18,282][INFO ][metrics.source.plain     ][pool-4-thread-1] totalrows = 0, 11 minutes 29 seconds = 689989 ms, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:19:18,282][INFO ][metrics.sink.plain       ][pool-4-thread-1] 11 minutes 29 seconds = 689456 ms, submitted = 0, succeeded = 0, failed = 0, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:19:48,282][INFO ][metrics.source.plain     ][pool-4-thread-1] totalrows = 0, 11 minutes 59 seconds = 719989 ms, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
[17:19:48,283][INFO ][metrics.sink.plain       ][pool-4-thread-1] 11 minutes 59 seconds = 719456 ms, submitted = 0, succeeded = 0, failed = 0, 0 = 0.0 bytes bytes, 0.0 bytes = 0 avg size, 0 dps, 0 MB/s
´´
My configuration file:
´´´
#!/bin/sh
DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
bin=${DIR}/bin
lib=${DIR}/lib
echo '
{
"type" : "jdbc",
"jdbc" : {
"url" : "jdbc:mysql://<IP_ADDRESS>:3307/myDataBase",
"threadpoolsize" : 8,
"query_timeout" : 18000,
"fetchsize" : 10000,
"statefile" : "statefile_ciatc.json",
"user" : "myUser",
"password" : "myPassword",
"timezone" : "TimeZone.getDefault()",
"sql" : [{
"statement": "query_teste.sql"
}],
"index" : "my_index",
"type" : "myType",
"metrics": {
"enabled" : true
},
"elasticsearch" : {
"host" : "xxx.xxx.xxx.xxx",
"cluster": "SomeCluster",
"port" : 9300
}
}
}
' | java
-cp "${lib}/*"
-Dlog4j.configurationFile=${bin}/log4j2.xml
org.xbib.tools.Runner
org.xbib.tools.JDBCImporter
´´´
i am run this operation in a amazon instance, with 16 giga of Ram and 8 cores processor.
tks.

Noticing similar issue here, inserts fine for the first few thousand records then ES doesn't index anymore.
River appears to still be submitting fine however, but ES's _count not updating after that. Logs:-
[12:45:08,322][INFO ][metrics.source.json      ][pool-3-thread-1] {"totalrows":3455910,"elapsed":18479916,"bytes":367105412,"avg":106.0,"dps":187.00896692387562,"mbps":0.019399513445096286}
[12:45:08,323][INFO ][metrics.sink.json        ][pool-3-thread-1] {"elapsed":18478879,"submitted":3455909,"succeeded":3449743,"failed":0,"bytes":762937317,"avg":220.0,"dps":187.01940740019998,"mbps":0.04031932746747313}
[12:46:08,308][INFO ][metrics.source.json      ][pool-3-thread-1] {"totalrows":3455910,"elapsed":18539916,"bytes":367105412,"avg":106.0,"dps":186.40375716912632,"mbps":0.019336731563737938}
[12:46:08,309][INFO ][metrics.sink.json        ][pool-3-thread-1] {"elapsed":18538865,"submitted":3455909,"succeeded":3449743,"failed":0,"bytes":762937317,"avg":220.0,"dps":186.4142707765551,"mbps":0.04018886666647675}

Nothing in ES's logs even with DEBUG on,
ES v2.4.0
JDBC River v<IP_ADDRESS>

@gaving
I solved this by reducing the amount of data entered, the documentation says that the bulk insert process must enter a maximum of 15MB per bulk, this is the recommendation.
Another valuable tip is to disable the "refresh_time" during bulk inserts and activate after the insertion process is complete.
this link you will find good tips:
https://www.elastic.co/guide/en/elasticsearch/guide/current/indexing-performance.html

Cheers for the tips @lipeRomani, I'll give those a shot!


Django 3

These commits update the testing matrix for current Django, and remove some older-Django-compatibility cruft.
On my machine, some of the sqlalchemy tests are failing, both before and after these changes.

@shaib It'd be nice to update trove classifiers in setup.py to reflect the new versions.
(Although it seems @jmcarp has abandoned the project a while back, so I'm not sure if it will ever get merged anyway...)

Hi @jmcarp ,
Maybe we should migrate package into jazzband organization?

Hi @jmcarp have you thought about moving it jazzband? Would love to see the great work maintained. thanks!

Looks like nplusone no longer works in the latest versions of Django. @jmcarp do you intend to maintain the project? How can I help you with this?


Ab/enrollments bulk update

Thank @blarghmatey. This is ready for re-review

As part of the work for https://github.com/mitodl/open-discussions/issues/3318 I took the opportunity to improve the structure of the Athena/S3 system which also involved changing database and table naming which will require some changes to the query in this PR. I think that this is also a good opportunity to add the integration with AWS Glue for registering the table/schema definitions of the data being loaded as part of the pipeline concern, rather than requiring configuration of the Glue crawler and waiting for it to execute.

AWS glue crawler only has to run if the data schema changes, correct? I'm not sure how useful it would be to run the crawler automatically as part of this pipeline since schema changes should occur infrequently and also the queries in the pipeline would not update automatically to a new schema.

My intent is to move away from using the crawler entirely and instead use the Glue catalog API (https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-catalog.html) directly to register tables and their schema. The crawler is intended to be used for registering data sources that are not managed programmatically and for which the schema is largely unknown.


RapyutaSimulationPlugins for UE5.4.4

The updated version of the  RapyutaSimulationPlugins  compatible with the last version of the Unreal Editor (5.4.4)

Hello, Unfortunately, it does not work. The project does not get built.
Il giorno mer 9 ott 2024 alle ore 15:12 yuokamoto @.***>
ha scritto:

Thanks.
Doesn't UE5.4 branch work with 5.4.4?
—
Reply to this email directly, view it on GitHub
https://github.com/rapyuta-robotics/RapyutaSimulationPlugins/pull/308#issuecomment-2402313351,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOC2PA6FUML3X652CGHWV2DZ2UTUTAVCNFSM6AAAAABPUPRI6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMBSGMYTGMZVGE
.
You are receiving this because you authored the thread.Message ID:
@.***
com>

--
--
Khalid BOURR
PhD Student in Computer Science and Mathematics
School of Science and Technology, Computer Science DivisionUNICAM -
University of Camerino
Via Madonna delle Carceri, 9 - 62032. Camerino, Italy
tel: +393335016702
http://pros.unicam.it/ http://pros.unicam.it/
--


Tutorial nuclei classification

Tutorial for nuclei classification using DSA and HistomicsTK.
The downloadable resources are yet to be added.

Since this is all markdown, we aren't really using the features of a notebook very much.  Do you think it'd be better to just have it be a markdown file with some upload images?  GitHub renders it just the same, so there may be no virtue to that.

Usually we try to put image resources for docs in the same repo.  They aren't that large (and if they are png files, you can run optipng on them to make them as small as possible), and if someone checks out the repo it is closer to being stand alone.  I'd only do this for the images (placing them in the doc_files folder, for instance).

Usually we try to put image resources for docs in the same repo. They aren't that large (and if they are png files, you can run optipng on them to make them as small as possible), and if someone checks out the repo it is closer to being stand alone. I'd only do this for the images (placing them in the doc_files folder, for instance).

I have used the optimpng and transferred all the files to the doc_files repo. But there is a model file as .pkl(6 MB). Currently, it is in my personal public folder at data.kitware.com. Can you provide me a location to save it as a part of the HistomicsTK folder?


Crunchyroll: No video formats found

youtube_dl -v http://www.crunchyroll.com/rezero-starting-life-in-another-world-/rezero-kara-hajimeru-isekai-seikatsu-o-fim-do-comeo-e-o-comeo-do-fim-parte-1-702401
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.crunchyroll.com/rezero-starting-life-in-another-world-/rezero-kara-hajimeru-isekai-seikatsu-o-fim-do-comeo-e-o-comeo-do-fim-parte-1-702401']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.08.12
[debug] Python version 2.7.12 - Linux-4.4.0-31-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: rtmpdump 2.4
[debug] Proxy map: {}
[Crunchyroll] 702401: Downloading webpage
[Crunchyroll] 702401: Downloading media info for 360p
[Crunchyroll] 702401: Downloading media info for 480p
[Crunchyroll] 702401: Downloading media info for 720p
[Crunchyroll] 702401: Downloading media info for 1080p
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/home/davi/.local/lib/python2.7/site-packages/youtube_dl/YoutubeDL.py", line 691, in extract_info
ie_result = ie.extract(url)
File "/home/davi/.local/lib/python2.7/site-packages/youtube_dl/extractor/common.py", line 347, in extract
return self._real_extract(url)
File "/home/davi/.local/lib/python2.7/site-packages/youtube_dl/extractor/crunchyroll.py", line 370, in _real_extract
self._sort_formats(formats)
File "/home/davi/.local/lib/python2.7/site-packages/youtube_dl/extractor/common.py", line 901, in _sort_formats
raise ExtractorError('No video formats found')
ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Duplicate of #10301.


Reduce number of D3D12 context resets

As title says, reduce somehow how much we reset state as we do it a lot of the times unnecessarily.
We also reset context 4 times on shutdown currently, as we don't know exactly when our swapchain is freed (just cca time)

Where are the changes?

https://github.com/yamashi/CyberEngineTweaks/commit/79d5e1a11ca297ac852143e64026bdaf007b974d
https://github.com/yamashi/CyberEngineTweaks/commit/244ad82880b19e1a1184a8caa9501cd84d389e7b
Probably some bits and pieces in other...
We were referencing wrongly some COM objects before, should be hopefully better now.
ImGui impl manages this on its own, I didnt touch that (presuming it was not modified in a way that should break sth)
I will be updating these anyway to latest 1.88-docking versions so we have full access to docking etc.

The changes you made are not fixing anything https://learn.microsoft.com/en-us/cpp/cppcx/wrl/comptr-class?view=msvc-170#operator-ampersand
They actually introduce a memory leak as the pointer isn't

Im unsure now what exactly you mean.
You mean the usage of GetAddressOf() vs. addressof operator?
Could be, will check and fix after work. I see one is doing release as you say and other not...
There were problematic uses of & before, I was replacing them with the Get() and GetAddressOf() to distinguish intention better.
It was asserting in debug before that as addressof expected internal data to be nullptr. And it was used in context of pointer array, which was wrong. Usages of ExecuteCommandLists think was the one.

Also, we were leaking before too as mentioned. QueryInterface functions should operate on ComPtrs or have resources released manually after use, which we did not do in multiple places. They AddRef to pointers.
Think overall, if this issue you mentioned gets resolved, I think we should have better resource handling with less leakage.

GetAddressOf will just return the address, it will not call Release on the ptr itself so we would just overwrite the pointer but not release the previous value if it was not nullptr, the equivalent of operator& is ReleaseAndGetAddressOf but I don't understand why being verbose here is an improvement

I guess there is no need for extra verbosity then.
I was doing this mainly to fix the issue of wrong usage of that operator before as mentioned, will change it back then for GetAddressOf usecases with & 👍
It does not help anything now I guess, helped me personally before x)

Thanks btw for spoting this 🙇

I may not write much code, but I keep an eye on things haha

Some extra issues/concerns I noticed in current master

There is possibly invalid use of CommandQueue in downlevel (Win7)
There also is an issue with a lot of unnecessary context resets (all, look into Resize)
I dont know how safe it is that we use single command queue when we create multiple, should be checked (either we unnecessarily create resources or dont correctly work with them)

changed the title of this, as there was only one thing left here to do

issues with shutdown resource and script handling moved to #728

Fixed in #757 (among others)


Swift 2: Framework not found

I've recently downloaded Realm, trying to add it to my project.  I've followed the specific instructions for installing for Swift 2 using the source.  I'm running on xCode 7, El Capitan and tried deploying to both iOS 8.4 and iOS 9.
When attempting to build, either on device or simulator I'm getting;
ld: framework not found RealmSwift
clang: error: linker command failed with exit code 1 (use -v to see invocation)
I've attempted cleaning the project and the build, deleting the DerivedData Directory, tried importing the framework into a new project and rebooting, none of which are solving the problem.
Any suggestion for a fix?
I would try CocoaPods but I haven't reinstalled it since I got El Capitan.  If needs be I'll try it, was just hoping to get it working this way for now.

@Neilq5 are you sure that the framework search paths include the path the the directory that contains the realm and RealmSwift frameworks?

I tried the search paths yesterday with no luck.  I reinstalled Xcode the that problem has seemingly disappeared.  Moving on to a new problem.
If I import Realm and build, I'm getting errors anywhere I force a downcast to string;
`Cannot assign a value of type 'String' to a value of type 'String'
If I remove the import, it disappears.  Tried cleaning and stuff again with no difference.

Hm, that is a strange error indeed... Would you mind sharing a project with us, either here or privately at<EMAIL_ADDRESS>so we can take a look? Thanks!

Thanks, just sent it in an email.

This is likely not a Realm issue, but keep us posted, @Neilq5 !


SRP server respond to the SRP Update with Name Conflict(Name exists), the host name and service name are the same, and the public/private key pair are the same.

First response to SRP Update with No Error. The second SRP Update, the SRP server unexpectedly respond with Name Exist.
This issue cannot be reproduced every time. It's a probabilistic event.
srp_name_exists.log

NetworkKey:
42b9ff82f478ce151344f9b39516c7de
Wireshark packets:

srp_name_exists.zip

From the logs you provided, there seems to be a name conflict detected by the platform's mDNS on the infra-if link. It appears you're using mDNSResponder, which is detecting the name conflict:
Sun Feb 26 18:26:03 2023 daemon.err mdnsd[1906]: Default: register_service_instance 56fd10f18adb._knx._udp.local. error -65548
Sun Feb 26 18:26:03 2023 user.err otbr-agent[1967]: [ERR ]-MDNS----: Failed to register service 56fd10f18adb._knx._udp: Name Conflict

In this scenario, the SRP server rejecting the SRP update message is expected behavior.
It might be helpful to investigate the infra-if side to determine if another device or BR is registering the same name.

This TBR is connected to an Ethernet network that does not have any other TBR. The service name and host name of the terminal device (56fd10f18adb) are composed of serial numbers, which are unique across the network.  So I suspect there may be a problem with the exchange logic between the SRP server and mdnsd.

With the same setup, DNS updates sometimes fail and sometimes succeed. On the left is failures and on the right is successes. I suspect the left side failed because mdnsd processed the 'registering service' before the 'removing service'. Can you look into it for me?

How do I listen to interprocess communication between mdnsd and SRP server (otbr-agent)?

Note that ot-br-posix includes patches to 1790.80.10 - see https://github.com/openthread/ot-br-posix/pull/1919 . However, I don't know if any of those patches address your issue.

Hi @jwhui
The https://github.com/gl-inet/gl-feeds/tree/21.02.2/mdnsresponder/patches is confirmed to have been applied, but not resolved the issue.

Thank you. This product has these patches applied.

There is a end device product that will no longer register for SRP once the SRP server replies with name exist. I wonder if the standard OpenThread SRP client will try to register SRP again in this scenario? What is the retry interval?

As long as the content of the registered text information changes, this issue can be easily reproduced.

The issue does not seem to be with the OpenThread core or the SRP server or client implementation. They behave as intended. The SRP server receives a registration, notifies the adv proxy (which should be provided by the platform layer), and waits for its callback to send the response back to the client. In this case, it gets a "conflict error" in the callback from the adv proxy and conveys this back to the client. This is all correct and intended behavior.
From the logs, the adv proxy being used is the one provided by ot-br-posix (a POSIX-based platform implementation). The issue seems to be with ot-br-posix and/or its integration with an underlying mDNS responder. From the snippet, it seems like the adv proxy code does issue an API call to delete the previous registration when there is a change before registering the new one, but in some cases, this still causes a conflict (I guess within the mDNS responder with its own previous registration).
Here are some suggestions:

Check the version of ot-br-posix (commit) you are using and try updating it to a later version (there have been many changes related to integration with different mDNS libraries over time).
Investigate the mDNS shim layer implementation in ot-br-posix and how it interacts with and calls mDNSResponder APIs.

The ot-br-posix used comes from https://github.com/SiliconLabs/gecko_sdk/releases/tag/v4.4.3
The Silicon Labs OpenThread SDK includes all changes from the OpenThread border router GitHub repo
(https://github.com/openthread/ot-br-posix) up to and including commit 42f98b27b.

I tested this case with GSDK v4.3.1, this version does not have this issue.
The Silicon Labs GSDK v4.3.1 includes all changes from the OpenThread border router GitHub repo
(https://github.com/openthread/ot-br-posix) up to and including commit bb565ca01.

The latest GSDK is GSDK v4.4.5.
The Silicon Labs GSDK v4.4.5 includes all changes from the OpenThread border router GitHub repo
(https://github.com/openthread/ot-br-posix) up to and including commit 4bb0d4d78.
Can you help to test and check whether this version has this issue?


Missing options.version being reported when assigning Centos Workflow

Not sure if I have missed anything but I get the same error repeatable (through a number of environment rebuilds) of a 'TemplateRenderingError' error reporting due to a missing value of 'options.version'. I have stripped the reference out of the Templates and Profiles to see if it changed the behaviour but still same result. Noticed while doing that a seperation in what file content is shown int the UI and what is on the host. Removing the reference to a version in these areas made no difference anyway.
Result of the error is that the workflow never gets passed the first action.

Just a small mistake in the installation instructions in step 11, the curl command for the workflow upload specified a POST command where the API requires a PUT. The upload of a SKU definition is a POST so that is good. Thanks!
current:
curl -H "Content-Type: application/json" -X POST --data @centos_workflow.json http://localhost:9090/api/1.1/workflows
fixed example:
curl -H "Content-Type: application/json" -X PUT --data @centos_workflow.json http://localhost:9090/api/1.1/workflows

changes pushed up to readme.md and to workflow file to address issues

Thanks @davlloyd. @kenny can you review? https://github.com/emccode/machine/pull/4

Also https://github.com/emccode/machine/pull/3

yes i will... thanks @davlloyd. I remember options.version being needed somewhere along my testing


Ability to add extra field to menu_item from page field

What would be the best way to add a extra property to the some menu items? I had a look at the hooks, but there is no clear hook to do this.
My issue is that I have a property on some of my pages which should change the menu item CSS. These can change between pages. I can grab the page_id from the menu_item, do a lookup for that property on the page from there, but this will cause extra database queries that I'd prefer to avoid.

Correction: I cannot even look up page_id in the template using a filter because even this is not passed to the context.

I tried the following:
@hooks.register('menus_modify_base_page_queryset')
def menu_item_highlights(
        queryset,
        request,
        menu_instance,
        original_menu_tag,
        current_site,
        **kwargs):

    queryset = queryset.annotate(
        highlight_color=F('genericpage__highlight_color'))
    return queryset

But of course this doesn't work because, when the menu_items are primed, this value is not added. I just want  a way to add highlight_color to the menu_item context.

@andrewebdev the page for a menu item should always be accessible from the template.
For top-level menu items, the the menu item will be a MenuItem instance, with the page available via the link_page field, so menu_item.link_page.highlight_color should work.
For menu items generated from pages, the menu items are actually specific page instances with attributes added, so menu_item.highlight_color should work.


Snakify error

"Command raised an exception: RecursionError: maximum recursion depth exceeded while calling a Python object"

this will be fixed in #81


Please add licensing information

Hello,
This module is perfect for a project that I am working on. However, I noticed it doesn't contain any licensing information, which makes it legally risky to use. I'd greatly appreciate if you could add a license!
If you are in doubt about which license to choose, you can check out https://choosealicense.com/ or similar websites to help you choose.
Best wishes,
Jannes

Thank you @jh0ker i think MIT is perfect for this kind of project https://github.com/adrz/twitch-realtime-handler/pull/9
Is it good for you ?

Hey, sorry for the late response, I seem to have missed your response.
The MIT license is very permissive which is great for adoption, so it's perfect for my needs.
I appreciate you taking the time and making this project available, it's really useful!


⚠ Bofrost.lu has degraded performance

In 445d470, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1045 ms

Resolved: Bofrost.lu performance has improved in 849f779 after 31 minutes.


Accessing Cisco Spark APIs

Hi All,
Firstly I'm new to Bot Building so this might be more of a novice mistake!
Botkit v0.6.12
Within Cisco Spark, I am trying to retrieve the current Room Name to use in a Botkit Response.
Based on the final comment in (https://github.com/howdyai/botkit/issues/7) the APIs should be directly accessible, an output of bot.botkit.api shows the objects (bot.api is undefined), but they appear to be empty.
Should this work or is this not available for Cisco Spark or is there another way of accessing the APIs?
Cheers,
Jeremy
console.log(bot.botkit.api)
{ loaded: true,   sessionId: 'XXXXXXXXXXX',   ready: true,   canAuthorize: true,   canRefresh: false,   isAuthorizing: false,   isAuthenticating: false,   internal:    { device:       { services: {},         serviceHostMap: [Object],         features: [Object],         serviceCatalog: [] },      feature: {},      metrics:       { batcher: {},         clientMetricsBatcher: {},         callDiagnosticEventsBatcher: {} },      mercury: {},      locus: {} },   credentials:    { supertoken:       { access_token: 'XXXXXXXXXXX',         token_type: 'Bearer' },      userTokens: [] },   logger: {},   authorization: {},   people: { batcher: {} },   phone: { emittedCalls: [] },   messages: {},   memberships: {},   rooms: {},   teams: {},   teamMemberships: {},   webhooks: {} }

@jeremywillans I am surprised this is returning undefined since bot.botkit.api does work for me.
May you check this sample:
https://github.com/CiscoDevNet/botkit-webex-samples/blob/master/roomid-phantom.js#L94

Thanks Steve - yes after finding that example i got it working successfully. Cheers for the follow up !


Added new Color operations

Added new functions to Color, including:

add - Adds two colors componentwise
subtract - Subtracts two colors componentwise
multiply - Multiplies two colors componentwise
divide - Divide two colors componentwise
mod - Mod two colors componentwise
multiplyByScalar - Multiply a color by a scalar componentwise
divideByScalar - Divide a color by a scalar componentwise

And updated ColorSpec for each of these new functions

I don't normally hear of divide or mod in regards to color.  Is there a use case in mind for color division?
More commonly, the opposite (or negative) of a multiply type color operation is called screen or some such, and the formula looks like this:
vec3 result_color = 1.0 - ( (1.0 - color_A) * (1.0 - color_B) );

This is kind of the photo-negative effect of multiply, and is useful for superimposing brighter things on darker things etc.
Also, diff is sometimes useful, it's essentially an absolute-value version of subtract.
Just my $0.02, not saying anyone needs to change the design here, just something to consider.

@emackey this is for the 3D Tiles styling language where Color is a first-class type just like Number, String, etc.  I think it is important that we implement all the sane operators for completeness even if they wouldn't be widely used; think of this like a color that is a vec4 in GLSL.
As for interesting color ideas, feel free post them here: https://github.com/AnalyticalGraphicsInc/3d-tiles/issues/2

P.S. it would be a killer code sprint project to extend 3D Tiles styling with new color operations...gamma correction...lighten...darken...whatever.  We could only put the pragmatic ones in the spec though.

@ggetz code looks good.  Update CHANGES.md.

Updated.

Thanks @ggetz!


parser status (%_) disappears as soon as it's drawn

%_ and %^ become unusable (eg for PROMPT2 and RPROMPT2. They flash briefly before being removed.

Hi, thetic, thanks for this report. I'm not able to reproduce it, though. Can you please try with a clean ~/.zshrc, and report zsh --version, so we can narrow down what is causing it?
Here's what I tried. Let me know what you're doing differently.

I am able to reproduce without my ~/.zshrc by placing ${MODE_INDICATOR_PROMPT} in PS2 or RPS2.

Ah, I see. I'll look into this, I've never used R/PS2 settings with it and don't take any care to make it work, but it should get fixed.

This looks impossible to fix fully. The '%' expansion is the only method for exposing the cmdstack values that are kept inside zsh/Src/prompt.c, and the cmdstack is hidden away during line editing. So the only % that's available is whatever is going on inside the zle hooks at the time that reset-prompt is called. I.e., if the last time reset-prompt was called was inside a for loop and then inside an if, then %_ will be replaced with for then. Which is pretty confusing.
I've pushed a partial fix that at least leaves the %_ in place if you don't change modes, and just stay in insert mode. Once you hit escape, %_ will get cleared (or worse, if anybody else is hooking in and calling reset-prompt.
Note that this problem happens regardless of whether ${MODE_INDICATOR_PROMPT} is set in RPS2 or not. I made a typo in my first test, but this problem shows up regardless of that.
I'd appreciate hearing back if this minimizes the problem enough for you to feel that it works as it "should" given the circumstances.

I think I've fixed that (and a number of other things).

Fixed in 734931db


Accept unfinalized readonly classes

I made this pull request to accept readonly classes, for instance this class is detected as non-final by the command but nothing's  changed :
<?php
readonly class MyAwesomeClass {
}

Like this ?

Looks good, thank you @niji-ahubert :clap:


Re-structure extensions documentation in integrators-guide

In a recent issue I found out the use of ExtensionGroups, and saw it's not documented.
I wanted to add it, but then though it could be a chance to improve the overall section to accomodate the new docs.
Right now, to me how it's explained is a bit confusing.
At the beginning of the section we say:
To create an extension two things are required:

1. Create a class extending one of the extension classes from above
2. Register your class using the JavaExtensionRegistry class

But, then we jump into the AST stating knowing about it is also a pre-requisit.
After that, we explain at the same section depth:

Each extension type and for each how to register directly using asciidoctor.javaExtensionRegistry().
How register with SPI automatically

This is the tree as seen in Intellj plugin (excuse the bug showing the cols and note as sections):

I think it would be easier if we beging saying there are "three steps":

Briefly understand how Asciidoctor converts documents -> we can talk about AST + how extension plug into it without much detail since extensions are explained later on it's own section. We should not make this cumbersome or overly complex not to discourage people, I can imagine that hearing AST right at the start can be dauning for some.
How to create an AsciidoctorJ extension -> here we aggregate the extension types, and remove the duplicated examplations about asciidoctor.javaExtensionRegistry() from each.
How to register your extension -> here, in 3 subsections (level 4 in depth) we explain:

Manual registering (so we remove duplciation in previous section)
SPI
ExtensionGroups

I tend to have this rule in which if an introduction mentions a list of key elements, then each point/number should map to a sub-section. wdyt?
Related to this I have some questions:

Should we recomend ExtensionGroups above the other methods? It seems to me this is simpler and more flexible since it allows un-registering, and also does not leak the java implementation. Are there any pros-cons of using manual vs the groups? For SPI there's a clear advantage of automatic detection
Is there a set of JVM languages we can mention with confidence other than Java and Groovy? This is OSS so I don't think we need to fully commit or talk about "support", but i'd be nice if we can mantion some that we feel confident about.

I tend to have this rule in which if an introduction mentions a list of key elements, then each point/number should map to a sub-section. wdyt?

That's a very good idea.

Should we recomend ExtensionGroups above the other methods? It seems to me this is simpler and more flexible since it allows un-registering, and also does not leak the java implementation. Are there any pros-cons of using manual vs the groups? For SPI there's a clear advantage of automatic detection

About this I am unsure and it probably depends on what you are doing.
For a simple one-off task I would always prefer the version without ExtensionGroup because it is less code.
But I agree, in server environments that might be different.
So it would be great to document both approaches.

Is there a set of JVM languages we can mention with confidence other than Java and Groovy? This is OSS so I don't think we need to fully commit or talk about "support", but i'd be nice if we can mantion some that we feel confident about.

You mean about using AsciidoctorJ in Scala or Kotlin?
Definitely sth to test and document.
Thanks for creating this issue! 🚀

Definitely sth to test and document.

:sweat_smile: I was hoping to avoid delving too much.
I'll stick with Java and groovy which are well known and in some future see if I can find time for the others.

I just noticed docs seem duplicated under /docs an in asciidoctorj-documentation project. How should I update?


[Issue] Could not find bin/sort.dart in package arb_utils.

After executing flutter pub run arb_utils:sort lib/l10n/intl_en.arb the command returns:
Could not find bin/sort.dart in package arb_utils.
pub finished with exit code 66

flutterSdkVersion= 3.0.5
package version: 0.4.0
Thanks!

@mirland See https://github.com/Rodsevich/arb_utils/issues/6 for context, but in short the command has changed a bit:
See the revised commands at https://github.com/Rodsevich/arb_utils#bin-scripts
If you need or want to run from flutter pub run, then flutter pub run arb_utils sort lib/l10n/intl_en.arb should work.

Daniel, thanks for the quick response. It worked perfectly.
You should release a new version with the metadata change because pub.dev doc is old

Thanks!


Debugging Incomplete Writers

Hello, running version 2.4 and copying records from one AWS ES cluster to another. I'm getting the following output
Wed, 10 Aug 2016 16:21:36 GMT | got 50 objects from source elasticsearch (offset: 0)
Wed, 10 Aug 2016 16:21:37 GMT | sent 50 objects to destination elasticsearch, wrote 48
Wed, 10 Aug 2016 16:21:38 GMT | got 50 objects from source elasticsearch (offset: 50)
Wed, 10 Aug 2016 16:21:39 GMT | sent 50 objects to destination elasticsearch, wrote 49
Wed, 10 Aug 2016 16:21:39 GMT | got 50 objects from source elasticsearch (offset: 100)
Wed, 10 Aug 2016 16:21:39 GMT | sent 50 objects to destination elasticsearch, wrote 47
Wed, 10 Aug 2016 16:21:40 GMT | got 50 objects from source elasticsearch (offset: 150)
Wed, 10 Aug 2016 16:21:40 GMT | sent 50 objects to destination elasticsearch, wrote 48
Wed, 10 Aug 2016 16:21:41 GMT | got 50 objects from source elasticsearch (offset: 200)
Wed, 10 Aug 2016 16:21:41 GMT | sent 50 objects to destination elasticsearch, wrote 47
Wed, 10 Aug 2016 16:21:41 GMT | got 50 objects from source elasticsearch (offset: 250)
Wed, 10 Aug 2016 16:21:42 GMT | sent 50 objects to destination elasticsearch, wrote 49
Wed, 10 Aug 2016 16:21:43 GMT | got 50 objects from source elasticsearch (offset: 300)
Wed, 10 Aug 2016 16:21:44 GMT | sent 50 objects to destination elasticsearch, wrote 50
Wed, 10 Aug 2016 16:21:44 GMT | got 50 objects from source elasticsearch (offset: 350)
Wed, 10 Aug 2016 16:21:45 GMT | sent 50 objects to destination elasticsearch, wrote 48
Wed, 10 Aug 2016 16:21:45 GMT | got 50 objects from source elasticsearch (offset: 400)
Wed, 10 Aug 2016 16:21:46 GMT | sent 50 objects to destination elasticsearch, wrote 49
Wed, 10 Aug 2016 16:21:46 GMT | got 50 objects from source elasticsearch (offset: 450)
Wed, 10 Aug 2016 16:21:47 GMT | sent 50 objects to destination elasticsearch, wrote 42

Using the following command
./elasticdump --input=$INPUT --input-index=$INDEX --output=$OUTPUT --output-index=$INDEX --type=data --limit=50 --bulk=true

Tried with different permutations of limits and bulk setting. No luck. Is there a good way to debug the rows that it's not writing? When it fetches 50 and writes 49, i'd love to see why it's not writing that one row.

+1

+1

+1

+1

+1

+1

+1

+1

Have you tried the --debug flag?  That will print out the request query being sent to ES, and then the JSON that it is trying to write to disk.   You can then isolate the write command, try it manually, and see what happens.
Also, note that the --bulk options have been removed.

Hi we tried --debug option, we removed also --bulk option however it looks like the --limit option is ignored and we cannot see which records are not inserted from debug output

we also think it can have something to do with the encoding of the data, basically the difference between ES stacks or file when we dump first to file and import form file. FYI we use ES Service from Amazon and migrating data from our installation of ES.

So, I had this problem when I was taking from ES 1.5 and moving it to ES 2.3. The errors were related to how 2.3 was handling nested mappings in a way that is different from how 1.5 handled nesting mappings. I was able to use the --debug flag to see the queries and then just manually re-tried a set until I could find the error. Is it worth considering having the --debug flag also throw out the JSON that is returned from ES upon insertion? If so, I'd be happy to submit a PR for this.

@haydenth You are right. I tried to migrate one small index to ES 2.3 and all records were inserted. So it looks like that in some cases mappings between 1.5 and 2.x versions are not compatible.

Thanks @haydenth.  Sadly, converting index settings between ES versions seems out-of-scope for this project.

@haydenth please submit that PR with the output!  Perhaps only on error?


Axioms for 'organism identification datum' and its children

Currently the associated assays have axioms, but the data terms do not.
Would equivalent axioms be appropriate for these data terms, and if so, how should we go about constructing them?
'organism detection datum' could have 'data item' and is_specified_output_of some 'organism detection assay'.
'blood microbiology datum' could have 'organism detection datum' and is_specified_output_of some 'blood microbiology assay' (and so on for children of 'organism detection datum').
EDIT: since we now have an 'organism detection assay' terms, I changed "identification" here to "detection".

That would certainly work. Primary question is if we really want / need to
pre-compose all possible data items like that?
On Mon, Oct 17, 2022 at 6:45 AM John Judkins @.***>
wrote:

Currently the associated assays have axioms, but the data terms do not.
Would equivalent axioms be appropriate for these data terms, and if so,
how should we go about constructing them?
'organism identification datum' could have 'data item' and
is_specified_output_of some 'organism identification assay'.
'blood microbiology datum' could have 'organism identification datum' and
is_specified_output_of some 'blood microbiology assay' (and so on for
children of 'organism identification datum').
—
Reply to this email directly, view it on GitHub
https://github.com/obi-ontology/obi/issues/1615, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADJX2IRF3JOBZX7HCLD2AL3WDVJ7BANCNFSM6AAAAAARHC3DXU
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

--
Bjoern Peters
Professor
La Jolla Institute for Immunology
9420 Athena Circle
La Jolla, CA 92037, USA
Tel: 858/752-6914
Fax: 858/752-6987
http://www.liai.org/pages/faculty-peters

Besides, I propose the subClass logical axioms of specimen specific datum, such as blood assay datum should change to equivalent axioms as well.
'blood assay datum' = data item and is_specified_output_of some blood assay
Current, blood microbiology assay is asserted as a subClassOf organism identification assay and inferred as a subClassOf blood assay.
However, the output of these assays are not organized same as the assays. blood microbiology datum is asserted as a subClassOf organism identification datum but not inferred as a subClassOf blood assay datum

2023-02-06 Will go ahead with changes in template, but must be sure to run Hermit reasoning. Also will change 'organism identification datum' to 'organism detection datum' to match assay term. Also will change some definitions to match equivalent axiom (will mention specific changes in PR).
OBI:0003498: change input axiom to 'HSI some specimen', change definition to "An assay that detects a type of organism and/or the quantity of individuals of a type of organism, in a specimen."
microbiology assays: will remove 'HSI some organism' (organism is already bearer of measurand role)


CASSANDRA-12148 cdc hard-link support

@mambocab can you review?

Yep.

Should have mentioned this Friday -- I'm making a number of stylistic changes in a branch, which I'll link here soon. Don't worry about my nits above.

I've addressed some style nits I had here:
https://github.com/riptano/cassandra-dtest/compare/master...mambocab:pull-1244_style
and rebased that onto master here:
https://github.com/riptano/cassandra-dtest/compare/master...mambocab:pull-1244_style_rebase

Ping @josh-mckenzie -- just confirming you saw my proposed changes.

I a) did (thanks to Philip pinging me earlier this week), b) actually got this notification (gasp), and c) can actually move on this now that I know some procedural things regarding this effort. I'm planning on rebasing the C* branch early next week and re-running CI, then getting to this as well. Might not get to it in that time frame, however, so don't hold your breath.
Thanks.

:+1: Perfect, thanks!

I'm +1 to the stylistic changes. Feel free to merge (after resolving conflicts) and I'll commit 12148 to trunk on the C* side.

Closing in favor of #1332.


[2.5.1] ingres k8s 1.22 v1alpha1.MiddlewareTCP problem

Welcome!

[X] Yes, I've searched similar issues on GitHub and didn't find any.
[X] Yes, I've searched similar issues on the Traefik community forum and didn't find any.

What did you do?
Migrated to k8s 1.22, logs show:
Failed to watch *v1alpha1.MiddlewareTCP: failed to list *v1alpha1.MiddlewareTCP
Similar problem described in #8342 , but it's related to "v1beta1.Ingress failed to list" errors.
It seems, there's serious issues with ingres k8s 1.22.
https://kubernetes.io/blog/2021/07/14/upcoming-changes-in-kubernetes-1-22/#api-changes
Because of that, this crd not working:
    apiVersion: traefik.containo.us/v1alpha1
    kind: Middleware
    metadata:
      name: stripprefix
    spec:
      stripPrefix:
        prefixes:
          - /onlyofficeds

What did you see instead?
Failed to watch *v1alpha1.MiddlewareTCP: failed to list *v1alpha1.MiddlewareTCP
What version of Traefik are you using?
2.5.1
What is your environment & configuration?
k0s 1.22
If applicable, please paste the log output in DEBUG level
No response

Hello @sacesare,
Thanks for your interest in Traefik!
You need to update the CRD definitions as well as the RBAC of Traefik service. You can take a look at the documentation references.
Each time a new CRD resource is created, those definitions are updated in the documentation.


XRE-16281 Adding Gstreamer Audio pipeline for Platco device

Signed-off-by: nrajan002c<EMAIL_ADDRESS>

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

I am closing this outdated PR. If this change set needs to be merged, please resubmit it to the latest sprint branch.


selinux restorecon doesn't work for files on nfs shares

Description
When running chef-client and it creates a file on an nfs share and selinux is enabled, the following error is seen:
restorecon: Could not set context for /nfs-share-dir/test.txt:  Operation not supported
the package installing restorecon is: policycoreutils-2.9-25.el8.x86_64
The error appears to be here: chef/util/selinux.rb
It seems that the initialization of restorecon_flags should just be empty array and not ["-R"]
Chef Version
17.2.7-1.el8
Platform Version
This is on an Almalinux 8 system 4.18.0-553.el8_10.x86_64
Replication Case
Need to make sure nfs-server is installed and running along with selinux is enabled.  It can be either Permissive or Enforcing
Have a system with an NFS share mounted with RW permissions.
sudo mkdir /nfs-share
sudo mkdir /nfs-mount
sudo bash -c  'echo "/nfs-share *(rw,sync,no_root_squash)" >> /etc/exports'
sudo exportfs -a
sudo mount localhost:/nfs-share /nfs-mount
sudo touch /nfs-share/test.txt
sudo restorecon -R /nfs-mount/test.txt  <-- Just to show that this doesn't work even outside chef
sudo restorecon -R /nfs-share/test.txt  <-- Just to show that this does work outside chef, since it isn't an nfs mounted dir.
sudo rm -f /nfs-share/test.txt
Create the recipe with the following in it:
file "/nfs-mount/test.txt" do
    mode '0644'
    owner 'root'
    group 'root'
end

Then run chef-client on that recipe.
Client Output
 * file[/nfs-mount/test.txt] action create
    - create new file /nfs-mount/test.txt
    - change mode from '' to '0644'
    - change owner from '' to 'root'
    - change group from '' to 'root'
    ================================================================================
    Error executing action `create` on resource 'file[/nfs-mount/test.txt]'
    ================================================================================

    Mixlib::ShellOut::ShellCommandFailed
    ------------------------------------
    Expected process to exit with [0], but received '255'
    ---- Begin output of ["/sbin/restorecon", "-R", "/nfs-mount/test.txt"] ----
    STDOUT:
    STDERR: /sbin/restorecon: Could not set context for /nfs-mount/test.txt:  Operation not supported
    ---- End output of ["/sbin/restorecon", "-R", "/nfs-mount/test.txt"] ----
    Ran ["/sbin/restorecon", "-R", "/nfs-mount/test.txt"] returned 255

Stacktrace

The chef version is actually: 18.2.7-1.el8

Just ran into this with Chef 14.15.6. Curiously, it works on Amazon Linux 2, but we're trying to update to Amazon Linux 2023, which encounters this "operation not supported" error when touching a file on an Amazon EFS disk.


fix: Search not working

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 59.76%. Comparing base (7be6357) to head (746891c).

Additional details and impacted files
@@           Coverage Diff           @@
##             main      #93   +/-   ##
=======================================
  Coverage   59.76%   59.76%
=======================================
  Files          21       21
  Lines         671      671
=======================================
  Hits          401      401
  Misses        270      270

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Invalid XHTML

Hi,
First of all: Thanks for your work, this is indeed awesome. I did something similar for our project documentation, but your solution is much cleaner and more comprehensive. I immediately adopted it, see our user guide for an example. I did some minor changes, mostly to the sidebar, maybe you are interested in some of those.
Anyway, the main issue I had was invalid XHTML markup: If you run your site through the W3C validator you'll notice a couple of issues you might want to fix.
Thanks,
Daniel

Thanks for pointing that out, it seems like I have mixed in some html5 by accident...
Thanks for sending me a link of your documentation, it's always helpful to see what others do with the theme!
I like the style of the arrows in the sidebar! It seems like the adjustments that you made don't work for the dark theme, though:

If you don't want / don't care about dark mode you will be able to disable it in the upcoming release by setting
<html class="light-mode">

Thanks for spotting, fixed. Only tested dark mode on mobile.
For the arrows I simply override the icon used in navtree.js by adding a snippet to my header.html:
<script type="text/javascript">
  var arrowRight = '▷';
</script>


Shoot hibernate/wake-up is blocked by admission controller working on leases even when failurePolicy=Ignore and timeout=10s

How to categorize this issue?

/area ops-productivity
/kind bug
What happened:
Gardener has not disallowed hibernation for a shoot cluster configured with admission webhook affecting leases with failurePolicy=Ignore and timeout=10s.
Some controllers, like KCM, are doing their leader election on leases in the kube-system namespace. As a client, KCM acquire the leader election with longer timeout, however it maintains it with timeout of 5s and this is not enough, when there is such webhook and it is not available. In this case, KCM just logs
E0312 14:57:22.228821       1 leaderelection.go:367] Failed to update lock: Put "https://kube-apiserver/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

Sometimes the hibernation might fail, depending on how quickly prerequisites for the hibernation will be executed (like all pods to be deleted). If the endpoints for the webhook were not removed from the cluster, waking up the cluster also fails because KCM cannot start and without running KCM:

no machine can join the cluster
no pods for the webhook backend are created

What you expected to happen:
The hibernation to not be allowed when there is a webhook affecting leases in the kube-system namespace even when the failurePolicy=Ignore and timeout=10s.
How to reproduce it (as minimally and precisely as possible):

Create a shoot cluster.
Create a dummy webhook backend

kubeclt create namespace block-hibernation
kubectl -n block-hibernation create deployment webhook --image=nginx
kubectl -n block-hibernation expose deployment webhook --port 10443 --target-port 10443

Create the following webhook

apiVersion: admissionregistration.k8s.io/v1
kind: ValidatingWebhookConfiguration
metadata:
  name: block-hibernation
webhooks:
- admissionReviewVersions:
  - v1beta1
  clientConfig:
    caBundle: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUREakNDQWZhZ0F3SUJBZ0lVS0RhRkp0Ym5lWmFZcGVURzdFamVscURuRS9Nd0RRWUpLb1pJaHZjTkFRRUwKQlFBd0h6RWRNQnNHQTFVRUF4TVVZMkV0WW14dlkyc3RhR2xpWlhKdVlYUnBiMjR3SGhjTk1qTXdNekE0TURnMApOekF3V2hjTk1qZ3dNekEyTURnME56QXdXakFmTVIwd0d3WURWUVFERXhSallTMWliRzlqYXkxb2FXSmxjbTVoCmRHbHZiakNDQVNJd0RRWUpLb1pJaHZjTkFRRUJCUUFEZ2dFUEFEQ0NBUW9DZ2dFQkFNbWtWS2ZEUTVrdVZBcy8KbnB3Z21CUDgydVVrZTVwMjUzUzBDUGlsVllYcExkTjdaTzRyQ1Y0WGU2c2tFOS91RnlNNS84eUdBckYvNlZwdgplcG9LTUswbzJKdWplNDJhWWF4N0pMbFlDV0RNK0pSamc5eWZhTjhvQU1hNXlrR3ZXQ0JwTW5PWXZwY1QrL2xoCmxkblFZd3pXUi90WWJRbW81b2tLNmhheER4M21RbU1Bb0hISHZiQXdZRlpMTHMyY1dyc01jcHNzb2loVHhpWnQKUUYvSFFlb2YwRERFcEpUMHRWUWpwNEhJQnArQVFtVHZiODVaUGczLytuZ2FGclAxWGFlWVg3UkxXcUpkL0hjNwpvQjRMZi9FeFRxbVBWYzdQQkNhc3VXOGF1SCsxbUIxendMR0lSTGNuM2pUQVRBR3IwWHJvNWQ1ajNFODVMcGc0CmMyUkZoNWtDQXdFQUFhTkNNRUF3RGdZRFZSMFBBUUgvQkFRREFnRUdNQThHQTFVZEV3RUIvd1FGTUFNQkFmOHcKSFFZRFZSME9CQllFRkw4REZ5UGQ4Vm0vQ0Y1aTd4b2dST1FzQmE1a01BMEdDU3FHU0liM0RRRUJDd1VBQTRJQgpBUUJlSERRSHZHREdCTlAxTE9JaFZnTDFZT1NYQWdPWWUxVFAyNUZwZzdsbGJuWTA1YWhaRzkwbTI3cFJNdHBECkU1Z3N0cXhsUE9LM1Q2Z0xEUmhHVVhPT05CQ2gveU1kVDFhZ3IxMTZrQ216aUcwNDFicFpNTWNNOU5uKzdDMWoKM1NWQ0dnQXdBemtwekNTSmRsbDBZNzluWlpua2lJakZOcHhBRTczRnltQkZLRGtLRG5zZVZhckNHa1dMWndyQgo5aklZc0k3SGlrenVYd3o5THJlVC8xYW5GdVd5b21JTDUyeDBiRldabmovVXVVYkZhYU00RW5jZm54d3ZGUzlJCjk4L0R4Y1VPT1ovbDZaWENTWmFsY3h2UkhFb3lQWHhvQ21hYks3ZDlQZFNHWXZKYzNtUHA5SVhkeG1Ca01KZFEKYWVreDM3bnV2RVBiSitlVVdWajlkKzdWCi0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K
    service:
      name: webhook
      namespace: block-hibernation
      path: /validate/fail
      port: 10443
  failurePolicy: Ignore
  matchPolicy: Equivalent
  name: validate.block.hibernation
  namespaceSelector: {}
  objectSelector: {}
  rules:
  - apiGroups:
    - coordination.k8s.io
    apiVersions:
    - v1
    operations:
    - UPDATE
    resources:
    - leases
    scope: '*'
  sideEffects: NoneOnDryRun
  timeoutSeconds: 10

See that the shoot constraint HibernationPossible is not set to False.
Hibernate the cluster and see it eventually fails to hibernate (for example, there are still Running pods and KCM already lost its leadership).
Wake-up the cluster and see it eventually fails to wake-up (the Endpoint for the webhook backend need to have some pod IPs, otherwise API server fails early and the 5s timeout does not occur).

Anything else we need to know?:
Environment:

Gardener version: v1.66.0
Kubernetes version (use kubectl version):
Cloud provider or hardware configuration:
Others:

/assign


Scale box rendering?

https://www.youtube.com/watch?v=ieyeQifzqio

And scale box make other player invisible?


Update neo4j_graph.py

Remove the version dependencies of neo4j-driver.
neo4j-driver Test code of different versions.
Your PR Title (What it does)

Fixes # (issue)
Before submitting

Who can review?
Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested:

@hwchase17 Exception catching is nicely encapsulated in the neo4j-driver, so there is no need for secondary judgment in the application code.  This avoids problems with different driver versions as much as possible.

这是来自QQ邮箱的假期自动回复邮件。你好，我最近正在休假中，无法亲自回复你的邮件。我将在假期结束后，尽快给你回复。


Support subparser

Codecov Report

Merging #14 into master will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master      #14   +/-   ##
=======================================
  Coverage   94.52%   94.52%
=======================================
  Files           4        4
  Lines         201      201
=======================================
  Hits          190      190
  Misses         11       11

Impacted Files
Coverage Δ

hpargparse/hputils.py
94.35% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f650292...8ae1352. Read the comment docs.


Update On Old Roadmap

See #657 for old road map.

Once kernelspecs can detect the default python installation we should switch to it for kernel detection. This would remove jupyter as an external dependency and make kernel detection faster.

I would love to switch to enchannel-zmq and rx-jupyter for kernel messaging

@BenRussert Have either of these been implemented to hydrogen? If not are they still planned, and do we still want these features?

@BenRussert bump

Answered by #1693


Uncaught SyntaxError: Unexpected token <

I'm getting the following error while trying to use the HTTP service example (https://angular.io/docs/ts/latest/api/http/Http-class.html):
Uncaught SyntaxError: Unexpected token <
Evaluating http://localhost:3000/angular2/http
Error loading http://localhost:3000/app/boot.js
angular2-polyfills.js:138
Tried it on Chrome and Firefox.
Code:
import {Component} from 'angular2/core';
import {Http, HTTP_PROVIDERS} from 'angular2/http';
@Component({
selector: 'my-app',
viewProviders: [HTTP_PROVIDERS],
template: 'Test Http page'
})
export class HttpComponent {
}
It works if I remove the line -
'viewProviders: [HTTP_PROVIDERS]'

@milesholt you have to add the http bundle
For example
<script src=".../http.dev.js"></script>

That worked, thanks


Update cleanup.sh to handle more files automatically

Resolves
None
Proposed Changes
Improves the cleanup script for helping blockly->scratch-blocks merges.  It now deals with most files that are not in core.

Handle more files
Clean up output

If I'm missing out on best practices for scripts like this, please let me know.
Reason for Changes
Ergonomics.
Test Coverage
I pulled from blockly (git pull https://github.com/google/blockly.git develop) and ran this.

@rachel-fenichel, looks okay to me. I think there should be more comments about usage up at the top, though it does look like using it incorrectly should not break things. I'm worried about weird edge cases and accidentally rm -rfing the wrong thing if this is run this from the wrong directory or something. Maybe there should be a check and early bail out if this is run from the wrong directory...?

@kchadha note that it's git rm -rf, so failure won't actually rm -rf all the things.  Also that it's done in the context of a git merge, so you usually can just back out with git merge --abort (which is what I did repeatedly while testing it).
What additional comments/checks/bail outs do you want me to add?  Happy to do so, but I don't know how to check that I'm in the right place.

@rachel-fenichel ah, oops yep re: git rm -rf.  The fact that it's done in the context of a merge should be documented somewhere (within comments in the script itself, a --help, in the README of this repo, or maybe even in the name of the script) b/c there's nothing really stopping users from running ./cleanup.sh at any other point.
The script also has cds which assume that you're running this script from the directory it's located in. You can add a check at the top which checks if the current working directory is the same as the directory that the script itself is located in. I only did a quick google search for this, but this might be useful:
https://stackoverflow.com/questions/59895/getting-the-source-directory-of-a-bash-script-from-within
FWIW, this PR is good to go, these suggestions don't need to block this merge!


BinaryAccuracy() sometimes gives incorrect answers due to non-deterministic sigmoiding

🐛 Bug
torchmetrics.classification.BinaryAccuracy will apply a sigmoid to some inputs but not others leading to incorrect behavior.
Details
The current behavior of BinaryAccuracy() is to apply a sigmoid transformation if the inputs are outside of [0, 1] before binarizing

If preds is a floating point tensor with values outside [0,1] range we consider the input to be logits and will auto apply sigmoid per element.

i.e.
y_hat = 1(sigmoid(z) >= threshold) if z outside [0, 1]
y_hat = 1(z >= threshold) if z inside [0, 1]
I assume z inside [0, 1] is checked for then entire batch (i.e. if one element of the batch is outside [0, 1] then we apply the sigmoid to everyone).
This will cause silent errors. In particular, if the user inputs logits then they expect the logits to always be sigmoided. However, it is totally possible for all of the logits to lie in [0, 1] for some batches in which case the input will not be sigmoided which will cause incorrect thresholding.
To Reproduce
Here is a simple example. Support our network outputs logits.
from torchmetrics.classification import BinaryAccuracy
from scipy.special import expit # expit = sigmoid
import numpy as np
import torch

This example should lead to a correct prediction
probability_thresh = 0.5
logits = np.array([0.49]) # network output
target = np.array([1])

# logits of 0.49 give a probability of 0.62 indicating class 1, the correct prediction
expit(logits)
array([0.62010643])
int(expit(logits) >= probability_thresh) == target
True

BinaryAccuracy() however thinks it's an incorrect prediction~
# torchmetrics, however, thinks we have the inccorect prediction because it does NOT sigmoid the logits
ba = BinaryAccuracy(threshold=probability_thresh)
ba.forward(preds=torch.tensor(logits), target=torch.tensor(target))
tensor(0.)

Suggested Fix
I suggest adding an argument indicating whether or not the input predictions are sigmoided so the inputs are either always sigmoided or never sigmoided

Looks like a similar thing happens in MultilabelAccuracy (https://torchmetrics.readthedocs.io/en/stable/classification/accuracy.html)


Cant create project/task from large backup

My actions before raising this issue

[x] Read/searched the docs
[x] Searched past issues

Expected Behaviour

Project and task should be created
Current Behaviour

Request Entity Too Large 413 error is displayed

Possible Solution

Integrate TUS uploads for backups
Steps to Reproduce (for bugs)

Create project from backup with large file (>1.5gb)
An error is displayed

Context

Your Environment

Git hash commit (git log -1): 449ae0c5bfa0cdc84e2cbff72eede181f5f3aaa6
Docker version docker version (e.g. Docker 17.0.05): 20.10.12
Are you using Docker Swarm or Kubernetes?
Operating System and version (e.g. Linux, Windows, MacOS): Linux
Code example or link to GitHub repo or gist to reproduce problem:
Other diagnostic information / logs:
Logs from `cvat` container

Next steps
You may join our Gitter channel for community support.

Resolved


Taxonomy (second attempt)

Alright folks, this brings tags (back) in. When I have gained more confidence that this works as expected I'll merge and it will be minor release 0.8. This is one of the main missing feature that I really wanted to add in Franklin.
I'd like some help to check it has the right behaviour. Basic stuff is unit-tested but the overall working of the tags is a bit subtle in terms of cleaning things up when tags are added/removed while the server is running.
To test this
Just add @def tags = [...] on meaningful pages. The first run will force-add a basic _layout/tag.html page which will be the mould for all generate tag pages. You should tweak this so that it respects the style of the rest of your pages. In the future it will be part of templates.
The function {{taglist}} could be replaced by your own function {{customTaglist}} by adding a hfun_customTaglist in your utils.jl but let's maybe not worry about that right now.
The basic one {{taglist}} just adds the list of pages corresponding to  the tag by reverse chronological order.
The very important thing to note is that _layout/tag.html must not depend on local page variable. It can only:

use global page variables
use page variable via {{fill var path/to/page}}

The only  exception is fd_tag which contains the tag name. This you can use in the title for instance. For convenience let's reproduce the default HTML with some comments:
<!doctype html>

  <meta charset="UTF-8">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <title>Tag: {{fill fd_tag}}</title>

    {{taglist}}

You can see the {{fill fd_tag}} this will fill the tag name
You can  see the {{taglist}} function which will generate something like

Title if it exists

Title if it exists

Finally you can still use {{ispage /tag/tagname/}}...{{end}} to change the style depending on which tag page you're on.

Some comments:
I think the default tag.html in _layout should include the head and foot.
My setup:
{{insert head.html }}

    {{taglist}}

{{insert foot.html}}

The links doesn't work for me i.e
A href linking to /blog/constraint-solver-table-constraint/index/ is created but it should be /blog/constraint-solver-table-constraint/ or with index.html in the end.
Adding, deleting tags seem to work for me ;)

Thanks for the feedback!

link ending with index, yes I noticed that, simple fix coming
adding head  and foot, so actually that cannot be the case because tag pages must not depend on local page var but, by default,  head and  foot will typically  have things like {{fill title}} etc which are ambiguous in generated pages.

The new templates show how one can do this (e.g.: https://github.com/tlienart/FranklinTemplates.jl/tree/tags/src/templates/basic/_layout), basically make the content of head more modular, and plug those blocks also in tag.html.

I see yeah I've changed my foot and head accordingly but your decision makes sense then I guess.
The fix doesn't seem to have worked for me. I did ] add Franklin#tags2 again hope that should be enough

Sorry the initial fix was something else, the actual fix will be in soon, thanks!

Now in 😄

I've updated all templates, will play with this a bit more and merge tomorrow I think.

Haha now the href is just / :rofl:

oops

fixed... dumb typo

How to check if a page has a tag in templates?

@newptcai please post in issues not in PR, tags will be advertised in the NEWS section soon. {{ispage /tag/tagname/}} works.


Pixhawk + Pi5

Hi,
I had a setup with a Pixhawk and a Pi3 connected via UART on GPIO connector which was working fine.
I wanted to switch to a Pi5, everything went well, mavlink-router starts and loads the same config file from my old setup correctly.
I made sure to say no and yes to the serial port activation.
My ground station is connected in the same way and I checked if the IPs match.
For me, I'm not receiving any information via the UART port, but do you have a solution?

i solved,
i use "/dev/ttyAMA0" in my /etc/mavlink-router/main.conf file.
it's work ;)


patch vars fails

What happened?
I would like to set a variable value depending on profile. However, patching fails; for example, the configuration:
version: v1beta6
vars:
- name: foo
  source: env
  default: bar

profiles:
- name: test
  patches:
  - op: replace
    path: vars[0].default
    value: baz

Produces:
% devspace use profile test
[info]   Successfully switched to profile 'test'
% devspace print
[fatal]  apply patches: yamlpatch replace operation does not apply: doc is missing path: /vars/0/default

What did you expect to happen instead?
For the configuration to be printed, displaying the variable 'foo' set to value 'baz' at the top.
How can we reproduce the bug? (as minimally and precisely as possible)
The configuration above should be sufficient.
Local Environment:

Operating System: mac
Deployment method: n.a.

Kubernetes Cluster:

Cloud Provider: n.a.
Kubernetes Version: n.a.

Anything else we need to know?
I assume variables are stripped out earlier in process. If it is hard to support patching variables, it should be documented. To support per-profile variable values, a vars section could be added to profiles -- such that variables in the profile configuration override those in the main configuration if they have the same names.

/kind bug

@shaunc thanks for opening this issue! Yes you are correct, it is currently not possible to patch variables as well as commands, because these parts are stripped out during the actual config loading process. We can think about supporting this, I actually think this is not very hard to implement.

Thanks for the fix!


Create a collection from a STIX bundle

As an individual or organization seeking to share a custom ATT&CK dataset, I want to be able to create a collection from a STIX bundle so that it can be imported into ATT&CK Workbench.
Create a collection-creation script which takes a STIX 2.0 or STIX 2.1 bundle as argument and outputs a new STIX 2.1 bundle containing a collection object which references the contents of the bundle.

If the input bundle contains STIX 2.0 data, it will need to be first converted to STIX 2.1. The STIX Stepper may be able to do this.
A CLI should also be provided so that the user can easily convert bundles on their filesystem.

#27, #28 and #29 should reside inside of a new module, collections, e.g from mitreattack.collections import bundleToCollection


Authority

Authority is coming through as a single variable but it needs to be passed to the track model along with a track line and train ID variable so that there can be an authority associated with a specific train.

Not getting authority


Support for Avro schema on createProducer

Would it be possible to add a schema property on the config object that initializes createProducer? Similar to what Python does, we could initialize avro-js with the JSON schema and call type.getSchema() to initialize the producer.
Having to disable schema validation on topics isn't ideal for some cases and I think only Java and Python are the clients that have schema support.
A pseudo code would look like:
    const client = new Pulsar.Client({
      serviceUrl: 'pulsar://localhost:6650',
    });

    const type = avro.parse({
      name: 'Pet',
      type: 'record',
      fields: [
        {name: 'kind', type: {name: 'Kind', type: 'enum', symbols: ['CAT', 'DOG']}},
        {name: 'name', type: 'string'}
      ]
    });

    const producer = await client.createProducer({
      topic: 'persistent://public/default/my-topic',
      schema: type.getSchema(),
    });

I'm not sure if the schema validation happens on the client when creating the producer, even if that is the case avro-js has methods to check whether JS objects are valid for a given schema.
On that same line, alternatively, is there any guidelines on how to implement a client? What makes it more difficult for me is that I don't know c++ and I would like to contribute with the JS library (specially Typescript).

I was wondering the same. What would be required to add Avro support via a schema property? Thanks.


Add truncate option

Adds an option to truncate a table!
this adds a wrapper CurrentTableTransforms which can either be a Truncate or a list of Columns with transformers

Hey @danturn, can you add some more details on what this change is doing, what the intended use case is and how it works, to make it easier for me to review.
Is it also possible to add a note to the README on how to use this new option

Hey @danturn, can you add some more details on what this change is doing, what the intended use case is and how it works, to make it easier for me to review.
Is it also possible to add a note to the README on how to use this new option

Heya!
I've updated the readme, and the PR description, hopefully its clearer now
lmk if you need any more info


Add option to skip statree index evaluation during query

Currently, there are some cases where Startree index might not work properly (such as using aggregation with OR filters). For such cases, we can have the option in query itself to skip startree index.

Codecov Report

Merging #8737 (72ec8d9) into master (b4c4585) will decrease coverage by 55.43%.
The diff coverage is 0.00%.

@@              Coverage Diff              @@
##             master    #8737       +/-   ##
=============================================
- Coverage     69.67%   14.24%   -55.44%
+ Complexity     4612      168     -4444
=============================================
  Files          1730     1684       -46
  Lines         90312    88349     -1963
  Branches      13421    13206      -215
=============================================
- Hits          62928    12582    -50346
- Misses        23015    74825    +51810
+ Partials       4369      942     -3427

Flag
Coverage Δ

integration1
?

integration2
?

unittests1
?

unittests2
14.24% <0.00%> (-0.04%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b4c4585...72ec8d9. Read the comment docs.

Done. I have kept the methods name though as isSkipStarTree for now since the current logic is that it needs to be disabled explicitly and is enabled by default. Once we reach the stage of where we start making a choice whether to use starTree or not, we can change the method to usStarTree


Feature/code coverage

Add code coverage plugins to plugins.sbt
Add code coverage commands to .travis.yml
Add code coverage badge to the README.md

Changes Unknown when pulling 654c93a1e123b1432835502b215dbb4af84cd651 on feature/code-coverage into ** on develop**.


Enforce octets and croak() if given a string containing code points above U+00FF

This pull request addresses issue #4.

Wonderful, thanks!


Round functions and square root are failing with the new number type

We should try all the numeric functions to see which ones are broken. Using POW with 0.5 fails atm, and using CEIL and FLOOR do too.

Update: CEIL is broken but FLOOR isn't.


Add a DateTime field to CacheEntry and code to Cache to use it and a …

Pull request for initial aged cache implementation.  There are 2 constructors so other than locking the current implementation will work as it already does.  The client code needs to be updated to specify a timer interval and max age to enable the aging behavior.
Room to optimize here but this is functional including a test.

Holding this for now pending further discussion


False-positive Cannot call method on

Bug report
PHPStan 0.12.50
Cannot call method update() on App\Entity\MyEntity|false when it can't be false.
Code snippet that reproduces the problem
/** @var \Doctrine\Common\Collections\Collection<MyEntity> $collection */
if ($collection->isEmpty()) {
    $collection->add($new);
} else {
    $collection->first()->update($new); // Cannot call method update() on App\Entity\MyEntity|false
}

Expected output
There should not be any error, but Cannot call method update() on App\Entity\MyEntity|false raised

This is not a bug but a well-known limitation described in the documentation: https://phpstan.org/writing-php-code/narrowing-types
This can be solved with a simple TypeSpecifyingExtension (https://phpstan.org/developing-extensions/type-specifying-extensions). When isEmpty() is truthy, first() and other methods should return null. When it's falsey, null should be removed from first() and other methods typehints.

@ondrejmirtes I've tried to write a TypeSpecifyingExtension for the case based on some examples I've found in phpstan/phpstan-symfony, but it doesn't work as I expected. Everything I got - PHPStan gives me a new error
Call to method Doctrine\Common\Collections\Collection<int,App\Entity\MyEntity>::isEmpty() will always evaluate to false., and Cannot call method on errors are still there.
Could you please explain what am I doing wrong?
This is my code:
<?php

declare(strict_types=1);

namespace App\PHPStan;

use PhpParser\Node\Expr\MethodCall;
use PHPStan\Analyser\Scope;
use PHPStan\Analyser\SpecifiedTypes;
use PHPStan\Analyser\TypeSpecifier;
use PHPStan\Analyser\TypeSpecifierAwareExtension;
use PHPStan\Analyser\TypeSpecifierContext;
use PHPStan\Broker\Broker;
use PHPStan\Reflection\MethodReflection;
use PHPStan\Reflection\ParametersAcceptorSelector;
use PHPStan\Type\BooleanType;
use PHPStan\Type\MethodTypeSpecifyingExtension;
use PHPStan\Type\TypeCombinator;

final class DoctrineCollectionFirstTypeSpecifyingExtension implements MethodTypeSpecifyingExtension, TypeSpecifierAwareExtension
{
    private const COLLECTION_CLASS = 'Doctrine\Common\Collections\Collection';
    private const IS_EMPTY_METHOD_NAME = 'isEmpty';
    private const FIRST_METHOD_NAME = 'first';

    private Broker $broker;
    private TypeSpecifier $typeSpecifier;

    public function __construct(Broker $broker)
    {
        $this->broker = $broker;
    }

    public function getClass(): string
    {
        return self::COLLECTION_CLASS;
    }

    public function isMethodSupported(
        MethodReflection $methodReflection,
        MethodCall $node,
        TypeSpecifierContext $context
    ): bool {
        return $methodReflection->getName() === self::IS_EMPTY_METHOD_NAME && $context->false();
    }

    public function specifyTypes(
        MethodReflection $methodReflection,
        MethodCall $node,
        Scope $scope,
        TypeSpecifierContext $context
    ): SpecifiedTypes {
        $classReflection = $this->broker->getClass(self::COLLECTION_CLASS);
        $methodVariants = $classReflection->getNativeMethod(self::FIRST_METHOD_NAME)->getVariants();

        return $this->typeSpecifier->create(
            new MethodCall($node->var, self::FIRST_METHOD_NAME),
            TypeCombinator::remove(new BooleanType(), ParametersAcceptorSelector::selectSingle($methodVariants)->getReturnType()),
            $context
        );
    }

    public function setTypeSpecifier(TypeSpecifier $typeSpecifier): void
    {
        $this->typeSpecifier = $typeSpecifier;
    }
}

Please send that as PR so I can do a proper review.

Should be fixed by https://github.com/phpstan/phpstan-doctrine/pull/172

Thank you :)


Changelog for 1.15.10 (#18274)

Frontport #18274
1.15.10 - 2022-01-14

BUGFIXES

Fix inconsistent PR comment counts (#18260) (#18261)
Fix release link broken (#18252) (#18253)
Fix update user from site administration page bug (#18250) (#18251)
Set HeadCommit when creating tags (#18116) (#18173)
Use correct translation key for error messages due to max repo limits (#18135 & #18153) (#18152)
Fix purple color in suggested label colors (#18241) (#18242)

SECURITY

Bump mermaid from 8.10.1 to 8.13.8 (#18198) (#18206)

Everytime I forget this!

done


Cow: Watch iseehair.com

Cow requests the watch of the watch_keyword iseehair\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

iseehair\.com has been seen in 2 true positives, 0 false positives, and 0 NAAs.

Approved by Dragonrage in Charcoal HQ


Proposals to add new feature: playing music after a cycle, motivational quotes, personalized data with peers

Summary:

Add a box for user to paste a Spotify/pandora/youtubeURL to be played every cycle, help boosting the mood
Add random motivational quotes. maybe some external api calls
Stored user data, like school, role, firms, in order to compare with other peers, setting expectation sometimes help motivating myself to work harder.

Let me know what you think

Summary:

Add a box for user to paste a Spotify/pandora/youtubeURL to be played every cycle, help boosting the mood
Add random motivational quotes. maybe some external api calls
Stored user data, like school, role, firms, in order to compare with other peers, setting expectation sometimes help motivating myself to work harder.

Let me know what you think

great, can we have user accounts for saving settings so that user don't need to set it up every time.


file to import not found or unreadable

Hello! I note in the README you mention using Bourbon and Neat via meteor-bower and I'm attempting to do just that (I'm using "mquandalle/meteor-bower").
The issue I've got is that after a meteor reset or in a fresh test environment on Travis-CI, I'm running into what appears to be a race condition with dependency installation. On the first run, I get file to import not found or unreadable: "bourbon" errors which do not occur on subsequent runs of meteor.
Digging through the Meteor docs I don't see a clear way to specify build steps which depend on one another. Any insights as to how to solve this?

I've published a beta based on node-sass 2.0.0-beta, can you see if this is still a problem with this version?

I'm running into constraint issues with the Bourbon and Neat packages, taking a bit too long to figure out a work around at the moment so I'll have to pick it up and try again over the weekend.

I'm unable to get the error disappear at all. Even the second attempt results in the same
file to import not found or unreadable

The folder does not even exist in my local docs
.meteor/local/build/programs/server/assets/packages/<package>

This isn't relevant anymore.


As a datascientist, I want to install maven hosted libraries with it's dependencies in one go so that i don't have to install one by one.

As a datascientist, I want to install maven hosted libraries with it's dependecies in one go so that
i don't have to install one by one.
Expected behavior
When installing package from maven repo using pixiedust, it is expected that pixiedust pull all other
depedencies and install it as well and not just the package specified.
import pixiedust pixiedust.installPackage("org.diana-hep:spark-root_2.11:0.1.7")
So other dependencies like root4j and other dependencies should be downloaded/installed automatically or the api should have option to specify if user would want to install the dependencies or no.
Something similar to  %AddDeps
Actual behavior
pixiedust.installPackage("org.diana-hep:spark-root_2.11:0.1.7")
Downloading package org.diana-hep:spark-root_2.11:0.1.7 to /gpfs/fs01/user/s7b4-b98406426c07e8-2c631c8ff999/data/libs/spark-root_2.11-0.1.7.jar Downloaded 458035 of 458035 bytes   Package org.diana-hep:spark-root_2.11:0.1.7 downloaded successfully Please restart Kernel to complete installation of the new package Successfully added package org.diana-hep:spark-root_2.11:0.1.7 Out[3]: <pixiedust.packageManager.package.Package at 0x7f60bc4d89d0>
Steps to reproduce the behavior
Just run following code:-
import pixiedust pixiedust.installPackage("org.diana-hep:spark-root_2.11:0.1.7")

Moving to 1.1 milestone

@DTAIEB Is there a date for release 1.1?  Likewise, is there a date for when release 1.1 will be rolled out on DSX?

@superdude264 for dsx once the package is released on pypi repo,  you can simply do  pip install  --user --upgrade pixiedust to upgrade from notebook on DSX

@superdude264:  @charles2588 is correct, you can always update the pixiedust package yourself using --user option. However, we try to update the global version of PixieDust on DSX as often as possible. 1.0 will be installed on DSX very soon after we declare it, hopefully this week.


Rancher encryption config gone bust

What kind of request is this (question/bug/enhancement/feature request):
Question/bug
Steps to reproduce (least amount of steps as possible):
We've upgraded our cluster from 2.3.8 to 2.5.5. local cluster is not encrypted but for our managed cluster we use following config provided via rke templates:
rancher_kubernetes_engine_config:
...
  services:
...
      secrets_encryption_config:
        custom_config:
          apiVersion: apiserver.config.k8s.io/v1
          kind: EncryptionConfiguration
          resources:
          - providers:
              - aescbc:
                  keys:
                    - name: key1
                      secret: xxxx
              - identity: {}
            resources:
              - secrets
        enabled: true

And this used to work on 2.3.x without any problems. With 2.5.5 /etc/kubernetes/ssl/encryption.yaml is zeroed and looks like:
apiVersion: apiserver.config.k8s.io/v1
kind: EncryptionConfiguration
resources: []

which basically causes kube-apiserver not to start.
Result:
kube-apiserver not starting
Other details that may be helpful:
Tried without custom_config like:
rancher_kubernetes_engine_config:
...
  services:
...
      secrets_encryption_config:
        enabled: true

and the result was the same.
Tried also spinning literally one node aio cluster with new template and behaviour was the same.
Environment information

Rancher version: 2.5.5
Installation option: H/A

??
Are we doing something that we shouldn't? Did something change? Config matches with the docs.

When using a custom configuration for encrypting data at rest, there is a bug relating to the format that exists in Rancher 2.5.0+.
In 2.4.x, when configuring secrets_encryption_config Rancher would take any case for the keys and adjust them to be the case it needed, and that cycle repeated. In 2.5 however, the cases have to match on submit. The RKE docs linked above display the configuration keys all starting with lowercase, and with this issue that format will not work.
If you set this configuration in 2.4 and you upgraded to 2.5, everything should continue to work, as the configuration's case will still be correct. But if you edit the configuration and change the case of the keys, the cluster will become unavailable. It appears some workloads may continue to run, but the cluster's API server will be unresponsive.
If you start a 2.5 cluster with the configuration containing incorrect cases it will fail to start with the same error.
The workaround in 2.5 is to continue to use the cases that Rancher expects:
secretsEncryptionConfig:
  customConfig:
    Resources:
    - Providers:
      - AESCBC:
          Keys:
          - Name: k-fw5hn
            Secret: <encoded secret>
        AESGCM: null
        Identity: null
        KMS: null
        Secretbox: null
      Resources:
      - secrets
    apiVersion: apiserver.config.k8s.io/v1
    kind: EncryptionConfiguration
  enabled: true

Wow. That worked! Many thanks @dramich!

https://github.com/rancher/rke/pull/2409

On master-head commit id: 5715b8a

Enable custom encryption on the cluster (during creation) by setting this

services:
  kube-api:
    secrets_encryption_config:
      enabled: true
      custom_config:
        apiVersion: apiserver.config.k8s.io/v1
        kind: EncryptionConfiguration
        resources:
        - resources:
          - secrets
          providers:
          - aescbc:
              keys:
              - name: k-fw5hn
                secret: <base64 encoded>
          - identity: {}

Cluster comes up successfully.
On control plane node cat /etc/kubernetes/ssl/encryption.yaml is set with the custom excrption details
Create a secret test in default namespace
ETCDCTL_API=3 etcdctl get /registry/secrets/default/test | hexdump -C --> secret is encrypted


Discord invite is invalid

dlight is exactly the framework I was looking for ages. Thanks for the amazing work. I have noticed that Discord invite link is not working. Please create a new invite.

Here it is: https://discord.gg/sD57p7NakQ

Thanks


[Question]: Are you going to release version with input fields?

Hi. Are you going to add the ability to add input fields in toast?

Hi,
The holiday season is approaching, and I will have some additional time to work on this feature for our upcoming release. In the meantime, please feel free to contribute and create a pull request. I'd be happy to review or extend your work. Thank you.


SAKIII-4279 only display item counts if user has any

https://jira.sakaiproject.org/browse/SAKIII-4279

Verified and merged via squash.


[stdlib] Fix Array.append(contentsOf:) for arguments of type NSArray

Due to a couple of unfortunate circumstances, appending an NSArray instance to an Array instance does not actually append any elements.
The cause is https://github.com/apple/swift/pull/29220, which accidentally optimized away the actual loop that appends the elements in this particular case. (And only this particular case, which is why this wasn’t detected by the test suite.)
When the argument to Array.append(contentsOf:) is of type NSArray, the newElements is [Element] expression is compiled into a runtime check that returns true, eliminating the subsequent loop over the remaining items of the iterator. Sadly, NSArray.underestimatedCount currently returns 0, so the earlier _copyContents call is a noop, so no elements get added to self at all.
Turning the is test into a direct equality check between the metatype instances resolves the issue.
Resolves rdar://70448247

@swift-ci test


Support defining java installations in settings

This is the first step towards supporting toolchains. This introduces support to define custom java installations in the settings script to later be used for toolchain resolution.

@bot-gradle test RFM

OK, I've already triggered ReadyForMerge build for you.


Bump base dependency

The library appears compatible with base 4.8.
I can't figure out how to run the tests. Cabal eludes all my attempts to run them.

Pushed these changes with version <IP_ADDRESS> to hackage. Thanks again @wereHamster!


download the cddd pre training model

Hello, when using (. / download_default_model. SH) to download the cddd pre training model, an error was reported: failed to connect to drive.google COM port 443: connection timeout.
Therefore, I opened the link of the. sh file to download it myself, but the web page cannot be opened (with VPN). I hope to get your help.

Hello. You can download the pre-trained CDDD model from the original repo following this link


refactor: parametrized hard-coded identity auth vars

Which problem does the PR fix?
Part of: https://github.com/camunda/camunda-platform-helm/issues/2403
What's in this PR?
Parametrized hard-coded identity vars allow customization of identity auth vars like clientID and audience.
Checklist
Please make sure to follow our Contributing Guide.

Before opening the PR:

[ ] In the repo's root dir, run make go.update-golden-only.
[ ] There is no other open pull request for the same update/change.
[ ] Tests for charts are added (if needed).
[ ] In-repo documentation are updated (if needed).

After opening the PR:

[ ] Did you sign our CLA (Contributor License Agreement)? It will show once you open the PR.
[ ] Did all checks/tests pass in the PR?

The failed latest jobs should be actually removed as we don't have latest anymore (I will do it in another PR).


[SMALLFIX] Remove unused field

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/18078/
Test PASSed.