Release 0.9.0

Release a new version: 0.9.0
Changeling (Comparison)

Added support for typed collections (#516). Thanks @JrGoodle!
Adjusted GTMergeAnalysis type to use NS_OPTIONS (#522). Thanks @slavikus!
Silence umbrella header warnings (#523). Thanks @joshaber!
Remove isGitDirectory: (#527). Thanks @pietbrauer!
Expose moveHEAD (#533). Thanks @phatblat!

I created a 0.8.9 release (https://github.com/libgit2/objective-git/releases/tag/0.8.9) but I haven't been able to create a binary for it. When I try, I get:
target 'Nimble-iOS' has bitcode disabled (ENABLE_BITCODE = NO), but it is required for the 'appletvos' platform

Possibly the same as SwiftJSON is seeing: https://github.com/SwiftyJSON/SwiftyJSON/issues/327#issuecomment-160602150?
Any ideas? Anyone else able to create a binary? (carthage build --no-skip-current)

I created a 0.8.9 release (https://github.com/libgit2/objective-git/releases/tag/0.8.9) but I haven't been able to create a binary for it. When I try, I get:
target 'Nimble-iOS' has bitcode disabled (ENABLE_BITCODE = NO), but it is required for the 'appletvos' platform

Possibly the same as SwiftJSON is seeing: https://github.com/SwiftyJSON/SwiftyJSON/issues/327#issuecomment-160602150?
Any ideas? Anyone else able to create a binary? (carthage build --no-skip-current)

Sweet, can try tomorrow. Why 0.8.9 though? Isn't the NS_OPTIONS change is a breaking change?

Sweet, can try tomorrow. Why 0.8.9 though? Isn't the NS_OPTIONS change is a breaking change?

Why 0.8.9 though? Isn't the NS_OPTIONS change is a breaking change?

Good point. I was thinking it was just fixing a bug, but I guess it does break anyone who was using it. :+1:
Updated to be 0.9.

Why 0.8.9 though? Isn't the NS_OPTIONS change is a breaking change?

Good point. I was thinking it was just fixing a bug, but I guess it does break anyone who was using it. :+1:
Updated to be 0.9.

With watchOS and tvOS being part of "all" platforms now in carthage, we should probably use the following when building dependencies:
carthage build --platform Mac,iOS

With watchOS and tvOS being part of "all" platforms now in carthage, we should probably use the following when building dependencies:
carthage build --platform Mac,iOS

Ah interesting. So that gets me a bit further, and then a lot of errors like:
/Users/joshaber/Documents/Development/GitHub/objective-git/Carthage/Checkouts/Nimble/Nimble/Nimble.h:1:9: note: while building module 'Foundation' imported from /Users/joshaber/Documents/Development/GitHub/objective-git/Carthage/Checkouts/Nimble/Nimble/Nimble.h:1:
#import <Foundation/Foundation.h>
        ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/Foundation.framework/Headers/Foundation.h:6:10: note: while building module 'CoreFoundation' imported from /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/Foundation.framework/Headers/Foundation.h:6:
#include <CoreFoundation/CoreFoundation.h>
         ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CoreFoundation.h:11:10: note: while building module 'Darwin' imported from /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CoreFoundation.h:11:
#include <sys/types.h>
         ^
<module-includes>:1:9: note: in file included from <module-includes>:1:
#import "sys/cdefs.h"
        ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/usr/include/sys/cdefs.h:707:2: error: Unsupported architecture
#error Unsupported architecture

Ah interesting. So that gets me a bit further, and then a lot of errors like:
/Users/joshaber/Documents/Development/GitHub/objective-git/Carthage/Checkouts/Nimble/Nimble/Nimble.h:1:9: note: while building module 'Foundation' imported from /Users/joshaber/Documents/Development/GitHub/objective-git/Carthage/Checkouts/Nimble/Nimble/Nimble.h:1:
#import <Foundation/Foundation.h>
        ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/Foundation.framework/Headers/Foundation.h:6:10: note: while building module 'CoreFoundation' imported from /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/Foundation.framework/Headers/Foundation.h:6:
#include <CoreFoundation/CoreFoundation.h>
         ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CoreFoundation.h:11:10: note: while building module 'Darwin' imported from /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CoreFoundation.h:11:
#include <sys/types.h>
         ^
<module-includes>:1:9: note: in file included from <module-includes>:1:
#import "sys/cdefs.h"
        ^
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator9.2.sdk/usr/include/sys/cdefs.h:707:2: error: Unsupported architecture
#error Unsupported architecture

I don't get these errors building with Xcode 7.2 and carthage 0.11.0 using the following command:
carthage build --no-skip-current --platform Mac,iOS --verbose

Build log: https://gist.github.com/phatblat/e6525b198bff64dfa738
Build: http://b.log-g.co/eCNa

I don't get these errors building with Xcode 7.2 and carthage 0.11.0 using the following command:
carthage build --no-skip-current --platform Mac,iOS --verbose

Build log: https://gist.github.com/phatblat/e6525b198bff64dfa738
Build: http://b.log-g.co/eCNa

¯_(ツ)_/¯
I uploaded that build. Thanks to you both!

¯_(ツ)_/¯
I uploaded that build. Thanks to you both!

A couple differences between that .zip file and the 0.8.8 release:

not codesigned
.dSYMs not included (I removed these to make the file smaller)

A couple differences between that .zip file and the 0.8.8 release:

not codesigned
.dSYMs not included (I removed these to make the file smaller)

So should I remove the binary?

So should I remove the binary?

I don't think either of these are problems. The README currently states:

dSYM files are not currently included in the GitHub release zip files

As for codesign, iOS apps need to sign embedded frameworks anyway before deployment. I'm not sure about Mac apps. So, I think the file I provided is fine, just not 100% sure since I typically build ObjectiveGit from source.
@pietbrauer lmk if you have any problems with the new build.

I don't think either of these are problems. The README currently states:

dSYM files are not currently included in the GitHub release zip files

As for codesign, iOS apps need to sign embedded frameworks anyway before deployment. I'm not sure about Mac apps. So, I think the file I provided is fine, just not 100% sure since I typically build ObjectiveGit from source.
@pietbrauer lmk if you have any problems with the new build.

Works, thanks guys! Such a bliss to work with it in Swift now.

👍🏼

@phatblat Why did you strip the symbols out? It's only 5 MB difference, going from 10 MB to 15 MB?

Before i zipped up the Carthage build dir, I removed the Quick and Nimble framework builds and too the .dSYM files out too. Together, the symbols for both platforms were 18MB before compression.

We didn't used to include them, which is why I added that section to the README about including debug symbols.
Additionally, I provided a Release build which doesn't make for a deterministic debugging experience

It was only after @joshaber losted the build that I compared it to the 0.8.8 release and noticed those differences. I didn't see them as a problem but figured I'd mention them in case someone else called for a rebuild.
Are you needing them for debugging into the framework? If so, I think you're better off building the framework with the Debug config which will give you symbol files too. Note that I've had to add the ObjectiveGit project to my app's xcworkspace to get Xcode to even try to show me source while debugging.

We didn't used to include them, which is why I added that section to the README about including debug symbols.

That's because Carthage didn't use to include them in releases.

Yeah, when I use. carthage archive ObjectiveGit it includes them. Anyway, the reason why I was asking was because I tried to analyze a memory bug and the symbols where not included and I spent 30 minutes integrating the project and building from source 😉. I am ok either way.

IMHO, it's worth it to set up the config to build from source. That way, you could point to your branch/fork to test a change, or do something fancy like -enableAddressSanitizer YES when you need to track down those pesky memory bugs 😲.

looks up carthage archive command 🤔


how to add random messages

there are these comments in the code but no direction who to actually go about realizing this
          // You could modify this to send a random string from an array (ex. a quote), create a
          // random sentence by pulling words from a dictionary file, or to just send a random
          // arrangement of characters and integers. Doing something like this may help prevent
          // future moderation bots from detecting that you sent a spam message.

          if (content) {

can you guide me through it? thank you.

Let me give you a short example of how I would do it, let me know if this makes sense:
// https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Math/random
function getRandomInt(min, max) {
  // Maximum exclusive and minimum inclusive
  min = Math.ceil(min);
  max = Math.floor(max);
  return Math.floor(Math.random() * (max - min) + min);
}

let messages = ["OG Bobby Johnson", "Shotgun with the potato", "Okay Doeee"];
let content = messages[getRandomInt(0, messages.length)];
console.log("Your randomly selected message is", content);

This one pulls from a pre-defined list of strings. If you wanted to generate random words, you would need to do something similar but with reading in input from a dictionary file with a FileReader object.

thank you for the response! however I am still confused on how to implement this ( I know 0 js). Where exactly do I add those lines of code?
      if (command === "spam") {
        function sendSpamMessage() {
          // You could modify this to send a random string from an array (ex. a quote), create a
          // random sentence by pulling words from a dictionary file, or to just send a random
          // arrangement of characters and integers. Doing something like this may help prevent
          // future moderation bots from detecting that you sent a spam message.

          if (content) {
		// https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Math/random
		function getRandomInt(min, max) {
		// Maximum exclusive and minimum inclusive
		min = Math.ceil(min);
		max = Math.floor(max);
		return Math.floor(Math.random() * (max - min) + min);
		}
		let messages = ["OG Bobby Johnson", "Shotgun with the potato", "Okay Doeee"];
		let content = messages[getRandomInt(0, messages.length)];
		console.log("Your randomly selected message is", content);
            message.channel.send(content);
          } else {
            message.channel.send("This is spam message #" + count);

It looks like this now but it sends "This is spam message #1" still.


First run hurdle: put the mac into developer mode in flutter tool

Users running anything in xcode for the first time need to put their mac into developer mode.
Otherwise, our flutter tool will always give a non-explicit error
flutter run
Launching lib/main.dart on Xiao Yu’s iPhone in debug mode...
Automatically signing iOS for device deployment using specified development team in Xcode project: J23Z8ZF55Q
Running Xcode build...                               14.0s
Could not install build/ios/Release-iphoneos/Runner.app on ff369dfd5f4a80545a431441c1e3066f8cb8d759.
Try launching Xcode and selecting "Product > Run" to fix the problem:
  open ios/Runner.xcworkspace

Error launching application on Xiao Yu’s iPhone.

It seems like it's possible to do it in the command line by sudo'ing DevToolsSecurity -enable. We should save the user the round trip into Xcode

Can we check for this in flutter doctor or should we just always unconditionally enable?

We should check with DevToolsSecurity -status
Enabling requires sudo so we should just do it once per user's machine

@LarkAscending did you run into this as well when you were testing https://github.com/flutter/website/pull/596?

Don't believe so...
OTOH it's been almost 3 weeks and eyewitness testimony is notoriously unreliable.
;-)


Add clientMetadata to triggers that support it

Issue #, if available:
https://github.com/aws/aws-lambda-go/issues/255
Description of changes:
Request structs for triggers are updated with a ClientMetadata field when supported as noted in the documentation under https://docs.aws.amazon.com/cognito/latest/developerguide/cognito-user-identity-pools-working-with-aws-lambda-triggers.html
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

AWS CodeBuild CI Report

CodeBuild project: aws-lambda-go-github-ci
Commit ID: db17044c2f534a7571ca8caadde7e836d05258ac
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Codecov Report

Merging #256 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #256   +/-   ##
=======================================
  Coverage   74.59%   74.59%
=======================================
  Files          20       20
  Lines         681      681
=======================================
  Hits          508      508
  Misses        128      128
  Partials       45       45

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6625202...db17044. Read the comment docs.

AWS CodeBuild CI Report

CodeBuild project: aws-lambda-go-github-ci
Commit ID: 6b4e9f424be48e4832546811d988e06773e2edc8
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

LGTM, thanks!


Automated cherry pick of #934: bugfix:

Cherry pick of #934 on release/2.9.0.
#934: bugfix:

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.9.0@d90c599). Click here to learn what that means.
The diff coverage is 2.56%.

@@               Coverage Diff               @@
##             release/2.9.0    #945   +/-   ##
===============================================
  Coverage                 ?   7.54%
===============================================
  Files                    ?     343
  Lines                    ?   53853
  Branches                 ?       0
===============================================
  Hits                     ?    4063
  Misses                   ?   49409
  Partials                 ?     381

Flag
Coverage Δ

#aFlag
7.54% <2.56%> (?)

Impacted Files
Coverage Δ

pkg/compute/models/guest_actions.go
0% <0%> (ø)

pkg/compute/models/hosts.go
0.36% <0%> (ø)

pkg/hostman/storageman/nbd/nbdman.go
55.88% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d90c599...7b48d52. Read the comment docs.

/lgtm
/approve


Viv3ckj/rates

Added rates to the report, and increased monthly interval by 2 to include potential October data for seasonality analysis.
Closes #53
Closes #52

Discussed with milan over the phone, approved verbally.


make develop the default branch

Defaulting to the main often ends up with developers starting with the wrong branch

@smohan-dw develop is the default branch in cord.js right now (since some time now).

My bad. it was main on the fork I created


Remove the common API group

The types / values / functions from the common group are now moved to the core group.
Updated all related code & documentation.

Closing since this needs to be taken care of differently.


Spring Cloud Sleuth to Zipkin via Kafka not working

I am having trouble configuring a Spring Boot application to have Spring Cloud Sleuth send data to Zipkin using Kafka.
I orginally thought this might be a versioning issue. See issue #571. For that issue @marcingrzejszczak suggested I use the Spring Cloud Release Train BOM (Dalston.RELEASE). Based on that suggestion here is my latest build.gradle file:
buildscript {
  ext {
	springBootVersion = '1.5.2.RELEASE'
  }
  repositories {
	mavenCentral()
  }
  dependencies {
	classpath("org.springframework.boot:spring-boot-gradle-plugin:${springBootVersion}")
	classpath "io.spring.gradle:dependency-management-plugin:0.5.2.RELEASE"
  }
}

// Apply the java plugin to add support for Java
apply plugin: 'java'
apply plugin: 'eclipse'
apply plugin: 'idea'
apply plugin: 'org.springframework.boot'
apply plugin: "io.spring.dependency-management"

jar {
  baseName = 'sleuth-test-app'
  version  = '0.1.0'
  manifest {
    attributes(
	  'Main-Class': 'hello.Application'
    )
  }
}

repositories {
    mavenCentral()
}

sourceCompatibility = 1.8
targetCompatibility = 1.8

dependencyManagement {
     imports {
	   mavenBom "org.springframework.cloud:spring-cloud-dependencies:Dalston.RELEASE"
     }
}

// In this section you declare the dependencies for your production and test code
dependencies {
    // The production code uses the SLF4J logging API at compile time
    compile 'org.slf4j:slf4j-api:1.7.21'

    // tag::jetty[]
    compile("org.springframework.boot:spring-boot-starter-web") {
        exclude module: "spring-boot-starter-tomcat"
    }
    compile("org.springframework.boot:spring-boot-starter-jetty")
    // end::jetty[]
    // tag::actuator[]
    compile("org.springframework.boot:spring-boot-starter-actuator")
    // end::actuator[]

	compile("org.springframework.cloud:spring-cloud-starter-sleuth")

	compile "org.springframework.cloud:spring-cloud-sleuth-stream"
	compile "org.springframework.cloud:spring-cloud-stream-binder-kafka"

    testCompile("junit:junit")
}

Unfortunately this did not solve the issue I am running into.
My application is very simple. It is based of of the Spring Boot and Spring Cloud Sleuth examples:
package hello;

import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.RestController;

@SpringBootApplication
@RestController
public class Application {

	static Logger logger = LoggerFactory.getLogger(Application.class);

	@RequestMapping("/")
	public String home() {
		logger.info("Handling home");
		return "Hello World";
	}

	public static void main(String[] args) {
		SpringApplication.run(Application.class, args);
	}
}

And here is the properties file I am using to configure the application:
spring.application.name=sleuth-test-app
spring.cloud.stream.kafka.binder.zkNodes=brokername
spring.cloud.stream.kafka.binder.brokers=brokername
spring.cloud.stream.default.contentType=application/json
spring.cloud.stream.bindings.output.destination=topicname

When I start the app, I don't get any errors but I am unable to reach the app. The last thing to show up in the logs in the ProducerConfig values:
2017-04-25 10:36:37,064  INFO main o.a.k.c.p.ProducerConfig:180 - ProducerConfig values:
        acks = 1
        batch.size = 16384
        block.on.buffer.full = false
        bootstrap.servers = [brokername:9092]
        buffer.memory = 33554432
        client.id = producer-1
        compression.type = none
        connections.max.idle.ms = 540000
        interceptor.classes = null
        key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
        linger.ms = 0
        max.block.ms = 60000
        max.in.flight.requests.per.connection = 5
        max.request.size = 1048576
        metadata.fetch.timeout.ms = 60000
        metadata.max.age.ms = 300000
        metric.reporters = []
        metrics.num.samples = 2
        metrics.sample.window.ms = 30000
        partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
        receive.buffer.bytes = 32768
        reconnect.backoff.ms = 50
        request.timeout.ms = 30000
        retries = 0
        retry.backoff.ms = 100
        sasl.kerberos.kinit.cmd = /usr/bin/kinit
        sasl.kerberos.min.time.before.relogin = 60000
        sasl.kerberos.service.name = null
        sasl.kerberos.ticket.renew.jitter = 0.05
        sasl.kerberos.ticket.renew.window.factor = 0.8
        sasl.mechanism = GSSAPI
        security.protocol = PLAINTEXT
        send.buffer.bytes = 131072
        ssl.cipher.suites = null
        ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
        ssl.endpoint.identification.algorithm = null
        ssl.key.password = null
        ssl.keymanager.algorithm = SunX509
        ssl.keystore.location = null
        ssl.keystore.password = null
        ssl.keystore.type = JKS
        ssl.protocol = TLS
        ssl.provider = null
        ssl.secure.random.implementation = null
        ssl.trustmanager.algorithm = PKIX
        ssl.truststore.location = null
        ssl.truststore.password = null
        ssl.truststore.type = JKS
        timeout.ms = 30000
        value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer

2017-04-25 10:36:37,148  WARN main o.a.k.c.p.ProducerConfig:188 - The configuration 'key.deserializer' was supplied but isn't a known config.
2017-04-25 10:36:37,148  WARN main o.a.k.c.p.ProducerConfig:188 - The configuration 'value.deserializer' was supplied but isn't a known config.
2017-04-25 10:36:37,151  INFO main o.a.k.c.u.AppInfoParser:83 - Kafka version : <IP_ADDRESS>
2017-04-25 10:36:37,151  INFO main o.a.k.c.u.AppInfoParser:84 - Kafka commitId : f10ef2720b03b247

Any help would be greatly appreciated.

You're not able to reach which app? What does it mean that it's not reachable?

I mean I am not able to access the app (hello.Application from above) at  http://localhost:8080/.
This all seems to work fine if I try to send data to Zipkin via http, but stops working when I switch to using Kafka.

And you have no exceptions or anything in the logs?

@dmmx Just to double check on these configuration properties:
spring.cloud.stream.kafka.binder.zkNodes=brokername
spring.cloud.stream.kafka.binder.brokers=brokername

Have you configured the correct host names and port for zkNodes and brokers.

@marcingrzejszczak The logs look clean. there are no errors or exceptions.

 If you check localhost:8080/health do you get anything there?

@ilayaperumalg Thanks for asking about this. After fiddling with these settings a bit I was able to produce this error:
2017-04-25 14:37:13,051 ERROR kafka-producer-network-thread | producer-1 o.a.k.c.p.i.Sender:137 - Uncaught error in kafka producer I/O thread:
org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'brokers': Error reading field 'host': Error reading string of length 25199, only 132 bytes available
        at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:236) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:135) ~[kafka-clients-<IP_ADDRESS>.jar!/:na]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]

Does this indicate that my kafka client is at .10 and the broker I am trying to connect to is at .9?
If so, is there a way I can figure the sleuth/cloud stream client to use .9?
I am not able to change the version of the broker.

@marcingrzejszczak Yes, when things are working correctly (accessing Zipkin via HTTP) the end point returns Hello World

@dmmx  You can find some configuration examples for downgrading the client library here: http://docs.spring.io/autorepo/docs/spring-cloud-stream-docs/Chelsea.SR1/reference/htmlsingle/#_using_the_binder_with_apache_kafka_0_10.

I was able to find out from our Kafka admin that our broker is at version .8.2 not .9 as I previously thought.
Does anyone know how to configure spring-cloud-sleuth and spring-cloud-stream to use a kafka .8.2. client?
I've tried many different combinations and haven't had any luck.

Decided to take a different approach for the integration.


ambient: support full Telemetry for waypoint

See https://github.com/istio/istio/blob/827473641d1dcc0029e8e9c96f80a0d184b6888e/pilot/pkg/model/telemetry.go#L873 currently we hardcode config. We should allow the customized config

Besides the basic configuration, there are some missing features:

tracing open/close spans don't make sense in the waypoint;
stackdriver doesn't have destination metadata;
direct pod traffic doesn't emit telemetry.

Not stale


Some idea

Hi,
great initiative.
Couple of ideas:

by default goo is getting always the latest version. maybe worth to get the latest by default, but to add a versioning; not needed today, but just in case for the future.
the Goosql method, you could instance a single SqlConnection and not create a new one every time. Not a big deal, but more elegant. Also I'd call the module GooSqlSrv

I think they could be useful the following modules:

Redis cache (install, clear keys etc.)
PostgreSql
ELK

very cool module

Cool... Good suggestions
On Wed, 5 Jan 2022, 20:01 Manuel Conti, @.***> wrote:

Hi,
great initiative.
Couple of ideas:

by default goo is getting always the latest version. maybe worth to
get the latest by default, but to add a versioning; not needed today, but
just in case for the future.
the Goosql method, you could instance a single SqlConnection and not
create a new one every time. Not a big deal, but more elegant. Also I'd
call the module GooSqlSrv

I think they could be useful the following modules:

Redis cache (install, clear keys etc.)
PostgreSql
ELK

very cool module
—
Reply to this email directly, view it on GitHub
https://github.com/andresharpe/goo/issues/15, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABYSRP5VGPATB7FPPIFLST3UUSIP5ANCNFSM5LKTULTQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>


Possibility to copy tag by Ctrl+C in the preview dialog

Is your feature request related to a problem? Please describe
Currently there is the only way to copy tag in the preview dialog — it is by using right mouse click menu.
Describe the solution you'd like
It would be useful to be able to copy a tag by selecting it and by pressing Ctrl+C shortcut.
Describe alternatives you've considered
None.
Additional context

That's likely because you have the shortcut for "Copy image data" bound to "Ctrl+C" and it prevents you from copying text. I just updated the default shortcut to use "Ctrl+Shift+C" instead, but you might want to change it in your settings 👍


Access tabs via query params in typedoc module docs

it would be great if for module links (like https://iasql.com/docs/modules/aws/aws_ec2/ ) clicking on the "Code examples" tab added a #code_examples or ?tab=code_examples link to the URL and a fresh-load of the page with that parameter switched the tab focus to the code examples.

If it takes more than half a day we can put it in the backlog, ideally it is quick


Update tier_three.json

Added diamond and netherite tools (including swords), enchanted golden apple, sharpness enchant for swords (disclaimer: all code additions are all guessed based on your code so if there's any problem, you can edit it as you like) (and you can add tnt and flint n steel if you want)

also, i forgot to add armors in the file so you can add them in all tiers

sadly, it didn't work...

Hi again, when you make commits to your branch patch-2 this pull request will be updated. That's how you perform changes


OpenBLAS-0.2.18 compile error on Cygwin64

Hi All,
I am trying to build openblas on Cygwin64. The pre-build configuration goes just fine, but when I start make, the error occurs:
cd 'G:/Xiyao/opensource/OpenBLAS-0.2.18'
C:\cygwin64\bin\make.exe -f Makefile
Scanning dependencies of target kernel
[  0%] Building C object kernel/CMakeFiles/kernel.dir/CMakeFiles/lsame.c.o
[  0%] Building C object kernel/CMakeFiles/kernel.dir/CMakeFiles/scabs1.c.o
In file included from /cygdrive/g/Xiyao/opensource/OpenBLAS-0.2.18/common.h:741:0,
from /cygdrive/g/Xiyao/opensource/OpenBLAS-0.2.18/kernel/generic/cabs.c:40,
from /cygdrive/g/Xiyao/opensource/OpenBLAS-0.2.18/kernel/CMakeFiles/scabs1.c:9:
/cygdrive/g/Xiyao/opensource/OpenBLAS-0.2.18/common_thread.h:107:3: error: unknown type name 'CRITICAL_SECTION'
CRITICAL_SECTION lock;
^
/cygdrive/g/Xiyao/opensource/OpenBLAS-0.2.18/common_thread.h:108:3: error: unknown type name 'HANDLE'
HANDLE finish;
^
make[2]: *** [kernel/CMakeFiles/kernel.dir/build.make:87: kernel/CMakeFiles/kernel.dir/CMakeFiles/scabs1.c.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:392: kernel/CMakeFiles/kernel.dir/all] Error 2
make: *** [Makefile:95: all] Error 2
Coud you please give me some advices?
Thank you.
Xiyao

This looks as if your cygwin installation does not have (or does not find) a suitable windows.h (or for some reason OS_WINDOWS is not set, which normally triggers inclusion of windows.h from common.h around line 110, long before common_thread.h is read). It could be that you need to install the "w32api-headers" package from cygwin.

Did you manage to resolve this in the meantime, or do you need further assistance ? Note also that the precompiled windows binaries on sourceforge have been updated to the current 0.2.19 release a few weeks ago so you could probably also try using those instead of building your own.

Hi Xiaoyi,
I got the same problem. And I had already installed the w32api-headers package. I want to build the library on cygwin because another library which I also want to build depends on this one. Does OpenBLAS support cygwin? If it is not, I should give up trying.
Thanks!
Liyu

In principle it should, since the early days of libGoto. Perhaps there is something wrong with your PATH setting, leading to a stock Windows utility of the same name being called instead of the cygwin-supplied one ? The cygwin wiki has installation instructions for gcc at  http://cygwin.wikia.com/wiki/How_to_install_a_newer_version_of_GCC - while this is very obviously the wrong topic, maybe its sections "Verify Cygwin Prerequisites" and "Check Environment Variables" can provide a clue ?


[Java] Collect JVM dump files in the case of failure

Describe the enhancement requested
In development and specially figuring out CI jobs, it would be better if we can collect JVM dump files in the case of failure. This will help in debugging such issues properly.
Component(s)
Java

Following up with the discussion in PR https://github.com/apache/arrow/pull/41772 shows the importance of this.

As a hack, I added to dev/tasks/java-jars/github.yml the following snippet to capture relevant information:
       - name: Build bundled jar
         run: |
           set -e
           ulimit -c unlimited
           [...]
       - name: Capture build artifacts
         uses: actions/upload-artifact@v4
         with:
           name: surefire-reports
           path: |
             **/surefire-reports/**
             **/hs_err*.log
             /cores/core.*
         if: always()

Thanks for sharing @laurentgo. I will take a look.


Error while deploying the stack

Trying to deploy the stack causes deployment to fail with following error.
2:07:02 PM | CREATE_FAILED        | AWS::StepFunctions::StateMachine                | RagEnginesAuroraPg...aWorkspace50EFF4E7
Resource handler returned message: "Invalid Logging Configuration: The CloudWatch Logs Resource Policy size was exceeded. We suggest prefixing your CloudWatch log group name with /aws/vendedlogs/states/. (Service: AWSStepFunctions; Status Code: 400; Error Code: Inva
lidLoggingConfiguration; Request ID: c2ca8c66-348b-4413-88bb-80d913450642; Proxy: null)" (RequestToken: 2ab965eb-f585-b0b1-8da9-b06b54ff745d, HandlerErrorCode: InvalidRequest)

Here is my config.json file contents:
{
  "prefix": "proto",
  "createCMKs": false,
  "retainOnDelete": false,
  "bedrock": {
    "enabled": true,
    "region": "us-east-1",
    "guardrails": {
      "enabled": false,
      "identifier": "",
      "version": "DRAFT"
    }
  },
  "llms": {
    "enableSagemakerModels": false,
    "sagemaker": [],
    "huggingfaceApiSecretArn": ""
  },
  "rag": {
    "enabled": true,
    "deployDefaultSagemakerModels": false,
    "engines": {
      "aurora": {
        "enabled": true
      },
      "opensearch": {
        "enabled": true
      },
      "kendra": {
        "enabled": false,
        "createIndex": false,
        "external": [],
        "enterprise": false
      },
      "knowledgeBase": {
        "enabled": false,
        "external": []
      }
    },
    "embeddingsModels": [
      {
        "provider": "bedrock",
        "name": "amazon.titan-embed-text-v1",
        "dimensions": 1536,
        "default": false
      },
      {
        "provider": "bedrock",
        "name": "amazon.titan-embed-image-v1",
        "dimensions": 1024,
        "default": false
      },
      {
        "provider": "bedrock",
        "name": "cohere.embed-english-v3",
        "dimensions": 1024,
        "default": false
      },
      {
        "provider": "bedrock",
        "name": "cohere.embed-multilingual-v3",
        "dimensions": 1024,
        "default": true
      },
      {
        "provider": "openai",
        "name": "text-embedding-ada-002",
        "dimensions": 1536,
        "default": false
      }
    ],
    "crossEncoderModels": []
  }
}

When I disable Aurora RAG option and try to deploy. I get following error.
2:42:27 PM | CREATE_FAILED        | AWS::StepFunctions::StateMachine                | RagEngines/DataImp...ow/WebsiteCrawling
Resource handler returned message: "Invalid Logging Configuration: The CloudWatch Logs Resource Policy size was exceeded. We suggest prefixing your CloudWatch log group name with /aws/vendedlogs/states/. (Service: AWSStepFunctions; Status Code: 400; Error Code: Inva
lidLoggingConfiguration; Request ID: 5c921692-2541-4a63-b272-93cff8449b44; Proxy: null)" (RequestToken: 4f37ffbe-968d-eb5b-e72a-d617d41885f5, HandlerErrorCode: InvalidRequest)

Added a fix in the PR #598 .
Will merge it when possible, feel free to check the PR branch if you are blocked.

@surukonda , the change is merge. Please confirm it fixes your deployment.

@surukonda , the change is merged. Please confirm it fixes your deployment.

All good, thanks @charles-marion


SRVKP-4524: give tekton perms to konflux-sre

@zanssa FYI ... I will reference this in the SOP updates I'm making as part of responding to your comments over in the gitlab MR
@enarha @savitaashture @divyansh42 FYI
rh-pre-commit.version: 2.3.0
rh-pre-commit.check-secrets: ENABLED

ACK. Is this for running the scripts to collect data referred in the Gitlab MR?

as well as the recovery scripts referred to in the various SOPs @zanssa

/test appstudio-e2e-tests

/retest

/retest

still unrelated, inconsistent flakes
/retest

/retest


Fix duplicated wheel forwarding

The key aspect is in TrackRenderer line 1903. Setting e.forwarded = true; in the TrackRendererensures that the wheelHandler in HiGlassComponent doesn't fire again when the wheel event from track-renderer-event bubbled all the way up to the window which the domEvent service is listening to.
Description
Remove duplicated wheel events
Why is it necessary?
Fixes #417
Checklist

[x] Unit tests added or updated

@pkerpedjiev Yes it does but better double check if you have the chance. Not that there are edge cases I forgot to test manually.


A generation a class for System.Exception in CSharp Client from a Web API Core project.

Hi,
We are generating a C# Client with NSwag from a Web API Core project, The generation process creates a class for the System.Exception type, because there is a DTO class with a property of this type. I verified the generation when a controller operation returns a System.Exception and it works, it just generates this class when there is a property of these type in a class.
I have downloaded the NSwagStudio and generated the same C# Client with the same result. Is there any configuration or workaround to avoid the generation of these class?
I attach an example code project and the C# Client result generated by NSwagStudio.
Best Regards.
José Romo
NSwagIssue.zip

[JsonIgnore] on the property of type Exception?

The class that contains the property of type Exception is an input parameter of a controller operation, I can't put the JsonIgnore attribute on this property because the generation doesn't includes this property into the C# Client and calls to the web service will fail.


Bug fix when values are zero

When hiding values below a positive number, zero values are not hidden.  The conditional for the if statement was updated to include a zero value.

@mermino looks like the build fails and it asks for the check to be stricter (===)?

@yesoreyeram Hi, it seems that the build check failed. By the look of things the check needs to be stricter (=== as opposed to ==)?

Yea.. i am aware.. fixing in sometime today..

Hi @mermino @yesoreyeram, thank you for the improvement, but I'm still seeing rows having value = 0, even though my filter is "hide if value is below 2". Can you please help?

Ignore my previous comment - looks like it all started working correctly after grafana's restart (facepalm). my bad.

Sorry... I just saw your comments today.  Looks like you fixed the === for me.  Thanks for that.


Add getSelectionInfo

Add getSelectionInfo to pagelib.c1.InteractionHandler
https://phabricator.wikimedia.org/T228686

@joewalsh Thank you! This works well. It would be good to add documentation for this to the pcs.md file. Is the action/event for the text selection going to be a different PR?

@berndsi I think the action/event may have been a miscommunication in the PR - it looked like in the android code it only needed to be a read of selection information, not an an action when selection changes - @sharvaniharan is this correct?

@berndsi I updated the doc

@joewalsh I think you're correct. My bad. Should we add in the docs that section may be null (in the case of the selected text being outside of a section, e.g. in the description)?

@berndsi done


Be able to filter notes by author

At the moment it's actually impossible to fetch blog notes by particular author 😬  I've came across this issue when I tried to find one of Tim's articles about dry-rb stack and thought it would be nice to click author name inside the note and see all his articles. So here we are )

          1 Warning

:warning:
Tests were not updated

  Generated by :no_entry_sign: danger


Mainnet shadow fork 2 - empty deposit tree ETH1_ERROR_WRONG_DEPOSIT_ROOT

Describe the bug
Shadow fork 2 lodestar geth combination (only checked this one) failed to propose all blocks between genesis and genesis +3 hours
Apr-22 09:58:48.067[API]             error: Req req-1f2 produceBlock error  code=ETH1_ERROR_WRONG_DEPOSIT_ROOT, root=0xff836677895bc3325cfcc752ff966cda93fd773ee6e602b18977630d5e527932, expectedRoot=0xd70a234731285c6804c2a4f56711ddb8c82c99740f207854891028af34e27e5e
Error: ETH1_ERROR_WRONG_DEPOSIT_ROOT
    at getDepositsWithProofs (/usr/app/node_modules/@chainsafe/lodestar/src/eth1/utils/deposits.ts:52:11)
    at Eth1DepositsCache.get (/usr/app/node_modules/@chainsafe/lodestar/src/eth1/eth1DepositsCache.ts:34:33)
    at getDeposits (/usr/app/node_modules/@chainsafe/lodestar/src/eth1/utils/deposits.ts:30:20)
    at Eth1DepositDataTracker.getDeposits (/usr/app/node_modules/@chainsafe/lodestar/src/eth1/eth1DepositDataTracker.ts:116:12)
    at Eth1DepositDataTracker.getEth1DataAndDeposits (/usr/app/node_modules/@chainsafe/lodestar/src/eth1/eth1DepositDataTracker.ts:77:22)
    at assembleBody (/usr/app/node_modules/@chainsafe/lodestar/src/chain/factory/block/body.ts:64:32)
    at assembleBlock (/usr/app/node_modules/@chainsafe/lodestar/src/chain/factory/block/index.ts:43:11)
    at Object.produceBlock (/usr/app/node_modules/@chainsafe/lodestar/src/api/impl/validator/index.ts:180:21)
    at Object.handler (/usr/app/node_modules/@chainsafe/lodestar-api/src/server/utils/server.ts:61:23)

at genesis +3 hours the node restarted and could propose 100% of blocks.
Note that the deposit queue is empty during the first 4 hours because there has not been a vote yet on eth1 data. Could it be some issue handling an empty deposit tree?
Expected behavior
Propose all blocks

Are we still experiencing this?

Are we still experiencing this?

The only way to experience this is with a shadow-fork that has an empty deposit contract for more than 1 eth1 voting period. This condition doesn't happen on any existing network. We may choose to put this issue on ice until shadow forks happen again for capella

Closing issues for specific incidents on old versions of Lodestar


[bug]: Shortcuts/Persistent Panel shows KeyClu shortcuts instead of active application after search in shortcuts panel

Description
Not sure if this was reported before, but if I trigger the shortcuts panel, trigger the search box via the shortcut key, then exit by pressing Esc, when I go to trigger the shortcuts panel again or the persistent panel, it shows me the KeyClu shortcuts instead of the current application's shortcuts.
I have to click inside the app's window to bring it into focus for the shortcuts panel to show the respective shortcuts again.
Expected behavior
Opening the shortcuts panel again after having tried a search in the previous shortcuts panel should show the same application's shortcuts still.
App version
0.23.1
macOS version
macOS Sonoma 14.4
Installation method
Homebrew
Checklist before submitting a bug

[X] This issue hasn't been addressed in an existing GitHub issue or discussion.

Hey danny-tps,
I've noticed this behaviour, and it should been fixed in the latest version. Could you please update the app and see if the issue still persists?

works like a charm now. Thanks for the quick response!

Hey danny-tps,
Sorry to hear you're having troubles. To check the workflow I need some information from you: could you please share info, how you’ve set activation and the delay for holding the key? The most convenient way would be to provide a screenshot or copy-paste the output of a terminal command: defaults read com.0804Team.KeyClu.


Confusion around CHEBI:537519 (L-aspartic acid 4-semialdehyde betaine)

Hi !
CHEBI:537519 (L-aspartic acid 4-semialdehyde betaine) is listed as an amino-acid betaine (CHEBI:22860) and has the following formula:

However, there are several problems here, because:

the molecule corresponding to this formula is not a betaine, since the ammonium nitrogen is linked to hydrogen atoms
this formula corresponds to the L-aspartic acid 4-semialdehyde zwitterion
L-aspartic acid 4-semialdehyde betaine is not a tautomer of L-aspartic acid 4-semialdehyde (it has 3 extra methyl groups)

The right formula should be:

Proposed fix

Fix existing term CHEBI:537519 (L-aspartic acid 4-semialdehyde betaine) with:

SMILES: [H]C(=O)C[C@]([N+](C)(C)C)C([O-])=O
remove: is tautomer of: L-aspartic 4-semialdehyde (CHEBI:18051)

Create a new term (L-aspartic acid 4-semialdehyde zwitterion) that:

has SMILES: [H]C(=O)C[C@H]([NH3+])C([O-])=O
is tautomer of: L-aspartic 4-semialdehyde (CHEBI:18051)

Thanks for letting us know. The entry has now been fixed and the word 'betaine' has now been removed


fix: bad regex in yarn translator

Also don't allow evaluation to fail, but instead provide default value.
Opening as draft because I doubt "unversioned" is a desirable default value here, but we probably shouldn't fail here either.
If we would rather fail here we should probably at least provide a nice message, since the original error made it very difficult to understand what was going on. I also don't understand the point of the regex here exactly, so am not even 100% sure if we still need it.
x-ref: https://github.com/nix-community/dream2nix/issues/73#issuecomment-1132038224

Thanks for that. Could you share the lock file which produces the error. I'd like to how the lock file looks like and also what upstream yarn does with it.

The branch I am trying to package is here:
https://github.com/input-output-hk/cardano-js-sdk/tree/refactor/circular-deps
The wip flake I've got is this:
{
  inputs = {
    # local checkout containing this PR
    dream2nix.url = "/home/nrd/git/hub/nix-community/dream2nix";
  };

  outputs = {
    self,
    dream2nix,
    nixpkgs,
  } @ inp: let
    dream2nix = inp.dream2nix.lib2.init {
      systems = ["x86_64-linux"];
      config.projectRoot = ./.;
    };
  in (dream2nix.makeFlakeOutputs {
    source = ./.;
    packageOverrides =
      builtins.mapAttrs (
        _: _: {add-inputs.buildInputs = with nixpkgs.legacyPackages.x86_64-linux; self: self ++ [nodePackages.typescript];}
      )
      self.packages.x86_64-linux;
  });
}

I also had to apply this patch since dream2nix doesn't seem to support the "npm:" prefix in package.json versions yet:
diff --git a/packages/blockfrost/package.json b/packages/blockfrost/package.json
index a38384c4..b3375099 100644
--- a/packages/blockfrost/package.json
+++ b/packages/blockfrost/package.json
@@ -25,7 +25,7 @@
     "shx": "^0.3.3"
   },
   "dependencies": {
-    "@blockfrost/blockfrost-js": <EMAIL_ADDRESS>+    "@blockfrost-js-ratelimited": "2.0.3",
     "@cardano-sdk/core": " 0.2.0"
   },
   "files": [
diff --git a/yarn.lock b/yarn.lock
index eaa19f09..817d68a2 100644
--- a/yarn.lock
+++ b/yarn.lock
@@ -351,7 +351,7 @@
   resolved<EMAIL_ADDRESS>   integrity sha512-0hYQ8SB4Db5zvZB4axdMHGwEaQjkZzFjQiN9LVYvIFB2nSUHW9tYpxWriPrWDASIxiaXax83REcLxuSdnGPZtw==

-"@blockfrost/blockfrost-js<EMAIL_ADDRESS>+"<EMAIL_ADDRESS>   version "2.0.3"
   resolved "https://registry.yarnpkg.com/blockfrost-js-ratelimited/-/blockfrost-js-ratelimited-2.0.3.tgz#44569571bc4d3e73b90c8738c30e53bb1f17645f"
   integrity sha512-616NF9cOvL4xBvJP/As4/SmcEC9xJvogL08Zm0PXTIWPzygnJ/qkVtve3otk5U61SlBiVojtf9jHsX5waibQSA==

I also just force pushed as I noticed a lot of versions in package.json files through the repo were prefixed with an   (space) character. I'm not sure what that means, but I had to account for it in the regex so I just changed it a bit.
Even with all that I am still failing to package it because of the error I mentioned here: https://github.com/nix-community/dream2nix/issues/103#issuecomment-1126292721


Add tool to evaluate bitwise expression patterns

Inspired by [1] that evaluates (x & y) & (x ^ y) % 13 and then connects adjacent points by a line. There's definitely more to it than that, but I've been unable to completely reproduce the author's work (nor did I really want to).
[1] https://www.reddit.com/r/generative/comments/10hk4jg/big_renfest_crest_energy_bitwise_operations_svg

I also want to use https://rhai.rs/book/index.html to allow evaluating custom expressions.


Auto copy with safecontent

With this, passwords will be copied to clipboard when safecontent is set and there is only a password in the entry invoked.
This is addressing #684.
I've adapted the unit tests accordingly and I've added a unit test to check for conflict between safecontent and -c in the show action. (To avoid regressions later on, as the expected behaviour when specifying -c is to copy to clipboard, not to show the (safe) content)

Wow, this failed for a reason I wasn't expecting:
Error: Not equal:
	   expected: "No safe content to display, you can force display with show -f.\nCopying password instead.\nCopied fixed/secret to clipboard. Will clear in 45 seconds."
	   actual  : "No safe content to display, you can force display with show -f.\nCopying password instead.\nWARNING: No clipboard available. Install xsel or xclip or use -p to print to console"

Should I fix it by adapting the unit test to reflect Travis lack of xsel or xclip, or should I fix it by modifying travis.yml to add xclip to its apt packages?

Hi,
thanks a lot for this PR. This should be a useful addition.
Please set clipboard.Unsupported = true in the test case to make it pass, see https://github.com/justwatchcom/gopass/blob/master/action/clipboard_test.go#L16

I guess I've misunderstood something there.
What's clipboard.Unsupported = true supposed to do?
Its doc says:

Unsupported might be set true during clipboard init, to help callers decide whether or not to offer clipboard options.

The problem I'm having seems to be that I'm expecting the copy action to succeed with its standard message, but since Travis isn't featuring xclip, it fails.
A solution could be to simply add xclip in the Travis config file, when installing gnupg and git.

Oh, my bad. I missed the fact that you added an integration test, not a unit test.
While integration tests are a good safety net, the have some limitations and are generally slower than unit tests. Why don't you just turn the integration test into a unit test? There setting clipboard.Unsupported will work because of https://github.com/justwatchcom/gopass/blob/master/action/clipboard.go#L18

Actually I think you could just change this line https://github.com/justwatchcom/gopass/pull/685/files#diff-a9331e67576623a133a012a0cfd71beeR40 to assert.Contains(t, out, "No safe content to display, you can force display with show -f.\nCopying password instead.").
This should work.

True. But it's kind of a workaround and it wouldn't cost me much to add it to the actual unit tests.
Is there any benefits to have a same test both as a unit test and as an integration test? (I was thinking those were all unit tests.)

Both have their merits. Unit tests are much faster and easier to implement, but you need to do a lot of mocking so you might change the behavior without noticing.
Integration tests are usually more annoying but they test the final binary without any mocking, so they give greater confidence.

Alright, I've workaround all the problems I had... At last!
Maybe I should rebase, since I'm reverting a lot of stuff in the end?

Yes, please rebase onto master git rebase master and possibly squash your changes git rebase -i master.

Done.
I haven't squashed everything into just one commit, because those 3 commits are doing 3 different things... But if you want, I can squash everything into just one.

No, this is fine.


Csv must ignore empty columns

@rultor release, tag is 0.8.1

@rultor release, tag is 0.8.1

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.8.1

@yegor256 Done! FYI, the full log is here (took me 9min)


Scrum 3459 - pdf2tei conversion pipeline

I had envisioned all jobs doing things similarly. condition in workflow_transition table would list the type of job is needed.
Lets pretend we have something like:-
    {'mod': "WB",
     'from': "files uploaded",
     'to': "text conversion needed ",
     'condition': 'text_conversion_job',
     'actions': []
     },
    {'mod': "WB",
     'from': "text conversion needed",
     'to': "text conversion in progress ",
     'condition': 'on_start',
     'actions': []
     },
    {'mod': "WB",
     'from': "text conversion in progress",
     'to': "text conversion failed",
     'condition': 'on_failed',
     'actions': []
     },
    {'mod': "WB",
     'from': "text conversion in progress",
     'to': "text conversion complete",
     'condition': 'on_success',
     'actions': []
     },

So to get a list of jobs for processing we call get_jobs(db, "text_conversion_job")
(WFT= workflow_tag, WT = workflow_transition)
This links WFT and WT via 'transition_to' in WT and 'workflow_tag_id' WFT with condition containing 'text_conversion_job'
this returns an array of
{new_job['job_name'] = condition
new_job['workflow_tag_id'] = wft[0].workflow_tag_id
new_job['reference_id'] = wft[0].reference_id
new_job['reference_workflow_tag_id'] = wft[0].reference_workflow_tag_id}
So before we start the job we call job_change_atp_code(db, new_job['reference_workflow_tag_id'], 'on_start')
This changes "text conversion needed" to "text conversion in progress"
Then run the job.
If it fails call job_change_atp_code(db, new_job['reference_workflow_tag_id'], 'on_failed')
else job_change_atp_code(db, new_job['reference_workflow_tag_id'], 'on_success')
Does this make sense? Probably easier over zoom.
There are routers for these job methods if we have external processing of jobs.

Just noticed we do not have a "text conversion in progress" so the above may need some rejigging or that would need to be added.

Thanks @ianlongden ! Yes, your suggestions make sense. I didn't know how to run jobs in the transition function, but we should definitely do it. Let's talk about it on zoom and ask Ceri to add the missing tag (text conversion in progress).

Thanks for your help @ianlongden. This PR is now ready for review

@ianlongden the pdf2tei unit test is currently a webtest, but I think it would be very useful to have it as part of the PR unit tests. I'll mock the GROBID API and store the resulting TEI file in the repo. I'll work on this asap but I'll keep this PR in draft mode

removed webtest from pdf2tei and mocked grobid conversion. The PR is ready for review

The transition is using the new job management that @ianlongden set up. We should probably do a team meeting to talk about this and familiarize with the code.

That will be cool ! @valearna


jax library error jaxlib.xla_extension.XlaRuntimeError: FAILED_PRECONDITION: DNN library initialization failed

Description
Hey,
I am working on a code that uses the Jax library, and I run into this error over and over again no matter how I tried to configure my environment:
2024-08-20 16:26:58.037892: E external/xla/xla/stream_executor/cuda/cuda_dnn.cc:439]

Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR
2024-08-20 16:26:58.037952: E external/xla/xla/stream_executor/cuda/cuda_dnn.cc:443] Memory usage:<PHONE_NUMBER>2 bytes free,<PHONE_NUMBER>2 bytes total.
Traceback (most recent call last):
  File "GPU_pairwise_pipline.py", line 260, in <module>
    SSMD_res_with_indices = process_blocks(train_set_sick, train_set_healthy, block_size)
  File "GPU_pairwise_pipline.py", line 172, in process_blocks
    mean_block1_sick, var_block1_sick = cal_mean_and_var(block1_sick)
  File "GPU_pairwise_pipline.py", line 17, in cal_mean_and_var
    data_jax = jnp.array(data)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/numpy/lax_numpy.py", line 2035, in array
    out = _array_copy(object) if copy else object
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/lax/lax.py", line 4447, in _array_copy
    return copy_p.bind(arr)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/core.py", line 380, in bind
    return self.bind_with_trace(find_top_trace(args), args, params)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/core.py", line 383, in bind_with_trace
    out = trace.process_primitive(self, map(trace.full_raise, args), params)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/core.py", line 815, in process_primitive
    return primitive.impl(*tracers, **params)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/lax/lax.py", line 4486, in _copy_impl
    return dispatch.apply_primitive(prim, *args, **kwargs)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/dispatch.py", line 132, in apply_primitive
    compiled_fun = xla_primitive_callable(
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/util.py", line 284, in wrapper
    return cached(config._trace_context(), *args, **kwargs)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/util.py", line 277, in cached
    return f(*args, **kwargs)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/dispatch.py", line 223, in xla_primitive_callable
    compiled = _xla_callable_uncached(
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/dispatch.py", line 253, in _xla_callable_uncached
    return computation.compile().unsafe_call
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/interpreters/pxla.py", line 2323, in compile
    executable = UnloadedMeshExecutable.from_hlo(
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/interpreters/pxla.py", line 2645, in from_hlo
    xla_executable, compile_options = _cached_compilation(
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/interpreters/pxla.py", line 2555, in _cached_compilation
    xla_executable = dispatch.compile_or_get_cached(
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/dispatch.py", line 497, in compile_or_get_cached
    return backend_compile(backend, computation, compile_options,
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/profiler.py", line 314, in wrapper
    return func(*args, **kwargs)
  File "/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages/jax/_src/dispatch.py", line 465, in backend_compile
    return backend.compile(built_c, compile_options=options)
jaxlib.xla_extension.XlaRuntimeError: FAILED_PRECONDITION: DNN library initialization failed. Look at the errors above for more details.

There is no memory problem, and I have set up my $LD_LIBRARY_PATH to point to where my CUDNN version I downloaded is:
echo $LD_LIBRARY_PATH
/a/home/cc/chemist/mikabell/anaconda3/envs/jax-env/lib/

#define CUDNN_MAJOR 8
#define CUDNN_MINOR 9

Please I would appreciate someone's help in understanding why I get the same error over and over again..
Thank you!
System info (python version, jaxlib version, accelerator, etc.)
nvidia-smi
Tue Aug 20 16:52:27 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.23.08              Driver Version: 545.23.08    CUDA Version: 12.3     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA L40                     On  | 00000000:01:00.0 Off |                    0 |
| N/A   39C    P0              79W / 300W |    894MiB / 46068MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
|   1  NVIDIA L40                     On  | 00000000:02:00.0 Off |                    0 |
| N/A   29C    P8              34W / 300W |     21MiB / 46068MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
|   2  NVIDIA L40                     On  | 00000000:61:00.0 Off |                    0 |
| N/A   29C    P8              34W / 300W |     21MiB / 46068MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
|   3  NVIDIA L40                     On  | 00000000:62:00.0 Off |                    0 |
| N/A   30C    P8              35W / 300W |     21MiB / 46068MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|    0   N/A  N/A      3774      G   /usr/lib/xorg/Xorg                            4MiB |
|    0   N/A  N/A    999897      C   ...physics/rtk243/anaconda3/bin/python      868MiB |
|    1   N/A  N/A      3774      G   /usr/lib/xorg/Xorg                            4MiB |
|    2   N/A  N/A      3774      G   /usr/lib/xorg/Xorg                            4MiB |
|    3   N/A  N/A      3774      G   /usr/lib/xorg/Xorg                            4MiB |
+---------------------------------------------------------------------------------------+

pip show jax jaxlib
Name: jax
Version: 0.4.13
Summary: Differentiate, compile, and transform Numpy code.
Home-page: https://github.com/google/jax
Author: JAX team
Author-email<EMAIL_ADDRESS>License: Apache-2.0
Location: /home/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages
Requires: importlib-metadata, ml-dtypes, numpy, opt-einsum, scipy
Required-by:
---
Name: jaxlib
Version: 0.4.13+cuda12.cudnn89
Summary: XLA library for JAX
Home-page: https://github.com/google/jax
Author: JAX team
Author-email<EMAIL_ADDRESS>License: Apache-2.0
Location: /home/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages
Requires: ml-dtypes, numpy, scipy
Required-by:

It looks like you're running a really old version of JAX (0.4.13; the current version is 0.4.31). You'll probably need to update your Python version because 3.8 is no longer supported, and then install the most recent version of JAX (pip install -U "jax[cuda12]") to see if that does the trick!

@dfm

It looks like you're running a really old version of JAX (0.4.13; the current version is 0.4.31). You'll probably need to update your Python version because 3.8 is no longer supported, and then install the most recent version of JAX (pip install -U "jax[cuda12]") to see if that does the trick!

I tried to upgrade into a new version but I only get this after running  'pip install -U "jax[cuda12]"':
pip show jax jaxlib WARNING: Package(s) not found: jaxlib Name: jax Version: 0.4.13 Summary: Differentiate, compile, and transform Numpy code. Home-page: https://github.com/google/jax Author: JAX team Author-email<EMAIL_ADDRESS>License: Apache-2.0 Location: /home/mikabell/anaconda3/envs/jax-env/lib/python3.8/site-packages Requires: importlib-metadata, ml-dtypes, numpy, opt-einsum, scipy Required-by:

Did you upgrade your Python version? Python 3.8 is no longer supported!

@dfm

Did you upgrade your Python version? Python 3.8 is no longer supported!

I upgraded, but now my code only runs on the CPU not GPU:
python --version
Python 3.12.0
pip show jax jaxlib
Name:
jax Version: 0.4.31
Name:
jaxlib Version: 0.4.31

import jax
jax.devices()
[CpuDevice(id=0)]

How can I resolve this? thanks!

Given the 🎉  reaction, I'm going to hope that you got this sorted out on your end @MikaBell and close this issue. Please feel free to comment or open a new issue if the problem persists!


0.6.171 Router adds "Content-Encoding: gzip" even if the response content is raw/text

so our http-client gets baffled.
see below, some of the requests we tried... (few internal details have been removed/obscured)
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
User-Agent: curl/7.37.1
Host: host:port
Accept: /
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 20:54:11 GMT
Date: Wed, 25 Feb 2015 20:54:11 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
Accept-Encoding:
Host: host:port
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 20:59:07 GMT
Date: Wed, 25 Feb 2015 20:59:07 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
Host: host:port
Accept-Encoding: gzip
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 21:07:47 GMT
Date: Wed, 25 Feb 2015 21:07:47 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}

I thought we had fixed this already. Is this only for the datasources endpoint or also for query endpoints?

On Feb 27, 2015, at 08:34, Himanshu<EMAIL_ADDRESS>wrote:
so our http-client gets baffled.
see below, some of the requests we tried... (few internal details have been removed/obscured)
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
User-Agent: curl/7.37.1
Host: host:port
Accept: /
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 20:54:11 GMT
Date: Wed, 25 Feb 2015 20:54:11 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
Accept-Encoding:
Host: host:port
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 20:59:07 GMT
Date: Wed, 25 Feb 2015 20:59:07 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}
$ netcat router-host port
GET /druid/v2/datasources/mydatasource?interval=2010-01-01/2016-01-01&full HTTP/1.1
Host: host:port
Accept-Encoding: gzip
HTTP/1.1 200 OK
Date: Wed, 25 Feb 2015 21:07:47 GMT
Date: Wed, 25 Feb 2015 21:07:47 GMT
Content-Type: application/json
Content-Encoding: gzip
Vary: Accept-Encoding, User-Agent
Server: Jetty(9.2.5.v20141112)
Content-Length: 1456
{..plain text json..}
—
Reply to this email directly or view it on GitHub.

Thanks for looking.
That is correct we are not seeing the issue on query endpoint (POST /druid/v2/)
Also, we are seeing it on 0.6.171. Did the fix go in 0.6 or in 0.7 only?

also pls point me to the commit, i'll backport it internally on 0.6 if required.

@himanshug See if the following PR fixes it for you in 0.6 https://github.com/druid-io/druid/pull/957/files
Just adding the line here should fix your issue: https://github.com/druid-io/druid/pull/957/files#diff-564b553ed0071ba9c897abf6a7ca8b8fR129, but if you also want to have gzip compression for POST requests, you will need this as well https://github.com/druid-io/druid/pull/957/files#diff-f7b24049b9788368c23c082e1cb63e15R32
I'm rewriting the async query proxy servlet as we speak to remove the copy/pasted code from the jetty codebase, now that jetty has better methods to allow overriding, which should allow us to benefit from all the fixes in Jetty.

@himanshug can you have a look at this pull-request, if this one does what you expect in 0.7
https://github.com/druid-io/druid/pull/1158

@himanshug I have updated the issue title to reflect that this has only been confirmed for 0.6.x

@xvrl sure, thanks

@himanshug I just tested, and 0.7.0 works as expected, so this only affects 0.6.
If you are able to fix it for 0.6.x based on my earlier comment https://github.com/druid-io/druid/issues/1157#issuecomment-76458543, would you mind submitting a PR for 0.6.x? Thanks!

Closing this as I believe it is no longer an issue in master


grammar of typehood judgments is confusing

It looks like we have A type at k and A = B at k type; it might be clearer to have A = B type at k. Unless I misunderstood the grammar.

There are levels and kinds. The current full grammar is
A = B k type at l
M = N in A type at l with k

and various components will be hidden under various conditions.

I am all ears for grammar suggestions because my English is terrible.

I am all ears for grammar suggestions because my English is terrible.

It's continued to improve and it's already pretty good! 😄
I'll circle back to this issue soon, I need to stop procrastinating on my TA duties.

Any suggestion for the new grammar? I am tweaking the parser now.

Turns out A = B at k is due to a bug. term EQUALS term atLevel kindedType should have been term EQUALS term kindedType atLevel.


One odd puzzle fail

For whatever reason, while all the other puzzles I have tried are found by Crossword Scraper, this one is not:
https://www.washingtonexaminer.com/crossword-swallow-ones-words

The iframe is at https://aws1.washingtonexaminer.com/embeds/crossword/2022-04-26.html, and the puzzle scrapes fine from there, so we probably just have to add aws1.washingtonexaminer.com to the list of known hosts here. Other puzzles have been hosted on a different domain.


setting read_timeout is not working

'''File "/usr/local/anaconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: AWSHTTPSConnectionPool(host='ec2.us-east-1.amazonaws.com', port=443): Read timed out. (read timeout=60)
Here's the code:
config_boto = Config(connect_timeout=3600, read_timeout=3600, retries={'max_attempts' : 0})
client = boto3.client('ec2', config=config_boto, region_name="us-east-1")

What version of boto3/botocore are you using?  I'd double check your'e using the latest version.  Botocore will catch the ReadTimeoutError and raise it's own version so if you're seeing a ReadTimeoutError from urllib3 it could mean you're using an old version of botocore that doesn't support read timeouts.  I double checked that we are plumbing this value through to urllib3.  This is what you should see on the latest version of botocore:
Traceback (most recent call last):
  File "/tmp/a.py", line 5, in <module>
    client.describe_images()
  File "botocore/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "botocore/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "botocore/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "botocore/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "botocore/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "botocore/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "botocore/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "botocore/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "botocore/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "botocore/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "botocore/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "botocore/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "botocore/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "botocore/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "botocore/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
botocore.exceptions.ReadTimeoutError: Read timeout on endpoint URL: "https://ec2.us-east-1.amazonaws.com/"

I tried to put read_timeout in ~/.aws/config under default profile, and it didn't take the value.
Could it be read_timeout cannot be in ~/.aws/config?

21:27:54 Traceback (most recent call last):
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 421, in _make_request
21:27:54     six.raise_from(e, None)
21:27:54   File "", line 3, in raise_from
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 416, in _make_request
21:27:54     httplib_response = conn.getresponse()
21:27:54   File "/usr/local/lib/python3.7/http/client.py", line 1344, in getresponse
21:27:54     response.begin()
21:27:54   File "/usr/local/lib/python3.7/http/client.py", line 306, in begin
21:27:54     version, status, reason = self._read_status()
21:27:54   File "/usr/local/lib/python3.7/http/client.py", line 267, in _read_status
21:27:54     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
21:27:54   File "/usr/local/lib/python3.7/socket.py", line 589, in readinto
21:27:54     return self._sock.recv_into(b)
21:27:54   File "/usr/local/lib/python3.7/ssl.py", line 1071, in recv_into
21:27:54     return self.read(nbytes, buffer)
21:27:54   File "/usr/local/lib/python3.7/ssl.py", line 929, in read
21:27:54     return self._sslobj.read(len, buffer)
21:27:54 socket.timeout: The read operation timed out
21:27:54
21:27:54 During handling of the above exception, another exception occurred:
21:27:54
21:27:54 Traceback (most recent call last):
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/httpsession.py", line 263, in send
21:27:54     chunked=self._chunked(request.headers),
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
21:27:54     method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 376, in increment
21:27:54     raise six.reraise(type(error), error, _stacktrace)
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 735, in reraise
21:27:54     raise value
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
21:27:54     chunked=chunked,
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 423, in _make_request
21:27:54     self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
21:27:54   File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 331, in _raise_timeout
21:27:54     self, url, "Read timed out. (read timeout=%s)" % timeout_value
21:27:54 urllib3.exceptions.ReadTimeoutError: AWSHTTPSConnectionPool(host='ec2.us-east-1.amazonaws.com', port=443): Read timed out. (read timeout=60)
21:27:54
21:27:54 During handling of the above exception, another exception occurred:
21:27:54
21:27:54 Traceback (most recent call last):
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/commands.py", line 283, in run
21:27:54     policy()
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/policy.py", line 1045, in call
21:27:54     resources = PullMode(self).run()
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/policy.py", line 288, in run
21:27:54     resources = self.policy.resource_manager.resources()
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/resources/ec2.py", line 93, in resources
21:27:54     return super(EC2, self).resources(query=query)
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/query.py", line 460, in resources
21:27:54     resources = self.source.resources(query)
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/query.py", line 230, in resources
21:27:54     return self.query.filter(self.manager, **query)
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/query.py", line 90, in filter
21:27:54     getattr(resource_manager, 'retry', None)) or []
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/query.py", line 69, in _invoke_client_enum
21:27:54     data = results.build_full_result()
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/paginate.py", line 449, in build_full_result
21:27:54     for response in self:
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/paginate.py", line 255, in iter
21:27:54     response = self._make_request(current_kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/query.py", line 686, in _make_request
21:27:54     return self.retry(self._method, **current_kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/c7n/utils.py", line 390, in _retry
21:27:54     return func(*args, **kw)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 276, in _api_call
21:27:54     return self._make_api_call(operation_name, kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 573, in _make_api_call
21:27:54     operation_model, request_dict, request_context)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 592, in _make_request
21:27:54     return self._endpoint.make_request(operation_model, request_dict)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 102, in make_request
21:27:54     return self._send_request(request_dict, operation_model)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 137, in _send_request
21:27:54     success_response, exception):
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 231, in _needs_retry
21:27:54     caught_exception=caught_exception, request_dict=request_dict)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/hooks.py", line 356, in emit
21:27:54     return self._emitter.emit(aliased_event_name, **kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/hooks.py", line 228, in emit
21:27:54     return self._emit(event_name, kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/hooks.py", line 211, in _emit
21:27:54     response = handler(**kwargs)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 183, in call
21:27:54     if self._checker(attempts, response, caught_exception):
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 251, in call
21:27:54     caught_exception)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 277, in _should_retry
21:27:54     return self._checker(attempt_number, response, caught_exception)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 317, in call
21:27:54     caught_exception)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 223, in call
21:27:54     attempt_number, caught_exception)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
21:27:54     raise caught_exception
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 200, in _do_get_response
21:27:54     http_response = self._send(request)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 244, in _send
21:27:54     return self.http_session.send(request)
21:27:54   File "/usr/local/lib/python3.7/site-packages/botocore/httpsession.py", line 289, in send
21:27:54     raise ReadTimeoutError(endpoint_url=request.url, error=e)
21:27:54 botocore.exceptions.ReadTimeoutError: Read timeout on endpoint URL: "https://ec2.us-east-1.amazonaws.com/"

What version of boto3/botocore are you using? I'd double check your'e using the latest version. Botocore will catch the ReadTimeoutError and raise it's own version so if you're seeing a ReadTimeoutError from urllib3 it could mean you're using an old version of botocore that doesn't support read timeouts. I double checked that we are plumbing this value through to urllib3. This is what you should see on the latest version of botocore:
Traceback (most recent call last):
  File "/tmp/a.py", line 5, in <module>
    client.describe_images()
  File "botocore/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "botocore/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "botocore/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "botocore/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "botocore/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "botocore/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "botocore/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "botocore/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "botocore/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "botocore/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "botocore/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "botocore/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "botocore/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "botocore/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "botocore/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
botocore.exceptions.ReadTimeoutError: Read timeout on endpoint URL: "https://ec2.us-east-1.amazonaws.com/"

Hi! My dependency is:
# pip list|grep boto
boto                     2.49.0
boto3                    1.14.47
botocore                 1.17.47

My code is:


How does mega discriminator lable "human-written disinformation"?

According to your blog, grover achieved great accuracy on both neural fake news as well as human-written disinformation. The output label of your released mega is ['machine', 'human']. So, how do you label the "human-written disinformation", it should be "human" literally but should be "machine" because it is "fake".
Your work is very interesting to me and I am hoping to apply your model in near future.

We added a separate label for that. The code for that isn't currently in the repo, but it's a pretty simple change (just add the third label). best of luck!

Thanks for your comments. I'd like to reproduce your interesting and great work. Therefore, I am wondering whether you could share human-written disinformation data set you collected (as you mentioned in the blog). If not, could you please tell me how you collect these 30k data? Cheers!

Sure, the raw data is here gs://grover-models/data/data_3way_human_prop_machine_june7.jsonl . lmk if that works. thanks!

Thanks so much for sharing the data. But I tried to download in the following two ways:
gsutil cp gs://grover-models/data/data_3way_human_prop_machine_june7.jsonl . wget https://storage.googleapis.com/grover-models/data/data_3way_human_prop_machine_june7.jsonl
Both reported 403 access denied error. Might you please check if you made this data file public accessible? Thank you!

sorry, should be fixed now. thanks!

I downloaded it this time. Much appreciated for sharing!

I've been trying to reproduce this. I added the extra label, and ran run_discrimination.py on a TPU pod against the 3-class dataset.
But the loss barely decreases before training ends, and the final model always predicts human.
LABEL_LIST = ['machine', 'human', 'propaganda']

PYTHONPATH=${PWD} python discrimination/run_discrimination.py --input_data data/data_3way_human_prop_machine_june7.jsonl --output_dir gs://<my-bucket> --config_file lm/configs/large.json --do_train --tpu_name <my-tpu-pod> --tpu_zone <my-zone> --use_tpu

@rowanz Were there any other changes to the training code? How many epochs did you need? Do you still have the checkpoints for that model?


Disabled accuracy computation for straightening

Related to issue #1075

@benjamindeleener, can you update this branch with master, then merge, then we can incorporate this PR for the beta_30 release


Add simple cmd

needs: https://github.com/SuperMeepBoy/wikitransbot/pull/30
add 2 command:

"intro" to get https://wikitrans.co/intro/
"tronbi" to https://wikitrans.co/modeles/

Hey ! I looked at your code. As I said in your other PR, I've been working on that today too and chose another solution. I have thought of your solution but I concluded it reduced readability. I am still thinking of a way to easily add new commands and I might do something that looks like that in a near future.
The need asked on #27 requires much more unfortunately.

I can't merge code with unfinished features (basically all error handlers you added)
Commands must be fully configurable with the config.json because I plan to make a front for the WIkitrans team
I think it lacks readability but I'm definitely going to try as much as I can to find a compromise between your solution and the things I've done today. Again I thought about doing classes for commands and I still think as you say that this is a good solution if we need to add more commands in the future

Be sure your work is not going to be lost even if I can't accept the PR as it is.
Thanks a lot for your contribution !

I can't merge code with unfinished features (basically all error handlers you added)
Yes this was done on purpose and will have updated based on the return / adding template for them

Commands must be fully configurable with the config.json because I plan to make a front for the WIkitrans team
This shouldn't be a problem at all, A init function or somethings should be quite easy to add
I didn't wanted to change to much at the time and I think here it was already a little to much

I think it lacks readability
This can be "fixed" or comment can be added to help

but I'm definitely going to try as much as I can to find a compromise between your solution and the things I've done today.
Don't worries about it, if you have somethings that's works for it, it's fine


bump up to the latest minio-storage

with docker compose as a plugin

donw

Will be test after fix https://github.com/zebrunner/reporting/issues/2357

Verified.


Import: exception when morph targets don't have POSITIONS

Traceback (most recent call last):
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/__init__.py", line 473, in execute
    return self.import_gltf2(context)
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/__init__.py", line 492, in import_gltf2
    BlenderGlTF.create(self.gltf_importer)
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/blender/imp/gltf2_blender_gltf.py", line 36, in create
    BlenderScene.create(gltf, scene_idx)
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/blender/imp/gltf2_blender_scene.py", line 84, in create
    BlenderNode.create(gltf, node_idx, None)  # None => No parent
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/blender/imp/gltf2_blender_node.py", line 76, in create
    BlenderMesh.set_mesh(gltf, gltf.data.meshes[pynode.mesh], mesh, obj)
  File "/home/scurest/.config/blender/2.79/scripts/addons/io_scene_gltf2/blender/imp/gltf2_blender_mesh.py", line 127, in set_mesh
    pos = BinaryData.get_data_from_accessor(gltf, prim.targets[i]['POSITION'])
KeyError: 'POSITION'

Test File

Will fix the exception.

Trying to read the spec to undertand how to manage this morph.

This is in glTF spec regarding meshes :

Implementation note: When positions are not specified, client implementations should skip primitive's rendering unless its positions are provided by other means (e.g., by extension). This applies to both indexed and non-indexed geometry.

This is in glTF spec regarding morph targets :

Implementation note: The number of morph targets is not limited in glTF. A conformant client implementation must support at least eight morphed attributes. This means that it has to support at least eight morph targets that contain a POSITION attribute, or four morph targets that contain a POSITION and a NORMAL attribute, or two morph targets that contain POSITION, NORMAL and TANGENT attributes. For assets that contain a higher number of morphed attributes, renderers may choose to either fully support them (for example, by performing the morph computations in software), or to only use the eight attributes of the morph targets with the highest weights.

(So this is not explicitly written that POSITION can be omitted in morph target too).
So  ... How to handle? Ignore this morph target? Create a morph target will same mesh as in primitive?
@donmccurdy any thoughts ?

It just means that the positions are not affected by the morph weights (the normals or tangents might be). I'd just skip creating the shape key since a shape key is basically a morph target for POSITIONs. And then you also need to skip creating actions that animate the weights of an instance of such a mesh.


Update README.md

Should fix #15
Please let me know if you expect anything else to be added.

@Kallyan01 Please take a look

ok


Editor

@EvanLovely is this ready for review by the team / ready to merge down to master?
If so, could I be a pain and ask for a 1-line PR summary, short description, and how to test steps so the team + myself can take a look?

Created http://vjira2:8080/browse/BDS-1720 and http://vjira2:8080/browse/BDS-1721 for @sghoweri and @mikemai2awesome to review.


Adds top level reference indices

closes #1559

Adds all top level indices

Adds a docsConvert.js to convert json into module.exports = ${json}, b/c the json-loader would not cooperate.

Adds a format.js module which provides a place to format docs as desired to be used in rendering.

Crumbs per-index still need work, as do descriptions and other strings with embedded HTML. Can be addressed after this is in.

Example:

Coverage increased (+0.09%) to 81.32% when pulling 9e48f6b1fa9abc4f5407fdb1ca335490befbb6b5 on mparke:docs-linodes-index into 7b53ea3fe3f0085738116c00690adf40dd98b8f0 on linode:master.

Coverage remained the same at 81.231% when pulling 76c3452264e787d09368c804fb78535cafa4fc2e on mparke:docs-linodes-index into 7b53ea3fe3f0085738116c00690adf40dd98b8f0 on linode:master.


Weather App

Thanks for contributing to the community.
I'd still love you to give the repo a Star ⭐.
Thanks.

If there are any other react issue post it

I've added other issues on react, do well to check the issues tab.
Thanks


Prisma introspects Postgres not null generated columns as required fields.

Bug description
It's not possible to insert a value into Postgres generated columns. When Prisma introspects a table with a not null generated column, it makes the corresponding model field as required. At the minimum it should be optional.
How to reproduce
CREATE TABLE person (
    primary key (person_id),
    person_id      bigint,
    first_name     text not null,
    last_name      text not null,
    full_name      text NOT NULL GENERATED ALWAYS AS (first_name || ' ' || last_name)
);

When you run prisma introspect, you get
model person {
  person_id         Int             @id
  first_name        String
  last_name         String
  full_name         String
}

Postgres will throw an error when you try to insert a person since you can't insert into the full_name column.
Expected behavior
prisma introspect should mark NOT NULL GENERATED ALWAYS AS columns with a @default tag. Or an optional tag as a temporary workaround.
Environment & setup

OS: Debian
Database: PostgreSQL
Node.js version: 15.0.1
Prisma version:

@prisma/cli          : 2.13.1
@prisma/client       : 2.13.1
Current platform     : debian-openssl-1.1.x
Query Engine         : query-engine fcbc4bb2d306c86c28014f596b1e8c7980af8bd4 (at<EMAIL_ADDRESS>Migration Engine     : migration-engine-cli fcbc4bb2d306c86c28014f596b1e8c7980af8bd4 (at<EMAIL_ADDRESS>Introspection Engine : introspection-core fcbc4bb2d306c86c28014f596b1e8c7980af8bd4 (at<EMAIL_ADDRESS>Format Binary        : prisma-fmt fcbc4bb2d306c86c28014f596b1e8c7980af8bd4 (at<EMAIL_ADDRESS>Studio               : 0.329.0

Fixing this in the introspection engine would be a first step, but technically the QE should also know to not expose that field as writable then. For that we currently do not have a schema language capability.

Fixing this in the introspection engine would be a first step, but technically the QE should also know to not expose that field as writable then. For that we currently do not have a schema language capability.

I'm experiencing the same issue.

I am closing this issue as a duplicate of https://github.com/prisma/prisma/issues/3001.
This will help us actually prioritize the issue, as we are not distracted by having multiple ones that compete for attention. Please make sure you left a 👍 reaction on the original issue description over there, and leave a comment if any aspect of the feature has not been talked about yet. Thank you!


Compatibility with Julia v 1.10

Pkg.add("Casacore") on Julia 1.10 fails due to both CxxWrap and libcasacorecxx_jll failing to build. This seems to be due at least to CxxWrap being restricted to version 0.12 in Project.toml. Independently, I can confirm that I can precompile CxxWrap version 0.14 on Julia 1.10 successfully, but not 0.12.
Would it be easy to release an updated version of Casacore that works with Julia 1.10?
Thanks!

@iniyannatarajan Thanks for creating the issue, I'll look at this tomorrow.

I'm struggling to get BinaryBuilder to rebuild both casacore_jll and casacorecxx_jll. I'll have to pin down the issues I'm encountering and reach out for some help.

casacore_jll needs to be rebuilt with updated FITSIO_jll dependency.
Waiting for this to be merged: https://github.com/JuliaPackaging/Yggdrasil/pull/8082

It looks like that has been merged now.  I haven't used BinaryBuilder before, but is there anything I can do to help this process along?

I'm having issues getting things working with the updated CxxWrap module. I have opened a ticket there: https://github.com/JuliaInterop/CxxWrap.jl/issues/410

I've merged the 1.10 branch; waiting on Yggdrasil to accept my changes, and then push out the changes to the Julia registry.

The Juliahub registry has been updated.
Install v0.3.0 of Casacore to work with Julia 1.10. There are no other changes to the module.


Fixed few issues

Parallax bg input fields were not working
If you didn't provide any content/layout plugins, instead of nothing, it showed "0" literally in the ui as that's the length of plugin array

Second issue can be easily seen if you navigate to https://editor.ory.am/?utm_source=github&utm_medium=header&utm_campaign=editor and search for "bla bla", you'll see "00", imho what you should rly see is a placeholder of some sort. "No plugins found" but for now this at least keeps it without bugs

Coverage remained the same at 49.656% when pulling a7714dc5f0f4fe3363b4729d6dced21ab0871633 on PeterKottas:minor-fixes into 3ef3a273e3255e4a503695046a74ede39302d0eb on ory:master.

Hell the no message on empty search for just stupid, I've added it right away.

Thanks! I am out of of office until Thursday and will review/merge then or earlier if I find some time. Cheers :)

On 12. Aug 2018, at 20:34, Peter Kottas<EMAIL_ADDRESS>wrote:
Second issue can be easily seen if you navigate to https://editor.ory.am/?utm_source=github&utm_medium=header&utm_campaign=editor and search for "bla bla", you'll see "00", imho what you should rly see is a placeholder of some sort. "No plugins found" but for now this at least keeps it without bugs
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

DCO may fail if the sign-off name + email is different from the github one!

Sometimes the sign-off works, sometimes it doesn't. Driving me nuts. Always commiting the same way. But anyways, the anon functions are fixed, good catch

Apparently there's a problem in build with the Node type you suggest
import type { Node } from 'react'
                   ^^^^ Named import from module `react`. This module has no named export called `Node`.

Apparently that one doesn't exist. Is it a typo or can you suggest something else that would work pls?

Hm strange, might have to do with an outdated flow version. It's from the docs:

import type {Node} from 'react';

Let's have any then as a workaround for now

Ok fair enough. Yeah the version is truly archaic. Is this all for this PR then or should I fix something else?

No, that would be it. But : any is still missing :)

Haha, my bad. Too many changes flying around

Thank you!