Update deps 2020 07 22

Disclaimer
For the purpose of this upcoming release we will do the process backwards without tagging. We will point dependencies to its latest master at a given point on time, Once the ocis release is complete, tags will be added to each extension.
Involved steps are:

[x] start ocis-store by default

Releases:

[x] Update ocis-accounts @refs needs to include https://github.com/owncloud/ocis-accounts/commit/229e5e01d7f6599a1e38463df7497dae40aacc55
[x] Release ocis-proxy 0.5.0 @kulmann

[x] merge https://github.com/owncloud/ocis-proxy/pull/76 first

[x] Release ocis-ocs 0.1.0 @kulmann
[x] Release ocis-store 0.1.0 @kulmann
[x] Prepare release ocis-store 0.1.1 (0.1.0 has code referencing ocis-settings, which should not be there) @refs
[x] Update ocis-reva to https://github.com/owncloud/ocis-reva/commit/ef92a0b3ffedd4989e355d6672f672f1e98bb3bf
[x] Release ocis-konnectd 0.3.2 @kulmann
[x] Release ocis-glauth 0.5.0 @butonic
[x] Update ocis-glauth to https://github.com/owncloud/ocis-glauth/commit/c01ce162774eb7bc25068f0c47aa150648f800c8
[x] Release ocis-webdav 0.1.1 @kulmann
[x] Release ocis-thumbnails 0.2.0 @C0rby
[x] Update ocis-phoenix - as a draft PR because it doesn't use a phoenix release, but a manual build instead @kulmann

[x] implement https://github.com/owncloud/product/issues/116
[x] get https://github.com/owncloud/phoenix/pull/3817 merged
[x] in ocis-phoenix, provide default config option for hiding search bar
[x] get https://github.com/owncloud/phoenix/pull/3797 merged - currently blocked

[x] possible fix in https://github.com/owncloud/openidconnect/pull/89

[x] go mod tidy in ocis (depends on https://github.com/cs3org/reva/pull/1007 and update ocis-reva) @butonic

This PR can be used to test downloads with pre-signed urls. There is a manual step involved for phoenix:

check out https://github.com/owncloud/phoenix/pull/3797
inside the phoenix dir, run

yarn install-all
yarn build-all

inside the ocis dir, run OCIS_LOG_LEVEL=debug PHOENIX_ASSET_PATH=/path/to/phoenix/dist/ go run cmd/ocis/main.go server

Looking at webui tests, one can see that the login is failing on CI. Might be related to changes in ocis-accounts, needs investigation.

the tests are using the build in phoenix and using that I cannot login neither with the test users (einstein) not with LDAP users.
using "einstein" and no LDAP the response to the login request is:
HTTP/1.1 204 No Content
Access-Control-Allow-Origin: *
Cache-Control: no-cache, no-store, must-revalidate
Date: Thu, 23 Jul 2020 08:34:17 GMT
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Kopano-Konnect-State: ezrifk
Last-Modified: Thu, 23 Jul 2020 08:34:17 GMT
Pragma: no-cache
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Konnectd-Version: 0.0.0
X-Xss-Protection: 1; mode=block

log logs in the ocis console
with LDAP I get redirected after the kopano page, but the request to https://localhost:9200/ocs/v1.php/cloud/capabilities?format=json get a HTTP 500 response and I end up on a login error page.
ocis log output:
2020-07-23 14:23:59  file=grpc/grpc.go:373 level=error panic recovered: runtime error: invalid memory address or nil pointer dereference
2020-07-23 14:23:59  file=grpc/grpc.go:374 level=error goroutine 110 [running]:
runtime/debug.Stack(0xc00000e4e0, 0xc001c6fa02, 0xc001c6fa20)
	/usr/local/go/src/runtime/debug/stack.go:24 +0x9d
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest.func1.1(0xc000e78b38)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:374 +0x2cf
panic(0x2da2140, 0x4850f50)
	/usr/local/go/src/runtime/panic.go:679 +0x1b2
github.com/owncloud/ocis-accounts/pkg/service/v0.Service.ListAccounts(0xc001f809e0, 0x19, 0x364fa80, 0xc0012a52b0, 0xff, 0x0, 0x0, 0xc001270e00, 0x15, 0x1f4, ...)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-accounts@v0.1.2-0.20200721035523-7af05fb19171/pkg/service/v0/accounts.go:236 +0x673
github.com/owncloud/ocis-accounts/pkg/proto/v0.(*accountsServiceHandler).ListAccounts(0xc002550b60, 0x368d300, 0xc001ca7770, 0xc002675f80, 0xc00093ae10, 0x7fbdd7557460, 0x0)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-accounts@v0.1.2-0.20200721035523-7af05fb19171/pkg/proto/v0/accounts.pb.micro.go:229 +0x5b
reflect.Value.call(0xc00243f100, 0xc00255e7f8, 0x13, 0x315f452, 0x4, 0xc000e78a98, 0x4, 0x4, 0x16, 0x2ffd400, ...)
	/usr/local/go/src/reflect/value.go:460 +0x5f6
reflect.Value.Call(0xc00243f100, 0xc00255e7f8, 0x13, 0xc000f16a98, 0x4, 0x4, 0x203000, 0x203000, 0xc000f16a50)
	/usr/local/go/src/reflect/value.go:321 +0xb4
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest.func1(0x368d300, 0xc001ca7770, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:379 +0x303
github.com/micro/go-micro/v2/util/wrapper.AuthHandler.func1.1(0x368d300, 0xc001ca7770, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0xc001ca7770, 0xc000426fc0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:239 +0x444
github.com/micro/go-micro/v2/util/wrapper.TraceHandler.func1.1(0x368d300, 0xc001ca7650, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:120 +0x1c6
github.com/micro/go-micro/v2/util/wrapper.HandlerStats.func1.1(0x368d300, 0xc001ca7650, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x0, 0x368d300)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:65 +0x83
github.com/micro/go-plugins/wrapper/trace/opencensus/v2.NewHandlerWrapper.func1.1(0x368d300, 0xc001ca7650, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-plugins/wrapper/trace/opencensus/v2@v2.0.1/opencensus.go:129 +0x419
github.com/owncloud/ocis-pkg/v2/wrapper/prometheus.NewHandlerWrapper.func1.1(0x368d300, 0xc001ca73e0, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-pkg/v2@v2.2.2-0.20200602070144-cd0620668170/wrapper/prometheus/prometheus.go:77 +0x206
github.com/micro/go-micro/v2/util/wrapper.AuthHandler.func1.1(0x368d300, 0xc001ca7320, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0xc001ca7320, 0xc000426f50)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:239 +0x444
github.com/micro/go-micro/v2/util/wrapper.TraceHandler.func1.1(0x368d240, 0xc001d05280, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x16, 0x2fa85e0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:120 +0x1c6
github.com/micro/go-micro/v2/util/wrapper.HandlerStats.func1.1(0x368d240, 0xc001d05280, 0x36ae4c0, 0xc0000d6d00, 0x2fa85e0, 0xc00093ae10, 0x1c, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:65 +0x83
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest(0xc00026b380, 0x369e500, 0xc00017c6c0, 0xc002657a00, 0xc001fdfc20, 0xc002694fe0, 0x16, 0x368d240, 0xc001d05280, 0xc000268000, ...)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:396 +0x7ee
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).handler(0xc00026b380, 0x0, 0x0, 0x369e500, 0xc00017c6c0, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:315 +0x77f
google.golang.org/grpc.(*Server).processStreamingRPC(0xc001f8db00, 0x36ae640, 0xc001692a80, 0xc000171e00, 0x0, 0xc002662d00, 0x0, 0x0, 0x0)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:1237 +0xb44
google.golang.org/grpc.(*Server).handleStream(0xc001f8db00, 0x36ae640, 0xc001692a80, 0xc000171e00, 0x0)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:1323 +0xc0c
google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001d5bca0, 0xc001f8db00, 0x36ae640, 0xc001692a80, 0xc000171e00)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:722 +0xbb
created by google.golang.org/grpc.(*Server).serveStreams.func1
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:720 +0xa1

2020-07-23 14:23:59  file=grpc/grpc.go:373 level=error panic recovered: runtime error: invalid memory address or nil pointer dereference
2020-07-23 14:23:59  file=grpc/grpc.go:374 level=error goroutine 130 [running]:
runtime/debug.Stack(0xc00000e4e0, 0xc001e08802, 0xc001e08800)
	/usr/local/go/src/runtime/debug/stack.go:24 +0x9d
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest.func1.1(0xc000e78b38)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:374 +0x2cf
panic(0x2da2140, 0x4850f50)
	/usr/local/go/src/runtime/panic.go:679 +0x1b2
github.com/owncloud/ocis-accounts/pkg/service/v0.Service.ListAccounts(0xc001f809e0, 0x19, 0x364fa80, 0xc0012a52b0, 0xff, 0x0, 0x0, 0xc001270e00, 0x15, 0x1f4, ...)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-accounts@v0.1.2-0.20200721035523-7af05fb19171/pkg/service/v0/accounts.go:236 +0x673
github.com/owncloud/ocis-accounts/pkg/proto/v0.(*accountsServiceHandler).ListAccounts(0xc002550b60, 0x368d300, 0xc00260f140, 0xc0003b12c0, 0xc00169eb90, 0x7fbdd7557460, 0x0)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-accounts@v0.1.2-0.20200721035523-7af05fb19171/pkg/proto/v0/accounts.pb.micro.go:229 +0x5b
reflect.Value.call(0xc00243f100, 0xc00255e7f8, 0x13, 0x315f452, 0x4, 0xc000f16a98, 0x4, 0x4, 0x16, 0x2ffd400, ...)
	/usr/local/go/src/reflect/value.go:460 +0x5f6
reflect.Value.Call(0xc00243f100, 0xc00255e7f8, 0x13, 0xc000f16a98, 0x4, 0x4, 0x203000, 0x203000, 0xc000f16a50)
	/usr/local/go/src/reflect/value.go:321 +0xb4
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest.func1(0x368d300, 0xc00260f140, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:379 +0x303
github.com/micro/go-micro/v2/util/wrapper.AuthHandler.func1.1(0x368d300, 0xc00260f140, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0xc00260f140, 0xc000427650)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:239 +0x444
github.com/micro/go-micro/v2/util/wrapper.TraceHandler.func1.1(0x368d300, 0xc00260f020, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:120 +0x1c6
github.com/micro/go-micro/v2/util/wrapper.HandlerStats.func1.1(0x368d300, 0xc00260f020, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x0, 0x368d300)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:65 +0x83
github.com/micro/go-plugins/wrapper/trace/opencensus/v2.NewHandlerWrapper.func1.1(0x368d300, 0xc00260f020, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-plugins/wrapper/trace/opencensus/v2@v2.0.1/opencensus.go:129 +0x419
github.com/owncloud/ocis-pkg/v2/wrapper/prometheus.NewHandlerWrapper.func1.1(0x368d300, 0xc00260ede0, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/owncloud/ocis-pkg/v2@v2.2.2-0.20200602070144-cd0620668170/wrapper/prometheus/prometheus.go:77 +0x206
github.com/micro/go-micro/v2/util/wrapper.AuthHandler.func1.1(0x368d300, 0xc00260ed20, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0xc00260ed20, 0xc0004275e0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:239 +0x444
github.com/micro/go-micro/v2/util/wrapper.TraceHandler.func1.1(0x368d240, 0xc001d05880, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x16, 0x2fa85e0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:120 +0x1c6
github.com/micro/go-micro/v2/util/wrapper.HandlerStats.func1.1(0x368d240, 0xc001d05880, 0x36ae4c0, 0xc001f84780, 0x2fa85e0, 0xc00169eb90, 0x1c, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/util/wrapper/wrapper.go:65 +0x83
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).processRequest(0xc00026b380, 0x369e500, 0xc00017c9c0, 0xc002657a00, 0xc001fdfc20, 0xc0026955e0, 0x16, 0x368d240, 0xc001d05880, 0xc000268000, ...)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:396 +0x7ee
github.com/micro/go-micro/v2/server/grpc.(*grpcServer).handler(0xc00026b380, 0x0, 0x0, 0x369e500, 0xc00017c9c0, 0x0, 0x0)
	/home/artur/go/pkg/mod/github.com/micro/go-micro/v2@v2.8.0/server/grpc/grpc.go:315 +0x77f
google.golang.org/grpc.(*Server).processStreamingRPC(0xc001f8db00, 0x36ae640, 0xc001693080, 0xc000171f00, 0x0, 0xc002662d00, 0x0, 0x0, 0x0)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:1237 +0xb44
google.golang.org/grpc.(*Server).handleStream(0xc001f8db00, 0x36ae640, 0xc001693080, 0xc000171f00, 0x0)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:1323 +0xc0c
google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0012adf30, 0xc001f8db00, 0x36ae640, 0xc001693080, 0xc000171f00)
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:722 +0xbb
created by google.golang.org/grpc.(*Server).serveStreams.func1
	/home/artur/go/pkg/mod/google.golang.org/grpc@v1.26.0/server.go:720 +0xa1

2020-07-23T14:23:59+05:45 ERR Error fetching from accounts-service error="{\"id\":\"go.micro.server\",\"code\":500,\"detail\":\"panic recovered: runtime error: invalid memory address or nil pointer dereference\",\"status\":\"Internal Server Error\"}" query="mail eq<EMAIL_ADDRESS>service=proxy

CC @butonic

We probably should execute go mod tidy at the end

2020-07-27T12:14:44Z ERR could not initialize oidc provider error="oidc: issuer did not match the issuer returned by provider, expected \"https://localhost:9200\" got \"https://ocis-server:9200\"" service=proxy

[ ] update docs about how to run tests (new settings) https://owncloud.github.io/ocis/testing/#run-ocis-with-that-ldap-server

While digging into the tests, a failing scenario has different expectations on uid_owner:

The problem is that we are provisioning test users using ldap. thas leads to a disconnect beween usernames (in ldap) and the uuid that is generated by the accounts service. As a result, the api tests (which are using basic auth) will resolve the login to the uid attribute in ldap, e.g. user0 but the acceptance tests using konnectd will resolve the oidc claims to the account id which is generated when first provisioning user0.
We have several short term options:

make the testsuite use the accounts grpc api to provision users
implement the ocs users endpoint of the provisioning API (userid = accountid, a new username property that can be set independently from the userid in ocis. for oc10 it can be the same as the userid)

Long term solution: implment an ocis-accounts-ldap service that is persists users in ldap directly.
I would vote for implementing the ocs provisioning api, as we need that anyway.

@individual-it since the most recent commit to this PR (21db7ed), we now have the important bits of the user provisioning API in ocis-ocs. Could you please check, if you can make use of this for provisioning users in tests? Afaik you already do this for oc10. Maybe it is a quick win to do the same in ocis now. Please check if the provided API is sufficient for your needs - and if not, what else you need.
ocis-proxy also routes /ocs/v[1,2].php/cloud/users to ocis-ocs by default now. That is already in this PR as well. If you have a manual proxy config, you'll need to adapt it. See https://github.com/owncloud/ocis-proxy/pull/80 for the default route.

@kulmann also needs https://github.com/owncloud/ocis-accounts/pull/70 but the web ui tests fail there

@individual-it btw the provisioning endpoint for users in ocis allows you to set the displayname, email and username in the initial POST. no need for subsequent edit calls ...

@kulmann @butonic what user should be used to drive the provisioning API? In oc10 there is an "admin" user, what is the equivalent in ocis now?
when now simply running bin/ocis server and no special settings I cannot login as einstein to phoenix. The login hangs in the Redirecting screen
I guess its because the requests to /groups returns
<?xml version="1.0" encoding="UTF-8"?>
<ocs><meta><status>error</status><statuscode>999</statuscode><message>please check the syntax. API specifications are here: http://www.freedesktop.org/wiki/Specifications/open-collaboration-services</message></meta></ocs>

current issues:

user json file gets randomly corrupted:2020-07-30T09:32:44+05:45 WRN http end="30/Jul/2020:09:32:44 +0545" host=<IP_ADDRESS> method=POST pkg=rhttp proto=HTTP/1.1 service=reva size=141 start="30/Jul/2020:09:32:44 +0545" status=404 time_ns=45967894 traceid=6dab709d9394b4be604b001582897146 uri=/ocs/v2.php/privatedata/setattribute/testing/test url=/ocs/v2.php/privatedata/setattribute/testing/test
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" account=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" account=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not index new account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin path=/var/tmp/ocis-accounts/accounts/another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not index new account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin path=/var/tmp/ocis-accounts/accounts/another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not edit user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" service=ocs userid=another-admin
2020-07-30T09:32:44+05:45 ERR could not edit user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" service=ocs userid=another-admin
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" id=another-admin service=accounts
2020-07-30T09:32:44+05:45 ERR could not get user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":500,\"detail\":\"could not unmarshal account: invalid character 'A' after top-level value\",\"status\":\"Internal Server Error\"}" service=ocs userid=another-admin

account information in phoenix

basic auth is not checked the second time, when the username is capital case:
create a user: curl -k -X POST https://localhost:9200/ocs/v1.php/cloud/users    -d userid="Artur"    -d password="Artur" -d<EMAIL_ADDRESS>-d username="Artur"
make a request with the correct password: curl -u Artur:Artur -k -X PROPFIND https://localhost:9200/remote.php/webdav
make a request with the wrong password: curl -u Artur:invalid -k -X PROPFIND https://localhost:9200/remote.php/webdav
both requests response with content if first the correct password was given AND the userid begins with a capital case :scream_cat:

@individual-it can you post instructions how to run the testsuite with the user provisioning api here so we can continue when you need to leave. We found a problem in reva: https://github.com/cs3org/reva/pull/1033 that requires some coding to properly look up the userid ...

@butonic

delete all ocis & reva files rm -r /var/tmp/ocis-*; rm -r /var/tmp/reva/
start a redis server docker run --rm -d -p 6379:6379 -e REDIS_DATABASES=1 --name redis webhippie/redis:latest
start ocis bin/ocis server
on owncloud/core checkout testFixOCISPR409 branch
from core folder run tests: make test-acceptance-api TEST_SERVER_URL=https://localhost:9200 TEST_OCIS=true OCIS_REVA_DATA_ROOT=/var/tmp/reva/ SKELETON_DIR=apps/testing/data/apiSkeleton BEHAT_FILTER_TAGS='~@skipOnOcis&&~@skipOnOcis-OC-Storage' use BEHAT_FEATURE to run a single file or scenario

The UpdateAccount implementation on the ocis-accounts service is faulty. As it is the nature of Go programs, an argument of type struct will have all its members set to their zero value, rendering impossible for an update API to know which property to update, since it is perfectly valid to set a property to its zero value...

@individual-it I got a bunch of 0x51 (Can't contact LDAP server): ldaps://localhost:636 (Laminas\Ldap\Exception\LdapException), am I missing something?

@individual-it I see a lot of  Warning: opendir(apps/testing/data/apiSkeleton): failed to open dir: No such file or directory in /home/jfd/Repositories/core/tests/TestHelpers/OcisHelper.php line 83 which are not really related to ocis. Did you check in all files?

nevermind.
cd apps
git clone git@github.com:owncloud/testing.git

fixed it

now there is
And user "Alice" has created folder "/common"                                         # FeatureContext::userHasCreatedFolder()
      Fatal error: Call to undefined method PHPUnit\Framework\Assert::assertContainsEquals() (Behat\Testwork\Call\Exception\FatalThrowableError)

@butonic make in the core repo? :thinking:
yes sorry the testing app is also needed
@refs you should not need any LDAP server. Do you have set any LDAP related env variable before running make test-acceptance-api

@butonic make in the core repo? 🤔
yes sorry the testing app is also needed
@refs you should not need any LDAP server. Do you have set any LDAP related env variable before running make test-acceptance-api

You're right, LDAP not needed, it was a residual env config. But still getting stuck on that step :(

make clean && make seems to have helped

480 scenarios (443 passed, 37 failed)
3728 steps (3676 passed, 37 failed, 15 skipped)
11m16.75s (22.28Mb)

at this point testing with two replaces which use https://github.com/cs3org/reva/pull/1033
replace github.com/cs3org/reva => ../reva

replace github.com/gomodule/redigo => github.com/gomodule/redigo v1.8.2

running with REVA_STORAGE_OWNCLOUD_LAYOUT="{{.Id.OpaqueId}}" OCIS_LOG_LEVEL=debug go run cmd/ocis/main.go server

[ ] the thumbnail service seems to directly talk to reva, which causes reva to authenticate the requests with the given oidc credentials, but revas oidc auth code does not look up the real userid. you can only configure it to use a claim that is in the oidc id token. but the uuid from the accounts service is certainly not part of it. so. dig into ocis-thumbnails and make it use the ocis-proxy instead of the direct reva connection.

Ok I at least brought back recipient search results with https://github.com/owncloud/ocis-accounts/pull/76 and https://github.com/owncloud/ocis-glauth/pull/31.
my current go.mod uses thase replacements:
// for https://github.com/cs3org/reva/pull/1033
replace github.com/cs3org/reva => ../reva

// for https://github.com/owncloud/ocis-reva/pull/420 which sets the env vars for the above owncloud storage driver changes in reva
replace github.com/owncloud/ocis-reva => ../ocis-reva

// something in reva updated and I need to downgrade redigo
replace github.com/gomodule/redigo => github.com/gomodule/redigo v1.8.2

// https://github.com/owncloud/ocis-proxy/pull/83 for the sharing fix from ilja
replace github.com/owncloud/ocis-proxy => ../ocis-proxy

// for https://github.com/owncloud/ocis-accounts/pull/76
replace github.com/owncloud/ocis-accounts => ../ocis-accounts

this brings me to
--- Failed scenarios:

    /home/jfd/Repositories/core/tests/acceptance/features/apiAuthOcs/ocsDELETEAuth.feature:54
    /home/jfd/Repositories/core/tests/acceptance/features/apiAuthOcs/ocsGETAuth.feature:226
    /home/jfd/Repositories/core/tests/acceptance/features/apiAuthOcs/ocsPOSTAuth.feature:52
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:85
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:86
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:88
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:89
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:91
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:92
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:94
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:95
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:380
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:381
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:86
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:118
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:119
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:214
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:215
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:307
    /home/jfd/Repositories/core/tests/acceptance/features/apiSharePublicLink2/updatePublicLinkShare.feature:308
    /home/jfd/Repositories/core/tests/acceptance/features/apiShareUpdate/updateShare.feature:335

484 scenarios (463 passed, 21 failed)
3755 steps (3721 passed, 21 failed, 13 skipped)
11m59.25s (22.22Mb)

Steps to reproduce the current state from CI:

Copy the go.mod from https://github.com/owncloud/ocis/pull/409#issuecomment-667397522
Make sure to have the matching repos and branches checked out
Set REVA_STORAGE_OWNCLOUD_LAYOUT="{{.Id.OpaqueId}}" env var
Compile and run ocis
Checkout owncloud/core testFixOCISPR409 for running the tests
Run TEST_SERVER_URL=https://localhost:9200 \ TEST_OCIS=true \ OCIS_REVA_DATA_ROOT=/var/tmp/reva/ \ SKELETON_DIR=$HOME/work/workspace/owncloud/apps-external/testing/data/apiSkeleton \ BEHAT_FEATURE=tests/acceptance/features/apiShareManagementBasic/createShare.feature:85

Server logs:
2020-08-03T16:40:23+02:00 DBG director found path=/ocs/v1.php/cloud/users/alice policy=reva prefix=/ocs/v[12].php/cloud/user routeType=regex service=proxy
2020-08-03T16:40:23+02:00 INF deleted account id=alice service=accounts
2020-08-03T16:40:23+02:00 DBG deleted user service=ocs userid=alice
2020-08-03T16:40:23+02:00 DBG  bytes=144 duration=1.842988 method=DELETE path=/ocs/v1.php/cloud/users/alice proto=HTTP/1.1 request=033df72c-8a2f-49d0-ae13-684eba8491ed service=ocs status=200
2020-08-03T16:40:23+02:00 DBG director found path=/ocs/v2.php/cloud/users/alice policy=reva prefix=/ocs/v[12].php/cloud/user routeType=regex service=proxy
2020-08-03T16:40:23+02:00 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":404,\"detail\":\"could not read account: open /var/tmp/ocis-accounts/accounts/alice: no such file or directory\",\"status\":\"Not Found\"}" id=alice service=accounts
2020-08-03T16:40:23+02:00 ERR could not get user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":404,\"detail\":\"could not read account: open /var/tmp/ocis-accounts/accounts/alice: no such file or directory\",\"status\":\"Not Found\"}" service=ocs userid=alice
2020-08-03T16:40:23+02:00 DBG  bytes=169 duration=1.982102 method=GET path=/ocs/v2.php/cloud/users/alice proto=HTTP/1.1 request=64a5148b-461d-45e9-a9b0-9a061543f347 service=ocs status=404
2020-08-03T16:40:23+02:00 DBG director found path=/ocs/v1.php/cloud/users/brian policy=reva prefix=/ocs/v[12].php/cloud/user routeType=regex service=proxy
2020-08-03T16:40:23+02:00 INF deleted account id=brian service=accounts
2020-08-03T16:40:23+02:00 DBG deleted user service=ocs userid=brian
2020-08-03T16:40:23+02:00 DBG  bytes=144 duration=1.274421 method=DELETE path=/ocs/v1.php/cloud/users/brian proto=HTTP/1.1 request=71e94711-1da1-4939-8beb-a19c855c491a service=ocs status=200
2020-08-03T16:40:23+02:00 DBG director found path=/ocs/v2.php/cloud/users/brian policy=reva prefix=/ocs/v[12].php/cloud/user routeType=regex service=proxy
2020-08-03T16:40:23+02:00 ERR could not load account error="{\"id\":\"com.owncloud.api.accounts\",\"code\":404,\"detail\":\"could not read account: open /var/tmp/ocis-accounts/accounts/brian: no such file or directory\",\"status\":\"Not Found\"}" id=brian service=accounts
2020-08-03T16:40:23+02:00 ERR could not get user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":404,\"detail\":\"could not read account: open /var/tmp/ocis-accounts/accounts/brian: no such file or directory\",\"status\":\"Not Found\"}" service=ocs userid=brian

[ ] get all the PRs merged

[ ] reva: https://github.com/cs3org/reva/pull/1033
[ ] ocis-reva: https://github.com/owncloud/ocis-reva/pull/420
[ ] ocis-proxy: https://github.com/owncloud/ocis-proxy/pull/83
[ ] ocis-accounts: https://github.com/owncloud/ocis-accounts/pull/76

[ ] streamline REVA_STORAGE_OWNCLOUD_LAYOUT="{{.Id.OpaqueId}}"
[ ] investigate thumbnail issues (AFAIK there are currently no enabled tests for that)
[ ] fix the share_with_displayname problem reported by the "createShare.feature" tests
[ ] optionally: fix the ocis-ocs bug: https://github.com/owncloud/ocis-ocs/issues/26 (currently disabled in

Steps to reproduce the current state from CI:
[...]
3. Set REVA_STORAGE_OWNCLOUD_LAYOUT="{{.Id.OpaqueId}}" env var
should not be necessary with https://github.com/owncloud/ocis-reva/pull/420 which sets the env vars in

https://github.com/owncloud/ocis-reva/pull/420/files#diff-6e8d2a450c60708713085d20c0ce273eR332
https://github.com/owncloud/ocis-reva/pull/420/files#diff-7c21777c79fde749384ce1d345eae186R306
https://github.com/owncloud/ocis-reva/pull/420/files#diff-5bb6120cdfcd2cac99dc1bc0ab641304R330 and
https://github.com/owncloud/ocis-reva/pull/420/files#diff-7bcead762354316d60b52604bbaec878R308
as well as for the eos storage provider

@butonic that one was necessary to be able to run the "createShare" test. Without this, the authentication would fail when uploading the skeleton files.

with https://github.com/owncloud/ocis-ocs/pull/29 I now only get these failures
--- Failed scenarios:

    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsDELETEAuth.feature:54
    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsGETAuth.feature:224
    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsPOSTAuth.feature:49
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:86
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:380
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:381

ocsDELETEAuth.feature:54 is strange, it returns OCS code 998 when run by itself, but after running ocsGETAuth.feature it returns OCS 100 :thinking:

with owncloud/ocis-ocs#29 I now only get these failures
--- Failed scenarios:

    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsDELETEAuth.feature:54
    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsGETAuth.feature:224
    /home/artur/www/owncloud-core/tests/acceptance/features/apiAuthOcs/ocsPOSTAuth.feature:49
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:86
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:380
    /home/artur/www/owncloud-core/tests/acceptance/features/apiShareManagementBasic/createShare.feature:381

That's funny, I'm guessing you were not looking at the server logs and the tests were failing due to running out of file descriptors. IDK about Jorn's system limit but mine is set to 256 per process, so after some point all my tests were failing.
Looking into the tests that keep failing now, and the issue with the displayName.

looks for me like ocsDELETEAuth.feature:54 is about user deletion
trying to delete user alice gives 2020-08-05T13:10:33+05:45 ERR could not delete user error="{\"id\":\"com.owncloud.api.accounts\",\"code\":404,\"detail\":\"could not read account: open /var/tmp/ocis-accounts/accounts/alice: no such file or directory\",\"status\":\"Not Found\"}" service=ocs userid=alice because the user was created as Alice (capital A) and saved in  /var/tmp/ocis-accounts/accounts/Alice or with REVA_STORAGE_OWNCLOUD_LAYOUT="{{.Id.OpaqueId}}" /var/tmp/ocis-accounts/accounts/<uuid>
There is somewhere an issue about the accounts being case insensitive

query of users is possible case insensitive, but not deleting https://github.com/owncloud/ocis-accounts/issues/81

For the record: on my mac running the acceptance tests I HAVE to set TESTING_REMOTE_SYSTEM or it blocks here:
# Check if we can rely on a local ./occ command or if we are testing
# a remote instance (e.g. inside docker).
# If we have a remote instance we cannot enable the testing app and
# we have to hope it is enabled already, by other ways
if [ "${TESTING_REMOTE_SYSTEM}" = false ]
then
	# Enable testing app
	PREVIOUS_TESTING_APP_STATUS=$(${OCC} --no-warnings app:list "^testing$")
	if [[ "${PREVIOUS_TESTING_APP_STATUS}" =~ ^Disabled: ]]
	then
		${OCC} app:enable testing || { echo "Unable to enable testing app" >&2; exit 1; }
		TESTING_ENABLED_BY_SCRIPT=true;
	else
		TESTING_ENABLED_BY_SCRIPT=false;
	fi
else
	TESTING_ENABLED_BY_SCRIPT=false;
fi

cc @individual-it

@refs should be set by the Makefile https://github.com/owncloud/core/blob/14f0580c0d47d6ee8265c6ecd4d674953e93f503/Makefile#L63

Update for today from @PVince81 and I:
We got around the OCS errors with some proper error handling on Reva gateway code for getting the path from a share from a reference, and now all the scenarios on features/apiShareManagementBasic/createShare.feature are passing.

However presumably, the tests need to be adjusted since the provisioning API, when it receives a userid it saves the user as the user id it gets. When there is no id provided, it assigns a new uuid to the user. To test this:
curl -X POST http://localhost:9110/ocs/v1.php/cloud/users -d userid=5b8cd8a6-51b2-429f-8c13-1938e8b1eba4 -d password="frenkpassword" -d username="frenkusername" -d displayname="frenk display name" -d<EMAIL_ADDRESS>-d enabled="true" | xmllint --format -

[ ] awaiting Reva PR for the fix on the feature.

@individual-it can you check if anything changed on the test side since Monday ? As far as I remember, the folder "/var/tmp/ocis-accounts" folder only ever contained uuids for users, never the actual user ids, but now they do. This causes collisions between users when they get recreated, and cause some failures related to stray shares in shares.json (which @refs' upcoming PR will fix as mentioned in the previous comment).
So the proper solution, as I understand, is to not specify user ids in the provisioning API so that uuids can get created for the user id instead of text. Did anything change there or maybe I remembered the old state from Monday ?

thumbnails are indeed broken, raised here: https://github.com/owncloud/ocis-thumbnails/issues/40

downloading files in the web UI (bearer token) is broken, this is likely the reason why thumbnails are not working.
Phoenix tests confirm that downloads are broken, also reproduced locally.

uuid is missing in the jwt token, we should probably add it as some services like ocis-thumbnails should be able to use it. added as checkbox for discussion...

thumbnail fix by connecting to ocis-proxy directly: https://github.com/owncloud/ocis-thumbnails/pull/41

PR for the stray shares, should fix the failing tests (it did locally): https://github.com/cs3org/reva/pull/1064

deps updated again to grab latest fixes, checkboxes updated

I've raised https://github.com/owncloud/ocis/issues/436 to investigate the download issue with pre-signed URLs

Looks like this PR breaks the eos setup as described in the documentation in https://owncloud.github.io/ocis/eos/
I think this is because of the new accounts service update, some problems I noticed are
When I start the server with all the eos containers running and I try creating a new user with the ocis api
❯ curl -X POST https://localhost:9200/ocs/v2.php/cloud/users -u admin:admin -d password=pass -d<EMAIL_ADDRESS>-d username=alice -k | xmllint --format -

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   349  100   297  100    52   9000   1575 --:--:-- --:--:-- --:--:-- 10575
<?xml version="1.0" encoding="UTF-8"?>
<ocs>
  <meta>
    <status>ok</status>
    <statuscode>200</statuscode>
    <message>OK</message>
  </meta>
  <data>
    <enabled>true</enabled>
    <id>55e8f58b-4922-43dc-85a9-4dd386bce8c0</id>
    <username>alice</username>
    <displayname/>
<EMAIL_ADDRESS>  </data>
</ocs>

This steps works as expected, but the uidNumber and gidNumber are not set for this user.
{
  "id": "55e8f58b-4922-43dc-85a9-4dd386bce8c0",
  "accountEnabled": true,
  "preferredName": "alice",
  "mail"<EMAIL_ADDRESS>  "passwordProfile": {
    "password": "$6$lgUsECpubVc97MZM$1U03/81ZgAyb332Eautsu7l87rongM58VE7enQ3cEk.09Tj8nflIr7O.HAH4RUzncwr9F0wIcOuzVZCOL6aZf."
  },
  "onPremisesSamAccountName": "alice"
}

While for preexisting demo user (eg. Einstein), it is set
{
  "id": "4c510ada-c86b-4815-8820-42cdf82c3d51",
  "accountEnabled": true,
  "displayName": "Albert Einstein",
  "preferredName": "einstein",
  "uidNumber": "20000",
  "gidNumber": "30000",
  "mail"<EMAIL_ADDRESS>  "passwordProfile": {
    "password": "$6$rounds=35210$sa1u5Pmfo4cr23Vw$RJNGElaDB1D3xorWkfTEGm2Ko.o2QL3E0cimKx23MNxVWVFSkUUeRoC7FqC4RzYDNQBD6cKzovTEaDD.8TDkD."
  },

So the home directory of the user is created with root user as owner. So the directory is not writable for the user.
If I manually add the uidNumber and gidNumber in the json file for the new user and give permission on the eos home directory accordingly, the user can finally create their files and folders.

ok, so it means this PR would block any further work on the EOS env, so we must find a solution.
I've added a checkbox on top. @micbar FYI

added checkbox for race condition fix: https://github.com/owncloud/ocis-accounts/pull/82

With EOS storage backend, the new WebDAV API doesn't work. The old API seems to work fine.
Here's an example of deleting a folder
Using the old WebDav API:
curl https://localhost:9200/remote.php/webdav/PARENT -XDELETE -u einstein:relativity -k -v
...
> DELETE /remote.php/webdav/PARENT HTTP/1.1
> Host: localhost:9200
> Authorization: Basic ZWluc3RlaW46cmVsYXRpdml0eQ==
> User-Agent: curl/7.68.0
> Accept: */*
>
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* Mark bundle as not supporting multiuse
< HTTP/1.1 204 No Content
< Access-Control-Allow-Origin: *
< Content-Security-Policy: default-src 'none';
< Date: Tue, 11 Aug 2020 07:07:30 GMT
< Vary: Origin
< X-Access-Token: eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNTk3MTMzMjUwLCJpYXQiOjE1OTcxMjk2NTAsImlzcyI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJ1c2VyIjp7ImlkIjp7ImlkcCI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJvcGFxdWVfaWQiOiI0YzUxMGFkYS1jODZiLTQ4MTUtODgyMC00MmNkZjgyYzNkNTEifSwidXNlcm5hbWUiOiJlaW5zdGVpbiIsIm1haWwiOiJlaW5zdGVpbkBleGFtcGxlLm9yZyIsImRpc3BsYXlfbmFtZSI6IkFsYmVydCBFaW5zdGVpbiJ9fQ.4WiOi_8YuFC-H7v9gpeKlVZyFV1n-vKjpMaBZuNIStM
< X-Content-Type-Options: nosniff
< X-Download-Options: noopen
< X-Frame-Options: SAMEORIGIN
< X-Permitted-Cross-Domain-Policies: none
< X-Robots-Tag: none
< X-Xss-Protection: 1; mode=block
<
* Connection #0 to host localhost left intact

And using the new API.
curl https://localhost:9200/remote.php/dav/files/einstein/PARENT -XDELETE -u einstein:relativity -k -v
*   Trying <IP_ADDRESS>:9200...
...
> DELETE /remote.php/dav/files/einstein/PARENT HTTP/1.1
> Host: localhost:9200
> Authorization: Basic ZWluc3RlaW46cmVsYXRpdml0eQ==
> User-Agent: curl/7.68.0
> Accept: */*
>
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* Mark bundle as not supporting multiuse
< HTTP/1.1 500 Internal Server Error
< Access-Control-Allow-Origin: *
< Content-Length: 0
< Content-Security-Policy: default-src 'none';
< Date: Tue, 11 Aug 2020 07:07:17 GMT
< Vary: Origin
< X-Access-Token: eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNTk3MTMzMjM3LCJpYXQiOjE1OTcxMjk2MzcsImlzcyI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJ1c2VyIjp7ImlkIjp7ImlkcCI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJvcGFxdWVfaWQiOiI0YzUxMGFkYS1jODZiLTQ4MTUtODgyMC00MmNkZjgyYzNkNTEifSwidXNlcm5hbWUiOiJlaW5zdGVpbiIsIm1haWwiOiJlaW5zdGVpbkBleGFtcGxlLm9yZyIsImRpc3BsYXlfbmFtZSI6IkFsYmVydCBFaW5zdGVpbiJ9fQ.VG49delLpRlTCbOqJHMf5MHI0xKDYztbg6g4LMohw2M
< X-Content-Type-Options: nosniff
< X-Download-Options: noopen
< X-Frame-Options: SAMEORIGIN
< X-Permitted-Cross-Domain-Policies: none
< X-Robots-Tag: none
< X-Xss-Protection: 1; mode=block
<
* Connection #0 to host localhost left intact

The Logs in the server
ocis          | 2020-08-11T07:05:00.133989185Z 2020-08-11T07:05:00Z DBG http routing: head= tail=/remote.php/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT svc=root pkg=rhttp service=reva
ocis          | 2020-08-11T07:05:00.134064185Z 2020-08-11T07:05:00Z DBG http routing head=remote.php pkg=rhttp service=reva tail=/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT traceid=722f10be696f4f479f9076262ecf07c1
ocis          | 2020-08-11T07:05:00.134320798Z 2020-08-11T07:05:00Z DBG skipping auth method=/cs3.gateway.v1beta1.GatewayAPI/Delete pkg=rgrpc service=reva traceid=722f10be696f4f479f9076262ecf07c1
ocis          | 2020-08-11T07:05:00.134593378Z 2020-08-11T07:05:00Z INF unary code=OK end="11/Aug/2020:07:05:00 +0000" from=tcp://<IP_ADDRESS>:38556 pkg=rgrpc service=reva start="11/Aug/2020:07:05:00 +0000" time_ns=76365 traceid=722f10be696f4f479f9076262ecf07c1 uri=/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProvider user-agent=grpc-go/1.26.0
ocis          | 2020-08-11T07:05:00.135039379Z 2020-08-11T07:05:00Z DBG eos: wrap external=/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT internal=/eos/dockertest/reva/users/e/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT pkg=rgrpc service=reva traceid=722f10be696f4f479f9076262ecf07c1
ocis          | 2020-08-11T07:05:00.135141721Z 2020-08-11T07:05:00Z ERR root/go/pkg/mod/github.com/cs3org/reva@v0.1.1-0.20200728071211-c948977dd3a0/internal/grpc/services/storageprovider/storageprovider.go:405 > error deleting file: path:"/eos/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT"  error="user: unknown user einstein" pkg=rgrpc service=reva traceid=722f10be696f4f479f9076262ecf07c1
ocis          | 2020-08-11T07:05:00.135184171Z 2020-08-11T07:05:00Z INF unary code=OK end="11/Aug/2020:07:05:00 +0000" from=tcp://<IP_ADDRESS>:37068 pkg=rgrpc service=reva start="11/Aug/2020:07:05:00 +0000" time_ns=310031 traceid=722f10be696f4f479f9076262ecf07c1 uri=/cs3.storage.provider.v1beta1.ProviderAPI/Delete user-agent=grpc-go/1.26.0
ocis          | 2020-08-11T07:05:00.135447357Z 2020-08-11T07:05:00Z INF unary code=OK end="11/Aug/2020:07:05:00 +0000" from=tcp://<IP_ADDRESS>:38548 pkg=rgrpc service=reva start="11/Aug/2020:07:05:00 +0000" time_ns=1111122 traceid=722f10be696f4f479f9076262ecf07c1 uri=/cs3.gateway.v1beta1.GatewayAPI/Delete user-agent=grpc-go/1.26.0
ocis          | 2020-08-11T07:05:00.135594693Z 2020-08-11T07:05:00Z WRN grpc request failed code="\x0f" pkg=rhttp service=reva traceid=722f10be696f4f479f9076262ecf07c1
ocis          | 2020-08-11T07:05:00.135664931Z 2020-08-11T07:05:00Z ERR http end="11/Aug/2020:07:05:00 +0000" host=<IP_ADDRESS> method=DELETE pkg=rhttp proto=HTTP/1.1 service=reva size=0 start="11/Aug/2020:07:05:00 +0000" status=500 time_ns=111306104 traceid=722f10be696f4f479f9076262ecf07c1 uri=/remote.php/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT url=/remote.php/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT

@dpakach can you try changing the username in the new dav URL to the UUID ? I had to do so for OC FS here: https://github.com/cs3org/reva/pull/1052/files#diff-3216dfff0ed3e301453e6799e8c367e2R302

@PVince81, doesn't work with uuid either. Still gives 500.
❯ curl https://localhost:9200/remote.php/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT -XDELETE -u einstein:relativity -k -v
*   Trying <IP_ADDRESS>:9200...
* TCP_NODELAY set
* Connected to localhost (<IP_ADDRESS>) port 9200 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/certs/ca-certificates.crt
  CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* TLSv1.3 (IN), TLS handshake, Certificate (11):
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
* TLSv1.3 (IN), TLS handshake, Finished (20):
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN, server did not agree to a protocol
* Server certificate:
*  subject: O=Acme Corp; CN=OCIS
*  start date: Aug  7 04:02:20 2020 GMT
*  expire date: Aug  7 04:02:20 2021 GMT
*  issuer: O=Acme Corp; CN=OCIS
*  SSL certificate verify result: unable to get local issuer certificate (20), continuing anyway.
* Server auth using Basic with user 'einstein'
> DELETE /remote.php/dav/files/4c510ada-c86b-4815-8820-42cdf82c3d51/PARENT HTTP/1.1
> Host: localhost:9200
> Authorization: Basic ZWluc3RlaW46cmVsYXRpdml0eQ==
> User-Agent: curl/7.68.0
> Accept: */*
>
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* Mark bundle as not supporting multiuse
< HTTP/1.1 500 Internal Server Error
< Access-Control-Allow-Origin: *
< Content-Length: 0
< Content-Security-Policy: default-src 'none';
< Date: Tue, 11 Aug 2020 08:14:43 GMT
< Vary: Origin
< X-Access-Token: eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNTk3MTM3MjgzLCJpYXQiOjE1OTcxMzM2ODMsImlzcyI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJ1c2VyIjp7ImlkIjp7ImlkcCI6Imh0dHBzOi8vbG9jYWxob3N0OjkyMDAiLCJvcGFxdWVfaWQiOiI0YzUxMGFkYS1jODZiLTQ4MTUtODgyMC00MmNkZjgyYzNkNTEifSwidXNlcm5hbWUiOiJlaW5zdGVpbiIsIm1haWwiOiJlaW5zdGVpbkBleGFtcGxlLm9yZyIsImRpc3BsYXlfbmFtZSI6IkFsYmVydCBFaW5zdGVpbiJ9fQ.DannMOiVKeSlQgYPz56FD4u2rH7Q9FUYzhoFdaVvnyU
< X-Content-Type-Options: nosniff
< X-Download-Options: noopen
< X-Frame-Options: SAMEORIGIN
< X-Permitted-Cross-Domain-Policies: none
< X-Robots-Tag: none
< X-Xss-Protection: 1; mode=block
<
* Connection #0 to host localhost left intact

[ ] merge https://github.com/owncloud/ocis-proxy/pull/85
[ ] merge https://github.com/owncloud/ocis-accounts/pull/82
[ ] update ocis-ocs, ocis-pkg/v2 and ocis-proxy on this PR

deps updated https://github.com/owncloud/ocis/pull/409/commits/99ffcc4c263fcc189e93a282303e03011f9684f4
we can tick "pre-signed URLs" as fixed and also the share_with_displayname race condition

current API failures:
apiOcisSpecific/apiAuthOcs-ocsDELETEAuth.feature:6
apiOcisSpecific/apiAuthOcs-ocsGETAuth.feature:10
apiOcisSpecific/apiAuthOcs-ocsGETAuth.feature:42
apiOcisSpecific/apiAuthOcs-ocsGETAuth.feature:90
apiOcisSpecific/apiAuthOcs-ocsPOSTAuth.feature:9
apiOcisSpecific/apiAuthOcs-ocsPUTAuth.feature:6
apiOcisSpecific/apiShareUpdate-updateShare.feature:123
apiOcisSpecific/apiShareUpdate-updateShare.feature:124
apiOcisSpecific/apiWebdavPreviews-previews.feature:15
apiOcisSpecific/apiWebdavPreviews-previews.feature:16
apiOcisSpecific/apiWebdavPreviews-previews.feature:17
apiOcisSpecific/apiWebdavPreviews-previews.feature:18
apiOcisSpecific/apiWebdavPreviews-previews.feature:19
apiOcisSpecific/apiWebdavPreviews-previews.feature:20
apiOcisSpecific/apiWebdavPreviews-previews.feature:21
apiOcisSpecific/apiWebdavPreviews-previews.feature:31
apiOcisSpecific/apiWebdavPreviews-previews.feature:32
apiOcisSpecific/apiWebdavPreviews-previews.feature:33
apiOcisSpecific/apiWebdavPreviews-previews.feature:34
apiOcisSpecific/apiWebdavPreviews-previews.feature:35
apiOcisSpecific/apiWebdavPreviews-previews.feature:36
apiOcisSpecific/apiWebdavPreviews-previews.feature:37
apiOcisSpecific/apiWebdavPreviews-previews.feature:47
apiOcisSpecific/apiWebdavPreviews-previews.feature:48
apiOcisSpecific/apiWebdavPreviews-previews.feature:49
apiOcisSpecific/apiWebdavPreviews-previews.feature:60
apiOcisSpecific/apiWebdavPreviews-previews.feature:61
apiOcisSpecific/apiWebdavPreviews-previews.feature:65
apiOcisSpecific/apiWebdavPreviews-previews.feature:74
apiOcisSpecific/apiWebdavPreviews-previews.feature:82
apiOcisSpecific/apiWebdavPreviews-previews.feature:89
apiOcisSpecific/apiWebdavPreviews-previews.feature:97
apiOcisSpecific/apiWebdavPreviews-previews.feature:106

strange that previews fail now when they weren't earlier ?
we did fix thumbnails API

I've added three checkboxes in the top post for the failures. I'll look into the thumbnails one.

@individual-it is going to look at the failures, they are likely expected failures from before, so the expected failure file will be adjusted soon

there are Phoenix failures in https://cloud.drone.io/owncloud/ocis/1118/6/7 related to downloads with a weird error notification related to settings:
 Error while running "element" command: Expected element <//*[contains(@class, "uk-notification-message")]/div/div[contains(@class, "oc-notification-message-title")]> text to equal: "Download failed" - expected "equal 'Download failed'" but got: "Failed to load settings values."

@kulmann any idea ?

CI results so far might not have been fully up to date.
I've just pushed https://github.com/owncloud/ocis/pull/409/commits/6bd3feb5f3aa057e31ca2314520f3c97e1f51d88 to bring this PR up to date with ocis-reva and reva https://github.com/owncloud/ocis-reva/pull/420
This should give us more accurate results. Let's see :crossed_fingers:

the redigo replace might be needed for a while:
➜  ocis git:(update-deps-2020-07-22) ✗ go mod graph | grep redigo
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
investigating thedeps that pull in the unreleased v2.0.0 of redigo

[x] ocis-graph: https://github.com/owncloud/ocis-graph/pull/33
[ ] what repos pull in<EMAIL_ADDRESS>[ ]<EMAIL_ADDRESS><EMAIL_ADDRESS>[ ]<EMAIL_ADDRESS><EMAIL_ADDRESS>

ocis-settings update pushed to fix the uuid issue: https://github.com/owncloud/ocis/pull/409/commits/9d40d05538b747d9e5b2bf4878896b907c45a612
when I updated ocis-settings it automatically updated ocis-pkg/v2

Phoenix tests still fail, now I see this appearing once at the beginning:
2:01:00 PM - SEVERE - https://ocis-server:9200/api/v0/settings/values-list - Failed to load resource: the server responded with a status of 404 (Not Found)

I'll see if I can reproduce these also with the same state like this PR

I cannot reproduce the Phoenix failures locally...

@PVince81 that's probably the settings endpoint missing in the proxy config... let me check

It's not a missing endpoint. And the 404 log message appears for a lot of requests. Maybe something is not starting fast enough?

also strange: the Phoenix tests used to take 25 minutes but now they stop just after 6 minutes?!

@individual-it can someone have a look at the Phoenix test runs ? They look really odd.
There are timeout messages repeated all over the place instead of appearing once.
Also, instead of success messages or fail, it seems to jump directly to the next test.
There is no occurrence of the string "✖ failed" which used to appear in previous runs.

maybe an issue with special characters? Debugging
2020-08-12T14:51:35Z ERR srv/app/pkg/mod/github.com/cs3org/reva@v1.1.0/internal/grpc/services/storageprovider/storageprovider.go:439 > error moving file error="ocfs: error moving /srv/app/tmp/reva/data/user1/files/lorem.txt to /srv/app/tmp/reva/data/user1/files/'single': rename /srv/app/tmp/reva/data/user1/files/lorem.txt /srv/app/tmp/reva/data/user1/files/'single': no such file or directory" pkg=rgrpc service=reva traceid=9df906c7c602cc2af888b7079f1fe71f

@PVince81 here is what I found: #450 #451
The renaming / deleting does not work correctly because phoenix sends two requests. I've added checkboxes in the top comment

The weird issue with Phoenix is solved, it was due to build issues with the ocis-phoenix assets.
@individual-it mind retesting https://github.com/owncloud/ocis/issues/450 and https://github.com/owncloud/ocis/issues/451 to confirm they are solved ?
we are going to look into the remaining Phoenix failures: https://cloud.drone.io/owncloud/ocis/1147/7/7

raised https://github.com/owncloud/ocis-reva/issues/439 for the stray public share issues

seems "tests/acceptance/features/webUIDeleteFilesFolders/deleteFilesFolders.feature:77" is a random failure.
when run locally I also had once a strange result: ✖ And there should be 2 files/folders listed on the webUI # tests/acceptance/stepDefinitions/filesContext.js:736        Error while running "equal" command: Failed [equal]: (3 == 2) - expected "2" but got: "3" (undefinedms)

added checkbox for https://github.com/owncloud/ocis-reva/issues/439 the sharing issues from Phoenix.
it's fixed now but waiting for ocis-reva + tests

I've merged https://github.com/owncloud/ocis-reva/pull/420 and now updated ocis-reva in this PR.

https://cloud.drone.io/owncloud/ocis/1154/2/1
"unitTests: Error response from daemon: client version 1.40 is too new. Maximum supported API version is 1.39"
There is currently some problem with cloud.drone.io
I asked in https://discourse.drone.io/t/client-version-1-40-is-too-new/7877

I've merged https://github.com/owncloud/phoenix/pull/3949 and updated the Phoenix commit to ace991976a666cd551f1006303361897089bf59c

@PVince81 this failing test is about listing the public links in the sidebar of the selected file, right:

16) Scenario: sharing details of multiple indirect public link shares (attempt 1, retried) # tests/acceptance/features/webUISharingPublic/shareByPublicLink.feature:860
--
6232 | ✔ Before # tests/acceptance/setup.js:28
6233 | ✔ Before # tests/acceptance/setup.js:32
6234 | ✔ Before # tests/acceptance/setup.js:36
6235 | ✔ Before # tests/acceptance/setup.js:46
6236 | ✔ Before # tests/acceptance/setup.js:68
6237 | ✔ Before # tests/acceptance/setup.js:75
6238 | ✔ Before # tests/acceptance/stepDefinitions/filesContext.js:18
6239 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:228
6240 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:267
6241 | ✔ Given user "user1" has been created with default attributes # tests/acceptance/stepDefinitions/provisioningContext.js:147
6242 | ✔ Given user "user1" has created folder "/simple-folder/sub-folder" # tests/acceptance/stepDefinitions/filesContext.js:841
6243 | ✔ And user "user1" has uploaded file with content "test" to "/simple-folder/sub-folder/textfile.txt" # tests/acceptance/stepDefinitions/filesContext.js:93
6244 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6245 | \| path \| /simple-folder \|
6246 | \| name \| Public Link    \|
6247 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6248 | \| path \| /simple-folder/sub-folder      \|
6249 | \| name \| strängé लिंक नाम (#2 &).नेपाली \|
6250 | ✔ And user "user1" has logged in using the webUI # tests/acceptance/stepDefinitions/loginContext.js:67
6251 | ✔ When the user opens folder "simple-folder/sub-folder" directly on the webUI # tests/acceptance/stepDefinitions/filesContext.js:87
6252 | ✖ Then a link named "Public Link" should be listed with role "Viewer" in the public link list of resource "textfile.txt" via "simple-folder" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:229
6253 | AssertionError [ERR_ASSERTION]: Link with name "Public Link" was expected to be in share list but was not present. Found links:
6254 | at _callee23$ (/srv/app/phoenix/tests/acceptance/stepDefinitions/publicLinkContext.js:210:12)
6255 | at tryCatch (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:63:40)
6256 | at Generator.invoke [as _invoke] (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:293:22)
6257 | at Generator.next (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:118:21)
6258 | at asyncGeneratorStep (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:3:24)
6259 | at _next (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:25:9)
6260 | at processTicksAndRejections (internal/process/task_queues.js:86:5)
6261 | - And a link named "strängé लिंक नाम (#2 &).नेपाली" should be listed with role "Viewer" in the public link list of resource "textfile.txt" via "sub-folder" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:229
6262 | ✔ After # tests/acceptance/stepDefinitions/provisioningContext.js:221
6263 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:272
6264 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:252
6265 | ✔ After # tests/acceptance/setup.js:110
6266 | ✔ After # tests/acceptance/setup.js:106
6267 | ✔ After # tests/acceptance/setup.js:102
6268 | ✔ After # tests/acceptance/setup.js:95
6269 | ✔ After # tests/acceptance/setup.js:86
6270 | ✔ After # tests/acceptance/setup.js:54

needs to be implemented ... should be maked as failing in the tests, right?

@LukasHirt @individual-it Are you sure the XPath in the following test is correct:

12) Scenario: user creates a multiple public link of a file and delete the third link (attempt 1, retried) # tests/acceptance/features/webUISharingPublic/shareByPublicLink.feature:636
--
6083 | ✔ Before # tests/acceptance/setup.js:28
6084 | ✔ Before # tests/acceptance/setup.js:32
6085 | ✔ Before # tests/acceptance/setup.js:36
6086 | ✔ Before # tests/acceptance/setup.js:46
6087 | ✔ Before # tests/acceptance/setup.js:68
6088 | ✔ Before # tests/acceptance/setup.js:75
6089 | ✔ Before # tests/acceptance/stepDefinitions/filesContext.js:18
6090 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:228
6091 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:267
6092 | ✔ Given user "user1" has been created with default attributes # tests/acceptance/stepDefinitions/provisioningContext.js:147
6093 | ✔ Given user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6094 | \| path \| lorem.txt  \|
6095 | \| name \| first-name \|
6096 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6097 | \| path \| lorem.txt   \|
6098 | \| name \| second-name \|
6099 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6100 | \| path \| lorem.txt  \|
6101 | \| name \| third-name \|
6102 | ✔ And user "user1" has logged in using the webUI # tests/acceptance/stepDefinitions/loginContext.js:67
6103 | ✖ When the user removes the public link named "third-name" of file "lorem.txt" using the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:177
6104 | Timed out while waiting for element <//*[@id="oc-files-file-link"]//a[.="third-name"]/../..//button[contains(@class, "oc-files-file-link-delete")]> to be present for 20000 milliseconds. - expected "visible" but got: "not found" (20017ms)
6105 | Timed out while waiting for element <//*[@id="oc-files-file-link"]//a[.="third-name"]/../..//button[contains(@class, "oc-files-file-link-delete")]> to be present for 20000 milliseconds. - expected "visible" but got: "not found" (20017ms)
6106 | at Proxy.removePublicLink (/srv/app/phoenix/tests/acceptance/pageObjects/FilesPageElement/publicLinksDialog.js:140:10)
6107 | at _callee15$ (/srv/app/phoenix/tests/acceptance/stepDefinitions/publicLinkContext.js:183:61)
6108 | at processTicksAndRejections (internal/process/task_queues.js:86:5)
6109 | - Then public link named "third-name" should not be listed on the public links list on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:187
6110 | - And a link named "first-name" should be listed with role "Viewer" in the public link list of file "lorem.txt" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:222
6111 | - And a link named "second-name" should be listed with role "Viewer" in the public link list of folder "lorem.txt" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:222
6112 | ✔ After # tests/acceptance/stepDefinitions/provisioningContext.js:221
6113 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:272
6114 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:252
6115 | ✔ After # tests/acceptance/setup.js:110
6116 | ✔ After # tests/acceptance/setup.js:106
6117 | ✔ After # tests/acceptance/setup.js:102
6118 | ✔ After # tests/acceptance/setup.js:95
6119 | ✔ After # tests/acceptance/setup.js:86
6120 | ✔ After # tests/acceptance/setup.js:54

When manually creating three links in phoenix I can use the console to get
$x('//*[@id="oc-files-file-link"]')

[div#oc-files-file-link.uk-position-relative]

But
<EMAIL_ADDRESS>
[]

and of course then
$x('//*[@id="oc-files-file-link"]//a[.="third-name"]/../..//button[contains(@class, "oc-files-file-link-delete")]')

[]

IIRC something changed in the html / div layout ...

@PVince81 this seems to be a test case documenting past behavior:

11) Scenario: user creates a multiple public link of a file and delete the second link (attempt 1, retried) # tests/acceptance/features/webUISharingPublic/shareByPublicLink.feature:620
--
6043 | ✔ Before # tests/acceptance/setup.js:28
6044 | ✔ Before # tests/acceptance/setup.js:32
6045 | ✔ Before # tests/acceptance/setup.js:36
6046 | ✔ Before # tests/acceptance/setup.js:46
6047 | ✔ Before # tests/acceptance/setup.js:68
6048 | ✔ Before # tests/acceptance/setup.js:75
6049 | ✔ Before # tests/acceptance/stepDefinitions/filesContext.js:18
6050 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:228
6051 | ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:267
6052 | ✔ Given user "user1" has been created with default attributes # tests/acceptance/stepDefinitions/provisioningContext.js:147
6053 | ✔ Given user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6054 | \| path \| lorem.txt  \|
6055 | \| name \| first-name \|
6056 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6057 | \| path \| lorem.txt   \|
6058 | \| name \| second-name \|
6059 | ✔ And user "user1" has created a public link with following settings # tests/acceptance/stepDefinitions/sharingContext.js:567
6060 | \| path \| lorem.txt  \|
6061 | \| name \| third-name \|
6062 | ✔ And user "user1" has logged in using the webUI # tests/acceptance/stepDefinitions/loginContext.js:67
6063 | ✖ When the user removes the public link named "second-name" of file "lorem.txt" using the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:177
6064 | Timed out while waiting for element <//*[@id="oc-files-file-link"]//a[.="second-name"]/../..//button[contains(@class, "oc-files-file-link-delete")]> to be present for 20000 milliseconds. - expected "visible" but got: "not found" (20002ms)
6065 | Timed out while waiting for element <//*[@id="oc-files-file-link"]//a[.="second-name"]/../..//button[contains(@class, "oc-files-file-link-delete")]> to be present for 20000 milliseconds. - expected "visible" but got: "not found" (20002ms)
6066 | at Proxy.removePublicLink (/srv/app/phoenix/tests/acceptance/pageObjects/FilesPageElement/publicLinksDialog.js:140:10)
6067 | at _callee15$ (/srv/app/phoenix/tests/acceptance/stepDefinitions/publicLinkContext.js:183:61)
6068 | at processTicksAndRejections (internal/process/task_queues.js:86:5)
6069 | - Then public link named "second-name" should not be listed on the public links list on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:187
6070 | - And a link named "first-name" should be listed with role "Viewer" in the public link list of file "lorem.txt" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:222
6071 | - And a link named "third-name" should be listed with role "Viewer" in the public link list of folder "lorem.txt" on the webUI # tests/acceptance/stepDefinitions/publicLinkContext.js:222
6072 | ✔ After # tests/acceptance/stepDefinitions/provisioningContext.js:221
6073 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:272
6074 | ✔ After # tests/acceptance/stepDefinitions/generalContext.js:252
6075 | ✔ After # tests/acceptance/setup.js:110
6076 | ✔ After # tests/acceptance/setup.js:106
6077 | ✔ After # tests/acceptance/setup.js:102
6078 | ✔ After # tests/acceptance/setup.js:95
6079 | ✔ After # tests/acceptance/setup.js:86
6080 | ✔ After # tests/acceptance/setup.js:54

why is it expecting visible if the user deleted an entry?

@butonic all those public link tests pass locally but fail in drone. There is some condition in drone that makes them fail. But @refs and me, we failed to find out what it is. I suggest to skip those tests for now, as we know that public shares generally works, then open a ticket and I can spend time this week to investigate the issue in drone

@butonic all those public link tests pass locally but fail in drone. There is some condition in drone that makes them fail. But @refs and me, we failed to find out what it is. I suggest to skip those tests for now, as we know that public shares generally works, then open a ticket and I can spend time this week to investigate the issue in drone

I can vow I went through the test manually and was not able to replicate the failure. I agree having a release is more pushing and we can deal with the test later this week / next week.

So as I understood, the tests that got disabled in https://github.com/owncloud/phoenix/pull/3954 are not reproducible manually.
Now I'll need to check regression status for the undelete issue

I've checked 1.0.0beta8 and the trashbin issue already existed back then, so it's not a regression.

Next up:
@butonic runs the EOS tests:

[ ] run the current EOS tests against this PR
[ ] run the current EOS tests against ocis-1.0.0beta8 (if possible)
[ ] cross-reference to check for regressions

@individual-it

[ ] we have that Error while running "equal" command: Failed [equal]: (3 == 2) - expected "2" but got: "3" (undefinedms) random fail again, let's disable it and make a ticket to look into it afterwadrds

PR for disabling randomly failing Phoenix test https://github.com/owncloud/phoenix/pull/3955
to be addressed later in https://github.com/owncloud/ocis-reva/issues/442

[ ] update drone phoenix commit after merging https://github.com/owncloud/phoenix/pull/3955

Updated ocis-phoenix to 0.11.0 (includes phoenix 0.14.0).

I pushed 2 commits to tidy up some doc and comments in expected-failures.txt. None of that should break anything. CI is currently running.
Are we going to squash the 84 commits before merging?

Let's not squash these, keep them as a tribute and reminder of our struggles.

Any objections to merging this PR now ?
I think we're already far enough down the road that it doesn't make sense to hold this any more.
If we find any regressions in EOS we'll fix these separately.


Problem running test cases on new XCode6 simulators

My test cases are able to be run against 4s, 5, iPad2, but hitting the new devices 5s, iPhone 6 and 6 plus throws the following error:
Failed to query the list of test cases in the test bundle: 2014-10-22 15:38:53.279 sim[66135:303] /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/usr/bin/sim: No simulator devices appear to be running.  Setting data directories to /var/empty.
2014-10-22 15:38:53.281 sim[66135:303] DYLD_INSERT_LIBRARIES contains possible bad values.  Caller beware: /Users/blahblah/Development/xctool/build/44be852/6A1052d/Products/Release/lib/otest-query-lib-ios.dylib
2014-10-22 15:38:53.281 sim[66135:303] Error spawning child process: Bad CPU type in executable
xctool.sh -workspace ./GB.xcworkspace -scheme Standalone test -resetSimulator -freshInstall -sdk iphonesimulator8.1 -destination 'platform=iOS Simulator,name=iPhone 6,OS=8.1'
I am currently using version xctool 0.2.2.  Help appreciated

I have the same issue. What @skiptomyliu says is true, I verified it with a new project. Still, running tests with xcodebuild works even if the projects architecture is armv7 only. We are currently not able to build for arm64 due to a missing 3P library.
Is there a way to get it running with xctool, too?
The error message is the same like in examples above:
Failed to query the list of test cases in the test bundle: 2015-03-18 09:01:03.775 sim[4049:614573] /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/usr/bin/sim: No simulator devices appear to be running.  Setting data directories to /var/empty.
2015-03-18 09:01:03.776 sim[4049:614573] DYLD_INSERT_LIBRARIES contains possible bad values.  Caller beware: /usr/local/Cellar/xctool/0.2.3/libexec/lib/otest-query-lib-ios.dylib
2015-03-18 09:01:03.777 sim[4049:614573] Error spawning child process: Bad CPU type in executable

I also have the same issue, with the exactly same error message.

Do you have test projects I could you to reproduce the issue?

I'm also receiving this message. The error seems to appear if the project is a Framework, but not if it is an Application. Is that of any help?

Our project is not a framework.
@ExtremeMan: No, unfortunately, I can't give a test project where you could reproduce the issue.

I'm having the same issue, can confirm that using..
Valid Architectures = armv7 armv7s arm64
Architectures = Standard architectures (armv7 arm64) - $(ARCHS_STANDARD)
Project is not a framework. @ExtremeMan sorry, really cant share the project :(. But I can confirm it was working just a few days ago. Not sure what got changed.

Confirming same issue
Failed to query the list of test cases in the test bundle: 2015-06-11 14:37:15.056 sim[57531:928604] /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/usr/bin/sim: No simulator devices appear to be running.  Setting data directories to /var/empty.
2015-06-11 14:37:15.057 sim[57531:928604] DYLD_INSERT_LIBRARIES contains possible bad values.  Caller beware: /usr/local/Cellar/xctool/0.2.3/libexec/lib/otest-query-lib-ios.dylib
dyld: problem loading iOS simulator dyld

Command that triggers it:
xctool test -reporter plain -showTasks -workspace "Proj.xcworkspace" -scheme "ProjTests" -sdk "iphonesimulator8.1" -destination "platform=iOS Simulator,OS=8.1,name=iPhone 5s" ONLY_ACTIVE_ARCH=NO CODE_SIGN_IDENTITY="" CODE_SIGNING_REQUIRED=NO

I have another project that runs nicely though. I suspect there's a difference between the two that is causing this, but haven't been able to uncover it.


Stop keeping value in state

a.k.a. replace props.initialValue with props.value. This change makes the
behaviour of Autocomplete closer to that of native input elements, i.e. you are
forced to always supply the current value which the input should display, and
the element will provide the updated value via the onChange callback (and
onSelect).
Upgrade path:
Before:
class MyWidget extends Component {
  render() {
    return (
      <Autocomplete
        initialValue="hello"
      />
    )
  }
}

After:
class MyWidget extends Component {
  constructor() {
    this.state = { value: 'hello' }
  }
  render() {
    return (
      <Autocomplete
        value={this.state.value}
        onChange={event => this.setState({ value: event.target.value })}
        onSelect={value => this.setState({ value })}
      />
    )
  }
}

This is obviously a breaking change.
Closes #49

+1

+1

+1 - any timeline on when this change might occur, realizing this would require a version bump?

Looks like @sprjr has been accepting PRs lately. Perhaps he can evaluate whether or not this change aligns with the 1.0 API.

@CMTegner sure thing - do you want to rebase this branch and we can take a look at it?

@sprjr: Rebased and ready to review/discuss :)

I like it. Since this was said I'd like to see if @ryanflorence can take a look as well. I'm otherwise ok with merging it in and releasing a breaking version soon. I'd like to get out of the 0.x pattern and just go with better semver on it, perhaps we can include some other PRs with it as well since that'd be 1.0.0.

Sounds good to me! I know @ryanflorence has some ideas regarding how the API would change before 1.0. I'd be happy to chip in if help is needed.

Can we get an update on this?

I pinged Ryan again to see if he can weigh in (since he had originally asked for things like this. That being said, I'd love to get a bit of progress on this as well - especially now that #77 has been opened. Would love it if we could review that and get it merged in soon so we can follow up on others of these too with a bit more confidence.

@CMTegner lets plan to move forward on this. We have tests merged in now. Want to rebase off master and verify they are still working (and/or update them)?

@sprjr done!

I pushed and release 1.0.0-rc1 so that this is no longer delayed. I may try to tackle a few other issues in to the final release of 1.0.0 before releasing, but this is done now - sorry for the delay.

Great! :+1:


Update README debugging (Reflect feedbacks)

Reflect feedbacks https://github.com/sony/flutter-embedded-linux/issues/14

@Mai-Matsuura Please review.

@HidenoriMatsubayashi  I've checked the changes and it looks fine.


sandia photo

It looks like you are attempting to push a change to the template repository, for help with deploying your own website please start a new thread in the discussions.


Update nscplugin, sbt-scala-native to 0.4.2

Updates

org.scala-native:nscplugin
org.scala-native:sbt-scala-native

from 0.4.0-M2 to 0.4.2.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-native" } ]

labels: library-update, early-semver-minor, semver-spec-pre-release

Superseded by #67.


Facing issue - Error: parquet unsupported page type: undefined

Hi, I'm facing an error where it mentions that there is a page that is undefined. according to the logs, it happens at readColumn. Can I check how I can bypass this error?
await hyparquet.parquetRead({                 file: response.buffer,                 rowFormat: 'object',                 onComplete: (data: any) => {                     console.log(data);                 }             });
My response is in Uint8Array.
Thank you!

I haven't seen that error before. Can you provide a parquet file that reproduces the issue? If you can't provide the specific file, it would be helpful if you could share the parquet metadata (can be retrieved using parquetMetadata function, or from the viewer dropdown Table > Metadata here.

Hi, this is the parquet metadata that I obtained with the method that you have mentioned:
{   version: 1,   schema: [     {       type: undefined,       type_length: undefined,       repetition_type: undefined,       name: 'spark_schema',       num_children: 2,       converted_type: undefined,       scale: undefined,       precision: undefined,       field_id: undefined,       logical_type: undefined     },     {       type: 'INT32',       type_length: undefined,       repetition_type: 'OPTIONAL',       name: 'B_res',       num_children: undefined,       converted_type: undefined,       scale: undefined,       precision: undefined,       field_id: undefined,       logical_type: undefined     },     {       type: 'INT32',       type_length: undefined,       repetition_type: 'OPTIONAL',       name: 'E_res',       num_children: undefined,       converted_type: undefined,       scale: undefined,       precision: undefined,       field_id: undefined,       logical_type: undefined     }   ],   num_rows: 155519n,   row_groups: [     {       columns: [Array],       total_byte_size: 335100n,       num_rows: 155519n,       sorting_columns: undefined,       file_offset: 4n,       total_compressed_size: 335100n,       ordinal: 0     }   ],   key_value_metadata: [     { key: 'org.apache.spark.version', value: '3.4.2' },     {       key: 'org.apache.spark.sql.parquet.row.metadata',       value: '{"type":"struct","fields":[{"name":"B_res","type":"integer","nullable":true,"metadata":{}},{"name":"E_res","type":"integer","nullable":true,"metadata":{}}]}'     }   ],   created_by: 'parquet-mr version 1.12.3 (build f8dced182c4c1fbdec6ccb3185537b5a01e6ed6b)',   metadata_length: 596 }

Thanks for the info, but I'm not sure I can fix the problem without an example parquet file. Is there any way you can share your parquet file? I can almost certainly fix it if you can provide an example file.
If you cannot provide the data, here's some of the things I would do:

Does the file open in other parquet readers like duckdb or pandas?
Does the error happen on one column or both? Try adding columns: ["B_res"] or columns: ["E_res"] to your parquetRead call.
Can you open other parquet files with hyparquet? There could be an issue with how you are reading the arraybuffer, and opening a different parquet file that is known to work would help debug that (any parquet file in this repo).

Hi, thanks for providing some areas which I can start on debug. Let me try to download a copy of the parquet file. Meanwhile, I have tried to extract on one column as you have suggested, but I am faced with another error:
RangeError: Invalid typed array length: 40000
at new Uint8Array ()
at readColumn (...\hyparquet\src\column.js:44:29)

results.zip
Hi, this is the extracted parquet file.
Thank you!

I am not able to open that parquet file in either duckdb nor pandas.read_parquet nor hyparquet. It appears that is a corrupted or invalid parquet file. Are you able to open it in anything else? Where is the file from?

Hi, the file is actually obtained from an API. It would seem that the issue would be resolved if I coalesce my data.
Sorry for the inconvenience and thank you for the assistance!


⚠ Bofrost.be has degraded performance

In 72a6a7e, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1501 ms

Resolved: Bofrost.be performance has improved in 8d1bbce.


Cannot login to XMPP server

Any login ends with:
{ [ValidationError: User validation failed]
  stack: 'Error\n    at MongooseError.ValidationError (/var/www/lets-chat/node_modules/mongoose/lib/error/validation.js:22:16)\n    at model.Document.invalidate (/var/www/lets-chat/node_modules/mongoose/lib/document.js:1162:32)\n    at /var/www/lets-chat/node_modules/mongoose/lib/document.js:1037:16\n    at validate (/var/www/lets-chat/node_modules/mongoose/lib/schematype.js:651:7)\n    at /var/www/lets-chat/node_modules/mongoose/lib/schematype.js:676:11\n    at /var/www/lets-chat/node_modules/mongoose-unique-validator/index.js:43:9\n    at /var/www/lets-chat/node_modules/mongoose/lib/query.js:1174:16\n    at /var/www/lets-chat/node_modules/mongoose/node_modules/kareem/index.js:109:16\n    at process._tickCallback (node.js:419:13)',
  message: 'User validation failed',
  name: 'ValidationError',
  errors:
   { username:
      { [ValidatorError: Expected username to be unique]
        properties: [Object],
        stack: 'Error\n    at MongooseError.ValidatorError (/var/www/lets-chat/node_modules/mongoose/lib/error/validator.js:25:16)\n    at validate (/var/www/lets-chat/node_modules/mongoose/lib/schematype.js:650:13)\n    at /var/www/lets-chat/node_modules/mongoose/lib/schematype.js:676:11\n    at /var/www/lets-chat/node_modules/mongoose-unique-validator/index.js:43:9\n    at /var/www/lets-chat/node_modules/mongoose/lib/query.js:1174:16\n    at /var/www/lets-chat/node_modules/mongoose/node_modules/kareem/index.js:109:16\n    at process._tickCallback (node.js:419:13)',
        message: 'Expected username to be unique',
        name: 'ValidatorError',
        kind: 'user defined',
        path: 'username',
        value: 'ondrej' },
     email:
      { [ValidatorError: Expected email to be unique]
        properties: [Object],
        stack: 'Error\n    at MongooseError.ValidatorError (/var/www/lets-chat/node_modules/mongoose/lib/error/validator.js:25:16)\n    at validate (/var/www/lets-chat/node_modules/mongoose/lib/schematype.js:650:13)\n    at /var/www/lets-chat/node_modules/mongoose/lib/schematype.js:676:11\n    at /var/www/lets-chat/node_modules/mongoose-unique-validator/index.js:43:9\n    at /var/www/lets-chat/node_modules/mongoose/lib/query.js:1174:16\n    at /var/www/lets-chat/node_modules/mongoose/node_modules/kareem/index.js:109:16\n    at process._tickCallback (node.js:419:13)',
        message: 'Expected email to be unique',
        name: 'ValidatorError',
        kind: 'user defined',
        path: 'email',
        value<EMAIL_ADDRESS>} } }

Perhaps it's related to https://github.com/sdelements/lets-chat-ldap/issues/16 ?

@oerdnj Nice to see you hear on Node ;) But do you still have that issue?
I just got the same error messages while trying to self register a colleague on the local user database. Thought it might be due to an existing account, as i think the colleague already got an account, but i couldn't find him in the Mongo DB with
 # mongo use letschat_prod db.users.find({})

@bhat3 Unfortunately I dropped playing with Let's Chat, so I have no idea.

@oerdnj A that's sad we're still sticking to it in the company, especially cause it got an suberp XMPP support that you won't find in RocketChat, Mattermost & Co. But with local user database instead of LDAP it really got some limitations.

Actually it was a fault on myside, that user was already registered, but i didn't found him in the database due to wrong use of the Mongo shell. Old SQL me didn't know you need to page in the user selection with Mongo:
# mongo
use DBNAME
db.users.find({})
it

@oerdnj Would recommend you close the ticket (i can't), as i couldn't verify it and there no other followers. See you again on PHP ;)

@hhaidar BTW Thx for all your work on Let's Chat! Happy Eastern :)


fix: Use splat syntax to avoid error during destroy with an empty state

PR o'clock
Description
Resolves https://github.com/terraform-aws-modules/terraform-aws-eks/issues/568
Supersedes:

https://github.com/terraform-aws-modules/terraform-aws-eks/pull/1040
https://github.com/terraform-aws-modules/terraform-aws-eks/pull/1020

Checklist

[ ] CI tests are passing
[ ] README.md has been updated after any changes to variables and outputs. See https://github.com/terraform-aws-modules/terraform-aws-eks/#doc-generation

@@Carles-Figuerola  @ageekymonk Can you please test this and let me know if it solves your issue.

@barryib thanks for consolidating, added a suggestion on a missed line

@barryib thanks for consolidating, added a suggestion on a missed line

Thanks.

@Carles-Figuerola thanks a lot for the merge!
Could you please create a new release?

@nick4fake, sorry, I'm not the one who merged or have write permissions, this is probably on @barryib's terrytory


Introduce Makefile for easy setup

How to test this PR (please do):
git clone --branch mix-task-setup-content https://github.com/elixirschool/school_house.git test-setup
cd test-setup
make setup

@kinson would you be interested in joining the org?

@doomspork for sure! Thanks!

Sent 🚀


Adds backward compatibility to symfony 2.X

Adds backward compatibility to symfony 2.X.
On version 3.2 of symfony DataCollector::varToString was replaced by DataCollector::cloneVar().
This commit fix it.

Don't we have a test for the collector?

Thanks a lot for finding & fixing this bug!
@theofidry I'll add a test :)


remove functional tests for context timeout

Fixes https://github.com/minio/mint/issues/241
Tests for checking context timeouts for Put|Get object are removed in this PR. This is a sdk functionality test, and hard to set meaningful timeout that works for both server running locally and across network. As request context cancellation is happening at http handler level, there seems to be no value adding these tests to Mint.

closing as this is is a duplicate of #900


Add function for retrieving a chart's data

Description
Add function chart_data() for retrieving a chart's data as a pandas DataFrame.
Type of Change

[ ] 📚 Examples / docs / tutorials / dependencies update
[ ] 🔧 Bug fix (non-breaking change which fixes an issue)
[ ] 🥂 Improvement (non-breaking change which improves an existing feature)
[x] 🚀 New feature (non-breaking change which adds functionality)
[ ] 💥 Breaking change (fix or feature that would cause existing functionality to change)
[ ] 🔐 Security fix

Checklist

[x] I've read the CODE_OF_CONDUCT.md document.
[x] I've read the CONTRIBUTING.md guide.
[ ] I've updated the code style using make codestyle.
[x] I've written tests for all new methods and classes that I created.
[x] I've written the docstring in Google format for all the methods and classes that I used.

Hi! Thanks so much for the PR!
Does this function solve your problem? https://github.com/chekos/Datawrapper/blob/f23db0ad33cdac839155883dfd10cea58980fadb/datawrapper/main.py#L340-L372
(this is already available in the package)


Support for Security Score on Explorer

At Gecko Security we have developed a static analyser for clarity smart contracts, you can find more about it here. We are currently building more detectors to identify new types of vulnerabilities, but have already managed to detect several malicious contracts deployed on chain. An example of such contracts are 'scam tokens' which are airdropped to users wallets and when the user transfers the token, vulnerable functions are called to send the users stSTX, Welsh and aBTC to the token owner, you can see details here.
I think it will be valuable for all users interacting with contracts to see a brief security score of the contract, along with a link to a detailed report of the gecko scan. A concept design can be seen here. API's are currently being built out for Gecko so the implementation is mainly frontend changes.

Thanks @jjjutla we'll look into it


Following merge(mod = 'cos') by a Dense layer

I'm trying to implement a simple QA model. After creating two LSTM layers for the questions and the answers, I want to compute the cosine of the corresponding vectors before feeding them to a Dense layer.
q_input = Input(shape=(121, ), dtype='int32', name = 'q')
q_embedding = Embedding(56066, 200, mask_zero=True)(q_input)
q_lstm = LSTM(output_dim=100)(q_embedding)

a_input = Input(shape=(200, ), dtype='int32', name = 'a')
a_embedding = Embedding(56066, 200, mask_zero=True)(a_input)
a_lstm = LSTM(output_dim=100)(a_embedding)

merged = merge([q_lstm, a_lstm], mode='cos', dot_axes = 1)

y = Dense(1, activation='sigmoid')(merged)

model = Model(input=[q_input, a_input], output=y)
model.compile('adam', 'binary_crossentropy')
model.fit(train_input, train_input["l"])

The snippet above fails at the step of creating the Dense layer, with the error below. Everything works well when the merge mode is sum.
Exception: Input 0 is incompatible with layer dense_2: expected ndim=2, found ndim=3

@mossaab0  how do you solve this question? Doesn't it work when  the mode='cos'


Implemented executable actions

Codecov Report

Merging #8 into master will increase coverage by 2.64%.
The diff coverage is 94.28%.

@@            Coverage Diff             @@
##           master       #8      +/-   ##
==========================================
+ Coverage   93.33%   95.97%   +2.64%
==========================================
  Files          10       10
  Lines         435      621     +186
  Branches       46       57      +11
==========================================
+ Hits          406      596     +190
+ Misses         10        8       -2
+ Partials       19       17       -2

Impacted Files
Coverage Δ

src/index.ts
0% <ø> (ø)
:arrow_up:

test/viessmannapiclient.spec.ts
99.4% <100%> (+0.14%)
:arrow_up:

test/parser/parser.spec.ts
100% <100%> (ø)
:arrow_up:

src/viessmann-api-client.ts
97.26% <100%> (+3.81%)
:arrow_up:

src/oauth-client.ts
96.15% <100%> (+2.91%)
:arrow_up:

src/parser/viessmann-schema.ts
87.09% <87.8%> (+6.45%)
:arrow_up:

src/parser/siren.ts
90.47% <87.87%> (+2.59%)
:arrow_up:

test/parser/viessmann-schema.spec.ts
98.8% <91.66%> (+1.3%)
:arrow_up:

src/logger.ts
100% <0%> (ø)
:arrow_up:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1f70ddc...21272c5. Read the comment docs.


Import Google Analytics data in batches

Trello: https://trello.com/c/AuddFX1d
Motivation
We are not using batches to retrieve ContentItems from the Database, so while we are able to retrieve GA data for small departments, large organisations like HMRC time out waiting for Google Analytics to respond.
Changes
Modify the import to request data from Google Analytics in batches.
A new environment variable called GA_PAGEVIEW_BATCH_SIZE needs to be created across environments that sets the default batch size.
Related puppet changes: https://github.com/alphagov/govuk-puppet/pull/5521

@leenagupte the default value does not change per environment, so I am not sure we need to store it in an environment variable. What is the benefit you see?
I would get rid of 114c487

@pmanrubia I had a similar, thought. Just updating the value of a constant works for me.
I thought we discussed (and agreed on) putting the value in an environment variable though?

Hi @leenagupte, yeah, we had a quick discussion, I thought it was a good idea, but once I saw the PR I just thought that it might not be needed as this variable does not change per environment.
Sorry if I added noise to this PR, and thank you for addressing the changes.

@pmanrubia That's cool. I'll update this one. I think using a constant will make story 142 easier, perhaps.
I'll make the changes and close the PR in puppet: https://github.com/alphagov/govuk-puppet/pull/5521.

Just looking at this in relation to https://trello.com/c/02lWowaO/157-prep-for-cpm-testing-on-1-march. The use of ONE_MONTH as the name for the batch size constant a bit confusing? As far as I can tell this constant has nothing to do with the date range we fetch, just the number of items we query for? So with this PR we would still be importing Last 7 Days but in batches of 3000? Maybe i have the wrong end of the stick.

Just had another look and i see we override the 7DaysAgo. My bad.

@theleebriggs I was thinking that later we could add another variable for TWELVE_MONTHS that gets the optimal batch size for 12 months worth of data and pass that to the find_in_batches function.

@theleebriggs I've taken the suggestion you made in meat-space and renamed the batch size constant from ONE_MONTH to BATCH_SIZE.

@theleebriggs @chao-xian feel free to merge if you are happy with it.

I've squashed commits 2, 3 and 4, because whilst they showed how my thought processes for approaching the problem, ultimately they were not part of the solution, so it seems wrong to keep them in our history.


Switch to<EMAIL_ADDRESS>

Thus upgrading to Phantom.JS 2.1.1
@nathanboktae, I saw your comment on #175, and I agree that bring-your-own-binary would be even better in the long run.

I think all the failed tests speak loud enough but

I agree that bring-your-own-binary would be even better in the long run.

I'm very sold on this. Between the drama from Medium's phantomjs to the phantomjs to now this phantomjs-prebuilt, #167 (#199),  along with code bases that aren't ready to go to phantomjs2 and I am about to support SlimerJS on mocha-phantomjs-core, I had not yet made an official announcement, but I will be deprecating this project in favor of the BYOB version - after I move the command line parsing stuff into the core. There's too much hurt in trying to force users on the same binary, and force them in a certain way to get a binary. Most Hosted CI ssytems have it pre-instanalled, if not adding a wget | tar command is really trivial.


typo in laravel config lines

On my mac I need to use
'Statsd' => 'League\StatsD\Laravel\Facade\StatsdFacade',
and
'League\StatsD\Laravel\Provider\StatsdServiceProvider',

With capital D in StatsD instead of Statsd

I have updated the README, thanks for reporting this


Upgrade wrangler to 2.20.0

This is the last version before 3.0.0, which should be fine to sit on for now.

Thanks!


Update centuryLink-cloud-feature-availability-matrix.md

Removing IPS from list as it is now available in all data centers.

thx.  can you (on another pull) update https://www.ctl.io/knowledge-base/release-notes/2015-11-03-cloud-platform-release-notes/ as it says UC1 isn't an option in the release notes still


User   management

User   management
Non-technical
Cloud   One

user-managment

Put this on hold for now. Lets focus on Nectar services


Adds SBOM creation and build for ARM

Ready to be merged , example workflow -> https://github.com/Elenpay/liquidator/actions/runs/5241928046


Cryptic error for space before colon in packages

When I added a space after pf in the second line of this snippet (from the tutorial)
    app "hello"
>>>>    packages { pf : "examples/cli/platform" }
        imports [ pf.Stdout ]
        provides [ main ] to pf

    main = Stdout.line "I'm a Roc application!"

I get this cryptic error:
thread 'main' panicked at 'not yet implemented: unhandled parse error PackageEntry(Colon(@29), @27)', reporting/src/error/parse.rs:3481:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

FYI this seems to be fixed, the following works (with space after pf as described)
app [main] { pf : platform "https://github.com/roc-lang/basic-cli/releases/download/0.15.0/SlwdbJ-3GR7uBWQo6zlmYWNYOxnvo8r6YABXD-45UOw.tar.br" }

import pf.Stdout

main = Stdout.line "I'm a Roc application!"

Confirmed, thanks @nathanKramer!


Coding style

[ ] document coding style
[ ] use jslint in package.json

the PR ( https://github.com/ethereum/remix/issues/24 ) will use the package "standard" to check all js files against the npm coding standard.
execute "npm run test"
it is also very useful to add visual studio code plugins:
https://marketplace.visualstudio.com/items?itemName=chenxsan.vscode-standardjs
-> contextual warning.
https://marketplace.visualstudio.com/items?itemName=chenxsan.vscode-standard-format
-> provides autoformatting.
still todo:

add documentation (at least a link to npm coding standard).
add Jenkins job to chek PRs.

add documentation (at least a link to npm coding standard).
https://github.com/ethereum/remix/pull/27

add Jenkins job to chek PRs.
we use Travis


Update without_docker.md

added dosfstools to the apt install command, as this lead to errors at the end of the build (in my debian 11)

ACK

A little bit fster build was also my initial intention trying this out without the need to install docker first

ACK


fix(versions): update Activiti/activiti-cloud-full-chart-security versions

UpdateBot pushed helm dependency: activiti-cloud-full-example to: 7.1.236

UpdateBot commands:
updatebot push-version --kind helm activiti-cloud-full-example 7.1.236


Add: yahoo email domain validation

@mishelashala Still need this or the Google oAuth will prevail? Or is not related with the login process?

we need to add support for both, yahoo and gmail. Not sure about the requirement, so just forget about this for a moment.