Arrow Table conversion to DataFrame throws DimensionMismatch Error

Hello!
I was analyzing all 2020 data from NYC Taxi Cab data. I've download all the 12 months CSV data of Yellow Taxi Trip Records in 2020. They are all inside the same directory. I've created an arrow file from all the 12 CSV files:
using Arrow, Tables, CSV, DataFrames, Query, Statistics

csvfiles = readdir("/Users/storopoli/Desktop/arrow_test", join=true)
csv_parts_2020 = Tables.partitioner(CSV.File, csvfiles)
Arrow.write("/Users/storopoli/Desktop/2020.arrow", csv_parts_2020)
tbl = Arrow.Table("/Users/storopoli/Desktop/2020.arrow")

Handling the data with Query.jl is fine:
julia> Tables.datavaluerows(tbl) |>
           @groupby(_.payment_type) |>
           @map({
               payment_type = key(_),
               mean_total_amount = mean(_.total_amount),
               mean_tip_amount = mean(_.tip_amount)
           }) |>
           DataFrame
6×3 DataFrame
 Row │ payment_type  mean_total_amount  mean_tip_amount
     │ Int64?        Float64            Float64
─────┼──────────────────────────────────────────────────
   1 │            1            18.8628      2.85697
   2 │            2            15.2182      0.000347375
   3 │            4             7.6071      0.00982139
   4 │            3            24.5792     -0.00299149
   5 │            5            18.068       0.0
   6 │      missing            33.2352      1.75901

But when I try to create a DataFrame I get this error:
julia> df = DataFrame(tbl)
ERROR: LoadError: DimensionMismatch("column :VendorID has length 24648499 and column :store_and_fwd_flag has length 79378972")
Stacktrace:
 [1] DataFrame(columns::Vector{AbstractVector{T} where T}, colindex::DataFrames.Index; copycols::Bool)
   @ DataFrames ~/.julia/packages/DataFrames/oQ5c7/src/dataframe/dataframe.jl:181
 [2] fromcolumns(x::Tables.CopiedColumns{Arrow.Table}, names::Vector{Symbol}; copycols::Bool)
   @ DataFrames ~/.julia/packages/DataFrames/oQ5c7/src/other/tables.jl:36
 [3] #DataFrame#648
   @ ~/.julia/packages/DataFrames/oQ5c7/src/other/tables.jl:57 [inlined]
 [4] DataFrame(x::Arrow.Table)
   @ DataFrames ~/.julia/packages/DataFrames/oQ5c7/src/other/tables.jl:46
 [5] top-level scope
   @ ~/Documents/Julia_Scripts/Arrow/nyc_taxi.jl:25
in expression starting at /Users/storopoli/Documents/Julia_Scripts/Arrow/nyc_taxi.jl:25

I can reproduce this; it seems like there's some kind of issue in serializing a DictEncoded column here where the size is getting confused. I'll dig in further.

Alright, finally tracked this one down. Bit of a doozy. I put all the details in the PR, but it comes down to the fact that dict encoded columns didnt' have the same index type when being serialized across multiple record batches. https://github.com/JuliaData/Arrow.jl/pull/148


Issue search support elasticsearch

Replace #6150
This PR introduce a new issue indexer type - elasticsearch.
It will connect to an elasticsearch server or cluster to store issue indexer and search by keyword.
This will have better performance than db or bleve on a bigger gitea instance.
Especially there are serval gitea instances to share indexer.
This PR also added a test for elastic search issue indexer.

Codecov Report

Merging #9428 into master will increase coverage by 0.05%.
The diff coverage is 67.28%.

@@            Coverage Diff             @@
##           master    #9428      +/-   ##
==========================================
+ Coverage    41.5%   41.56%   +0.05%
==========================================
  Files         569      570       +1
  Lines       74289    74442     +153
==========================================
+ Hits        30837    30945     +108
- Misses      39614    39647      +33
- Partials     3838     3850      +12

Impacted Files
Coverage Δ

modules/setting/indexer.go
91.17% <100%> (+0.26%)
:arrow_up:

modules/indexer/issues/indexer.go
63.1% <64.7%> (-0.7%)
:arrow_down:

modules/indexer/issues/elastic_search.go
66.18% <66.18%> (ø)

models/repo_list.go
73.14% <0%> (-0.93%)
:arrow_down:

models/webhook.go
70.46% <0%> (+1.06%)
:arrow_up:

services/pull/check.go
53.52% <0%> (+4.92%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4147cc9...09b7458. Read the comment docs.

Partilly fix #6648

I think your rebase broke something ...

@6543 fixed. :)

make L-G-T-M work.


Get metadata from source URL

Is your feature request related to a problem? Please describe.
When adding sources from websites, I'd like for the website to auto populate the URL and it'd be nice to some metadata showing from the website so i know what the URL is about
Describe the solution you'd like
The source URL container needs to show the metadata and a way to clear the source URL container. Potentially something like below:

Also, I'd like to also show this in the NoteCard, LargeNoteCard, and the NoteEditor
Describe alternatives you've considered
Considered current method, but sometimes you fill the URL and it is not always as intended.

related to https://github.com/fleetingnotes/fleeting-notes-obsidian/issues/63

37f47096570677ed81987e66677cb329293ddf8e


waiting for etcd and controlplane nodes to be registered

Im getting the error below when trying to create a custom cluster.
`
waiting for etcd and controlplane nodes to be registered
`
Server: ubuntu 16.04
Client: same

Useful
Info

Versions
Rancher dev UI: v2.0.26

Access
local

Route
global-admin.clusters.index

Can you share the complete logging from the rancher/server container?

hi @superseb
Here:
E0313 12:24:29.649075       1 generic_controller.go:200] ProjectController cluster-sv25x/project-mkhh7 [mgmt-project-rbac-remove] failed with : Operation cannot be fulfilled on projects.management.cattle.io "project-mkhh7": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.672010       1 generic_controller.go:200] ClusterRoleTemplateBindingController cluster-sv25x/creator [mgmt-auth-crtb-controller] failed with : couldn't create role cluster-owner: roles.rbac.authorization.k8s.io "cluster-owner" already exists E0313 12:24:29.672816       1 generic_controller.go:200] ProjectController cluster-sv25x/project-mkhh7 [mgmt-project-rbac-remove] failed with : Operation cannot be fulfilled on projects.management.cattle.io "project-mkhh7": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.674055       1 generic_controller.go:200] ClusterController cluster-sv25x [cluster-provisioner-controller] failed with : Operation cannot be fulfilled on clusters.management.cattle.io "cluster-sv25x": the object has been modified; please apply your changes to the latest version and try again, [cluster-agent-controller] failed with : Operation cannot be fulfilled on clusters.management.cattle.io "cluster-sv25x": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.699285       1 generic_controller.go:200] ClusterRoleTemplateBindingController cluster-sv25x/creator [mgmt-auth-crtb-controller] failed with : Operation cannot be fulfilled on roles.rbac.authorization.k8s.io "cluster-owner": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.702982       1 generic_controller.go:200] ProjectRoleTemplateBindingController project-mkhh7/creator [mgmt-auth-prtb-controller] failed with : Operation cannot be fulfilled on projectroletemplatebindings.management.cattle.io "creator": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.704629       1 generic_controller.go:200] ClusterController cluster-sv25x [cluster-provisioner-controller] failed with : waiting for etcd and controlplane nodes to be registered, [cluster-stats] failed with : Operation cannot be fulfilled on clusters.management.cattle.io "cluster-sv25x": the object has been modified; please apply your changes to the latest version and try again E0313 12:24:29.706718       1 generic_controller.go:200] ClusterController cluster-sv25x [cluster-provisioner-controller] failed with : waiting for etcd and controlplane nodes to be registered, [cluster-stats] failed with : Operation cannot be fulfilled on clusters.management.cattle.io "cluster-sv25x": the object has been modified; please apply your changes to the latest version and try again 2018/03/13 12:24:29 [INFO] ClusterController cluster-sv25x completed with dropped err: [cluster-provisioner-controller] failed with : waiting for etcd and controlplane nodes to be registered 2018/03/13 12:24:30 [INFO] ClusterController cluster-sv25x completed with dropped err: [cluster-provisioner-controller] failed with : waiting for etcd and controlplane nodes to be registered 2018-03-13 12:31:40.854942 I | mvcc: store.index: compact 2650 2018-03-13 12:31:40.987719 I | mvcc: finished scheduled compaction at 2650 (took 131.352975ms) 2018-03-13 12:36:40.860258 I | mvcc: store.index: compact 3101 2018-03-13 12:36:40.863109 I | mvcc: finished scheduled compaction at 3101 (took 1.501934ms) 2018-03-13 12:41:40.865636 I | mvcc: store.index: compact 3552 2018-03-13 12:41:40.868355 I | mvcc: finished scheduled compaction at 3552 (took 1.312172ms)

I need the complete logging, at least the part where the node was added to see what part of the provisioning went right and what went wrong.

Thanks, it does not seem that the node you are trying to add is able to reach the rancher/server container. What is the logging of the rancher/agent container on the host you are trying to add?

@superseb
Here from the client:
ERROR: https://<IP_ADDRESS>/v3/settings/cacerts does not match b7f8226da43af99d08a1ff068d563abd7ec56e48ee930b65613565de738c173a

Hmm, this should be good out of the box. Do you have a loadbalancer/proxy with SSL/TLS termination or are you bind mounting certs into the rancher/server container?
If not, can you check that you correctly copy-pasted the command from the UI?

I didnt do anything of sort. I used the command from rancher's quick start up for the server and for the client I used the docker run command given when creating the cluster from web ui. @superseb

Ok, can you share what command you used? It should be
sudo docker run -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/server:preview

And possibly docker pull rancher/server:preview as your reported version seems to be dev and it should say v2.0.0-alpha21.
Otherwise, use
sudo docker run -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/server:v2.0.0-alpha21

@superseb i used docker run -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/server:preview
But i also tried other tags available in the dockerhub, i tried latest, v1.6.12 etc...

same here :+1:

Running sudo docker run -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/server:preview or sudo docker run -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/server:v2.0.0-alpha21 should say v2.0.0-alpha21 in the bottom left.
Then for debugging the cert issue, you can see what is being returned when you exec into the container that is ran on the host that you want to add.
# First, to see if what gets returned here (should start with `-----BEGIN CERTIFICATE-----`):
curl --insecure -s -fL https://<IP_ADDRESS>/v3/settings/cacerts | jq -r .value

# Then the checksum
curl --insecure -s -fL https://<IP_ADDRESS>/v3/settings/cacerts | jq -r .value | sha256sum  | awk '{print $1}'

Yes I am getting :
root@worker1:/# curl --insecure -s -fL https://<IP_ADDRESS>/v3/settings/cacerts | jq -r .value
-----BEGIN CERTIFICATE-----
MIIC7jCCAdagAwIBAgIBADANBgkqhkiG9w0BAQsFADAoMRIwEAYDVQQKEwl0aGUt
cmFuY2gxEjAQBgNVBAMTCWNhdHRsZS1jYTAeFw0xODAzMTIxMzUyMTNaFw0yODAz
MDkxMzUyMTNaMCgxEjAQBgNVBAoTCXRoZS1yYW5jaDESMBAGA1UEAxMJY2F0dGxl
LWNhMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA1gVb4BRbrnJm+L1G
8BdWHSvs7bnnCAlwOl1H5iEHpZ8JZ9+4MOfycBg6RFmDOE2nFNeTtmuBSQA67tZE
RvGW5ddh1E2rXIRe7t7t3694kohxWhprVZBAbsnIoa+v1EvtYaJCGQPUwZLkI6D6
sUeknGU/kufATfd4+BiWD5l053r7eA6yTXl6llm5gMpE6RTKysYChwDafl1eUeRs
FHY78QcEbJm8PJskasZywfrhTeqmOjP2kwXrsRyxo3oiP4MScgMcFEUf01BklptT
Rjm0J9n9w00g8dySuh9bwdyOm+ucz1sqAicId810Hwi3joC+fsefkFsuoN7ICANM
32zP5QIDAQABoyMwITAOBgNVHQ8BAf8EBAMCAqQwDwYDVR0TAQH/BAUwAwEB/zAN
BgkqhkiG9w0BAQsFAAOCAQEAg7d1VzW09PODhsq2Ze+OTy6iDAgTGKI/xxUu9bck
Cf5ey5eSNuTzf5TfYJ49Zy/N36nt9qrrQxWES1E91Il0NWD4McZCynZiImdDBe3f
klIs+CPuEoMIibx84z7Z0qwPpZysUNpXVCzC0EHfb87m6PEU51MTpR+bpDa0Jsm9
0CImCDC8OrK2e6wO3moMvcED1nKLY1j8isnu7773PkxA9q2cFi/LayhiHZp68LWu
UEODG5Uf7D5c5zL9L+MoPiCvLteN99yGwgN+d4WobmX/H/cWg+X7mmThG3OX1097
EAN7AYUHLLdYBG598rPWSdY3/f9fklkJBTQUdU2FO5s2FQ==
-----END CERTIFICATE-----
root@worker1:/# curl --insecure -s -fL https://<IP_ADDRESS>/v3/settings/cacerts | jq -r .value | sha256sum  | awk '{print $1}'
43d795ff172df682b615b462cc68f75a85c390c17655946fe5f7cd9a67069e45

But it is the same
docker run -d --restart=unless-stopped -v /var/run/docker.sock:/var/run/docker.sock --net=host rancher/agent:v2.0.3 --server https://<IP_ADDRESS> --token v6bwcqslffzf6w4rjmgkx7869f5x9wxn2kbmrxnchq2s2mprjrw7qd --ca-checksum 43d795ff172df682b615b462cc68f75a85c390c17655946fe5f7cd9a67069e45 --worker```

@arthurzinck from your command you only have one node registered as worker.You might need to check etcd and control plane boxes when you copy and paste docker run command.

You need to make sure you check off for etcd and control plane when adding custom hosts if it's the first one.

this is my logs on the rancher server:
http://pasteall.org/874140/bash
this is what i executed in client:
root@ip-172-16-100-6:/home/ubuntu# docker run -d --restart=unless-stopped -v /var/run/docker.sock:/var/run/docker.sock --net=host rancher/agent:v2.0.3 --server https://<IP_ADDRESS> --token 49cc7nvlvpzzztvthrqpcxvrw24pznb4vv5f8fk7btmxrznh9gb748 --ca-checksum 6d0fced96e457fd5c64a49d0576363109bc9b4e3f5ee15e81fe1a1f3d46fa7c3 --etcd --controlplane --worker
@superseb @deniseschannon

ill close out this issue as im able to resolve the problem already, thanks!

@Justluckyg what was your resolution ?
I am getting the same error message for ec2 instances , creating a cluster from web-ui
I have 1 master node for control plane and etcd
3 worker nodes.

I am getting the same issue @Justluckyg can you please share how did you resolve the issue

In the Cluster area, you can add a new Node. If you click on Nodes you can then add a machine. Checking the boxes for etcd and control when in the Cluster > Node area resolved this issue for me.

@chauhanr @sofiane-soufi  I got this error when I attempted to add a cluster and didn't run the displayed command on my node before clicking done. You need to run the command that Rancher generates on the nodes in the cluster.

does not work for me either
docker version: 17.03.2-ce
ubuntu 16.04
rancher 2.0 (stable version)

I just get this:
docker logs 672662bd1a38
INFO: Arguments: --server https://localhost --token REDACTED --ca-checksum e0c3ef324b82a58eabb0799ab339deb85a88a4096790ae4afb86ebd0961f7397 --etcd --controlplane --worker
INFO: Environment: CATTLE_ADDRESS=<IP_ADDRESS> CATTLE_INTERNAL_ADDRESS= CATTLE_NODE_NAME=thebeast CATTLE_ROLE=,etcd,worker,controlplane CATTLE_SERVER=https://localhost CATTLE_TOKEN=REDACTED
INFO: Using resolv.conf: nameserver <IP_ADDRESS> nameserver <IP_ADDRESS>
INFO: https://localhost/ping is accessible
INFO: localhost resolves to <IP_ADDRESS>
INFO: Value from https://localhost/v3/settings/cacerts is an x509 certificate
time="2020-02-23T17:38:12Z" level=info msg="Rancher agent version v2.3.5 is starting"
time="2020-02-23T17:38:12Z" level=info msg="Option customConfig=map[address:<IP_ADDRESS> internalAddress: label:map[] roles:[etcd worker controlplane] taints:[]]"
time="2020-02-23T17:38:12Z" level=info msg="Option etcd=true"
time="2020-02-23T17:38:12Z" level=info msg="Option controlPlane=true"
time="2020-02-23T17:38:12Z" level=info msg="Option worker=true"
time="2020-02-23T17:38:12Z" level=info msg="Option requestedHostname=thebeast"
time="2020-02-23T17:38:12Z" level=info msg="Listening on /tmp/log.sock"
time="2020-02-23T17:38:12Z" level=info msg="Connecting to wss://localhost/v3/connect/register with token fn2bv47q7sstg92ts9d24rjxg47hjbjl8b9kxhjmpkw6h4w8z9s6pv"
time="2020-02-23T17:38:12Z" level=info msg="Connecting to proxy" url="wss://localhost/v3/connect/register"
time="2020-02-23T17:38:12Z" level=info msg="Waiting for node to register. Either cluster is not ready for registering or etcd and controlplane node have to be registered first"

I cherry picked the Docker Logs so it wouldnt be some massive thread:
2020/02/25 03:05:09 [ERROR] ProjectRoleTemplateBindingController p-zh248/creator-project-owner [mgmt-auth-prtb-controller] failed with : clusterroles.rbac.authorization.k8s.io "c-xbsfg-clustermember" already exists

67 resource_quota_controller.go:437] failed to sync resource monitors: [couldn't start monitor for resource "management.cattle.io/v3, Resource=projectalertgroups": unable to monitor quota for resource "management.cattle.io/v3, Resource=projectalertgroups", couldn't start monitor for resource "management.cattle.io/v3, Resource=clusterroletemplatebindings": unable to monitor quota for resource "management.cattle.io/v3, Resource=clusterroletemplatebindings", couldn't start monitor for resource "project.cattle.io/v3, Resource=apps": unable to monitor quota for resource "project.cattle.io/v3, Resource=apps", couldn't start monitor for resource "project.cattle.io/v3, Resource=apprevisions":

E0225 03:01:57.372323      67 prometheus.go:138] failed to register depth metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372356      67 prometheus.go:150] failed to register adds metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372412      67 prometheus.go:162] failed to register latency metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372461      67 prometheus.go:174] failed to register work_duration metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372497      67 prometheus.go:189] failed to register unfinished_work_seconds metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372523      67 prometheus.go:202] failed to register longest_running_processor_microseconds metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.372570      67 prometheus.go:214] failed to register retries metric certificate: duplicate metrics collector registration attempted
E0225 03:01:57.375591      67 resource_quota_controller.go:437] failed to sync resource monitors: [couldn't start monitor for resource "helm.cattle.io/v1, Resource=helmcharts": unable to monitor quota for resource "helm.cattle.io/v1, Resource=helmcharts", couldn't start monitor for resource "management.cattle.io/v3,

2020/02/25 03:01:55 [ERROR] SettingController rke-metadata-config [rke-metadata-handler] failed with : namespaces "cattle-global-data" not found

time="2020-02-25T03:01:42.679753595Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller"
2020/02/25 03:01:42 [INFO] Creating CRD sourcecodeproviderconfigs.project.cattle.io
W0225 03:01:42.923499      67 lease.go:222] Resetting endpoints for master service "kubernetes" to [<IP_ADDRESS>]
2020/02/25 03:01:42 [INFO] Creating CRD clusteralertrules.management.cattle.io
2020/02/25 03:01:43 http: TLS handshake error from <IP_ADDRESS>:43902: EOF
2020/02/25 03:01:43 http: TLS handshake error from <IP_ADDRESS>:43898: EOF
2020/02/25 03:01:43 http: TLS handshake error from <IP_ADDRESS>:43900: EOF
2020/02/25 03:01:43 http: TLS handshake error from <IP_ADDRESS>:43916: EOF

67 prometheus.go:138] failed to register depth metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: "helm.cattle.io/v1, Kind=HelmChart_depth", help: "(Deprecated) Current depth of workqueue: helm.cattle.io/v1, Kind=HelmChart", constLabels: {}, variableLabels: []} is invalid: "helm.cattle.io/v1, Kind=HelmChart_depth" is not a valid metric name

67 prometheus.go:202] failed to register longest_running_processor_microseconds metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: "k3s.cattle.io/v1, Kind=ListenerConfig_longest_running_processor_microseconds", help: "(Deprecated) How many microseconds has the longest running processor for k3s.cattle.io/v1, Kind=ListenerConfig been running.", constLabels: {}, variableLabels: []} is invalid: "k3s.cattle.io/v1, Kind=ListenerConfig_longest_running_processor_microseconds" is not a valid metric name
E0225 03:01:41.064526      67 prometheus.go:214] failed to register retries metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: "k3s.cattle.io/v1, Kind=ListenerConfig_retries", help: "(Deprecated) Total number of retries handled by workqueue: k3s.cattle.io/v1, Kind=ListenerConfig", constLabels: {}, variableLabels: []} is invalid: "k3s.cattle.io/v1, Kind=ListenerConfig_retries" is not a valid metric name
time="2020-02-25T03:01:41.565234922Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"
time="2020-02-25T03:01:41.665492553Z" level=info msg="Starting k3s.cattle.io/v1, Kind=ListenerConfig controller"
time="2020-02-25T03:01:41.665571141Z" level=error msg="Update cert unable to convert string to cert: Unable to split cert into two parts"
time="2020-02-25T03:01:41.665952376Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/node-token"
time="2020-02-25T03:01:41.665972614Z" level=info msg="To join node to cluster: k3s agent -s https://<IP_ADDRESS>:6443 -t ${NODE_TOKEN}"

2020/02/25 03:02:57 http: TLS handshake error from <IP_ADDRESS>:44706: EOF
2020/02/25 03:02:57 [INFO] Catalog-cache removed 2 entries from disk

2020/02/25 03:01:36 [INFO] Listening on /tmp/log.sock
2020/02/25 03:01:36 [INFO] Running etcd --data-dir=management-state/etcd
2020-02-25 03:01:36.722970 W | pkg/flags: unrecognized environment variable ETCD_URL_arm64=https://github.com/etcd-io/etcd/releases/download/v3.3.14/etcd-v3.3.14-linux-arm64.tar.gz
2020-02-25 03:01:36.723003 W | pkg/flags: unrecognized environment variable ETCD_URL_amd64=https://github.com/etcd-io/etcd/releases/download/v3.3.14/etcd-v3.3.14-linux-amd64.tar.gz
2020-02-25 03:01:36.723008 W | pkg/flags: unrecognized environment variable ETCD_UNSUPPORTED_ARCH=amd64
2020-02-25 03:01:36.723013 W | pkg/flags: unrecognized environment variable ETCD_URL=ETCD_URL_amd64

+1 Please open issue

Does anyone know the fix? I just get this:
Rancher UI:

Docker Logs:
docker logs 672662bd1a38
INFO: Arguments: --server https://localhost --token REDACTED --ca-checksum e0c3ef324b82a58eabb0799ab339deb85a88a4096790ae4afb86ebd0961f7397 --etcd --controlplane --worker
INFO: Environment: CATTLE_ADDRESS=<IP_ADDRESS> CATTLE_INTERNAL_ADDRESS= CATTLE_NODE_NAME=thebeast CATTLE_ROLE=,etcd,worker,controlplane CATTLE_SERVER=https://localhost CATTLE_TOKEN=REDACTED
INFO: Using resolv.conf: nameserver <IP_ADDRESS> nameserver <IP_ADDRESS>
INFO: https://localhost/ping is accessible
INFO: localhost resolves to <IP_ADDRESS>
INFO: Value from https://localhost/v3/settings/cacerts is an x509 certificate
time="2020-02-23T17:38:12Z" level=info msg="Rancher agent version v2.3.5 is starting"
time="2020-02-23T17:38:12Z" level=info msg="Option customConfig=map[address:<IP_ADDRESS> internalAddress: label:map[] roles:[etcd worker controlplane] taints:[]]"
time="2020-02-23T17:38:12Z" level=info msg="Option etcd=true"
time="2020-02-23T17:38:12Z" level=info msg="Option controlPlane=true"
time="2020-02-23T17:38:12Z" level=info msg="Option worker=true"
time="2020-02-23T17:38:12Z" level=info msg="Option requestedHostname=thebeast"
time="2020-02-23T17:38:12Z" level=info msg="Listening on /tmp/log.sock"
time="2020-02-23T17:38:12Z" level=info msg="Connecting to wss://localhost/v3/connect/register with token fn2bv47q7sstg92ts9d24rjxg47hjbjl8b9kxhjmpkw6h4w8z9s6pv"
time="2020-02-23T17:38:12Z" level=info msg="Connecting to proxy" url="wss://localhost/v3/connect/register"
time="2020-02-23T17:38:12Z" level=info msg="Waiting for node to register. Either cluster is not ready for registering or etcd and controlplane node have to be registered first"

you need to   follow below steps:
1 Edit the cluster and select the etc,controlplane and workernode
2. Copy the Command  displayed in  that page which is like " sudo docker run -d --privileged --restart=unless-stopped --net=host -v  ........ --etcd --controlplane --worker "
3.Login to your node
4. Run the above copied  command and  go  the Rancher edit cluster page  and click on "Save" button

you have to expose the host to the k8 cluster, and check etcd and control plane in gui prior to deployment.

if first create clusters,you should choose all roles: etcd  controlplane worker

generated command like:
"xxxx --etcd --controlplane --worker"
it's work for me


Display version with cop added when pending cops warning

Follow up of https://github.com/rubocop-hq/rubocop/pull/7757#issuecomment-591358283.
When warning about a pending cop, this PR displays the version with the cop added.
Before
% rubocop
The following cops were added to RuboCop, but are not configured. Please
set Enabled to either `true` or `false` in your `.rubocop.yml` file:
 - Style/HashEachMethods
 - Style/HashTransformKeys
 - Style/HashTransformValues

After
% rubocop
The following cops were added to RuboCop, but are not configured. Please
set Enabled to either `true` or `false` in your `.rubocop.yml` file:
 - Style/HashEachMethods cop added by 0.80
 - Style/HashTransformKeys cop added by 0.80
 - Style/HashTransformValues cop added by 0.80

Before submitting the PR make sure the following are checked:

[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Added an entry to the Changelog if the new code introduces user-observable changes. See changelog entry format.
[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Run bundle exec rake default. It executes all tests and RuboCop for itself, and generates the documentation.

It looks a good improvement!
By the way, recently I've got a feedback about the feature from @znz.
He said it would be better if it displays the configurations. For example:
$ rubocop
The following cops were added to RuboCop, but are not configured. Please
set Enabled to either `true` or `false` in your `.rubocop.yml` file:
Style/HashEachMethods:
 VersionAdded: 0.80
 # Enabled: true/false # Confiure it!
Style/HashTransformKeys:
 VersionAdded: 0.80
 # Enabled: true/false # Confiure it!
Style/HashTransformValues:
 VersionAdded: 0.80
 # Enabled: true/false # Confiure it!

I think it is reasonable because the users can configure the new cops easier.
But I concern that it will be too long.
What do you think?

Style/HashEachMethods cop added by 0.80

I think a better format would be "Cop (added in version)".
Might also be a good idea to add a link to the manual (https://docs.rubocop.org/en/latest/versioning/)  at the end of the message, as it seems it confused some users.
I'd add to this page an example message and probably some configuration snippet (as suggested by @pocke), so it's easier for users to figure out what how to deal with the message.

@bbatsov @pocke Thanks for the feedback.

I think a better format would be "Cop (added in version)".
Might also be a good idea to add a link to the manual (https://docs.rubocop.org/en/latest/versioning/) at the end of the message, as it seems it confused some users.

I updated the warning message and the versioning manual.

Great work! 🙇

Thanks!


-version command

There should be -version and -v command added that respond with current package version
This one should be implemented inside index.js file

Please review and merge this #8


Injected "reconcile" can not compile when no "status" in resource

Expected Behavior
Everything works
Actual Behavior
pkg/client/injection/reconciler/${resource}/v1alpha1/${resource}/reconciler.go
can not compile!
Steps to Reproduce the Problem
My resource has no sub resource status, so based on the logic no skipStatusUpdates in reconcilerImpl, see the code:
https://github.com/knative/pkg/blob/5ac4a75f34884a2adc4a77ce1a6cb05cc29d897c/codegen/cmd/injection-gen/generators/reconciler_reconciler.go#L296-L300
but there is no such guard here:
https://github.com/knative/pkg/blob/5ac4a75f34884a2adc4a77ce1a6cb05cc29d897c/codegen/cmd/injection-gen/generators/reconciler_reconciler.go#L443-L447
and here:
https://github.com/knative/pkg/blob/5ac4a75f34884a2adc4a77ce1a6cb05cc29d897c/codegen/cmd/injection-gen/generators/reconciler_reconciler.go#L453-L457
it will raise compile error.
I suffered for several hours, please take a look, thanks

@markusthoemmes
I use https://github.com/knative-sandbox/sample-controller as template,
seems the knative/pkg version is:  knative.dev/pkg v0.0.0-20210331065221-952fdd90dbb0
So, you mean the issue has gone in latest version?

Hmm, that should easily be new enough. Can you share your code by any chance?

@markusthoemmes
sure, take a look this: https://github.com/vincent-pli/cel-tekton/tree/with-issue

Oh I see! We're indeed lacking a few more checks as you've pointed out. Sorry I misread your comments above. I guess we didn't catch that because Secrets are not KRShaped. Duh.
However, one might argue that your resource isn't KRShaped anyway (because it doesn't have a status), so you should be disabling that in the generator via the respective flag anyway.
The respective diff is
diff --git a/pkg/apis/variablestores/v1alpha1/variable_store_types.go b/pkg/apis/variablestores/v1alpha1/variable_store_types.go
index 6641d61..0e32f21 100644
--- a/pkg/apis/variablestores/v1alpha1/variable_store_types.go
+++ b/pkg/apis/variablestores/v1alpha1/variable_store_types.go
@@ -27,7 +27,7 @@ import (
 // VariableStore is a context or variables storage to help caculate the CEL expression.
 //
 // +genclient
-// +genreconciler
+// +genreconciler:krshapedlogic=false
 // +k8s:deepcopy-gen:interfaces=k8s.io/apimachinery/pkg/runtime.Object
 type VariableStore struct {
 	metav1.TypeMeta `json:",inline"`
diff --git a/pkg/client/injection/reconciler/variablestores/v1alpha1/variablestore/reconciler.go b/pkg/client/injection/reconciler/variablestores/v1alpha1/variablestore/reconciler.go
index 58a78b7..59e9ecc 100644
--- a/pkg/client/injection/reconciler/variablestores/v1alpha1/variablestore/reconciler.go
+++ b/pkg/client/injection/reconciler/variablestores/v1alpha1/variablestore/reconciler.go
@@ -225,18 +225,10 @@ func (r *reconcilerImpl) Reconcile(ctx context.Context, key string) error {
 			return fmt.Errorf("failed to set finalizers: %w", err)
 		}

-		if !r.skipStatusUpdates {
-			reconciler.PreProcessReconcile(ctx, resource)
-		}
-
 		// Reconcile this copy of the resource and then write back any status
 		// updates regardless of whether the reconciliation errored out.
 		reconcileEvent = do(ctx, resource)

-		if !r.skipStatusUpdates {
-			reconciler.PostProcessReconcile(ctx, resource, original)
-		}
-
 	case reconciler.DoFinalizeKind:
 		// For finalizing reconcilers, if this resource being marked for deletion
 		// and reconciled cleanly (nil or normal event), remove the finalizer.

(the second diff is generated by update-codegen, so that should fix your issue).
I guess we might want to default isKRShaped to false, if hasStatus is false.

Thanks @markusthoemmes
Do we have some document, I mean some guide for adopting knative/pkg to avoid have to dig into code for trouble shooting?

Not sure we have that right now to be honest. Did the above fix your problem @vincent-pli ?

Yes, thanks @markusthoemmes


When you upload a video, it will be locked as a private video.

Problem
When you upload a video, it will be locked as a private video.
If you have similar symptoms, how did you solve it?

Have you set the videos option
Have you set the video options privacyStatus paramater to public?

See #30


How to prevent php timeout when sending thousands of notifications

I am using push notifications in my website and I have an option to broadcast notification to all the endpoints. If I have thousands of endpoints, then PHP timeout will occur. How to prevent this issue?

Hi @stanlyjohn2, this is not related to web-push-php... Please consider googling about the issue before. Solution: set_time_limit(0) disables timeout.

@Minishlink perhaps we can support using curl multi if available.

@marco-c It's already supported through Guzzle ;)

Awesome!

I'm also experiencing timeouts when sending 5K push notifications;
`LogicException: Cannot change a rejected promise to fulfilled in /home/myapp/vendor/guzzlehttp/promises/src/Promise.php``
Would that mean that multi curl is not supported?

I meet the error too.
when I push notifications to 1,000 users, I got a php fatal error--exceeded 300s, the max execution time.I was using php cli, so the max execution time should be unlimited.So, I want to say , was there some module set the php max execution time to 300s ?


The schedule: "*/1 * * * *" is the same as "* * * * *"

The spec.schedule field in the CronJob eexample uses */1, which is the same as *.  This PR should reduce confusion over the crontab format.

I agree there is no reason for the /1.
/lgtm

/approve

/lgtm


[terra-application-navigation] Add Ids to Navigation Items, Settings, Logout, and Help

Summary

Adds the ability to add an id to navigation items, the settings button, logout button, and help button. This will be used for pendo integrations.

Deployment Link

Testing

Tested via updated unit tests/snapshots
Additional Details

Internal Cerner Jira: https://jira2.cerner.com/browse/CONNECT-29174

Thank you for contributing to Terra.
@cerner/terra

Can you link the issue reference  requesting the changes done in this PR...??

@mjhenkes, if I'm understanding correctly you're saying something like.
The ApplicationNavigation element has an id of 'main-navigation' and then when build the individual navigation/extension items there we would get something like
'id of the navigation element' + 'they key of the navigation item'
for example
there's a navigation item with the key of 'home' the code would then generate the id for that nav item as 'main-navigation-home'.
Then for stuff like settings/help/etc we would just generate stuff like 'main-navigation-help-btn'.

Pretty close.
Given:
ApplicationNavigation element has an id of main-navigation
It has one Navigation Item with a key of item-1.
it has one utility Item with a key of item-1. (keys only need to be unique within the group)
It has one extension Item with a key of item-2.
the navigation item would have a generated id of: main-navigation-navigationItem-item-1
the utility item would have a generated id of: main-navigation-utilityItem-item-1
the extension item would have a generated id of" main-navigation-extensionItem-item-2
help would have a generated id of : main-navigation-utilityItemHelp
logout  would have a generated id of : main-navigation-utilityItemLogout
settings item would have a generated id of : main-navigation-utilityItemSettings

I have updated per the comments. I'm still working on updating tests, but wanted to get the updates out so I can see if I'm going in the right direction.

@Andrew-Shoemake You're on the right track with these changes.

@Andrew-Shoemake can you add a changelog entry for terra-tabs?

Thanks for the contribution @Andrew-Shoemake!
This will get released next Tuesday.


Update README.rst

Maybe even more important: remember to update github project description and add a [DEPRECATED] prefix to it. Next step would be to even archive the repository.

Seems that only @rpkilby can do any kind of changes here... so until he does it 🤷


Dropping "sys_ptrace" capability.

proot is a program known for its usage in creating unprivileged chroots.
This program essentially gives the user the capability create a chroot into another system without any permissions, effectively turning the container into a "server" - which is not an intended use for a container.
However, this program relies on a unprivileged system call in Linux systems known as ptrace, and by disabling it, scripts such as PteroVM or any of its derivatives will be rendered useless.
Before merging, please conduct some tests as this might cause potential break in some eggs (maybe?)

Thanks.  I think this change makes sense but will need to test it out.    I can add a config option to add the capability back if that's the case, but I'll need to do some testing.

I can't see any reason to keep it, unless some service needs it to track a process. The only thing I can think of is possibly the Don't Starve Together egg.


3.5.1

fix: getType is not a function error occurs when addItem with point;
fix: checking comboTrees avaiability;
fix: error occurs when createCombo into the graph without any combos;
fix: endPoint and startPoint are missing in modelConfig type;
fix: edge background leads to empty canvas when the autoRotate is false.

closes: #1607 , #1601 , #1603 , #1600


Godot 3.0.3 rc1 Crash

Godot version:

Godot 3.0.3 rc1 - Classic & Mono version.
OS/device including version:

Windows 10
Issue description:

I know it's a new version, but Godot closes after he imported a project and imported the assets and Godot closes.
This happens in the classic version and in the mono version.
There is also an error, when I try to do a new project you can not create the folders.
Steps to reproduce:
Minimal reproduction project:

I know it's a new version, but Godot closes after he imported a project and imported the assets and Godot closes.

It just closes, without any error? What is displayed in the terminal?

There is also an error, when I try to do a new project you can not create the folders.

What's the error?

On my windows 7 PC this error occurs only when launching Godot_v3.0.3-rc1_mono_win64.
It does not occur when launching Godot_v3.0.3-rc1_win64.

It simply closes

And this is the bug of folders

Do you still have the same issue with 3.0.3 RC3? https://download.tuxfamily.org/godotengine/3.0.3/rc3/

No, since the RC2 leaves the error after having formatted my PC.
Thanks for the support Rémi


Implement file handling for Post Agent

This directly serializes a binary file downloaded with a GET method request in base64 into the emitted event and is compatible with both read-only file-systems and current file handling agents.
It might make sense to offer such functionality directly through the FileHandling module to avoid implementing serialization separately for each agent.
In some related issues we find others that would either like to download files from arbitrary URLs or simply attach them to events (this tackles both needs):

#2246
#433
#1064

Thanks for your contribution!
I am not sure if we should store the whole response body in the database. The idea of the filter pointers was to only pass around a small "reference" to the file between Agents. Putting the file contents in the database is limited by the maximum column size on mysql (I think 16MB) and will require a lot of memory to process the Events.
For the PostAgent (or any web agent) it's not really possible to pass around references to the response body, but it might be an option to store the data on disk temporarily. To my knowledge even on Heroku the file system isn't read-only anymore. This would be a bit less reliable (restarts on Heroku and Docker would remove the tmp file), but should scale better for larger files.
@knu What do you think?

Hi @dsander,
Thanks for looking at this.
Indeed my proposal would only work well for smaller files.
As things stand it's impossible to pass binary data around with a common API between different agents.
I think that would add a lot of flexibility to Huginn

I think this is fine as long as it is an opt-in feature.  PostAgent and WebsiteAgent already deal with text responses and a text response in JSON/HTML/XML could also be huge, so a huge binary response wouldn't be a new problem.
I just think there should probably be more options than storing a binary blob inside of an event, like using the filesystem as backend, a separate database table, S3, GCS, etc.

I could add a Tempfile as an alternative to keep the data out of the database...
Something more complex would probably work better within the FileHandling framework, so all agents can easily write to a file and obtain the binary data from one.
(Also, I don't really understand the failed test. Could you give me a pointer to fix that?)


Training on GPU

I tried training the model with both CPU and GPU. It works fine on CPU but takes very long. But when I install GPU version and run it, it gets stuck in the middle. It doesn't throw any error but it just stops at a point before showing verbose. Could you help me figure out what is possibly going wrong? @priya-dwivedi

This issue was resolved when I upgraded my tensorflow version to 1.9.0.


gl-430-perf-monitor-amd, shader paths

It looks like the test gl-430-perf-monitor-amd use invalid path to shader files:
https://github.com/g-truc/ogl-samples/blob/master/tests/gl-430-perf-monitor-amd.cpp#L28

CC @scyganINTEL

This issue has been fixed.
Thanks for contributing,
Christophe


Update with latest changes from Sparkfun

Pull in the commits from Sparkfun to synchronize repositories.

Merged  pull request with latest updates from Sparkfun


Removed default App structure, added fragment with components.

I've removed the generic Vite+React parts of the App.jsx component and replaced with fragment ( <> ) which contains the following section divs:

welcome-section (This renders the Message.jsx component inside).
transactions-section (This renders the Transactions.jsx component inside).
add-transaction-section (This renders the AddTransaction.jsx component inside).

This is how the application now looks:

In new commit [7f0aaf2] - I've fixed errors which appeared in console:

classes have now been converted to classNames
selected have now been convered to defaultValues


 This release is also the first release not marked as beta and
with that black has introduced a stability policy where no formatting
changes will be introduced on a major version release (which is the
year). [1] With this new policy in place we no longer need to pin to a
single version and can instead constrain the requirement to just the
major version without worrying about a new release breaking ci or local
development. This commit does that and sets the black version
requirement to be any 22.x.y release so that we'll continue to get
bugfixes moving forward without having to manually bump a pinned version.
Details and comments
[1] https://black.readthedocs.io/en/latest/the_black_code_style/index.html#stability-policy

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

142 of 169 (84.02%)  changed or added relevant lines in 87 files are covered.
6 unchanged lines in 3 files lost coverage.
Overall coverage decreased (-0.005%) to 83.352%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

qiskit/algorithms/eigen_solvers/numpy_eigen_solver.py
3
4
75.0%

qiskit/algorithms/factorizers/shor.py
0
1
0.0%

qiskit/algorithms/optimizers/spsa.py
1
2
50.0%

qiskit/circuit/library/arithmetic/piecewise_chebyshev.py
3
4
75.0%

qiskit/circuit/library/boolean_logic/quantum_xor.py
0
1
0.0%

qiskit/circuit/library/generalized_gates/gms.py
0
1
0.0%

qiskit/opflow/state_fns/dict_state_fn.py
1
2
50.0%

qiskit/providers/basicaer/unitary_simulator.py
3
4
75.0%

qiskit/quantum_info/operators/symplectic/pauli_list.py
1
2
50.0%

qiskit/result/mitigation/correlated_readout_mitigator.py
1
2
50.0%

Files with Coverage Reduction
New Missed Lines
%

qiskit/algorithms/eigen_solvers/numpy_eigen_solver.py
1
89.13%

qiskit/extensions/quantum_initializer/uc.py
2
87.94%

qiskit/pulse/library/waveform.py
3
89.36%

Totals

Change from base Build<PHONE_NUMBER>:
-0.005%

Covered Lines:
52222

Relevant Lines:
62652

💛  - Coveralls


Implement EndpointInterface for local xml file

In order to test and experiment with data served by an endpoint, it would be practical if a file from the local filesystem could be used as if its contents were retrieved from a server.
This can come in handy, for instance, when testing how to handle CRUD operations on the source data, for unit testing, or when working on code without internet available.
Writing an additional implementation of the EndpointInterface might be a clean way to do this.

I agree. I'm going to set this as a target task for the next version, which will include decoupling some of the tightly-coupled components into single-responsibility classes.

Hi @woutgg, I know this issue has been hanging out here for a while, but I made a little bit of progress on it  with the 2.6 release.
The method signatures now use interfaces instead of concrete class instances.  So, you can implement your own EndpointInterface, ClientInterface, and RecordIteratorInterface if you wish.  You'll have to code these yourself, but they will integrate with existing classes now.
In the 3.0 release, I anticipate further decoupling to make customization like this easier.

Hi @woutgg, just FYI, since this is an edge-case, I don't think I'm going to implement explicit local file support (yet).
However, if you are using Guzzle v6, you can use the MockHandler to return local files  (there is also a way to do it in v5, but you'll have to look at the docs):
use GuzzleHttp\Client as GuzzleClient;
use GuzzleHttp\Handler\MockHandler;
use GuzzleHttp\HandlerStack;
use GuzzleHttp\Psr7\Response;
use Phpoaipmh\Endpoint;
use Phpoaipmh\Client;
use Phpoaipmh\HttpAdapter\GuzzleAdapter;

// Iterate over a bunch of files, one at a time
$mock = new MockHandler([
    new Response(200, [], fopen('/path/to/file1.xml'),
    new Response(200, [], fopen('/path/to/file2.xml'),
    new Response(200, [], fopen('/path/to/file3.xml'),
    // etc....
]);

$handler = HandlerStack::create($mock);
$endpoint = new Endpoint(new Client('/', new GuzzleAdapter(new GuzzleClient(['handler' => $handler]))));

// etc...

There are even more tricks you can do by creating your own Guzzle handler, but I'll leave those up to you.
Another option is to simply create your own instance of Phpoaipmh\HttpAdapter\HttpAdapterInterface or Phpoaimph\ClientInterface.  If you do that, and think that your code is generally useful, I encourage you to submit a PR.


CFFL

CFFL

Linter check found the following problems:
The following problems have been found:
ERROR: /tmp/abs_13y2i9bmkb/clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Packages in host must have exact version pinnings, except python build tools.
ERROR: /tmp/abs_13y2i9bmkb/clone/recipe/meta.yaml:29: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: /tmp/abs_13y2i9bmkb/clone/recipe/meta.yaml:49: missing_documentation: The recipe is missing a doc_url or doc_source_url
WARNING: /tmp/abs_13y2i9bmkb/clone/recipe/meta.yaml:49: missing_description: The recipe is missing a description
Errors were found


tcpstream can not use try_clone method

fn test_tcp() -> Result<()> {
info!("About to open a TCP connection to <IP_ADDRESS> port 80");
let mut stream = TcpStream::connect("one.one.one.one:80")?;

let err = stream.try_clone();
if let Err(err) = err {
    info!(
        "Duplication of file descriptors does not work (yet) on the ESP-IDF, as expected: {}",
        err
    );
}

stream.write_all("GET / HTTP/1.0\n\n".as_bytes())?;

let mut result = Vec::new();

stream.read_to_end(&mut result)?;

info!(
    "<IP_ADDRESS> returned:\n=================\n{}\n=================\nSince it returned something, all is OK",
    std::str::from_utf8(&result)?);

Ok(())

}
here is the log output
rust_esp32_std_demo: Duplication of file descriptors does not work (yet) on the ESP-IDF, as expected: Function not implemented (os error 88)

The error message says: "as expected".


fixes #106

Type of PR (feature, enhancement, bug fix, etc.)
Bug fix
Description
shell=True missing from check_call
Fixes # (issue)
#106

So you are running on a windows machine and that fixes it?

Yes Windows machine and all works as expected now.

Thanks!


Is it possible to start span on one server instance, and finish it on another?

Hi. I am using already Jaeger with HTTP requests, and I need to apply it with JMS MQ. For HTTP I use the approach shown in tutorial https://github.com/yurishkuro/opentracing-tutorial/tree/master/java , i.e.
try (Scope scope = Tracing.startServerSpan(tracer, httpHeaders, "format")) {
// HTTP request/response
}
where scope = tracer.buildSpan(operationName).asChildOf(parentSpanCtx).startActive(true)
Is it possible to start the span on one server instance, and finish it on another? For example, if I send Jms message asynchronously. In the above example, I have the “scope” variable, and the scope.close() method is invoked automatically on leaving the try {} block. If I have the asynchronous MQ call it looks like I should somehow obtain the io.opentracing.Scope variable on the receiving side...

Jaeger span is designed to represent an operation in a process. In the producer that operation is writing to the queue, after which the operation ends. The consumer starts a new span, usually using follows-from reference type. This mode also supports multiple consumers.
Working example with Kafka: https://github.com/PacktPublishing/Mastering-Distributed-Tracing/tree/master/Chapter05

Thank you for the example! Here consumer extracts the span context and builds the span as referenced from parent in startConsumerSpan method. But how the parent, i.e. producers context had been created? I.e. I did not see starting spans on the producer side, the message is just sent in ChatController.java

The Kafka client is instrumented/wrapped to create a span when writing.

I am closing this as this is tagged as a question and the conversation seems to be over.

@yurishkuro I am trying to figure out this exact same problem using opentracing-go package. My strategy is this 1. create a parent span when the message is first read in the chain of consumers. Finish the parent span immediately after. (not exactly what I want, but this is good enough for now) 2. pass this parent span along with the message. 3. when any consumer reads the message, if a parent span is present, use that to create a child span. I use jaeger UI to collect the result. Everything shows up good.

So far so good. The problem is when I use elastic APM to display the same relationship. Elastic APM refuses to make the connection like Jaeger UI. What am I missing?
PS: I am closing the parent span in step 1 itself because I don't know how to pass the parent span to the last consumer. I know how to pass the span context around; but don';t know how to re-create the parent span from context so that I can call span.Finish() on it. Any idea what I am missing here?

I know how to pass the span context around; but don';t know how to re-create the parent span from context

Spans are not designed to represent work across service boundaries, each span must be started and finished in the same process. What you're doing already is the recommended approach.
I don't have any insights about Elastic APM.

@yurishkuro Thank you for your quick response.  Looks like I am doing everything right; which is confirmed by Jaeger UI. Let me see if the elastic documentation has some helpful pointers.

For anyone stumbling on this issue, Elastic APM added support for Jaeger tracing from v7.6 onwards. And my setup was using v7.5; thus the issue. Using the latest version of elastic stack on my local setup (using docker), I was able to see the same relationship as shown by Jaeger stack.


[derive] Don't support IntoBytes on repr(Rust) types

Closes #1764

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 87.46%. Comparing base (51e1900) to head (1a007bc).

Additional details and impacted files
@@              Coverage Diff               @@
##           derive-packed    #1783   +/-   ##
==============================================
  Coverage          87.46%   87.46%
==============================================
  Files                 16       16
  Lines               6021     6021
==============================================
  Hits                5266     5266
  Misses               755      755

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Framework7 SvelteJS Version 3 component

It would be great If framework7 also has components for Sveltejs Version 3.

There is no crossplaftorm UI-library for Svelte for now. Framework7 can be first :)

Is there any new update on this issue?

@ansarizafar Isn't Svelte 3 already implemented? https://framework7.io/svelte/introduction.html

@ansarizafar  Please close this issue, Svelete components are available now


Integrating OpenSearch with LDAP

I've been trying to integrate OpenSearch with our LDAP-catalog, in order to not have the whole team logging in as "admin", but I can't quite make it work.
I tried changing the settings in viya4-monitoring-kubernetes/logging/opensearch/securityconfig/config.yaml based on the documentation from OpenSearch which is linked to in the security settings menu in the default SAS OpenSearch installation, i.e. this https://opensearch.org/docs/latest/security/authentication-backends/ldap/
But when I re-apply my installation after updating and adding all required values OpenSearch does not change, and if I go back and login again with my local account and go to securit> settings > the LDAP expression is still the local one
{
"enable_ssl": false,
"enable_start_tls": false,
"enable_ssl_client_auth": false,
"verify_hostnames": true,
"hosts": [
"localhost:8389"
],
"userbase": "ou=people,dc=example,dc=com",
"usersearch": "(sAMAccountName={0})"
}
Is this because I cannot modify the settings after first installation, will it help if I do a complete uninstall and then reinstall ?
Is there a way to do this with settings in the viya4-monitoring-userdir config files instead ?

@mkrnbk23 Integrating with a site's LDAP is something we have on our radar but, unfortunately, we haven't had a chance to focus on it yet.  I think you are probably correct: you will need to make your changes prior to the initial deployment.  Looking over the OpenSearch documentation, I see references to two different files: config/opensearch-security/config.yml and config.yaml.  Although those names are very similar, I believe they are in fact two different files.  And, as I recall, we have run into cases where the same changes need to be made in both files.
Rather than making changes directly to the files in your copy of our project repo, I suggest you follow our preferred customization process which makes use of a USER_DIR directory.  This is a directory located outside of the project repo with a specific set of sub-directories and files with specific names.  You point to this directory by setting the environment variable USER_DIR prior to running our scripts.  This will ensure you can update your copy of our project repo in the future without wiping out any changes you have made.  Please refer to the Customization Process section of our documentation for full details.
In this case, your USER_DIR might be structured like this:
~/myviya4monitoring
~/myviya4monitoring/logging
~/myviya4monitoring/logging/user-values-opensearch.yaml
~/myviya4monitoring/logging/securityconfig/config.yaml
Any customizations you need to make to the OpenSearch config.yaml file would go in the appropriate section within the myviya4monitoring/logging/user-values-opensearch.yaml file.  And, any customizations you need to make to the config/opensearch-security/config.yml file would go in the appropriate section of the myviya4monitoring/logging/securityconfig/config.yaml file.  Before calling the logging/bin/deploy_logging.sh script, you would set the USER_DIR environment variable to "~/myviyamonitoring".
Please let us know how it goes.  As I said, this is something we would like to document but haven't been able to look into due to other priorities.  If you are successful, your fellow users could benefit from you experience.

@mkrnbk23 We're you ever able to successfully integrate OpenSearch with LDAP?  If so, please provide details so other users can see how you did it.  As I mentioned last year, this is something we would like to document but haven't been able to look into due to other priorities.


[TYPO] - Solution file is mispelled

Describe the bug
Solution file is called "NSAR2SCT"
Uninstall script is called "UNINSTAL..."
Project inside is called "NASARData" - is this important? Kyle was unsure
Kyle told me to report these for the upcoming name change.

Fixed / Added 0.8.3


removed requirement for threading link library

At the moment MKL is not found properly.
We should in general rethink if we want to require MKL to be found and disable MKL with a cmake option instead of searching for it silently like atm, because the CI will not pick it up.

CLosed because of #369


retry on AWS rate limit or throttling

created an AwsRequestUtil, to wrap aws api interactions and handle request limit errors by retrying thr request up to 10 times with exponential backoff

fixes #443

Current coverage is 48.62% (diff: 54.54%)

Merging #472 into master will decrease coverage by 0.02%

@@             master       #472   diff @@
==========================================
  Files           135        135
  Lines          3087       3095     +8
  Methods           0          0
  Messages          0          0
  Branches        258        258
==========================================
+ Hits           1502       1505     +3
- Misses         1514       1519     +5
  Partials         71         71

Powered by Codecov. Last update bfab206...fb3f1c9

:+1:


Insiders build failures when running tests with a Unicode character in the path

Follow-up to https://github.com/microsoft/vscode-python/issues/14168, see https://github.com/microsoft/vscode-python/pull/14113#discussion_r496227744
Test workflow run: https://github.com/kimadeline/vscode-python/actions/runs/292268465
And the associated workflow yml: https://github.com/microsoft/vscode-python/pull/14291
Failing at the "Run functional tests" step:

ubuntu-latest, 2.7, functional

Failing at the "Run TypeScript unit tests" step:

ubuntu-latest, 3.8, ts-unit
windows-latest, 3.8, ts-unit

Failing at the "Run debugger tests" step:

ubuntu-latest, 2.7, debugger

Failing at the "Run single-workspace tests" step:

ubuntu-latest, 2.7, single-workspace
windows-latest, 3.8, single-workspace

Failing at the "Run multi-workspace tests" step:

ubuntu-latest, 2.7, multi-workspace
windows-latest, 3.8, multi-workspace

Failing at the "Install Python requirements step" step

windows-latest, 2.7, ts-unit
windows-latest, 2.7, python-unit
windows-latest, 2.7, venv
windows-latest, 2.7, single-workspace
windows-latest, 2.7, multi-workspace
windows-latest, 2.7, debugger
windows-latest, 2.7, functional

Failing at the "Run Python and IPython unit tests" step:

ubuntu-latest, 2.7, python-unit
windows-latest, 3.8, python-unit

Failing at the "Prepare pipenv for venv tests" step:

ubuntu-latest, 2.7, venv
windows-latest, 3.8, venv

We need to talk to VS Code about exposing their quoting code so we can standardize on that.

Upstream issue: https://github.com/microsoft/vscode/issues/108550

This should not occur in the new insiders build system


Clarify the PKCS12 docs

Issue #23151 asks a question about the meaning of the PKCS12 documentation. This PR attempts to clarify how friendlyName and localKeyID are added to the PKCS12 structure.
Fixes #23151

Pushed to master/3.2/3.1/3.0. Thanks.


Look through debug.log

There's a whole bunch of "failed library load" etc stuff in there.  Not sure what's happening but it doesn't look like a clean start.

Raised the below issue with apoc dev team...they are taking a look at it
https://trello.com/c/WowRDYkU/240-apoc-warnings-seen-on-neo4j-449-enterprise-startup-using-apoc-core-4406-jar

As per some comments from dev team , they are working on removing some of the warnings and its expected for now (aws ,s3 warnings) , for others investigation is in progress

Closing issue as trello card raised and now with correct team.


New Dynamic Model pattern to support type-checked additional properties

Why:
The SDK code generator is being updated to improve the pattern used for
dynamic models (i.e. models that support "additionalProperties").
What:
The changes in this PR can be summarized as follows:

An enhanced DynamicModel class which is now parameterized with the
additionalProperties value type and includes a map for them
A new DynamicModelTypeAdapterFactory class which is registered with Gson
to perform serialization and deserialization of ALL generated DynamicModel
subclasses.
GsonSerializationHelper is now deprecated as it's no longer needed.
Tests related to the above functional changes.

Note that this PR will need to be managed together with a corresponding PR in the openapi-sdkgen project (which will be delivered "real soon now" :) ).   The codegen PR will change the way we generate dynamic models so they look like the ModelAPXXX classes that are included in this PR.

Note: this PR will need to be approved and merged into the master branch, then a new tagged release will need to be created before the corresponding openapi-sdkgen changes can be submitted in a PR.  This is because the code generator has a build-time dependency on the java core (we have unit tests that verify that certain generated models will compile cleanly) and the codegen PR will need to include a change to its pom.xml that points to the new release of the java core package that includes these DynamicModel changes.

I pushed another commit to address the rewiew comments

cc: @germanattanasio

cc: @ricellis
Tagging Richard for awareness...


Native Notebooks - Tags not rendered in markdown cells

From Jupyter issue:
I believe that not all tags are being rendered in markdown cells. Img tags are quite useful in notebooks but they seem to be missing in the cell preview mode:

Originally posted by @roma-glushko in https://github.com/microsoft/vscode-jupyter/issues/4261#issuecomment-749735862

To test:

Set "notebook.experimental.useMarkdownRenderer": true
Reload VS Code
Create a markdown cell with some html, such a as <b>bold</b>
Confirmed that it is rendered


Finish ReadMe

Add about myself

Done

Thanks for taking the course, im closing the PR out as it's not needed for the default branch.


[ENG-15812] Close okhttpclient on shutdown

Task linked: ENG-15812 Add lakeview sync tool in lakeview repo


Add sir4ur0n to maintainers

Description of changes
Add myself as maintainer (required for a few other PRs I have opened)

/marvin opt-in
/status needs_reviewer


Added more localization

Closed as your changes are already implemented in syuilo/master.
(Thanks for your PR.)


json_format.ParseError while converting Tfjs graph model into tensorflow saved model

I run this code:
!tfjs_graph_converter /content/ /content/model.pb --output_format=tf_saved_model
and getting this error I'm getting:
TensorFlow.js Graph Model Converter
Graph model:    /content/
Output:         /content/model.pb
Target format:  tf_saved_model
Converting.... Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/google/protobuf/json_format.py", line 528, in _ConvertFieldValuePair
[f.json_name for f in message_descriptor.fields]))
google.protobuf.json_format.ParseError: Message type "tensorflow.GraphDef" has no field named "class_name".
Available Fields(except extensions): ['node', 'versions', 'version', 'library']
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/tfjs_graph_converter", line 8, in
sys.exit(pip_main())
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/converter.py", line 214, in pip_main
main([' '.join(sys.argv[1:])])
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/converter.py", line 225, in main
convert(argv[0].split(' '))
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/converter.py", line 199, in convert
compat_mode=args.compat_mode)
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/api.py", line 418, in graph_model_to_saved_model
compat_mode)
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/api.py", line 294, in load_graph_model_and_signature
return _convert_graph_model_to_graph(model_json, model_path, compat_mode)
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/api.py", line 263, in _convert_graph_model_to_graph
graph_def = _convert_graph_def(topology)
File "/usr/local/lib/python3.6/dist-packages/tfjs_graph_converter/api.py", line 130, in _convert_graph_def
return ParseDict(message_dict, tf.compat.v1.GraphDef())
File "/usr/local/lib/python3.6/dist-packages/google/protobuf/json_format.py", line 454, in ParseDict
parser.ConvertMessage(js_dict, message)
File "/usr/local/lib/python3.6/dist-packages/google/protobuf/json_format.py", line 485, in ConvertMessage
self._ConvertFieldValuePair(value, message)
File "/usr/local/lib/python3.6/dist-packages/google/protobuf/json_format.py", line 596, in _ConvertFieldValuePair
raise ParseError(str(e))
google.protobuf.json_format.ParseError: Message type "tensorflow.GraphDef" has no field named "class_name".
Available Fields(except extensions): ['node', 'versions', 'version', 'library']
[Using Google Colab][Converting Teachable machine pose model to Tensorflow Saved Model]

Make sure your model isn't a TFJS layer model.
This converter only supports TFJS graph models as input.
You can load and save TFJS layer models directly without using a converter like so:
import tensorflowjs as tfjs

model = tfjs.converters.load_keras_model('./content/')
model.save('./content/saved_model')

Did this solve the issue?

Yeah, this magically solved my problem, I wasn't aware that it was a layer model. Thank you very much for your help and this awesome tool.


Broken AWS CLI installation

Refer to https://github.com/aws/aws-cli/issues/8036

Fixed with commit


How to set the decorator position?

How to set the decorator position around the number of day?

It's using span, not view.


Stack arrays along new axis

Example
Create slices
>>> import dask.array as da
>>> import numpy as np

>>> data = [da.into(da.Array, np.ones((4, 4)), blockshape=(2, 2))
...          for i in range(3)]

>>> x = stack(data, axis=0)
>>> x.shape
(3, 4, 4)

>>> stack(data, axis=1).shape
(4, 3, 4)

>>> stack(data, axis=2).shape
(4, 4, 3)

cc @shoyer
Fixes #28

I believe that this can be used repeatedly with nested lists with no loss of performance.

Also added concatenate

Is there some sort of a utility for aligning blockshapes?

We could do this.  Perhaps shape is to reshape as blockshape is to reblock?  I'll probably punt on this until it's clear people are using dask.array though.  I want to make sure I'm not prematurely developing this.
Until then we'll need to be consistent at creation time.


Sorry

sorry that i rage bro im just a little kid that has no knowledge
but how do I update the dll then I don't understand
and where is the character-> fields._data
sorry and what is misc in the mod menu

can you answer me please?

If you have no knowledge or you can’t compile it and run I think you shouldn’t cheat at all. I released it for people who has some knowledge about game hacking

Bro realy i compile it easy and i want a answer for my Update qeustion please

You have #Updates, only what you have to do is use Il2CppDumper and get offsets from script.json


Choice card creation, editing, and management

I created the subject "Atomic Nucleus". I tried to create a single choice card. While editing and refining it, I unwittingly created many subtly different variations of the same basic card. Getting to the screen that showed the whole list of cards I'd created was not intuitive. I see no option to delete cards.
Also, I see no reason to require that all choice cards have 4 options. Three choices is optimal for a variety of reasons.

Hi Bill, thanks so much for creating a new subject and creating new cards. That's so awesome of you!
I'm assuming this is the subject: https://sagefy.org/subjects/4cg965EL4S2N7cSfXydJTm
I went ahead and hid the all but latest updated choice card in the database directly.
It sounds like there's a few things to tackle here:

[ ] Add ability in the interface to hide cards / remove from learning experience
[ ] After creating a card, re-evaluate where to redirect
[ ] Update the interface to allow varying number of options for choice cards

I'm not sure how the number of options would impact the BKT (Bayesian Knowledge Tracing) model, especially the "guess" parameter. Currently those parameters are statically set, however; so its more of a something to think about in the future.

Hi Kevin, thanks for the update. I'd agree that varying the option count for choice cards is less urgent to address than the other items... but I can see this becoming an issue in the future. In the meantime, you may wish to add a statement that 4 options are required. For instance, here's card I noticed that tries to use just 2 options. https://sagefy.org/choice-cards/GSRwk5qXTeh9H5brL6LmAp


[DBG] Returning info from 'ietf-netconf-notifications' persist file: module disabled, 0 subtrees enabled in running, 0 features enabled.
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/ietf-netconf.persist'.
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf.persist (fd = 26) has been unlocked
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf-acm.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/ietf-netconf-acm.persist'.
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf-acm.persist (fd = 26) has been unlocked
[DBG] Circular buffer enqueue to position=8, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=9, count=0.
[DBG] Sending 12154 bytes of data.
[DBG] 12154 bytes of data sent.
[DBG] fd 10 readable
[DBG] 43 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 39 bytes received.
[DBG] Circular buffer enqueue to position=7, current count=1.
[DBG] Threads: active=1/4, 1 requests in queue
[DBG] Circular buffer dequeue, new buffer head=8, count=0.
[DBG] Processing get_schema request.
[INF] Get schema 'ietf-netconf', revision: '(null)', submodule: '(null)', submodule revision: '(null)'
[DBG] Circular buffer enqueue to position=9, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=0, count=0.
[DBG] Sending 33722 bytes of data.
[DBG] 33722 bytes of data sent.
[DBG] Thread id=1026 will wait.
[DBG] fd 10 readable
[DBG] 175 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 171 bytes received.
[DBG] Circular buffer enqueue to position=8, current count=1.
[DBG] Threads: active=0/4, 1 requests in queue
[DBG] Thread id=2051 signaled.
[DBG] Circular buffer dequeue, new buffer head=9, count=0.
[DBG] Processing subscribe request.
[DBG] Notification subscribe: event=40, dst_address='/tmp/sysrepo-subscriptions/ietf-netconf-notifications/16542.XXXXXX.sock', dst_id=383981305.
[DBG] Switching identity to UID='0' and GID='0' (username: root).
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf-notifications.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/ietf-netconf-notifications.persist'.
[DBG] Persist data tree successfully saved.
[DBG] Subscription entry successfully added into 'ietf-netconf-notifications' persist data tree.
[DBG] File /etc/configs/sysrepo/current/data/ietf-netconf-notifications.persist (fd = 26) has been unlocked
[DBG] Circular buffer enqueue to position=0, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=1, count=0.
[DBG] Sending 27 bytes of data.
[DBG] 27 bytes of data sent.
[DBG] Sending HELLO notification to '/tmp/sysrepo-subscriptions/ietf-netconf-notifications/16542.XXXXXX.sock' @ 383981305.
[DBG] Circular buffer enqueue to position=1, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=2, count=0.
[DBG] Sending a notification to '/tmp/sysrepo-subscriptions/ietf-netconf-notifications/16542.XXXXXX.sock'.
[DBG] Cannot find the connection with dst_address address='/tmp/sysrepo-subscriptions/ietf-netconf-notifications/16542.XXXXXX.sock'.
[DBG] Creating a new connection for the notification destination '/tmp/sysrepo-subscriptions/ietf-netconf-notifications/16542.XXXXXX.sock'
[DBG] New connection started successfully, fd=26, conn ctx=0x68dfe0.
[DBG] Output buffer for fd=26 expanded to 1024 bytes.
[DBG] Sending 118 bytes of data.
[DBG] 118 bytes of data sent.
[DBG] Thread id=2051 will wait.
[DBG] fd 10 readable
[DBG] 59 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 55 bytes received.
[DBG] Circular buffer enqueue to position=9, current count=1.
[DBG] Threads: active=0/4, 1 requests in queue
[DBG] Thread id=3076 signaled.
[DBG] Circular buffer dequeue, new buffer head=0, count=0.
[DBG] Processing get_schema request.
[INF] Get schema 'nc-notifications', revision: '2008-07-14', submodule: '(null)', submodule revision: '(null)'
[DBG] File /etc/configs/sysrepo/current/data/nc-notifications.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/nc-notifications.persist'.
[DBG] File /etc/configs/sysrepo/current/data/nc-notifications.persist (fd = 27) has been unlocked
[DBG] Returning info from 'nc-notifications' persist file: module disabled, 0 subtrees enabled in running, 0 features enabled.
[DBG] File /etc/configs/sysrepo/current/data/notifications.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/notifications.persist'.
[DBG] File /etc/configs/sysrepo/current/data/notifications.persist (fd = 27) has been unlocked
[DBG] Circular buffer enqueue to position=2, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=3, count=0.
[DBG] Sending 3525 bytes of data.
[DBG] 3525 bytes of data sent.
[DBG] fd 10 readable
[DBG] 44 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 40 bytes received.
[DBG] Circular buffer enqueue to position=0, current count=1.
[DBG] Threads: active=1/4, 1 requests in queue
[DBG] Circular buffer dequeue, new buffer head=1, count=0.
[DBG] Processing get_schema request.
[INF] Get schema 'notifications', revision: '(null)', submodule: '(null)', submodule revision: '(null)'
[DBG] File /etc/configs/sysrepo/current/data/notifications.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/notifications.persist'.
[DBG] File /etc/configs/sysrepo/current/data/notifications.persist (fd = 27) has been unlocked
[DBG] Circular buffer enqueue to position=3, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=4, count=0.
[DBG] Sending 3247 bytes of data.
[DBG] 3247 bytes of data sent.
[DBG] fd 10 readable
[DBG] 142 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 138 bytes received.
[DBG] Circular buffer enqueue to position=1, current count=1.
[DBG] Threads: active=1/4, 1 requests in queue
[DBG] Circular buffer dequeue, new buffer head=2, count=0.
[DBG] Processing subscribe request.
[DBG] Notification subscribe: event=40, dst_address='/tmp/sysrepo-subscriptions/nc-notifications/16542.XXXXXX.sock', dst_id=98874527.
[DBG] Switching identity to UID='0' and GID='0' (username: root).
[DBG] File /etc/configs/sysrepo/current/data/nc-notifications.persist has been locked
[DBG] Persist data successfully loaded from file '/etc/configs/sysrepo/current/data/nc-notifications.persist'.
[DBG] Persist data tree successfully saved.
[DBG] Subscription entry successfully added into 'nc-notifications' persist data tree.
[DBG] File /etc/configs/sysrepo/current/data/nc-notifications.persist (fd = 27) has been unlocked
[DBG] Circular buffer enqueue to position=4, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=5, count=0.
[DBG] Sending 27 bytes of data.
[DBG] 27 bytes of data sent.
[DBG] Sending HELLO notification to '/tmp/sysrepo-subscriptions/nc-notifications/16542.XXXXXX.sock' @ 98874527.
[DBG] Circular buffer enqueue to position=5, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=6, count=0.
[DBG] Sending a notification to '/tmp/sysrepo-subscriptions/nc-notifications/16542.XXXXXX.sock'.
[DBG] Cannot find the connection with dst_address address='/tmp/sysrepo-subscriptions/nc-notifications/16542.XXXXXX.sock'.
[DBG] Creating a new connection for the notification destination '/tmp/sysrepo-subscriptions/nc-notifications/16542.XXXXXX.sock'
[DBG] New connection started successfully, fd=27, conn ctx=0x6b9350.
[DBG] Output buffer for fd=27 expanded to 1024 bytes.
[DBG] Sending 107 bytes of data.
[DBG] 107 bytes of data sent.
[DBG] Thread id=3076 will wait.
[DBG] fd 10 readable
[DBG] 43 bytes of data received on fd 10
[DBG] fd 10 would block
[DBG] New message of size 39 bytes received.
[DBG] Circular buffer enqueue to position=2, current count=1.
[DBG] Threads: active=0/4, 1 requests in queue
[DBG] Thread id=4101 signaled.
[DBG] Circular buffer dequeue, new buffer head=3, count=0.
[DBG] Processing get_schema request.
[INF] Get schema 'ietf-netconf', revision: '(null)', submodule: '(null)', submodule revision: '(null)'
[DBG] Circular buffer enqueue to position=6, current count=1.
[DBG] New message enqueued into CM message queue.
[DBG] Circular buffer dequeue, new buffer head=7, count=0.
[DBG] Sending 33722 bytes of data.
[DBG] 33722 bytes of data sent.
[DBG] Thread id=4101 will wait.

netopeer2-server startup messages
~ # netopeer2-server -d -v2
netopeer2-server[16542]: Connected to daemon Sysrepo Engine at socket=/tmp/sysrepod.sock
netopeer2-server[16542]: Netopeer2 connected to sysrepod.
netopeer2-server[16542]: Extension plugin "/usr/lib/libyang/metadata.so" successfully loaded.
netopeer2-server[16542]: Extension plugin "/usr/lib/libyang/nacm.so" successfully loaded.
netopeer2-server[16542]: Reading module "ietf-yang-metadata".
netopeer2-server[16542]: Module "ietf-yang-metadata" successfully parsed.
netopeer2-server[16542]: Reading module "yang".
netopeer2-server[16542]: Resolving "yang" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "yang" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "yang" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-inet-types".
netopeer2-server[16542]: Resolving derived type "union" failed, it will be attempted later.
netopeer2-server[16542]: Resolving type default "" failed, it will be attempted later.
netopeer2-server[16542]: Resolving derived type "union" failed, it will be attempted later.
netopeer2-server[16542]: Resolving type default "" failed, it will be attempted later.
netopeer2-server[16542]: Resolving derived type "union" failed, it will be attempted later.
netopeer2-server[16542]: Resolving type default "" failed, it will be attempted later.
netopeer2-server[16542]: Resolving derived type "union" failed, it will be attempted later.
netopeer2-server[16542]: Resolving type default "" failed, it will be attempted later.
netopeer2-server[16542]: Resolving "ietf-inet-types" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-inet-types" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-inet-types" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-yang-types".
netopeer2-server[16542]: Module "ietf-yang-types" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-yang-library".
netopeer2-server[16542]: Module "ietf-yang-library" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-netconf-acm@2012-02-22" from sysrepo.
netopeer2-server[16542]: Reading module "ietf-netconf-acm".
netopeer2-server[16542]: Resolving "ietf-netconf-acm" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-netconf-acm" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-netconf-acm" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-netconf-server@2016-11-02" from sysrepo.
netopeer2-server[16542]: Reading module "ietf-netconf-server".
netopeer2-server[16542]: Reading module "ietf-x509-cert-to-name".
netopeer2-server[16542]: Module "ietf-x509-cert-to-name" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-ssh-server".
netopeer2-server[16542]: Reading module "ietf-keystore".
netopeer2-server[16542]: Module "ietf-keystore" successfully parsed.
netopeer2-server[16542]: Module "ietf-ssh-server" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-tls-server".
netopeer2-server[16542]: Reading module "ietf-keystore".
netopeer2-server[16542]: Module "ietf-keystore" already in context.
netopeer2-server[16542]: Module "ietf-keystore" successfully parsed.
netopeer2-server[16542]: Module "ietf-tls-server" successfully parsed.
netopeer2-server[16542]: Resolving "ietf-netconf-server" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-netconf-server" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-netconf-server" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-x509-cert-to-name@2014-12-10" from sysrepo.
netopeer2-server[16542]: Module ietf-x509-cert-to-name@2014-12-10 already present in context.
netopeer2-server[16542]: Loading schema "ietf-ssh-server@2016-11-02" from sysrepo.
netopeer2-server[16542]: Module ietf-ssh-server@2016-11-02 already present in context.
netopeer2-server[16542]: Loading schema "ietf-keystore@2016-10-31" from sysrepo.
netopeer2-server[16542]: Module ietf-keystore@2016-10-31 already present in context.
netopeer2-server[16542]: Loading schema "ietf-tls-server@2016-11-02" from sysrepo.
netopeer2-server[16542]: Module ietf-tls-server@2016-11-02 already present in context.
netopeer2-server[16542]: Loading schema "ietf-system@2014-08-06" from sysrepo.
netopeer2-server[16542]: Reading module "ietf-system".
netopeer2-server[16542]: Reading module "ietf-netconf-acm".
netopeer2-server[16542]: Module "ietf-netconf-acm" already in context.
netopeer2-server[16542]: Module "ietf-netconf-acm" successfully parsed.
netopeer2-server[16542]: Reading module "iana-crypt-hash".
netopeer2-server[16542]: Module "iana-crypt-hash" successfully parsed.
netopeer2-server[16542]: Resolving "ietf-system" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-system" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-system" successfully parsed.
netopeer2-server[16542]: Loading schema "iana-crypt-hash@2014-08-06" from sysrepo.
netopeer2-server[16542]: Module iana-crypt-hash@2014-08-06 already present in context.
netopeer2-server[16542]: Loading schema "tiesse-voip@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-voip".
netopeer2-server[16542]: Module "tiesse-voip" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-vlan@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-vlan".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-vlan" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-cli-types@2016-09-09" from sysrepo.
netopeer2-server[16542]: Module tiesse-cli-types@2016-09-09 already present in context.
netopeer2-server[16542]: Loading schema "tiesse-trigger@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-trigger".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-trigger" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-system@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-system".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-system" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-sysrepo-config@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-sysrepo-config".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-sysrepo-config" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-route@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-route".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-route" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-qos-ext@2016-10-03" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-qos-ext".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-qos-ext" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-ntp@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-ntp".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-ntp" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-notifications@2016-10-26" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-notifications".
netopeer2-server[16542]: Module "tiesse-notifications" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-l7@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-l7".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-l7" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-gre@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-gre".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-gre" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-features@2017-03-06" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-features".
netopeer2-server[16542]: Module "tiesse-features" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-ethernet@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-ethernet".
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Reading module "tiesse-features".
netopeer2-server[16542]: Module "tiesse-features" already in context.
netopeer2-server[16542]: Module "tiesse-features" successfully parsed.
netopeer2-server[16542]: Module "tiesse-ethernet" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-dhcp-server@2017-02-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-dhcp-server".
netopeer2-server[16542]: Reading module "tiesse-ethernet".
netopeer2-server[16542]: Module "tiesse-ethernet" already in context.
netopeer2-server[16542]: Module "tiesse-ethernet" successfully parsed.
netopeer2-server[16542]: Reading module "tiesse-cli-types".
netopeer2-server[16542]: Module "tiesse-cli-types" already in context.
netopeer2-server[16542]: Module "tiesse-cli-types" successfully parsed.
netopeer2-server[16542]: Module "tiesse-dhcp-server" successfully parsed.
netopeer2-server[16542]: Loading schema "tiesse-debug@2017-01-25" from sysrepo.
netopeer2-server[16542]: Reading module "tiesse-debug".
netopeer2-server[16542]: Module "tiesse-debug" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-netconf@2011-06-01" from sysrepo.
netopeer2-server[16542]: Reading module "ietf-netconf".
netopeer2-server[16542]: Reading module "ietf-netconf-acm".
netopeer2-server[16542]: Module "ietf-netconf-acm" already in context.
netopeer2-server[16542]: Module "ietf-netconf-acm" successfully parsed.
netopeer2-server[16542]: Resolving "ietf-netconf" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-netconf" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-netconf" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-netconf-notifications@2012-02-06" from sysrepo.
netopeer2-server[16542]: Reading module "ietf-netconf-notifications".
netopeer2-server[16542]: Reading module "ietf-netconf".
netopeer2-server[16542]: Module "ietf-netconf" already in context.
netopeer2-server[16542]: Module "ietf-netconf" successfully parsed.
netopeer2-server[16542]: Resolving XPath expressions of "killed-by" failed, it will be attempted later.
netopeer2-server[16542]: Resolving XPath expressions of "common-session-parms" failed, it will be attempted later.
netopeer2-server[16542]: Resolving "ietf-netconf-notifications" unresolved schema nodes and their constraints...
netopeer2-server[16542]: All "ietf-netconf-notifications" schema nodes and constraints resolved.
netopeer2-server[16542]: Module "ietf-netconf-notifications" successfully parsed.
netopeer2-server[16542]: Loading schema "ietf-yang-types@2013-07-15" from sysrepo.
netopeer2-server[16542]: Module ietf-yang-types@2013-07-15 already present in context.
netopeer2-server[16542]: Loading schema "ietf-inet-types@2013-07-15" from sysrepo.
netopeer2-server[16542]: Module ietf-inet-types@2013-07-15 already present in context.
netopeer2-server[16542]: Loading schema "nc-notifications@2008-07-14" from sysrepo.
netopeer2-server[16542]: Reading module "nc-notifications".
netopeer2-server[16542]: Reading module "notifications".
netopeer2-server[16542]: Module "notifications" successfully parsed.
netopeer2-server[16542]: Module "nc-notifications" successfully parsed.
netopeer2-server[16542]: Loading schema "notifications@2008-07-14" from sysrepo.
netopeer2-server[16542]: Module notifications@2008-07-14 already present in context.
netopeer2-server[16542]: Reading module "ietf-netconf-monitoring".
netopeer2-server[16542]: Module "ietf-netconf-monitoring" successfully parsed.
netopeer2-server[16542]: Reading module "ietf-netconf-with-defaults".
netopeer2-server[16542]: Reading module "ietf-netconf".
netopeer2-server[16542]: Module "ietf-netconf" already in context.
netopeer2-server[16542]: Module "ietf-netconf" successfully parsed.
netopeer2-server[16542]: Module "ietf-netconf-with-defaults" successfully parsed.
netopeer2-server[16542]: Sysrepo does not have the "ietf-netconf-server" module or keystored keys dir unknown, using default NETCONF server options.
netopeer2-server[16542]: Listening on <IP_ADDRESS>:830 for SSH connections.

here the attachements
netopeer2-server.startup.txt
sysrepod.startup.txt

I guess this issue is a clone of #120

Hi Fabio,
it seems you are right.
Michal

Hi Michal
I have pulled your pull request patch. It works fine now.
thanks
ciao
fabio
On 11/04/2017 14:12, michalvasko wrote:

Hi Fabio,
it seems you are right.
Michal
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/CESNET/Netopeer2/issues/125#issuecomment-293240692,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFpJna2VvLwL_qscPGFEPGqOclUsbfiOks5ru24VgaJpZM4M5z1z.


[Bug]: Camera stream for only 30 sec

Adapter version
0.8.4
JS-Controller version
v5.3.1
Node version
V14.19
Operating System type
Docker
Operating system version
Ubuntu 20.04
Describe the bug
When toggling the "start_stream", the livestream correctly received the m3u8 url but it will only stream for 29 sec before stopping and the following is logged: Stopping the station stream for the device T8200N10204911EB, because we have reached the configured maximum stream timeout (30 seconds)
But Live stream setting for the adapter instance is set to 180 sec

To reproduce
As described in the bug
Screenshots & Logfiles
No response
Additional context
No response

Will be fixed in the next version


Add a logo for messageformat

A while back I asked a friend (Antti Tolppanen) to help with designing a logo for messageformat; after some review by @SlexAxton and myself, this is the result:

The original SVG is included in this PR.
We also have a version that includes the name:

Sorry I missed this while I was away. Looks great!


File is read-only for owner

On files with permissions 0444 WinSshFS mounts this file as ReadOnly+Archive. This files cannot be changed or deleted, but they shoud if owner match.
This is causing git/tortoisegit/gitk crash on repositories containg files with "wrong" permissions.

Relevant SO about git:
http://stackoverflow.com/questions/6867336/why-is-git-creating-read-only-444-files
Especially the bit about gc pruning:
"On Unix, the ability to remove a file is determined by the permissions on the file's directory, not the file itself"


Add dependent task instance log

Purpose of the pull request
The dependent task instance log is missing.
Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:

(or)
If your pull request contain incompatible change, you should also add it to docs/docs/en/guide/upgrede/incompatible.md

Codecov Report

Merging #11541 (01962bf) into dev (c322367) will increase coverage by 0.00%.
The diff coverage is 0.00%.

@@            Coverage Diff            @@
##                dev   #11541   +/-   ##
=========================================
  Coverage     39.66%   39.66%
+ Complexity     4695     4691    -4
=========================================
  Files           993      992    -1
  Lines         37692    37664   -28
  Branches       4198     4191    -7
=========================================
- Hits          14950    14941    -9
+ Misses        21173    21151   -22
- Partials       1569     1572    +3

Impacted Files
Coverage Δ

...ver/master/runner/task/DependentTaskProcessor.java
5.00% <0.00%> (-0.27%)
:arrow_down:

...lugin/task/api/parameters/DependentParameters.java
0.00% <ø> (ø)

...er/master/dispatch/host/assign/RandomSelector.java
77.77% <0.00%> (-5.56%)
:arrow_down:

...e/dolphinscheduler/remote/NettyRemotingClient.java
50.00% <0.00%> (-2.78%)
:arrow_down:

...dolphinscheduler/remote/future/ResponseFuture.java
81.96% <0.00%> (-1.64%)
:arrow_down:

...rver/master/runner/task/BlockingTaskProcessor.java
75.86% <0.00%> (-0.55%)
:arrow_down:

...eduler/api/service/impl/DataSourceServiceImpl.java
27.90% <0.00%> (ø)

...cheduler/server/master/utils/DependentExecute.java
0.00% <0.00%> (ø)

.../dolphinscheduler/plugin/task/datax/DataxTask.java
0.00% <0.00%> (ø)

...phinscheduler/plugin/task/chunjun/ChunJunTask.java
0.00% <0.00%> (ø)

... and 10 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

@SbloodyS Please take a look again.


Reinert

Issue Description:
The Python file responsible for job retrieval returns an empty list upon completion of the scraper execution. The expected behavior is to obtain a list containing job details.
File Name: reinert.py
Details:
The current behavior of the Python script that retrieves jobs results in an empty list upon completion of the scraping process. The anticipated outcome should be a populated list containing job details retrieved.

Additional Context:
Please review the Python file logic for job retrieval to ensure accurate list generation post-execution.
Expected Outcome:
Upon the execution of the Python script, it should return a list populated with job details. Note that the company has job openings available on their careers website.

The scraper is disabled as the jobs lead to 404 page currently


⚠ RPC server - Astar has degraded performance

In d84546a, RPC server - Astar ($ASTAR_RPC_URL) experienced degraded performance:

HTTP code: 429
Response time: 426 ms

Resolved: RPC server - Astar performance has improved in d0a5414 after 7 minutes.